2024-01-21T19:46:15.981 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-21T19:46:15.981 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --name yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/orig.config.yaml 2024-01-21T19:46:16.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T19:46:16.108 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070 branch: wip-yuri4-testing-2024-01-18-1257-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7525070' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri4-testing-2024-01-18-1257-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2024-01-18-1257-pacific sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9457 sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri4-testing-2024-01-18-1257-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0nymZtq0wl7N3BjCPsC+43K4l1FjsZVDSaWo3ez8LK9r8VQBsn/7VbQ7knGB48HJWr1/xWNRA683XBnh90QgE= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBwAB24ROxB5Vhyls7EaREMRAIMA8XAHx9kVobDKri2yLptvTTWljFmfXittcFFzD0ony72pOOLvWVMeGdXG8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-21_16:37:18 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-21T19:46:16.108 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa; will attempt to use it 2024-01-21T19:46:16.109 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa/tasks 2024-01-21T19:46:16.109 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-21T19:46:16.111 INFO:teuthology.task.internal:Checking packages... 2024-01-21T19:46:16.135 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec' 2024-01-21T19:46:16.135 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-21T19:46:16.135 INFO:teuthology.packaging:ref: None 2024-01-21T19:46:16.135 INFO:teuthology.packaging:tag: None 2024-01-21T19:46:16.135 INFO:teuthology.packaging:branch: wip-yuri4-testing-2024-01-18-1257-pacific 2024-01-21T19:46:16.135 INFO:teuthology.packaging:sha1: ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T19:46:16.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2024-01-18-1257-pacific 2024-01-21T19:46:16.281 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-454.gea310589 2024-01-21T19:46:16.282 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-21T19:46:16.288 INFO:teuthology.task.internal:no buildpackages task found 2024-01-21T19:46:16.289 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-21T19:46:16.311 INFO:teuthology.task.internal:Saving configuration 2024-01-21T19:46:16.327 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-21T19:46:16.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T19:46:16.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 19:40:52.476216', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0nymZtq0wl7N3BjCPsC+43K4l1FjsZVDSaWo3ez8LK9r8VQBsn/7VbQ7knGB48HJWr1/xWNRA683XBnh90QgE='} 2024-01-21T19:46:16.378 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 19:40:52.475093', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBwAB24ROxB5Vhyls7EaREMRAIMA8XAHx9kVobDKri2yLptvTTWljFmfXittcFFzD0ony72pOOLvWVMeGdXG8='} 2024-01-21T19:46:16.379 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-21T19:46:16.385 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-01-21T19:46:16.385 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-01-21T19:46:16.385 INFO:teuthology.run_tasks:Running task console_log... 2024-01-21T19:46:16.462 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f404f32d160>, signals=[15]) 2024-01-21T19:46:16.463 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-21T19:46:16.469 INFO:teuthology.task.internal:Opening connections... 2024-01-21T19:46:16.469 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:46:16.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T19:46:16.548 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:46:16.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T19:46:16.620 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-21T19:46:16.627 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-01-21T19:46:16.648 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-01-21T19:46:16.648 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6" 2024-01-21T19:46:16.709 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T19:46:16.710 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T19:46:16.711 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-01-21T19:46:16.737 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-01-21T19:46:16.757 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-01-21T19:46:16.758 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-01-21T19:46:16.816 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T19:46:16.817 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:16.818 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T19:46:16.818 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T19:46:16.818 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T19:46:16.818 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T19:46:16.818 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-01-21T19:46:16.837 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-21T19:46:16.846 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-21T19:46:16.855 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-21T19:46:16.855 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-01-21T19:46:16.857 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-01-21T19:46:16.875 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-21T19:46:16.882 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-21T19:46:16.882 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-01-21T19:46:16.916 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-01-21T19:46:16.953 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-21T19:46:17.001 INFO:teuthology.run_tasks:Running task kernel... 2024-01-21T19:46:17.015 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-01-21T19:46:17.015 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-01-21T19:46:17.015 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-01-21T19:46:17.015 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-21T19:46:17.016 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-21T19:46:17.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:46:17.033 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-01-21T19:46:17.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:46:17.034 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-01-21T19:46:17.091 INFO:teuthology.orchestra.run.smithi178.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:17.092 INFO:teuthology.task.kernel:Running kernel on smithi178: 4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:17.092 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2024-01-21T19:46:17.094 INFO:teuthology.orchestra.run.smithi133.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:17.094 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:17.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2024-01-21T19:46:18.567 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:18.567 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2024-01-21T19:46:18.710 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:18.710 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-01-21T19:46:18.858 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:18.858 INFO:teuthology.orchestra.run.smithi178.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:18.858 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:19.175 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:19.175 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:19.175 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:20.635 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-01-21T19:46:20.937 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2024-01-21T19:46:22.490 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-01-21T19:46:26.087 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 304 kB/s | 24 kB 00:00 2024-01-21T19:46:26.848 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-01-21T19:46:26.848 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-01-21T19:46:26.943 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-01-21T19:46:26.944 INFO:teuthology.orchestra.run.smithi133.stdout:Nothing to do. 2024-01-21T19:46:26.944 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-01-21T19:46:27.121 DEBUG:teuthology.orchestra.run.smithi133:> echo no | sudo yum reinstall kernel || true 2024-01-21T19:46:27.458 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:27.459 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-01-21T19:46:27.670 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:27.671 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:27.671 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:27.981 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:01 ago on Sun 21 Jan 2024 07:46:26 PM UTC. 2024-01-21T19:46:28.061 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-01-21T19:46:28.073 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-01-21T19:46:28.147 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2024-01-21T19:46:28.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum reinstall -y kernel || true 2024-01-21T19:46:28.528 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:28.528 INFO:teuthology.orchestra.run.smithi133.stdout:Unable to read consumer identity 2024-01-21T19:46:28.859 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:28.860 INFO:teuthology.orchestra.run.smithi133.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:28.860 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:46:29.166 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Jan 2024 07:46:26 PM UTC. 2024-01-21T19:46:29.227 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-01-21T19:46:29.228 INFO:teuthology.orchestra.run.smithi133.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-01-21T19:46:29.264 INFO:teuthology.orchestra.run.smithi133.stderr:Error: No packages marked for reinstall. 2024-01-21T19:46:29.311 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-01-21T19:46:29.464 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:29.464 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:29.464 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-01-21T19:46:29.464 DEBUG:teuthology.parallel:result is None 2024-01-21T19:46:37.444 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:16 2024-01-21T19:46:41.032 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 312 kB/s | 24 kB 00:00 2024-01-21T19:46:41.822 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-01-21T19:46:41.822 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-01-21T19:46:41.921 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-01-21T19:46:41.922 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2024-01-21T19:46:41.922 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-01-21T19:46:42.055 DEBUG:teuthology.orchestra.run.smithi178:> echo no | sudo yum reinstall kernel || true 2024-01-21T19:46:42.393 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:42.393 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2024-01-21T19:46:42.546 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:42.546 INFO:teuthology.orchestra.run.smithi178.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:42.546 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:42.865 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:02 ago on Sun 21 Jan 2024 07:46:40 PM UTC. 2024-01-21T19:46:42.937 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-01-21T19:46:42.938 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-01-21T19:46:42.983 INFO:teuthology.orchestra.run.smithi178.stderr:Error: No packages marked for reinstall. 2024-01-21T19:46:43.032 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum reinstall -y kernel || true 2024-01-21T19:46:43.369 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2024-01-21T19:46:43.369 INFO:teuthology.orchestra.run.smithi178.stdout:Unable to read consumer identity 2024-01-21T19:46:43.647 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:43.647 INFO:teuthology.orchestra.run.smithi178.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-21T19:46:43.647 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:46:43.952 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:03 ago on Sun 21 Jan 2024 07:46:40 PM UTC. 2024-01-21T19:46:44.019 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-01-21T19:46:44.019 INFO:teuthology.orchestra.run.smithi178.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-01-21T19:46:44.056 INFO:teuthology.orchestra.run.smithi178.stderr:Error: No packages marked for reinstall. 2024-01-21T19:46:44.103 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-01-21T19:46:44.265 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:44.265 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-01-21T19:46:44.265 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-01-21T19:46:44.265 DEBUG:teuthology.parallel:result is None 2024-01-21T19:46:44.265 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-21T19:46:44.273 INFO:teuthology.task.internal:Creating test directory... 2024-01-21T19:46:44.273 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-21T19:46:44.276 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-21T19:46:44.294 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-21T19:46:44.301 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-21T19:46:44.317 INFO:teuthology.task.internal:Creating archive directory... 2024-01-21T19:46:44.317 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-21T19:46:44.336 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-21T19:46:44.372 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-21T19:46:44.378 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-21T19:46:44.379 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-21T19:46:44.410 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-21T19:46:44.438 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T19:46:44.454 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T19:46:44.455 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T19:46:44.474 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-21T19:46:44.475 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-21T19:46:44.486 INFO:teuthology.task.internal:Configuring sudo... 2024-01-21T19:46:44.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-21T19:46:44.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-21T19:46:44.523 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-21T19:46:44.533 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-21T19:46:44.533 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-21T19:46:44.559 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-21T19:46:44.580 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T19:46:44.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T19:46:44.725 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T19:46:44.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T19:46:44.813 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:46:44.813 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-21T19:46:44.882 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T19:46:44.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-21T19:46:44.978 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T19:46:45.066 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-21T19:46:45.104 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:46:45.104 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-21T19:46:45.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-01-21T19:46:45.173 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-01-21T19:46:45.225 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-21T19:46:45.257 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-21T19:46:45.667 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-21T19:46:45.675 INFO:teuthology.task.internal:Starting timer... 2024-01-21T19:46:45.676 INFO:teuthology.run_tasks:Running task pcp... 2024-01-21T19:46:45.829 INFO:teuthology.run_tasks:Running task selinux... 2024-01-21T19:46:45.839 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-01-21T19:46:45.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-01-21T19:46:45.924 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-01-21T19:46:45.926 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-01-21T19:46:45.997 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-01-21T19:46:45.999 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-21T19:46:45.999 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-01-21T19:46:46.025 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-01-21T19:46:46.025 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-01-21T19:46:46.045 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-01-21T19:46:46.045 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2024-01-21T19:46:46.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-21T19:46:46.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:46:46.092 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-21T19:46:46.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:46:46.119 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-21T19:46:46.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-01-21T19:46:46.159 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-01-21T19:46:46.186 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-21T19:46:46.196 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-21T19:46:46.200 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-21T19:46:46.308 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-21T19:46:46.323 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-21T19:46:46.324 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-21T19:55:30.283 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-01-21T19:55:30.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-21T19:55:30.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T19:55:30.363 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-01-21T19:55:30.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-01-21T19:55:30.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-01-21T19:55:30.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T19:55:30.504 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-01-21T19:55:30.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-01-21T19:55:30.575 INFO:teuthology.run_tasks:Running task clock... 2024-01-21T19:55:30.584 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-21T19:55:30.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-21T19:55:30.584 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T19:55:30.587 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-21T19:55:30.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T19:55:30.617 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-21T19:55:30.633 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-21T19:55:30.647 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-21T19:55:30.662 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-21T19:55:30.706 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-01-21T19:55:30.718 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-01-21T19:55:30.733 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-21T19:55:30.742 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-01-21T19:55:30.747 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-21T19:55:30.754 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-01-21T19:55:30.768 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-21T19:55:30.783 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-21T19:55:30.815 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.819 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.862 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.865 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T19:55:30.866 INFO:teuthology.run_tasks:Running task install... 2024-01-21T19:55:30.875 DEBUG:teuthology.task.install:project ceph 2024-01-21T19:55:30.875 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'}} 2024-01-21T19:55:30.875 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'} 2024-01-21T19:55:30.875 INFO:teuthology.task.install:Using flavor: default 2024-01-21T19:55:30.881 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-21T19:55:30.881 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-21T19:55:30.881 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec', 'tag': None, 'wait_for_package': False} 2024-01-21T19:55:30.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T19:55:30.884 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec', 'tag': None, 'wait_for_package': False} 2024-01-21T19:55:30.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T19:55:31.031 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/ 2024-01-21T19:55:31.031 INFO:teuthology.task.install.rpm:Package version is 16.2.14-454.gea310589 2024-01-21T19:55:31.105 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/ 2024-01-21T19:55:31.105 INFO:teuthology.task.install.rpm:Package version is 16.2.14-454.gea310589 2024-01-21T19:55:31.150 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-21T19:55:31.150 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:55:31.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-21T19:55:31.178 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-01-21T19:55:31.178 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-21T19:55:31.215 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-01-18-1257-pacific/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-21T19:55:31.215 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:55:31.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-21T19:55:31.243 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-01-21T19:55:31.243 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-21T19:55:31.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-21T19:55:31.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-21T19:55:31.323 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-21T19:55:31.389 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-21T19:55:31.389 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-01-21T19:55:31.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-01-21T19:55:31.456 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-01-21T19:55:31.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-01-21T19:55:31.766 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-01-21T19:55:31.834 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2024-01-21T19:55:33.156 INFO:teuthology.orchestra.run.smithi178.stdout:57 files removed 2024-01-21T19:55:33.214 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-01-21T19:55:33.283 INFO:teuthology.orchestra.run.smithi133.stdout:57 files removed 2024-01-21T19:55:33.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-01-21T19:55:33.549 INFO:teuthology.orchestra.run.smithi178.stdout:Updating Subscription Management repositories. 2024-01-21T19:55:33.670 INFO:teuthology.orchestra.run.smithi133.stdout:Updating Subscription Management repositories. 2024-01-21T19:55:35.328 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 197 kB/s | 76 kB 00:00 2024-01-21T19:55:35.515 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 155 kB/s | 76 kB 00:00 2024-01-21T19:55:35.695 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 46 kB/s | 15 kB 00:00 2024-01-21T19:55:35.882 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 46 kB/s | 15 kB 00:00 2024-01-21T19:55:35.955 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 6.2 kB/s | 1.4 kB 00:00 2024-01-21T19:55:36.128 INFO:teuthology.orchestra.run.smithi133.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-01-21T19:55:36.199 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2024-01-21T19:55:36.358 INFO:teuthology.orchestra.run.smithi178.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-01-21T19:55:37.922 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 16 MB 00:01 2024-01-21T19:55:38.962 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2024-01-21T19:55:41.497 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 435 kB/s | 24 kB 00:00 2024-01-21T19:55:42.601 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 566 kB/s | 24 kB 00:00 2024-01-21T19:55:42.890 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 65 MB 00:01 2024-01-21T19:55:43.978 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 65 MB 00:01 2024-01-21T19:55:52.907 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 12 MB/s | 8.8 MB 00:00 2024-01-21T19:55:54.795 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 MB/s | 59 MB 00:01 2024-01-21T19:55:55.858 INFO:teuthology.orchestra.run.smithi133.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 59 MB 00:01 2024-01-21T19:56:05.328 INFO:teuthology.orchestra.run.smithi178.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-01-21T19:56:11.160 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-21T19:56:11.162 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-21T19:56:11.181 INFO:teuthology.orchestra.run.smithi133.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-01-21T19:56:11.182 INFO:teuthology.orchestra.run.smithi133.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-01-21T19:56:11.184 INFO:teuthology.orchestra.run.smithi133.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-01-21T19:56:11.185 INFO:teuthology.orchestra.run.smithi133.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-21T19:56:11.188 INFO:teuthology.orchestra.run.smithi133.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-21T19:56:11.192 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-21T19:56:11.194 INFO:teuthology.orchestra.run.smithi133.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-21T19:56:11.390 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-01-21T19:56:11.403 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:16.2.14-454.gea310589.el8 ceph 6.4 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:16.2.14-454.gea310589.el8 ceph 6.1 M 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:16.2.14-454.gea310589.el8 ceph 911 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-454.gea310589.el8 ceph 161 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:16.2.14-454.gea310589.el8 ceph 1.6 M 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 116 k 2024-01-21T19:56:11.404 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 3.1 M 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 8.6 M 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 27 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:16.2.14-454.gea310589.el8 ceph 12 M 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:16.2.14-454.gea310589.el8 ceph 52 M 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 85 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror x86_64 2:16.2.14-454.gea310589.el8 ceph 257 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 19 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:16.2.14-454.gea310589.el8 ceph 25 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:16.2.14-454.gea310589.el8 ceph 825 k 2024-01-21T19:56:11.405 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:16.2.14-454.gea310589.el8 ceph 131 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:16.2.14-454.gea310589.el8 ceph 215 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:16.2.14-454.gea310589.el8 ceph 389 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:16.2.14-454.gea310589.el8 ceph 369 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:16.2.14-454.gea310589.el8 ceph 114 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:16.2.14-454.gea310589.el8 ceph 88 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:16.2.14-454.gea310589.el8 ceph 3.7 M 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:16.2.14-454.gea310589.el8 ceph 175 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-01-21T19:56:11.406 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:16.2.14-454.gea310589.el8 ceph 3.7 M 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:16.2.14-454.gea310589.el8 ceph 4.2 M 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-01-21T19:56:11.407 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:16.2.14-454.gea310589.el8 ceph 24 M 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 24 k 2024-01-21T19:56:11.408 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:16.2.14-454.gea310589.el8 ceph 2.4 M 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 245 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:16.2.14-454.gea310589.el8 ceph 5.0 M 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:16.2.14-454.gea310589.el8 ceph 18 M 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 15 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:16.2.14-454.gea310589.el8 ceph 26 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:16.2.14-454.gea310589.el8 ceph 174 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-01-21T19:56:11.409 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:16.2.14-454.gea310589.el8 ceph 494 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:16.2.14-454.gea310589.el8 ceph 3.8 M 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-01-21T19:56:11.410 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:16.2.14-454.gea310589.el8 ceph 45 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:16.2.14-454.gea310589.el8 ceph 99 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-21T19:56:11.411 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-21T19:56:11.412 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-01-21T19:56:11.413 INFO:teuthology.orchestra.run.smithi133.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-21T19:56:11.414 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout:=========================================================================================================================== 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout:Install 124 Packages 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 16 Packages 2024-01-21T19:56:11.415 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:56:11.416 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 211 M 2024-01-21T19:56:11.416 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-01-21T19:56:11.607 INFO:teuthology.orchestra.run.smithi133.stdout:(1/140): ceph-16.2.14-454.gea310589.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-01-21T19:56:11.849 INFO:teuthology.orchestra.run.smithi133.stdout:(2/140): ceph-fuse-16.2.14-454.gea310589.el8.x8 3.7 MB/s | 911 kB 00:00 2024-01-21T19:56:11.916 INFO:teuthology.orchestra.run.smithi133.stdout:(3/140): ceph-immutable-object-cache-16.2.14-45 2.4 MB/s | 161 kB 00:00 2024-01-21T19:56:12.274 INFO:teuthology.orchestra.run.smithi133.stdout:(4/140): ceph-mds-16.2.14-454.gea310589.el8.x86 6.8 MB/s | 2.4 MB 00:00 2024-01-21T19:56:12.408 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-21T19:56:12.409 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-21T19:56:12.428 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-01-21T19:56:12.429 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-01-21T19:56:12.431 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-01-21T19:56:12.433 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-21T19:56:12.435 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-21T19:56:12.439 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-21T19:56:12.441 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-21T19:56:12.542 INFO:teuthology.orchestra.run.smithi133.stdout:(5/140): ceph-mgr-16.2.14-454.gea310589.el8.x86 6.1 MB/s | 1.6 MB 00:00 2024-01-21T19:56:12.649 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-01-21T19:56:12.662 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2024-01-21T19:56:12.662 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:16.2.14-454.gea310589.el8 ceph 6.4 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:16.2.14-454.gea310589.el8 ceph 6.1 M 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:16.2.14-454.gea310589.el8 ceph 911 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-454.gea310589.el8 ceph 161 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:16.2.14-454.gea310589.el8 ceph 1.6 M 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 116 k 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 3.1 M 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 8.6 M 2024-01-21T19:56:12.663 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 27 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:16.2.14-454.gea310589.el8 ceph 12 M 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:16.2.14-454.gea310589.el8 ceph 52 M 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 85 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:16.2.14-454.gea310589.el8 ceph 257 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 19 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:16.2.14-454.gea310589.el8 ceph 25 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:16.2.14-454.gea310589.el8 ceph 825 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:16.2.14-454.gea310589.el8 ceph 131 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-01-21T19:56:12.664 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:16.2.14-454.gea310589.el8 ceph 215 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:16.2.14-454.gea310589.el8 ceph 389 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:16.2.14-454.gea310589.el8 ceph 369 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:16.2.14-454.gea310589.el8 ceph 114 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:16.2.14-454.gea310589.el8 ceph 88 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:16.2.14-454.gea310589.el8 ceph 3.7 M 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:16.2.14-454.gea310589.el8 ceph 175 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-21T19:56:12.665 INFO:teuthology.orchestra.run.smithi178.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:16.2.14-454.gea310589.el8 ceph 3.7 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:16.2.14-454.gea310589.el8 ceph 4.2 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:16.2.14-454.gea310589.el8 ceph 24 M 2024-01-21T19:56:12.666 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 24 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:16.2.14-454.gea310589.el8 ceph 2.4 M 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 245 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:16.2.14-454.gea310589.el8 ceph 5.0 M 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:16.2.14-454.gea310589.el8 ceph 18 M 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:16.2.14-454.gea310589.el8 ceph-noarch 15 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:16.2.14-454.gea310589.el8 ceph 26 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-01-21T19:56:12.667 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:16.2.14-454.gea310589.el8 ceph 174 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:16.2.14-454.gea310589.el8 ceph 494 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:16.2.14-454.gea310589.el8 ceph 3.8 M 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-01-21T19:56:12.668 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:16.2.14-454.gea310589.el8 ceph 45 k 2024-01-21T19:56:12.669 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:16.2.14-454.gea310589.el8 ceph 99 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-21T19:56:12.670 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-01-21T19:56:12.671 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-21T19:56:12.672 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================================================== 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout:Install 124 Packages 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 16 Packages 2024-01-21T19:56:12.673 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:56:12.674 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 211 M 2024-01-21T19:56:12.674 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-01-21T19:56:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:(1/140): ceph-16.2.14-454.gea310589.el8.x86_64. 50 kB/s | 6.4 kB 00:00 2024-01-21T19:56:13.025 INFO:teuthology.orchestra.run.smithi133.stdout:(6/140): ceph-common-16.2.14-454.gea310589.el8. 16 MB/s | 24 MB 00:01 2024-01-21T19:56:13.225 INFO:teuthology.orchestra.run.smithi133.stdout:(7/140): ceph-mon-16.2.14-454.gea310589.el8.x86 7.4 MB/s | 5.0 MB 00:00 2024-01-21T19:56:13.420 INFO:teuthology.orchestra.run.smithi178.stdout:(2/140): ceph-fuse-16.2.14-454.gea310589.el8.x8 1.6 MB/s | 911 kB 00:00 2024-01-21T19:56:13.578 INFO:teuthology.orchestra.run.smithi178.stdout:(3/140): ceph-immutable-object-cache-16.2.14-45 1.0 MB/s | 161 kB 00:00 2024-01-21T19:56:14.851 INFO:teuthology.orchestra.run.smithi133.stdout:(8/140): ceph-radosgw-16.2.14-454.gea310589.el8 7.2 MB/s | 12 MB 00:01 2024-01-21T19:56:14.904 INFO:teuthology.orchestra.run.smithi178.stdout:(4/140): ceph-mds-16.2.14-454.gea310589.el8.x86 1.8 MB/s | 2.4 MB 00:01 2024-01-21T19:56:15.068 INFO:teuthology.orchestra.run.smithi133.stdout:(9/140): ceph-osd-16.2.14-454.gea310589.el8.x86 9.0 MB/s | 18 MB 00:02 2024-01-21T19:56:15.093 INFO:teuthology.orchestra.run.smithi133.stdout:(10/140): ceph-selinux-16.2.14-454.gea310589.el 106 kB/s | 26 kB 00:00 2024-01-21T19:56:15.095 INFO:teuthology.orchestra.run.smithi178.stdout:(5/140): ceph-base-16.2.14-454.gea310589.el8.x8 2.6 MB/s | 6.1 MB 00:02 2024-01-21T19:56:15.151 INFO:teuthology.orchestra.run.smithi133.stdout:(11/140): cephfs-mirror-16.2.14-454.gea310589.e 4.3 MB/s | 257 kB 00:00 2024-01-21T19:56:15.235 INFO:teuthology.orchestra.run.smithi133.stdout:(12/140): libcephfs-devel-16.2.14-454.gea310589 306 kB/s | 25 kB 00:00 2024-01-21T19:56:15.410 INFO:teuthology.orchestra.run.smithi133.stdout:(13/140): libcephfs2-16.2.14-454.gea310589.el8. 4.6 MB/s | 825 kB 00:00 2024-01-21T19:56:15.485 INFO:teuthology.orchestra.run.smithi133.stdout:(14/140): libcephsqlite-16.2.14-454.gea310589.e 2.3 MB/s | 174 kB 00:00 2024-01-21T19:56:15.487 INFO:teuthology.orchestra.run.smithi178.stdout:(6/140): ceph-mgr-16.2.14-454.gea310589.el8.x86 2.8 MB/s | 1.6 MB 00:00 2024-01-21T19:56:15.544 INFO:teuthology.orchestra.run.smithi133.stdout:(15/140): librados-devel-16.2.14-454.gea310589. 2.2 MB/s | 131 kB 00:00 2024-01-21T19:56:15.653 INFO:teuthology.orchestra.run.smithi133.stdout:(16/140): libradosstriper1-16.2.14-454.gea31058 4.5 MB/s | 494 kB 00:00 2024-01-21T19:56:16.204 INFO:teuthology.orchestra.run.smithi178.stdout:(7/140): ceph-mon-16.2.14-454.gea310589.el8.x86 4.5 MB/s | 5.0 MB 00:01 2024-01-21T19:56:16.212 INFO:teuthology.orchestra.run.smithi133.stdout:(17/140): librgw2-16.2.14-454.gea310589.el8.x86 6.8 MB/s | 3.8 MB 00:00 2024-01-21T19:56:16.270 INFO:teuthology.orchestra.run.smithi133.stdout:(18/140): python3-ceph-argparse-16.2.14-454.gea 783 kB/s | 45 kB 00:00 2024-01-21T19:56:16.328 INFO:teuthology.orchestra.run.smithi133.stdout:(19/140): python3-ceph-common-16.2.14-454.gea31 1.7 MB/s | 99 kB 00:00 2024-01-21T19:56:16.387 INFO:teuthology.orchestra.run.smithi133.stdout:(20/140): python3-cephfs-16.2.14-454.gea310589. 3.6 MB/s | 215 kB 00:00 2024-01-21T19:56:16.438 INFO:teuthology.orchestra.run.smithi178.stdout:(8/140): ceph-common-16.2.14-454.gea310589.el8. 6.5 MB/s | 24 MB 00:03 2024-01-21T19:56:16.462 INFO:teuthology.orchestra.run.smithi133.stdout:(21/140): python3-rados-16.2.14-454.gea310589.e 5.1 MB/s | 389 kB 00:00 2024-01-21T19:56:16.505 INFO:teuthology.orchestra.run.smithi178.stdout:(9/140): ceph-selinux-16.2.14-454.gea310589.el8 386 kB/s | 26 kB 00:00 2024-01-21T19:56:16.546 INFO:teuthology.orchestra.run.smithi133.stdout:(22/140): python3-rbd-16.2.14-454.gea310589.el8 4.3 MB/s | 369 kB 00:00 2024-01-21T19:56:16.663 INFO:teuthology.orchestra.run.smithi133.stdout:(23/140): ceph-base-16.2.14-454.gea310589.el8.x 1.2 MB/s | 6.1 MB 00:05 2024-01-21T19:56:16.688 INFO:teuthology.orchestra.run.smithi133.stdout:(24/140): python3-rgw-16.2.14-454.gea310589.el8 807 kB/s | 114 kB 00:00 2024-01-21T19:56:16.747 INFO:teuthology.orchestra.run.smithi133.stdout:(25/140): rbd-fuse-16.2.14-454.gea310589.el8.x8 1.0 MB/s | 88 kB 00:00 2024-01-21T19:56:16.947 INFO:teuthology.orchestra.run.smithi133.stdout:(26/140): rbd-nbd-16.2.14-454.gea310589.el8.x86 876 kB/s | 175 kB 00:00 2024-01-21T19:56:17.088 INFO:teuthology.orchestra.run.smithi133.stdout:(27/140): ceph-grafana-dashboards-16.2.14-454.g 174 kB/s | 24 kB 00:00 2024-01-21T19:56:17.197 INFO:teuthology.orchestra.run.smithi133.stdout:(28/140): rbd-mirror-16.2.14-454.gea310589.el8. 7.2 MB/s | 3.7 MB 00:00 2024-01-21T19:56:17.223 INFO:teuthology.orchestra.run.smithi133.stdout:(29/140): ceph-mgr-cephadm-16.2.14-454.gea31058 859 kB/s | 116 kB 00:00 2024-01-21T19:56:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:(30/140): ceph-mgr-dashboard-16.2.14-454.gea310 7.5 MB/s | 3.1 MB 00:00 2024-01-21T19:56:17.773 INFO:teuthology.orchestra.run.smithi133.stdout:(31/140): ceph-mgr-modules-core-16.2.14-454.gea 1.5 MB/s | 245 kB 00:00 2024-01-21T19:56:17.849 INFO:teuthology.orchestra.run.smithi133.stdout:(32/140): ceph-mgr-rook-16.2.14-454.gea310589.e 366 kB/s | 27 kB 00:00 2024-01-21T19:56:17.962 INFO:teuthology.orchestra.run.smithi133.stdout:(33/140): ceph-prometheus-alerts-16.2.14-454.ge 130 kB/s | 15 kB 00:00 2024-01-21T19:56:18.041 INFO:teuthology.orchestra.run.smithi133.stdout:(34/140): cephadm-16.2.14-454.gea310589.el8.noa 1.1 MB/s | 85 kB 00:00 2024-01-21T19:56:18.116 INFO:teuthology.orchestra.run.smithi133.stdout:(35/140): cephfs-top-16.2.14-454.gea310589.el8. 250 kB/s | 19 kB 00:00 2024-01-21T19:56:18.372 INFO:teuthology.orchestra.run.smithi178.stdout:(10/140): ceph-radosgw-16.2.14-454.gea310589.el 5.4 MB/s | 12 MB 00:02 2024-01-21T19:56:18.465 INFO:teuthology.orchestra.run.smithi178.stdout:(11/140): cephfs-mirror-16.2.14-454.gea310589.e 2.7 MB/s | 257 kB 00:00 2024-01-21T19:56:18.549 INFO:teuthology.orchestra.run.smithi178.stdout:(12/140): libcephfs-devel-16.2.14-454.gea310589 306 kB/s | 25 kB 00:00 2024-01-21T19:56:18.566 INFO:teuthology.orchestra.run.smithi133.stdout:(36/140): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2024-01-21T19:56:18.659 INFO:teuthology.orchestra.run.smithi133.stdout:(37/140): leveldb-1.22-1.el8.x86_64.rpm 1.9 MB/s | 181 kB 00:00 2024-01-21T19:56:18.733 INFO:teuthology.orchestra.run.smithi178.stdout:(13/140): libcephfs2-16.2.14-454.gea310589.el8. 4.4 MB/s | 825 kB 00:00 2024-01-21T19:56:18.759 INFO:teuthology.orchestra.run.smithi133.stdout:(38/140): liboath-2.6.2-3.el8.x86_64.rpm 588 kB/s | 59 kB 00:00 2024-01-21T19:56:18.858 INFO:teuthology.orchestra.run.smithi178.stdout:(14/140): libcephsqlite-16.2.14-454.gea310589.e 1.4 MB/s | 174 kB 00:00 2024-01-21T19:56:18.859 INFO:teuthology.orchestra.run.smithi133.stdout:(39/140): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2024-01-21T19:56:18.941 INFO:teuthology.orchestra.run.smithi178.stdout:(15/140): librados-devel-16.2.14-454.gea310589. 1.5 MB/s | 131 kB 00:00 2024-01-21T19:56:18.968 INFO:teuthology.orchestra.run.smithi133.stdout:(40/140): python3-apipkg-1.5-6.el8.noarch.rpm 196 kB/s | 21 kB 00:00 2024-01-21T19:56:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:(41/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 437 kB/s | 44 kB 00:00 2024-01-21T19:56:19.125 INFO:teuthology.orchestra.run.smithi178.stdout:(16/140): libradosstriper1-16.2.14-454.gea31058 2.6 MB/s | 494 kB 00:00 2024-01-21T19:56:19.185 INFO:teuthology.orchestra.run.smithi133.stdout:(42/140): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2024-01-21T19:56:19.277 INFO:teuthology.orchestra.run.smithi133.stdout:(43/140): python3-cachetools-3.1.1-4.el8.noarch 361 kB/s | 33 kB 00:00 2024-01-21T19:56:19.369 INFO:teuthology.orchestra.run.smithi133.stdout:(44/140): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2024-01-21T19:56:19.469 INFO:teuthology.orchestra.run.smithi133.stdout:(45/140): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2024-01-21T19:56:19.570 INFO:teuthology.orchestra.run.smithi133.stdout:(46/140): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2024-01-21T19:56:19.697 INFO:teuthology.orchestra.run.smithi133.stdout:(47/140): python3-execnet-1.7.1-1.el8.noarch.rp 2.7 MB/s | 355 kB 00:00 2024-01-21T19:56:19.784 INFO:teuthology.orchestra.run.smithi178.stdout:(17/140): librgw2-16.2.14-454.gea310589.el8.x86 5.8 MB/s | 3.8 MB 00:00 2024-01-21T19:56:19.795 INFO:teuthology.orchestra.run.smithi133.stdout:(48/140): python3-google-auth-1.1.1-10.el8.noar 832 kB/s | 81 kB 00:00 2024-01-21T19:56:19.851 INFO:teuthology.orchestra.run.smithi178.stdout:(18/140): python3-ceph-argparse-16.2.14-454.gea 675 kB/s | 45 kB 00:00 2024-01-21T19:56:19.895 INFO:teuthology.orchestra.run.smithi133.stdout:(49/140): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-01-21T19:56:19.972 INFO:teuthology.orchestra.run.smithi178.stdout:(19/140): python3-ceph-common-16.2.14-454.gea31 813 kB/s | 99 kB 00:00 2024-01-21T19:56:20.012 INFO:teuthology.orchestra.run.smithi133.stdout:(50/140): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2024-01-21T19:56:20.068 INFO:teuthology.orchestra.run.smithi178.stdout:(20/140): python3-cephfs-16.2.14-454.gea310589. 2.2 MB/s | 215 kB 00:00 2024-01-21T19:56:20.176 INFO:teuthology.orchestra.run.smithi178.stdout:(21/140): python3-rados-16.2.14-454.gea310589.e 3.5 MB/s | 389 kB 00:00 2024-01-21T19:56:20.277 INFO:teuthology.orchestra.run.smithi178.stdout:(22/140): python3-rbd-16.2.14-454.gea310589.el8 3.6 MB/s | 369 kB 00:00 2024-01-21T19:56:20.297 INFO:teuthology.orchestra.run.smithi133.stdout:(51/140): python3-kubernetes-11.0.0-6.el8.noarc 4.1 MB/s | 1.2 MB 00:00 2024-01-21T19:56:20.400 INFO:teuthology.orchestra.run.smithi178.stdout:(23/140): python3-rgw-16.2.14-454.gea310589.el8 931 kB/s | 114 kB 00:00 2024-01-21T19:56:20.477 INFO:teuthology.orchestra.run.smithi178.stdout:(24/140): rbd-fuse-16.2.14-454.gea310589.el8.x8 1.1 MB/s | 88 kB 00:00 2024-01-21T19:56:20.763 INFO:teuthology.orchestra.run.smithi133.stdout:(52/140): ceph-test-16.2.14-454.gea310589.el8.x 9.1 MB/s | 52 MB 00:05 2024-01-21T19:56:20.779 INFO:teuthology.orchestra.run.smithi133.stdout:(53/140): python3-logutils-0.3.5-11.el8.noarch. 101 kB/s | 49 kB 00:00 2024-01-21T19:56:20.945 INFO:teuthology.orchestra.run.smithi178.stdout:(25/140): ceph-osd-16.2.14-454.gea310589.el8.x8 3.4 MB/s | 18 MB 00:05 2024-01-21T19:56:20.955 INFO:teuthology.orchestra.run.smithi133.stdout:(54/140): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2024-01-21T19:56:21.011 INFO:teuthology.orchestra.run.smithi178.stdout:(26/140): rbd-mirror-16.2.14-454.gea310589.el8. 6.9 MB/s | 3.7 MB 00:00 2024-01-21T19:56:21.036 INFO:teuthology.orchestra.run.smithi178.stdout:(27/140): rbd-nbd-16.2.14-454.gea310589.el8.x86 1.9 MB/s | 175 kB 00:00 2024-01-21T19:56:21.047 INFO:teuthology.orchestra.run.smithi133.stdout:(55/140): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2024-01-21T19:56:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:(28/140): ceph-grafana-dashboards-16.2.14-454.g 416 kB/s | 24 kB 00:00 2024-01-21T19:56:21.072 INFO:teuthology.orchestra.run.smithi133.stdout:(56/140): python3-more-itertools-7.2.0-3.el8.no 190 kB/s | 59 kB 00:00 2024-01-21T19:56:21.095 INFO:teuthology.orchestra.run.smithi178.stdout:(29/140): ceph-mgr-cephadm-16.2.14-454.gea31058 1.9 MB/s | 116 kB 00:00 2024-01-21T19:56:21.131 INFO:teuthology.orchestra.run.smithi133.stdout:(57/140): python3-remoto-1.2.1-1.el8.noarch.rpm 585 kB/s | 49 kB 00:00 2024-01-21T19:56:21.165 INFO:teuthology.orchestra.run.smithi133.stdout:(58/140): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2024-01-21T19:56:21.231 INFO:teuthology.orchestra.run.smithi133.stdout:(59/140): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2024-01-21T19:56:21.297 INFO:teuthology.orchestra.run.smithi133.stdout:(60/140): python3-rsa-4.9-2.el8.noarch.rpm 486 kB/s | 64 kB 00:00 2024-01-21T19:56:21.324 INFO:teuthology.orchestra.run.smithi133.stdout:(61/140): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2024-01-21T19:56:21.399 INFO:teuthology.orchestra.run.smithi133.stdout:(62/140): python3-singledispatch-3.4.0.3-18.el8 235 kB/s | 24 kB 00:00 2024-01-21T19:56:21.424 INFO:teuthology.orchestra.run.smithi133.stdout:(63/140): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-01-21T19:56:21.471 INFO:teuthology.orchestra.run.smithi178.stdout:(30/140): ceph-mgr-dashboard-16.2.14-454.gea310 7.8 MB/s | 3.1 MB 00:00 2024-01-21T19:56:21.500 INFO:teuthology.orchestra.run.smithi133.stdout:(64/140): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2024-01-21T19:56:21.546 INFO:teuthology.orchestra.run.smithi178.stdout:(31/140): ceph-mgr-modules-core-16.2.14-454.gea 3.2 MB/s | 245 kB 00:00 2024-01-21T19:56:21.621 INFO:teuthology.orchestra.run.smithi178.stdout:(32/140): ceph-mgr-rook-16.2.14-454.gea310589.e 364 kB/s | 27 kB 00:00 2024-01-21T19:56:21.625 INFO:teuthology.orchestra.run.smithi133.stdout:(65/140): ceph-mgr-diskprediction-local-16.2.14 2.0 MB/s | 8.6 MB 00:04 2024-01-21T19:56:21.651 INFO:teuthology.orchestra.run.smithi133.stdout:(66/140): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2024-01-21T19:56:21.697 INFO:teuthology.orchestra.run.smithi178.stdout:(33/140): ceph-prometheus-alerts-16.2.14-454.ge 198 kB/s | 15 kB 00:00 2024-01-21T19:56:21.709 INFO:teuthology.orchestra.run.smithi133.stdout:(67/140): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2024-01-21T19:56:21.742 INFO:teuthology.orchestra.run.smithi133.stdout:(68/140): python3-webtest-2.0.33-1.el8.noarch.r 929 kB/s | 85 kB 00:00 2024-01-21T19:56:21.768 INFO:teuthology.orchestra.run.smithi133.stdout:(69/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-01-21T19:56:21.772 INFO:teuthology.orchestra.run.smithi178.stdout:(34/140): cephadm-16.2.14-454.gea310589.el8.noa 1.1 MB/s | 85 kB 00:00 2024-01-21T19:56:21.810 INFO:teuthology.orchestra.run.smithi133.stdout:(70/140): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2024-01-21T19:56:21.847 INFO:teuthology.orchestra.run.smithi178.stdout:(35/140): cephfs-top-16.2.14-454.gea310589.el8. 249 kB/s | 19 kB 00:00 2024-01-21T19:56:21.952 INFO:teuthology.orchestra.run.smithi133.stdout:(71/140): python3-websocket-client-0.56.0-5.el8 188 kB/s | 61 kB 00:00 2024-01-21T19:56:22.010 INFO:teuthology.orchestra.run.smithi133.stdout:(72/140): libverto-devel-0.3.0-5.el8.x86_64.rpm 74 kB/s | 18 kB 00:00 2024-01-21T19:56:22.036 INFO:teuthology.orchestra.run.smithi133.stdout:(73/140): python3-jwt-1.6.1-2.el8.noarch.rpm 194 kB/s | 43 kB 00:00 2024-01-21T19:56:22.198 INFO:teuthology.orchestra.run.smithi133.stdout:(74/140): python3-oauthlib-2.1.0-1.el8.noarch.r 630 kB/s | 155 kB 00:00 2024-01-21T19:56:22.244 INFO:teuthology.orchestra.run.smithi133.stdout:(75/140): python3-pycparser-2.14-14.el8.noarch. 467 kB/s | 109 kB 00:00 2024-01-21T19:56:22.270 INFO:teuthology.orchestra.run.smithi133.stdout:(76/140): python3-requests-oauthlib-1.0.0-1.el8 182 kB/s | 43 kB 00:00 2024-01-21T19:56:22.303 INFO:teuthology.orchestra.run.smithi133.stdout:(77/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 177 kB/s | 19 kB 00:00 2024-01-21T19:56:22.337 INFO:teuthology.orchestra.run.smithi133.stdout:(78/140): libzstd-devel-1.4.4-1.el8.x86_64.rpm 475 kB/s | 44 kB 00:00 2024-01-21T19:56:22.395 INFO:teuthology.orchestra.run.smithi133.stdout:(79/140): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2024-01-21T19:56:22.429 INFO:teuthology.orchestra.run.smithi133.stdout:(80/140): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-01-21T19:56:22.448 INFO:teuthology.orchestra.run.smithi178.stdout:(36/140): ceph-test-16.2.14-454.gea310589.el8.x 8.7 MB/s | 52 MB 00:05 2024-01-21T19:56:22.473 INFO:teuthology.orchestra.run.smithi178.stdout:(37/140): gperftools-libs-2.7-9.el8.x86_64.rpm 490 kB/s | 306 kB 00:00 2024-01-21T19:56:22.501 INFO:teuthology.orchestra.run.smithi133.stdout:(81/140): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2024-01-21T19:56:22.557 INFO:teuthology.orchestra.run.smithi178.stdout:(38/140): liboath-2.6.2-3.el8.x86_64.rpm 703 kB/s | 59 kB 00:00 2024-01-21T19:56:22.707 INFO:teuthology.orchestra.run.smithi178.stdout:(39/140): ceph-mgr-diskprediction-local-16.2.14 5.3 MB/s | 8.6 MB 00:01 2024-01-21T19:56:22.732 INFO:teuthology.orchestra.run.smithi178.stdout:(40/140): libunwind-1.3.1-3.el8.x86_64.rpm 428 kB/s | 75 kB 00:00 2024-01-21T19:56:22.738 INFO:teuthology.orchestra.run.smithi133.stdout:(82/140): libsepol-devel-2.9-3.el8.x86_64.rpm 367 kB/s | 87 kB 00:00 2024-01-21T19:56:22.758 INFO:teuthology.orchestra.run.smithi178.stdout:(41/140): leveldb-1.22-1.el8.x86_64.rpm 584 kB/s | 181 kB 00:00 2024-01-21T19:56:22.795 INFO:teuthology.orchestra.run.smithi133.stdout:(83/140): pcre2-utf32-10.32-2.el8.x86_64.rpm 481 kB/s | 220 kB 00:00 2024-01-21T19:56:22.808 INFO:teuthology.orchestra.run.smithi178.stdout:(42/140): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 580 kB/s | 44 kB 00:00 2024-01-21T19:56:22.850 INFO:teuthology.orchestra.run.smithi178.stdout:(43/140): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2024-01-21T19:56:22.867 INFO:teuthology.orchestra.run.smithi178.stdout:(44/140): python3-apipkg-1.5-6.el8.noarch.rpm 133 kB/s | 21 kB 00:00 2024-01-21T19:56:22.892 INFO:teuthology.orchestra.run.smithi178.stdout:(45/140): python3-cachetools-3.1.1-4.el8.noarch 394 kB/s | 33 kB 00:00 2024-01-21T19:56:22.905 INFO:teuthology.orchestra.run.smithi133.stdout:(84/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 101 kB/s | 48 kB 00:00 2024-01-21T19:56:22.942 INFO:teuthology.orchestra.run.smithi178.stdout:(46/140): python3-certifi-2018.10.15-7.el8.noar 176 kB/s | 16 kB 00:00 2024-01-21T19:56:23.018 INFO:teuthology.orchestra.run.smithi178.stdout:(47/140): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2024-01-21T19:56:23.043 INFO:teuthology.orchestra.run.smithi178.stdout:(48/140): python3-execnet-1.7.1-1.el8.noarch.rp 3.5 MB/s | 355 kB 00:00 2024-01-21T19:56:23.068 INFO:teuthology.orchestra.run.smithi178.stdout:(49/140): python3-cherrypy-18.4.0-1.el8.noarch. 2.1 MB/s | 384 kB 00:00 2024-01-21T19:56:23.094 INFO:teuthology.orchestra.run.smithi178.stdout:(50/140): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2024-01-21T19:56:23.111 INFO:teuthology.orchestra.run.smithi178.stdout:(51/140): python3-jaraco-6.2-6.el8.noarch.rpm 165 kB/s | 11 kB 00:00 2024-01-21T19:56:23.114 INFO:teuthology.orchestra.run.smithi133.stdout:(85/140): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 154 kB/s | 58 kB 00:00 2024-01-21T19:56:23.127 INFO:teuthology.orchestra.run.smithi178.stdout:(52/140): python3-jaraco-functools-2.0-4.el8.no 298 kB/s | 18 kB 00:00 2024-01-21T19:56:23.139 INFO:teuthology.orchestra.run.smithi133.stdout:(86/140): libcom_err-devel-1.45.6-4.el8.x86_64. 112 kB/s | 39 kB 00:00 2024-01-21T19:56:23.161 INFO:teuthology.orchestra.run.smithi178.stdout:(53/140): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2024-01-21T19:56:23.164 INFO:teuthology.orchestra.run.smithi133.stdout:(87/140): fuse-2.9.7-17.el8.x86_64.rpm 320 kB/s | 83 kB 00:00 2024-01-21T19:56:23.186 INFO:teuthology.orchestra.run.smithi178.stdout:(54/140): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2024-01-21T19:56:23.220 INFO:teuthology.orchestra.run.smithi178.stdout:(55/140): python3-kubernetes-11.0.0-6.el8.noarc 9.2 MB/s | 1.2 MB 00:00 2024-01-21T19:56:23.245 INFO:teuthology.orchestra.run.smithi178.stdout:(56/140): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-01-21T19:56:23.271 INFO:teuthology.orchestra.run.smithi178.stdout:(57/140): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-01-21T19:56:23.296 INFO:teuthology.orchestra.run.smithi178.stdout:(58/140): python3-remoto-1.2.1-1.el8.noarch.rpm 647 kB/s | 49 kB 00:00 2024-01-21T19:56:23.298 INFO:teuthology.orchestra.run.smithi133.stdout:(88/140): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-01-21T19:56:23.323 INFO:teuthology.orchestra.run.smithi133.stdout:(89/140): libuuid-devel-2.32.1-43.el8.x86_64.rp 629 kB/s | 100 kB 00:00 2024-01-21T19:56:23.355 INFO:teuthology.orchestra.run.smithi178.stdout:(59/140): python3-repoze-lru-0.7-6.el8.noarch.r 308 kB/s | 34 kB 00:00 2024-01-21T19:56:23.380 INFO:teuthology.orchestra.run.smithi178.stdout:(60/140): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2024-01-21T19:56:23.405 INFO:teuthology.orchestra.run.smithi178.stdout:(61/140): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2024-01-21T19:56:23.423 INFO:teuthology.orchestra.run.smithi133.stdout:(90/140): libgfortran-8.5.0-20.el8.x86_64.rpm 2.0 MB/s | 645 kB 00:00 2024-01-21T19:56:23.430 INFO:teuthology.orchestra.run.smithi178.stdout:(62/140): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2024-01-21T19:56:23.449 INFO:teuthology.orchestra.run.smithi133.stdout:(91/140): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-01-21T19:56:23.456 INFO:teuthology.orchestra.run.smithi178.stdout:(63/140): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2024-01-21T19:56:23.481 INFO:teuthology.orchestra.run.smithi178.stdout:(64/140): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2024-01-21T19:56:23.506 INFO:teuthology.orchestra.run.smithi178.stdout:(65/140): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2024-01-21T19:56:23.532 INFO:teuthology.orchestra.run.smithi178.stdout:(66/140): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2024-01-21T19:56:23.557 INFO:teuthology.orchestra.run.smithi178.stdout:(67/140): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2024-01-21T19:56:23.582 INFO:teuthology.orchestra.run.smithi178.stdout:(68/140): python3-websocket-client-0.56.0-5.el8 809 kB/s | 61 kB 00:00 2024-01-21T19:56:23.608 INFO:teuthology.orchestra.run.smithi178.stdout:(69/140): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-01-21T19:56:23.633 INFO:teuthology.orchestra.run.smithi178.stdout:(70/140): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2024-01-21T19:56:23.658 INFO:teuthology.orchestra.run.smithi178.stdout:(71/140): xmlstarlet-1.6.1-20.el8.x86_64.rpm 920 kB/s | 70 kB 00:00 2024-01-21T19:56:23.707 INFO:teuthology.orchestra.run.smithi133.stdout:(92/140): python3-cryptography-3.2.1-6.el8.x86_ 1.4 MB/s | 559 kB 00:00 2024-01-21T19:56:23.733 INFO:teuthology.orchestra.run.smithi133.stdout:(93/140): elfutils-libelf-devel-0.189-3.el8.x86 218 kB/s | 62 kB 00:00 2024-01-21T19:56:23.758 INFO:teuthology.orchestra.run.smithi133.stdout:(94/140): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 217 kB/s | 73 kB 00:00 2024-01-21T19:56:23.801 INFO:teuthology.orchestra.run.smithi178.stdout:(72/140): libverto-devel-0.3.0-5.el8.x86_64.rpm 93 kB/s | 18 kB 00:00 2024-01-21T19:56:23.826 INFO:teuthology.orchestra.run.smithi178.stdout:(73/140): python3-jwt-1.6.1-2.el8.noarch.rpm 221 kB/s | 43 kB 00:00 2024-01-21T19:56:23.851 INFO:teuthology.orchestra.run.smithi178.stdout:(74/140): python3-oauthlib-2.1.0-1.el8.noarch.r 830 kB/s | 155 kB 00:00 2024-01-21T19:56:23.925 INFO:teuthology.orchestra.run.smithi133.stdout:(95/140): librabbitmq-0.9.0-4.el8.x86_64.rpm 216 kB/s | 47 kB 00:00 2024-01-21T19:56:23.989 INFO:teuthology.orchestra.run.smithi133.stdout:(96/140): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.1 MB/s | 562 kB 00:00 2024-01-21T19:56:24.084 INFO:teuthology.orchestra.run.smithi133.stdout:(97/140): openssl-devel-1.1.1k-12.el8_9.x86_64. 7.1 MB/s | 2.3 MB 00:00 2024-01-21T19:56:24.109 INFO:teuthology.orchestra.run.smithi133.stdout:(98/140): python3-jsonpointer-1.10-11.el8.noarc 168 kB/s | 20 kB 00:00 2024-01-21T19:56:24.126 INFO:teuthology.orchestra.run.smithi178.stdout:(75/140): python3-requests-oauthlib-1.0.0-1.el8 142 kB/s | 43 kB 00:00 2024-01-21T19:56:24.134 INFO:teuthology.orchestra.run.smithi133.stdout:(99/140): NetworkManager-initscripts-updown-1.4 689 kB/s | 144 kB 00:00 2024-01-21T19:56:24.152 INFO:teuthology.orchestra.run.smithi178.stdout:(76/140): libaio-devel-0.3.112-1.el8.x86_64.rpm 62 kB/s | 19 kB 00:00 2024-01-21T19:56:24.210 INFO:teuthology.orchestra.run.smithi178.stdout:(77/140): python3-pycparser-2.14-14.el8.noarch. 266 kB/s | 109 kB 00:00 2024-01-21T19:56:24.243 INFO:teuthology.orchestra.run.smithi133.stdout:(100/140): python3-prettytable-0.7.2-14.el8.noa 277 kB/s | 44 kB 00:00 2024-01-21T19:56:24.244 INFO:teuthology.orchestra.run.smithi178.stdout:(78/140): libzstd-devel-1.4.4-1.el8.x86_64.rpm 375 kB/s | 44 kB 00:00 2024-01-21T19:56:24.286 INFO:teuthology.orchestra.run.smithi178.stdout:(79/140): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2024-01-21T19:56:24.345 INFO:teuthology.orchestra.run.smithi178.stdout:(80/140): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2024-01-21T19:56:24.460 INFO:teuthology.orchestra.run.smithi133.stdout:(101/140): python3-pyasn1-modules-0.3.7-6.el8.n 314 kB/s | 110 kB 00:00 2024-01-21T19:56:24.485 INFO:teuthology.orchestra.run.smithi133.stdout:(102/140): python3-jsonpatch-1.21-2.el8.noarch. 76 kB/s | 27 kB 00:00 2024-01-21T19:56:24.486 INFO:teuthology.orchestra.run.smithi178.stdout:(81/140): pcre2-utf32-10.32-2.el8.x86_64.rpm 910 kB/s | 220 kB 00:00 2024-01-21T19:56:24.511 INFO:teuthology.orchestra.run.smithi178.stdout:(82/140): libselinux-devel-2.9-5.el8.x86_64.rpm 886 kB/s | 200 kB 00:00 2024-01-21T19:56:24.537 INFO:teuthology.orchestra.run.smithi178.stdout:(83/140): keyutils-libs-devel-1.5.10-9.el8.x86_ 250 kB/s | 48 kB 00:00 2024-01-21T19:56:24.593 INFO:teuthology.orchestra.run.smithi133.stdout:(103/140): python3-pyasn1-0.3.7-6.el8.noarch.rp 361 kB/s | 126 kB 00:00 2024-01-21T19:56:24.602 INFO:teuthology.orchestra.run.smithi178.stdout:(84/140): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 640 kB/s | 58 kB 00:00 2024-01-21T19:56:24.627 INFO:teuthology.orchestra.run.smithi133.stdout:(104/140): python3-werkzeug-0.12.2-4.el8.noarch 2.7 MB/s | 457 kB 00:00 2024-01-21T19:56:24.629 INFO:teuthology.orchestra.run.smithi178.stdout:(85/140): libcom_err-devel-1.45.6-4.el8.x86_64. 419 kB/s | 39 kB 00:00 2024-01-21T19:56:24.655 INFO:teuthology.orchestra.run.smithi178.stdout:(86/140): libsepol-devel-2.9-3.el8.x86_64.rpm 519 kB/s | 87 kB 00:00 2024-01-21T19:56:24.669 INFO:teuthology.orchestra.run.smithi133.stdout:(105/140): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2024-01-21T19:56:24.788 INFO:teuthology.orchestra.run.smithi178.stdout:(87/140): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-01-21T19:56:24.830 INFO:teuthology.orchestra.run.smithi178.stdout:(88/140): libgfortran-8.5.0-20.el8.x86_64.rpm 3.1 MB/s | 645 kB 00:00 2024-01-21T19:56:24.880 INFO:teuthology.orchestra.run.smithi178.stdout:(89/140): fuse-2.9.7-17.el8.x86_64.rpm 299 kB/s | 83 kB 00:00 2024-01-21T19:56:24.894 INFO:teuthology.orchestra.run.smithi133.stdout:(106/140): libtool-2.4.6-25.el8.x86_64.rpm 2.6 MB/s | 709 kB 00:00 2024-01-21T19:56:24.919 INFO:teuthology.orchestra.run.smithi133.stdout:(107/140): flex-2.6.1-9.el8.x86_64.rpm 981 kB/s | 320 kB 00:00 2024-01-21T19:56:24.931 INFO:teuthology.orchestra.run.smithi178.stdout:(90/140): libuuid-devel-2.32.1-43.el8.x86_64.rp 701 kB/s | 100 kB 00:00 2024-01-21T19:56:24.945 INFO:teuthology.orchestra.run.smithi133.stdout:(108/140): python3-markupsafe-0.23-19.el8.x86_6 141 kB/s | 39 kB 00:00 2024-01-21T19:56:25.031 INFO:teuthology.orchestra.run.smithi178.stdout:(91/140): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 238 kB 00:00 2024-01-21T19:56:25.073 INFO:teuthology.orchestra.run.smithi178.stdout:(92/140): python3-cryptography-3.2.1-6.el8.x86_ 2.8 MB/s | 559 kB 00:00 2024-01-21T19:56:25.098 INFO:teuthology.orchestra.run.smithi178.stdout:(93/140): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 434 kB/s | 73 kB 00:00 2024-01-21T19:56:25.112 INFO:teuthology.orchestra.run.smithi133.stdout:(109/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2024-01-21T19:56:25.140 INFO:teuthology.orchestra.run.smithi178.stdout:(94/140): elfutils-libelf-devel-0.189-3.el8.x86 566 kB/s | 62 kB 00:00 2024-01-21T19:56:25.162 INFO:teuthology.orchestra.run.smithi133.stdout:(110/140): oniguruma-6.8.2-2.el8.x86_64.rpm 774 kB/s | 187 kB 00:00 2024-01-21T19:56:25.187 INFO:teuthology.orchestra.run.smithi133.stdout:(111/140): python3-pyOpenSSL-19.0.0-1.el8.noarc 427 kB/s | 103 kB 00:00 2024-01-21T19:56:25.207 INFO:teuthology.orchestra.run.smithi178.stdout:(95/140): librabbitmq-0.9.0-4.el8.x86_64.rpm 350 kB/s | 47 kB 00:00 2024-01-21T19:56:25.258 INFO:teuthology.orchestra.run.smithi178.stdout:(96/140): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-01-21T19:56:25.316 INFO:teuthology.orchestra.run.smithi178.stdout:(97/140): openssl-devel-1.1.1k-12.el8_9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-01-21T19:56:25.367 INFO:teuthology.orchestra.run.smithi178.stdout:(98/140): NetworkManager-initscripts-updown-1.4 907 kB/s | 144 kB 00:00 2024-01-21T19:56:25.371 INFO:teuthology.orchestra.run.smithi133.stdout:(112/140): python3-jinja2-2.10.1-3.el8.noarch.r 2.5 MB/s | 538 kB 00:00 2024-01-21T19:56:25.460 INFO:teuthology.orchestra.run.smithi178.stdout:(99/140): python3-prettytable-0.7.2-14.el8.noar 307 kB/s | 44 kB 00:00 2024-01-21T19:56:25.488 INFO:teuthology.orchestra.run.smithi133.stdout:(113/140): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2024-01-21T19:56:25.492 INFO:teuthology.orchestra.run.smithi178.stdout:(100/140): python3-jsonpointer-1.10-11.el8.noar 85 kB/s | 20 kB 00:00 2024-01-21T19:56:25.518 INFO:teuthology.orchestra.run.smithi178.stdout:(101/140): python3-pyasn1-modules-0.3.7-6.el8.n 730 kB/s | 110 kB 00:00 2024-01-21T19:56:25.580 INFO:teuthology.orchestra.run.smithi133.stdout:(114/140): python3-numpy-1.14.3-10.el8.x86_64.r 9.5 MB/s | 3.7 MB 00:00 2024-01-21T19:56:25.605 INFO:teuthology.orchestra.run.smithi133.stdout:(115/140): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2024-01-21T19:56:25.634 INFO:teuthology.orchestra.run.smithi178.stdout:(102/140): python3-jsonpatch-1.21-2.el8.noarch. 152 kB/s | 27 kB 00:00 2024-01-21T19:56:25.735 INFO:teuthology.orchestra.run.smithi178.stdout:(103/140): python3-pyasn1-0.3.7-6.el8.noarch.rp 522 kB/s | 126 kB 00:00 2024-01-21T19:56:25.827 INFO:teuthology.orchestra.run.smithi178.stdout:(104/140): python3-werkzeug-0.12.2-4.el8.noarch 1.4 MB/s | 457 kB 00:00 2024-01-21T19:56:25.838 INFO:teuthology.orchestra.run.smithi133.stdout:(116/140): librdkafka-0.11.4-3.el8.x86_64.rpm 1.3 MB/s | 354 kB 00:00 2024-01-21T19:56:25.852 INFO:teuthology.orchestra.run.smithi178.stdout:(105/140): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2024-01-21T19:56:25.864 INFO:teuthology.orchestra.run.smithi133.stdout:(117/140): python3-numpy-f2py-1.14.3-10.el8.x86 599 kB/s | 225 kB 00:00 2024-01-21T19:56:25.911 INFO:teuthology.orchestra.run.smithi178.stdout:(106/140): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2024-01-21T19:56:25.953 INFO:teuthology.orchestra.run.smithi178.stdout:(107/140): libtool-2.4.6-25.el8.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2024-01-21T19:56:25.978 INFO:teuthology.orchestra.run.smithi178.stdout:(108/140): python3-markupsafe-0.23-19.el8.x86_6 310 kB/s | 39 kB 00:00 2024-01-21T19:56:26.003 INFO:teuthology.orchestra.run.smithi178.stdout:(109/140): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.7 MB/s | 259 kB 00:00 2024-01-21T19:56:26.026 INFO:teuthology.orchestra.run.smithi133.stdout:(118/140): openblas-threads-0.3.15-6.el8.x86_64 12 MB/s | 5.2 MB 00:00 2024-01-21T19:56:26.028 INFO:teuthology.orchestra.run.smithi178.stdout:(110/140): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-01-21T19:56:26.114 INFO:teuthology.orchestra.run.smithi133.stdout:(119/140): python3-mako-1.0.6-14.el8.noarch.rpm 570 kB/s | 157 kB 00:00 2024-01-21T19:56:26.179 INFO:teuthology.orchestra.run.smithi178.stdout:(111/140): python3-jinja2-2.10.1-3.el8.noarch.r 3.5 MB/s | 538 kB 00:00 2024-01-21T19:56:26.246 INFO:teuthology.orchestra.run.smithi178.stdout:(112/140): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2024-01-21T19:56:26.263 INFO:teuthology.orchestra.run.smithi178.stdout:(113/140): python3-pyOpenSSL-19.0.0-1.el8.noarc 364 kB/s | 103 kB 00:00 2024-01-21T19:56:26.363 INFO:teuthology.orchestra.run.smithi178.stdout:(114/140): python3-numpy-1.14.3-10.el8.x86_64.r 20 MB/s | 3.7 MB 00:00 2024-01-21T19:56:26.397 INFO:teuthology.orchestra.run.smithi178.stdout:(115/140): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-01-21T19:56:26.398 INFO:teuthology.orchestra.run.smithi133.stdout:(120/140): openblas-0.3.15-6.el8.x86_64.rpm 9.5 MB/s | 5.0 MB 00:00 2024-01-21T19:56:26.422 INFO:teuthology.orchestra.run.smithi178.stdout:(116/140): python3-numpy-f2py-1.14.3-10.el8.x86 1.4 MB/s | 225 kB 00:00 2024-01-21T19:56:26.423 INFO:teuthology.orchestra.run.smithi133.stdout:(121/140): jq-1.6-7.el8.x86_64.rpm 656 kB/s | 202 kB 00:00 2024-01-21T19:56:26.457 INFO:teuthology.orchestra.run.smithi133.stdout:(122/140): automake-1.16.1-8.el8.noarch.rpm 1.6 MB/s | 714 kB 00:00 2024-01-21T19:56:26.489 INFO:teuthology.orchestra.run.smithi178.stdout:(117/140): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2024-01-21T19:56:26.531 INFO:teuthology.orchestra.run.smithi178.stdout:(118/140): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-01-21T19:56:26.541 INFO:teuthology.orchestra.run.smithi133.stdout:(123/140): python3-pytz-2017.2-11.el8.noarch.rp 381 kB/s | 54 kB 00:00 2024-01-21T19:56:26.631 INFO:teuthology.orchestra.run.smithi178.stdout:(119/140): openblas-threads-0.3.15-6.el8.x86_64 22 MB/s | 5.2 MB 00:00 2024-01-21T19:56:26.665 INFO:teuthology.orchestra.run.smithi178.stdout:(120/140): automake-1.16.1-8.el8.noarch.rpm 5.2 MB/s | 714 kB 00:00 2024-01-21T19:56:26.774 INFO:teuthology.orchestra.run.smithi178.stdout:(121/140): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-01-21T19:56:26.807 INFO:teuthology.orchestra.run.smithi178.stdout:(122/140): python3-pytz-2017.2-11.el8.noarch.rp 382 kB/s | 54 kB 00:00 2024-01-21T19:56:26.816 INFO:teuthology.orchestra.run.smithi133.stdout:(124/140): python3-scipy-1.0.0-21.module+el8.9. 35 MB/s | 14 MB 00:00 2024-01-21T19:56:26.874 INFO:teuthology.orchestra.run.smithi178.stdout:(123/140): openblas-0.3.15-6.el8.x86_64.rpm 13 MB/s | 5.0 MB 00:00 2024-01-21T19:56:26.991 INFO:teuthology.orchestra.run.smithi133.stdout:(125/140): elfutils-libelf-0.189-3.el8.x86_64.r 1.3 MB/s | 232 kB 00:00 2024-01-21T19:56:27.249 INFO:teuthology.orchestra.run.smithi178.stdout:(124/140): python3-scipy-1.0.0-21.module+el8.9. 29 MB/s | 14 MB 00:00 2024-01-21T19:56:27.308 INFO:teuthology.orchestra.run.smithi133.stdout:(126/140): elfutils-libs-0.189-3.el8.x86_64.rpm 956 kB/s | 303 kB 00:00 2024-01-21T19:56:27.400 INFO:teuthology.orchestra.run.smithi178.stdout:(125/140): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2024-01-21T19:56:27.550 INFO:teuthology.orchestra.run.smithi133.stdout:(127/140): librados2-16.2.14-454.gea310589.el8. 3.4 MB/s | 3.7 MB 00:01 2024-01-21T19:56:27.575 INFO:teuthology.orchestra.run.smithi133.stdout:(128/140): libmount-2.32.1-43.el8.x86_64.rpm 887 kB/s | 237 kB 00:00 2024-01-21T19:56:27.580 INFO:teuthology.orchestra.run.smithi178.stdout:(126/140): elfutils-libs-0.189-3.el8.x86_64.rpm 1.6 MB/s | 303 kB 00:00 2024-01-21T19:56:27.700 INFO:teuthology.orchestra.run.smithi178.stdout:(127/140): libmount-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 237 kB 00:00 2024-01-21T19:56:27.775 INFO:teuthology.orchestra.run.smithi133.stdout:(129/140): libsmartcols-2.32.1-43.el8.x86_64.rp 798 kB/s | 179 kB 00:00 2024-01-21T19:56:27.801 INFO:teuthology.orchestra.run.smithi133.stdout:(130/140): libuuid-2.32.1-43.el8.x86_64.rpm 439 kB/s | 99 kB 00:00 2024-01-21T19:56:27.867 INFO:teuthology.orchestra.run.smithi178.stdout:(128/140): libsmartcols-2.32.1-43.el8.x86_64.rp 1.1 MB/s | 179 kB 00:00 2024-01-21T19:56:28.076 INFO:teuthology.orchestra.run.smithi178.stdout:(129/140): librbd1-16.2.14-454.gea310589.el8.x8 3.5 MB/s | 4.2 MB 00:01 2024-01-21T19:56:28.076 INFO:teuthology.orchestra.run.smithi133.stdout:(131/140): util-linux-2.32.1-43.el8.x86_64.rpm 8.3 MB/s | 2.5 MB 00:00 2024-01-21T19:56:28.093 INFO:teuthology.orchestra.run.smithi133.stdout:(132/140): util-linux-user-2.32.1-43.el8.x86_64 352 kB/s | 103 kB 00:00 2024-01-21T19:56:28.101 INFO:teuthology.orchestra.run.smithi178.stdout:(130/140): libuuid-2.32.1-43.el8.x86_64.rpm 424 kB/s | 99 kB 00:00 2024-01-21T19:56:28.201 INFO:teuthology.orchestra.run.smithi178.stdout:(131/140): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2024-01-21T19:56:28.252 INFO:teuthology.orchestra.run.smithi178.stdout:(132/140): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2024-01-21T19:56:28.301 INFO:teuthology.orchestra.run.smithi133.stdout:(133/140): iproute-6.2.0-5.el8_9.x86_64.rpm 3.7 MB/s | 854 kB 00:00 2024-01-21T19:56:28.352 INFO:teuthology.orchestra.run.smithi178.stdout:(133/140): librados2-16.2.14-454.gea310589.el8. 2.4 MB/s | 3.7 MB 00:01 2024-01-21T19:56:28.353 INFO:teuthology.orchestra.run.smithi133.stdout:(134/140): libblkid-2.32.1-43.el8.x86_64.rpm 847 kB/s | 220 kB 00:00 2024-01-21T19:56:28.420 INFO:teuthology.orchestra.run.smithi178.stdout:(134/140): iproute-6.2.0-5.el8_9.x86_64.rpm 3.8 MB/s | 854 kB 00:00 2024-01-21T19:56:28.453 INFO:teuthology.orchestra.run.smithi178.stdout:(135/140): libblkid-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2024-01-21T19:56:28.657 INFO:teuthology.orchestra.run.smithi133.stdout:(135/140): libfdisk-2.32.1-43.el8.x86_64.rpm 716 kB/s | 254 kB 00:00 2024-01-21T19:56:28.745 INFO:teuthology.orchestra.run.smithi178.stdout:(136/140): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.3 MB/s | 1.1 MB 00:00 2024-01-21T19:56:28.770 INFO:teuthology.orchestra.run.smithi178.stdout:(137/140): libfdisk-2.32.1-43.el8.x86_64.rpm 608 kB/s | 254 kB 00:00 2024-01-21T19:56:28.794 INFO:teuthology.orchestra.run.smithi133.stdout:(136/140): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.4 MB/s | 1.1 MB 00:00 2024-01-21T19:56:28.803 INFO:teuthology.orchestra.run.smithi178.stdout:(138/140): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.0 MB/s | 711 kB 00:00 2024-01-21T19:56:28.853 INFO:teuthology.orchestra.run.smithi133.stdout:(137/140): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.5 MB/s | 711 kB 00:00 2024-01-21T19:56:28.954 INFO:teuthology.orchestra.run.smithi178.stdout:(139/140): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.1 MB/s | 1.5 MB 00:00 2024-01-21T19:56:28.969 INFO:teuthology.orchestra.run.smithi133.stdout:(138/140): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.4 MB/s | 1.5 MB 00:00 2024-01-21T19:56:29.011 INFO:teuthology.orchestra.run.smithi133.stdout:(139/140): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.1 MB/s | 333 kB 00:00 2024-01-21T19:56:29.020 INFO:teuthology.orchestra.run.smithi178.stdout:(140/140): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.3 MB/s | 333 kB 00:00 2024-01-21T19:56:29.024 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-01-21T19:56:29.024 INFO:teuthology.orchestra.run.smithi178.stdout:Total 13 MB/s | 211 MB 00:16 2024-01-21T19:56:29.970 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-01-21T19:56:30.062 INFO:teuthology.orchestra.run.smithi133.stdout:(140/140): librbd1-16.2.14-454.gea310589.el8.x8 1.2 MB/s | 4.2 MB 00:03 2024-01-21T19:56:30.065 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-01-21T19:56:30.065 INFO:teuthology.orchestra.run.smithi133.stdout:Total 11 MB/s | 211 MB 00:18 2024-01-21T19:56:30.363 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-01-21T19:56:30.363 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-01-21T19:56:30.989 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-01-21T19:56:31.379 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-01-21T19:56:31.379 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-01-21T19:56:31.542 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-01-21T19:56:31.553 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-01-21T19:56:32.554 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-01-21T19:56:32.564 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-01-21T19:56:37.301 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-01-21T19:56:37.437 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-01-21T19:56:37.664 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2024-01-21T19:56:37.733 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2024-01-21T19:56:37.923 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/156 2024-01-21T19:56:37.988 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/156 2024-01-21T19:56:38.148 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/156 2024-01-21T19:56:38.241 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/156 2024-01-21T19:56:38.407 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/156 2024-01-21T19:56:38.563 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-01-21T19:56:38.577 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/156 2024-01-21T19:56:38.698 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-01-21T19:56:38.779 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/156 2024-01-21T19:56:38.949 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2024-01-21T19:56:38.965 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/156 2024-01-21T19:56:39.026 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/156 2024-01-21T19:56:39.064 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/156 2024-01-21T19:56:39.160 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 2/156 2024-01-21T19:56:39.256 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/156 2024-01-21T19:56:39.312 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 2/156 2024-01-21T19:56:39.527 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 3/156 2024-01-21T19:56:39.598 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 3/156 2024-01-21T19:56:39.629 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/156 2024-01-21T19:56:39.823 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:56:39.827 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/156 2024-01-21T19:56:40.023 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : leveldb-1.22-1.el8.x86_64 5/156 2024-01-21T19:56:40.232 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:56:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/156 2024-01-21T19:56:40.444 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/156 2024-01-21T19:56:40.523 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:56:40.548 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/156 2024-01-21T19:56:40.633 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:56:40.769 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/156 2024-01-21T19:56:40.822 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:56:40.904 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:56:41.137 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/156 2024-01-21T19:56:41.360 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:16.2.14-454.gea310589.el8.x86_64 12/156 2024-01-21T19:56:41.361 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:56:41.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:56:41.664 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:56:41.755 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:56:41.881 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/156 2024-01-21T19:56:41.970 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/156 2024-01-21T19:56:41.985 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:56:42.114 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:56:42.201 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/156 2024-01-21T19:56:42.277 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:56:42.376 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:56:42.383 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/156 2024-01-21T19:56:42.553 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/156 2024-01-21T19:56:42.689 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 18/156 2024-01-21T19:56:42.791 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 18/156 2024-01-21T19:56:42.865 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:16.2.14-454.gea310589.el8.x86_64 12/156 2024-01-21T19:56:42.947 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:16.2.14-454.gea310589.el8.x86 19/156 2024-01-21T19:56:43.022 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:16.2.14-454.gea310589.el8.x86 19/156 2024-01-21T19:56:43.035 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:56:43.159 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/156 2024-01-21T19:56:43.219 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:56:43.389 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/156 2024-01-21T19:56:43.451 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/156 2024-01-21T19:56:43.542 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/156 2024-01-21T19:56:43.602 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/156 2024-01-21T19:56:43.772 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 23/156 2024-01-21T19:56:43.772 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/156 2024-01-21T19:56:43.907 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 23/156 2024-01-21T19:56:43.988 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/156 2024-01-21T19:56:44.080 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 24/156 2024-01-21T19:56:44.141 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/156 2024-01-21T19:56:44.310 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 18/156 2024-01-21T19:56:44.447 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 18/156 2024-01-21T19:56:44.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:16.2.14-454.gea310589.el8.x86 19/156 2024-01-21T19:56:44.661 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:16.2.14-454.gea310589.el8.x86 19/156 2024-01-21T19:56:44.708 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 24/156 2024-01-21T19:56:44.847 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/156 2024-01-21T19:56:44.889 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 25/156 2024-01-21T19:56:45.110 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/156 2024-01-21T19:56:45.340 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/156 2024-01-21T19:56:45.498 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 25/156 2024-01-21T19:56:45.509 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 23/156 2024-01-21T19:56:45.649 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 23/156 2024-01-21T19:56:45.843 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 24/156 2024-01-21T19:56:45.922 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.15-6.el8.x86_64 26/156 2024-01-21T19:56:46.494 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 24/156 2024-01-21T19:56:46.602 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 26/156 2024-01-21T19:56:46.668 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 25/156 2024-01-21T19:56:46.886 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/156 2024-01-21T19:56:47.077 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 28/156 2024-01-21T19:56:47.261 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 25/156 2024-01-21T19:56:47.341 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/156 2024-01-21T19:56:47.476 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.15-6.el8.x86_64 26/156 2024-01-21T19:56:47.485 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:16.2.14-454.gea310589.el8. 30/156 2024-01-21T19:56:47.651 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:16.2.14-454.gea310589.el 31/156 2024-01-21T19:56:47.932 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:16.2.14-454.gea310589.el8.x86_6 32/156 2024-01-21T19:56:48.146 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2024-01-21T19:56:48.157 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 26/156 2024-01-21T19:56:48.465 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 27/156 2024-01-21T19:56:48.690 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 28/156 2024-01-21T19:56:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 29/156 2024-01-21T19:56:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:16.2.14-454.gea310589.el8. 30/156 2024-01-21T19:56:49.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:16.2.14-454.gea310589.el 31/156 2024-01-21T19:56:49.638 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:16.2.14-454.gea310589.el8.x86_6 32/156 2024-01-21T19:56:49.867 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2024-01-21T19:56:49.892 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2024-01-21T19:56:50.248 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 34/156 2024-01-21T19:56:51.200 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/156 2024-01-21T19:56:51.551 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/156 2024-01-21T19:56:51.609 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/156 2024-01-21T19:56:51.762 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/156 2024-01-21T19:56:51.969 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 34/156 2024-01-21T19:56:52.014 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/156 2024-01-21T19:56:52.182 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/156 2024-01-21T19:56:52.438 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 40/156 2024-01-21T19:56:52.666 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 41/156 2024-01-21T19:56:52.826 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:16.2.14-454.gea310589.el8.x86_6 42/156 2024-01-21T19:56:52.971 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/156 2024-01-21T19:56:53.062 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/156 2024-01-21T19:56:53.143 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/156 2024-01-21T19:56:53.279 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/156 2024-01-21T19:56:53.345 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/156 2024-01-21T19:56:53.419 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/156 2024-01-21T19:56:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/156 2024-01-21T19:56:53.658 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/156 2024-01-21T19:56:53.727 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/156 2024-01-21T19:56:53.890 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/156 2024-01-21T19:56:53.927 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 39/156 2024-01-21T19:56:54.112 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/156 2024-01-21T19:56:54.201 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 40/156 2024-01-21T19:56:54.446 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 41/156 2024-01-21T19:56:54.539 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/156 2024-01-21T19:56:54.639 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:16.2.14-454.gea310589.el8.x86_6 42/156 2024-01-21T19:56:54.841 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/156 2024-01-21T19:56:54.904 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/156 2024-01-21T19:56:54.904 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/156 2024-01-21T19:56:54.999 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/156 2024-01-21T19:56:55.133 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/156 2024-01-21T19:56:55.205 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/156 2024-01-21T19:56:55.239 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.1-8.el8.noarch 49/156 2024-01-21T19:56:55.395 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 50/156 2024-01-21T19:56:55.472 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/156 2024-01-21T19:56:55.476 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 50/156 2024-01-21T19:56:55.703 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : jq-1.6-7.el8.x86_64 51/156 2024-01-21T19:56:55.758 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/156 2024-01-21T19:56:55.882 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 52/156 2024-01-21T19:56:55.983 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/156 2024-01-21T19:56:56.069 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/156 2024-01-21T19:56:56.237 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/156 2024-01-21T19:56:56.418 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/156 2024-01-21T19:56:56.482 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.7-17.el8.x86_64 55/156 2024-01-21T19:56:56.677 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 56/156 2024-01-21T19:56:56.774 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/156 2024-01-21T19:56:56.841 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/156 2024-01-21T19:56:56.867 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/156 2024-01-21T19:56:57.059 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/156 2024-01-21T19:56:57.118 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : automake-1.16.1-8.el8.noarch 49/156 2024-01-21T19:56:57.249 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 59/156 2024-01-21T19:56:57.308 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 50/156 2024-01-21T19:56:57.409 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 50/156 2024-01-21T19:56:57.580 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 60/156 2024-01-21T19:56:57.599 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jq-1.6-7.el8.x86_64 51/156 2024-01-21T19:56:57.823 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 52/156 2024-01-21T19:56:57.907 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/156 2024-01-21T19:56:57.998 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/156 2024-01-21T19:56:58.141 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/156 2024-01-21T19:56:58.168 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/156 2024-01-21T19:56:58.306 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 63/156 2024-01-21T19:56:58.387 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.7-17.el8.x86_64 55/156 2024-01-21T19:56:58.504 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/156 2024-01-21T19:56:58.631 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 56/156 2024-01-21T19:56:58.804 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/156 2024-01-21T19:56:58.883 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 65/156 2024-01-21T19:56:59.033 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/156 2024-01-21T19:56:59.187 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 66/156 2024-01-21T19:56:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 59/156 2024-01-21T19:56:59.364 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/156 2024-01-21T19:56:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 60/156 2024-01-21T19:56:59.621 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/156 2024-01-21T19:56:59.865 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/156 2024-01-21T19:56:59.898 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/156 2024-01-21T19:57:00.093 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/156 2024-01-21T19:57:00.154 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/156 2024-01-21T19:57:00.261 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/156 2024-01-21T19:57:00.311 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 63/156 2024-01-21T19:57:00.496 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/156 2024-01-21T19:57:00.569 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 64/156 2024-01-21T19:57:00.692 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 73/156 2024-01-21T19:57:00.974 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 65/156 2024-01-21T19:57:00.995 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 74/156 2024-01-21T19:57:01.135 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/156 2024-01-21T19:57:01.275 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 66/156 2024-01-21T19:57:01.349 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/156 2024-01-21T19:57:01.451 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 67/156 2024-01-21T19:57:01.617 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/156 2024-01-21T19:57:01.709 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/156 2024-01-21T19:57:01.817 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/156 2024-01-21T19:57:01.990 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/156 2024-01-21T19:57:01.994 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 69/156 2024-01-21T19:57:02.197 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/156 2024-01-21T19:57:02.223 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 70/156 2024-01-21T19:57:02.399 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/156 2024-01-21T19:57:02.412 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/156 2024-01-21T19:57:02.625 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 72/156 2024-01-21T19:57:02.655 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/156 2024-01-21T19:57:02.859 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 73/156 2024-01-21T19:57:02.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 83/156 2024-01-21T19:57:03.008 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 84/156 2024-01-21T19:57:03.092 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 74/156 2024-01-21T19:57:03.230 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 85/156 2024-01-21T19:57:03.249 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 75/156 2024-01-21T19:57:03.445 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 76/156 2024-01-21T19:57:03.480 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 86/156 2024-01-21T19:57:03.649 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/156 2024-01-21T19:57:03.720 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 77/156 2024-01-21T19:57:03.948 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/156 2024-01-21T19:57:03.963 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 78/156 2024-01-21T19:57:04.128 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 79/156 2024-01-21T19:57:04.184 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/156 2024-01-21T19:57:04.351 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 80/156 2024-01-21T19:57:04.387 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 90/156 2024-01-21T19:57:04.599 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 81/156 2024-01-21T19:57:04.643 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 91/156 2024-01-21T19:57:04.892 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 82/156 2024-01-21T19:57:05.117 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 83/156 2024-01-21T19:57:05.288 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 84/156 2024-01-21T19:57:05.552 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 85/156 2024-01-21T19:57:05.691 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 92/156 2024-01-21T19:57:05.793 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 86/156 2024-01-21T19:57:06.005 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 93/156 2024-01-21T19:57:06.020 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 87/156 2024-01-21T19:57:06.217 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 94/156 2024-01-21T19:57:06.269 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-2.6-1.el8.noarch 88/156 2024-01-21T19:57:06.455 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/156 2024-01-21T19:57:06.543 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/156 2024-01-21T19:57:06.689 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 90/156 2024-01-21T19:57:06.816 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/156 2024-01-21T19:57:06.964 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 91/156 2024-01-21T19:57:07.077 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 97/156 2024-01-21T19:57:07.383 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 98/156 2024-01-21T19:57:07.644 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 99/156 2024-01-21T19:57:07.851 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/156 2024-01-21T19:57:08.054 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 92/156 2024-01-21T19:57:08.102 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/156 2024-01-21T19:57:08.410 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 93/156 2024-01-21T19:57:08.697 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 94/156 2024-01-21T19:57:09.006 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/156 2024-01-21T19:57:09.286 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/156 2024-01-21T19:57:09.606 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 97/156 2024-01-21T19:57:09.945 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 98/156 2024-01-21T19:57:10.640 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 99/156 2024-01-21T19:57:10.857 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/156 2024-01-21T19:57:11.081 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/156 2024-01-21T19:57:11.781 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:12.013 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:12.688 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:12.983 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:16.2.14-454.gea310589.el8.x86_64 103/156 2024-01-21T19:57:13.097 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:16.2.14-454.gea310589.el8.x86_64 103/156 2024-01-21T19:57:13.275 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 104/156 2024-01-21T19:57:14.860 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:15.125 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:15.807 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 102/156 2024-01-21T19:57:16.409 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:16.2.14-454.gea310589.el8.x86_64 103/156 2024-01-21T19:57:16.498 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:16.2.14-454.gea310589.el8.x86_64 103/156 2024-01-21T19:57:16.654 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 104/156 2024-01-21T19:57:32.408 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 104/156 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /run 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /dev 2024-01-21T19:57:32.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:57:32.797 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 105/156 2024-01-21T19:57:33.223 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 105/156 2024-01-21T19:57:33.380 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 106/156 2024-01-21T19:57:34.864 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 106/156 2024-01-21T19:57:35.046 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 107/156 2024-01-21T19:57:35.068 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 107/156 2024-01-21T19:57:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 104/156 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /run 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /dev 2024-01-21T19:57:35.910 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:57:36.318 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 105/156 2024-01-21T19:57:36.745 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 105/156 2024-01-21T19:57:36.901 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:16.2.14-454.gea310589.el8.noarch 108/156 2024-01-21T19:57:36.918 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 106/156 2024-01-21T19:57:37.048 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:16.2.14-454.gea310589.el8.noarch 108/156 2024-01-21T19:57:37.202 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-454.gea310589.e 109/156 2024-01-21T19:57:37.421 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-454.gea310589. 110/156 2024-01-21T19:57:37.670 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 111/156 2024-01-21T19:57:38.407 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 106/156 2024-01-21T19:57:38.580 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 111/156 2024-01-21T19:57:38.642 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 107/156 2024-01-21T19:57:38.664 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 107/156 2024-01-21T19:57:38.845 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 112/156 2024-01-21T19:57:39.885 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 112/156 2024-01-21T19:57:40.037 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 113/156 2024-01-21T19:57:40.126 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 113/156 2024-01-21T19:57:40.404 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:16.2.14-454.gea310589.el8.noarch 108/156 2024-01-21T19:57:40.538 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-454.gea310589.el 114/156 2024-01-21T19:57:40.589 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:16.2.14-454.gea310589.el8.noarch 108/156 2024-01-21T19:57:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 115/156 2024-01-21T19:57:40.754 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 115/156 2024-01-21T19:57:40.756 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-454.gea310589.e 109/156 2024-01-21T19:57:40.895 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 116/156 2024-01-21T19:57:40.907 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 116/156 2024-01-21T19:57:40.976 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-454.gea310589. 110/156 2024-01-21T19:57:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 111/156 2024-01-21T19:57:41.966 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:16.2.14-454.gea310589.el8.x86_64 117/156 2024-01-21T19:57:42.123 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 111/156 2024-01-21T19:57:42.136 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 118/156 2024-01-21T19:57:42.230 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 118/156 2024-01-21T19:57:42.403 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-454.gea310 119/156 2024-01-21T19:57:42.421 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 112/156 2024-01-21T19:57:42.445 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-454.gea310 119/156 2024-01-21T19:57:42.611 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 120/156 2024-01-21T19:57:42.956 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 120/156 2024-01-21T19:57:43.103 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 121/156 2024-01-21T19:57:43.461 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 112/156 2024-01-21T19:57:43.658 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 113/156 2024-01-21T19:57:43.749 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 113/156 2024-01-21T19:57:44.140 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-454.gea310589.el 114/156 2024-01-21T19:57:44.305 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 115/156 2024-01-21T19:57:44.330 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 115/156 2024-01-21T19:57:44.524 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 116/156 2024-01-21T19:57:44.536 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 116/156 2024-01-21T19:57:45.605 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:16.2.14-454.gea310589.el8.x86_64 117/156 2024-01-21T19:57:45.787 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 118/156 2024-01-21T19:57:45.898 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 118/156 2024-01-21T19:57:46.049 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-454.gea310 119/156 2024-01-21T19:57:46.091 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-454.gea310 119/156 2024-01-21T19:57:46.258 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 120/156 2024-01-21T19:57:46.603 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 120/156 2024-01-21T19:57:46.808 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 121/156 2024-01-21T19:57:47.621 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 121/156 2024-01-21T19:57:48.582 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:16.2.14-454.gea310589.el8.x86_64 122/156 2024-01-21T19:57:48.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/156 2024-01-21T19:57:49.159 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/156 2024-01-21T19:57:49.420 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 125/156 2024-01-21T19:57:49.626 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/156 2024-01-21T19:57:49.639 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/156 2024-01-21T19:57:49.837 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 127/156 2024-01-21T19:57:50.038 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/156 2024-01-21T19:57:50.232 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_ 129/156 2024-01-21T19:57:50.588 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/156 2024-01-21T19:57:50.917 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 131/156 2024-01-21T19:57:51.122 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 132/156 2024-01-21T19:57:51.317 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:16.2.14-454.gea310589.el8.noarch 133/156 2024-01-21T19:57:51.334 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 121/156 2024-01-21T19:57:51.517 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 134/156 2024-01-21T19:57:51.809 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 135/156 2024-01-21T19:57:52.103 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 136/156 2024-01-21T19:57:52.276 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.1-9.el8.x86_64 137/156 2024-01-21T19:57:52.285 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:16.2.14-454.gea310589.el8.x86_64 122/156 2024-01-21T19:57:52.351 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 137/156 2024-01-21T19:57:52.592 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.0.4-10.el8.x86_64 138/156 2024-01-21T19:57:52.606 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 138/156 2024-01-21T19:57:52.626 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 123/156 2024-01-21T19:57:52.751 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 139/156 2024-01-21T19:57:52.759 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 139/156 2024-01-21T19:57:52.888 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 124/156 2024-01-21T19:57:52.920 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 140/156 2024-01-21T19:57:53.071 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 141/156 2024-01-21T19:57:53.100 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 125/156 2024-01-21T19:57:53.227 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 142/156 2024-01-21T19:57:53.323 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-2.4.6-25.el8.x86_64 126/156 2024-01-21T19:57:53.336 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 126/156 2024-01-21T19:57:53.395 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 143/156 2024-01-21T19:57:53.395 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 144/156 2024-01-21T19:57:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 127/156 2024-01-21T19:57:53.653 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 144/156 2024-01-21T19:57:53.654 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 145/156 2024-01-21T19:57:53.768 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 128/156 2024-01-21T19:57:53.887 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 145/156 2024-01-21T19:57:53.888 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/156 2024-01-21T19:57:53.962 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_ 129/156 2024-01-21T19:57:54.149 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/156 2024-01-21T19:57:54.322 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 130/156 2024-01-21T19:57:54.377 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 147/156 2024-01-21T19:57:54.553 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 148/156 2024-01-21T19:57:54.738 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 131/156 2024-01-21T19:57:54.794 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 149/156 2024-01-21T19:57:54.794 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 150/156 2024-01-21T19:57:55.019 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 132/156 2024-01-21T19:57:55.062 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 150/156 2024-01-21T19:57:55.062 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 151/156 2024-01-21T19:57:55.197 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephfs-top-2:16.2.14-454.gea310589.el8.noarch 133/156 2024-01-21T19:57:55.286 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 151/156 2024-01-21T19:57:55.286 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 152/156 2024-01-21T19:57:55.422 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 134/156 2024-01-21T19:57:55.511 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 152/156 2024-01-21T19:57:55.511 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 153/156 2024-01-21T19:57:55.719 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 135/156 2024-01-21T19:57:55.728 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 153/156 2024-01-21T19:57:55.728 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 154/156 2024-01-21T19:57:55.994 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 154/156 2024-01-21T19:57:56.001 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 136/156 2024-01-21T19:57:56.161 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 155/156 2024-01-21T19:57:56.161 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2024-01-21T19:57:56.231 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flex-2.6.1-9.el8.x86_64 137/156 2024-01-21T19:57:56.309 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 137/156 2024-01-21T19:57:56.546 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bison-3.0.4-10.el8.x86_64 138/156 2024-01-21T19:57:56.560 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 138/156 2024-01-21T19:57:56.755 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 139/156 2024-01-21T19:57:56.765 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 139/156 2024-01-21T19:57:56.924 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 140/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:16.2.14-454.gea310589.el8.x86_64 1/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:16.2.14-454.gea310589.el8.x86_64 2/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:16.2.14-454.gea310589.el8.x86_64 3/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 4/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-454.gea310 5/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 6/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 7/156 2024-01-21T19:57:57.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 8/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:16.2.14-454.gea310589.el8.x86_64 12/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_ 14/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 15/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 16/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:16.2.14-454.gea310589.el8.x86_6 17/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:16.2.14-454.gea310589.el8.x86 18/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:16.2.14-454.gea310589.el8.x86_64 19/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:16.2.14-454.gea310589.el 20/156 2024-01-21T19:57:57.052 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:16.2.14-454.gea310589.el8. 21/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:16.2.14-454.gea310589.el8.x86_6 22/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:16.2.14-454.gea310589.el8.x86_64 23/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 24/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 25/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 26/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 27/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 28/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-454.gea310589. 29/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 30/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 31/156 2024-01-21T19:57:57.053 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 32/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-454.gea310589.el 33/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 34/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-454.gea310589.e 35/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:16.2.14-454.gea310589.el8.noarch 36/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:16.2.14-454.gea310589.el8.noarch 37/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/156 2024-01-21T19:57:57.065 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/156 2024-01-21T19:57:57.066 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/156 2024-01-21T19:57:57.067 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/156 2024-01-21T19:57:57.068 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/156 2024-01-21T19:57:57.069 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 94/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 95/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 98/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/156 2024-01-21T19:57:57.070 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/156 2024-01-21T19:57:57.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : jq-1.6-7.el8.x86_64 122/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 123/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 124/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.14-454.gea310589.el8.x86_64 125/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 126/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.14-454.gea310589.el8.x86_64 127/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 128/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 129/156 2024-01-21T19:57:57.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 130/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 131/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 132/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 133/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 134/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 135/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 136/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 137/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 138/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 139/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 140/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 141/156 2024-01-21T19:57:57.073 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 142/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 143/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 144/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 145/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 146/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 147/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 148/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 149/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 150/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 151/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 152/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 153/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 154/156 2024-01-21T19:57:57.074 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 155/156 2024-01-21T19:57:57.106 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 141/156 2024-01-21T19:57:57.282 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 142/156 2024-01-21T19:57:57.459 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 143/156 2024-01-21T19:57:57.459 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 144/156 2024-01-21T19:57:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 144/156 2024-01-21T19:57:57.742 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 145/156 2024-01-21T19:57:57.984 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 145/156 2024-01-21T19:57:57.985 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/156 2024-01-21T19:57:58.270 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/156 2024-01-21T19:57:58.515 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 147/156 2024-01-21T19:57:58.682 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 148/156 2024-01-21T19:57:58.957 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 149/156 2024-01-21T19:57:58.957 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 150/156 2024-01-21T19:57:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 150/156 2024-01-21T19:57:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 151/156 2024-01-21T19:57:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 151/156 2024-01-21T19:57:59.516 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 152/156 2024-01-21T19:57:59.749 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 152/156 2024-01-21T19:57:59.750 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 153/156 2024-01-21T19:57:59.966 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 153/156 2024-01-21T19:57:59.966 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 154/156 2024-01-21T19:58:00.232 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 154/156 2024-01-21T19:58:00.433 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 155/156 2024-01-21T19:58:00.433 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 156/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:16.2.14-454.gea310589.el8.x86_64 1/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:16.2.14-454.gea310589.el8.x86_64 2/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:16.2.14-454.gea310589.el8.x86_64 3/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 4/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-454.gea310 5/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 6/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 7/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 8/156 2024-01-21T19:58:01.357 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 9/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 10/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 11/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:16.2.14-454.gea310589.el8.x86_64 12/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 13/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_ 14/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 15/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 16/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:16.2.14-454.gea310589.el8.x86_6 17/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:16.2.14-454.gea310589.el8.x86 18/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:16.2.14-454.gea310589.el8.x86_64 19/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:16.2.14-454.gea310589.el 20/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:16.2.14-454.gea310589.el8. 21/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:16.2.14-454.gea310589.el8.x86_6 22/156 2024-01-21T19:58:01.358 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:16.2.14-454.gea310589.el8.x86_64 23/156 2024-01-21T19:58:01.359 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 24/156 2024-01-21T19:58:01.359 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 25/156 2024-01-21T19:58:01.359 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 26/156 2024-01-21T19:58:01.359 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 27/156 2024-01-21T19:58:01.370 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 28/156 2024-01-21T19:58:01.370 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-454.gea310589. 29/156 2024-01-21T19:58:01.370 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noa 30/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.n 31/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-454.gea3 32/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-454.gea310589.el 33/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 34/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-454.gea310589.e 35/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:16.2.14-454.gea310589.el8.noarch 36/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephfs-top-2:16.2.14-454.gea310589.el8.noarch 37/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 38/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : leveldb-1.22-1.el8.x86_64 39/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 42/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/156 2024-01-21T19:58:01.371 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 49/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/156 2024-01-21T19:58:01.372 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 58/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/156 2024-01-21T19:58:01.373 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/156 2024-01-21T19:58:01.374 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 94/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 95/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 98/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/156 2024-01-21T19:58:01.375 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/156 2024-01-21T19:58:01.376 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jq-1.6-7.el8.x86_64 122/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 123/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 124/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.14-454.gea310589.el8.x86_64 125/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 126/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.14-454.gea310589.el8.x86_64 127/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 128/156 2024-01-21T19:58:01.377 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 129/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 130/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 131/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 132/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 133/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 134/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 135/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 136/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 137/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 138/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 139/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 140/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 141/156 2024-01-21T19:58:01.378 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 142/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 143/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 144/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 145/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 146/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 147/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 148/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 149/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 150/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 151/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 152/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 153/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 154/156 2024-01-21T19:58:01.379 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 155/156 2024-01-21T19:58:09.433 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 156/156 2024-01-21T19:58:09.433 INFO:teuthology.orchestra.run.smithi178.stdout:Installed products updated. 2024-01-21T19:58:10.015 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:10.015 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-01-21T19:58:10.015 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-01-21T19:58:10.015 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.016 INFO:teuthology.orchestra.run.smithi178.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-01-21T19:58:10.017 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.1-8.el8.noarch 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.0.4-10.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.018 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.1-9.el8.x86_64 2024-01-21T19:58:10.020 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: jq-1.6-7.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: leveldb-1.22-1.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.021 INFO:teuthology.orchestra.run.smithi178.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-01-21T19:58:10.022 INFO:teuthology.orchestra.run.smithi178.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.15-6.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-01-21T19:58:10.023 INFO:teuthology.orchestra.run.smithi178.stdout: python3-apipkg-1.5-6.el8.noarch 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-21T19:58:10.024 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-21T19:58:10.025 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-2.6-1.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-21T19:58:10.026 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-21T19:58:10.027 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-21T19:58:10.028 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-21T19:58:10.029 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-01-21T19:58:10.029 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:10.029 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-01-21T19:58:10.218 DEBUG:teuthology.parallel:result is None 2024-01-21T19:58:12.027 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 156/156 2024-01-21T19:58:12.027 INFO:teuthology.orchestra.run.smithi133.stdout:Installed products updated. 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.930 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: automake-1.16.1-8.el8.noarch 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: bison-3.0.4-10.el8.x86_64 2024-01-21T19:58:12.931 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.932 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-top-2:16.2.14-454.gea310589.el8.noarch 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: flex-2.6.1-9.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-21T19:58:12.933 INFO:teuthology.orchestra.run.smithi133.stdout: jq-1.6-7.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: leveldb-1.22-1.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.934 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.15-6.el8.x86_64 2024-01-21T19:58:12.935 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-apipkg-1.5-6.el8.noarch 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.936 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-21T19:58:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-2.6-1.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-21T19:58:12.938 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-21T19:58:12.939 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:16.2.14-454.gea310589.el8.x86_64 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-21T19:58:12.940 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-21T19:58:12.941 INFO:teuthology.orchestra.run.smithi133.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-01-21T19:58:12.941 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:12.941 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-01-21T19:58:13.130 DEBUG:teuthology.parallel:result is None 2024-01-21T19:58:13.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T19:58:13.357 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-21T19:58:13.381 INFO:teuthology.orchestra.run.smithi133.stdout:16.2.14-454.gea310589.el8 2024-01-21T19:58:13.381 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-454.gea310589.el8 2024-01-21T19:58:13.382 INFO:teuthology.task.install:The correct ceph version 16.2.14-454.gea310589 is installed. 2024-01-21T19:58:13.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec 2024-01-21T19:58:13.538 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-21T19:58:13.566 INFO:teuthology.orchestra.run.smithi178.stdout:16.2.14-454.gea310589.el8 2024-01-21T19:58:13.566 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-454.gea310589.el8 2024-01-21T19:58:13.567 INFO:teuthology.task.install:The correct ceph version 16.2.14-454.gea310589 is installed. 2024-01-21T19:58:13.568 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-21T19:58:13.569 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:13.569 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-21T19:58:13.611 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:13.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-21T19:58:13.659 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-21T19:58:13.659 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:13.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-01-21T19:58:13.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-21T19:58:13.752 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:13.752 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-01-21T19:58:13.784 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-21T19:58:13.886 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-21T19:58:13.886 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:13.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-21T19:58:13.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-21T19:58:13.978 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:13.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-21T19:58:14.010 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-21T19:58:14.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-21T19:58:14.080 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:14.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-01-21T19:58:14.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-21T19:58:14.174 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:14.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-01-21T19:58:14.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-21T19:58:14.274 INFO:teuthology.run_tasks:Running task ceph... 2024-01-21T19:58:14.347 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-21T19:58:14.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-01-21T19:58:14.349 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-01-21T19:58:14.378 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-21T19:58:14.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-21T19:58:14.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-21T19:58:14.446 INFO:tasks.ceph:Creating extra log directories... 2024-01-21T19:58:14.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-21T19:58:14.483 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-21T19:58:14.519 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-21T19:58:14.519 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-21T19:58:14.519 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-21T19:58:14.519 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:14.519 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-21T19:58:14.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:14.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:14.705 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:14.706 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-21T19:58:14.725 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:14.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:14.877 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-21T19:58:14.877 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-21T19:58:14.877 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070', 'branch': 'wip-yuri4-testing-2024-01-18-1257-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7525070', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2024-01-18-1257-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2024-01-18-1257-pacific', 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9457, 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2024-01-18-1257-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec', 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0nymZtq0wl7N3BjCPsC+43K4l1FjsZVDSaWo3ez8LK9r8VQBsn/7VbQ7knGB48HJWr1/xWNRA683XBnh90QgE=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBwAB24ROxB5Vhyls7EaREMRAIMA8XAHx9kVobDKri2yLptvTTWljFmfXittcFFzD0ony72pOOLvWVMeGdXG8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'ea310589757b987e8ba9e9ba96dfa9a6f9c1e8ec'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-21_16:37:18', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-21T19:58:14.877 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-21T19:58:14.880 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-21T19:58:14.927 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-01-21T19:58:14.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-01-21T19:58:14.994 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:14.994 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-01-21T19:58:15.018 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-21T19:58:15.018 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 173890 Links: 1 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-21 19:58:00.999795720 +0000 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-21 19:55:01.503204560 +0000 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-21 19:55:01.503204560 +0000 2024-01-21T19:58:15.075 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-21T19:58:15.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-21T19:58:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-21T19:58:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-21T19:58:15.140 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000248055 s, 2.1 MB/s 2024-01-21T19:58:15.141 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-21T19:58:15.200 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 178252 Links: 1 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-21 19:58:00.999795720 +0000 2024-01-21T19:58:15.257 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-21 19:55:01.850198028 +0000 2024-01-21T19:58:15.258 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-21 19:55:01.850198028 +0000 2024-01-21T19:58:15.258 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-21T19:58:15.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-21T19:58:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-21T19:58:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-21T19:58:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000306533 s, 1.7 MB/s 2024-01-21T19:58:15.324 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-21T19:58:15.382 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 178386 Links: 1 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-21 19:58:00.999795720 +0000 2024-01-21T19:58:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-21 19:55:02.201191420 +0000 2024-01-21T19:58:15.440 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-21 19:55:02.201191420 +0000 2024-01-21T19:58:15.440 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-21T19:58:15.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-21T19:58:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-21T19:58:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-21T19:58:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000165976 s, 3.1 MB/s 2024-01-21T19:58:15.506 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-21T19:58:15.564 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-01-21T19:58:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-21T19:58:15.621 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:15.621 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 178486 Links: 1 2024-01-21T19:58:15.621 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-01-21 19:58:00.999795720 +0000 2024-01-21T19:58:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-01-21 19:55:02.543184982 +0000 2024-01-21T19:58:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-01-21 19:55:02.543184982 +0000 2024-01-21T19:58:15.622 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2024-01-21T19:58:15.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-21T19:58:15.686 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-01-21T19:58:15.686 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-01-21T19:58:15.686 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000229325 s, 2.2 MB/s 2024-01-21T19:58:15.687 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-21T19:58:15.745 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:15.745 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:15.745 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-01-21T19:58:15.765 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-21T19:58:15.766 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-01-21T19:58:15.826 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-21T19:58:15.826 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 173540 Links: 1 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-01-21 19:57:56.708186126 +0000 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-01-21 19:55:01.489669855 +0000 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-01-21 19:55:01.489669855 +0000 2024-01-21T19:58:15.827 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-01-21T19:58:15.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-21T19:58:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-01-21T19:58:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-01-21T19:58:15.896 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00012589 s, 4.1 MB/s 2024-01-21T19:58:15.897 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-21T19:58:15.958 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 174931 Links: 1 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-01-21 19:57:56.708186126 +0000 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-01-21 19:55:01.820663703 +0000 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-01-21 19:55:01.820663703 +0000 2024-01-21T19:58:16.018 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-01-21T19:58:16.019 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-21T19:58:16.086 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-01-21T19:58:16.087 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-01-21T19:58:16.087 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00011938 s, 4.3 MB/s 2024-01-21T19:58:16.088 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-21T19:58:16.147 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-01-21T19:58:16.205 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 170978 Links: 1 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-01-21 19:57:56.708186126 +0000 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-01-21 19:55:02.145657676 +0000 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-01-21 19:55:02.145657676 +0000 2024-01-21T19:58:16.206 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-01-21T19:58:16.206 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-21T19:58:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-01-21T19:58:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-01-21T19:58:16.273 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.5936e-05 s, 6.0 MB/s 2024-01-21T19:58:16.274 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-21T19:58:16.333 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 176761 Links: 1 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-01-21 19:57:56.708186126 +0000 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-01-21 19:55:02.506650982 +0000 2024-01-21T19:58:16.391 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-01-21 19:55:02.506650982 +0000 2024-01-21T19:58:16.392 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-01-21T19:58:16.392 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-21T19:58:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-01-21T19:58:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-01-21T19:58:16.457 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.7839e-05 s, 5.8 MB/s 2024-01-21T19:58:16.458 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-21T19:58:16.516 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:16.516 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-21T19:58:16.516 INFO:tasks.ceph:Generating config... 2024-01-21T19:58:16.517 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-21T19:58:16.517 INFO:tasks.ceph:[client] debug client = 20 2024-01-21T19:58:16.518 INFO:tasks.ceph:[client] debug ms = 1 2024-01-21T19:58:16.518 INFO:tasks.ceph:[client] pid file = 2024-01-21T19:58:16.518 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-21T19:58:16.518 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-21T19:58:16.518 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-21T19:58:16.518 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mgr] debug client = 20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-21T19:58:16.519 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-21T19:58:16.520 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-21T19:58:16.520 INFO:tasks.ceph:Setting up mon.a... 2024-01-21T19:58:16.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-21T19:58:16.568 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2024-01-21T19:58:16.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-21T19:58:16.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-21T19:58:16.642 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2024-01-21T19:58:16.643 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-21T19:58:16.644 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:16.644 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-21T19:58:16.700 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:16.782 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:16.782 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 5608d7ec-e990-4e2d-988c-7c34378633be 2024-01-21T19:58:16.782 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2024-01-21T19:58:16.782 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 5608d7ec-e990-4e2d-988c-7c34378633be 2024-01-21T19:58:16.782 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2024-01-21T19:58:16.792199+0000 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:created 2024-01-21T19:58:16.792199+0000 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 0 (unknown) 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2024-01-21T19:58:16.783 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-21T19:58:16.784 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-21T19:58:16.841 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5608d7ec-e990-4e2d-988c-7c34378633be... 2024-01-21T19:58:16.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-21T19:58:16.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.927 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-21T19:58:16.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.929 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 5608d7ec-e990-4e2d-988c-7c34378633be 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-01-21T19:58:16.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-01-21T19:58:16.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-01-21T19:58:16.932 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-01-21T19:58:16.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug finisher = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-01-21T19:58:16.934 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:16.935 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = "" 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-01-21T19:58:16.936 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2024-01-21T19:58:16.937 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-01-21T19:58:16.938 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-01-21T19:58:16.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-01-21T19:58:16.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.133,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 5608d7ec-e990-4e2d-988c-7c34378633be 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-01-21T19:58:16.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.942 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2024-01-21T19:58:16.943 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-01-21T19:58:16.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug finisher = 20 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.945 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-21T19:58:16.946 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-01-21T19:58:16.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-01-21T19:58:16.948 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-01-21T19:58:16.949 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-21T19:58:16.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-21T19:58:17.042 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-21T19:58:17.042 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:17.042 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-21T19:58:17.059 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:17.059 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-21T19:58:17.116 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:58:17.116 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:17.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-21T19:58:17.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-21T19:58:17.194 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:17.194 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:17.251 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:58:17.251 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:17.251 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-21T19:58:17.251 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-21T19:58:17.290 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:17.290 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:17.347 INFO:tasks.ceph:Setting up mon nodes... 2024-01-21T19:58:17.347 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-21T19:58:17.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-21T19:58:17.397 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-21T19:58:17.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-21T19:58:17.457 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-21T19:58:17.459 INFO:tasks.ceph:Setting up mds nodes... 2024-01-21T19:58:17.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-21T19:58:17.509 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-21T19:58:17.511 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-21T19:58:17.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-21T19:58:17.628 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-21T19:58:17.630 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-21T19:58:17.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-21T19:58:17.707 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-21T19:58:17.710 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-21T19:58:17.736 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-21T19:58:17.824 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-21T19:58:17.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-21T19:58:17.853 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-21T19:58:17.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-21T19:58:17.896 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-21T19:58:17.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-01-21T19:58:17.988 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-01-21T19:58:18.001 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-21T19:58:18.040 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-21T19:58:18.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-01-21T19:58:18.132 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-01-21T19:58:18.144 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-21T19:58:18.144 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-21T19:58:18.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-21T19:58:18.171 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:18.171 INFO:tasks.ceph:role: osd.0 2024-01-21T19:58:18.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:58:18.172 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:18.246 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:18.247 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:18.247 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:18.682 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-21T19:58:18.685 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-21T19:58:18.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-21T19:58:18.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-21T19:58:18.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-21T19:58:18.937 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:18.937 INFO:tasks.ceph:role: osd.1 2024-01-21T19:58:18.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:58:18.937 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:19.013 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:19.436 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-21T19:58:19.438 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-21T19:58:19.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-21T19:58:19.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-21T19:58:19.587 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-21T19:58:19.656 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:19.656 INFO:tasks.ceph:role: osd.2 2024-01-21T19:58:19.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:58:19.656 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-21T19:58:19.732 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:19.732 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:19.732 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:19.732 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:19.732 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:19.733 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:19.733 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:19.733 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:19.733 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:19.733 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:20.181 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-21T19:58:20.183 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-21T19:58:20.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-21T19:58:20.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-21T19:58:20.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-21T19:58:20.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:20.460 INFO:tasks.ceph:role: osd.3 2024-01-21T19:58:20.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:58:20.461 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:20.537 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:20.538 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:20.979 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-01-21T19:58:20.981 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-01-21T19:58:20.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-21T19:58:21.161 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-21T19:58:21.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.297+0000 7fc47031e380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-21T19:58:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.298+0000 7fc47031e380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-21T19:58:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.298+0000 7fc47031e380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-21T19:58:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.298+0000 7fc47031e380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-21T19:58:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.298+0000 7fc47031e380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-21T19:58:21.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:21.298+0000 7fc47031e380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-21T19:58:24.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-21T19:58:24.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.272+0000 7fa8c107f380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.272+0000 7fa8c107f380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.272+0000 7fa8c107f380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.272+0000 7fa8c107f380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.272+0000 7fa8c107f380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-21T19:58:24.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:24.273+0000 7fa8c107f380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-21T19:58:27.113 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-21T19:58:27.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.241+0000 7f5769994380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.241+0000 7f5769994380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.241+0000 7f5769994380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.241+0000 7f5769994380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.241+0000 7f5769994380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-21T19:58:27.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:27.242+0000 7f5769994380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-21T19:58:30.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-21T19:58:30.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.208+0000 7f342d8b4380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-21T19:58:30.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.208+0000 7f342d8b4380 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-21T19:58:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.208+0000 7f342d8b4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-21T19:58:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.208+0000 7f342d8b4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-21T19:58:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.208+0000 7f342d8b4380 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-21T19:58:30.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:30.209+0000 7f342d8b4380 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-21T19:58:33.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-21T19:58:33.070 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-21T19:58:33.104 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:33.104 INFO:tasks.ceph:role: osd.4 2024-01-21T19:58:33.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:58:33.104 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:33.174 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:33.196 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-01-21T19:58:33.198 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-01-21T19:58:33.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-21T19:58:33.280 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-21T19:58:33.352 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-21T19:58:33.419 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:33.419 INFO:tasks.ceph:role: osd.5 2024-01-21T19:58:33.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:58:33.419 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-21T19:58:33.485 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:33.486 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:33.508 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-01-21T19:58:33.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-01-21T19:58:33.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-21T19:58:33.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-21T19:58:33.659 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-21T19:58:33.726 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:33.726 INFO:tasks.ceph:role: osd.6 2024-01-21T19:58:33.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:58:33.726 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-21T19:58:33.792 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:33.792 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:33.792 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:33.792 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:33.792 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:33.793 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:33.793 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:33.793 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:33.793 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:33.793 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:33.815 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-01-21T19:58:33.816 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-01-21T19:58:33.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-21T19:58:33.896 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-21T19:58:33.966 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-21T19:58:34.033 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-21T19:58:34.033 INFO:tasks.ceph:role: osd.7 2024-01-21T19:58:34.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:58:34.034 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-21T19:58:34.099 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-21T19:58:34.099 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-21T19:58:34.099 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-21T19:58:34.100 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-21T19:58:34.122 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-01-21T19:58:34.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-01-21T19:58:34.124 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-21T19:58:34.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-21T19:58:34.273 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:34.357 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.365+0000 7f3012e74380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-21T19:58:34.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.365+0000 7f3012e74380 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-21T19:58:34.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.365+0000 7f3012e74380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-21T19:58:34.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.365+0000 7f3012e74380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-21T19:58:34.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.365+0000 7f3012e74380 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-21T19:58:34.358 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:34.366+0000 7f3012e74380 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-21T19:58:37.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-21T19:58:37.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:37.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.362+0000 7f2127a06380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-21T19:58:37.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.363+0000 7f2127a06380 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-21T19:58:37.354 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.363+0000 7f2127a06380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-21T19:58:37.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.363+0000 7f2127a06380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-21T19:58:37.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.363+0000 7f2127a06380 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-21T19:58:37.355 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:37.363+0000 7f2127a06380 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-21T19:58:40.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-21T19:58:40.229 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:40.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.324+0000 7fc8aa789380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-21T19:58:40.316 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.325+0000 7fc8aa789380 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-21T19:58:40.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.325+0000 7fc8aa789380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-21T19:58:40.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.325+0000 7fc8aa789380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-21T19:58:40.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.325+0000 7fc8aa789380 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-21T19:58:40.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:40.325+0000 7fc8aa789380 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-21T19:58:43.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-21T19:58:43.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-21T19:58:43.276 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:43.284+0000 7f4288c06380 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-21T19:58:44.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:44.881 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:58:46.120 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-21T19:58:46.151 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-21T19:58:46.151 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-21T19:58:46.183 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-21T19:58:46.255 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-21T19:58:46.325 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-21T19:58:46.393 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-21T19:58:46.462 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-21T19:58:46.530 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:46.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-21T19:58:46.597 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-21T19:58:46.630 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-21T19:58:46.701 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.702 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-21T19:58:46.770 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-21T19:58:46.839 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-21T19:58:46.906 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-21T19:58:46.974 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:46.974 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-21T19:58:47.041 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:47.041 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-21T19:58:47.061 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:47.062 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-01-21T19:58:47.122 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:47.122 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-21T19:58:47.139 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:47.139 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-01-21T19:58:47.196 INFO:tasks.ceph:Adding keys to all mons... 2024-01-21T19:58:47.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-21T19:58:47.199 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA== 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw== 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A== 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q== 2024-01-21T19:58:47.239 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng== 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2024-01-21T19:58:47.240 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBzd61lNsYEERAATdt066AJrttp72fePBymoA== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[client.2] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng== 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout:[client.3] 2024-01-21T19:58:47.241 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA== 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA== 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw== 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A== 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-01-21T19:58:47.261 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng== 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2024-01-21T19:58:47.262 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBzd61lNsYEERAATdt066AJrttp72fePBymoA== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng== 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2024-01-21T19:58:47.263 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA== 2024-01-21T19:58:47.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-21T19:58:47.285 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-21T19:58:47.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.355 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.410 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-21T19:58:47.664 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-21T19:58:47.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.765 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.767 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-21T19:58:47.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.820 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.868 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.871 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.921 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.969 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:47.971 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-21T19:58:48.019 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.021 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.075 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.128 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.182 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-21T19:58:48.233 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-21T19:58:48.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-21T19:58:48.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-21T19:58:48.353 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-21T19:58:48.380 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-21T19:58:48.407 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-21T19:58:48.501 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-21T19:58:48.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-21T19:58:48.594 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-21T19:58:48.688 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-21T19:58:48.714 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:48.716 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-21T19:58:48.771 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-21T19:58:48.771 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-21T19:58:48.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-21T19:58:48.774 INFO:tasks.ceph.mon.a:Started 2024-01-21T19:58:48.774 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-21T19:58:48.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-21T19:58:48.813 INFO:tasks.ceph.mon.b:Started 2024-01-21T19:58:48.814 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-21T19:58:48.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-21T19:58:48.816 INFO:tasks.ceph.mon.c:Started 2024-01-21T19:58:48.816 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-21T19:58:48.816 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-21T19:58:48.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-21T19:58:48.818 INFO:tasks.ceph.mgr.y:Started 2024-01-21T19:58:48.818 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-21T19:58:48.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-21T19:58:48.820 INFO:tasks.ceph.mgr.x:Started 2024-01-21T19:58:48.820 INFO:tasks.ceph:Setting crush tunables to default 2024-01-21T19:58:48.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2024-01-21T19:58:48.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.945+0000 7f78b0627700 1 Processor -- start 2024-01-21T19:58:48.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.945+0000 7f78b0627700 1 -- start start 2024-01-21T19:58:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78b0627700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78b0627700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 0x7f78a8066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78b0627700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a8065660 con 0x7f78a80beb30 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78b0627700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80bef10 con 0x7f78a8069ef0 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78b0627700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a8156070 con 0x7f78a80c3fb0 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54320/0 (socket says 172.21.15.133:54320) 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 learned_addr learned my addr 172.21.15.133:0/3802687987 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78ae3c3700 1 --1- 172.21.15.133:0/3802687987 >> v1:172.21.15.133:6789/0 conn(0x7f78a80beb30 0x7f78a80697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57346/0 (socket says 172.21.15.133:57346) 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 msgr2=0x7f78a8155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 msgr2=0x7f78a8155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.946+0000 7f78aebc4700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 0x7f78a8066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.947+0000 7f78aebc4700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 msgr2=0x7f78a8066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-21T19:58:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.947+0000 7f78aebc4700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 msgr2=0x7f78a8066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-21T19:58:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.947+0000 7f78aebc4700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 0x7f78a8066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-01-21T19:58:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:48.947+0000 7f78aebc4700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 0x7f78a8066390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884198755 0 0) 0x7f78a8065660 con 0x7f78a80beb30 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78940033f0 con 0x7f78a80beb30 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 745694195 0 0) 0x7f78940033f0 con 0x7f78a80beb30 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 msgr2=0x7f78a8066390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.178:3300/0 conn(0x7f78a80c3fb0 0x7f78a8066390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 msgr2=0x7f78a8155b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 --2- 172.21.15.133:0/3802687987 >> v2:172.21.15.133:3300/0 conn(0x7f78a8069ef0 0x7f78a8155b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8065f00 con 0x7f78a80beb30 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f7898001470 con 0x7f78a80beb30 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.126+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 >> v1:172.21.15.133:6789/0 conn(0x7f78a80beb30 legacy=0x7f78a80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7894003910 0x7f7894003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f7894004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7894005050 0x7f789400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80bef10 con 0x7f7894004690 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8156070 con 0x7f7894005050 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789400bfb0 con 0x7f7894003910 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f7894004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78aebc4700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7894005050 0x7f789400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78ae3c3700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7894003910 0x7f7894003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7894003910 msgr2=0x7f7894003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7894003910 0x7f7894003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7894005050 msgr2=0x7f789400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7894005050 0x7f789400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 -- 172.21.15.133:0/3802687987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940033f0 con 0x7f7894004690 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78aebc4700 1 -- 172.21.15.133:0/3802687987 reap_dead start 2024-01-21T19:58:49.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.127+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f7894004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f78a80a76f0 tx=0x7f78a4008040).ready entity=mon.0 client_cookie=6a48592cbe8d41a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.130+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400b420 con 0x7f7894004690 2024-01-21T19:58:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.130+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400d5a0 con 0x7f7894004690 2024-01-21T19:58:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.130+0000 7f78ad3c1700 1 -- 172.21.15.133:0/3802687987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400d920 con 0x7f7894004690 2024-01-21T19:58:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.130+0000 7f78b0627700 1 -- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 msgr2=0x7f7894004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.130+0000 7f78b0627700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f7894004b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f78a80a76f0 tx=0x7f78a4008040).stop 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.131+0000 7f78b0627700 1 -- 172.21.15.133:0/3802687987 shutdown_connections 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.131+0000 7f78b0627700 1 --2- 172.21.15.133:0/3802687987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f7894004b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.131+0000 7f78b0627700 1 -- 172.21.15.133:0/3802687987 >> 172.21.15.133:0/3802687987 conn(0x7f78a80c8010 msgr2=0x7f78a80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.131+0000 7f78b0627700 1 -- 172.21.15.133:0/3802687987 shutdown_connections 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.131+0000 7f78b0627700 1 -- 172.21.15.133:0/3802687987 wait complete. 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.132+0000 7f78b0627700 1 Processor -- start 2024-01-21T19:58:49.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.132+0000 7f78b0627700 1 -- start start 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a80a6dd0 0x7f78a80bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a80bffb0 0x7f78a8137580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80c0430 con 0x7f7894004690 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80a5d30 con 0x7f78a80a6dd0 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78b0627700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80a6010 con 0x7f78a80bffb0 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54360/0 (socket says 172.21.15.133:54360) 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 -- 172.21.15.133:0/3343746849 learned_addr learned my addr 172.21.15.133:0/3343746849 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78adbc2700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a80a6dd0 0x7f78a80bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78aebc4700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a80bffb0 0x7f78a8137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 -- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a80bffb0 msgr2=0x7f78a8137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a80bffb0 0x7f78a8137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 -- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a80a6dd0 msgr2=0x7f78a80bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a80a6dd0 0x7f78a80bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 -- 172.21.15.133:0/3343746849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80a62f0 con 0x7f7894004690 2024-01-21T19:58:49.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.133+0000 7f78ae3c3700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f78980047e0 tx=0x7f7898001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011590 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980116f0 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a80a65d0 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7898011a70 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80a59d0 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f789801e6a0 con 0x7f7894004690 2024-01-21T19:58:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.135+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f789801d720 con 0x7f7894004690 2024-01-21T19:58:49.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.136+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80a6af0 con 0x7f7894004690 2024-01-21T19:58:49.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.140+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f78a80a6af0 con 0x7f7894004690 2024-01-21T19:58:49.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.214+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f78a805fdf0 con 0x7f7894004690 2024-01-21T19:58:49.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.217+0000 7f789effd700 1 -- 172.21.15.133:0/3343746849 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7898019070 con 0x7f7894004690 2024-01-21T19:58:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 msgr2=0x7f78a80a54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f78980047e0 tx=0x7f7898001e50).stop 2024-01-21T19:58:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 shutdown_connections 2024-01-21T19:58:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a80bffb0 0x7f78a8137580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7894004690 0x7f78a80a54e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 --2- 172.21.15.133:0/3343746849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a80a6dd0 0x7f78a80bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 >> 172.21.15.133:0/3343746849 conn(0x7f78a80c8010 msgr2=0x7f78a8155330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 shutdown_connections 2024-01-21T19:58:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:49.218+0000 7f78b0627700 1 -- 172.21.15.133:0/3343746849 wait complete. 2024-01-21T19:58:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2024-01-21T19:58:49.222 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-21T19:58:49.222 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:49.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-21T19:58:49.249 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:49.249 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-21T19:58:49.255 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:49.263+0000 7f4f4fa6e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T19:58:49.265 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:49.273+0000 7f1f57527680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T19:58:49.291 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:49.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-21T19:58:49.324 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:49.332+0000 7f4f4fa6e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T19:58:49.338 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:49.346+0000 7f1f57527680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T19:58:49.358 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-01-21T19:58:49.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-21T19:58:49.425 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:49.425 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-21T19:58:49.452 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:49.452 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-21T19:58:49.522 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:49.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-21T19:58:49.588 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-01-21T19:58:49.589 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-21T19:58:49.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 889e1b23-a30f-41de-a410-f9508c0b3007 0 2024-01-21T19:58:49.774 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:49.783+0000 7f4f4fa6e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T19:58:49.791 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:49.799+0000 7f1f57527680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T19:58:49.811 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.820+0000 7fc93b8d3700 1 Processor -- start 2024-01-21T19:58:49.812 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.820+0000 7fc93b8d3700 1 -- start start 2024-01-21T19:58:49.815 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93b8d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 0x7fc934153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93b8d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9340626f0 0x7fc934062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93b8d3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc934153750 con 0x7fc934155d30 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93b8d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9340671e0 con 0x7fc9340626f0 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93b8d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc934063060 con 0x7fc934066e00 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc93966f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 0x7fc934153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc939e70700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc934155d30 0x7fc9341561e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:42034/0 (socket says 172.21.15.178:42034) 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.821+0000 7fc939e70700 1 -- 172.21.15.178:0/1506715761 learned_addr learned my addr 172.21.15.178:0/1506715761 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc938e6e700 1 --2- 172.21.15.178:0/1506715761 >> v2:172.21.15.133:3300/0 conn(0x7fc9340626f0 0x7fc934062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc92bfff700 1 -- 172.21.15.178:0/1506715761 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177655046 0 0) 0x7fc934153750 con 0x7fc934155d30 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc92bfff700 1 -- 172.21.15.178:0/1506715761 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9200033f0 con 0x7fc934155d30 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc93966f700 1 -- 172.21.15.178:0/1506715761 >> v2:172.21.15.133:3300/0 conn(0x7fc9340626f0 msgr2=0x7fc934062b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc93966f700 1 --2- 172.21.15.178:0/1506715761 >> v2:172.21.15.133:3300/0 conn(0x7fc9340626f0 0x7fc934062b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.816 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc93966f700 1 -- 172.21.15.178:0/1506715761 >> v1:172.21.15.178:6789/0 conn(0x7fc934155d30 legacy=0x7fc9341561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc93966f700 1 -- 172.21.15.178:0/1506715761 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340662e0 con 0x7fc934066e00 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc93966f700 1 --2- 172.21.15.178:0/1506715761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 0x7fc934153260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc930009760 tx=0x7fc930009060).ready entity=mon.2 client_cookie=bd0d860591809ed9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc92bfff700 1 -- 172.21.15.178:0/1506715761 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9300090d0 con 0x7fc934066e00 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc92bfff700 1 -- 172.21.15.178:0/1506715761 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93000d4a0 con 0x7fc934066e00 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.822+0000 7fc92bfff700 1 -- 172.21.15.178:0/1506715761 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000d820 con 0x7fc934066e00 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 -- 172.21.15.178:0/1506715761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 msgr2=0x7fc934153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/1506715761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 0x7fc934153260 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc930009760 tx=0x7fc930009060).stop 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 -- 172.21.15.178:0/1506715761 shutdown_connections 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/1506715761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc934066e00 0x7fc934153260 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/1506715761 >> v2:172.21.15.133:3300/0 conn(0x7fc9340626f0 0x7fc934062b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 -- 172.21.15.178:0/1506715761 >> 172.21.15.178:0/1506715761 conn(0x7fc9340c7dc0 msgr2=0x7fc9340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 -- 172.21.15.178:0/1506715761 shutdown_connections 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.823+0000 7fc93b8d3700 1 -- 172.21.15.178:0/1506715761 wait complete. 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.824+0000 7fc93b8d3700 1 Processor -- start 2024-01-21T19:58:49.817 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.824+0000 7fc93b8d3700 1 -- start start 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 0x7fc934164620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc934155d30 0x7fc9340c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934165610 con 0x7fc934155d30 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9340a58e0 con 0x7fc934066e00 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc934165050 con 0x7fc9340626f0 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc938e6e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 0x7fc934164620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc938e6e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 0x7fc934164620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46660/0 (socket says 172.21.15.178:46660) 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:35476/0 (socket says 172.21.15.178:35476) 2024-01-21T19:58:49.820 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc938e6e700 1 -- 172.21.15.178:0/3153075451 learned_addr learned my addr 172.21.15.178:0/3153075451 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc939e70700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc934155d30 0x7fc9340c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 -- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 msgr2=0x7fc934164620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 0x7fc934164620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 -- 172.21.15.178:0/3153075451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc934155d30 msgr2=0x7fc9340c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc934155d30 0x7fc9340c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 -- 172.21.15.178:0/3153075451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300092a0 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93966f700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc934060070 tx=0x7fc930016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930006990 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9300127f0 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc934165330 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.825+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930012b70 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.826+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93414e790 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.826+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc9300266c0 con 0x7fc9340626f0 2024-01-21T19:58:49.821 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.826+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fc93001c790 con 0x7fc9340626f0 2024-01-21T19:58:49.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.827+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340a5740 con 0x7fc9340626f0 2024-01-21T19:58:49.822 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.829+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc9340a5740 con 0x7fc9340626f0 2024-01-21T19:58:49.899 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.908+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "889e1b23-a30f-41de-a410-f9508c0b3007", "id": 0} v 0) v1 -- 0x7fc934069990 con 0x7fc9340626f0 2024-01-21T19:58:49.902 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.911+0000 7fc929ffb700 1 -- 172.21.15.178:0/3153075451 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "889e1b23-a30f-41de-a410-f9508c0b3007", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc930016070 con 0x7fc9340626f0 2024-01-21T19:58:49.903 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 msgr2=0x7fc93414e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc934060070 tx=0x7fc930016000).stop 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 shutdown_connections 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc934155d30 0x7fc9340c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9340626f0 0x7fc93414e2a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 --2- 172.21.15.178:0/3153075451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc934066e00 0x7fc934164620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 >> 172.21.15.178:0/3153075451 conn(0x7fc9340c7dc0 msgr2=0x7fc9340a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:49.904 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 shutdown_connections 2024-01-21T19:58:49.905 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:49.912+0000 7fc93b8d3700 1 -- 172.21.15.178:0/3153075451 wait complete. 2024-01-21T19:58:49.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 7b1647fa-e508-4a8e-ae0e-6c43c687eba4 1 2024-01-21T19:58:50.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.040+0000 7f086ffff700 1 Processor -- start 2024-01-21T19:58:50.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.040+0000 7f086ffff700 1 -- start start 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0870152840 0x7f0870152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0870066860 con 0x7f0870069a60 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086ffff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08700c5e80 con 0x7f087013a790 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086ffff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0870152c60 con 0x7f0870152840 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0870152840 0x7f0870152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0870152840 0x7f0870152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46662/0 (socket says 172.21.15.178:46662) 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 -- 172.21.15.178:0/2473338907 learned_addr learned my addr 172.21.15.178:0/2473338907 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086effd700 1 --1- 172.21.15.178:0/2473338907 >> v1:172.21.15.178:6789/0 conn(0x7f087013a790 0x7f0870069350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:42038/0 (socket says 172.21.15.178:42038) 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 -- 172.21.15.178:0/2473338907 >> v1:172.21.15.178:6789/0 conn(0x7f087013a790 legacy=0x7f0870069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.034 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 -- 172.21.15.178:0/2473338907 >> v1:172.21.15.133:6789/0 conn(0x7f0870069a60 legacy=0x7f0870066d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 -- 172.21.15.178:0/2473338907 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08700c6160 con 0x7f0870152840 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086f7fe700 1 --2- 172.21.15.178:0/2473338907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f0870152020 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0868009f20 tx=0x7f0868009840).ready entity=mon.1 client_cookie=f3f841360f2547ff server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.041+0000 7f086dffb700 1 -- 172.21.15.178:0/2473338907 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800e070 con 0x7f0870152840 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086dffb700 1 -- 172.21.15.178:0/2473338907 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086800ba40 con 0x7f0870152840 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086dffb700 1 -- 172.21.15.178:0/2473338907 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800bdc0 con 0x7f0870152840 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 -- 172.21.15.178:0/2473338907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 msgr2=0x7f0870152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 --2- 172.21.15.178:0/2473338907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f0870152020 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0868009f20 tx=0x7f0868009840).stop 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 -- 172.21.15.178:0/2473338907 shutdown_connections 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 --2- 172.21.15.178:0/2473338907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f0870152020 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 -- 172.21.15.178:0/2473338907 >> 172.21.15.178:0/2473338907 conn(0x7f08700c7bd0 msgr2=0x7f08700c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 -- 172.21.15.178:0/2473338907 shutdown_connections 2024-01-21T19:58:50.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.042+0000 7f086ffff700 1 -- 172.21.15.178:0/2473338907 wait complete. 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.043+0000 7f086ffff700 1 Processor -- start 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.043+0000 7f086ffff700 1 -- start start 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 0x7f0870150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0870137b90 con 0x7f087013a790 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0870168440 con 0x7f0870152840 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0870167830 con 0x7f0870069a60 2024-01-21T19:58:50.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 0x7f0870150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46670/0 (socket says 172.21.15.178:46670) 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 0x7f0870150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:35480/0 (socket says 172.21.15.178:35480) 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086f7fe700 1 -- 172.21.15.178:0/3075216066 learned_addr learned my addr 172.21.15.178:0/3075216066 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.044+0000 7f086e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.178:52010/0 (socket says 172.21.15.178:52010) 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 -- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 msgr2=0x7f0870150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 0x7f0870150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 -- 172.21.15.178:0/3075216066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 msgr2=0x7f08701371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 -- 172.21.15.178:0/3075216066 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868009ae0 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086e7fc700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086f7fe700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f087006aaf0 tx=0x7f0868009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086800bdc0 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086801d460 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086801d800 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0870167b10 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08701680d0 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f0868003040 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.045+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f0868027750 con 0x7f0870152840 2024-01-21T19:58:50.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.046+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08701685b0 con 0x7f0870152840 2024-01-21T19:58:50.041 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.048+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f0868022070 con 0x7f0870152840 2024-01-21T19:58:50.120 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.129+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7b1647fa-e508-4a8e-ae0e-6c43c687eba4", "id": 1} v 0) v1 -- 0x7f087006c7b0 con 0x7f0870152840 2024-01-21T19:58:50.124 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.132+0000 7f08577fe700 1 -- 172.21.15.178:0/3075216066 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b1647fa-e508-4a8e-ae0e-6c43c687eba4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0868018040 con 0x7f0870152840 2024-01-21T19:58:50.124 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 msgr2=0x7f08701376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f087006aaf0 tx=0x7f0868009840).stop 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 shutdown_connections 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0870152840 0x7f08701376a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0870069a60 0x7f0870150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 --2- 172.21.15.178:0/3075216066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f087013a790 0x7f08701371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 >> 172.21.15.178:0/3075216066 conn(0x7f08700c7bd0 msgr2=0x7f0870136900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 shutdown_connections 2024-01-21T19:58:50.125 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.133+0000 7f086ffff700 1 -- 172.21.15.178:0/3075216066 wait complete. 2024-01-21T19:58:50.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new dd9d1bc0-7f9f-434f-8398-d5727e17f902 2 2024-01-21T19:58:50.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.261+0000 7f5b06061700 1 Processor -- start 2024-01-21T19:58:50.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.261+0000 7f5b06061700 1 -- start start 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5b06061700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b001546b0 0x7f5b00154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5b06061700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000654f0 con 0x7f5b000a9e30 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5b06061700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b00063700 con 0x7f5b000bc6d0 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5b06061700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b00063950 con 0x7f5b001546b0 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b001546b0 0x7f5b00154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b001546b0 0x7f5b00154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46674/0 (socket says 172.21.15.178:46674) 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 -- 172.21.15.178:0/3713906665 learned_addr learned my addr 172.21.15.178:0/3713906665 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 -- 172.21.15.178:0/3713906665 >> v1:172.21.15.178:6789/0 conn(0x7f5b000bc6d0 legacy=0x7f5b00066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 -- 172.21.15.178:0/3713906665 >> v1:172.21.15.133:6789/0 conn(0x7f5b000a9e30 legacy=0x7f5b00065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 -- 172.21.15.178:0/3713906665 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b00065180 con 0x7f5b001546b0 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.262+0000 7f5aff7fe700 1 --2- 172.21.15.178:0/3713906665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b00154a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5af0006fd0 tx=0x7f5af00090f0).ready entity=mon.1 client_cookie=6b5d482744e486a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5afe7fc700 1 -- 172.21.15.178:0/3713906665 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000b600 con 0x7f5b001546b0 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5afe7fc700 1 -- 172.21.15.178:0/3713906665 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000b760 con 0x7f5b001546b0 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5afe7fc700 1 -- 172.21.15.178:0/3713906665 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000bb00 con 0x7f5b001546b0 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 -- 172.21.15.178:0/3713906665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 msgr2=0x7f5b00154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 --2- 172.21.15.178:0/3713906665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b00154a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f5af0006fd0 tx=0x7f5af00090f0).stop 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 -- 172.21.15.178:0/3713906665 shutdown_connections 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 --2- 172.21.15.178:0/3713906665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b00154a90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 -- 172.21.15.178:0/3713906665 >> 172.21.15.178:0/3713906665 conn(0x7f5b000c8200 msgr2=0x7f5b000c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 -- 172.21.15.178:0/3713906665 shutdown_connections 2024-01-21T19:58:50.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.263+0000 7f5b06061700 1 -- 172.21.15.178:0/3713906665 wait complete. 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.265+0000 7f5b06061700 1 Processor -- start 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.265+0000 7f5b06061700 1 -- start start 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.265+0000 7f5b06061700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 0x7f5b00147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.265+0000 7f5b06061700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.265+0000 7f5b06061700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5b06061700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000bf4c0 con 0x7f5b000a9e30 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5b06061700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000be8b0 con 0x7f5b001546b0 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5b06061700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000beb90 con 0x7f5b000bc6d0 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afeffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46688/0 (socket says 172.21.15.178:46688) 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afeffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:35496/0 (socket says 172.21.15.178:35496) 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 -- 172.21.15.178:0/4027662495 learned_addr learned my addr 172.21.15.178:0/4027662495 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5aff7fe700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 0x7f5b00147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 -- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 msgr2=0x7f5b000c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 -- 172.21.15.178:0/4027662495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 msgr2=0x7f5b00147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 0x7f5b00147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 -- 172.21.15.178:0/4027662495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009370 con 0x7f5b001546b0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afeffd700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5aff7fe700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 0x7f5b00147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5afffff700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5af800c7c0 tx=0x7f5af8001510).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800e4a0 con 0x7f5b001546b0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800e600 con 0x7f5b001546b0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b000bee70 con 0x7f5b001546b0 2024-01-21T19:58:50.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800e980 con 0x7f5b001546b0 2024-01-21T19:58:50.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.266+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00151400 con 0x7f5b001546b0 2024-01-21T19:58:50.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.267+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f5af801b3f0 con 0x7f5b001546b0 2024-01-21T19:58:50.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.267+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f5af800ed70 con 0x7f5b001546b0 2024-01-21T19:58:50.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.267+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b000bf630 con 0x7f5b001546b0 2024-01-21T19:58:50.262 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.270+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f5af8020060 con 0x7f5b001546b0 2024-01-21T19:58:50.342 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.350+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd9d1bc0-7f9f-434f-8398-d5727e17f902", "id": 2} v 0) v1 -- 0x7f5b0005fdf0 con 0x7f5b001546b0 2024-01-21T19:58:50.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.356+0000 7f5ae7fff700 1 -- 172.21.15.178:0/4027662495 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd9d1bc0-7f9f-434f-8398-d5727e17f902", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5af80290b0 con 0x7f5b001546b0 2024-01-21T19:58:50.348 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-01-21T19:58:50.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 msgr2=0x7f5b000c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f5af800c7c0 tx=0x7f5af8001510).stop 2024-01-21T19:58:50.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 shutdown_connections 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b001546b0 0x7f5b000c2020 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b000a9e30 0x7f5b00147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 --2- 172.21.15.178:0/4027662495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b000bc6d0 0x7f5b000c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 >> 172.21.15.178:0/4027662495 conn(0x7f5b000c8200 msgr2=0x7f5b000bd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 shutdown_connections 2024-01-21T19:58:50.350 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.357+0000 7f5b06061700 1 -- 172.21.15.178:0/4027662495 wait complete. 2024-01-21T19:58:50.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 925b134b-fb46-4552-a8dc-47d566fc86bc 3 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.498+0000 7fc1282b3700 1 Processor -- start 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.498+0000 7fc1282b3700 1 -- start start 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.499+0000 7fc1282b3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc120082830 0x7fc120069330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc1282b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc120082c10 0x7fc1200c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc1282b3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc120069b50 con 0x7fc120064e20 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc1282b3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc120069e30 con 0x7fc120082c10 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc1282b3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12006a110 con 0x7fc120082830 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc12604f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc120082830 0x7fc120069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc12584e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc120082c10 0x7fc1200c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc12604f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc120082830 0x7fc120069330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46692/0 (socket says 172.21.15.178:46692) 2024-01-21T19:58:50.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.500+0000 7fc12604f700 1 -- 172.21.15.178:0/4158366819 learned_addr learned my addr 172.21.15.178:0/4158366819 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12604f700 1 -- 172.21.15.178:0/4158366819 >> v2:172.21.15.133:3300/0 conn(0x7fc120082c10 msgr2=0x7fc1200c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12604f700 1 --2- 172.21.15.178:0/4158366819 >> v2:172.21.15.133:3300/0 conn(0x7fc120082c10 0x7fc1200c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12604f700 1 -- 172.21.15.178:0/4158366819 >> v1:172.21.15.178:6789/0 conn(0x7fc120064e20 legacy=0x7fc1200c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12504d700 1 -- 172.21.15.178:0/4158366819 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475549427 0 0) 0x7fc120069b50 con 0x7fc120064e20 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12604f700 1 -- 172.21.15.178:0/4158366819 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12006a3f0 con 0x7fc120082830 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12604f700 1 --2- 172.21.15.178:0/4158366819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120069330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc120067f00 tx=0x7fc118009840).ready entity=mon.1 client_cookie=46bd614a5b884c8c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12504d700 1 -- 172.21.15.178:0/4158366819 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11800dc30 con 0x7fc120082830 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12504d700 1 -- 172.21.15.178:0/4158366819 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11800dd90 con 0x7fc120082830 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.501+0000 7fc12504d700 1 -- 172.21.15.178:0/4158366819 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118011690 con 0x7fc120082830 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 -- 172.21.15.178:0/4158366819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 msgr2=0x7fc120069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 --2- 172.21.15.178:0/4158366819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120069330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc120067f00 tx=0x7fc118009840).stop 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 -- 172.21.15.178:0/4158366819 shutdown_connections 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 --2- 172.21.15.178:0/4158366819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120069330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 --2- 172.21.15.178:0/4158366819 >> v2:172.21.15.133:3300/0 conn(0x7fc120082c10 0x7fc1200c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.502+0000 7fc1282b3700 1 -- 172.21.15.178:0/4158366819 >> 172.21.15.178:0/4158366819 conn(0x7fc1200c6ef0 msgr2=0x7fc1200c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.495 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.503+0000 7fc1282b3700 1 -- 172.21.15.178:0/4158366819 shutdown_connections 2024-01-21T19:58:50.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.503+0000 7fc1282b3700 1 -- 172.21.15.178:0/4158366819 wait complete. 2024-01-21T19:58:50.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.504+0000 7fc1282b3700 1 Processor -- start 2024-01-21T19:58:50.496 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.504+0000 7fc1282b3700 1 -- start start 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc120064e20 0x7fc1200aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc120082c10 0x7fc12015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200a70d0 con 0x7fc120064e20 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200a6ac0 con 0x7fc120082830 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.505+0000 7fc1282b3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200aabb0 con 0x7fc120082c10 2024-01-21T19:58:50.497 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46704/0 (socket says 172.21.15.178:46704) 2024-01-21T19:58:50.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 -- 172.21.15.178:0/3788100762 learned_addr learned my addr 172.21.15.178:0/3788100762 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.498 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc126850700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc120082c10 0x7fc12015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 -- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc120082c10 msgr2=0x7fc12015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc120082c10 0x7fc12015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 -- 172.21.15.178:0/3788100762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc120064e20 msgr2=0x7fc1200aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc120064e20 0x7fc1200aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 -- 172.21.15.178:0/3788100762 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118009ae0 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc12584e700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc11c00e810 tx=0x7fc11c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.506+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00f040 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00adc0 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c00c780 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200a6d60 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200aae90 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc11c00cd50 con 0x7fc120082830 2024-01-21T19:58:50.499 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.507+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fc11c01dc20 con 0x7fc120082830 2024-01-21T19:58:50.500 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.508+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12005fdf0 con 0x7fc120082830 2024-01-21T19:58:50.503 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.511+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc11c01d5a0 con 0x7fc120082830 2024-01-21T19:58:50.522 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:50.530+0000 7f1f57527680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T19:58:50.533 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:50.542+0000 7f4f4fa6e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T19:58:50.589 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:50.597+0000 7f1f57527680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T19:58:50.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.604+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "925b134b-fb46-4552-a8dc-47d566fc86bc", "id": 3} v 0) v1 -- 0x7fc120069820 con 0x7fc120082830 2024-01-21T19:58:50.602 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:50.611+0000 7f4f4fa6e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T19:58:50.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.612+0000 7fc116f78700 1 -- 172.21.15.178:0/3788100762 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "925b134b-fb46-4552-a8dc-47d566fc86bc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc11c01d780 con 0x7fc120082830 2024-01-21T19:58:50.604 INFO:teuthology.orchestra.run.smithi178.stdout:3 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 msgr2=0x7fc120093d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc11c00e810 tx=0x7fc11c008040).stop 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 shutdown_connections 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc120082c10 0x7fc12015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc120064e20 0x7fc1200aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 --2- 172.21.15.178:0/3788100762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc120082830 0x7fc120093d70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 >> 172.21.15.178:0/3788100762 conn(0x7fc1200c6ef0 msgr2=0x7fc1200a5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 shutdown_connections 2024-01-21T19:58:50.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.613+0000 7fc1282b3700 1 -- 172.21.15.178:0/3788100762 wait complete. 2024-01-21T19:58:50.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 73e87d8f-c1e6-497e-bfd4-85402b130ed4 4 2024-01-21T19:58:50.735 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.744+0000 7f45e4523700 1 Processor -- start 2024-01-21T19:58:50.736 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.744+0000 7f45e4523700 1 -- start start 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e4523700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45dc1558c0 0x7f45dc0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e4523700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45dc155ca0 0x7f45dc062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e4523700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc0a50f0 con 0x7f45dc0bd180 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e4523700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0630d0 con 0x7f45dc1558c0 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e4523700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0a4da0 con 0x7f45dc155ca0 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45dc155ca0 0x7f45dc062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45dc155ca0 0x7f45dc062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46716/0 (socket says 172.21.15.178:46716) 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 -- 172.21.15.178:0/3019412631 learned_addr learned my addr 172.21.15.178:0/3019412631 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e22bf700 1 --2- 172.21.15.178:0/3019412631 >> v2:172.21.15.133:3300/0 conn(0x7f45dc1558c0 0x7f45dc0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 -- 172.21.15.178:0/3019412631 >> v2:172.21.15.133:3300/0 conn(0x7f45dc1558c0 msgr2=0x7f45dc0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 --2- 172.21.15.178:0/3019412631 >> v2:172.21.15.133:3300/0 conn(0x7f45dc1558c0 0x7f45dc0626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 -- 172.21.15.178:0/3019412631 >> v1:172.21.15.133:6789/0 conn(0x7f45dc0bd180 legacy=0x7f45dc0bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.745+0000 7f45e1abe700 1 -- 172.21.15.178:0/3019412631 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc0bde00 con 0x7f45dc155ca0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e1abe700 1 --2- 172.21.15.178:0/3019412631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc155ca0 0x7f45dc062be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f45dc067930 tx=0x7f45cc0090f0).ready entity=mon.1 client_cookie=5b55c57c4adb2fc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e12bd700 1 -- 172.21.15.178:0/3019412631 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00b520 con 0x7f45dc155ca0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e12bd700 1 -- 172.21.15.178:0/3019412631 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc00b680 con 0x7f45dc155ca0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e12bd700 1 -- 172.21.15.178:0/3019412631 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00ba00 con 0x7f45dc155ca0 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 -- 172.21.15.178:0/3019412631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc155ca0 msgr2=0x7f45dc062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 --2- 172.21.15.178:0/3019412631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc155ca0 0x7f45dc062be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f45dc067930 tx=0x7f45cc0090f0).stop 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 -- 172.21.15.178:0/3019412631 shutdown_connections 2024-01-21T19:58:50.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 --2- 172.21.15.178:0/3019412631 >> v2:172.21.15.133:3300/0 conn(0x7f45dc1558c0 0x7f45dc0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 --2- 172.21.15.178:0/3019412631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc155ca0 0x7f45dc062be0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 -- 172.21.15.178:0/3019412631 >> 172.21.15.178:0/3019412631 conn(0x7f45dc0c8010 msgr2=0x7f45dc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 -- 172.21.15.178:0/3019412631 shutdown_connections 2024-01-21T19:58:50.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.746+0000 7f45e4523700 1 -- 172.21.15.178:0/3019412631 wait complete. 2024-01-21T19:58:50.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 Processor -- start 2024-01-21T19:58:50.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 -- start start 2024-01-21T19:58:50.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45dc1558c0 0x7f45dc0c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45dc155ca0 0x7f45dc14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc14d880 con 0x7f45dc1558c0 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0c0640 con 0x7f45dc0bd180 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.748+0000 7f45e4523700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0bfa80 con 0x7f45dc155ca0 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46722/0 (socket says 172.21.15.178:46722) 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 -- 172.21.15.178:0/1759313321 learned_addr learned my addr 172.21.15.178:0/1759313321 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e2ac0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45dc155ca0 0x7f45dc14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e1abe700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45dc1558c0 0x7f45dc0c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 -- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45dc155ca0 msgr2=0x7f45dc14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45dc155ca0 0x7f45dc14f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 -- 172.21.15.178:0/1759313321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45dc1558c0 msgr2=0x7f45dc0c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45dc1558c0 0x7f45dc0c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.743 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 -- 172.21.15.178:0/1759313321 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc009370 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e22bf700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f45d800e960 tx=0x7f45d8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012600 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d8012760 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8012ae0 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc0bfd10 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc0c02d0 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f45d801b660 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.749+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f45d800c910 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.750+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc0c0920 con 0x7f45dc0bd180 2024-01-21T19:58:50.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.752+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f45d8016020 con 0x7f45dc0bd180 2024-01-21T19:58:50.778 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:50.786+0000 7f1f57527680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T19:58:50.804 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:50.812+0000 7f4f4fa6e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T19:58:50.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.834+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "73e87d8f-c1e6-497e-bfd4-85402b130ed4", "id": 4} v 0) v1 -- 0x7f45dc05fdf0 con 0x7f45dc0bd180 2024-01-21T19:58:50.833 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.842+0000 7f45d2ffd700 1 -- 172.21.15.178:0/1759313321 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "73e87d8f-c1e6-497e-bfd4-85402b130ed4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45d801bb40 con 0x7f45dc0bd180 2024-01-21T19:58:50.834 INFO:teuthology.orchestra.run.smithi178.stdout:4 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 msgr2=0x7f45dc14d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f45d800e960 tx=0x7f45d8009060).stop 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 shutdown_connections 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45dc155ca0 0x7f45dc14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45dc0bd180 0x7f45dc14d390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 --2- 172.21.15.178:0/1759313321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45dc1558c0 0x7f45dc0c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 >> 172.21.15.178:0/1759313321 conn(0x7f45dc0c8010 msgr2=0x7f45dc153040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 shutdown_connections 2024-01-21T19:58:50.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.843+0000 7f45e4523700 1 -- 172.21.15.178:0/1759313321 wait complete. 2024-01-21T19:58:50.846 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new c0bf882d-61a6-4a82-91fa-6da314fa6699 5 2024-01-21T19:58:50.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.973+0000 7f8326b0e700 1 Processor -- start 2024-01-21T19:58:50.964 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.973+0000 7f8326b0e700 1 -- start start 2024-01-21T19:58:50.966 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.973+0000 7f8326b0e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f8326b0e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f8326b0e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832014ee20 con 0x7f832014ea40 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f8326b0e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200bed10 con 0x7f83200bcf10 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f8326b0e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c6620 con 0x7f83200c5ce0 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:35532/0 (socket says 172.21.15.178:35532) 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46736/0 (socket says 172.21.15.178:46736) 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 -- 172.21.15.178:0/4108748180 learned_addr learned my addr 172.21.15.178:0/4108748180 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 -- 172.21.15.178:0/4108748180 >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 msgr2=0x7f83200c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 --2- 172.21.15.178:0/4108748180 >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 -- 172.21.15.178:0/4108748180 >> v1:172.21.15.133:6789/0 conn(0x7f832014ea40 legacy=0x7f83200630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.967 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 -- 172.21.15.178:0/4108748180 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200bea30 con 0x7f83200c5ce0 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831ffff700 1 --2- 172.21.15.178:0/4108748180 >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f83250ab700 1 --2- 172.21.15.178:0/4108748180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8318009f20 tx=0x7f8318009840).ready entity=mon.2 client_cookie=76950c8d8c83cb48 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831f7fe700 1 -- 172.21.15.178:0/4108748180 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800e070 con 0x7f83200c5ce0 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831f7fe700 1 -- 172.21.15.178:0/4108748180 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800b9d0 con 0x7f83200c5ce0 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.974+0000 7f831f7fe700 1 -- 172.21.15.178:0/4108748180 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800bd50 con 0x7f83200c5ce0 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 -- 172.21.15.178:0/4108748180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 msgr2=0x7f83200c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 --2- 172.21.15.178:0/4108748180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8318009f20 tx=0x7f8318009840).stop 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 -- 172.21.15.178:0/4108748180 shutdown_connections 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 --2- 172.21.15.178:0/4108748180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200c5ce0 0x7f83200c6130 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 --2- 172.21.15.178:0/4108748180 >> v2:172.21.15.178:3300/0 conn(0x7f83200bcf10 0x7f83200c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 -- 172.21.15.178:0/4108748180 >> 172.21.15.178:0/4108748180 conn(0x7f83200c7de0 msgr2=0x7f83200c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 -- 172.21.15.178:0/4108748180 shutdown_connections 2024-01-21T19:58:50.968 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.975+0000 7f8326b0e700 1 -- 172.21.15.178:0/4108748180 wait complete. 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.976+0000 7f8326b0e700 1 Processor -- start 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.976+0000 7f8326b0e700 1 -- start start 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200bcf10 0x7f83201649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83200c5ce0 0x7f83200ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320164ea0 con 0x7f83200c5ce0 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200adc50 con 0x7f832014ea40 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f8326b0e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200ad040 con 0x7f83200bcf10 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83248aa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200bcf10 0x7f83201649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46738/0 (socket says 172.21.15.178:46738) 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 -- 172.21.15.178:0/215479397 learned_addr learned my addr 172.21.15.178:0/215479397 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f831ffff700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83200c5ce0 0x7f83200ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 -- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200bcf10 msgr2=0x7f83201649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200bcf10 0x7f83201649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 -- 172.21.15.178:0/215479397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83200c5ce0 msgr2=0x7f83200ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83200c5ce0 0x7f83200ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.977+0000 7f83250ab700 1 -- 172.21.15.178:0/215479397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c0092a0 con 0x7f832014ea40 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f83250ab700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8320068de0 tx=0x7f8318009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180092e0 con 0x7f832014ea40 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831801e470 con 0x7f832014ea40 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831801e7f0 con 0x7f832014ea40 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8318009ae0 con 0x7f832014ea40 2024-01-21T19:58:50.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83200ad600 con 0x7f832014ea40 2024-01-21T19:58:50.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f8318003040 con 0x7f832014ea40 2024-01-21T19:58:50.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.978+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f831801edc0 con 0x7f832014ea40 2024-01-21T19:58:50.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.979+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83200add90 con 0x7f832014ea40 2024-01-21T19:58:50.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:50.981+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f83200add90 con 0x7f832014ea40 2024-01-21T19:58:51.070 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.078+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0bf882d-61a6-4a82-91fa-6da314fa6699", "id": 5} v 0) v1 -- 0x7f83200a7170 con 0x7f832014ea40 2024-01-21T19:58:51.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.086+0000 7f831d7fa700 1 -- 172.21.15.178:0/215479397 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0bf882d-61a6-4a82-91fa-6da314fa6699", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f831802d060 con 0x7f832014ea40 2024-01-21T19:58:51.078 INFO:teuthology.orchestra.run.smithi178.stdout:5 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 msgr2=0x7f832014b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8320068de0 tx=0x7f8318009840).stop 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 shutdown_connections 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f832014ea40 0x7f832014b7a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83200bcf10 0x7f83201649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 --2- 172.21.15.178:0/215479397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83200c5ce0 0x7f83200ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.079 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 >> 172.21.15.178:0/215479397 conn(0x7f83200c7de0 msgr2=0x7f83200626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 shutdown_connections 2024-01-21T19:58:51.080 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.087+0000 7f8326b0e700 1 -- 172.21.15.178:0/215479397 wait complete. 2024-01-21T19:58:51.091 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 2fec80c9-4500-4f89-9d4a-ff67637535b8 6 2024-01-21T19:58:51.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.215+0000 7f1be3aba700 1 Processor -- start 2024-01-21T19:58:51.206 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.215+0000 7f1be3aba700 1 -- start start 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be3aba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1bdc13a620 0x7f1bdc0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be3aba700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1bdc13aa00 0x7f1bdc158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be3aba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc1584f0 con 0x7f1bdc0626f0 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be3aba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc0bd6f0 con 0x7f1bdc13a620 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be3aba700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc0654e0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.209 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1bdc13aa00 0x7f1bdc158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1bdc13aa00 0x7f1bdc158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46742/0 (socket says 172.21.15.178:46742) 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 -- 172.21.15.178:0/241484071 learned_addr learned my addr 172.21.15.178:0/241484071 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1856700 1 --2- 172.21.15.178:0/241484071 >> v2:172.21.15.133:3300/0 conn(0x7f1bdc13a620 0x7f1bdc0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 -- 172.21.15.178:0/241484071 >> v2:172.21.15.133:3300/0 conn(0x7f1bdc13a620 msgr2=0x7f1bdc0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 --2- 172.21.15.178:0/241484071 >> v2:172.21.15.133:3300/0 conn(0x7f1bdc13a620 0x7f1bdc0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 -- 172.21.15.178:0/241484071 >> v1:172.21.15.133:6789/0 conn(0x7f1bdc0626f0 legacy=0x7f1bdc0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 -- 172.21.15.178:0/241484071 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc158730 con 0x7f1bdc13aa00 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.216+0000 7f1be1055700 1 --2- 172.21.15.178:0/241484071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc158000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1bdc13e3f0 tx=0x7f1bcc0090f0).ready entity=mon.1 client_cookie=4ead15b1d023b2c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be0854700 1 -- 172.21.15.178:0/241484071 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00b520 con 0x7f1bdc13aa00 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be0854700 1 -- 172.21.15.178:0/241484071 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00b680 con 0x7f1bdc13aa00 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be0854700 1 -- 172.21.15.178:0/241484071 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00ba20 con 0x7f1bdc13aa00 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 -- 172.21.15.178:0/241484071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc13aa00 msgr2=0x7f1bdc158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 --2- 172.21.15.178:0/241484071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc158000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f1bdc13e3f0 tx=0x7f1bcc0090f0).stop 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 -- 172.21.15.178:0/241484071 shutdown_connections 2024-01-21T19:58:51.210 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 --2- 172.21.15.178:0/241484071 >> v2:172.21.15.133:3300/0 conn(0x7f1bdc13a620 0x7f1bdc0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 --2- 172.21.15.178:0/241484071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc158000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 -- 172.21.15.178:0/241484071 >> 172.21.15.178:0/241484071 conn(0x7f1bdc0c7dc0 msgr2=0x7f1bdc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 -- 172.21.15.178:0/241484071 shutdown_connections 2024-01-21T19:58:51.211 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.217+0000 7f1be3aba700 1 -- 172.21.15.178:0/241484071 wait complete. 2024-01-21T19:58:51.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.218+0000 7f1be3aba700 1 Processor -- start 2024-01-21T19:58:51.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.218+0000 7f1be3aba700 1 -- start start 2024-01-21T19:58:51.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.213 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bdc13a620 0x7f1bdc1388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0aa870 con 0x7f1bdc13aa00 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc167b90 con 0x7f1bdc0626f0 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be3aba700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc167e70 con 0x7f1bdc13a620 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be1856700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be1856700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46748/0 (socket says 172.21.15.178:46748) 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be1856700 1 -- 172.21.15.178:0/1014633162 learned_addr learned my addr 172.21.15.178:0/1014633162 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be2057700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.219+0000 7f1be1055700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bdc13a620 0x7f1bdc1388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 -- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bdc13a620 msgr2=0x7f1bdc1388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bdc13a620 0x7f1bdc1388d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 -- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 msgr2=0x7f1bdc0aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 -- 172.21.15.178:0/1014633162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc009370 con 0x7f1bdc13aa00 2024-01-21T19:58:51.214 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be1856700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be2057700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc069500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1bd40013d0 tx=0x7f1bd4001530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400e4a0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd400e600 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc168150 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400e980 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc0addb0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f1bd401b3f0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.220+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f1bd401b6a0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.221+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc168670 con 0x7f1bdc13aa00 2024-01-21T19:58:51.215 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.223+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f1bdc168670 con 0x7f1bdc13aa00 2024-01-21T19:58:51.218 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.226+0000 7f1f57527680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T19:58:51.286 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:51.294+0000 7f4f4fa6e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T19:58:51.294 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.303+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2fec80c9-4500-4f89-9d4a-ff67637535b8", "id": 6} v 0) v1 -- 0x7f1bdc05fdf0 con 0x7f1bdc13aa00 2024-01-21T19:58:51.302 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.310+0000 7f1bd2777700 1 -- 172.21.15.178:0/1014633162 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fec80c9-4500-4f89-9d4a-ff67637535b8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bd4020060 con 0x7f1bdc13aa00 2024-01-21T19:58:51.302 INFO:teuthology.orchestra.run.smithi178.stdout:6 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 msgr2=0x7f1bdc069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc069500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f1bd40013d0 tx=0x7f1bd4001530).stop 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 shutdown_connections 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bdc13aa00 0x7f1bdc069500 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bdc0626f0 0x7f1bdc0aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 --2- 172.21.15.178:0/1014633162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bdc13a620 0x7f1bdc1388d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 >> 172.21.15.178:0/1014633162 conn(0x7f1bdc0c7dc0 msgr2=0x7f1bdc1397c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.303 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 shutdown_connections 2024-01-21T19:58:51.304 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.311+0000 7f1be3aba700 1 -- 172.21.15.178:0/1014633162 wait complete. 2024-01-21T19:58:51.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f 7 2024-01-21T19:58:51.321 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.329+0000 7f1f57527680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T19:58:51.395 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:51.404+0000 7f4f4fa6e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T19:58:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.439+0000 7f64bb18c700 1 Processor -- start 2024-01-21T19:58:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.439+0000 7f64bb18c700 1 -- start start 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64bb18c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64b41558c0 0x7f64b40626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64bb18c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64b40bd890 0x7f64b4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64bb18c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b40a50f0 con 0x7f64b4155ca0 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64bb18c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40630d0 con 0x7f64b41558c0 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64bb18c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40a4da0 con 0x7f64b40bd890 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64b40bd890 0x7f64b4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64b40bd890 0x7f64b4062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46758/0 (socket says 172.21.15.178:46758) 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 -- 172.21.15.178:0/2025466655 learned_addr learned my addr 172.21.15.178:0/2025466655 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b8f28700 1 --2- 172.21.15.178:0/2025466655 >> v2:172.21.15.133:3300/0 conn(0x7f64b41558c0 0x7f64b40626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 -- 172.21.15.178:0/2025466655 >> v2:172.21.15.133:3300/0 conn(0x7f64b41558c0 msgr2=0x7f64b40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 --2- 172.21.15.178:0/2025466655 >> v2:172.21.15.133:3300/0 conn(0x7f64b41558c0 0x7f64b40626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b37fe700 1 -- 172.21.15.178:0/2025466655 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003618104 0 0) 0x7f64b40a50f0 con 0x7f64b4155ca0 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 -- 172.21.15.178:0/2025466655 >> v1:172.21.15.133:6789/0 conn(0x7f64b4155ca0 legacy=0x7f64b40bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 -- 172.21.15.178:0/2025466655 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40bde00 con 0x7f64b40bd890 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.440+0000 7f64b9729700 1 --2- 172.21.15.178:0/2025466655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b40bd890 0x7f64b4062be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64b40c4410 tx=0x7f64ac009840).ready entity=mon.1 client_cookie=9aec48ed31a1079c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64b37fe700 1 -- 172.21.15.178:0/2025466655 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00e070 con 0x7f64b40bd890 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64b37fe700 1 -- 172.21.15.178:0/2025466655 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac00ba20 con 0x7f64b40bd890 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64b37fe700 1 -- 172.21.15.178:0/2025466655 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac00bda0 con 0x7f64b40bd890 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 -- 172.21.15.178:0/2025466655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b40bd890 msgr2=0x7f64b4062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2025466655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b40bd890 0x7f64b4062be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f64b40c4410 tx=0x7f64ac009840).stop 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 -- 172.21.15.178:0/2025466655 shutdown_connections 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2025466655 >> v2:172.21.15.133:3300/0 conn(0x7f64b41558c0 0x7f64b40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2025466655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b40bd890 0x7f64b4062be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 -- 172.21.15.178:0/2025466655 >> 172.21.15.178:0/2025466655 conn(0x7f64b40c8010 msgr2=0x7f64b40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 -- 172.21.15.178:0/2025466655 shutdown_connections 2024-01-21T19:58:51.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.441+0000 7f64bb18c700 1 -- 172.21.15.178:0/2025466655 wait complete. 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.442+0000 7f64bb18c700 1 Processor -- start 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.442+0000 7f64bb18c700 1 -- start start 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 0x7f64b4164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64b41558c0 0x7f64b4168960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4168e50 con 0x7f64b40bd890 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4148210 con 0x7f64b4155ca0 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64bb18c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40bf0b0 con 0x7f64b41558c0 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64b9729700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64b9729700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46766/0 (socket says 172.21.15.178:46766) 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64b3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64b41558c0 0x7f64b4168960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64b9729700 1 -- 172.21.15.178:0/2389057042 learned_addr learned my addr 172.21.15.178:0/2389057042 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:58:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.443+0000 7f64b8f28700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 0x7f64b4164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 -- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64b41558c0 msgr2=0x7f64b4168960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64b41558c0 0x7f64b4168960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 -- 172.21.15.178:0/2389057042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 msgr2=0x7f64b4164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 0x7f64b4164950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 -- 172.21.15.178:0/2389057042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac009ae0 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b8f28700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 0x7f64b4164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b9729700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f64ac00b6c0 tx=0x7f64ac009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac013e60 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac009500 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b4164f90 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ac01e6c0 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b4165550 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f64ac003040 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.444+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f64ac012a50 con 0x7f64b4155ca0 2024-01-21T19:58:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.445+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b40bf270 con 0x7f64b4155ca0 2024-01-21T19:58:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.447+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f64ac023070 con 0x7f64b4155ca0 2024-01-21T19:58:51.476 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.484+0000 7f1f57527680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T19:58:51.520 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.529+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f", "id": 7} v 0) v1 -- 0x7f64b405f970 con 0x7f64b4155ca0 2024-01-21T19:58:51.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.537+0000 7f64b17fa700 1 -- 172.21.15.178:0/2389057042 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f64ac018040 con 0x7f64b4155ca0 2024-01-21T19:58:51.528 INFO:teuthology.orchestra.run.smithi178.stdout:7 2024-01-21T19:58:51.529 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 msgr2=0x7f64b4147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f64ac00b6c0 tx=0x7f64ac009840).stop 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 shutdown_connections 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64b4155ca0 0x7f64b4147610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64b40bd890 0x7f64b4164950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 --2- 172.21.15.178:0/2389057042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64b41558c0 0x7f64b4168960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 >> 172.21.15.178:0/2389057042 conn(0x7f64b40c8010 msgr2=0x7f64b4152f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 shutdown_connections 2024-01-21T19:58:51.530 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:58:51.538+0000 7f64bb18c700 1 -- 172.21.15.178:0/2389057042 wait complete. 2024-01-21T19:58:51.541 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-21T19:58:51.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-21T19:58:51.543 INFO:tasks.ceph.osd.0:Started 2024-01-21T19:58:51.543 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-21T19:58:51.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-21T19:58:51.545 INFO:tasks.ceph.osd.1:Started 2024-01-21T19:58:51.545 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-21T19:58:51.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-21T19:58:51.547 INFO:tasks.ceph.osd.2:Started 2024-01-21T19:58:51.547 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-21T19:58:51.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-21T19:58:51.549 INFO:tasks.ceph.osd.3:Started 2024-01-21T19:58:51.550 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-21T19:58:51.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-21T19:58:51.552 INFO:tasks.ceph.osd.4:Started 2024-01-21T19:58:51.552 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-21T19:58:51.552 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-21T19:58:51.554 INFO:tasks.ceph.osd.5:Started 2024-01-21T19:58:51.554 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-21T19:58:51.554 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-21T19:58:51.556 INFO:tasks.ceph.osd.6:Started 2024-01-21T19:58:51.556 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-21T19:58:51.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-21T19:58:51.558 INFO:tasks.ceph.osd.7:Started 2024-01-21T19:58:51.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:58:51.559 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.567+0000 7f1f57527680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T19:58:51.561 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:51.569+0000 7f4f4fa6e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T19:58:51.670 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.678+0000 7f1f57527680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T19:58:51.674 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:51.683+0000 7f4f4fa6e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T19:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.711+0000 7f4843a4c700 1 Processor -- start 2024-01-21T19:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.711+0000 7f4843a4c700 1 -- start start 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4843a4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c154140 0x7f483c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4843a4c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f483c154520 0x7f483c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4843a4c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483c0ab620 con 0x7f483c0c6090 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4843a4c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483c0c6ae0 con 0x7f483c154520 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4843a4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0c05e0 con 0x7f483c154140 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4840fe7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f483c154520 0x7f483c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4841fe9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f483c0c6090 0x7f483c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36670/0 (socket says 172.21.15.133:36670) 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4841fe9700 1 -- 172.21.15.133:0/1111000765 learned_addr learned my addr 172.21.15.133:0/1111000765 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f48417e8700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c154140 0x7f483c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4840fe7700 1 -- 172.21.15.133:0/1111000765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c154140 msgr2=0x7f483c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4840fe7700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c154140 0x7f483c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.712+0000 7f4840fe7700 1 -- 172.21.15.133:0/1111000765 >> v1:172.21.15.133:6789/0 conn(0x7f483c0c6090 legacy=0x7f483c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4840fe7700 1 -- 172.21.15.133:0/1111000765 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0c0e40 con 0x7f483c154520 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4833fff700 1 -- 172.21.15.133:0/1111000765 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182052810 0 0) 0x7f483c0ab620 con 0x7f483c0c6090 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4840fe7700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154520 0x7f483c0ab130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f482c009760 tx=0x7f482c009060).ready entity=mon.0 client_cookie=871f373c884c4322 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4833fff700 1 -- 172.21.15.133:0/1111000765 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00f510 con 0x7f483c154520 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4833fff700 1 -- 172.21.15.133:0/1111000765 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00f670 con 0x7f483c154520 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4833fff700 1 -- 172.21.15.133:0/1111000765 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00f9f0 con 0x7f483c154520 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 -- 172.21.15.133:0/1111000765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154520 msgr2=0x7f483c0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154520 0x7f483c0ab130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f482c009760 tx=0x7f482c009060).stop 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 -- 172.21.15.133:0/1111000765 shutdown_connections 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c154140 0x7f483c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 --2- 172.21.15.133:0/1111000765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154520 0x7f483c0ab130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.713+0000 7f4843a4c700 1 -- 172.21.15.133:0/1111000765 >> 172.21.15.133:0/1111000765 conn(0x7f483c05e1e0 msgr2=0x7f483c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.714+0000 7f4843a4c700 1 -- 172.21.15.133:0/1111000765 shutdown_connections 2024-01-21T19:58:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.714+0000 7f4843a4c700 1 -- 172.21.15.133:0/1111000765 wait complete. 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.715+0000 7f4843a4c700 1 Processor -- start 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.715+0000 7f4843a4c700 1 -- start start 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 0x7f483c143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f483c154520 0x7f483c0ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0aea50 con 0x7f483c154140 2024-01-21T19:58:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483c143f20 con 0x7f483c154520 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483c0af660 con 0x7f483c0c6090 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58004/0 (socket says 172.21.15.133:58004) 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 -- 172.21.15.133:0/571922463 learned_addr learned my addr 172.21.15.133:0/571922463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f48417e8700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 0x7f483c143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4841fe9700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f483c154520 0x7f483c0ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 -- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 msgr2=0x7f483c143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 0x7f483c143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 -- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f483c154520 msgr2=0x7f483c0ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f483c154520 0x7f483c0ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 -- 172.21.15.133:0/571922463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c0092a0 con 0x7f483c154140 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f48417e8700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 0x7f483c143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4840fe7700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f482c011000 tx=0x7f482c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c00f7e0 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482c00f940 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483c0af940 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.716+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482c01b620 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.717+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483c0aff00 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.717+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f482c01bc70 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.717+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f482c024d80 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.718+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483c05fdf0 con 0x7f483c154140 2024-01-21T19:58:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.720+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f482c029060 con 0x7f483c154140 2024-01-21T19:58:51.746 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:51.755+0000 7f4f4fa6e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T19:58:51.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.786+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f483c0c00f0 con 0x7f483c154140 2024-01-21T19:58:51.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.786+0000 7f4831ffb700 1 -- 172.21.15.133:0/571922463 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f482c01f070 con 0x7f483c154140 2024-01-21T19:58:51.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:58:51.779 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:58:51.531096+0000","last_up_change":"0.000000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 msgr2=0x7f483c0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f482c011000 tx=0x7f482c017000).stop 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 shutdown_connections 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f483c154520 0x7f483c0ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f483c0c6090 0x7f483c143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 --2- 172.21.15.133:0/571922463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f483c154140 0x7f483c0ae070 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 >> 172.21.15.133:0/571922463 conn(0x7f483c05e1e0 msgr2=0x7f483c14db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 shutdown_connections 2024-01-21T19:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:58:51.787+0000 7f4843a4c700 1 -- 172.21.15.133:0/571922463 wait complete. 2024-01-21T19:58:51.791 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-21T19:58:51.791 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-21T19:58:51.942 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:51.950+0000 7f1f57527680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T19:58:52.011 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:52.020+0000 7f4f4fa6e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T19:58:52.142 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:52.150+0000 7f1f57527680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T19:58:52.151 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-01-21T19:58:52.159+0000 7f65d0e7f380 -1 Falling back to public interface 2024-01-21T19:58:52.158 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-01-21T19:58:52.166+0000 7f6218813380 -1 Falling back to public interface 2024-01-21T19:58:52.159 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-21T19:58:52.167+0000 7f19f25ec380 -1 Falling back to public interface 2024-01-21T19:58:52.160 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-21T19:58:52.168+0000 7f551e47a380 -1 Falling back to public interface 2024-01-21T19:58:52.162 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-01-21T19:58:52.170+0000 7f9646638380 -1 Falling back to public interface 2024-01-21T19:58:52.163 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-21T19:58:52.171+0000 7f1e18497380 -1 Falling back to public interface 2024-01-21T19:58:52.178 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-21T19:58:52.186+0000 7f3f82649380 -1 Falling back to public interface 2024-01-21T19:58:52.186 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-01-21T19:58:52.194+0000 7fd02151b380 -1 Falling back to public interface 2024-01-21T19:58:52.212 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:52.220+0000 7f4f4fa6e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T19:58:52.597 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-21T19:58:52.708 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.716+0000 7fa0fbdae700 1 Processor -- start 2024-01-21T19:58:52.708 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.716+0000 7fa0fbdae700 1 -- start start 2024-01-21T19:58:52.711 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0fbdae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0f4152020 0x7fa0f40639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:52.711 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0fbdae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:52.711 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0fbdae700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f40626f0 con 0x7fa0f405e380 2024-01-21T19:58:52.711 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0fbdae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f4063550 con 0x7fa0f4152020 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0fbdae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4065e30 con 0x7fa0f4152400 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0f9b4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0f4152020 0x7fa0f40639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0f9b4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0f4152020 0x7fa0f40639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58010/0 (socket says 172.21.15.133:58010) 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0f9b4a700 1 -- 172.21.15.133:0/4154923714 learned_addr learned my addr 172.21.15.133:0/4154923714 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.717+0000 7fa0f9349700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9b4a700 1 -- 172.21.15.133:0/4154923714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 msgr2=0x7fa0f40bc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9b4a700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9b4a700 1 -- 172.21.15.133:0/4154923714 >> v1:172.21.15.178:6789/0 conn(0x7fa0f405e380 legacy=0x7fa0f40aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9b4a700 1 -- 172.21.15.133:0/4154923714 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4062940 con 0x7fa0f4152020 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9349700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f9b4a700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152020 0x7fa0f40639e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa0f0006fd0 tx=0x7fa0f00090f0).ready entity=mon.0 client_cookie=6a5692e50a335a84 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f8b48700 1 -- 172.21.15.133:0/4154923714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000b600 con 0x7fa0f4152020 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f8b48700 1 -- 172.21.15.133:0/4154923714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000b760 con 0x7fa0f4152020 2024-01-21T19:58:52.712 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.718+0000 7fa0f8b48700 1 -- 172.21.15.133:0/4154923714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000bae0 con 0x7fa0f4152020 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 -- 172.21.15.133:0/4154923714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152020 msgr2=0x7fa0f40639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152020 0x7fa0f40639e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa0f0006fd0 tx=0x7fa0f00090f0).stop 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 -- 172.21.15.133:0/4154923714 shutdown_connections 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152020 0x7fa0f40639e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/4154923714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 -- 172.21.15.133:0/4154923714 >> 172.21.15.133:0/4154923714 conn(0x7fa0f40c3f80 msgr2=0x7fa0f40c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 -- 172.21.15.133:0/4154923714 shutdown_connections 2024-01-21T19:58:52.713 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.719+0000 7fa0fbdae700 1 -- 172.21.15.133:0/4154923714 wait complete. 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.720+0000 7fa0fbdae700 1 Processor -- start 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.721+0000 7fa0fbdae700 1 -- start start 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0f405e380 0x7fa0f4140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152020 0x7fa0f4166670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4164720 con 0x7fa0f4152400 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4163df0 con 0x7fa0f405e380 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41640d0 con 0x7fa0f4152020 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58020/0 (socket says 172.21.15.133:58020) 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 -- 172.21.15.133:0/1171431338 learned_addr learned my addr 172.21.15.133:0/1171431338 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0f9b4a700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0f405e380 0x7fa0f4140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:52.716 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0f9349700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152020 0x7fa0f4166670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 -- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152020 msgr2=0x7fa0f4166670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152020 0x7fa0f4166670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 -- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0f405e380 msgr2=0x7fa0f4140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0f405e380 0x7fa0f4140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 -- 172.21.15.133:0/1171431338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009370 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fa34b700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa0ec002230 tx=0x7fa0ec0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00e4a0 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00e600 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00e980 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f41643b0 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.722+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4140680 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.723+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fa0ec01c440 con 0x7fa0f4152400 2024-01-21T19:58:52.717 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.723+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fa0ec01bab0 con 0x7fa0f4152400 2024-01-21T19:58:52.718 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.723+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f4164890 con 0x7fa0f4152400 2024-01-21T19:58:52.718 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.726+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fa0ec021060 con 0x7fa0f4152400 2024-01-21T19:58:52.786 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.793+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0f406c7b0 con 0x7fa0f4152400 2024-01-21T19:58:52.786 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.794+0000 7fa0ea7fc700 1 -- 172.21.15.133:0/1171431338 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7fa0ec017070 con 0x7fa0f4152400 2024-01-21T19:58:52.787 INFO:teuthology.misc.health.smithi133.stdout: 2024-01-21T19:58:52.787 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:58:51.531096+0000","last_up_change":"0.000000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 msgr2=0x7fa0f40bc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fa0ec002230 tx=0x7fa0ec0015e0).stop 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 shutdown_connections 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f4152400 0x7fa0f40bc440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0f405e380 0x7fa0f4140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 --2- 172.21.15.133:0/1171431338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0f4152020 0x7fa0f4166670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 >> 172.21.15.133:0/1171431338 conn(0x7fa0f40c3f80 msgr2=0x7fa0f414f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 shutdown_connections 2024-01-21T19:58:52.788 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:52.795+0000 7fa0fbdae700 1 -- 172.21.15.133:0/1171431338 wait complete. 2024-01-21T19:58:52.798 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-21T19:58:52.830 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:52.838+0000 7f1f57527680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T19:58:52.885 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:52.894+0000 7f4f4fa6e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T19:58:52.899 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:52.906+0000 7f1f57527680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T19:58:52.954 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:52.962+0000 7f4f4fa6e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T19:58:52.977 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:52.985+0000 7f1f57527680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T19:58:53.035 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.043+0000 7f4f4fa6e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T19:58:53.128 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.136+0000 7f1f57527680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T19:58:53.184 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.193+0000 7f4f4fa6e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T19:58:53.199 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.207+0000 7f1f57527680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T19:58:53.256 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.264+0000 7f4f4fa6e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T19:58:53.318 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.326+0000 7f1f57527680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T19:58:53.374 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.383+0000 7f4f4fa6e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T19:58:53.425 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.433+0000 7f1f57527680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T19:58:53.482 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.490+0000 7f4f4fa6e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T19:58:53.746 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.754+0000 7f1f57527680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T19:58:53.807 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.816+0000 7f4f4fa6e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T19:58:53.818 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:53.826+0000 7f1f57527680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T19:58:53.883 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T19:58:53.892+0000 7f4f4fa6e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T19:58:54.843 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:54.850+0000 7f1f0cd64700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-21T19:58:54.843 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T19:58:54.851+0000 7f1f0cd64700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-21T19:58:55.653 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-21T19:58:55.662+0000 7f19f25ec380 -1 osd.2 0 log_to_monitors {default=true} 2024-01-21T19:58:55.667 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-21T19:58:55.676+0000 7f551e47a380 -1 osd.3 0 log_to_monitors {default=true} 2024-01-21T19:58:55.674 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-01-21T19:58:55.683+0000 7f9646638380 -1 osd.5 0 log_to_monitors {default=true} 2024-01-21T19:58:55.681 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-01-21T19:58:55.689+0000 7f65d0e7f380 -1 osd.4 0 log_to_monitors {default=true} 2024-01-21T19:58:55.683 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-01-21T19:58:55.691+0000 7f6218813380 -1 osd.6 0 log_to_monitors {default=true} 2024-01-21T19:58:55.693 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-21T19:58:55.701+0000 7f3f82649380 -1 osd.0 0 log_to_monitors {default=true} 2024-01-21T19:58:55.693 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-21T19:58:55.702+0000 7f1e18497380 -1 osd.1 0 log_to_monitors {default=true} 2024-01-21T19:58:55.708 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-01-21T19:58:55.718+0000 7fd02151b380 -1 osd.7 0 log_to_monitors {default=true} 2024-01-21T19:58:56.847 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-01-21T19:58:56.856+0000 7f963cfed700 -1 osd.5 0 waiting for initial osdmap 2024-01-21T19:58:56.847 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-01-21T19:58:56.856+0000 7f620f1c8700 -1 osd.6 0 waiting for initial osdmap 2024-01-21T19:58:56.848 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-01-21T19:58:56.857+0000 7f65c7834700 -1 osd.4 0 waiting for initial osdmap 2024-01-21T19:58:56.848 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-21T19:58:56.857+0000 7f5514e2f700 -1 osd.3 0 waiting for initial osdmap 2024-01-21T19:58:56.849 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-21T19:58:56.857+0000 7f19e8fa1700 -1 osd.2 0 waiting for initial osdmap 2024-01-21T19:58:56.849 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-21T19:58:56.858+0000 7f3f78ffe700 -1 osd.0 0 waiting for initial osdmap 2024-01-21T19:58:56.852 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-01-21T19:58:56.861+0000 7f65c3fb0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.852 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-01-21T19:58:56.861+0000 7f9639769700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.852 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-01-21T19:58:56.862+0000 7f620b944700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.854 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-01-21T19:58:56.863+0000 7f55115ab700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.855 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-01-21T19:58:56.864+0000 7f3f7577a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.855 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-01-21T19:58:56.864+0000 7f19e571d700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.858 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-01-21T19:58:56.867+0000 7fd017ed0700 -1 osd.7 0 waiting for initial osdmap 2024-01-21T19:58:56.858 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-21T19:58:56.867+0000 7f1e0ee4c700 -1 osd.1 0 waiting for initial osdmap 2024-01-21T19:58:56.862 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-01-21T19:58:56.872+0000 7fd01464c700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:56.863 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-01-21T19:58:56.872+0000 7f1e0b5c8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-21T19:58:59.605 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-21T19:58:59.725 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.734+0000 7f4c1d3e4700 1 Processor -- start 2024-01-21T19:58:59.725 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.734+0000 7f4c1d3e4700 1 -- start start 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 0x7f4c18155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 0x7f4c180c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c180c7e30 0x7f4c18157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c180ca0c0 con 0x7f4c180c7e30 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c180c82e0 con 0x7f4c180c8ca0 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c1d3e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c18152220 con 0x7f4c18151e40 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c180c7e30 0x7f4c18157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.728 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c180c7e30 0x7f4c18157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58118/0 (socket says 172.21.15.133:58118) 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 -- 172.21.15.133:0/3995085510 learned_addr learned my addr 172.21.15.133:0/3995085510 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c167fc700 1 --2- 172.21.15.133:0/3995085510 >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 0x7f4c180c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c16ffd700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 0x7f4c18155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 -- 172.21.15.133:0/3995085510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 msgr2=0x7f4c18155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 0x7f4c18155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 -- 172.21.15.133:0/3995085510 >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 msgr2=0x7f4c180c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 --2- 172.21.15.133:0/3995085510 >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 0x7f4c180c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 -- 172.21.15.133:0/3995085510 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180c94b0 con 0x7f4c180c7e30 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c16ffd700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 0x7f4c18155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c167fc700 1 --2- 172.21.15.133:0/3995085510 >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 0x7f4c180c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c177fe700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c18157dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4c18083fb0 tx=0x7f4c10009840).ready entity=mon.0 client_cookie=72d889a08106a7f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.735+0000 7f4c15ffb700 1 -- 172.21.15.133:0/3995085510 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000e070 con 0x7f4c180c7e30 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c15ffb700 1 -- 172.21.15.133:0/3995085510 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000ba50 con 0x7f4c180c7e30 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c15ffb700 1 -- 172.21.15.133:0/3995085510 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bdd0 con 0x7f4c180c7e30 2024-01-21T19:58:59.729 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3995085510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 msgr2=0x7f4c18157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c18157dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f4c18083fb0 tx=0x7f4c10009840).stop 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3995085510 shutdown_connections 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c18157dc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3995085510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c18151e40 0x7f4c18155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3995085510 >> v2:172.21.15.178:3300/0 conn(0x7f4c180c8ca0 0x7f4c180c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3995085510 >> 172.21.15.133:0/3995085510 conn(0x7f4c18084c30 msgr2=0x7f4c18094550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3995085510 shutdown_connections 2024-01-21T19:58:59.730 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.736+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3995085510 wait complete. 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 Processor -- start 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 -- start start 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c180c8ca0 0x7f4c180afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c18151e40 0x7f4c1814f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b0300 con 0x7f4c180c7e30 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b05e0 con 0x7f4c18151e40 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c1d3e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b08c0 con 0x7f4c180c8ca0 2024-01-21T19:58:59.733 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58128/0 (socket says 172.21.15.133:58128) 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.738+0000 7f4c16ffd700 1 -- 172.21.15.133:0/3583291422 learned_addr learned my addr 172.21.15.133:0/3583291422 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c167fc700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c180c8ca0 0x7f4c180afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c177fe700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c18151e40 0x7f4c1814f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 -- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c180c8ca0 msgr2=0x7f4c180afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c180c8ca0 0x7f4c180afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 -- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c18151e40 msgr2=0x7f4c1814f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c18151e40 0x7f4c1814f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 -- 172.21.15.133:0/3583291422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10009ae0 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c16ffd700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4c0800d890 tx=0x7f4c08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08017070 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08005880 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c180aa6c0 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08005c00 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.739+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1814df30 con 0x7f4c180c7e30 2024-01-21T19:58:59.734 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.740+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1806c7b0 con 0x7f4c180c7e30 2024-01-21T19:58:59.735 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.740+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c08005fb0 con 0x7f4c180c7e30 2024-01-21T19:58:59.735 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.741+0000 7f4bff7fe700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 0x7f4c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:58:59.735 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.741+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4892+0+0 (secure 0 0 0) 0x7f4c08079b70 con 0x7f4c180c7e30 2024-01-21T19:58:59.735 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.741+0000 7f4c167fc700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 0x7f4c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:58:59.735 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.741+0000 7f4c167fc700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 0x7f4c04061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4c0c006d20 tx=0x7f4c0c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:58:59.736 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.745+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c0804b310 con 0x7f4c180c7e30 2024-01-21T19:58:59.903 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.912+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c180c9790 con 0x7f4c180c7e30 2024-01-21T19:58:59.904 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.913+0000 7f4bff7fe700 1 -- 172.21.15.133:0/3583291422 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12250 (secure 0 0 0) 0x7f4c0804e930 con 0x7f4c180c7e30 2024-01-21T19:58:59.904 INFO:teuthology.misc.health.smithi133.stdout: 2024-01-21T19:58:59.905 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":15,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:58:59.874329+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:58:59.906 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 msgr2=0x7f4c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:59.906 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 0x7f4c04061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f4c0c006d20 tx=0x7f4c0c008040).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 msgr2=0x7f4c1814da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4c0800d890 tx=0x7f4c08008040).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 shutdown_connections 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c0405f150 0x7f4c04061610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c18151e40 0x7f4c1814f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c180c7e30 0x7f4c1814da40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 --2- 172.21.15.133:0/3583291422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c180c8ca0 0x7f4c180afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 >> 172.21.15.133:0/3583291422 conn(0x7f4c18084c30 msgr2=0x7f4c181524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 shutdown_connections 2024-01-21T19:58:59.907 INFO:teuthology.misc.health.smithi133.stderr:2024-01-21T19:58:59.915+0000 7f4c1d3e4700 1 -- 172.21.15.133:0/3583291422 wait complete. 2024-01-21T19:58:59.917 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-21T19:58:59.917 INFO:tasks.ceph:Creating RBD pool 2024-01-21T19:58:59.918 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd pool create rbd 8 2024-01-21T19:59:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.041+0000 7f3fcfb37700 1 Processor -- start 2024-01-21T19:59:00.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.041+0000 7f3fcfb37700 1 -- start start 2024-01-21T19:59:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcfb37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fc8062c10 0x7f3fc8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcfb37700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 0x7f3fc8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcfb37700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80634e0 con 0x7f3fc8069c40 2024-01-21T19:59:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcfb37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc806a130 con 0x7f3fc8062c10 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcfb37700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc806a410 con 0x7f3fc80697e0 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.042+0000 7f3fcd8d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fc8062c10 0x7f3fc8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fc8062c10 0x7f3fc8062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58134/0 (socket says 172.21.15.133:58134) 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fce0d4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3fc8069c40 0x7f3fc81583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36684/0 (socket says 172.21.15.133:36684) 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/696264967 learned_addr learned my addr 172.21.15.133:0/696264967 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd0d2700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 0x7f3fc8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/696264967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 msgr2=0x7f3fc8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 0x7f3fc8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/696264967 >> v1:172.21.15.133:6789/0 conn(0x7f3fc8069c40 legacy=0x7f3fc81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/696264967 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc806a6f0 con 0x7f3fc8062c10 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcc8d1700 1 -- 172.21.15.133:0/696264967 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407391623 0 0) 0x7f3fc80634e0 con 0x7f3fc8069c40 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd0d2700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 0x7f3fc8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:00.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcd8d3700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8062ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3fb8006fd0 tx=0x7f3fb80090f0).ready entity=mon.0 client_cookie=be7c466b27f82e28 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcc8d1700 1 -- 172.21.15.133:0/696264967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800b600 con 0x7f3fc8062c10 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcc8d1700 1 -- 172.21.15.133:0/696264967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800b760 con 0x7f3fc8062c10 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.043+0000 7f3fcc8d1700 1 -- 172.21.15.133:0/696264967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800bb00 con 0x7f3fc8062c10 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 -- 172.21.15.133:0/696264967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 msgr2=0x7f3fc8062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8062ff0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f3fb8006fd0 tx=0x7f3fb80090f0).stop 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 -- 172.21.15.133:0/696264967 shutdown_connections 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8062ff0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/696264967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc80697e0 0x7f3fc8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 -- 172.21.15.133:0/696264967 >> 172.21.15.133:0/696264967 conn(0x7f3fc80c8010 msgr2=0x7f3fc80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 -- 172.21.15.133:0/696264967 shutdown_connections 2024-01-21T19:59:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.044+0000 7f3fcfb37700 1 -- 172.21.15.133:0/696264967 wait complete. 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.045+0000 7f3fcfb37700 1 Processor -- start 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.045+0000 7f3fcfb37700 1 -- start start 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc80697e0 0x7f3fc80aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc8069c40 0x7f3fc813cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8165630 con 0x7f3fc8062c10 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8138c60 con 0x7f3fc80697e0 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8164a20 con 0x7f3fc8069c40 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58136/0 (socket says 172.21.15.133:58136) 2024-01-21T19:59:00.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/3031153068 learned_addr learned my addr 172.21.15.133:0/3031153068 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc8069c40 msgr2=0x7f3fc813cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc8069c40 0x7f3fc813cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc80697e0 msgr2=0x7f3fc80aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc80697e0 0x7f3fc80aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 -- 172.21.15.133:0/3031153068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8009370 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcd8d3700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3fb8009f50 tx=0x7f3fb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb800b8d0 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb800ba30 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8164d00 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb80246c0 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.046+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc81652c0 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.047+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3fb8021070 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.047+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc805fdf0 con 0x7f3fc8062c10 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.048+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 0x7f3fac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.048+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4916+0+0 (secure 0 0 0) 0x7f3fb807b8b0 con 0x7f3fc8062c10 2024-01-21T19:59:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.048+0000 7f3fcd0d2700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 0x7f3fac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.048+0000 7f3fcd0d2700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 0x7f3fac061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3fc4006fd0 tx=0x7f3fc4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.052+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3fb804d030 con 0x7f3fc8062c10 2024-01-21T19:59:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.216+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3fc80bcf70 con 0x7f3fc8062c10 2024-01-21T19:59:00.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.883+0000 7f3fbe7fc700 1 -- 172.21.15.133:0/3031153068 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3fb8029030 con 0x7f3fc8062c10 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 msgr2=0x7f3fac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 0x7f3fac061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3fc4006fd0 tx=0x7f3fc4008040).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 msgr2=0x7f3fc8138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f3fb8009f50 tx=0x7f3fb8017000).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 shutdown_connections 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3fac05f150 0x7f3fac061610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc8069c40 0x7f3fc813cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc8062c10 0x7f3fc8138770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 --2- 172.21.15.133:0/3031153068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc80697e0 0x7f3fc80aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 >> 172.21.15.133:0/3031153068 conn(0x7f3fc80c8010 msgr2=0x7f3fc8156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 shutdown_connections 2024-01-21T19:59:00.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:00.887+0000 7f3fcfb37700 1 -- 172.21.15.133:0/3031153068 wait complete. 2024-01-21T19:59:00.880 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'rbd' created 2024-01-21T19:59:00.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-21T19:59:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.029+0000 7f08a296b700 1 Processor -- start 2024-01-21T19:59:01.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.029+0000 7f08a296b700 1 -- start start 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a296b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f089c154050 0x7f089c069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a296b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f089c063e10 0x7f089c154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a296b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089c065440 con 0x7f089c0c1aa0 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a296b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089c0c1f20 con 0x7f089c063e10 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a296b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089c0a4d90 con 0x7f089c154050 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f089c063e10 0x7f089c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f089c063e10 0x7f089c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42682/0 (socket says 172.21.15.133:42682) 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f089b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f089c0c1aa0 0x7f089c063700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58958/0 (socket says 172.21.15.133:58958) 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 -- 172.21.15.133:0/2717021130 learned_addr learned my addr 172.21.15.133:0/2717021130 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:01.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f089bfff700 1 --2- 172.21.15.133:0/2717021130 >> v2:172.21.15.178:3300/0 conn(0x7f089c154050 0x7f089c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 -- 172.21.15.133:0/2717021130 >> v2:172.21.15.178:3300/0 conn(0x7f089c154050 msgr2=0x7f089c069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 --2- 172.21.15.133:0/2717021130 >> v2:172.21.15.178:3300/0 conn(0x7f089c154050 0x7f089c069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 -- 172.21.15.133:0/2717021130 >> v1:172.21.15.133:6789/0 conn(0x7f089c0c1aa0 legacy=0x7f089c063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 -- 172.21.15.133:0/2717021130 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c069cd0 con 0x7f089c063e10 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f089affd700 1 -- 172.21.15.133:0/2717021130 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125353599 0 0) 0x7f089c065440 con 0x7f089c0c1aa0 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f08a0f08700 1 --2- 172.21.15.133:0/2717021130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c063e10 0x7f089c154430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f089c06a320 tx=0x7f0894009840).ready entity=mon.0 client_cookie=27a3803f1fe3fb2b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.030+0000 7f089affd700 1 -- 172.21.15.133:0/2717021130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400e070 con 0x7f089c063e10 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f089affd700 1 -- 172.21.15.133:0/2717021130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089400ba50 con 0x7f089c063e10 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f089affd700 1 -- 172.21.15.133:0/2717021130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bdd0 con 0x7f089c063e10 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 -- 172.21.15.133:0/2717021130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c063e10 msgr2=0x7f089c154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 --2- 172.21.15.133:0/2717021130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c063e10 0x7f089c154430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f089c06a320 tx=0x7f0894009840).stop 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 -- 172.21.15.133:0/2717021130 shutdown_connections 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 --2- 172.21.15.133:0/2717021130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c063e10 0x7f089c154430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 --2- 172.21.15.133:0/2717021130 >> v2:172.21.15.178:3300/0 conn(0x7f089c154050 0x7f089c069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 -- 172.21.15.133:0/2717021130 >> 172.21.15.133:0/2717021130 conn(0x7f089c0c4a10 msgr2=0x7f089c068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:01.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 -- 172.21.15.133:0/2717021130 shutdown_connections 2024-01-21T19:59:01.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.031+0000 7f08a296b700 1 -- 172.21.15.133:0/2717021130 wait complete. 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.032+0000 7f08a296b700 1 Processor -- start 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 -- start start 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 0x7f089c0ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 0x7f089c0bd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0be270 con 0x7f089c154050 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0be540 con 0x7f089c063e10 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a296b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089c0be7e0 con 0x7f089c0c1aa0 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a0f08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a0f08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42688/0 (socket says 172.21.15.133:42688) 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.033+0000 7f08a0f08700 1 -- 172.21.15.133:0/3840366569 learned_addr learned my addr 172.21.15.133:0/3840366569 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f089b7fe700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 0x7f089c0bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f089bfff700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 0x7f089c0ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 -- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 msgr2=0x7f089c0bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 0x7f089c0bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 -- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 msgr2=0x7f089c0ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 0x7f089c0ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 -- 172.21.15.133:0/3840366569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894009ae0 con 0x7f089c154050 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f089b7fe700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 0x7f089c0bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f089bfff700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 0x7f089c0ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a0f08700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f089c064270 tx=0x7f0894009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400bdd0 con 0x7f089c154050 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089401c400 con 0x7f089c154050 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089c0a8d60 con 0x7f089c154050 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089401c780 con 0x7f089c154050 2024-01-21T19:59:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.034+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089c0a9320 con 0x7f089c154050 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.035+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089c0a9510 con 0x7f089c154050 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.035+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f089401cb70 con 0x7f089c154050 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.036+0000 7f0898ff9700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 0x7f0888061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.036+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7f089407b890 con 0x7f089c154050 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.036+0000 7f089bfff700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 0x7f0888061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:01.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.036+0000 7f089bfff700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 0x7f0888061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f089c0a62a0 tx=0x7f0890008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:01.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.040+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f089404cec0 con 0x7f089c154050 2024-01-21T19:59:01.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.207+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f089c05fdf0 con 0x7f089c154050 2024-01-21T19:59:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.887+0000 7f0898ff9700 1 -- 172.21.15.133:0/3840366569 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f08940504e0 con 0x7f089c154050 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.890+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 msgr2=0x7f0888061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.890+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 0x7f0888061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f089c0a62a0 tx=0x7f0890008040).stop 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.890+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 msgr2=0x7f089c0bdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.890+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f089c064270 tx=0x7f0894009840).stop 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 shutdown_connections 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f088805f150 0x7f0888061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f089c154050 0x7f089c0bdd80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089c063e10 0x7f089c0ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 --2- 172.21.15.133:0/3840366569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089c0c1aa0 0x7f089c0bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 >> 172.21.15.133:0/3840366569 conn(0x7f089c0c4a10 msgr2=0x7f089c0c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 shutdown_connections 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:01.891+0000 7f08a296b700 1 -- 172.21.15.133:0/3840366569 wait complete. 2024-01-21T19:59:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-21T19:59:01.897 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-21T19:59:01.898 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T19:59:01.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T19:59:01.900 INFO:tasks.ceph.mds.a:Started 2024-01-21T19:59:01.900 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T19:59:01.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T19:59:01.902 INFO:tasks.ceph.mds.c:Started 2024-01-21T19:59:01.902 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T19:59:01.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T19:59:01.905 INFO:tasks.ceph.mds.b:Started 2024-01-21T19:59:01.905 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T19:59:01.905 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T19:59:01.907 INFO:tasks.ceph.mds.d:Started 2024-01-21T19:59:01.907 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-21T19:59:01.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:01.980 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T19:59:01.980 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T19:59:01.990 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T19:59:01.990 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T19:59:02.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.041+0000 7f09063ed700 1 Processor -- start 2024-01-21T19:59:02.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.041+0000 7f09063ed700 1 -- start start 2024-01-21T19:59:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.042+0000 7f09063ed700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.042+0000 7f09063ed700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.042+0000 7f09063ed700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0900063750 con 0x7f09000aa0f0 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.042+0000 7f09063ed700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000640d0 con 0x7f09000a9d10 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.042+0000 7f09063ed700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090005e380 con 0x7f09001558d0 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08fffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08fffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40684/0 (socket says 172.21.15.133:40684) 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08fffff700 1 -- 172.21.15.133:0/2473208817 learned_addr learned my addr 172.21.15.133:0/2473208817 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43622/0 (socket says 172.21.15.133:43622) 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08ff7fe700 1 --1- 172.21.15.133:0/2473208817 >> v1:172.21.15.178:6789/0 conn(0x7f09000aa0f0 0x7f09001551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35662/0 (socket says 172.21.15.133:35662) 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 -- 172.21.15.133:0/2473208817 >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 msgr2=0x7f09000ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 --2- 172.21.15.133:0/2473208817 >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 -- 172.21.15.133:0/2473208817 >> v1:172.21.15.178:6789/0 conn(0x7f09000aa0f0 legacy=0x7f09001551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08feffd700 1 -- 172.21.15.133:0/2473208817 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957553829 0 0) 0x7f0900063750 con 0x7f09000aa0f0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 -- 172.21.15.133:0/2473208817 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090005e660 con 0x7f09001558d0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08fffff700 1 --2- 172.21.15.133:0/2473208817 >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f090498a700 1 --2- 172.21.15.133:0/2473208817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f08f8009e60 tx=0x7f08f8009780).ready entity=mon.2 client_cookie=1c71b8166a1318d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08feffd700 1 -- 172.21.15.133:0/2473208817 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800e070 con 0x7f09001558d0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08feffd700 1 -- 172.21.15.133:0/2473208817 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800bb60 con 0x7f09001558d0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.043+0000 7f08feffd700 1 -- 172.21.15.133:0/2473208817 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8012410 con 0x7f09001558d0 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 -- 172.21.15.133:0/2473208817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 msgr2=0x7f0900063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 --2- 172.21.15.133:0/2473208817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f08f8009e60 tx=0x7f08f8009780).stop 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 -- 172.21.15.133:0/2473208817 shutdown_connections 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 --2- 172.21.15.133:0/2473208817 >> v2:172.21.15.178:3300/0 conn(0x7f09000a9d10 0x7f09000ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 --2- 172.21.15.133:0/2473208817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09001558d0 0x7f0900063be0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 -- 172.21.15.133:0/2473208817 >> 172.21.15.133:0/2473208817 conn(0x7f09000c8200 msgr2=0x7f09000c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 -- 172.21.15.133:0/2473208817 shutdown_connections 2024-01-21T19:59:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.044+0000 7f09063ed700 1 -- 172.21.15.133:0/2473208817 wait complete. 2024-01-21T19:59:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.045+0000 7f09063ed700 1 Processor -- start 2024-01-21T19:59:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.045+0000 7f09063ed700 1 -- start start 2024-01-21T19:59:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09000aa0f0 0x7f09000c1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09001558d0 0x7f090013aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900142310 con 0x7f09000a9d10 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900141700 con 0x7f09001558d0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f09063ed700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09001419e0 con 0x7f09000aa0f0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42722/0 (socket says 172.21.15.133:42722) 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 -- 172.21.15.133:0/958652736 learned_addr learned my addr 172.21.15.133:0/958652736 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f090498a700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09001558d0 0x7f090013aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09000aa0f0 0x7f09000c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 -- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09000aa0f0 msgr2=0x7f09000c1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09000aa0f0 0x7f09000c1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 -- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09001558d0 msgr2=0x7f090013aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09001558d0 0x7f090013aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.046+0000 7f08fffff700 1 -- 172.21.15.133:0/958652736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009370 con 0x7f09000a9d10 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f08fffff700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08f400ea20 tx=0x7f08f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400ee60 con 0x7f09000a9d10 2024-01-21T19:59:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400c850 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400cbd0 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f8009a20 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.047+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900141fa0 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.048+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090005fdf0 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.048+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f08f401b400 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.048+0000 7f08fcff9700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 0x7f08ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.049+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f08f407a3b0 con 0x7f09000a9d10 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.049+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 0x7f08ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.049+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 0x7f08ec061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0900141630 tx=0x7f08f0007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.053+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08f404ba20 con 0x7f09000a9d10 2024-01-21T19:59:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.217+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09000662a0 con 0x7f09000a9d10 2024-01-21T19:59:02.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.218+0000 7f08fcff9700 1 -- 172.21.15.133:0/958652736 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f08f4016020 con 0x7f09000a9d10 2024-01-21T19:59:02.210 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:02.210 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:01.882517+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 msgr2=0x7f08ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 0x7f08ec061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0900141630 tx=0x7f08f0007bd0).stop 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 msgr2=0x7f0900141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f08f400ea20 tx=0x7f08f40090f0).stop 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 shutdown_connections 2024-01-21T19:59:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08ec05f150 0x7f08ec061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09001558d0 0x7f090013aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000a9d10 0x7f0900141140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 --2- 172.21.15.133:0/958652736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09000aa0f0 0x7f09000c1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 >> 172.21.15.133:0/958652736 conn(0x7f09000c8200 msgr2=0x7f09000c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 shutdown_connections 2024-01-21T19:59:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.220+0000 7f09063ed700 1 -- 172.21.15.133:0/958652736 wait complete. 2024-01-21T19:59:02.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T19:59:02.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:02.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.351+0000 7fba1f37a700 1 Processor -- start 2024-01-21T19:59:02.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.351+0000 7fba1f37a700 1 -- start start 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1f37a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba180c3c10 0x7fba180be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1f37a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba180be5f0 0x7fba180a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1f37a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180bfa40 con 0x7fba1813b970 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1f37a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180bee30 con 0x7fba180be5f0 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1f37a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180bf110 con 0x7fba180c3c10 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d116700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba1813b970 0x7fba180c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58960/0 (socket says 172.21.15.133:58960) 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d116700 1 -- 172.21.15.133:0/611393595 learned_addr learned my addr 172.21.15.133:0/611393595 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 --2- 172.21.15.133:0/611393595 >> v2:172.21.15.133:3300/0 conn(0x7fba180be5f0 0x7fba180a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1c915700 1 --2- 172.21.15.133:0/611393595 >> v2:172.21.15.178:3300/0 conn(0x7fba180c3c10 0x7fba180be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba0ffff700 1 -- 172.21.15.133:0/611393595 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792426654 0 0) 0x7fba180bfa40 con 0x7fba1813b970 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba0ffff700 1 -- 172.21.15.133:0/611393595 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba040033f0 con 0x7fba1813b970 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 -- 172.21.15.133:0/611393595 >> v2:172.21.15.178:3300/0 conn(0x7fba180c3c10 msgr2=0x7fba180be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:02.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 --2- 172.21.15.133:0/611393595 >> v2:172.21.15.178:3300/0 conn(0x7fba180c3c10 0x7fba180be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 -- 172.21.15.133:0/611393595 >> v1:172.21.15.133:6789/0 conn(0x7fba1813b970 legacy=0x7fba180c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 -- 172.21.15.133:0/611393595 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180bf3f0 con 0x7fba180be5f0 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.352+0000 7fba1d917700 1 --2- 172.21.15.133:0/611393595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180be5f0 0x7fba180a8ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fba180c8ed0 tx=0x7fba10009780).ready entity=mon.0 client_cookie=f8caea36c085aa3c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba0ffff700 1 -- 172.21.15.133:0/611393595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000e070 con 0x7fba180be5f0 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba0ffff700 1 -- 172.21.15.133:0/611393595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000bab0 con 0x7fba180be5f0 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba0ffff700 1 -- 172.21.15.133:0/611393595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000be30 con 0x7fba180be5f0 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 -- 172.21.15.133:0/611393595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180be5f0 msgr2=0x7fba180a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 --2- 172.21.15.133:0/611393595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180be5f0 0x7fba180a8ab0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fba180c8ed0 tx=0x7fba10009780).stop 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 -- 172.21.15.133:0/611393595 shutdown_connections 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 --2- 172.21.15.133:0/611393595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180be5f0 0x7fba180a8ab0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 --2- 172.21.15.133:0/611393595 >> v2:172.21.15.178:3300/0 conn(0x7fba180c3c10 0x7fba180be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 -- 172.21.15.133:0/611393595 >> 172.21.15.133:0/611393595 conn(0x7fba18066a70 msgr2=0x7fba18066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 -- 172.21.15.133:0/611393595 shutdown_connections 2024-01-21T19:59:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.353+0000 7fba1f37a700 1 -- 172.21.15.133:0/611393595 wait complete. 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.354+0000 7fba1f37a700 1 Processor -- start 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.354+0000 7fba1f37a700 1 -- start start 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba180be5f0 0x7fba18152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba1813b970 0x7fba18161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18155c20 con 0x7fba180c3c10 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18152c50 con 0x7fba1813b970 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1f37a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba18138ed0 con 0x7fba180be5f0 2024-01-21T19:59:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1c915700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1c915700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42748/0 (socket says 172.21.15.133:42748) 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.355+0000 7fba1c915700 1 -- 172.21.15.133:0/4114167323 learned_addr learned my addr 172.21.15.133:0/4114167323 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1d116700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba180be5f0 0x7fba18152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1d917700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba1813b970 0x7fba18161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 -- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba180be5f0 msgr2=0x7fba18152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba180be5f0 0x7fba18152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 -- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba1813b970 msgr2=0x7fba18161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba1813b970 0x7fba18161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 -- 172.21.15.133:0/4114167323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10009a20 con 0x7fba180c3c10 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1c915700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fba0800e900 tx=0x7fba08009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800eea0 con 0x7fba180c3c10 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800c7f0 con 0x7fba180c3c10 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba181629b0 con 0x7fba180c3c10 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800cb70 con 0x7fba180c3c10 2024-01-21T19:59:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.356+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18138b60 con 0x7fba180c3c10 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.357+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18138cf0 con 0x7fba180c3c10 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.357+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fba0801b400 con 0x7fba180c3c10 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.357+0000 7fba0dffb700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 0x7fb9fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.358+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fba0807a460 con 0x7fba180c3c10 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.358+0000 7fba1d116700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 0x7fb9fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.358+0000 7fba1d116700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 0x7fb9fc061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fba14005750 tx=0x7fba14009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.362+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fba0804ba20 con 0x7fba180c3c10 2024-01-21T19:59:02.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.524+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fba181389c0 con 0x7fba180c3c10 2024-01-21T19:59:02.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.525+0000 7fba0dffb700 1 -- 172.21.15.133:0/4114167323 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fba181389c0 con 0x7fba180c3c10 2024-01-21T19:59:02.516 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:02.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 msgr2=0x7fb9fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 0x7fb9fc061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fba14005750 tx=0x7fba14009040).stop 2024-01-21T19:59:02.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 msgr2=0x7fba18138250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fba0800e900 tx=0x7fba08009060).stop 2024-01-21T19:59:02.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 shutdown_connections 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9fc05f150 0x7fb9fc061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba1813b970 0x7fba18161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba180be5f0 0x7fba18152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 --2- 172.21.15.133:0/4114167323 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba180c3c10 0x7fba18138250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 >> 172.21.15.133:0/4114167323 conn(0x7fba18066a70 msgr2=0x7fba180ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 shutdown_connections 2024-01-21T19:59:02.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.527+0000 7fba1f37a700 1 -- 172.21.15.133:0/4114167323 wait complete. 2024-01-21T19:59:02.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:02.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.657+0000 7ff1eac4b700 1 Processor -- start 2024-01-21T19:59:02.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.657+0000 7ff1eac4b700 1 -- start start 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1eac4b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 0x7ff1e40a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1eac4b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40654e0 con 0x7ff1e413aa00 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1eac4b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e4158730 con 0x7ff1e4062e00 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1e3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1e413aa00 0x7ff1e40626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58974/0 (socket says 172.21.15.133:58974) 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1e3fff700 1 -- 172.21.15.133:0/890834957 learned_addr learned my addr 172.21.15.133:0/890834957 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40bd6f0 con 0x7ff1e413a620 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.658+0000 7ff1e89e7700 1 --2- 172.21.15.133:0/890834957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 0x7ff1e40a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e37fe700 1 -- 172.21.15.133:0/890834957 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201314913 0 0) 0x7ff1e40654e0 con 0x7ff1e413aa00 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e37fe700 1 -- 172.21.15.133:0/890834957 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d40033f0 con 0x7ff1e413aa00 2024-01-21T19:59:02.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e89e7700 1 -- 172.21.15.133:0/890834957 >> v1:172.21.15.178:6789/0 conn(0x7ff1e4062e00 legacy=0x7ff1e4065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e89e7700 1 -- 172.21.15.133:0/890834957 >> v1:172.21.15.133:6789/0 conn(0x7ff1e413aa00 legacy=0x7ff1e40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e89e7700 1 -- 172.21.15.133:0/890834957 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4158a10 con 0x7ff1e413a620 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e89e7700 1 --2- 172.21.15.133:0/890834957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 0x7ff1e40a6e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff1d8009790 tx=0x7ff1d8009060).ready entity=mon.2 client_cookie=aed54bbfaf6da461 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e37fe700 1 -- 172.21.15.133:0/890834957 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d80090d0 con 0x7ff1e413a620 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e37fe700 1 -- 172.21.15.133:0/890834957 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d800f510 con 0x7ff1e413a620 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.659+0000 7ff1e37fe700 1 -- 172.21.15.133:0/890834957 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800f890 con 0x7ff1e413a620 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 msgr2=0x7ff1e40a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/890834957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 0x7ff1e40a6e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff1d8009790 tx=0x7ff1d8009060).stop 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 shutdown_connections 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/890834957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413a620 0x7ff1e40a6e30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 >> 172.21.15.133:0/890834957 conn(0x7ff1e40c7dc0 msgr2=0x7ff1e40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 shutdown_connections 2024-01-21T19:59:02.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.660+0000 7ff1eac4b700 1 -- 172.21.15.133:0/890834957 wait complete. 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.661+0000 7ff1eac4b700 1 Processor -- start 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.661+0000 7ff1eac4b700 1 -- start start 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4062e00 0x7ff1e4157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413aa00 0x7ff1e40ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4158360 con 0x7ff1e413a620 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40a76d0 con 0x7ff1e4062e00 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40c0870 con 0x7ff1e413aa00 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42762/0 (socket says 172.21.15.133:42762) 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 -- 172.21.15.133:0/419560169 learned_addr learned my addr 172.21.15.133:0/419560169 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e89e7700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4062e00 0x7ff1e4157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e91e8700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413aa00 0x7ff1e40ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 -- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413aa00 msgr2=0x7ff1e40ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413aa00 0x7ff1e40ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 -- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4062e00 msgr2=0x7ff1e4157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4062e00 0x7ff1e4157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 -- 172.21.15.133:0/419560169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d80092a0 con 0x7ff1e413a620 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e3fff700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff1d000c450 tx=0x7ff1d0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00070d0 con 0x7ff1e413a620 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d0007230 con 0x7ff1e413a620 2024-01-21T19:59:02.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40c0540 con 0x7ff1e413a620 2024-01-21T19:59:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00075f0 con 0x7ff1e413a620 2024-01-21T19:59:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.662+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40ac140 con 0x7ff1e413a620 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.664+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40c03a0 con 0x7ff1e413a620 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.664+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff1d00059b0 con 0x7ff1e413a620 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.664+0000 7ff1e17fa700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 0x7ff1c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.664+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff1d0079430 con 0x7ff1e413a620 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.664+0000 7ff1e89e7700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 0x7ff1c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.665+0000 7ff1e89e7700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 0x7ff1c8061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff1d80096e0 tx=0x7ff1d8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.669+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff1e40c03a0 con 0x7ff1e413a620 2024-01-21T19:59:02.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.832+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1e40c03a0 con 0x7ff1e413a620 2024-01-21T19:59:02.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.832+0000 7ff1e17fa700 1 -- 172.21.15.133:0/419560169 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1e40c03a0 con 0x7ff1e413a620 2024-01-21T19:59:02.824 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:02.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 msgr2=0x7ff1c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 0x7ff1c8061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff1d80096e0 tx=0x7ff1d8017000).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 msgr2=0x7ff1e4157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7ff1d000c450 tx=0x7ff1d0007c50).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 shutdown_connections 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1c805f150 0x7ff1c8061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e413aa00 0x7ff1e40ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4062e00 0x7ff1e4157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 --2- 172.21.15.133:0/419560169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1e413a620 0x7ff1e4157e70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 >> 172.21.15.133:0/419560169 conn(0x7ff1e40c7dc0 msgr2=0x7ff1e4157000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 shutdown_connections 2024-01-21T19:59:02.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.834+0000 7ff1eac4b700 1 -- 172.21.15.133:0/419560169 wait complete. 2024-01-21T19:59:02.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:02.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.962+0000 7f4ff843a700 1 Processor -- start 2024-01-21T19:59:02.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.962+0000 7f4ff843a700 1 -- start start 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff843a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff843a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff843a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff0063750 con 0x7f4ff00a9d10 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff843a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff00640d0 con 0x7f4ff00aa0f0 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff843a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff005e380 con 0x7f4ff01558d0 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff59d5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff59d5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40746/0 (socket says 172.21.15.133:40746) 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43656/0 (socket says 172.21.15.133:43656) 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff59d5700 1 -- 172.21.15.133:0/414982078 learned_addr learned my addr 172.21.15.133:0/414982078 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff61d6700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4ff00a9d10 0x7f4ff01551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35670/0 (socket says 172.21.15.133:35670) 2024-01-21T19:59:02.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 -- 172.21.15.133:0/414982078 >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 msgr2=0x7f4ff00ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 --2- 172.21.15.133:0/414982078 >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 -- 172.21.15.133:0/414982078 >> v1:172.21.15.178:6789/0 conn(0x7f4ff00a9d10 legacy=0x7f4ff01551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff69d7700 1 -- 172.21.15.133:0/414982078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff005e660 con 0x7f4ff01558d0 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.964+0000 7f4ff59d5700 1 --2- 172.21.15.133:0/414982078 >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff69d7700 1 --2- 172.21.15.133:0/414982078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4fe8009e60 tx=0x7f4fe8009780).ready entity=mon.2 client_cookie=94da214126144404 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff51d4700 1 -- 172.21.15.133:0/414982078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe800e070 con 0x7f4ff01558d0 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff51d4700 1 -- 172.21.15.133:0/414982078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe800bb60 con 0x7f4ff01558d0 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff51d4700 1 -- 172.21.15.133:0/414982078 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8012410 con 0x7f4ff01558d0 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 -- 172.21.15.133:0/414982078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 msgr2=0x7f4ff0063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 --2- 172.21.15.133:0/414982078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4fe8009e60 tx=0x7f4fe8009780).stop 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 -- 172.21.15.133:0/414982078 shutdown_connections 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 --2- 172.21.15.133:0/414982078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff0063be0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 --2- 172.21.15.133:0/414982078 >> v2:172.21.15.178:3300/0 conn(0x7f4ff00aa0f0 0x7f4ff00ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 -- 172.21.15.133:0/414982078 >> 172.21.15.133:0/414982078 conn(0x7f4ff00c8200 msgr2=0x7f4ff00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 -- 172.21.15.133:0/414982078 shutdown_connections 2024-01-21T19:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.965+0000 7f4ff843a700 1 -- 172.21.15.133:0/414982078 wait complete. 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.967+0000 7f4ff843a700 1 Processor -- start 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.967+0000 7f4ff843a700 1 -- start start 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 0x7f4ff0139c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff00c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013afe0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013a150 con 0x7f4ff00aa0f0 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff843a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013a3d0 con 0x7f4ff01558d0 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42772/0 (socket says 172.21.15.133:42772) 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 -- 172.21.15.133:0/3142020167 learned_addr learned my addr 172.21.15.133:0/3142020167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff59d5700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 0x7f4ff0139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff69d7700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff00c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 -- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 msgr2=0x7f4ff00c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff00c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 -- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 msgr2=0x7f4ff0139c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 0x7f4ff0139c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff61d6700 1 -- 172.21.15.133:0/3142020167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009370 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.968+0000 7f4ff59d5700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 0x7f4ff0139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4ff61d6700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4fe0007fd0 tx=0x7f4fe0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe000ce10 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe00072e0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe8009a20 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00056e0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.969+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff013a990 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.970+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff005fdf0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.970+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4fe0005ad0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.970+0000 7f4fe6ffd700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 0x7f4fd4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.970+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4fe00794e0 con 0x7f4ff00a9d10 2024-01-21T19:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.970+0000 7f4ff59d5700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 0x7f4fd4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.971+0000 7f4ff59d5700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 0x7f4fd4061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4ff0163c90 tx=0x7f4fec0090f0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:02.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:02.974+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4fe004ab00 con 0x7f4ff00a9d10 2024-01-21T19:59:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.179+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ff00633e0 con 0x7f4ff00a9d10 2024-01-21T19:59:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.180+0000 7f4fe6ffd700 1 -- 172.21.15.133:0/3142020167 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f4fe004e120 con 0x7f4ff00a9d10 2024-01-21T19:59:03.171 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:03.171 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.181+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 msgr2=0x7f4fd4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.181+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 0x7f4fd4061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4ff0163c90 tx=0x7f4fec0090f0).stop 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 msgr2=0x7f4ff00bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4fe0007fd0 tx=0x7f4fe0007df0).stop 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 shutdown_connections 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fd405f150 0x7f4fd4061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff01558d0 0x7f4ff00c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ff00a9d10 0x7f4ff00bf640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 --2- 172.21.15.133:0/3142020167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff00aa0f0 0x7f4ff0139c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 >> 172.21.15.133:0/3142020167 conn(0x7f4ff00c8200 msgr2=0x7f4ff0069a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 shutdown_connections 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.182+0000 7f4ff843a700 1 -- 172.21.15.133:0/3142020167 wait complete. 2024-01-21T19:59:03.174 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2024-01-21T19:59:03.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.309+0000 7f24ba0fe700 1 Processor -- start 2024-01-21T19:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.309+0000 7f24ba0fe700 1 -- start start 2024-01-21T19:59:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24ba0fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24b41546b0 0x7f24b4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24ba0fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24b40bc6d0 0x7f24b4066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24ba0fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b40654f0 con 0x7f24b40a9e30 2024-01-21T19:59:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24ba0fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b4063700 con 0x7f24b41546b0 2024-01-21T19:59:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24ba0fe700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b4063950 con 0x7f24b40bc6d0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24b41546b0 0x7f24b4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f24b40a9e30 0x7f24b4065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58988/0 (socket says 172.21.15.133:58988) 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b2ffd700 1 -- 172.21.15.133:0/477599480 learned_addr learned my addr 172.21.15.133:0/477599480 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 -- 172.21.15.133:0/477599480 >> v2:172.21.15.178:3300/0 conn(0x7f24b40bc6d0 msgr2=0x7f24b4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b3fff700 1 --2- 172.21.15.133:0/477599480 >> v2:172.21.15.178:3300/0 conn(0x7f24b40bc6d0 0x7f24b4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b27fc700 1 -- 172.21.15.133:0/477599480 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079868618 0 0) 0x7f24b40654f0 con 0x7f24b40a9e30 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 --2- 172.21.15.133:0/477599480 >> v2:172.21.15.178:3300/0 conn(0x7f24b40bc6d0 0x7f24b4066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 -- 172.21.15.133:0/477599480 >> v1:172.21.15.133:6789/0 conn(0x7f24b40a9e30 legacy=0x7f24b4065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 -- 172.21.15.133:0/477599480 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b4065180 con 0x7f24b41546b0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b37fe700 1 --2- 172.21.15.133:0/477599480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b41546b0 0x7f24b4154a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f24b4065460 tx=0x7f24a4009060).ready entity=mon.0 client_cookie=ce8c15dd63b20ee2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b27fc700 1 -- 172.21.15.133:0/477599480 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40090d0 con 0x7f24b41546b0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b27fc700 1 -- 172.21.15.133:0/477599480 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400b580 con 0x7f24b41546b0 2024-01-21T19:59:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.310+0000 7f24b27fc700 1 -- 172.21.15.133:0/477599480 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400b900 con 0x7f24b41546b0 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 -- 172.21.15.133:0/477599480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b41546b0 msgr2=0x7f24b4154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/477599480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b41546b0 0x7f24b4154a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f24b4065460 tx=0x7f24a4009060).stop 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 -- 172.21.15.133:0/477599480 shutdown_connections 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/477599480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b41546b0 0x7f24b4154a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/477599480 >> v2:172.21.15.178:3300/0 conn(0x7f24b40bc6d0 0x7f24b4066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 -- 172.21.15.133:0/477599480 >> 172.21.15.133:0/477599480 conn(0x7f24b40c8200 msgr2=0x7f24b40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 -- 172.21.15.133:0/477599480 shutdown_connections 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.311+0000 7f24ba0fe700 1 -- 172.21.15.133:0/477599480 wait complete. 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.312+0000 7f24ba0fe700 1 Processor -- start 2024-01-21T19:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.312+0000 7f24ba0fe700 1 -- start start 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 0x7f24b414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 0x7f24b4150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40ab1d0 con 0x7f24b40a9e30 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40aa8a0 con 0x7f24b40bc6d0 2024-01-21T19:59:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24ba0fe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b40aab80 con 0x7f24b41546b0 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42784/0 (socket says 172.21.15.133:42784) 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 -- 172.21.15.133:0/402768554 learned_addr learned my addr 172.21.15.133:0/402768554 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b2ffd700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 0x7f24b414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b3fff700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 0x7f24b4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 -- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 msgr2=0x7f24b4150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 0x7f24b4150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 -- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 msgr2=0x7f24b414fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 0x7f24b414fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b37fe700 1 -- 172.21.15.133:0/402768554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40092a0 con 0x7f24b40a9e30 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b2ffd700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 0x7f24b414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.313+0000 7f24b3fff700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 0x7f24b4150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f24b37fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f24b405f8e0 tx=0x7f24a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400b900 con 0x7f24b40a9e30 2024-01-21T19:59:03.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a4006910 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b40aae60 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400bed0 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.314+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b4148ab0 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.315+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b405fdf0 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.315+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f24a401b650 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.316+0000 7f249bfff700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 0x7f24a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.316+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f24a407b740 con 0x7f24b40a9e30 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.316+0000 7f24b2ffd700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 0x7f24a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.316+0000 7f24b2ffd700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 0x7f24a0061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f24a80016f0 tx=0x7f24a8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.320+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24a404cd60 con 0x7f24b40a9e30 2024-01-21T19:59:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.484+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24b40aaff0 con 0x7f24b40a9e30 2024-01-21T19:59:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.485+0000 7f249bfff700 1 -- 172.21.15.133:0/402768554 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7f24a4050380 con 0x7f24b40a9e30 2024-01-21T19:59:03.476 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:03.476 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:02.886605+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.486+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 msgr2=0x7f24a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.486+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 0x7f24a0061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f24a80016f0 tx=0x7f24a8009040).stop 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.486+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 msgr2=0x7f24b4148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.486+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f24b405f8e0 tx=0x7f24a4017000).stop 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 shutdown_connections 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a005f150 0x7f24a0061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b41546b0 0x7f24b4150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b40a9e30 0x7f24b4148400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 --2- 172.21.15.133:0/402768554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b40bc6d0 0x7f24b414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 >> 172.21.15.133:0/402768554 conn(0x7f24b40c8200 msgr2=0x7f24b40bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 shutdown_connections 2024-01-21T19:59:03.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.487+0000 7f24ba0fe700 1 -- 172.21.15.133:0/402768554 wait complete. 2024-01-21T19:59:03.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T19:59:03.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:03.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.617+0000 7fb5772c3700 1 Processor -- start 2024-01-21T19:59:03.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.618+0000 7fb5772c3700 1 -- start start 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.618+0000 7fb5772c3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5700beb30 0x7fb570155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.618+0000 7fb5772c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb570065660 con 0x7fb5700c3fb0 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.618+0000 7fb5772c3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb570065f00 con 0x7fb570069ef0 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.618+0000 7fb5772c3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700bef10 con 0x7fb5700beb30 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb57485e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5700c3fb0 0x7fb5700697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58994/0 (socket says 172.21.15.133:58994) 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb57485e700 1 -- 172.21.15.133:0/2331166729 learned_addr learned my addr 172.21.15.133:0/2331166729 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503549739 0 0) 0x7fb570065660 con 0x7fb5700c3fb0 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb57505f700 1 --2- 172.21.15.133:0/2331166729 >> v2:172.21.15.178:3300/0 conn(0x7fb5700beb30 0x7fb570155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0033f0 con 0x7fb5700c3fb0 2024-01-21T19:59:03.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707540846 0 0) 0x7fb55c0033f0 con 0x7fb5700c3fb0 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 >> v2:172.21.15.178:3300/0 conn(0x7fb5700beb30 msgr2=0x7fb570155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 --2- 172.21.15.133:0/2331166729 >> v2:172.21.15.178:3300/0 conn(0x7fb5700beb30 0x7fb570155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 >> v1:172.21.15.178:6789/0 conn(0x7fb570069ef0 legacy=0x7fb570066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700c4740 con 0x7fb5700c3fb0 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb56c001470 con 0x7fb5700c3fb0 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 >> v1:172.21.15.133:6789/0 conn(0x7fb5700c3fb0 legacy=0x7fb5700697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb55c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb55c005050 0x7fb55c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700bef10 con 0x7fb55c0038e0 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c00bfe0 con 0x7fb55c005050 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb57505f700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb55c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c00c1a0 con 0x7fb55c004690 2024-01-21T19:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb57485e700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.619+0000 7fb575860700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb55c005050 0x7fb55c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 -- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55c004690 msgr2=0x7fb55c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 -- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb55c005050 msgr2=0x7fb55c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb55c005050 0x7fb55c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb575860700 1 -- 172.21.15.133:0/2331166729 reap_dead start 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 -- 172.21.15.133:0/2331166729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0033f0 con 0x7fb55c0038e0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57485e700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55c004690 0x7fb55c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb57505f700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb55c003d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb560006d80 tx=0x7fb560009060).ready entity=mon.0 client_cookie=491b1a5e00550ad server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560009430 con 0x7fb55c0038e0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560009e70 con 0x7fb55c0038e0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb567fff700 1 -- 172.21.15.133:0/2331166729 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000e850 con 0x7fb55c0038e0 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 -- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 msgr2=0x7fb55c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb55c003d00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb560006d80 tx=0x7fb560009060).stop 2024-01-21T19:59:03.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 -- 172.21.15.133:0/2331166729 shutdown_connections 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 --2- 172.21.15.133:0/2331166729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb55c003d00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 -- 172.21.15.133:0/2331166729 >> 172.21.15.133:0/2331166729 conn(0x7fb5700c8010 msgr2=0x7fb5700c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 -- 172.21.15.133:0/2331166729 shutdown_connections 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.620+0000 7fb5772c3700 1 -- 172.21.15.133:0/2331166729 wait complete. 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 Processor -- start 2024-01-21T19:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 -- start start 2024-01-21T19:59:03.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 0x7fb5700c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb570062760 0x7fb570062bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570162f20 con 0x7fb55c0038e0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c1c30 con 0x7fb5700c12c0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb5772c3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701625a0 con 0x7fb570062760 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb57505f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb57505f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42802/0 (socket says 172.21.15.133:42802) 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.622+0000 7fb57505f700 1 -- 172.21.15.133:0/3818037374 learned_addr learned my addr 172.21.15.133:0/3818037374 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57485e700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 0x7fb5700c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb575860700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb570062760 0x7fb570062bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 -- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb570062760 msgr2=0x7fb570062bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb570062760 0x7fb570062bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 -- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 msgr2=0x7fb5700c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 0x7fb5700c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 -- 172.21.15.133:0/3818037374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570063490 con 0x7fb55c0038e0 2024-01-21T19:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57485e700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 0x7fb5700c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb57505f700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb56001b750 tx=0x7fb56001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56001bca0 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56001be00 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570162860 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560025680 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.623+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5700adf50 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.624+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57005fdf0 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.624+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5600123f0 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.625+0000 7fb565f76700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 0x7fb554061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.625+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb56007b3b0 con 0x7fb55c0038e0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.625+0000 7fb57485e700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 0x7fb554061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.625+0000 7fb57485e700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 0x7fb554061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb56c001c00 tx=0x7fb56c000ed0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.629+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb56004c970 con 0x7fb55c0038e0 2024-01-21T19:59:03.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.795+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb57006ac20 con 0x7fb55c0038e0 2024-01-21T19:59:03.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.796+0000 7fb565f76700 1 -- 172.21.15.133:0/3818037374 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb56002a0b0 con 0x7fb55c0038e0 2024-01-21T19:59:03.787 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 msgr2=0x7fb554061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 0x7fb554061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb56c001c00 tx=0x7fb56c000ed0).stop 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 msgr2=0x7fb5700ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fb56001b750 tx=0x7fb56001a000).stop 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 shutdown_connections 2024-01-21T19:59:03.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb55405f150 0x7fb554061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb570062760 0x7fb570062bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb55c0038e0 0x7fb5700ada60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 --2- 172.21.15.133:0/3818037374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5700c12c0 0x7fb5700c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 >> 172.21.15.133:0/3818037374 conn(0x7fb5700c8010 msgr2=0x7fb5700661e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 shutdown_connections 2024-01-21T19:59:03.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.798+0000 7fb5772c3700 1 -- 172.21.15.133:0/3818037374 wait complete. 2024-01-21T19:59:03.801 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.931+0000 7fe273118700 1 Processor -- start 2024-01-21T19:59:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.931+0000 7fe273118700 1 -- start start 2024-01-21T19:59:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe273118700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe26c0a9e30 0x7fe26c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe273118700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c1511f0 con 0x7fe26c0bd360 2024-01-21T19:59:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe273118700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c065b20 con 0x7fe26c065fb0 2024-01-21T19:59:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe273118700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0c2ff0 con 0x7fe26c0a9e30 2024-01-21T19:59:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe2716b5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe26c0bd360 0x7fe26c154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58996/0 (socket says 172.21.15.133:58996) 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe2716b5700 1 -- 172.21.15.133:0/2684030425 learned_addr learned my addr 172.21.15.133:0/2684030425 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe270eb4700 1 --2- 172.21.15.133:0/2684030425 >> v2:172.21.15.178:3300/0 conn(0x7fe26c0a9e30 0x7fe26c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454748434 0 0) 0x7fe264001490 con 0x7fe26c0bd360 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c0033f0 con 0x7fe26c0bd360 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116724783 0 0) 0x7fe26c065b20 con 0x7fe26c065fb0 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264001490 con 0x7fe26c065fb0 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.932+0000 7fe270eb4700 1 -- 172.21.15.133:0/2684030425 >> v1:172.21.15.178:6789/0 conn(0x7fe26c065fb0 legacy=0x7fe26c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 139934745 0 0) 0x7fe25c0033f0 con 0x7fe26c0bd360 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe270eb4700 1 -- 172.21.15.133:0/2684030425 >> v1:172.21.15.133:6789/0 conn(0x7fe26c0bd360 legacy=0x7fe26c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe270eb4700 1 -- 172.21.15.133:0/2684030425 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0c2240 con 0x7fe26c0a9e30 2024-01-21T19:59:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe270eb4700 1 --2- 172.21.15.133:0/2684030425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0c2b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe260009760 tx=0x7fe260009060).ready entity=mon.1 client_cookie=8e5848e4d2d49ec0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264001980 con 0x7fe26c0a9e30 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2600090d0 con 0x7fe26c0a9e30 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2684030425 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe260011610 con 0x7fe26c0a9e30 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 -- 172.21.15.133:0/2684030425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 msgr2=0x7fe26c0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 --2- 172.21.15.133:0/2684030425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0c2b00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe260009760 tx=0x7fe260009060).stop 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 -- 172.21.15.133:0/2684030425 shutdown_connections 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 --2- 172.21.15.133:0/2684030425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0c2b00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 -- 172.21.15.133:0/2684030425 >> 172.21.15.133:0/2684030425 conn(0x7fe26c0c8200 msgr2=0x7fe26c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 -- 172.21.15.133:0/2684030425 shutdown_connections 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.933+0000 7fe273118700 1 -- 172.21.15.133:0/2684030425 wait complete. 2024-01-21T19:59:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.935+0000 7fe273118700 1 Processor -- start 2024-01-21T19:59:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.935+0000 7fe273118700 1 -- start start 2024-01-21T19:59:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.935+0000 7fe273118700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c065fb0 0x7fe26c13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0ad250 con 0x7fe26c0bd360 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c152e10 con 0x7fe26c0a9e30 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c1536b0 con 0x7fe26c065fb0 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42808/0 (socket says 172.21.15.133:42808) 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 -- 172.21.15.133:0/3422024778 learned_addr learned my addr 172.21.15.133:0/3422024778 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe26bfff700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 -- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c065fb0 msgr2=0x7fe26c13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe270eb4700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c065fb0 0x7fe26c13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c065fb0 0x7fe26c13e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 -- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 msgr2=0x7fe26c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 -- 172.21.15.133:0/3422024778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600092a0 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2716b5700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe26400cb60 tx=0x7fe264001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264004c40 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c158040 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264004dc0 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2640073c0 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.936+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c153340 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.937+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c153820 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.937+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe264007730 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.938+0000 7fe2697fa700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 0x7fe250061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.938+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe264079cf0 con 0x7fe26c0bd360 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.938+0000 7fe270eb4700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 0x7fe250061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.938+0000 7fe270eb4700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 0x7fe250061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe260009760 tx=0x7fe260016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:03.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:03.942+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe26407e070 con 0x7fe26c0bd360 2024-01-21T19:59:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.103+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe26c0c24e0 con 0x7fe26c0bd360 2024-01-21T19:59:04.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.104+0000 7fe2697fa700 1 -- 172.21.15.133:0/3422024778 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe26404b310 con 0x7fe26c0bd360 2024-01-21T19:59:04.095 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 msgr2=0x7fe250061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 0x7fe250061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe260009760 tx=0x7fe260016000).stop 2024-01-21T19:59:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 msgr2=0x7fe26c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe26400cb60 tx=0x7fe264001e90).stop 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 shutdown_connections 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe25005f150 0x7fe250061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.105+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c0bd360 0x7fe26c0acd60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.106+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c065fb0 0x7fe26c13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.106+0000 7fe273118700 1 --2- 172.21.15.133:0/3422024778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c0a9e30 0x7fe26c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.106+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 >> 172.21.15.133:0/3422024778 conn(0x7fe26c0c8200 msgr2=0x7fe26c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.106+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 shutdown_connections 2024-01-21T19:59:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.106+0000 7fe273118700 1 -- 172.21.15.133:0/3422024778 wait complete. 2024-01-21T19:59:04.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T19:59:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.232+0000 7ff534f9f700 1 Processor -- start 2024-01-21T19:59:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.233+0000 7ff534f9f700 1 -- start start 2024-01-21T19:59:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.233+0000 7ff534f9f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300beb30 0x7ff530155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.233+0000 7ff534f9f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5300c3fb0 0x7ff5300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff534f9f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff530069cd0 0x7ff530151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff534f9f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300bef10 con 0x7ff5300c3fb0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff534f9f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff530156070 con 0x7ff530069cd0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff534f9f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff530065660 con 0x7ff5300beb30 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5300c3fb0 0x7ff5300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5300c3fb0 0x7ff5300697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42812/0 (socket says 172.21.15.133:42812) 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 -- 172.21.15.133:0/3729155814 learned_addr learned my addr 172.21.15.133:0/3729155814 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52ed9d700 1 --2- 172.21.15.133:0/3729155814 >> v2:172.21.15.178:3300/0 conn(0x7ff530069cd0 0x7ff530151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52e59c700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300beb30 0x7ff530155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 -- 172.21.15.133:0/3729155814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300beb30 msgr2=0x7ff530155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300beb30 0x7ff530155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 -- 172.21.15.133:0/3729155814 >> v2:172.21.15.178:3300/0 conn(0x7ff530069cd0 msgr2=0x7ff530151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/3729155814 >> v2:172.21.15.178:3300/0 conn(0x7ff530069cd0 0x7ff530151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 -- 172.21.15.133:0/3729155814 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530065f00 con 0x7ff5300c3fb0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5300c3fb0 0x7ff5300697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff5300a76d0 tx=0x7ff5180090f0).ready entity=mon.0 client_cookie=b272c38d4f40b3a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52d59a700 1 -- 172.21.15.133:0/3729155814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800f510 con 0x7ff5300c3fb0 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52d59a700 1 -- 172.21.15.133:0/3729155814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51800f670 con 0x7ff5300c3fb0 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.234+0000 7ff52d59a700 1 -- 172.21.15.133:0/3729155814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51800fa10 con 0x7ff5300c3fb0 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 -- 172.21.15.133:0/3729155814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5300c3fb0 msgr2=0x7ff5300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5300c3fb0 0x7ff5300697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7ff5300a76d0 tx=0x7ff5180090f0).stop 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 -- 172.21.15.133:0/3729155814 shutdown_connections 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 --2- 172.21.15.133:0/3729155814 >> v2:172.21.15.178:3300/0 conn(0x7ff530069cd0 0x7ff530151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300beb30 0x7ff530155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 --2- 172.21.15.133:0/3729155814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5300c3fb0 0x7ff5300697e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 -- 172.21.15.133:0/3729155814 >> 172.21.15.133:0/3729155814 conn(0x7ff5300c8010 msgr2=0x7ff5300c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 -- 172.21.15.133:0/3729155814 shutdown_connections 2024-01-21T19:59:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.235+0000 7ff534f9f700 1 -- 172.21.15.133:0/3729155814 wait complete. 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.236+0000 7ff534f9f700 1 Processor -- start 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.236+0000 7ff534f9f700 1 -- start start 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5300beb30 0x7ff5300ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300c3fb0 0x7ff5300ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530168de0 con 0x7ff530069cd0 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300bf8a0 con 0x7ff5300beb30 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff534f9f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff530168b00 con 0x7ff5300c3fb0 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42824/0 (socket says 172.21.15.133:42824) 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 -- 172.21.15.133:0/613509322 learned_addr learned my addr 172.21.15.133:0/613509322 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5300beb30 0x7ff5300ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52ed9d700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300c3fb0 0x7ff5300ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 -- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300c3fb0 msgr2=0x7ff5300ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300c3fb0 0x7ff5300ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 -- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5300beb30 msgr2=0x7ff5300ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5300beb30 0x7ff5300ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.237+0000 7ff52e59c700 1 -- 172.21.15.133:0/613509322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518009370 con 0x7ff530069cd0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff52e59c700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff52000e900 tx=0x7ff520009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000c640 con 0x7ff530069cd0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000c7a0 con 0x7ff530069cd0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5300bf250 con 0x7ff530069cd0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000cb20 con 0x7ff530069cd0 2024-01-21T19:59:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.238+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff530139920 con 0x7ff530069cd0 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.239+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5300bf090 con 0x7ff530069cd0 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.239+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff52001b400 con 0x7ff530069cd0 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.239+0000 7ff526ffd700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 0x7ff510061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.239+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff52007a2d0 con 0x7ff530069cd0 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.240+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 0x7ff510061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.240+0000 7ff52dd9b700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 0x7ff510061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff5300a76d0 tx=0x7ff518016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.244+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff52004b890 con 0x7ff530069cd0 2024-01-21T19:59:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.408+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff53005fdf0 con 0x7ff530069cd0 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.408+0000 7ff526ffd700 1 -- 172.21.15.133:0/613509322 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff520016020 con 0x7ff530069cd0 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:04.400 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T19:59:04.401 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T19:59:04.401 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:04.401 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 msgr2=0x7ff510061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 0x7ff510061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff5300a76d0 tx=0x7ff518016000).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 msgr2=0x7ff530139430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff52000e900 tx=0x7ff520009060).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 shutdown_connections 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff51005f150 0x7ff510061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5300c3fb0 0x7ff5300ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff530069cd0 0x7ff530139430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 --2- 172.21.15.133:0/613509322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5300beb30 0x7ff5300ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 >> 172.21.15.133:0/613509322 conn(0x7ff5300c8010 msgr2=0x7ff5300bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 shutdown_connections 2024-01-21T19:59:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.410+0000 7ff534f9f700 1 -- 172.21.15.133:0/613509322 wait complete. 2024-01-21T19:59:04.413 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T19:59:04.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T19:59:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 Processor -- start 2024-01-21T19:59:04.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 -- start start 2024-01-21T19:59:04.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 0x7fdaa81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdaa80bd130 0x7fdaa80c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa80be2b0 con 0x7fdaa8069510 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.544+0000 7fdaaf0d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa80be740 con 0x7fdaa80bd130 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaaf0d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80bd6a0 con 0x7fdaa8150de0 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdaa80bd130 0x7fdaa80c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaad671700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdaa8069510 0x7fdaa8154c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59010/0 (socket says 172.21.15.133:59010) 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaad671700 1 -- 172.21.15.133:0/1863326763 learned_addr learned my addr 172.21.15.133:0/1863326763 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdaa80bd130 0x7fdaa80c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42830/0 (socket says 172.21.15.133:42830) 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 -- 172.21.15.133:0/1863326763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 msgr2=0x7fdaa81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaace70700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 0x7fdaa81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa77fe700 1 -- 172.21.15.133:0/1863326763 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803281352 0 0) 0x7fdaa80be2b0 con 0x7fdaa8069510 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 0x7fdaa81511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 -- 172.21.15.133:0/1863326763 >> v1:172.21.15.133:6789/0 conn(0x7fdaa8069510 legacy=0x7fdaa8154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 -- 172.21.15.133:0/1863326763 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa80bd980 con 0x7fdaa80bd130 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaace70700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 0x7fdaa81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa7fff700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa80bd130 0x7fdaa80c3f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fda94009760 tx=0x7fda94009060).ready entity=mon.0 client_cookie=af738b9d57dab530 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa77fe700 1 -- 172.21.15.133:0/1863326763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400b580 con 0x7fdaa80bd130 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa77fe700 1 -- 172.21.15.133:0/1863326763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9400b6e0 con 0x7fdaa80bd130 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.545+0000 7fdaa77fe700 1 -- 172.21.15.133:0/1863326763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400ba60 con 0x7fdaa80bd130 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/1863326763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa80bd130 msgr2=0x7fdaa80c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa80bd130 0x7fdaa80c3f70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fda94009760 tx=0x7fda94009060).stop 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/1863326763 shutdown_connections 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa8150de0 0x7fdaa81511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/1863326763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa80bd130 0x7fdaa80c3f70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/1863326763 >> 172.21.15.133:0/1863326763 conn(0x7fdaa80c7d30 msgr2=0x7fdaa80c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/1863326763 shutdown_connections 2024-01-21T19:59:04.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.546+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/1863326763 wait complete. 2024-01-21T19:59:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.547+0000 7fdaaf0d4700 1 Processor -- start 2024-01-21T19:59:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.547+0000 7fdaaf0d4700 1 -- start start 2024-01-21T19:59:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa8069510 0x7fdaa80c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa80bd130 0x7fdaa813a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80c1c00 con 0x7fdaa8150de0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa813ad10 con 0x7fdaa8069510 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.548+0000 7fdaaf0d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa80bf170 con 0x7fdaa80bd130 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42844/0 (socket says 172.21.15.133:42844) 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 -- 172.21.15.133:0/3291595963 learned_addr learned my addr 172.21.15.133:0/3291595963 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaa7fff700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa80bd130 0x7fdaa813a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 -- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa80bd130 msgr2=0x7fdaa813a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa80bd130 0x7fdaa813a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 -- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa8069510 msgr2=0x7fdaa80c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa8069510 0x7fdaa80c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 -- 172.21.15.133:0/3291595963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda940092a0 con 0x7fdaa8150de0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaad671700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fdaa000c7e0 tx=0x7fdaa0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0005d30 con 0x7fdaa8150de0 2024-01-21T19:59:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0005e90 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0007320 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa80bf450 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.549+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa80bfa10 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.550+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa805fdf0 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.550+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdaa0007710 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.551+0000 7fdaa57fa700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 0x7fda8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.551+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdaa0079f30 con 0x7fdaa8150de0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.551+0000 7fdaace70700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 0x7fda8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:04.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.551+0000 7fdaace70700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 0x7fda8c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fda9c00a880 tx=0x7fda9c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.555+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdaa004b550 con 0x7fdaa8150de0 2024-01-21T19:59:04.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:04.717+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fdaa80ac170 con 0x7fdaa8150de0 2024-01-21T19:59:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.012+0000 7fdaa57fa700 1 -- 172.21.15.133:0/3291595963 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7fdaa004eb70 con 0x7fdaa8150de0 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 msgr2=0x7fda8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 0x7fda8c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fda9c00a880 tx=0x7fda9c008040).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 msgr2=0x7fdaa813c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fdaa000c7e0 tx=0x7fdaa0007f90).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 shutdown_connections 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda8c05f150 0x7fda8c061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdaa8150de0 0x7fdaa813c450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaa8069510 0x7fdaa80c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 --2- 172.21.15.133:0/3291595963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaa80bd130 0x7fdaa813a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 >> 172.21.15.133:0/3291595963 conn(0x7fdaa80c7d30 msgr2=0x7fdaa8153710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 shutdown_connections 2024-01-21T19:59:05.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.018+0000 7fdaaf0d4700 1 -- 172.21.15.133:0/3291595963 wait complete. 2024-01-21T19:59:05.011 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T19:59:05.022 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T19:59:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.153+0000 7f7d808bd700 1 Processor -- start 2024-01-21T19:59:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.153+0000 7f7d808bd700 1 -- start start 2024-01-21T19:59:05.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0aa0f0 0x7f7d7c063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 0x7f7d7c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c0640d0 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c063750 con 0x7f7d7c0c4920 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.154+0000 7f7d808bd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c05e380 con 0x7f7d7c0aa0f0 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42846/0 (socket says 172.21.15.133:42846) 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 -- 172.21.15.133:0/3547834225 learned_addr learned my addr 172.21.15.133:0/3547834225 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7ad9d700 1 --2- 172.21.15.133:0/3547834225 >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 0x7f7d7c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d79d9b700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0aa0f0 0x7f7d7c063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 -- 172.21.15.133:0/3547834225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0aa0f0 msgr2=0x7f7d7c063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0aa0f0 0x7f7d7c063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 -- 172.21.15.133:0/3547834225 >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 msgr2=0x7f7d7c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/3547834225 >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 0x7f7d7c1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 -- 172.21.15.133:0/3547834225 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c05e660 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7ad9d700 1 --2- 172.21.15.133:0/3547834225 >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 0x7f7d7c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7d7c069010 tx=0x7f7d700090f0).ready entity=mon.0 client_cookie=3e761f790040c758 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7959a700 1 -- 172.21.15.133:0/3547834225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000b600 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7959a700 1 -- 172.21.15.133:0/3547834225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7000b760 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.155+0000 7f7d7959a700 1 -- 172.21.15.133:0/3547834225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7000bb00 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 -- 172.21.15.133:0/3547834225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0a9d10 msgr2=0x7f7d7c0ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f7d7c069010 tx=0x7f7d700090f0).stop 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 -- 172.21.15.133:0/3547834225 shutdown_connections 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 --2- 172.21.15.133:0/3547834225 >> v2:172.21.15.178:3300/0 conn(0x7f7d7c0c4920 0x7f7d7c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0a9d10 0x7f7d7c0ad410 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 --2- 172.21.15.133:0/3547834225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0aa0f0 0x7f7d7c063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 -- 172.21.15.133:0/3547834225 >> 172.21.15.133:0/3547834225 conn(0x7f7d7c0c8200 msgr2=0x7f7d7c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:05.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 -- 172.21.15.133:0/3547834225 shutdown_connections 2024-01-21T19:59:05.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.156+0000 7f7d808bd700 1 -- 172.21.15.133:0/3547834225 wait complete. 2024-01-21T19:59:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.157+0000 7f7d808bd700 1 Processor -- start 2024-01-21T19:59:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.157+0000 7f7d808bd700 1 -- start start 2024-01-21T19:59:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0a9d10 0x7f7d7c151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c0aa0f0 0x7f7d7c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c157550 con 0x7f7d7c0c4920 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c168630 con 0x7f7d7c0aa0f0 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d808bd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c168910 con 0x7f7d7c0a9d10 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42858/0 (socket says 172.21.15.133:42858) 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 -- 172.21.15.133:0/208770849 learned_addr learned my addr 172.21.15.133:0/208770849 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0a9d10 0x7f7d7c151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d79d9b700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c0aa0f0 0x7f7d7c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 -- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0a9d10 msgr2=0x7f7d7c151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0a9d10 0x7f7d7c151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 -- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c0aa0f0 msgr2=0x7f7d7c1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c0aa0f0 0x7f7d7c1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 -- 172.21.15.133:0/208770849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70009370 con 0x7f7d7c0c4920 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.158+0000 7f7d7ad9d700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7d7400cef0 tx=0x7f7d74007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.159+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400ad20 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.159+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7400ae80 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.159+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c156f00 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.159+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74016610 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.159+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c153a90 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.160+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c1576c0 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.160+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7d740203f0 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.160+0000 7f7d6affd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 0x7f7d5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.160+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f7d7407a950 con 0x7f7d7c0c4920 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.160+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 0x7f7d5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:05.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.161+0000 7f7d7a59c700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 0x7f7d5c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7d70009fd0 tx=0x7f7d70017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.165+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7d7404bda0 con 0x7f7d7c0c4920 2024-01-21T19:59:05.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:05.330+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7d7c05fdf0 con 0x7f7d7c0c4920 2024-01-21T19:59:06.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.014+0000 7f7d6affd700 1 -- 172.21.15.133:0/208770849 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7d7404f3c0 con 0x7f7d7c0c4920 2024-01-21T19:59:06.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 msgr2=0x7f7d5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 0x7f7d5c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7d70009fd0 tx=0x7f7d70017000).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 msgr2=0x7f7d7c167bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7d7400cef0 tx=0x7f7d74007860).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 shutdown_connections 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d5c05f150 0x7f7d5c061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d7c0c4920 0x7f7d7c167bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7c0a9d10 0x7f7d7c151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 --2- 172.21.15.133:0/208770849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c0aa0f0 0x7f7d7c1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.019+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 >> 172.21.15.133:0/208770849 conn(0x7f7d7c0c8200 msgr2=0x7f7d7c0ad040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.020+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 shutdown_connections 2024-01-21T19:59:06.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.020+0000 7f7d808bd700 1 -- 172.21.15.133:0/208770849 wait complete. 2024-01-21T19:59:06.016 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T19:59:06.037 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T19:59:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.168+0000 7f47dee7d700 1 Processor -- start 2024-01-21T19:59:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.168+0000 7f47dee7d700 1 -- start start 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dee7d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47d80acbc0 0x7f47d80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dee7d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47d81521e0 0x7f47d8152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dee7d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d8065fd0 con 0x7f47d8066460 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dee7d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d8063be0 con 0x7f47d80acbc0 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dee7d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d80653c0 con 0x7f47d81521e0 2024-01-21T19:59:06.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dcc19700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47d80acbc0 0x7f47d80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dcc19700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47d80acbc0 0x7f47d80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42866/0 (socket says 172.21.15.133:42866) 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dcc19700 1 -- 172.21.15.133:0/1479022490 learned_addr learned my addr 172.21.15.133:0/1479022490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.169+0000 7f47dd41a700 1 --2- 172.21.15.133:0/1479022490 >> v2:172.21.15.178:3300/0 conn(0x7f47d81521e0 0x7f47d8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dcc19700 1 -- 172.21.15.133:0/1479022490 >> v2:172.21.15.178:3300/0 conn(0x7f47d81521e0 msgr2=0x7f47d8152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dcc19700 1 --2- 172.21.15.133:0/1479022490 >> v2:172.21.15.178:3300/0 conn(0x7f47d81521e0 0x7f47d8152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dcc19700 1 -- 172.21.15.133:0/1479022490 >> v1:172.21.15.133:6789/0 conn(0x7f47d8066460 legacy=0x7f47d80634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47d77fe700 1 -- 172.21.15.133:0/1479022490 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929644852 0 0) 0x7f47d8065fd0 con 0x7f47d8066460 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dcc19700 1 -- 172.21.15.133:0/1479022490 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d80656a0 con 0x7f47d80acbc0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dcc19700 1 --2- 172.21.15.133:0/1479022490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d80acbc0 0x7f47d80acfa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f47d805e880 tx=0x7f47cc0090f0).ready entity=mon.0 client_cookie=d45e77fd3ab8d21b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47d77fe700 1 -- 172.21.15.133:0/1479022490 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00b600 con 0x7f47d80acbc0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47d77fe700 1 -- 172.21.15.133:0/1479022490 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc00b760 con 0x7f47d80acbc0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47d77fe700 1 -- 172.21.15.133:0/1479022490 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00bae0 con 0x7f47d80acbc0 2024-01-21T19:59:06.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 -- 172.21.15.133:0/1479022490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d80acbc0 msgr2=0x7f47d80acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1479022490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d80acbc0 0x7f47d80acfa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f47d805e880 tx=0x7f47cc0090f0).stop 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 -- 172.21.15.133:0/1479022490 shutdown_connections 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1479022490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d80acbc0 0x7f47d80acfa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1479022490 >> v2:172.21.15.178:3300/0 conn(0x7f47d81521e0 0x7f47d8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 -- 172.21.15.133:0/1479022490 >> 172.21.15.133:0/1479022490 conn(0x7f47d80c8200 msgr2=0x7f47d80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 -- 172.21.15.133:0/1479022490 shutdown_connections 2024-01-21T19:59:06.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.170+0000 7f47dee7d700 1 -- 172.21.15.133:0/1479022490 wait complete. 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.171+0000 7f47dee7d700 1 Processor -- start 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 -- start start 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47d8066460 0x7f47d8145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47d80acbc0 0x7f47d81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80bfb50 con 0x7f47d81521e0 2024-01-21T19:59:06.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8145a50 con 0x7f47d8066460 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.172+0000 7f47dee7d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8154ea0 con 0x7f47d80acbc0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42872/0 (socket says 172.21.15.133:42872) 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 -- 172.21.15.133:0/1098815424 learned_addr learned my addr 172.21.15.133:0/1098815424 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47d7fff700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47d80acbc0 0x7f47d81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dcc19700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47d8066460 0x7f47d8145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 -- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47d80acbc0 msgr2=0x7f47d81544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47d80acbc0 0x7f47d81544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 -- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47d8066460 msgr2=0x7f47d8145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47d8066460 0x7f47d8145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 -- 172.21.15.133:0/1098815424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009370 con 0x7f47d81521e0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dd41a700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f47d000cdb0 tx=0x7f47d00077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000aa80 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000abe0 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d8155180 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000f400 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.173+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d80bf7e0 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.174+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d805fdf0 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.174+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f47d000d040 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.175+0000 7f47d57fa700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 0x7f47bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.175+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f47d007a320 con 0x7f47d81521e0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.175+0000 7f47dcc19700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 0x7f47bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.175+0000 7f47dcc19700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 0x7f47bc061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f47cc009fd0 tx=0x7f47cc017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.179+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f47d004b650 con 0x7f47d81521e0 2024-01-21T19:59:06.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.383+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47d8065980 con 0x7f47d81521e0 2024-01-21T19:59:06.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.388+0000 7f47d57fa700 1 -- 172.21.15.133:0/1098815424 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f47d001d0c0 con 0x7f47d81521e0 2024-01-21T19:59:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.393+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 msgr2=0x7f47bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.393+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 0x7f47bc061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f47cc009fd0 tx=0x7f47cc017000).stop 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.393+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 msgr2=0x7f47d80bffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.393+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f47d000cdb0 tx=0x7f47d00077d0).stop 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 shutdown_connections 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f47bc05f150 0x7f47bc061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47d81521e0 0x7f47d80bffe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47d8066460 0x7f47d8145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 --2- 172.21.15.133:0/1098815424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47d80acbc0 0x7f47d81544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.394+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 >> 172.21.15.133:0/1098815424 conn(0x7f47d80c8200 msgr2=0x7f47d8155790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.395+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 shutdown_connections 2024-01-21T19:59:06.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.396+0000 7f47dee7d700 1 -- 172.21.15.133:0/1098815424 wait complete. 2024-01-21T19:59:06.390 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 3 and data pool 4 2024-01-21T19:59:06.409 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 Processor -- start 2024-01-21T19:59:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 -- start start 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d38154a90 0x7f9d380a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380654f0 con 0x7f9d380bc6d0 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d38063700 con 0x7f9d381546b0 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.533+0000 7f9d3dbe5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d38063950 con 0x7f9d38154a90 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d38154a90 0x7f9d380a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d38154a90 0x7f9d380a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42886/0 (socket says 172.21.15.133:42886) 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3920933725 learned_addr learned my addr 172.21.15.133:0/3920933725 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d37fff700 1 --1- 172.21.15.133:0/3920933725 >> v1:172.21.15.133:6789/0 conn(0x7f9d380bc6d0 0x7f9d38066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59040/0 (socket says 172.21.15.133:59040) 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3920933725 >> v1:172.21.15.178:6789/0 conn(0x7f9d381546b0 legacy=0x7f9d38065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3920933725 >> v1:172.21.15.133:6789/0 conn(0x7f9d380bc6d0 legacy=0x7f9d38066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d367fc700 1 -- 172.21.15.133:0/3920933725 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653845879 0 0) 0x7f9d380654f0 con 0x7f9d380bc6d0 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3920933725 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38065180 con 0x7f9d38154a90 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3920933725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380a9e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9d20006fd0 tx=0x7f9d200090f0).ready entity=mon.0 client_cookie=8b23440c440629bb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d367fc700 1 -- 172.21.15.133:0/3920933725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000b600 con 0x7f9d38154a90 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d367fc700 1 -- 172.21.15.133:0/3920933725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2000b760 con 0x7f9d38154a90 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.534+0000 7f9d367fc700 1 -- 172.21.15.133:0/3920933725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2000bb00 con 0x7f9d38154a90 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3920933725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 msgr2=0x7f9d380a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3920933725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380a9e30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9d20006fd0 tx=0x7f9d200090f0).stop 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3920933725 shutdown_connections 2024-01-21T19:59:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3920933725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380a9e30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3920933725 >> 172.21.15.133:0/3920933725 conn(0x7f9d380c8200 msgr2=0x7f9d380c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3920933725 shutdown_connections 2024-01-21T19:59:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.535+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3920933725 wait complete. 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.536+0000 7f9d3dbe5700 1 Processor -- start 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.536+0000 7f9d3dbe5700 1 -- start start 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 0x7f9d38157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 0x7f9d380ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380ac520 con 0x7f9d38154a90 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380ab910 con 0x7f9d381546b0 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d3dbe5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380abbf0 con 0x7f9d380bc6d0 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42890/0 (socket says 172.21.15.133:42890) 2024-01-21T19:59:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 -- 172.21.15.133:0/3257159192 learned_addr learned my addr 172.21.15.133:0/3257159192 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 0x7f9d380ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 0x7f9d38157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 -- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 msgr2=0x7f9d38157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 0x7f9d38157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 -- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 msgr2=0x7f9d380ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 0x7f9d380ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 -- 172.21.15.133:0/3257159192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d20009370 con 0x7f9d38154a90 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 0x7f9d38157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 0x7f9d380ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.537+0000 7f9d37fff700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9d3000c730 tx=0x7f9d30001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.538+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30005c70 con 0x7f9d38154a90 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.538+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d30005dd0 con 0x7f9d38154a90 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.538+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380abed0 con 0x7f9d38154a90 2024-01-21T19:59:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.538+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30007340 con 0x7f9d38154a90 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.538+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380c0e40 con 0x7f9d38154a90 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.539+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380ac690 con 0x7f9d38154a90 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.539+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d300076f0 con 0x7f9d38154a90 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.539+0000 7f9d2ffff700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 0x7f9d18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.540+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 0x7f9d18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.540+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9d3007a270 con 0x7f9d38154a90 2024-01-21T19:59:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.540+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 0x7f9d18061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9d28001670 tx=0x7f9d28009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.544+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d3004b4e0 con 0x7f9d38154a90 2024-01-21T19:59:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.707+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d3805fdf0 con 0x7f9d38154a90 2024-01-21T19:59:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.708+0000 7f9d2ffff700 1 -- 172.21.15.133:0/3257159192 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f9d3004eb00 con 0x7f9d38154a90 2024-01-21T19:59:06.700 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:06.700 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:06.384905+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 msgr2=0x7f9d18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 0x7f9d18061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9d28001670 tx=0x7f9d28009040).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 msgr2=0x7f9d380c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f9d3000c730 tx=0x7f9d30001520).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 shutdown_connections 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d1805f150 0x7f9d18061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d38154a90 0x7f9d380c0950 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d380bc6d0 0x7f9d38157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 --2- 172.21.15.133:0/3257159192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d381546b0 0x7f9d380ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 >> 172.21.15.133:0/3257159192 conn(0x7f9d380c8200 msgr2=0x7f9d38151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 shutdown_connections 2024-01-21T19:59:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.710+0000 7f9d3dbe5700 1 -- 172.21.15.133:0/3257159192 wait complete. 2024-01-21T19:59:06.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.838+0000 7feb9d7f3700 1 Processor -- start 2024-01-21T19:59:06.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.838+0000 7feb9d7f3700 1 -- start start 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb9d7f3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb98155b80 0x7feb980c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb9d7f3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb98065660 con 0x7feb98069ef0 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb9d7f3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb98065f00 con 0x7feb980beb30 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb9d7f3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980bef10 con 0x7feb98155b80 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb98155b80 0x7feb980c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb98155b80 0x7feb980c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42906/0 (socket says 172.21.15.133:42906) 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb977fe700 1 -- 172.21.15.133:0/2011208826 learned_addr learned my addr 172.21.15.133:0/2011208826 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.839+0000 7feb967fc700 1 --1- 172.21.15.133:0/2011208826 >> v1:172.21.15.133:6789/0 conn(0x7feb98069ef0 0x7feb98066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59050/0 (socket says 172.21.15.133:59050) 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb977fe700 1 -- 172.21.15.133:0/2011208826 >> v1:172.21.15.178:6789/0 conn(0x7feb980beb30 legacy=0x7feb980697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb977fe700 1 -- 172.21.15.133:0/2011208826 >> v1:172.21.15.133:6789/0 conn(0x7feb98069ef0 legacy=0x7feb98066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb95ffb700 1 -- 172.21.15.133:0/2011208826 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096749648 0 0) 0x7feb98065660 con 0x7feb98069ef0 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb977fe700 1 -- 172.21.15.133:0/2011208826 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980c44a0 con 0x7feb98155b80 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb977fe700 1 --2- 172.21.15.133:0/2011208826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb980c3fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7feb90009f20 tx=0x7feb90009840).ready entity=mon.0 client_cookie=6f17c66847688de8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb95ffb700 1 -- 172.21.15.133:0/2011208826 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000e070 con 0x7feb98155b80 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb95ffb700 1 -- 172.21.15.133:0/2011208826 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000ba40 con 0x7feb98155b80 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb95ffb700 1 -- 172.21.15.133:0/2011208826 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000bdc0 con 0x7feb98155b80 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 -- 172.21.15.133:0/2011208826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 msgr2=0x7feb980c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/2011208826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb980c3fb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7feb90009f20 tx=0x7feb90009840).stop 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 -- 172.21.15.133:0/2011208826 shutdown_connections 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/2011208826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb980c3fb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 -- 172.21.15.133:0/2011208826 >> 172.21.15.133:0/2011208826 conn(0x7feb980c8010 msgr2=0x7feb980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.840+0000 7feb9d7f3700 1 -- 172.21.15.133:0/2011208826 shutdown_connections 2024-01-21T19:59:06.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.841+0000 7feb9d7f3700 1 -- 172.21.15.133:0/2011208826 wait complete. 2024-01-21T19:59:06.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.842+0000 7feb9d7f3700 1 Processor -- start 2024-01-21T19:59:06.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.842+0000 7feb9d7f3700 1 -- start start 2024-01-21T19:59:06.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 0x7feb980a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb980beb30 0x7feb980a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb980a5ce0 con 0x7feb98155b80 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98139b40 con 0x7feb98069ef0 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98150760 con 0x7feb980beb30 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42914/0 (socket says 172.21.15.133:42914) 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 -- 172.21.15.133:0/3612040156 learned_addr learned my addr 172.21.15.133:0/3612040156 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb96ffd700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 0x7feb980a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb967fc700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb980beb30 0x7feb980a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 -- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb980beb30 msgr2=0x7feb980a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb980beb30 0x7feb980a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 -- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 msgr2=0x7feb980a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:06.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 0x7feb980a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 -- 172.21.15.133:0/3612040156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009ae0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb96ffd700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 0x7feb980a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb977fe700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7feb98068a00 tx=0x7feb90009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9000bdc0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9001c400 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9001c7c0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb980a67b0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.843+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb98139210 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.844+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb98139cf0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.845+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feb9001cbf0 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.845+0000 7feb7f7fe700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 0x7feb84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.845+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feb9007bd50 con 0x7feb98155b80 2024-01-21T19:59:06.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.845+0000 7feb96ffd700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 0x7feb84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:06.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.846+0000 7feb96ffd700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 0x7feb84061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feb8c002780 tx=0x7feb8c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:06.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:06.849+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feb98139cf0 con 0x7feb98155b80 2024-01-21T19:59:07.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.013+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb9805fdf0 con 0x7feb98155b80 2024-01-21T19:59:07.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.015+0000 7feb7f7fe700 1 -- 172.21.15.133:0/3612040156 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7feb9007f030 con 0x7feb98155b80 2024-01-21T19:59:07.008 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:07.008 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:06.384905+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 msgr2=0x7feb84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 0x7feb84061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7feb8c002780 tx=0x7feb8c009040).stop 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 msgr2=0x7feb981571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7feb98068a00 tx=0x7feb90009840).stop 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 shutdown_connections 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feb8405f150 0x7feb84061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb98155b80 0x7feb981571c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb98069ef0 0x7feb980a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 --2- 172.21.15.133:0/3612040156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb980beb30 0x7feb980a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 >> 172.21.15.133:0/3612040156 conn(0x7feb980c8010 msgr2=0x7feb98150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:07.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 shutdown_connections 2024-01-21T19:59:07.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.017+0000 7feb9d7f3700 1 -- 172.21.15.133:0/3612040156 wait complete. 2024-01-21T19:59:07.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T19:59:07.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.147+0000 7fbf93faf700 1 Processor -- start 2024-01-21T19:59:07.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.148+0000 7fbf93faf700 1 -- start start 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.148+0000 7fbf93faf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf8c155b80 0x7fbf8c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.148+0000 7fbf93faf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c065660 con 0x7fbf8c0beb30 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.148+0000 7fbf93faf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c065f00 con 0x7fbf8c069ef0 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.148+0000 7fbf93faf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c0bef10 con 0x7fbf8c155b80 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf91d4b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbf8c0beb30 0x7fbf8c0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59052/0 (socket says 172.21.15.133:59052) 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf91d4b700 1 -- 172.21.15.133:0/1376853793 learned_addr learned my addr 172.21.15.133:0/1376853793 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf9254c700 1 --2- 172.21.15.133:0/1376853793 >> v2:172.21.15.178:3300/0 conn(0x7fbf8c155b80 0x7fbf8c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861959420 0 0) 0x7fbf8c065660 con 0x7fbf8c0beb30 2024-01-21T19:59:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf780033f0 con 0x7fbf8c0beb30 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541504025 0 0) 0x7fbf780033f0 con 0x7fbf8c0beb30 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 >> v2:172.21.15.178:3300/0 conn(0x7fbf8c155b80 msgr2=0x7fbf8c0c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 --2- 172.21.15.133:0/1376853793 >> v2:172.21.15.178:3300/0 conn(0x7fbf8c155b80 0x7fbf8c0c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 >> v1:172.21.15.178:6789/0 conn(0x7fbf8c069ef0 legacy=0x7fbf8c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0c44a0 con 0x7fbf8c0beb30 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fbf80001470 con 0x7fbf8c0beb30 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 >> v1:172.21.15.133:6789/0 conn(0x7fbf8c0beb30 legacy=0x7fbf8c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780038e0 0x7fbf78003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf78004690 0x7fbf78004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf7800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0bef10 con 0x7fbf78005050 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7800bfe0 con 0x7fbf780038e0 2024-01-21T19:59:07.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7800c1a0 con 0x7fbf78004690 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf9254c700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf7800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf91d4b700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780038e0 0x7fbf78003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf9154a700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf78004690 0x7fbf78004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf9254c700 1 -- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf78004690 msgr2=0x7fbf78004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.149+0000 7fbf9254c700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf78004690 0x7fbf78004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf9254c700 1 -- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780038e0 msgr2=0x7fbf78003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf9254c700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780038e0 0x7fbf78003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf9254c700 1 -- 172.21.15.133:0/1376853793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780033f0 con 0x7fbf78005050 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf91d4b700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf780038e0 0x7fbf78003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf9254c700 1 -- 172.21.15.133:0/1376853793 reap_dead start 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf9254c700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf7800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbf840094d0 tx=0x7fbf8400b040).ready entity=mon.0 client_cookie=4516db872af2d77d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84009bb0 con 0x7fbf78005050 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84010d60 con 0x7fbf78005050 2024-01-21T19:59:07.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf90d49700 1 -- 172.21.15.133:0/1376853793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84012640 con 0x7fbf78005050 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 -- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 msgr2=0x7fbf7800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf7800b8e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbf840094d0 tx=0x7fbf8400b040).stop 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 -- 172.21.15.133:0/1376853793 shutdown_connections 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 --2- 172.21.15.133:0/1376853793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf7800b8e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 -- 172.21.15.133:0/1376853793 >> 172.21.15.133:0/1376853793 conn(0x7fbf8c0c8010 msgr2=0x7fbf8c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 -- 172.21.15.133:0/1376853793 shutdown_connections 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.150+0000 7fbf93faf700 1 -- 172.21.15.133:0/1376853793 wait complete. 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 Processor -- start 2024-01-21T19:59:07.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 -- start start 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8c1607d0 0x7fbf8c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c0c5ed0 0x7fbf8c0c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c160c50 con 0x7fbf78005050 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c161700 con 0x7fbf8c0c5ed0 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf93faf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c163f80 con 0x7fbf8c1607d0 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf91d4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf91d4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42934/0 (socket says 172.21.15.133:42934) 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.152+0000 7fbf91d4b700 1 -- 172.21.15.133:0/3454018328 learned_addr learned my addr 172.21.15.133:0/3454018328 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf9254c700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c0c5ed0 0x7fbf8c0c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf9154a700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8c1607d0 0x7fbf8c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 -- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8c1607d0 msgr2=0x7fbf8c150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8c1607d0 0x7fbf8c150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 -- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c0c5ed0 msgr2=0x7fbf8c0c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c0c5ed0 0x7fbf8c0c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 -- 172.21.15.133:0/3454018328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c160e60 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf91d4b700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbf80000fd0 tx=0x7fbf80001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000f8d0 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8000fa30 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c161140 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8000fdd0 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.153+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c1513e0 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.154+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c164260 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.154+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbf80015620 con 0x7fbf78005050 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.154+0000 7fbf7e7fc700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 0x7fbf70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.155+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbf8007a6f0 con 0x7fbf78005050 2024-01-21T19:59:07.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.155+0000 7fbf9154a700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 0x7fbf70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.155+0000 7fbf9154a700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 0x7fbf70061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbf88000f60 tx=0x7fbf88009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.159+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf8004b9c0 con 0x7fbf78005050 2024-01-21T19:59:07.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.363+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbf8c095ee0 con 0x7fbf78005050 2024-01-21T19:59:07.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.389+0000 7fbf7e7fc700 1 -- 172.21.15.133:0/3454018328 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbf8004efe0 con 0x7fbf78005050 2024-01-21T19:59:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 msgr2=0x7fbf70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 0x7fbf70061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fbf88000f60 tx=0x7fbf88009040).stop 2024-01-21T19:59:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 msgr2=0x7fbf8c0bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbf80000fd0 tx=0x7fbf80001e50).stop 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 shutdown_connections 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7005f150 0x7fbf70061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8c0c5ed0 0x7fbf8c0c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf78005050 0x7fbf8c0bf0b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 --2- 172.21.15.133:0/3454018328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8c1607d0 0x7fbf8c150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 >> 172.21.15.133:0/3454018328 conn(0x7fbf8c0c8010 msgr2=0x7fbf8c155340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 shutdown_connections 2024-01-21T19:59:07.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.391+0000 7fbf93faf700 1 -- 172.21.15.133:0/3454018328 wait complete. 2024-01-21T19:59:07.396 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T19:59:07.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T19:59:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.523+0000 7f3bfbae3700 1 Processor -- start 2024-01-21T19:59:07.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.523+0000 7f3bfbae3700 1 -- start start 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfbae3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf4062e00 0x7f3bf40a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfbae3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3bf413aa00 0x7f3bf4158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfbae3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf41584f0 con 0x7f3bf413a620 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfbae3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40bd6f0 con 0x7f3bf4062e00 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfbae3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40654e0 con 0x7f3bf413aa00 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf4062e00 0x7f3bf40a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf987f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3bf413a620 0x7f3bf40626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59060/0 (socket says 172.21.15.133:59060) 2024-01-21T19:59:07.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf4062e00 0x7f3bf40a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42940/0 (socket says 172.21.15.133:42940) 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf987f700 1 -- 172.21.15.133:0/1073080653 learned_addr learned my addr 172.21.15.133:0/1073080653 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bfa080700 1 --2- 172.21.15.133:0/1073080653 >> v2:172.21.15.178:3300/0 conn(0x7f3bf413aa00 0x7f3bf4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 -- 172.21.15.133:0/1073080653 >> v2:172.21.15.178:3300/0 conn(0x7f3bf413aa00 msgr2=0x7f3bf4158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 --2- 172.21.15.133:0/1073080653 >> v2:172.21.15.178:3300/0 conn(0x7f3bf413aa00 0x7f3bf4158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 -- 172.21.15.133:0/1073080653 >> v1:172.21.15.133:6789/0 conn(0x7f3bf413a620 legacy=0x7f3bf40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf887d700 1 -- 172.21.15.133:0/1073080653 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381132440 0 0) 0x7f3bf0001110 con 0x7f3bf413a620 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 -- 172.21.15.133:0/1073080653 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4158730 con 0x7f3bf4062e00 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.524+0000 7f3bf907e700 1 --2- 172.21.15.133:0/1073080653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf4062e00 0x7f3bf40a6e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3bf4068da0 tx=0x7f3be4009060).ready entity=mon.0 client_cookie=3bc582d0d9098406 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bf887d700 1 -- 172.21.15.133:0/1073080653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40090d0 con 0x7f3bf4062e00 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bf887d700 1 -- 172.21.15.133:0/1073080653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400b580 con 0x7f3bf4062e00 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bf887d700 1 -- 172.21.15.133:0/1073080653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400b900 con 0x7f3bf4062e00 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 -- 172.21.15.133:0/1073080653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf4062e00 msgr2=0x7f3bf40a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/1073080653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf4062e00 0x7f3bf40a6e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3bf4068da0 tx=0x7f3be4009060).stop 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 -- 172.21.15.133:0/1073080653 shutdown_connections 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/1073080653 >> v2:172.21.15.178:3300/0 conn(0x7f3bf413aa00 0x7f3bf4158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/1073080653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf4062e00 0x7f3bf40a6e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 -- 172.21.15.133:0/1073080653 >> 172.21.15.133:0/1073080653 conn(0x7f3bf40c7dc0 msgr2=0x7f3bf40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 -- 172.21.15.133:0/1073080653 shutdown_connections 2024-01-21T19:59:07.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.525+0000 7f3bfbae3700 1 -- 172.21.15.133:0/1073080653 wait complete. 2024-01-21T19:59:07.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.526+0000 7f3bfbae3700 1 Processor -- start 2024-01-21T19:59:07.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.526+0000 7f3bfbae3700 1 -- start start 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bf4062e00 0x7f3bf4139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 0x7f3bf40c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c65b0 con 0x7f3bf413a620 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40ac690 con 0x7f3bf413aa00 2024-01-21T19:59:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfbae3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40acb20 con 0x7f3bf4062e00 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bf907e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bf907e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42952/0 (socket says 172.21.15.133:42952) 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bf907e700 1 -- 172.21.15.133:0/2137322681 learned_addr learned my addr 172.21.15.133:0/2137322681 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bfa080700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 0x7f3bf40c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.527+0000 7f3bf987f700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bf4062e00 0x7f3bf4139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 -- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bf4062e00 msgr2=0x7f3bf4139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bf4062e00 0x7f3bf4139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 -- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 msgr2=0x7f3bf40c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 0x7f3bf40c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:07.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 -- 172.21.15.133:0/2137322681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40092a0 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bfa080700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 0x7f3bf40c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bf907e700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3be4009fd0 tx=0x7f3be4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400b900 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400bcc0 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be401b440 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf40aba80 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.528+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40ac040 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.529+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf40ac820 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.529+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3be401b870 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.530+0000 7f3bea777700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 0x7f3bd8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.530+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3be407b910 con 0x7f3bf413a620 2024-01-21T19:59:07.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.530+0000 7f3bf987f700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 0x7f3bd8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:07.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.530+0000 7f3bf987f700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 0x7f3bd8061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3bf0001720 tx=0x7f3bf0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:07.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.534+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3be404cb80 con 0x7f3bf413a620 2024-01-21T19:59:07.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:07.742+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3bf405fdf0 con 0x7f3bf413a620 2024-01-21T19:59:07.993 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T19:59:08.001+0000 7f1da3ee6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T19:59:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.394+0000 7f3bea777700 1 -- 172.21.15.133:0/2137322681 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3be4028020 con 0x7f3bf413a620 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 msgr2=0x7f3bd8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 0x7f3bd8061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3bf0001720 tx=0x7f3bf0009040).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 msgr2=0x7f3bf40c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3be4009fd0 tx=0x7f3be4017000).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 shutdown_connections 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3bd805f150 0x7f3bd8061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bf413aa00 0x7f3bf40c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bf4062e00 0x7f3bf4139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 --2- 172.21.15.133:0/2137322681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf413a620 0x7f3bf40c5bd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.396+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 >> 172.21.15.133:0/2137322681 conn(0x7f3bf40c7dc0 msgr2=0x7f3bf4156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.397+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 shutdown_connections 2024-01-21T19:59:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.397+0000 7f3bfbae3700 1 -- 172.21.15.133:0/2137322681 wait complete. 2024-01-21T19:59:08.400 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T19:59:08.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:08.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.526+0000 7fb72a02d700 1 Processor -- start 2024-01-21T19:59:08.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.526+0000 7fb72a02d700 1 -- start start 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb72a02d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb72a02d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb72a02d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb724065660 con 0x7fb7240beb30 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb72a02d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7240bef10 con 0x7fb7240c3fb0 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb72a02d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb724156070 con 0x7fb724069ef0 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb723fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb722ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43812/0 (socket says 172.21.15.133:43812) 2024-01-21T19:59:08.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb723fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40954/0 (socket says 172.21.15.133:40954) 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb722ffd700 1 -- 172.21.15.133:0/412972232 learned_addr learned my addr 172.21.15.133:0/412972232 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.527+0000 7fb7237fe700 1 --1- 172.21.15.133:0/412972232 >> v1:172.21.15.178:6789/0 conn(0x7fb7240beb30 0x7fb7240697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35732/0 (socket says 172.21.15.133:35732) 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb722ffd700 1 -- 172.21.15.133:0/412972232 >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 msgr2=0x7fb724066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb722ffd700 1 --2- 172.21.15.133:0/412972232 >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb722ffd700 1 -- 172.21.15.133:0/412972232 >> v1:172.21.15.178:6789/0 conn(0x7fb7240beb30 legacy=0x7fb7240697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb722ffd700 1 -- 172.21.15.133:0/412972232 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724065f00 con 0x7fb724069ef0 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb723fff700 1 --2- 172.21.15.133:0/412972232 >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb722ffd700 1 --2- 172.21.15.133:0/412972232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb714006fd0 tx=0x7fb7140090f0).ready entity=mon.2 client_cookie=605ceb21e72fc745 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb7227fc700 1 -- 172.21.15.133:0/412972232 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400b580 con 0x7fb724069ef0 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb7227fc700 1 -- 172.21.15.133:0/412972232 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400b6e0 con 0x7fb724069ef0 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb7227fc700 1 -- 172.21.15.133:0/412972232 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400ba80 con 0x7fb724069ef0 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 -- 172.21.15.133:0/412972232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 msgr2=0x7fb724155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 --2- 172.21.15.133:0/412972232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fb714006fd0 tx=0x7fb7140090f0).stop 2024-01-21T19:59:08.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 -- 172.21.15.133:0/412972232 shutdown_connections 2024-01-21T19:59:08.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 --2- 172.21.15.133:0/412972232 >> v2:172.21.15.178:3300/0 conn(0x7fb7240c3fb0 0x7fb724066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 --2- 172.21.15.133:0/412972232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb724069ef0 0x7fb724155b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.528+0000 7fb72a02d700 1 -- 172.21.15.133:0/412972232 >> 172.21.15.133:0/412972232 conn(0x7fb7240c8010 msgr2=0x7fb7240c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:08.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.529+0000 7fb72a02d700 1 -- 172.21.15.133:0/412972232 shutdown_connections 2024-01-21T19:59:08.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.529+0000 7fb72a02d700 1 -- 172.21.15.133:0/412972232 wait complete. 2024-01-21T19:59:08.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.530+0000 7fb72a02d700 1 Processor -- start 2024-01-21T19:59:08.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.530+0000 7fb72a02d700 1 -- start start 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7240beb30 0x7fb7241367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 0x7fb7241399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb724165460 con 0x7fb724069ef0 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7240c05b0 con 0x7fb7240beb30 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb724165180 con 0x7fb7240c3fb0 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42966/0 (socket says 172.21.15.133:42966) 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 -- 172.21.15.133:0/165507178 learned_addr learned my addr 172.21.15.133:0/165507178 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb723fff700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 0x7fb7241399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb722ffd700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7240beb30 0x7fb7241367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 -- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 msgr2=0x7fb7241399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 0x7fb7241399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 -- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7240beb30 msgr2=0x7fb7241367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7240beb30 0x7fb7241367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 -- 172.21.15.133:0/165507178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c00bc30 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb723fff700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 0x7fb7241399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb7237fe700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb70c007fd0 tx=0x7fb70c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0072e0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c007440 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb714009370 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c0058f0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.531+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7240c08e0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.532+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72405fdf0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.533+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb70c005ce0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.533+0000 7fb71bfff700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 0x7fb704061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.533+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb70c0799d0 con 0x7fb724069ef0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.533+0000 7fb722ffd700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 0x7fb704061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.534+0000 7fb722ffd700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 0x7fb704061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb714009fd0 tx=0x7fb714017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.537+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb70c04aca0 con 0x7fb724069ef0 2024-01-21T19:59:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.744+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7240c3d90 con 0x7fb724069ef0 2024-01-21T19:59:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.745+0000 7fb71bfff700 1 -- 172.21.15.133:0/165507178 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fb70c079020 con 0x7fb724069ef0 2024-01-21T19:59:08.736 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:08.736 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:08.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 msgr2=0x7fb704061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 0x7fb704061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb714009fd0 tx=0x7fb714017000).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 msgr2=0x7fb724152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb70c007fd0 tx=0x7fb70c007df0).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 shutdown_connections 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb70405f150 0x7fb704061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7240c3fb0 0x7fb7241399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb724069ef0 0x7fb724152c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 --2- 172.21.15.133:0/165507178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7240beb30 0x7fb7241367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 >> 172.21.15.133:0/165507178 conn(0x7fb7240c8010 msgr2=0x7fb724137b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 shutdown_connections 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.747+0000 7fb72a02d700 1 -- 172.21.15.133:0/165507178 wait complete. 2024-01-21T19:59:08.739 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:08.750 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:08.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.875+0000 7fee6ed8a700 1 Processor -- start 2024-01-21T19:59:08.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.875+0000 7fee6ed8a700 1 -- start start 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.875+0000 7fee6ed8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee680a9e30 0x7fee680c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6ed8a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 0x7fee680bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6ed8a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee681511f0 con 0x7fee680bd140 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6ed8a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680c2ff0 con 0x7fee680a9e30 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6ed8a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee68065b20 con 0x7fee68065fb0 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee680a9e30 0x7fee680c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee680a9e30 0x7fee680c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42974/0 (socket says 172.21.15.133:42974) 2024-01-21T19:59:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 -- 172.21.15.133:0/1694246537 learned_addr learned my addr 172.21.15.133:0/1694246537 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee67fff700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 0x7fee680bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 -- 172.21.15.133:0/1694246537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 msgr2=0x7fee680bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 0x7fee680bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 -- 172.21.15.133:0/1694246537 >> v1:172.21.15.178:6789/0 conn(0x7fee680bd140 legacy=0x7fee680626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 -- 172.21.15.133:0/1694246537 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680c2240 con 0x7fee680a9e30 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee67fff700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 0x7fee680bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee6cb26700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680a9e30 0x7fee680c2b00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fee5c006fd0 tx=0x7fee5c0090f0).ready entity=mon.0 client_cookie=1972aec68a9674a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee677fe700 1 -- 172.21.15.133:0/1694246537 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00b600 con 0x7fee680a9e30 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee677fe700 1 -- 172.21.15.133:0/1694246537 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c00b760 con 0x7fee680a9e30 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.876+0000 7fee677fe700 1 -- 172.21.15.133:0/1694246537 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c00bb00 con 0x7fee680a9e30 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 -- 172.21.15.133:0/1694246537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680a9e30 msgr2=0x7fee680c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680a9e30 0x7fee680c2b00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fee5c006fd0 tx=0x7fee5c0090f0).stop 2024-01-21T19:59:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 -- 172.21.15.133:0/1694246537 shutdown_connections 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680a9e30 0x7fee680c2b00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/1694246537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee68065fb0 0x7fee680bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 -- 172.21.15.133:0/1694246537 >> 172.21.15.133:0/1694246537 conn(0x7fee680c8200 msgr2=0x7fee680c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 -- 172.21.15.133:0/1694246537 shutdown_connections 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.877+0000 7fee6ed8a700 1 -- 172.21.15.133:0/1694246537 wait complete. 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.878+0000 7fee6ed8a700 1 Processor -- start 2024-01-21T19:59:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.878+0000 7fee6ed8a700 1 -- start start 2024-01-21T19:59:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee68065fb0 0x7fee680c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680a9e30 0x7fee6814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68154560 con 0x7fee680bd140 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68151d00 con 0x7fee68065fb0 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6ed8a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c5990 con 0x7fee680a9e30 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42982/0 (socket says 172.21.15.133:42982) 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6cb26700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee68065fb0 0x7fee680c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee67fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680a9e30 0x7fee6814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 -- 172.21.15.133:0/286956325 learned_addr learned my addr 172.21.15.133:0/286956325 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 -- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680a9e30 msgr2=0x7fee6814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680a9e30 0x7fee6814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 -- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee68065fb0 msgr2=0x7fee680c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee68065fb0 0x7fee680c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 -- 172.21.15.133:0/286956325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c009370 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.879+0000 7fee6d327700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fee6000c7f0 tx=0x7fee60001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.880+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000e4a0 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.880+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000e600 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.880+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee68154280 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.880+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000e980 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.880+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee68151990 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.881+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee680c2420 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.881+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fee600123f0 con 0x7fee680bd140 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.881+0000 7fee657fa700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 0x7fee4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.881+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee60079910 con 0x7fee680bd140 2024-01-21T19:59:08.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.881+0000 7fee6cb26700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 0x7fee4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:08.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.882+0000 7fee6cb26700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 0x7fee4c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fee5c00b3c0 tx=0x7fee5c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:08.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:08.885+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee60047b00 con 0x7fee680bd140 2024-01-21T19:59:09.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.052+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee6805fdf0 con 0x7fee680bd140 2024-01-21T19:59:09.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.052+0000 7fee657fa700 1 -- 172.21.15.133:0/286956325 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fee6004ab80 con 0x7fee680bd140 2024-01-21T19:59:09.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:09.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 msgr2=0x7fee4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 0x7fee4c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fee5c00b3c0 tx=0x7fee5c017000).stop 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 msgr2=0x7fee68152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fee6000c7f0 tx=0x7fee60001510).stop 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 shutdown_connections 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee4c05f150 0x7fee4c061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee680bd140 0x7fee68152190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee68065fb0 0x7fee680c54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 --2- 172.21.15.133:0/286956325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680a9e30 0x7fee6814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 >> 172.21.15.133:0/286956325 conn(0x7fee680c8200 msgr2=0x7fee68064fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 shutdown_connections 2024-01-21T19:59:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.054+0000 7fee6ed8a700 1 -- 172.21.15.133:0/286956325 wait complete. 2024-01-21T19:59:09.058 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T19:59:09.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:09.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.183+0000 7f33cdfb0700 1 Processor -- start 2024-01-21T19:59:09.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.183+0000 7f33cdfb0700 1 -- start start 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.183+0000 7f33cdfb0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33c80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.183+0000 7f33cdfb0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33c80c39f0 0x7f33c80be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.183+0000 7f33cdfb0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80bfa40 con 0x7f33c80be5f0 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33cdfb0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80c3e70 con 0x7f33c80c39f0 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33cdfb0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80bee30 con 0x7f33c813b970 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f33c80be5f0 0x7f33c80c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59064/0 (socket says 172.21.15.133:59064) 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c7fff700 1 -- 172.21.15.133:0/691299846 learned_addr learned my addr 172.21.15.133:0/691299846 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c6ffd700 1 --2- 172.21.15.133:0/691299846 >> v2:172.21.15.178:3300/0 conn(0x7f33c80c39f0 0x7f33c80be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c77fe700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33c80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437869893 0 0) 0x7f33c80bfa40 con 0x7f33c80be5f0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b40033f0 con 0x7f33c80be5f0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977396541 0 0) 0x7f33b40033f0 con 0x7f33c80be5f0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 msgr2=0x7f33c80c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33c80c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 >> v2:172.21.15.178:3300/0 conn(0x7f33c80c39f0 msgr2=0x7f33c80be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 --2- 172.21.15.133:0/691299846 >> v2:172.21.15.178:3300/0 conn(0x7f33c80c39f0 0x7f33c80be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80bf110 con 0x7f33c80be5f0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f33c0001470 con 0x7f33c80be5f0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 >> v1:172.21.15.133:6789/0 conn(0x7f33c80be5f0 legacy=0x7f33c80c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33b40038e0 0x7f33b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b4004b80 0x7f33b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80c3e70 con 0x7f33b4004b80 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80bee30 con 0x7f33b40038e0 2024-01-21T19:59:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b400b8e0 con 0x7f33c813b970 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c7fff700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b4004b80 0x7f33b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c77fe700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33b40038e0 0x7f33b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.184+0000 7f33c6ffd700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 -- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 msgr2=0x7f33b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c813b970 0x7f33b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 -- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33b40038e0 msgr2=0x7f33b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33b40038e0 0x7f33b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 -- 172.21.15.133:0/691299846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b40033f0 con 0x7f33b4004b80 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b4004b80 0x7f33b4005000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f33c000c210 tx=0x7f33c0001e90).ready entity=mon.0 client_cookie=88dfd44a9a57d4fa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007a60 con 0x7f33b4004b80 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c000cae0 con 0x7f33b4004b80 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c67fc700 1 -- 172.21.15.133:0/691299846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000ce80 con 0x7f33b4004b80 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 -- 172.21.15.133:0/691299846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b4004b80 msgr2=0x7f33b4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/691299846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b4004b80 0x7f33b4005000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f33c000c210 tx=0x7f33c0001e90).stop 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33c7fff700 1 -- 172.21.15.133:0/691299846 reap_dead start 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 -- 172.21.15.133:0/691299846 shutdown_connections 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 -- 172.21.15.133:0/691299846 >> 172.21.15.133:0/691299846 conn(0x7f33c8066a70 msgr2=0x7f33c8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 -- 172.21.15.133:0/691299846 shutdown_connections 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.185+0000 7f33cdfb0700 1 -- 172.21.15.133:0/691299846 wait complete. 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.187+0000 7f33cdfb0700 1 Processor -- start 2024-01-21T19:59:09.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.187+0000 7f33cdfb0700 1 -- start start 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.187+0000 7f33cdfb0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.187+0000 7f33cdfb0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c80bffa0 0x7f33c8063da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.187+0000 7f33cdfb0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c81641a0 0x7f33c8164600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33cdfb0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c813a360 con 0x7f33c80639c0 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33cdfb0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8158d60 con 0x7f33c80bffa0 2024-01-21T19:59:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33cdfb0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80c31f0 con 0x7f33c81641a0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43000/0 (socket says 172.21.15.133:43000) 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 -- 172.21.15.133:0/674639793 learned_addr learned my addr 172.21.15.133:0/674639793 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c7fff700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c81641a0 0x7f33c8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c6ffd700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c80bffa0 0x7f33c8063da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 -- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c81641a0 msgr2=0x7f33c8164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c81641a0 0x7f33c8164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 -- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c80bffa0 msgr2=0x7f33c8063da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c80bffa0 0x7f33c8063da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 -- 172.21.15.133:0/674639793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8158430 con 0x7f33c80639c0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33c77fe700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f33b8011f00 tx=0x7f33b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800e040 con 0x7f33c80639c0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800f040 con 0x7f33c80639c0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c8158710 con 0x7f33c80639c0 2024-01-21T19:59:09.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8015450 con 0x7f33c80639c0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.188+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81591f0 con 0x7f33c80639c0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.189+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c8159040 con 0x7f33c80639c0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.189+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f33b8015880 con 0x7f33c80639c0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.190+0000 7f33bffff700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 0x7f33a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.190+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f33b807af00 con 0x7f33c80639c0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.190+0000 7f33c6ffd700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 0x7f33a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.190+0000 7f33c6ffd700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 0x7f33a8061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f33c80c2c10 tx=0x7f33b0009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.194+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f33b804c1d0 con 0x7f33c80639c0 2024-01-21T19:59:09.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.353+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33c805fdf0 con 0x7f33a805f150 2024-01-21T19:59:09.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.362+0000 7f33bffff700 1 -- 172.21.15.133:0/674639793 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325137 (secure 0 0 0) 0x7f33c805fdf0 con 0x7f33a805f150 2024-01-21T19:59:09.357 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:09.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 msgr2=0x7f33a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 0x7f33a8061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f33c80c2c10 tx=0x7f33b0009060).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 msgr2=0x7f33c8139d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f33b8011f00 tx=0x7f33b800b040).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 shutdown_connections 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f33a805f150 0x7f33a8061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33c81641a0 0x7f33c8164600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33c80639c0 0x7f33c8139d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 --2- 172.21.15.133:0/674639793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33c80bffa0 0x7f33c8063da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 >> 172.21.15.133:0/674639793 conn(0x7f33c8066a70 msgr2=0x7f33c8064760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 shutdown_connections 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.365+0000 7f33cdfb0700 1 -- 172.21.15.133:0/674639793 wait complete. 2024-01-21T19:59:09.360 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:09.368 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-21T19:59:07.848260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378120,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596600,"statfs":{"total":773094113280,"available":770658918400,"internally_reserved":0,"allocated":1384448,"data_stored":443346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:02.668073+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:02.668073+0000","last_peered":"2024-01-21T19:59:02.668073+0000","last_clean":"2024-01-21T19:59:02.668073+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:02.668073+0000","last_undegraded":"2024-01-21T19:59:02.668073+0000","last_fullsized":"2024-01-21T19:59:02.668073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.900269+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:01.900269+0000","last_peered":"2024-01-21T19:59:01.900269+0000","last_clean":"2024-01-21T19:59:01.900269+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:01.900269+0000","last_undegraded":"2024-01-21T19:59:01.900269+0000","last_fullsized":"2024-01-21T19:59:01.900269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.904406+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:01.904406+0000","last_peered":"2024-01-21T19:59:01.904406+0000","last_clean":"2024-01-21T19:59:01.904406+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:01.904406+0000","last_undegraded":"2024-01-21T19:59:01.904406+0000","last_fullsized":"2024-01-21T19:59:01.904406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.897304+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:01.897304+0000","last_peered":"2024-01-21T19:59:01.897304+0000","last_clean":"2024-01-21T19:59:01.897304+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:01.897304+0000","last_undegraded":"2024-01-21T19:59:01.897304+0000","last_fullsized":"2024-01-21T19:59:01.897304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-21T19:59:00.998550+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:00.998550+0000","last_peered":"2024-01-21T19:59:00.998550+0000","last_clean":"2024-01-21T19:59:00.998550+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:00.998550+0000","last_undegraded":"2024-01-21T19:59:00.998550+0000","last_fullsized":"2024-01-21T19:59:00.998550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.899524+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:01.899524+0000","last_peered":"2024-01-21T19:59:01.899524+0000","last_clean":"2024-01-21T19:59:01.899524+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:01.899524+0000","last_undegraded":"2024-01-21T19:59:01.899524+0000","last_fullsized":"2024-01-21T19:59:01.899524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:02.668362+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:02.668362+0000","last_peered":"2024-01-21T19:59:02.668362+0000","last_clean":"2024-01-21T19:59:02.668362+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:02.668362+0000","last_undegraded":"2024-01-21T19:59:02.668362+0000","last_fullsized":"2024-01-21T19:59:02.668362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.899227+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:01.899227+0000","last_peered":"2024-01-21T19:59:01.899227+0000","last_clean":"2024-01-21T19:59:01.899227+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:01.899227+0000","last_undegraded":"2024-01-21T19:59:01.899227+0000","last_fullsized":"2024-01-21T19:59:01.899227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.892937+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:01.892937+0000","last_peered":"2024-01-21T19:59:01.892937+0000","last_clean":"2024-01-21T19:59:01.892937+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:01.892937+0000","last_undegraded":"2024-01-21T19:59:01.892937+0000","last_fullsized":"2024-01-21T19:59:01.892937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":51798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":57597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:09.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:09.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.535+0000 7f10c8a89700 1 Processor -- start 2024-01-21T19:59:09.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.535+0000 7f10c8a89700 1 -- start start 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c8a89700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10c40c3c20 0x7f10c413a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c8a89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c40bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c8a89700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40c64d0 con 0x7f10c40c3840 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c8a89700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c4067f10 con 0x7f10c40c3c20 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c8a89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40681f0 con 0x7f10c413a9e0 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10c40c3c20 0x7f10c413a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10c40c3c20 0x7f10c413a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43016/0 (socket says 172.21.15.133:43016) 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 -- 172.21.15.133:0/2870354792 learned_addr learned my addr 172.21.15.133:0/2870354792 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c2d9d700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c40bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 -- 172.21.15.133:0/2870354792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 msgr2=0x7f10c40bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c40bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 -- 172.21.15.133:0/2870354792 >> v1:172.21.15.178:6789/0 conn(0x7f10c40c3840 legacy=0x7f10c40c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 -- 172.21.15.133:0/2870354792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c40684d0 con 0x7f10c40c3c20 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c2d9d700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c40bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3c20 0x7f10c413a4f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f10b8006fd0 tx=0x7f10b80090f0).ready entity=mon.0 client_cookie=158cac5a36dc796b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c159a700 1 -- 172.21.15.133:0/2870354792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800b600 con 0x7f10c40c3c20 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c159a700 1 -- 172.21.15.133:0/2870354792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800b760 con 0x7f10c40c3c20 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.536+0000 7f10c159a700 1 -- 172.21.15.133:0/2870354792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800bb00 con 0x7f10c40c3c20 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 -- 172.21.15.133:0/2870354792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3c20 msgr2=0x7f10c413a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3c20 0x7f10c413a4f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f10b8006fd0 tx=0x7f10b80090f0).stop 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 -- 172.21.15.133:0/2870354792 shutdown_connections 2024-01-21T19:59:09.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c40bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 --2- 172.21.15.133:0/2870354792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3c20 0x7f10c413a4f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 -- 172.21.15.133:0/2870354792 >> 172.21.15.133:0/2870354792 conn(0x7f10c4066a70 msgr2=0x7f10c4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 -- 172.21.15.133:0/2870354792 shutdown_connections 2024-01-21T19:59:09.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.537+0000 7f10c8a89700 1 -- 172.21.15.133:0/2870354792 wait complete. 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.538+0000 7f10c8a89700 1 Processor -- start 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 -- start start 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 0x7f10c4152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4158880 con 0x7f10c40c3840 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4152f80 con 0x7f10c40c3c20 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c8a89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c4153440 con 0x7f10c413a9e0 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43020/0 (socket says 172.21.15.133:43020) 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.539+0000 7f10c259c700 1 -- 172.21.15.133:0/4155623612 learned_addr learned my addr 172.21.15.133:0/4155623612 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:09.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 0x7f10c4152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c2d9d700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 -- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 msgr2=0x7f10c4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c4151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 -- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 msgr2=0x7f10c4152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 0x7f10c4152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 -- 172.21.15.133:0/4155623612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8009370 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 0x7f10c4152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c259c700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f10b400c440 tx=0x7f10b4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4007020 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4007180 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40ac070 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4007520 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.540+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c41582c0 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.541+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c405fdf0 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.541+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f10b40068b0 con 0x7f10c40c3840 2024-01-21T19:59:09.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.542+0000 7f10b2ffd700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 0x7f10a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.542+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f10b40793c0 con 0x7f10c40c3840 2024-01-21T19:59:09.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.542+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 0x7f10a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.542+0000 7f10c1d9b700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 0x7f10a4061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f10c4157290 tx=0x7f10b8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.546+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f10b4047b00 con 0x7f10c40c3840 2024-01-21T19:59:09.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.704+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10c40c64d0 con 0x7f10a405f150 2024-01-21T19:59:09.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.712+0000 7f10b2ffd700 1 -- 172.21.15.133:0/4155623612 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325137 (secure 0 0 0) 0x7f10c40c64d0 con 0x7f10a405f150 2024-01-21T19:59:09.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:09.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 msgr2=0x7f10a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 0x7f10a4061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f10c4157290 tx=0x7f10b8017000).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 msgr2=0x7f10c4157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f10b400c440 tx=0x7f10b4007e00).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 shutdown_connections 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f10a405f150 0x7f10a4061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c413a9e0 0x7f10c4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10c40c3840 0x7f10c4157a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 --2- 172.21.15.133:0/4155623612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c40c3c20 0x7f10c4152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 >> 172.21.15.133:0/4155623612 conn(0x7f10c4066a70 msgr2=0x7f10c413d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 shutdown_connections 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.715+0000 7f10c8a89700 1 -- 172.21.15.133:0/4155623612 wait complete. 2024-01-21T19:59:09.711 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:09.719 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-21T19:59:07.848260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2378120,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596600,"statfs":{"total":773094113280,"available":770658918400,"internally_reserved":0,"allocated":1384448,"data_stored":443346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:02.668073+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:02.668073+0000","last_peered":"2024-01-21T19:59:02.668073+0000","last_clean":"2024-01-21T19:59:02.668073+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:02.668073+0000","last_undegraded":"2024-01-21T19:59:02.668073+0000","last_fullsized":"2024-01-21T19:59:02.668073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.900269+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:01.900269+0000","last_peered":"2024-01-21T19:59:01.900269+0000","last_clean":"2024-01-21T19:59:01.900269+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:01.900269+0000","last_undegraded":"2024-01-21T19:59:01.900269+0000","last_fullsized":"2024-01-21T19:59:01.900269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.904406+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:01.904406+0000","last_peered":"2024-01-21T19:59:01.904406+0000","last_clean":"2024-01-21T19:59:01.904406+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:01.904406+0000","last_undegraded":"2024-01-21T19:59:01.904406+0000","last_fullsized":"2024-01-21T19:59:01.904406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.897304+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:01.897304+0000","last_peered":"2024-01-21T19:59:01.897304+0000","last_clean":"2024-01-21T19:59:01.897304+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:01.897304+0000","last_undegraded":"2024-01-21T19:59:01.897304+0000","last_fullsized":"2024-01-21T19:59:01.897304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-01-21T19:59:00.998550+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:00.998550+0000","last_peered":"2024-01-21T19:59:00.998550+0000","last_clean":"2024-01-21T19:59:00.998550+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:00.998550+0000","last_undegraded":"2024-01-21T19:59:00.998550+0000","last_fullsized":"2024-01-21T19:59:00.998550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.899524+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:01.899524+0000","last_peered":"2024-01-21T19:59:01.899524+0000","last_clean":"2024-01-21T19:59:01.899524+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:01.899524+0000","last_undegraded":"2024-01-21T19:59:01.899524+0000","last_fullsized":"2024-01-21T19:59:01.899524+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:02.668362+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:02.668362+0000","last_peered":"2024-01-21T19:59:02.668362+0000","last_clean":"2024-01-21T19:59:02.668362+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:02.668362+0000","last_undegraded":"2024-01-21T19:59:02.668362+0000","last_fullsized":"2024-01-21T19:59:02.668362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.899227+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:01.899227+0000","last_peered":"2024-01-21T19:59:01.899227+0000","last_clean":"2024-01-21T19:59:01.899227+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:01.899227+0000","last_undegraded":"2024-01-21T19:59:01.899227+0000","last_fullsized":"2024-01-21T19:59:01.899227+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-01-21T19:59:01.892937+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:01.892937+0000","last_peered":"2024-01-21T19:59:01.892937+0000","last_clean":"2024-01-21T19:59:01.892937+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:01.892937+0000","last_undegraded":"2024-01-21T19:59:01.892937+0000","last_fullsized":"2024-01-21T19:59:01.892937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:06.006845+0000","last_change":"2024-01-21T19:59:06.006845+0000","last_active":"2024-01-21T19:59:06.006845+0000","last_peered":"2024-01-21T19:59:06.006845+0000","last_clean":"2024-01-21T19:59:06.006845+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:06.006845+0000","last_undegraded":"2024-01-21T19:59:06.006845+0000","last_fullsized":"2024-01-21T19:59:06.006845+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:04.998226+0000","last_change":"2024-01-21T19:59:04.998226+0000","last_active":"2024-01-21T19:59:04.998226+0000","last_peered":"2024-01-21T19:59:04.998226+0000","last_clean":"2024-01-21T19:59:04.998226+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:04.998226+0000","last_undegraded":"2024-01-21T19:59:04.998226+0000","last_fullsized":"2024-01-21T19:59:04.998226+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":51798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297268,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074572,"statfs":{"total":96636764160,"available":96332361728,"internally_reserved":0,"allocated":176128,"data_stored":57597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297260,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074580,"statfs":{"total":96636764160,"available":96332369920,"internally_reserved":0,"allocated":167936,"data_stored":52759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297272,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074568,"statfs":{"total":96636764160,"available":96332357632,"internally_reserved":0,"allocated":180224,"data_stored":58558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:09.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.885+0000 7faf3e1c5700 1 Processor -- start 2024-01-21T19:59:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.885+0000 7faf3e1c5700 1 -- start start 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 0x7faf38062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf380697e0 0x7faf38065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf38065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf38066040 con 0x7faf380697e0 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf380634e0 con 0x7faf38062c10 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf3e1c5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3806a130 con 0x7faf38069c40 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf380697e0 0x7faf38065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf380697e0 0x7faf38065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43032/0 (socket says 172.21.15.133:43032) 2024-01-21T19:59:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 -- 172.21.15.133:0/1343637966 learned_addr learned my addr 172.21.15.133:0/1343637966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf377fe700 1 --2- 172.21.15.133:0/1343637966 >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 0x7faf38062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf37fff700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf38065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 -- 172.21.15.133:0/1343637966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 msgr2=0x7faf38065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf38065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 -- 172.21.15.133:0/1343637966 >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 msgr2=0x7faf38062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 --2- 172.21.15.133:0/1343637966 >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 0x7faf38062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 -- 172.21.15.133:0/1343637966 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3806a410 con 0x7faf380697e0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf377fe700 1 --2- 172.21.15.133:0/1343637966 >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 0x7faf38062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf36ffd700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf38065660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf38069390 tx=0x7faf2c0090f0).ready entity=mon.0 client_cookie=5209b8dfb06b29da server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf367fc700 1 -- 172.21.15.133:0/1343637966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00b600 con 0x7faf380697e0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf367fc700 1 -- 172.21.15.133:0/1343637966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c00b760 con 0x7faf380697e0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.886+0000 7faf367fc700 1 -- 172.21.15.133:0/1343637966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00bb00 con 0x7faf380697e0 2024-01-21T19:59:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 -- 172.21.15.133:0/1343637966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 msgr2=0x7faf38065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf38065660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf38069390 tx=0x7faf2c0090f0).stop 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 -- 172.21.15.133:0/1343637966 shutdown_connections 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf38065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/1343637966 >> v2:172.21.15.178:3300/0 conn(0x7faf38062c10 0x7faf38062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/1343637966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf38065660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 -- 172.21.15.133:0/1343637966 >> 172.21.15.133:0/1343637966 conn(0x7faf380c8010 msgr2=0x7faf380c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 -- 172.21.15.133:0/1343637966 shutdown_connections 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.887+0000 7faf3e1c5700 1 -- 172.21.15.133:0/1343637966 wait complete. 2024-01-21T19:59:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.888+0000 7faf3e1c5700 1 Processor -- start 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.888+0000 7faf3e1c5700 1 -- start start 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf38062c10 0x7faf380aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf380aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380aab30 con 0x7faf380697e0 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf380bfcc0 con 0x7faf38062c10 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf3e1c5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf380bf0b0 con 0x7faf38069c40 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43038/0 (socket says 172.21.15.133:43038) 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 -- 172.21.15.133:0/2985087986 learned_addr learned my addr 172.21.15.133:0/2985087986 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf377fe700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf38062c10 0x7faf380aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf37fff700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf380aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 -- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 msgr2=0x7faf380aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf380aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 -- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf38062c10 msgr2=0x7faf380aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf38062c10 0x7faf380aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf36ffd700 1 -- 172.21.15.133:0/2985087986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c009370 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.889+0000 7faf37fff700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf380aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf36ffd700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faf380692f0 tx=0x7faf2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00bec0 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c002f30 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf380bf390 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c00bb00 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.890+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf380bf950 con 0x7faf380697e0 2024-01-21T19:59:09.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.891+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3805fdf0 con 0x7faf380697e0 2024-01-21T19:59:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.891+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faf2c021070 con 0x7faf380697e0 2024-01-21T19:59:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.891+0000 7faf1ffff700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 0x7faf24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.892+0000 7faf377fe700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 0x7faf24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.892+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faf2c07bc60 con 0x7faf380697e0 2024-01-21T19:59:09.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.892+0000 7faf377fe700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 0x7faf24061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faf28006fd0 tx=0x7faf28008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:09.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:09.896+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf2c04ce70 con 0x7faf380697e0 2024-01-21T19:59:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.057+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf38063090 con 0x7faf2405f150 2024-01-21T19:59:10.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.066+0000 7faf1ffff700 1 -- 172.21.15.133:0/2985087986 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336457 (secure 0 0 0) 0x7faf38063090 con 0x7faf2405f150 2024-01-21T19:59:10.062 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 msgr2=0x7faf24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 0x7faf24061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faf28006fd0 tx=0x7faf28008040).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 msgr2=0x7faf380aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7faf380692f0 tx=0x7faf2c017000).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 shutdown_connections 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf2405f150 0x7faf24061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf38069c40 0x7faf380aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf38062c10 0x7faf380aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 --2- 172.21.15.133:0/2985087986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf380697e0 0x7faf380aa150 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 >> 172.21.15.133:0/2985087986 conn(0x7faf380c8010 msgr2=0x7faf380be7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 shutdown_connections 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.070+0000 7faf3e1c5700 1 -- 172.21.15.133:0/2985087986 wait complete. 2024-01-21T19:59:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:10.073 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T19:59:09.848561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378616,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596104,"statfs":{"total":773094113280,"available":770658410496,"internally_reserved":0,"allocated":1892352,"data_stored":685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408931+0000","last_change":"2024-01-21T19:59:06.407131+0000","last_active":"2024-01-21T19:59:06.408931+0000","last_peered":"2024-01-21T19:59:06.408931+0000","last_clean":"2024-01-21T19:59:06.408931+0000","last_became_active":"2024-01-21T19:59:06.406853+0000","last_became_peered":"2024-01-21T19:59:06.406853+0000","last_unstale":"2024-01-21T19:59:06.408931+0000","last_undegraded":"2024-01-21T19:59:06.408931+0000","last_fullsized":"2024-01-21T19:59:06.408931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405624+0000","last_change":"2024-01-21T19:59:06.034930+0000","last_active":"2024-01-21T19:59:06.405624+0000","last_peered":"2024-01-21T19:59:06.405624+0000","last_clean":"2024-01-21T19:59:06.405624+0000","last_became_active":"2024-01-21T19:59:06.034648+0000","last_became_peered":"2024-01-21T19:59:06.034648+0000","last_unstale":"2024-01-21T19:59:06.405624+0000","last_undegraded":"2024-01-21T19:59:06.405624+0000","last_fullsized":"2024-01-21T19:59:06.405624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415745+0000","last_change":"2024-01-21T19:59:06.414371+0000","last_active":"2024-01-21T19:59:06.415745+0000","last_peered":"2024-01-21T19:59:06.415745+0000","last_clean":"2024-01-21T19:59:06.415745+0000","last_became_active":"2024-01-21T19:59:06.414078+0000","last_became_peered":"2024-01-21T19:59:06.414078+0000","last_unstale":"2024-01-21T19:59:06.415745+0000","last_undegraded":"2024-01-21T19:59:06.415745+0000","last_fullsized":"2024-01-21T19:59:06.415745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403854+0000","last_change":"2024-01-21T19:59:06.035542+0000","last_active":"2024-01-21T19:59:06.403854+0000","last_peered":"2024-01-21T19:59:06.403854+0000","last_clean":"2024-01-21T19:59:06.403854+0000","last_became_active":"2024-01-21T19:59:06.035262+0000","last_became_peered":"2024-01-21T19:59:06.035262+0000","last_unstale":"2024-01-21T19:59:06.403854+0000","last_undegraded":"2024-01-21T19:59:06.403854+0000","last_fullsized":"2024-01-21T19:59:06.403854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406814+0000","last_change":"2024-01-21T19:59:06.405992+0000","last_active":"2024-01-21T19:59:06.406814+0000","last_peered":"2024-01-21T19:59:06.406814+0000","last_clean":"2024-01-21T19:59:06.406814+0000","last_became_active":"2024-01-21T19:59:06.405013+0000","last_became_peered":"2024-01-21T19:59:06.405013+0000","last_unstale":"2024-01-21T19:59:06.406814+0000","last_undegraded":"2024-01-21T19:59:06.406814+0000","last_fullsized":"2024-01-21T19:59:06.406814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392792+0000","last_change":"2024-01-21T19:59:06.041467+0000","last_active":"2024-01-21T19:59:06.392792+0000","last_peered":"2024-01-21T19:59:06.392792+0000","last_clean":"2024-01-21T19:59:06.392792+0000","last_became_active":"2024-01-21T19:59:06.041158+0000","last_became_peered":"2024-01-21T19:59:06.041158+0000","last_unstale":"2024-01-21T19:59:06.392792+0000","last_undegraded":"2024-01-21T19:59:06.392792+0000","last_fullsized":"2024-01-21T19:59:06.392792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408938+0000","last_change":"2024-01-21T19:59:06.407402+0000","last_active":"2024-01-21T19:59:06.408938+0000","last_peered":"2024-01-21T19:59:06.408938+0000","last_clean":"2024-01-21T19:59:06.408938+0000","last_became_active":"2024-01-21T19:59:06.406722+0000","last_became_peered":"2024-01-21T19:59:06.406722+0000","last_unstale":"2024-01-21T19:59:06.408938+0000","last_undegraded":"2024-01-21T19:59:06.408938+0000","last_fullsized":"2024-01-21T19:59:06.408938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392400+0000","last_change":"2024-01-21T19:59:06.038017+0000","last_active":"2024-01-21T19:59:06.392400+0000","last_peered":"2024-01-21T19:59:06.392400+0000","last_clean":"2024-01-21T19:59:06.392400+0000","last_became_active":"2024-01-21T19:59:06.037532+0000","last_became_peered":"2024-01-21T19:59:06.037532+0000","last_unstale":"2024-01-21T19:59:06.392400+0000","last_undegraded":"2024-01-21T19:59:06.392400+0000","last_fullsized":"2024-01-21T19:59:06.392400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415998+0000","last_change":"2024-01-21T19:59:06.415183+0000","last_active":"2024-01-21T19:59:06.415998+0000","last_peered":"2024-01-21T19:59:06.415998+0000","last_clean":"2024-01-21T19:59:06.415998+0000","last_became_active":"2024-01-21T19:59:06.414874+0000","last_became_peered":"2024-01-21T19:59:06.414874+0000","last_unstale":"2024-01-21T19:59:06.415998+0000","last_undegraded":"2024-01-21T19:59:06.415998+0000","last_fullsized":"2024-01-21T19:59:06.415998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392424+0000","last_change":"2024-01-21T19:59:06.039345+0000","last_active":"2024-01-21T19:59:06.392424+0000","last_peered":"2024-01-21T19:59:06.392424+0000","last_clean":"2024-01-21T19:59:06.392424+0000","last_became_active":"2024-01-21T19:59:06.039077+0000","last_became_peered":"2024-01-21T19:59:06.039077+0000","last_unstale":"2024-01-21T19:59:06.392424+0000","last_undegraded":"2024-01-21T19:59:06.392424+0000","last_fullsized":"2024-01-21T19:59:06.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412461+0000","last_change":"2024-01-21T19:59:06.408094+0000","last_active":"2024-01-21T19:59:06.412461+0000","last_peered":"2024-01-21T19:59:06.412461+0000","last_clean":"2024-01-21T19:59:06.412461+0000","last_became_active":"2024-01-21T19:59:06.407833+0000","last_became_peered":"2024-01-21T19:59:06.407833+0000","last_unstale":"2024-01-21T19:59:06.412461+0000","last_undegraded":"2024-01-21T19:59:06.412461+0000","last_fullsized":"2024-01-21T19:59:06.412461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417155+0000","last_change":"2024-01-21T19:59:06.037535+0000","last_active":"2024-01-21T19:59:06.417155+0000","last_peered":"2024-01-21T19:59:06.417155+0000","last_clean":"2024-01-21T19:59:06.417155+0000","last_became_active":"2024-01-21T19:59:06.037260+0000","last_became_peered":"2024-01-21T19:59:06.037260+0000","last_unstale":"2024-01-21T19:59:06.417155+0000","last_undegraded":"2024-01-21T19:59:06.417155+0000","last_fullsized":"2024-01-21T19:59:06.417155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415420+0000","last_change":"2024-01-21T19:59:06.411473+0000","last_active":"2024-01-21T19:59:06.415420+0000","last_peered":"2024-01-21T19:59:06.415420+0000","last_clean":"2024-01-21T19:59:06.415420+0000","last_became_active":"2024-01-21T19:59:06.408751+0000","last_became_peered":"2024-01-21T19:59:06.408751+0000","last_unstale":"2024-01-21T19:59:06.415420+0000","last_undegraded":"2024-01-21T19:59:06.415420+0000","last_fullsized":"2024-01-21T19:59:06.415420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419677+0000","last_change":"2024-01-21T19:59:06.037480+0000","last_active":"2024-01-21T19:59:06.419677+0000","last_peered":"2024-01-21T19:59:06.419677+0000","last_clean":"2024-01-21T19:59:06.419677+0000","last_became_active":"2024-01-21T19:59:06.037054+0000","last_became_peered":"2024-01-21T19:59:06.037054+0000","last_unstale":"2024-01-21T19:59:06.419677+0000","last_undegraded":"2024-01-21T19:59:06.419677+0000","last_fullsized":"2024-01-21T19:59:06.419677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413369+0000","last_change":"2024-01-21T19:59:06.411113+0000","last_active":"2024-01-21T19:59:06.413369+0000","last_peered":"2024-01-21T19:59:06.413369+0000","last_clean":"2024-01-21T19:59:06.413369+0000","last_became_active":"2024-01-21T19:59:06.410842+0000","last_became_peered":"2024-01-21T19:59:06.410842+0000","last_unstale":"2024-01-21T19:59:06.413369+0000","last_undegraded":"2024-01-21T19:59:06.413369+0000","last_fullsized":"2024-01-21T19:59:06.413369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415706+0000","last_change":"2024-01-21T19:59:06.042850+0000","last_active":"2024-01-21T19:59:06.415706+0000","last_peered":"2024-01-21T19:59:06.415706+0000","last_clean":"2024-01-21T19:59:06.415706+0000","last_became_active":"2024-01-21T19:59:06.041938+0000","last_became_peered":"2024-01-21T19:59:06.041938+0000","last_unstale":"2024-01-21T19:59:06.415706+0000","last_undegraded":"2024-01-21T19:59:06.415706+0000","last_fullsized":"2024-01-21T19:59:06.415706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413389+0000","last_change":"2024-01-21T19:59:06.411722+0000","last_active":"2024-01-21T19:59:06.413389+0000","last_peered":"2024-01-21T19:59:06.413389+0000","last_clean":"2024-01-21T19:59:06.413389+0000","last_became_active":"2024-01-21T19:59:06.411400+0000","last_became_peered":"2024-01-21T19:59:06.411400+0000","last_unstale":"2024-01-21T19:59:06.413389+0000","last_undegraded":"2024-01-21T19:59:06.413389+0000","last_fullsized":"2024-01-21T19:59:06.413389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392771+0000","last_change":"2024-01-21T19:59:06.040019+0000","last_active":"2024-01-21T19:59:06.392771+0000","last_peered":"2024-01-21T19:59:06.392771+0000","last_clean":"2024-01-21T19:59:06.392771+0000","last_became_active":"2024-01-21T19:59:06.038603+0000","last_became_peered":"2024-01-21T19:59:06.038603+0000","last_unstale":"2024-01-21T19:59:06.392771+0000","last_undegraded":"2024-01-21T19:59:06.392771+0000","last_fullsized":"2024-01-21T19:59:06.392771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401930+0000","last_change":"2024-01-21T19:59:06.397578+0000","last_active":"2024-01-21T19:59:06.401930+0000","last_peered":"2024-01-21T19:59:06.401930+0000","last_clean":"2024-01-21T19:59:06.401930+0000","last_became_active":"2024-01-21T19:59:06.397304+0000","last_became_peered":"2024-01-21T19:59:06.397304+0000","last_unstale":"2024-01-21T19:59:06.401930+0000","last_undegraded":"2024-01-21T19:59:06.401930+0000","last_fullsized":"2024-01-21T19:59:06.401930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405880+0000","last_change":"2024-01-21T19:59:06.037427+0000","last_active":"2024-01-21T19:59:06.405880+0000","last_peered":"2024-01-21T19:59:06.405880+0000","last_clean":"2024-01-21T19:59:06.405880+0000","last_became_active":"2024-01-21T19:59:06.037106+0000","last_became_peered":"2024-01-21T19:59:06.037106+0000","last_unstale":"2024-01-21T19:59:06.405880+0000","last_undegraded":"2024-01-21T19:59:06.405880+0000","last_fullsized":"2024-01-21T19:59:06.405880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412944+0000","last_change":"2024-01-21T19:59:06.410874+0000","last_active":"2024-01-21T19:59:06.412944+0000","last_peered":"2024-01-21T19:59:06.412944+0000","last_clean":"2024-01-21T19:59:06.412944+0000","last_became_active":"2024-01-21T19:59:06.410611+0000","last_became_peered":"2024-01-21T19:59:06.410611+0000","last_unstale":"2024-01-21T19:59:06.412944+0000","last_undegraded":"2024-01-21T19:59:06.412944+0000","last_fullsized":"2024-01-21T19:59:06.412944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407859+0000","last_change":"2024-01-21T19:59:06.041197+0000","last_active":"2024-01-21T19:59:06.407859+0000","last_peered":"2024-01-21T19:59:06.407859+0000","last_clean":"2024-01-21T19:59:06.407859+0000","last_became_active":"2024-01-21T19:59:06.040869+0000","last_became_peered":"2024-01-21T19:59:06.040869+0000","last_unstale":"2024-01-21T19:59:06.407859+0000","last_undegraded":"2024-01-21T19:59:06.407859+0000","last_fullsized":"2024-01-21T19:59:06.407859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413128+0000","last_change":"2024-01-21T19:59:06.411500+0000","last_active":"2024-01-21T19:59:06.413128+0000","last_peered":"2024-01-21T19:59:06.413128+0000","last_clean":"2024-01-21T19:59:06.413128+0000","last_became_active":"2024-01-21T19:59:06.411276+0000","last_became_peered":"2024-01-21T19:59:06.411276+0000","last_unstale":"2024-01-21T19:59:06.413128+0000","last_undegraded":"2024-01-21T19:59:06.413128+0000","last_fullsized":"2024-01-21T19:59:06.413128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415690+0000","last_change":"2024-01-21T19:59:06.038505+0000","last_active":"2024-01-21T19:59:06.415690+0000","last_peered":"2024-01-21T19:59:06.415690+0000","last_clean":"2024-01-21T19:59:06.415690+0000","last_became_active":"2024-01-21T19:59:06.038100+0000","last_became_peered":"2024-01-21T19:59:06.038100+0000","last_unstale":"2024-01-21T19:59:06.415690+0000","last_undegraded":"2024-01-21T19:59:06.415690+0000","last_fullsized":"2024-01-21T19:59:06.415690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415464+0000","last_change":"2024-01-21T19:59:06.412541+0000","last_active":"2024-01-21T19:59:06.415464+0000","last_peered":"2024-01-21T19:59:06.415464+0000","last_clean":"2024-01-21T19:59:06.415464+0000","last_became_active":"2024-01-21T19:59:06.412353+0000","last_became_peered":"2024-01-21T19:59:06.412353+0000","last_unstale":"2024-01-21T19:59:06.415464+0000","last_undegraded":"2024-01-21T19:59:06.415464+0000","last_fullsized":"2024-01-21T19:59:06.415464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418953+0000","last_change":"2024-01-21T19:59:06.034594+0000","last_active":"2024-01-21T19:59:06.418953+0000","last_peered":"2024-01-21T19:59:06.418953+0000","last_clean":"2024-01-21T19:59:06.418953+0000","last_became_active":"2024-01-21T19:59:06.034292+0000","last_became_peered":"2024-01-21T19:59:06.034292+0000","last_unstale":"2024-01-21T19:59:06.418953+0000","last_undegraded":"2024-01-21T19:59:06.418953+0000","last_fullsized":"2024-01-21T19:59:06.418953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416149+0000","last_change":"2024-01-21T19:59:06.411225+0000","last_active":"2024-01-21T19:59:06.416149+0000","last_peered":"2024-01-21T19:59:06.416149+0000","last_clean":"2024-01-21T19:59:06.416149+0000","last_became_active":"2024-01-21T19:59:06.410953+0000","last_became_peered":"2024-01-21T19:59:06.410953+0000","last_unstale":"2024-01-21T19:59:06.416149+0000","last_undegraded":"2024-01-21T19:59:06.416149+0000","last_fullsized":"2024-01-21T19:59:06.416149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399828+0000","last_change":"2024-01-21T19:59:06.037843+0000","last_active":"2024-01-21T19:59:06.399828+0000","last_peered":"2024-01-21T19:59:06.399828+0000","last_clean":"2024-01-21T19:59:06.399828+0000","last_became_active":"2024-01-21T19:59:06.033911+0000","last_became_peered":"2024-01-21T19:59:06.033911+0000","last_unstale":"2024-01-21T19:59:06.399828+0000","last_undegraded":"2024-01-21T19:59:06.399828+0000","last_fullsized":"2024-01-21T19:59:06.399828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.411011+0000","last_change":"2024-01-21T19:59:06.409655+0000","last_active":"2024-01-21T19:59:06.411011+0000","last_peered":"2024-01-21T19:59:06.411011+0000","last_clean":"2024-01-21T19:59:06.411011+0000","last_became_active":"2024-01-21T19:59:06.408656+0000","last_became_peered":"2024-01-21T19:59:06.408656+0000","last_unstale":"2024-01-21T19:59:06.411011+0000","last_undegraded":"2024-01-21T19:59:06.411011+0000","last_fullsized":"2024-01-21T19:59:06.411011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392261+0000","last_change":"2024-01-21T19:59:06.036207+0000","last_active":"2024-01-21T19:59:06.392261+0000","last_peered":"2024-01-21T19:59:06.392261+0000","last_clean":"2024-01-21T19:59:06.392261+0000","last_became_active":"2024-01-21T19:59:06.035921+0000","last_became_peered":"2024-01-21T19:59:06.035921+0000","last_unstale":"2024-01-21T19:59:06.392261+0000","last_undegraded":"2024-01-21T19:59:06.392261+0000","last_fullsized":"2024-01-21T19:59:06.392261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416535+0000","last_change":"2024-01-21T19:59:06.406341+0000","last_active":"2024-01-21T19:59:06.416535+0000","last_peered":"2024-01-21T19:59:06.416535+0000","last_clean":"2024-01-21T19:59:06.416535+0000","last_became_active":"2024-01-21T19:59:06.405508+0000","last_became_peered":"2024-01-21T19:59:06.405508+0000","last_unstale":"2024-01-21T19:59:06.416535+0000","last_undegraded":"2024-01-21T19:59:06.416535+0000","last_fullsized":"2024-01-21T19:59:06.416535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399066+0000","last_change":"2024-01-21T19:59:06.042182+0000","last_active":"2024-01-21T19:59:06.399066+0000","last_peered":"2024-01-21T19:59:06.399066+0000","last_clean":"2024-01-21T19:59:06.399066+0000","last_became_active":"2024-01-21T19:59:06.041899+0000","last_became_peered":"2024-01-21T19:59:06.041899+0000","last_unstale":"2024-01-21T19:59:06.399066+0000","last_undegraded":"2024-01-21T19:59:06.399066+0000","last_fullsized":"2024-01-21T19:59:06.399066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417530+0000","last_change":"2024-01-21T19:59:06.408589+0000","last_active":"2024-01-21T19:59:06.417530+0000","last_peered":"2024-01-21T19:59:06.417530+0000","last_clean":"2024-01-21T19:59:06.417530+0000","last_became_active":"2024-01-21T19:59:06.407943+0000","last_became_peered":"2024-01-21T19:59:06.407943+0000","last_unstale":"2024-01-21T19:59:06.417530+0000","last_undegraded":"2024-01-21T19:59:06.417530+0000","last_fullsized":"2024-01-21T19:59:06.417530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396785+0000","last_change":"2024-01-21T19:59:06.030824+0000","last_active":"2024-01-21T19:59:06.396785+0000","last_peered":"2024-01-21T19:59:06.396785+0000","last_clean":"2024-01-21T19:59:06.396785+0000","last_became_active":"2024-01-21T19:59:06.030428+0000","last_became_peered":"2024-01-21T19:59:06.030428+0000","last_unstale":"2024-01-21T19:59:06.396785+0000","last_undegraded":"2024-01-21T19:59:06.396785+0000","last_fullsized":"2024-01-21T19:59:06.396785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415606+0000","last_change":"2024-01-21T19:59:06.409370+0000","last_active":"2024-01-21T19:59:06.415606+0000","last_peered":"2024-01-21T19:59:06.415606+0000","last_clean":"2024-01-21T19:59:06.415606+0000","last_became_active":"2024-01-21T19:59:06.406417+0000","last_became_peered":"2024-01-21T19:59:06.406417+0000","last_unstale":"2024-01-21T19:59:06.415606+0000","last_undegraded":"2024-01-21T19:59:06.415606+0000","last_fullsized":"2024-01-21T19:59:06.415606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406327+0000","last_change":"2024-01-21T19:59:06.035645+0000","last_active":"2024-01-21T19:59:06.406327+0000","last_peered":"2024-01-21T19:59:06.406327+0000","last_clean":"2024-01-21T19:59:06.406327+0000","last_became_active":"2024-01-21T19:59:06.035356+0000","last_became_peered":"2024-01-21T19:59:06.035356+0000","last_unstale":"2024-01-21T19:59:06.406327+0000","last_undegraded":"2024-01-21T19:59:06.406327+0000","last_fullsized":"2024-01-21T19:59:06.406327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412394+0000","last_change":"2024-01-21T19:59:06.407766+0000","last_active":"2024-01-21T19:59:06.412394+0000","last_peered":"2024-01-21T19:59:06.412394+0000","last_clean":"2024-01-21T19:59:06.412394+0000","last_became_active":"2024-01-21T19:59:06.407502+0000","last_became_peered":"2024-01-21T19:59:06.407502+0000","last_unstale":"2024-01-21T19:59:06.412394+0000","last_undegraded":"2024-01-21T19:59:06.412394+0000","last_fullsized":"2024-01-21T19:59:06.412394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392023+0000","last_change":"2024-01-21T19:59:06.036576+0000","last_active":"2024-01-21T19:59:06.392023+0000","last_peered":"2024-01-21T19:59:06.392023+0000","last_clean":"2024-01-21T19:59:06.392023+0000","last_became_active":"2024-01-21T19:59:06.036282+0000","last_became_peered":"2024-01-21T19:59:06.036282+0000","last_unstale":"2024-01-21T19:59:06.392023+0000","last_undegraded":"2024-01-21T19:59:06.392023+0000","last_fullsized":"2024-01-21T19:59:06.392023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403780+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:06.403780+0000","last_peered":"2024-01-21T19:59:06.403780+0000","last_clean":"2024-01-21T19:59:06.403780+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:06.403780+0000","last_undegraded":"2024-01-21T19:59:06.403780+0000","last_fullsized":"2024-01-21T19:59:06.403780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391912+0000","last_change":"2024-01-21T19:59:06.035851+0000","last_active":"2024-01-21T19:59:06.391912+0000","last_peered":"2024-01-21T19:59:06.391912+0000","last_clean":"2024-01-21T19:59:06.391912+0000","last_became_active":"2024-01-21T19:59:06.035316+0000","last_became_peered":"2024-01-21T19:59:06.035316+0000","last_unstale":"2024-01-21T19:59:06.391912+0000","last_undegraded":"2024-01-21T19:59:06.391912+0000","last_fullsized":"2024-01-21T19:59:06.391912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412286+0000","last_change":"2024-01-21T19:59:06.406779+0000","last_active":"2024-01-21T19:59:06.412286+0000","last_peered":"2024-01-21T19:59:06.412286+0000","last_clean":"2024-01-21T19:59:06.412286+0000","last_became_active":"2024-01-21T19:59:06.406509+0000","last_became_peered":"2024-01-21T19:59:06.406509+0000","last_unstale":"2024-01-21T19:59:06.412286+0000","last_undegraded":"2024-01-21T19:59:06.412286+0000","last_fullsized":"2024-01-21T19:59:06.412286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392515+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:06.392515+0000","last_peered":"2024-01-21T19:59:06.392515+0000","last_clean":"2024-01-21T19:59:06.392515+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:06.392515+0000","last_undegraded":"2024-01-21T19:59:06.392515+0000","last_fullsized":"2024-01-21T19:59:06.392515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407902+0000","last_change":"2024-01-21T19:59:06.041554+0000","last_active":"2024-01-21T19:59:06.407902+0000","last_peered":"2024-01-21T19:59:06.407902+0000","last_clean":"2024-01-21T19:59:06.407902+0000","last_became_active":"2024-01-21T19:59:06.041229+0000","last_became_peered":"2024-01-21T19:59:06.041229+0000","last_unstale":"2024-01-21T19:59:06.407902+0000","last_undegraded":"2024-01-21T19:59:06.407902+0000","last_fullsized":"2024-01-21T19:59:06.407902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412418+0000","last_change":"2024-01-21T19:59:06.407976+0000","last_active":"2024-01-21T19:59:06.412418+0000","last_peered":"2024-01-21T19:59:06.412418+0000","last_clean":"2024-01-21T19:59:06.412418+0000","last_became_active":"2024-01-21T19:59:06.407713+0000","last_became_peered":"2024-01-21T19:59:06.407713+0000","last_unstale":"2024-01-21T19:59:06.412418+0000","last_undegraded":"2024-01-21T19:59:06.412418+0000","last_fullsized":"2024-01-21T19:59:06.412418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412281+0000","last_change":"2024-01-21T19:59:06.406673+0000","last_active":"2024-01-21T19:59:06.412281+0000","last_peered":"2024-01-21T19:59:06.412281+0000","last_clean":"2024-01-21T19:59:06.412281+0000","last_became_active":"2024-01-21T19:59:06.406394+0000","last_became_peered":"2024-01-21T19:59:06.406394+0000","last_unstale":"2024-01-21T19:59:06.412281+0000","last_undegraded":"2024-01-21T19:59:06.412281+0000","last_fullsized":"2024-01-21T19:59:06.412281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388616+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:06.388616+0000","last_peered":"2024-01-21T19:59:06.388616+0000","last_clean":"2024-01-21T19:59:06.388616+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:06.388616+0000","last_undegraded":"2024-01-21T19:59:06.388616+0000","last_fullsized":"2024-01-21T19:59:06.388616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403727+0000","last_change":"2024-01-21T19:59:06.031330+0000","last_active":"2024-01-21T19:59:06.403727+0000","last_peered":"2024-01-21T19:59:06.403727+0000","last_clean":"2024-01-21T19:59:06.403727+0000","last_became_active":"2024-01-21T19:59:06.031043+0000","last_became_peered":"2024-01-21T19:59:06.031043+0000","last_unstale":"2024-01-21T19:59:06.403727+0000","last_undegraded":"2024-01-21T19:59:06.403727+0000","last_fullsized":"2024-01-21T19:59:06.403727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414575+0000","last_change":"2024-01-21T19:59:06.409494+0000","last_active":"2024-01-21T19:59:06.414575+0000","last_peered":"2024-01-21T19:59:06.414575+0000","last_clean":"2024-01-21T19:59:06.414575+0000","last_became_active":"2024-01-21T19:59:06.409221+0000","last_became_peered":"2024-01-21T19:59:06.409221+0000","last_unstale":"2024-01-21T19:59:06.414575+0000","last_undegraded":"2024-01-21T19:59:06.414575+0000","last_fullsized":"2024-01-21T19:59:06.414575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391231+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:06.391231+0000","last_peered":"2024-01-21T19:59:06.391231+0000","last_clean":"2024-01-21T19:59:06.391231+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:06.391231+0000","last_undegraded":"2024-01-21T19:59:06.391231+0000","last_fullsized":"2024-01-21T19:59:06.391231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.398950+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:06.398950+0000","last_peered":"2024-01-21T19:59:06.398950+0000","last_clean":"2024-01-21T19:59:06.398950+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:06.398950+0000","last_undegraded":"2024-01-21T19:59:06.398950+0000","last_fullsized":"2024-01-21T19:59:06.398950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392105+0000","last_change":"2024-01-21T19:59:06.034391+0000","last_active":"2024-01-21T19:59:06.392105+0000","last_peered":"2024-01-21T19:59:06.392105+0000","last_clean":"2024-01-21T19:59:06.392105+0000","last_became_active":"2024-01-21T19:59:06.034060+0000","last_became_peered":"2024-01-21T19:59:06.034060+0000","last_unstale":"2024-01-21T19:59:06.392105+0000","last_undegraded":"2024-01-21T19:59:06.392105+0000","last_fullsized":"2024-01-21T19:59:06.392105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410899+0000","last_change":"2024-01-21T19:59:06.408800+0000","last_active":"2024-01-21T19:59:06.410899+0000","last_peered":"2024-01-21T19:59:06.410899+0000","last_clean":"2024-01-21T19:59:06.410899+0000","last_became_active":"2024-01-21T19:59:06.408515+0000","last_became_peered":"2024-01-21T19:59:06.408515+0000","last_unstale":"2024-01-21T19:59:06.410899+0000","last_undegraded":"2024-01-21T19:59:06.410899+0000","last_fullsized":"2024-01-21T19:59:06.410899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401822+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:06.401822+0000","last_peered":"2024-01-21T19:59:06.401822+0000","last_clean":"2024-01-21T19:59:06.401822+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:06.401822+0000","last_undegraded":"2024-01-21T19:59:06.401822+0000","last_fullsized":"2024-01-21T19:59:06.401822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391457+0000","last_change":"2024-01-21T19:59:06.041530+0000","last_active":"2024-01-21T19:59:06.391457+0000","last_peered":"2024-01-21T19:59:06.391457+0000","last_clean":"2024-01-21T19:59:06.391457+0000","last_became_active":"2024-01-21T19:59:06.041251+0000","last_became_peered":"2024-01-21T19:59:06.041251+0000","last_unstale":"2024-01-21T19:59:06.391457+0000","last_undegraded":"2024-01-21T19:59:06.391457+0000","last_fullsized":"2024-01-21T19:59:06.391457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399714+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:06.399714+0000","last_peered":"2024-01-21T19:59:06.399714+0000","last_clean":"2024-01-21T19:59:06.399714+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:06.399714+0000","last_undegraded":"2024-01-21T19:59:06.399714+0000","last_fullsized":"2024-01-21T19:59:06.399714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403900+0000","last_change":"2024-01-21T19:59:06.031857+0000","last_active":"2024-01-21T19:59:06.403900+0000","last_peered":"2024-01-21T19:59:06.403900+0000","last_clean":"2024-01-21T19:59:06.403900+0000","last_became_active":"2024-01-21T19:59:06.031591+0000","last_became_peered":"2024-01-21T19:59:06.031591+0000","last_unstale":"2024-01-21T19:59:06.403900+0000","last_undegraded":"2024-01-21T19:59:06.403900+0000","last_fullsized":"2024-01-21T19:59:06.403900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402917+0000","last_change":"2024-01-21T19:59:06.401094+0000","last_active":"2024-01-21T19:59:06.402917+0000","last_peered":"2024-01-21T19:59:06.402917+0000","last_clean":"2024-01-21T19:59:06.402917+0000","last_became_active":"2024-01-21T19:59:06.400832+0000","last_became_peered":"2024-01-21T19:59:06.400832+0000","last_unstale":"2024-01-21T19:59:06.402917+0000","last_undegraded":"2024-01-21T19:59:06.402917+0000","last_fullsized":"2024-01-21T19:59:06.402917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410385+0000","last_change":"2024-01-21T19:59:06.039467+0000","last_active":"2024-01-21T19:59:06.410385+0000","last_peered":"2024-01-21T19:59:06.410385+0000","last_clean":"2024-01-21T19:59:06.410385+0000","last_became_active":"2024-01-21T19:59:06.039167+0000","last_became_peered":"2024-01-21T19:59:06.039167+0000","last_unstale":"2024-01-21T19:59:06.410385+0000","last_undegraded":"2024-01-21T19:59:06.410385+0000","last_fullsized":"2024-01-21T19:59:06.410385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405399+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:06.405399+0000","last_peered":"2024-01-21T19:59:06.405399+0000","last_clean":"2024-01-21T19:59:06.405399+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:06.405399+0000","last_undegraded":"2024-01-21T19:59:06.405399+0000","last_fullsized":"2024-01-21T19:59:06.405399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413120+0000","last_change":"2024-01-21T19:59:06.410865+0000","last_active":"2024-01-21T19:59:06.413120+0000","last_peered":"2024-01-21T19:59:06.413120+0000","last_clean":"2024-01-21T19:59:06.413120+0000","last_became_active":"2024-01-21T19:59:06.410572+0000","last_became_peered":"2024-01-21T19:59:06.410572+0000","last_unstale":"2024-01-21T19:59:06.413120+0000","last_undegraded":"2024-01-21T19:59:06.413120+0000","last_fullsized":"2024-01-21T19:59:06.413120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396528+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:06.396528+0000","last_peered":"2024-01-21T19:59:06.396528+0000","last_clean":"2024-01-21T19:59:06.396528+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:06.396528+0000","last_undegraded":"2024-01-21T19:59:06.396528+0000","last_fullsized":"2024-01-21T19:59:06.396528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392481+0000","last_change":"2024-01-21T19:59:06.039407+0000","last_active":"2024-01-21T19:59:06.392481+0000","last_peered":"2024-01-21T19:59:06.392481+0000","last_clean":"2024-01-21T19:59:06.392481+0000","last_became_active":"2024-01-21T19:59:06.039118+0000","last_became_peered":"2024-01-21T19:59:06.039118+0000","last_unstale":"2024-01-21T19:59:06.392481+0000","last_undegraded":"2024-01-21T19:59:06.392481+0000","last_fullsized":"2024-01-21T19:59:06.392481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415445+0000","last_change":"2024-01-21T19:59:06.411742+0000","last_active":"2024-01-21T19:59:06.415445+0000","last_peered":"2024-01-21T19:59:06.415445+0000","last_clean":"2024-01-21T19:59:06.415445+0000","last_became_active":"2024-01-21T19:59:06.408852+0000","last_became_peered":"2024-01-21T19:59:06.408852+0000","last_unstale":"2024-01-21T19:59:06.415445+0000","last_undegraded":"2024-01-21T19:59:06.415445+0000","last_fullsized":"2024-01-21T19:59:06.415445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413174+0000","last_change":"2024-01-21T19:59:06.411871+0000","last_active":"2024-01-21T19:59:06.413174+0000","last_peered":"2024-01-21T19:59:06.413174+0000","last_clean":"2024-01-21T19:59:06.413174+0000","last_became_active":"2024-01-21T19:59:06.411604+0000","last_became_peered":"2024-01-21T19:59:06.411604+0000","last_unstale":"2024-01-21T19:59:06.413174+0000","last_undegraded":"2024-01-21T19:59:06.413174+0000","last_fullsized":"2024-01-21T19:59:06.413174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394020+0000","last_change":"2024-01-21T19:59:06.042778+0000","last_active":"2024-01-21T19:59:06.394020+0000","last_peered":"2024-01-21T19:59:06.394020+0000","last_clean":"2024-01-21T19:59:06.394020+0000","last_became_active":"2024-01-21T19:59:06.042250+0000","last_became_peered":"2024-01-21T19:59:06.042250+0000","last_unstale":"2024-01-21T19:59:06.394020+0000","last_undegraded":"2024-01-21T19:59:06.394020+0000","last_fullsized":"2024-01-21T19:59:06.394020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415400+0000","last_change":"2024-01-21T19:59:06.408475+0000","last_active":"2024-01-21T19:59:06.415400+0000","last_peered":"2024-01-21T19:59:06.415400+0000","last_clean":"2024-01-21T19:59:06.415400+0000","last_became_active":"2024-01-21T19:59:06.406096+0000","last_became_peered":"2024-01-21T19:59:06.406096+0000","last_unstale":"2024-01-21T19:59:06.415400+0000","last_undegraded":"2024-01-21T19:59:06.415400+0000","last_fullsized":"2024-01-21T19:59:06.415400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392127+0000","last_change":"2024-01-21T19:59:06.041454+0000","last_active":"2024-01-21T19:59:06.392127+0000","last_peered":"2024-01-21T19:59:06.392127+0000","last_clean":"2024-01-21T19:59:06.392127+0000","last_became_active":"2024-01-21T19:59:06.041172+0000","last_became_peered":"2024-01-21T19:59:06.041172+0000","last_unstale":"2024-01-21T19:59:06.392127+0000","last_undegraded":"2024-01-21T19:59:06.392127+0000","last_fullsized":"2024-01-21T19:59:06.392127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416665+0000","last_change":"2024-01-21T19:59:06.404670+0000","last_active":"2024-01-21T19:59:06.416665+0000","last_peered":"2024-01-21T19:59:06.416665+0000","last_clean":"2024-01-21T19:59:06.416665+0000","last_became_active":"2024-01-21T19:59:06.404385+0000","last_became_peered":"2024-01-21T19:59:06.404385+0000","last_unstale":"2024-01-21T19:59:06.416665+0000","last_undegraded":"2024-01-21T19:59:06.416665+0000","last_fullsized":"2024-01-21T19:59:06.416665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404466+0000","last_change":"2024-01-21T19:59:06.032073+0000","last_active":"2024-01-21T19:59:06.404466+0000","last_peered":"2024-01-21T19:59:06.404466+0000","last_clean":"2024-01-21T19:59:06.404466+0000","last_became_active":"2024-01-21T19:59:06.031626+0000","last_became_peered":"2024-01-21T19:59:06.031626+0000","last_unstale":"2024-01-21T19:59:06.404466+0000","last_undegraded":"2024-01-21T19:59:06.404466+0000","last_fullsized":"2024-01-21T19:59:06.404466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402318+0000","last_change":"2024-01-21T19:59:06.399583+0000","last_active":"2024-01-21T19:59:06.402318+0000","last_peered":"2024-01-21T19:59:06.402318+0000","last_clean":"2024-01-21T19:59:06.402318+0000","last_became_active":"2024-01-21T19:59:06.399318+0000","last_became_peered":"2024-01-21T19:59:06.399318+0000","last_unstale":"2024-01-21T19:59:06.402318+0000","last_undegraded":"2024-01-21T19:59:06.402318+0000","last_fullsized":"2024-01-21T19:59:06.402318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406744+0000","last_change":"2024-01-21T19:59:06.034516+0000","last_active":"2024-01-21T19:59:06.406744+0000","last_peered":"2024-01-21T19:59:06.406744+0000","last_clean":"2024-01-21T19:59:06.406744+0000","last_became_active":"2024-01-21T19:59:06.034231+0000","last_became_peered":"2024-01-21T19:59:06.034231+0000","last_unstale":"2024-01-21T19:59:06.406744+0000","last_undegraded":"2024-01-21T19:59:06.406744+0000","last_fullsized":"2024-01-21T19:59:06.406744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418474+0000","last_change":"2024-01-21T19:59:06.413015+0000","last_active":"2024-01-21T19:59:06.418474+0000","last_peered":"2024-01-21T19:59:06.418474+0000","last_clean":"2024-01-21T19:59:06.418474+0000","last_became_active":"2024-01-21T19:59:06.412719+0000","last_became_peered":"2024-01-21T19:59:06.412719+0000","last_unstale":"2024-01-21T19:59:06.418474+0000","last_undegraded":"2024-01-21T19:59:06.418474+0000","last_fullsized":"2024-01-21T19:59:06.418474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400212+0000","last_change":"2024-01-21T19:59:06.037831+0000","last_active":"2024-01-21T19:59:06.400212+0000","last_peered":"2024-01-21T19:59:06.400212+0000","last_clean":"2024-01-21T19:59:06.400212+0000","last_became_active":"2024-01-21T19:59:06.037213+0000","last_became_peered":"2024-01-21T19:59:06.037213+0000","last_unstale":"2024-01-21T19:59:06.400212+0000","last_undegraded":"2024-01-21T19:59:06.400212+0000","last_fullsized":"2024-01-21T19:59:06.400212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412328+0000","last_change":"2024-01-21T19:59:06.407158+0000","last_active":"2024-01-21T19:59:06.412328+0000","last_peered":"2024-01-21T19:59:06.412328+0000","last_clean":"2024-01-21T19:59:06.412328+0000","last_became_active":"2024-01-21T19:59:06.406887+0000","last_became_peered":"2024-01-21T19:59:06.406887+0000","last_unstale":"2024-01-21T19:59:06.412328+0000","last_undegraded":"2024-01-21T19:59:06.412328+0000","last_fullsized":"2024-01-21T19:59:06.412328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394796+0000","last_change":"2024-01-21T19:59:06.040441+0000","last_active":"2024-01-21T19:59:06.394796+0000","last_peered":"2024-01-21T19:59:06.394796+0000","last_clean":"2024-01-21T19:59:06.394796+0000","last_became_active":"2024-01-21T19:59:06.040145+0000","last_became_peered":"2024-01-21T19:59:06.040145+0000","last_unstale":"2024-01-21T19:59:06.394796+0000","last_undegraded":"2024-01-21T19:59:06.394796+0000","last_fullsized":"2024-01-21T19:59:06.394796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412523+0000","last_change":"2024-01-21T19:59:06.408682+0000","last_active":"2024-01-21T19:59:06.412523+0000","last_peered":"2024-01-21T19:59:06.412523+0000","last_clean":"2024-01-21T19:59:06.412523+0000","last_became_active":"2024-01-21T19:59:06.408415+0000","last_became_peered":"2024-01-21T19:59:06.408415+0000","last_unstale":"2024-01-21T19:59:06.412523+0000","last_undegraded":"2024-01-21T19:59:06.412523+0000","last_fullsized":"2024-01-21T19:59:06.412523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388707+0000","last_change":"2024-01-21T19:59:06.033168+0000","last_active":"2024-01-21T19:59:06.388707+0000","last_peered":"2024-01-21T19:59:06.388707+0000","last_clean":"2024-01-21T19:59:06.388707+0000","last_became_active":"2024-01-21T19:59:06.032815+0000","last_became_peered":"2024-01-21T19:59:06.032815+0000","last_unstale":"2024-01-21T19:59:06.388707+0000","last_undegraded":"2024-01-21T19:59:06.388707+0000","last_fullsized":"2024-01-21T19:59:06.388707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414019+0000","last_change":"2024-01-21T19:59:06.412182+0000","last_active":"2024-01-21T19:59:06.414019+0000","last_peered":"2024-01-21T19:59:06.414019+0000","last_clean":"2024-01-21T19:59:06.414019+0000","last_became_active":"2024-01-21T19:59:06.411457+0000","last_became_peered":"2024-01-21T19:59:06.411457+0000","last_unstale":"2024-01-21T19:59:06.414019+0000","last_undegraded":"2024-01-21T19:59:06.414019+0000","last_fullsized":"2024-01-21T19:59:06.414019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392449+0000","last_change":"2024-01-21T19:59:06.036108+0000","last_active":"2024-01-21T19:59:06.392449+0000","last_peered":"2024-01-21T19:59:06.392449+0000","last_clean":"2024-01-21T19:59:06.392449+0000","last_became_active":"2024-01-21T19:59:06.035841+0000","last_became_peered":"2024-01-21T19:59:06.035841+0000","last_unstale":"2024-01-21T19:59:06.392449+0000","last_undegraded":"2024-01-21T19:59:06.392449+0000","last_fullsized":"2024-01-21T19:59:06.392449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413392+0000","last_change":"2024-01-21T19:59:06.411927+0000","last_active":"2024-01-21T19:59:06.413392+0000","last_peered":"2024-01-21T19:59:06.413392+0000","last_clean":"2024-01-21T19:59:06.413392+0000","last_became_active":"2024-01-21T19:59:06.411661+0000","last_became_peered":"2024-01-21T19:59:06.411661+0000","last_unstale":"2024-01-21T19:59:06.413392+0000","last_undegraded":"2024-01-21T19:59:06.413392+0000","last_fullsized":"2024-01-21T19:59:06.413392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.036660+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.036371+0000","last_became_peered":"2024-01-21T19:59:06.036371+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415968+0000","last_change":"2024-01-21T19:59:06.415069+0000","last_active":"2024-01-21T19:59:06.415968+0000","last_peered":"2024-01-21T19:59:06.415968+0000","last_clean":"2024-01-21T19:59:06.415968+0000","last_became_active":"2024-01-21T19:59:06.414647+0000","last_became_peered":"2024-01-21T19:59:06.414647+0000","last_unstale":"2024-01-21T19:59:06.415968+0000","last_undegraded":"2024-01-21T19:59:06.415968+0000","last_fullsized":"2024-01-21T19:59:06.415968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.393346+0000","last_change":"2024-01-21T19:59:06.042806+0000","last_active":"2024-01-21T19:59:06.393346+0000","last_peered":"2024-01-21T19:59:06.393346+0000","last_clean":"2024-01-21T19:59:06.393346+0000","last_became_active":"2024-01-21T19:59:06.042528+0000","last_became_peered":"2024-01-21T19:59:06.042528+0000","last_unstale":"2024-01-21T19:59:06.393346+0000","last_undegraded":"2024-01-21T19:59:06.393346+0000","last_fullsized":"2024-01-21T19:59:06.393346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416691+0000","last_change":"2024-01-21T19:59:06.410923+0000","last_active":"2024-01-21T19:59:06.416691+0000","last_peered":"2024-01-21T19:59:06.416691+0000","last_clean":"2024-01-21T19:59:06.416691+0000","last_became_active":"2024-01-21T19:59:06.408605+0000","last_became_peered":"2024-01-21T19:59:06.408605+0000","last_unstale":"2024-01-21T19:59:06.416691+0000","last_undegraded":"2024-01-21T19:59:06.416691+0000","last_fullsized":"2024-01-21T19:59:06.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404296+0000","last_change":"2024-01-21T19:59:06.033138+0000","last_active":"2024-01-21T19:59:06.404296+0000","last_peered":"2024-01-21T19:59:06.404296+0000","last_clean":"2024-01-21T19:59:06.404296+0000","last_became_active":"2024-01-21T19:59:06.032729+0000","last_became_peered":"2024-01-21T19:59:06.032729+0000","last_unstale":"2024-01-21T19:59:06.404296+0000","last_undegraded":"2024-01-21T19:59:06.404296+0000","last_fullsized":"2024-01-21T19:59:06.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412956+0000","last_change":"2024-01-21T19:59:06.409878+0000","last_active":"2024-01-21T19:59:06.412956+0000","last_peered":"2024-01-21T19:59:06.412956+0000","last_clean":"2024-01-21T19:59:06.412956+0000","last_became_active":"2024-01-21T19:59:06.409584+0000","last_became_peered":"2024-01-21T19:59:06.409584+0000","last_unstale":"2024-01-21T19:59:06.412956+0000","last_undegraded":"2024-01-21T19:59:06.412956+0000","last_fullsized":"2024-01-21T19:59:06.412956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396323+0000","last_change":"2024-01-21T19:59:06.036306+0000","last_active":"2024-01-21T19:59:06.396323+0000","last_peered":"2024-01-21T19:59:06.396323+0000","last_clean":"2024-01-21T19:59:06.396323+0000","last_became_active":"2024-01-21T19:59:06.036019+0000","last_became_peered":"2024-01-21T19:59:06.036019+0000","last_unstale":"2024-01-21T19:59:06.396323+0000","last_undegraded":"2024-01-21T19:59:06.396323+0000","last_fullsized":"2024-01-21T19:59:06.396323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407918+0000","last_change":"2024-01-21T19:59:06.403990+0000","last_active":"2024-01-21T19:59:06.407918+0000","last_peered":"2024-01-21T19:59:06.407918+0000","last_clean":"2024-01-21T19:59:06.407918+0000","last_became_active":"2024-01-21T19:59:06.403735+0000","last_became_peered":"2024-01-21T19:59:06.403735+0000","last_unstale":"2024-01-21T19:59:06.407918+0000","last_undegraded":"2024-01-21T19:59:06.407918+0000","last_fullsized":"2024-01-21T19:59:06.407918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.031905+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.031528+0000","last_became_peered":"2024-01-21T19:59:06.031528+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410340+0000","last_change":"2024-01-21T19:59:06.404278+0000","last_active":"2024-01-21T19:59:06.410340+0000","last_peered":"2024-01-21T19:59:06.410340+0000","last_clean":"2024-01-21T19:59:06.410340+0000","last_became_active":"2024-01-21T19:59:06.403605+0000","last_became_peered":"2024-01-21T19:59:06.403605+0000","last_unstale":"2024-01-21T19:59:06.410340+0000","last_undegraded":"2024-01-21T19:59:06.410340+0000","last_fullsized":"2024-01-21T19:59:06.410340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391853+0000","last_change":"2024-01-21T19:59:06.036513+0000","last_active":"2024-01-21T19:59:06.391853+0000","last_peered":"2024-01-21T19:59:06.391853+0000","last_clean":"2024-01-21T19:59:06.391853+0000","last_became_active":"2024-01-21T19:59:06.036203+0000","last_became_peered":"2024-01-21T19:59:06.036203+0000","last_unstale":"2024-01-21T19:59:06.391853+0000","last_undegraded":"2024-01-21T19:59:06.391853+0000","last_fullsized":"2024-01-21T19:59:06.391853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418991+0000","last_change":"2024-01-21T19:59:06.413135+0000","last_active":"2024-01-21T19:59:06.418991+0000","last_peered":"2024-01-21T19:59:06.418991+0000","last_clean":"2024-01-21T19:59:06.418991+0000","last_became_active":"2024-01-21T19:59:06.412662+0000","last_became_peered":"2024-01-21T19:59:06.412662+0000","last_unstale":"2024-01-21T19:59:06.418991+0000","last_undegraded":"2024-01-21T19:59:06.418991+0000","last_fullsized":"2024-01-21T19:59:06.418991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394244+0000","last_change":"2024-01-21T19:59:06.041668+0000","last_active":"2024-01-21T19:59:06.394244+0000","last_peered":"2024-01-21T19:59:06.394244+0000","last_clean":"2024-01-21T19:59:06.394244+0000","last_became_active":"2024-01-21T19:59:06.041337+0000","last_became_peered":"2024-01-21T19:59:06.041337+0000","last_unstale":"2024-01-21T19:59:06.394244+0000","last_undegraded":"2024-01-21T19:59:06.394244+0000","last_fullsized":"2024-01-21T19:59:06.394244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410112+0000","last_change":"2024-01-21T19:59:06.405482+0000","last_active":"2024-01-21T19:59:06.410112+0000","last_peered":"2024-01-21T19:59:06.410112+0000","last_clean":"2024-01-21T19:59:06.410112+0000","last_became_active":"2024-01-21T19:59:06.405206+0000","last_became_peered":"2024-01-21T19:59:06.405206+0000","last_unstale":"2024-01-21T19:59:06.410112+0000","last_undegraded":"2024-01-21T19:59:06.410112+0000","last_fullsized":"2024-01-21T19:59:06.410112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392562+0000","last_change":"2024-01-21T19:59:06.033405+0000","last_active":"2024-01-21T19:59:06.392562+0000","last_peered":"2024-01-21T19:59:06.392562+0000","last_clean":"2024-01-21T19:59:06.392562+0000","last_became_active":"2024-01-21T19:59:06.033067+0000","last_became_peered":"2024-01-21T19:59:06.033067+0000","last_unstale":"2024-01-21T19:59:06.392562+0000","last_undegraded":"2024-01-21T19:59:06.392562+0000","last_fullsized":"2024-01-21T19:59:06.392562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419068+0000","last_change":"2024-01-21T19:59:06.416968+0000","last_active":"2024-01-21T19:59:06.419068+0000","last_peered":"2024-01-21T19:59:06.419068+0000","last_clean":"2024-01-21T19:59:06.419068+0000","last_became_active":"2024-01-21T19:59:06.416702+0000","last_became_peered":"2024-01-21T19:59:06.416702+0000","last_unstale":"2024-01-21T19:59:06.419068+0000","last_undegraded":"2024-01-21T19:59:06.419068+0000","last_fullsized":"2024-01-21T19:59:06.419068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403561+0000","last_change":"2024-01-21T19:59:06.040770+0000","last_active":"2024-01-21T19:59:06.403561+0000","last_peered":"2024-01-21T19:59:06.403561+0000","last_clean":"2024-01-21T19:59:06.403561+0000","last_became_active":"2024-01-21T19:59:06.039205+0000","last_became_peered":"2024-01-21T19:59:06.039205+0000","last_unstale":"2024-01-21T19:59:06.403561+0000","last_undegraded":"2024-01-21T19:59:06.403561+0000","last_fullsized":"2024-01-21T19:59:06.403561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416618+0000","last_change":"2024-01-21T19:59:06.412006+0000","last_active":"2024-01-21T19:59:06.416618+0000","last_peered":"2024-01-21T19:59:06.416618+0000","last_clean":"2024-01-21T19:59:06.416618+0000","last_became_active":"2024-01-21T19:59:06.411000+0000","last_became_peered":"2024-01-21T19:59:06.411000+0000","last_unstale":"2024-01-21T19:59:06.416618+0000","last_undegraded":"2024-01-21T19:59:06.416618+0000","last_fullsized":"2024-01-21T19:59:06.416618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396610+0000","last_change":"2024-01-21T19:59:06.031139+0000","last_active":"2024-01-21T19:59:06.396610+0000","last_peered":"2024-01-21T19:59:06.396610+0000","last_clean":"2024-01-21T19:59:06.396610+0000","last_became_active":"2024-01-21T19:59:06.030914+0000","last_became_peered":"2024-01-21T19:59:06.030914+0000","last_unstale":"2024-01-21T19:59:06.396610+0000","last_undegraded":"2024-01-21T19:59:06.396610+0000","last_fullsized":"2024-01-21T19:59:06.396610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413171+0000","last_change":"2024-01-21T19:59:06.411676+0000","last_active":"2024-01-21T19:59:06.413171+0000","last_peered":"2024-01-21T19:59:06.413171+0000","last_clean":"2024-01-21T19:59:06.413171+0000","last_became_active":"2024-01-21T19:59:06.411417+0000","last_became_peered":"2024-01-21T19:59:06.411417+0000","last_unstale":"2024-01-21T19:59:06.413171+0000","last_undegraded":"2024-01-21T19:59:06.413171+0000","last_fullsized":"2024-01-21T19:59:06.413171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416934+0000","last_change":"2024-01-21T19:59:06.027798+0000","last_active":"2024-01-21T19:59:06.416934+0000","last_peered":"2024-01-21T19:59:06.416934+0000","last_clean":"2024-01-21T19:59:06.416934+0000","last_became_active":"2024-01-21T19:59:06.027498+0000","last_became_peered":"2024-01-21T19:59:06.027498+0000","last_unstale":"2024-01-21T19:59:06.416934+0000","last_undegraded":"2024-01-21T19:59:06.416934+0000","last_fullsized":"2024-01-21T19:59:06.416934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402297+0000","last_change":"2024-01-21T19:59:06.398605+0000","last_active":"2024-01-21T19:59:06.402297+0000","last_peered":"2024-01-21T19:59:06.402297+0000","last_clean":"2024-01-21T19:59:06.402297+0000","last_became_active":"2024-01-21T19:59:06.398350+0000","last_became_peered":"2024-01-21T19:59:06.398350+0000","last_unstale":"2024-01-21T19:59:06.402297+0000","last_undegraded":"2024-01-21T19:59:06.402297+0000","last_fullsized":"2024-01-21T19:59:06.402297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388678+0000","last_change":"2024-01-21T19:59:06.024779+0000","last_active":"2024-01-21T19:59:06.388678+0000","last_peered":"2024-01-21T19:59:06.388678+0000","last_clean":"2024-01-21T19:59:06.388678+0000","last_became_active":"2024-01-21T19:59:06.024455+0000","last_became_peered":"2024-01-21T19:59:06.024455+0000","last_unstale":"2024-01-21T19:59:06.388678+0000","last_undegraded":"2024-01-21T19:59:06.388678+0000","last_fullsized":"2024-01-21T19:59:06.388678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416608+0000","last_change":"2024-01-21T19:59:06.411381+0000","last_active":"2024-01-21T19:59:06.416608+0000","last_peered":"2024-01-21T19:59:06.416608+0000","last_clean":"2024-01-21T19:59:06.416608+0000","last_became_active":"2024-01-21T19:59:06.411065+0000","last_became_peered":"2024-01-21T19:59:06.411065+0000","last_unstale":"2024-01-21T19:59:06.416608+0000","last_undegraded":"2024-01-21T19:59:06.416608+0000","last_fullsized":"2024-01-21T19:59:06.416608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391431+0000","last_change":"2024-01-21T19:59:06.035305+0000","last_active":"2024-01-21T19:59:06.391431+0000","last_peered":"2024-01-21T19:59:06.391431+0000","last_clean":"2024-01-21T19:59:06.391431+0000","last_became_active":"2024-01-21T19:59:06.035011+0000","last_became_peered":"2024-01-21T19:59:06.035011+0000","last_unstale":"2024-01-21T19:59:06.391431+0000","last_undegraded":"2024-01-21T19:59:06.391431+0000","last_fullsized":"2024-01-21T19:59:06.391431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410360+0000","last_change":"2024-01-21T19:59:06.404314+0000","last_active":"2024-01-21T19:59:06.410360+0000","last_peered":"2024-01-21T19:59:06.410360+0000","last_clean":"2024-01-21T19:59:06.410360+0000","last_became_active":"2024-01-21T19:59:06.403954+0000","last_became_peered":"2024-01-21T19:59:06.403954+0000","last_unstale":"2024-01-21T19:59:06.410360+0000","last_undegraded":"2024-01-21T19:59:06.410360+0000","last_fullsized":"2024-01-21T19:59:06.410360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403338+0000","last_change":"2024-01-21T19:59:06.039241+0000","last_active":"2024-01-21T19:59:06.403338+0000","last_peered":"2024-01-21T19:59:06.403338+0000","last_clean":"2024-01-21T19:59:06.403338+0000","last_became_active":"2024-01-21T19:59:06.038967+0000","last_became_peered":"2024-01-21T19:59:06.038967+0000","last_unstale":"2024-01-21T19:59:06.403338+0000","last_undegraded":"2024-01-21T19:59:06.403338+0000","last_fullsized":"2024-01-21T19:59:06.403338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404457+0000","last_change":"2024-01-21T19:59:06.398845+0000","last_active":"2024-01-21T19:59:06.404457+0000","last_peered":"2024-01-21T19:59:06.404457+0000","last_clean":"2024-01-21T19:59:06.404457+0000","last_became_active":"2024-01-21T19:59:06.398598+0000","last_became_peered":"2024-01-21T19:59:06.398598+0000","last_unstale":"2024-01-21T19:59:06.404457+0000","last_undegraded":"2024-01-21T19:59:06.404457+0000","last_fullsized":"2024-01-21T19:59:06.404457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403951+0000","last_change":"2024-01-21T19:59:06.031315+0000","last_active":"2024-01-21T19:59:06.403951+0000","last_peered":"2024-01-21T19:59:06.403951+0000","last_clean":"2024-01-21T19:59:06.403951+0000","last_became_active":"2024-01-21T19:59:06.031001+0000","last_became_peered":"2024-01-21T19:59:06.031001+0000","last_unstale":"2024-01-21T19:59:06.403951+0000","last_undegraded":"2024-01-21T19:59:06.403951+0000","last_fullsized":"2024-01-21T19:59:06.403951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418455+0000","last_change":"2024-01-21T19:59:06.412803+0000","last_active":"2024-01-21T19:59:06.418455+0000","last_peered":"2024-01-21T19:59:06.418455+0000","last_clean":"2024-01-21T19:59:06.418455+0000","last_became_active":"2024-01-21T19:59:06.412494+0000","last_became_peered":"2024-01-21T19:59:06.412494+0000","last_unstale":"2024-01-21T19:59:06.418455+0000","last_undegraded":"2024-01-21T19:59:06.418455+0000","last_fullsized":"2024-01-21T19:59:06.418455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392612+0000","last_change":"2024-01-21T19:59:06.036578+0000","last_active":"2024-01-21T19:59:06.392612+0000","last_peered":"2024-01-21T19:59:06.392612+0000","last_clean":"2024-01-21T19:59:06.392612+0000","last_became_active":"2024-01-21T19:59:06.036234+0000","last_became_peered":"2024-01-21T19:59:06.036234+0000","last_unstale":"2024-01-21T19:59:06.392612+0000","last_undegraded":"2024-01-21T19:59:06.392612+0000","last_fullsized":"2024-01-21T19:59:06.392612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417722+0000","last_change":"2024-01-21T19:59:06.417024+0000","last_active":"2024-01-21T19:59:06.417722+0000","last_peered":"2024-01-21T19:59:06.417722+0000","last_clean":"2024-01-21T19:59:06.417722+0000","last_became_active":"2024-01-21T19:59:06.416747+0000","last_became_peered":"2024-01-21T19:59:06.416747+0000","last_unstale":"2024-01-21T19:59:06.417722+0000","last_undegraded":"2024-01-21T19:59:06.417722+0000","last_fullsized":"2024-01-21T19:59:06.417722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407615+0000","last_change":"2024-01-21T19:59:06.033544+0000","last_active":"2024-01-21T19:59:06.407615+0000","last_peered":"2024-01-21T19:59:06.407615+0000","last_clean":"2024-01-21T19:59:06.407615+0000","last_became_active":"2024-01-21T19:59:06.031765+0000","last_became_peered":"2024-01-21T19:59:06.031765+0000","last_unstale":"2024-01-21T19:59:06.407615+0000","last_undegraded":"2024-01-21T19:59:06.407615+0000","last_fullsized":"2024-01-21T19:59:06.407615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403490+0000","last_change":"2024-01-21T19:59:06.400361+0000","last_active":"2024-01-21T19:59:06.403490+0000","last_peered":"2024-01-21T19:59:06.403490+0000","last_clean":"2024-01-21T19:59:06.403490+0000","last_became_active":"2024-01-21T19:59:06.400070+0000","last_became_peered":"2024-01-21T19:59:06.400070+0000","last_unstale":"2024-01-21T19:59:06.403490+0000","last_undegraded":"2024-01-21T19:59:06.403490+0000","last_fullsized":"2024-01-21T19:59:06.403490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419401+0000","last_change":"2024-01-21T19:59:06.037315+0000","last_active":"2024-01-21T19:59:06.419401+0000","last_peered":"2024-01-21T19:59:06.419401+0000","last_clean":"2024-01-21T19:59:06.419401+0000","last_became_active":"2024-01-21T19:59:06.036690+0000","last_became_peered":"2024-01-21T19:59:06.036690+0000","last_unstale":"2024-01-21T19:59:06.419401+0000","last_undegraded":"2024-01-21T19:59:06.419401+0000","last_fullsized":"2024-01-21T19:59:06.419401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404278+0000","last_change":"2024-01-21T19:59:06.399152+0000","last_active":"2024-01-21T19:59:06.404278+0000","last_peered":"2024-01-21T19:59:06.404278+0000","last_clean":"2024-01-21T19:59:06.404278+0000","last_became_active":"2024-01-21T19:59:06.398559+0000","last_became_peered":"2024-01-21T19:59:06.398559+0000","last_unstale":"2024-01-21T19:59:06.404278+0000","last_undegraded":"2024-01-21T19:59:06.404278+0000","last_fullsized":"2024-01-21T19:59:06.404278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.395765+0000","last_change":"2024-01-21T19:59:06.033529+0000","last_active":"2024-01-21T19:59:06.395765+0000","last_peered":"2024-01-21T19:59:06.395765+0000","last_clean":"2024-01-21T19:59:06.395765+0000","last_became_active":"2024-01-21T19:59:06.033242+0000","last_became_peered":"2024-01-21T19:59:06.033242+0000","last_unstale":"2024-01-21T19:59:06.395765+0000","last_undegraded":"2024-01-21T19:59:06.395765+0000","last_fullsized":"2024-01-21T19:59:06.395765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419003+0000","last_change":"2024-01-21T19:59:06.415302+0000","last_active":"2024-01-21T19:59:06.419003+0000","last_peered":"2024-01-21T19:59:06.419003+0000","last_clean":"2024-01-21T19:59:06.419003+0000","last_became_active":"2024-01-21T19:59:06.414840+0000","last_became_peered":"2024-01-21T19:59:06.414840+0000","last_unstale":"2024-01-21T19:59:06.419003+0000","last_undegraded":"2024-01-21T19:59:06.419003+0000","last_fullsized":"2024-01-21T19:59:06.419003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396109+0000","last_change":"2024-01-21T19:59:06.032758+0000","last_active":"2024-01-21T19:59:06.396109+0000","last_peered":"2024-01-21T19:59:06.396109+0000","last_clean":"2024-01-21T19:59:06.396109+0000","last_became_active":"2024-01-21T19:59:06.032460+0000","last_became_peered":"2024-01-21T19:59:06.032460+0000","last_unstale":"2024-01-21T19:59:06.396109+0000","last_undegraded":"2024-01-21T19:59:06.396109+0000","last_fullsized":"2024-01-21T19:59:06.396109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418725+0000","last_change":"2024-01-21T19:59:06.414719+0000","last_active":"2024-01-21T19:59:06.418725+0000","last_peered":"2024-01-21T19:59:06.418725+0000","last_clean":"2024-01-21T19:59:06.418725+0000","last_became_active":"2024-01-21T19:59:06.414337+0000","last_became_peered":"2024-01-21T19:59:06.414337+0000","last_unstale":"2024-01-21T19:59:06.418725+0000","last_undegraded":"2024-01-21T19:59:06.418725+0000","last_fullsized":"2024-01-21T19:59:06.418725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399500+0000","last_change":"2024-01-21T19:59:06.035036+0000","last_active":"2024-01-21T19:59:06.399500+0000","last_peered":"2024-01-21T19:59:06.399500+0000","last_clean":"2024-01-21T19:59:06.399500+0000","last_became_active":"2024-01-21T19:59:06.034698+0000","last_became_peered":"2024-01-21T19:59:06.034698+0000","last_unstale":"2024-01-21T19:59:06.399500+0000","last_undegraded":"2024-01-21T19:59:06.399500+0000","last_fullsized":"2024-01-21T19:59:06.399500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401865+0000","last_change":"2024-01-21T19:59:06.397365+0000","last_active":"2024-01-21T19:59:06.401865+0000","last_peered":"2024-01-21T19:59:06.401865+0000","last_clean":"2024-01-21T19:59:06.401865+0000","last_became_active":"2024-01-21T19:59:06.397044+0000","last_became_peered":"2024-01-21T19:59:06.397044+0000","last_unstale":"2024-01-21T19:59:06.401865+0000","last_undegraded":"2024-01-21T19:59:06.401865+0000","last_fullsized":"2024-01-21T19:59:06.401865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394352+0000","last_change":"2024-01-21T19:59:06.033282+0000","last_active":"2024-01-21T19:59:06.394352+0000","last_peered":"2024-01-21T19:59:06.394352+0000","last_clean":"2024-01-21T19:59:06.394352+0000","last_became_active":"2024-01-21T19:59:06.033013+0000","last_became_peered":"2024-01-21T19:59:06.033013+0000","last_unstale":"2024-01-21T19:59:06.394352+0000","last_undegraded":"2024-01-21T19:59:06.394352+0000","last_fullsized":"2024-01-21T19:59:06.394352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413996+0000","last_change":"2024-01-21T19:59:06.412489+0000","last_active":"2024-01-21T19:59:06.413996+0000","last_peered":"2024-01-21T19:59:06.413996+0000","last_clean":"2024-01-21T19:59:06.413996+0000","last_became_active":"2024-01-21T19:59:06.412296+0000","last_became_peered":"2024-01-21T19:59:06.412296+0000","last_unstale":"2024-01-21T19:59:06.413996+0000","last_undegraded":"2024-01-21T19:59:06.413996+0000","last_fullsized":"2024-01-21T19:59:06.413996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405984+0000","last_change":"2024-01-21T19:59:06.040467+0000","last_active":"2024-01-21T19:59:06.405984+0000","last_peered":"2024-01-21T19:59:06.405984+0000","last_clean":"2024-01-21T19:59:06.405984+0000","last_became_active":"2024-01-21T19:59:06.040135+0000","last_became_peered":"2024-01-21T19:59:06.040135+0000","last_unstale":"2024-01-21T19:59:06.405984+0000","last_undegraded":"2024-01-21T19:59:06.405984+0000","last_fullsized":"2024-01-21T19:59:06.405984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418656+0000","last_change":"2024-01-21T19:59:06.414583+0000","last_active":"2024-01-21T19:59:06.418656+0000","last_peered":"2024-01-21T19:59:06.418656+0000","last_clean":"2024-01-21T19:59:06.418656+0000","last_became_active":"2024-01-21T19:59:06.414307+0000","last_became_peered":"2024-01-21T19:59:06.414307+0000","last_unstale":"2024-01-21T19:59:06.418656+0000","last_undegraded":"2024-01-21T19:59:06.418656+0000","last_fullsized":"2024-01-21T19:59:06.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400826+0000","last_change":"2024-01-21T19:59:06.037540+0000","last_active":"2024-01-21T19:59:06.400826+0000","last_peered":"2024-01-21T19:59:06.400826+0000","last_clean":"2024-01-21T19:59:06.400826+0000","last_became_active":"2024-01-21T19:59:06.037227+0000","last_became_peered":"2024-01-21T19:59:06.037227+0000","last_unstale":"2024-01-21T19:59:06.400826+0000","last_undegraded":"2024-01-21T19:59:06.400826+0000","last_fullsized":"2024-01-21T19:59:06.400826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410359+0000","last_change":"2024-01-21T19:59:06.407140+0000","last_active":"2024-01-21T19:59:06.410359+0000","last_peered":"2024-01-21T19:59:06.410359+0000","last_clean":"2024-01-21T19:59:06.410359+0000","last_became_active":"2024-01-21T19:59:06.406818+0000","last_became_peered":"2024-01-21T19:59:06.406818+0000","last_unstale":"2024-01-21T19:59:06.410359+0000","last_undegraded":"2024-01-21T19:59:06.410359+0000","last_fullsized":"2024-01-21T19:59:06.410359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412154+0000","last_change":"2024-01-21T19:59:06.038267+0000","last_active":"2024-01-21T19:59:06.412154+0000","last_peered":"2024-01-21T19:59:06.412154+0000","last_clean":"2024-01-21T19:59:06.412154+0000","last_became_active":"2024-01-21T19:59:06.037931+0000","last_became_peered":"2024-01-21T19:59:06.037931+0000","last_unstale":"2024-01-21T19:59:06.412154+0000","last_undegraded":"2024-01-21T19:59:06.412154+0000","last_fullsized":"2024-01-21T19:59:06.412154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402031+0000","last_change":"2024-01-21T19:59:06.397703+0000","last_active":"2024-01-21T19:59:06.402031+0000","last_peered":"2024-01-21T19:59:06.402031+0000","last_clean":"2024-01-21T19:59:06.402031+0000","last_became_active":"2024-01-21T19:59:06.397296+0000","last_became_peered":"2024-01-21T19:59:06.397296+0000","last_unstale":"2024-01-21T19:59:06.402031+0000","last_undegraded":"2024-01-21T19:59:06.402031+0000","last_fullsized":"2024-01-21T19:59:06.402031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402469+0000","last_change":"2024-01-21T19:59:06.036008+0000","last_active":"2024-01-21T19:59:06.402469+0000","last_peered":"2024-01-21T19:59:06.402469+0000","last_clean":"2024-01-21T19:59:06.402469+0000","last_became_active":"2024-01-21T19:59:06.035721+0000","last_became_peered":"2024-01-21T19:59:06.035721+0000","last_unstale":"2024-01-21T19:59:06.402469+0000","last_undegraded":"2024-01-21T19:59:06.402469+0000","last_fullsized":"2024-01-21T19:59:06.402469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419018+0000","last_change":"2024-01-21T19:59:06.415104+0000","last_active":"2024-01-21T19:59:06.419018+0000","last_peered":"2024-01-21T19:59:06.419018+0000","last_clean":"2024-01-21T19:59:06.419018+0000","last_became_active":"2024-01-21T19:59:06.414325+0000","last_became_peered":"2024-01-21T19:59:06.414325+0000","last_unstale":"2024-01-21T19:59:06.419018+0000","last_undegraded":"2024-01-21T19:59:06.419018+0000","last_fullsized":"2024-01-21T19:59:06.419018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392399+0000","last_change":"2024-01-21T19:59:06.036961+0000","last_active":"2024-01-21T19:59:06.392399+0000","last_peered":"2024-01-21T19:59:06.392399+0000","last_clean":"2024-01-21T19:59:06.392399+0000","last_became_active":"2024-01-21T19:59:06.036674+0000","last_became_peered":"2024-01-21T19:59:06.036674+0000","last_unstale":"2024-01-21T19:59:06.392399+0000","last_undegraded":"2024-01-21T19:59:06.392399+0000","last_fullsized":"2024-01-21T19:59:06.392399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416883+0000","last_change":"2024-01-21T19:59:06.415128+0000","last_active":"2024-01-21T19:59:06.416883+0000","last_peered":"2024-01-21T19:59:06.416883+0000","last_clean":"2024-01-21T19:59:06.416883+0000","last_became_active":"2024-01-21T19:59:06.411896+0000","last_became_peered":"2024-01-21T19:59:06.411896+0000","last_unstale":"2024-01-21T19:59:06.416883+0000","last_undegraded":"2024-01-21T19:59:06.416883+0000","last_fullsized":"2024-01-21T19:59:06.416883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405540+0000","last_change":"2024-01-21T19:59:06.040769+0000","last_active":"2024-01-21T19:59:06.405540+0000","last_peered":"2024-01-21T19:59:06.405540+0000","last_clean":"2024-01-21T19:59:06.405540+0000","last_became_active":"2024-01-21T19:59:06.040493+0000","last_became_peered":"2024-01-21T19:59:06.040493+0000","last_unstale":"2024-01-21T19:59:06.405540+0000","last_undegraded":"2024-01-21T19:59:06.405540+0000","last_fullsized":"2024-01-21T19:59:06.405540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415838+0000","last_change":"2024-01-21T19:59:06.413738+0000","last_active":"2024-01-21T19:59:06.415838+0000","last_peered":"2024-01-21T19:59:06.415838+0000","last_clean":"2024-01-21T19:59:06.415838+0000","last_became_active":"2024-01-21T19:59:06.413499+0000","last_became_peered":"2024-01-21T19:59:06.413499+0000","last_unstale":"2024-01-21T19:59:06.415838+0000","last_undegraded":"2024-01-21T19:59:06.415838+0000","last_fullsized":"2024-01-21T19:59:06.415838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417380+0000","last_change":"2024-01-21T19:59:06.039198+0000","last_active":"2024-01-21T19:59:06.417380+0000","last_peered":"2024-01-21T19:59:06.417380+0000","last_clean":"2024-01-21T19:59:06.417380+0000","last_became_active":"2024-01-21T19:59:06.038161+0000","last_became_peered":"2024-01-21T19:59:06.038161+0000","last_unstale":"2024-01-21T19:59:06.417380+0000","last_undegraded":"2024-01-21T19:59:06.417380+0000","last_fullsized":"2024-01-21T19:59:06.417380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":85794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":84380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:10.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T19:59:10.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.237+0000 7fb5aaf43700 1 Processor -- start 2024-01-21T19:59:10.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.237+0000 7fb5aaf43700 1 -- start start 2024-01-21T19:59:10.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5aaf43700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5a41558c0 0x7fb5a40626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5aaf43700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 0x7fb5a4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5aaf43700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a40a50f0 con 0x7fb5a40bd180 2024-01-21T19:59:10.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5aaf43700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a40630d0 con 0x7fb5a41558c0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5aaf43700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40a4da0 con 0x7fb5a4155ca0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 0x7fb5a4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5a41558c0 0x7fb5a40626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5a41558c0 0x7fb5a40626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:34574/0 (socket says 172.21.15.133:34574) 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 0x7fb5a4062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:44842/0 (socket says 172.21.15.133:44842) 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 -- 172.21.15.133:0/1221323988 learned_addr learned my addr 172.21.15.133:0/1221323988 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a94e0700 1 --1- 172.21.15.133:0/1221323988 >> v1:172.21.15.178:6789/0 conn(0x7fb5a40bd180 0x7fb5a40bd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39348/0 (socket says 172.21.15.133:39348) 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 -- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 msgr2=0x7fb5a4062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 --2- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 0x7fb5a4062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 -- 172.21.15.133:0/1221323988 >> v1:172.21.15.178:6789/0 conn(0x7fb5a40bd180 legacy=0x7fb5a40bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 -- 172.21.15.133:0/1221323988 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40bde00 con 0x7fb5a41558c0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a37fe700 1 -- 172.21.15.133:0/1221323988 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429963725 0 0) 0x7fb5a40a50f0 con 0x7fb5a40bd180 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.238+0000 7fb5a8cdf700 1 --2- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a40626f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb598006fd0 tx=0x7fb5980090f0).ready entity=mon.1 client_cookie=7e8dc0a69e90ef55 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5a37fe700 1 -- 172.21.15.133:0/1221323988 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800b580 con 0x7fb5a41558c0 2024-01-21T19:59:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5a37fe700 1 -- 172.21.15.133:0/1221323988 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59800b6e0 con 0x7fb5a41558c0 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5a37fe700 1 -- 172.21.15.133:0/1221323988 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59800ba80 con 0x7fb5a41558c0 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 msgr2=0x7fb5a40626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a40626f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb598006fd0 tx=0x7fb5980090f0).stop 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1221323988 shutdown_connections 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a40626f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1221323988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a4155ca0 0x7fb5a4062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1221323988 >> 172.21.15.133:0/1221323988 conn(0x7fb5a40c8010 msgr2=0x7fb5a40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1221323988 shutdown_connections 2024-01-21T19:59:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.239+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1221323988 wait complete. 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.240+0000 7fb5aaf43700 1 Processor -- start 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.240+0000 7fb5aaf43700 1 -- start start 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a40bd180 0x7fb5a40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a4146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a4156470 con 0x7fb5a4155ca0 2024-01-21T19:59:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40c7740 con 0x7fb5a41558c0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5aaf43700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a40c6ea0 con 0x7fb5a40bd180 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5a94e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5a94e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60082/0 (socket says 172.21.15.133:60082) 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5a94e0700 1 -- 172.21.15.133:0/1410499464 learned_addr learned my addr 172.21.15.133:0/1410499464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5a3fff700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a4146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.241+0000 7fb5a8cdf700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a40bd180 0x7fb5a40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 -- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a40bd180 msgr2=0x7fb5a40c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a40bd180 0x7fb5a40c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 -- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 msgr2=0x7fb5a4146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a4146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 -- 172.21.15.133:0/1410499464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb598009370 con 0x7fb5a4155ca0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a3fff700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a4146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a94e0700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb59c00c730 tx=0x7fb59c001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c005c70 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c005dd0 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a40c7180 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c007300 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.242+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a40bf5a0 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.243+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a40bf400 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.243+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb59c0076b0 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.244+0000 7fb5a17fa700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 0x7fb588061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.244+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb59c079c60 con 0x7fb5a4155ca0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.244+0000 7fb5a8cdf700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 0x7fb588061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.244+0000 7fb5a8cdf700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 0x7fb588061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb598009fd0 tx=0x7fb598017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.248+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5a40bf400 con 0x7fb5a4155ca0 2024-01-21T19:59:10.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.474+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb5a40bf400 con 0x7fb5a4155ca0 2024-01-21T19:59:10.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.475+0000 7fb5a17fa700 1 -- 172.21.15.133:0/1410499464 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+950 (secure 0 0 0) 0x7fb5a40bf400 con 0x7fb5a4155ca0 2024-01-21T19:59:10.466 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:10.466 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2435702784,"bytes_avail":770658410496,"bytes_total":773094113280},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4267}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-01-21T19:58:49.119243+0000","services":{}},"progress_events":{}} 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.476+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 msgr2=0x7fb588061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.476+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 0x7fb588061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb598009fd0 tx=0x7fb598017000).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.476+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 msgr2=0x7fb5a40ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.476+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fb59c00c730 tx=0x7fb59c001520).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 shutdown_connections 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb58805f150 0x7fb588061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5a4155ca0 0x7fb5a40ac580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a40bd180 0x7fb5a40c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 --2- 172.21.15.133:0/1410499464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a41558c0 0x7fb5a4146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 >> 172.21.15.133:0/1410499464 conn(0x7fb5a40c8010 msgr2=0x7fb5a4153010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 shutdown_connections 2024-01-21T19:59:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.477+0000 7fb5aaf43700 1 -- 172.21.15.133:0/1410499464 wait complete. 2024-01-21T19:59:10.479 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T19:59:10.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:10.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.604+0000 7f04364ce700 1 Processor -- start 2024-01-21T19:59:10.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.604+0000 7f04364ce700 1 -- start start 2024-01-21T19:59:10.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f04364ce700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f04364ce700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 0x7f0430066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f04364ce700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04300654f0 con 0x7f04300a9e30 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f04364ce700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0430063700 con 0x7f04301546b0 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f04364ce700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430063950 con 0x7f04300bc6d0 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 0x7f0430066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:34590/0 (socket says 172.21.15.133:34590) 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042ffff700 1 -- 172.21.15.133:0/497612411 learned_addr learned my addr 172.21.15.133:0/497612411 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042f7fe700 1 --1- 172.21.15.133:0/497612411 >> v1:172.21.15.178:6789/0 conn(0x7f04300a9e30 0x7f0430065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39360/0 (socket says 172.21.15.133:39360) 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 -- 172.21.15.133:0/497612411 >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 msgr2=0x7f0430154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 --2- 172.21.15.133:0/497612411 >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 -- 172.21.15.133:0/497612411 >> v1:172.21.15.178:6789/0 conn(0x7f04300a9e30 legacy=0x7f0430065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 -- 172.21.15.133:0/497612411 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430065180 con 0x7f04300bc6d0 2024-01-21T19:59:10.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042ffff700 1 --2- 172.21.15.133:0/497612411 >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f042effd700 1 -- 172.21.15.133:0/497612411 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127896775 0 0) 0x7f04300654f0 con 0x7f04300a9e30 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.605+0000 7f0434a6b700 1 --2- 172.21.15.133:0/497612411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 0x7f0430066090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0428009e60 tx=0x7f0428009780).ready entity=mon.2 client_cookie=6b0639fd1f7af028 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f042effd700 1 -- 172.21.15.133:0/497612411 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800e070 con 0x7f04300bc6d0 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f042effd700 1 -- 172.21.15.133:0/497612411 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042800bb60 con 0x7f04300bc6d0 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f042effd700 1 -- 172.21.15.133:0/497612411 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428012410 con 0x7f04300bc6d0 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 -- 172.21.15.133:0/497612411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 msgr2=0x7f0430066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 --2- 172.21.15.133:0/497612411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 0x7f0430066090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0428009e60 tx=0x7f0428009780).stop 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 -- 172.21.15.133:0/497612411 shutdown_connections 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 --2- 172.21.15.133:0/497612411 >> v2:172.21.15.178:3300/0 conn(0x7f04301546b0 0x7f0430154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 --2- 172.21.15.133:0/497612411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300bc6d0 0x7f0430066090 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 -- 172.21.15.133:0/497612411 >> 172.21.15.133:0/497612411 conn(0x7f04300c8200 msgr2=0x7f04300c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 -- 172.21.15.133:0/497612411 shutdown_connections 2024-01-21T19:59:10.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.606+0000 7f04364ce700 1 -- 172.21.15.133:0/497612411 wait complete. 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.607+0000 7f04364ce700 1 Processor -- start 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.607+0000 7f04364ce700 1 -- start start 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300a9e30 0x7f043014d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04301546b0 0x7f04300626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301655d0 con 0x7f04300bc6d0 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04301649c0 con 0x7f04301546b0 2024-01-21T19:59:10.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f04364ce700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0430164ca0 con 0x7f04300a9e30 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f042f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60086/0 (socket says 172.21.15.133:60086) 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.608+0000 7f042f7fe700 1 -- 172.21.15.133:0/1306250664 learned_addr learned my addr 172.21.15.133:0/1306250664 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042ffff700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300a9e30 0x7f043014d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f0434a6b700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04301546b0 0x7f04300626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 -- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300a9e30 msgr2=0x7f043014d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300a9e30 0x7f043014d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 -- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04301546b0 msgr2=0x7f04300626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04301546b0 0x7f04300626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 -- 172.21.15.133:0/1306250664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009370 con 0x7f04300bc6d0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042f7fe700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f042400c440 tx=0x7f0424007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240072e0 con 0x7f04300bc6d0 2024-01-21T19:59:10.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424007440 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424005910 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0428009a20 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.609+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0430165260 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.610+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0430165740 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.610+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0424005d00 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.611+0000 7f042cff9700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 0x7f041c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.611+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0424079950 con 0x7f04300bc6d0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.611+0000 7f042ffff700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 0x7f041c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:10.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.611+0000 7f042ffff700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 0x7f041c061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0420009340 tx=0x7f0420008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:10.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.615+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f042404ac20 con 0x7f04300bc6d0 2024-01-21T19:59:10.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.774+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04300c4c80 con 0x7f041c05f150 2024-01-21T19:59:10.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.783+0000 7f042cff9700 1 -- 172.21.15.133:0/1306250664 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336457 (secure 0 0 0) 0x7f04300c4c80 con 0x7f041c05f150 2024-01-21T19:59:10.778 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 msgr2=0x7f041c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 0x7f041c061610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0420009340 tx=0x7f0420008040).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 msgr2=0x7f04300c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f042400c440 tx=0x7f0424007e30).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 shutdown_connections 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f041c05f150 0x7f041c061610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04301546b0 0x7f04300626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04300a9e30 0x7f043014d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 --2- 172.21.15.133:0/1306250664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04300bc6d0 0x7f04300c6d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 >> 172.21.15.133:0/1306250664 conn(0x7f04300c8200 msgr2=0x7f0430069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 shutdown_connections 2024-01-21T19:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:10.786+0000 7f04364ce700 1 -- 172.21.15.133:0/1306250664 wait complete. 2024-01-21T19:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:10.789 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T19:59:09.848561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378616,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596104,"statfs":{"total":773094113280,"available":770658410496,"internally_reserved":0,"allocated":1892352,"data_stored":685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408931+0000","last_change":"2024-01-21T19:59:06.407131+0000","last_active":"2024-01-21T19:59:06.408931+0000","last_peered":"2024-01-21T19:59:06.408931+0000","last_clean":"2024-01-21T19:59:06.408931+0000","last_became_active":"2024-01-21T19:59:06.406853+0000","last_became_peered":"2024-01-21T19:59:06.406853+0000","last_unstale":"2024-01-21T19:59:06.408931+0000","last_undegraded":"2024-01-21T19:59:06.408931+0000","last_fullsized":"2024-01-21T19:59:06.408931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405624+0000","last_change":"2024-01-21T19:59:06.034930+0000","last_active":"2024-01-21T19:59:06.405624+0000","last_peered":"2024-01-21T19:59:06.405624+0000","last_clean":"2024-01-21T19:59:06.405624+0000","last_became_active":"2024-01-21T19:59:06.034648+0000","last_became_peered":"2024-01-21T19:59:06.034648+0000","last_unstale":"2024-01-21T19:59:06.405624+0000","last_undegraded":"2024-01-21T19:59:06.405624+0000","last_fullsized":"2024-01-21T19:59:06.405624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415745+0000","last_change":"2024-01-21T19:59:06.414371+0000","last_active":"2024-01-21T19:59:06.415745+0000","last_peered":"2024-01-21T19:59:06.415745+0000","last_clean":"2024-01-21T19:59:06.415745+0000","last_became_active":"2024-01-21T19:59:06.414078+0000","last_became_peered":"2024-01-21T19:59:06.414078+0000","last_unstale":"2024-01-21T19:59:06.415745+0000","last_undegraded":"2024-01-21T19:59:06.415745+0000","last_fullsized":"2024-01-21T19:59:06.415745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403854+0000","last_change":"2024-01-21T19:59:06.035542+0000","last_active":"2024-01-21T19:59:06.403854+0000","last_peered":"2024-01-21T19:59:06.403854+0000","last_clean":"2024-01-21T19:59:06.403854+0000","last_became_active":"2024-01-21T19:59:06.035262+0000","last_became_peered":"2024-01-21T19:59:06.035262+0000","last_unstale":"2024-01-21T19:59:06.403854+0000","last_undegraded":"2024-01-21T19:59:06.403854+0000","last_fullsized":"2024-01-21T19:59:06.403854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406814+0000","last_change":"2024-01-21T19:59:06.405992+0000","last_active":"2024-01-21T19:59:06.406814+0000","last_peered":"2024-01-21T19:59:06.406814+0000","last_clean":"2024-01-21T19:59:06.406814+0000","last_became_active":"2024-01-21T19:59:06.405013+0000","last_became_peered":"2024-01-21T19:59:06.405013+0000","last_unstale":"2024-01-21T19:59:06.406814+0000","last_undegraded":"2024-01-21T19:59:06.406814+0000","last_fullsized":"2024-01-21T19:59:06.406814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392792+0000","last_change":"2024-01-21T19:59:06.041467+0000","last_active":"2024-01-21T19:59:06.392792+0000","last_peered":"2024-01-21T19:59:06.392792+0000","last_clean":"2024-01-21T19:59:06.392792+0000","last_became_active":"2024-01-21T19:59:06.041158+0000","last_became_peered":"2024-01-21T19:59:06.041158+0000","last_unstale":"2024-01-21T19:59:06.392792+0000","last_undegraded":"2024-01-21T19:59:06.392792+0000","last_fullsized":"2024-01-21T19:59:06.392792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408938+0000","last_change":"2024-01-21T19:59:06.407402+0000","last_active":"2024-01-21T19:59:06.408938+0000","last_peered":"2024-01-21T19:59:06.408938+0000","last_clean":"2024-01-21T19:59:06.408938+0000","last_became_active":"2024-01-21T19:59:06.406722+0000","last_became_peered":"2024-01-21T19:59:06.406722+0000","last_unstale":"2024-01-21T19:59:06.408938+0000","last_undegraded":"2024-01-21T19:59:06.408938+0000","last_fullsized":"2024-01-21T19:59:06.408938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392400+0000","last_change":"2024-01-21T19:59:06.038017+0000","last_active":"2024-01-21T19:59:06.392400+0000","last_peered":"2024-01-21T19:59:06.392400+0000","last_clean":"2024-01-21T19:59:06.392400+0000","last_became_active":"2024-01-21T19:59:06.037532+0000","last_became_peered":"2024-01-21T19:59:06.037532+0000","last_unstale":"2024-01-21T19:59:06.392400+0000","last_undegraded":"2024-01-21T19:59:06.392400+0000","last_fullsized":"2024-01-21T19:59:06.392400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415998+0000","last_change":"2024-01-21T19:59:06.415183+0000","last_active":"2024-01-21T19:59:06.415998+0000","last_peered":"2024-01-21T19:59:06.415998+0000","last_clean":"2024-01-21T19:59:06.415998+0000","last_became_active":"2024-01-21T19:59:06.414874+0000","last_became_peered":"2024-01-21T19:59:06.414874+0000","last_unstale":"2024-01-21T19:59:06.415998+0000","last_undegraded":"2024-01-21T19:59:06.415998+0000","last_fullsized":"2024-01-21T19:59:06.415998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392424+0000","last_change":"2024-01-21T19:59:06.039345+0000","last_active":"2024-01-21T19:59:06.392424+0000","last_peered":"2024-01-21T19:59:06.392424+0000","last_clean":"2024-01-21T19:59:06.392424+0000","last_became_active":"2024-01-21T19:59:06.039077+0000","last_became_peered":"2024-01-21T19:59:06.039077+0000","last_unstale":"2024-01-21T19:59:06.392424+0000","last_undegraded":"2024-01-21T19:59:06.392424+0000","last_fullsized":"2024-01-21T19:59:06.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412461+0000","last_change":"2024-01-21T19:59:06.408094+0000","last_active":"2024-01-21T19:59:06.412461+0000","last_peered":"2024-01-21T19:59:06.412461+0000","last_clean":"2024-01-21T19:59:06.412461+0000","last_became_active":"2024-01-21T19:59:06.407833+0000","last_became_peered":"2024-01-21T19:59:06.407833+0000","last_unstale":"2024-01-21T19:59:06.412461+0000","last_undegraded":"2024-01-21T19:59:06.412461+0000","last_fullsized":"2024-01-21T19:59:06.412461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417155+0000","last_change":"2024-01-21T19:59:06.037535+0000","last_active":"2024-01-21T19:59:06.417155+0000","last_peered":"2024-01-21T19:59:06.417155+0000","last_clean":"2024-01-21T19:59:06.417155+0000","last_became_active":"2024-01-21T19:59:06.037260+0000","last_became_peered":"2024-01-21T19:59:06.037260+0000","last_unstale":"2024-01-21T19:59:06.417155+0000","last_undegraded":"2024-01-21T19:59:06.417155+0000","last_fullsized":"2024-01-21T19:59:06.417155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415420+0000","last_change":"2024-01-21T19:59:06.411473+0000","last_active":"2024-01-21T19:59:06.415420+0000","last_peered":"2024-01-21T19:59:06.415420+0000","last_clean":"2024-01-21T19:59:06.415420+0000","last_became_active":"2024-01-21T19:59:06.408751+0000","last_became_peered":"2024-01-21T19:59:06.408751+0000","last_unstale":"2024-01-21T19:59:06.415420+0000","last_undegraded":"2024-01-21T19:59:06.415420+0000","last_fullsized":"2024-01-21T19:59:06.415420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419677+0000","last_change":"2024-01-21T19:59:06.037480+0000","last_active":"2024-01-21T19:59:06.419677+0000","last_peered":"2024-01-21T19:59:06.419677+0000","last_clean":"2024-01-21T19:59:06.419677+0000","last_became_active":"2024-01-21T19:59:06.037054+0000","last_became_peered":"2024-01-21T19:59:06.037054+0000","last_unstale":"2024-01-21T19:59:06.419677+0000","last_undegraded":"2024-01-21T19:59:06.419677+0000","last_fullsized":"2024-01-21T19:59:06.419677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413369+0000","last_change":"2024-01-21T19:59:06.411113+0000","last_active":"2024-01-21T19:59:06.413369+0000","last_peered":"2024-01-21T19:59:06.413369+0000","last_clean":"2024-01-21T19:59:06.413369+0000","last_became_active":"2024-01-21T19:59:06.410842+0000","last_became_peered":"2024-01-21T19:59:06.410842+0000","last_unstale":"2024-01-21T19:59:06.413369+0000","last_undegraded":"2024-01-21T19:59:06.413369+0000","last_fullsized":"2024-01-21T19:59:06.413369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415706+0000","last_change":"2024-01-21T19:59:06.042850+0000","last_active":"2024-01-21T19:59:06.415706+0000","last_peered":"2024-01-21T19:59:06.415706+0000","last_clean":"2024-01-21T19:59:06.415706+0000","last_became_active":"2024-01-21T19:59:06.041938+0000","last_became_peered":"2024-01-21T19:59:06.041938+0000","last_unstale":"2024-01-21T19:59:06.415706+0000","last_undegraded":"2024-01-21T19:59:06.415706+0000","last_fullsized":"2024-01-21T19:59:06.415706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413389+0000","last_change":"2024-01-21T19:59:06.411722+0000","last_active":"2024-01-21T19:59:06.413389+0000","last_peered":"2024-01-21T19:59:06.413389+0000","last_clean":"2024-01-21T19:59:06.413389+0000","last_became_active":"2024-01-21T19:59:06.411400+0000","last_became_peered":"2024-01-21T19:59:06.411400+0000","last_unstale":"2024-01-21T19:59:06.413389+0000","last_undegraded":"2024-01-21T19:59:06.413389+0000","last_fullsized":"2024-01-21T19:59:06.413389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392771+0000","last_change":"2024-01-21T19:59:06.040019+0000","last_active":"2024-01-21T19:59:06.392771+0000","last_peered":"2024-01-21T19:59:06.392771+0000","last_clean":"2024-01-21T19:59:06.392771+0000","last_became_active":"2024-01-21T19:59:06.038603+0000","last_became_peered":"2024-01-21T19:59:06.038603+0000","last_unstale":"2024-01-21T19:59:06.392771+0000","last_undegraded":"2024-01-21T19:59:06.392771+0000","last_fullsized":"2024-01-21T19:59:06.392771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401930+0000","last_change":"2024-01-21T19:59:06.397578+0000","last_active":"2024-01-21T19:59:06.401930+0000","last_peered":"2024-01-21T19:59:06.401930+0000","last_clean":"2024-01-21T19:59:06.401930+0000","last_became_active":"2024-01-21T19:59:06.397304+0000","last_became_peered":"2024-01-21T19:59:06.397304+0000","last_unstale":"2024-01-21T19:59:06.401930+0000","last_undegraded":"2024-01-21T19:59:06.401930+0000","last_fullsized":"2024-01-21T19:59:06.401930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405880+0000","last_change":"2024-01-21T19:59:06.037427+0000","last_active":"2024-01-21T19:59:06.405880+0000","last_peered":"2024-01-21T19:59:06.405880+0000","last_clean":"2024-01-21T19:59:06.405880+0000","last_became_active":"2024-01-21T19:59:06.037106+0000","last_became_peered":"2024-01-21T19:59:06.037106+0000","last_unstale":"2024-01-21T19:59:06.405880+0000","last_undegraded":"2024-01-21T19:59:06.405880+0000","last_fullsized":"2024-01-21T19:59:06.405880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412944+0000","last_change":"2024-01-21T19:59:06.410874+0000","last_active":"2024-01-21T19:59:06.412944+0000","last_peered":"2024-01-21T19:59:06.412944+0000","last_clean":"2024-01-21T19:59:06.412944+0000","last_became_active":"2024-01-21T19:59:06.410611+0000","last_became_peered":"2024-01-21T19:59:06.410611+0000","last_unstale":"2024-01-21T19:59:06.412944+0000","last_undegraded":"2024-01-21T19:59:06.412944+0000","last_fullsized":"2024-01-21T19:59:06.412944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407859+0000","last_change":"2024-01-21T19:59:06.041197+0000","last_active":"2024-01-21T19:59:06.407859+0000","last_peered":"2024-01-21T19:59:06.407859+0000","last_clean":"2024-01-21T19:59:06.407859+0000","last_became_active":"2024-01-21T19:59:06.040869+0000","last_became_peered":"2024-01-21T19:59:06.040869+0000","last_unstale":"2024-01-21T19:59:06.407859+0000","last_undegraded":"2024-01-21T19:59:06.407859+0000","last_fullsized":"2024-01-21T19:59:06.407859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413128+0000","last_change":"2024-01-21T19:59:06.411500+0000","last_active":"2024-01-21T19:59:06.413128+0000","last_peered":"2024-01-21T19:59:06.413128+0000","last_clean":"2024-01-21T19:59:06.413128+0000","last_became_active":"2024-01-21T19:59:06.411276+0000","last_became_peered":"2024-01-21T19:59:06.411276+0000","last_unstale":"2024-01-21T19:59:06.413128+0000","last_undegraded":"2024-01-21T19:59:06.413128+0000","last_fullsized":"2024-01-21T19:59:06.413128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415690+0000","last_change":"2024-01-21T19:59:06.038505+0000","last_active":"2024-01-21T19:59:06.415690+0000","last_peered":"2024-01-21T19:59:06.415690+0000","last_clean":"2024-01-21T19:59:06.415690+0000","last_became_active":"2024-01-21T19:59:06.038100+0000","last_became_peered":"2024-01-21T19:59:06.038100+0000","last_unstale":"2024-01-21T19:59:06.415690+0000","last_undegraded":"2024-01-21T19:59:06.415690+0000","last_fullsized":"2024-01-21T19:59:06.415690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415464+0000","last_change":"2024-01-21T19:59:06.412541+0000","last_active":"2024-01-21T19:59:06.415464+0000","last_peered":"2024-01-21T19:59:06.415464+0000","last_clean":"2024-01-21T19:59:06.415464+0000","last_became_active":"2024-01-21T19:59:06.412353+0000","last_became_peered":"2024-01-21T19:59:06.412353+0000","last_unstale":"2024-01-21T19:59:06.415464+0000","last_undegraded":"2024-01-21T19:59:06.415464+0000","last_fullsized":"2024-01-21T19:59:06.415464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418953+0000","last_change":"2024-01-21T19:59:06.034594+0000","last_active":"2024-01-21T19:59:06.418953+0000","last_peered":"2024-01-21T19:59:06.418953+0000","last_clean":"2024-01-21T19:59:06.418953+0000","last_became_active":"2024-01-21T19:59:06.034292+0000","last_became_peered":"2024-01-21T19:59:06.034292+0000","last_unstale":"2024-01-21T19:59:06.418953+0000","last_undegraded":"2024-01-21T19:59:06.418953+0000","last_fullsized":"2024-01-21T19:59:06.418953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416149+0000","last_change":"2024-01-21T19:59:06.411225+0000","last_active":"2024-01-21T19:59:06.416149+0000","last_peered":"2024-01-21T19:59:06.416149+0000","last_clean":"2024-01-21T19:59:06.416149+0000","last_became_active":"2024-01-21T19:59:06.410953+0000","last_became_peered":"2024-01-21T19:59:06.410953+0000","last_unstale":"2024-01-21T19:59:06.416149+0000","last_undegraded":"2024-01-21T19:59:06.416149+0000","last_fullsized":"2024-01-21T19:59:06.416149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399828+0000","last_change":"2024-01-21T19:59:06.037843+0000","last_active":"2024-01-21T19:59:06.399828+0000","last_peered":"2024-01-21T19:59:06.399828+0000","last_clean":"2024-01-21T19:59:06.399828+0000","last_became_active":"2024-01-21T19:59:06.033911+0000","last_became_peered":"2024-01-21T19:59:06.033911+0000","last_unstale":"2024-01-21T19:59:06.399828+0000","last_undegraded":"2024-01-21T19:59:06.399828+0000","last_fullsized":"2024-01-21T19:59:06.399828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.411011+0000","last_change":"2024-01-21T19:59:06.409655+0000","last_active":"2024-01-21T19:59:06.411011+0000","last_peered":"2024-01-21T19:59:06.411011+0000","last_clean":"2024-01-21T19:59:06.411011+0000","last_became_active":"2024-01-21T19:59:06.408656+0000","last_became_peered":"2024-01-21T19:59:06.408656+0000","last_unstale":"2024-01-21T19:59:06.411011+0000","last_undegraded":"2024-01-21T19:59:06.411011+0000","last_fullsized":"2024-01-21T19:59:06.411011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392261+0000","last_change":"2024-01-21T19:59:06.036207+0000","last_active":"2024-01-21T19:59:06.392261+0000","last_peered":"2024-01-21T19:59:06.392261+0000","last_clean":"2024-01-21T19:59:06.392261+0000","last_became_active":"2024-01-21T19:59:06.035921+0000","last_became_peered":"2024-01-21T19:59:06.035921+0000","last_unstale":"2024-01-21T19:59:06.392261+0000","last_undegraded":"2024-01-21T19:59:06.392261+0000","last_fullsized":"2024-01-21T19:59:06.392261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416535+0000","last_change":"2024-01-21T19:59:06.406341+0000","last_active":"2024-01-21T19:59:06.416535+0000","last_peered":"2024-01-21T19:59:06.416535+0000","last_clean":"2024-01-21T19:59:06.416535+0000","last_became_active":"2024-01-21T19:59:06.405508+0000","last_became_peered":"2024-01-21T19:59:06.405508+0000","last_unstale":"2024-01-21T19:59:06.416535+0000","last_undegraded":"2024-01-21T19:59:06.416535+0000","last_fullsized":"2024-01-21T19:59:06.416535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399066+0000","last_change":"2024-01-21T19:59:06.042182+0000","last_active":"2024-01-21T19:59:06.399066+0000","last_peered":"2024-01-21T19:59:06.399066+0000","last_clean":"2024-01-21T19:59:06.399066+0000","last_became_active":"2024-01-21T19:59:06.041899+0000","last_became_peered":"2024-01-21T19:59:06.041899+0000","last_unstale":"2024-01-21T19:59:06.399066+0000","last_undegraded":"2024-01-21T19:59:06.399066+0000","last_fullsized":"2024-01-21T19:59:06.399066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417530+0000","last_change":"2024-01-21T19:59:06.408589+0000","last_active":"2024-01-21T19:59:06.417530+0000","last_peered":"2024-01-21T19:59:06.417530+0000","last_clean":"2024-01-21T19:59:06.417530+0000","last_became_active":"2024-01-21T19:59:06.407943+0000","last_became_peered":"2024-01-21T19:59:06.407943+0000","last_unstale":"2024-01-21T19:59:06.417530+0000","last_undegraded":"2024-01-21T19:59:06.417530+0000","last_fullsized":"2024-01-21T19:59:06.417530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396785+0000","last_change":"2024-01-21T19:59:06.030824+0000","last_active":"2024-01-21T19:59:06.396785+0000","last_peered":"2024-01-21T19:59:06.396785+0000","last_clean":"2024-01-21T19:59:06.396785+0000","last_became_active":"2024-01-21T19:59:06.030428+0000","last_became_peered":"2024-01-21T19:59:06.030428+0000","last_unstale":"2024-01-21T19:59:06.396785+0000","last_undegraded":"2024-01-21T19:59:06.396785+0000","last_fullsized":"2024-01-21T19:59:06.396785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415606+0000","last_change":"2024-01-21T19:59:06.409370+0000","last_active":"2024-01-21T19:59:06.415606+0000","last_peered":"2024-01-21T19:59:06.415606+0000","last_clean":"2024-01-21T19:59:06.415606+0000","last_became_active":"2024-01-21T19:59:06.406417+0000","last_became_peered":"2024-01-21T19:59:06.406417+0000","last_unstale":"2024-01-21T19:59:06.415606+0000","last_undegraded":"2024-01-21T19:59:06.415606+0000","last_fullsized":"2024-01-21T19:59:06.415606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406327+0000","last_change":"2024-01-21T19:59:06.035645+0000","last_active":"2024-01-21T19:59:06.406327+0000","last_peered":"2024-01-21T19:59:06.406327+0000","last_clean":"2024-01-21T19:59:06.406327+0000","last_became_active":"2024-01-21T19:59:06.035356+0000","last_became_peered":"2024-01-21T19:59:06.035356+0000","last_unstale":"2024-01-21T19:59:06.406327+0000","last_undegraded":"2024-01-21T19:59:06.406327+0000","last_fullsized":"2024-01-21T19:59:06.406327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412394+0000","last_change":"2024-01-21T19:59:06.407766+0000","last_active":"2024-01-21T19:59:06.412394+0000","last_peered":"2024-01-21T19:59:06.412394+0000","last_clean":"2024-01-21T19:59:06.412394+0000","last_became_active":"2024-01-21T19:59:06.407502+0000","last_became_peered":"2024-01-21T19:59:06.407502+0000","last_unstale":"2024-01-21T19:59:06.412394+0000","last_undegraded":"2024-01-21T19:59:06.412394+0000","last_fullsized":"2024-01-21T19:59:06.412394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392023+0000","last_change":"2024-01-21T19:59:06.036576+0000","last_active":"2024-01-21T19:59:06.392023+0000","last_peered":"2024-01-21T19:59:06.392023+0000","last_clean":"2024-01-21T19:59:06.392023+0000","last_became_active":"2024-01-21T19:59:06.036282+0000","last_became_peered":"2024-01-21T19:59:06.036282+0000","last_unstale":"2024-01-21T19:59:06.392023+0000","last_undegraded":"2024-01-21T19:59:06.392023+0000","last_fullsized":"2024-01-21T19:59:06.392023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403780+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:06.403780+0000","last_peered":"2024-01-21T19:59:06.403780+0000","last_clean":"2024-01-21T19:59:06.403780+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:06.403780+0000","last_undegraded":"2024-01-21T19:59:06.403780+0000","last_fullsized":"2024-01-21T19:59:06.403780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391912+0000","last_change":"2024-01-21T19:59:06.035851+0000","last_active":"2024-01-21T19:59:06.391912+0000","last_peered":"2024-01-21T19:59:06.391912+0000","last_clean":"2024-01-21T19:59:06.391912+0000","last_became_active":"2024-01-21T19:59:06.035316+0000","last_became_peered":"2024-01-21T19:59:06.035316+0000","last_unstale":"2024-01-21T19:59:06.391912+0000","last_undegraded":"2024-01-21T19:59:06.391912+0000","last_fullsized":"2024-01-21T19:59:06.391912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412286+0000","last_change":"2024-01-21T19:59:06.406779+0000","last_active":"2024-01-21T19:59:06.412286+0000","last_peered":"2024-01-21T19:59:06.412286+0000","last_clean":"2024-01-21T19:59:06.412286+0000","last_became_active":"2024-01-21T19:59:06.406509+0000","last_became_peered":"2024-01-21T19:59:06.406509+0000","last_unstale":"2024-01-21T19:59:06.412286+0000","last_undegraded":"2024-01-21T19:59:06.412286+0000","last_fullsized":"2024-01-21T19:59:06.412286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392515+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:06.392515+0000","last_peered":"2024-01-21T19:59:06.392515+0000","last_clean":"2024-01-21T19:59:06.392515+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:06.392515+0000","last_undegraded":"2024-01-21T19:59:06.392515+0000","last_fullsized":"2024-01-21T19:59:06.392515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407902+0000","last_change":"2024-01-21T19:59:06.041554+0000","last_active":"2024-01-21T19:59:06.407902+0000","last_peered":"2024-01-21T19:59:06.407902+0000","last_clean":"2024-01-21T19:59:06.407902+0000","last_became_active":"2024-01-21T19:59:06.041229+0000","last_became_peered":"2024-01-21T19:59:06.041229+0000","last_unstale":"2024-01-21T19:59:06.407902+0000","last_undegraded":"2024-01-21T19:59:06.407902+0000","last_fullsized":"2024-01-21T19:59:06.407902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412418+0000","last_change":"2024-01-21T19:59:06.407976+0000","last_active":"2024-01-21T19:59:06.412418+0000","last_peered":"2024-01-21T19:59:06.412418+0000","last_clean":"2024-01-21T19:59:06.412418+0000","last_became_active":"2024-01-21T19:59:06.407713+0000","last_became_peered":"2024-01-21T19:59:06.407713+0000","last_unstale":"2024-01-21T19:59:06.412418+0000","last_undegraded":"2024-01-21T19:59:06.412418+0000","last_fullsized":"2024-01-21T19:59:06.412418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412281+0000","last_change":"2024-01-21T19:59:06.406673+0000","last_active":"2024-01-21T19:59:06.412281+0000","last_peered":"2024-01-21T19:59:06.412281+0000","last_clean":"2024-01-21T19:59:06.412281+0000","last_became_active":"2024-01-21T19:59:06.406394+0000","last_became_peered":"2024-01-21T19:59:06.406394+0000","last_unstale":"2024-01-21T19:59:06.412281+0000","last_undegraded":"2024-01-21T19:59:06.412281+0000","last_fullsized":"2024-01-21T19:59:06.412281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388616+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:06.388616+0000","last_peered":"2024-01-21T19:59:06.388616+0000","last_clean":"2024-01-21T19:59:06.388616+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:06.388616+0000","last_undegraded":"2024-01-21T19:59:06.388616+0000","last_fullsized":"2024-01-21T19:59:06.388616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403727+0000","last_change":"2024-01-21T19:59:06.031330+0000","last_active":"2024-01-21T19:59:06.403727+0000","last_peered":"2024-01-21T19:59:06.403727+0000","last_clean":"2024-01-21T19:59:06.403727+0000","last_became_active":"2024-01-21T19:59:06.031043+0000","last_became_peered":"2024-01-21T19:59:06.031043+0000","last_unstale":"2024-01-21T19:59:06.403727+0000","last_undegraded":"2024-01-21T19:59:06.403727+0000","last_fullsized":"2024-01-21T19:59:06.403727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414575+0000","last_change":"2024-01-21T19:59:06.409494+0000","last_active":"2024-01-21T19:59:06.414575+0000","last_peered":"2024-01-21T19:59:06.414575+0000","last_clean":"2024-01-21T19:59:06.414575+0000","last_became_active":"2024-01-21T19:59:06.409221+0000","last_became_peered":"2024-01-21T19:59:06.409221+0000","last_unstale":"2024-01-21T19:59:06.414575+0000","last_undegraded":"2024-01-21T19:59:06.414575+0000","last_fullsized":"2024-01-21T19:59:06.414575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391231+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:06.391231+0000","last_peered":"2024-01-21T19:59:06.391231+0000","last_clean":"2024-01-21T19:59:06.391231+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:06.391231+0000","last_undegraded":"2024-01-21T19:59:06.391231+0000","last_fullsized":"2024-01-21T19:59:06.391231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.398950+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:06.398950+0000","last_peered":"2024-01-21T19:59:06.398950+0000","last_clean":"2024-01-21T19:59:06.398950+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:06.398950+0000","last_undegraded":"2024-01-21T19:59:06.398950+0000","last_fullsized":"2024-01-21T19:59:06.398950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392105+0000","last_change":"2024-01-21T19:59:06.034391+0000","last_active":"2024-01-21T19:59:06.392105+0000","last_peered":"2024-01-21T19:59:06.392105+0000","last_clean":"2024-01-21T19:59:06.392105+0000","last_became_active":"2024-01-21T19:59:06.034060+0000","last_became_peered":"2024-01-21T19:59:06.034060+0000","last_unstale":"2024-01-21T19:59:06.392105+0000","last_undegraded":"2024-01-21T19:59:06.392105+0000","last_fullsized":"2024-01-21T19:59:06.392105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410899+0000","last_change":"2024-01-21T19:59:06.408800+0000","last_active":"2024-01-21T19:59:06.410899+0000","last_peered":"2024-01-21T19:59:06.410899+0000","last_clean":"2024-01-21T19:59:06.410899+0000","last_became_active":"2024-01-21T19:59:06.408515+0000","last_became_peered":"2024-01-21T19:59:06.408515+0000","last_unstale":"2024-01-21T19:59:06.410899+0000","last_undegraded":"2024-01-21T19:59:06.410899+0000","last_fullsized":"2024-01-21T19:59:06.410899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401822+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:06.401822+0000","last_peered":"2024-01-21T19:59:06.401822+0000","last_clean":"2024-01-21T19:59:06.401822+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:06.401822+0000","last_undegraded":"2024-01-21T19:59:06.401822+0000","last_fullsized":"2024-01-21T19:59:06.401822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391457+0000","last_change":"2024-01-21T19:59:06.041530+0000","last_active":"2024-01-21T19:59:06.391457+0000","last_peered":"2024-01-21T19:59:06.391457+0000","last_clean":"2024-01-21T19:59:06.391457+0000","last_became_active":"2024-01-21T19:59:06.041251+0000","last_became_peered":"2024-01-21T19:59:06.041251+0000","last_unstale":"2024-01-21T19:59:06.391457+0000","last_undegraded":"2024-01-21T19:59:06.391457+0000","last_fullsized":"2024-01-21T19:59:06.391457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399714+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:06.399714+0000","last_peered":"2024-01-21T19:59:06.399714+0000","last_clean":"2024-01-21T19:59:06.399714+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:06.399714+0000","last_undegraded":"2024-01-21T19:59:06.399714+0000","last_fullsized":"2024-01-21T19:59:06.399714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403900+0000","last_change":"2024-01-21T19:59:06.031857+0000","last_active":"2024-01-21T19:59:06.403900+0000","last_peered":"2024-01-21T19:59:06.403900+0000","last_clean":"2024-01-21T19:59:06.403900+0000","last_became_active":"2024-01-21T19:59:06.031591+0000","last_became_peered":"2024-01-21T19:59:06.031591+0000","last_unstale":"2024-01-21T19:59:06.403900+0000","last_undegraded":"2024-01-21T19:59:06.403900+0000","last_fullsized":"2024-01-21T19:59:06.403900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402917+0000","last_change":"2024-01-21T19:59:06.401094+0000","last_active":"2024-01-21T19:59:06.402917+0000","last_peered":"2024-01-21T19:59:06.402917+0000","last_clean":"2024-01-21T19:59:06.402917+0000","last_became_active":"2024-01-21T19:59:06.400832+0000","last_became_peered":"2024-01-21T19:59:06.400832+0000","last_unstale":"2024-01-21T19:59:06.402917+0000","last_undegraded":"2024-01-21T19:59:06.402917+0000","last_fullsized":"2024-01-21T19:59:06.402917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410385+0000","last_change":"2024-01-21T19:59:06.039467+0000","last_active":"2024-01-21T19:59:06.410385+0000","last_peered":"2024-01-21T19:59:06.410385+0000","last_clean":"2024-01-21T19:59:06.410385+0000","last_became_active":"2024-01-21T19:59:06.039167+0000","last_became_peered":"2024-01-21T19:59:06.039167+0000","last_unstale":"2024-01-21T19:59:06.410385+0000","last_undegraded":"2024-01-21T19:59:06.410385+0000","last_fullsized":"2024-01-21T19:59:06.410385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405399+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:06.405399+0000","last_peered":"2024-01-21T19:59:06.405399+0000","last_clean":"2024-01-21T19:59:06.405399+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:06.405399+0000","last_undegraded":"2024-01-21T19:59:06.405399+0000","last_fullsized":"2024-01-21T19:59:06.405399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413120+0000","last_change":"2024-01-21T19:59:06.410865+0000","last_active":"2024-01-21T19:59:06.413120+0000","last_peered":"2024-01-21T19:59:06.413120+0000","last_clean":"2024-01-21T19:59:06.413120+0000","last_became_active":"2024-01-21T19:59:06.410572+0000","last_became_peered":"2024-01-21T19:59:06.410572+0000","last_unstale":"2024-01-21T19:59:06.413120+0000","last_undegraded":"2024-01-21T19:59:06.413120+0000","last_fullsized":"2024-01-21T19:59:06.413120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396528+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:06.396528+0000","last_peered":"2024-01-21T19:59:06.396528+0000","last_clean":"2024-01-21T19:59:06.396528+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:06.396528+0000","last_undegraded":"2024-01-21T19:59:06.396528+0000","last_fullsized":"2024-01-21T19:59:06.396528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392481+0000","last_change":"2024-01-21T19:59:06.039407+0000","last_active":"2024-01-21T19:59:06.392481+0000","last_peered":"2024-01-21T19:59:06.392481+0000","last_clean":"2024-01-21T19:59:06.392481+0000","last_became_active":"2024-01-21T19:59:06.039118+0000","last_became_peered":"2024-01-21T19:59:06.039118+0000","last_unstale":"2024-01-21T19:59:06.392481+0000","last_undegraded":"2024-01-21T19:59:06.392481+0000","last_fullsized":"2024-01-21T19:59:06.392481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415445+0000","last_change":"2024-01-21T19:59:06.411742+0000","last_active":"2024-01-21T19:59:06.415445+0000","last_peered":"2024-01-21T19:59:06.415445+0000","last_clean":"2024-01-21T19:59:06.415445+0000","last_became_active":"2024-01-21T19:59:06.408852+0000","last_became_peered":"2024-01-21T19:59:06.408852+0000","last_unstale":"2024-01-21T19:59:06.415445+0000","last_undegraded":"2024-01-21T19:59:06.415445+0000","last_fullsized":"2024-01-21T19:59:06.415445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413174+0000","last_change":"2024-01-21T19:59:06.411871+0000","last_active":"2024-01-21T19:59:06.413174+0000","last_peered":"2024-01-21T19:59:06.413174+0000","last_clean":"2024-01-21T19:59:06.413174+0000","last_became_active":"2024-01-21T19:59:06.411604+0000","last_became_peered":"2024-01-21T19:59:06.411604+0000","last_unstale":"2024-01-21T19:59:06.413174+0000","last_undegraded":"2024-01-21T19:59:06.413174+0000","last_fullsized":"2024-01-21T19:59:06.413174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394020+0000","last_change":"2024-01-21T19:59:06.042778+0000","last_active":"2024-01-21T19:59:06.394020+0000","last_peered":"2024-01-21T19:59:06.394020+0000","last_clean":"2024-01-21T19:59:06.394020+0000","last_became_active":"2024-01-21T19:59:06.042250+0000","last_became_peered":"2024-01-21T19:59:06.042250+0000","last_unstale":"2024-01-21T19:59:06.394020+0000","last_undegraded":"2024-01-21T19:59:06.394020+0000","last_fullsized":"2024-01-21T19:59:06.394020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415400+0000","last_change":"2024-01-21T19:59:06.408475+0000","last_active":"2024-01-21T19:59:06.415400+0000","last_peered":"2024-01-21T19:59:06.415400+0000","last_clean":"2024-01-21T19:59:06.415400+0000","last_became_active":"2024-01-21T19:59:06.406096+0000","last_became_peered":"2024-01-21T19:59:06.406096+0000","last_unstale":"2024-01-21T19:59:06.415400+0000","last_undegraded":"2024-01-21T19:59:06.415400+0000","last_fullsized":"2024-01-21T19:59:06.415400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392127+0000","last_change":"2024-01-21T19:59:06.041454+0000","last_active":"2024-01-21T19:59:06.392127+0000","last_peered":"2024-01-21T19:59:06.392127+0000","last_clean":"2024-01-21T19:59:06.392127+0000","last_became_active":"2024-01-21T19:59:06.041172+0000","last_became_peered":"2024-01-21T19:59:06.041172+0000","last_unstale":"2024-01-21T19:59:06.392127+0000","last_undegraded":"2024-01-21T19:59:06.392127+0000","last_fullsized":"2024-01-21T19:59:06.392127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416665+0000","last_change":"2024-01-21T19:59:06.404670+0000","last_active":"2024-01-21T19:59:06.416665+0000","last_peered":"2024-01-21T19:59:06.416665+0000","last_clean":"2024-01-21T19:59:06.416665+0000","last_became_active":"2024-01-21T19:59:06.404385+0000","last_became_peered":"2024-01-21T19:59:06.404385+0000","last_unstale":"2024-01-21T19:59:06.416665+0000","last_undegraded":"2024-01-21T19:59:06.416665+0000","last_fullsized":"2024-01-21T19:59:06.416665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404466+0000","last_change":"2024-01-21T19:59:06.032073+0000","last_active":"2024-01-21T19:59:06.404466+0000","last_peered":"2024-01-21T19:59:06.404466+0000","last_clean":"2024-01-21T19:59:06.404466+0000","last_became_active":"2024-01-21T19:59:06.031626+0000","last_became_peered":"2024-01-21T19:59:06.031626+0000","last_unstale":"2024-01-21T19:59:06.404466+0000","last_undegraded":"2024-01-21T19:59:06.404466+0000","last_fullsized":"2024-01-21T19:59:06.404466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402318+0000","last_change":"2024-01-21T19:59:06.399583+0000","last_active":"2024-01-21T19:59:06.402318+0000","last_peered":"2024-01-21T19:59:06.402318+0000","last_clean":"2024-01-21T19:59:06.402318+0000","last_became_active":"2024-01-21T19:59:06.399318+0000","last_became_peered":"2024-01-21T19:59:06.399318+0000","last_unstale":"2024-01-21T19:59:06.402318+0000","last_undegraded":"2024-01-21T19:59:06.402318+0000","last_fullsized":"2024-01-21T19:59:06.402318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406744+0000","last_change":"2024-01-21T19:59:06.034516+0000","last_active":"2024-01-21T19:59:06.406744+0000","last_peered":"2024-01-21T19:59:06.406744+0000","last_clean":"2024-01-21T19:59:06.406744+0000","last_became_active":"2024-01-21T19:59:06.034231+0000","last_became_peered":"2024-01-21T19:59:06.034231+0000","last_unstale":"2024-01-21T19:59:06.406744+0000","last_undegraded":"2024-01-21T19:59:06.406744+0000","last_fullsized":"2024-01-21T19:59:06.406744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418474+0000","last_change":"2024-01-21T19:59:06.413015+0000","last_active":"2024-01-21T19:59:06.418474+0000","last_peered":"2024-01-21T19:59:06.418474+0000","last_clean":"2024-01-21T19:59:06.418474+0000","last_became_active":"2024-01-21T19:59:06.412719+0000","last_became_peered":"2024-01-21T19:59:06.412719+0000","last_unstale":"2024-01-21T19:59:06.418474+0000","last_undegraded":"2024-01-21T19:59:06.418474+0000","last_fullsized":"2024-01-21T19:59:06.418474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400212+0000","last_change":"2024-01-21T19:59:06.037831+0000","last_active":"2024-01-21T19:59:06.400212+0000","last_peered":"2024-01-21T19:59:06.400212+0000","last_clean":"2024-01-21T19:59:06.400212+0000","last_became_active":"2024-01-21T19:59:06.037213+0000","last_became_peered":"2024-01-21T19:59:06.037213+0000","last_unstale":"2024-01-21T19:59:06.400212+0000","last_undegraded":"2024-01-21T19:59:06.400212+0000","last_fullsized":"2024-01-21T19:59:06.400212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412328+0000","last_change":"2024-01-21T19:59:06.407158+0000","last_active":"2024-01-21T19:59:06.412328+0000","last_peered":"2024-01-21T19:59:06.412328+0000","last_clean":"2024-01-21T19:59:06.412328+0000","last_became_active":"2024-01-21T19:59:06.406887+0000","last_became_peered":"2024-01-21T19:59:06.406887+0000","last_unstale":"2024-01-21T19:59:06.412328+0000","last_undegraded":"2024-01-21T19:59:06.412328+0000","last_fullsized":"2024-01-21T19:59:06.412328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394796+0000","last_change":"2024-01-21T19:59:06.040441+0000","last_active":"2024-01-21T19:59:06.394796+0000","last_peered":"2024-01-21T19:59:06.394796+0000","last_clean":"2024-01-21T19:59:06.394796+0000","last_became_active":"2024-01-21T19:59:06.040145+0000","last_became_peered":"2024-01-21T19:59:06.040145+0000","last_unstale":"2024-01-21T19:59:06.394796+0000","last_undegraded":"2024-01-21T19:59:06.394796+0000","last_fullsized":"2024-01-21T19:59:06.394796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412523+0000","last_change":"2024-01-21T19:59:06.408682+0000","last_active":"2024-01-21T19:59:06.412523+0000","last_peered":"2024-01-21T19:59:06.412523+0000","last_clean":"2024-01-21T19:59:06.412523+0000","last_became_active":"2024-01-21T19:59:06.408415+0000","last_became_peered":"2024-01-21T19:59:06.408415+0000","last_unstale":"2024-01-21T19:59:06.412523+0000","last_undegraded":"2024-01-21T19:59:06.412523+0000","last_fullsized":"2024-01-21T19:59:06.412523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388707+0000","last_change":"2024-01-21T19:59:06.033168+0000","last_active":"2024-01-21T19:59:06.388707+0000","last_peered":"2024-01-21T19:59:06.388707+0000","last_clean":"2024-01-21T19:59:06.388707+0000","last_became_active":"2024-01-21T19:59:06.032815+0000","last_became_peered":"2024-01-21T19:59:06.032815+0000","last_unstale":"2024-01-21T19:59:06.388707+0000","last_undegraded":"2024-01-21T19:59:06.388707+0000","last_fullsized":"2024-01-21T19:59:06.388707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414019+0000","last_change":"2024-01-21T19:59:06.412182+0000","last_active":"2024-01-21T19:59:06.414019+0000","last_peered":"2024-01-21T19:59:06.414019+0000","last_clean":"2024-01-21T19:59:06.414019+0000","last_became_active":"2024-01-21T19:59:06.411457+0000","last_became_peered":"2024-01-21T19:59:06.411457+0000","last_unstale":"2024-01-21T19:59:06.414019+0000","last_undegraded":"2024-01-21T19:59:06.414019+0000","last_fullsized":"2024-01-21T19:59:06.414019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392449+0000","last_change":"2024-01-21T19:59:06.036108+0000","last_active":"2024-01-21T19:59:06.392449+0000","last_peered":"2024-01-21T19:59:06.392449+0000","last_clean":"2024-01-21T19:59:06.392449+0000","last_became_active":"2024-01-21T19:59:06.035841+0000","last_became_peered":"2024-01-21T19:59:06.035841+0000","last_unstale":"2024-01-21T19:59:06.392449+0000","last_undegraded":"2024-01-21T19:59:06.392449+0000","last_fullsized":"2024-01-21T19:59:06.392449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413392+0000","last_change":"2024-01-21T19:59:06.411927+0000","last_active":"2024-01-21T19:59:06.413392+0000","last_peered":"2024-01-21T19:59:06.413392+0000","last_clean":"2024-01-21T19:59:06.413392+0000","last_became_active":"2024-01-21T19:59:06.411661+0000","last_became_peered":"2024-01-21T19:59:06.411661+0000","last_unstale":"2024-01-21T19:59:06.413392+0000","last_undegraded":"2024-01-21T19:59:06.413392+0000","last_fullsized":"2024-01-21T19:59:06.413392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.036660+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.036371+0000","last_became_peered":"2024-01-21T19:59:06.036371+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415968+0000","last_change":"2024-01-21T19:59:06.415069+0000","last_active":"2024-01-21T19:59:06.415968+0000","last_peered":"2024-01-21T19:59:06.415968+0000","last_clean":"2024-01-21T19:59:06.415968+0000","last_became_active":"2024-01-21T19:59:06.414647+0000","last_became_peered":"2024-01-21T19:59:06.414647+0000","last_unstale":"2024-01-21T19:59:06.415968+0000","last_undegraded":"2024-01-21T19:59:06.415968+0000","last_fullsized":"2024-01-21T19:59:06.415968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.393346+0000","last_change":"2024-01-21T19:59:06.042806+0000","last_active":"2024-01-21T19:59:06.393346+0000","last_peered":"2024-01-21T19:59:06.393346+0000","last_clean":"2024-01-21T19:59:06.393346+0000","last_became_active":"2024-01-21T19:59:06.042528+0000","last_became_peered":"2024-01-21T19:59:06.042528+0000","last_unstale":"2024-01-21T19:59:06.393346+0000","last_undegraded":"2024-01-21T19:59:06.393346+0000","last_fullsized":"2024-01-21T19:59:06.393346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416691+0000","last_change":"2024-01-21T19:59:06.410923+0000","last_active":"2024-01-21T19:59:06.416691+0000","last_peered":"2024-01-21T19:59:06.416691+0000","last_clean":"2024-01-21T19:59:06.416691+0000","last_became_active":"2024-01-21T19:59:06.408605+0000","last_became_peered":"2024-01-21T19:59:06.408605+0000","last_unstale":"2024-01-21T19:59:06.416691+0000","last_undegraded":"2024-01-21T19:59:06.416691+0000","last_fullsized":"2024-01-21T19:59:06.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404296+0000","last_change":"2024-01-21T19:59:06.033138+0000","last_active":"2024-01-21T19:59:06.404296+0000","last_peered":"2024-01-21T19:59:06.404296+0000","last_clean":"2024-01-21T19:59:06.404296+0000","last_became_active":"2024-01-21T19:59:06.032729+0000","last_became_peered":"2024-01-21T19:59:06.032729+0000","last_unstale":"2024-01-21T19:59:06.404296+0000","last_undegraded":"2024-01-21T19:59:06.404296+0000","last_fullsized":"2024-01-21T19:59:06.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412956+0000","last_change":"2024-01-21T19:59:06.409878+0000","last_active":"2024-01-21T19:59:06.412956+0000","last_peered":"2024-01-21T19:59:06.412956+0000","last_clean":"2024-01-21T19:59:06.412956+0000","last_became_active":"2024-01-21T19:59:06.409584+0000","last_became_peered":"2024-01-21T19:59:06.409584+0000","last_unstale":"2024-01-21T19:59:06.412956+0000","last_undegraded":"2024-01-21T19:59:06.412956+0000","last_fullsized":"2024-01-21T19:59:06.412956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396323+0000","last_change":"2024-01-21T19:59:06.036306+0000","last_active":"2024-01-21T19:59:06.396323+0000","last_peered":"2024-01-21T19:59:06.396323+0000","last_clean":"2024-01-21T19:59:06.396323+0000","last_became_active":"2024-01-21T19:59:06.036019+0000","last_became_peered":"2024-01-21T19:59:06.036019+0000","last_unstale":"2024-01-21T19:59:06.396323+0000","last_undegraded":"2024-01-21T19:59:06.396323+0000","last_fullsized":"2024-01-21T19:59:06.396323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407918+0000","last_change":"2024-01-21T19:59:06.403990+0000","last_active":"2024-01-21T19:59:06.407918+0000","last_peered":"2024-01-21T19:59:06.407918+0000","last_clean":"2024-01-21T19:59:06.407918+0000","last_became_active":"2024-01-21T19:59:06.403735+0000","last_became_peered":"2024-01-21T19:59:06.403735+0000","last_unstale":"2024-01-21T19:59:06.407918+0000","last_undegraded":"2024-01-21T19:59:06.407918+0000","last_fullsized":"2024-01-21T19:59:06.407918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.031905+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.031528+0000","last_became_peered":"2024-01-21T19:59:06.031528+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410340+0000","last_change":"2024-01-21T19:59:06.404278+0000","last_active":"2024-01-21T19:59:06.410340+0000","last_peered":"2024-01-21T19:59:06.410340+0000","last_clean":"2024-01-21T19:59:06.410340+0000","last_became_active":"2024-01-21T19:59:06.403605+0000","last_became_peered":"2024-01-21T19:59:06.403605+0000","last_unstale":"2024-01-21T19:59:06.410340+0000","last_undegraded":"2024-01-21T19:59:06.410340+0000","last_fullsized":"2024-01-21T19:59:06.410340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391853+0000","last_change":"2024-01-21T19:59:06.036513+0000","last_active":"2024-01-21T19:59:06.391853+0000","last_peered":"2024-01-21T19:59:06.391853+0000","last_clean":"2024-01-21T19:59:06.391853+0000","last_became_active":"2024-01-21T19:59:06.036203+0000","last_became_peered":"2024-01-21T19:59:06.036203+0000","last_unstale":"2024-01-21T19:59:06.391853+0000","last_undegraded":"2024-01-21T19:59:06.391853+0000","last_fullsized":"2024-01-21T19:59:06.391853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418991+0000","last_change":"2024-01-21T19:59:06.413135+0000","last_active":"2024-01-21T19:59:06.418991+0000","last_peered":"2024-01-21T19:59:06.418991+0000","last_clean":"2024-01-21T19:59:06.418991+0000","last_became_active":"2024-01-21T19:59:06.412662+0000","last_became_peered":"2024-01-21T19:59:06.412662+0000","last_unstale":"2024-01-21T19:59:06.418991+0000","last_undegraded":"2024-01-21T19:59:06.418991+0000","last_fullsized":"2024-01-21T19:59:06.418991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394244+0000","last_change":"2024-01-21T19:59:06.041668+0000","last_active":"2024-01-21T19:59:06.394244+0000","last_peered":"2024-01-21T19:59:06.394244+0000","last_clean":"2024-01-21T19:59:06.394244+0000","last_became_active":"2024-01-21T19:59:06.041337+0000","last_became_peered":"2024-01-21T19:59:06.041337+0000","last_unstale":"2024-01-21T19:59:06.394244+0000","last_undegraded":"2024-01-21T19:59:06.394244+0000","last_fullsized":"2024-01-21T19:59:06.394244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410112+0000","last_change":"2024-01-21T19:59:06.405482+0000","last_active":"2024-01-21T19:59:06.410112+0000","last_peered":"2024-01-21T19:59:06.410112+0000","last_clean":"2024-01-21T19:59:06.410112+0000","last_became_active":"2024-01-21T19:59:06.405206+0000","last_became_peered":"2024-01-21T19:59:06.405206+0000","last_unstale":"2024-01-21T19:59:06.410112+0000","last_undegraded":"2024-01-21T19:59:06.410112+0000","last_fullsized":"2024-01-21T19:59:06.410112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392562+0000","last_change":"2024-01-21T19:59:06.033405+0000","last_active":"2024-01-21T19:59:06.392562+0000","last_peered":"2024-01-21T19:59:06.392562+0000","last_clean":"2024-01-21T19:59:06.392562+0000","last_became_active":"2024-01-21T19:59:06.033067+0000","last_became_peered":"2024-01-21T19:59:06.033067+0000","last_unstale":"2024-01-21T19:59:06.392562+0000","last_undegraded":"2024-01-21T19:59:06.392562+0000","last_fullsized":"2024-01-21T19:59:06.392562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419068+0000","last_change":"2024-01-21T19:59:06.416968+0000","last_active":"2024-01-21T19:59:06.419068+0000","last_peered":"2024-01-21T19:59:06.419068+0000","last_clean":"2024-01-21T19:59:06.419068+0000","last_became_active":"2024-01-21T19:59:06.416702+0000","last_became_peered":"2024-01-21T19:59:06.416702+0000","last_unstale":"2024-01-21T19:59:06.419068+0000","last_undegraded":"2024-01-21T19:59:06.419068+0000","last_fullsized":"2024-01-21T19:59:06.419068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403561+0000","last_change":"2024-01-21T19:59:06.040770+0000","last_active":"2024-01-21T19:59:06.403561+0000","last_peered":"2024-01-21T19:59:06.403561+0000","last_clean":"2024-01-21T19:59:06.403561+0000","last_became_active":"2024-01-21T19:59:06.039205+0000","last_became_peered":"2024-01-21T19:59:06.039205+0000","last_unstale":"2024-01-21T19:59:06.403561+0000","last_undegraded":"2024-01-21T19:59:06.403561+0000","last_fullsized":"2024-01-21T19:59:06.403561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416618+0000","last_change":"2024-01-21T19:59:06.412006+0000","last_active":"2024-01-21T19:59:06.416618+0000","last_peered":"2024-01-21T19:59:06.416618+0000","last_clean":"2024-01-21T19:59:06.416618+0000","last_became_active":"2024-01-21T19:59:06.411000+0000","last_became_peered":"2024-01-21T19:59:06.411000+0000","last_unstale":"2024-01-21T19:59:06.416618+0000","last_undegraded":"2024-01-21T19:59:06.416618+0000","last_fullsized":"2024-01-21T19:59:06.416618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396610+0000","last_change":"2024-01-21T19:59:06.031139+0000","last_active":"2024-01-21T19:59:06.396610+0000","last_peered":"2024-01-21T19:59:06.396610+0000","last_clean":"2024-01-21T19:59:06.396610+0000","last_became_active":"2024-01-21T19:59:06.030914+0000","last_became_peered":"2024-01-21T19:59:06.030914+0000","last_unstale":"2024-01-21T19:59:06.396610+0000","last_undegraded":"2024-01-21T19:59:06.396610+0000","last_fullsized":"2024-01-21T19:59:06.396610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413171+0000","last_change":"2024-01-21T19:59:06.411676+0000","last_active":"2024-01-21T19:59:06.413171+0000","last_peered":"2024-01-21T19:59:06.413171+0000","last_clean":"2024-01-21T19:59:06.413171+0000","last_became_active":"2024-01-21T19:59:06.411417+0000","last_became_peered":"2024-01-21T19:59:06.411417+0000","last_unstale":"2024-01-21T19:59:06.413171+0000","last_undegraded":"2024-01-21T19:59:06.413171+0000","last_fullsized":"2024-01-21T19:59:06.413171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416934+0000","last_change":"2024-01-21T19:59:06.027798+0000","last_active":"2024-01-21T19:59:06.416934+0000","last_peered":"2024-01-21T19:59:06.416934+0000","last_clean":"2024-01-21T19:59:06.416934+0000","last_became_active":"2024-01-21T19:59:06.027498+0000","last_became_peered":"2024-01-21T19:59:06.027498+0000","last_unstale":"2024-01-21T19:59:06.416934+0000","last_undegraded":"2024-01-21T19:59:06.416934+0000","last_fullsized":"2024-01-21T19:59:06.416934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402297+0000","last_change":"2024-01-21T19:59:06.398605+0000","last_active":"2024-01-21T19:59:06.402297+0000","last_peered":"2024-01-21T19:59:06.402297+0000","last_clean":"2024-01-21T19:59:06.402297+0000","last_became_active":"2024-01-21T19:59:06.398350+0000","last_became_peered":"2024-01-21T19:59:06.398350+0000","last_unstale":"2024-01-21T19:59:06.402297+0000","last_undegraded":"2024-01-21T19:59:06.402297+0000","last_fullsized":"2024-01-21T19:59:06.402297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388678+0000","last_change":"2024-01-21T19:59:06.024779+0000","last_active":"2024-01-21T19:59:06.388678+0000","last_peered":"2024-01-21T19:59:06.388678+0000","last_clean":"2024-01-21T19:59:06.388678+0000","last_became_active":"2024-01-21T19:59:06.024455+0000","last_became_peered":"2024-01-21T19:59:06.024455+0000","last_unstale":"2024-01-21T19:59:06.388678+0000","last_undegraded":"2024-01-21T19:59:06.388678+0000","last_fullsized":"2024-01-21T19:59:06.388678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416608+0000","last_change":"2024-01-21T19:59:06.411381+0000","last_active":"2024-01-21T19:59:06.416608+0000","last_peered":"2024-01-21T19:59:06.416608+0000","last_clean":"2024-01-21T19:59:06.416608+0000","last_became_active":"2024-01-21T19:59:06.411065+0000","last_became_peered":"2024-01-21T19:59:06.411065+0000","last_unstale":"2024-01-21T19:59:06.416608+0000","last_undegraded":"2024-01-21T19:59:06.416608+0000","last_fullsized":"2024-01-21T19:59:06.416608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391431+0000","last_change":"2024-01-21T19:59:06.035305+0000","last_active":"2024-01-21T19:59:06.391431+0000","last_peered":"2024-01-21T19:59:06.391431+0000","last_clean":"2024-01-21T19:59:06.391431+0000","last_became_active":"2024-01-21T19:59:06.035011+0000","last_became_peered":"2024-01-21T19:59:06.035011+0000","last_unstale":"2024-01-21T19:59:06.391431+0000","last_undegraded":"2024-01-21T19:59:06.391431+0000","last_fullsized":"2024-01-21T19:59:06.391431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410360+0000","last_change":"2024-01-21T19:59:06.404314+0000","last_active":"2024-01-21T19:59:06.410360+0000","last_peered":"2024-01-21T19:59:06.410360+0000","last_clean":"2024-01-21T19:59:06.410360+0000","last_became_active":"2024-01-21T19:59:06.403954+0000","last_became_peered":"2024-01-21T19:59:06.403954+0000","last_unstale":"2024-01-21T19:59:06.410360+0000","last_undegraded":"2024-01-21T19:59:06.410360+0000","last_fullsized":"2024-01-21T19:59:06.410360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403338+0000","last_change":"2024-01-21T19:59:06.039241+0000","last_active":"2024-01-21T19:59:06.403338+0000","last_peered":"2024-01-21T19:59:06.403338+0000","last_clean":"2024-01-21T19:59:06.403338+0000","last_became_active":"2024-01-21T19:59:06.038967+0000","last_became_peered":"2024-01-21T19:59:06.038967+0000","last_unstale":"2024-01-21T19:59:06.403338+0000","last_undegraded":"2024-01-21T19:59:06.403338+0000","last_fullsized":"2024-01-21T19:59:06.403338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404457+0000","last_change":"2024-01-21T19:59:06.398845+0000","last_active":"2024-01-21T19:59:06.404457+0000","last_peered":"2024-01-21T19:59:06.404457+0000","last_clean":"2024-01-21T19:59:06.404457+0000","last_became_active":"2024-01-21T19:59:06.398598+0000","last_became_peered":"2024-01-21T19:59:06.398598+0000","last_unstale":"2024-01-21T19:59:06.404457+0000","last_undegraded":"2024-01-21T19:59:06.404457+0000","last_fullsized":"2024-01-21T19:59:06.404457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403951+0000","last_change":"2024-01-21T19:59:06.031315+0000","last_active":"2024-01-21T19:59:06.403951+0000","last_peered":"2024-01-21T19:59:06.403951+0000","last_clean":"2024-01-21T19:59:06.403951+0000","last_became_active":"2024-01-21T19:59:06.031001+0000","last_became_peered":"2024-01-21T19:59:06.031001+0000","last_unstale":"2024-01-21T19:59:06.403951+0000","last_undegraded":"2024-01-21T19:59:06.403951+0000","last_fullsized":"2024-01-21T19:59:06.403951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418455+0000","last_change":"2024-01-21T19:59:06.412803+0000","last_active":"2024-01-21T19:59:06.418455+0000","last_peered":"2024-01-21T19:59:06.418455+0000","last_clean":"2024-01-21T19:59:06.418455+0000","last_became_active":"2024-01-21T19:59:06.412494+0000","last_became_peered":"2024-01-21T19:59:06.412494+0000","last_unstale":"2024-01-21T19:59:06.418455+0000","last_undegraded":"2024-01-21T19:59:06.418455+0000","last_fullsized":"2024-01-21T19:59:06.418455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392612+0000","last_change":"2024-01-21T19:59:06.036578+0000","last_active":"2024-01-21T19:59:06.392612+0000","last_peered":"2024-01-21T19:59:06.392612+0000","last_clean":"2024-01-21T19:59:06.392612+0000","last_became_active":"2024-01-21T19:59:06.036234+0000","last_became_peered":"2024-01-21T19:59:06.036234+0000","last_unstale":"2024-01-21T19:59:06.392612+0000","last_undegraded":"2024-01-21T19:59:06.392612+0000","last_fullsized":"2024-01-21T19:59:06.392612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417722+0000","last_change":"2024-01-21T19:59:06.417024+0000","last_active":"2024-01-21T19:59:06.417722+0000","last_peered":"2024-01-21T19:59:06.417722+0000","last_clean":"2024-01-21T19:59:06.417722+0000","last_became_active":"2024-01-21T19:59:06.416747+0000","last_became_peered":"2024-01-21T19:59:06.416747+0000","last_unstale":"2024-01-21T19:59:06.417722+0000","last_undegraded":"2024-01-21T19:59:06.417722+0000","last_fullsized":"2024-01-21T19:59:06.417722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407615+0000","last_change":"2024-01-21T19:59:06.033544+0000","last_active":"2024-01-21T19:59:06.407615+0000","last_peered":"2024-01-21T19:59:06.407615+0000","last_clean":"2024-01-21T19:59:06.407615+0000","last_became_active":"2024-01-21T19:59:06.031765+0000","last_became_peered":"2024-01-21T19:59:06.031765+0000","last_unstale":"2024-01-21T19:59:06.407615+0000","last_undegraded":"2024-01-21T19:59:06.407615+0000","last_fullsized":"2024-01-21T19:59:06.407615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403490+0000","last_change":"2024-01-21T19:59:06.400361+0000","last_active":"2024-01-21T19:59:06.403490+0000","last_peered":"2024-01-21T19:59:06.403490+0000","last_clean":"2024-01-21T19:59:06.403490+0000","last_became_active":"2024-01-21T19:59:06.400070+0000","last_became_peered":"2024-01-21T19:59:06.400070+0000","last_unstale":"2024-01-21T19:59:06.403490+0000","last_undegraded":"2024-01-21T19:59:06.403490+0000","last_fullsized":"2024-01-21T19:59:06.403490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419401+0000","last_change":"2024-01-21T19:59:06.037315+0000","last_active":"2024-01-21T19:59:06.419401+0000","last_peered":"2024-01-21T19:59:06.419401+0000","last_clean":"2024-01-21T19:59:06.419401+0000","last_became_active":"2024-01-21T19:59:06.036690+0000","last_became_peered":"2024-01-21T19:59:06.036690+0000","last_unstale":"2024-01-21T19:59:06.419401+0000","last_undegraded":"2024-01-21T19:59:06.419401+0000","last_fullsized":"2024-01-21T19:59:06.419401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404278+0000","last_change":"2024-01-21T19:59:06.399152+0000","last_active":"2024-01-21T19:59:06.404278+0000","last_peered":"2024-01-21T19:59:06.404278+0000","last_clean":"2024-01-21T19:59:06.404278+0000","last_became_active":"2024-01-21T19:59:06.398559+0000","last_became_peered":"2024-01-21T19:59:06.398559+0000","last_unstale":"2024-01-21T19:59:06.404278+0000","last_undegraded":"2024-01-21T19:59:06.404278+0000","last_fullsized":"2024-01-21T19:59:06.404278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.395765+0000","last_change":"2024-01-21T19:59:06.033529+0000","last_active":"2024-01-21T19:59:06.395765+0000","last_peered":"2024-01-21T19:59:06.395765+0000","last_clean":"2024-01-21T19:59:06.395765+0000","last_became_active":"2024-01-21T19:59:06.033242+0000","last_became_peered":"2024-01-21T19:59:06.033242+0000","last_unstale":"2024-01-21T19:59:06.395765+0000","last_undegraded":"2024-01-21T19:59:06.395765+0000","last_fullsized":"2024-01-21T19:59:06.395765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419003+0000","last_change":"2024-01-21T19:59:06.415302+0000","last_active":"2024-01-21T19:59:06.419003+0000","last_peered":"2024-01-21T19:59:06.419003+0000","last_clean":"2024-01-21T19:59:06.419003+0000","last_became_active":"2024-01-21T19:59:06.414840+0000","last_became_peered":"2024-01-21T19:59:06.414840+0000","last_unstale":"2024-01-21T19:59:06.419003+0000","last_undegraded":"2024-01-21T19:59:06.419003+0000","last_fullsized":"2024-01-21T19:59:06.419003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396109+0000","last_change":"2024-01-21T19:59:06.032758+0000","last_active":"2024-01-21T19:59:06.396109+0000","last_peered":"2024-01-21T19:59:06.396109+0000","last_clean":"2024-01-21T19:59:06.396109+0000","last_became_active":"2024-01-21T19:59:06.032460+0000","last_became_peered":"2024-01-21T19:59:06.032460+0000","last_unstale":"2024-01-21T19:59:06.396109+0000","last_undegraded":"2024-01-21T19:59:06.396109+0000","last_fullsized":"2024-01-21T19:59:06.396109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418725+0000","last_change":"2024-01-21T19:59:06.414719+0000","last_active":"2024-01-21T19:59:06.418725+0000","last_peered":"2024-01-21T19:59:06.418725+0000","last_clean":"2024-01-21T19:59:06.418725+0000","last_became_active":"2024-01-21T19:59:06.414337+0000","last_became_peered":"2024-01-21T19:59:06.414337+0000","last_unstale":"2024-01-21T19:59:06.418725+0000","last_undegraded":"2024-01-21T19:59:06.418725+0000","last_fullsized":"2024-01-21T19:59:06.418725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399500+0000","last_change":"2024-01-21T19:59:06.035036+0000","last_active":"2024-01-21T19:59:06.399500+0000","last_peered":"2024-01-21T19:59:06.399500+0000","last_clean":"2024-01-21T19:59:06.399500+0000","last_became_active":"2024-01-21T19:59:06.034698+0000","last_became_peered":"2024-01-21T19:59:06.034698+0000","last_unstale":"2024-01-21T19:59:06.399500+0000","last_undegraded":"2024-01-21T19:59:06.399500+0000","last_fullsized":"2024-01-21T19:59:06.399500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401865+0000","last_change":"2024-01-21T19:59:06.397365+0000","last_active":"2024-01-21T19:59:06.401865+0000","last_peered":"2024-01-21T19:59:06.401865+0000","last_clean":"2024-01-21T19:59:06.401865+0000","last_became_active":"2024-01-21T19:59:06.397044+0000","last_became_peered":"2024-01-21T19:59:06.397044+0000","last_unstale":"2024-01-21T19:59:06.401865+0000","last_undegraded":"2024-01-21T19:59:06.401865+0000","last_fullsized":"2024-01-21T19:59:06.401865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394352+0000","last_change":"2024-01-21T19:59:06.033282+0000","last_active":"2024-01-21T19:59:06.394352+0000","last_peered":"2024-01-21T19:59:06.394352+0000","last_clean":"2024-01-21T19:59:06.394352+0000","last_became_active":"2024-01-21T19:59:06.033013+0000","last_became_peered":"2024-01-21T19:59:06.033013+0000","last_unstale":"2024-01-21T19:59:06.394352+0000","last_undegraded":"2024-01-21T19:59:06.394352+0000","last_fullsized":"2024-01-21T19:59:06.394352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413996+0000","last_change":"2024-01-21T19:59:06.412489+0000","last_active":"2024-01-21T19:59:06.413996+0000","last_peered":"2024-01-21T19:59:06.413996+0000","last_clean":"2024-01-21T19:59:06.413996+0000","last_became_active":"2024-01-21T19:59:06.412296+0000","last_became_peered":"2024-01-21T19:59:06.412296+0000","last_unstale":"2024-01-21T19:59:06.413996+0000","last_undegraded":"2024-01-21T19:59:06.413996+0000","last_fullsized":"2024-01-21T19:59:06.413996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405984+0000","last_change":"2024-01-21T19:59:06.040467+0000","last_active":"2024-01-21T19:59:06.405984+0000","last_peered":"2024-01-21T19:59:06.405984+0000","last_clean":"2024-01-21T19:59:06.405984+0000","last_became_active":"2024-01-21T19:59:06.040135+0000","last_became_peered":"2024-01-21T19:59:06.040135+0000","last_unstale":"2024-01-21T19:59:06.405984+0000","last_undegraded":"2024-01-21T19:59:06.405984+0000","last_fullsized":"2024-01-21T19:59:06.405984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418656+0000","last_change":"2024-01-21T19:59:06.414583+0000","last_active":"2024-01-21T19:59:06.418656+0000","last_peered":"2024-01-21T19:59:06.418656+0000","last_clean":"2024-01-21T19:59:06.418656+0000","last_became_active":"2024-01-21T19:59:06.414307+0000","last_became_peered":"2024-01-21T19:59:06.414307+0000","last_unstale":"2024-01-21T19:59:06.418656+0000","last_undegraded":"2024-01-21T19:59:06.418656+0000","last_fullsized":"2024-01-21T19:59:06.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400826+0000","last_change":"2024-01-21T19:59:06.037540+0000","last_active":"2024-01-21T19:59:06.400826+0000","last_peered":"2024-01-21T19:59:06.400826+0000","last_clean":"2024-01-21T19:59:06.400826+0000","last_became_active":"2024-01-21T19:59:06.037227+0000","last_became_peered":"2024-01-21T19:59:06.037227+0000","last_unstale":"2024-01-21T19:59:06.400826+0000","last_undegraded":"2024-01-21T19:59:06.400826+0000","last_fullsized":"2024-01-21T19:59:06.400826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410359+0000","last_change":"2024-01-21T19:59:06.407140+0000","last_active":"2024-01-21T19:59:06.410359+0000","last_peered":"2024-01-21T19:59:06.410359+0000","last_clean":"2024-01-21T19:59:06.410359+0000","last_became_active":"2024-01-21T19:59:06.406818+0000","last_became_peered":"2024-01-21T19:59:06.406818+0000","last_unstale":"2024-01-21T19:59:06.410359+0000","last_undegraded":"2024-01-21T19:59:06.410359+0000","last_fullsized":"2024-01-21T19:59:06.410359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412154+0000","last_change":"2024-01-21T19:59:06.038267+0000","last_active":"2024-01-21T19:59:06.412154+0000","last_peered":"2024-01-21T19:59:06.412154+0000","last_clean":"2024-01-21T19:59:06.412154+0000","last_became_active":"2024-01-21T19:59:06.037931+0000","last_became_peered":"2024-01-21T19:59:06.037931+0000","last_unstale":"2024-01-21T19:59:06.412154+0000","last_undegraded":"2024-01-21T19:59:06.412154+0000","last_fullsized":"2024-01-21T19:59:06.412154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402031+0000","last_change":"2024-01-21T19:59:06.397703+0000","last_active":"2024-01-21T19:59:06.402031+0000","last_peered":"2024-01-21T19:59:06.402031+0000","last_clean":"2024-01-21T19:59:06.402031+0000","last_became_active":"2024-01-21T19:59:06.397296+0000","last_became_peered":"2024-01-21T19:59:06.397296+0000","last_unstale":"2024-01-21T19:59:06.402031+0000","last_undegraded":"2024-01-21T19:59:06.402031+0000","last_fullsized":"2024-01-21T19:59:06.402031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402469+0000","last_change":"2024-01-21T19:59:06.036008+0000","last_active":"2024-01-21T19:59:06.402469+0000","last_peered":"2024-01-21T19:59:06.402469+0000","last_clean":"2024-01-21T19:59:06.402469+0000","last_became_active":"2024-01-21T19:59:06.035721+0000","last_became_peered":"2024-01-21T19:59:06.035721+0000","last_unstale":"2024-01-21T19:59:06.402469+0000","last_undegraded":"2024-01-21T19:59:06.402469+0000","last_fullsized":"2024-01-21T19:59:06.402469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419018+0000","last_change":"2024-01-21T19:59:06.415104+0000","last_active":"2024-01-21T19:59:06.419018+0000","last_peered":"2024-01-21T19:59:06.419018+0000","last_clean":"2024-01-21T19:59:06.419018+0000","last_became_active":"2024-01-21T19:59:06.414325+0000","last_became_peered":"2024-01-21T19:59:06.414325+0000","last_unstale":"2024-01-21T19:59:06.419018+0000","last_undegraded":"2024-01-21T19:59:06.419018+0000","last_fullsized":"2024-01-21T19:59:06.419018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392399+0000","last_change":"2024-01-21T19:59:06.036961+0000","last_active":"2024-01-21T19:59:06.392399+0000","last_peered":"2024-01-21T19:59:06.392399+0000","last_clean":"2024-01-21T19:59:06.392399+0000","last_became_active":"2024-01-21T19:59:06.036674+0000","last_became_peered":"2024-01-21T19:59:06.036674+0000","last_unstale":"2024-01-21T19:59:06.392399+0000","last_undegraded":"2024-01-21T19:59:06.392399+0000","last_fullsized":"2024-01-21T19:59:06.392399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416883+0000","last_change":"2024-01-21T19:59:06.415128+0000","last_active":"2024-01-21T19:59:06.416883+0000","last_peered":"2024-01-21T19:59:06.416883+0000","last_clean":"2024-01-21T19:59:06.416883+0000","last_became_active":"2024-01-21T19:59:06.411896+0000","last_became_peered":"2024-01-21T19:59:06.411896+0000","last_unstale":"2024-01-21T19:59:06.416883+0000","last_undegraded":"2024-01-21T19:59:06.416883+0000","last_fullsized":"2024-01-21T19:59:06.416883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405540+0000","last_change":"2024-01-21T19:59:06.040769+0000","last_active":"2024-01-21T19:59:06.405540+0000","last_peered":"2024-01-21T19:59:06.405540+0000","last_clean":"2024-01-21T19:59:06.405540+0000","last_became_active":"2024-01-21T19:59:06.040493+0000","last_became_peered":"2024-01-21T19:59:06.040493+0000","last_unstale":"2024-01-21T19:59:06.405540+0000","last_undegraded":"2024-01-21T19:59:06.405540+0000","last_fullsized":"2024-01-21T19:59:06.405540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415838+0000","last_change":"2024-01-21T19:59:06.413738+0000","last_active":"2024-01-21T19:59:06.415838+0000","last_peered":"2024-01-21T19:59:06.415838+0000","last_clean":"2024-01-21T19:59:06.415838+0000","last_became_active":"2024-01-21T19:59:06.413499+0000","last_became_peered":"2024-01-21T19:59:06.413499+0000","last_unstale":"2024-01-21T19:59:06.415838+0000","last_undegraded":"2024-01-21T19:59:06.415838+0000","last_fullsized":"2024-01-21T19:59:06.415838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417380+0000","last_change":"2024-01-21T19:59:06.039198+0000","last_active":"2024-01-21T19:59:06.417380+0000","last_peered":"2024-01-21T19:59:06.417380+0000","last_clean":"2024-01-21T19:59:06.417380+0000","last_became_active":"2024-01-21T19:59:06.038161+0000","last_became_peered":"2024-01-21T19:59:06.038161+0000","last_unstale":"2024-01-21T19:59:06.417380+0000","last_undegraded":"2024-01-21T19:59:06.417380+0000","last_fullsized":"2024-01-21T19:59:06.417380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":85794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":84380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:13.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.935+0000 7f4068c23700 1 Processor -- start 2024-01-21T19:59:13.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.935+0000 7f4068c23700 1 -- start start 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4068c23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40640c3840 0x7f40640c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4068c23700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40640c6250 0x7f40640bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4068c23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4064067f10 con 0x7f40640c5dc0 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4068c23700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40640681f0 con 0x7f40640c3840 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4068c23700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40640684d0 con 0x7f40640c6250 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40640c3840 0x7f40640c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40640c3840 0x7f40640c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60096/0 (socket says 172.21.15.133:60096) 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4061d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f40640c5dc0 0x7f406413a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55976/0 (socket says 172.21.15.133:55976) 2024-01-21T19:59:13.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 -- 172.21.15.133:0/2941526528 learned_addr learned my addr 172.21.15.133:0/2941526528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f4062d9d700 1 --2- 172.21.15.133:0/2941526528 >> v2:172.21.15.178:3300/0 conn(0x7f40640c6250 0x7f40640bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 -- 172.21.15.133:0/2941526528 >> v2:172.21.15.178:3300/0 conn(0x7f40640c6250 msgr2=0x7f40640bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 --2- 172.21.15.133:0/2941526528 >> v2:172.21.15.178:3300/0 conn(0x7f40640c6250 0x7f40640bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 -- 172.21.15.133:0/2941526528 >> v1:172.21.15.133:6789/0 conn(0x7f40640c5dc0 legacy=0x7f406413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.936+0000 7f406259c700 1 -- 172.21.15.133:0/2941526528 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640687b0 con 0x7f40640c3840 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f406259c700 1 --2- 172.21.15.133:0/2941526528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c3840 0x7f40640c3c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f40640c8eb0 tx=0x7f40580090f0).ready entity=mon.0 client_cookie=ea28e4769cc07d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f406159a700 1 -- 172.21.15.133:0/2941526528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800f510 con 0x7f40640c3840 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f406159a700 1 -- 172.21.15.133:0/2941526528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800f670 con 0x7f40640c3840 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f406159a700 1 -- 172.21.15.133:0/2941526528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800fa10 con 0x7f40640c3840 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 -- 172.21.15.133:0/2941526528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c3840 msgr2=0x7f40640c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 --2- 172.21.15.133:0/2941526528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c3840 0x7f40640c3c20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f40640c8eb0 tx=0x7f40580090f0).stop 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 -- 172.21.15.133:0/2941526528 shutdown_connections 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 --2- 172.21.15.133:0/2941526528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c3840 0x7f40640c3c20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:13.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 --2- 172.21.15.133:0/2941526528 >> v2:172.21.15.178:3300/0 conn(0x7f40640c6250 0x7f40640bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 -- 172.21.15.133:0/2941526528 >> 172.21.15.133:0/2941526528 conn(0x7f4064066a70 msgr2=0x7f4064066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 -- 172.21.15.133:0/2941526528 shutdown_connections 2024-01-21T19:59:13.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.937+0000 7f4068c23700 1 -- 172.21.15.133:0/2941526528 wait complete. 2024-01-21T19:59:13.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.939+0000 7f4068c23700 1 Processor -- start 2024-01-21T19:59:13.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.939+0000 7f4068c23700 1 -- start start 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.939+0000 7f4068c23700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40640c3840 0x7f40641517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.939+0000 7f4068c23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40640c6250 0x7f40640c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640c0e60 con 0x7f40640c5dc0 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40640c0980 con 0x7f40640c3840 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40641522e0 con 0x7f40640c6250 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60104/0 (socket says 172.21.15.133:60104) 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 -- 172.21.15.133:0/3437257171 learned_addr learned my addr 172.21.15.133:0/3437257171 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 -- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40640c6250 msgr2=0x7f40640c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40640c6250 0x7f40640c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f406259c700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40640c3840 0x7f40641517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:13.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 -- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40640c3840 msgr2=0x7f40641517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40640c3840 0x7f40641517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 -- 172.21.15.133:0/3437257171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058009370 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4061d9b700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f405400c810 tx=0x7f4054007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540072e0 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054007440 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40640c0b80 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540058f0 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.940+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4064168490 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.941+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406405fdf0 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.942+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4054005ce0 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.942+0000 7f4052ffd700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 0x7f4044061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.942+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4054079be0 con 0x7f40640c5dc0 2024-01-21T19:59:13.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.942+0000 7f406259c700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 0x7f4044061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:13.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.942+0000 7f406259c700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 0x7f4044061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4058006df0 tx=0x7f4058016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:13.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:13.946+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f405404af60 con 0x7f40640c5dc0 2024-01-21T19:59:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.109+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4064068a90 con 0x7f404405f150 2024-01-21T19:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.118+0000 7f4052ffd700 1 -- 172.21.15.133:0/3437257171 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336457 (secure 0 0 0) 0x7f4064068a90 con 0x7f404405f150 2024-01-21T19:59:14.115 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 msgr2=0x7f4044061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 0x7f4044061610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4058006df0 tx=0x7f4058016000).stop 2024-01-21T19:59:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 msgr2=0x7f40640bffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f405400c810 tx=0x7f4054007db0).stop 2024-01-21T19:59:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 shutdown_connections 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f404405f150 0x7f4044061610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40640c6250 0x7f40640c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40640c3840 0x7f40641517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 --2- 172.21.15.133:0/3437257171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40640c5dc0 0x7f40640bffa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 >> 172.21.15.133:0/3437257171 conn(0x7f4064066a70 msgr2=0x7f406413a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 shutdown_connections 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.121+0000 7f4068c23700 1 -- 172.21.15.133:0/3437257171 wait complete. 2024-01-21T19:59:14.120 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:14.124 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T19:59:13.849829+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378616,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596104,"statfs":{"total":773094113280,"available":770658410496,"internally_reserved":0,"allocated":1892352,"data_stored":685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001267"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408931+0000","last_change":"2024-01-21T19:59:06.407131+0000","last_active":"2024-01-21T19:59:06.408931+0000","last_peered":"2024-01-21T19:59:06.408931+0000","last_clean":"2024-01-21T19:59:06.408931+0000","last_became_active":"2024-01-21T19:59:06.406853+0000","last_became_peered":"2024-01-21T19:59:06.406853+0000","last_unstale":"2024-01-21T19:59:06.408931+0000","last_undegraded":"2024-01-21T19:59:06.408931+0000","last_fullsized":"2024-01-21T19:59:06.408931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405624+0000","last_change":"2024-01-21T19:59:06.034930+0000","last_active":"2024-01-21T19:59:06.405624+0000","last_peered":"2024-01-21T19:59:06.405624+0000","last_clean":"2024-01-21T19:59:06.405624+0000","last_became_active":"2024-01-21T19:59:06.034648+0000","last_became_peered":"2024-01-21T19:59:06.034648+0000","last_unstale":"2024-01-21T19:59:06.405624+0000","last_undegraded":"2024-01-21T19:59:06.405624+0000","last_fullsized":"2024-01-21T19:59:06.405624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415745+0000","last_change":"2024-01-21T19:59:06.414371+0000","last_active":"2024-01-21T19:59:06.415745+0000","last_peered":"2024-01-21T19:59:06.415745+0000","last_clean":"2024-01-21T19:59:06.415745+0000","last_became_active":"2024-01-21T19:59:06.414078+0000","last_became_peered":"2024-01-21T19:59:06.414078+0000","last_unstale":"2024-01-21T19:59:06.415745+0000","last_undegraded":"2024-01-21T19:59:06.415745+0000","last_fullsized":"2024-01-21T19:59:06.415745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403854+0000","last_change":"2024-01-21T19:59:06.035542+0000","last_active":"2024-01-21T19:59:06.403854+0000","last_peered":"2024-01-21T19:59:06.403854+0000","last_clean":"2024-01-21T19:59:06.403854+0000","last_became_active":"2024-01-21T19:59:06.035262+0000","last_became_peered":"2024-01-21T19:59:06.035262+0000","last_unstale":"2024-01-21T19:59:06.403854+0000","last_undegraded":"2024-01-21T19:59:06.403854+0000","last_fullsized":"2024-01-21T19:59:06.403854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406814+0000","last_change":"2024-01-21T19:59:06.405992+0000","last_active":"2024-01-21T19:59:06.406814+0000","last_peered":"2024-01-21T19:59:06.406814+0000","last_clean":"2024-01-21T19:59:06.406814+0000","last_became_active":"2024-01-21T19:59:06.405013+0000","last_became_peered":"2024-01-21T19:59:06.405013+0000","last_unstale":"2024-01-21T19:59:06.406814+0000","last_undegraded":"2024-01-21T19:59:06.406814+0000","last_fullsized":"2024-01-21T19:59:06.406814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392792+0000","last_change":"2024-01-21T19:59:06.041467+0000","last_active":"2024-01-21T19:59:06.392792+0000","last_peered":"2024-01-21T19:59:06.392792+0000","last_clean":"2024-01-21T19:59:06.392792+0000","last_became_active":"2024-01-21T19:59:06.041158+0000","last_became_peered":"2024-01-21T19:59:06.041158+0000","last_unstale":"2024-01-21T19:59:06.392792+0000","last_undegraded":"2024-01-21T19:59:06.392792+0000","last_fullsized":"2024-01-21T19:59:06.392792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408938+0000","last_change":"2024-01-21T19:59:06.407402+0000","last_active":"2024-01-21T19:59:06.408938+0000","last_peered":"2024-01-21T19:59:06.408938+0000","last_clean":"2024-01-21T19:59:06.408938+0000","last_became_active":"2024-01-21T19:59:06.406722+0000","last_became_peered":"2024-01-21T19:59:06.406722+0000","last_unstale":"2024-01-21T19:59:06.408938+0000","last_undegraded":"2024-01-21T19:59:06.408938+0000","last_fullsized":"2024-01-21T19:59:06.408938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392400+0000","last_change":"2024-01-21T19:59:06.038017+0000","last_active":"2024-01-21T19:59:06.392400+0000","last_peered":"2024-01-21T19:59:06.392400+0000","last_clean":"2024-01-21T19:59:06.392400+0000","last_became_active":"2024-01-21T19:59:06.037532+0000","last_became_peered":"2024-01-21T19:59:06.037532+0000","last_unstale":"2024-01-21T19:59:06.392400+0000","last_undegraded":"2024-01-21T19:59:06.392400+0000","last_fullsized":"2024-01-21T19:59:06.392400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415998+0000","last_change":"2024-01-21T19:59:06.415183+0000","last_active":"2024-01-21T19:59:06.415998+0000","last_peered":"2024-01-21T19:59:06.415998+0000","last_clean":"2024-01-21T19:59:06.415998+0000","last_became_active":"2024-01-21T19:59:06.414874+0000","last_became_peered":"2024-01-21T19:59:06.414874+0000","last_unstale":"2024-01-21T19:59:06.415998+0000","last_undegraded":"2024-01-21T19:59:06.415998+0000","last_fullsized":"2024-01-21T19:59:06.415998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392424+0000","last_change":"2024-01-21T19:59:06.039345+0000","last_active":"2024-01-21T19:59:06.392424+0000","last_peered":"2024-01-21T19:59:06.392424+0000","last_clean":"2024-01-21T19:59:06.392424+0000","last_became_active":"2024-01-21T19:59:06.039077+0000","last_became_peered":"2024-01-21T19:59:06.039077+0000","last_unstale":"2024-01-21T19:59:06.392424+0000","last_undegraded":"2024-01-21T19:59:06.392424+0000","last_fullsized":"2024-01-21T19:59:06.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412461+0000","last_change":"2024-01-21T19:59:06.408094+0000","last_active":"2024-01-21T19:59:06.412461+0000","last_peered":"2024-01-21T19:59:06.412461+0000","last_clean":"2024-01-21T19:59:06.412461+0000","last_became_active":"2024-01-21T19:59:06.407833+0000","last_became_peered":"2024-01-21T19:59:06.407833+0000","last_unstale":"2024-01-21T19:59:06.412461+0000","last_undegraded":"2024-01-21T19:59:06.412461+0000","last_fullsized":"2024-01-21T19:59:06.412461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417155+0000","last_change":"2024-01-21T19:59:06.037535+0000","last_active":"2024-01-21T19:59:06.417155+0000","last_peered":"2024-01-21T19:59:06.417155+0000","last_clean":"2024-01-21T19:59:06.417155+0000","last_became_active":"2024-01-21T19:59:06.037260+0000","last_became_peered":"2024-01-21T19:59:06.037260+0000","last_unstale":"2024-01-21T19:59:06.417155+0000","last_undegraded":"2024-01-21T19:59:06.417155+0000","last_fullsized":"2024-01-21T19:59:06.417155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415420+0000","last_change":"2024-01-21T19:59:06.411473+0000","last_active":"2024-01-21T19:59:06.415420+0000","last_peered":"2024-01-21T19:59:06.415420+0000","last_clean":"2024-01-21T19:59:06.415420+0000","last_became_active":"2024-01-21T19:59:06.408751+0000","last_became_peered":"2024-01-21T19:59:06.408751+0000","last_unstale":"2024-01-21T19:59:06.415420+0000","last_undegraded":"2024-01-21T19:59:06.415420+0000","last_fullsized":"2024-01-21T19:59:06.415420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419677+0000","last_change":"2024-01-21T19:59:06.037480+0000","last_active":"2024-01-21T19:59:06.419677+0000","last_peered":"2024-01-21T19:59:06.419677+0000","last_clean":"2024-01-21T19:59:06.419677+0000","last_became_active":"2024-01-21T19:59:06.037054+0000","last_became_peered":"2024-01-21T19:59:06.037054+0000","last_unstale":"2024-01-21T19:59:06.419677+0000","last_undegraded":"2024-01-21T19:59:06.419677+0000","last_fullsized":"2024-01-21T19:59:06.419677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413369+0000","last_change":"2024-01-21T19:59:06.411113+0000","last_active":"2024-01-21T19:59:06.413369+0000","last_peered":"2024-01-21T19:59:06.413369+0000","last_clean":"2024-01-21T19:59:06.413369+0000","last_became_active":"2024-01-21T19:59:06.410842+0000","last_became_peered":"2024-01-21T19:59:06.410842+0000","last_unstale":"2024-01-21T19:59:06.413369+0000","last_undegraded":"2024-01-21T19:59:06.413369+0000","last_fullsized":"2024-01-21T19:59:06.413369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415706+0000","last_change":"2024-01-21T19:59:06.042850+0000","last_active":"2024-01-21T19:59:06.415706+0000","last_peered":"2024-01-21T19:59:06.415706+0000","last_clean":"2024-01-21T19:59:06.415706+0000","last_became_active":"2024-01-21T19:59:06.041938+0000","last_became_peered":"2024-01-21T19:59:06.041938+0000","last_unstale":"2024-01-21T19:59:06.415706+0000","last_undegraded":"2024-01-21T19:59:06.415706+0000","last_fullsized":"2024-01-21T19:59:06.415706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413389+0000","last_change":"2024-01-21T19:59:06.411722+0000","last_active":"2024-01-21T19:59:06.413389+0000","last_peered":"2024-01-21T19:59:06.413389+0000","last_clean":"2024-01-21T19:59:06.413389+0000","last_became_active":"2024-01-21T19:59:06.411400+0000","last_became_peered":"2024-01-21T19:59:06.411400+0000","last_unstale":"2024-01-21T19:59:06.413389+0000","last_undegraded":"2024-01-21T19:59:06.413389+0000","last_fullsized":"2024-01-21T19:59:06.413389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392771+0000","last_change":"2024-01-21T19:59:06.040019+0000","last_active":"2024-01-21T19:59:06.392771+0000","last_peered":"2024-01-21T19:59:06.392771+0000","last_clean":"2024-01-21T19:59:06.392771+0000","last_became_active":"2024-01-21T19:59:06.038603+0000","last_became_peered":"2024-01-21T19:59:06.038603+0000","last_unstale":"2024-01-21T19:59:06.392771+0000","last_undegraded":"2024-01-21T19:59:06.392771+0000","last_fullsized":"2024-01-21T19:59:06.392771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401930+0000","last_change":"2024-01-21T19:59:06.397578+0000","last_active":"2024-01-21T19:59:06.401930+0000","last_peered":"2024-01-21T19:59:06.401930+0000","last_clean":"2024-01-21T19:59:06.401930+0000","last_became_active":"2024-01-21T19:59:06.397304+0000","last_became_peered":"2024-01-21T19:59:06.397304+0000","last_unstale":"2024-01-21T19:59:06.401930+0000","last_undegraded":"2024-01-21T19:59:06.401930+0000","last_fullsized":"2024-01-21T19:59:06.401930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405880+0000","last_change":"2024-01-21T19:59:06.037427+0000","last_active":"2024-01-21T19:59:06.405880+0000","last_peered":"2024-01-21T19:59:06.405880+0000","last_clean":"2024-01-21T19:59:06.405880+0000","last_became_active":"2024-01-21T19:59:06.037106+0000","last_became_peered":"2024-01-21T19:59:06.037106+0000","last_unstale":"2024-01-21T19:59:06.405880+0000","last_undegraded":"2024-01-21T19:59:06.405880+0000","last_fullsized":"2024-01-21T19:59:06.405880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412944+0000","last_change":"2024-01-21T19:59:06.410874+0000","last_active":"2024-01-21T19:59:06.412944+0000","last_peered":"2024-01-21T19:59:06.412944+0000","last_clean":"2024-01-21T19:59:06.412944+0000","last_became_active":"2024-01-21T19:59:06.410611+0000","last_became_peered":"2024-01-21T19:59:06.410611+0000","last_unstale":"2024-01-21T19:59:06.412944+0000","last_undegraded":"2024-01-21T19:59:06.412944+0000","last_fullsized":"2024-01-21T19:59:06.412944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407859+0000","last_change":"2024-01-21T19:59:06.041197+0000","last_active":"2024-01-21T19:59:06.407859+0000","last_peered":"2024-01-21T19:59:06.407859+0000","last_clean":"2024-01-21T19:59:06.407859+0000","last_became_active":"2024-01-21T19:59:06.040869+0000","last_became_peered":"2024-01-21T19:59:06.040869+0000","last_unstale":"2024-01-21T19:59:06.407859+0000","last_undegraded":"2024-01-21T19:59:06.407859+0000","last_fullsized":"2024-01-21T19:59:06.407859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413128+0000","last_change":"2024-01-21T19:59:06.411500+0000","last_active":"2024-01-21T19:59:06.413128+0000","last_peered":"2024-01-21T19:59:06.413128+0000","last_clean":"2024-01-21T19:59:06.413128+0000","last_became_active":"2024-01-21T19:59:06.411276+0000","last_became_peered":"2024-01-21T19:59:06.411276+0000","last_unstale":"2024-01-21T19:59:06.413128+0000","last_undegraded":"2024-01-21T19:59:06.413128+0000","last_fullsized":"2024-01-21T19:59:06.413128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415690+0000","last_change":"2024-01-21T19:59:06.038505+0000","last_active":"2024-01-21T19:59:06.415690+0000","last_peered":"2024-01-21T19:59:06.415690+0000","last_clean":"2024-01-21T19:59:06.415690+0000","last_became_active":"2024-01-21T19:59:06.038100+0000","last_became_peered":"2024-01-21T19:59:06.038100+0000","last_unstale":"2024-01-21T19:59:06.415690+0000","last_undegraded":"2024-01-21T19:59:06.415690+0000","last_fullsized":"2024-01-21T19:59:06.415690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415464+0000","last_change":"2024-01-21T19:59:06.412541+0000","last_active":"2024-01-21T19:59:06.415464+0000","last_peered":"2024-01-21T19:59:06.415464+0000","last_clean":"2024-01-21T19:59:06.415464+0000","last_became_active":"2024-01-21T19:59:06.412353+0000","last_became_peered":"2024-01-21T19:59:06.412353+0000","last_unstale":"2024-01-21T19:59:06.415464+0000","last_undegraded":"2024-01-21T19:59:06.415464+0000","last_fullsized":"2024-01-21T19:59:06.415464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418953+0000","last_change":"2024-01-21T19:59:06.034594+0000","last_active":"2024-01-21T19:59:06.418953+0000","last_peered":"2024-01-21T19:59:06.418953+0000","last_clean":"2024-01-21T19:59:06.418953+0000","last_became_active":"2024-01-21T19:59:06.034292+0000","last_became_peered":"2024-01-21T19:59:06.034292+0000","last_unstale":"2024-01-21T19:59:06.418953+0000","last_undegraded":"2024-01-21T19:59:06.418953+0000","last_fullsized":"2024-01-21T19:59:06.418953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416149+0000","last_change":"2024-01-21T19:59:06.411225+0000","last_active":"2024-01-21T19:59:06.416149+0000","last_peered":"2024-01-21T19:59:06.416149+0000","last_clean":"2024-01-21T19:59:06.416149+0000","last_became_active":"2024-01-21T19:59:06.410953+0000","last_became_peered":"2024-01-21T19:59:06.410953+0000","last_unstale":"2024-01-21T19:59:06.416149+0000","last_undegraded":"2024-01-21T19:59:06.416149+0000","last_fullsized":"2024-01-21T19:59:06.416149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399828+0000","last_change":"2024-01-21T19:59:06.037843+0000","last_active":"2024-01-21T19:59:06.399828+0000","last_peered":"2024-01-21T19:59:06.399828+0000","last_clean":"2024-01-21T19:59:06.399828+0000","last_became_active":"2024-01-21T19:59:06.033911+0000","last_became_peered":"2024-01-21T19:59:06.033911+0000","last_unstale":"2024-01-21T19:59:06.399828+0000","last_undegraded":"2024-01-21T19:59:06.399828+0000","last_fullsized":"2024-01-21T19:59:06.399828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.411011+0000","last_change":"2024-01-21T19:59:06.409655+0000","last_active":"2024-01-21T19:59:06.411011+0000","last_peered":"2024-01-21T19:59:06.411011+0000","last_clean":"2024-01-21T19:59:06.411011+0000","last_became_active":"2024-01-21T19:59:06.408656+0000","last_became_peered":"2024-01-21T19:59:06.408656+0000","last_unstale":"2024-01-21T19:59:06.411011+0000","last_undegraded":"2024-01-21T19:59:06.411011+0000","last_fullsized":"2024-01-21T19:59:06.411011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392261+0000","last_change":"2024-01-21T19:59:06.036207+0000","last_active":"2024-01-21T19:59:06.392261+0000","last_peered":"2024-01-21T19:59:06.392261+0000","last_clean":"2024-01-21T19:59:06.392261+0000","last_became_active":"2024-01-21T19:59:06.035921+0000","last_became_peered":"2024-01-21T19:59:06.035921+0000","last_unstale":"2024-01-21T19:59:06.392261+0000","last_undegraded":"2024-01-21T19:59:06.392261+0000","last_fullsized":"2024-01-21T19:59:06.392261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416535+0000","last_change":"2024-01-21T19:59:06.406341+0000","last_active":"2024-01-21T19:59:06.416535+0000","last_peered":"2024-01-21T19:59:06.416535+0000","last_clean":"2024-01-21T19:59:06.416535+0000","last_became_active":"2024-01-21T19:59:06.405508+0000","last_became_peered":"2024-01-21T19:59:06.405508+0000","last_unstale":"2024-01-21T19:59:06.416535+0000","last_undegraded":"2024-01-21T19:59:06.416535+0000","last_fullsized":"2024-01-21T19:59:06.416535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399066+0000","last_change":"2024-01-21T19:59:06.042182+0000","last_active":"2024-01-21T19:59:06.399066+0000","last_peered":"2024-01-21T19:59:06.399066+0000","last_clean":"2024-01-21T19:59:06.399066+0000","last_became_active":"2024-01-21T19:59:06.041899+0000","last_became_peered":"2024-01-21T19:59:06.041899+0000","last_unstale":"2024-01-21T19:59:06.399066+0000","last_undegraded":"2024-01-21T19:59:06.399066+0000","last_fullsized":"2024-01-21T19:59:06.399066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417530+0000","last_change":"2024-01-21T19:59:06.408589+0000","last_active":"2024-01-21T19:59:06.417530+0000","last_peered":"2024-01-21T19:59:06.417530+0000","last_clean":"2024-01-21T19:59:06.417530+0000","last_became_active":"2024-01-21T19:59:06.407943+0000","last_became_peered":"2024-01-21T19:59:06.407943+0000","last_unstale":"2024-01-21T19:59:06.417530+0000","last_undegraded":"2024-01-21T19:59:06.417530+0000","last_fullsized":"2024-01-21T19:59:06.417530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396785+0000","last_change":"2024-01-21T19:59:06.030824+0000","last_active":"2024-01-21T19:59:06.396785+0000","last_peered":"2024-01-21T19:59:06.396785+0000","last_clean":"2024-01-21T19:59:06.396785+0000","last_became_active":"2024-01-21T19:59:06.030428+0000","last_became_peered":"2024-01-21T19:59:06.030428+0000","last_unstale":"2024-01-21T19:59:06.396785+0000","last_undegraded":"2024-01-21T19:59:06.396785+0000","last_fullsized":"2024-01-21T19:59:06.396785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415606+0000","last_change":"2024-01-21T19:59:06.409370+0000","last_active":"2024-01-21T19:59:06.415606+0000","last_peered":"2024-01-21T19:59:06.415606+0000","last_clean":"2024-01-21T19:59:06.415606+0000","last_became_active":"2024-01-21T19:59:06.406417+0000","last_became_peered":"2024-01-21T19:59:06.406417+0000","last_unstale":"2024-01-21T19:59:06.415606+0000","last_undegraded":"2024-01-21T19:59:06.415606+0000","last_fullsized":"2024-01-21T19:59:06.415606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406327+0000","last_change":"2024-01-21T19:59:06.035645+0000","last_active":"2024-01-21T19:59:06.406327+0000","last_peered":"2024-01-21T19:59:06.406327+0000","last_clean":"2024-01-21T19:59:06.406327+0000","last_became_active":"2024-01-21T19:59:06.035356+0000","last_became_peered":"2024-01-21T19:59:06.035356+0000","last_unstale":"2024-01-21T19:59:06.406327+0000","last_undegraded":"2024-01-21T19:59:06.406327+0000","last_fullsized":"2024-01-21T19:59:06.406327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412394+0000","last_change":"2024-01-21T19:59:06.407766+0000","last_active":"2024-01-21T19:59:06.412394+0000","last_peered":"2024-01-21T19:59:06.412394+0000","last_clean":"2024-01-21T19:59:06.412394+0000","last_became_active":"2024-01-21T19:59:06.407502+0000","last_became_peered":"2024-01-21T19:59:06.407502+0000","last_unstale":"2024-01-21T19:59:06.412394+0000","last_undegraded":"2024-01-21T19:59:06.412394+0000","last_fullsized":"2024-01-21T19:59:06.412394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392023+0000","last_change":"2024-01-21T19:59:06.036576+0000","last_active":"2024-01-21T19:59:06.392023+0000","last_peered":"2024-01-21T19:59:06.392023+0000","last_clean":"2024-01-21T19:59:06.392023+0000","last_became_active":"2024-01-21T19:59:06.036282+0000","last_became_peered":"2024-01-21T19:59:06.036282+0000","last_unstale":"2024-01-21T19:59:06.392023+0000","last_undegraded":"2024-01-21T19:59:06.392023+0000","last_fullsized":"2024-01-21T19:59:06.392023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403780+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:06.403780+0000","last_peered":"2024-01-21T19:59:06.403780+0000","last_clean":"2024-01-21T19:59:06.403780+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:06.403780+0000","last_undegraded":"2024-01-21T19:59:06.403780+0000","last_fullsized":"2024-01-21T19:59:06.403780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391912+0000","last_change":"2024-01-21T19:59:06.035851+0000","last_active":"2024-01-21T19:59:06.391912+0000","last_peered":"2024-01-21T19:59:06.391912+0000","last_clean":"2024-01-21T19:59:06.391912+0000","last_became_active":"2024-01-21T19:59:06.035316+0000","last_became_peered":"2024-01-21T19:59:06.035316+0000","last_unstale":"2024-01-21T19:59:06.391912+0000","last_undegraded":"2024-01-21T19:59:06.391912+0000","last_fullsized":"2024-01-21T19:59:06.391912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412286+0000","last_change":"2024-01-21T19:59:06.406779+0000","last_active":"2024-01-21T19:59:06.412286+0000","last_peered":"2024-01-21T19:59:06.412286+0000","last_clean":"2024-01-21T19:59:06.412286+0000","last_became_active":"2024-01-21T19:59:06.406509+0000","last_became_peered":"2024-01-21T19:59:06.406509+0000","last_unstale":"2024-01-21T19:59:06.412286+0000","last_undegraded":"2024-01-21T19:59:06.412286+0000","last_fullsized":"2024-01-21T19:59:06.412286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392515+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:06.392515+0000","last_peered":"2024-01-21T19:59:06.392515+0000","last_clean":"2024-01-21T19:59:06.392515+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:06.392515+0000","last_undegraded":"2024-01-21T19:59:06.392515+0000","last_fullsized":"2024-01-21T19:59:06.392515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407902+0000","last_change":"2024-01-21T19:59:06.041554+0000","last_active":"2024-01-21T19:59:06.407902+0000","last_peered":"2024-01-21T19:59:06.407902+0000","last_clean":"2024-01-21T19:59:06.407902+0000","last_became_active":"2024-01-21T19:59:06.041229+0000","last_became_peered":"2024-01-21T19:59:06.041229+0000","last_unstale":"2024-01-21T19:59:06.407902+0000","last_undegraded":"2024-01-21T19:59:06.407902+0000","last_fullsized":"2024-01-21T19:59:06.407902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412418+0000","last_change":"2024-01-21T19:59:06.407976+0000","last_active":"2024-01-21T19:59:06.412418+0000","last_peered":"2024-01-21T19:59:06.412418+0000","last_clean":"2024-01-21T19:59:06.412418+0000","last_became_active":"2024-01-21T19:59:06.407713+0000","last_became_peered":"2024-01-21T19:59:06.407713+0000","last_unstale":"2024-01-21T19:59:06.412418+0000","last_undegraded":"2024-01-21T19:59:06.412418+0000","last_fullsized":"2024-01-21T19:59:06.412418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412281+0000","last_change":"2024-01-21T19:59:06.406673+0000","last_active":"2024-01-21T19:59:06.412281+0000","last_peered":"2024-01-21T19:59:06.412281+0000","last_clean":"2024-01-21T19:59:06.412281+0000","last_became_active":"2024-01-21T19:59:06.406394+0000","last_became_peered":"2024-01-21T19:59:06.406394+0000","last_unstale":"2024-01-21T19:59:06.412281+0000","last_undegraded":"2024-01-21T19:59:06.412281+0000","last_fullsized":"2024-01-21T19:59:06.412281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388616+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:06.388616+0000","last_peered":"2024-01-21T19:59:06.388616+0000","last_clean":"2024-01-21T19:59:06.388616+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:06.388616+0000","last_undegraded":"2024-01-21T19:59:06.388616+0000","last_fullsized":"2024-01-21T19:59:06.388616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403727+0000","last_change":"2024-01-21T19:59:06.031330+0000","last_active":"2024-01-21T19:59:06.403727+0000","last_peered":"2024-01-21T19:59:06.403727+0000","last_clean":"2024-01-21T19:59:06.403727+0000","last_became_active":"2024-01-21T19:59:06.031043+0000","last_became_peered":"2024-01-21T19:59:06.031043+0000","last_unstale":"2024-01-21T19:59:06.403727+0000","last_undegraded":"2024-01-21T19:59:06.403727+0000","last_fullsized":"2024-01-21T19:59:06.403727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414575+0000","last_change":"2024-01-21T19:59:06.409494+0000","last_active":"2024-01-21T19:59:06.414575+0000","last_peered":"2024-01-21T19:59:06.414575+0000","last_clean":"2024-01-21T19:59:06.414575+0000","last_became_active":"2024-01-21T19:59:06.409221+0000","last_became_peered":"2024-01-21T19:59:06.409221+0000","last_unstale":"2024-01-21T19:59:06.414575+0000","last_undegraded":"2024-01-21T19:59:06.414575+0000","last_fullsized":"2024-01-21T19:59:06.414575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391231+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:06.391231+0000","last_peered":"2024-01-21T19:59:06.391231+0000","last_clean":"2024-01-21T19:59:06.391231+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:06.391231+0000","last_undegraded":"2024-01-21T19:59:06.391231+0000","last_fullsized":"2024-01-21T19:59:06.391231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.398950+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:06.398950+0000","last_peered":"2024-01-21T19:59:06.398950+0000","last_clean":"2024-01-21T19:59:06.398950+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:06.398950+0000","last_undegraded":"2024-01-21T19:59:06.398950+0000","last_fullsized":"2024-01-21T19:59:06.398950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392105+0000","last_change":"2024-01-21T19:59:06.034391+0000","last_active":"2024-01-21T19:59:06.392105+0000","last_peered":"2024-01-21T19:59:06.392105+0000","last_clean":"2024-01-21T19:59:06.392105+0000","last_became_active":"2024-01-21T19:59:06.034060+0000","last_became_peered":"2024-01-21T19:59:06.034060+0000","last_unstale":"2024-01-21T19:59:06.392105+0000","last_undegraded":"2024-01-21T19:59:06.392105+0000","last_fullsized":"2024-01-21T19:59:06.392105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410899+0000","last_change":"2024-01-21T19:59:06.408800+0000","last_active":"2024-01-21T19:59:06.410899+0000","last_peered":"2024-01-21T19:59:06.410899+0000","last_clean":"2024-01-21T19:59:06.410899+0000","last_became_active":"2024-01-21T19:59:06.408515+0000","last_became_peered":"2024-01-21T19:59:06.408515+0000","last_unstale":"2024-01-21T19:59:06.410899+0000","last_undegraded":"2024-01-21T19:59:06.410899+0000","last_fullsized":"2024-01-21T19:59:06.410899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401822+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:06.401822+0000","last_peered":"2024-01-21T19:59:06.401822+0000","last_clean":"2024-01-21T19:59:06.401822+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:06.401822+0000","last_undegraded":"2024-01-21T19:59:06.401822+0000","last_fullsized":"2024-01-21T19:59:06.401822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391457+0000","last_change":"2024-01-21T19:59:06.041530+0000","last_active":"2024-01-21T19:59:06.391457+0000","last_peered":"2024-01-21T19:59:06.391457+0000","last_clean":"2024-01-21T19:59:06.391457+0000","last_became_active":"2024-01-21T19:59:06.041251+0000","last_became_peered":"2024-01-21T19:59:06.041251+0000","last_unstale":"2024-01-21T19:59:06.391457+0000","last_undegraded":"2024-01-21T19:59:06.391457+0000","last_fullsized":"2024-01-21T19:59:06.391457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399714+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:06.399714+0000","last_peered":"2024-01-21T19:59:06.399714+0000","last_clean":"2024-01-21T19:59:06.399714+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:06.399714+0000","last_undegraded":"2024-01-21T19:59:06.399714+0000","last_fullsized":"2024-01-21T19:59:06.399714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403900+0000","last_change":"2024-01-21T19:59:06.031857+0000","last_active":"2024-01-21T19:59:06.403900+0000","last_peered":"2024-01-21T19:59:06.403900+0000","last_clean":"2024-01-21T19:59:06.403900+0000","last_became_active":"2024-01-21T19:59:06.031591+0000","last_became_peered":"2024-01-21T19:59:06.031591+0000","last_unstale":"2024-01-21T19:59:06.403900+0000","last_undegraded":"2024-01-21T19:59:06.403900+0000","last_fullsized":"2024-01-21T19:59:06.403900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402917+0000","last_change":"2024-01-21T19:59:06.401094+0000","last_active":"2024-01-21T19:59:06.402917+0000","last_peered":"2024-01-21T19:59:06.402917+0000","last_clean":"2024-01-21T19:59:06.402917+0000","last_became_active":"2024-01-21T19:59:06.400832+0000","last_became_peered":"2024-01-21T19:59:06.400832+0000","last_unstale":"2024-01-21T19:59:06.402917+0000","last_undegraded":"2024-01-21T19:59:06.402917+0000","last_fullsized":"2024-01-21T19:59:06.402917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410385+0000","last_change":"2024-01-21T19:59:06.039467+0000","last_active":"2024-01-21T19:59:06.410385+0000","last_peered":"2024-01-21T19:59:06.410385+0000","last_clean":"2024-01-21T19:59:06.410385+0000","last_became_active":"2024-01-21T19:59:06.039167+0000","last_became_peered":"2024-01-21T19:59:06.039167+0000","last_unstale":"2024-01-21T19:59:06.410385+0000","last_undegraded":"2024-01-21T19:59:06.410385+0000","last_fullsized":"2024-01-21T19:59:06.410385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405399+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:06.405399+0000","last_peered":"2024-01-21T19:59:06.405399+0000","last_clean":"2024-01-21T19:59:06.405399+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:06.405399+0000","last_undegraded":"2024-01-21T19:59:06.405399+0000","last_fullsized":"2024-01-21T19:59:06.405399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413120+0000","last_change":"2024-01-21T19:59:06.410865+0000","last_active":"2024-01-21T19:59:06.413120+0000","last_peered":"2024-01-21T19:59:06.413120+0000","last_clean":"2024-01-21T19:59:06.413120+0000","last_became_active":"2024-01-21T19:59:06.410572+0000","last_became_peered":"2024-01-21T19:59:06.410572+0000","last_unstale":"2024-01-21T19:59:06.413120+0000","last_undegraded":"2024-01-21T19:59:06.413120+0000","last_fullsized":"2024-01-21T19:59:06.413120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396528+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:06.396528+0000","last_peered":"2024-01-21T19:59:06.396528+0000","last_clean":"2024-01-21T19:59:06.396528+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:06.396528+0000","last_undegraded":"2024-01-21T19:59:06.396528+0000","last_fullsized":"2024-01-21T19:59:06.396528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392481+0000","last_change":"2024-01-21T19:59:06.039407+0000","last_active":"2024-01-21T19:59:06.392481+0000","last_peered":"2024-01-21T19:59:06.392481+0000","last_clean":"2024-01-21T19:59:06.392481+0000","last_became_active":"2024-01-21T19:59:06.039118+0000","last_became_peered":"2024-01-21T19:59:06.039118+0000","last_unstale":"2024-01-21T19:59:06.392481+0000","last_undegraded":"2024-01-21T19:59:06.392481+0000","last_fullsized":"2024-01-21T19:59:06.392481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415445+0000","last_change":"2024-01-21T19:59:06.411742+0000","last_active":"2024-01-21T19:59:06.415445+0000","last_peered":"2024-01-21T19:59:06.415445+0000","last_clean":"2024-01-21T19:59:06.415445+0000","last_became_active":"2024-01-21T19:59:06.408852+0000","last_became_peered":"2024-01-21T19:59:06.408852+0000","last_unstale":"2024-01-21T19:59:06.415445+0000","last_undegraded":"2024-01-21T19:59:06.415445+0000","last_fullsized":"2024-01-21T19:59:06.415445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413174+0000","last_change":"2024-01-21T19:59:06.411871+0000","last_active":"2024-01-21T19:59:06.413174+0000","last_peered":"2024-01-21T19:59:06.413174+0000","last_clean":"2024-01-21T19:59:06.413174+0000","last_became_active":"2024-01-21T19:59:06.411604+0000","last_became_peered":"2024-01-21T19:59:06.411604+0000","last_unstale":"2024-01-21T19:59:06.413174+0000","last_undegraded":"2024-01-21T19:59:06.413174+0000","last_fullsized":"2024-01-21T19:59:06.413174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394020+0000","last_change":"2024-01-21T19:59:06.042778+0000","last_active":"2024-01-21T19:59:06.394020+0000","last_peered":"2024-01-21T19:59:06.394020+0000","last_clean":"2024-01-21T19:59:06.394020+0000","last_became_active":"2024-01-21T19:59:06.042250+0000","last_became_peered":"2024-01-21T19:59:06.042250+0000","last_unstale":"2024-01-21T19:59:06.394020+0000","last_undegraded":"2024-01-21T19:59:06.394020+0000","last_fullsized":"2024-01-21T19:59:06.394020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415400+0000","last_change":"2024-01-21T19:59:06.408475+0000","last_active":"2024-01-21T19:59:06.415400+0000","last_peered":"2024-01-21T19:59:06.415400+0000","last_clean":"2024-01-21T19:59:06.415400+0000","last_became_active":"2024-01-21T19:59:06.406096+0000","last_became_peered":"2024-01-21T19:59:06.406096+0000","last_unstale":"2024-01-21T19:59:06.415400+0000","last_undegraded":"2024-01-21T19:59:06.415400+0000","last_fullsized":"2024-01-21T19:59:06.415400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392127+0000","last_change":"2024-01-21T19:59:06.041454+0000","last_active":"2024-01-21T19:59:06.392127+0000","last_peered":"2024-01-21T19:59:06.392127+0000","last_clean":"2024-01-21T19:59:06.392127+0000","last_became_active":"2024-01-21T19:59:06.041172+0000","last_became_peered":"2024-01-21T19:59:06.041172+0000","last_unstale":"2024-01-21T19:59:06.392127+0000","last_undegraded":"2024-01-21T19:59:06.392127+0000","last_fullsized":"2024-01-21T19:59:06.392127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416665+0000","last_change":"2024-01-21T19:59:06.404670+0000","last_active":"2024-01-21T19:59:06.416665+0000","last_peered":"2024-01-21T19:59:06.416665+0000","last_clean":"2024-01-21T19:59:06.416665+0000","last_became_active":"2024-01-21T19:59:06.404385+0000","last_became_peered":"2024-01-21T19:59:06.404385+0000","last_unstale":"2024-01-21T19:59:06.416665+0000","last_undegraded":"2024-01-21T19:59:06.416665+0000","last_fullsized":"2024-01-21T19:59:06.416665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404466+0000","last_change":"2024-01-21T19:59:06.032073+0000","last_active":"2024-01-21T19:59:06.404466+0000","last_peered":"2024-01-21T19:59:06.404466+0000","last_clean":"2024-01-21T19:59:06.404466+0000","last_became_active":"2024-01-21T19:59:06.031626+0000","last_became_peered":"2024-01-21T19:59:06.031626+0000","last_unstale":"2024-01-21T19:59:06.404466+0000","last_undegraded":"2024-01-21T19:59:06.404466+0000","last_fullsized":"2024-01-21T19:59:06.404466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402318+0000","last_change":"2024-01-21T19:59:06.399583+0000","last_active":"2024-01-21T19:59:06.402318+0000","last_peered":"2024-01-21T19:59:06.402318+0000","last_clean":"2024-01-21T19:59:06.402318+0000","last_became_active":"2024-01-21T19:59:06.399318+0000","last_became_peered":"2024-01-21T19:59:06.399318+0000","last_unstale":"2024-01-21T19:59:06.402318+0000","last_undegraded":"2024-01-21T19:59:06.402318+0000","last_fullsized":"2024-01-21T19:59:06.402318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406744+0000","last_change":"2024-01-21T19:59:06.034516+0000","last_active":"2024-01-21T19:59:06.406744+0000","last_peered":"2024-01-21T19:59:06.406744+0000","last_clean":"2024-01-21T19:59:06.406744+0000","last_became_active":"2024-01-21T19:59:06.034231+0000","last_became_peered":"2024-01-21T19:59:06.034231+0000","last_unstale":"2024-01-21T19:59:06.406744+0000","last_undegraded":"2024-01-21T19:59:06.406744+0000","last_fullsized":"2024-01-21T19:59:06.406744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418474+0000","last_change":"2024-01-21T19:59:06.413015+0000","last_active":"2024-01-21T19:59:06.418474+0000","last_peered":"2024-01-21T19:59:06.418474+0000","last_clean":"2024-01-21T19:59:06.418474+0000","last_became_active":"2024-01-21T19:59:06.412719+0000","last_became_peered":"2024-01-21T19:59:06.412719+0000","last_unstale":"2024-01-21T19:59:06.418474+0000","last_undegraded":"2024-01-21T19:59:06.418474+0000","last_fullsized":"2024-01-21T19:59:06.418474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400212+0000","last_change":"2024-01-21T19:59:06.037831+0000","last_active":"2024-01-21T19:59:06.400212+0000","last_peered":"2024-01-21T19:59:06.400212+0000","last_clean":"2024-01-21T19:59:06.400212+0000","last_became_active":"2024-01-21T19:59:06.037213+0000","last_became_peered":"2024-01-21T19:59:06.037213+0000","last_unstale":"2024-01-21T19:59:06.400212+0000","last_undegraded":"2024-01-21T19:59:06.400212+0000","last_fullsized":"2024-01-21T19:59:06.400212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412328+0000","last_change":"2024-01-21T19:59:06.407158+0000","last_active":"2024-01-21T19:59:06.412328+0000","last_peered":"2024-01-21T19:59:06.412328+0000","last_clean":"2024-01-21T19:59:06.412328+0000","last_became_active":"2024-01-21T19:59:06.406887+0000","last_became_peered":"2024-01-21T19:59:06.406887+0000","last_unstale":"2024-01-21T19:59:06.412328+0000","last_undegraded":"2024-01-21T19:59:06.412328+0000","last_fullsized":"2024-01-21T19:59:06.412328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394796+0000","last_change":"2024-01-21T19:59:06.040441+0000","last_active":"2024-01-21T19:59:06.394796+0000","last_peered":"2024-01-21T19:59:06.394796+0000","last_clean":"2024-01-21T19:59:06.394796+0000","last_became_active":"2024-01-21T19:59:06.040145+0000","last_became_peered":"2024-01-21T19:59:06.040145+0000","last_unstale":"2024-01-21T19:59:06.394796+0000","last_undegraded":"2024-01-21T19:59:06.394796+0000","last_fullsized":"2024-01-21T19:59:06.394796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412523+0000","last_change":"2024-01-21T19:59:06.408682+0000","last_active":"2024-01-21T19:59:06.412523+0000","last_peered":"2024-01-21T19:59:06.412523+0000","last_clean":"2024-01-21T19:59:06.412523+0000","last_became_active":"2024-01-21T19:59:06.408415+0000","last_became_peered":"2024-01-21T19:59:06.408415+0000","last_unstale":"2024-01-21T19:59:06.412523+0000","last_undegraded":"2024-01-21T19:59:06.412523+0000","last_fullsized":"2024-01-21T19:59:06.412523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388707+0000","last_change":"2024-01-21T19:59:06.033168+0000","last_active":"2024-01-21T19:59:06.388707+0000","last_peered":"2024-01-21T19:59:06.388707+0000","last_clean":"2024-01-21T19:59:06.388707+0000","last_became_active":"2024-01-21T19:59:06.032815+0000","last_became_peered":"2024-01-21T19:59:06.032815+0000","last_unstale":"2024-01-21T19:59:06.388707+0000","last_undegraded":"2024-01-21T19:59:06.388707+0000","last_fullsized":"2024-01-21T19:59:06.388707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414019+0000","last_change":"2024-01-21T19:59:06.412182+0000","last_active":"2024-01-21T19:59:06.414019+0000","last_peered":"2024-01-21T19:59:06.414019+0000","last_clean":"2024-01-21T19:59:06.414019+0000","last_became_active":"2024-01-21T19:59:06.411457+0000","last_became_peered":"2024-01-21T19:59:06.411457+0000","last_unstale":"2024-01-21T19:59:06.414019+0000","last_undegraded":"2024-01-21T19:59:06.414019+0000","last_fullsized":"2024-01-21T19:59:06.414019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392449+0000","last_change":"2024-01-21T19:59:06.036108+0000","last_active":"2024-01-21T19:59:06.392449+0000","last_peered":"2024-01-21T19:59:06.392449+0000","last_clean":"2024-01-21T19:59:06.392449+0000","last_became_active":"2024-01-21T19:59:06.035841+0000","last_became_peered":"2024-01-21T19:59:06.035841+0000","last_unstale":"2024-01-21T19:59:06.392449+0000","last_undegraded":"2024-01-21T19:59:06.392449+0000","last_fullsized":"2024-01-21T19:59:06.392449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413392+0000","last_change":"2024-01-21T19:59:06.411927+0000","last_active":"2024-01-21T19:59:06.413392+0000","last_peered":"2024-01-21T19:59:06.413392+0000","last_clean":"2024-01-21T19:59:06.413392+0000","last_became_active":"2024-01-21T19:59:06.411661+0000","last_became_peered":"2024-01-21T19:59:06.411661+0000","last_unstale":"2024-01-21T19:59:06.413392+0000","last_undegraded":"2024-01-21T19:59:06.413392+0000","last_fullsized":"2024-01-21T19:59:06.413392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.036660+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.036371+0000","last_became_peered":"2024-01-21T19:59:06.036371+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415968+0000","last_change":"2024-01-21T19:59:06.415069+0000","last_active":"2024-01-21T19:59:06.415968+0000","last_peered":"2024-01-21T19:59:06.415968+0000","last_clean":"2024-01-21T19:59:06.415968+0000","last_became_active":"2024-01-21T19:59:06.414647+0000","last_became_peered":"2024-01-21T19:59:06.414647+0000","last_unstale":"2024-01-21T19:59:06.415968+0000","last_undegraded":"2024-01-21T19:59:06.415968+0000","last_fullsized":"2024-01-21T19:59:06.415968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.393346+0000","last_change":"2024-01-21T19:59:06.042806+0000","last_active":"2024-01-21T19:59:06.393346+0000","last_peered":"2024-01-21T19:59:06.393346+0000","last_clean":"2024-01-21T19:59:06.393346+0000","last_became_active":"2024-01-21T19:59:06.042528+0000","last_became_peered":"2024-01-21T19:59:06.042528+0000","last_unstale":"2024-01-21T19:59:06.393346+0000","last_undegraded":"2024-01-21T19:59:06.393346+0000","last_fullsized":"2024-01-21T19:59:06.393346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416691+0000","last_change":"2024-01-21T19:59:06.410923+0000","last_active":"2024-01-21T19:59:06.416691+0000","last_peered":"2024-01-21T19:59:06.416691+0000","last_clean":"2024-01-21T19:59:06.416691+0000","last_became_active":"2024-01-21T19:59:06.408605+0000","last_became_peered":"2024-01-21T19:59:06.408605+0000","last_unstale":"2024-01-21T19:59:06.416691+0000","last_undegraded":"2024-01-21T19:59:06.416691+0000","last_fullsized":"2024-01-21T19:59:06.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404296+0000","last_change":"2024-01-21T19:59:06.033138+0000","last_active":"2024-01-21T19:59:06.404296+0000","last_peered":"2024-01-21T19:59:06.404296+0000","last_clean":"2024-01-21T19:59:06.404296+0000","last_became_active":"2024-01-21T19:59:06.032729+0000","last_became_peered":"2024-01-21T19:59:06.032729+0000","last_unstale":"2024-01-21T19:59:06.404296+0000","last_undegraded":"2024-01-21T19:59:06.404296+0000","last_fullsized":"2024-01-21T19:59:06.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412956+0000","last_change":"2024-01-21T19:59:06.409878+0000","last_active":"2024-01-21T19:59:06.412956+0000","last_peered":"2024-01-21T19:59:06.412956+0000","last_clean":"2024-01-21T19:59:06.412956+0000","last_became_active":"2024-01-21T19:59:06.409584+0000","last_became_peered":"2024-01-21T19:59:06.409584+0000","last_unstale":"2024-01-21T19:59:06.412956+0000","last_undegraded":"2024-01-21T19:59:06.412956+0000","last_fullsized":"2024-01-21T19:59:06.412956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396323+0000","last_change":"2024-01-21T19:59:06.036306+0000","last_active":"2024-01-21T19:59:06.396323+0000","last_peered":"2024-01-21T19:59:06.396323+0000","last_clean":"2024-01-21T19:59:06.396323+0000","last_became_active":"2024-01-21T19:59:06.036019+0000","last_became_peered":"2024-01-21T19:59:06.036019+0000","last_unstale":"2024-01-21T19:59:06.396323+0000","last_undegraded":"2024-01-21T19:59:06.396323+0000","last_fullsized":"2024-01-21T19:59:06.396323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407918+0000","last_change":"2024-01-21T19:59:06.403990+0000","last_active":"2024-01-21T19:59:06.407918+0000","last_peered":"2024-01-21T19:59:06.407918+0000","last_clean":"2024-01-21T19:59:06.407918+0000","last_became_active":"2024-01-21T19:59:06.403735+0000","last_became_peered":"2024-01-21T19:59:06.403735+0000","last_unstale":"2024-01-21T19:59:06.407918+0000","last_undegraded":"2024-01-21T19:59:06.407918+0000","last_fullsized":"2024-01-21T19:59:06.407918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.031905+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.031528+0000","last_became_peered":"2024-01-21T19:59:06.031528+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410340+0000","last_change":"2024-01-21T19:59:06.404278+0000","last_active":"2024-01-21T19:59:06.410340+0000","last_peered":"2024-01-21T19:59:06.410340+0000","last_clean":"2024-01-21T19:59:06.410340+0000","last_became_active":"2024-01-21T19:59:06.403605+0000","last_became_peered":"2024-01-21T19:59:06.403605+0000","last_unstale":"2024-01-21T19:59:06.410340+0000","last_undegraded":"2024-01-21T19:59:06.410340+0000","last_fullsized":"2024-01-21T19:59:06.410340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391853+0000","last_change":"2024-01-21T19:59:06.036513+0000","last_active":"2024-01-21T19:59:06.391853+0000","last_peered":"2024-01-21T19:59:06.391853+0000","last_clean":"2024-01-21T19:59:06.391853+0000","last_became_active":"2024-01-21T19:59:06.036203+0000","last_became_peered":"2024-01-21T19:59:06.036203+0000","last_unstale":"2024-01-21T19:59:06.391853+0000","last_undegraded":"2024-01-21T19:59:06.391853+0000","last_fullsized":"2024-01-21T19:59:06.391853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418991+0000","last_change":"2024-01-21T19:59:06.413135+0000","last_active":"2024-01-21T19:59:06.418991+0000","last_peered":"2024-01-21T19:59:06.418991+0000","last_clean":"2024-01-21T19:59:06.418991+0000","last_became_active":"2024-01-21T19:59:06.412662+0000","last_became_peered":"2024-01-21T19:59:06.412662+0000","last_unstale":"2024-01-21T19:59:06.418991+0000","last_undegraded":"2024-01-21T19:59:06.418991+0000","last_fullsized":"2024-01-21T19:59:06.418991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394244+0000","last_change":"2024-01-21T19:59:06.041668+0000","last_active":"2024-01-21T19:59:06.394244+0000","last_peered":"2024-01-21T19:59:06.394244+0000","last_clean":"2024-01-21T19:59:06.394244+0000","last_became_active":"2024-01-21T19:59:06.041337+0000","last_became_peered":"2024-01-21T19:59:06.041337+0000","last_unstale":"2024-01-21T19:59:06.394244+0000","last_undegraded":"2024-01-21T19:59:06.394244+0000","last_fullsized":"2024-01-21T19:59:06.394244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410112+0000","last_change":"2024-01-21T19:59:06.405482+0000","last_active":"2024-01-21T19:59:06.410112+0000","last_peered":"2024-01-21T19:59:06.410112+0000","last_clean":"2024-01-21T19:59:06.410112+0000","last_became_active":"2024-01-21T19:59:06.405206+0000","last_became_peered":"2024-01-21T19:59:06.405206+0000","last_unstale":"2024-01-21T19:59:06.410112+0000","last_undegraded":"2024-01-21T19:59:06.410112+0000","last_fullsized":"2024-01-21T19:59:06.410112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392562+0000","last_change":"2024-01-21T19:59:06.033405+0000","last_active":"2024-01-21T19:59:06.392562+0000","last_peered":"2024-01-21T19:59:06.392562+0000","last_clean":"2024-01-21T19:59:06.392562+0000","last_became_active":"2024-01-21T19:59:06.033067+0000","last_became_peered":"2024-01-21T19:59:06.033067+0000","last_unstale":"2024-01-21T19:59:06.392562+0000","last_undegraded":"2024-01-21T19:59:06.392562+0000","last_fullsized":"2024-01-21T19:59:06.392562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419068+0000","last_change":"2024-01-21T19:59:06.416968+0000","last_active":"2024-01-21T19:59:06.419068+0000","last_peered":"2024-01-21T19:59:06.419068+0000","last_clean":"2024-01-21T19:59:06.419068+0000","last_became_active":"2024-01-21T19:59:06.416702+0000","last_became_peered":"2024-01-21T19:59:06.416702+0000","last_unstale":"2024-01-21T19:59:06.419068+0000","last_undegraded":"2024-01-21T19:59:06.419068+0000","last_fullsized":"2024-01-21T19:59:06.419068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403561+0000","last_change":"2024-01-21T19:59:06.040770+0000","last_active":"2024-01-21T19:59:06.403561+0000","last_peered":"2024-01-21T19:59:06.403561+0000","last_clean":"2024-01-21T19:59:06.403561+0000","last_became_active":"2024-01-21T19:59:06.039205+0000","last_became_peered":"2024-01-21T19:59:06.039205+0000","last_unstale":"2024-01-21T19:59:06.403561+0000","last_undegraded":"2024-01-21T19:59:06.403561+0000","last_fullsized":"2024-01-21T19:59:06.403561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416618+0000","last_change":"2024-01-21T19:59:06.412006+0000","last_active":"2024-01-21T19:59:06.416618+0000","last_peered":"2024-01-21T19:59:06.416618+0000","last_clean":"2024-01-21T19:59:06.416618+0000","last_became_active":"2024-01-21T19:59:06.411000+0000","last_became_peered":"2024-01-21T19:59:06.411000+0000","last_unstale":"2024-01-21T19:59:06.416618+0000","last_undegraded":"2024-01-21T19:59:06.416618+0000","last_fullsized":"2024-01-21T19:59:06.416618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396610+0000","last_change":"2024-01-21T19:59:06.031139+0000","last_active":"2024-01-21T19:59:06.396610+0000","last_peered":"2024-01-21T19:59:06.396610+0000","last_clean":"2024-01-21T19:59:06.396610+0000","last_became_active":"2024-01-21T19:59:06.030914+0000","last_became_peered":"2024-01-21T19:59:06.030914+0000","last_unstale":"2024-01-21T19:59:06.396610+0000","last_undegraded":"2024-01-21T19:59:06.396610+0000","last_fullsized":"2024-01-21T19:59:06.396610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413171+0000","last_change":"2024-01-21T19:59:06.411676+0000","last_active":"2024-01-21T19:59:06.413171+0000","last_peered":"2024-01-21T19:59:06.413171+0000","last_clean":"2024-01-21T19:59:06.413171+0000","last_became_active":"2024-01-21T19:59:06.411417+0000","last_became_peered":"2024-01-21T19:59:06.411417+0000","last_unstale":"2024-01-21T19:59:06.413171+0000","last_undegraded":"2024-01-21T19:59:06.413171+0000","last_fullsized":"2024-01-21T19:59:06.413171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416934+0000","last_change":"2024-01-21T19:59:06.027798+0000","last_active":"2024-01-21T19:59:06.416934+0000","last_peered":"2024-01-21T19:59:06.416934+0000","last_clean":"2024-01-21T19:59:06.416934+0000","last_became_active":"2024-01-21T19:59:06.027498+0000","last_became_peered":"2024-01-21T19:59:06.027498+0000","last_unstale":"2024-01-21T19:59:06.416934+0000","last_undegraded":"2024-01-21T19:59:06.416934+0000","last_fullsized":"2024-01-21T19:59:06.416934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402297+0000","last_change":"2024-01-21T19:59:06.398605+0000","last_active":"2024-01-21T19:59:06.402297+0000","last_peered":"2024-01-21T19:59:06.402297+0000","last_clean":"2024-01-21T19:59:06.402297+0000","last_became_active":"2024-01-21T19:59:06.398350+0000","last_became_peered":"2024-01-21T19:59:06.398350+0000","last_unstale":"2024-01-21T19:59:06.402297+0000","last_undegraded":"2024-01-21T19:59:06.402297+0000","last_fullsized":"2024-01-21T19:59:06.402297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388678+0000","last_change":"2024-01-21T19:59:06.024779+0000","last_active":"2024-01-21T19:59:06.388678+0000","last_peered":"2024-01-21T19:59:06.388678+0000","last_clean":"2024-01-21T19:59:06.388678+0000","last_became_active":"2024-01-21T19:59:06.024455+0000","last_became_peered":"2024-01-21T19:59:06.024455+0000","last_unstale":"2024-01-21T19:59:06.388678+0000","last_undegraded":"2024-01-21T19:59:06.388678+0000","last_fullsized":"2024-01-21T19:59:06.388678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416608+0000","last_change":"2024-01-21T19:59:06.411381+0000","last_active":"2024-01-21T19:59:06.416608+0000","last_peered":"2024-01-21T19:59:06.416608+0000","last_clean":"2024-01-21T19:59:06.416608+0000","last_became_active":"2024-01-21T19:59:06.411065+0000","last_became_peered":"2024-01-21T19:59:06.411065+0000","last_unstale":"2024-01-21T19:59:06.416608+0000","last_undegraded":"2024-01-21T19:59:06.416608+0000","last_fullsized":"2024-01-21T19:59:06.416608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391431+0000","last_change":"2024-01-21T19:59:06.035305+0000","last_active":"2024-01-21T19:59:06.391431+0000","last_peered":"2024-01-21T19:59:06.391431+0000","last_clean":"2024-01-21T19:59:06.391431+0000","last_became_active":"2024-01-21T19:59:06.035011+0000","last_became_peered":"2024-01-21T19:59:06.035011+0000","last_unstale":"2024-01-21T19:59:06.391431+0000","last_undegraded":"2024-01-21T19:59:06.391431+0000","last_fullsized":"2024-01-21T19:59:06.391431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410360+0000","last_change":"2024-01-21T19:59:06.404314+0000","last_active":"2024-01-21T19:59:06.410360+0000","last_peered":"2024-01-21T19:59:06.410360+0000","last_clean":"2024-01-21T19:59:06.410360+0000","last_became_active":"2024-01-21T19:59:06.403954+0000","last_became_peered":"2024-01-21T19:59:06.403954+0000","last_unstale":"2024-01-21T19:59:06.410360+0000","last_undegraded":"2024-01-21T19:59:06.410360+0000","last_fullsized":"2024-01-21T19:59:06.410360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403338+0000","last_change":"2024-01-21T19:59:06.039241+0000","last_active":"2024-01-21T19:59:06.403338+0000","last_peered":"2024-01-21T19:59:06.403338+0000","last_clean":"2024-01-21T19:59:06.403338+0000","last_became_active":"2024-01-21T19:59:06.038967+0000","last_became_peered":"2024-01-21T19:59:06.038967+0000","last_unstale":"2024-01-21T19:59:06.403338+0000","last_undegraded":"2024-01-21T19:59:06.403338+0000","last_fullsized":"2024-01-21T19:59:06.403338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404457+0000","last_change":"2024-01-21T19:59:06.398845+0000","last_active":"2024-01-21T19:59:06.404457+0000","last_peered":"2024-01-21T19:59:06.404457+0000","last_clean":"2024-01-21T19:59:06.404457+0000","last_became_active":"2024-01-21T19:59:06.398598+0000","last_became_peered":"2024-01-21T19:59:06.398598+0000","last_unstale":"2024-01-21T19:59:06.404457+0000","last_undegraded":"2024-01-21T19:59:06.404457+0000","last_fullsized":"2024-01-21T19:59:06.404457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403951+0000","last_change":"2024-01-21T19:59:06.031315+0000","last_active":"2024-01-21T19:59:06.403951+0000","last_peered":"2024-01-21T19:59:06.403951+0000","last_clean":"2024-01-21T19:59:06.403951+0000","last_became_active":"2024-01-21T19:59:06.031001+0000","last_became_peered":"2024-01-21T19:59:06.031001+0000","last_unstale":"2024-01-21T19:59:06.403951+0000","last_undegraded":"2024-01-21T19:59:06.403951+0000","last_fullsized":"2024-01-21T19:59:06.403951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418455+0000","last_change":"2024-01-21T19:59:06.412803+0000","last_active":"2024-01-21T19:59:06.418455+0000","last_peered":"2024-01-21T19:59:06.418455+0000","last_clean":"2024-01-21T19:59:06.418455+0000","last_became_active":"2024-01-21T19:59:06.412494+0000","last_became_peered":"2024-01-21T19:59:06.412494+0000","last_unstale":"2024-01-21T19:59:06.418455+0000","last_undegraded":"2024-01-21T19:59:06.418455+0000","last_fullsized":"2024-01-21T19:59:06.418455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392612+0000","last_change":"2024-01-21T19:59:06.036578+0000","last_active":"2024-01-21T19:59:06.392612+0000","last_peered":"2024-01-21T19:59:06.392612+0000","last_clean":"2024-01-21T19:59:06.392612+0000","last_became_active":"2024-01-21T19:59:06.036234+0000","last_became_peered":"2024-01-21T19:59:06.036234+0000","last_unstale":"2024-01-21T19:59:06.392612+0000","last_undegraded":"2024-01-21T19:59:06.392612+0000","last_fullsized":"2024-01-21T19:59:06.392612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417722+0000","last_change":"2024-01-21T19:59:06.417024+0000","last_active":"2024-01-21T19:59:06.417722+0000","last_peered":"2024-01-21T19:59:06.417722+0000","last_clean":"2024-01-21T19:59:06.417722+0000","last_became_active":"2024-01-21T19:59:06.416747+0000","last_became_peered":"2024-01-21T19:59:06.416747+0000","last_unstale":"2024-01-21T19:59:06.417722+0000","last_undegraded":"2024-01-21T19:59:06.417722+0000","last_fullsized":"2024-01-21T19:59:06.417722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407615+0000","last_change":"2024-01-21T19:59:06.033544+0000","last_active":"2024-01-21T19:59:06.407615+0000","last_peered":"2024-01-21T19:59:06.407615+0000","last_clean":"2024-01-21T19:59:06.407615+0000","last_became_active":"2024-01-21T19:59:06.031765+0000","last_became_peered":"2024-01-21T19:59:06.031765+0000","last_unstale":"2024-01-21T19:59:06.407615+0000","last_undegraded":"2024-01-21T19:59:06.407615+0000","last_fullsized":"2024-01-21T19:59:06.407615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403490+0000","last_change":"2024-01-21T19:59:06.400361+0000","last_active":"2024-01-21T19:59:06.403490+0000","last_peered":"2024-01-21T19:59:06.403490+0000","last_clean":"2024-01-21T19:59:06.403490+0000","last_became_active":"2024-01-21T19:59:06.400070+0000","last_became_peered":"2024-01-21T19:59:06.400070+0000","last_unstale":"2024-01-21T19:59:06.403490+0000","last_undegraded":"2024-01-21T19:59:06.403490+0000","last_fullsized":"2024-01-21T19:59:06.403490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419401+0000","last_change":"2024-01-21T19:59:06.037315+0000","last_active":"2024-01-21T19:59:06.419401+0000","last_peered":"2024-01-21T19:59:06.419401+0000","last_clean":"2024-01-21T19:59:06.419401+0000","last_became_active":"2024-01-21T19:59:06.036690+0000","last_became_peered":"2024-01-21T19:59:06.036690+0000","last_unstale":"2024-01-21T19:59:06.419401+0000","last_undegraded":"2024-01-21T19:59:06.419401+0000","last_fullsized":"2024-01-21T19:59:06.419401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404278+0000","last_change":"2024-01-21T19:59:06.399152+0000","last_active":"2024-01-21T19:59:06.404278+0000","last_peered":"2024-01-21T19:59:06.404278+0000","last_clean":"2024-01-21T19:59:06.404278+0000","last_became_active":"2024-01-21T19:59:06.398559+0000","last_became_peered":"2024-01-21T19:59:06.398559+0000","last_unstale":"2024-01-21T19:59:06.404278+0000","last_undegraded":"2024-01-21T19:59:06.404278+0000","last_fullsized":"2024-01-21T19:59:06.404278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.395765+0000","last_change":"2024-01-21T19:59:06.033529+0000","last_active":"2024-01-21T19:59:06.395765+0000","last_peered":"2024-01-21T19:59:06.395765+0000","last_clean":"2024-01-21T19:59:06.395765+0000","last_became_active":"2024-01-21T19:59:06.033242+0000","last_became_peered":"2024-01-21T19:59:06.033242+0000","last_unstale":"2024-01-21T19:59:06.395765+0000","last_undegraded":"2024-01-21T19:59:06.395765+0000","last_fullsized":"2024-01-21T19:59:06.395765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419003+0000","last_change":"2024-01-21T19:59:06.415302+0000","last_active":"2024-01-21T19:59:06.419003+0000","last_peered":"2024-01-21T19:59:06.419003+0000","last_clean":"2024-01-21T19:59:06.419003+0000","last_became_active":"2024-01-21T19:59:06.414840+0000","last_became_peered":"2024-01-21T19:59:06.414840+0000","last_unstale":"2024-01-21T19:59:06.419003+0000","last_undegraded":"2024-01-21T19:59:06.419003+0000","last_fullsized":"2024-01-21T19:59:06.419003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396109+0000","last_change":"2024-01-21T19:59:06.032758+0000","last_active":"2024-01-21T19:59:06.396109+0000","last_peered":"2024-01-21T19:59:06.396109+0000","last_clean":"2024-01-21T19:59:06.396109+0000","last_became_active":"2024-01-21T19:59:06.032460+0000","last_became_peered":"2024-01-21T19:59:06.032460+0000","last_unstale":"2024-01-21T19:59:06.396109+0000","last_undegraded":"2024-01-21T19:59:06.396109+0000","last_fullsized":"2024-01-21T19:59:06.396109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418725+0000","last_change":"2024-01-21T19:59:06.414719+0000","last_active":"2024-01-21T19:59:06.418725+0000","last_peered":"2024-01-21T19:59:06.418725+0000","last_clean":"2024-01-21T19:59:06.418725+0000","last_became_active":"2024-01-21T19:59:06.414337+0000","last_became_peered":"2024-01-21T19:59:06.414337+0000","last_unstale":"2024-01-21T19:59:06.418725+0000","last_undegraded":"2024-01-21T19:59:06.418725+0000","last_fullsized":"2024-01-21T19:59:06.418725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399500+0000","last_change":"2024-01-21T19:59:06.035036+0000","last_active":"2024-01-21T19:59:06.399500+0000","last_peered":"2024-01-21T19:59:06.399500+0000","last_clean":"2024-01-21T19:59:06.399500+0000","last_became_active":"2024-01-21T19:59:06.034698+0000","last_became_peered":"2024-01-21T19:59:06.034698+0000","last_unstale":"2024-01-21T19:59:06.399500+0000","last_undegraded":"2024-01-21T19:59:06.399500+0000","last_fullsized":"2024-01-21T19:59:06.399500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401865+0000","last_change":"2024-01-21T19:59:06.397365+0000","last_active":"2024-01-21T19:59:06.401865+0000","last_peered":"2024-01-21T19:59:06.401865+0000","last_clean":"2024-01-21T19:59:06.401865+0000","last_became_active":"2024-01-21T19:59:06.397044+0000","last_became_peered":"2024-01-21T19:59:06.397044+0000","last_unstale":"2024-01-21T19:59:06.401865+0000","last_undegraded":"2024-01-21T19:59:06.401865+0000","last_fullsized":"2024-01-21T19:59:06.401865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394352+0000","last_change":"2024-01-21T19:59:06.033282+0000","last_active":"2024-01-21T19:59:06.394352+0000","last_peered":"2024-01-21T19:59:06.394352+0000","last_clean":"2024-01-21T19:59:06.394352+0000","last_became_active":"2024-01-21T19:59:06.033013+0000","last_became_peered":"2024-01-21T19:59:06.033013+0000","last_unstale":"2024-01-21T19:59:06.394352+0000","last_undegraded":"2024-01-21T19:59:06.394352+0000","last_fullsized":"2024-01-21T19:59:06.394352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413996+0000","last_change":"2024-01-21T19:59:06.412489+0000","last_active":"2024-01-21T19:59:06.413996+0000","last_peered":"2024-01-21T19:59:06.413996+0000","last_clean":"2024-01-21T19:59:06.413996+0000","last_became_active":"2024-01-21T19:59:06.412296+0000","last_became_peered":"2024-01-21T19:59:06.412296+0000","last_unstale":"2024-01-21T19:59:06.413996+0000","last_undegraded":"2024-01-21T19:59:06.413996+0000","last_fullsized":"2024-01-21T19:59:06.413996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405984+0000","last_change":"2024-01-21T19:59:06.040467+0000","last_active":"2024-01-21T19:59:06.405984+0000","last_peered":"2024-01-21T19:59:06.405984+0000","last_clean":"2024-01-21T19:59:06.405984+0000","last_became_active":"2024-01-21T19:59:06.040135+0000","last_became_peered":"2024-01-21T19:59:06.040135+0000","last_unstale":"2024-01-21T19:59:06.405984+0000","last_undegraded":"2024-01-21T19:59:06.405984+0000","last_fullsized":"2024-01-21T19:59:06.405984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418656+0000","last_change":"2024-01-21T19:59:06.414583+0000","last_active":"2024-01-21T19:59:06.418656+0000","last_peered":"2024-01-21T19:59:06.418656+0000","last_clean":"2024-01-21T19:59:06.418656+0000","last_became_active":"2024-01-21T19:59:06.414307+0000","last_became_peered":"2024-01-21T19:59:06.414307+0000","last_unstale":"2024-01-21T19:59:06.418656+0000","last_undegraded":"2024-01-21T19:59:06.418656+0000","last_fullsized":"2024-01-21T19:59:06.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400826+0000","last_change":"2024-01-21T19:59:06.037540+0000","last_active":"2024-01-21T19:59:06.400826+0000","last_peered":"2024-01-21T19:59:06.400826+0000","last_clean":"2024-01-21T19:59:06.400826+0000","last_became_active":"2024-01-21T19:59:06.037227+0000","last_became_peered":"2024-01-21T19:59:06.037227+0000","last_unstale":"2024-01-21T19:59:06.400826+0000","last_undegraded":"2024-01-21T19:59:06.400826+0000","last_fullsized":"2024-01-21T19:59:06.400826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410359+0000","last_change":"2024-01-21T19:59:06.407140+0000","last_active":"2024-01-21T19:59:06.410359+0000","last_peered":"2024-01-21T19:59:06.410359+0000","last_clean":"2024-01-21T19:59:06.410359+0000","last_became_active":"2024-01-21T19:59:06.406818+0000","last_became_peered":"2024-01-21T19:59:06.406818+0000","last_unstale":"2024-01-21T19:59:06.410359+0000","last_undegraded":"2024-01-21T19:59:06.410359+0000","last_fullsized":"2024-01-21T19:59:06.410359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412154+0000","last_change":"2024-01-21T19:59:06.038267+0000","last_active":"2024-01-21T19:59:06.412154+0000","last_peered":"2024-01-21T19:59:06.412154+0000","last_clean":"2024-01-21T19:59:06.412154+0000","last_became_active":"2024-01-21T19:59:06.037931+0000","last_became_peered":"2024-01-21T19:59:06.037931+0000","last_unstale":"2024-01-21T19:59:06.412154+0000","last_undegraded":"2024-01-21T19:59:06.412154+0000","last_fullsized":"2024-01-21T19:59:06.412154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402031+0000","last_change":"2024-01-21T19:59:06.397703+0000","last_active":"2024-01-21T19:59:06.402031+0000","last_peered":"2024-01-21T19:59:06.402031+0000","last_clean":"2024-01-21T19:59:06.402031+0000","last_became_active":"2024-01-21T19:59:06.397296+0000","last_became_peered":"2024-01-21T19:59:06.397296+0000","last_unstale":"2024-01-21T19:59:06.402031+0000","last_undegraded":"2024-01-21T19:59:06.402031+0000","last_fullsized":"2024-01-21T19:59:06.402031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402469+0000","last_change":"2024-01-21T19:59:06.036008+0000","last_active":"2024-01-21T19:59:06.402469+0000","last_peered":"2024-01-21T19:59:06.402469+0000","last_clean":"2024-01-21T19:59:06.402469+0000","last_became_active":"2024-01-21T19:59:06.035721+0000","last_became_peered":"2024-01-21T19:59:06.035721+0000","last_unstale":"2024-01-21T19:59:06.402469+0000","last_undegraded":"2024-01-21T19:59:06.402469+0000","last_fullsized":"2024-01-21T19:59:06.402469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419018+0000","last_change":"2024-01-21T19:59:06.415104+0000","last_active":"2024-01-21T19:59:06.419018+0000","last_peered":"2024-01-21T19:59:06.419018+0000","last_clean":"2024-01-21T19:59:06.419018+0000","last_became_active":"2024-01-21T19:59:06.414325+0000","last_became_peered":"2024-01-21T19:59:06.414325+0000","last_unstale":"2024-01-21T19:59:06.419018+0000","last_undegraded":"2024-01-21T19:59:06.419018+0000","last_fullsized":"2024-01-21T19:59:06.419018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392399+0000","last_change":"2024-01-21T19:59:06.036961+0000","last_active":"2024-01-21T19:59:06.392399+0000","last_peered":"2024-01-21T19:59:06.392399+0000","last_clean":"2024-01-21T19:59:06.392399+0000","last_became_active":"2024-01-21T19:59:06.036674+0000","last_became_peered":"2024-01-21T19:59:06.036674+0000","last_unstale":"2024-01-21T19:59:06.392399+0000","last_undegraded":"2024-01-21T19:59:06.392399+0000","last_fullsized":"2024-01-21T19:59:06.392399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416883+0000","last_change":"2024-01-21T19:59:06.415128+0000","last_active":"2024-01-21T19:59:06.416883+0000","last_peered":"2024-01-21T19:59:06.416883+0000","last_clean":"2024-01-21T19:59:06.416883+0000","last_became_active":"2024-01-21T19:59:06.411896+0000","last_became_peered":"2024-01-21T19:59:06.411896+0000","last_unstale":"2024-01-21T19:59:06.416883+0000","last_undegraded":"2024-01-21T19:59:06.416883+0000","last_fullsized":"2024-01-21T19:59:06.416883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405540+0000","last_change":"2024-01-21T19:59:06.040769+0000","last_active":"2024-01-21T19:59:06.405540+0000","last_peered":"2024-01-21T19:59:06.405540+0000","last_clean":"2024-01-21T19:59:06.405540+0000","last_became_active":"2024-01-21T19:59:06.040493+0000","last_became_peered":"2024-01-21T19:59:06.040493+0000","last_unstale":"2024-01-21T19:59:06.405540+0000","last_undegraded":"2024-01-21T19:59:06.405540+0000","last_fullsized":"2024-01-21T19:59:06.405540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415838+0000","last_change":"2024-01-21T19:59:06.413738+0000","last_active":"2024-01-21T19:59:06.415838+0000","last_peered":"2024-01-21T19:59:06.415838+0000","last_clean":"2024-01-21T19:59:06.415838+0000","last_became_active":"2024-01-21T19:59:06.413499+0000","last_became_peered":"2024-01-21T19:59:06.413499+0000","last_unstale":"2024-01-21T19:59:06.415838+0000","last_undegraded":"2024-01-21T19:59:06.415838+0000","last_fullsized":"2024-01-21T19:59:06.415838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417380+0000","last_change":"2024-01-21T19:59:06.039198+0000","last_active":"2024-01-21T19:59:06.417380+0000","last_peered":"2024-01-21T19:59:06.417380+0000","last_clean":"2024-01-21T19:59:06.417380+0000","last_became_active":"2024-01-21T19:59:06.038161+0000","last_became_peered":"2024-01-21T19:59:06.038161+0000","last_unstale":"2024-01-21T19:59:06.417380+0000","last_undegraded":"2024-01-21T19:59:06.417380+0000","last_fullsized":"2024-01-21T19:59:06.417380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":85794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":84380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7130000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.425}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:14.130 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T19:59:14.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-21T19:59:14.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-21T19:59:14.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-21T19:59:14.131 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-21T19:59:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.289+0000 7f994f6c4700 1 Processor -- start 2024-01-21T19:59:14.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.289+0000 7f994f6c4700 1 -- start start 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994f6c4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9948069ef0 0x7f9948155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994f6c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99480c3fb0 0x7f9948066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994f6c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9948065660 con 0x7f99480beb30 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994f6c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99480bef10 con 0x7f99480c3fb0 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994f6c4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9948156070 con 0x7f9948069ef0 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99480c3fb0 0x7f9948066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99480c3fb0 0x7f9948066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60120/0 (socket says 172.21.15.133:60120) 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 -- 172.21.15.133:0/1386940926 learned_addr learned my addr 172.21.15.133:0/1386940926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994d460700 1 --1- 172.21.15.133:0/1386940926 >> v1:172.21.15.133:6789/0 conn(0x7f99480beb30 0x7f99480697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55990/0 (socket says 172.21.15.133:55990) 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994cc5f700 1 --2- 172.21.15.133:0/1386940926 >> v2:172.21.15.178:3300/0 conn(0x7f9948069ef0 0x7f9948155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f993ffff700 1 -- 172.21.15.133:0/1386940926 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741730440 0 0) 0x7f9948065660 con 0x7f99480beb30 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f993ffff700 1 -- 172.21.15.133:0/1386940926 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99340033f0 con 0x7f99480beb30 2024-01-21T19:59:14.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 -- 172.21.15.133:0/1386940926 >> v2:172.21.15.178:3300/0 conn(0x7f9948069ef0 msgr2=0x7f9948155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 --2- 172.21.15.133:0/1386940926 >> v2:172.21.15.178:3300/0 conn(0x7f9948069ef0 0x7f9948155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 -- 172.21.15.133:0/1386940926 >> v1:172.21.15.133:6789/0 conn(0x7f99480beb30 legacy=0x7f99480697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 -- 172.21.15.133:0/1386940926 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948065f00 con 0x7f99480c3fb0 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.290+0000 7f994dc61700 1 --2- 172.21.15.133:0/1386940926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480c3fb0 0x7f9948066390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f994805ecd0 tx=0x7f9940009840).ready entity=mon.0 client_cookie=8bf012c44d02557 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f993ffff700 1 -- 172.21.15.133:0/1386940926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000e070 con 0x7f99480c3fb0 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f993ffff700 1 -- 172.21.15.133:0/1386940926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994000b990 con 0x7f99480c3fb0 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f993ffff700 1 -- 172.21.15.133:0/1386940926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000bd10 con 0x7f99480c3fb0 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 -- 172.21.15.133:0/1386940926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480c3fb0 msgr2=0x7f9948066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1386940926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480c3fb0 0x7f9948066390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f994805ecd0 tx=0x7f9940009840).stop 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 -- 172.21.15.133:0/1386940926 shutdown_connections 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1386940926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99480c3fb0 0x7f9948066390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1386940926 >> v2:172.21.15.178:3300/0 conn(0x7f9948069ef0 0x7f9948155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 -- 172.21.15.133:0/1386940926 >> 172.21.15.133:0/1386940926 conn(0x7f99480c8010 msgr2=0x7f99480c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 -- 172.21.15.133:0/1386940926 shutdown_connections 2024-01-21T19:59:14.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.291+0000 7f994f6c4700 1 -- 172.21.15.133:0/1386940926 wait complete. 2024-01-21T19:59:14.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.293+0000 7f994f6c4700 1 Processor -- start 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.293+0000 7f994f6c4700 1 -- start start 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99480beb30 0x7f99480c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 0x7f99480a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c13f0 con 0x7f9948069ef0 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9948139860 con 0x7f99480c3fb0 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99480c07e0 con 0x7f99480beb30 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60128/0 (socket says 172.21.15.133:60128) 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 -- 172.21.15.133:0/1550645987 learned_addr learned my addr 172.21.15.133:0/1550645987 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 -- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99480beb30 msgr2=0x7f99480c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994dc61700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 0x7f99480a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994cc5f700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99480beb30 0x7f99480c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99480beb30 0x7f99480c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 -- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 msgr2=0x7f99480a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 0x7f99480a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 -- 172.21.15.133:0/1550645987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940009ae0 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994dc61700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 0x7f99480a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994d460700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f994400e7a0 tx=0x7f9944007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944007320 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944007480 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99480c0ac0 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.294+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944005930 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.295+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99480c1080 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9944005ca0 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994805fdf0 con 0x7f9948069ef0 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f993dffb700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 0x7f992c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f994cc5f700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 0x7f992c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f994407c570 con 0x7f9948069ef0 2024-01-21T19:59:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.296+0000 7f994cc5f700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 0x7f992c061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9938006fd0 tx=0x7f9938008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.300+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f994404d840 con 0x7f9948069ef0 2024-01-21T19:59:14.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.509+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f99480c4740 con 0x7f9948069ef0 2024-01-21T19:59:14.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.512+0000 7f993dffb700 1 -- 172.21.15.133:0/1550645987 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+148955 (secure 0 0 0) 0x7f9944050e60 con 0x7f9948069ef0 2024-01-21T19:59:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.514+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 msgr2=0x7f992c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.514+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 0x7f992c061610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9938006fd0 tx=0x7f9938008040).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.514+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 msgr2=0x7f9948139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.514+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f994400e7a0 tx=0x7f9944007cd0).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.514+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 shutdown_connections 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f992c05f150 0x7f992c061610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99480c3fb0 0x7f99480a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9948069ef0 0x7f9948139370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 --2- 172.21.15.133:0/1550645987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99480beb30 0x7f99480c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 >> 172.21.15.133:0/1550645987 conn(0x7f99480c8010 msgr2=0x7f9948139b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 shutdown_connections 2024-01-21T19:59:14.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.515+0000 7f994f6c4700 1 -- 172.21.15.133:0/1550645987 wait complete. 2024-01-21T19:59:14.520 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":43404},{"type":"v1","addr":"172.21.15.133:6833","nonce":43404}]},"active_addr":"172.21.15.133:6833/43404","active_change":"2024-01-21T19:58:53.841602+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3194509186}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2594876400}]}]} 2024-01-21T19:59:14.523 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-21T19:59:14.523 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-21T19:59:14.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.649+0000 7fda1621b700 1 Processor -- start 2024-01-21T19:59:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.649+0000 7fda1621b700 1 -- start start 2024-01-21T19:59:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.649+0000 7fda1621b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100beb30 0x7fda10155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.649+0000 7fda1621b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda100c3fb0 0x7fda100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda1621b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda10069cd0 0x7fda10151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda1621b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda100bef10 con 0x7fda100c3fb0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda1621b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda10156070 con 0x7fda10069cd0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda1621b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda10065660 con 0x7fda100beb30 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda100c3fb0 0x7fda100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda100c3fb0 0x7fda100697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60138/0 (socket says 172.21.15.133:60138) 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 -- 172.21.15.133:0/972069347 learned_addr learned my addr 172.21.15.133:0/972069347 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda0f7fe700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100beb30 0x7fda10155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda0ffff700 1 --2- 172.21.15.133:0/972069347 >> v2:172.21.15.178:3300/0 conn(0x7fda10069cd0 0x7fda10151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 -- 172.21.15.133:0/972069347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100beb30 msgr2=0x7fda10155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100beb30 0x7fda10155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 -- 172.21.15.133:0/972069347 >> v2:172.21.15.178:3300/0 conn(0x7fda10069cd0 msgr2=0x7fda10151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 --2- 172.21.15.133:0/972069347 >> v2:172.21.15.178:3300/0 conn(0x7fda10069cd0 0x7fda10151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 -- 172.21.15.133:0/972069347 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10065f00 con 0x7fda100c3fb0 2024-01-21T19:59:14.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda07fff700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100c3fb0 0x7fda100697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fda100a76d0 tx=0x7fd9f80090f0).ready entity=mon.0 client_cookie=ae710bacc5a9657c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda0effd700 1 -- 172.21.15.133:0/972069347 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800f510 con 0x7fda100c3fb0 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda0effd700 1 -- 172.21.15.133:0/972069347 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f800f670 con 0x7fda100c3fb0 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.650+0000 7fda0effd700 1 -- 172.21.15.133:0/972069347 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f800fa10 con 0x7fda100c3fb0 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 -- 172.21.15.133:0/972069347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100c3fb0 msgr2=0x7fda100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100c3fb0 0x7fda100697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fda100a76d0 tx=0x7fd9f80090f0).stop 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 -- 172.21.15.133:0/972069347 shutdown_connections 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 --2- 172.21.15.133:0/972069347 >> v2:172.21.15.178:3300/0 conn(0x7fda10069cd0 0x7fda10151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100beb30 0x7fda10155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 --2- 172.21.15.133:0/972069347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100c3fb0 0x7fda100697e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 -- 172.21.15.133:0/972069347 >> 172.21.15.133:0/972069347 conn(0x7fda100c8010 msgr2=0x7fda100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 -- 172.21.15.133:0/972069347 shutdown_connections 2024-01-21T19:59:14.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.651+0000 7fda1621b700 1 -- 172.21.15.133:0/972069347 wait complete. 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.652+0000 7fda1621b700 1 Processor -- start 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.652+0000 7fda1621b700 1 -- start start 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10069cd0 0x7fda100a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100c3fb0 0x7fda10062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100630d0 con 0x7fda100beb30 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100a6df0 con 0x7fda10069cd0 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda1621b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda100a61e0 con 0x7fda100c3fb0 2024-01-21T19:59:14.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60148/0 (socket says 172.21.15.133:60148) 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 -- 172.21.15.133:0/3392588946 learned_addr learned my addr 172.21.15.133:0/3392588946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda0f7fe700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10069cd0 0x7fda100a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda0ffff700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100c3fb0 0x7fda10062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 -- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100c3fb0 msgr2=0x7fda10062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100c3fb0 0x7fda10062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 -- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10069cd0 msgr2=0x7fda100a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10069cd0 0x7fda100a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 -- 172.21.15.133:0/3392588946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009370 con 0x7fda100beb30 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.653+0000 7fda07fff700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fd9f8011000 tx=0x7fd9f8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.654+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8006d90 con 0x7fda100beb30 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.654+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f800fe50 con 0x7fda100beb30 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.654+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda100a64c0 con 0x7fda100beb30 2024-01-21T19:59:14.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.654+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8011e90 con 0x7fda100beb30 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.654+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda100a6a80 con 0x7fda100beb30 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.655+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda100bf090 con 0x7fda100beb30 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.655+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd9f801c650 con 0x7fda100beb30 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.655+0000 7fda0cff9700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 0x7fd9f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.655+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd9f807bc60 con 0x7fda100beb30 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.656+0000 7fda0f7fe700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 0x7fd9f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.656+0000 7fda0f7fe700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 0x7fd9f0061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fda00009b20 tx=0x7fda00008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.660+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9f804cf30 con 0x7fda100beb30 2024-01-21T19:59:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.824+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda1006ac20 con 0x7fda100beb30 2024-01-21T19:59:14.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.825+0000 7fda0cff9700 1 -- 172.21.15.133:0/3392588946 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fd9f802a020 con 0x7fda100beb30 2024-01-21T19:59:14.817 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:14.817 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:14.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 msgr2=0x7fd9f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 0x7fd9f0061610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fda00009b20 tx=0x7fda00008040).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 msgr2=0x7fda100626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fd9f8011000 tx=0x7fd9f8016000).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 shutdown_connections 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9f005f150 0x7fd9f0061610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda100c3fb0 0x7fda10062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10069cd0 0x7fda100a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 --2- 172.21.15.133:0/3392588946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda100beb30 0x7fda100626f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 >> 172.21.15.133:0/3392588946 conn(0x7fda100c8010 msgr2=0x7fda10138cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 shutdown_connections 2024-01-21T19:59:14.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.827+0000 7fda1621b700 1 -- 172.21.15.133:0/3392588946 wait complete. 2024-01-21T19:59:14.831 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-21T19:59:14.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:14.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.956+0000 7fc84c60b700 1 Processor -- start 2024-01-21T19:59:14.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.956+0000 7fc84c60b700 1 -- start start 2024-01-21T19:59:14.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84c60b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc844062c10 0x7fc844062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84c60b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 0x7fc844065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84c60b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8440634e0 con 0x7fc844069c40 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84c60b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84406a130 con 0x7fc844062c10 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84c60b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84406a410 con 0x7fc8440697e0 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc844062c10 0x7fc844062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84aba8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc844069c40 0x7fc8441583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56004/0 (socket says 172.21.15.133:56004) 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84aba8700 1 -- 172.21.15.133:0/1656596394 learned_addr learned my addr 172.21.15.133:0/1656596394 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc849ba6700 1 --2- 172.21.15.133:0/1656596394 >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 0x7fc844065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 -- 172.21.15.133:0/1656596394 >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 msgr2=0x7fc844065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 --2- 172.21.15.133:0/1656596394 >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 0x7fc844065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 -- 172.21.15.133:0/1656596394 >> v1:172.21.15.133:6789/0 conn(0x7fc844069c40 legacy=0x7fc8441583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc8493a5700 1 -- 172.21.15.133:0/1656596394 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579756380 0 0) 0x7fc8440634e0 con 0x7fc844069c40 2024-01-21T19:59:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 -- 172.21.15.133:0/1656596394 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84406a6f0 con 0x7fc844062c10 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc849ba6700 1 --2- 172.21.15.133:0/1656596394 >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 0x7fc844065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc84a3a7700 1 --2- 172.21.15.133:0/1656596394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844062c10 0x7fc844062ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc8440c9080 tx=0x7fc840009060).ready entity=mon.0 client_cookie=a500db9722a07517 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.957+0000 7fc8493a5700 1 -- 172.21.15.133:0/1656596394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400090d0 con 0x7fc844062c10 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc8493a5700 1 -- 172.21.15.133:0/1656596394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84000b580 con 0x7fc844062c10 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc8493a5700 1 -- 172.21.15.133:0/1656596394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84000b900 con 0x7fc844062c10 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 -- 172.21.15.133:0/1656596394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844062c10 msgr2=0x7fc844062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 --2- 172.21.15.133:0/1656596394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844062c10 0x7fc844062ff0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fc8440c9080 tx=0x7fc840009060).stop 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 -- 172.21.15.133:0/1656596394 shutdown_connections 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 --2- 172.21.15.133:0/1656596394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844062c10 0x7fc844062ff0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 --2- 172.21.15.133:0/1656596394 >> v2:172.21.15.178:3300/0 conn(0x7fc8440697e0 0x7fc844065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 -- 172.21.15.133:0/1656596394 >> 172.21.15.133:0/1656596394 conn(0x7fc8440c8010 msgr2=0x7fc8440c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 -- 172.21.15.133:0/1656596394 shutdown_connections 2024-01-21T19:59:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.958+0000 7fc84c60b700 1 -- 172.21.15.133:0/1656596394 wait complete. 2024-01-21T19:59:14.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.959+0000 7fc84c60b700 1 Processor -- start 2024-01-21T19:59:14.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.959+0000 7fc84c60b700 1 -- start start 2024-01-21T19:59:14.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc844062c10 0x7fc84412eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8440697e0 0x7fc8440ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ac2e0 con 0x7fc844069c40 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ac5c0 con 0x7fc8440697e0 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84c60b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8440ac8a0 con 0x7fc844062c10 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60156/0 (socket says 172.21.15.133:60156) 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 -- 172.21.15.133:0/3798220495 learned_addr learned my addr 172.21.15.133:0/3798220495 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84a3a7700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc844062c10 0x7fc84412eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc849ba6700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8440697e0 0x7fc8440ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 -- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc844062c10 msgr2=0x7fc84412eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc844062c10 0x7fc84412eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 -- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8440697e0 msgr2=0x7fc8440ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8440697e0 0x7fc8440ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:14.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.960+0000 7fc84aba8700 1 -- 172.21.15.133:0/3798220495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400092a0 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc84aba8700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc83c00c7e0 tx=0x7fc83c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c005d30 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c005e90 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8440acb80 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c007360 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.961+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8440abf90 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.962+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8440ad0a0 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.962+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc83c007750 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.962+0000 7fc83affd700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 0x7fc828061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.963+0000 7fc84a3a7700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 0x7fc828061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.963+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc83c07a080 con 0x7fc844069c40 2024-01-21T19:59:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.963+0000 7fc84a3a7700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 0x7fc828061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc840009fd0 tx=0x7fc840017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:14.957 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:59:14.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:14.967+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc8440ad0a0 con 0x7fc844069c40 2024-01-21T19:59:14.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.136+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8440ad0a0 con 0x7fc844069c40 2024-01-21T19:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.137+0000 7fc83affd700 1 -- 172.21.15.133:0/3798220495 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc8440ad0a0 con 0x7fc844069c40 2024-01-21T19:59:15.129 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:15.129 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 msgr2=0x7fc828061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 0x7fc828061610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc840009fd0 tx=0x7fc840017000).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 msgr2=0x7fc8440a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fc83c00c7e0 tx=0x7fc83c007f90).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 shutdown_connections 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc82805f150 0x7fc828061610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc844069c40 0x7fc8440a5e40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc844062c10 0x7fc84412eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 --2- 172.21.15.133:0/3798220495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8440697e0 0x7fc8440ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 >> 172.21.15.133:0/3798220495 conn(0x7fc8440c8010 msgr2=0x7fc84413cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 shutdown_connections 2024-01-21T19:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.139+0000 7fc84c60b700 1 -- 172.21.15.133:0/3798220495 wait complete. 2024-01-21T19:59:15.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-21T19:59:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.267+0000 7fe2fa767700 1 Processor -- start 2024-01-21T19:59:15.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.267+0000 7fe2fa767700 1 -- start start 2024-01-21T19:59:15.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2fa767700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2f4069cc0 0x7fe2f40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2fa767700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40c3890 con 0x7fe2f413a830 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2fa767700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40c3b70 con 0x7fe2f413ac10 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2fa767700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40c3e50 con 0x7fe2f4069cc0 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2f3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe2f413a830 0x7fe2f40bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56008/0 (socket says 172.21.15.133:56008) 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2f3fff700 1 -- 172.21.15.133:0/1488840520 learned_addr learned my addr 172.21.15.133:0/1488840520 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.268+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/1488840520 >> v2:172.21.15.178:3300/0 conn(0x7fe2f4069cc0 0x7fe2f40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145639192 0 0) 0x7fe2f40c3890 con 0x7fe2f413a830 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e00033f0 con 0x7fe2f413a830 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447731472 0 0) 0x7fe2e00033f0 con 0x7fe2f413a830 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 >> v2:172.21.15.178:3300/0 conn(0x7fe2f4069cc0 msgr2=0x7fe2f40c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 --2- 172.21.15.133:0/1488840520 >> v2:172.21.15.178:3300/0 conn(0x7fe2f4069cc0 0x7fe2f40c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 >> v1:172.21.15.178:6789/0 conn(0x7fe2f413ac10 legacy=0x7fe2f40695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40c4130 con 0x7fe2f413a830 2024-01-21T19:59:15.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe2dc001470 con 0x7fe2f413a830 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 >> v1:172.21.15.133:6789/0 conn(0x7fe2f413a830 legacy=0x7fe2f40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e00038e0 0x7fe2e0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e0005050 0x7fe2e000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40c3e50 con 0x7fe2e0004690 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e000bfe0 con 0x7fe2e00038e0 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e000c1a0 con 0x7fe2e0005050 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f3fff700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e00038e0 0x7fe2e0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e0005050 0x7fe2e000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 -- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e0005050 msgr2=0x7fe2e000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e0005050 0x7fe2e000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 -- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e00038e0 msgr2=0x7fe2e0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2e00038e0 0x7fe2e0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 -- 172.21.15.133:0/1488840520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00033f0 con 0x7fe2e0004690 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2e0005050 0x7fe2e000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f8d04700 1 -- 172.21.15.133:0/1488840520 reap_dead start 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.269+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2e0004b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe2f413b060 tx=0x7fe2e4007bb0).ready entity=mon.0 client_cookie=beb9045a4eb8627c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4007020 con 0x7fe2e0004690 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4007180 con 0x7fe2e0004690 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2f2ffd700 1 -- 172.21.15.133:0/1488840520 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4007520 con 0x7fe2e0004690 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 -- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 msgr2=0x7fe2e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2e0004b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe2f413b060 tx=0x7fe2e4007bb0).stop 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 -- 172.21.15.133:0/1488840520 shutdown_connections 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 --2- 172.21.15.133:0/1488840520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2e0004b10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 -- 172.21.15.133:0/1488840520 >> 172.21.15.133:0/1488840520 conn(0x7fe2f40c7dc0 msgr2=0x7fe2f40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 -- 172.21.15.133:0/1488840520 shutdown_connections 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.270+0000 7fe2fa767700 1 -- 172.21.15.133:0/1488840520 wait complete. 2024-01-21T19:59:15.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.271+0000 7fe2fa767700 1 Processor -- start 2024-01-21T19:59:15.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.271+0000 7fe2fa767700 1 -- start start 2024-01-21T19:59:15.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2f40ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f40a61f0 0x7fe2f4150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f40c81a0 0x7fe2f40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40a89c0 con 0x7fe2e0004690 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40a8b50 con 0x7fe2f40a61f0 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2fa767700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f40a6670 con 0x7fe2f40c81a0 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2f40ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2f40ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60182/0 (socket says 172.21.15.133:60182) 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f3fff700 1 -- 172.21.15.133:0/3698316886 learned_addr learned my addr 172.21.15.133:0/3698316886 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f40c81a0 0x7fe2f40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f3fff700 1 -- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f40c81a0 msgr2=0x7fe2f40c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f3fff700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f40c81a0 0x7fe2f40c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.272+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f40a61f0 0x7fe2f4150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f3fff700 1 -- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f40a61f0 msgr2=0x7fe2f4150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f3fff700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f40a61f0 0x7fe2f4150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f3fff700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40c8b10 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f3fff700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2f40ab850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe2dc007720 tx=0x7fe2dc001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc011590 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0116f0 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f40a68e0 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc011a70 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.273+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f40a6ea0 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.274+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2f405fdf0 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.274+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe2dc015410 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.274+0000 7fe2f0ff9700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe2d405f120 0x7fe2d40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.274+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe2dc07a2f0 con 0x7fe2e0004690 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe2d405f120 0x7fe2d40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f0ff9700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fe2d40684c0 0x7fe2d406a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2d406afa0 con 0x7fe2d40684c0 2024-01-21T19:59:15.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2dc07c910 con 0x7fe2e0004690 2024-01-21T19:59:15.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fe2d40684c0 0x7fe2d406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f37fe700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe2d405f120 0x7fe2d40615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe2f4065380 tx=0x7fe2e4013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.275+0000 7fe2f8d04700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fe2d40684c0 0x7fe2d406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.276+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== osd.0 v2:172.21.15.133:6824/43684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fe2d406afa0 con 0x7fe2d40684c0 2024-01-21T19:59:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 --> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2f40c4410 con 0x7fe2d40684c0 2024-01-21T19:59:15.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2f0ff9700 1 -- 172.21.15.133:0/3698316886 <== osd.0 v2:172.21.15.133:6824/43684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2f40c4410 con 0x7fe2d40684c0 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fe2d40684c0 msgr2=0x7fe2d406a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fe2d40684c0 0x7fe2d406a920 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe2d405f120 msgr2=0x7fe2d40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe2d405f120 0x7fe2d40615e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe2f4065380 tx=0x7fe2e4013000).stop 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 msgr2=0x7fe2f40ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 --2- 172.21.15.133:0/3698316886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2e0004690 0x7fe2f40ab850 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fe2dc007720 tx=0x7fe2dc001e50).stop 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2f8d04700 1 -- 172.21.15.133:0/3698316886 reap_dead start 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 shutdown_connections 2024-01-21T19:59:15.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 >> 172.21.15.133:0/3698316886 conn(0x7fe2f40c7dc0 msgr2=0x7fe2f40655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.290+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 shutdown_connections 2024-01-21T19:59:15.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.291+0000 7fe2fa767700 1 -- 172.21.15.133:0/3698316886 wait complete. 2024-01-21T19:59:15.293 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:15.293 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-21T19:59:15.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.418+0000 7faa942cd700 1 Processor -- start 2024-01-21T19:59:15.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.418+0000 7faa942cd700 1 -- start start 2024-01-21T19:59:15.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa942cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa942cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa8c066460 0x7faa8c0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa942cd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c065fd0 con 0x7faa8c1521e0 2024-01-21T19:59:15.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa942cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c152d00 con 0x7faa8c066460 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa942cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0653c0 con 0x7faa8c0acbc0 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa91868700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa8c066460 0x7faa8c0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa91868700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa8c066460 0x7faa8c0634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60186/0 (socket says 172.21.15.133:60186) 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa9286a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faa8c1521e0 0x7faa8c1525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56012/0 (socket says 172.21.15.133:56012) 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.419+0000 7faa91868700 1 -- 172.21.15.133:0/542024966 learned_addr learned my addr 172.21.15.133:0/542024966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa92069700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91868700 1 -- 172.21.15.133:0/542024966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 msgr2=0x7faa8c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91868700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91868700 1 -- 172.21.15.133:0/542024966 >> v1:172.21.15.133:6789/0 conn(0x7faa8c1521e0 legacy=0x7faa8c1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91067700 1 -- 172.21.15.133:0/542024966 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879948369 0 0) 0x7faa8c065fd0 con 0x7faa8c1521e0 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91868700 1 -- 172.21.15.133:0/542024966 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0656a0 con 0x7faa8c066460 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91868700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c066460 0x7faa8c0634d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7faa88006fd0 tx=0x7faa880090f0).ready entity=mon.0 client_cookie=b9ea09c880ad04f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91067700 1 -- 172.21.15.133:0/542024966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800b600 con 0x7faa8c066460 2024-01-21T19:59:15.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91067700 1 -- 172.21.15.133:0/542024966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8800b760 con 0x7faa8c066460 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa91067700 1 -- 172.21.15.133:0/542024966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800bb00 con 0x7faa8c066460 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa942cd700 1 -- 172.21.15.133:0/542024966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c066460 msgr2=0x7faa8c0634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.420+0000 7faa942cd700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c066460 0x7faa8c0634d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7faa88006fd0 tx=0x7faa880090f0).stop 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 -- 172.21.15.133:0/542024966 shutdown_connections 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 --2- 172.21.15.133:0/542024966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c066460 0x7faa8c0634d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 -- 172.21.15.133:0/542024966 >> 172.21.15.133:0/542024966 conn(0x7faa8c0c8200 msgr2=0x7faa8c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 -- 172.21.15.133:0/542024966 shutdown_connections 2024-01-21T19:59:15.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.421+0000 7faa942cd700 1 -- 172.21.15.133:0/542024966 wait complete. 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.422+0000 7faa942cd700 1 Processor -- start 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.422+0000 7faa942cd700 1 -- start start 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.422+0000 7faa942cd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c066460 0x7faa8c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.422+0000 7faa942cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 0x7faa8c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c166ad0 con 0x7faa8c1521e0 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c14fa70 con 0x7faa8c066460 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c165be0 con 0x7faa8c0acbc0 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 0x7faa8c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 0x7faa8c0c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60202/0 (socket says 172.21.15.133:60202) 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 -- 172.21.15.133:0/1131387664 learned_addr learned my addr 172.21.15.133:0/1131387664 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa92069700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c066460 0x7faa8c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa91868700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 -- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 msgr2=0x7faa8c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa8c0acbc0 0x7faa8c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 -- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c066460 msgr2=0x7faa8c14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c066460 0x7faa8c14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88009370 con 0x7faa8c1521e0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa92069700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa8c066460 0x7faa8c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa9286a700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 0x7faa8c0c0290 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7faa8400c760 tx=0x7faa84001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84005c70 con 0x7faa8c1521e0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84005dd0 con 0x7faa8c1521e0 2024-01-21T19:59:15.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c165ec0 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84007360 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.423+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c166480 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.424+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa8c05fdf0 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.424+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faa84007750 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa82f78700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa7005f150 0x7faa70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa8407a1a0 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa92069700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa7005f150 0x7faa70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa82f78700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7faa70068470 0x7faa7006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa7006af50 con 0x7faa70068470 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa8407c7c0 con 0x7faa8c1521e0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa91868700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7faa70068470 0x7faa7006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa92069700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa7005f150 0x7faa70061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faa8c0bfe30 tx=0x7faa7c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.425+0000 7faa91868700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7faa70068470 0x7faa7006a8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.426+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== osd.1 v2:172.21.15.133:6816/43675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7faa7006af50 con 0x7faa70068470 2024-01-21T19:59:15.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.440+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 --> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa8c065980 con 0x7faa70068470 2024-01-21T19:59:15.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.440+0000 7faa82f78700 1 -- 172.21.15.133:0/1131387664 <== osd.1 v2:172.21.15.133:6816/43675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa8c065980 con 0x7faa70068470 2024-01-21T19:59:15.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.440+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7faa70068470 msgr2=0x7faa7006a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.440+0000 7faa942cd700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7faa70068470 0x7faa7006a8d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa7005f150 msgr2=0x7faa70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa7005f150 0x7faa70061610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7faa8c0bfe30 tx=0x7faa7c008040).stop 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 msgr2=0x7faa8c0c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 --2- 172.21.15.133:0/1131387664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa8c1521e0 0x7faa8c0c0290 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7faa8400c760 tx=0x7faa84001520).stop 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa9286a700 1 -- 172.21.15.133:0/1131387664 reap_dead start 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 shutdown_connections 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 >> 172.21.15.133:0/1131387664 conn(0x7faa8c0c8200 msgr2=0x7faa8c0c38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 shutdown_connections 2024-01-21T19:59:15.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.441+0000 7faa942cd700 1 -- 172.21.15.133:0/1131387664 wait complete. 2024-01-21T19:59:15.443 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-01-21T19:59:15.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-21T19:59:15.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.568+0000 7fe18b5a8700 1 Processor -- start 2024-01-21T19:59:15.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.568+0000 7fe18b5a8700 1 -- start start 2024-01-21T19:59:15.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe18b5a8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe18413a830 0x7fe1840c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe18b5a8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18413ac10 0x7fe1840bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe18b5a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1840c3890 con 0x7fe1840695b0 2024-01-21T19:59:15.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe18b5a8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840c3b70 con 0x7fe18413a830 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe18b5a8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c3e50 con 0x7fe18413ac10 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe189b45700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe1840695b0 0x7fe184154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56018/0 (socket says 172.21.15.133:56018) 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.569+0000 7fe189b45700 1 -- 172.21.15.133:0/3223840698 learned_addr learned my addr 172.21.15.133:0/3223840698 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 --2- 172.21.15.133:0/3223840698 >> v2:172.21.15.178:3300/0 conn(0x7fe18413a830 0x7fe1840c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe188b43700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18413ac10 0x7fe1840bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324977584 0 0) 0x7fe1840c3890 con 0x7fe1840695b0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1700033f0 con 0x7fe1840695b0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 -- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18413ac10 msgr2=0x7fe1840bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18413ac10 0x7fe1840bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 -- 172.21.15.133:0/3223840698 >> v1:172.21.15.133:6789/0 conn(0x7fe1840695b0 legacy=0x7fe184154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1841801333 0 0) 0x7fe1700033f0 con 0x7fe1840695b0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 -- 172.21.15.133:0/3223840698 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840c4130 con 0x7fe18413a830 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe189344700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe1840c3220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe174009760 tx=0x7fe174009060).ready entity=mon.1 client_cookie=10079c6c073ecd50 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0017f0 con 0x7fe18413a830 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740090d0 con 0x7fe18413a830 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.570+0000 7fe17bfff700 1 -- 172.21.15.133:0/3223840698 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400f6b0 con 0x7fe18413a830 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 -- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 msgr2=0x7fe1840c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe1840c3220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe174009760 tx=0x7fe174009060).stop 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 -- 172.21.15.133:0/3223840698 shutdown_connections 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe1840c3220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/3223840698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18413ac10 0x7fe1840bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 -- 172.21.15.133:0/3223840698 >> 172.21.15.133:0/3223840698 conn(0x7fe1840c7dc0 msgr2=0x7fe1840c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 -- 172.21.15.133:0/3223840698 shutdown_connections 2024-01-21T19:59:15.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.571+0000 7fe18b5a8700 1 -- 172.21.15.133:0/3223840698 wait complete. 2024-01-21T19:59:15.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.572+0000 7fe18b5a8700 1 Processor -- start 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.572+0000 7fe18b5a8700 1 -- start start 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1840695b0 0x7fe184136c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe184160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 0x7fe1840c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840a8f40 con 0x7fe18413ac10 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe184160f50 con 0x7fe18413a830 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe184066a60 con 0x7fe1840695b0 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 0x7fe1840c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 0x7fe1840c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60218/0 (socket says 172.21.15.133:60218) 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 -- 172.21.15.133:0/13083046 learned_addr learned my addr 172.21.15.133:0/13083046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189344700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1840695b0 0x7fe184136c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe188b43700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe184160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 -- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1840695b0 msgr2=0x7fe184136c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1840695b0 0x7fe184136c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 -- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 msgr2=0x7fe184160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18413a830 0x7fe184160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740092a0 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe189b45700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 0x7fe1840c5b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe17c00c930 tx=0x7fe17c001cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c004c40 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c004dc0 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1840a8330 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.573+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0073c0 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.574+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1840a88f0 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.574+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe18405fdf0 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.575+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe17c007730 con 0x7fe18413ac10 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe179ffb700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16805f150 0x7fe168061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe17c07a740 con 0x7fe18413ac10 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe189344700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16805f150 0x7fe168061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe179ffb700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7fe1680684f0 0x7fe16806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe16806afd0 con 0x7fe1680684f0 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe17c07aaf0 con 0x7fe18413ac10 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe188b43700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7fe1680684f0 0x7fe16806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe189344700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16805f150 0x7fe168061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe1840c2080 tx=0x7fe174018000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.576+0000 7fe188b43700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7fe1680684f0 0x7fe16806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.577+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== osd.2 v2:172.21.15.133:6800/43673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fe16806afd0 con 0x7fe1680684f0 2024-01-21T19:59:15.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.591+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 --> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1840a9080 con 0x7fe1680684f0 2024-01-21T19:59:15.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.591+0000 7fe179ffb700 1 -- 172.21.15.133:0/13083046 <== osd.2 v2:172.21.15.133:6800/43673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1840a9080 con 0x7fe1680684f0 2024-01-21T19:59:15.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.591+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7fe1680684f0 msgr2=0x7fe16806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.591+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7fe1680684f0 0x7fe16806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16805f150 msgr2=0x7fe168061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16805f150 0x7fe168061610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe1840c2080 tx=0x7fe174018000).stop 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 msgr2=0x7fe1840c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 --2- 172.21.15.133:0/13083046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe18413ac10 0x7fe1840c5b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fe17c00c930 tx=0x7fe17c001cf0).stop 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe189b45700 1 -- 172.21.15.133:0/13083046 reap_dead start 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 shutdown_connections 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 >> 172.21.15.133:0/13083046 conn(0x7fe1840c7dc0 msgr2=0x7fe184137b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 shutdown_connections 2024-01-21T19:59:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.592+0000 7fe18b5a8700 1 -- 172.21.15.133:0/13083046 wait complete. 2024-01-21T19:59:15.594 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:15.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-21T19:59:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.719+0000 7f2874752700 1 Processor -- start 2024-01-21T19:59:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.719+0000 7f2874752700 1 -- start start 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2874752700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f286c062c10 0x7f286c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2874752700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c0634e0 con 0x7f286c065d70 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2874752700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286c06a130 con 0x7f286c0697e0 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2874752700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286c06a410 con 0x7f286c062c10 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2872cef700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f286c065d70 0x7f286c0bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56034/0 (socket says 172.21.15.133:56034) 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f2872cef700 1 -- 172.21.15.133:0/2542573807 learned_addr learned my addr 172.21.15.133:0/2542573807 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.720+0000 7f28724ee700 1 --2- 172.21.15.133:0/2542573807 >> v2:172.21.15.178:3300/0 conn(0x7f286c062c10 0x7f286c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838351718 0 0) 0x7f286c0634e0 con 0x7f286c065d70 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28580033f0 con 0x7f286c065d70 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316060279 0 0) 0x7f286c06a130 con 0x7f286c0697e0 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f286c0634e0 con 0x7f286c0697e0 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28724ee700 1 -- 172.21.15.133:0/2542573807 >> v1:172.21.15.178:6789/0 conn(0x7f286c0697e0 legacy=0x7f286c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28724ee700 1 -- 172.21.15.133:0/2542573807 >> v1:172.21.15.133:6789/0 conn(0x7f286c065d70 legacy=0x7f286c0bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28724ee700 1 -- 172.21.15.133:0/2542573807 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c06a6f0 con 0x7f286c062c10 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28724ee700 1 --2- 172.21.15.133:0/2542573807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c062c10 0x7f286c062ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f285c009760 tx=0x7f285c009060).ready entity=mon.1 client_cookie=a09473cc622d8edf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c009120 con 0x7f286c062c10 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c00d4a0 con 0x7f286c062c10 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.721+0000 7f28714ec700 1 -- 172.21.15.133:0/2542573807 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00d820 con 0x7f286c062c10 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 -- 172.21.15.133:0/2542573807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c062c10 msgr2=0x7f286c062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 --2- 172.21.15.133:0/2542573807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c062c10 0x7f286c062ff0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f285c009760 tx=0x7f285c009060).stop 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 -- 172.21.15.133:0/2542573807 shutdown_connections 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 --2- 172.21.15.133:0/2542573807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c062c10 0x7f286c062ff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 -- 172.21.15.133:0/2542573807 >> 172.21.15.133:0/2542573807 conn(0x7f286c0c8010 msgr2=0x7f286c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 -- 172.21.15.133:0/2542573807 shutdown_connections 2024-01-21T19:59:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.722+0000 7f2874752700 1 -- 172.21.15.133:0/2542573807 wait complete. 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.723+0000 7f2874752700 1 Processor -- start 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.723+0000 7f2874752700 1 -- start start 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 0x7f286c0ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f286c065d70 0x7f286c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c0697e0 0x7f286c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0ada00 con 0x7f286c062c10 2024-01-21T19:59:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0aab70 con 0x7f286c0697e0 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f2874752700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286c0a83e0 con 0x7f286c065d70 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f28724ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 0x7f286c0ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f28724ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 0x7f286c0ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60228/0 (socket says 172.21.15.133:60228) 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.724+0000 7f28724ee700 1 -- 172.21.15.133:0/663158835 learned_addr learned my addr 172.21.15.133:0/663158835 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2871ced700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f286c065d70 0x7f286c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2872cef700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c0697e0 0x7f286c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 -- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f286c065d70 msgr2=0x7f286c0aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f286c065d70 0x7f286c0aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 -- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c0697e0 msgr2=0x7f286c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c0697e0 0x7f286c153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0092a0 con 0x7f286c062c10 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2871ced700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f286c065d70 0x7f286c0aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2872cef700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286c0697e0 0x7f286c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:15.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f28724ee700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 0x7f286c0ad510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f285c006d60 tx=0x7f285c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c012920 con 0x7f286c062c10 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c012a80 con 0x7f286c062c10 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c012e00 con 0x7f286c062c10 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c0adc30 con 0x7f286c062c10 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.725+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c0a7d90 con 0x7f286c062c10 2024-01-21T19:59:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.726+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f286c05fdf0 con 0x7f286c062c10 2024-01-21T19:59:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.726+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f285c01c630 con 0x7f286c062c10 2024-01-21T19:59:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2862ffd700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f285005f180 0x7f2850061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f285c07b5b0 con 0x7f286c062c10 2024-01-21T19:59:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2871ced700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f285005f180 0x7f2850061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2862ffd700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f2850068520 0x7f285006a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f285006b000 con 0x7f2850068520 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f285c07dc00 con 0x7f286c062c10 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2872cef700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f2850068520 0x7f285006a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2871ced700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f285005f180 0x7f2850061640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2868007fd0 tx=0x7f2868009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.727+0000 7f2872cef700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f2850068520 0x7f285006a980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.728+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== osd.3 v2:172.21.15.133:6808/43674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f285006b000 con 0x7f2850068520 2024-01-21T19:59:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 --> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f286c0a8520 con 0x7f2850068520 2024-01-21T19:59:15.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2862ffd700 1 -- 172.21.15.133:0/663158835 <== osd.3 v2:172.21.15.133:6808/43674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2864001f70 con 0x7f2850068520 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f2850068520 msgr2=0x7f285006a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f2850068520 0x7f285006a980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f285005f180 msgr2=0x7f2850061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f285005f180 0x7f2850061640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f2868007fd0 tx=0x7f2868009040).stop 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 msgr2=0x7f286c0ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.742+0000 7f2874752700 1 --2- 172.21.15.133:0/663158835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f286c062c10 0x7f286c0ad510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f285c006d60 tx=0x7f285c016000).stop 2024-01-21T19:59:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.743+0000 7f2872cef700 1 -- 172.21.15.133:0/663158835 reap_dead start 2024-01-21T19:59:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.743+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 shutdown_connections 2024-01-21T19:59:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.743+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 >> 172.21.15.133:0/663158835 conn(0x7f286c0c8010 msgr2=0x7f286c065660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.743+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 shutdown_connections 2024-01-21T19:59:15.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.743+0000 7f2874752700 1 -- 172.21.15.133:0/663158835 wait complete. 2024-01-21T19:59:15.745 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:15.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-21T19:59:15.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.870+0000 7f699ef5b700 1 Processor -- start 2024-01-21T19:59:15.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.870+0000 7f699ef5b700 1 -- start start 2024-01-21T19:59:15.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ef5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6998062c10 0x7f6998062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ef5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69980697e0 0x7f6998065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ef5b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980634e0 con 0x7f6998069c40 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ef5b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699806a130 con 0x7f6998062c10 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ef5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699806a410 con 0x7f69980697e0 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6998062c10 0x7f6998062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6998062c10 0x7f6998062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60234/0 (socket says 172.21.15.133:60234) 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 -- 172.21.15.133:0/1612974298 learned_addr learned my addr 172.21.15.133:0/1612974298 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699d4f8700 1 --1- 172.21.15.133:0/1612974298 >> v1:172.21.15.133:6789/0 conn(0x7f6998069c40 0x7f69981583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56042/0 (socket says 172.21.15.133:56042) 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f6997fff700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69980697e0 0x7f6998065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 -- 172.21.15.133:0/1612974298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69980697e0 msgr2=0x7f6998065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69980697e0 0x7f6998065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 -- 172.21.15.133:0/1612974298 >> v1:172.21.15.133:6789/0 conn(0x7f6998069c40 legacy=0x7f69981583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 -- 172.21.15.133:0/1612974298 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699806a6f0 con 0x7f6998062c10 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f69977fe700 1 -- 172.21.15.133:0/1612974298 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717668841 0 0) 0x7f69980634e0 con 0x7f6998069c40 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.871+0000 7f699ccf7700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998062c10 0x7f6998062ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f698c006fd0 tx=0x7f698c0090f0).ready entity=mon.0 client_cookie=ac19258f1d7fc60e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f69977fe700 1 -- 172.21.15.133:0/1612974298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c00b580 con 0x7f6998062c10 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f69977fe700 1 -- 172.21.15.133:0/1612974298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c00b6e0 con 0x7f6998062c10 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f69977fe700 1 -- 172.21.15.133:0/1612974298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c00ba80 con 0x7f6998062c10 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 -- 172.21.15.133:0/1612974298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998062c10 msgr2=0x7f6998062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998062c10 0x7f6998062ff0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f698c006fd0 tx=0x7f698c0090f0).stop 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 -- 172.21.15.133:0/1612974298 shutdown_connections 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998062c10 0x7f6998062ff0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 --2- 172.21.15.133:0/1612974298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69980697e0 0x7f6998065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 -- 172.21.15.133:0/1612974298 >> 172.21.15.133:0/1612974298 conn(0x7f69980c8010 msgr2=0x7f69980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 -- 172.21.15.133:0/1612974298 shutdown_connections 2024-01-21T19:59:15.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.872+0000 7f699ef5b700 1 -- 172.21.15.133:0/1612974298 wait complete. 2024-01-21T19:59:15.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.873+0000 7f699ef5b700 1 Processor -- start 2024-01-21T19:59:15.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.873+0000 7f699ef5b700 1 -- start start 2024-01-21T19:59:15.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6998062c10 0x7f6998153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69980697e0 0x7f6998167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 0x7f6998168260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6998159cc0 con 0x7f6998069c40 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69981590b0 con 0x7f69980697e0 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699ef5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6998159390 con 0x7f6998062c10 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699d4f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 0x7f6998168260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699d4f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 0x7f6998168260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60236/0 (socket says 172.21.15.133:60236) 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.874+0000 7f699d4f8700 1 -- 172.21.15.133:0/3337453800 learned_addr learned my addr 172.21.15.133:0/3337453800 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699ccf7700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6998062c10 0x7f6998153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f6997fff700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69980697e0 0x7f6998167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 -- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6998062c10 msgr2=0x7f6998153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6998062c10 0x7f6998153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 -- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69980697e0 msgr2=0x7f6998167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69980697e0 0x7f6998167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c009370 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699d4f8700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 0x7f6998168260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f699000c810 tx=0x7f6990007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990005c70 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6990005df0 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6998159670 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990007360 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.875+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69980ad460 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.876+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69980ad6e0 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.876+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6990007750 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f69957fa700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f697c05f150 0x7f697c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f699007aae0 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f699ccf7700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f697c05f150 0x7f697c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f69957fa700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f697c0684f0 0x7f697c06a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f697c06afd0 con 0x7f697c0684f0 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f699007ae90 con 0x7f6998069c40 2024-01-21T19:59:15.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f6997fff700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f697c0684f0 0x7f697c06a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:15.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f699ccf7700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f697c05f150 0x7f697c061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f698c00b340 tx=0x7f698c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.877+0000 7f6997fff700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f697c0684f0 0x7f697c06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:15.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.878+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== osd.4 v2:172.21.15.178:6800/43897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f697c06afd0 con 0x7f697c0684f0 2024-01-21T19:59:15.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.892+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 --> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f699805fdf0 con 0x7f697c0684f0 2024-01-21T19:59:15.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f69957fa700 1 -- 172.21.15.133:0/3337453800 <== osd.4 v2:172.21.15.178:6800/43897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f699805fdf0 con 0x7f697c0684f0 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f697c0684f0 msgr2=0x7f697c06a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f697c0684f0 0x7f697c06a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f697c05f150 msgr2=0x7f697c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f697c05f150 0x7f697c061610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f698c00b340 tx=0x7f698c017000).stop 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 msgr2=0x7f6998168260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 --2- 172.21.15.133:0/3337453800 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6998069c40 0x7f6998168260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f699000c810 tx=0x7f6990007f10).stop 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699d4f8700 1 -- 172.21.15.133:0/3337453800 reap_dead start 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 shutdown_connections 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 >> 172.21.15.133:0/3337453800 conn(0x7f69980c8010 msgr2=0x7f69980a5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 shutdown_connections 2024-01-21T19:59:15.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:15.893+0000 7f699ef5b700 1 -- 172.21.15.133:0/3337453800 wait complete. 2024-01-21T19:59:15.896 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:15.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-21T19:59:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.021+0000 7ff837e57700 1 Processor -- start 2024-01-21T19:59:16.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.022+0000 7ff837e57700 1 -- start start 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.022+0000 7ff837e57700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff830154140 0x7ff830158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.022+0000 7ff837e57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300c0e40 con 0x7ff8300c8120 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff837e57700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8301549b0 con 0x7ff830154520 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff837e57700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8300c6ae0 con 0x7ff830154140 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff830154140 0x7ff830158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff8363f4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8300c8120 0x7ff8300c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56050/0 (socket says 172.21.15.133:56050) 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff830154140 0x7ff830158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60250/0 (socket says 172.21.15.133:60250) 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff8363f4700 1 -- 172.21.15.133:0/3805723041 learned_addr learned my addr 172.21.15.133:0/3805723041 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 -- 172.21.15.133:0/3805723041 >> v1:172.21.15.178:6789/0 conn(0x7ff830154520 legacy=0x7ff8300c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 -- 172.21.15.133:0/3805723041 >> v1:172.21.15.133:6789/0 conn(0x7ff8300c8120 legacy=0x7ff8300c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff834bf1700 1 -- 172.21.15.133:0/3805723041 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145213293 0 0) 0x7ff8300c0e40 con 0x7ff8300c8120 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 -- 172.21.15.133:0/3805723041 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300c6800 con 0x7ff830154140 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff835bf3700 1 --2- 172.21.15.133:0/3805723041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff830154140 0x7ff830158bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff820009790 tx=0x7ff820009060).ready entity=mon.0 client_cookie=5e20c287f9053a76 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff834bf1700 1 -- 172.21.15.133:0/3805723041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b580 con 0x7ff830154140 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff834bf1700 1 -- 172.21.15.133:0/3805723041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b6e0 con 0x7ff830154140 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.023+0000 7ff834bf1700 1 -- 172.21.15.133:0/3805723041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000ba60 con 0x7ff830154140 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 -- 172.21.15.133:0/3805723041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff830154140 msgr2=0x7ff830158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 --2- 172.21.15.133:0/3805723041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff830154140 0x7ff830158bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff820009790 tx=0x7ff820009060).stop 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 -- 172.21.15.133:0/3805723041 shutdown_connections 2024-01-21T19:59:16.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 --2- 172.21.15.133:0/3805723041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff830154140 0x7ff830158bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 -- 172.21.15.133:0/3805723041 >> 172.21.15.133:0/3805723041 conn(0x7ff83005e1e0 msgr2=0x7ff83005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 -- 172.21.15.133:0/3805723041 shutdown_connections 2024-01-21T19:59:16.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.024+0000 7ff837e57700 1 -- 172.21.15.133:0/3805723041 wait complete. 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.025+0000 7ff837e57700 1 Processor -- start 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.025+0000 7ff837e57700 1 -- start start 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 0x7ff83014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff830154140 0x7ff8300cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff830154520 0x7ff8300cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8300cba00 con 0x7ff8300c8120 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff830168ba0 con 0x7ff830154520 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff830167f90 con 0x7ff830154140 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 0x7ff83014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 0x7ff83014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60266/0 (socket says 172.21.15.133:60266) 2024-01-21T19:59:16.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 -- 172.21.15.133:0/1530739643 learned_addr learned my addr 172.21.15.133:0/1530739643 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8363f4700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff830154520 0x7ff8300cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8353f2700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff830154140 0x7ff8300cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 -- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff830154140 msgr2=0x7ff8300cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff830154140 0x7ff8300cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 -- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff830154520 msgr2=0x7ff8300cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff830154520 0x7ff8300cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200092a0 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8353f2700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff830154140 0x7ff8300cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff835bf3700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 0x7ff83014cd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff83006afd0 tx=0x7ff820017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000b850 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000b9b0 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82001b660 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.026+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff830168270 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.027+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff830168830 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.027+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff83005fdf0 con 0x7ff8300c8120 2024-01-21T19:59:16.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff82001ba90 con 0x7ff8300c8120 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff81405f150 0x7ff814061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff82007c100 con 0x7ff8300c8120 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8353f2700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff81405f150 0x7ff814061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7ff8140684f0 0x7ff81406a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff81406afd0 con 0x7ff8140684f0 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.028+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff82007e750 con 0x7ff8300c8120 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.029+0000 7ff8353f2700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff81405f150 0x7ff814061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff83014f580 tx=0x7ff82c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.029+0000 7ff8363f4700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7ff8140684f0 0x7ff81406a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.029+0000 7ff8363f4700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7ff8140684f0 0x7ff81406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.030+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== osd.5 v2:172.21.15.178:6816/43898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7ff81406afd0 con 0x7ff8140684f0 2024-01-21T19:59:16.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.044+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 --> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff830168e80 con 0x7ff8140684f0 2024-01-21T19:59:16.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.045+0000 7ff8267fc700 1 -- 172.21.15.133:0/1530739643 <== osd.5 v2:172.21.15.178:6816/43898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff830168e80 con 0x7ff8140684f0 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.045+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7ff8140684f0 msgr2=0x7ff81406a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.045+0000 7ff837e57700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7ff8140684f0 0x7ff81406a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff81405f150 msgr2=0x7ff814061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff81405f150 0x7ff814061610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff83014f580 tx=0x7ff82c009040).stop 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 msgr2=0x7ff83014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 --2- 172.21.15.133:0/1530739643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8300c8120 0x7ff83014cd80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff83006afd0 tx=0x7ff820017000).stop 2024-01-21T19:59:16.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff8363f4700 1 -- 172.21.15.133:0/1530739643 reap_dead start 2024-01-21T19:59:16.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 shutdown_connections 2024-01-21T19:59:16.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 >> 172.21.15.133:0/1530739643 conn(0x7ff83005e1e0 msgr2=0x7ff8300c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 shutdown_connections 2024-01-21T19:59:16.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.046+0000 7ff837e57700 1 -- 172.21.15.133:0/1530739643 wait complete. 2024-01-21T19:59:16.048 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:16.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-21T19:59:16.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.174+0000 7f705cff4700 1 Processor -- start 2024-01-21T19:59:16.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.174+0000 7f705cff4700 1 -- start start 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7058062c10 0x7f7058062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f7058065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7058069c40 0x7f7058065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7058066040 con 0x7f7058062c10 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70580634e0 con 0x7f7058069c40 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705cff4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705806a130 con 0x7f70580697e0 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7058062c10 0x7f7058062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7058062c10 0x7f7058062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60268/0 (socket says 172.21.15.133:60268) 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.175+0000 7f705659c700 1 -- 172.21.15.133:0/4066748273 learned_addr learned my addr 172.21.15.133:0/4066748273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f7055d9b700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f7058065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f7056d9d700 1 --2- 172.21.15.133:0/4066748273 >> v2:172.21.15.178:3300/0 conn(0x7f7058069c40 0x7f7058065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 -- 172.21.15.133:0/4066748273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 msgr2=0x7f7058065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f7058065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 -- 172.21.15.133:0/4066748273 >> v2:172.21.15.178:3300/0 conn(0x7f7058069c40 msgr2=0x7f7058065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 --2- 172.21.15.133:0/4066748273 >> v2:172.21.15.178:3300/0 conn(0x7f7058069c40 0x7f7058065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 -- 172.21.15.133:0/4066748273 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705806a410 con 0x7f7058062c10 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705659c700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f7058062ff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7058067340 tx=0x7f704c0090f0).ready entity=mon.0 client_cookie=6173ec8f7d917c30 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705559a700 1 -- 172.21.15.133:0/4066748273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00b600 con 0x7f7058062c10 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705559a700 1 -- 172.21.15.133:0/4066748273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00b760 con 0x7f7058062c10 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705559a700 1 -- 172.21.15.133:0/4066748273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00bb00 con 0x7f7058062c10 2024-01-21T19:59:16.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 -- 172.21.15.133:0/4066748273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 msgr2=0x7f7058062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f7058062ff0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7058067340 tx=0x7f704c0090f0).stop 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 -- 172.21.15.133:0/4066748273 shutdown_connections 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 --2- 172.21.15.133:0/4066748273 >> v2:172.21.15.178:3300/0 conn(0x7f7058069c40 0x7f7058065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f7058062ff0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.176+0000 7f705cff4700 1 --2- 172.21.15.133:0/4066748273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f7058065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.177+0000 7f705cff4700 1 -- 172.21.15.133:0/4066748273 >> 172.21.15.133:0/4066748273 conn(0x7f70580c8010 msgr2=0x7f70580c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.177+0000 7f705cff4700 1 -- 172.21.15.133:0/4066748273 shutdown_connections 2024-01-21T19:59:16.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.177+0000 7f705cff4700 1 -- 172.21.15.133:0/4066748273 wait complete. 2024-01-21T19:59:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.178+0000 7f705cff4700 1 Processor -- start 2024-01-21T19:59:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.178+0000 7f705cff4700 1 -- start start 2024-01-21T19:59:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f705813c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f705812faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7058069c40 0x7f70580bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705813cd20 con 0x7f7058062c10 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70580c1000 con 0x7f7058069c40 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70580c03f0 con 0x7f70580697e0 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f705813c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f705813c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60276/0 (socket says 172.21.15.133:60276) 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 -- 172.21.15.133:0/83743449 learned_addr learned my addr 172.21.15.133:0/83743449 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f7056d9d700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7058069c40 0x7f70580bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f7055d9b700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f705812faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 -- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 msgr2=0x7f705812faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70580697e0 0x7f705812faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 -- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7058069c40 msgr2=0x7f70580bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7058069c40 0x7f70580bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009370 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705659c700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f705813c830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f70580692f0 tx=0x7f704c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00bec0 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c00b8d0 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c024470 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70580c06d0 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.179+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70580c0c90 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.180+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f705805fdf0 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f704c021070 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f703805f150 0x7f7038061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f704c07bfc0 con 0x7f7058062c10 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7055d9b700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f703805f150 0x7f7038061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f70380684f0 0x7f703806a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f703806afd0 con 0x7f70380684f0 2024-01-21T19:59:16.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.181+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f704c07c370 con 0x7f7058062c10 2024-01-21T19:59:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.182+0000 7f7056d9d700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f70380684f0 0x7f703806a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.182+0000 7f7055d9b700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f703805f150 0x7f7038061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7048006fd0 tx=0x7f7048008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.182+0000 7f7056d9d700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f70380684f0 0x7f703806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.183+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== osd.6 v2:172.21.15.178:6808/43899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f703806afd0 con 0x7f70380684f0 2024-01-21T19:59:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.197+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 --> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f705806a6f0 con 0x7f70380684f0 2024-01-21T19:59:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.197+0000 7f7046ffd700 1 -- 172.21.15.133:0/83743449 <== osd.6 v2:172.21.15.178:6808/43899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f705806a6f0 con 0x7f70380684f0 2024-01-21T19:59:16.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.197+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f70380684f0 msgr2=0x7f703806a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.197+0000 7f705cff4700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f70380684f0 0x7f703806a950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f703805f150 msgr2=0x7f7038061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f703805f150 0x7f7038061610 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f7048006fd0 tx=0x7f7048008040).stop 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 msgr2=0x7f705813c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 --2- 172.21.15.133:0/83743449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7058062c10 0x7f705813c830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f70580692f0 tx=0x7f704c017000).stop 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f7056d9d700 1 -- 172.21.15.133:0/83743449 reap_dead start 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 shutdown_connections 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 >> 172.21.15.133:0/83743449 conn(0x7f70580c8010 msgr2=0x7f70580c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 shutdown_connections 2024-01-21T19:59:16.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.198+0000 7f705cff4700 1 -- 172.21.15.133:0/83743449 wait complete. 2024-01-21T19:59:16.200 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:16.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-21T19:59:16.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.325+0000 7fad0456e700 1 Processor -- start 2024-01-21T19:59:16.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.325+0000 7fad0456e700 1 -- start start 2024-01-21T19:59:16.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad0456e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7facfc13b970 0x7facfc0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad0456e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facfc0be810 0x7facfc0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad0456e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc0bfa40 con 0x7facfc0c39f0 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad0456e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0c3e70 con 0x7facfc0be810 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad0456e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc0bee30 con 0x7facfc13b970 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad02b0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facfc0be810 0x7facfc0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad01b09700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7facfc0c39f0 0x7facfc0be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56058/0 (socket says 172.21.15.133:56058) 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.326+0000 7fad01b09700 1 -- 172.21.15.133:0/3415271781 learned_addr learned my addr 172.21.15.133:0/3415271781 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad0230a700 1 --2- 172.21.15.133:0/3415271781 >> v2:172.21.15.178:3300/0 conn(0x7facfc13b970 0x7facfc0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad02b0b700 1 -- 172.21.15.133:0/3415271781 >> v2:172.21.15.178:3300/0 conn(0x7facfc13b970 msgr2=0x7facfc0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad02b0b700 1 --2- 172.21.15.133:0/3415271781 >> v2:172.21.15.178:3300/0 conn(0x7facfc13b970 0x7facfc0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad02b0b700 1 -- 172.21.15.133:0/3415271781 >> v1:172.21.15.133:6789/0 conn(0x7facfc0c39f0 legacy=0x7facfc0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad01308700 1 -- 172.21.15.133:0/3415271781 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71186783 0 0) 0x7facfc0bfa40 con 0x7facfc0c39f0 2024-01-21T19:59:16.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad02b0b700 1 -- 172.21.15.133:0/3415271781 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0bf110 con 0x7facfc0be810 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad02b0b700 1 --2- 172.21.15.133:0/3415271781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc0a8ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7facfc065f70 tx=0x7facf4009780).ready entity=mon.0 client_cookie=ba898d21cefdfe5c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad01308700 1 -- 172.21.15.133:0/3415271781 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400e070 con 0x7facfc0be810 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad01308700 1 -- 172.21.15.133:0/3415271781 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400bc30 con 0x7facfc0be810 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad01308700 1 -- 172.21.15.133:0/3415271781 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4012410 con 0x7facfc0be810 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad0456e700 1 -- 172.21.15.133:0/3415271781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 msgr2=0x7facfc0a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.327+0000 7fad0456e700 1 --2- 172.21.15.133:0/3415271781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc0a8ab0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7facfc065f70 tx=0x7facf4009780).stop 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 -- 172.21.15.133:0/3415271781 shutdown_connections 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 --2- 172.21.15.133:0/3415271781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc0a8ab0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 --2- 172.21.15.133:0/3415271781 >> v2:172.21.15.178:3300/0 conn(0x7facfc13b970 0x7facfc0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 -- 172.21.15.133:0/3415271781 >> 172.21.15.133:0/3415271781 conn(0x7facfc066a70 msgr2=0x7facfc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 -- 172.21.15.133:0/3415271781 shutdown_connections 2024-01-21T19:59:16.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.328+0000 7fad0456e700 1 -- 172.21.15.133:0/3415271781 wait complete. 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.329+0000 7fad0456e700 1 Processor -- start 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.329+0000 7fad0456e700 1 -- start start 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facfc0c39f0 0x7facfc0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facfc13b970 0x7facfc151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0c2ff0 con 0x7facfc0be810 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0640b0 con 0x7facfc13b970 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc156e10 con 0x7facfc0c39f0 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60296/0 (socket says 172.21.15.133:60296) 2024-01-21T19:59:16.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 -- 172.21.15.133:0/427980603 learned_addr learned my addr 172.21.15.133:0/427980603 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad01b09700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facfc0c39f0 0x7facfc0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad02b0b700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facfc13b970 0x7facfc151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 -- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facfc0c39f0 msgr2=0x7facfc0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facfc0c39f0 0x7facfc0c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 -- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facfc13b970 msgr2=0x7facfc151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facfc13b970 0x7facfc151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4009a20 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0230a700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc164410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7facec00d890 tx=0x7facec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0125f0 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facec012750 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc1649d0 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec012ad0 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.330+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc165010 con 0x7facfc0be810 2024-01-21T19:59:16.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.331+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facfc05fdf0 con 0x7facfc0be810 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.331+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7facec013480 con 0x7facfc0be810 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7facf2ffd700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7face005f150 0x7face0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facec079f20 con 0x7facfc0be810 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7fad01b09700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7face005f150 0x7face0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7facf2ffd700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7face00684f0 0x7face006a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face006afd0 con 0x7face00684f0 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7facec07c540 con 0x7facfc0be810 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7fad02b0b700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7face00684f0 0x7face006a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.332+0000 7fad01b09700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7face005f150 0x7face0061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7facf800c7d0 tx=0x7facf8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.333+0000 7fad02b0b700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7face00684f0 0x7face006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.333+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== osd.7 v2:172.21.15.178:6824/43943 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7face006afd0 con 0x7face00684f0 2024-01-21T19:59:16.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.348+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 --> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facfc064390 con 0x7face00684f0 2024-01-21T19:59:16.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.348+0000 7facf2ffd700 1 -- 172.21.15.133:0/427980603 <== osd.7 v2:172.21.15.178:6824/43943 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facfc064390 con 0x7face00684f0 2024-01-21T19:59:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7face00684f0 msgr2=0x7face006a950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7face00684f0 0x7face006a950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7face005f150 msgr2=0x7face0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7face005f150 0x7face0061610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7facf800c7d0 tx=0x7facf8009040).stop 2024-01-21T19:59:16.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 msgr2=0x7facfc164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 --2- 172.21.15.133:0/427980603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0be810 0x7facfc164410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7facec00d890 tx=0x7facec008040).stop 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad02b0b700 1 -- 172.21.15.133:0/427980603 reap_dead start 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 shutdown_connections 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 >> 172.21.15.133:0/427980603 conn(0x7facfc066a70 msgr2=0x7facfc0c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 shutdown_connections 2024-01-21T19:59:16.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.349+0000 7fad0456e700 1 -- 172.21.15.133:0/427980603 wait complete. 2024-01-21T19:59:16.351 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:16.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-21T19:59:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.476+0000 7f4db5192700 1 Processor -- start 2024-01-21T19:59:16.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.476+0000 7f4db5192700 1 -- start start 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4db5192700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4db0137030 0x7f4db0067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4db5192700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 0x7f4db0155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4db5192700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db01557f0 con 0x7f4db00c5930 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4db5192700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db0068370 con 0x7f4db0137030 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4db5192700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db0068650 con 0x7f4db0137410 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4daed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4db0137030 0x7f4db0067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4daed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4db0137030 0x7f4db0067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60298/0 (socket says 172.21.15.133:60298) 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.477+0000 7f4daed9d700 1 -- 172.21.15.133:0/932264735 learned_addr learned my addr 172.21.15.133:0/932264735 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4dae59c700 1 --2- 172.21.15.133:0/932264735 >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 0x7f4db0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4daed9d700 1 -- 172.21.15.133:0/932264735 >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 msgr2=0x7f4db0155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4daed9d700 1 --2- 172.21.15.133:0/932264735 >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 0x7f4db0155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4daed9d700 1 -- 172.21.15.133:0/932264735 >> v1:172.21.15.178:6789/0 conn(0x7f4db00c5930 legacy=0x7f4db00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4daed9d700 1 -- 172.21.15.133:0/932264735 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0068930 con 0x7f4db0137030 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4dae59c700 1 --2- 172.21.15.133:0/932264735 >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 0x7f4db0155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4daed9d700 1 --2- 172.21.15.133:0/932264735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db0137030 0x7f4db0067d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4db00af0d0 tx=0x7f4da40090f0).ready entity=mon.0 client_cookie=460e656a1e0fdd19 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4dadd9b700 1 -- 172.21.15.133:0/932264735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400b5a0 con 0x7f4db0137030 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4dadd9b700 1 -- 172.21.15.133:0/932264735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400b700 con 0x7f4db0137030 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4dadd9b700 1 -- 172.21.15.133:0/932264735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400baa0 con 0x7f4db0137030 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 -- 172.21.15.133:0/932264735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db0137030 msgr2=0x7f4db0067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 --2- 172.21.15.133:0/932264735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db0137030 0x7f4db0067d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4db00af0d0 tx=0x7f4da40090f0).stop 2024-01-21T19:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 -- 172.21.15.133:0/932264735 shutdown_connections 2024-01-21T19:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 --2- 172.21.15.133:0/932264735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db0137030 0x7f4db0067d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 --2- 172.21.15.133:0/932264735 >> v2:172.21.15.178:3300/0 conn(0x7f4db0137410 0x7f4db0155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 -- 172.21.15.133:0/932264735 >> 172.21.15.133:0/932264735 conn(0x7f4db0066a90 msgr2=0x7f4db0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 -- 172.21.15.133:0/932264735 shutdown_connections 2024-01-21T19:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.478+0000 7f4db5192700 1 -- 172.21.15.133:0/932264735 wait complete. 2024-01-21T19:59:16.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.480+0000 7f4db5192700 1 Processor -- start 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.480+0000 7f4db5192700 1 -- start start 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4db0137030 0x7f4db0135960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4db0137410 0x7f4db013bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00aef00 con 0x7f4db00c5930 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0167a60 con 0x7f4db0137030 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00aec80 con 0x7f4db0137410 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60300/0 (socket says 172.21.15.133:60300) 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 -- 172.21.15.133:0/4186587297 learned_addr learned my addr 172.21.15.133:0/4186587297 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4dae59c700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4db0137030 0x7f4db0135960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daf59e700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4db0137410 0x7f4db013bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 -- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4db0137410 msgr2=0x7f4db013bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4db0137410 0x7f4db013bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 -- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4db0137030 msgr2=0x7f4db0135960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4db0137030 0x7f4db0135960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 -- 172.21.15.133:0/4186587297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da4009370 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4daed9d700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4db0066530 tx=0x7f4da4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4006910 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400b870 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4024470 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db01369a0 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.481+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db00ac330 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.482+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db005fdf0 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.483+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4da4021070 con 0x7f4db00c5930 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.483+0000 7f4d977fe700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 0x7f4d9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.483+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4da407bc30 con 0x7f4db00c5930 2024-01-21T19:59:16.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.483+0000 7f4dae59c700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 0x7f4d9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.484+0000 7f4dae59c700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 0x7f4d9c061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4da000aa70 tx=0x7f4da0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.487+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4da404cfb0 con 0x7f4db00c5930 2024-01-21T19:59:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.649+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4db0064c40 con 0x7f4db00c5930 2024-01-21T19:59:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.650+0000 7f4d977fe700 1 -- 172.21.15.133:0/4186587297 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4da4029070 con 0x7f4db00c5930 2024-01-21T19:59:16.641 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 msgr2=0x7f4d9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 0x7f4d9c061610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f4da000aa70 tx=0x7f4da0008040).stop 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 msgr2=0x7f4db00ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4db0066530 tx=0x7f4da4015000).stop 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 shutdown_connections 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d9c05f150 0x7f4d9c061610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4db0137410 0x7f4db013bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4db00c5930 0x7f4db00ae790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 --2- 172.21.15.133:0/4186587297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4db0137030 0x7f4db0135960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 >> 172.21.15.133:0/4186587297 conn(0x7f4db0066a90 msgr2=0x7f4db00c4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.651+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 shutdown_connections 2024-01-21T19:59:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.652+0000 7f4db5192700 1 -- 172.21.15.133:0/4186587297 wait complete. 2024-01-21T19:59:16.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-01-21T19:59:16.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-21T19:59:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.780+0000 7f01a5fcc700 1 Processor -- start 2024-01-21T19:59:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.780+0000 7f01a5fcc700 1 -- start start 2024-01-21T19:59:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f01a5fcc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01a01546b0 0x7f01a0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f01a5fcc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01a00bc6d0 0x7f01a0066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f01a5fcc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a00654f0 con 0x7f01a00a9e30 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f01a5fcc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a0063700 con 0x7f01a00bc6d0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f01a5fcc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a0063950 con 0x7f01a01546b0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f019ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01a00bc6d0 0x7f01a0066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f019ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01a00bc6d0 0x7f01a0066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60304/0 (socket says 172.21.15.133:60304) 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f019ffff700 1 -- 172.21.15.133:0/3902871975 learned_addr learned my addr 172.21.15.133:0/3902871975 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.781+0000 7f019f7fe700 1 --2- 172.21.15.133:0/3902871975 >> v2:172.21.15.178:3300/0 conn(0x7f01a01546b0 0x7f01a0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019ffff700 1 -- 172.21.15.133:0/3902871975 >> v2:172.21.15.178:3300/0 conn(0x7f01a01546b0 msgr2=0x7f01a0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019ffff700 1 --2- 172.21.15.133:0/3902871975 >> v2:172.21.15.178:3300/0 conn(0x7f01a01546b0 0x7f01a0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019ffff700 1 -- 172.21.15.133:0/3902871975 >> v1:172.21.15.178:6789/0 conn(0x7f01a00a9e30 legacy=0x7f01a0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019ffff700 1 -- 172.21.15.133:0/3902871975 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0065180 con 0x7f01a00bc6d0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019ffff700 1 --2- 172.21.15.133:0/3902871975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00bc6d0 0x7f01a0066090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f01a005f0d0 tx=0x7f0198009840).ready entity=mon.0 client_cookie=8621bc218907db50 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019e7fc700 1 -- 172.21.15.133:0/3902871975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800e070 con 0x7f01a00bc6d0 2024-01-21T19:59:16.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019e7fc700 1 -- 172.21.15.133:0/3902871975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019800ba10 con 0x7f01a00bc6d0 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f019e7fc700 1 -- 172.21.15.133:0/3902871975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800bd90 con 0x7f01a00bc6d0 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3902871975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00bc6d0 msgr2=0x7f01a0066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3902871975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00bc6d0 0x7f01a0066090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f01a005f0d0 tx=0x7f0198009840).stop 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3902871975 shutdown_connections 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3902871975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00bc6d0 0x7f01a0066090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3902871975 >> v2:172.21.15.178:3300/0 conn(0x7f01a01546b0 0x7f01a0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3902871975 >> 172.21.15.133:0/3902871975 conn(0x7f01a00c8200 msgr2=0x7f01a00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3902871975 shutdown_connections 2024-01-21T19:59:16.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.782+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3902871975 wait complete. 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.784+0000 7f01a5fcc700 1 Processor -- start 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.784+0000 7f01a5fcc700 1 -- start start 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00bc6d0 0x7f01a0164910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a01546b0 0x7f01a0164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00ad6c0 con 0x7f01a00a9e30 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0148a40 con 0x7f01a01546b0 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00acab0 con 0x7f01a00bc6d0 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60320/0 (socket says 172.21.15.133:60320) 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 -- 172.21.15.133:0/3912201602 learned_addr learned my addr 172.21.15.133:0/3912201602 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 -- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00bc6d0 msgr2=0x7f01a0164910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00bc6d0 0x7f01a0164910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019ffff700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a01546b0 0x7f01a0164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 -- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a01546b0 msgr2=0x7f01a0164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a01546b0 0x7f01a0164e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 -- 172.21.15.133:0/3912201602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198009ae0 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f019f7fe700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f018800d860 tx=0x7f0188008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011590 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01880116f0 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a00acd90 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0188011a70 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.785+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a00ad350 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.786+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a0063440 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.787+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0188012420 con 0x7f01a00a9e30 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.787+0000 7f0197fff700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:16.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.787+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0188079c80 con 0x7f01a00a9e30 2024-01-21T19:59:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.787+0000 7f019effd700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:16.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.787+0000 7f019effd700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 0x7f0180061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f01a00abc60 tx=0x7f0190006ae0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:16.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.791+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f018804aef0 con 0x7f01a00a9e30 2024-01-21T19:59:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.957+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f01a005fdf0 con 0x7f01a00a9e30 2024-01-21T19:59:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.957+0000 7f0197fff700 1 -- 172.21.15.133:0/3912201602 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01a005fdf0 con 0x7f01a00a9e30 2024-01-21T19:59:16.949 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2024-01-21T19:59:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 msgr2=0x7f0180061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 0x7f0180061610 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f01a00abc60 tx=0x7f0190006ae0).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 msgr2=0x7f01a0147a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f018800d860 tx=0x7f0188008040).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 shutdown_connections 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018005f150 0x7f0180061610 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a01546b0 0x7f01a0164e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01a00a9e30 0x7f01a0147a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 --2- 172.21.15.133:0/3912201602 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00bc6d0 0x7f01a0164910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 >> 172.21.15.133:0/3912201602 conn(0x7f01a00c8200 msgr2=0x7f01a0069920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 shutdown_connections 2024-01-21T19:59:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:16.959+0000 7f01a5fcc700 1 -- 172.21.15.133:0/3912201602 wait complete. 2024-01-21T19:59:16.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-01-21T19:59:16.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-21T19:59:17.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.089+0000 7f611c316700 1 Processor -- start 2024-01-21T19:59:17.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.089+0000 7f611c316700 1 -- start start 2024-01-21T19:59:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f611c316700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61140beb30 0x7f6114155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f611c316700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114065660 con 0x7f61140c3fb0 2024-01-21T19:59:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f611c316700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114065f00 con 0x7f6114069ef0 2024-01-21T19:59:17.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f611c316700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140bef10 con 0x7f61140beb30 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f61198b1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61140c3fb0 0x7f61140697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56064/0 (socket says 172.21.15.133:56064) 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f61198b1700 1 -- 172.21.15.133:0/3717349730 learned_addr learned my addr 172.21.15.133:0/3717349730 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.090+0000 7f611a0b2700 1 --2- 172.21.15.133:0/3717349730 >> v2:172.21.15.178:3300/0 conn(0x7f61140beb30 0x7f6114155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418301255 0 0) 0x7f6114065660 con 0x7f61140c3fb0 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61000033f0 con 0x7f61140c3fb0 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3398782711 0 0) 0x7f61000033f0 con 0x7f61140c3fb0 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f611a0b2700 1 -- 172.21.15.133:0/3717349730 >> v1:172.21.15.178:6789/0 conn(0x7f6114069ef0 legacy=0x7f6114066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f611a0b2700 1 -- 172.21.15.133:0/3717349730 >> v1:172.21.15.133:6789/0 conn(0x7f61140c3fb0 legacy=0x7f61140697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f611a0b2700 1 -- 172.21.15.133:0/3717349730 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140c4740 con 0x7f61140beb30 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f611a0b2700 1 --2- 172.21.15.133:0/3717349730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f6114155b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).ready entity=mon.1 client_cookie=3a7b3b7df711ef1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110001470 con 0x7f61140beb30 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104009130 con 0x7f61140beb30 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.091+0000 7f61190b0700 1 -- 172.21.15.133:0/3717349730 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104011610 con 0x7f61140beb30 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 -- 172.21.15.133:0/3717349730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 msgr2=0x7f6114155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 --2- 172.21.15.133:0/3717349730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f6114155b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6104009760 tx=0x7f6104009060).stop 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 -- 172.21.15.133:0/3717349730 shutdown_connections 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 --2- 172.21.15.133:0/3717349730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f6114155b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 -- 172.21.15.133:0/3717349730 >> 172.21.15.133:0/3717349730 conn(0x7f61140c8010 msgr2=0x7f61140c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 -- 172.21.15.133:0/3717349730 shutdown_connections 2024-01-21T19:59:17.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.092+0000 7f611c316700 1 -- 172.21.15.133:0/3717349730 wait complete. 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.093+0000 7f611c316700 1 Processor -- start 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.093+0000 7f611c316700 1 -- start start 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f61141508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61140c3fb0 0x7f61140c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114161910 con 0x7f6114069ef0 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114150de0 con 0x7f61140beb30 2024-01-21T19:59:17.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114160d00 con 0x7f61140c3fb0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60330/0 (socket says 172.21.15.133:60330) 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 -- 172.21.15.133:0/2489003384 learned_addr learned my addr 172.21.15.133:0/2489003384 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 -- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61140c3fb0 msgr2=0x7f61140c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61140c3fb0 0x7f61140c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 -- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 msgr2=0x7f61141508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f61141508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 -- 172.21.15.133:0/2489003384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040092a0 con 0x7f6114069ef0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611a0b2700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6104009e00 tx=0x7f6104014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61040109d0 con 0x7f6114069ef0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104010b30 con 0x7f6114069ef0 2024-01-21T19:59:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6114160fe0 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610401d430 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.094+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61141615a0 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.095+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6114067ce0 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.096+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f610401d870 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.096+0000 7f610affd700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 0x7f60f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.096+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f610407b5e0 con 0x7f6114069ef0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.096+0000 7f61198b1700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 0x7f60f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.096+0000 7f61198b1700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 0x7f60f8061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f6110000c00 tx=0x7f61100012e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.100+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f610404c850 con 0x7f6114069ef0 2024-01-21T19:59:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.265+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f611405fdf0 con 0x7f6114069ef0 2024-01-21T19:59:17.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.266+0000 7f610affd700 1 -- 172.21.15.133:0/2489003384 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6104016070 con 0x7f6114069ef0 2024-01-21T19:59:17.257 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.267+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 msgr2=0x7f60f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.267+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 0x7f60f8061610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f6110000c00 tx=0x7f61100012e0).stop 2024-01-21T19:59:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.267+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 msgr2=0x7f61140bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.267+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6104009e00 tx=0x7f6104014000).stop 2024-01-21T19:59:17.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 shutdown_connections 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f805f150 0x7f60f8061610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61140c3fb0 0x7f61140c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6114069ef0 0x7f61140bfc30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 --2- 172.21.15.133:0/2489003384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61140beb30 0x7f61141508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 >> 172.21.15.133:0/2489003384 conn(0x7f61140c8010 msgr2=0x7f6114139f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 shutdown_connections 2024-01-21T19:59:17.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.268+0000 7f611c316700 1 -- 172.21.15.133:0/2489003384 wait complete. 2024-01-21T19:59:17.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-01-21T19:59:17.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-21T19:59:17.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.397+0000 7f0e7b2e8700 1 Processor -- start 2024-01-21T19:59:17.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.397+0000 7f0e7b2e8700 1 -- start start 2024-01-21T19:59:17.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e7b2e8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0e741549a0 0x7f0e740c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e7b2e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e740a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e7b2e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e740c3740 con 0x7f0e74154d80 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e7b2e8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e740c22e0 con 0x7f0e741549a0 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e7b2e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c25c0 con 0x7f0e741559d0 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e78883700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e74154d80 0x7f0e741552c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56080/0 (socket says 172.21.15.133:56080) 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e78883700 1 -- 172.21.15.133:0/2005801293 learned_addr learned my addr 172.21.15.133:0/2005801293 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e79885700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e740a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e79084700 1 --2- 172.21.15.133:0/2005801293 >> v2:172.21.15.178:3300/0 conn(0x7f0e741549a0 0x7f0e740c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95458019 0 0) 0x7f0e740c3740 con 0x7f0e74154d80 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.398+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e600033f0 con 0x7f0e74154d80 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911339406 0 0) 0x7f0e600033f0 con 0x7f0e74154d80 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 msgr2=0x7f0e740a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e740a4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 >> v2:172.21.15.178:3300/0 conn(0x7f0e741549a0 msgr2=0x7f0e740c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 --2- 172.21.15.133:0/2005801293 >> v2:172.21.15.178:3300/0 conn(0x7f0e741549a0 0x7f0e740c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e740c28a0 con 0x7f0e74154d80 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0e70001470 con 0x7f0e74154d80 2024-01-21T19:59:17.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 >> v1:172.21.15.133:6789/0 conn(0x7f0e74154d80 legacy=0x7f0e741552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e600038e0 0x7f0e60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e60004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e60004b80 0x7f0e60005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c22e0 con 0x7f0e60004b80 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740c25c0 con 0x7f0e600038e0 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6000b8e0 con 0x7f0e741559d0 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e60004b80 0x7f0e60005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e78883700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e60004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79084700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e600038e0 0x7f0e60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 -- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 msgr2=0x7f0e60004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e741559d0 0x7f0e60004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 -- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e600038e0 msgr2=0x7f0e60003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e600038e0 0x7f0e60003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 -- 172.21.15.133:0/2005801293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e600033f0 con 0x7f0e60004b80 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e79885700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e60004b80 0x7f0e60005000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0e740a60e0 tx=0x7f0e6c00b040).ready entity=mon.0 client_cookie=d0c26d71d6385f94 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c009ac0 con 0x7f0e60004b80 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c00f040 con 0x7f0e60004b80 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.399+0000 7f0e6bfff700 1 -- 172.21.15.133:0/2005801293 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c00eca0 con 0x7f0e60004b80 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/2005801293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e60004b80 msgr2=0x7f0e60005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/2005801293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e60004b80 0x7f0e60005000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0e740a60e0 tx=0x7f0e6c00b040).stop 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e79885700 1 -- 172.21.15.133:0/2005801293 reap_dead start 2024-01-21T19:59:17.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/2005801293 shutdown_connections 2024-01-21T19:59:17.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/2005801293 >> 172.21.15.133:0/2005801293 conn(0x7f0e740c6ef0 msgr2=0x7f0e740c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/2005801293 shutdown_connections 2024-01-21T19:59:17.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.400+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/2005801293 wait complete. 2024-01-21T19:59:17.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.401+0000 7f0e7b2e8700 1 Processor -- start 2024-01-21T19:59:17.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.401+0000 7f0e7b2e8700 1 -- start start 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60004b80 0x7f0e74092ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e740bc6e0 0x7f0e740bcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740933b0 con 0x7f0e74151a70 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e74150a20 con 0x7f0e60004b80 2024-01-21T19:59:17.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e740bd030 con 0x7f0e740bc6e0 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60358/0 (socket says 172.21.15.133:60358) 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 -- 172.21.15.133:0/1456004081 learned_addr learned my addr 172.21.15.133:0/1456004081 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e79885700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e740bc6e0 0x7f0e740bcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e79084700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60004b80 0x7f0e74092ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 -- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e740bc6e0 msgr2=0x7f0e740bcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e740bc6e0 0x7f0e740bcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 -- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60004b80 msgr2=0x7f0e74092ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60004b80 0x7f0e74092ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 -- 172.21.15.133:0/1456004081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74091e20 con 0x7f0e74151a70 2024-01-21T19:59:17.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e78883700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0e7000e780 tx=0x7f0e70000cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70010490 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70010040 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.402+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e74092100 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.403+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70010800 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.403+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e740926c0 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7405fdf0 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e70010c30 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e69f76700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 0x7f0e58061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e700798d0 con 0x7f0e74151a70 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e79084700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 0x7f0e58061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.404+0000 7f0e79084700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 0x7f0e58061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0e64006f70 tx=0x7f0e64008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.408+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e7004aba0 con 0x7f0e74151a70 2024-01-21T19:59:17.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.572+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e7406ade0 con 0x7f0e74151a70 2024-01-21T19:59:17.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.573+0000 7f0e69f76700 1 -- 172.21.15.133:0/1456004081 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e7004e1c0 con 0x7f0e74151a70 2024-01-21T19:59:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 msgr2=0x7f0e58061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 0x7f0e58061610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0e64006f70 tx=0x7f0e64008040).stop 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 msgr2=0x7f0e74148bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0e7000e780 tx=0x7f0e70000cf0).stop 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 shutdown_connections 2024-01-21T19:59:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e5805f150 0x7f0e58061610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e740bc6e0 0x7f0e740bcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e60004b80 0x7f0e74092ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 --2- 172.21.15.133:0/1456004081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e74151a70 0x7f0e74148bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 >> 172.21.15.133:0/1456004081 conn(0x7f0e740c6ef0 msgr2=0x7f0e74153860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.574+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 shutdown_connections 2024-01-21T19:59:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.575+0000 7f0e7b2e8700 1 -- 172.21.15.133:0/1456004081 wait complete. 2024-01-21T19:59:17.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-01-21T19:59:17.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-21T19:59:17.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.703+0000 7f7c1e1fb700 1 Processor -- start 2024-01-21T19:59:17.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.703+0000 7f7c1e1fb700 1 -- start start 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c1e1fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 0x7f7c180c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c1e1fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c180be810 0x7f7c180a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c1e1fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180bfa40 con 0x7f7c180c39f0 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c1e1fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180c3e70 con 0x7f7c180be810 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c1e1fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180bee30 con 0x7f7c1813b970 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c180be810 0x7f7c180a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c180be810 0x7f7c180a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60364/0 (socket says 172.21.15.133:60364) 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c17fff700 1 -- 172.21.15.133:0/3797977795 learned_addr learned my addr 172.21.15.133:0/3797977795 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.704+0000 7f7c16ffd700 1 --1- 172.21.15.133:0/3797977795 >> v1:172.21.15.133:6789/0 conn(0x7f7c180c39f0 0x7f7c180be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56086/0 (socket says 172.21.15.133:56086) 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c177fe700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 0x7f7c180c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c17fff700 1 -- 172.21.15.133:0/3797977795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 msgr2=0x7f7c180c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c17fff700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 0x7f7c180c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c17fff700 1 -- 172.21.15.133:0/3797977795 >> v1:172.21.15.133:6789/0 conn(0x7f7c180c39f0 legacy=0x7f7c180be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c167fc700 1 -- 172.21.15.133:0/3797977795 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770159977 0 0) 0x7f7c180bfa40 con 0x7f7c180c39f0 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c17fff700 1 -- 172.21.15.133:0/3797977795 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c180bf110 con 0x7f7c180be810 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c177fe700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 0x7f7c180c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c17fff700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180be810 0x7f7c180a8ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7c10009f20 tx=0x7f7c10009840).ready entity=mon.0 client_cookie=8ede2704fa30f2f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c167fc700 1 -- 172.21.15.133:0/3797977795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1000e070 con 0x7f7c180be810 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c167fc700 1 -- 172.21.15.133:0/3797977795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1000ba80 con 0x7f7c180be810 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c167fc700 1 -- 172.21.15.133:0/3797977795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1000be00 con 0x7f7c180be810 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/3797977795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180be810 msgr2=0x7f7c180a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180be810 0x7f7c180a8ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7c10009f20 tx=0x7f7c10009840).stop 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/3797977795 shutdown_connections 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180be810 0x7f7c180a8ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/3797977795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c1813b970 0x7f7c180c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.705+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/3797977795 >> 172.21.15.133:0/3797977795 conn(0x7f7c18066a70 msgr2=0x7f7c18066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.706+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/3797977795 shutdown_connections 2024-01-21T19:59:17.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.706+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/3797977795 wait complete. 2024-01-21T19:59:17.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.707+0000 7f7c1e1fb700 1 Processor -- start 2024-01-21T19:59:17.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.707+0000 7f7c1e1fb700 1 -- start start 2024-01-21T19:59:17.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c180be810 0x7f7c18136b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c1813b970 0x7f7c18151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18063cf0 con 0x7f7c180c39f0 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c181575b0 con 0x7f7c1813b970 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18064b10 con 0x7f7c180be810 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60368/0 (socket says 172.21.15.133:60368) 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 -- 172.21.15.133:0/2558339367 learned_addr learned my addr 172.21.15.133:0/2558339367 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c17fff700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c1813b970 0x7f7c18151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c177fe700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c180be810 0x7f7c18136b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 -- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c180be810 msgr2=0x7f7c18136b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c180be810 0x7f7c18136b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 -- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c1813b970 msgr2=0x7f7c18151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c1813b970 0x7f7c18151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 -- 172.21.15.133:0/2558339367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10009ae0 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c16ffd700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7c0800c490 tx=0x7f7c08007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080072e0 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08007440 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c18063f00 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08005930 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.708+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c18064540 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.709+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c18064cc0 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.710+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7c08005ce0 con 0x7f7c180c39f0 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.710+0000 7f7bfffff700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:17.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.710+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c08079a20 con 0x7f7c180c39f0 2024-01-21T19:59:17.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.710+0000 7f7c177fe700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:17.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.710+0000 7f7c177fe700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 0x7f7c04061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7c0c00aa70 tx=0x7f7c0c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:17.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.714+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c18064cc0 con 0x7f7c180c39f0 2024-01-21T19:59:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.878+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7c18064c80 con 0x7f7c180c39f0 2024-01-21T19:59:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.878+0000 7f7bfffff700 1 -- 172.21.15.133:0/2558339367 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c08018030 con 0x7f7c180c39f0 2024-01-21T19:59:17.870 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 msgr2=0x7f7c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 0x7f7c04061610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7c0c00aa70 tx=0x7f7c0c008040).stop 2024-01-21T19:59:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 msgr2=0x7f7c18063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f7c0800c490 tx=0x7f7c08007e00).stop 2024-01-21T19:59:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 shutdown_connections 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c0405f150 0x7f7c04061610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c1813b970 0x7f7c18151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c180be810 0x7f7c18136b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 --2- 172.21.15.133:0/2558339367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c180c39f0 0x7f7c18063800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 >> 172.21.15.133:0/2558339367 conn(0x7f7c18066a70 msgr2=0x7f7c180c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 shutdown_connections 2024-01-21T19:59:17.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:17.880+0000 7f7c1e1fb700 1 -- 172.21.15.133:0/2558339367 wait complete. 2024-01-21T19:59:17.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-01-21T19:59:18.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-21T19:59:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.022+0000 7f9161a9d700 1 Processor -- start 2024-01-21T19:59:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.022+0000 7f9161a9d700 1 -- start start 2024-01-21T19:59:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f9161a9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f915c062c10 0x7f915c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f9161a9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915c0697e0 0x7f915c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f9161a9d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c0634e0 con 0x7f915c069c40 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f9161a9d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c06a130 con 0x7f915c0697e0 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f9161a9d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c06a410 con 0x7f915c062c10 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915c0697e0 0x7f915c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f915c0697e0 0x7f915c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60374/0 (socket says 172.21.15.133:60374) 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 -- 172.21.15.133:0/2027634554 learned_addr learned my addr 172.21.15.133:0/2027634554 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f915c069c40 0x7f915c1583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56102/0 (socket says 172.21.15.133:56102) 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915b7fe700 1 --2- 172.21.15.133:0/2027634554 >> v2:172.21.15.178:3300/0 conn(0x7f915c062c10 0x7f915c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 -- 172.21.15.133:0/2027634554 >> v2:172.21.15.178:3300/0 conn(0x7f915c062c10 msgr2=0x7f915c062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 --2- 172.21.15.133:0/2027634554 >> v2:172.21.15.178:3300/0 conn(0x7f915c062c10 0x7f915c062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 -- 172.21.15.133:0/2027634554 >> v1:172.21.15.133:6789/0 conn(0x7f915c069c40 legacy=0x7f915c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 -- 172.21.15.133:0/2027634554 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c06a6f0 con 0x7f915c0697e0 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915a7fc700 1 -- 172.21.15.133:0/2027634554 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250494322 0 0) 0x7f915c0634e0 con 0x7f915c069c40 2024-01-21T19:59:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915affd700 1 --2- 172.21.15.133:0/2027634554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c0697e0 0x7f915c065660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f915c069390 tx=0x7f91500090f0).ready entity=mon.0 client_cookie=cb0bf78ed126db74 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915a7fc700 1 -- 172.21.15.133:0/2027634554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000b600 con 0x7f915c0697e0 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915a7fc700 1 -- 172.21.15.133:0/2027634554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000b760 con 0x7f915c0697e0 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.023+0000 7f915a7fc700 1 -- 172.21.15.133:0/2027634554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000bb00 con 0x7f915c0697e0 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 -- 172.21.15.133:0/2027634554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c0697e0 msgr2=0x7f915c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 --2- 172.21.15.133:0/2027634554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c0697e0 0x7f915c065660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f915c069390 tx=0x7f91500090f0).stop 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 -- 172.21.15.133:0/2027634554 shutdown_connections 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 --2- 172.21.15.133:0/2027634554 >> v2:172.21.15.178:3300/0 conn(0x7f915c062c10 0x7f915c062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 --2- 172.21.15.133:0/2027634554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c0697e0 0x7f915c065660 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 -- 172.21.15.133:0/2027634554 >> 172.21.15.133:0/2027634554 conn(0x7f915c0c8010 msgr2=0x7f915c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 -- 172.21.15.133:0/2027634554 shutdown_connections 2024-01-21T19:59:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.024+0000 7f9161a9d700 1 -- 172.21.15.133:0/2027634554 wait complete. 2024-01-21T19:59:19.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.025+0000 7f9161a9d700 1 Processor -- start 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.025+0000 7f9161a9d700 1 -- start start 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f915c062c10 0x7f915c13b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f915c0697e0 0x7f915c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c1650d0 con 0x7f915c069c40 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c164da0 con 0x7f915c0697e0 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f9161a9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0aca70 con 0x7f915c062c10 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f915bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f915bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60390/0 (socket says 172.21.15.133:60390) 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f915bfff700 1 -- 172.21.15.133:0/385935551 learned_addr learned my addr 172.21.15.133:0/385935551 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f915affd700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f915c0697e0 0x7f915c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.026+0000 7f915b7fe700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f915c062c10 0x7f915c13b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 -- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f915c062c10 msgr2=0x7f915c13b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f915c062c10 0x7f915c13b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 -- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f915c0697e0 msgr2=0x7f915c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f915c0697e0 0x7f915c159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 -- 172.21.15.133:0/385935551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009370 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f915bfff700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f915400c810 tx=0x7f9154007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005c70 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005df0 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c0acd50 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154007360 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.027+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c15a340 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.028+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c165240 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.028+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9154007750 con 0x7f915c069c40 2024-01-21T19:59:19.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.029+0000 7f9143fff700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 0x7f9148061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.029+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f915407a0d0 con 0x7f915c069c40 2024-01-21T19:59:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.029+0000 7f915b7fe700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 0x7f9148061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.029+0000 7f915b7fe700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 0x7f9148061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f915c0a8fd0 tx=0x7f914c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.033+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f915404b3a0 con 0x7f915c069c40 2024-01-21T19:59:19.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.197+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f915c0bcf70 con 0x7f915c069c40 2024-01-21T19:59:19.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.197+0000 7f9143fff700 1 -- 172.21.15.133:0/385935551 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f915404e9c0 con 0x7f915c069c40 2024-01-21T19:59:19.189 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:19.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.198+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 msgr2=0x7f9148061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.198+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 0x7f9148061610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f915c0a8fd0 tx=0x7f914c008040).stop 2024-01-21T19:59:19.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 msgr2=0x7f915c165560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f915400c810 tx=0x7f9154007f10).stop 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 shutdown_connections 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f914805f150 0x7f9148061610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f915c069c40 0x7f915c165560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f915c062c10 0x7f915c13b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 --2- 172.21.15.133:0/385935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f915c0697e0 0x7f915c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 >> 172.21.15.133:0/385935551 conn(0x7f915c0c8010 msgr2=0x7f915c0c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 shutdown_connections 2024-01-21T19:59:19.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.199+0000 7f9161a9d700 1 -- 172.21.15.133:0/385935551 wait complete. 2024-01-21T19:59:19.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-01-21T19:59:19.202 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-21T19:59:19.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.327+0000 7fea22b81700 1 Processor -- start 2024-01-21T19:59:19.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.327+0000 7fea22b81700 1 -- start start 2024-01-21T19:59:19.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea22b81700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 0x7fea1c065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea22b81700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0bd360 0x7fea1c154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea22b81700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c1511f0 con 0x7fea1c0a9e30 2024-01-21T19:59:19.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea22b81700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c065b20 con 0x7fea1c0bd360 2024-01-21T19:59:19.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea22b81700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0c2240 con 0x7fea1c0c2b00 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea2111e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0bd360 0x7fea1c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea2111e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0bd360 0x7fea1c154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60394/0 (socket says 172.21.15.133:60394) 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea2111e700 1 -- 172.21.15.133:0/2566171902 learned_addr learned my addr 172.21.15.133:0/2566171902 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea2091d700 1 --1- 172.21.15.133:0/2566171902 >> v1:172.21.15.133:6789/0 conn(0x7fea1c0a9e30 0x7fea1c0bcc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56106/0 (socket says 172.21.15.133:56106) 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.328+0000 7fea1bfff700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 0x7fea1c065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea2111e700 1 -- 172.21.15.133:0/2566171902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 msgr2=0x7fea1c065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea2111e700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 0x7fea1c065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea2111e700 1 -- 172.21.15.133:0/2566171902 >> v1:172.21.15.133:6789/0 conn(0x7fea1c0a9e30 legacy=0x7fea1c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea2111e700 1 -- 172.21.15.133:0/2566171902 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0c2f60 con 0x7fea1c0bd360 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea1b7fe700 1 -- 172.21.15.133:0/2566171902 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254055295 0 0) 0x7fea10001110 con 0x7fea1c0a9e30 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea1bfff700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 0x7fea1c065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea2111e700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0bd360 0x7fea1c154870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fea14009f20 tx=0x7fea14009840).ready entity=mon.0 client_cookie=6575b6111033043b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea1b7fe700 1 -- 172.21.15.133:0/2566171902 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400e070 con 0x7fea1c0bd360 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea1b7fe700 1 -- 172.21.15.133:0/2566171902 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400ba80 con 0x7fea1c0bd360 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea1b7fe700 1 -- 172.21.15.133:0/2566171902 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400be00 con 0x7fea1c0bd360 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 -- 172.21.15.133:0/2566171902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0bd360 msgr2=0x7fea1c154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0bd360 0x7fea1c154870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fea14009f20 tx=0x7fea14009840).stop 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 -- 172.21.15.133:0/2566171902 shutdown_connections 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0bd360 0x7fea1c154870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 --2- 172.21.15.133:0/2566171902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0c2b00 0x7fea1c065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 -- 172.21.15.133:0/2566171902 >> 172.21.15.133:0/2566171902 conn(0x7fea1c0c8200 msgr2=0x7fea1c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 -- 172.21.15.133:0/2566171902 shutdown_connections 2024-01-21T19:59:19.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.329+0000 7fea22b81700 1 -- 172.21.15.133:0/2566171902 wait complete. 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.331+0000 7fea22b81700 1 Processor -- start 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.331+0000 7fea22b81700 1 -- start start 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 0x7fea1c0c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 0x7fea1c0ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0ab7d0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0aca40 con 0x7fea1c0bd360 2024-01-21T19:59:19.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea22b81700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0aba70 con 0x7fea1c0a9e30 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea2111e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea2111e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60410/0 (socket says 172.21.15.133:60410) 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea2111e700 1 -- 172.21.15.133:0/1343464638 learned_addr learned my addr 172.21.15.133:0/1343464638 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea2091d700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 0x7fea1c0c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea1bfff700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 0x7fea1c0ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.332+0000 7fea2111e700 1 -- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 msgr2=0x7fea1c0c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2111e700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 0x7fea1c0c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2111e700 1 -- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 msgr2=0x7fea1c0ad1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2111e700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 0x7fea1c0ad1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2111e700 1 -- 172.21.15.133:0/1343464638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009ae0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2091d700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 0x7fea1c0c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea1bfff700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 0x7fea1c0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea2111e700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fea1400b6c0 tx=0x7fea1c065c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140032f0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140092e0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0abd50 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1401e6a0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.333+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0c0fa0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.334+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c0ac270 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.334+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fea14003040 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.334+0000 7fea197fa700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 0x7fea00061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.334+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea1407b6c0 con 0x7fea1c0c2b00 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.334+0000 7fea2091d700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 0x7fea00061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.335+0000 7fea2091d700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 0x7fea00061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea100057e0 tx=0x7fea10007c90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.338+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fea1c0ac270 con 0x7fea1c0c2b00 2024-01-21T19:59:19.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.504+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fea1c0ac270 con 0x7fea1c0c2b00 2024-01-21T19:59:19.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.504+0000 7fea197fa700 1 -- 172.21.15.133:0/1343464638 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea1c0ac270 con 0x7fea1c0c2b00 2024-01-21T19:59:19.496 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 msgr2=0x7fea00061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 0x7fea00061610 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fea100057e0 tx=0x7fea10007c90).stop 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 msgr2=0x7fea1c0ac550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fea1400b6c0 tx=0x7fea1c065c60).stop 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 shutdown_connections 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f150 0x7fea00061610 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0c2b00 0x7fea1c0ac550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0a9e30 0x7fea1c0c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 --2- 172.21.15.133:0/1343464638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c0bd360 0x7fea1c0ad1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 >> 172.21.15.133:0/1343464638 conn(0x7fea1c0c8200 msgr2=0x7fea1c0c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 shutdown_connections 2024-01-21T19:59:19.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.506+0000 7fea22b81700 1 -- 172.21.15.133:0/1343464638 wait complete. 2024-01-21T19:59:19.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-01-21T19:59:19.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-21T19:59:19.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.634+0000 7feef91fd700 1 Processor -- start 2024-01-21T19:59:19.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.634+0000 7feef91fd700 1 -- start start 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef91fd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feef4155b80 0x7feef40c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef91fd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4065660 con 0x7feef40beb30 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef91fd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4065f00 con 0x7feef4069ef0 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef91fd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40bef10 con 0x7feef4155b80 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef2d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feef40beb30 0x7feef40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56108/0 (socket says 172.21.15.133:56108) 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef2d9d700 1 -- 172.21.15.133:0/3369186158 learned_addr learned my addr 172.21.15.133:0/3369186158 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:19.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef359e700 1 --2- 172.21.15.133:0/3369186158 >> v2:172.21.15.178:3300/0 conn(0x7feef4155b80 0x7feef40c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973775421 0 0) 0x7feef4065660 con 0x7feef40beb30 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc0033f0 con 0x7feef40beb30 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776451069 0 0) 0x7feedc0033f0 con 0x7feef40beb30 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 >> v2:172.21.15.178:3300/0 conn(0x7feef4155b80 msgr2=0x7feef40c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 --2- 172.21.15.133:0/3369186158 >> v2:172.21.15.178:3300/0 conn(0x7feef4155b80 0x7feef40c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 >> v1:172.21.15.178:6789/0 conn(0x7feef4069ef0 legacy=0x7feef4066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40c44a0 con 0x7feef40beb30 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7feee4001470 con 0x7feef40beb30 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 >> v1:172.21.15.133:6789/0 conn(0x7feef40beb30 legacy=0x7feef40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc005050 0x7feedc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40bef10 con 0x7feedc004690 2024-01-21T19:59:19.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00bfe0 con 0x7feedc0038e0 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc00c1a0 con 0x7feedc005050 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.635+0000 7feef259c700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef2d9d700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef359e700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc005050 0x7feedc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 -- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc005050 msgr2=0x7feedc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc005050 0x7feedc00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 -- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feedc0038e0 msgr2=0x7feedc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feedc0038e0 0x7feedc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 -- 172.21.15.133:0/3369186158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0033f0 con 0x7feedc004690 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef359e700 1 -- 172.21.15.133:0/3369186158 reap_dead start 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef259c700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 0x7feedc004b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7feef40a76f0 tx=0x7feee8007bb0).ready entity=mon.0 client_cookie=933674826b5ed7c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8007020 con 0x7feedc004690 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8007180 con 0x7feedc004690 2024-01-21T19:59:19.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef1d9b700 1 -- 172.21.15.133:0/3369186158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8007520 con 0x7feedc004690 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef91fd700 1 -- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 msgr2=0x7feedc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef91fd700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 0x7feedc004b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7feef40a76f0 tx=0x7feee8007bb0).stop 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef91fd700 1 -- 172.21.15.133:0/3369186158 shutdown_connections 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef91fd700 1 --2- 172.21.15.133:0/3369186158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feedc004690 0x7feedc004b10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.636+0000 7feef91fd700 1 -- 172.21.15.133:0/3369186158 >> 172.21.15.133:0/3369186158 conn(0x7feef40c8010 msgr2=0x7feef40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.637+0000 7feef91fd700 1 -- 172.21.15.133:0/3369186158 shutdown_connections 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.637+0000 7feef91fd700 1 -- 172.21.15.133:0/3369186158 wait complete. 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.638+0000 7feef91fd700 1 Processor -- start 2024-01-21T19:59:19.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.638+0000 7feef91fd700 1 -- start start 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc004690 0x7feef4154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4137ea0 0x7feef4138300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40c1650 con 0x7feef40c0b60 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40c1370 con 0x7feef4137ea0 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40bf1e0 con 0x7feedc004690 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60422/0 (socket says 172.21.15.133:60422) 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 -- 172.21.15.133:0/2397786394 learned_addr learned my addr 172.21.15.133:0/2397786394 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef2d9d700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc004690 0x7feef4154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef359e700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4137ea0 0x7feef4138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 -- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc004690 msgr2=0x7feef4154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc004690 0x7feef4154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 -- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4137ea0 msgr2=0x7feef4138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4137ea0 0x7feef4138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 -- 172.21.15.133:0/2397786394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40bf4c0 con 0x7feef40c0b60 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef259c700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7feee8000fd0 tx=0x7feee8013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8007750 con 0x7feef40c0b60 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8013670 con 0x7feef40c0b60 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef40bf7a0 con 0x7feef40c0b60 2024-01-21T19:59:19.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.639+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80139f0 con 0x7feef40c0b60 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.640+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef40c01b0 con 0x7feef40c0b60 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.641+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef405fdf0 con 0x7feef40c0b60 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.641+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feee8028480 con 0x7feef40c0b60 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.642+0000 7feedb7fe700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 0x7feee0061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.642+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feee807a9d0 con 0x7feef40c0b60 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.642+0000 7feef2d9d700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 0x7feee0061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.642+0000 7feef2d9d700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 0x7feee0061640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feee4000e50 tx=0x7feee4001e50).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.645+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feee804bc40 con 0x7feef40c0b60 2024-01-21T19:59:19.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.810+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7feef40c1650 con 0x7feef40c0b60 2024-01-21T19:59:19.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.810+0000 7feedb7fe700 1 -- 172.21.15.133:0/2397786394 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feee8023070 con 0x7feef40c0b60 2024-01-21T19:59:19.802 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 msgr2=0x7feee0061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 0x7feee0061640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7feee4000e50 tx=0x7feee4001e50).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 msgr2=0x7feef40bfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7feee8000fd0 tx=0x7feee8013000).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 shutdown_connections 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f180 0x7feee0061640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4137ea0 0x7feef4138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feedc004690 0x7feef4154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 --2- 172.21.15.133:0/2397786394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef40c0b60 0x7feef40bfcc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 >> 172.21.15.133:0/2397786394 conn(0x7feef40c8010 msgr2=0x7feef4138930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 shutdown_connections 2024-01-21T19:59:19.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.812+0000 7feef91fd700 1 -- 172.21.15.133:0/2397786394 wait complete. 2024-01-21T19:59:19.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-01-21T19:59:19.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-21T19:59:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.941+0000 7eff7283b700 1 Processor -- start 2024-01-21T19:59:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.941+0000 7eff7283b700 1 -- start start 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.941+0000 7eff7283b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff6c0a9e30 0x7eff6c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff7283b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff6c065fb0 0x7eff6c0bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff7283b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c1511f0 con 0x7eff6c0bd140 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff7283b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c0c2ff0 con 0x7eff6c065fb0 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff7283b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c065b20 con 0x7eff6c0a9e30 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff6c065fb0 0x7eff6c0bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff6c065fb0 0x7eff6c0bcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60432/0 (socket says 172.21.15.133:60432) 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 -- 172.21.15.133:0/3980773523 learned_addr learned my addr 172.21.15.133:0/3980773523 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6bfff700 1 --2- 172.21.15.133:0/3980773523 >> v2:172.21.15.178:3300/0 conn(0x7eff6c0a9e30 0x7eff6c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 -- 172.21.15.133:0/3980773523 >> v2:172.21.15.178:3300/0 conn(0x7eff6c0a9e30 msgr2=0x7eff6c0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 --2- 172.21.15.133:0/3980773523 >> v2:172.21.15.178:3300/0 conn(0x7eff6c0a9e30 0x7eff6c0c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 -- 172.21.15.133:0/3980773523 >> v1:172.21.15.178:6789/0 conn(0x7eff6c0bd140 legacy=0x7eff6c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 -- 172.21.15.133:0/3980773523 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c0c2240 con 0x7eff6c065fb0 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6b7fe700 1 --2- 172.21.15.133:0/3980773523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c065fb0 0x7eff6c0bcc50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7eff6c05f0d0 tx=0x7eff600090f0).ready entity=mon.0 client_cookie=e96deaccb8f04630 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6affd700 1 -- 172.21.15.133:0/3980773523 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000b520 con 0x7eff6c065fb0 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6affd700 1 -- 172.21.15.133:0/3980773523 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6000b680 con 0x7eff6c065fb0 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.942+0000 7eff6affd700 1 -- 172.21.15.133:0/3980773523 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000ba20 con 0x7eff6c065fb0 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 -- 172.21.15.133:0/3980773523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c065fb0 msgr2=0x7eff6c0bcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 --2- 172.21.15.133:0/3980773523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c065fb0 0x7eff6c0bcc50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7eff6c05f0d0 tx=0x7eff600090f0).stop 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 -- 172.21.15.133:0/3980773523 shutdown_connections 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 --2- 172.21.15.133:0/3980773523 >> v2:172.21.15.178:3300/0 conn(0x7eff6c0a9e30 0x7eff6c0c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 --2- 172.21.15.133:0/3980773523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c065fb0 0x7eff6c0bcc50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 -- 172.21.15.133:0/3980773523 >> 172.21.15.133:0/3980773523 conn(0x7eff6c0c8200 msgr2=0x7eff6c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 -- 172.21.15.133:0/3980773523 shutdown_connections 2024-01-21T19:59:19.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.943+0000 7eff7283b700 1 -- 172.21.15.133:0/3980773523 wait complete. 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.944+0000 7eff7283b700 1 Processor -- start 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.944+0000 7eff7283b700 1 -- start start 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff6c065fb0 0x7eff6c13b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff6c0bd140 0x7eff6c0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0bf2e0 con 0x7eff6c0a9e30 2024-01-21T19:59:19.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c0acb30 con 0x7eff6c0bd140 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff7283b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c13beb0 con 0x7eff6c065fb0 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60446/0 (socket says 172.21.15.133:60446) 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 -- 172.21.15.133:0/2882325405 learned_addr learned my addr 172.21.15.133:0/2882325405 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6bfff700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff6c065fb0 0x7eff6c13b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff70dd8700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff6c0bd140 0x7eff6c0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 -- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff6c065fb0 msgr2=0x7eff6c13b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff6c065fb0 0x7eff6c13b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 -- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff6c0bd140 msgr2=0x7eff6c0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff6c0bd140 0x7eff6c0ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 -- 172.21.15.133:0/2882325405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009370 con 0x7eff6c0a9e30 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.945+0000 7eff6b7fe700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7eff6c05f8e0 tx=0x7eff60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.946+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60000bc0 con 0x7eff6c0a9e30 2024-01-21T19:59:19.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.946+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6000b7f0 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.946+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c14cc40 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.946+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60000d20 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.946+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c0bec20 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.947+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c0bf420 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.947+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7eff6001c630 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.947+0000 7eff68ff9700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 0x7eff58061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.947+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7eff6007be10 con 0x7eff6c0a9e30 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.947+0000 7eff6bfff700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 0x7eff58061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.948+0000 7eff6bfff700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 0x7eff58061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7eff5c009bc0 tx=0x7eff5c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:19.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:19.951+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7eff6c0bf420 con 0x7eff6c0a9e30 2024-01-21T19:59:20.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.116+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7eff6c0bf420 con 0x7eff6c0a9e30 2024-01-21T19:59:20.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.116+0000 7eff68ff9700 1 -- 172.21.15.133:0/2882325405 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff6c0bf420 con 0x7eff6c0a9e30 2024-01-21T19:59:20.108 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-01-21T19:59:20.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 msgr2=0x7eff58061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 0x7eff58061610 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7eff5c009bc0 tx=0x7eff5c008040).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 msgr2=0x7eff6c0ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7eff6c05f8e0 tx=0x7eff60017000).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 shutdown_connections 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7eff5805f150 0x7eff58061610 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff6c0bd140 0x7eff6c0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff6c065fb0 0x7eff6c13b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 --2- 172.21.15.133:0/2882325405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff6c0a9e30 0x7eff6c0ac150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 >> 172.21.15.133:0/2882325405 conn(0x7eff6c0c8200 msgr2=0x7eff6c0c0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 shutdown_connections 2024-01-21T19:59:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.118+0000 7eff7283b700 1 -- 172.21.15.133:0/2882325405 wait complete. 2024-01-21T19:59:20.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-01-21T19:59:20.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-21T19:59:20.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.245+0000 7f2fddd9d700 1 Processor -- start 2024-01-21T19:59:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.245+0000 7f2fddd9d700 1 -- start start 2024-01-21T19:59:20.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fddd9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fd81351b0 0x7f2fd80c3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fddd9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2fd8153290 0x7f2fd80c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fddd9d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd81536c0 con 0x7f2fd8135590 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fddd9d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd8068860 con 0x7f2fd81351b0 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fddd9d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd8067c90 con 0x7f2fd8153290 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fdcd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fd81351b0 0x7f2fd80c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fd7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fd8135590 0x7f2fd8152b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42536/0 (socket says 172.21.15.133:42536) 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.246+0000 7f2fd7fff700 1 -- 172.21.15.133:0/1544789869 learned_addr learned my addr 172.21.15.133:0/1544789869 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdd59c700 1 --2- 172.21.15.133:0/1544789869 >> v2:172.21.15.178:3300/0 conn(0x7f2fd8153290 0x7f2fd80c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fd77fe700 1 -- 172.21.15.133:0/1544789869 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757256209 0 0) 0x7f2fc4001110 con 0x7f2fd8135590 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fd77fe700 1 -- 172.21.15.133:0/1544789869 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc80033f0 con 0x7f2fd8135590 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/1544789869 >> v2:172.21.15.178:3300/0 conn(0x7f2fd8153290 msgr2=0x7f2fd80c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdcd9b700 1 --2- 172.21.15.133:0/1544789869 >> v2:172.21.15.178:3300/0 conn(0x7f2fd8153290 0x7f2fd80c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/1544789869 >> v1:172.21.15.133:6789/0 conn(0x7f2fd8135590 legacy=0x7f2fd8152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/1544789869 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80c3e70 con 0x7f2fd81351b0 2024-01-21T19:59:20.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fdcd9b700 1 --2- 172.21.15.133:0/1544789869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd80c3490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2fd80672e0 tx=0x7f2fcc009060).ready entity=mon.0 client_cookie=6bc8264a1374a631 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fd77fe700 1 -- 172.21.15.133:0/1544789869 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0090d0 con 0x7f2fd81351b0 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fd77fe700 1 -- 172.21.15.133:0/1544789869 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00d4a0 con 0x7f2fd81351b0 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.247+0000 7f2fd77fe700 1 -- 172.21.15.133:0/1544789869 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00d820 con 0x7f2fd81351b0 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 -- 172.21.15.133:0/1544789869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 msgr2=0x7f2fd80c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/1544789869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd80c3490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2fd80672e0 tx=0x7f2fcc009060).stop 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 -- 172.21.15.133:0/1544789869 shutdown_connections 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/1544789869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd80c3490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/1544789869 >> v2:172.21.15.178:3300/0 conn(0x7f2fd8153290 0x7f2fd80c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 -- 172.21.15.133:0/1544789869 >> 172.21.15.133:0/1544789869 conn(0x7f2fd80c5930 msgr2=0x7f2fd80c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 -- 172.21.15.133:0/1544789869 shutdown_connections 2024-01-21T19:59:20.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.248+0000 7f2fddd9d700 1 -- 172.21.15.133:0/1544789869 wait complete. 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.249+0000 7f2fddd9d700 1 Processor -- start 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.249+0000 7f2fddd9d700 1 -- start start 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd8135590 0x7f2fd8162a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd8153290 0x7f2fd8161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81600f0 con 0x7f2fd81351b0 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81641c0 con 0x7f2fd8153290 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8162f00 con 0x7f2fd8135590 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51882/0 (socket says 172.21.15.133:51882) 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/2385625973 learned_addr learned my addr 172.21.15.133:0/2385625973 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd8135590 msgr2=0x7f2fd8162a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd8135590 0x7f2fd8162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd8153290 msgr2=0x7f2fd8161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdd59c700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd8153290 0x7f2fd8161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd8153290 0x7f2fd8161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 -- 172.21.15.133:0/2385625973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc0092a0 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fdcd9b700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2fcc009d20 tx=0x7f2fcc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0128d0 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc012a30 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd80aae00 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc012df0 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.250+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd8163890 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd806c7b0 con 0x7f2fd81351b0 2024-01-21T19:59:20.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2fcc01c630 con 0x7f2fd81351b0 2024-01-21T19:59:20.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fd57fa700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 0x7f2fbc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2fcc07b750 con 0x7f2fd81351b0 2024-01-21T19:59:20.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fd7fff700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 0x7f2fbc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.252+0000 7f2fd7fff700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 0x7f2fbc061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2fc4005750 tx=0x7f2fc40011a0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.256+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2fcc04ca20 con 0x7f2fd81351b0 2024-01-21T19:59:20.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.416+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fd8066060 con 0x7f2fbc05f150 2024-01-21T19:59:20.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.425+0000 7f2fd57fa700 1 -- 172.21.15.133:0/2385625973 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336328 (secure 0 0 0) 0x7f2fd8066060 con 0x7f2fbc05f150 2024-01-21T19:59:20.421 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:20.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.428+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 msgr2=0x7f2fbc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 0x7f2fbc061610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2fc4005750 tx=0x7f2fc40011a0).stop 2024-01-21T19:59:20.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 msgr2=0x7f2fd815fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2fcc009d20 tx=0x7f2fcc016000).stop 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 shutdown_connections 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2fbc05f150 0x7f2fbc061610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd8153290 0x7f2fd8161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd81351b0 0x7f2fd815fc00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 --2- 172.21.15.133:0/2385625973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd8135590 0x7f2fd8162a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 >> 172.21.15.133:0/2385625973 conn(0x7f2fd80c5930 msgr2=0x7f2fd80c3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 shutdown_connections 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.429+0000 7f2fddd9d700 1 -- 172.21.15.133:0/2385625973 wait complete. 2024-01-21T19:59:20.424 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:20.432 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-21T19:59:19.851310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378616,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596104,"statfs":{"total":773094113280,"available":770658410496,"internally_reserved":0,"allocated":1892352,"data_stored":685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002748"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408931+0000","last_change":"2024-01-21T19:59:06.407131+0000","last_active":"2024-01-21T19:59:06.408931+0000","last_peered":"2024-01-21T19:59:06.408931+0000","last_clean":"2024-01-21T19:59:06.408931+0000","last_became_active":"2024-01-21T19:59:06.406853+0000","last_became_peered":"2024-01-21T19:59:06.406853+0000","last_unstale":"2024-01-21T19:59:06.408931+0000","last_undegraded":"2024-01-21T19:59:06.408931+0000","last_fullsized":"2024-01-21T19:59:06.408931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405624+0000","last_change":"2024-01-21T19:59:06.034930+0000","last_active":"2024-01-21T19:59:06.405624+0000","last_peered":"2024-01-21T19:59:06.405624+0000","last_clean":"2024-01-21T19:59:06.405624+0000","last_became_active":"2024-01-21T19:59:06.034648+0000","last_became_peered":"2024-01-21T19:59:06.034648+0000","last_unstale":"2024-01-21T19:59:06.405624+0000","last_undegraded":"2024-01-21T19:59:06.405624+0000","last_fullsized":"2024-01-21T19:59:06.405624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415745+0000","last_change":"2024-01-21T19:59:06.414371+0000","last_active":"2024-01-21T19:59:06.415745+0000","last_peered":"2024-01-21T19:59:06.415745+0000","last_clean":"2024-01-21T19:59:06.415745+0000","last_became_active":"2024-01-21T19:59:06.414078+0000","last_became_peered":"2024-01-21T19:59:06.414078+0000","last_unstale":"2024-01-21T19:59:06.415745+0000","last_undegraded":"2024-01-21T19:59:06.415745+0000","last_fullsized":"2024-01-21T19:59:06.415745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403854+0000","last_change":"2024-01-21T19:59:06.035542+0000","last_active":"2024-01-21T19:59:06.403854+0000","last_peered":"2024-01-21T19:59:06.403854+0000","last_clean":"2024-01-21T19:59:06.403854+0000","last_became_active":"2024-01-21T19:59:06.035262+0000","last_became_peered":"2024-01-21T19:59:06.035262+0000","last_unstale":"2024-01-21T19:59:06.403854+0000","last_undegraded":"2024-01-21T19:59:06.403854+0000","last_fullsized":"2024-01-21T19:59:06.403854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406814+0000","last_change":"2024-01-21T19:59:06.405992+0000","last_active":"2024-01-21T19:59:06.406814+0000","last_peered":"2024-01-21T19:59:06.406814+0000","last_clean":"2024-01-21T19:59:06.406814+0000","last_became_active":"2024-01-21T19:59:06.405013+0000","last_became_peered":"2024-01-21T19:59:06.405013+0000","last_unstale":"2024-01-21T19:59:06.406814+0000","last_undegraded":"2024-01-21T19:59:06.406814+0000","last_fullsized":"2024-01-21T19:59:06.406814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392792+0000","last_change":"2024-01-21T19:59:06.041467+0000","last_active":"2024-01-21T19:59:06.392792+0000","last_peered":"2024-01-21T19:59:06.392792+0000","last_clean":"2024-01-21T19:59:06.392792+0000","last_became_active":"2024-01-21T19:59:06.041158+0000","last_became_peered":"2024-01-21T19:59:06.041158+0000","last_unstale":"2024-01-21T19:59:06.392792+0000","last_undegraded":"2024-01-21T19:59:06.392792+0000","last_fullsized":"2024-01-21T19:59:06.392792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408938+0000","last_change":"2024-01-21T19:59:06.407402+0000","last_active":"2024-01-21T19:59:06.408938+0000","last_peered":"2024-01-21T19:59:06.408938+0000","last_clean":"2024-01-21T19:59:06.408938+0000","last_became_active":"2024-01-21T19:59:06.406722+0000","last_became_peered":"2024-01-21T19:59:06.406722+0000","last_unstale":"2024-01-21T19:59:06.408938+0000","last_undegraded":"2024-01-21T19:59:06.408938+0000","last_fullsized":"2024-01-21T19:59:06.408938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392400+0000","last_change":"2024-01-21T19:59:06.038017+0000","last_active":"2024-01-21T19:59:06.392400+0000","last_peered":"2024-01-21T19:59:06.392400+0000","last_clean":"2024-01-21T19:59:06.392400+0000","last_became_active":"2024-01-21T19:59:06.037532+0000","last_became_peered":"2024-01-21T19:59:06.037532+0000","last_unstale":"2024-01-21T19:59:06.392400+0000","last_undegraded":"2024-01-21T19:59:06.392400+0000","last_fullsized":"2024-01-21T19:59:06.392400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415998+0000","last_change":"2024-01-21T19:59:06.415183+0000","last_active":"2024-01-21T19:59:06.415998+0000","last_peered":"2024-01-21T19:59:06.415998+0000","last_clean":"2024-01-21T19:59:06.415998+0000","last_became_active":"2024-01-21T19:59:06.414874+0000","last_became_peered":"2024-01-21T19:59:06.414874+0000","last_unstale":"2024-01-21T19:59:06.415998+0000","last_undegraded":"2024-01-21T19:59:06.415998+0000","last_fullsized":"2024-01-21T19:59:06.415998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392424+0000","last_change":"2024-01-21T19:59:06.039345+0000","last_active":"2024-01-21T19:59:06.392424+0000","last_peered":"2024-01-21T19:59:06.392424+0000","last_clean":"2024-01-21T19:59:06.392424+0000","last_became_active":"2024-01-21T19:59:06.039077+0000","last_became_peered":"2024-01-21T19:59:06.039077+0000","last_unstale":"2024-01-21T19:59:06.392424+0000","last_undegraded":"2024-01-21T19:59:06.392424+0000","last_fullsized":"2024-01-21T19:59:06.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412461+0000","last_change":"2024-01-21T19:59:06.408094+0000","last_active":"2024-01-21T19:59:06.412461+0000","last_peered":"2024-01-21T19:59:06.412461+0000","last_clean":"2024-01-21T19:59:06.412461+0000","last_became_active":"2024-01-21T19:59:06.407833+0000","last_became_peered":"2024-01-21T19:59:06.407833+0000","last_unstale":"2024-01-21T19:59:06.412461+0000","last_undegraded":"2024-01-21T19:59:06.412461+0000","last_fullsized":"2024-01-21T19:59:06.412461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417155+0000","last_change":"2024-01-21T19:59:06.037535+0000","last_active":"2024-01-21T19:59:06.417155+0000","last_peered":"2024-01-21T19:59:06.417155+0000","last_clean":"2024-01-21T19:59:06.417155+0000","last_became_active":"2024-01-21T19:59:06.037260+0000","last_became_peered":"2024-01-21T19:59:06.037260+0000","last_unstale":"2024-01-21T19:59:06.417155+0000","last_undegraded":"2024-01-21T19:59:06.417155+0000","last_fullsized":"2024-01-21T19:59:06.417155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415420+0000","last_change":"2024-01-21T19:59:06.411473+0000","last_active":"2024-01-21T19:59:06.415420+0000","last_peered":"2024-01-21T19:59:06.415420+0000","last_clean":"2024-01-21T19:59:06.415420+0000","last_became_active":"2024-01-21T19:59:06.408751+0000","last_became_peered":"2024-01-21T19:59:06.408751+0000","last_unstale":"2024-01-21T19:59:06.415420+0000","last_undegraded":"2024-01-21T19:59:06.415420+0000","last_fullsized":"2024-01-21T19:59:06.415420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419677+0000","last_change":"2024-01-21T19:59:06.037480+0000","last_active":"2024-01-21T19:59:06.419677+0000","last_peered":"2024-01-21T19:59:06.419677+0000","last_clean":"2024-01-21T19:59:06.419677+0000","last_became_active":"2024-01-21T19:59:06.037054+0000","last_became_peered":"2024-01-21T19:59:06.037054+0000","last_unstale":"2024-01-21T19:59:06.419677+0000","last_undegraded":"2024-01-21T19:59:06.419677+0000","last_fullsized":"2024-01-21T19:59:06.419677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413369+0000","last_change":"2024-01-21T19:59:06.411113+0000","last_active":"2024-01-21T19:59:06.413369+0000","last_peered":"2024-01-21T19:59:06.413369+0000","last_clean":"2024-01-21T19:59:06.413369+0000","last_became_active":"2024-01-21T19:59:06.410842+0000","last_became_peered":"2024-01-21T19:59:06.410842+0000","last_unstale":"2024-01-21T19:59:06.413369+0000","last_undegraded":"2024-01-21T19:59:06.413369+0000","last_fullsized":"2024-01-21T19:59:06.413369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415706+0000","last_change":"2024-01-21T19:59:06.042850+0000","last_active":"2024-01-21T19:59:06.415706+0000","last_peered":"2024-01-21T19:59:06.415706+0000","last_clean":"2024-01-21T19:59:06.415706+0000","last_became_active":"2024-01-21T19:59:06.041938+0000","last_became_peered":"2024-01-21T19:59:06.041938+0000","last_unstale":"2024-01-21T19:59:06.415706+0000","last_undegraded":"2024-01-21T19:59:06.415706+0000","last_fullsized":"2024-01-21T19:59:06.415706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413389+0000","last_change":"2024-01-21T19:59:06.411722+0000","last_active":"2024-01-21T19:59:06.413389+0000","last_peered":"2024-01-21T19:59:06.413389+0000","last_clean":"2024-01-21T19:59:06.413389+0000","last_became_active":"2024-01-21T19:59:06.411400+0000","last_became_peered":"2024-01-21T19:59:06.411400+0000","last_unstale":"2024-01-21T19:59:06.413389+0000","last_undegraded":"2024-01-21T19:59:06.413389+0000","last_fullsized":"2024-01-21T19:59:06.413389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392771+0000","last_change":"2024-01-21T19:59:06.040019+0000","last_active":"2024-01-21T19:59:06.392771+0000","last_peered":"2024-01-21T19:59:06.392771+0000","last_clean":"2024-01-21T19:59:06.392771+0000","last_became_active":"2024-01-21T19:59:06.038603+0000","last_became_peered":"2024-01-21T19:59:06.038603+0000","last_unstale":"2024-01-21T19:59:06.392771+0000","last_undegraded":"2024-01-21T19:59:06.392771+0000","last_fullsized":"2024-01-21T19:59:06.392771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401930+0000","last_change":"2024-01-21T19:59:06.397578+0000","last_active":"2024-01-21T19:59:06.401930+0000","last_peered":"2024-01-21T19:59:06.401930+0000","last_clean":"2024-01-21T19:59:06.401930+0000","last_became_active":"2024-01-21T19:59:06.397304+0000","last_became_peered":"2024-01-21T19:59:06.397304+0000","last_unstale":"2024-01-21T19:59:06.401930+0000","last_undegraded":"2024-01-21T19:59:06.401930+0000","last_fullsized":"2024-01-21T19:59:06.401930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405880+0000","last_change":"2024-01-21T19:59:06.037427+0000","last_active":"2024-01-21T19:59:06.405880+0000","last_peered":"2024-01-21T19:59:06.405880+0000","last_clean":"2024-01-21T19:59:06.405880+0000","last_became_active":"2024-01-21T19:59:06.037106+0000","last_became_peered":"2024-01-21T19:59:06.037106+0000","last_unstale":"2024-01-21T19:59:06.405880+0000","last_undegraded":"2024-01-21T19:59:06.405880+0000","last_fullsized":"2024-01-21T19:59:06.405880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412944+0000","last_change":"2024-01-21T19:59:06.410874+0000","last_active":"2024-01-21T19:59:06.412944+0000","last_peered":"2024-01-21T19:59:06.412944+0000","last_clean":"2024-01-21T19:59:06.412944+0000","last_became_active":"2024-01-21T19:59:06.410611+0000","last_became_peered":"2024-01-21T19:59:06.410611+0000","last_unstale":"2024-01-21T19:59:06.412944+0000","last_undegraded":"2024-01-21T19:59:06.412944+0000","last_fullsized":"2024-01-21T19:59:06.412944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407859+0000","last_change":"2024-01-21T19:59:06.041197+0000","last_active":"2024-01-21T19:59:06.407859+0000","last_peered":"2024-01-21T19:59:06.407859+0000","last_clean":"2024-01-21T19:59:06.407859+0000","last_became_active":"2024-01-21T19:59:06.040869+0000","last_became_peered":"2024-01-21T19:59:06.040869+0000","last_unstale":"2024-01-21T19:59:06.407859+0000","last_undegraded":"2024-01-21T19:59:06.407859+0000","last_fullsized":"2024-01-21T19:59:06.407859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413128+0000","last_change":"2024-01-21T19:59:06.411500+0000","last_active":"2024-01-21T19:59:06.413128+0000","last_peered":"2024-01-21T19:59:06.413128+0000","last_clean":"2024-01-21T19:59:06.413128+0000","last_became_active":"2024-01-21T19:59:06.411276+0000","last_became_peered":"2024-01-21T19:59:06.411276+0000","last_unstale":"2024-01-21T19:59:06.413128+0000","last_undegraded":"2024-01-21T19:59:06.413128+0000","last_fullsized":"2024-01-21T19:59:06.413128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415690+0000","last_change":"2024-01-21T19:59:06.038505+0000","last_active":"2024-01-21T19:59:06.415690+0000","last_peered":"2024-01-21T19:59:06.415690+0000","last_clean":"2024-01-21T19:59:06.415690+0000","last_became_active":"2024-01-21T19:59:06.038100+0000","last_became_peered":"2024-01-21T19:59:06.038100+0000","last_unstale":"2024-01-21T19:59:06.415690+0000","last_undegraded":"2024-01-21T19:59:06.415690+0000","last_fullsized":"2024-01-21T19:59:06.415690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415464+0000","last_change":"2024-01-21T19:59:06.412541+0000","last_active":"2024-01-21T19:59:06.415464+0000","last_peered":"2024-01-21T19:59:06.415464+0000","last_clean":"2024-01-21T19:59:06.415464+0000","last_became_active":"2024-01-21T19:59:06.412353+0000","last_became_peered":"2024-01-21T19:59:06.412353+0000","last_unstale":"2024-01-21T19:59:06.415464+0000","last_undegraded":"2024-01-21T19:59:06.415464+0000","last_fullsized":"2024-01-21T19:59:06.415464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418953+0000","last_change":"2024-01-21T19:59:06.034594+0000","last_active":"2024-01-21T19:59:06.418953+0000","last_peered":"2024-01-21T19:59:06.418953+0000","last_clean":"2024-01-21T19:59:06.418953+0000","last_became_active":"2024-01-21T19:59:06.034292+0000","last_became_peered":"2024-01-21T19:59:06.034292+0000","last_unstale":"2024-01-21T19:59:06.418953+0000","last_undegraded":"2024-01-21T19:59:06.418953+0000","last_fullsized":"2024-01-21T19:59:06.418953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416149+0000","last_change":"2024-01-21T19:59:06.411225+0000","last_active":"2024-01-21T19:59:06.416149+0000","last_peered":"2024-01-21T19:59:06.416149+0000","last_clean":"2024-01-21T19:59:06.416149+0000","last_became_active":"2024-01-21T19:59:06.410953+0000","last_became_peered":"2024-01-21T19:59:06.410953+0000","last_unstale":"2024-01-21T19:59:06.416149+0000","last_undegraded":"2024-01-21T19:59:06.416149+0000","last_fullsized":"2024-01-21T19:59:06.416149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399828+0000","last_change":"2024-01-21T19:59:06.037843+0000","last_active":"2024-01-21T19:59:06.399828+0000","last_peered":"2024-01-21T19:59:06.399828+0000","last_clean":"2024-01-21T19:59:06.399828+0000","last_became_active":"2024-01-21T19:59:06.033911+0000","last_became_peered":"2024-01-21T19:59:06.033911+0000","last_unstale":"2024-01-21T19:59:06.399828+0000","last_undegraded":"2024-01-21T19:59:06.399828+0000","last_fullsized":"2024-01-21T19:59:06.399828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.411011+0000","last_change":"2024-01-21T19:59:06.409655+0000","last_active":"2024-01-21T19:59:06.411011+0000","last_peered":"2024-01-21T19:59:06.411011+0000","last_clean":"2024-01-21T19:59:06.411011+0000","last_became_active":"2024-01-21T19:59:06.408656+0000","last_became_peered":"2024-01-21T19:59:06.408656+0000","last_unstale":"2024-01-21T19:59:06.411011+0000","last_undegraded":"2024-01-21T19:59:06.411011+0000","last_fullsized":"2024-01-21T19:59:06.411011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392261+0000","last_change":"2024-01-21T19:59:06.036207+0000","last_active":"2024-01-21T19:59:06.392261+0000","last_peered":"2024-01-21T19:59:06.392261+0000","last_clean":"2024-01-21T19:59:06.392261+0000","last_became_active":"2024-01-21T19:59:06.035921+0000","last_became_peered":"2024-01-21T19:59:06.035921+0000","last_unstale":"2024-01-21T19:59:06.392261+0000","last_undegraded":"2024-01-21T19:59:06.392261+0000","last_fullsized":"2024-01-21T19:59:06.392261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416535+0000","last_change":"2024-01-21T19:59:06.406341+0000","last_active":"2024-01-21T19:59:06.416535+0000","last_peered":"2024-01-21T19:59:06.416535+0000","last_clean":"2024-01-21T19:59:06.416535+0000","last_became_active":"2024-01-21T19:59:06.405508+0000","last_became_peered":"2024-01-21T19:59:06.405508+0000","last_unstale":"2024-01-21T19:59:06.416535+0000","last_undegraded":"2024-01-21T19:59:06.416535+0000","last_fullsized":"2024-01-21T19:59:06.416535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399066+0000","last_change":"2024-01-21T19:59:06.042182+0000","last_active":"2024-01-21T19:59:06.399066+0000","last_peered":"2024-01-21T19:59:06.399066+0000","last_clean":"2024-01-21T19:59:06.399066+0000","last_became_active":"2024-01-21T19:59:06.041899+0000","last_became_peered":"2024-01-21T19:59:06.041899+0000","last_unstale":"2024-01-21T19:59:06.399066+0000","last_undegraded":"2024-01-21T19:59:06.399066+0000","last_fullsized":"2024-01-21T19:59:06.399066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417530+0000","last_change":"2024-01-21T19:59:06.408589+0000","last_active":"2024-01-21T19:59:06.417530+0000","last_peered":"2024-01-21T19:59:06.417530+0000","last_clean":"2024-01-21T19:59:06.417530+0000","last_became_active":"2024-01-21T19:59:06.407943+0000","last_became_peered":"2024-01-21T19:59:06.407943+0000","last_unstale":"2024-01-21T19:59:06.417530+0000","last_undegraded":"2024-01-21T19:59:06.417530+0000","last_fullsized":"2024-01-21T19:59:06.417530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396785+0000","last_change":"2024-01-21T19:59:06.030824+0000","last_active":"2024-01-21T19:59:06.396785+0000","last_peered":"2024-01-21T19:59:06.396785+0000","last_clean":"2024-01-21T19:59:06.396785+0000","last_became_active":"2024-01-21T19:59:06.030428+0000","last_became_peered":"2024-01-21T19:59:06.030428+0000","last_unstale":"2024-01-21T19:59:06.396785+0000","last_undegraded":"2024-01-21T19:59:06.396785+0000","last_fullsized":"2024-01-21T19:59:06.396785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415606+0000","last_change":"2024-01-21T19:59:06.409370+0000","last_active":"2024-01-21T19:59:06.415606+0000","last_peered":"2024-01-21T19:59:06.415606+0000","last_clean":"2024-01-21T19:59:06.415606+0000","last_became_active":"2024-01-21T19:59:06.406417+0000","last_became_peered":"2024-01-21T19:59:06.406417+0000","last_unstale":"2024-01-21T19:59:06.415606+0000","last_undegraded":"2024-01-21T19:59:06.415606+0000","last_fullsized":"2024-01-21T19:59:06.415606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406327+0000","last_change":"2024-01-21T19:59:06.035645+0000","last_active":"2024-01-21T19:59:06.406327+0000","last_peered":"2024-01-21T19:59:06.406327+0000","last_clean":"2024-01-21T19:59:06.406327+0000","last_became_active":"2024-01-21T19:59:06.035356+0000","last_became_peered":"2024-01-21T19:59:06.035356+0000","last_unstale":"2024-01-21T19:59:06.406327+0000","last_undegraded":"2024-01-21T19:59:06.406327+0000","last_fullsized":"2024-01-21T19:59:06.406327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412394+0000","last_change":"2024-01-21T19:59:06.407766+0000","last_active":"2024-01-21T19:59:06.412394+0000","last_peered":"2024-01-21T19:59:06.412394+0000","last_clean":"2024-01-21T19:59:06.412394+0000","last_became_active":"2024-01-21T19:59:06.407502+0000","last_became_peered":"2024-01-21T19:59:06.407502+0000","last_unstale":"2024-01-21T19:59:06.412394+0000","last_undegraded":"2024-01-21T19:59:06.412394+0000","last_fullsized":"2024-01-21T19:59:06.412394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392023+0000","last_change":"2024-01-21T19:59:06.036576+0000","last_active":"2024-01-21T19:59:06.392023+0000","last_peered":"2024-01-21T19:59:06.392023+0000","last_clean":"2024-01-21T19:59:06.392023+0000","last_became_active":"2024-01-21T19:59:06.036282+0000","last_became_peered":"2024-01-21T19:59:06.036282+0000","last_unstale":"2024-01-21T19:59:06.392023+0000","last_undegraded":"2024-01-21T19:59:06.392023+0000","last_fullsized":"2024-01-21T19:59:06.392023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403780+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:06.403780+0000","last_peered":"2024-01-21T19:59:06.403780+0000","last_clean":"2024-01-21T19:59:06.403780+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:06.403780+0000","last_undegraded":"2024-01-21T19:59:06.403780+0000","last_fullsized":"2024-01-21T19:59:06.403780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391912+0000","last_change":"2024-01-21T19:59:06.035851+0000","last_active":"2024-01-21T19:59:06.391912+0000","last_peered":"2024-01-21T19:59:06.391912+0000","last_clean":"2024-01-21T19:59:06.391912+0000","last_became_active":"2024-01-21T19:59:06.035316+0000","last_became_peered":"2024-01-21T19:59:06.035316+0000","last_unstale":"2024-01-21T19:59:06.391912+0000","last_undegraded":"2024-01-21T19:59:06.391912+0000","last_fullsized":"2024-01-21T19:59:06.391912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412286+0000","last_change":"2024-01-21T19:59:06.406779+0000","last_active":"2024-01-21T19:59:06.412286+0000","last_peered":"2024-01-21T19:59:06.412286+0000","last_clean":"2024-01-21T19:59:06.412286+0000","last_became_active":"2024-01-21T19:59:06.406509+0000","last_became_peered":"2024-01-21T19:59:06.406509+0000","last_unstale":"2024-01-21T19:59:06.412286+0000","last_undegraded":"2024-01-21T19:59:06.412286+0000","last_fullsized":"2024-01-21T19:59:06.412286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392515+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:06.392515+0000","last_peered":"2024-01-21T19:59:06.392515+0000","last_clean":"2024-01-21T19:59:06.392515+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:06.392515+0000","last_undegraded":"2024-01-21T19:59:06.392515+0000","last_fullsized":"2024-01-21T19:59:06.392515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407902+0000","last_change":"2024-01-21T19:59:06.041554+0000","last_active":"2024-01-21T19:59:06.407902+0000","last_peered":"2024-01-21T19:59:06.407902+0000","last_clean":"2024-01-21T19:59:06.407902+0000","last_became_active":"2024-01-21T19:59:06.041229+0000","last_became_peered":"2024-01-21T19:59:06.041229+0000","last_unstale":"2024-01-21T19:59:06.407902+0000","last_undegraded":"2024-01-21T19:59:06.407902+0000","last_fullsized":"2024-01-21T19:59:06.407902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412418+0000","last_change":"2024-01-21T19:59:06.407976+0000","last_active":"2024-01-21T19:59:06.412418+0000","last_peered":"2024-01-21T19:59:06.412418+0000","last_clean":"2024-01-21T19:59:06.412418+0000","last_became_active":"2024-01-21T19:59:06.407713+0000","last_became_peered":"2024-01-21T19:59:06.407713+0000","last_unstale":"2024-01-21T19:59:06.412418+0000","last_undegraded":"2024-01-21T19:59:06.412418+0000","last_fullsized":"2024-01-21T19:59:06.412418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412281+0000","last_change":"2024-01-21T19:59:06.406673+0000","last_active":"2024-01-21T19:59:06.412281+0000","last_peered":"2024-01-21T19:59:06.412281+0000","last_clean":"2024-01-21T19:59:06.412281+0000","last_became_active":"2024-01-21T19:59:06.406394+0000","last_became_peered":"2024-01-21T19:59:06.406394+0000","last_unstale":"2024-01-21T19:59:06.412281+0000","last_undegraded":"2024-01-21T19:59:06.412281+0000","last_fullsized":"2024-01-21T19:59:06.412281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388616+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:06.388616+0000","last_peered":"2024-01-21T19:59:06.388616+0000","last_clean":"2024-01-21T19:59:06.388616+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:06.388616+0000","last_undegraded":"2024-01-21T19:59:06.388616+0000","last_fullsized":"2024-01-21T19:59:06.388616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403727+0000","last_change":"2024-01-21T19:59:06.031330+0000","last_active":"2024-01-21T19:59:06.403727+0000","last_peered":"2024-01-21T19:59:06.403727+0000","last_clean":"2024-01-21T19:59:06.403727+0000","last_became_active":"2024-01-21T19:59:06.031043+0000","last_became_peered":"2024-01-21T19:59:06.031043+0000","last_unstale":"2024-01-21T19:59:06.403727+0000","last_undegraded":"2024-01-21T19:59:06.403727+0000","last_fullsized":"2024-01-21T19:59:06.403727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414575+0000","last_change":"2024-01-21T19:59:06.409494+0000","last_active":"2024-01-21T19:59:06.414575+0000","last_peered":"2024-01-21T19:59:06.414575+0000","last_clean":"2024-01-21T19:59:06.414575+0000","last_became_active":"2024-01-21T19:59:06.409221+0000","last_became_peered":"2024-01-21T19:59:06.409221+0000","last_unstale":"2024-01-21T19:59:06.414575+0000","last_undegraded":"2024-01-21T19:59:06.414575+0000","last_fullsized":"2024-01-21T19:59:06.414575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391231+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:06.391231+0000","last_peered":"2024-01-21T19:59:06.391231+0000","last_clean":"2024-01-21T19:59:06.391231+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:06.391231+0000","last_undegraded":"2024-01-21T19:59:06.391231+0000","last_fullsized":"2024-01-21T19:59:06.391231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.398950+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:06.398950+0000","last_peered":"2024-01-21T19:59:06.398950+0000","last_clean":"2024-01-21T19:59:06.398950+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:06.398950+0000","last_undegraded":"2024-01-21T19:59:06.398950+0000","last_fullsized":"2024-01-21T19:59:06.398950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392105+0000","last_change":"2024-01-21T19:59:06.034391+0000","last_active":"2024-01-21T19:59:06.392105+0000","last_peered":"2024-01-21T19:59:06.392105+0000","last_clean":"2024-01-21T19:59:06.392105+0000","last_became_active":"2024-01-21T19:59:06.034060+0000","last_became_peered":"2024-01-21T19:59:06.034060+0000","last_unstale":"2024-01-21T19:59:06.392105+0000","last_undegraded":"2024-01-21T19:59:06.392105+0000","last_fullsized":"2024-01-21T19:59:06.392105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410899+0000","last_change":"2024-01-21T19:59:06.408800+0000","last_active":"2024-01-21T19:59:06.410899+0000","last_peered":"2024-01-21T19:59:06.410899+0000","last_clean":"2024-01-21T19:59:06.410899+0000","last_became_active":"2024-01-21T19:59:06.408515+0000","last_became_peered":"2024-01-21T19:59:06.408515+0000","last_unstale":"2024-01-21T19:59:06.410899+0000","last_undegraded":"2024-01-21T19:59:06.410899+0000","last_fullsized":"2024-01-21T19:59:06.410899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401822+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:06.401822+0000","last_peered":"2024-01-21T19:59:06.401822+0000","last_clean":"2024-01-21T19:59:06.401822+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:06.401822+0000","last_undegraded":"2024-01-21T19:59:06.401822+0000","last_fullsized":"2024-01-21T19:59:06.401822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391457+0000","last_change":"2024-01-21T19:59:06.041530+0000","last_active":"2024-01-21T19:59:06.391457+0000","last_peered":"2024-01-21T19:59:06.391457+0000","last_clean":"2024-01-21T19:59:06.391457+0000","last_became_active":"2024-01-21T19:59:06.041251+0000","last_became_peered":"2024-01-21T19:59:06.041251+0000","last_unstale":"2024-01-21T19:59:06.391457+0000","last_undegraded":"2024-01-21T19:59:06.391457+0000","last_fullsized":"2024-01-21T19:59:06.391457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399714+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:06.399714+0000","last_peered":"2024-01-21T19:59:06.399714+0000","last_clean":"2024-01-21T19:59:06.399714+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:06.399714+0000","last_undegraded":"2024-01-21T19:59:06.399714+0000","last_fullsized":"2024-01-21T19:59:06.399714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403900+0000","last_change":"2024-01-21T19:59:06.031857+0000","last_active":"2024-01-21T19:59:06.403900+0000","last_peered":"2024-01-21T19:59:06.403900+0000","last_clean":"2024-01-21T19:59:06.403900+0000","last_became_active":"2024-01-21T19:59:06.031591+0000","last_became_peered":"2024-01-21T19:59:06.031591+0000","last_unstale":"2024-01-21T19:59:06.403900+0000","last_undegraded":"2024-01-21T19:59:06.403900+0000","last_fullsized":"2024-01-21T19:59:06.403900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402917+0000","last_change":"2024-01-21T19:59:06.401094+0000","last_active":"2024-01-21T19:59:06.402917+0000","last_peered":"2024-01-21T19:59:06.402917+0000","last_clean":"2024-01-21T19:59:06.402917+0000","last_became_active":"2024-01-21T19:59:06.400832+0000","last_became_peered":"2024-01-21T19:59:06.400832+0000","last_unstale":"2024-01-21T19:59:06.402917+0000","last_undegraded":"2024-01-21T19:59:06.402917+0000","last_fullsized":"2024-01-21T19:59:06.402917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410385+0000","last_change":"2024-01-21T19:59:06.039467+0000","last_active":"2024-01-21T19:59:06.410385+0000","last_peered":"2024-01-21T19:59:06.410385+0000","last_clean":"2024-01-21T19:59:06.410385+0000","last_became_active":"2024-01-21T19:59:06.039167+0000","last_became_peered":"2024-01-21T19:59:06.039167+0000","last_unstale":"2024-01-21T19:59:06.410385+0000","last_undegraded":"2024-01-21T19:59:06.410385+0000","last_fullsized":"2024-01-21T19:59:06.410385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405399+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:06.405399+0000","last_peered":"2024-01-21T19:59:06.405399+0000","last_clean":"2024-01-21T19:59:06.405399+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:06.405399+0000","last_undegraded":"2024-01-21T19:59:06.405399+0000","last_fullsized":"2024-01-21T19:59:06.405399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413120+0000","last_change":"2024-01-21T19:59:06.410865+0000","last_active":"2024-01-21T19:59:06.413120+0000","last_peered":"2024-01-21T19:59:06.413120+0000","last_clean":"2024-01-21T19:59:06.413120+0000","last_became_active":"2024-01-21T19:59:06.410572+0000","last_became_peered":"2024-01-21T19:59:06.410572+0000","last_unstale":"2024-01-21T19:59:06.413120+0000","last_undegraded":"2024-01-21T19:59:06.413120+0000","last_fullsized":"2024-01-21T19:59:06.413120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396528+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:06.396528+0000","last_peered":"2024-01-21T19:59:06.396528+0000","last_clean":"2024-01-21T19:59:06.396528+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:06.396528+0000","last_undegraded":"2024-01-21T19:59:06.396528+0000","last_fullsized":"2024-01-21T19:59:06.396528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392481+0000","last_change":"2024-01-21T19:59:06.039407+0000","last_active":"2024-01-21T19:59:06.392481+0000","last_peered":"2024-01-21T19:59:06.392481+0000","last_clean":"2024-01-21T19:59:06.392481+0000","last_became_active":"2024-01-21T19:59:06.039118+0000","last_became_peered":"2024-01-21T19:59:06.039118+0000","last_unstale":"2024-01-21T19:59:06.392481+0000","last_undegraded":"2024-01-21T19:59:06.392481+0000","last_fullsized":"2024-01-21T19:59:06.392481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415445+0000","last_change":"2024-01-21T19:59:06.411742+0000","last_active":"2024-01-21T19:59:06.415445+0000","last_peered":"2024-01-21T19:59:06.415445+0000","last_clean":"2024-01-21T19:59:06.415445+0000","last_became_active":"2024-01-21T19:59:06.408852+0000","last_became_peered":"2024-01-21T19:59:06.408852+0000","last_unstale":"2024-01-21T19:59:06.415445+0000","last_undegraded":"2024-01-21T19:59:06.415445+0000","last_fullsized":"2024-01-21T19:59:06.415445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413174+0000","last_change":"2024-01-21T19:59:06.411871+0000","last_active":"2024-01-21T19:59:06.413174+0000","last_peered":"2024-01-21T19:59:06.413174+0000","last_clean":"2024-01-21T19:59:06.413174+0000","last_became_active":"2024-01-21T19:59:06.411604+0000","last_became_peered":"2024-01-21T19:59:06.411604+0000","last_unstale":"2024-01-21T19:59:06.413174+0000","last_undegraded":"2024-01-21T19:59:06.413174+0000","last_fullsized":"2024-01-21T19:59:06.413174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394020+0000","last_change":"2024-01-21T19:59:06.042778+0000","last_active":"2024-01-21T19:59:06.394020+0000","last_peered":"2024-01-21T19:59:06.394020+0000","last_clean":"2024-01-21T19:59:06.394020+0000","last_became_active":"2024-01-21T19:59:06.042250+0000","last_became_peered":"2024-01-21T19:59:06.042250+0000","last_unstale":"2024-01-21T19:59:06.394020+0000","last_undegraded":"2024-01-21T19:59:06.394020+0000","last_fullsized":"2024-01-21T19:59:06.394020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415400+0000","last_change":"2024-01-21T19:59:06.408475+0000","last_active":"2024-01-21T19:59:06.415400+0000","last_peered":"2024-01-21T19:59:06.415400+0000","last_clean":"2024-01-21T19:59:06.415400+0000","last_became_active":"2024-01-21T19:59:06.406096+0000","last_became_peered":"2024-01-21T19:59:06.406096+0000","last_unstale":"2024-01-21T19:59:06.415400+0000","last_undegraded":"2024-01-21T19:59:06.415400+0000","last_fullsized":"2024-01-21T19:59:06.415400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392127+0000","last_change":"2024-01-21T19:59:06.041454+0000","last_active":"2024-01-21T19:59:06.392127+0000","last_peered":"2024-01-21T19:59:06.392127+0000","last_clean":"2024-01-21T19:59:06.392127+0000","last_became_active":"2024-01-21T19:59:06.041172+0000","last_became_peered":"2024-01-21T19:59:06.041172+0000","last_unstale":"2024-01-21T19:59:06.392127+0000","last_undegraded":"2024-01-21T19:59:06.392127+0000","last_fullsized":"2024-01-21T19:59:06.392127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416665+0000","last_change":"2024-01-21T19:59:06.404670+0000","last_active":"2024-01-21T19:59:06.416665+0000","last_peered":"2024-01-21T19:59:06.416665+0000","last_clean":"2024-01-21T19:59:06.416665+0000","last_became_active":"2024-01-21T19:59:06.404385+0000","last_became_peered":"2024-01-21T19:59:06.404385+0000","last_unstale":"2024-01-21T19:59:06.416665+0000","last_undegraded":"2024-01-21T19:59:06.416665+0000","last_fullsized":"2024-01-21T19:59:06.416665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404466+0000","last_change":"2024-01-21T19:59:06.032073+0000","last_active":"2024-01-21T19:59:06.404466+0000","last_peered":"2024-01-21T19:59:06.404466+0000","last_clean":"2024-01-21T19:59:06.404466+0000","last_became_active":"2024-01-21T19:59:06.031626+0000","last_became_peered":"2024-01-21T19:59:06.031626+0000","last_unstale":"2024-01-21T19:59:06.404466+0000","last_undegraded":"2024-01-21T19:59:06.404466+0000","last_fullsized":"2024-01-21T19:59:06.404466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402318+0000","last_change":"2024-01-21T19:59:06.399583+0000","last_active":"2024-01-21T19:59:06.402318+0000","last_peered":"2024-01-21T19:59:06.402318+0000","last_clean":"2024-01-21T19:59:06.402318+0000","last_became_active":"2024-01-21T19:59:06.399318+0000","last_became_peered":"2024-01-21T19:59:06.399318+0000","last_unstale":"2024-01-21T19:59:06.402318+0000","last_undegraded":"2024-01-21T19:59:06.402318+0000","last_fullsized":"2024-01-21T19:59:06.402318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406744+0000","last_change":"2024-01-21T19:59:06.034516+0000","last_active":"2024-01-21T19:59:06.406744+0000","last_peered":"2024-01-21T19:59:06.406744+0000","last_clean":"2024-01-21T19:59:06.406744+0000","last_became_active":"2024-01-21T19:59:06.034231+0000","last_became_peered":"2024-01-21T19:59:06.034231+0000","last_unstale":"2024-01-21T19:59:06.406744+0000","last_undegraded":"2024-01-21T19:59:06.406744+0000","last_fullsized":"2024-01-21T19:59:06.406744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418474+0000","last_change":"2024-01-21T19:59:06.413015+0000","last_active":"2024-01-21T19:59:06.418474+0000","last_peered":"2024-01-21T19:59:06.418474+0000","last_clean":"2024-01-21T19:59:06.418474+0000","last_became_active":"2024-01-21T19:59:06.412719+0000","last_became_peered":"2024-01-21T19:59:06.412719+0000","last_unstale":"2024-01-21T19:59:06.418474+0000","last_undegraded":"2024-01-21T19:59:06.418474+0000","last_fullsized":"2024-01-21T19:59:06.418474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400212+0000","last_change":"2024-01-21T19:59:06.037831+0000","last_active":"2024-01-21T19:59:06.400212+0000","last_peered":"2024-01-21T19:59:06.400212+0000","last_clean":"2024-01-21T19:59:06.400212+0000","last_became_active":"2024-01-21T19:59:06.037213+0000","last_became_peered":"2024-01-21T19:59:06.037213+0000","last_unstale":"2024-01-21T19:59:06.400212+0000","last_undegraded":"2024-01-21T19:59:06.400212+0000","last_fullsized":"2024-01-21T19:59:06.400212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412328+0000","last_change":"2024-01-21T19:59:06.407158+0000","last_active":"2024-01-21T19:59:06.412328+0000","last_peered":"2024-01-21T19:59:06.412328+0000","last_clean":"2024-01-21T19:59:06.412328+0000","last_became_active":"2024-01-21T19:59:06.406887+0000","last_became_peered":"2024-01-21T19:59:06.406887+0000","last_unstale":"2024-01-21T19:59:06.412328+0000","last_undegraded":"2024-01-21T19:59:06.412328+0000","last_fullsized":"2024-01-21T19:59:06.412328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394796+0000","last_change":"2024-01-21T19:59:06.040441+0000","last_active":"2024-01-21T19:59:06.394796+0000","last_peered":"2024-01-21T19:59:06.394796+0000","last_clean":"2024-01-21T19:59:06.394796+0000","last_became_active":"2024-01-21T19:59:06.040145+0000","last_became_peered":"2024-01-21T19:59:06.040145+0000","last_unstale":"2024-01-21T19:59:06.394796+0000","last_undegraded":"2024-01-21T19:59:06.394796+0000","last_fullsized":"2024-01-21T19:59:06.394796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412523+0000","last_change":"2024-01-21T19:59:06.408682+0000","last_active":"2024-01-21T19:59:06.412523+0000","last_peered":"2024-01-21T19:59:06.412523+0000","last_clean":"2024-01-21T19:59:06.412523+0000","last_became_active":"2024-01-21T19:59:06.408415+0000","last_became_peered":"2024-01-21T19:59:06.408415+0000","last_unstale":"2024-01-21T19:59:06.412523+0000","last_undegraded":"2024-01-21T19:59:06.412523+0000","last_fullsized":"2024-01-21T19:59:06.412523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388707+0000","last_change":"2024-01-21T19:59:06.033168+0000","last_active":"2024-01-21T19:59:06.388707+0000","last_peered":"2024-01-21T19:59:06.388707+0000","last_clean":"2024-01-21T19:59:06.388707+0000","last_became_active":"2024-01-21T19:59:06.032815+0000","last_became_peered":"2024-01-21T19:59:06.032815+0000","last_unstale":"2024-01-21T19:59:06.388707+0000","last_undegraded":"2024-01-21T19:59:06.388707+0000","last_fullsized":"2024-01-21T19:59:06.388707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414019+0000","last_change":"2024-01-21T19:59:06.412182+0000","last_active":"2024-01-21T19:59:06.414019+0000","last_peered":"2024-01-21T19:59:06.414019+0000","last_clean":"2024-01-21T19:59:06.414019+0000","last_became_active":"2024-01-21T19:59:06.411457+0000","last_became_peered":"2024-01-21T19:59:06.411457+0000","last_unstale":"2024-01-21T19:59:06.414019+0000","last_undegraded":"2024-01-21T19:59:06.414019+0000","last_fullsized":"2024-01-21T19:59:06.414019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392449+0000","last_change":"2024-01-21T19:59:06.036108+0000","last_active":"2024-01-21T19:59:06.392449+0000","last_peered":"2024-01-21T19:59:06.392449+0000","last_clean":"2024-01-21T19:59:06.392449+0000","last_became_active":"2024-01-21T19:59:06.035841+0000","last_became_peered":"2024-01-21T19:59:06.035841+0000","last_unstale":"2024-01-21T19:59:06.392449+0000","last_undegraded":"2024-01-21T19:59:06.392449+0000","last_fullsized":"2024-01-21T19:59:06.392449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413392+0000","last_change":"2024-01-21T19:59:06.411927+0000","last_active":"2024-01-21T19:59:06.413392+0000","last_peered":"2024-01-21T19:59:06.413392+0000","last_clean":"2024-01-21T19:59:06.413392+0000","last_became_active":"2024-01-21T19:59:06.411661+0000","last_became_peered":"2024-01-21T19:59:06.411661+0000","last_unstale":"2024-01-21T19:59:06.413392+0000","last_undegraded":"2024-01-21T19:59:06.413392+0000","last_fullsized":"2024-01-21T19:59:06.413392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.036660+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.036371+0000","last_became_peered":"2024-01-21T19:59:06.036371+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415968+0000","last_change":"2024-01-21T19:59:06.415069+0000","last_active":"2024-01-21T19:59:06.415968+0000","last_peered":"2024-01-21T19:59:06.415968+0000","last_clean":"2024-01-21T19:59:06.415968+0000","last_became_active":"2024-01-21T19:59:06.414647+0000","last_became_peered":"2024-01-21T19:59:06.414647+0000","last_unstale":"2024-01-21T19:59:06.415968+0000","last_undegraded":"2024-01-21T19:59:06.415968+0000","last_fullsized":"2024-01-21T19:59:06.415968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.393346+0000","last_change":"2024-01-21T19:59:06.042806+0000","last_active":"2024-01-21T19:59:06.393346+0000","last_peered":"2024-01-21T19:59:06.393346+0000","last_clean":"2024-01-21T19:59:06.393346+0000","last_became_active":"2024-01-21T19:59:06.042528+0000","last_became_peered":"2024-01-21T19:59:06.042528+0000","last_unstale":"2024-01-21T19:59:06.393346+0000","last_undegraded":"2024-01-21T19:59:06.393346+0000","last_fullsized":"2024-01-21T19:59:06.393346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416691+0000","last_change":"2024-01-21T19:59:06.410923+0000","last_active":"2024-01-21T19:59:06.416691+0000","last_peered":"2024-01-21T19:59:06.416691+0000","last_clean":"2024-01-21T19:59:06.416691+0000","last_became_active":"2024-01-21T19:59:06.408605+0000","last_became_peered":"2024-01-21T19:59:06.408605+0000","last_unstale":"2024-01-21T19:59:06.416691+0000","last_undegraded":"2024-01-21T19:59:06.416691+0000","last_fullsized":"2024-01-21T19:59:06.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404296+0000","last_change":"2024-01-21T19:59:06.033138+0000","last_active":"2024-01-21T19:59:06.404296+0000","last_peered":"2024-01-21T19:59:06.404296+0000","last_clean":"2024-01-21T19:59:06.404296+0000","last_became_active":"2024-01-21T19:59:06.032729+0000","last_became_peered":"2024-01-21T19:59:06.032729+0000","last_unstale":"2024-01-21T19:59:06.404296+0000","last_undegraded":"2024-01-21T19:59:06.404296+0000","last_fullsized":"2024-01-21T19:59:06.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412956+0000","last_change":"2024-01-21T19:59:06.409878+0000","last_active":"2024-01-21T19:59:06.412956+0000","last_peered":"2024-01-21T19:59:06.412956+0000","last_clean":"2024-01-21T19:59:06.412956+0000","last_became_active":"2024-01-21T19:59:06.409584+0000","last_became_peered":"2024-01-21T19:59:06.409584+0000","last_unstale":"2024-01-21T19:59:06.412956+0000","last_undegraded":"2024-01-21T19:59:06.412956+0000","last_fullsized":"2024-01-21T19:59:06.412956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-21T19:59:07.397481+0000","last_change":"2024-01-21T19:59:06.036306+0000","last_active":"2024-01-21T19:59:07.397481+0000","last_peered":"2024-01-21T19:59:07.397481+0000","last_clean":"2024-01-21T19:59:07.397481+0000","last_became_active":"2024-01-21T19:59:06.036019+0000","last_became_peered":"2024-01-21T19:59:06.036019+0000","last_unstale":"2024-01-21T19:59:07.397481+0000","last_undegraded":"2024-01-21T19:59:07.397481+0000","last_fullsized":"2024-01-21T19:59:07.397481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407918+0000","last_change":"2024-01-21T19:59:06.403990+0000","last_active":"2024-01-21T19:59:06.407918+0000","last_peered":"2024-01-21T19:59:06.407918+0000","last_clean":"2024-01-21T19:59:06.407918+0000","last_became_active":"2024-01-21T19:59:06.403735+0000","last_became_peered":"2024-01-21T19:59:06.403735+0000","last_unstale":"2024-01-21T19:59:06.407918+0000","last_undegraded":"2024-01-21T19:59:06.407918+0000","last_fullsized":"2024-01-21T19:59:06.407918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.031905+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.031528+0000","last_became_peered":"2024-01-21T19:59:06.031528+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410340+0000","last_change":"2024-01-21T19:59:06.404278+0000","last_active":"2024-01-21T19:59:06.410340+0000","last_peered":"2024-01-21T19:59:06.410340+0000","last_clean":"2024-01-21T19:59:06.410340+0000","last_became_active":"2024-01-21T19:59:06.403605+0000","last_became_peered":"2024-01-21T19:59:06.403605+0000","last_unstale":"2024-01-21T19:59:06.410340+0000","last_undegraded":"2024-01-21T19:59:06.410340+0000","last_fullsized":"2024-01-21T19:59:06.410340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391853+0000","last_change":"2024-01-21T19:59:06.036513+0000","last_active":"2024-01-21T19:59:06.391853+0000","last_peered":"2024-01-21T19:59:06.391853+0000","last_clean":"2024-01-21T19:59:06.391853+0000","last_became_active":"2024-01-21T19:59:06.036203+0000","last_became_peered":"2024-01-21T19:59:06.036203+0000","last_unstale":"2024-01-21T19:59:06.391853+0000","last_undegraded":"2024-01-21T19:59:06.391853+0000","last_fullsized":"2024-01-21T19:59:06.391853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418991+0000","last_change":"2024-01-21T19:59:06.413135+0000","last_active":"2024-01-21T19:59:06.418991+0000","last_peered":"2024-01-21T19:59:06.418991+0000","last_clean":"2024-01-21T19:59:06.418991+0000","last_became_active":"2024-01-21T19:59:06.412662+0000","last_became_peered":"2024-01-21T19:59:06.412662+0000","last_unstale":"2024-01-21T19:59:06.418991+0000","last_undegraded":"2024-01-21T19:59:06.418991+0000","last_fullsized":"2024-01-21T19:59:06.418991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394244+0000","last_change":"2024-01-21T19:59:06.041668+0000","last_active":"2024-01-21T19:59:06.394244+0000","last_peered":"2024-01-21T19:59:06.394244+0000","last_clean":"2024-01-21T19:59:06.394244+0000","last_became_active":"2024-01-21T19:59:06.041337+0000","last_became_peered":"2024-01-21T19:59:06.041337+0000","last_unstale":"2024-01-21T19:59:06.394244+0000","last_undegraded":"2024-01-21T19:59:06.394244+0000","last_fullsized":"2024-01-21T19:59:06.394244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410112+0000","last_change":"2024-01-21T19:59:06.405482+0000","last_active":"2024-01-21T19:59:06.410112+0000","last_peered":"2024-01-21T19:59:06.410112+0000","last_clean":"2024-01-21T19:59:06.410112+0000","last_became_active":"2024-01-21T19:59:06.405206+0000","last_became_peered":"2024-01-21T19:59:06.405206+0000","last_unstale":"2024-01-21T19:59:06.410112+0000","last_undegraded":"2024-01-21T19:59:06.410112+0000","last_fullsized":"2024-01-21T19:59:06.410112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392562+0000","last_change":"2024-01-21T19:59:06.033405+0000","last_active":"2024-01-21T19:59:06.392562+0000","last_peered":"2024-01-21T19:59:06.392562+0000","last_clean":"2024-01-21T19:59:06.392562+0000","last_became_active":"2024-01-21T19:59:06.033067+0000","last_became_peered":"2024-01-21T19:59:06.033067+0000","last_unstale":"2024-01-21T19:59:06.392562+0000","last_undegraded":"2024-01-21T19:59:06.392562+0000","last_fullsized":"2024-01-21T19:59:06.392562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419068+0000","last_change":"2024-01-21T19:59:06.416968+0000","last_active":"2024-01-21T19:59:06.419068+0000","last_peered":"2024-01-21T19:59:06.419068+0000","last_clean":"2024-01-21T19:59:06.419068+0000","last_became_active":"2024-01-21T19:59:06.416702+0000","last_became_peered":"2024-01-21T19:59:06.416702+0000","last_unstale":"2024-01-21T19:59:06.419068+0000","last_undegraded":"2024-01-21T19:59:06.419068+0000","last_fullsized":"2024-01-21T19:59:06.419068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403561+0000","last_change":"2024-01-21T19:59:06.040770+0000","last_active":"2024-01-21T19:59:06.403561+0000","last_peered":"2024-01-21T19:59:06.403561+0000","last_clean":"2024-01-21T19:59:06.403561+0000","last_became_active":"2024-01-21T19:59:06.039205+0000","last_became_peered":"2024-01-21T19:59:06.039205+0000","last_unstale":"2024-01-21T19:59:06.403561+0000","last_undegraded":"2024-01-21T19:59:06.403561+0000","last_fullsized":"2024-01-21T19:59:06.403561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416618+0000","last_change":"2024-01-21T19:59:06.412006+0000","last_active":"2024-01-21T19:59:06.416618+0000","last_peered":"2024-01-21T19:59:06.416618+0000","last_clean":"2024-01-21T19:59:06.416618+0000","last_became_active":"2024-01-21T19:59:06.411000+0000","last_became_peered":"2024-01-21T19:59:06.411000+0000","last_unstale":"2024-01-21T19:59:06.416618+0000","last_undegraded":"2024-01-21T19:59:06.416618+0000","last_fullsized":"2024-01-21T19:59:06.416618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396610+0000","last_change":"2024-01-21T19:59:06.031139+0000","last_active":"2024-01-21T19:59:06.396610+0000","last_peered":"2024-01-21T19:59:06.396610+0000","last_clean":"2024-01-21T19:59:06.396610+0000","last_became_active":"2024-01-21T19:59:06.030914+0000","last_became_peered":"2024-01-21T19:59:06.030914+0000","last_unstale":"2024-01-21T19:59:06.396610+0000","last_undegraded":"2024-01-21T19:59:06.396610+0000","last_fullsized":"2024-01-21T19:59:06.396610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413171+0000","last_change":"2024-01-21T19:59:06.411676+0000","last_active":"2024-01-21T19:59:06.413171+0000","last_peered":"2024-01-21T19:59:06.413171+0000","last_clean":"2024-01-21T19:59:06.413171+0000","last_became_active":"2024-01-21T19:59:06.411417+0000","last_became_peered":"2024-01-21T19:59:06.411417+0000","last_unstale":"2024-01-21T19:59:06.413171+0000","last_undegraded":"2024-01-21T19:59:06.413171+0000","last_fullsized":"2024-01-21T19:59:06.413171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416934+0000","last_change":"2024-01-21T19:59:06.027798+0000","last_active":"2024-01-21T19:59:06.416934+0000","last_peered":"2024-01-21T19:59:06.416934+0000","last_clean":"2024-01-21T19:59:06.416934+0000","last_became_active":"2024-01-21T19:59:06.027498+0000","last_became_peered":"2024-01-21T19:59:06.027498+0000","last_unstale":"2024-01-21T19:59:06.416934+0000","last_undegraded":"2024-01-21T19:59:06.416934+0000","last_fullsized":"2024-01-21T19:59:06.416934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402297+0000","last_change":"2024-01-21T19:59:06.398605+0000","last_active":"2024-01-21T19:59:06.402297+0000","last_peered":"2024-01-21T19:59:06.402297+0000","last_clean":"2024-01-21T19:59:06.402297+0000","last_became_active":"2024-01-21T19:59:06.398350+0000","last_became_peered":"2024-01-21T19:59:06.398350+0000","last_unstale":"2024-01-21T19:59:06.402297+0000","last_undegraded":"2024-01-21T19:59:06.402297+0000","last_fullsized":"2024-01-21T19:59:06.402297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388678+0000","last_change":"2024-01-21T19:59:06.024779+0000","last_active":"2024-01-21T19:59:06.388678+0000","last_peered":"2024-01-21T19:59:06.388678+0000","last_clean":"2024-01-21T19:59:06.388678+0000","last_became_active":"2024-01-21T19:59:06.024455+0000","last_became_peered":"2024-01-21T19:59:06.024455+0000","last_unstale":"2024-01-21T19:59:06.388678+0000","last_undegraded":"2024-01-21T19:59:06.388678+0000","last_fullsized":"2024-01-21T19:59:06.388678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416608+0000","last_change":"2024-01-21T19:59:06.411381+0000","last_active":"2024-01-21T19:59:06.416608+0000","last_peered":"2024-01-21T19:59:06.416608+0000","last_clean":"2024-01-21T19:59:06.416608+0000","last_became_active":"2024-01-21T19:59:06.411065+0000","last_became_peered":"2024-01-21T19:59:06.411065+0000","last_unstale":"2024-01-21T19:59:06.416608+0000","last_undegraded":"2024-01-21T19:59:06.416608+0000","last_fullsized":"2024-01-21T19:59:06.416608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391431+0000","last_change":"2024-01-21T19:59:06.035305+0000","last_active":"2024-01-21T19:59:06.391431+0000","last_peered":"2024-01-21T19:59:06.391431+0000","last_clean":"2024-01-21T19:59:06.391431+0000","last_became_active":"2024-01-21T19:59:06.035011+0000","last_became_peered":"2024-01-21T19:59:06.035011+0000","last_unstale":"2024-01-21T19:59:06.391431+0000","last_undegraded":"2024-01-21T19:59:06.391431+0000","last_fullsized":"2024-01-21T19:59:06.391431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410360+0000","last_change":"2024-01-21T19:59:06.404314+0000","last_active":"2024-01-21T19:59:06.410360+0000","last_peered":"2024-01-21T19:59:06.410360+0000","last_clean":"2024-01-21T19:59:06.410360+0000","last_became_active":"2024-01-21T19:59:06.403954+0000","last_became_peered":"2024-01-21T19:59:06.403954+0000","last_unstale":"2024-01-21T19:59:06.410360+0000","last_undegraded":"2024-01-21T19:59:06.410360+0000","last_fullsized":"2024-01-21T19:59:06.410360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403338+0000","last_change":"2024-01-21T19:59:06.039241+0000","last_active":"2024-01-21T19:59:06.403338+0000","last_peered":"2024-01-21T19:59:06.403338+0000","last_clean":"2024-01-21T19:59:06.403338+0000","last_became_active":"2024-01-21T19:59:06.038967+0000","last_became_peered":"2024-01-21T19:59:06.038967+0000","last_unstale":"2024-01-21T19:59:06.403338+0000","last_undegraded":"2024-01-21T19:59:06.403338+0000","last_fullsized":"2024-01-21T19:59:06.403338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404457+0000","last_change":"2024-01-21T19:59:06.398845+0000","last_active":"2024-01-21T19:59:06.404457+0000","last_peered":"2024-01-21T19:59:06.404457+0000","last_clean":"2024-01-21T19:59:06.404457+0000","last_became_active":"2024-01-21T19:59:06.398598+0000","last_became_peered":"2024-01-21T19:59:06.398598+0000","last_unstale":"2024-01-21T19:59:06.404457+0000","last_undegraded":"2024-01-21T19:59:06.404457+0000","last_fullsized":"2024-01-21T19:59:06.404457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403951+0000","last_change":"2024-01-21T19:59:06.031315+0000","last_active":"2024-01-21T19:59:06.403951+0000","last_peered":"2024-01-21T19:59:06.403951+0000","last_clean":"2024-01-21T19:59:06.403951+0000","last_became_active":"2024-01-21T19:59:06.031001+0000","last_became_peered":"2024-01-21T19:59:06.031001+0000","last_unstale":"2024-01-21T19:59:06.403951+0000","last_undegraded":"2024-01-21T19:59:06.403951+0000","last_fullsized":"2024-01-21T19:59:06.403951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418455+0000","last_change":"2024-01-21T19:59:06.412803+0000","last_active":"2024-01-21T19:59:06.418455+0000","last_peered":"2024-01-21T19:59:06.418455+0000","last_clean":"2024-01-21T19:59:06.418455+0000","last_became_active":"2024-01-21T19:59:06.412494+0000","last_became_peered":"2024-01-21T19:59:06.412494+0000","last_unstale":"2024-01-21T19:59:06.418455+0000","last_undegraded":"2024-01-21T19:59:06.418455+0000","last_fullsized":"2024-01-21T19:59:06.418455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392612+0000","last_change":"2024-01-21T19:59:06.036578+0000","last_active":"2024-01-21T19:59:06.392612+0000","last_peered":"2024-01-21T19:59:06.392612+0000","last_clean":"2024-01-21T19:59:06.392612+0000","last_became_active":"2024-01-21T19:59:06.036234+0000","last_became_peered":"2024-01-21T19:59:06.036234+0000","last_unstale":"2024-01-21T19:59:06.392612+0000","last_undegraded":"2024-01-21T19:59:06.392612+0000","last_fullsized":"2024-01-21T19:59:06.392612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417722+0000","last_change":"2024-01-21T19:59:06.417024+0000","last_active":"2024-01-21T19:59:06.417722+0000","last_peered":"2024-01-21T19:59:06.417722+0000","last_clean":"2024-01-21T19:59:06.417722+0000","last_became_active":"2024-01-21T19:59:06.416747+0000","last_became_peered":"2024-01-21T19:59:06.416747+0000","last_unstale":"2024-01-21T19:59:06.417722+0000","last_undegraded":"2024-01-21T19:59:06.417722+0000","last_fullsized":"2024-01-21T19:59:06.417722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407615+0000","last_change":"2024-01-21T19:59:06.033544+0000","last_active":"2024-01-21T19:59:06.407615+0000","last_peered":"2024-01-21T19:59:06.407615+0000","last_clean":"2024-01-21T19:59:06.407615+0000","last_became_active":"2024-01-21T19:59:06.031765+0000","last_became_peered":"2024-01-21T19:59:06.031765+0000","last_unstale":"2024-01-21T19:59:06.407615+0000","last_undegraded":"2024-01-21T19:59:06.407615+0000","last_fullsized":"2024-01-21T19:59:06.407615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403490+0000","last_change":"2024-01-21T19:59:06.400361+0000","last_active":"2024-01-21T19:59:06.403490+0000","last_peered":"2024-01-21T19:59:06.403490+0000","last_clean":"2024-01-21T19:59:06.403490+0000","last_became_active":"2024-01-21T19:59:06.400070+0000","last_became_peered":"2024-01-21T19:59:06.400070+0000","last_unstale":"2024-01-21T19:59:06.403490+0000","last_undegraded":"2024-01-21T19:59:06.403490+0000","last_fullsized":"2024-01-21T19:59:06.403490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419401+0000","last_change":"2024-01-21T19:59:06.037315+0000","last_active":"2024-01-21T19:59:06.419401+0000","last_peered":"2024-01-21T19:59:06.419401+0000","last_clean":"2024-01-21T19:59:06.419401+0000","last_became_active":"2024-01-21T19:59:06.036690+0000","last_became_peered":"2024-01-21T19:59:06.036690+0000","last_unstale":"2024-01-21T19:59:06.419401+0000","last_undegraded":"2024-01-21T19:59:06.419401+0000","last_fullsized":"2024-01-21T19:59:06.419401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404278+0000","last_change":"2024-01-21T19:59:06.399152+0000","last_active":"2024-01-21T19:59:06.404278+0000","last_peered":"2024-01-21T19:59:06.404278+0000","last_clean":"2024-01-21T19:59:06.404278+0000","last_became_active":"2024-01-21T19:59:06.398559+0000","last_became_peered":"2024-01-21T19:59:06.398559+0000","last_unstale":"2024-01-21T19:59:06.404278+0000","last_undegraded":"2024-01-21T19:59:06.404278+0000","last_fullsized":"2024-01-21T19:59:06.404278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.395765+0000","last_change":"2024-01-21T19:59:06.033529+0000","last_active":"2024-01-21T19:59:06.395765+0000","last_peered":"2024-01-21T19:59:06.395765+0000","last_clean":"2024-01-21T19:59:06.395765+0000","last_became_active":"2024-01-21T19:59:06.033242+0000","last_became_peered":"2024-01-21T19:59:06.033242+0000","last_unstale":"2024-01-21T19:59:06.395765+0000","last_undegraded":"2024-01-21T19:59:06.395765+0000","last_fullsized":"2024-01-21T19:59:06.395765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419003+0000","last_change":"2024-01-21T19:59:06.415302+0000","last_active":"2024-01-21T19:59:06.419003+0000","last_peered":"2024-01-21T19:59:06.419003+0000","last_clean":"2024-01-21T19:59:06.419003+0000","last_became_active":"2024-01-21T19:59:06.414840+0000","last_became_peered":"2024-01-21T19:59:06.414840+0000","last_unstale":"2024-01-21T19:59:06.419003+0000","last_undegraded":"2024-01-21T19:59:06.419003+0000","last_fullsized":"2024-01-21T19:59:06.419003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396109+0000","last_change":"2024-01-21T19:59:06.032758+0000","last_active":"2024-01-21T19:59:06.396109+0000","last_peered":"2024-01-21T19:59:06.396109+0000","last_clean":"2024-01-21T19:59:06.396109+0000","last_became_active":"2024-01-21T19:59:06.032460+0000","last_became_peered":"2024-01-21T19:59:06.032460+0000","last_unstale":"2024-01-21T19:59:06.396109+0000","last_undegraded":"2024-01-21T19:59:06.396109+0000","last_fullsized":"2024-01-21T19:59:06.396109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418725+0000","last_change":"2024-01-21T19:59:06.414719+0000","last_active":"2024-01-21T19:59:06.418725+0000","last_peered":"2024-01-21T19:59:06.418725+0000","last_clean":"2024-01-21T19:59:06.418725+0000","last_became_active":"2024-01-21T19:59:06.414337+0000","last_became_peered":"2024-01-21T19:59:06.414337+0000","last_unstale":"2024-01-21T19:59:06.418725+0000","last_undegraded":"2024-01-21T19:59:06.418725+0000","last_fullsized":"2024-01-21T19:59:06.418725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399500+0000","last_change":"2024-01-21T19:59:06.035036+0000","last_active":"2024-01-21T19:59:06.399500+0000","last_peered":"2024-01-21T19:59:06.399500+0000","last_clean":"2024-01-21T19:59:06.399500+0000","last_became_active":"2024-01-21T19:59:06.034698+0000","last_became_peered":"2024-01-21T19:59:06.034698+0000","last_unstale":"2024-01-21T19:59:06.399500+0000","last_undegraded":"2024-01-21T19:59:06.399500+0000","last_fullsized":"2024-01-21T19:59:06.399500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401865+0000","last_change":"2024-01-21T19:59:06.397365+0000","last_active":"2024-01-21T19:59:06.401865+0000","last_peered":"2024-01-21T19:59:06.401865+0000","last_clean":"2024-01-21T19:59:06.401865+0000","last_became_active":"2024-01-21T19:59:06.397044+0000","last_became_peered":"2024-01-21T19:59:06.397044+0000","last_unstale":"2024-01-21T19:59:06.401865+0000","last_undegraded":"2024-01-21T19:59:06.401865+0000","last_fullsized":"2024-01-21T19:59:06.401865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394352+0000","last_change":"2024-01-21T19:59:06.033282+0000","last_active":"2024-01-21T19:59:06.394352+0000","last_peered":"2024-01-21T19:59:06.394352+0000","last_clean":"2024-01-21T19:59:06.394352+0000","last_became_active":"2024-01-21T19:59:06.033013+0000","last_became_peered":"2024-01-21T19:59:06.033013+0000","last_unstale":"2024-01-21T19:59:06.394352+0000","last_undegraded":"2024-01-21T19:59:06.394352+0000","last_fullsized":"2024-01-21T19:59:06.394352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413996+0000","last_change":"2024-01-21T19:59:06.412489+0000","last_active":"2024-01-21T19:59:06.413996+0000","last_peered":"2024-01-21T19:59:06.413996+0000","last_clean":"2024-01-21T19:59:06.413996+0000","last_became_active":"2024-01-21T19:59:06.412296+0000","last_became_peered":"2024-01-21T19:59:06.412296+0000","last_unstale":"2024-01-21T19:59:06.413996+0000","last_undegraded":"2024-01-21T19:59:06.413996+0000","last_fullsized":"2024-01-21T19:59:06.413996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405984+0000","last_change":"2024-01-21T19:59:06.040467+0000","last_active":"2024-01-21T19:59:06.405984+0000","last_peered":"2024-01-21T19:59:06.405984+0000","last_clean":"2024-01-21T19:59:06.405984+0000","last_became_active":"2024-01-21T19:59:06.040135+0000","last_became_peered":"2024-01-21T19:59:06.040135+0000","last_unstale":"2024-01-21T19:59:06.405984+0000","last_undegraded":"2024-01-21T19:59:06.405984+0000","last_fullsized":"2024-01-21T19:59:06.405984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418656+0000","last_change":"2024-01-21T19:59:06.414583+0000","last_active":"2024-01-21T19:59:06.418656+0000","last_peered":"2024-01-21T19:59:06.418656+0000","last_clean":"2024-01-21T19:59:06.418656+0000","last_became_active":"2024-01-21T19:59:06.414307+0000","last_became_peered":"2024-01-21T19:59:06.414307+0000","last_unstale":"2024-01-21T19:59:06.418656+0000","last_undegraded":"2024-01-21T19:59:06.418656+0000","last_fullsized":"2024-01-21T19:59:06.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400826+0000","last_change":"2024-01-21T19:59:06.037540+0000","last_active":"2024-01-21T19:59:06.400826+0000","last_peered":"2024-01-21T19:59:06.400826+0000","last_clean":"2024-01-21T19:59:06.400826+0000","last_became_active":"2024-01-21T19:59:06.037227+0000","last_became_peered":"2024-01-21T19:59:06.037227+0000","last_unstale":"2024-01-21T19:59:06.400826+0000","last_undegraded":"2024-01-21T19:59:06.400826+0000","last_fullsized":"2024-01-21T19:59:06.400826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410359+0000","last_change":"2024-01-21T19:59:06.407140+0000","last_active":"2024-01-21T19:59:06.410359+0000","last_peered":"2024-01-21T19:59:06.410359+0000","last_clean":"2024-01-21T19:59:06.410359+0000","last_became_active":"2024-01-21T19:59:06.406818+0000","last_became_peered":"2024-01-21T19:59:06.406818+0000","last_unstale":"2024-01-21T19:59:06.410359+0000","last_undegraded":"2024-01-21T19:59:06.410359+0000","last_fullsized":"2024-01-21T19:59:06.410359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412154+0000","last_change":"2024-01-21T19:59:06.038267+0000","last_active":"2024-01-21T19:59:06.412154+0000","last_peered":"2024-01-21T19:59:06.412154+0000","last_clean":"2024-01-21T19:59:06.412154+0000","last_became_active":"2024-01-21T19:59:06.037931+0000","last_became_peered":"2024-01-21T19:59:06.037931+0000","last_unstale":"2024-01-21T19:59:06.412154+0000","last_undegraded":"2024-01-21T19:59:06.412154+0000","last_fullsized":"2024-01-21T19:59:06.412154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402031+0000","last_change":"2024-01-21T19:59:06.397703+0000","last_active":"2024-01-21T19:59:06.402031+0000","last_peered":"2024-01-21T19:59:06.402031+0000","last_clean":"2024-01-21T19:59:06.402031+0000","last_became_active":"2024-01-21T19:59:06.397296+0000","last_became_peered":"2024-01-21T19:59:06.397296+0000","last_unstale":"2024-01-21T19:59:06.402031+0000","last_undegraded":"2024-01-21T19:59:06.402031+0000","last_fullsized":"2024-01-21T19:59:06.402031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402469+0000","last_change":"2024-01-21T19:59:06.036008+0000","last_active":"2024-01-21T19:59:06.402469+0000","last_peered":"2024-01-21T19:59:06.402469+0000","last_clean":"2024-01-21T19:59:06.402469+0000","last_became_active":"2024-01-21T19:59:06.035721+0000","last_became_peered":"2024-01-21T19:59:06.035721+0000","last_unstale":"2024-01-21T19:59:06.402469+0000","last_undegraded":"2024-01-21T19:59:06.402469+0000","last_fullsized":"2024-01-21T19:59:06.402469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419018+0000","last_change":"2024-01-21T19:59:06.415104+0000","last_active":"2024-01-21T19:59:06.419018+0000","last_peered":"2024-01-21T19:59:06.419018+0000","last_clean":"2024-01-21T19:59:06.419018+0000","last_became_active":"2024-01-21T19:59:06.414325+0000","last_became_peered":"2024-01-21T19:59:06.414325+0000","last_unstale":"2024-01-21T19:59:06.419018+0000","last_undegraded":"2024-01-21T19:59:06.419018+0000","last_fullsized":"2024-01-21T19:59:06.419018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392399+0000","last_change":"2024-01-21T19:59:06.036961+0000","last_active":"2024-01-21T19:59:06.392399+0000","last_peered":"2024-01-21T19:59:06.392399+0000","last_clean":"2024-01-21T19:59:06.392399+0000","last_became_active":"2024-01-21T19:59:06.036674+0000","last_became_peered":"2024-01-21T19:59:06.036674+0000","last_unstale":"2024-01-21T19:59:06.392399+0000","last_undegraded":"2024-01-21T19:59:06.392399+0000","last_fullsized":"2024-01-21T19:59:06.392399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416883+0000","last_change":"2024-01-21T19:59:06.415128+0000","last_active":"2024-01-21T19:59:06.416883+0000","last_peered":"2024-01-21T19:59:06.416883+0000","last_clean":"2024-01-21T19:59:06.416883+0000","last_became_active":"2024-01-21T19:59:06.411896+0000","last_became_peered":"2024-01-21T19:59:06.411896+0000","last_unstale":"2024-01-21T19:59:06.416883+0000","last_undegraded":"2024-01-21T19:59:06.416883+0000","last_fullsized":"2024-01-21T19:59:06.416883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405540+0000","last_change":"2024-01-21T19:59:06.040769+0000","last_active":"2024-01-21T19:59:06.405540+0000","last_peered":"2024-01-21T19:59:06.405540+0000","last_clean":"2024-01-21T19:59:06.405540+0000","last_became_active":"2024-01-21T19:59:06.040493+0000","last_became_peered":"2024-01-21T19:59:06.040493+0000","last_unstale":"2024-01-21T19:59:06.405540+0000","last_undegraded":"2024-01-21T19:59:06.405540+0000","last_fullsized":"2024-01-21T19:59:06.405540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415838+0000","last_change":"2024-01-21T19:59:06.413738+0000","last_active":"2024-01-21T19:59:06.415838+0000","last_peered":"2024-01-21T19:59:06.415838+0000","last_clean":"2024-01-21T19:59:06.415838+0000","last_became_active":"2024-01-21T19:59:06.413499+0000","last_became_peered":"2024-01-21T19:59:06.413499+0000","last_unstale":"2024-01-21T19:59:06.415838+0000","last_undegraded":"2024-01-21T19:59:06.415838+0000","last_fullsized":"2024-01-21T19:59:06.415838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417380+0000","last_change":"2024-01-21T19:59:06.039198+0000","last_active":"2024-01-21T19:59:06.417380+0000","last_peered":"2024-01-21T19:59:06.417380+0000","last_clean":"2024-01-21T19:59:06.417380+0000","last_became_active":"2024-01-21T19:59:06.038161+0000","last_became_peered":"2024-01-21T19:59:06.038161+0000","last_unstale":"2024-01-21T19:59:06.417380+0000","last_undegraded":"2024-01-21T19:59:06.417380+0000","last_fullsized":"2024-01-21T19:59:06.417380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":85794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":84380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:20.437 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.597+0000 7f301ca57700 1 Processor -- start 2024-01-21T19:59:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.597+0000 7f301ca57700 1 -- start start 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301ca57700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018151f70 0x7f3018152350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301ca57700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3018066880 0x7f3018066d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301ca57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018068b20 con 0x7f30180c3630 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301ca57700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180671f0 con 0x7f3018066880 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301ca57700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018067f10 con 0x7f3018151f70 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3018066880 0x7f3018066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3018066880 0x7f3018066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51898/0 (socket says 172.21.15.133:51898) 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 -- 172.21.15.133:0/2195087603 learned_addr learned my addr 172.21.15.133:0/2195087603 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3016d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f30180c3630 0x7f30180c3ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42542/0 (socket says 172.21.15.133:42542) 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301659c700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018151f70 0x7f3018152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 -- 172.21.15.133:0/2195087603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018151f70 msgr2=0x7f3018152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018151f70 0x7f3018152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 -- 172.21.15.133:0/2195087603 >> v1:172.21.15.133:6789/0 conn(0x7f30180c3630 legacy=0x7f30180c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f301559a700 1 -- 172.21.15.133:0/2195087603 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7118234 0 0) 0x7f3018068b20 con 0x7f30180c3630 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 -- 172.21.15.133:0/2195087603 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180681f0 con 0x7f3018066880 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.598+0000 7f3015d9b700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3018066880 0x7f3018066d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3008006fd0 tx=0x7f30080090f0).ready entity=mon.0 client_cookie=472dfc281b54ab2c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301559a700 1 -- 172.21.15.133:0/2195087603 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800b600 con 0x7f3018066880 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301559a700 1 -- 172.21.15.133:0/2195087603 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800b760 con 0x7f3018066880 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301559a700 1 -- 172.21.15.133:0/2195087603 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800bb00 con 0x7f3018066880 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 -- 172.21.15.133:0/2195087603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3018066880 msgr2=0x7f3018066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3018066880 0x7f3018066d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3008006fd0 tx=0x7f30080090f0).stop 2024-01-21T19:59:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 -- 172.21.15.133:0/2195087603 shutdown_connections 2024-01-21T19:59:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018151f70 0x7f3018152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 --2- 172.21.15.133:0/2195087603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3018066880 0x7f3018066d00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 -- 172.21.15.133:0/2195087603 >> 172.21.15.133:0/2195087603 conn(0x7f30180c8f90 msgr2=0x7f30180c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 -- 172.21.15.133:0/2195087603 shutdown_connections 2024-01-21T19:59:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.599+0000 7f301ca57700 1 -- 172.21.15.133:0/2195087603 wait complete. 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 Processor -- start 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 -- start start 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 0x7f3018143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 0x7f3018156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018154630 con 0x7f30180c3630 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018153a40 con 0x7f3018151f70 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f301ca57700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018153d00 con 0x7f3018066880 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f3015d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f3015d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51908/0 (socket says 172.21.15.133:51908) 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.601+0000 7f3015d9b700 1 -- 172.21.15.133:0/856072452 learned_addr learned my addr 172.21.15.133:0/856072452 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3016d9d700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 0x7f3018156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f301659c700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 0x7f3018143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 -- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 msgr2=0x7f3018143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 0x7f3018143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 -- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 msgr2=0x7f3018156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 0x7f3018156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 -- 172.21.15.133:0/856072452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009370 con 0x7f30180c3630 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f301659c700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 0x7f3018143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3016d9d700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 0x7f3018156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3015d9b700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3008011000 tx=0x7f3008017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800b8d0 con 0x7f30180c3630 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800ba30 con 0x7f30180c3630 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300801c670 con 0x7f30180c3630 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018153fe0 con 0x7f30180c3630 2024-01-21T19:59:20.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.602+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3018143f20 con 0x7f30180c3630 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.603+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30181547a0 con 0x7f30180c3630 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.603+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f300801caa0 con 0x7f30180c3630 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.604+0000 7f3006ffd700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 0x7f2ff8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.604+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f300807bc00 con 0x7f30180c3630 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.604+0000 7f301659c700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 0x7f2ff8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.604+0000 7f301659c700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 0x7f2ff8061640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f300c006fd0 tx=0x7f300c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.608+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3008082080 con 0x7f30180c3630 2024-01-21T19:59:20.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.769+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f301805fdf0 con 0x7f2ff805f180 2024-01-21T19:59:20.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.778+0000 7f3006ffd700 1 -- 172.21.15.133:0/856072452 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336328 (secure 0 0 0) 0x7f301805fdf0 con 0x7f2ff805f180 2024-01-21T19:59:20.773 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 msgr2=0x7f2ff8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 0x7f2ff8061640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f300c006fd0 tx=0x7f300c008040).stop 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 msgr2=0x7f3018154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f3008011000 tx=0x7f3008017000).stop 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 shutdown_connections 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f180 0x7f2ff8061640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018151f70 0x7f3018156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018066880 0x7f3018143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 --2- 172.21.15.133:0/856072452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c3630 0x7f3018154ac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 >> 172.21.15.133:0/856072452 conn(0x7f30180c8f90 msgr2=0x7f30180ad050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 shutdown_connections 2024-01-21T19:59:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.781+0000 7f301ca57700 1 -- 172.21.15.133:0/856072452 wait complete. 2024-01-21T19:59:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:20.784 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-21T19:59:19.851310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378616,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596104,"statfs":{"total":773094113280,"available":770658410496,"internally_reserved":0,"allocated":1892352,"data_stored":685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002748"},"pg_stats":[{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408931+0000","last_change":"2024-01-21T19:59:06.407131+0000","last_active":"2024-01-21T19:59:06.408931+0000","last_peered":"2024-01-21T19:59:06.408931+0000","last_clean":"2024-01-21T19:59:06.408931+0000","last_became_active":"2024-01-21T19:59:06.406853+0000","last_became_peered":"2024-01-21T19:59:06.406853+0000","last_unstale":"2024-01-21T19:59:06.408931+0000","last_undegraded":"2024-01-21T19:59:06.408931+0000","last_fullsized":"2024-01-21T19:59:06.408931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405624+0000","last_change":"2024-01-21T19:59:06.034930+0000","last_active":"2024-01-21T19:59:06.405624+0000","last_peered":"2024-01-21T19:59:06.405624+0000","last_clean":"2024-01-21T19:59:06.405624+0000","last_became_active":"2024-01-21T19:59:06.034648+0000","last_became_peered":"2024-01-21T19:59:06.034648+0000","last_unstale":"2024-01-21T19:59:06.405624+0000","last_undegraded":"2024-01-21T19:59:06.405624+0000","last_fullsized":"2024-01-21T19:59:06.405624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415745+0000","last_change":"2024-01-21T19:59:06.414371+0000","last_active":"2024-01-21T19:59:06.415745+0000","last_peered":"2024-01-21T19:59:06.415745+0000","last_clean":"2024-01-21T19:59:06.415745+0000","last_became_active":"2024-01-21T19:59:06.414078+0000","last_became_peered":"2024-01-21T19:59:06.414078+0000","last_unstale":"2024-01-21T19:59:06.415745+0000","last_undegraded":"2024-01-21T19:59:06.415745+0000","last_fullsized":"2024-01-21T19:59:06.415745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403854+0000","last_change":"2024-01-21T19:59:06.035542+0000","last_active":"2024-01-21T19:59:06.403854+0000","last_peered":"2024-01-21T19:59:06.403854+0000","last_clean":"2024-01-21T19:59:06.403854+0000","last_became_active":"2024-01-21T19:59:06.035262+0000","last_became_peered":"2024-01-21T19:59:06.035262+0000","last_unstale":"2024-01-21T19:59:06.403854+0000","last_undegraded":"2024-01-21T19:59:06.403854+0000","last_fullsized":"2024-01-21T19:59:06.403854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406814+0000","last_change":"2024-01-21T19:59:06.405992+0000","last_active":"2024-01-21T19:59:06.406814+0000","last_peered":"2024-01-21T19:59:06.406814+0000","last_clean":"2024-01-21T19:59:06.406814+0000","last_became_active":"2024-01-21T19:59:06.405013+0000","last_became_peered":"2024-01-21T19:59:06.405013+0000","last_unstale":"2024-01-21T19:59:06.406814+0000","last_undegraded":"2024-01-21T19:59:06.406814+0000","last_fullsized":"2024-01-21T19:59:06.406814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392792+0000","last_change":"2024-01-21T19:59:06.041467+0000","last_active":"2024-01-21T19:59:06.392792+0000","last_peered":"2024-01-21T19:59:06.392792+0000","last_clean":"2024-01-21T19:59:06.392792+0000","last_became_active":"2024-01-21T19:59:06.041158+0000","last_became_peered":"2024-01-21T19:59:06.041158+0000","last_unstale":"2024-01-21T19:59:06.392792+0000","last_undegraded":"2024-01-21T19:59:06.392792+0000","last_fullsized":"2024-01-21T19:59:06.392792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.408938+0000","last_change":"2024-01-21T19:59:06.407402+0000","last_active":"2024-01-21T19:59:06.408938+0000","last_peered":"2024-01-21T19:59:06.408938+0000","last_clean":"2024-01-21T19:59:06.408938+0000","last_became_active":"2024-01-21T19:59:06.406722+0000","last_became_peered":"2024-01-21T19:59:06.406722+0000","last_unstale":"2024-01-21T19:59:06.408938+0000","last_undegraded":"2024-01-21T19:59:06.408938+0000","last_fullsized":"2024-01-21T19:59:06.408938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392400+0000","last_change":"2024-01-21T19:59:06.038017+0000","last_active":"2024-01-21T19:59:06.392400+0000","last_peered":"2024-01-21T19:59:06.392400+0000","last_clean":"2024-01-21T19:59:06.392400+0000","last_became_active":"2024-01-21T19:59:06.037532+0000","last_became_peered":"2024-01-21T19:59:06.037532+0000","last_unstale":"2024-01-21T19:59:06.392400+0000","last_undegraded":"2024-01-21T19:59:06.392400+0000","last_fullsized":"2024-01-21T19:59:06.392400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415998+0000","last_change":"2024-01-21T19:59:06.415183+0000","last_active":"2024-01-21T19:59:06.415998+0000","last_peered":"2024-01-21T19:59:06.415998+0000","last_clean":"2024-01-21T19:59:06.415998+0000","last_became_active":"2024-01-21T19:59:06.414874+0000","last_became_peered":"2024-01-21T19:59:06.414874+0000","last_unstale":"2024-01-21T19:59:06.415998+0000","last_undegraded":"2024-01-21T19:59:06.415998+0000","last_fullsized":"2024-01-21T19:59:06.415998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392424+0000","last_change":"2024-01-21T19:59:06.039345+0000","last_active":"2024-01-21T19:59:06.392424+0000","last_peered":"2024-01-21T19:59:06.392424+0000","last_clean":"2024-01-21T19:59:06.392424+0000","last_became_active":"2024-01-21T19:59:06.039077+0000","last_became_peered":"2024-01-21T19:59:06.039077+0000","last_unstale":"2024-01-21T19:59:06.392424+0000","last_undegraded":"2024-01-21T19:59:06.392424+0000","last_fullsized":"2024-01-21T19:59:06.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412461+0000","last_change":"2024-01-21T19:59:06.408094+0000","last_active":"2024-01-21T19:59:06.412461+0000","last_peered":"2024-01-21T19:59:06.412461+0000","last_clean":"2024-01-21T19:59:06.412461+0000","last_became_active":"2024-01-21T19:59:06.407833+0000","last_became_peered":"2024-01-21T19:59:06.407833+0000","last_unstale":"2024-01-21T19:59:06.412461+0000","last_undegraded":"2024-01-21T19:59:06.412461+0000","last_fullsized":"2024-01-21T19:59:06.412461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417155+0000","last_change":"2024-01-21T19:59:06.037535+0000","last_active":"2024-01-21T19:59:06.417155+0000","last_peered":"2024-01-21T19:59:06.417155+0000","last_clean":"2024-01-21T19:59:06.417155+0000","last_became_active":"2024-01-21T19:59:06.037260+0000","last_became_peered":"2024-01-21T19:59:06.037260+0000","last_unstale":"2024-01-21T19:59:06.417155+0000","last_undegraded":"2024-01-21T19:59:06.417155+0000","last_fullsized":"2024-01-21T19:59:06.417155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415420+0000","last_change":"2024-01-21T19:59:06.411473+0000","last_active":"2024-01-21T19:59:06.415420+0000","last_peered":"2024-01-21T19:59:06.415420+0000","last_clean":"2024-01-21T19:59:06.415420+0000","last_became_active":"2024-01-21T19:59:06.408751+0000","last_became_peered":"2024-01-21T19:59:06.408751+0000","last_unstale":"2024-01-21T19:59:06.415420+0000","last_undegraded":"2024-01-21T19:59:06.415420+0000","last_fullsized":"2024-01-21T19:59:06.415420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419677+0000","last_change":"2024-01-21T19:59:06.037480+0000","last_active":"2024-01-21T19:59:06.419677+0000","last_peered":"2024-01-21T19:59:06.419677+0000","last_clean":"2024-01-21T19:59:06.419677+0000","last_became_active":"2024-01-21T19:59:06.037054+0000","last_became_peered":"2024-01-21T19:59:06.037054+0000","last_unstale":"2024-01-21T19:59:06.419677+0000","last_undegraded":"2024-01-21T19:59:06.419677+0000","last_fullsized":"2024-01-21T19:59:06.419677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413369+0000","last_change":"2024-01-21T19:59:06.411113+0000","last_active":"2024-01-21T19:59:06.413369+0000","last_peered":"2024-01-21T19:59:06.413369+0000","last_clean":"2024-01-21T19:59:06.413369+0000","last_became_active":"2024-01-21T19:59:06.410842+0000","last_became_peered":"2024-01-21T19:59:06.410842+0000","last_unstale":"2024-01-21T19:59:06.413369+0000","last_undegraded":"2024-01-21T19:59:06.413369+0000","last_fullsized":"2024-01-21T19:59:06.413369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415706+0000","last_change":"2024-01-21T19:59:06.042850+0000","last_active":"2024-01-21T19:59:06.415706+0000","last_peered":"2024-01-21T19:59:06.415706+0000","last_clean":"2024-01-21T19:59:06.415706+0000","last_became_active":"2024-01-21T19:59:06.041938+0000","last_became_peered":"2024-01-21T19:59:06.041938+0000","last_unstale":"2024-01-21T19:59:06.415706+0000","last_undegraded":"2024-01-21T19:59:06.415706+0000","last_fullsized":"2024-01-21T19:59:06.415706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413389+0000","last_change":"2024-01-21T19:59:06.411722+0000","last_active":"2024-01-21T19:59:06.413389+0000","last_peered":"2024-01-21T19:59:06.413389+0000","last_clean":"2024-01-21T19:59:06.413389+0000","last_became_active":"2024-01-21T19:59:06.411400+0000","last_became_peered":"2024-01-21T19:59:06.411400+0000","last_unstale":"2024-01-21T19:59:06.413389+0000","last_undegraded":"2024-01-21T19:59:06.413389+0000","last_fullsized":"2024-01-21T19:59:06.413389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392771+0000","last_change":"2024-01-21T19:59:06.040019+0000","last_active":"2024-01-21T19:59:06.392771+0000","last_peered":"2024-01-21T19:59:06.392771+0000","last_clean":"2024-01-21T19:59:06.392771+0000","last_became_active":"2024-01-21T19:59:06.038603+0000","last_became_peered":"2024-01-21T19:59:06.038603+0000","last_unstale":"2024-01-21T19:59:06.392771+0000","last_undegraded":"2024-01-21T19:59:06.392771+0000","last_fullsized":"2024-01-21T19:59:06.392771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401930+0000","last_change":"2024-01-21T19:59:06.397578+0000","last_active":"2024-01-21T19:59:06.401930+0000","last_peered":"2024-01-21T19:59:06.401930+0000","last_clean":"2024-01-21T19:59:06.401930+0000","last_became_active":"2024-01-21T19:59:06.397304+0000","last_became_peered":"2024-01-21T19:59:06.397304+0000","last_unstale":"2024-01-21T19:59:06.401930+0000","last_undegraded":"2024-01-21T19:59:06.401930+0000","last_fullsized":"2024-01-21T19:59:06.401930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405880+0000","last_change":"2024-01-21T19:59:06.037427+0000","last_active":"2024-01-21T19:59:06.405880+0000","last_peered":"2024-01-21T19:59:06.405880+0000","last_clean":"2024-01-21T19:59:06.405880+0000","last_became_active":"2024-01-21T19:59:06.037106+0000","last_became_peered":"2024-01-21T19:59:06.037106+0000","last_unstale":"2024-01-21T19:59:06.405880+0000","last_undegraded":"2024-01-21T19:59:06.405880+0000","last_fullsized":"2024-01-21T19:59:06.405880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412944+0000","last_change":"2024-01-21T19:59:06.410874+0000","last_active":"2024-01-21T19:59:06.412944+0000","last_peered":"2024-01-21T19:59:06.412944+0000","last_clean":"2024-01-21T19:59:06.412944+0000","last_became_active":"2024-01-21T19:59:06.410611+0000","last_became_peered":"2024-01-21T19:59:06.410611+0000","last_unstale":"2024-01-21T19:59:06.412944+0000","last_undegraded":"2024-01-21T19:59:06.412944+0000","last_fullsized":"2024-01-21T19:59:06.412944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407859+0000","last_change":"2024-01-21T19:59:06.041197+0000","last_active":"2024-01-21T19:59:06.407859+0000","last_peered":"2024-01-21T19:59:06.407859+0000","last_clean":"2024-01-21T19:59:06.407859+0000","last_became_active":"2024-01-21T19:59:06.040869+0000","last_became_peered":"2024-01-21T19:59:06.040869+0000","last_unstale":"2024-01-21T19:59:06.407859+0000","last_undegraded":"2024-01-21T19:59:06.407859+0000","last_fullsized":"2024-01-21T19:59:06.407859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413128+0000","last_change":"2024-01-21T19:59:06.411500+0000","last_active":"2024-01-21T19:59:06.413128+0000","last_peered":"2024-01-21T19:59:06.413128+0000","last_clean":"2024-01-21T19:59:06.413128+0000","last_became_active":"2024-01-21T19:59:06.411276+0000","last_became_peered":"2024-01-21T19:59:06.411276+0000","last_unstale":"2024-01-21T19:59:06.413128+0000","last_undegraded":"2024-01-21T19:59:06.413128+0000","last_fullsized":"2024-01-21T19:59:06.413128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415690+0000","last_change":"2024-01-21T19:59:06.038505+0000","last_active":"2024-01-21T19:59:06.415690+0000","last_peered":"2024-01-21T19:59:06.415690+0000","last_clean":"2024-01-21T19:59:06.415690+0000","last_became_active":"2024-01-21T19:59:06.038100+0000","last_became_peered":"2024-01-21T19:59:06.038100+0000","last_unstale":"2024-01-21T19:59:06.415690+0000","last_undegraded":"2024-01-21T19:59:06.415690+0000","last_fullsized":"2024-01-21T19:59:06.415690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415464+0000","last_change":"2024-01-21T19:59:06.412541+0000","last_active":"2024-01-21T19:59:06.415464+0000","last_peered":"2024-01-21T19:59:06.415464+0000","last_clean":"2024-01-21T19:59:06.415464+0000","last_became_active":"2024-01-21T19:59:06.412353+0000","last_became_peered":"2024-01-21T19:59:06.412353+0000","last_unstale":"2024-01-21T19:59:06.415464+0000","last_undegraded":"2024-01-21T19:59:06.415464+0000","last_fullsized":"2024-01-21T19:59:06.415464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418953+0000","last_change":"2024-01-21T19:59:06.034594+0000","last_active":"2024-01-21T19:59:06.418953+0000","last_peered":"2024-01-21T19:59:06.418953+0000","last_clean":"2024-01-21T19:59:06.418953+0000","last_became_active":"2024-01-21T19:59:06.034292+0000","last_became_peered":"2024-01-21T19:59:06.034292+0000","last_unstale":"2024-01-21T19:59:06.418953+0000","last_undegraded":"2024-01-21T19:59:06.418953+0000","last_fullsized":"2024-01-21T19:59:06.418953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416149+0000","last_change":"2024-01-21T19:59:06.411225+0000","last_active":"2024-01-21T19:59:06.416149+0000","last_peered":"2024-01-21T19:59:06.416149+0000","last_clean":"2024-01-21T19:59:06.416149+0000","last_became_active":"2024-01-21T19:59:06.410953+0000","last_became_peered":"2024-01-21T19:59:06.410953+0000","last_unstale":"2024-01-21T19:59:06.416149+0000","last_undegraded":"2024-01-21T19:59:06.416149+0000","last_fullsized":"2024-01-21T19:59:06.416149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399828+0000","last_change":"2024-01-21T19:59:06.037843+0000","last_active":"2024-01-21T19:59:06.399828+0000","last_peered":"2024-01-21T19:59:06.399828+0000","last_clean":"2024-01-21T19:59:06.399828+0000","last_became_active":"2024-01-21T19:59:06.033911+0000","last_became_peered":"2024-01-21T19:59:06.033911+0000","last_unstale":"2024-01-21T19:59:06.399828+0000","last_undegraded":"2024-01-21T19:59:06.399828+0000","last_fullsized":"2024-01-21T19:59:06.399828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.411011+0000","last_change":"2024-01-21T19:59:06.409655+0000","last_active":"2024-01-21T19:59:06.411011+0000","last_peered":"2024-01-21T19:59:06.411011+0000","last_clean":"2024-01-21T19:59:06.411011+0000","last_became_active":"2024-01-21T19:59:06.408656+0000","last_became_peered":"2024-01-21T19:59:06.408656+0000","last_unstale":"2024-01-21T19:59:06.411011+0000","last_undegraded":"2024-01-21T19:59:06.411011+0000","last_fullsized":"2024-01-21T19:59:06.411011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392261+0000","last_change":"2024-01-21T19:59:06.036207+0000","last_active":"2024-01-21T19:59:06.392261+0000","last_peered":"2024-01-21T19:59:06.392261+0000","last_clean":"2024-01-21T19:59:06.392261+0000","last_became_active":"2024-01-21T19:59:06.035921+0000","last_became_peered":"2024-01-21T19:59:06.035921+0000","last_unstale":"2024-01-21T19:59:06.392261+0000","last_undegraded":"2024-01-21T19:59:06.392261+0000","last_fullsized":"2024-01-21T19:59:06.392261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416535+0000","last_change":"2024-01-21T19:59:06.406341+0000","last_active":"2024-01-21T19:59:06.416535+0000","last_peered":"2024-01-21T19:59:06.416535+0000","last_clean":"2024-01-21T19:59:06.416535+0000","last_became_active":"2024-01-21T19:59:06.405508+0000","last_became_peered":"2024-01-21T19:59:06.405508+0000","last_unstale":"2024-01-21T19:59:06.416535+0000","last_undegraded":"2024-01-21T19:59:06.416535+0000","last_fullsized":"2024-01-21T19:59:06.416535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399066+0000","last_change":"2024-01-21T19:59:06.042182+0000","last_active":"2024-01-21T19:59:06.399066+0000","last_peered":"2024-01-21T19:59:06.399066+0000","last_clean":"2024-01-21T19:59:06.399066+0000","last_became_active":"2024-01-21T19:59:06.041899+0000","last_became_peered":"2024-01-21T19:59:06.041899+0000","last_unstale":"2024-01-21T19:59:06.399066+0000","last_undegraded":"2024-01-21T19:59:06.399066+0000","last_fullsized":"2024-01-21T19:59:06.399066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417530+0000","last_change":"2024-01-21T19:59:06.408589+0000","last_active":"2024-01-21T19:59:06.417530+0000","last_peered":"2024-01-21T19:59:06.417530+0000","last_clean":"2024-01-21T19:59:06.417530+0000","last_became_active":"2024-01-21T19:59:06.407943+0000","last_became_peered":"2024-01-21T19:59:06.407943+0000","last_unstale":"2024-01-21T19:59:06.417530+0000","last_undegraded":"2024-01-21T19:59:06.417530+0000","last_fullsized":"2024-01-21T19:59:06.417530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396785+0000","last_change":"2024-01-21T19:59:06.030824+0000","last_active":"2024-01-21T19:59:06.396785+0000","last_peered":"2024-01-21T19:59:06.396785+0000","last_clean":"2024-01-21T19:59:06.396785+0000","last_became_active":"2024-01-21T19:59:06.030428+0000","last_became_peered":"2024-01-21T19:59:06.030428+0000","last_unstale":"2024-01-21T19:59:06.396785+0000","last_undegraded":"2024-01-21T19:59:06.396785+0000","last_fullsized":"2024-01-21T19:59:06.396785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415606+0000","last_change":"2024-01-21T19:59:06.409370+0000","last_active":"2024-01-21T19:59:06.415606+0000","last_peered":"2024-01-21T19:59:06.415606+0000","last_clean":"2024-01-21T19:59:06.415606+0000","last_became_active":"2024-01-21T19:59:06.406417+0000","last_became_peered":"2024-01-21T19:59:06.406417+0000","last_unstale":"2024-01-21T19:59:06.415606+0000","last_undegraded":"2024-01-21T19:59:06.415606+0000","last_fullsized":"2024-01-21T19:59:06.415606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406327+0000","last_change":"2024-01-21T19:59:06.035645+0000","last_active":"2024-01-21T19:59:06.406327+0000","last_peered":"2024-01-21T19:59:06.406327+0000","last_clean":"2024-01-21T19:59:06.406327+0000","last_became_active":"2024-01-21T19:59:06.035356+0000","last_became_peered":"2024-01-21T19:59:06.035356+0000","last_unstale":"2024-01-21T19:59:06.406327+0000","last_undegraded":"2024-01-21T19:59:06.406327+0000","last_fullsized":"2024-01-21T19:59:06.406327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412394+0000","last_change":"2024-01-21T19:59:06.407766+0000","last_active":"2024-01-21T19:59:06.412394+0000","last_peered":"2024-01-21T19:59:06.412394+0000","last_clean":"2024-01-21T19:59:06.412394+0000","last_became_active":"2024-01-21T19:59:06.407502+0000","last_became_peered":"2024-01-21T19:59:06.407502+0000","last_unstale":"2024-01-21T19:59:06.412394+0000","last_undegraded":"2024-01-21T19:59:06.412394+0000","last_fullsized":"2024-01-21T19:59:06.412394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392023+0000","last_change":"2024-01-21T19:59:06.036576+0000","last_active":"2024-01-21T19:59:06.392023+0000","last_peered":"2024-01-21T19:59:06.392023+0000","last_clean":"2024-01-21T19:59:06.392023+0000","last_became_active":"2024-01-21T19:59:06.036282+0000","last_became_peered":"2024-01-21T19:59:06.036282+0000","last_unstale":"2024-01-21T19:59:06.392023+0000","last_undegraded":"2024-01-21T19:59:06.392023+0000","last_fullsized":"2024-01-21T19:59:06.392023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403780+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:06.403780+0000","last_peered":"2024-01-21T19:59:06.403780+0000","last_clean":"2024-01-21T19:59:06.403780+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:06.403780+0000","last_undegraded":"2024-01-21T19:59:06.403780+0000","last_fullsized":"2024-01-21T19:59:06.403780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391912+0000","last_change":"2024-01-21T19:59:06.035851+0000","last_active":"2024-01-21T19:59:06.391912+0000","last_peered":"2024-01-21T19:59:06.391912+0000","last_clean":"2024-01-21T19:59:06.391912+0000","last_became_active":"2024-01-21T19:59:06.035316+0000","last_became_peered":"2024-01-21T19:59:06.035316+0000","last_unstale":"2024-01-21T19:59:06.391912+0000","last_undegraded":"2024-01-21T19:59:06.391912+0000","last_fullsized":"2024-01-21T19:59:06.391912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412286+0000","last_change":"2024-01-21T19:59:06.406779+0000","last_active":"2024-01-21T19:59:06.412286+0000","last_peered":"2024-01-21T19:59:06.412286+0000","last_clean":"2024-01-21T19:59:06.412286+0000","last_became_active":"2024-01-21T19:59:06.406509+0000","last_became_peered":"2024-01-21T19:59:06.406509+0000","last_unstale":"2024-01-21T19:59:06.412286+0000","last_undegraded":"2024-01-21T19:59:06.412286+0000","last_fullsized":"2024-01-21T19:59:06.412286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392515+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:06.392515+0000","last_peered":"2024-01-21T19:59:06.392515+0000","last_clean":"2024-01-21T19:59:06.392515+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:06.392515+0000","last_undegraded":"2024-01-21T19:59:06.392515+0000","last_fullsized":"2024-01-21T19:59:06.392515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407902+0000","last_change":"2024-01-21T19:59:06.041554+0000","last_active":"2024-01-21T19:59:06.407902+0000","last_peered":"2024-01-21T19:59:06.407902+0000","last_clean":"2024-01-21T19:59:06.407902+0000","last_became_active":"2024-01-21T19:59:06.041229+0000","last_became_peered":"2024-01-21T19:59:06.041229+0000","last_unstale":"2024-01-21T19:59:06.407902+0000","last_undegraded":"2024-01-21T19:59:06.407902+0000","last_fullsized":"2024-01-21T19:59:06.407902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412418+0000","last_change":"2024-01-21T19:59:06.407976+0000","last_active":"2024-01-21T19:59:06.412418+0000","last_peered":"2024-01-21T19:59:06.412418+0000","last_clean":"2024-01-21T19:59:06.412418+0000","last_became_active":"2024-01-21T19:59:06.407713+0000","last_became_peered":"2024-01-21T19:59:06.407713+0000","last_unstale":"2024-01-21T19:59:06.412418+0000","last_undegraded":"2024-01-21T19:59:06.412418+0000","last_fullsized":"2024-01-21T19:59:06.412418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412281+0000","last_change":"2024-01-21T19:59:06.406673+0000","last_active":"2024-01-21T19:59:06.412281+0000","last_peered":"2024-01-21T19:59:06.412281+0000","last_clean":"2024-01-21T19:59:06.412281+0000","last_became_active":"2024-01-21T19:59:06.406394+0000","last_became_peered":"2024-01-21T19:59:06.406394+0000","last_unstale":"2024-01-21T19:59:06.412281+0000","last_undegraded":"2024-01-21T19:59:06.412281+0000","last_fullsized":"2024-01-21T19:59:06.412281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388616+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:06.388616+0000","last_peered":"2024-01-21T19:59:06.388616+0000","last_clean":"2024-01-21T19:59:06.388616+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:06.388616+0000","last_undegraded":"2024-01-21T19:59:06.388616+0000","last_fullsized":"2024-01-21T19:59:06.388616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403727+0000","last_change":"2024-01-21T19:59:06.031330+0000","last_active":"2024-01-21T19:59:06.403727+0000","last_peered":"2024-01-21T19:59:06.403727+0000","last_clean":"2024-01-21T19:59:06.403727+0000","last_became_active":"2024-01-21T19:59:06.031043+0000","last_became_peered":"2024-01-21T19:59:06.031043+0000","last_unstale":"2024-01-21T19:59:06.403727+0000","last_undegraded":"2024-01-21T19:59:06.403727+0000","last_fullsized":"2024-01-21T19:59:06.403727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414575+0000","last_change":"2024-01-21T19:59:06.409494+0000","last_active":"2024-01-21T19:59:06.414575+0000","last_peered":"2024-01-21T19:59:06.414575+0000","last_clean":"2024-01-21T19:59:06.414575+0000","last_became_active":"2024-01-21T19:59:06.409221+0000","last_became_peered":"2024-01-21T19:59:06.409221+0000","last_unstale":"2024-01-21T19:59:06.414575+0000","last_undegraded":"2024-01-21T19:59:06.414575+0000","last_fullsized":"2024-01-21T19:59:06.414575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391231+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:06.391231+0000","last_peered":"2024-01-21T19:59:06.391231+0000","last_clean":"2024-01-21T19:59:06.391231+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:06.391231+0000","last_undegraded":"2024-01-21T19:59:06.391231+0000","last_fullsized":"2024-01-21T19:59:06.391231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.398950+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:06.398950+0000","last_peered":"2024-01-21T19:59:06.398950+0000","last_clean":"2024-01-21T19:59:06.398950+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:06.398950+0000","last_undegraded":"2024-01-21T19:59:06.398950+0000","last_fullsized":"2024-01-21T19:59:06.398950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392105+0000","last_change":"2024-01-21T19:59:06.034391+0000","last_active":"2024-01-21T19:59:06.392105+0000","last_peered":"2024-01-21T19:59:06.392105+0000","last_clean":"2024-01-21T19:59:06.392105+0000","last_became_active":"2024-01-21T19:59:06.034060+0000","last_became_peered":"2024-01-21T19:59:06.034060+0000","last_unstale":"2024-01-21T19:59:06.392105+0000","last_undegraded":"2024-01-21T19:59:06.392105+0000","last_fullsized":"2024-01-21T19:59:06.392105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410899+0000","last_change":"2024-01-21T19:59:06.408800+0000","last_active":"2024-01-21T19:59:06.410899+0000","last_peered":"2024-01-21T19:59:06.410899+0000","last_clean":"2024-01-21T19:59:06.410899+0000","last_became_active":"2024-01-21T19:59:06.408515+0000","last_became_peered":"2024-01-21T19:59:06.408515+0000","last_unstale":"2024-01-21T19:59:06.410899+0000","last_undegraded":"2024-01-21T19:59:06.410899+0000","last_fullsized":"2024-01-21T19:59:06.410899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401822+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:06.401822+0000","last_peered":"2024-01-21T19:59:06.401822+0000","last_clean":"2024-01-21T19:59:06.401822+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:06.401822+0000","last_undegraded":"2024-01-21T19:59:06.401822+0000","last_fullsized":"2024-01-21T19:59:06.401822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391457+0000","last_change":"2024-01-21T19:59:06.041530+0000","last_active":"2024-01-21T19:59:06.391457+0000","last_peered":"2024-01-21T19:59:06.391457+0000","last_clean":"2024-01-21T19:59:06.391457+0000","last_became_active":"2024-01-21T19:59:06.041251+0000","last_became_peered":"2024-01-21T19:59:06.041251+0000","last_unstale":"2024-01-21T19:59:06.391457+0000","last_undegraded":"2024-01-21T19:59:06.391457+0000","last_fullsized":"2024-01-21T19:59:06.391457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399714+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:06.399714+0000","last_peered":"2024-01-21T19:59:06.399714+0000","last_clean":"2024-01-21T19:59:06.399714+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:06.399714+0000","last_undegraded":"2024-01-21T19:59:06.399714+0000","last_fullsized":"2024-01-21T19:59:06.399714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403900+0000","last_change":"2024-01-21T19:59:06.031857+0000","last_active":"2024-01-21T19:59:06.403900+0000","last_peered":"2024-01-21T19:59:06.403900+0000","last_clean":"2024-01-21T19:59:06.403900+0000","last_became_active":"2024-01-21T19:59:06.031591+0000","last_became_peered":"2024-01-21T19:59:06.031591+0000","last_unstale":"2024-01-21T19:59:06.403900+0000","last_undegraded":"2024-01-21T19:59:06.403900+0000","last_fullsized":"2024-01-21T19:59:06.403900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402917+0000","last_change":"2024-01-21T19:59:06.401094+0000","last_active":"2024-01-21T19:59:06.402917+0000","last_peered":"2024-01-21T19:59:06.402917+0000","last_clean":"2024-01-21T19:59:06.402917+0000","last_became_active":"2024-01-21T19:59:06.400832+0000","last_became_peered":"2024-01-21T19:59:06.400832+0000","last_unstale":"2024-01-21T19:59:06.402917+0000","last_undegraded":"2024-01-21T19:59:06.402917+0000","last_fullsized":"2024-01-21T19:59:06.402917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410385+0000","last_change":"2024-01-21T19:59:06.039467+0000","last_active":"2024-01-21T19:59:06.410385+0000","last_peered":"2024-01-21T19:59:06.410385+0000","last_clean":"2024-01-21T19:59:06.410385+0000","last_became_active":"2024-01-21T19:59:06.039167+0000","last_became_peered":"2024-01-21T19:59:06.039167+0000","last_unstale":"2024-01-21T19:59:06.410385+0000","last_undegraded":"2024-01-21T19:59:06.410385+0000","last_fullsized":"2024-01-21T19:59:06.410385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405399+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:06.405399+0000","last_peered":"2024-01-21T19:59:06.405399+0000","last_clean":"2024-01-21T19:59:06.405399+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:06.405399+0000","last_undegraded":"2024-01-21T19:59:06.405399+0000","last_fullsized":"2024-01-21T19:59:06.405399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413120+0000","last_change":"2024-01-21T19:59:06.410865+0000","last_active":"2024-01-21T19:59:06.413120+0000","last_peered":"2024-01-21T19:59:06.413120+0000","last_clean":"2024-01-21T19:59:06.413120+0000","last_became_active":"2024-01-21T19:59:06.410572+0000","last_became_peered":"2024-01-21T19:59:06.410572+0000","last_unstale":"2024-01-21T19:59:06.413120+0000","last_undegraded":"2024-01-21T19:59:06.413120+0000","last_fullsized":"2024-01-21T19:59:06.413120+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396528+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:06.396528+0000","last_peered":"2024-01-21T19:59:06.396528+0000","last_clean":"2024-01-21T19:59:06.396528+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:06.396528+0000","last_undegraded":"2024-01-21T19:59:06.396528+0000","last_fullsized":"2024-01-21T19:59:06.396528+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392481+0000","last_change":"2024-01-21T19:59:06.039407+0000","last_active":"2024-01-21T19:59:06.392481+0000","last_peered":"2024-01-21T19:59:06.392481+0000","last_clean":"2024-01-21T19:59:06.392481+0000","last_became_active":"2024-01-21T19:59:06.039118+0000","last_became_peered":"2024-01-21T19:59:06.039118+0000","last_unstale":"2024-01-21T19:59:06.392481+0000","last_undegraded":"2024-01-21T19:59:06.392481+0000","last_fullsized":"2024-01-21T19:59:06.392481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415445+0000","last_change":"2024-01-21T19:59:06.411742+0000","last_active":"2024-01-21T19:59:06.415445+0000","last_peered":"2024-01-21T19:59:06.415445+0000","last_clean":"2024-01-21T19:59:06.415445+0000","last_became_active":"2024-01-21T19:59:06.408852+0000","last_became_peered":"2024-01-21T19:59:06.408852+0000","last_unstale":"2024-01-21T19:59:06.415445+0000","last_undegraded":"2024-01-21T19:59:06.415445+0000","last_fullsized":"2024-01-21T19:59:06.415445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413174+0000","last_change":"2024-01-21T19:59:06.411871+0000","last_active":"2024-01-21T19:59:06.413174+0000","last_peered":"2024-01-21T19:59:06.413174+0000","last_clean":"2024-01-21T19:59:06.413174+0000","last_became_active":"2024-01-21T19:59:06.411604+0000","last_became_peered":"2024-01-21T19:59:06.411604+0000","last_unstale":"2024-01-21T19:59:06.413174+0000","last_undegraded":"2024-01-21T19:59:06.413174+0000","last_fullsized":"2024-01-21T19:59:06.413174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394020+0000","last_change":"2024-01-21T19:59:06.042778+0000","last_active":"2024-01-21T19:59:06.394020+0000","last_peered":"2024-01-21T19:59:06.394020+0000","last_clean":"2024-01-21T19:59:06.394020+0000","last_became_active":"2024-01-21T19:59:06.042250+0000","last_became_peered":"2024-01-21T19:59:06.042250+0000","last_unstale":"2024-01-21T19:59:06.394020+0000","last_undegraded":"2024-01-21T19:59:06.394020+0000","last_fullsized":"2024-01-21T19:59:06.394020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415400+0000","last_change":"2024-01-21T19:59:06.408475+0000","last_active":"2024-01-21T19:59:06.415400+0000","last_peered":"2024-01-21T19:59:06.415400+0000","last_clean":"2024-01-21T19:59:06.415400+0000","last_became_active":"2024-01-21T19:59:06.406096+0000","last_became_peered":"2024-01-21T19:59:06.406096+0000","last_unstale":"2024-01-21T19:59:06.415400+0000","last_undegraded":"2024-01-21T19:59:06.415400+0000","last_fullsized":"2024-01-21T19:59:06.415400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392127+0000","last_change":"2024-01-21T19:59:06.041454+0000","last_active":"2024-01-21T19:59:06.392127+0000","last_peered":"2024-01-21T19:59:06.392127+0000","last_clean":"2024-01-21T19:59:06.392127+0000","last_became_active":"2024-01-21T19:59:06.041172+0000","last_became_peered":"2024-01-21T19:59:06.041172+0000","last_unstale":"2024-01-21T19:59:06.392127+0000","last_undegraded":"2024-01-21T19:59:06.392127+0000","last_fullsized":"2024-01-21T19:59:06.392127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416665+0000","last_change":"2024-01-21T19:59:06.404670+0000","last_active":"2024-01-21T19:59:06.416665+0000","last_peered":"2024-01-21T19:59:06.416665+0000","last_clean":"2024-01-21T19:59:06.416665+0000","last_became_active":"2024-01-21T19:59:06.404385+0000","last_became_peered":"2024-01-21T19:59:06.404385+0000","last_unstale":"2024-01-21T19:59:06.416665+0000","last_undegraded":"2024-01-21T19:59:06.416665+0000","last_fullsized":"2024-01-21T19:59:06.416665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404466+0000","last_change":"2024-01-21T19:59:06.032073+0000","last_active":"2024-01-21T19:59:06.404466+0000","last_peered":"2024-01-21T19:59:06.404466+0000","last_clean":"2024-01-21T19:59:06.404466+0000","last_became_active":"2024-01-21T19:59:06.031626+0000","last_became_peered":"2024-01-21T19:59:06.031626+0000","last_unstale":"2024-01-21T19:59:06.404466+0000","last_undegraded":"2024-01-21T19:59:06.404466+0000","last_fullsized":"2024-01-21T19:59:06.404466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402318+0000","last_change":"2024-01-21T19:59:06.399583+0000","last_active":"2024-01-21T19:59:06.402318+0000","last_peered":"2024-01-21T19:59:06.402318+0000","last_clean":"2024-01-21T19:59:06.402318+0000","last_became_active":"2024-01-21T19:59:06.399318+0000","last_became_peered":"2024-01-21T19:59:06.399318+0000","last_unstale":"2024-01-21T19:59:06.402318+0000","last_undegraded":"2024-01-21T19:59:06.402318+0000","last_fullsized":"2024-01-21T19:59:06.402318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.406744+0000","last_change":"2024-01-21T19:59:06.034516+0000","last_active":"2024-01-21T19:59:06.406744+0000","last_peered":"2024-01-21T19:59:06.406744+0000","last_clean":"2024-01-21T19:59:06.406744+0000","last_became_active":"2024-01-21T19:59:06.034231+0000","last_became_peered":"2024-01-21T19:59:06.034231+0000","last_unstale":"2024-01-21T19:59:06.406744+0000","last_undegraded":"2024-01-21T19:59:06.406744+0000","last_fullsized":"2024-01-21T19:59:06.406744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418474+0000","last_change":"2024-01-21T19:59:06.413015+0000","last_active":"2024-01-21T19:59:06.418474+0000","last_peered":"2024-01-21T19:59:06.418474+0000","last_clean":"2024-01-21T19:59:06.418474+0000","last_became_active":"2024-01-21T19:59:06.412719+0000","last_became_peered":"2024-01-21T19:59:06.412719+0000","last_unstale":"2024-01-21T19:59:06.418474+0000","last_undegraded":"2024-01-21T19:59:06.418474+0000","last_fullsized":"2024-01-21T19:59:06.418474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400212+0000","last_change":"2024-01-21T19:59:06.037831+0000","last_active":"2024-01-21T19:59:06.400212+0000","last_peered":"2024-01-21T19:59:06.400212+0000","last_clean":"2024-01-21T19:59:06.400212+0000","last_became_active":"2024-01-21T19:59:06.037213+0000","last_became_peered":"2024-01-21T19:59:06.037213+0000","last_unstale":"2024-01-21T19:59:06.400212+0000","last_undegraded":"2024-01-21T19:59:06.400212+0000","last_fullsized":"2024-01-21T19:59:06.400212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412328+0000","last_change":"2024-01-21T19:59:06.407158+0000","last_active":"2024-01-21T19:59:06.412328+0000","last_peered":"2024-01-21T19:59:06.412328+0000","last_clean":"2024-01-21T19:59:06.412328+0000","last_became_active":"2024-01-21T19:59:06.406887+0000","last_became_peered":"2024-01-21T19:59:06.406887+0000","last_unstale":"2024-01-21T19:59:06.412328+0000","last_undegraded":"2024-01-21T19:59:06.412328+0000","last_fullsized":"2024-01-21T19:59:06.412328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394796+0000","last_change":"2024-01-21T19:59:06.040441+0000","last_active":"2024-01-21T19:59:06.394796+0000","last_peered":"2024-01-21T19:59:06.394796+0000","last_clean":"2024-01-21T19:59:06.394796+0000","last_became_active":"2024-01-21T19:59:06.040145+0000","last_became_peered":"2024-01-21T19:59:06.040145+0000","last_unstale":"2024-01-21T19:59:06.394796+0000","last_undegraded":"2024-01-21T19:59:06.394796+0000","last_fullsized":"2024-01-21T19:59:06.394796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412523+0000","last_change":"2024-01-21T19:59:06.408682+0000","last_active":"2024-01-21T19:59:06.412523+0000","last_peered":"2024-01-21T19:59:06.412523+0000","last_clean":"2024-01-21T19:59:06.412523+0000","last_became_active":"2024-01-21T19:59:06.408415+0000","last_became_peered":"2024-01-21T19:59:06.408415+0000","last_unstale":"2024-01-21T19:59:06.412523+0000","last_undegraded":"2024-01-21T19:59:06.412523+0000","last_fullsized":"2024-01-21T19:59:06.412523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388707+0000","last_change":"2024-01-21T19:59:06.033168+0000","last_active":"2024-01-21T19:59:06.388707+0000","last_peered":"2024-01-21T19:59:06.388707+0000","last_clean":"2024-01-21T19:59:06.388707+0000","last_became_active":"2024-01-21T19:59:06.032815+0000","last_became_peered":"2024-01-21T19:59:06.032815+0000","last_unstale":"2024-01-21T19:59:06.388707+0000","last_undegraded":"2024-01-21T19:59:06.388707+0000","last_fullsized":"2024-01-21T19:59:06.388707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.414019+0000","last_change":"2024-01-21T19:59:06.412182+0000","last_active":"2024-01-21T19:59:06.414019+0000","last_peered":"2024-01-21T19:59:06.414019+0000","last_clean":"2024-01-21T19:59:06.414019+0000","last_became_active":"2024-01-21T19:59:06.411457+0000","last_became_peered":"2024-01-21T19:59:06.411457+0000","last_unstale":"2024-01-21T19:59:06.414019+0000","last_undegraded":"2024-01-21T19:59:06.414019+0000","last_fullsized":"2024-01-21T19:59:06.414019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392449+0000","last_change":"2024-01-21T19:59:06.036108+0000","last_active":"2024-01-21T19:59:06.392449+0000","last_peered":"2024-01-21T19:59:06.392449+0000","last_clean":"2024-01-21T19:59:06.392449+0000","last_became_active":"2024-01-21T19:59:06.035841+0000","last_became_peered":"2024-01-21T19:59:06.035841+0000","last_unstale":"2024-01-21T19:59:06.392449+0000","last_undegraded":"2024-01-21T19:59:06.392449+0000","last_fullsized":"2024-01-21T19:59:06.392449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413392+0000","last_change":"2024-01-21T19:59:06.411927+0000","last_active":"2024-01-21T19:59:06.413392+0000","last_peered":"2024-01-21T19:59:06.413392+0000","last_clean":"2024-01-21T19:59:06.413392+0000","last_became_active":"2024-01-21T19:59:06.411661+0000","last_became_peered":"2024-01-21T19:59:06.411661+0000","last_unstale":"2024-01-21T19:59:06.413392+0000","last_undegraded":"2024-01-21T19:59:06.413392+0000","last_fullsized":"2024-01-21T19:59:06.413392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.036660+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.036371+0000","last_became_peered":"2024-01-21T19:59:06.036371+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415968+0000","last_change":"2024-01-21T19:59:06.415069+0000","last_active":"2024-01-21T19:59:06.415968+0000","last_peered":"2024-01-21T19:59:06.415968+0000","last_clean":"2024-01-21T19:59:06.415968+0000","last_became_active":"2024-01-21T19:59:06.414647+0000","last_became_peered":"2024-01-21T19:59:06.414647+0000","last_unstale":"2024-01-21T19:59:06.415968+0000","last_undegraded":"2024-01-21T19:59:06.415968+0000","last_fullsized":"2024-01-21T19:59:06.415968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.393346+0000","last_change":"2024-01-21T19:59:06.042806+0000","last_active":"2024-01-21T19:59:06.393346+0000","last_peered":"2024-01-21T19:59:06.393346+0000","last_clean":"2024-01-21T19:59:06.393346+0000","last_became_active":"2024-01-21T19:59:06.042528+0000","last_became_peered":"2024-01-21T19:59:06.042528+0000","last_unstale":"2024-01-21T19:59:06.393346+0000","last_undegraded":"2024-01-21T19:59:06.393346+0000","last_fullsized":"2024-01-21T19:59:06.393346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416691+0000","last_change":"2024-01-21T19:59:06.410923+0000","last_active":"2024-01-21T19:59:06.416691+0000","last_peered":"2024-01-21T19:59:06.416691+0000","last_clean":"2024-01-21T19:59:06.416691+0000","last_became_active":"2024-01-21T19:59:06.408605+0000","last_became_peered":"2024-01-21T19:59:06.408605+0000","last_unstale":"2024-01-21T19:59:06.416691+0000","last_undegraded":"2024-01-21T19:59:06.416691+0000","last_fullsized":"2024-01-21T19:59:06.416691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404296+0000","last_change":"2024-01-21T19:59:06.033138+0000","last_active":"2024-01-21T19:59:06.404296+0000","last_peered":"2024-01-21T19:59:06.404296+0000","last_clean":"2024-01-21T19:59:06.404296+0000","last_became_active":"2024-01-21T19:59:06.032729+0000","last_became_peered":"2024-01-21T19:59:06.032729+0000","last_unstale":"2024-01-21T19:59:06.404296+0000","last_undegraded":"2024-01-21T19:59:06.404296+0000","last_fullsized":"2024-01-21T19:59:06.404296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412956+0000","last_change":"2024-01-21T19:59:06.409878+0000","last_active":"2024-01-21T19:59:06.412956+0000","last_peered":"2024-01-21T19:59:06.412956+0000","last_clean":"2024-01-21T19:59:06.412956+0000","last_became_active":"2024-01-21T19:59:06.409584+0000","last_became_peered":"2024-01-21T19:59:06.409584+0000","last_unstale":"2024-01-21T19:59:06.412956+0000","last_undegraded":"2024-01-21T19:59:06.412956+0000","last_fullsized":"2024-01-21T19:59:06.412956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-21T19:59:07.397481+0000","last_change":"2024-01-21T19:59:06.036306+0000","last_active":"2024-01-21T19:59:07.397481+0000","last_peered":"2024-01-21T19:59:07.397481+0000","last_clean":"2024-01-21T19:59:07.397481+0000","last_became_active":"2024-01-21T19:59:06.036019+0000","last_became_peered":"2024-01-21T19:59:06.036019+0000","last_unstale":"2024-01-21T19:59:07.397481+0000","last_undegraded":"2024-01-21T19:59:07.397481+0000","last_fullsized":"2024-01-21T19:59:07.397481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407918+0000","last_change":"2024-01-21T19:59:06.403990+0000","last_active":"2024-01-21T19:59:06.407918+0000","last_peered":"2024-01-21T19:59:06.407918+0000","last_clean":"2024-01-21T19:59:06.407918+0000","last_became_active":"2024-01-21T19:59:06.403735+0000","last_became_peered":"2024-01-21T19:59:06.403735+0000","last_unstale":"2024-01-21T19:59:06.407918+0000","last_undegraded":"2024-01-21T19:59:06.407918+0000","last_fullsized":"2024-01-21T19:59:06.407918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394138+0000","last_change":"2024-01-21T19:59:06.031905+0000","last_active":"2024-01-21T19:59:06.394138+0000","last_peered":"2024-01-21T19:59:06.394138+0000","last_clean":"2024-01-21T19:59:06.394138+0000","last_became_active":"2024-01-21T19:59:06.031528+0000","last_became_peered":"2024-01-21T19:59:06.031528+0000","last_unstale":"2024-01-21T19:59:06.394138+0000","last_undegraded":"2024-01-21T19:59:06.394138+0000","last_fullsized":"2024-01-21T19:59:06.394138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410340+0000","last_change":"2024-01-21T19:59:06.404278+0000","last_active":"2024-01-21T19:59:06.410340+0000","last_peered":"2024-01-21T19:59:06.410340+0000","last_clean":"2024-01-21T19:59:06.410340+0000","last_became_active":"2024-01-21T19:59:06.403605+0000","last_became_peered":"2024-01-21T19:59:06.403605+0000","last_unstale":"2024-01-21T19:59:06.410340+0000","last_undegraded":"2024-01-21T19:59:06.410340+0000","last_fullsized":"2024-01-21T19:59:06.410340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391853+0000","last_change":"2024-01-21T19:59:06.036513+0000","last_active":"2024-01-21T19:59:06.391853+0000","last_peered":"2024-01-21T19:59:06.391853+0000","last_clean":"2024-01-21T19:59:06.391853+0000","last_became_active":"2024-01-21T19:59:06.036203+0000","last_became_peered":"2024-01-21T19:59:06.036203+0000","last_unstale":"2024-01-21T19:59:06.391853+0000","last_undegraded":"2024-01-21T19:59:06.391853+0000","last_fullsized":"2024-01-21T19:59:06.391853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418991+0000","last_change":"2024-01-21T19:59:06.413135+0000","last_active":"2024-01-21T19:59:06.418991+0000","last_peered":"2024-01-21T19:59:06.418991+0000","last_clean":"2024-01-21T19:59:06.418991+0000","last_became_active":"2024-01-21T19:59:06.412662+0000","last_became_peered":"2024-01-21T19:59:06.412662+0000","last_unstale":"2024-01-21T19:59:06.418991+0000","last_undegraded":"2024-01-21T19:59:06.418991+0000","last_fullsized":"2024-01-21T19:59:06.418991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394244+0000","last_change":"2024-01-21T19:59:06.041668+0000","last_active":"2024-01-21T19:59:06.394244+0000","last_peered":"2024-01-21T19:59:06.394244+0000","last_clean":"2024-01-21T19:59:06.394244+0000","last_became_active":"2024-01-21T19:59:06.041337+0000","last_became_peered":"2024-01-21T19:59:06.041337+0000","last_unstale":"2024-01-21T19:59:06.394244+0000","last_undegraded":"2024-01-21T19:59:06.394244+0000","last_fullsized":"2024-01-21T19:59:06.394244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410112+0000","last_change":"2024-01-21T19:59:06.405482+0000","last_active":"2024-01-21T19:59:06.410112+0000","last_peered":"2024-01-21T19:59:06.410112+0000","last_clean":"2024-01-21T19:59:06.410112+0000","last_became_active":"2024-01-21T19:59:06.405206+0000","last_became_peered":"2024-01-21T19:59:06.405206+0000","last_unstale":"2024-01-21T19:59:06.410112+0000","last_undegraded":"2024-01-21T19:59:06.410112+0000","last_fullsized":"2024-01-21T19:59:06.410112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392562+0000","last_change":"2024-01-21T19:59:06.033405+0000","last_active":"2024-01-21T19:59:06.392562+0000","last_peered":"2024-01-21T19:59:06.392562+0000","last_clean":"2024-01-21T19:59:06.392562+0000","last_became_active":"2024-01-21T19:59:06.033067+0000","last_became_peered":"2024-01-21T19:59:06.033067+0000","last_unstale":"2024-01-21T19:59:06.392562+0000","last_undegraded":"2024-01-21T19:59:06.392562+0000","last_fullsized":"2024-01-21T19:59:06.392562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419068+0000","last_change":"2024-01-21T19:59:06.416968+0000","last_active":"2024-01-21T19:59:06.419068+0000","last_peered":"2024-01-21T19:59:06.419068+0000","last_clean":"2024-01-21T19:59:06.419068+0000","last_became_active":"2024-01-21T19:59:06.416702+0000","last_became_peered":"2024-01-21T19:59:06.416702+0000","last_unstale":"2024-01-21T19:59:06.419068+0000","last_undegraded":"2024-01-21T19:59:06.419068+0000","last_fullsized":"2024-01-21T19:59:06.419068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403561+0000","last_change":"2024-01-21T19:59:06.040770+0000","last_active":"2024-01-21T19:59:06.403561+0000","last_peered":"2024-01-21T19:59:06.403561+0000","last_clean":"2024-01-21T19:59:06.403561+0000","last_became_active":"2024-01-21T19:59:06.039205+0000","last_became_peered":"2024-01-21T19:59:06.039205+0000","last_unstale":"2024-01-21T19:59:06.403561+0000","last_undegraded":"2024-01-21T19:59:06.403561+0000","last_fullsized":"2024-01-21T19:59:06.403561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416618+0000","last_change":"2024-01-21T19:59:06.412006+0000","last_active":"2024-01-21T19:59:06.416618+0000","last_peered":"2024-01-21T19:59:06.416618+0000","last_clean":"2024-01-21T19:59:06.416618+0000","last_became_active":"2024-01-21T19:59:06.411000+0000","last_became_peered":"2024-01-21T19:59:06.411000+0000","last_unstale":"2024-01-21T19:59:06.416618+0000","last_undegraded":"2024-01-21T19:59:06.416618+0000","last_fullsized":"2024-01-21T19:59:06.416618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396610+0000","last_change":"2024-01-21T19:59:06.031139+0000","last_active":"2024-01-21T19:59:06.396610+0000","last_peered":"2024-01-21T19:59:06.396610+0000","last_clean":"2024-01-21T19:59:06.396610+0000","last_became_active":"2024-01-21T19:59:06.030914+0000","last_became_peered":"2024-01-21T19:59:06.030914+0000","last_unstale":"2024-01-21T19:59:06.396610+0000","last_undegraded":"2024-01-21T19:59:06.396610+0000","last_fullsized":"2024-01-21T19:59:06.396610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413171+0000","last_change":"2024-01-21T19:59:06.411676+0000","last_active":"2024-01-21T19:59:06.413171+0000","last_peered":"2024-01-21T19:59:06.413171+0000","last_clean":"2024-01-21T19:59:06.413171+0000","last_became_active":"2024-01-21T19:59:06.411417+0000","last_became_peered":"2024-01-21T19:59:06.411417+0000","last_unstale":"2024-01-21T19:59:06.413171+0000","last_undegraded":"2024-01-21T19:59:06.413171+0000","last_fullsized":"2024-01-21T19:59:06.413171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416934+0000","last_change":"2024-01-21T19:59:06.027798+0000","last_active":"2024-01-21T19:59:06.416934+0000","last_peered":"2024-01-21T19:59:06.416934+0000","last_clean":"2024-01-21T19:59:06.416934+0000","last_became_active":"2024-01-21T19:59:06.027498+0000","last_became_peered":"2024-01-21T19:59:06.027498+0000","last_unstale":"2024-01-21T19:59:06.416934+0000","last_undegraded":"2024-01-21T19:59:06.416934+0000","last_fullsized":"2024-01-21T19:59:06.416934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402297+0000","last_change":"2024-01-21T19:59:06.398605+0000","last_active":"2024-01-21T19:59:06.402297+0000","last_peered":"2024-01-21T19:59:06.402297+0000","last_clean":"2024-01-21T19:59:06.402297+0000","last_became_active":"2024-01-21T19:59:06.398350+0000","last_became_peered":"2024-01-21T19:59:06.398350+0000","last_unstale":"2024-01-21T19:59:06.402297+0000","last_undegraded":"2024-01-21T19:59:06.402297+0000","last_fullsized":"2024-01-21T19:59:06.402297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.388678+0000","last_change":"2024-01-21T19:59:06.024779+0000","last_active":"2024-01-21T19:59:06.388678+0000","last_peered":"2024-01-21T19:59:06.388678+0000","last_clean":"2024-01-21T19:59:06.388678+0000","last_became_active":"2024-01-21T19:59:06.024455+0000","last_became_peered":"2024-01-21T19:59:06.024455+0000","last_unstale":"2024-01-21T19:59:06.388678+0000","last_undegraded":"2024-01-21T19:59:06.388678+0000","last_fullsized":"2024-01-21T19:59:06.388678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416608+0000","last_change":"2024-01-21T19:59:06.411381+0000","last_active":"2024-01-21T19:59:06.416608+0000","last_peered":"2024-01-21T19:59:06.416608+0000","last_clean":"2024-01-21T19:59:06.416608+0000","last_became_active":"2024-01-21T19:59:06.411065+0000","last_became_peered":"2024-01-21T19:59:06.411065+0000","last_unstale":"2024-01-21T19:59:06.416608+0000","last_undegraded":"2024-01-21T19:59:06.416608+0000","last_fullsized":"2024-01-21T19:59:06.416608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.391431+0000","last_change":"2024-01-21T19:59:06.035305+0000","last_active":"2024-01-21T19:59:06.391431+0000","last_peered":"2024-01-21T19:59:06.391431+0000","last_clean":"2024-01-21T19:59:06.391431+0000","last_became_active":"2024-01-21T19:59:06.035011+0000","last_became_peered":"2024-01-21T19:59:06.035011+0000","last_unstale":"2024-01-21T19:59:06.391431+0000","last_undegraded":"2024-01-21T19:59:06.391431+0000","last_fullsized":"2024-01-21T19:59:06.391431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410360+0000","last_change":"2024-01-21T19:59:06.404314+0000","last_active":"2024-01-21T19:59:06.410360+0000","last_peered":"2024-01-21T19:59:06.410360+0000","last_clean":"2024-01-21T19:59:06.410360+0000","last_became_active":"2024-01-21T19:59:06.403954+0000","last_became_peered":"2024-01-21T19:59:06.403954+0000","last_unstale":"2024-01-21T19:59:06.410360+0000","last_undegraded":"2024-01-21T19:59:06.410360+0000","last_fullsized":"2024-01-21T19:59:06.410360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403338+0000","last_change":"2024-01-21T19:59:06.039241+0000","last_active":"2024-01-21T19:59:06.403338+0000","last_peered":"2024-01-21T19:59:06.403338+0000","last_clean":"2024-01-21T19:59:06.403338+0000","last_became_active":"2024-01-21T19:59:06.038967+0000","last_became_peered":"2024-01-21T19:59:06.038967+0000","last_unstale":"2024-01-21T19:59:06.403338+0000","last_undegraded":"2024-01-21T19:59:06.403338+0000","last_fullsized":"2024-01-21T19:59:06.403338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404457+0000","last_change":"2024-01-21T19:59:06.398845+0000","last_active":"2024-01-21T19:59:06.404457+0000","last_peered":"2024-01-21T19:59:06.404457+0000","last_clean":"2024-01-21T19:59:06.404457+0000","last_became_active":"2024-01-21T19:59:06.398598+0000","last_became_peered":"2024-01-21T19:59:06.398598+0000","last_unstale":"2024-01-21T19:59:06.404457+0000","last_undegraded":"2024-01-21T19:59:06.404457+0000","last_fullsized":"2024-01-21T19:59:06.404457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403951+0000","last_change":"2024-01-21T19:59:06.031315+0000","last_active":"2024-01-21T19:59:06.403951+0000","last_peered":"2024-01-21T19:59:06.403951+0000","last_clean":"2024-01-21T19:59:06.403951+0000","last_became_active":"2024-01-21T19:59:06.031001+0000","last_became_peered":"2024-01-21T19:59:06.031001+0000","last_unstale":"2024-01-21T19:59:06.403951+0000","last_undegraded":"2024-01-21T19:59:06.403951+0000","last_fullsized":"2024-01-21T19:59:06.403951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418455+0000","last_change":"2024-01-21T19:59:06.412803+0000","last_active":"2024-01-21T19:59:06.418455+0000","last_peered":"2024-01-21T19:59:06.418455+0000","last_clean":"2024-01-21T19:59:06.418455+0000","last_became_active":"2024-01-21T19:59:06.412494+0000","last_became_peered":"2024-01-21T19:59:06.412494+0000","last_unstale":"2024-01-21T19:59:06.418455+0000","last_undegraded":"2024-01-21T19:59:06.418455+0000","last_fullsized":"2024-01-21T19:59:06.418455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392612+0000","last_change":"2024-01-21T19:59:06.036578+0000","last_active":"2024-01-21T19:59:06.392612+0000","last_peered":"2024-01-21T19:59:06.392612+0000","last_clean":"2024-01-21T19:59:06.392612+0000","last_became_active":"2024-01-21T19:59:06.036234+0000","last_became_peered":"2024-01-21T19:59:06.036234+0000","last_unstale":"2024-01-21T19:59:06.392612+0000","last_undegraded":"2024-01-21T19:59:06.392612+0000","last_fullsized":"2024-01-21T19:59:06.392612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417722+0000","last_change":"2024-01-21T19:59:06.417024+0000","last_active":"2024-01-21T19:59:06.417722+0000","last_peered":"2024-01-21T19:59:06.417722+0000","last_clean":"2024-01-21T19:59:06.417722+0000","last_became_active":"2024-01-21T19:59:06.416747+0000","last_became_peered":"2024-01-21T19:59:06.416747+0000","last_unstale":"2024-01-21T19:59:06.417722+0000","last_undegraded":"2024-01-21T19:59:06.417722+0000","last_fullsized":"2024-01-21T19:59:06.417722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.407615+0000","last_change":"2024-01-21T19:59:06.033544+0000","last_active":"2024-01-21T19:59:06.407615+0000","last_peered":"2024-01-21T19:59:06.407615+0000","last_clean":"2024-01-21T19:59:06.407615+0000","last_became_active":"2024-01-21T19:59:06.031765+0000","last_became_peered":"2024-01-21T19:59:06.031765+0000","last_unstale":"2024-01-21T19:59:06.407615+0000","last_undegraded":"2024-01-21T19:59:06.407615+0000","last_fullsized":"2024-01-21T19:59:06.407615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.403490+0000","last_change":"2024-01-21T19:59:06.400361+0000","last_active":"2024-01-21T19:59:06.403490+0000","last_peered":"2024-01-21T19:59:06.403490+0000","last_clean":"2024-01-21T19:59:06.403490+0000","last_became_active":"2024-01-21T19:59:06.400070+0000","last_became_peered":"2024-01-21T19:59:06.400070+0000","last_unstale":"2024-01-21T19:59:06.403490+0000","last_undegraded":"2024-01-21T19:59:06.403490+0000","last_fullsized":"2024-01-21T19:59:06.403490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419401+0000","last_change":"2024-01-21T19:59:06.037315+0000","last_active":"2024-01-21T19:59:06.419401+0000","last_peered":"2024-01-21T19:59:06.419401+0000","last_clean":"2024-01-21T19:59:06.419401+0000","last_became_active":"2024-01-21T19:59:06.036690+0000","last_became_peered":"2024-01-21T19:59:06.036690+0000","last_unstale":"2024-01-21T19:59:06.419401+0000","last_undegraded":"2024-01-21T19:59:06.419401+0000","last_fullsized":"2024-01-21T19:59:06.419401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.404278+0000","last_change":"2024-01-21T19:59:06.399152+0000","last_active":"2024-01-21T19:59:06.404278+0000","last_peered":"2024-01-21T19:59:06.404278+0000","last_clean":"2024-01-21T19:59:06.404278+0000","last_became_active":"2024-01-21T19:59:06.398559+0000","last_became_peered":"2024-01-21T19:59:06.398559+0000","last_unstale":"2024-01-21T19:59:06.404278+0000","last_undegraded":"2024-01-21T19:59:06.404278+0000","last_fullsized":"2024-01-21T19:59:06.404278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.395765+0000","last_change":"2024-01-21T19:59:06.033529+0000","last_active":"2024-01-21T19:59:06.395765+0000","last_peered":"2024-01-21T19:59:06.395765+0000","last_clean":"2024-01-21T19:59:06.395765+0000","last_became_active":"2024-01-21T19:59:06.033242+0000","last_became_peered":"2024-01-21T19:59:06.033242+0000","last_unstale":"2024-01-21T19:59:06.395765+0000","last_undegraded":"2024-01-21T19:59:06.395765+0000","last_fullsized":"2024-01-21T19:59:06.395765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419003+0000","last_change":"2024-01-21T19:59:06.415302+0000","last_active":"2024-01-21T19:59:06.419003+0000","last_peered":"2024-01-21T19:59:06.419003+0000","last_clean":"2024-01-21T19:59:06.419003+0000","last_became_active":"2024-01-21T19:59:06.414840+0000","last_became_peered":"2024-01-21T19:59:06.414840+0000","last_unstale":"2024-01-21T19:59:06.419003+0000","last_undegraded":"2024-01-21T19:59:06.419003+0000","last_fullsized":"2024-01-21T19:59:06.419003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.396109+0000","last_change":"2024-01-21T19:59:06.032758+0000","last_active":"2024-01-21T19:59:06.396109+0000","last_peered":"2024-01-21T19:59:06.396109+0000","last_clean":"2024-01-21T19:59:06.396109+0000","last_became_active":"2024-01-21T19:59:06.032460+0000","last_became_peered":"2024-01-21T19:59:06.032460+0000","last_unstale":"2024-01-21T19:59:06.396109+0000","last_undegraded":"2024-01-21T19:59:06.396109+0000","last_fullsized":"2024-01-21T19:59:06.396109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418725+0000","last_change":"2024-01-21T19:59:06.414719+0000","last_active":"2024-01-21T19:59:06.418725+0000","last_peered":"2024-01-21T19:59:06.418725+0000","last_clean":"2024-01-21T19:59:06.418725+0000","last_became_active":"2024-01-21T19:59:06.414337+0000","last_became_peered":"2024-01-21T19:59:06.414337+0000","last_unstale":"2024-01-21T19:59:06.418725+0000","last_undegraded":"2024-01-21T19:59:06.418725+0000","last_fullsized":"2024-01-21T19:59:06.418725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.399500+0000","last_change":"2024-01-21T19:59:06.035036+0000","last_active":"2024-01-21T19:59:06.399500+0000","last_peered":"2024-01-21T19:59:06.399500+0000","last_clean":"2024-01-21T19:59:06.399500+0000","last_became_active":"2024-01-21T19:59:06.034698+0000","last_became_peered":"2024-01-21T19:59:06.034698+0000","last_unstale":"2024-01-21T19:59:06.399500+0000","last_undegraded":"2024-01-21T19:59:06.399500+0000","last_fullsized":"2024-01-21T19:59:06.399500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.401865+0000","last_change":"2024-01-21T19:59:06.397365+0000","last_active":"2024-01-21T19:59:06.401865+0000","last_peered":"2024-01-21T19:59:06.401865+0000","last_clean":"2024-01-21T19:59:06.401865+0000","last_became_active":"2024-01-21T19:59:06.397044+0000","last_became_peered":"2024-01-21T19:59:06.397044+0000","last_unstale":"2024-01-21T19:59:06.401865+0000","last_undegraded":"2024-01-21T19:59:06.401865+0000","last_fullsized":"2024-01-21T19:59:06.401865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.394352+0000","last_change":"2024-01-21T19:59:06.033282+0000","last_active":"2024-01-21T19:59:06.394352+0000","last_peered":"2024-01-21T19:59:06.394352+0000","last_clean":"2024-01-21T19:59:06.394352+0000","last_became_active":"2024-01-21T19:59:06.033013+0000","last_became_peered":"2024-01-21T19:59:06.033013+0000","last_unstale":"2024-01-21T19:59:06.394352+0000","last_undegraded":"2024-01-21T19:59:06.394352+0000","last_fullsized":"2024-01-21T19:59:06.394352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.413996+0000","last_change":"2024-01-21T19:59:06.412489+0000","last_active":"2024-01-21T19:59:06.413996+0000","last_peered":"2024-01-21T19:59:06.413996+0000","last_clean":"2024-01-21T19:59:06.413996+0000","last_became_active":"2024-01-21T19:59:06.412296+0000","last_became_peered":"2024-01-21T19:59:06.412296+0000","last_unstale":"2024-01-21T19:59:06.413996+0000","last_undegraded":"2024-01-21T19:59:06.413996+0000","last_fullsized":"2024-01-21T19:59:06.413996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405984+0000","last_change":"2024-01-21T19:59:06.040467+0000","last_active":"2024-01-21T19:59:06.405984+0000","last_peered":"2024-01-21T19:59:06.405984+0000","last_clean":"2024-01-21T19:59:06.405984+0000","last_became_active":"2024-01-21T19:59:06.040135+0000","last_became_peered":"2024-01-21T19:59:06.040135+0000","last_unstale":"2024-01-21T19:59:06.405984+0000","last_undegraded":"2024-01-21T19:59:06.405984+0000","last_fullsized":"2024-01-21T19:59:06.405984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.418656+0000","last_change":"2024-01-21T19:59:06.414583+0000","last_active":"2024-01-21T19:59:06.418656+0000","last_peered":"2024-01-21T19:59:06.418656+0000","last_clean":"2024-01-21T19:59:06.418656+0000","last_became_active":"2024-01-21T19:59:06.414307+0000","last_became_peered":"2024-01-21T19:59:06.414307+0000","last_unstale":"2024-01-21T19:59:06.418656+0000","last_undegraded":"2024-01-21T19:59:06.418656+0000","last_fullsized":"2024-01-21T19:59:06.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.400826+0000","last_change":"2024-01-21T19:59:06.037540+0000","last_active":"2024-01-21T19:59:06.400826+0000","last_peered":"2024-01-21T19:59:06.400826+0000","last_clean":"2024-01-21T19:59:06.400826+0000","last_became_active":"2024-01-21T19:59:06.037227+0000","last_became_peered":"2024-01-21T19:59:06.037227+0000","last_unstale":"2024-01-21T19:59:06.400826+0000","last_undegraded":"2024-01-21T19:59:06.400826+0000","last_fullsized":"2024-01-21T19:59:06.400826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.410359+0000","last_change":"2024-01-21T19:59:06.407140+0000","last_active":"2024-01-21T19:59:06.410359+0000","last_peered":"2024-01-21T19:59:06.410359+0000","last_clean":"2024-01-21T19:59:06.410359+0000","last_became_active":"2024-01-21T19:59:06.406818+0000","last_became_peered":"2024-01-21T19:59:06.406818+0000","last_unstale":"2024-01-21T19:59:06.410359+0000","last_undegraded":"2024-01-21T19:59:06.410359+0000","last_fullsized":"2024-01-21T19:59:06.410359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.412154+0000","last_change":"2024-01-21T19:59:06.038267+0000","last_active":"2024-01-21T19:59:06.412154+0000","last_peered":"2024-01-21T19:59:06.412154+0000","last_clean":"2024-01-21T19:59:06.412154+0000","last_became_active":"2024-01-21T19:59:06.037931+0000","last_became_peered":"2024-01-21T19:59:06.037931+0000","last_unstale":"2024-01-21T19:59:06.412154+0000","last_undegraded":"2024-01-21T19:59:06.412154+0000","last_fullsized":"2024-01-21T19:59:06.412154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402031+0000","last_change":"2024-01-21T19:59:06.397703+0000","last_active":"2024-01-21T19:59:06.402031+0000","last_peered":"2024-01-21T19:59:06.402031+0000","last_clean":"2024-01-21T19:59:06.402031+0000","last_became_active":"2024-01-21T19:59:06.397296+0000","last_became_peered":"2024-01-21T19:59:06.397296+0000","last_unstale":"2024-01-21T19:59:06.402031+0000","last_undegraded":"2024-01-21T19:59:06.402031+0000","last_fullsized":"2024-01-21T19:59:06.402031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.402469+0000","last_change":"2024-01-21T19:59:06.036008+0000","last_active":"2024-01-21T19:59:06.402469+0000","last_peered":"2024-01-21T19:59:06.402469+0000","last_clean":"2024-01-21T19:59:06.402469+0000","last_became_active":"2024-01-21T19:59:06.035721+0000","last_became_peered":"2024-01-21T19:59:06.035721+0000","last_unstale":"2024-01-21T19:59:06.402469+0000","last_undegraded":"2024-01-21T19:59:06.402469+0000","last_fullsized":"2024-01-21T19:59:06.402469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.419018+0000","last_change":"2024-01-21T19:59:06.415104+0000","last_active":"2024-01-21T19:59:06.419018+0000","last_peered":"2024-01-21T19:59:06.419018+0000","last_clean":"2024-01-21T19:59:06.419018+0000","last_became_active":"2024-01-21T19:59:06.414325+0000","last_became_peered":"2024-01-21T19:59:06.414325+0000","last_unstale":"2024-01-21T19:59:06.419018+0000","last_undegraded":"2024-01-21T19:59:06.419018+0000","last_fullsized":"2024-01-21T19:59:06.419018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.392399+0000","last_change":"2024-01-21T19:59:06.036961+0000","last_active":"2024-01-21T19:59:06.392399+0000","last_peered":"2024-01-21T19:59:06.392399+0000","last_clean":"2024-01-21T19:59:06.392399+0000","last_became_active":"2024-01-21T19:59:06.036674+0000","last_became_peered":"2024-01-21T19:59:06.036674+0000","last_unstale":"2024-01-21T19:59:06.392399+0000","last_undegraded":"2024-01-21T19:59:06.392399+0000","last_fullsized":"2024-01-21T19:59:06.392399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.416883+0000","last_change":"2024-01-21T19:59:06.415128+0000","last_active":"2024-01-21T19:59:06.416883+0000","last_peered":"2024-01-21T19:59:06.416883+0000","last_clean":"2024-01-21T19:59:06.416883+0000","last_became_active":"2024-01-21T19:59:06.411896+0000","last_became_peered":"2024-01-21T19:59:06.411896+0000","last_unstale":"2024-01-21T19:59:06.416883+0000","last_undegraded":"2024-01-21T19:59:06.416883+0000","last_fullsized":"2024-01-21T19:59:06.416883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.405540+0000","last_change":"2024-01-21T19:59:06.040769+0000","last_active":"2024-01-21T19:59:06.405540+0000","last_peered":"2024-01-21T19:59:06.405540+0000","last_clean":"2024-01-21T19:59:06.405540+0000","last_became_active":"2024-01-21T19:59:06.040493+0000","last_became_peered":"2024-01-21T19:59:06.040493+0000","last_unstale":"2024-01-21T19:59:06.405540+0000","last_undegraded":"2024-01-21T19:59:06.405540+0000","last_fullsized":"2024-01-21T19:59:06.405540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.415838+0000","last_change":"2024-01-21T19:59:06.413738+0000","last_active":"2024-01-21T19:59:06.415838+0000","last_peered":"2024-01-21T19:59:06.415838+0000","last_clean":"2024-01-21T19:59:06.415838+0000","last_became_active":"2024-01-21T19:59:06.413499+0000","last_became_peered":"2024-01-21T19:59:06.413499+0000","last_unstale":"2024-01-21T19:59:06.415838+0000","last_undegraded":"2024-01-21T19:59:06.415838+0000","last_fullsized":"2024-01-21T19:59:06.415838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:06.006845+0000","last_clean_scrub_stamp":"2024-01-21T19:59:06.006845+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-21T19:59:06.417380+0000","last_change":"2024-01-21T19:59:06.039198+0000","last_active":"2024-01-21T19:59:06.417380+0000","last_peered":"2024-01-21T19:59:06.417380+0000","last_clean":"2024-01-21T19:59:06.417380+0000","last_became_active":"2024-01-21T19:59:06.038161+0000","last_became_peered":"2024-01-21T19:59:06.038161+0000","last_unstale":"2024-01-21T19:59:06.417380+0000","last_undegraded":"2024-01-21T19:59:06.417380+0000","last_fullsized":"2024-01-21T19:59:06.417380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:04.998226+0000","last_clean_scrub_stamp":"2024-01-21T19:59:04.998226+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297344,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074496,"statfs":{"total":96636764160,"available":96332283904,"internally_reserved":0,"allocated":253952,"data_stored":85794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297328,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074512,"statfs":{"total":96636764160,"available":96332300288,"internally_reserved":0,"allocated":237568,"data_stored":86787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":84380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":85431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297340,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074500,"statfs":{"total":96636764160,"available":96332288000,"internally_reserved":0,"allocated":249856,"data_stored":86933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":85341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:20.789 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-21T19:59:20.789 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-21T19:59:20.790 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-21T19:59:20.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-21T19:59:20.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.948+0000 7f57bc2ae700 1 Processor -- start 2024-01-21T19:59:20.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.948+0000 7f57bc2ae700 1 -- start start 2024-01-21T19:59:20.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57bc2ae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57b40bcf10 0x7f57b40c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57bc2ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57b40c5ce0 0x7f57b40c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57bc2ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b414ee20 con 0x7f57b414ea40 2024-01-21T19:59:20.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57bc2ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40bed10 con 0x7f57b40c5ce0 2024-01-21T19:59:20.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57bc2ae700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40bea30 con 0x7f57b40bcf10 2024-01-21T19:59:20.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57b40c5ce0 0x7f57b40c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57b40c5ce0 0x7f57b40c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51918/0 (socket says 172.21.15.133:51918) 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 -- 172.21.15.133:0/576443521 learned_addr learned my addr 172.21.15.133:0/576443521 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba04a700 1 --1- 172.21.15.133:0/576443521 >> v1:172.21.15.133:6789/0 conn(0x7f57b414ea40 0x7f57b40630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42544/0 (socket says 172.21.15.133:42544) 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57b9849700 1 --2- 172.21.15.133:0/576443521 >> v2:172.21.15.178:3300/0 conn(0x7f57b40bcf10 0x7f57b40c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 -- 172.21.15.133:0/576443521 >> v2:172.21.15.178:3300/0 conn(0x7f57b40bcf10 msgr2=0x7f57b40c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 --2- 172.21.15.133:0/576443521 >> v2:172.21.15.178:3300/0 conn(0x7f57b40bcf10 0x7f57b40c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 -- 172.21.15.133:0/576443521 >> v1:172.21.15.133:6789/0 conn(0x7f57b414ea40 legacy=0x7f57b40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57ba84b700 1 -- 172.21.15.133:0/576443521 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40a7170 con 0x7f57b40c5ce0 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.949+0000 7f57b9048700 1 -- 172.21.15.133:0/576443521 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803283641 0 0) 0x7f57a4001110 con 0x7f57b414ea40 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57ba84b700 1 --2- 172.21.15.133:0/576443521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40c60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f57b406c390 tx=0x7f57ac009840).ready entity=mon.0 client_cookie=f6497d8e4c820575 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57b9048700 1 -- 172.21.15.133:0/576443521 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e070 con 0x7f57b40c5ce0 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57b9048700 1 -- 172.21.15.133:0/576443521 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00ba50 con 0x7f57b40c5ce0 2024-01-21T19:59:20.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57b9048700 1 -- 172.21.15.133:0/576443521 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bdd0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 -- 172.21.15.133:0/576443521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 msgr2=0x7f57b40c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/576443521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40c60f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f57b406c390 tx=0x7f57ac009840).stop 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 -- 172.21.15.133:0/576443521 shutdown_connections 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/576443521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40c60f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/576443521 >> v2:172.21.15.178:3300/0 conn(0x7f57b40bcf10 0x7f57b40c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 -- 172.21.15.133:0/576443521 >> 172.21.15.133:0/576443521 conn(0x7f57b40c7de0 msgr2=0x7f57b40c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 -- 172.21.15.133:0/576443521 shutdown_connections 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.950+0000 7f57bc2ae700 1 -- 172.21.15.133:0/576443521 wait complete. 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.951+0000 7f57bc2ae700 1 Processor -- start 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.951+0000 7f57bc2ae700 1 -- start start 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 0x7f57b40c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57b414ea40 0x7f57b40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40abb40 con 0x7f57b40c5ce0 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40aaf30 con 0x7f57b40bcf10 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57bc2ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40ab210 con 0x7f57b414ea40 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57b9849700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57b9849700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51930/0 (socket says 172.21.15.133:51930) 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57b9849700 1 -- 172.21.15.133:0/3413586785 learned_addr learned my addr 172.21.15.133:0/3413586785 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57ba04a700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 0x7f57b40c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.952+0000 7f57ba84b700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57b414ea40 0x7f57b40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 -- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57b414ea40 msgr2=0x7f57b40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57b414ea40 0x7f57b40abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 -- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 msgr2=0x7f57b40c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 0x7f57b40c4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 -- 172.21.15.133:0/3413586785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009ae0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57ba04a700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 0x7f57b40c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57b9849700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f57b000d890 tx=0x7f57b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00125f0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0012750 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40ab4f0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0012ad0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.953+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40c5290 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.954+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40abcf0 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.954+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f57b0013480 con 0x7f57b40c5ce0 2024-01-21T19:59:20.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.954+0000 7f57aaf78700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 0x7f5798061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:20.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.955+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57b007a450 con 0x7f57b40c5ce0 2024-01-21T19:59:20.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.955+0000 7f57ba04a700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 0x7f5798061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:20.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.955+0000 7f57ba04a700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 0x7f5798061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f57a40057e0 tx=0x7f57a4007cb0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:20.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:20.959+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f57b40abcf0 con 0x7f57b40c5ce0 2024-01-21T19:59:21.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.161+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f57b40abcf0 con 0x7f57b40c5ce0 2024-01-21T19:59:21.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.161+0000 7f57aaf78700 1 -- 172.21.15.133:0/3413586785 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f57b40abcf0 con 0x7f57b40c5ce0 2024-01-21T19:59:21.153 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 msgr2=0x7f5798061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 0x7f5798061610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f57a40057e0 tx=0x7f57a4007cb0).stop 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 msgr2=0x7f57b40a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f57b000d890 tx=0x7f57b0008040).stop 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 shutdown_connections 2024-01-21T19:59:21.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f579805f150 0x7f5798061610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57b414ea40 0x7f57b40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57b40bcf10 0x7f57b40c4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 --2- 172.21.15.133:0/3413586785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57b40c5ce0 0x7f57b40a9e00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 >> 172.21.15.133:0/3413586785 conn(0x7f57b40c7de0 msgr2=0x7f57b414c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 shutdown_connections 2024-01-21T19:59:21.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.163+0000 7f57bc2ae700 1 -- 172.21.15.133:0/3413586785 wait complete. 2024-01-21T19:59:21.166 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-21T19:59:21.166 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-21T19:59:21.167 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:21.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.291+0000 7fdcde780700 1 Processor -- start 2024-01-21T19:59:21.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.291+0000 7fdcde780700 1 -- start start 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcde780700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcd80bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcde780700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd80654f0 con 0x7fdcd81546b0 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcde780700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd8063700 con 0x7fdcd8154a90 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcde780700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8063950 con 0x7fdcd80a9e30 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdcd81546b0 0x7fdcd8065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42558/0 (socket says 172.21.15.133:42558) 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd7fff700 1 -- 172.21.15.133:0/2003603269 learned_addr learned my addr 172.21.15.133:0/2003603269 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25275725 0 0) 0x7fdcd80654f0 con 0x7fdcd81546b0 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc00033f0 con 0x7fdcd81546b0 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcdcd1d700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcd80bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466598342 0 0) 0x7fdcc00033f0 con 0x7fdcd81546b0 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 msgr2=0x7fdcd80bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:21.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcd80bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 >> v1:172.21.15.178:6789/0 conn(0x7fdcd8154a90 legacy=0x7fdcd8066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8065180 con 0x7fdcd81546b0 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdcc8001470 con 0x7fdcd81546b0 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 >> v1:172.21.15.133:6789/0 conn(0x7fdcd81546b0 legacy=0x7fdcd8065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc0003910 0x7fdcc0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc0004690 0x7fdcc0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcc00050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8063950 con 0x7fdcc0004690 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc000b9c0 con 0x7fdcc0003910 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc000bb80 con 0x7fdcd80a9e30 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd77fe700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc0004690 0x7fdcc0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcd7fff700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc0003910 0x7fdcc0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.292+0000 7fdcdcd1d700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcc00050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 -- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 msgr2=0x7fdcc00050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcd80a9e30 0x7fdcc00050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 -- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc0003910 msgr2=0x7fdcc0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc0003910 0x7fdcc0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 -- 172.21.15.133:0/2003603269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00033f0 con 0x7fdcc0004690 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd7fff700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc0003910 0x7fdcc0003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:21.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd77fe700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc0004690 0x7fdcc0004b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fdccc001730 tx=0x7fdccc007bb0).ready entity=mon.0 client_cookie=3e0fd5d48b009188 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc007020 con 0x7fdcc0004690 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc007180 con 0x7fdcc0004690 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcd6ffd700 1 -- 172.21.15.133:0/2003603269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc007500 con 0x7fdcc0004690 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 -- 172.21.15.133:0/2003603269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc0004690 msgr2=0x7fdcc0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 --2- 172.21.15.133:0/2003603269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc0004690 0x7fdcc0004b10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fdccc001730 tx=0x7fdccc007bb0).stop 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcdcd1d700 1 -- 172.21.15.133:0/2003603269 reap_dead start 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 -- 172.21.15.133:0/2003603269 shutdown_connections 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 -- 172.21.15.133:0/2003603269 >> 172.21.15.133:0/2003603269 conn(0x7fdcd80c8200 msgr2=0x7fdcd80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 -- 172.21.15.133:0/2003603269 shutdown_connections 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.293+0000 7fdcde780700 1 -- 172.21.15.133:0/2003603269 wait complete. 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.295+0000 7fdcde780700 1 Processor -- start 2024-01-21T19:59:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.295+0000 7fdcde780700 1 -- start start 2024-01-21T19:59:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.295+0000 7fdcde780700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc0004690 0x7fdcd8167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.295+0000 7fdcde780700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcd8167fd0 0x7fdcd8157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.295+0000 7fdcde780700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcde780700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd80bf7e0 con 0x7fdcd8157840 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcde780700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd8157ca0 con 0x7fdcd8167fd0 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcde780700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd815a0f0 con 0x7fdcc0004690 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51944/0 (socket says 172.21.15.133:51944) 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 -- 172.21.15.133:0/145413874 learned_addr learned my addr 172.21.15.133:0/145413874 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcd7fff700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc0004690 0x7fdcd8167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcd77fe700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcd8167fd0 0x7fdcd8157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 -- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc0004690 msgr2=0x7fdcd8167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc0004690 0x7fdcd8167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 -- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcd8167fd0 msgr2=0x7fdcd8157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcd8167fd0 0x7fdcd8157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 -- 172.21.15.133:0/145413874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd815a3d0 con 0x7fdcd8157840 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcdcd1d700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdcc0004610 tx=0x7fdcd000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000e040 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000fd70 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd80bfa30 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.296+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd8166090 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.297+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd80be350 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.298+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdcd0015660 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.298+0000 7fdcd4ff9700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 0x7fdcc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.298+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdcd007aca0 con 0x7fdcd8157840 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.298+0000 7fdcd7fff700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 0x7fdcc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.298+0000 7fdcd7fff700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 0x7fdcc4061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdcc8001ed0 tx=0x7fdcc8007040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.302+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdcd004bf70 con 0x7fdcd8157840 2024-01-21T19:59:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.468+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcd8063cc0 con 0x7fdcd8157840 2024-01-21T19:59:21.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.469+0000 7fdcd4ff9700 1 -- 172.21.15.133:0/145413874 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fdcd004fe60 con 0x7fdcd8157840 2024-01-21T19:59:21.460 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:21.460 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 msgr2=0x7fdcc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 0x7fdcc4061610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fdcc8001ed0 tx=0x7fdcc8007040).stop 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 msgr2=0x7fdcd8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fdcc0004610 tx=0x7fdcd000b040).stop 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 shutdown_connections 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcc405f150 0x7fdcc4061610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcd8157840 0x7fdcd8159300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc0004690 0x7fdcd8167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 --2- 172.21.15.133:0/145413874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcd8167fd0 0x7fdcd8157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.470+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 >> 172.21.15.133:0/145413874 conn(0x7fdcd80c8200 msgr2=0x7fdcd8153950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.471+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 shutdown_connections 2024-01-21T19:59:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.471+0000 7fdcde780700 1 -- 172.21.15.133:0/145413874 wait complete. 2024-01-21T19:59:21.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:21.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 Processor -- start 2024-01-21T19:59:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 -- start start 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576814ee20 con 0x7f57680c5ce0 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680bed10 con 0x7f57680bcf10 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.601+0000 7f576df74700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680bea30 con 0x7f576814ea40 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f5766ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f5766ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40918/0 (socket says 172.21.15.133:40918) 2024-01-21T19:59:21.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:35120/0 (socket says 172.21.15.133:35120) 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f5766ffd700 1 -- 172.21.15.133:0/2149741628 learned_addr learned my addr 172.21.15.133:0/2149741628 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f5767fff700 1 --1- 172.21.15.133:0/2149741628 >> v1:172.21.15.178:6789/0 conn(0x7f57680c5ce0 0x7f5768154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:33306/0 (socket says 172.21.15.133:33306) 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 -- 172.21.15.133:0/2149741628 >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 msgr2=0x7f57680630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 --2- 172.21.15.133:0/2149741628 >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 -- 172.21.15.133:0/2149741628 >> v1:172.21.15.178:6789/0 conn(0x7f57680c5ce0 legacy=0x7f5768154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 -- 172.21.15.133:0/2149741628 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680a7170 con 0x7f576814ea40 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57667fc700 1 -- 172.21.15.133:0/2149741628 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352537071 0 0) 0x7f5760001490 con 0x7f57680c5ce0 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f5766ffd700 1 --2- 172.21.15.133:0/2149741628 >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.602+0000 7f57677fe700 1 --2- 172.21.15.133:0/2149741628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f575c009760 tx=0x7f575c009060).ready entity=mon.2 client_cookie=376ea1c422c30c76 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f57667fc700 1 -- 172.21.15.133:0/2149741628 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0090d0 con 0x7f576814ea40 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f57667fc700 1 -- 172.21.15.133:0/2149741628 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c00f510 con 0x7f576814ea40 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f57667fc700 1 -- 172.21.15.133:0/2149741628 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00f890 con 0x7f576814ea40 2024-01-21T19:59:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 -- 172.21.15.133:0/2149741628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 msgr2=0x7f57680c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 --2- 172.21.15.133:0/2149741628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f575c009760 tx=0x7f575c009060).stop 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 -- 172.21.15.133:0/2149741628 shutdown_connections 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 --2- 172.21.15.133:0/2149741628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576814ea40 0x7f57680c77e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 --2- 172.21.15.133:0/2149741628 >> v2:172.21.15.178:3300/0 conn(0x7f57680bcf10 0x7f57680630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 -- 172.21.15.133:0/2149741628 >> 172.21.15.133:0/2149741628 conn(0x7f57680c7de0 msgr2=0x7f57680c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 -- 172.21.15.133:0/2149741628 shutdown_connections 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.603+0000 7f576df74700 1 -- 172.21.15.133:0/2149741628 wait complete. 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.604+0000 7f576df74700 1 Processor -- start 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 -- start start 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57680bcf10 0x7f57680ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57680c5ce0 0x7f57680a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680a7db0 con 0x7f576814ea40 2024-01-21T19:59:21.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680a8bd0 con 0x7f57680c5ce0 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f576df74700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576814c390 con 0x7f57680bcf10 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f5767fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f5767fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51948/0 (socket says 172.21.15.133:51948) 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.605+0000 7f5767fff700 1 -- 172.21.15.133:0/2420075414 learned_addr learned my addr 172.21.15.133:0/2420075414 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f57677fe700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57680bcf10 0x7f57680ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5766ffd700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57680c5ce0 0x7f57680a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 -- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57680bcf10 msgr2=0x7f57680ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57680bcf10 0x7f57680ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 -- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57680c5ce0 msgr2=0x7f57680a78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57680c5ce0 0x7f57680a78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 -- 172.21.15.133:0/2420075414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009370 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f5767fff700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f576000c7e0 tx=0x7f5760007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760005c70 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5760005dd0 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c0092a0 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5760007340 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.606+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680a82a0 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.607+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680a8d40 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.607+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f57600076f0 con 0x7f576814ea40 2024-01-21T19:59:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.608+0000 7f574ffff700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 0x7f5754061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.608+0000 7f57677fe700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 0x7f5754061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.608+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5760079f60 con 0x7f576814ea40 2024-01-21T19:59:21.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.608+0000 7f57677fe700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 0x7f5754061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f575c009fd0 tx=0x7f575c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.612+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f576004b1d0 con 0x7f576814ea40 2024-01-21T19:59:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.773+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f576814ee20 con 0x7f576814ea40 2024-01-21T19:59:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.773+0000 7f574ffff700 1 -- 172.21.15.133:0/2420075414 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f576814ee20 con 0x7f576814ea40 2024-01-21T19:59:21.765 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 msgr2=0x7f5754061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 0x7f5754061610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f575c009fd0 tx=0x7f575c017000).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 msgr2=0x7f576814bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f576000c7e0 tx=0x7f5760007dd0).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 shutdown_connections 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f575405f150 0x7f5754061610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f576814ea40 0x7f576814bea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57680bcf10 0x7f57680ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 --2- 172.21.15.133:0/2420075414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57680c5ce0 0x7f57680a78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 >> 172.21.15.133:0/2420075414 conn(0x7f57680c7de0 msgr2=0x7f5768153790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 shutdown_connections 2024-01-21T19:59:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.775+0000 7f576df74700 1 -- 172.21.15.133:0/2420075414 wait complete. 2024-01-21T19:59:21.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.905+0000 7fb693154700 1 Processor -- start 2024-01-21T19:59:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.905+0000 7fb693154700 1 -- start start 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb693154700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb68c0beb30 0x7fb68c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb693154700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb68c0c3fb0 0x7fb68c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb693154700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c065660 con 0x7fb68c069cd0 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb693154700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0bef10 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb693154700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c156070 con 0x7fb68c0beb30 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb68bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb68c0c3fb0 0x7fb68c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb6916f1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb68c069cd0 0x7fb68c151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42568/0 (socket says 172.21.15.133:42568) 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb6916f1700 1 -- 172.21.15.133:0/944387774 learned_addr learned my addr 172.21.15.133:0/944387774 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.906+0000 7fb690ef0700 1 --2- 172.21.15.133:0/944387774 >> v2:172.21.15.178:3300/0 conn(0x7fb68c0beb30 0x7fb68c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68bfff700 1 -- 172.21.15.133:0/944387774 >> v2:172.21.15.178:3300/0 conn(0x7fb68c0beb30 msgr2=0x7fb68c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68bfff700 1 --2- 172.21.15.133:0/944387774 >> v2:172.21.15.178:3300/0 conn(0x7fb68c0beb30 0x7fb68c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68bfff700 1 -- 172.21.15.133:0/944387774 >> v1:172.21.15.133:6789/0 conn(0x7fb68c069cd0 legacy=0x7fb68c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68bfff700 1 -- 172.21.15.133:0/944387774 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c065f00 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68bfff700 1 --2- 172.21.15.133:0/944387774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c0697e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb68c0650a0 tx=0x7fb678009060).ready entity=mon.0 client_cookie=90450b2988add606 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68b7fe700 1 -- 172.21.15.133:0/944387774 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780090d0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68b7fe700 1 -- 172.21.15.133:0/944387774 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67800b520 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb68b7fe700 1 -- 172.21.15.133:0/944387774 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800b8a0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 -- 172.21.15.133:0/944387774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 msgr2=0x7fb68c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 --2- 172.21.15.133:0/944387774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c0697e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb68c0650a0 tx=0x7fb678009060).stop 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 -- 172.21.15.133:0/944387774 shutdown_connections 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 --2- 172.21.15.133:0/944387774 >> v2:172.21.15.178:3300/0 conn(0x7fb68c0beb30 0x7fb68c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 --2- 172.21.15.133:0/944387774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c0697e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 -- 172.21.15.133:0/944387774 >> 172.21.15.133:0/944387774 conn(0x7fb68c0c8010 msgr2=0x7fb68c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:21.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 -- 172.21.15.133:0/944387774 shutdown_connections 2024-01-21T19:59:21.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.907+0000 7fb693154700 1 -- 172.21.15.133:0/944387774 wait complete. 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.909+0000 7fb693154700 1 Processor -- start 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.909+0000 7fb693154700 1 -- start start 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.909+0000 7fb693154700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb68c069cd0 0x7fb68c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb68c0beb30 0x7fb68c150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c1514e0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0c0310 con 0x7fb68c069cd0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c153b30 con 0x7fb68c0beb30 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51964/0 (socket says 172.21.15.133:51964) 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 -- 172.21.15.133:0/3113577112 learned_addr learned my addr 172.21.15.133:0/3113577112 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 -- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb68c0beb30 msgr2=0x7fb68c150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb68c0beb30 0x7fb68c150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb690ef0700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb68c069cd0 0x7fb68c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 -- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb68c069cd0 msgr2=0x7fb68c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb68c069cd0 0x7fb68c0bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 -- 172.21.15.133:0/3113577112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780092a0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6916f1700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb68400c7c0 tx=0x7fb684001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684005d30 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb684005e90 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c0bf700 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684007320 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.910+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c0bfcc0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.911+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c05fdf0 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.911+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb684007710 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.912+0000 7fb6897fa700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 0x7fb6700615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.912+0000 7fb690ef0700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 0x7fb6700615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.912+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb68407a340 con 0x7fb68c0c3fb0 2024-01-21T19:59:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.912+0000 7fb690ef0700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 0x7fb6700615e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb680006fd0 tx=0x7fb680008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:21.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:21.916+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb68404b550 con 0x7fb68c0c3fb0 2024-01-21T19:59:22.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.084+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb68c06ac20 con 0x7fb68c0c3fb0 2024-01-21T19:59:22.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.084+0000 7fb6897fa700 1 -- 172.21.15.133:0/3113577112 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb68404eb70 con 0x7fb68c0c3fb0 2024-01-21T19:59:22.076 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.086+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 msgr2=0x7fb6700615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.086+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 0x7fb6700615e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb680006fd0 tx=0x7fb680008040).stop 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.086+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 msgr2=0x7fb68c153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.086+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb68400c7c0 tx=0x7fb684001510).stop 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.086+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 shutdown_connections 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb67005f120 0x7fb6700615e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb68c0c3fb0 0x7fb68c153640 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb68c069cd0 0x7fb68c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 --2- 172.21.15.133:0/3113577112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb68c0beb30 0x7fb68c150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 >> 172.21.15.133:0/3113577112 conn(0x7fb68c0c8010 msgr2=0x7fb68c155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 shutdown_connections 2024-01-21T19:59:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.087+0000 7fb693154700 1 -- 172.21.15.133:0/3113577112 wait complete. 2024-01-21T19:59:22.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:22.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.219+0000 7f2de9876700 1 Processor -- start 2024-01-21T19:59:22.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.219+0000 7f2de9876700 1 -- start start 2024-01-21T19:59:22.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de9876700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2de40beb30 0x7f2de4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de9876700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 0x7f2de40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de9876700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de4065660 con 0x7f2de4069cd0 2024-01-21T19:59:22.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de9876700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40bef10 con 0x7f2de40beb30 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de9876700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de4156070 con 0x7f2de40c3fb0 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2de40beb30 0x7f2de4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2de4069cd0 0x7f2de4151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42580/0 (socket says 172.21.15.133:42580) 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de37fe700 1 -- 172.21.15.133:0/1980934842 learned_addr learned my addr 172.21.15.133:0/1980934842 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.220+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/1980934842 >> v2:172.21.15.133:3300/0 conn(0x7f2de40beb30 0x7f2de4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51968/0 (socket says 172.21.15.133:51968) 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de27fc700 1 --2- 172.21.15.133:0/1980934842 >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 0x7f2de40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de2ffd700 1 -- 172.21.15.133:0/1980934842 >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 msgr2=0x7f2de40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/1980934842 >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 0x7f2de40697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de2ffd700 1 -- 172.21.15.133:0/1980934842 >> v1:172.21.15.133:6789/0 conn(0x7f2de4069cd0 legacy=0x7f2de4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de1ffb700 1 -- 172.21.15.133:0/1980934842 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377989357 0 0) 0x7f2de4065660 con 0x7f2de4069cd0 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de2ffd700 1 -- 172.21.15.133:0/1980934842 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4065f00 con 0x7f2de40beb30 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de27fc700 1 --2- 172.21.15.133:0/1980934842 >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 0x7f2de40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/1980934842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40beb30 0x7f2de4155b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2de405ecd0 tx=0x7f2dd8009060).ready entity=mon.0 client_cookie=9b3e00e49a63dbfb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de1ffb700 1 -- 172.21.15.133:0/1980934842 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80090d0 con 0x7f2de40beb30 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de1ffb700 1 -- 172.21.15.133:0/1980934842 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800b520 con 0x7f2de40beb30 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de1ffb700 1 -- 172.21.15.133:0/1980934842 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd800b8a0 con 0x7f2de40beb30 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de9876700 1 -- 172.21.15.133:0/1980934842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40beb30 msgr2=0x7f2de4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.221+0000 7f2de9876700 1 --2- 172.21.15.133:0/1980934842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40beb30 0x7f2de4155b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f2de405ecd0 tx=0x7f2dd8009060).stop 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 -- 172.21.15.133:0/1980934842 shutdown_connections 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 --2- 172.21.15.133:0/1980934842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40beb30 0x7f2de4155b80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 --2- 172.21.15.133:0/1980934842 >> v2:172.21.15.178:3300/0 conn(0x7f2de40c3fb0 0x7f2de40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 -- 172.21.15.133:0/1980934842 >> 172.21.15.133:0/1980934842 conn(0x7f2de40c8010 msgr2=0x7f2de40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 -- 172.21.15.133:0/1980934842 shutdown_connections 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.222+0000 7f2de9876700 1 -- 172.21.15.133:0/1980934842 wait complete. 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.223+0000 7f2de9876700 1 Processor -- start 2024-01-21T19:59:22.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.223+0000 7f2de9876700 1 -- start start 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2de40beb30 0x7f2de40a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de40c3fb0 0x7f2de4062c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40ab330 con 0x7f2de4069cd0 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40c0980 con 0x7f2de40c3fb0 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40c0c60 con 0x7f2de40beb30 2024-01-21T19:59:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51980/0 (socket says 172.21.15.133:51980) 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 -- 172.21.15.133:0/435289367 learned_addr learned my addr 172.21.15.133:0/435289367 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de37fe700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de40c3fb0 0x7f2de4062c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de27fc700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2de40beb30 0x7f2de40a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 -- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2de40beb30 msgr2=0x7f2de40a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2de40beb30 0x7f2de40a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 -- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de40c3fb0 msgr2=0x7f2de4062c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de40c3fb0 0x7f2de4062c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 -- 172.21.15.133:0/435289367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80092a0 con 0x7f2de4069cd0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de2ffd700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2dd8009eb0 tx=0x7f2dd8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8011ac0 con 0x7f2de4069cd0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd8011c20 con 0x7f2de4069cd0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de40c0f40 con 0x7f2de4069cd0 2024-01-21T19:59:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801b410 con 0x7f2de4069cd0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.224+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de40c0570 con 0x7f2de4069cd0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.225+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4069390 con 0x7f2de4069cd0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.226+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2dd801b840 con 0x7f2de4069cd0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.226+0000 7f2dcb7fe700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 0x7f2dd0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.226+0000 7f2de27fc700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 0x7f2dd0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.226+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2dd807bb80 con 0x7f2de4069cd0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.227+0000 7f2de27fc700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 0x7f2dd0061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2de40c1fd0 tx=0x7f2dd4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.230+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2dd804ce50 con 0x7f2de4069cd0 2024-01-21T19:59:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.392+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2de405fdf0 con 0x7f2de4069cd0 2024-01-21T19:59:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.392+0000 7f2dcb7fe700 1 -- 172.21.15.133:0/435289367 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2dd801f0a0 con 0x7f2de4069cd0 2024-01-21T19:59:22.384 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 msgr2=0x7f2dd0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 0x7f2dd0061610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2de40c1fd0 tx=0x7f2dd4008040).stop 2024-01-21T19:59:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 msgr2=0x7f2de40c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f2dd8009eb0 tx=0x7f2dd8017000).stop 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 shutdown_connections 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2dd005f150 0x7f2dd0061610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2de40c3fb0 0x7f2de4062c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de4069cd0 0x7f2de40c0080 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 --2- 172.21.15.133:0/435289367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2de40beb30 0x7f2de40a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 >> 172.21.15.133:0/435289367 conn(0x7f2de40c8010 msgr2=0x7f2de413aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 shutdown_connections 2024-01-21T19:59:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.394+0000 7f2de9876700 1 -- 172.21.15.133:0/435289367 wait complete. 2024-01-21T19:59:22.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:22.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.525+0000 7fbc7b2ab700 1 Processor -- start 2024-01-21T19:59:22.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.525+0000 7fbc7b2ab700 1 -- start start 2024-01-21T19:59:22.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc7b2ab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc7413a620 0x7fbc740a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc7b2ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc740654e0 con 0x7fbc74062e00 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc7b2ab700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc74158730 con 0x7fbc7413aa00 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc7b2ab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc740bd6f0 con 0x7fbc7413a620 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc79848700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc74062e00 0x7fbc74065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42592/0 (socket says 172.21.15.133:42592) 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc79848700 1 -- 172.21.15.133:0/3824755823 learned_addr learned my addr 172.21.15.133:0/3824755823 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.526+0000 7fbc79047700 1 --2- 172.21.15.133:0/3824755823 >> v2:172.21.15.178:3300/0 conn(0x7fbc7413a620 0x7fbc740a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335084438 0 0) 0x7fbc740654e0 con 0x7fbc74062e00 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc600033f0 con 0x7fbc74062e00 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3296066908 0 0) 0x7fbc600033f0 con 0x7fbc74062e00 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 >> v2:172.21.15.178:3300/0 conn(0x7fbc7413a620 msgr2=0x7fbc740a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 --2- 172.21.15.133:0/3824755823 >> v2:172.21.15.178:3300/0 conn(0x7fbc7413a620 0x7fbc740a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 >> v1:172.21.15.178:6789/0 conn(0x7fbc7413aa00 legacy=0x7fbc740626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74158a10 con 0x7fbc74062e00 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fbc6c0017f0 con 0x7fbc74062e00 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 >> v1:172.21.15.133:6789/0 conn(0x7fbc74062e00 legacy=0x7fbc74065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc600038e0 0x7fbc60003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 0x7fbc60004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc60005050 0x7fbc6000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740bd6f0 con 0x7fbc60004690 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6000bfe0 con 0x7fbc600038e0 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6000c1a0 con 0x7fbc60005050 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 0x7fbc60004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc79047700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc600038e0 0x7fbc60003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc79848700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc60005050 0x7fbc6000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 -- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc60005050 msgr2=0x7fbc6000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc60005050 0x7fbc6000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 -- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc600038e0 msgr2=0x7fbc60003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc600038e0 0x7fbc60003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc79848700 1 -- 172.21.15.133:0/3824755823 reap_dead start 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 -- 172.21.15.133:0/3824755823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600033f0 con 0x7fbc60004690 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc78846700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 0x7fbc60004b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fbc70001700 tx=0x7fbc70007bb0).ready entity=mon.0 client_cookie=4a5d11ac9ef3b43d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70007020 con 0x7fbc60004690 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70007180 con 0x7fbc60004690 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.527+0000 7fbc6bfff700 1 -- 172.21.15.133:0/3824755823 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70007520 con 0x7fbc60004690 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 msgr2=0x7fbc60004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 0x7fbc60004b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fbc70001700 tx=0x7fbc70007bb0).stop 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/3824755823 shutdown_connections 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/3824755823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc60004690 0x7fbc60004b10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/3824755823 >> 172.21.15.133:0/3824755823 conn(0x7fbc740c7dc0 msgr2=0x7fbc740c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/3824755823 shutdown_connections 2024-01-21T19:59:22.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.528+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/3824755823 wait complete. 2024-01-21T19:59:22.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.529+0000 7fbc7b2ab700 1 Processor -- start 2024-01-21T19:59:22.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.529+0000 7fbc7b2ab700 1 -- start start 2024-01-21T19:59:22.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc60004690 0x7fbc74155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc740abc70 0x7fbc740c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740ac720 con 0x7fbc74155f00 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74164330 con 0x7fbc60004690 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc7b2ab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc741648b0 con 0x7fbc740abc70 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52008/0 (socket says 172.21.15.133:52008) 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 -- 172.21.15.133:0/2003222549 learned_addr learned my addr 172.21.15.133:0/2003222549 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc79047700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc60004690 0x7fbc74155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc79848700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc740abc70 0x7fbc740c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 -- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc740abc70 msgr2=0x7fbc740c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc740abc70 0x7fbc740c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 -- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc60004690 msgr2=0x7fbc74155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc60004690 0x7fbc74155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 -- 172.21.15.133:0/2003222549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740ac160 con 0x7fbc74155f00 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.530+0000 7fbc78846700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fbc70001cf0 tx=0x7fbc70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.531+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70006fe0 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.531+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc70000c60 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.531+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7001e690 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.531+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc740ac440 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.531+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc740c1b10 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.532+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc740c1d00 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.532+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbc70012400 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.532+0000 7fbc69f76700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 0x7fbc58061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.533+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbc7007ade0 con 0x7fbc74155f00 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.533+0000 7fbc79047700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 0x7fbc58061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.533+0000 7fbc79047700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 0x7fbc58061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbc74060fa0 tx=0x7fbc64009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.537+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbc740c1d00 con 0x7fbc74155f00 2024-01-21T19:59:22.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.701+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc740c1d00 con 0x7fbc74155f00 2024-01-21T19:59:22.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.701+0000 7fbc69f76700 1 -- 172.21.15.133:0/2003222549 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc740c1d00 con 0x7fbc74155f00 2024-01-21T19:59:22.693 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 msgr2=0x7fbc58061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 0x7fbc58061610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbc74060fa0 tx=0x7fbc64009060).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 msgr2=0x7fbc740ab780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fbc70001cf0 tx=0x7fbc70016000).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 shutdown_connections 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbc5805f150 0x7fbc58061610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc740abc70 0x7fbc740c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc60004690 0x7fbc74155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 --2- 172.21.15.133:0/2003222549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc74155f00 0x7fbc740ab780 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.703+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 >> 172.21.15.133:0/2003222549 conn(0x7fbc740c7dc0 msgr2=0x7fbc740c6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.704+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 shutdown_connections 2024-01-21T19:59:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.704+0000 7fbc7b2ab700 1 -- 172.21.15.133:0/2003222549 wait complete. 2024-01-21T19:59:22.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.832+0000 7fc6055dc700 1 Processor -- start 2024-01-21T19:59:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.832+0000 7fc6055dc700 1 -- start start 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc6055dc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6001542f0 0x7fc6001546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc6055dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc600158c00 con 0x7fc6000aa7a0 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc6055dc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc600159090 con 0x7fc6000c60b0 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc6055dc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6001582d0 con 0x7fc6001542f0 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5ff7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6000aa7a0 0x7fc6000c0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42602/0 (socket says 172.21.15.133:42602) 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/4042541732 learned_addr learned my addr 172.21.15.133:0/4042541732 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5feffd700 1 --2- 172.21.15.133:0/4042541732 >> v2:172.21.15.178:3300/0 conn(0x7fc6001542f0 0x7fc6001546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272843475 0 0) 0x7fc600158c00 con 0x7fc6000aa7a0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e80033f0 con 0x7fc6000aa7a0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915464778 0 0) 0x7fc5e80033f0 con 0x7fc6000aa7a0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 >> v2:172.21.15.178:3300/0 conn(0x7fc6001542f0 msgr2=0x7fc6001546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 --2- 172.21.15.133:0/4042541732 >> v2:172.21.15.178:3300/0 conn(0x7fc6001542f0 0x7fc6001546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 >> v1:172.21.15.178:6789/0 conn(0x7fc6000c60b0 legacy=0x7fc6000aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6001585b0 con 0x7fc6000aa7a0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc5f80017f0 con 0x7fc6000aa7a0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 >> v1:172.21.15.133:6789/0 conn(0x7fc6000aa7a0 legacy=0x7fc6000c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e80038e0 0x7fc5e8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5e8004690 0x7fc5e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 0x7fc5e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001582d0 con 0x7fc5e8005050 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800bfe0 con 0x7fc5e80038e0 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e800c1a0 con 0x7fc5e8004690 2024-01-21T19:59:22.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.833+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 0x7fc5e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5feffd700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e80038e0 0x7fc5e8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5fe7fc700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5e8004690 0x7fc5e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5e8004690 msgr2=0x7fc5e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5e8004690 0x7fc5e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e80038e0 msgr2=0x7fc5e8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e80038e0 0x7fc5e8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/4042541732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e80033f0 con 0x7fc5e8005050 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5fe7fc700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5e8004690 0x7fc5e8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/4042541732 reap_dead start 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 0x7fc5e800b8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc6000aabb0 tx=0x7fc5f800c730).ready entity=mon.0 client_cookie=dee115901b1ca261 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8002030 con 0x7fc5e8005050 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f800cdc0 con 0x7fc5e8005050 2024-01-21T19:59:22.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc5fdffb700 1 -- 172.21.15.133:0/4042541732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8005d30 con 0x7fc5e8005050 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc6055dc700 1 -- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 msgr2=0x7fc5e800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc6055dc700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 0x7fc5e800b8e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc6000aabb0 tx=0x7fc5f800c730).stop 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc6055dc700 1 -- 172.21.15.133:0/4042541732 shutdown_connections 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc6055dc700 1 --2- 172.21.15.133:0/4042541732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5e8005050 0x7fc5e800b8e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.834+0000 7fc6055dc700 1 -- 172.21.15.133:0/4042541732 >> 172.21.15.133:0/4042541732 conn(0x7fc60005e1e0 msgr2=0x7fc60005e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.835+0000 7fc6055dc700 1 -- 172.21.15.133:0/4042541732 shutdown_connections 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.835+0000 7fc6055dc700 1 -- 172.21.15.133:0/4042541732 wait complete. 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.836+0000 7fc6055dc700 1 Processor -- start 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.836+0000 7fc6055dc700 1 -- start start 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e8005050 0x7fc60014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc600151670 0x7fc6000aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c2c50 con 0x7fc600151af0 2024-01-21T19:59:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000b0920 con 0x7fc5e8005050 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000c2320 con 0x7fc600151670 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52020/0 (socket says 172.21.15.133:52020) 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/1116375017 learned_addr learned my addr 172.21.15.133:0/1116375017 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5feffd700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e8005050 0x7fc60014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5fe7fc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc600151670 0x7fc6000aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc600151670 msgr2=0x7fc6000aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc600151670 0x7fc6000aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e8005050 msgr2=0x7fc60014dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e8005050 0x7fc60014dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 -- 172.21.15.133:0/1116375017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000c2600 con 0x7fc600151af0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5ff7fe700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc5f8000f80 tx=0x7fc5f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8002030 con 0x7fc600151af0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f80017f0 con 0x7fc600151af0 2024-01-21T19:59:22.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8013890 con 0x7fc600151af0 2024-01-21T19:59:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6000c28e0 con 0x7fc600151af0 2024-01-21T19:59:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.837+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600164610 con 0x7fc600151af0 2024-01-21T19:59:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.838+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6000c2aa0 con 0x7fc600151af0 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.839+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc5f8013c00 con 0x7fc600151af0 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.839+0000 7fc5e77fe700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 0x7fc5ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.839+0000 7fc5feffd700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 0x7fc5ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.839+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc5f807b480 con 0x7fc600151af0 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.839+0000 7fc5feffd700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 0x7fc5ec061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc5f0006d80 tx=0x7fc5f0009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:22.843+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5f804c750 con 0x7fc600151af0 2024-01-21T19:59:23.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.048+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc60005fdf0 con 0x7fc600151af0 2024-01-21T19:59:23.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.048+0000 7fc5e77fe700 1 -- 172.21.15.133:0/1116375017 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fc5f801a020 con 0x7fc600151af0 2024-01-21T19:59:23.040 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:23.041 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 msgr2=0x7fc5ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 0x7fc5ec061610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc5f0006d80 tx=0x7fc5f0009060).stop 2024-01-21T19:59:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 msgr2=0x7fc6000b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc5f8000f80 tx=0x7fc5f8015000).stop 2024-01-21T19:59:23.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 shutdown_connections 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5ec05f150 0x7fc5ec061610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc600151af0 0x7fc6000b0430 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5e8005050 0x7fc60014dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 --2- 172.21.15.133:0/1116375017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc600151670 0x7fc6000aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 >> 172.21.15.133:0/1116375017 conn(0x7fc60005e1e0 msgr2=0x7fc6000c0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 shutdown_connections 2024-01-21T19:59:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.050+0000 7fc6055dc700 1 -- 172.21.15.133:0/1116375017 wait complete. 2024-01-21T19:59:23.045 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:23.054 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.179+0000 7f8fe9805700 1 Processor -- start 2024-01-21T19:59:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.179+0000 7f8fe9805700 1 -- start start 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe9805700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe40bc8a0 0x7f8fe40bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe9805700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fe40658d0 0x7f8fe406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe9805700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe4065000 con 0x7f8fe4065490 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe9805700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe4065d50 con 0x7f8fe40658d0 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe9805700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe4069540 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fe40658d0 0x7f8fe406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fe40658d0 0x7f8fe406a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52024/0 (socket says 172.21.15.133:52024) 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 -- 172.21.15.133:0/592758331 learned_addr learned my addr 172.21.15.133:0/592758331 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe2ffd700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe40bc8a0 0x7f8fe40bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 -- 172.21.15.133:0/592758331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe40bc8a0 msgr2=0x7f8fe40bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe40bc8a0 0x7f8fe40bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 -- 172.21.15.133:0/592758331 >> v1:172.21.15.178:6789/0 conn(0x7f8fe4065490 legacy=0x7f8fe40a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 -- 172.21.15.133:0/592758331 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4064410 con 0x7f8fe40658d0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe37fe700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40658d0 0x7f8fe406a170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8fdc009f20 tx=0x7f8fdc009840).ready entity=mon.0 client_cookie=da5b071732f483c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe1ffb700 1 -- 172.21.15.133:0/592758331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00e070 con 0x7f8fe40658d0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe1ffb700 1 -- 172.21.15.133:0/592758331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc00b9d0 con 0x7f8fe40658d0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.180+0000 7f8fe1ffb700 1 -- 172.21.15.133:0/592758331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00bd50 con 0x7f8fe40658d0 2024-01-21T19:59:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 -- 172.21.15.133:0/592758331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40658d0 msgr2=0x7f8fe406a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40658d0 0x7f8fe406a170 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8fdc009f20 tx=0x7f8fdc009840).stop 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 -- 172.21.15.133:0/592758331 shutdown_connections 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40658d0 0x7f8fe406a170 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 --2- 172.21.15.133:0/592758331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe40bc8a0 0x7f8fe40bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 -- 172.21.15.133:0/592758331 >> 172.21.15.133:0/592758331 conn(0x7f8fe40c6ef0 msgr2=0x7f8fe40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 -- 172.21.15.133:0/592758331 shutdown_connections 2024-01-21T19:59:23.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.181+0000 7f8fe9805700 1 -- 172.21.15.133:0/592758331 wait complete. 2024-01-21T19:59:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.182+0000 7f8fe9805700 1 Processor -- start 2024-01-21T19:59:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.182+0000 7f8fe9805700 1 -- start start 2024-01-21T19:59:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe4065490 0x7f8fe4152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 0x7f8fe41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a6080 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a6340 con 0x7f8fe40658d0 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe9805700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40a6620 con 0x7f8fe4065490 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52036/0 (socket says 172.21.15.133:52036) 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe37fe700 1 -- 172.21.15.133:0/4130555583 learned_addr learned my addr 172.21.15.133:0/4130555583 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe2ffd700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe4065490 0x7f8fe4152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.183+0000 7f8fe27fc700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 0x7f8fe41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 -- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe4065490 msgr2=0x7f8fe4152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe4065490 0x7f8fe4152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 -- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 msgr2=0x7f8fe41522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 0x7f8fe41522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 -- 172.21.15.133:0/4130555583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc009ae0 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe27fc700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 0x7f8fe41522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe37fe700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f8fe4063ce0 tx=0x7f8fdc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0092e0 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc020070 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe40a6900 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc01c470 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.184+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe41533d0 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.185+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe40a6e20 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.185+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8fdc003040 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.186+0000 7f8fcb7fe700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 0x7f8fd0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.186+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fdc07d350 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.186+0000 7f8fe2ffd700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 0x7f8fd0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.186+0000 7f8fe2ffd700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 0x7f8fd0061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8fd400ac00 tx=0x7f8fd400a200).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.190+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8fe40a6e20 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.354+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fe40a6e20 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.355+0000 7f8fcb7fe700 1 -- 172.21.15.133:0/4130555583 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f8fe40a6e20 con 0x7f8fe40bc8a0 2024-01-21T19:59:23.346 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:23.347 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.356+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 msgr2=0x7f8fd0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.356+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 0x7f8fd0061610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8fd400ac00 tx=0x7f8fd400a200).stop 2024-01-21T19:59:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.356+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 msgr2=0x7f8fe40aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.356+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f8fe4063ce0 tx=0x7f8fdc009840).stop 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 shutdown_connections 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f150 0x7f8fd0061610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fe40bc8a0 0x7f8fe40aae70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fe4065490 0x7f8fe4152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 --2- 172.21.15.133:0/4130555583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fe40658d0 0x7f8fe41522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 >> 172.21.15.133:0/4130555583 conn(0x7f8fe40c6ef0 msgr2=0x7f8fe40a4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 shutdown_connections 2024-01-21T19:59:23.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.357+0000 7f8fe9805700 1 -- 172.21.15.133:0/4130555583 wait complete. 2024-01-21T19:59:23.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:23.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:23.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.487+0000 7f981287b700 1 Processor -- start 2024-01-21T19:59:23.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.487+0000 7f981287b700 1 -- start start 2024-01-21T19:59:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f981287b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f980c0beb30 0x7f980c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f981287b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f980c0c3fb0 0x7f980c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f981287b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c065660 con 0x7f980c069cd0 2024-01-21T19:59:23.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f981287b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0bef10 con 0x7f980c0c3fb0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f981287b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c156070 con 0x7f980c0beb30 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f980b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f980c0c3fb0 0x7f980c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f980b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f980c0c3fb0 0x7f980c0697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52042/0 (socket says 172.21.15.133:52042) 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.488+0000 7f980b7fe700 1 -- 172.21.15.133:0/1256813049 learned_addr learned my addr 172.21.15.133:0/1256813049 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980bfff700 1 --2- 172.21.15.133:0/1256813049 >> v2:172.21.15.178:3300/0 conn(0x7f980c0beb30 0x7f980c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980b7fe700 1 -- 172.21.15.133:0/1256813049 >> v2:172.21.15.178:3300/0 conn(0x7f980c0beb30 msgr2=0x7f980c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980b7fe700 1 --2- 172.21.15.133:0/1256813049 >> v2:172.21.15.178:3300/0 conn(0x7f980c0beb30 0x7f980c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980b7fe700 1 -- 172.21.15.133:0/1256813049 >> v1:172.21.15.178:6789/0 conn(0x7f980c069cd0 legacy=0x7f980c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980b7fe700 1 -- 172.21.15.133:0/1256813049 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c065f00 con 0x7f980c0c3fb0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980b7fe700 1 --2- 172.21.15.133:0/1256813049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c0c3fb0 0x7f980c0697e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f980c0650a0 tx=0x7f97f40090f0).ready entity=mon.0 client_cookie=8ddac4bcf3ebf2af server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980affd700 1 -- 172.21.15.133:0/1256813049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400b580 con 0x7f980c0c3fb0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980affd700 1 -- 172.21.15.133:0/1256813049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f400b6e0 con 0x7f980c0c3fb0 2024-01-21T19:59:23.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f980affd700 1 -- 172.21.15.133:0/1256813049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400ba80 con 0x7f980c0c3fb0 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 -- 172.21.15.133:0/1256813049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c0c3fb0 msgr2=0x7f980c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 --2- 172.21.15.133:0/1256813049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c0c3fb0 0x7f980c0697e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f980c0650a0 tx=0x7f97f40090f0).stop 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 -- 172.21.15.133:0/1256813049 shutdown_connections 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 --2- 172.21.15.133:0/1256813049 >> v2:172.21.15.178:3300/0 conn(0x7f980c0beb30 0x7f980c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 --2- 172.21.15.133:0/1256813049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c0c3fb0 0x7f980c0697e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 -- 172.21.15.133:0/1256813049 >> 172.21.15.133:0/1256813049 conn(0x7f980c0c8010 msgr2=0x7f980c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.489+0000 7f981287b700 1 -- 172.21.15.133:0/1256813049 shutdown_connections 2024-01-21T19:59:23.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.490+0000 7f981287b700 1 -- 172.21.15.133:0/1256813049 wait complete. 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.491+0000 7f981287b700 1 Processor -- start 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.491+0000 7f981287b700 1 -- start start 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980c0beb30 0x7f980c0a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f980c0c3fb0 0x7f980c0a5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0a5780 con 0x7f980c069cd0 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c164a60 con 0x7f980c0beb30 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c164130 con 0x7f980c0c3fb0 2024-01-21T19:59:23.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52052/0 (socket says 172.21.15.133:52052) 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 -- 172.21.15.133:0/156684190 learned_addr learned my addr 172.21.15.133:0/156684190 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 -- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f980c0c3fb0 msgr2=0x7f980c0a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f980c0c3fb0 0x7f980c0a5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 -- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980c0beb30 msgr2=0x7f980c0a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980c0beb30 0x7f980c0a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 -- 172.21.15.133:0/156684190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009370 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f980bfff700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f97fc00c850 tx=0x7f97fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc010580 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc0106e0 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c164410 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc010a60 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.492+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c1513d0 con 0x7f980c069cd0 2024-01-21T19:59:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.493+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c05fdf0 con 0x7f980c069cd0 2024-01-21T19:59:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.493+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f97fc01b460 con 0x7f980c069cd0 2024-01-21T19:59:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.494+0000 7f9808ff9700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 0x7f97ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.494+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f97fc07a220 con 0x7f980c069cd0 2024-01-21T19:59:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.494+0000 7f980b7fe700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 0x7f97ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.494+0000 7f980b7fe700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 0x7f97ec061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f980c13ae10 tx=0x7f97f4017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.498+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f97fc04b4f0 con 0x7f980c069cd0 2024-01-21T19:59:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.661+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f980c06ac20 con 0x7f980c069cd0 2024-01-21T19:59:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.661+0000 7f9808ff9700 1 -- 172.21.15.133:0/156684190 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f97fc04eb10 con 0x7f980c069cd0 2024-01-21T19:59:23.653 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 msgr2=0x7f97ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 0x7f97ec061610 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f980c13ae10 tx=0x7f97f4017000).stop 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 msgr2=0x7f980c150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f97fc00c850 tx=0x7f97fc008040).stop 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 shutdown_connections 2024-01-21T19:59:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97ec05f150 0x7f97ec061610 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f980c0c3fb0 0x7f980c0a5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f980c069cd0 0x7f980c150ee0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 --2- 172.21.15.133:0/156684190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f980c0beb30 0x7f980c0a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 >> 172.21.15.133:0/156684190 conn(0x7f980c0c8010 msgr2=0x7f980c139e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 shutdown_connections 2024-01-21T19:59:23.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.663+0000 7f981287b700 1 -- 172.21.15.133:0/156684190 wait complete. 2024-01-21T19:59:23.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:23.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.794+0000 7fe8659ae700 1 Processor -- start 2024-01-21T19:59:23.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.794+0000 7fe8659ae700 1 -- start start 2024-01-21T19:59:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8601542f0 0x7fe8601546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8600c60b0 0x7fe8600aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 0x7fe8600aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600aaa70 con 0x7fe8600c60b0 2024-01-21T19:59:23.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe860158c00 con 0x7fe8600c6530 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe8659ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe860159090 con 0x7fe8601542f0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8600c60b0 0x7fe8600aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8600c60b0 0x7fe8600aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52054/0 (socket says 172.21.15.133:52054) 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 -- 172.21.15.133:0/4089799175 learned_addr learned my addr 172.21.15.133:0/4089799175 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85effd700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8601542f0 0x7fe8601546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85f7fe700 1 --2- 172.21.15.133:0/4089799175 >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 0x7fe8600aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 -- 172.21.15.133:0/4089799175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8601542f0 msgr2=0x7fe8601546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8601542f0 0x7fe8601546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 -- 172.21.15.133:0/4089799175 >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 msgr2=0x7fe8600aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/4089799175 >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 0x7fe8600aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85e7fc700 1 -- 172.21.15.133:0/4089799175 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8601582d0 con 0x7fe8600c60b0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.795+0000 7fe85f7fe700 1 --2- 172.21.15.133:0/4089799175 >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 0x7fe8600aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600aa090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe8600c01c0 tx=0x7fe8500090f0).ready entity=mon.0 client_cookie=389a5cad5a0c5003 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe85dffb700 1 -- 172.21.15.133:0/4089799175 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000b520 con 0x7fe8600c60b0 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe85dffb700 1 -- 172.21.15.133:0/4089799175 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85000b680 con 0x7fe8600c60b0 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe85dffb700 1 -- 172.21.15.133:0/4089799175 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000ba20 con 0x7fe8600c60b0 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 -- 172.21.15.133:0/4089799175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 msgr2=0x7fe8600aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600aa090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fe8600c01c0 tx=0x7fe8500090f0).stop 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 -- 172.21.15.133:0/4089799175 shutdown_connections 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 --2- 172.21.15.133:0/4089799175 >> v2:172.21.15.178:3300/0 conn(0x7fe8600c6530 0x7fe8600aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8601542f0 0x7fe8601546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 --2- 172.21.15.133:0/4089799175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600aa090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 -- 172.21.15.133:0/4089799175 >> 172.21.15.133:0/4089799175 conn(0x7fe86005e1e0 msgr2=0x7fe86005e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 -- 172.21.15.133:0/4089799175 shutdown_connections 2024-01-21T19:59:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.796+0000 7fe8659ae700 1 -- 172.21.15.133:0/4089799175 wait complete. 2024-01-21T19:59:23.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 Processor -- start 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 -- start start 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8600c6530 0x7fe8601409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8601542f0 0x7fe860140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600b0e60 con 0x7fe8600c60b0 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c96b0 con 0x7fe8601542f0 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.798+0000 7fe8659ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe860169010 con 0x7fe8600c6530 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52062/0 (socket says 172.21.15.133:52062) 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 -- 172.21.15.133:0/10256926 learned_addr learned my addr 172.21.15.133:0/10256926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85f7fe700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8601542f0 0x7fe860140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8600c6530 0x7fe8601409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 -- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8600c6530 msgr2=0x7fe8601409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8600c6530 0x7fe8601409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 -- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8601542f0 msgr2=0x7fe860140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8601542f0 0x7fe860140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 -- 172.21.15.133:0/10256926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850009370 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe85effd700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe85400e960 tx=0x7fe854009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400c850 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400c9b0 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8601413c0 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400cd30 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.799+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe860168810 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.800+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860158010 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.800+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe854012600 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.801+0000 7fe8477fe700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 0x7fe84c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.801+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe85407a750 con 0x7fe8600c60b0 2024-01-21T19:59:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.801+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 0x7fe84c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.801+0000 7fe85e7fc700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 0x7fe84c061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe8600c01c0 tx=0x7fe850017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.805+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe85404ba20 con 0x7fe8600c60b0 2024-01-21T19:59:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.969+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe86005fdf0 con 0x7fe8600c60b0 2024-01-21T19:59:23.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.969+0000 7fe8477fe700 1 -- 172.21.15.133:0/10256926 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe85404f040 con 0x7fe8600c60b0 2024-01-21T19:59:23.961 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 msgr2=0x7fe84c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 0x7fe84c061610 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe8600c01c0 tx=0x7fe850017000).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 msgr2=0x7fe8600c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fe85400e960 tx=0x7fe854009060).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 shutdown_connections 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe84c05f150 0x7fe84c061610 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8601542f0 0x7fe860140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8600c60b0 0x7fe8600c4740 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 --2- 172.21.15.133:0/10256926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8600c6530 0x7fe8601409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 >> 172.21.15.133:0/10256926 conn(0x7fe86005e1e0 msgr2=0x7fe8600c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 shutdown_connections 2024-01-21T19:59:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:23.971+0000 7fe8659ae700 1 -- 172.21.15.133:0/10256926 wait complete. 2024-01-21T19:59:23.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:24.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.103+0000 7fccebbfd700 1 Processor -- start 2024-01-21T19:59:24.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.103+0000 7fccebbfd700 1 -- start start 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 0x7fcce4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce40c3fb0 0x7fcce40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4069cd0 0x7fcce4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40bef10 con 0x7fcce4069cd0 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4156070 con 0x7fcce40beb30 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccebbfd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4065660 con 0x7fcce40c3fb0 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4069cd0 0x7fcce4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4069cd0 0x7fcce4151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52064/0 (socket says 172.21.15.133:52064) 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 -- 172.21.15.133:0/1919844419 learned_addr learned my addr 172.21.15.133:0/1919844419 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fcce9999700 1 --2- 172.21.15.133:0/1919844419 >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 0x7fcce4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fcce9198700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce40c3fb0 0x7fcce40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 -- 172.21.15.133:0/1919844419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce40c3fb0 msgr2=0x7fcce40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce40c3fb0 0x7fcce40697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 -- 172.21.15.133:0/1919844419 >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 msgr2=0x7fcce4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 --2- 172.21.15.133:0/1919844419 >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 0x7fcce4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 -- 172.21.15.133:0/1919844419 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4065f00 con 0x7fcce4069cd0 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fcce9999700 1 --2- 172.21.15.133:0/1919844419 >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 0x7fcce4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fccea19a700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4069cd0 0x7fcce4151b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fcce40650a0 tx=0x7fccdc009840).ready entity=mon.0 client_cookie=2d7529cd9842efd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.104+0000 7fcce8997700 1 -- 172.21.15.133:0/1919844419 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00e070 con 0x7fcce4069cd0 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fcce8997700 1 -- 172.21.15.133:0/1919844419 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc00ba20 con 0x7fcce4069cd0 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fcce8997700 1 -- 172.21.15.133:0/1919844419 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc00bda0 con 0x7fcce4069cd0 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 -- 172.21.15.133:0/1919844419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4069cd0 msgr2=0x7fcce4151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4069cd0 0x7fcce4151b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fcce40650a0 tx=0x7fccdc009840).stop 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 -- 172.21.15.133:0/1919844419 shutdown_connections 2024-01-21T19:59:24.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4069cd0 0x7fcce4151b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 --2- 172.21.15.133:0/1919844419 >> v2:172.21.15.178:3300/0 conn(0x7fcce40beb30 0x7fcce4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 --2- 172.21.15.133:0/1919844419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce40c3fb0 0x7fcce40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 -- 172.21.15.133:0/1919844419 >> 172.21.15.133:0/1919844419 conn(0x7fcce40c8010 msgr2=0x7fcce40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 -- 172.21.15.133:0/1919844419 shutdown_connections 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.105+0000 7fccebbfd700 1 -- 172.21.15.133:0/1919844419 wait complete. 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.106+0000 7fccebbfd700 1 Processor -- start 2024-01-21T19:59:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.106+0000 7fccebbfd700 1 -- start start 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce4069cd0 0x7fcce4135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcce40c3fb0 0x7fcce4150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4150630 con 0x7fcce40beb30 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40ace20 con 0x7fcce40c3fb0 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccebbfd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40ab2e0 con 0x7fcce4069cd0 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52078/0 (socket says 172.21.15.133:52078) 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 -- 172.21.15.133:0/2586336668 learned_addr learned my addr 172.21.15.133:0/2586336668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9999700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce4069cd0 0x7fcce4135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 -- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce4069cd0 msgr2=0x7fcce4135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fccea19a700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcce40c3fb0 0x7fcce4150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce4069cd0 0x7fcce4135af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 -- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcce40c3fb0 msgr2=0x7fcce4150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcce40c3fb0 0x7fcce4150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.107+0000 7fcce9198700 1 -- 172.21.15.133:0/2586336668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009ae0 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fcce9198700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fccd400e930 tx=0x7fccd4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400eed0 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd400c850 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4150830 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400cbd0 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.108+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce4150e70 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.109+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce405fdf0 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.109+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fccd4025480 con 0x7fcce40beb30 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.110+0000 7fccda7fc700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 0x7fccc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.110+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fccd407ac00 con 0x7fcce40beb30 2024-01-21T19:59:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.110+0000 7fcce9999700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 0x7fccc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.110+0000 7fcce9999700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 0x7fccc8061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcce0006d80 tx=0x7fcce0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.114+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fccd404bf10 con 0x7fcce40beb30 2024-01-21T19:59:24.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.277+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcce406ac20 con 0x7fcce40beb30 2024-01-21T19:59:24.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.277+0000 7fccda7fc700 1 -- 172.21.15.133:0/2586336668 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccd404f530 con 0x7fcce40beb30 2024-01-21T19:59:24.269 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 msgr2=0x7fccc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 0x7fccc8061610 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcce0006d80 tx=0x7fcce0008040).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 msgr2=0x7fcce414fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fccd400e930 tx=0x7fccd4009060).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 shutdown_connections 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fccc805f150 0x7fccc8061610 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcce40c3fb0 0x7fcce4150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcce4069cd0 0x7fcce4135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 --2- 172.21.15.133:0/2586336668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40beb30 0x7fcce414fc50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 >> 172.21.15.133:0/2586336668 conn(0x7fcce40c8010 msgr2=0x7fcce4067070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 shutdown_connections 2024-01-21T19:59:24.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.279+0000 7fccebbfd700 1 -- 172.21.15.133:0/2586336668 wait complete. 2024-01-21T19:59:24.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.409+0000 7fc59c7b8700 1 Processor -- start 2024-01-21T19:59:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.409+0000 7fc59c7b8700 1 -- start start 2024-01-21T19:59:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59c7b8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc594154140 0x7fc594158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59c7b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc5940ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59c7b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5940ab620 con 0x7fc5940c6090 2024-01-21T19:59:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59c7b8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5940c6ae0 con 0x7fc594154140 2024-01-21T19:59:24.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59c7b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940c05e0 con 0x7fc594154520 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.410+0000 7fc59ad55700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc5940c6090 0x7fc5940c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42608/0 (socket says 172.21.15.133:42608) 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc59ad55700 1 -- 172.21.15.133:0/439575535 learned_addr learned my addr 172.21.15.133:0/439575535 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc59a554700 1 --2- 172.21.15.133:0/439575535 >> v2:172.21.15.178:3300/0 conn(0x7fc594154140 0x7fc594158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc5940ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359869186 0 0) 0x7fc5940ab620 con 0x7fc5940c6090 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5800033f0 con 0x7fc5940c6090 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952640757 0 0) 0x7fc5800033f0 con 0x7fc5940c6090 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 msgr2=0x7fc5940ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc5940ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 >> v2:172.21.15.178:3300/0 conn(0x7fc594154140 msgr2=0x7fc594158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 --2- 172.21.15.133:0/439575535 >> v2:172.21.15.178:3300/0 conn(0x7fc594154140 0x7fc594158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940c0e40 con 0x7fc5940c6090 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc58c0017f0 con 0x7fc5940c6090 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 >> v1:172.21.15.133:6789/0 conn(0x7fc5940c6090 legacy=0x7fc5940c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5800038e0 0x7fc580003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc580004690 0x7fc580004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc580005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940c6ae0 con 0x7fc580004690 2024-01-21T19:59:24.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940c05e0 con 0x7fc5800038e0 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58000b8e0 con 0x7fc594154520 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc580004690 0x7fc580004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc59a554700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5800038e0 0x7fc580003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc59ad55700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc580005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 -- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 msgr2=0x7fc580005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc594154520 0x7fc580005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 -- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5800038e0 msgr2=0x7fc580003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5800038e0 0x7fc580003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.411+0000 7fc599d53700 1 -- 172.21.15.133:0/439575535 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800033f0 con 0x7fc580004690 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc599d53700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc580004690 0x7fc580004b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc590009a80 tx=0x7fc590009060).ready entity=mon.0 client_cookie=5061ace037b3f1cc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590009430 con 0x7fc580004690 2024-01-21T19:59:24.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000e640 con 0x7fc580004690 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc599552700 1 -- 172.21.15.133:0/439575535 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000e9c0 con 0x7fc580004690 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 -- 172.21.15.133:0/439575535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc580004690 msgr2=0x7fc580004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/439575535 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc580004690 0x7fc580004b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fc590009a80 tx=0x7fc590009060).stop 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59ad55700 1 -- 172.21.15.133:0/439575535 reap_dead start 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 -- 172.21.15.133:0/439575535 shutdown_connections 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 -- 172.21.15.133:0/439575535 >> 172.21.15.133:0/439575535 conn(0x7fc59405e1e0 msgr2=0x7fc59405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 -- 172.21.15.133:0/439575535 shutdown_connections 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.412+0000 7fc59c7b8700 1 -- 172.21.15.133:0/439575535 wait complete. 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.414+0000 7fc59c7b8700 1 Processor -- start 2024-01-21T19:59:24.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.414+0000 7fc59c7b8700 1 -- start start 2024-01-21T19:59:24.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc580004690 0x7fc5940aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc59414fdc0 0x7fc5940ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594150220 con 0x7fc59413abf0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940cb690 con 0x7fc59414fdc0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc594151e80 con 0x7fc580004690 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52102/0 (socket says 172.21.15.133:52102) 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 -- 172.21.15.133:0/2666140607 learned_addr learned my addr 172.21.15.133:0/2666140607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59a554700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc580004690 0x7fc5940aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59ad55700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc59414fdc0 0x7fc5940ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 -- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc580004690 msgr2=0x7fc5940aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc580004690 0x7fc5940aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 -- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc59414fdc0 msgr2=0x7fc5940ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc59414fdc0 0x7fc5940ca920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 -- 172.21.15.133:0/2666140607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594152160 con 0x7fc59413abf0 2024-01-21T19:59:24.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc599d53700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc59000e4b0 tx=0x7fc59001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59000ed30 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59000ee90 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc594152440 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.415+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59001b450 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.416+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59413b070 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.417+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc594151cf0 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.417+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc59001b7c0 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.417+0000 7fc58affd700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 0x7fc578061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.417+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc59007bae0 con 0x7fc59413abf0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.417+0000 7fc59a554700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 0x7fc578061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.418+0000 7fc59a554700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 0x7fc578061610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc584006d80 tx=0x7fc584009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.421+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc59004cdb0 con 0x7fc59413abf0 2024-01-21T19:59:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.584+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc59413b260 con 0x7fc59413abf0 2024-01-21T19:59:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.584+0000 7fc58affd700 1 -- 172.21.15.133:0/2666140607 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc590016030 con 0x7fc59413abf0 2024-01-21T19:59:24.575 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 msgr2=0x7fc578061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 0x7fc578061610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc584006d80 tx=0x7fc584009060).stop 2024-01-21T19:59:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 msgr2=0x7fc59414f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fc59000e4b0 tx=0x7fc59001a000).stop 2024-01-21T19:59:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 shutdown_connections 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc57805f150 0x7fc578061610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc59414fdc0 0x7fc5940ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc580004690 0x7fc5940aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 --2- 172.21.15.133:0/2666140607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc59413abf0 0x7fc59414f8d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 >> 172.21.15.133:0/2666140607 conn(0x7fc59405e1e0 msgr2=0x7fc5940ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 shutdown_connections 2024-01-21T19:59:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.586+0000 7fc59c7b8700 1 -- 172.21.15.133:0/2666140607 wait complete. 2024-01-21T19:59:24.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.714+0000 7f9a3002b700 1 Processor -- start 2024-01-21T19:59:24.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.714+0000 7f9a3002b700 1 -- start start 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a3002b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a280beb30 0x7f9a28155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a3002b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a3002b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a28065660 con 0x7f9a28069cd0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a3002b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280bef10 con 0x7f9a280beb30 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a3002b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28156070 con 0x7f9a280c3fb0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2e5c8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9a28069cd0 0x7f9a28151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42620/0 (socket says 172.21.15.133:42620) 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2e5c8700 1 -- 172.21.15.133:0/1355702832 learned_addr learned my addr 172.21.15.133:0/1355702832 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2d5c6700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1355702832 >> v2:172.21.15.178:3300/0 conn(0x7f9a280beb30 0x7f9a28155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017475780 0 0) 0x7f9a28065660 con 0x7f9a28069cd0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.715+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a140033f0 con 0x7f9a28069cd0 2024-01-21T19:59:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026158526 0 0) 0x7f9a140033f0 con 0x7f9a28069cd0 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 msgr2=0x7f9a280697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a280697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 >> v2:172.21.15.178:3300/0 conn(0x7f9a280beb30 msgr2=0x7f9a28155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 --2- 172.21.15.133:0/1355702832 >> v2:172.21.15.178:3300/0 conn(0x7f9a280beb30 0x7f9a28155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28065f00 con 0x7f9a28069cd0 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f9a200017f0 con 0x7f9a28069cd0 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 >> v1:172.21.15.133:6789/0 conn(0x7f9a28069cd0 legacy=0x7f9a28151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a14003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a14004690 0x7f9a14004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a14005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280bef10 con 0x7f9a140038e0 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28156070 con 0x7f9a14004690 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1400b8e0 con 0x7f9a280c3fb0 2024-01-21T19:59:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a14003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2e5c8700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a14005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2d5c6700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a14004690 0x7f9a14004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 msgr2=0x7f9a14005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280c3fb0 0x7f9a14005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a14004690 msgr2=0x7f9a14004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a14004690 0x7f9a14004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1355702832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140033f0 con 0x7f9a140038e0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a14003d00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f9a18009a80 tx=0x7f9a18009060).ready entity=mon.0 client_cookie=19e245f24533abcd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18009430 con 0x7f9a140038e0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800e640 con 0x7f9a140038e0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.716+0000 7f9a2cdc5700 1 -- 172.21.15.133:0/1355702832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800e9c0 con 0x7f9a140038e0 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 -- 172.21.15.133:0/1355702832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 msgr2=0x7f9a14003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1355702832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a14003d00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f9a18009a80 tx=0x7f9a18009060).stop 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a2e5c8700 1 -- 172.21.15.133:0/1355702832 reap_dead start 2024-01-21T19:59:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 -- 172.21.15.133:0/1355702832 shutdown_connections 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 -- 172.21.15.133:0/1355702832 >> 172.21.15.133:0/1355702832 conn(0x7f9a280c8010 msgr2=0x7f9a280c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 -- 172.21.15.133:0/1355702832 shutdown_connections 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.717+0000 7f9a3002b700 1 -- 172.21.15.133:0/1355702832 wait complete. 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.718+0000 7f9a3002b700 1 Processor -- start 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.718+0000 7f9a3002b700 1 -- start start 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a280ad8c0 0x7f9a280aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280add40 0x7f9a280acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280c0030 con 0x7f9a140038e0 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280bf420 con 0x7f9a280ad8c0 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280bf700 con 0x7f9a280add40 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52116/0 (socket says 172.21.15.133:52116) 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1900183184 learned_addr learned my addr 172.21.15.133:0/1900183184 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2e5c8700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280add40 0x7f9a280acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2d5c6700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a280ad8c0 0x7f9a280aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280add40 msgr2=0x7f9a280acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280add40 0x7f9a280acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a280ad8c0 msgr2=0x7f9a280aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a280ad8c0 0x7f9a280aca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 -- 172.21.15.133:0/1900183184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280bf9e0 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a2ddc7700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9a140055c0 tx=0x7f9a1801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18009ec0 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800ed30 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800eea0 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.719+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a280bfcc0 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.720+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a281350c0 con 0x7f9a140038e0 2024-01-21T19:59:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.720+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2805fdf0 con 0x7f9a140038e0 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.721+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9a1802f440 con 0x7f9a140038e0 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.721+0000 7f9a1e7fc700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 0x7f9a0c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.721+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9a1807bdc0 con 0x7f9a140038e0 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.721+0000 7f9a2d5c6700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 0x7f9a0c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.721+0000 7f9a2d5c6700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 0x7f9a0c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9a28067fb0 tx=0x7f9a24008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.725+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a1804d030 con 0x7f9a140038e0 2024-01-21T19:59:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.929+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a2815d220 con 0x7f9a140038e0 2024-01-21T19:59:24.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.930+0000 7f9a1e7fc700 1 -- 172.21.15.133:0/1900183184 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f9a18016070 con 0x7f9a140038e0 2024-01-21T19:59:24.921 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:24.921 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 msgr2=0x7f9a0c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 0x7f9a0c061610 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f9a28067fb0 tx=0x7f9a24008040).stop 2024-01-21T19:59:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 msgr2=0x7f9a28134bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f9a140055c0 tx=0x7f9a1801a000).stop 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 shutdown_connections 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a0c05f150 0x7f9a0c061610 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a280add40 0x7f9a280acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a140038e0 0x7f9a28134bd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 --2- 172.21.15.133:0/1900183184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a280ad8c0 0x7f9a280aca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 >> 172.21.15.133:0/1900183184 conn(0x7f9a280c8010 msgr2=0x7f9a280bde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 shutdown_connections 2024-01-21T19:59:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:24.932+0000 7f9a3002b700 1 -- 172.21.15.133:0/1900183184 wait complete. 2024-01-21T19:59:24.925 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:24.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.059+0000 7f443f12b700 1 Processor -- start 2024-01-21T19:59:25.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.059+0000 7f443f12b700 1 -- start start 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44380c3840 0x7f44380c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c5dc0 0x7f443813a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 0x7f443813a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443813aed0 con 0x7f44380c3840 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4438067f10 con 0x7f44380c6220 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443f12b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44380681f0 con 0x7f44380c5dc0 2024-01-21T19:59:25.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44380c3840 0x7f44380c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f44380c3840 0x7f44380c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52132/0 (socket says 172.21.15.133:52132) 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 -- 172.21.15.133:0/245299628 learned_addr learned my addr 172.21.15.133:0/245299628 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443d6c8700 1 --2- 172.21.15.133:0/245299628 >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 0x7f443813a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f4437fff700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c5dc0 0x7f443813a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 -- 172.21.15.133:0/245299628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c5dc0 msgr2=0x7f443813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c5dc0 0x7f443813a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 -- 172.21.15.133:0/245299628 >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 msgr2=0x7f443813a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 --2- 172.21.15.133:0/245299628 >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 0x7f443813a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 -- 172.21.15.133:0/245299628 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380684d0 con 0x7f44380c3840 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443d6c8700 1 --2- 172.21.15.133:0/245299628 >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 0x7f443813a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f443cec7700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c3840 0x7f44380c3c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f44380c69f0 tx=0x7f442c0090f0).ready entity=mon.0 client_cookie=568fc7dc98d6faa0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f44377fe700 1 -- 172.21.15.133:0/245299628 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00b600 con 0x7f44380c3840 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f44377fe700 1 -- 172.21.15.133:0/245299628 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c00b760 con 0x7f44380c3840 2024-01-21T19:59:25.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.060+0000 7f44377fe700 1 -- 172.21.15.133:0/245299628 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c00bb00 con 0x7f44380c3840 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 -- 172.21.15.133:0/245299628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c3840 msgr2=0x7f44380c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c3840 0x7f44380c3c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f44380c69f0 tx=0x7f442c0090f0).stop 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 -- 172.21.15.133:0/245299628 shutdown_connections 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 --2- 172.21.15.133:0/245299628 >> v2:172.21.15.178:3300/0 conn(0x7f44380c6220 0x7f443813a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c3840 0x7f44380c3c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 --2- 172.21.15.133:0/245299628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c5dc0 0x7f443813a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 -- 172.21.15.133:0/245299628 >> 172.21.15.133:0/245299628 conn(0x7f4438066a70 msgr2=0x7f4438066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 -- 172.21.15.133:0/245299628 shutdown_connections 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.061+0000 7f443f12b700 1 -- 172.21.15.133:0/245299628 wait complete. 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.062+0000 7f443f12b700 1 Processor -- start 2024-01-21T19:59:25.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.062+0000 7f443f12b700 1 -- start start 2024-01-21T19:59:25.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44380c3840 0x7f443815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c6220 0x7f4438167ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443813d2d0 con 0x7f44380c5dc0 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4438168520 con 0x7f44380c3840 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.063+0000 7f443f12b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4438168800 con 0x7f44380c6220 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f443cec7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44380c3840 0x7f443815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52142/0 (socket says 172.21.15.133:52142) 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 -- 172.21.15.133:0/4113783812 learned_addr learned my addr 172.21.15.133:0/4113783812 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f443d6c8700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c6220 0x7f4438167ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 -- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c6220 msgr2=0x7f4438167ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c6220 0x7f4438167ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 -- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44380c3840 msgr2=0x7f443815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44380c3840 0x7f443815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 -- 172.21.15.133:0/4113783812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c009370 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.064+0000 7f4437fff700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f442400d890 tx=0x7f4424008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.065+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011590 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.065+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44380bffa0 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.065+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44380c0560 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.065+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424011900 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.065+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011a70 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.066+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443805fdf0 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.066+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4424005880 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.067+0000 7f44357fa700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 0x7f441c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.067+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4424079e70 con 0x7f44380c5dc0 2024-01-21T19:59:25.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.067+0000 7f443cec7700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 0x7f441c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.067+0000 7f443cec7700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 0x7f441c061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f442c00b3c0 tx=0x7f442c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.071+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f442404b140 con 0x7f44380c5dc0 2024-01-21T19:59:25.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.234+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4438068ec0 con 0x7f44380c5dc0 2024-01-21T19:59:25.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.235+0000 7f44357fa700 1 -- 172.21.15.133:0/4113783812 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f442404e760 con 0x7f44380c5dc0 2024-01-21T19:59:25.226 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:25.226 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:25.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 msgr2=0x7f441c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 0x7f441c061610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f442c00b3c0 tx=0x7f442c017000).stop 2024-01-21T19:59:25.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 msgr2=0x7f44381679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f442400d890 tx=0x7f4424008040).stop 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 shutdown_connections 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f441c05f150 0x7f441c061610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44380c6220 0x7f4438167ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44380c3840 0x7f443815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 --2- 172.21.15.133:0/4113783812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44380c5dc0 0x7f44381679f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 >> 172.21.15.133:0/4113783812 conn(0x7f4438066a70 msgr2=0x7f44380befa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 shutdown_connections 2024-01-21T19:59:25.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.237+0000 7f443f12b700 1 -- 172.21.15.133:0/4113783812 wait complete. 2024-01-21T19:59:25.240 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:25.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.365+0000 7ffa4013c700 1 Processor -- start 2024-01-21T19:59:25.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.365+0000 7ffa4013c700 1 -- start start 2024-01-21T19:59:25.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa4013c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa38155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa4013c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa380c3fb0 0x7ffa380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa4013c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa38065660 con 0x7ffa38069cd0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa4013c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380bef10 con 0x7ffa380c3fb0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa4013c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38156070 con 0x7ffa380beb30 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3e6d9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa38069cd0 0x7ffa38151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42626/0 (socket says 172.21.15.133:42626) 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3e6d9700 1 -- 172.21.15.133:0/410791977 learned_addr learned my addr 172.21.15.133:0/410791977 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/410791977 >> v2:172.21.15.178:3300/0 conn(0x7ffa380c3fb0 0x7ffa380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3ded8700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa38155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752212651 0 0) 0x7ffa38065660 con 0x7ffa38069cd0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.366+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa240033f0 con 0x7ffa38069cd0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3833265523 0 0) 0x7ffa240033f0 con 0x7ffa38069cd0 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 msgr2=0x7ffa38155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa38155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 >> v2:172.21.15.178:3300/0 conn(0x7ffa380c3fb0 msgr2=0x7ffa380697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 --2- 172.21.15.133:0/410791977 >> v2:172.21.15.178:3300/0 conn(0x7ffa380c3fb0 0x7ffa380697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38065f00 con 0x7ffa38069cd0 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ffa300017f0 con 0x7ffa38069cd0 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 >> v1:172.21.15.133:6789/0 conn(0x7ffa38069cd0 legacy=0x7ffa38151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa240038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa24004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa24004b80 0x7ffa24005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380bef10 con 0x7ffa24003e10 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38156070 con 0x7ffa24004b80 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2400b8e0 con 0x7ffa380beb30 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa24004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3e6d9700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa24004b80 0x7ffa24005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ded8700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa240038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 -- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 msgr2=0x7ffa240038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380beb30 0x7ffa240038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 -- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa24004b80 msgr2=0x7ffa24005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa24004b80 0x7ffa24005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 -- 172.21.15.133:0/410791977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240033f0 con 0x7ffa24003e10 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3e6d9700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa24004b80 0x7ffa24005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa24004690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ffa34009a80 tx=0x7ffa34009060).ready entity=mon.0 client_cookie=f5de2759c05e3c5a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34009430 con 0x7ffa24003e10 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400e640 con 0x7ffa24003e10 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.367+0000 7ffa3ced6700 1 -- 172.21.15.133:0/410791977 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400e9c0 con 0x7ffa24003e10 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 -- 172.21.15.133:0/410791977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 msgr2=0x7ffa24004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 --2- 172.21.15.133:0/410791977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa24004690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7ffa34009a80 tx=0x7ffa34009060).stop 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa3e6d9700 1 -- 172.21.15.133:0/410791977 reap_dead start 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 -- 172.21.15.133:0/410791977 shutdown_connections 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 -- 172.21.15.133:0/410791977 >> 172.21.15.133:0/410791977 conn(0x7ffa380c8010 msgr2=0x7ffa380c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 -- 172.21.15.133:0/410791977 shutdown_connections 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.368+0000 7ffa4013c700 1 -- 172.21.15.133:0/410791977 wait complete. 2024-01-21T19:59:25.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.369+0000 7ffa4013c700 1 Processor -- start 2024-01-21T19:59:25.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.369+0000 7ffa4013c700 1 -- start start 2024-01-21T19:59:25.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380a4da0 0x7ffa380a5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa380a68e0 0x7ffa380a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380a64c0 con 0x7ffa24003e10 2024-01-21T19:59:25.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380a7210 con 0x7ffa380a68e0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa4013c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380a5840 con 0x7ffa380a4da0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52162/0 (socket says 172.21.15.133:52162) 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 -- 172.21.15.133:0/2868548062 learned_addr learned my addr 172.21.15.133:0/2868548062 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380a4da0 0x7ffa380a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3e6d9700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa380a68e0 0x7ffa380a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 -- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380a4da0 msgr2=0x7ffa380a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380a4da0 0x7ffa380a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 -- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa380a68e0 msgr2=0x7ffa380a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa380a68e0 0x7ffa380a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 -- 172.21.15.133:0/2868548062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380a5b20 con 0x7ffa24003e10 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.370+0000 7ffa3ded8700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ffa280116e0 tx=0x7ffa28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28013620 con 0x7ffa24003e10 2024-01-21T19:59:25.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28013780 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380a5e00 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28013b00 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa38164a20 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.371+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa380a6730 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.372+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffa28015480 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.372+0000 7ffa2e7fc700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 0x7ffa1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.372+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 0x7ffa1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.372+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa2807a800 con 0x7ffa24003e10 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.373+0000 7ffa3d6d7700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 0x7ffa1c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ffa380c2000 tx=0x7ffa3401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:25.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.376+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa2804ba70 con 0x7ffa24003e10 2024-01-21T19:59:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.580+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa3805fdf0 con 0x7ffa24003e10 2024-01-21T19:59:25.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.580+0000 7ffa2e7fc700 1 -- 172.21.15.133:0/2868548062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7ffa3805fdf0 con 0x7ffa24003e10 2024-01-21T19:59:25.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:25.573 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 msgr2=0x7ffa1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 0x7ffa1c061610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ffa380c2000 tx=0x7ffa3401a000).stop 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 msgr2=0x7ffa38138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ffa280116e0 tx=0x7ffa28008040).stop 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 shutdown_connections 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa1c05f150 0x7ffa1c061610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa380a68e0 0x7ffa380a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa24003e10 0x7ffa38138b60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 --2- 172.21.15.133:0/2868548062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa380a4da0 0x7ffa380a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 >> 172.21.15.133:0/2868548062 conn(0x7ffa380c8010 msgr2=0x7ffa3813ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 shutdown_connections 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:25.582+0000 7ffa4013c700 1 -- 172.21.15.133:0/2868548062 wait complete. 2024-01-21T19:59:25.576 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:25.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T19:59:06.385325+0000', 'modified': '2024-01-21T19:59:08.391173+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/287382996', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6833', 'nonce': 287382996}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 287382996}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T19:59:25.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T19:59:25.988 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-21T19:59:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.118+0000 7f01a734f700 1 Processor -- start 2024-01-21T19:59:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.118+0000 7f01a734f700 1 -- start start 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a734f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01a0069ef0 0x7f01a0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a734f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f01a0066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a734f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a0065660 con 0x7f01a00beb30 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a734f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a00bef10 con 0x7f01a0069ef0 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a734f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0156070 con 0x7f01a00c3fb0 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a50eb700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01a00beb30 0x7f01a00697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42634/0 (socket says 172.21.15.133:42634) 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a50eb700 1 -- 172.21.15.133:0/2507658596 learned_addr learned my addr 172.21.15.133:0/2507658596 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960188896 0 0) 0x7f01a0065660 con 0x7f01a00beb30 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2507658596 >> v2:172.21.15.178:3300/0 conn(0x7f01a0069ef0 0x7f01a0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f018c0033f0 con 0x7f01a00beb30 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a58ec700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f01a0066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939488354 0 0) 0x7f018c0033f0 con 0x7f01a00beb30 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 msgr2=0x7f01a0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f01a0066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 >> v2:172.21.15.178:3300/0 conn(0x7f01a0069ef0 msgr2=0x7f01a0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 --2- 172.21.15.133:0/2507658596 >> v2:172.21.15.178:3300/0 conn(0x7f01a0069ef0 0x7f01a0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a0065f00 con 0x7f01a00beb30 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0190001470 con 0x7f01a00beb30 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 >> v1:172.21.15.133:6789/0 conn(0x7f01a00beb30 legacy=0x7f01a00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f018c0038e0 0x7f018c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f018c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f018c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00bef10 con 0x7f018c004690 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a0156070 con 0x7f018c0038e0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c00b8e0 con 0x7f01a00c3fb0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f018c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.119+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f018c0038e0 0x7f018c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a58ec700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f018c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 -- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 msgr2=0x7f018c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00c3fb0 0x7f018c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 -- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f018c0038e0 msgr2=0x7f018c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f018c0038e0 0x7f018c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 -- 172.21.15.133:0/2507658596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c0033f0 con 0x7f018c004690 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f018c004b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f019c009a80 tx=0x7f019c009060).ready entity=mon.0 client_cookie=359aacd32526a846 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c009430 con 0x7f018c004690 2024-01-21T19:59:26.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c00e640 con 0x7f018c004690 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f0197fff700 1 -- 172.21.15.133:0/2507658596 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c00e9c0 con 0x7f018c004690 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a734f700 1 -- 172.21.15.133:0/2507658596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 msgr2=0x7f018c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a734f700 1 --2- 172.21.15.133:0/2507658596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f018c004b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f019c009a80 tx=0x7f019c009060).stop 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.120+0000 7f01a58ec700 1 -- 172.21.15.133:0/2507658596 reap_dead start 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.121+0000 7f01a734f700 1 -- 172.21.15.133:0/2507658596 shutdown_connections 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.121+0000 7f01a734f700 1 -- 172.21.15.133:0/2507658596 >> 172.21.15.133:0/2507658596 conn(0x7f01a00c8010 msgr2=0x7f01a00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.121+0000 7f01a734f700 1 -- 172.21.15.133:0/2507658596 shutdown_connections 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.121+0000 7f01a734f700 1 -- 172.21.15.133:0/2507658596 wait complete. 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.122+0000 7f01a734f700 1 Processor -- start 2024-01-21T19:59:26.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.122+0000 7f01a734f700 1 -- start start 2024-01-21T19:59:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00ade20 0x7f01a00acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 0x7f01a00c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c0200 con 0x7f018c004690 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c04e0 con 0x7f01a00ad010 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a00c07c0 con 0x7f01a00ade20 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52178/0 (socket says 172.21.15.133:52178) 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 -- 172.21.15.133:0/159055775 learned_addr learned my addr 172.21.15.133:0/159055775 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a48ea700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00ade20 0x7f01a00acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a58ec700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 0x7f01a00c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 -- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00ade20 msgr2=0x7f01a00acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00ade20 0x7f01a00acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 -- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 msgr2=0x7f01a00c0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 0x7f01a00c0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 -- 172.21.15.133:0/159055775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a00c0aa0 con 0x7f018c004690 2024-01-21T19:59:26.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a58ec700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 0x7f01a00c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a50eb700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0190001120 tx=0x7f0190001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f0195ffb700 1 -- 172.21.15.133:0/159055775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000f630 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f0195ffb700 1 -- 172.21.15.133:0/159055775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000f790 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a01514c0 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f0195ffb700 1 -- 172.21.15.133:0/159055775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000fb10 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.123+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a00c1670 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.125+0000 7f0195ffb700 1 -- 172.21.15.133:0/159055775 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f019001d3b0 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.125+0000 7f0195ffb700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 0x7f0184061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.125+0000 7f0195ffb700 1 -- 172.21.15.133:0/159055775 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0190079b70 con 0x7f018c004690 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.125+0000 7f01a48ea700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 0x7f0184061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.126+0000 7f01a48ea700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 0x7f0184061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f019c006d50 tx=0x7f019c01a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.127+0000 7f01b8cf2b80 1 Processor -- start 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.127+0000 7f01b8cf2b80 1 -- start start 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fcbf2c0 0x56168fc71900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc71df0 0x56168fc72270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fbed3d0 con 0x56168fc76620 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fbb2be0 con 0x56168fc71df0 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168fbc8260 con 0x56168fcbf2c0 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52184/0 (socket says 172.21.15.133:52184) 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 -- 172.21.15.133:0/2795231807 learned_addr learned my addr 172.21.15.133:0/2795231807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fcbf2c0 0x56168fc71900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a58ec700 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc71df0 0x56168fc72270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 -- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fcbf2c0 msgr2=0x56168fc71900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fcbf2c0 0x56168fc71900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 -- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc71df0 msgr2=0x56168fc72270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc71df0 0x56168fc72270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.128+0000 7f01a50eb700 1 -- 172.21.15.133:0/2795231807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56168fbc12f0 con 0x56168fc76620 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f019004e9c0 tx=0x7f0190012000).ready entity=mon.0 client_cookie=1fb259876d5e99d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f018affd700 1 -- 172.21.15.133:0/2795231807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019004e3f0 con 0x56168fc76620 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f018affd700 1 -- 172.21.15.133:0/2795231807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190054120 con 0x56168fc76620 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f018affd700 1 -- 172.21.15.133:0/2795231807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190077c00 con 0x56168fc76620 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2795231807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 msgr2=0x56168fc76a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f019004e9c0 tx=0x7f0190012000).stop 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2795231807 shutdown_connections 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc71df0 0x56168fc72270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fc76a00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2795231807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fcbf2c0 0x56168fc71900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2795231807 >> 172.21.15.133:0/2795231807 conn(0x56168fadf2e0 msgr2=0x56168fcbf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2795231807 shutdown_connections 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.129+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2795231807 wait complete. 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.130+0000 7f01b8cf2b80 1 -- start start 2024-01-21T19:59:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.130+0000 7f01b8cf2b80 1 Processor -- start 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc9e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 0x56168fc9ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fbc83a0 con 0x56168fcbf2c0 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fbc8620 con 0x56168fc76620 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168fb93990 con 0x56168fc71df0 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.131+0000 7f01b8cf2b80 10 client.0 ll_register_callbacks cb 0x56168fc36610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52196/0 (socket says 172.21.15.133:52196) 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 -- 172.21.15.133:0/608327252 learned_addr learned my addr 172.21.15.133:0/608327252 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a50eb700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc9e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a48ea700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 0x56168fc9ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 -- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 msgr2=0x56168fc9e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc9e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 -- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 msgr2=0x56168fc9ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 0x56168fc9ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 -- 172.21.15.133:0/608327252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a00c1670 con 0x56168fcbf2c0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a50eb700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc9e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a48ea700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 0x56168fc9ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01a58ec700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f01980094d0 tx=0x7f019800b040).ready entity=mon.0 client_cookie=81e6e82c358ff182 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019800e040 con 0x56168fcbf2c0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0198014a20 con 0x56168fcbf2c0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56168fc70df0 con 0x56168fcbf2c0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0198014c20 con 0x56168fcbf2c0 2024-01-21T19:59:26.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 10 client.4686 fetch_fsmap learned FSMap version 6 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56168fbbc520 con 0x56168fcbf2c0 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56168fc70df0 con 0x56168fcbf2c0 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0198020420 con 0x56168fcbf2c0 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 10 client.4686 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 20 client.4686 populate_metadata read hostname 'smithi133' 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fca3d20 0x56168fca4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 4 client.4686 mds_command: new command op to 4267 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.132+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 --> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56168fbbdd60 con 0x56168fca3d20 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.133+0000 7f01a50eb700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fca3d20 0x56168fca4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.133+0000 7f017ffff700 10 client.4686 ms_handle_connect on v2:172.21.15.178:6833/287382996 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.133+0000 7f01a50eb700 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fca3d20 0x56168fca4100 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8a8083334c4b5f5a server_cookie=ea3e7a1eae90aaba in_seq=0 out_seq=0 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f017ffff700 1 -- 172.21.15.133:0/608327252 <== mds.0 v2:172.21.15.178:6833/287382996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x56168fbbdd60 con 0x56168fca3d20 2024-01-21T19:59:26.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f017ffff700 10 client.4686 handle_command_reply: tid=0 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 client.4686 shutdown 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 msgr2=0x56168fc72270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f01980094d0 tx=0x7f019800b040).stop 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 shutdown_connections 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fca3d20 0x56168fca4100 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fcbf2c0 0x56168fc72270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc9e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/608327252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fc76620 0x56168fc9ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f017ffff700 0 client.4686 ms_handle_reset on v2:172.21.15.178:6833/287382996 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 >> 172.21.15.133:0/608327252 conn(0x56168fadf2e0 msgr2=0x56168fc74690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 shutdown_connections 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/608327252 wait complete. 2024-01-21T19:59:26.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.134+0000 7f01b8cf2b80 20 client.4686 trim_cache size 0 max 16384 2024-01-21T19:59:26.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 Processor -- start 2024-01-21T19:59:26.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 -- start start 2024-01-21T19:59:26.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc77bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fc6b180 con 0x56168fc76620 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fc74510 con 0x56168fcbf2c0 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168fc9f620 con 0x56168fc71df0 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01a48ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01a48ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52206/0 (socket says 172.21.15.133:52206) 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.151+0000 7f01a48ea700 1 -- 172.21.15.133:0/3728608278 learned_addr learned my addr 172.21.15.133:0/3728608278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a58ec700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a50eb700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc77bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 -- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 msgr2=0x56168fc77bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc77bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 -- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 msgr2=0x56168fca4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 -- 172.21.15.133:0/3728608278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56168fbbc270 con 0x56168fc76620 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a58ec700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a50eb700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01a48ea700 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f019c009f10 tx=0x7f019c023000).ready entity=mon.0 client_cookie=c764da96bf059005 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f018b7fe700 1 -- 172.21.15.133:0/3728608278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c023070 con 0x56168fc76620 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f018b7fe700 1 -- 172.21.15.133:0/3728608278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c030040 con 0x56168fc76620 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f018b7fe700 1 -- 172.21.15.133:0/3728608278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c035650 con 0x56168fc76620 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/3728608278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 msgr2=0x56168fcbb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f019c009f10 tx=0x7f019c023000).stop 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/3728608278 shutdown_connections 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fc77bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/3728608278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fcbb3d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.152+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/3728608278 >> 172.21.15.133:0/3728608278 conn(0x56168fadf2e0 msgr2=0x56168fcbf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.153+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/3728608278 shutdown_connections 2024-01-21T19:59:26.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.153+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/3728608278 wait complete. 2024-01-21T19:59:26.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.153+0000 7f01b8cf2b80 1 -- start start 2024-01-21T19:59:26.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.153+0000 7f01b8cf2b80 1 Processor -- start 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fd20c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fcda000 con 0x56168fc76620 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56168fca2ea0 con 0x56168fcbf2c0 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56168fc9dad0 con 0x56168fc71df0 2024-01-21T19:59:26.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01b8cf2b80 10 client.0 ll_register_callbacks cb 0x56168fc36610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52214/0 (socket says 172.21.15.133:52214) 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 -- 172.21.15.133:0/2865887977 learned_addr learned my addr 172.21.15.133:0/2865887977 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fd20c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a58ec700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 -- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 msgr2=0x56168fd20c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fd20c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 -- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 msgr2=0x56168fca4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.154+0000 7f01a48ea700 1 -- 172.21.15.133:0/2865887977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c0033f0 con 0x56168fc76620 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01a48ea700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f019c006f70 tx=0x7f019c031000).ready entity=mon.0 client_cookie=f640f1d06a876680 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c023040 con 0x56168fc76620 2024-01-21T19:59:26.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0190054120 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f019c035c50 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f019c035e50 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 10 client.4692 fetch_fsmap learned FSMap version 6 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56168fa35f80 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190054120 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 6) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f019c01c990 con 0x56168fc76620 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 10 client.4692 fetch_fsmap finished waiting for FSMap version 6 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 10 client.4692 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 20 client.4692 populate_metadata read hostname 'smithi133' 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fcbc120 0x56168fcbc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 4 client.4692 mds_command: new command op to 4267 tid=0[{"prefix": "status"}] 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 --> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56168fbb47d0 con 0x56168fcbc120 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.155+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fcbc120 0x56168fcbc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f017ffff700 10 client.4692 ms_handle_connect on v2:172.21.15.178:6833/287382996 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01a50eb700 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fcbc120 0x56168fcbc500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4bbd7306d6a12950 server_cookie=89c0b5bf6eb7e0b3 in_seq=0 out_seq=0 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f017ffff700 1 -- 172.21.15.133:0/2865887977 <== mds.0 v2:172.21.15.178:6833/287382996 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56168fbb47d0 con 0x56168fcbc120 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f017ffff700 10 client.4692 handle_command_reply: tid=0 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 client.4692 shutdown 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 msgr2=0x56168fca26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f019c006f70 tx=0x7f019c031000).stop 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 shutdown_connections 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56168fcbf2c0 0x56168fca4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56168fc71df0 0x56168fd20c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.178:6833/287382996,v1:172.21.15.178:6835/287382996] conn(0x56168fcbc120 0x56168fcbc500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 --2- 172.21.15.133:0/2865887977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x56168fc76620 0x56168fca26e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f017ffff700 0 client.4692 ms_handle_reset on v2:172.21.15.178:6833/287382996 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 >> 172.21.15.133:0/2865887977 conn(0x56168fadf2e0 msgr2=0x56168fc77920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 shutdown_connections 2024-01-21T19:59:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 1 -- 172.21.15.133:0/2865887977 wait complete. 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.156+0000 7f01b8cf2b80 20 client.4692 trim_cache size 0 max 16384 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4267, 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 19.769012800999999, 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 6, 2024-01-21T19:59:26.155 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 22, 2024-01-21T19:59:26.156 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 22, 2024-01-21T19:59:26.156 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 24.154656808999999 2024-01-21T19:59:26.156 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 msgr2=0x7f0184061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 0x7f0184061610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f019c006d50 tx=0x7f019c01a000).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 msgr2=0x7f01a0150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0190001120 tx=0x7f0190001e90).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 shutdown_connections 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f018405f150 0x7f0184061610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01a00ad010 0x7f01a00c0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f018c004690 0x7f01a0150fd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 --2- 172.21.15.133:0/159055775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01a00ade20 0x7f01a00acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 >> 172.21.15.133:0/159055775 conn(0x7f01a00c8010 msgr2=0x7f01a00697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 shutdown_connections 2024-01-21T19:59:26.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.157+0000 7f01a734f700 1 -- 172.21.15.133:0/159055775 wait complete. 2024-01-21T19:59:26.160 INFO:teuthology.run_tasks:Running task kclient... 2024-01-21T19:59:26.197 INFO:tasks.kclient:Mounting kernel clients... 2024-01-21T19:59:26.197 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-01-21T19:59:26.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.198 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T19:59:26.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-21T19:59:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-01-21T19:59:26.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:59:26.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.287 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T19:59:26.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-21T19:59:26.412 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-01-21T19:59:26.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:59:26.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.414 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T19:59:26.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.436 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-01-21T19:59:26.512 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-01-21T19:59:26.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:59:26.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.514 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T19:59:26.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.573 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-01-21T19:59:26.645 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-01-21T19:59:26.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T19:59:26.647 INFO:tasks.kclient:client.0 config is {} 2024-01-21T19:59:26.647 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T19:59:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.759+0000 7fd9a4b3d700 1 Processor -- start 2024-01-21T19:59:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.759+0000 7fd9a4b3d700 1 -- start start 2024-01-21T19:59:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd9a4b3d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 0x7fd9a0154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd9a4b3d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a0155530 con 0x7fd9a00bde30 2024-01-21T19:59:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd9a4b3d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a00c5f20 con 0x7fd9a0063430 2024-01-21T19:59:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd9a4b3d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a0154920 con 0x7fd9a0153e90 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd99ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd9a00bde30 0x7fd9a0069590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42650/0 (socket says 172.21.15.133:42650) 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd99ed9d700 1 -- 172.21.15.133:0/2273802630 learned_addr learned my addr 172.21.15.133:0/2273802630 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd99e59c700 1 --2- 172.21.15.133:0/2273802630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 0x7fd9a0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034635947 0 0) 0x7fd9a0155530 con 0x7fd9a00bde30 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.760+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9880033f0 con 0x7fd9a00bde30 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465901272 0 0) 0x7fd9a00c5f20 con 0x7fd9a0063430 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a0155530 con 0x7fd9a0063430 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1886043742 0 0) 0x7fd9880033f0 con 0x7fd9a00bde30 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99e59c700 1 -- 172.21.15.133:0/2273802630 >> v1:172.21.15.178:6789/0 conn(0x7fd9a0063430 legacy=0x7fd9a00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99e59c700 1 -- 172.21.15.133:0/2273802630 >> v1:172.21.15.133:6789/0 conn(0x7fd9a00bde30 legacy=0x7fd9a0069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99e59c700 1 -- 172.21.15.133:0/2273802630 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0154c00 con 0x7fd9a0153e90 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99e59c700 1 --2- 172.21.15.133:0/2273802630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 0x7fd9a0154270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd994009790 tx=0x7fd994009060).ready entity=mon.2 client_cookie=d2897166b0c5a393 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9980017f0 con 0x7fd9a0153e90 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd994011400 con 0x7fd9a0153e90 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd99d59a700 1 -- 172.21.15.133:0/2273802630 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd994011780 con 0x7fd9a0153e90 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/2273802630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 msgr2=0x7fd9a0154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.761+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/2273802630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 0x7fd9a0154270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd994009790 tx=0x7fd994009060).stop 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.762+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/2273802630 shutdown_connections 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.762+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/2273802630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0153e90 0x7fd9a0154270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.762+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/2273802630 >> 172.21.15.133:0/2273802630 conn(0x7fd9a00c7cb0 msgr2=0x7fd9a00c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.762+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/2273802630 shutdown_connections 2024-01-21T19:59:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.762+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/2273802630 wait complete. 2024-01-21T19:59:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.763+0000 7fd9a4b3d700 1 Processor -- start 2024-01-21T19:59:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.763+0000 7fd9a4b3d700 1 -- start start 2024-01-21T19:59:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a00bde30 0x7fd9a0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0156c50 0x7fd9a00c1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00c2260 con 0x7fd9a0153e90 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00c2520 con 0x7fd9a00bde30 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a00c2800 con 0x7fd9a0156c50 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52224/0 (socket says 172.21.15.133:52224) 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 -- 172.21.15.133:0/3301552922 learned_addr learned my addr 172.21.15.133:0/3301552922 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99e59c700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a00bde30 0x7fd9a0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99ed9d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0156c50 0x7fd9a00c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 -- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0156c50 msgr2=0x7fd9a00c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0156c50 0x7fd9a00c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 -- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a00bde30 msgr2=0x7fd9a0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a00bde30 0x7fd9a0156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 -- 172.21.15.133:0/3301552922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9940092a0 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd99dd9b700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd99000c440 tx=0x7fd990007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990012400 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd990012560 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a00c2ae0 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.764+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd990012920 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.765+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a00c1a00 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.765+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a00c3000 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.766+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd99001b3b0 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.766+0000 7fd98effd700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 0x7fd980061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.766+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd990079890 con 0x7fd9a0153e90 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.766+0000 7fd99e59c700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 0x7fd980061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.766+0000 7fd99e59c700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 0x7fd980061640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fd9940096e0 tx=0x7fd994016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:26.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.770+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd9a00c3000 con 0x7fd9a0153e90 2024-01-21T19:59:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.975+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9a00c3000 con 0x7fd9a0153e90 2024-01-21T19:59:26.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.976+0000 7fd98effd700 1 -- 172.21.15.133:0/3301552922 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9a00c3000 con 0x7fd9a0153e90 2024-01-21T19:59:26.967 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T19:59:26.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 msgr2=0x7fd980061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 0x7fd980061640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fd9940096e0 tx=0x7fd994016000).stop 2024-01-21T19:59:26.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 msgr2=0x7fd9a00c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:26.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fd99000c440 tx=0x7fd990007bc0).stop 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 shutdown_connections 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd98005f180 0x7fd980061640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a0156c50 0x7fd9a00c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a00bde30 0x7fd9a0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 --2- 172.21.15.133:0/3301552922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9a0153e90 0x7fd9a00c1020 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.977+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 >> 172.21.15.133:0/3301552922 conn(0x7fd9a00c7cb0 msgr2=0x7fd9a00c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.978+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 shutdown_connections 2024-01-21T19:59:26.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:26.978+0000 7fd9a4b3d700 1 -- 172.21.15.133:0/3301552922 wait complete. 2024-01-21T19:59:26.979 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-21T19:59:26.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T19:59:26.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T19:59:26.980 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T19:59:26.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:26.980 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T19:59:26.998 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42365sec preferred_lft 42365sec 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T19:59:26.999 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:27.000 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-21T19:59:27.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-21T19:59:27.000 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:27.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.155 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T19:59:27.185 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T19:59:27.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.186 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T19:59:27.258 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T19:59:27.258 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T19:59:27.258 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T19:59:27.258 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T19:59:27.258 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T19:59:27.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T19:59:27.259 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:27.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.485 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T19:59:27.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.502 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-01-21T19:59:27.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.559 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:27.559 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:27.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T19:59:27.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-21T19:59:27.560 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:27.655 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-21T19:59:27.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-21T19:59:27.656 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:27.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.861 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:27.861 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:27.861 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T19:59:27.861 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2024-01-21T19:59:27.861 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:27.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:27.959 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T19:59:27.976 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T19:59:27.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:28.057 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:28.057 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:28.150 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:28.150 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:28.153 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T19:59:28.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T19:59:28.221 INFO:tasks.kclient:client.2 config is {} 2024-01-21T19:59:28.221 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T19:59:28.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.373+0000 7f8d55796700 1 Processor -- start 2024-01-21T19:59:28.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.373+0000 7f8d55796700 1 -- start start 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d55796700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d500c0a10 0x7f8d50155310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d55796700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500aa010 0x7f8d5015def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d55796700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500aa980 con 0x7f8d500c8f30 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d55796700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500a88b0 con 0x7f8d500c0a10 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d55796700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500a7f80 con 0x7f8d500aa010 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d500c0a10 0x7f8d50155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8d500c8f30 0x7f8d500c0df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42662/0 (socket says 172.21.15.133:42662) 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d500c0a10 0x7f8d50155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52228/0 (socket says 172.21.15.133:52228) 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4e7fc700 1 -- 172.21.15.133:0/320226925 learned_addr learned my addr 172.21.15.133:0/320226925 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4f7fe700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500aa010 0x7f8d5015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 -- 172.21.15.133:0/320226925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500aa010 msgr2=0x7f8d5015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500aa010 0x7f8d5015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 -- 172.21.15.133:0/320226925 >> v1:172.21.15.133:6789/0 conn(0x7f8d500c8f30 legacy=0x7f8d500c0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4dffb700 1 -- 172.21.15.133:0/320226925 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062696849 0 0) 0x7f8d500aa980 con 0x7f8d500c8f30 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 -- 172.21.15.133:0/320226925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500a8260 con 0x7f8d500c0a10 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4effd700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c0a10 0x7f8d50155310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f8d40009760 tx=0x7f8d40009060).ready entity=mon.0 client_cookie=505e242767b802f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4dffb700 1 -- 172.21.15.133:0/320226925 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000b580 con 0x7f8d500c0a10 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.374+0000 7f8d4dffb700 1 -- 172.21.15.133:0/320226925 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000b6e0 con 0x7f8d500c0a10 2024-01-21T19:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d4dffb700 1 -- 172.21.15.133:0/320226925 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4000ba60 con 0x7f8d500c0a10 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 -- 172.21.15.133:0/320226925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c0a10 msgr2=0x7f8d50155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c0a10 0x7f8d50155310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f8d40009760 tx=0x7f8d40009060).stop 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 -- 172.21.15.133:0/320226925 shutdown_connections 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500aa010 0x7f8d5015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 --2- 172.21.15.133:0/320226925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c0a10 0x7f8d50155310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 -- 172.21.15.133:0/320226925 >> 172.21.15.133:0/320226925 conn(0x7f8d500946b0 msgr2=0x7f8d5006a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 -- 172.21.15.133:0/320226925 shutdown_connections 2024-01-21T19:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.375+0000 7f8d55796700 1 -- 172.21.15.133:0/320226925 wait complete. 2024-01-21T19:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.376+0000 7f8d55796700 1 Processor -- start 2024-01-21T19:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 -- start start 2024-01-21T19:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 0x7f8d500b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 0x7f8d500c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c2820 con 0x7f8d500c8f30 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c4700 con 0x7f8d500aa010 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d55796700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c5240 con 0x7f8d500c0a10 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52238/0 (socket says 172.21.15.133:52238) 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.377+0000 7f8d4f7fe700 1 -- 172.21.15.133:0/2757576285 learned_addr learned my addr 172.21.15.133:0/2757576285 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4effd700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 0x7f8d500b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4e7fc700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 0x7f8d500c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 -- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 msgr2=0x7f8d500c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 0x7f8d500c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 -- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 msgr2=0x7f8d500b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 0x7f8d500b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 -- 172.21.15.133:0/2757576285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400092a0 con 0x7f8d500c8f30 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4effd700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 0x7f8d500b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4e7fc700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 0x7f8d500c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d4f7fe700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f8d48009fa0 tx=0x7f8d48009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800ed20 con 0x7f8d500c8f30 2024-01-21T19:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4800ee80 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500c25c0 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48014610 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.378+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500c4c70 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.379+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500c4ff0 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.379+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8d4801d3b0 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.380+0000 7f8d377fe700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 0x7f8d3c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.380+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8d4807a7a0 con 0x7f8d500c8f30 2024-01-21T19:59:28.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.380+0000 7f8d4effd700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 0x7f8d3c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:28.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.380+0000 7f8d4effd700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 0x7f8d3c061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8d4000b340 tx=0x7f8d40017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:28.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.384+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8d4804ba10 con 0x7f8d500c8f30 2024-01-21T19:59:28.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.591+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d500475e0 con 0x7f8d500c8f30 2024-01-21T19:59:28.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.592+0000 7f8d377fe700 1 -- 172.21.15.133:0/2757576285 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8d4804f030 con 0x7f8d500c8f30 2024-01-21T19:59:28.583 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 msgr2=0x7f8d3c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 0x7f8d3c061610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8d4000b340 tx=0x7f8d40017000).stop 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 msgr2=0x7f8d500afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f8d48009fa0 tx=0x7f8d48009900).stop 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 shutdown_connections 2024-01-21T19:59:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8d3c05f150 0x7f8d3c061610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d500c8f30 0x7f8d500afd50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d500aa010 0x7f8d500b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 --2- 172.21.15.133:0/2757576285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d500c0a10 0x7f8d500c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.593+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 >> 172.21.15.133:0/2757576285 conn(0x7f8d500946b0 msgr2=0x7f8d500cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.594+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 shutdown_connections 2024-01-21T19:59:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:28.594+0000 7f8d55796700 1 -- 172.21.15.133:0/2757576285 wait complete. 2024-01-21T19:59:28.595 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T19:59:28.596 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-01-21T19:59:28.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.596 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T19:59:28.614 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:28.614 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T19:59:28.615 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42363sec preferred_lft 42363sec 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T19:59:28.616 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link tentative 2024-01-21T19:59:28.617 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:28.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.617 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T19:59:28.680 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T19:59:28.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.682 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T19:59:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T19:59:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T19:59:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T19:59:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T19:59:28.741 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T19:59:28.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T19:59:28.742 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:28.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.847 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T19:59:28.864 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T19:59:28.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.864 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2024-01-21T19:59:28.921 INFO:teuthology.orchestra.run.smithi133.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-01-21T19:59:28.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:28.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:28.922 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:28.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T19:59:28.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-01-21T19:59:28.922 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:29.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-21T19:59:29.056 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.057 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T19:59:29.058 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether f6:30:f9:b3:26:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-21T19:59:29.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-21T19:59:29.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f430:f9ff:feb3:2630/64 scope link tentative 2024-01-21T19:59:29.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-01-21T19:59:29.155 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:29.155 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:29.155 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:29.155 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.155 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether f6:30:f9:b3:26:30 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::f430:f9ff:feb3:2630/64 scope link tentative 2024-01-21T19:59:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:29.173 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-01-21T19:59:29.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-01-21T19:59:29.174 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:29.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.403 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T19:59:29.403 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T19:59:29.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.1 up 2024-01-21T19:59:29.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.1 master ceph-brx 2024-01-21T19:59:29.403 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T19:59:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.489 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.2 2024-01-21T19:59:29.506 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T19:59:29.506 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:29.588 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:29.588 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:29.609 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:29.609 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:29.611 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T19:59:29.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:29.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-01-21T19:59:29.678 INFO:tasks.kclient:client.1 config is {} 2024-01-21T19:59:29.678 DEBUG:teuthology.orchestra.run.smithi178:> ceph fs ls 2024-01-21T19:59:29.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.802+0000 7fcd6b316700 1 Processor -- start 2024-01-21T19:59:29.794 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.802+0000 7fcd6b316700 1 -- start start 2024-01-21T19:59:29.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd6b316700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd640a6280 0x7fcd64069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd6b316700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd640be820 0x7fcd64062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.796 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd6b316700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd640c23e0 con 0x7fcd640a6660 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd6b316700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd640c2960 con 0x7fcd640a6280 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd6b316700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd640c4550 con 0x7fcd640be820 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.803+0000 7fcd698b3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd640be820 0x7fcd64062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd640be820 0x7fcd64062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:56640/0 (socket says 172.21.15.178:56640) 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 -- 172.21.15.178:0/3845003055 learned_addr learned my addr 172.21.15.178:0/3845003055 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd690b2700 1 --2- 172.21.15.178:0/3845003055 >> v2:172.21.15.133:3300/0 conn(0x7fcd640a6280 0x7fcd64069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 -- 172.21.15.178:0/3845003055 >> v2:172.21.15.133:3300/0 conn(0x7fcd640a6280 msgr2=0x7fcd64069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 --2- 172.21.15.178:0/3845003055 >> v2:172.21.15.133:3300/0 conn(0x7fcd640a6280 0x7fcd64069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 -- 172.21.15.178:0/3845003055 >> v1:172.21.15.133:6789/0 conn(0x7fcd640a6660 legacy=0x7fcd640c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 -- 172.21.15.178:0/3845003055 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640c2680 con 0x7fcd640be820 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd698b3700 1 --2- 172.21.15.178:0/3845003055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640be820 0x7fcd64062770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcd640c2240 tx=0x7fcd5c009840).ready entity=mon.1 client_cookie=8247ce42674fb641 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd5bfff700 1 -- 172.21.15.178:0/3845003055 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00e070 con 0x7fcd640be820 2024-01-21T19:59:29.797 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd5bfff700 1 -- 172.21.15.178:0/3845003055 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c00ba20 con 0x7fcd640be820 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.804+0000 7fcd5bfff700 1 -- 172.21.15.178:0/3845003055 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00bda0 con 0x7fcd640be820 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 -- 172.21.15.178:0/3845003055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640be820 msgr2=0x7fcd64062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 --2- 172.21.15.178:0/3845003055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640be820 0x7fcd64062770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcd640c2240 tx=0x7fcd5c009840).stop 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 -- 172.21.15.178:0/3845003055 shutdown_connections 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 --2- 172.21.15.178:0/3845003055 >> v2:172.21.15.133:3300/0 conn(0x7fcd640a6280 0x7fcd64069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 --2- 172.21.15.178:0/3845003055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640be820 0x7fcd64062770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 -- 172.21.15.178:0/3845003055 >> 172.21.15.178:0/3845003055 conn(0x7fcd640c7cb0 msgr2=0x7fcd640c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 -- 172.21.15.178:0/3845003055 shutdown_connections 2024-01-21T19:59:29.798 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.805+0000 7fcd6b316700 1 -- 172.21.15.178:0/3845003055 wait complete. 2024-01-21T19:59:29.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.806+0000 7fcd6b316700 1 Processor -- start 2024-01-21T19:59:29.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.806+0000 7fcd6b316700 1 -- start start 2024-01-21T19:59:29.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 0x7fcd6414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.801 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd640be820 0x7fcd640a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641537a0 con 0x7fcd640be820 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64152b90 con 0x7fcd640a6280 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64152e70 con 0x7fcd640a6660 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:52790/0 (socket says 172.21.15.178:52790) 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd690b2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 0x7fcd6414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 -- 172.21.15.178:0/363610843 learned_addr learned my addr 172.21.15.178:0/363610843 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd698b3700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd640be820 0x7fcd640a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 -- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 msgr2=0x7fcd6414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 0x7fcd6414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 -- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd640be820 msgr2=0x7fcd640a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:29.802 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd640be820 0x7fcd640a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 -- 172.21.15.178:0/363610843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c009ae0 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd690b2700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 0x7fcd6414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd688b1700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fcd6000c4c0 tx=0x7fcd60007e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60007020 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60001e90 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.807+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd64153150 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.808+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600073b0 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.808+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd640a9580 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.809+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd64153b30 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.809+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcd600068b0 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.809+0000 7fcd59ffb700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 0x7fcd480615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.809+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcd60079bd0 con 0x7fcd640a6660 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.809+0000 7fcd690b2700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 0x7fcd480615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:29.803 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.810+0000 7fcd690b2700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 0x7fcd480615e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcd54011310 tx=0x7fcd54009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:29.805 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:29.814+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd64153b30 con 0x7fcd640a6660 2024-01-21T19:59:30.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.019+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcd64153b30 con 0x7fcd640a6660 2024-01-21T19:59:30.011 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.019+0000 7fcd59ffb700 1 -- 172.21.15.178:0/363610843 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcd64153b30 con 0x7fcd640a6660 2024-01-21T19:59:30.011 INFO:teuthology.orchestra.run.smithi178.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 msgr2=0x7fcd480615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 0x7fcd480615e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcd54011310 tx=0x7fcd54009060).stop 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 msgr2=0x7fcd641525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fcd6000c4c0 tx=0x7fcd60007e00).stop 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 shutdown_connections 2024-01-21T19:59:30.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f120 0x7fcd480615e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd640be820 0x7fcd640a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd640a6280 0x7fcd6414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 --2- 172.21.15.178:0/363610843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd640a6660 0x7fcd641525b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 >> 172.21.15.178:0/363610843 conn(0x7fcd640c7cb0 msgr2=0x7fcd64062770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 shutdown_connections 2024-01-21T19:59:30.014 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:30.021+0000 7fcd6b316700 1 -- 172.21.15.178:0/363610843 wait complete. 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T19:59:30.024 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-21T19:59:30.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.025 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:30.042 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42379sec preferred_lft 42379sec 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::52a:d8fe:d264:99e2/64 scope link noprefixroute 2024-01-21T19:59:30.043 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:30.043 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-21T19:59:30.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-21T19:59:30.044 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:30.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.205 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T19:59:30.233 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-01-21T19:59:30.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.235 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-01-21T19:59:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-01-21T19:59:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T19:59:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T19:59:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T19:59:30.304 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T19:59:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T19:59:30.305 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:30.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.577 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T19:59:30.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.595 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-01-21T19:59:30.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.653 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:30.653 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:30.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-21T19:59:30.653 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-21T19:59:30.653 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:30.748 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-21T19:59:30.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.748 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:30.748 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-21T19:59:30.749 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:30.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:30.968 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:30.968 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:30.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2024-01-21T19:59:30.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2024-01-21T19:59:30.968 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:31.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.067 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p /home/ubuntu/cephtest/mnt.1 2024-01-21T19:59:31.083 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T19:59:31.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:31.166 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:31.166 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:31.254 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:31.254 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:31.257 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T19:59:31.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-21T19:59:31.325 INFO:tasks.kclient:client.3 config is {} 2024-01-21T19:59:31.325 DEBUG:teuthology.orchestra.run.smithi178:> ceph fs ls 2024-01-21T19:59:31.469 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 Processor -- start 2024-01-21T19:59:31.470 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 -- start start 2024-01-21T19:59:31.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe080063430 0x7fe0800c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.479 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080155530 con 0x7fe080063430 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080154920 con 0x7fe080153e90 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.478+0000 7fe085f1f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080154c00 con 0x7fe0800c5d00 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:52796/0 (socket says 172.21.15.178:52796) 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 -- 172.21.15.178:0/1552895907 learned_addr learned my addr 172.21.15.178:0/1552895907 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:59:31.480 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:56658/0 (socket says 172.21.15.178:56658) 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe076ffd700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.133:3300/0 conn(0x7fe080063430 0x7fe0800c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 -- 172.21.15.178:0/1552895907 >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 msgr2=0x7fe080154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 -- 172.21.15.178:0/1552895907 >> v2:172.21.15.133:3300/0 conn(0x7fe080063430 msgr2=0x7fe0800c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.133:3300/0 conn(0x7fe080063430 0x7fe0800c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 -- 172.21.15.178:0/1552895907 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080154ee0 con 0x7fe0800c5d00 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07f7fe700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07ffff700 1 --2- 172.21.15.178:0/1552895907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe080065310 tx=0x7fe078009840).ready entity=mon.2 client_cookie=b33327b27a1c961a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07effd700 1 -- 172.21.15.178:0/1552895907 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800e070 con 0x7fe0800c5d00 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07effd700 1 -- 172.21.15.178:0/1552895907 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800ba20 con 0x7fe0800c5d00 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.479+0000 7fe07effd700 1 -- 172.21.15.178:0/1552895907 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07800bda0 con 0x7fe0800c5d00 2024-01-21T19:59:31.482 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 -- 172.21.15.178:0/1552895907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 msgr2=0x7fe0800bde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1552895907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe080065310 tx=0x7fe078009840).stop 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 -- 172.21.15.178:0/1552895907 shutdown_connections 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1552895907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0800c5d00 0x7fe0800bde30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.178:3300/0 conn(0x7fe080153e90 0x7fe080154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1552895907 >> v2:172.21.15.133:3300/0 conn(0x7fe080063430 0x7fe0800c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 -- 172.21.15.178:0/1552895907 >> 172.21.15.178:0/1552895907 conn(0x7fe0800c7cb0 msgr2=0x7fe0800c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:31.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 -- 172.21.15.178:0/1552895907 shutdown_connections 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.480+0000 7fe085f1f700 1 -- 172.21.15.178:0/1552895907 wait complete. 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.482+0000 7fe085f1f700 1 Processor -- start 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.482+0000 7fe085f1f700 1 -- start start 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0801594c0 0x7fe080167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0801584b0 0x7fe08014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080158020 con 0x7fe0801584b0 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08014de80 con 0x7fe0801594c0 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080157cf0 con 0x7fe080153e90 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe076ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0801594c0 0x7fe080167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:52804/0 (socket says 172.21.15.178:52804) 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 -- 172.21.15.178:0/1359083805 learned_addr learned my addr 172.21.15.178:0/1359083805 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07ffff700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0801584b0 0x7fe08014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 -- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0801594c0 msgr2=0x7fe080167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0801594c0 0x7fe080167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 -- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0801584b0 msgr2=0x7fe08014f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:31.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0801584b0 0x7fe08014f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 -- 172.21.15.178:0/1359083805 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700092a0 con 0x7fe080153e90 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07f7fe700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe07000e9b0 tx=0x7fe070009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000eea0 con 0x7fe080153e90 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000c850 con 0x7fe080153e90 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078009ae0 con 0x7fe080153e90 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07000cbd0 con 0x7fe080153e90 2024-01-21T19:59:31.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.483+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080168420 con 0x7fe080153e90 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.484+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0800475e0 con 0x7fe080153e90 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.485+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe07001b400 con 0x7fe080153e90 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.485+0000 7fe07cff9700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 0x7fe060061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.485+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe07007a710 con 0x7fe080153e90 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.486+0000 7fe076ffd700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 0x7fe060061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:31.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.486+0000 7fe076ffd700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 0x7fe060061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe080153640 tx=0x7fe068008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:31.489 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.489+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe07004ba30 con 0x7fe080153e90 2024-01-21T19:59:31.684 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.693+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe08006ab50 con 0x7fe080153e90 2024-01-21T19:59:31.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.693+0000 7fe07cff9700 1 -- 172.21.15.178:0/1359083805 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe07004f050 con 0x7fe080153e90 2024-01-21T19:59:31.692 INFO:teuthology.orchestra.run.smithi178.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T19:59:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 msgr2=0x7fe060061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 0x7fe060061610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fe080153640 tx=0x7fe068008040).stop 2024-01-21T19:59:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 msgr2=0x7fe08014d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe07000e9b0 tx=0x7fe070009060).stop 2024-01-21T19:59:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 shutdown_connections 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe06005f150 0x7fe060061610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0801584b0 0x7fe08014f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe080153e90 0x7fe08014d990 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 --2- 172.21.15.178:0/1359083805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0801594c0 0x7fe080167840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 >> 172.21.15.178:0/1359083805 conn(0x7fe0800c7cb0 msgr2=0x7fe0801565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 shutdown_connections 2024-01-21T19:59:31.694 INFO:teuthology.orchestra.run.smithi178.stderr:2024-01-21T19:59:31.695+0000 7fe085f1f700 1 -- 172.21.15.178:0/1359083805 wait complete. 2024-01-21T19:59:31.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T19:59:31.698 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-01-21T19:59:31.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.698 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:31.716 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42377sec preferred_lft 42377sec 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::52a:d8fe:d264:99e2/64 scope link noprefixroute 2024-01-21T19:59:31.717 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 4a:92:74:9d:69:c7 brd ff:ff:ff:ff:ff:ff 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::7447:c8ff:febc:46ef/64 scope link tentative 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 4a:92:74:9d:69:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::4892:74ff:fe9d:69c7/64 scope link tentative 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:31.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.719 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T19:59:31.782 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-01-21T19:59:31.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.783 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-01-21T19:59:31.842 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-01-21T19:59:31.843 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T19:59:31.843 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T19:59:31.843 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T19:59:31.843 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T19:59:31.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.843 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:31.843 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:31.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T19:59:31.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T19:59:31.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T19:59:31.844 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:31.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.950 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T19:59:31.967 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-21T19:59:31.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:31.968 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-01-21T19:59:32.024 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-01-21T19:59:32.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.025 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:32.025 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:32.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-21T19:59:32.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-01-21T19:59:32.025 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:32.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-21T19:59:32.163 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether ae:53:01:52:27:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ac53:1ff:fe52:2757/64 scope link tentative 2024-01-21T19:59:32.164 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.175 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-01-21T19:59:32.210 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T19:59:32.210 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T19:59:32.210 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T19:59:32.210 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether ae:53:01:52:27:57 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ac53:1ff:fe52:2757/64 scope link tentative 2024-01-21T19:59:32.211 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-01-21T19:59:32.223 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-01-21T19:59:32.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-01-21T19:59:32.224 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:32.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.462 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-01-21T19:59:32.462 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-01-21T19:59:32.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2024-01-21T19:59:32.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2024-01-21T19:59:32.462 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-01-21T19:59:32.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.549 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p /home/ubuntu/cephtest/mnt.3 2024-01-21T19:59:32.565 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T19:59:32.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:32.647 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:32.647 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:32.667 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T19:59:32.667 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T19:59:32.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T19:59:32.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:32.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-01-21T19:59:32.739 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-21T19:59:32.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:32.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.910+0000 7f05c29a9700 1 Processor -- start 2024-01-21T19:59:32.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.910+0000 7f05c29a9700 1 -- start start 2024-01-21T19:59:32.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05c29a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f05bc065d70 0x7f05bc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:32.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05c29a9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc069ef0 con 0x7f05bc062c10 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05c29a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc06a130 con 0x7f05bc062ff0 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05c29a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc06a410 con 0x7f05bc065d70 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05bbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f05bc062c10 0x7f05bc0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38464/0 (socket says 172.21.15.133:38464) 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05bbfff700 1 -- 172.21.15.133:0/3750231081 learned_addr learned my addr 172.21.15.133:0/3750231081 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.911+0000 7f05c0f46700 1 --2- 172.21.15.133:0/3750231081 >> v2:172.21.15.178:3300/0 conn(0x7f05bc065d70 0x7f05bc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645970158 0 0) 0x7f05b0001110 con 0x7f05bc062c10 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a40033f0 con 0x7f05bc062c10 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747205945 0 0) 0x7f05bc06a130 con 0x7f05bc062ff0 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b0001110 con 0x7f05bc062ff0 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05c0f46700 1 -- 172.21.15.133:0/3750231081 >> v1:172.21.15.178:6789/0 conn(0x7f05bc062ff0 legacy=0x7f05bc065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05c0f46700 1 -- 172.21.15.133:0/3750231081 >> v1:172.21.15.133:6789/0 conn(0x7f05bc062c10 legacy=0x7f05bc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05c0f46700 1 -- 172.21.15.133:0/3750231081 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc06a6f0 con 0x7f05bc065d70 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05c0f46700 1 --2- 172.21.15.133:0/3750231081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc065d70 0x7f05bc15f750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f05b4009e60 tx=0x7f05b4009780).ready entity=mon.1 client_cookie=2dcd763e60e6dbd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400e070 con 0x7f05bc065d70 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400bab0 con 0x7f05bc065d70 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.912+0000 7f05baffd700 1 -- 172.21.15.133:0/3750231081 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400be30 con 0x7f05bc065d70 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 -- 172.21.15.133:0/3750231081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc065d70 msgr2=0x7f05bc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 --2- 172.21.15.133:0/3750231081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc065d70 0x7f05bc15f750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f05b4009e60 tx=0x7f05b4009780).stop 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 -- 172.21.15.133:0/3750231081 shutdown_connections 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 --2- 172.21.15.133:0/3750231081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc065d70 0x7f05bc15f750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 -- 172.21.15.133:0/3750231081 >> 172.21.15.133:0/3750231081 conn(0x7f05bc0c8010 msgr2=0x7f05bc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 -- 172.21.15.133:0/3750231081 shutdown_connections 2024-01-21T19:59:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.913+0000 7f05c29a9700 1 -- 172.21.15.133:0/3750231081 wait complete. 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.914+0000 7f05c29a9700 1 Processor -- start 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.914+0000 7f05c29a9700 1 -- start start 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc062ff0 0x7f05bc0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05bc065d70 0x7f05bc0a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0c0130 con 0x7f05bc062c10 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0a6730 con 0x7f05bc062ff0 2024-01-21T19:59:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c29a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0bf520 con 0x7f05bc065d70 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41934/0 (socket says 172.21.15.133:41934) 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 -- 172.21.15.133:0/1998776677 learned_addr learned my addr 172.21.15.133:0/1998776677 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bb7fe700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc062ff0 0x7f05bc0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05c0f46700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05bc065d70 0x7f05bc0a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 -- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05bc065d70 msgr2=0x7f05bc0a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05bc065d70 0x7f05bc0a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 -- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc062ff0 msgr2=0x7f05bc0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc062ff0 0x7f05bc0a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.915+0000 7f05bbfff700 1 -- 172.21.15.133:0/1998776677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4009a20 con 0x7f05bc062c10 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05bbfff700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f05b000c790 tx=0x7f05b0007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00072e0 con 0x7f05bc062c10 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0007440 con 0x7f05bc062c10 2024-01-21T19:59:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc0bf800 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00057a0 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.916+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0bfdc0 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.917+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc069510 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.917+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f05b0005b90 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.918+0000 7f05b8ff9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 0x7f05a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.918+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f05b0079900 con 0x7f05bc062c10 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.918+0000 7f05bb7fe700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 0x7f05a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.918+0000 7f05bb7fe700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 0x7f05a8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f05bc13af10 tx=0x7f05ac007bd0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:32.922+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05b004abd0 con 0x7f05bc062c10 2024-01-21T19:59:33.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.085+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05bc069ef0 con 0x7f05bc062c10 2024-01-21T19:59:33.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.086+0000 7f05b8ff9700 1 -- 172.21.15.133:0/1998776677 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f05bc069ef0 con 0x7f05bc062c10 2024-01-21T19:59:33.077 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:33.077 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.087+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 msgr2=0x7f05a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.087+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 0x7f05a8061610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f05bc13af10 tx=0x7f05ac007bd0).stop 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.087+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 msgr2=0x7f05bc0a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.087+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f05b000c790 tx=0x7f05b0007d00).stop 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 shutdown_connections 2024-01-21T19:59:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05a805f150 0x7f05a8061610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05bc065d70 0x7f05bc0a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05bc062c10 0x7f05bc0a6240 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 --2- 172.21.15.133:0/1998776677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05bc062ff0 0x7f05bc0a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 >> 172.21.15.133:0/1998776677 conn(0x7f05bc0c8010 msgr2=0x7f05bc065660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 shutdown_connections 2024-01-21T19:59:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.088+0000 7f05c29a9700 1 -- 172.21.15.133:0/1998776677 wait complete. 2024-01-21T19:59:33.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:33.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:33.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.218+0000 7f9b7fa24700 1 Processor -- start 2024-01-21T19:59:33.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.218+0000 7f9b7fa24700 1 -- start start 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7fa24700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b78158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7fa24700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b78154520 0x7f9b780ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7fa24700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b780ab620 con 0x7f9b78154140 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7fa24700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b780c6ae0 con 0x7f9b78154520 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7fa24700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780c05e0 con 0x7f9b780c8120 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7d7c0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b78154140 0x7f9b780c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38476/0 (socket says 172.21.15.133:38476) 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7d7c0700 1 -- 172.21.15.133:0/2073658256 learned_addr learned my addr 172.21.15.133:0/2073658256 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7cfbf700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b78158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.219+0000 7f9b7dfc1700 1 --2- 172.21.15.133:0/2073658256 >> v2:172.21.15.178:3300/0 conn(0x7f9b78154520 0x7f9b780ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b6ffff700 1 -- 172.21.15.133:0/2073658256 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080545780 0 0) 0x7f9b780ab620 con 0x7f9b78154140 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b6ffff700 1 -- 172.21.15.133:0/2073658256 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b640033f0 con 0x7f9b78154140 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7dfc1700 1 -- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 msgr2=0x7f9b78158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7dfc1700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b78158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7dfc1700 1 -- 172.21.15.133:0/2073658256 >> v1:172.21.15.133:6789/0 conn(0x7f9b78154140 legacy=0x7f9b780c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7dfc1700 1 -- 172.21.15.133:0/2073658256 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b780c0e40 con 0x7f9b78154520 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7cfbf700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b78158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b7dfc1700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154520 0x7f9b780ab130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9b70009e60 tx=0x7f9b70009780).ready entity=mon.1 client_cookie=b9c85fffbd0e8bc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b6ffff700 1 -- 172.21.15.133:0/2073658256 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000e070 con 0x7f9b78154520 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b6ffff700 1 -- 172.21.15.133:0/2073658256 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7000bab0 con 0x7f9b78154520 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.220+0000 7f9b6ffff700 1 -- 172.21.15.133:0/2073658256 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000be30 con 0x7f9b78154520 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154520 msgr2=0x7f9b780ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154520 0x7f9b780ab130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f9b70009e60 tx=0x7f9b70009780).stop 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2073658256 shutdown_connections 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154520 0x7f9b780ab130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2073658256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b78158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2073658256 >> 172.21.15.133:0/2073658256 conn(0x7f9b7805e1e0 msgr2=0x7f9b7805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2073658256 shutdown_connections 2024-01-21T19:59:33.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.221+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2073658256 wait complete. 2024-01-21T19:59:33.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.222+0000 7f9b7fa24700 1 Processor -- start 2024-01-21T19:59:33.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.222+0000 7f9b7fa24700 1 -- start start 2024-01-21T19:59:33.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b781530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154140 0x7f9b78151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 0x7f9b78151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78152c10 con 0x7f9b78154520 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78151740 con 0x7f9b78154140 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7fa24700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78152000 con 0x7f9b780c8120 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7dfc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 0x7f9b78151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7dfc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 0x7f9b78151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41950/0 (socket says 172.21.15.133:41950) 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7dfc1700 1 -- 172.21.15.133:0/2964503959 learned_addr learned my addr 172.21.15.133:0/2964503959 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b781530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7cfbf700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154140 0x7f9b78151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 -- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154140 msgr2=0x7f9b78151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154140 0x7f9b78151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 -- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 msgr2=0x7f9b78151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 0x7f9b78151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 -- 172.21.15.133:0/2964503959 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740092a0 con 0x7f9b780c8120 2024-01-21T19:59:33.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.223+0000 7f9b7d7c0700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b781530a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9b68001ed0 tx=0x7f9b68007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.224+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b680070d0 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.224+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b68007250 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.224+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b70009a20 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.224+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b68007610 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.224+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b781525c0 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.225+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b680059b0 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.225+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b78152ef0 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.225+0000 7f9b6dffb700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 0x7f9b5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.225+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9b68079680 con 0x7f9b780c8120 2024-01-21T19:59:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.225+0000 7f9b7cfbf700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 0x7f9b5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.226+0000 7f9b7cfbf700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 0x7f9b5c061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9b74009dc0 tx=0x7f9b74009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.230+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9b6804a950 con 0x7f9b780c8120 2024-01-21T19:59:33.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.391+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9b7805fdf0 con 0x7f9b780c8120 2024-01-21T19:59:33.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.392+0000 7f9b6dffb700 1 -- 172.21.15.133:0/2964503959 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9b68007cd0 con 0x7f9b780c8120 2024-01-21T19:59:33.383 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 msgr2=0x7f9b5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 0x7f9b5c061610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f9b74009dc0 tx=0x7f9b74009060).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 msgr2=0x7f9b781530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b781530a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9b68001ed0 tx=0x7f9b68007b90).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 shutdown_connections 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b5c05f150 0x7f9b5c061610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b78154520 0x7f9b78151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b780c8120 0x7f9b781530a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 --2- 172.21.15.133:0/2964503959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b78154140 0x7f9b78151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 >> 172.21.15.133:0/2964503959 conn(0x7f9b7805e1e0 msgr2=0x7f9b780c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 shutdown_connections 2024-01-21T19:59:33.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.394+0000 7f9b7fa24700 1 -- 172.21.15.133:0/2964503959 wait complete. 2024-01-21T19:59:33.397 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.524+0000 7f7bcdd1b700 1 Processor -- start 2024-01-21T19:59:33.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.524+0000 7f7bcdd1b700 1 -- start start 2024-01-21T19:59:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bcdd1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bcdd1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bc81521e0 0x7f7bc81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bcdd1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8065fd0 con 0x7f7bc8066460 2024-01-21T19:59:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bcdd1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc8063be0 con 0x7f7bc81521e0 2024-01-21T19:59:33.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bcdd1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80653c0 con 0x7f7bc80acbc0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:37608/0 (socket says 172.21.15.133:37608) 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bc77fe700 1 -- 172.21.15.133:0/190812082 learned_addr learned my addr 172.21.15.133:0/190812082 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.525+0000 7f7bc7fff700 1 --2- 172.21.15.133:0/190812082 >> v2:172.21.15.178:3300/0 conn(0x7f7bc81521e0 0x7f7bc81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc77fe700 1 -- 172.21.15.133:0/190812082 >> v2:172.21.15.178:3300/0 conn(0x7f7bc81521e0 msgr2=0x7f7bc81525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc77fe700 1 --2- 172.21.15.133:0/190812082 >> v2:172.21.15.178:3300/0 conn(0x7f7bc81521e0 0x7f7bc81525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc77fe700 1 -- 172.21.15.133:0/190812082 >> v1:172.21.15.178:6789/0 conn(0x7f7bc8066460 legacy=0x7f7bc80634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc77fe700 1 -- 172.21.15.133:0/190812082 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80656a0 con 0x7f7bc80acbc0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc77fe700 1 --2- 172.21.15.133:0/190812082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7bbc006fd0 tx=0x7f7bbc0090f0).ready entity=mon.2 client_cookie=d8acc31509c791d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc67fc700 1 -- 172.21.15.133:0/190812082 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00b580 con 0x7f7bc80acbc0 2024-01-21T19:59:33.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc67fc700 1 -- 172.21.15.133:0/190812082 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00b6e0 con 0x7f7bc80acbc0 2024-01-21T19:59:33.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.526+0000 7f7bc67fc700 1 -- 172.21.15.133:0/190812082 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc00ba80 con 0x7f7bc80acbc0 2024-01-21T19:59:33.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/190812082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 msgr2=0x7f7bc80acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/190812082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f7bbc006fd0 tx=0x7f7bbc0090f0).stop 2024-01-21T19:59:33.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/190812082 shutdown_connections 2024-01-21T19:59:33.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/190812082 >> v2:172.21.15.178:3300/0 conn(0x7f7bc81521e0 0x7f7bc81525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/190812082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/190812082 >> 172.21.15.133:0/190812082 conn(0x7f7bc80c8200 msgr2=0x7f7bc80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/190812082 shutdown_connections 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.527+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/190812082 wait complete. 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.528+0000 7f7bcdd1b700 1 Processor -- start 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.528+0000 7f7bcdd1b700 1 -- start start 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc81434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80bec90 con 0x7f7bc8066460 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8153af0 con 0x7f7bc80acbc0 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bcdd1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8153dd0 con 0x7f7bc81521e0 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41960/0 (socket says 172.21.15.133:41960) 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 -- 172.21.15.133:0/305505063 learned_addr learned my addr 172.21.15.133:0/305505063 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:33.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc7fff700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc6ffd700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc81434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 -- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 msgr2=0x7f7bc8154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 -- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 msgr2=0x7f7bc81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc81434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 -- 172.21.15.133:0/305505063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc009370 con 0x7f7bc8066460 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7bc77fe700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7bc805f8e0 tx=0x7f7bbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.529+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc006d90 con 0x7f7bc8066460 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.530+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00be40 con 0x7f7bc8066460 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.530+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc81540b0 con 0x7f7bc8066460 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.530+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc01c420 con 0x7f7bc8066460 2024-01-21T19:59:33.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.530+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc814fda0 con 0x7f7bc8066460 2024-01-21T19:59:33.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.531+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8154550 con 0x7f7bc8066460 2024-01-21T19:59:33.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.531+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7bbc01c790 con 0x7f7bc8066460 2024-01-21T19:59:33.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.531+0000 7f7baffff700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 0x7f7bb4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.531+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7bbc07bc50 con 0x7f7bc8066460 2024-01-21T19:59:33.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.531+0000 7f7bc6ffd700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 0x7f7bb4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.532+0000 7f7bc6ffd700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 0x7f7bb4061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7bc80c08c0 tx=0x7f7bb8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.536+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bbc081020 con 0x7f7bc8066460 2024-01-21T19:59:33.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.699+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7bc8065980 con 0x7f7bc8066460 2024-01-21T19:59:33.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.699+0000 7f7baffff700 1 -- 172.21.15.133:0/305505063 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bbc02a030 con 0x7f7bc8066460 2024-01-21T19:59:33.691 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:33.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 msgr2=0x7f7bb4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 0x7f7bb4061610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f7bc80c08c0 tx=0x7f7bb8009040).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 msgr2=0x7f7bc81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f7bc805f8e0 tx=0x7f7bbc017000).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 shutdown_connections 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bb405f150 0x7f7bb4061610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc8066460 0x7f7bc81525f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 --2- 172.21.15.133:0/305505063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc81434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 >> 172.21.15.133:0/305505063 conn(0x7f7bc80c8200 msgr2=0x7f7bc80c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 shutdown_connections 2024-01-21T19:59:33.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.701+0000 7f7bcdd1b700 1 -- 172.21.15.133:0/305505063 wait complete. 2024-01-21T19:59:33.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:33.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.831+0000 7f1f08fe5700 1 Processor -- start 2024-01-21T19:59:33.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.831+0000 7f1f08fe5700 1 -- start start 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f08fe5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f04062c10 0x7f1f04062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f08fe5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f04065d70 0x7f1f040bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f08fe5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f040634e0 con 0x7f1f040697e0 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f08fe5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0406a130 con 0x7f1f04065d70 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f08fe5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0406a410 con 0x7f1f04062c10 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f02d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f04065d70 0x7f1f040bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f02d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f04065d70 0x7f1f040bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41962/0 (socket says 172.21.15.133:41962) 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.832+0000 7f1f02d9d700 1 -- 172.21.15.133:0/2983353423 learned_addr learned my addr 172.21.15.133:0/2983353423 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:33.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f0259c700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f04062c10 0x7f1f04062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f02d9d700 1 -- 172.21.15.133:0/2983353423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f04062c10 msgr2=0x7f1f04062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f02d9d700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f04062c10 0x7f1f04062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f02d9d700 1 -- 172.21.15.133:0/2983353423 >> v1:172.21.15.178:6789/0 conn(0x7f1f040697e0 legacy=0x7f1f04065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f02d9d700 1 -- 172.21.15.133:0/2983353423 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0406a6f0 con 0x7f1f04065d70 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f02d9d700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04065d70 0x7f1f040bd770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f1efc009f20 tx=0x7f1efc009840).ready entity=mon.0 client_cookie=6c16ce03ea055046 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f0159a700 1 -- 172.21.15.133:0/2983353423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00e070 con 0x7f1f04065d70 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f0159a700 1 -- 172.21.15.133:0/2983353423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00ba40 con 0x7f1f04065d70 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f0159a700 1 -- 172.21.15.133:0/2983353423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00bdc0 con 0x7f1f04065d70 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f08fe5700 1 -- 172.21.15.133:0/2983353423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04065d70 msgr2=0x7f1f040bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.833+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04065d70 0x7f1f040bd770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f1efc009f20 tx=0x7f1efc009840).stop 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 -- 172.21.15.133:0/2983353423 shutdown_connections 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04065d70 0x7f1f040bd770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/2983353423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f04062c10 0x7f1f04062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 -- 172.21.15.133:0/2983353423 >> 172.21.15.133:0/2983353423 conn(0x7f1f040c8010 msgr2=0x7f1f040c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:33.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 -- 172.21.15.133:0/2983353423 shutdown_connections 2024-01-21T19:59:33.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.834+0000 7f1f08fe5700 1 -- 172.21.15.133:0/2983353423 wait complete. 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.835+0000 7f1f08fe5700 1 Processor -- start 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.835+0000 7f1f08fe5700 1 -- start start 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f04065d70 0x7f1f04158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f040697e0 0x7f1f0413a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040aaa10 con 0x7f1f04062c10 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040a99b0 con 0x7f1f04065d70 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f040a8ac0 con 0x7f1f040697e0 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41970/0 (socket says 172.21.15.133:41970) 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 -- 172.21.15.133:0/1780469552 learned_addr learned my addr 172.21.15.133:0/1780469552 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f01d9b700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f04065d70 0x7f1f04158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f02d9d700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f040697e0 0x7f1f0413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 -- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f040697e0 msgr2=0x7f1f0413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f040697e0 0x7f1f0413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 -- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f04065d70 msgr2=0x7f1f04158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f04065d70 0x7f1f04158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 -- 172.21.15.133:0/1780469552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009ae0 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f0259c700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1ef800c650 tx=0x7f1ef8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8010580 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef80106e0 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f040a8da0 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8010a60 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.836+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f040a9360 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.837+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0405fdf0 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.838+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1ef801b460 con 0x7f1f04062c10 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.838+0000 7f1ef2ffd700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 0x7f1ee4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:33.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.838+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ef8079fe0 con 0x7f1f04062c10 2024-01-21T19:59:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.838+0000 7f1f01d9b700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 0x7f1ee4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.839+0000 7f1f01d9b700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 0x7f1ee4061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f1f04155d40 tx=0x7f1ef4007d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:33.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:33.842+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ef804b250 con 0x7f1f04062c10 2024-01-21T19:59:34.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.009+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f040c8e40 con 0x7f1f04062c10 2024-01-21T19:59:34.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.009+0000 7f1ef2ffd700 1 -- 172.21.15.133:0/1780469552 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ef804e870 con 0x7f1f04062c10 2024-01-21T19:59:34.001 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 msgr2=0x7f1ee4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 0x7f1ee4061610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f1f04155d40 tx=0x7f1ef4007d20).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 msgr2=0x7f1f04139f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f1ef800c650 tx=0x7f1ef8008040).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 shutdown_connections 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ee405f150 0x7f1ee4061610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f040697e0 0x7f1f0413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04062c10 0x7f1f04139f00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 --2- 172.21.15.133:0/1780469552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f04065d70 0x7f1f04158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 >> 172.21.15.133:0/1780469552 conn(0x7f1f040c8010 msgr2=0x7f1f040c6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 shutdown_connections 2024-01-21T19:59:34.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.011+0000 7f1f08fe5700 1 -- 172.21.15.133:0/1780469552 wait complete. 2024-01-21T19:59:34.015 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:34.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.143+0000 7ff17956d700 1 Processor -- start 2024-01-21T19:59:34.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.143+0000 7ff17956d700 1 -- start start 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff17956d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 0x7ff1740626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff17956d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff174155ca0 0x7ff174062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff17956d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1740a50f0 con 0x7ff1740bd180 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff17956d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1740630d0 con 0x7ff174155ca0 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff17956d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740a4da0 con 0x7ff1741558c0 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff1727fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff174155ca0 0x7ff174062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff1727fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff174155ca0 0x7ff174062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41980/0 (socket says 172.21.15.133:41980) 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff1727fc700 1 -- 172.21.15.133:0/3405981018 learned_addr learned my addr 172.21.15.133:0/3405981018 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.144+0000 7ff1737fe700 1 --1- 172.21.15.133:0/3405981018 >> v1:172.21.15.133:6789/0 conn(0x7ff1740bd180 0x7ff1740bd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38490/0 (socket says 172.21.15.133:38490) 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff172ffd700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 0x7ff1740626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff1727fc700 1 -- 172.21.15.133:0/3405981018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 msgr2=0x7ff1740626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff1727fc700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 0x7ff1740626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff1727fc700 1 -- 172.21.15.133:0/3405981018 >> v1:172.21.15.133:6789/0 conn(0x7ff1740bd180 legacy=0x7ff1740bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff1727fc700 1 -- 172.21.15.133:0/3405981018 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740bde00 con 0x7ff174155ca0 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff171ffb700 1 -- 172.21.15.133:0/3405981018 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803835761 0 0) 0x7ff1740a50f0 con 0x7ff1740bd180 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff172ffd700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 0x7ff1740626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff1727fc700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174155ca0 0x7ff174062be0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff164006fd0 tx=0x7ff1640090f0).ready entity=mon.0 client_cookie=ead039b7edbd9a2f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff171ffb700 1 -- 172.21.15.133:0/3405981018 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400b600 con 0x7ff174155ca0 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff171ffb700 1 -- 172.21.15.133:0/3405981018 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400b760 con 0x7ff174155ca0 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff171ffb700 1 -- 172.21.15.133:0/3405981018 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400bb00 con 0x7ff174155ca0 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 -- 172.21.15.133:0/3405981018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174155ca0 msgr2=0x7ff174062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174155ca0 0x7ff174062be0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff164006fd0 tx=0x7ff1640090f0).stop 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 -- 172.21.15.133:0/3405981018 shutdown_connections 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1741558c0 0x7ff1740626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 --2- 172.21.15.133:0/3405981018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff174155ca0 0x7ff174062be0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 -- 172.21.15.133:0/3405981018 >> 172.21.15.133:0/3405981018 conn(0x7ff1740c8010 msgr2=0x7ff1740c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.145+0000 7ff17956d700 1 -- 172.21.15.133:0/3405981018 shutdown_connections 2024-01-21T19:59:34.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.146+0000 7ff17956d700 1 -- 172.21.15.133:0/3405981018 wait complete. 2024-01-21T19:59:34.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.147+0000 7ff17956d700 1 Processor -- start 2024-01-21T19:59:34.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.147+0000 7ff17956d700 1 -- start start 2024-01-21T19:59:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 0x7ff174094e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 0x7ff1740add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c0e90 con 0x7ff1741558c0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c1170 con 0x7ff174155ca0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c1450 con 0x7ff1740bd180 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41988/0 (socket says 172.21.15.133:41988) 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 -- 172.21.15.133:0/920826826 learned_addr learned my addr 172.21.15.133:0/920826826 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1737fe700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 0x7ff1740add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff172ffd700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 0x7ff174094e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 -- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 msgr2=0x7ff174094e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 0x7ff174094e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 -- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 msgr2=0x7ff1740add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 0x7ff1740add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 -- 172.21.15.133:0/920826826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164009370 con 0x7ff1741558c0 2024-01-21T19:59:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff172ffd700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 0x7ff174094e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1737fe700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 0x7ff1740add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff1727fc700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff174068a00 tx=0x7ff164017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164006990 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400b8d0 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1740c1730 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16401d430 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.148+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff174095370 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.149+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1740c2c00 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.150+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff16401d7e0 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.150+0000 7ff15b7fe700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 0x7ff160061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.150+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff16407bdf0 con 0x7ff1741558c0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.150+0000 7ff172ffd700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 0x7ff160061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.150+0000 7ff172ffd700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 0x7ff160061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff16800aa90 tx=0x7ff168008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.154+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff16404d170 con 0x7ff1741558c0 2024-01-21T19:59:34.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.317+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1740c18c0 con 0x7ff1741558c0 2024-01-21T19:59:34.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.318+0000 7ff15b7fe700 1 -- 172.21.15.133:0/920826826 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff164021070 con 0x7ff1741558c0 2024-01-21T19:59:34.309 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 msgr2=0x7ff160061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 0x7ff160061610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff16800aa90 tx=0x7ff168008040).stop 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 msgr2=0x7ff1740ad820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7ff174068a00 tx=0x7ff164017000).stop 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 shutdown_connections 2024-01-21T19:59:34.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff16005f150 0x7ff160061610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff174155ca0 0x7ff1740add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1740bd180 0x7ff174094e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 --2- 172.21.15.133:0/920826826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1741558c0 0x7ff1740ad820 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 >> 172.21.15.133:0/920826826 conn(0x7ff1740c8010 msgr2=0x7ff1740626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.319+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 shutdown_connections 2024-01-21T19:59:34.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.320+0000 7ff17956d700 1 -- 172.21.15.133:0/920826826 wait complete. 2024-01-21T19:59:34.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:34.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.448+0000 7f1a9dc1d700 1 Processor -- start 2024-01-21T19:59:34.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.448+0000 7f1a9dc1d700 1 -- start start 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a9dc1d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a981546b0 0x7f1a98154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a9dc1d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a980bc6d0 0x7f1a98066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a9dc1d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a980654f0 con 0x7f1a980a9e30 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a9dc1d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98063700 con 0x7f1a981546b0 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a9dc1d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a98063950 con 0x7f1a980bc6d0 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a981546b0 0x7f1a98154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1a981546b0 0x7f1a98154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41996/0 (socket says 172.21.15.133:41996) 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 -- 172.21.15.133:0/3228629911 learned_addr learned my addr 172.21.15.133:0/3228629911 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a97fff700 1 --2- 172.21.15.133:0/3228629911 >> v2:172.21.15.178:3300/0 conn(0x7f1a980bc6d0 0x7f1a98066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 -- 172.21.15.133:0/3228629911 >> v2:172.21.15.178:3300/0 conn(0x7f1a980bc6d0 msgr2=0x7f1a98066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 --2- 172.21.15.133:0/3228629911 >> v2:172.21.15.178:3300/0 conn(0x7f1a980bc6d0 0x7f1a98066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 -- 172.21.15.133:0/3228629911 >> v1:172.21.15.178:6789/0 conn(0x7f1a980a9e30 legacy=0x7f1a98065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 -- 172.21.15.133:0/3228629911 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98065180 con 0x7f1a981546b0 2024-01-21T19:59:34.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.449+0000 7f1a977fe700 1 --2- 172.21.15.133:0/3228629911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a981546b0 0x7f1a98154a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1a98065460 tx=0x7f1a8c0090f0).ready entity=mon.0 client_cookie=bfa688e31e32ce0a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a967fc700 1 -- 172.21.15.133:0/3228629911 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00b5a0 con 0x7f1a981546b0 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a967fc700 1 -- 172.21.15.133:0/3228629911 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00b700 con 0x7f1a981546b0 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a967fc700 1 -- 172.21.15.133:0/3228629911 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00baa0 con 0x7f1a981546b0 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/3228629911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a981546b0 msgr2=0x7f1a98154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/3228629911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a981546b0 0x7f1a98154a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1a98065460 tx=0x7f1a8c0090f0).stop 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/3228629911 shutdown_connections 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/3228629911 >> v2:172.21.15.178:3300/0 conn(0x7f1a980bc6d0 0x7f1a98066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/3228629911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a981546b0 0x7f1a98154a90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/3228629911 >> 172.21.15.133:0/3228629911 conn(0x7f1a980c8200 msgr2=0x7f1a980c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/3228629911 shutdown_connections 2024-01-21T19:59:34.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.450+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/3228629911 wait complete. 2024-01-21T19:59:34.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.451+0000 7f1a9dc1d700 1 Processor -- start 2024-01-21T19:59:34.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.451+0000 7f1a9dc1d700 1 -- start start 2024-01-21T19:59:34.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a980bc6d0 0x7f1a98140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a981546b0 0x7f1a980be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980bfe00 con 0x7f1a980a9e30 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980bf1f0 con 0x7f1a980bc6d0 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a9dc1d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a980bf4d0 con 0x7f1a981546b0 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42000/0 (socket says 172.21.15.133:42000) 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.452+0000 7f1a977fe700 1 -- 172.21.15.133:0/2324463343 learned_addr learned my addr 172.21.15.133:0/2324463343 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 -- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a981546b0 msgr2=0x7f1a980be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a981546b0 0x7f1a980be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 -- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a980bc6d0 msgr2=0x7f1a98140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a96ffd700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a980bc6d0 0x7f1a98140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a980bc6d0 0x7f1a98140380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 -- 172.21.15.133:0/2324463343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009370 con 0x7f1a980a9e30 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a977fe700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f1a9805f8e0 tx=0x7f1a8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c006910 con 0x7f1a980a9e30 2024-01-21T19:59:34.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00b870 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c024470 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a980bf7b0 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.453+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a98140870 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.454+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9805fdf0 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.454+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1a8c021070 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.454+0000 7f1a7ffff700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 0x7f1a84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.455+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1a8c07bb80 con 0x7f1a980a9e30 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.455+0000 7f1a96ffd700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 0x7f1a84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.455+0000 7f1a96ffd700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 0x7f1a84061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1a98151260 tx=0x7f1a88008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.459+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a8c04ce50 con 0x7f1a980a9e30 2024-01-21T19:59:34.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.620+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a9805e850 con 0x7f1a980a9e30 2024-01-21T19:59:34.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.621+0000 7f1a7ffff700 1 -- 172.21.15.133:0/2324463343 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f1a8c050470 con 0x7f1a980a9e30 2024-01-21T19:59:34.613 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:34.614 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:34.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 msgr2=0x7f1a84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 0x7f1a84061610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1a98151260 tx=0x7f1a88008040).stop 2024-01-21T19:59:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 msgr2=0x7f1a980c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f1a9805f8e0 tx=0x7f1a8c015000).stop 2024-01-21T19:59:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 shutdown_connections 2024-01-21T19:59:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a8405f150 0x7f1a84061610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a981546b0 0x7f1a980be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a980a9e30 0x7f1a980c0290 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 --2- 172.21.15.133:0/2324463343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a980bc6d0 0x7f1a98140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 >> 172.21.15.133:0/2324463343 conn(0x7f1a980c8200 msgr2=0x7f1a981518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 shutdown_connections 2024-01-21T19:59:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.623+0000 7f1a9dc1d700 1 -- 172.21.15.133:0/2324463343 wait complete. 2024-01-21T19:59:34.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:34.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.755+0000 7fdc2e2d5700 1 Processor -- start 2024-01-21T19:59:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.755+0000 7fdc2e2d5700 1 -- start start 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2e2d5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc280acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2e2d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc281521e0 0x7fdc281525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2e2d5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc28065fd0 con 0x7fdc28066460 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2e2d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc28063be0 con 0x7fdc281521e0 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2e2d5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280653c0 con 0x7fdc280acbc0 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2c872700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc281521e0 0x7fdc281525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2c872700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc281521e0 0x7fdc281525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42010/0 (socket says 172.21.15.133:42010) 2024-01-21T19:59:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc2c872700 1 -- 172.21.15.133:0/3025194303 learned_addr learned my addr 172.21.15.133:0/3025194303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.756+0000 7fdc27fff700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc280acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2c872700 1 -- 172.21.15.133:0/3025194303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 msgr2=0x7fdc280acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2c872700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc280acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2c872700 1 -- 172.21.15.133:0/3025194303 >> v1:172.21.15.178:6789/0 conn(0x7fdc28066460 legacy=0x7fdc280634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2c872700 1 -- 172.21.15.133:0/3025194303 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280656a0 con 0x7fdc281521e0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2c872700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281521e0 0x7fdc281525f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdc20009f20 tx=0x7fdc20009840).ready entity=mon.0 client_cookie=c767f8cdd86270ee server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc26ffd700 1 -- 172.21.15.133:0/3025194303 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000e070 con 0x7fdc281521e0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc26ffd700 1 -- 172.21.15.133:0/3025194303 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2000b9d0 con 0x7fdc281521e0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc26ffd700 1 -- 172.21.15.133:0/3025194303 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2000bd50 con 0x7fdc281521e0 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/3025194303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281521e0 msgr2=0x7fdc281525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281521e0 0x7fdc281525f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdc20009f20 tx=0x7fdc20009840).stop 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/3025194303 shutdown_connections 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc281521e0 0x7fdc281525f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/3025194303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc280acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/3025194303 >> 172.21.15.133:0/3025194303 conn(0x7fdc280c8200 msgr2=0x7fdc280c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/3025194303 shutdown_connections 2024-01-21T19:59:34.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.757+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/3025194303 wait complete. 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 Processor -- start 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 -- start start 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc2814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc281521e0 0x7fdc28068f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28154260 con 0x7fdc28066460 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.759+0000 7fdc2e2d5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280c16f0 con 0x7fdc281521e0 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc2e2d5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280aa7f0 con 0x7fdc280acbc0 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42016/0 (socket says 172.21.15.133:42016) 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 -- 172.21.15.133:0/1094536617 learned_addr learned my addr 172.21.15.133:0/1094536617 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc2c872700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc281521e0 0x7fdc28068f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc277fe700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc2814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 -- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 msgr2=0x7fdc2814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc2814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 -- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc281521e0 msgr2=0x7fdc28068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc281521e0 0x7fdc28068f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 -- 172.21.15.133:0/1094536617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc20009ae0 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc27fff700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdc1c00e930 tx=0x7fdc1c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c012600 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c012760 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc28152de0 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c012ae0 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.760+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc28152790 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.761+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc280ad300 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.762+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdc1c01b400 con 0x7fdc28066460 2024-01-21T19:59:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.762+0000 7fdc24f74700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 0x7fdc14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.762+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc1c07a640 con 0x7fdc28066460 2024-01-21T19:59:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.762+0000 7fdc277fe700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 0x7fdc14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.762+0000 7fdc277fe700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 0x7fdc14061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdc280ac480 tx=0x7fdc18007d40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.766+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc1c04b8b0 con 0x7fdc28066460 2024-01-21T19:59:34.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.929+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdc2805fdf0 con 0x7fdc28066460 2024-01-21T19:59:34.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.929+0000 7fdc24f74700 1 -- 172.21.15.133:0/1094536617 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdc1c04eed0 con 0x7fdc28066460 2024-01-21T19:59:34.921 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:34.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 msgr2=0x7fdc14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 0x7fdc14061610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fdc280ac480 tx=0x7fdc18007d40).stop 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 msgr2=0x7fdc280c01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fdc1c00e930 tx=0x7fdc1c009060).stop 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 shutdown_connections 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc1405f150 0x7fdc14061610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc281521e0 0x7fdc28068f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc28066460 0x7fdc280c01b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 --2- 172.21.15.133:0/1094536617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc280acbc0 0x7fdc2814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 >> 172.21.15.133:0/1094536617 conn(0x7fdc280c8200 msgr2=0x7fdc28063460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 shutdown_connections 2024-01-21T19:59:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:34.931+0000 7fdc2e2d5700 1 -- 172.21.15.133:0/1094536617 wait complete. 2024-01-21T19:59:34.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:35.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.062+0000 7fbb7f801700 1 Processor -- start 2024-01-21T19:59:35.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.062+0000 7fbb7f801700 1 -- start start 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.063+0000 7fbb7f801700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.063+0000 7fbb7f801700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbb780c6220 0x7fbb780bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.063+0000 7fbb7f801700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb78067f10 con 0x7fbb780c5dc0 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.063+0000 7fbb7f801700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780681f0 con 0x7fbb780c6220 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.063+0000 7fbb7f801700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb780684d0 con 0x7fbb780c3840 2024-01-21T19:59:35.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7d59d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbb780c6220 0x7fbb780bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7d59d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:37692/0 (socket says 172.21.15.133:37692) 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7d59d700 1 -- 172.21.15.133:0/4036991593 learned_addr learned my addr 172.21.15.133:0/4036991593 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7cd9c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbb780c5dc0 0x7fbb7813a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:44788/0 (socket says 172.21.15.133:44788) 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 -- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 msgr2=0x7fbb780c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 -- 172.21.15.133:0/4036991593 >> v1:172.21.15.178:6789/0 conn(0x7fbb780c5dc0 legacy=0x7fbb7813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 -- 172.21.15.133:0/4036991593 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb780687b0 con 0x7fbb780c6220 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb6ffff700 1 -- 172.21.15.133:0/4036991593 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761115793 0 0) 0x7fbb78067f10 con 0x7fbb780c5dc0 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7d59d700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb7dd9e700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780bdf60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbb70009e60 tx=0x7fbb70009780).ready entity=mon.1 client_cookie=2a97f7799391649c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb6ffff700 1 -- 172.21.15.133:0/4036991593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000e070 con 0x7fbb780c6220 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb6ffff700 1 -- 172.21.15.133:0/4036991593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7000bb60 con 0x7fbb780c6220 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.064+0000 7fbb6ffff700 1 -- 172.21.15.133:0/4036991593 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70012410 con 0x7fbb780c6220 2024-01-21T19:59:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 -- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 msgr2=0x7fbb780bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780bdf60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbb70009e60 tx=0x7fbb70009780).stop 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 -- 172.21.15.133:0/4036991593 shutdown_connections 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780bdf60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 --2- 172.21.15.133:0/4036991593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb780c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 -- 172.21.15.133:0/4036991593 >> 172.21.15.133:0/4036991593 conn(0x7fbb78066a70 msgr2=0x7fbb78066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 -- 172.21.15.133:0/4036991593 shutdown_connections 2024-01-21T19:59:35.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.065+0000 7fbb7f801700 1 -- 172.21.15.133:0/4036991593 wait complete. 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.066+0000 7fbb7f801700 1 Processor -- start 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.066+0000 7fbb7f801700 1 -- start start 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb781392a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78138e10 con 0x7fbb780c5dc0 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78138200 con 0x7fbb780c6220 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7f801700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb781384e0 con 0x7fbb780c3840 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7cd9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7cd9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42018/0 (socket says 172.21.15.133:42018) 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7cd9c700 1 -- 172.21.15.133:0/2754282794 learned_addr learned my addr 172.21.15.133:0/2754282794 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7dd9e700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.067+0000 7fbb7d59d700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb781392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 -- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 msgr2=0x7fbb781392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb781392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 -- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 msgr2=0x7fbb780ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 -- 172.21.15.133:0/2754282794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68009370 con 0x7fbb780c5dc0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7cd9c700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fbb7400c4e0 tx=0x7fbb74007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7400ce50 con 0x7fbb780c5dc0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb740072e0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740056e0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb70009a20 con 0x7fbb780c5dc0 2024-01-21T19:59:35.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.068+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78138aa0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.069+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb78139790 con 0x7fbb780c5dc0 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.069+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbb74005ad0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.069+0000 7fbb6dffb700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 0x7fbb5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.070+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbb740798a0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.070+0000 7fbb7d59d700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 0x7fbb5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.070+0000 7fbb7d59d700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 0x7fbb5c061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fbb68006fd0 tx=0x7fbb680090f0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.074+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbb7404ab70 con 0x7fbb780c5dc0 2024-01-21T19:59:35.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.236+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb7805fdf0 con 0x7fbb780c5dc0 2024-01-21T19:59:35.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.237+0000 7fbb6dffb700 1 -- 172.21.15.133:0/2754282794 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb7404e190 con 0x7fbb780c5dc0 2024-01-21T19:59:35.228 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 msgr2=0x7fbb5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 0x7fbb5c061610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fbb68006fd0 tx=0x7fbb680090f0).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 msgr2=0x7fbb780ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fbb7400c4e0 tx=0x7fbb74007c60).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 shutdown_connections 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbb5c05f150 0x7fbb5c061610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb780c6220 0x7fbb780ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb780c3840 0x7fbb781392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 --2- 172.21.15.133:0/2754282794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb780c5dc0 0x7fbb780ae410 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 >> 172.21.15.133:0/2754282794 conn(0x7fbb78066a70 msgr2=0x7fbb78135f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 shutdown_connections 2024-01-21T19:59:35.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.238+0000 7fbb7f801700 1 -- 172.21.15.133:0/2754282794 wait complete. 2024-01-21T19:59:35.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.368+0000 7f5133cbb700 1 Processor -- start 2024-01-21T19:59:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 -- start start 2024-01-21T19:59:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f512c0c5dc0 0x7f512c13a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f512c0c6220 0x7f512c13a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c13aed0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c067f10 con 0x7f512c0c6220 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.369+0000 7f5133cbb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0681f0 con 0x7f512c0c3840 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f512c0c5dc0 0x7f512c13a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f512c0c5dc0 0x7f512c13a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42032/0 (socket says 172.21.15.133:42032) 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 -- 172.21.15.133:0/3414365298 learned_addr learned my addr 172.21.15.133:0/3414365298 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131a57700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 -- 172.21.15.133:0/3414365298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 msgr2=0x7f512c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 -- 172.21.15.133:0/3414365298 >> v2:172.21.15.178:3300/0 conn(0x7f512c0c6220 msgr2=0x7f512c13a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5132258700 1 --2- 172.21.15.133:0/3414365298 >> v2:172.21.15.178:3300/0 conn(0x7f512c0c6220 0x7f512c13a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 --2- 172.21.15.133:0/3414365298 >> v2:172.21.15.178:3300/0 conn(0x7f512c0c6220 0x7f512c13a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 -- 172.21.15.133:0/3414365298 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0684d0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5131256700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13a4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f512c0c69f0 tx=0x7f51280090f0).ready entity=mon.0 client_cookie=1fac38b8c8cf729e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5130a55700 1 -- 172.21.15.133:0/3414365298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800b600 con 0x7f512c0c5dc0 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5130a55700 1 -- 172.21.15.133:0/3414365298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800b760 con 0x7f512c0c5dc0 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.370+0000 7f5130a55700 1 -- 172.21.15.133:0/3414365298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800bb00 con 0x7f512c0c5dc0 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 -- 172.21.15.133:0/3414365298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 msgr2=0x7f512c13a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13a4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f512c0c69f0 tx=0x7f51280090f0).stop 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 -- 172.21.15.133:0/3414365298 shutdown_connections 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 --2- 172.21.15.133:0/3414365298 >> v2:172.21.15.178:3300/0 conn(0x7f512c0c6220 0x7f512c13a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 --2- 172.21.15.133:0/3414365298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13a4f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 -- 172.21.15.133:0/3414365298 >> 172.21.15.133:0/3414365298 conn(0x7f512c066a70 msgr2=0x7f512c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 -- 172.21.15.133:0/3414365298 shutdown_connections 2024-01-21T19:59:35.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.371+0000 7f5133cbb700 1 -- 172.21.15.133:0/3414365298 wait complete. 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.372+0000 7f5133cbb700 1 Processor -- start 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.372+0000 7f5133cbb700 1 -- start start 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c1358a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 0x7f512c066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c13c960 con 0x7f512c0c5dc0 2024-01-21T19:59:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c13cc40 con 0x7f512c0c6220 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c13cf20 con 0x7f512c0c3840 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42046/0 (socket says 172.21.15.133:42046) 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 -- 172.21.15.133:0/2285801677 learned_addr learned my addr 172.21.15.133:0/2285801677 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 -- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 msgr2=0x7f512c1358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c1358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 -- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 msgr2=0x7f512c066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5132258700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 0x7f512c066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 0x7f512c066e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 -- 172.21.15.133:0/2285801677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128009370 con 0x7f512c0c5dc0 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5132258700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 0x7f512c066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5131256700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f512c065f70 tx=0x7f5128017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800b8d0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800ba30 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c13d200 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.373+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512801c670 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.374+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c135d90 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.374+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c05fdf0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.375+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f512801ca60 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.375+0000 7f51227fc700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 0x7f51100615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.375+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f512807bed0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.375+0000 7f5131a57700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 0x7f51100615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.376+0000 7f5131a57700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 0x7f51100615e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f511c00a7e0 tx=0x7f511c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.379+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f512804d1a0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.541+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f512c0687b0 con 0x7f512c0c5dc0 2024-01-21T19:59:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.541+0000 7f51227fc700 1 -- 172.21.15.133:0/2285801677 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f512802a020 con 0x7f512c0c5dc0 2024-01-21T19:59:35.533 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 msgr2=0x7f51100615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 0x7f51100615e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f511c00a7e0 tx=0x7f511c008040).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 msgr2=0x7f512c13bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f512c065f70 tx=0x7f5128017000).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 shutdown_connections 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f511005f120 0x7f51100615e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c0c6220 0x7f512c066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0c3840 0x7f512c1358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 --2- 172.21.15.133:0/2285801677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f512c0c5dc0 0x7f512c13bf10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 >> 172.21.15.133:0/2285801677 conn(0x7f512c066a70 msgr2=0x7f512c0bf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 shutdown_connections 2024-01-21T19:59:35.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.543+0000 7f5133cbb700 1 -- 172.21.15.133:0/2285801677 wait complete. 2024-01-21T19:59:35.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.673+0000 7faf8900b700 1 Processor -- start 2024-01-21T19:59:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.673+0000 7faf8900b700 1 -- start start 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8900b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf840c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8900b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf840c6220 0x7faf840bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8900b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf84067f10 con 0x7faf840c5dc0 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8900b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840681f0 con 0x7faf840c6220 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8900b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840684d0 con 0x7faf840c3840 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faf840c5dc0 0x7faf8413a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38506/0 (socket says 172.21.15.133:38506) 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8259c700 1 -- 172.21.15.133:0/2546638787 learned_addr learned my addr 172.21.15.133:0/2546638787 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541304945 0 0) 0x7faf84067f10 con 0x7faf840c5dc0 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf8359e700 1 --2- 172.21.15.133:0/2546638787 >> v2:172.21.15.178:3300/0 conn(0x7faf840c6220 0x7faf840bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf82d9d700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf840c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.674+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf6c0033f0 con 0x7faf840c5dc0 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663953410 0 0) 0x7faf6c0033f0 con 0x7faf840c5dc0 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 msgr2=0x7faf840c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf840c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 >> v2:172.21.15.178:3300/0 conn(0x7faf840c6220 msgr2=0x7faf840bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 --2- 172.21.15.133:0/2546638787 >> v2:172.21.15.178:3300/0 conn(0x7faf840c6220 0x7faf840bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840687b0 con 0x7faf840c5dc0 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7faf74001470 con 0x7faf840c5dc0 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 >> v1:172.21.15.133:6789/0 conn(0x7faf840c5dc0 legacy=0x7faf8413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf6c0038e0 0x7faf6c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6c004690 0x7faf6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840681f0 con 0x7faf6c0038e0 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840684d0 con 0x7faf6c004690 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c00b8e0 con 0x7faf840c3840 2024-01-21T19:59:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf6c0038e0 0x7faf6c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf8259c700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6c004690 0x7faf6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf8359e700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 -- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 msgr2=0x7faf6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf840c3840 0x7faf6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 -- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6c004690 msgr2=0x7faf6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6c004690 0x7faf6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 -- 172.21.15.133:0/2546638787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c0033f0 con 0x7faf6c0038e0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf82d9d700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf6c0038e0 0x7faf6c003d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7faf78009a80 tx=0x7faf78009060).ready entity=mon.0 client_cookie=2d2742f0a49b1ca2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78009430 con 0x7faf6c0038e0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800e640 con 0x7faf6c0038e0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.675+0000 7faf81d9b700 1 -- 172.21.15.133:0/2546638787 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800e9c0 con 0x7faf6c0038e0 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 -- 172.21.15.133:0/2546638787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf6c0038e0 msgr2=0x7faf6c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 --2- 172.21.15.133:0/2546638787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf6c0038e0 0x7faf6c003d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7faf78009a80 tx=0x7faf78009060).stop 2024-01-21T19:59:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8359e700 1 -- 172.21.15.133:0/2546638787 reap_dead start 2024-01-21T19:59:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 -- 172.21.15.133:0/2546638787 shutdown_connections 2024-01-21T19:59:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 -- 172.21.15.133:0/2546638787 >> 172.21.15.133:0/2546638787 conn(0x7faf84066a70 msgr2=0x7faf84066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 -- 172.21.15.133:0/2546638787 shutdown_connections 2024-01-21T19:59:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.676+0000 7faf8900b700 1 -- 172.21.15.133:0/2546638787 wait complete. 2024-01-21T19:59:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.677+0000 7faf8900b700 1 Processor -- start 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.677+0000 7faf8900b700 1 -- start start 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf6c0038e0 0x7faf84165410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf840c13b0 0x7faf841571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84165900 con 0x7faf840c1dd0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c2720 con 0x7faf840c13b0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8900b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf84157690 con 0x7faf6c0038e0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42064/0 (socket says 172.21.15.133:42064) 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.678+0000 7faf8359e700 1 -- 172.21.15.133:0/1929916997 learned_addr learned my addr 172.21.15.133:0/1929916997 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf82d9d700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf6c0038e0 0x7faf84165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8259c700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf840c13b0 0x7faf841571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 -- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf6c0038e0 msgr2=0x7faf84165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf6c0038e0 0x7faf84165410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 -- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf840c13b0 msgr2=0x7faf841571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf840c13b0 0x7faf841571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 -- 172.21.15.133:0/1929916997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840c0310 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8359e700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7faf8406c3c0 tx=0x7faf7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00e070 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c011c30 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840c05f0 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c016450 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.679+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840c0bb0 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.680+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8405fdf0 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.680+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faf7c016800 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.681+0000 7faf6b7fe700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 0x7faf70061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.681+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faf7c07a6a0 con 0x7faf840c1dd0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.681+0000 7faf82d9d700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 0x7faf70061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.681+0000 7faf82d9d700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 0x7faf70061640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7faf78009a80 tx=0x7faf7801a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.685+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faf7c04b9c0 con 0x7faf840c1dd0 2024-01-21T19:59:35.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.846+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf84068ec0 con 0x7faf840c1dd0 2024-01-21T19:59:35.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.847+0000 7faf6b7fe700 1 -- 172.21.15.133:0/1929916997 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf7c04efe0 con 0x7faf840c1dd0 2024-01-21T19:59:35.838 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:35.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 msgr2=0x7faf70061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 0x7faf70061640 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7faf78009a80 tx=0x7faf7801a000).stop 2024-01-21T19:59:35.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 msgr2=0x7faf840c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7faf8406c3c0 tx=0x7faf7c00b040).stop 2024-01-21T19:59:35.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 shutdown_connections 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faf7005f180 0x7faf70061640 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf840c1dd0 0x7faf840c2230 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf6c0038e0 0x7faf84165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 --2- 172.21.15.133:0/1929916997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf840c13b0 0x7faf841571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 >> 172.21.15.133:0/1929916997 conn(0x7faf84066a70 msgr2=0x7faf84152550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 shutdown_connections 2024-01-21T19:59:35.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.849+0000 7faf8900b700 1 -- 172.21.15.133:0/1929916997 wait complete. 2024-01-21T19:59:35.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.977+0000 7f7006ce3700 1 Processor -- start 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.977+0000 7f7006ce3700 1 -- start start 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.977+0000 7f7006ce3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f7000154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7006ce3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000654f0 con 0x7f70000a9e30 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7006ce3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7000063700 con 0x7f70000bc6d0 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7006ce3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7000063950 con 0x7f70001546b0 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6ffffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f70000a9e30 0x7f7000065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38514/0 (socket says 172.21.15.133:38514) 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6ffffff700 1 -- 172.21.15.133:0/1057937450 learned_addr learned my addr 172.21.15.133:0/1057937450 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7004a7f700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f7000154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480871614 0 0) 0x7f70000654f0 con 0x7f70000a9e30 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff00033f0 con 0x7f70000a9e30 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903584040 0 0) 0x7f7000063700 con 0x7f70000bc6d0 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70000654f0 con 0x7f70000bc6d0 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3081691289 0 0) 0x7f6ff00033f0 con 0x7f70000a9e30 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 msgr2=0x7f7000154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f7000154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 >> v1:172.21.15.178:6789/0 conn(0x7f70000bc6d0 legacy=0x7f7000066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000065180 con 0x7f70000a9e30 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f6fec001470 con 0x7f70000a9e30 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7004a7f700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f7000154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 >> v1:172.21.15.133:6789/0 conn(0x7f70000a9e30 legacy=0x7f7000065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f6ff0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff0003f90 0x7f6ff0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ff0004b80 0x7f6ff0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000063950 con 0x7f6ff0004b80 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000b9f0 con 0x7f6ff0003f90 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff000bbb0 con 0x7f70001546b0 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7005280700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ff0004b80 0x7f6ff0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f7004a7f700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f6ff0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.978+0000 7f6ffffff700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff0003f90 0x7f6ff0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 -- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 msgr2=0x7f6ff0003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70001546b0 0x7f6ff0003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 -- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff0003f90 msgr2=0x7f6ff0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff0003f90 0x7f6ff0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 -- 172.21.15.133:0/1057937450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40092a0 con 0x7f6ff0004b80 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ff0004b80 0x7f6ff0005000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f6ff8001f60 tx=0x7f6ff8007f30).ready entity=mon.0 client_cookie=36682f848a6f44e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff80020c0 con 0x7f6ff0004b80 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8006a20 con 0x7f6ff0004b80 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f6fff7fe700 1 -- 172.21.15.133:0/1057937450 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8006de0 con 0x7f6ff0004b80 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 -- 172.21.15.133:0/1057937450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ff0004b80 msgr2=0x7f6ff0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 --2- 172.21.15.133:0/1057937450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ff0004b80 0x7f6ff0005000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f6ff8001f60 tx=0x7f6ff8007f30).stop 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7005280700 1 -- 172.21.15.133:0/1057937450 reap_dead start 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 -- 172.21.15.133:0/1057937450 shutdown_connections 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 -- 172.21.15.133:0/1057937450 >> 172.21.15.133:0/1057937450 conn(0x7f70000c8200 msgr2=0x7f70000c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 -- 172.21.15.133:0/1057937450 shutdown_connections 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.979+0000 7f7006ce3700 1 -- 172.21.15.133:0/1057937450 wait complete. 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.981+0000 7f7006ce3700 1 Processor -- start 2024-01-21T19:59:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.981+0000 7f7006ce3700 1 -- start start 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70000a7930 0x7f70000a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7000143f70 0x7f70001443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000ab260 con 0x7f70000a7d10 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001448c0 con 0x7f7000143f70 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7000164cf0 con 0x7f70000a7930 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42082/0 (socket says 172.21.15.133:42082) 2024-01-21T19:59:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 -- 172.21.15.133:0/410099251 learned_addr learned my addr 172.21.15.133:0/410099251 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7004a7f700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70000a7930 0x7f70000a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7005280700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7000143f70 0x7f70001443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 -- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70000a7930 msgr2=0x7f70000a51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70000a7930 0x7f70000a51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 -- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7000143f70 msgr2=0x7f70001443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7000143f70 0x7f70001443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 -- 172.21.15.133:0/410099251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000a69b0 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffffff700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f6fec007790 tx=0x7f6fec001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011590 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec011710 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000a6c90 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011ad0 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.982+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000aaef0 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.983+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7000065880 con 0x7f70000a7d10 2024-01-21T19:59:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.984+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6fec01d3b0 con 0x7f70000a7d10 2024-01-21T19:59:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.984+0000 7f6ffd7fa700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 0x7f6fe4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.984+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6fec079a80 con 0x7f70000a7d10 2024-01-21T19:59:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.984+0000 7f7004a7f700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 0x7f6fe4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.984+0000 7f7004a7f700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 0x7f6fe4061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6ff4009270 tx=0x7f6ff4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:35.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:35.988+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fec04acf0 con 0x7f70000a7d10 2024-01-21T19:59:36.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.156+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f700005fdf0 con 0x7f70000a7d10 2024-01-21T19:59:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.157+0000 7f6ffd7fa700 1 -- 172.21.15.133:0/410099251 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f6fec019020 con 0x7f70000a7d10 2024-01-21T19:59:36.149 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:36.149 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 msgr2=0x7f6fe4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 0x7f6fe4061610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6ff4009270 tx=0x7f6ff4009060).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 msgr2=0x7f70000a6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f6fec007790 tx=0x7f6fec001df0).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 shutdown_connections 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6fe405f150 0x7f6fe4061610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7000143f70 0x7f70001443d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70000a7930 0x7f70000a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 --2- 172.21.15.133:0/410099251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70000a7d10 0x7f70000a6140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 >> 172.21.15.133:0/410099251 conn(0x7f70000c8200 msgr2=0x7f70000c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 shutdown_connections 2024-01-21T19:59:36.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.159+0000 7f7006ce3700 1 -- 172.21.15.133:0/410099251 wait complete. 2024-01-21T19:59:36.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:36.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:36.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.291+0000 7f15b9c53700 1 Processor -- start 2024-01-21T19:59:36.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.291+0000 7f15b9c53700 1 -- start start 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b9c53700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15b4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b9c53700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b4065660 con 0x7f15b40beb30 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b9c53700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b4065f00 con 0x7f15b40c3fb0 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b9c53700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40bef10 con 0x7f15b4069ef0 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15b40beb30 0x7f15b40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38520/0 (socket says 172.21.15.133:38520) 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b37fe700 1 -- 172.21.15.133:0/1577578305 learned_addr learned my addr 172.21.15.133:0/1577578305 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:36.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513255549 0 0) 0x7f15b4065660 con 0x7f15b40beb30 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a00033f0 con 0x7f15b40beb30 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.292+0000 7f15b2ffd700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15b4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1552101261 0 0) 0x7f15a00033f0 con 0x7f15b40beb30 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 msgr2=0x7f15b4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15b4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 >> v1:172.21.15.178:6789/0 conn(0x7f15b40c3fb0 legacy=0x7f15b4066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40c4740 con 0x7f15b40beb30 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f159c001470 con 0x7f15b40beb30 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 >> v1:172.21.15.133:6789/0 conn(0x7f15b40beb30 legacy=0x7f15b40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a0003910 0x7f15a0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0004690 0x7f15a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15a00050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40bef10 con 0x7f15a0003910 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a000b9c0 con 0x7f15a0004690 2024-01-21T19:59:36.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a000dd90 con 0x7f15b4069ef0 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a0003910 0x7f15a0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b2ffd700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0004690 0x7f15a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b3fff700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15a00050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 -- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 msgr2=0x7f15a00050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15a00050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 -- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0004690 msgr2=0x7f15a0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0004690 0x7f15a0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 -- 172.21.15.133:0/1577578305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a00033f0 con 0x7f15a0003910 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b3fff700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4069ef0 0x7f15a00050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a0003910 0x7f15a0003d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f159c00c190 tx=0x7f159c001e50).ready entity=mon.0 client_cookie=278424050aa1a447 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c007a20 con 0x7f15a0003910 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00cac0 con 0x7f15a0003910 2024-01-21T19:59:36.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.293+0000 7f15b27fc700 1 -- 172.21.15.133:0/1577578305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00ce40 con 0x7f15a0003910 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 -- 172.21.15.133:0/1577578305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a0003910 msgr2=0x7f15a0003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1577578305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15a0003910 0x7f15a0003d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f159c00c190 tx=0x7f159c001e50).stop 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b3fff700 1 -- 172.21.15.133:0/1577578305 reap_dead start 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 -- 172.21.15.133:0/1577578305 shutdown_connections 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 -- 172.21.15.133:0/1577578305 >> 172.21.15.133:0/1577578305 conn(0x7f15b40c8010 msgr2=0x7f15b40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 -- 172.21.15.133:0/1577578305 shutdown_connections 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.294+0000 7f15b9c53700 1 -- 172.21.15.133:0/1577578305 wait complete. 2024-01-21T19:59:36.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.295+0000 7f15b9c53700 1 Processor -- start 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.295+0000 7f15b9c53700 1 -- start start 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 0x7f15b4161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4161b80 0x7f15b40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4153990 con 0x7f15b40add80 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4152d80 con 0x7f15a0003910 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b9c53700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4153060 con 0x7f15b4161b80 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42100/0 (socket says 172.21.15.133:42100) 2024-01-21T19:59:36.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.296+0000 7f15b3fff700 1 -- 172.21.15.133:0/1319736539 learned_addr learned my addr 172.21.15.133:0/1319736539 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b2ffd700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4161b80 0x7f15b40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 0x7f15b4161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 -- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4161b80 msgr2=0x7f15b40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4161b80 0x7f15b40ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 -- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 msgr2=0x7f15b4161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 0x7f15b4161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 -- 172.21.15.133:0/1319736539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4153340 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 0x7f15b4161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b3fff700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f15ac000f80 tx=0x7f15ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac010520 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac010680 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4153620 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac010a20 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.297+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4161270 con 0x7f15b40add80 2024-01-21T19:59:36.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.298+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4153b40 con 0x7f15b40add80 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.298+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f15ac003070 con 0x7f15b40add80 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.298+0000 7f15abfff700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.299+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f15ac079d40 con 0x7f15b40add80 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.299+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.299+0000 7f15b37fe700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 0x7f1594061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f159c001e90 tx=0x7f159c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.302+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f15b4153b40 con 0x7f15b40add80 2024-01-21T19:59:36.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.467+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f15b4153ad0 con 0x7f15b40add80 2024-01-21T19:59:36.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.468+0000 7f15abfff700 1 -- 172.21.15.133:0/1319736539 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f15ac04b010 con 0x7f15b40add80 2024-01-21T19:59:36.459 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 msgr2=0x7f1594061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 0x7f1594061610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f159c001e90 tx=0x7f159c015000).stop 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 msgr2=0x7f15b4153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f15ac000f80 tx=0x7f15ac009040).stop 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 shutdown_connections 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f159405f150 0x7f1594061610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b40add80 0x7f15b4153e20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15a0003910 0x7f15b4161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 --2- 172.21.15.133:0/1319736539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15b4161b80 0x7f15b40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.469+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 >> 172.21.15.133:0/1319736539 conn(0x7f15b40c8010 msgr2=0x7f15b40c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.470+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 shutdown_connections 2024-01-21T19:59:36.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.470+0000 7f15b9c53700 1 -- 172.21.15.133:0/1319736539 wait complete. 2024-01-21T19:59:36.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:36.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.601+0000 7f2860045700 1 Processor -- start 2024-01-21T19:59:36.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.601+0000 7f2860045700 1 -- start start 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f2860045700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f285813ac00 0x7f285815f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f2860045700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580c64d0 con 0x7f28580c3840 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f2860045700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2858067f10 con 0x7f28580c3c20 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f2860045700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580681f0 con 0x7f285813ac00 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f285dde1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28580c3840 0x7f28580c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38522/0 (socket says 172.21.15.133:38522) 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.602+0000 7f285dde1700 1 -- 172.21.15.133:0/278410120 learned_addr learned my addr 172.21.15.133:0/278410120 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681435290 0 0) 0x7f2848001110 con 0x7f28580c3840 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28440033f0 con 0x7f28580c3840 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285e5e2700 1 --2- 172.21.15.133:0/278410120 >> v2:172.21.15.178:3300/0 conn(0x7f285813ac00 0x7f285815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290576109 0 0) 0x7f28440033f0 con 0x7f28580c3840 2024-01-21T19:59:36.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 >> v2:172.21.15.178:3300/0 conn(0x7f285813ac00 msgr2=0x7f285815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 --2- 172.21.15.133:0/278410120 >> v2:172.21.15.178:3300/0 conn(0x7f285813ac00 0x7f285815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 >> v1:172.21.15.178:6789/0 conn(0x7f28580c3c20 legacy=0x7f285813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580684d0 con 0x7f28580c3840 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f2848001600 con 0x7f28580c3840 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 >> v1:172.21.15.133:6789/0 conn(0x7f28580c3840 legacy=0x7f28580c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28440038e0 0x7f2844003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f2844004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2844005050 0x7f284400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580681f0 con 0x7f2844004690 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284400bfe0 con 0x7f2844005050 2024-01-21T19:59:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284400c1a0 con 0x7f28440038e0 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f2844004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285e5e2700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2844005050 0x7f284400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285dde1700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28440038e0 0x7f2844003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 -- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28440038e0 msgr2=0x7f2844003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28440038e0 0x7f2844003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 -- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2844005050 msgr2=0x7f284400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2844005050 0x7f284400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285e5e2700 1 -- 172.21.15.133:0/278410120 reap_dead start 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.603+0000 7f285d5e0700 1 -- 172.21.15.133:0/278410120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440033f0 con 0x7f2844004690 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f285d5e0700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f2844004b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f2854001700 tx=0x7f2854007bb0).ready entity=mon.0 client_cookie=ac9b7d9af63b5e0c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854007020 con 0x7f2844004690 2024-01-21T19:59:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854007180 con 0x7f2844004690 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f285cddf700 1 -- 172.21.15.133:0/278410120 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854007540 con 0x7f2844004690 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 -- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 msgr2=0x7f2844004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f2844004b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f2854001700 tx=0x7f2854007bb0).stop 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 -- 172.21.15.133:0/278410120 shutdown_connections 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 --2- 172.21.15.133:0/278410120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f2844004b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 -- 172.21.15.133:0/278410120 >> 172.21.15.133:0/278410120 conn(0x7f2858066a70 msgr2=0x7f2858066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 -- 172.21.15.133:0/278410120 shutdown_connections 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.604+0000 7f2860045700 1 -- 172.21.15.133:0/278410120 wait complete. 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.605+0000 7f2860045700 1 Processor -- start 2024-01-21T19:59:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 -- start start 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28580adab0 0x7f2858153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2858064a50 0x7f2858064ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581582c0 con 0x7f2844004690 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580653c0 con 0x7f2858064a50 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f2860045700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580ae290 con 0x7f28580adab0 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f285dde1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f285dde1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42118/0 (socket says 172.21.15.133:42118) 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.606+0000 7f285dde1700 1 -- 172.21.15.133:0/4013442172 learned_addr learned my addr 172.21.15.133:0/4013442172 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285d5e0700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28580adab0 0x7f2858153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285e5e2700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2858064a50 0x7f2858064ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 -- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28580adab0 msgr2=0x7f2858153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28580adab0 0x7f2858153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 -- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2858064a50 msgr2=0x7f2858064ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2858064a50 0x7f2858064ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 -- 172.21.15.133:0/4013442172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580ae570 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f285dde1700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f28480047b0 tx=0x7f28480078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011590 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28480116f0 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28580ae850 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011a90 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.607+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28580adf30 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.608+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285805fdf0 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.608+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f284801d3b0 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.609+0000 7f284e7fc700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 0x7f283c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.609+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2848079a40 con 0x7f2844004690 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.609+0000 7f285d5e0700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 0x7f283c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.609+0000 7f285d5e0700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 0x7f283c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2858139f90 tx=0x7f2854016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.613+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f284807be60 con 0x7f2844004690 2024-01-21T19:59:36.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.777+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28580c64d0 con 0x7f2844004690 2024-01-21T19:59:36.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.777+0000 7f284e7fc700 1 -- 172.21.15.133:0/4013442172 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f28580c64d0 con 0x7f2844004690 2024-01-21T19:59:36.769 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 msgr2=0x7f283c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 0x7f283c061610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2858139f90 tx=0x7f2854016000).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 msgr2=0x7f28580ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f28480047b0 tx=0x7f28480078d0).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 shutdown_connections 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f283c05f150 0x7f283c061610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2858064a50 0x7f2858064ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2844004690 0x7f28580ad010 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 --2- 172.21.15.133:0/4013442172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28580adab0 0x7f2858153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 >> 172.21.15.133:0/4013442172 conn(0x7f2858066a70 msgr2=0x7f28580c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 shutdown_connections 2024-01-21T19:59:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.779+0000 7f2860045700 1 -- 172.21.15.133:0/4013442172 wait complete. 2024-01-21T19:59:36.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.911+0000 7fbd34ca8700 1 Processor -- start 2024-01-21T19:59:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.911+0000 7fbd34ca8700 1 -- start start 2024-01-21T19:59:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd34ca8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 0x7fbd300c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd34ca8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd34ca8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd30069ef0 con 0x7fbd3013a830 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd34ca8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd300c3890 con 0x7fbd3013ac10 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd34ca8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd300c3b70 con 0x7fbd300695b0 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2dd9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 0x7fbd300c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:37812/0 (socket says 172.21.15.133:37812) 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 -- 172.21.15.133:0/3003607463 learned_addr learned my addr 172.21.15.133:0/3003607463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 -- 172.21.15.133:0/3003607463 >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 msgr2=0x7fbd300c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 --2- 172.21.15.133:0/3003607463 >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 0x7fbd300c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 -- 172.21.15.133:0/3003607463 >> v1:172.21.15.178:6789/0 conn(0x7fbd3013a830 legacy=0x7fbd300bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2ed9d700 1 -- 172.21.15.133:0/3003607463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd300c3e50 con 0x7fbd300695b0 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2d59a700 1 -- 172.21.15.133:0/3003607463 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144350647 0 0) 0x7fbd30069ef0 con 0x7fbd3013a830 2024-01-21T19:59:36.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.912+0000 7fbd2dd9b700 1 --2- 172.21.15.133:0/3003607463 >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 0x7fbd300c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd2ed9d700 1 --2- 172.21.15.133:0/3003607463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbd2800d1a0 tx=0x7fbd2800ba50).ready entity=mon.2 client_cookie=d0529122782601a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd2d59a700 1 -- 172.21.15.133:0/3003607463 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28010070 con 0x7fbd300695b0 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd2d59a700 1 -- 172.21.15.133:0/3003607463 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2800de10 con 0x7fbd300695b0 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd2d59a700 1 -- 172.21.15.133:0/3003607463 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2800b2e0 con 0x7fbd300695b0 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 -- 172.21.15.133:0/3003607463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 msgr2=0x7fbd30069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/3003607463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fbd2800d1a0 tx=0x7fbd2800ba50).stop 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 -- 172.21.15.133:0/3003607463 shutdown_connections 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/3003607463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300695b0 0x7fbd30069a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/3003607463 >> v2:172.21.15.178:3300/0 conn(0x7fbd3013ac10 0x7fbd300c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 -- 172.21.15.133:0/3003607463 >> 172.21.15.133:0/3003607463 conn(0x7fbd300c7dc0 msgr2=0x7fbd300c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 -- 172.21.15.133:0/3003607463 shutdown_connections 2024-01-21T19:59:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.913+0000 7fbd34ca8700 1 -- 172.21.15.133:0/3003607463 wait complete. 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 Processor -- start 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 -- start start 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd3013a830 0x7fbd301514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd3013ac10 0x7fbd301519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301510a0 con 0x7fbd300695b0 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30151ed0 con 0x7fbd3013a830 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.915+0000 7fbd34ca8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd30154380 con 0x7fbd3013ac10 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42120/0 (socket says 172.21.15.133:42120) 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 -- 172.21.15.133:0/574558836 learned_addr learned my addr 172.21.15.133:0/574558836 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:36.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2dd9b700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd3013a830 0x7fbd301514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2ed9d700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd3013ac10 0x7fbd301519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 -- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd3013ac10 msgr2=0x7fbd301519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd3013ac10 0x7fbd301519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 -- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd3013a830 msgr2=0x7fbd301514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd3013a830 0x7fbd301514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 -- 172.21.15.133:0/574558836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200092a0 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd2e59c700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbd24001eb0 tx=0x7fbd24007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400ce00 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2400f470 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400f830 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2800bcf0 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.916+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd30168a20 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.917+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30158650 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.917+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd2400fbe0 con 0x7fbd300695b0 2024-01-21T19:59:36.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.918+0000 7fbd1effd700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 0x7fbd10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.918+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd24079470 con 0x7fbd300695b0 2024-01-21T19:59:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.918+0000 7fbd2dd9b700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 0x7fbd10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:36.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.918+0000 7fbd2dd9b700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 0x7fbd10061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbd30153380 tx=0x7fbd20009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:36.922+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd24048b00 con 0x7fbd300695b0 2024-01-21T19:59:37.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.086+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd300c4130 con 0x7fbd300695b0 2024-01-21T19:59:37.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.086+0000 7fbd1effd700 1 -- 172.21.15.133:0/574558836 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd2404a7f0 con 0x7fbd300695b0 2024-01-21T19:59:37.079 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 msgr2=0x7fbd10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 0x7fbd10061610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fbd30153380 tx=0x7fbd20009060).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 msgr2=0x7fbd30153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbd24001eb0 tx=0x7fbd24007c70).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 shutdown_connections 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbd1005f150 0x7fbd10061610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd3013ac10 0x7fbd301519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd300695b0 0x7fbd30153e90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 --2- 172.21.15.133:0/574558836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd3013a830 0x7fbd301514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 >> 172.21.15.133:0/574558836 conn(0x7fbd300c7dc0 msgr2=0x7fbd300c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 shutdown_connections 2024-01-21T19:59:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.088+0000 7fbd34ca8700 1 -- 172.21.15.133:0/574558836 wait complete. 2024-01-21T19:59:37.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:37.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.220+0000 7f261dd08700 1 Processor -- start 2024-01-21T19:59:37.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.220+0000 7f261dd08700 1 -- start start 2024-01-21T19:59:37.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f261dd08700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f26180be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f261dd08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26180be5f0 0x7f26180a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f261dd08700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180bfa40 con 0x7f261813b970 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f261dd08700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180bee30 con 0x7f26180be5f0 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f261dd08700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180bf110 con 0x7f26180c3c10 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26180be5f0 0x7f26180a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26180be5f0 0x7f26180a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42126/0 (socket says 172.21.15.133:42126) 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 -- 172.21.15.133:0/2348174693 learned_addr learned my addr 172.21.15.133:0/2348174693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2616ffd700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f26180be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 -- 172.21.15.133:0/2348174693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 msgr2=0x7f26180be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f26180be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 -- 172.21.15.133:0/2348174693 >> v1:172.21.15.178:6789/0 conn(0x7f261813b970 legacy=0x7f26180c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 -- 172.21.15.133:0/2348174693 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180bf3f0 con 0x7f26180be5f0 2024-01-21T19:59:37.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f2617fff700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26180be5f0 0x7f26180a8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2610009f20 tx=0x7f2610009840).ready entity=mon.0 client_cookie=9d4fc293c9a267b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f26167fc700 1 -- 172.21.15.133:0/2348174693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000e070 con 0x7f26180be5f0 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.221+0000 7f26167fc700 1 -- 172.21.15.133:0/2348174693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000ba40 con 0x7f26180be5f0 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f26167fc700 1 -- 172.21.15.133:0/2348174693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000bdc0 con 0x7f26180be5f0 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 -- 172.21.15.133:0/2348174693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26180be5f0 msgr2=0x7f26180a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26180be5f0 0x7f26180a8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2610009f20 tx=0x7f2610009840).stop 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 -- 172.21.15.133:0/2348174693 shutdown_connections 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26180be5f0 0x7f26180a8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 --2- 172.21.15.133:0/2348174693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f26180be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 -- 172.21.15.133:0/2348174693 >> 172.21.15.133:0/2348174693 conn(0x7f2618066a70 msgr2=0x7f2618066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 -- 172.21.15.133:0/2348174693 shutdown_connections 2024-01-21T19:59:37.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.222+0000 7f261dd08700 1 -- 172.21.15.133:0/2348174693 wait complete. 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.223+0000 7f261dd08700 1 Processor -- start 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 -- start start 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26180be5f0 0x7f2618139740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f2618150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180c2f00 con 0x7f261813b970 2024-01-21T19:59:37.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181386a0 con 0x7f26180be5f0 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f261dd08700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618138980 con 0x7f26180c3c10 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.224+0000 7f2617fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42134/0 (socket says 172.21.15.133:42134) 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 -- 172.21.15.133:0/3021991332 learned_addr learned my addr 172.21.15.133:0/3021991332 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2616ffd700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f2618150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f26177fe700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26180be5f0 0x7f2618139740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 -- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 msgr2=0x7f2618150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f2618150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 -- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26180be5f0 msgr2=0x7f2618139740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26180be5f0 0x7f2618139740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 -- 172.21.15.133:0/3021991332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610009ae0 con 0x7f261813b970 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f2617fff700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f261000b6c0 tx=0x7f2610009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610007070 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000bdc0 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261001d6b0 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2618138c60 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.225+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2618139220 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.226+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2618139410 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.227+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2610003040 con 0x7f261813b970 2024-01-21T19:59:37.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.227+0000 7f25fffff700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 0x7f2604061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.227+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f261007bf00 con 0x7f261813b970 2024-01-21T19:59:37.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.227+0000 7f26177fe700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 0x7f2604061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.228+0000 7f26177fe700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 0x7f2604061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f260c007fd0 tx=0x7f260c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.231+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f261004d320 con 0x7f261813b970 2024-01-21T19:59:37.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.394+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f261805fdf0 con 0x7f261813b970 2024-01-21T19:59:37.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.395+0000 7f25fffff700 1 -- 172.21.15.133:0/3021991332 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f261002c070 con 0x7f261813b970 2024-01-21T19:59:37.387 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 msgr2=0x7f2604061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 0x7f2604061610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f260c007fd0 tx=0x7f260c009040).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 msgr2=0x7f2618156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f261000b6c0 tx=0x7f2610009840).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 shutdown_connections 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f260405f150 0x7f2604061610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f261813b970 0x7f2618156b70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26180be5f0 0x7f2618139740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 --2- 172.21.15.133:0/3021991332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26180c3c10 0x7f2618150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 >> 172.21.15.133:0/3021991332 conn(0x7f2618066a70 msgr2=0x7f2618151710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 shutdown_connections 2024-01-21T19:59:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.396+0000 7f261dd08700 1 -- 172.21.15.133:0/3021991332 wait complete. 2024-01-21T19:59:37.401 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.523+0000 7f5a3c639700 1 Processor -- start 2024-01-21T19:59:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.523+0000 7f5a3c639700 1 -- start start 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.524+0000 7f5a3c639700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a34155ca0 0x7f5a340bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.524+0000 7f5a3c639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.524+0000 7f5a3c639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340a50f0 con 0x7f5a341558c0 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.524+0000 7f5a3c639700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a340bdb60 con 0x7f5a34155ca0 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.524+0000 7f5a3c639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340a4da0 con 0x7f5a34062e00 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a3abd6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a34155ca0 0x7f5a340bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a3abd6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:37852/0 (socket says 172.21.15.133:37852) 2024-01-21T19:59:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a3abd6700 1 -- 172.21.15.133:0/1856444628 learned_addr learned my addr 172.21.15.133:0/1856444628 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 -- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 msgr2=0x7f5a340bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 -- 172.21.15.133:0/1856444628 >> v1:172.21.15.178:6789/0 conn(0x7f5a341558c0 legacy=0x7f5a340626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a393d3700 1 -- 172.21.15.133:0/1856444628 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811239709 0 0) 0x7f5a340a50f0 con 0x7f5a341558c0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 -- 172.21.15.133:0/1856444628 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a340bde00 con 0x7f5a34155ca0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a3abd6700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.525+0000 7f5a39bd4700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34155ca0 0x7f5a340bd180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5a28009760 tx=0x7f5a28009060).ready entity=mon.1 client_cookie=e458333723b7af42 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a393d3700 1 -- 172.21.15.133:0/1856444628 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280090d0 con 0x7f5a34155ca0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a393d3700 1 -- 172.21.15.133:0/1856444628 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800f510 con 0x7f5a34155ca0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a393d3700 1 -- 172.21.15.133:0/1856444628 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800f890 con 0x7f5a34155ca0 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 -- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34155ca0 msgr2=0x7f5a340bd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34155ca0 0x7f5a340bd180 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5a28009760 tx=0x7f5a28009060).stop 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 -- 172.21.15.133:0/1856444628 shutdown_connections 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34062e00 0x7f5a340bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 --2- 172.21.15.133:0/1856444628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34155ca0 0x7f5a340bd180 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 -- 172.21.15.133:0/1856444628 >> 172.21.15.133:0/1856444628 conn(0x7f5a340c8010 msgr2=0x7f5a340c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 -- 172.21.15.133:0/1856444628 shutdown_connections 2024-01-21T19:59:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.526+0000 7f5a3c639700 1 -- 172.21.15.133:0/1856444628 wait complete. 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.527+0000 7f5a3c639700 1 Processor -- start 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.527+0000 7f5a3c639700 1 -- start start 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 0x7f5a3414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34155ca0 0x7f5a340c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340c77f0 con 0x7f5a341558c0 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340bf0b0 con 0x7f5a34062e00 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a3c639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340bff10 con 0x7f5a34155ca0 2024-01-21T19:59:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a39bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a39bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42138/0 (socket says 172.21.15.133:42138) 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.528+0000 7f5a39bd4700 1 -- 172.21.15.133:0/3171255038 learned_addr learned my addr 172.21.15.133:0/3171255038 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a3abd6700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34155ca0 0x7f5a340c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a3a3d5700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 0x7f5a3414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 -- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34155ca0 msgr2=0x7f5a340c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34155ca0 0x7f5a340c7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 -- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 msgr2=0x7f5a3414e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 0x7f5a3414e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 -- 172.21.15.133:0/3171255038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009ae0 con 0x7f5a341558c0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a3a3d5700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 0x7f5a3414e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a39bd4700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f5a28009e00 tx=0x7f5a28017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800fc50 con 0x7f5a341558c0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800fdb0 con 0x7f5a341558c0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a280092a0 con 0x7f5a341558c0 2024-01-21T19:59:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2801c650 con 0x7f5a341558c0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.529+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a340bf5e0 con 0x7f5a341558c0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.530+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a340bf770 con 0x7f5a341558c0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.530+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5a2801ca80 con 0x7f5a341558c0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.530+0000 7f5a26ffd700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 0x7f5a18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.531+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5a2807bdc0 con 0x7f5a341558c0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.531+0000 7f5a3a3d5700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 0x7f5a18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.531+0000 7f5a3a3d5700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 0x7f5a18061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5a300011e0 tx=0x7f5a30009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.535+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5a2804d030 con 0x7f5a341558c0 2024-01-21T19:59:37.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.697+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a34065210 con 0x7f5a341558c0 2024-01-21T19:59:37.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.698+0000 7f5a26ffd700 1 -- 172.21.15.133:0/3171255038 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f5a2802a020 con 0x7f5a341558c0 2024-01-21T19:59:37.691 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:37.691 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 msgr2=0x7f5a18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 0x7f5a18061610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f5a300011e0 tx=0x7f5a30009040).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 msgr2=0x7f5a340c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f5a28009e00 tx=0x7f5a28017000).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 shutdown_connections 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5a1805f150 0x7f5a18061610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a34155ca0 0x7f5a340c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a34062e00 0x7f5a3414e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 --2- 172.21.15.133:0/3171255038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a341558c0 0x7f5a340c6e10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 >> 172.21.15.133:0/3171255038 conn(0x7f5a340c8010 msgr2=0x7f5a34153000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 shutdown_connections 2024-01-21T19:59:37.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.700+0000 7f5a3c639700 1 -- 172.21.15.133:0/3171255038 wait complete. 2024-01-21T19:59:37.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:37.705 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:37.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.832+0000 7f5e03e12700 1 Processor -- start 2024-01-21T19:59:37.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.832+0000 7f5e03e12700 1 -- start start 2024-01-21T19:59:37.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e03e12700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5dfc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e03e12700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5dfc069ef0 0x7f5dfc066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e03e12700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dfc065660 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e03e12700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dfc0bef10 con 0x7f5dfc069ef0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e03e12700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc156070 con 0x7f5dfc0beb30 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e013ad700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5dfc0c3fb0 0x7f5dfc0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38528/0 (socket says 172.21.15.133:38528) 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e013ad700 1 -- 172.21.15.133:0/620956573 learned_addr learned my addr 172.21.15.133:0/620956573 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.833+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437843870 0 0) 0x7f5dfc065660 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 --2- 172.21.15.133:0/620956573 >> v2:172.21.15.178:3300/0 conn(0x7f5dfc069ef0 0x7f5dfc066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e01bae700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5dfc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de80033f0 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 513515319 0 0) 0x7f5de80033f0 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 msgr2=0x7f5dfc155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5dfc155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 >> v2:172.21.15.178:3300/0 conn(0x7f5dfc069ef0 msgr2=0x7f5dfc066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 --2- 172.21.15.133:0/620956573 >> v2:172.21.15.178:3300/0 conn(0x7f5dfc069ef0 0x7f5dfc066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc065f00 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f5df8001470 con 0x7f5dfc0c3fb0 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 >> v1:172.21.15.133:6789/0 conn(0x7f5dfc0c3fb0 legacy=0x7f5dfc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5de8003910 0x7f5de8003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5de8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5de8004b80 0x7f5de8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0bef10 con 0x7f5de8004b80 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc156070 con 0x7f5de8003910 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de800b8e0 con 0x7f5dfc0beb30 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5de8004b80 0x7f5de8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e01bae700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5de8003910 0x7f5de8003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e013ad700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5de8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 -- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 msgr2=0x7f5de8004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dfc0beb30 0x7f5de8004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 -- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5de8003910 msgr2=0x7f5de8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5de8003910 0x7f5de8003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 -- 172.21.15.133:0/620956573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80033f0 con 0x7f5de8004b80 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e01bae700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5de8003910 0x7f5de8003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.834+0000 7f5e023af700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5de8004b80 0x7f5de8005000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f5df400e210 tx=0x7f5df400b040).ready entity=mon.0 client_cookie=b3fe97394efce8f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4009ac0 con 0x7f5de8004b80 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400f040 con 0x7f5de8004b80 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e00bac700 1 -- 172.21.15.133:0/620956573 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400ecd0 con 0x7f5de8004b80 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 -- 172.21.15.133:0/620956573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5de8004b80 msgr2=0x7f5de8005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 --2- 172.21.15.133:0/620956573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5de8004b80 0x7f5de8005000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f5df400e210 tx=0x7f5df400b040).stop 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e023af700 1 -- 172.21.15.133:0/620956573 reap_dead start 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 -- 172.21.15.133:0/620956573 shutdown_connections 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 -- 172.21.15.133:0/620956573 >> 172.21.15.133:0/620956573 conn(0x7f5dfc0c8010 msgr2=0x7f5dfc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 -- 172.21.15.133:0/620956573 shutdown_connections 2024-01-21T19:59:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.835+0000 7f5e03e12700 1 -- 172.21.15.133:0/620956573 wait complete. 2024-01-21T19:59:37.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.837+0000 7f5e03e12700 1 Processor -- start 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.837+0000 7f5e03e12700 1 -- start start 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5de8004b80 0x7f5dfc1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 0x7f5dfc0a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c0020 con 0x7f5dfc0a6260 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0c0300 con 0x7f5dfc150ce0 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dfc0a6780 con 0x7f5de8004b80 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42154/0 (socket says 172.21.15.133:42154) 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 -- 172.21.15.133:0/2212066661 learned_addr learned my addr 172.21.15.133:0/2212066661 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e013ad700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 0x7f5dfc0a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e01bae700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5de8004b80 0x7f5dfc1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 -- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5de8004b80 msgr2=0x7f5dfc1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5de8004b80 0x7f5dfc1507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 -- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 msgr2=0x7f5dfc0a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 0x7f5dfc0a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 -- 172.21.15.133:0/2212066661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc0a6a60 con 0x7f5dfc0a6260 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e013ad700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 0x7f5dfc0a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e023af700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f5de80045a0 tx=0x7f5df401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4009ac0 con 0x7f5dfc0a6260 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4013c20 con 0x7f5dfc0a6260 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df401d400 con 0x7f5dfc0a6260 2024-01-21T19:59:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.838+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dfc0a6d40 con 0x7f5dfc0a6260 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.839+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dfc13ad80 con 0x7f5dfc0a6260 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.840+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dfc0c0490 con 0x7f5dfc0a6260 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.840+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5df4003040 con 0x7f5dfc0a6260 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.840+0000 7f5df27fc700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 0x7f5de0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.840+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5df407bd60 con 0x7f5dfc0a6260 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.840+0000 7f5e01bae700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 0x7f5de0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.841+0000 7f5e01bae700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 0x7f5de0061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5dec006ac0 tx=0x7f5dec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:37.844+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5df404d030 con 0x7f5dfc0a6260 2024-01-21T19:59:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.008+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5dfc05fdf0 con 0x7f5dfc0a6260 2024-01-21T19:59:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.009+0000 7f5df27fc700 1 -- 172.21.15.133:0/2212066661 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5df4050650 con 0x7f5dfc0a6260 2024-01-21T19:59:38.001 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 msgr2=0x7f5de0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 0x7f5de0061610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5dec006ac0 tx=0x7f5dec008040).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 msgr2=0x7f5dfc13a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f5de80045a0 tx=0x7f5df401a000).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 shutdown_connections 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5de005f150 0x7f5de0061610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dfc0a6260 0x7f5dfc13a890 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5de8004b80 0x7f5dfc1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 --2- 172.21.15.133:0/2212066661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dfc150ce0 0x7f5dfc0a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 >> 172.21.15.133:0/2212066661 conn(0x7f5dfc0c8010 msgr2=0x7f5dfc0bdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 shutdown_connections 2024-01-21T19:59:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.011+0000 7f5e03e12700 1 -- 172.21.15.133:0/2212066661 wait complete. 2024-01-21T19:59:38.015 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.143+0000 7f78ece0a700 1 Processor -- start 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.143+0000 7f78ece0a700 1 -- start start 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78ece0a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e813a830 0x7f78e80c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78ece0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78e813ac10 0x7f78e80bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78ece0a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e80c3890 con 0x7f78e80695b0 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78ece0a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e80c3b70 con 0x7f78e813ac10 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78ece0a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80c3e50 con 0x7f78e813a830 2024-01-21T19:59:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78e813ac10 0x7f78e80bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78e813ac10 0x7f78e80bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42170/0 (socket says 172.21.15.133:42170) 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1376096544 learned_addr learned my addr 172.21.15.133:0/1376096544 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e659c700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e813a830 0x7f78e80c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1376096544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e813a830 msgr2=0x7f78e80c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e813a830 0x7f78e80c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1376096544 >> v1:172.21.15.178:6789/0 conn(0x7f78e80695b0 legacy=0x7f78e8154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.144+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1376096544 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e80c4130 con 0x7f78e813ac10 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78e5d9b700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813ac10 0x7f78e80bce60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f78d8006fd0 tx=0x7f78d80090f0).ready entity=mon.0 client_cookie=4fcbb0f0cc6dd11d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78e559a700 1 -- 172.21.15.133:0/1376096544 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800b600 con 0x7f78e813ac10 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78e559a700 1 -- 172.21.15.133:0/1376096544 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800b760 con 0x7f78e813ac10 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78e559a700 1 -- 172.21.15.133:0/1376096544 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800bb00 con 0x7f78e813ac10 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 -- 172.21.15.133:0/1376096544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813ac10 msgr2=0x7f78e80bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813ac10 0x7f78e80bce60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f78d8006fd0 tx=0x7f78d80090f0).stop 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 -- 172.21.15.133:0/1376096544 shutdown_connections 2024-01-21T19:59:38.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e813a830 0x7f78e80c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1376096544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813ac10 0x7f78e80bce60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 -- 172.21.15.133:0/1376096544 >> 172.21.15.133:0/1376096544 conn(0x7f78e80c7dc0 msgr2=0x7f78e80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 -- 172.21.15.133:0/1376096544 shutdown_connections 2024-01-21T19:59:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.145+0000 7f78ece0a700 1 -- 172.21.15.133:0/1376096544 wait complete. 2024-01-21T19:59:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 Processor -- start 2024-01-21T19:59:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 -- start start 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e80695b0 0x7f78e80bf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 0x7f78e80a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80c1cc0 con 0x7f78e813a830 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80bf600 con 0x7f78e813ac10 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78ece0a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e80c1a40 con 0x7f78e80695b0 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78e5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.147+0000 7f78e5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42184/0 (socket says 172.21.15.133:42184) 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1785935875 learned_addr learned my addr 172.21.15.133:0/1785935875 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e659c700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e80695b0 0x7f78e80bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e6d9d700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 0x7f78e80a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e80695b0 msgr2=0x7f78e80bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e80695b0 0x7f78e80bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 msgr2=0x7f78e80a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 0x7f78e80a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 -- 172.21.15.133:0/1785935875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d8009370 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e6d9d700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 0x7f78e80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78e5d9b700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f78d8009f50 tx=0x7f78d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800b8d0 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800ba30 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e80ac2f0 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8025420 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.148+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e80bfcf0 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.149+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e8130bb0 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.149+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f78d8022020 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.150+0000 7f78d6ffd700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 0x7f78c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.150+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78d807bb00 con 0x7f78e813a830 2024-01-21T19:59:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.150+0000 7f78e659c700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 0x7f78c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.150+0000 7f78e659c700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 0x7f78c8061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f78dc00a9d0 tx=0x7f78dc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.154+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f78d804cdd0 con 0x7f78e813a830 2024-01-21T19:59:38.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.317+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78e805fdf0 con 0x7f78e813a830 2024-01-21T19:59:38.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.317+0000 7f78d6ffd700 1 -- 172.21.15.133:0/1785935875 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78d802a030 con 0x7f78e813a830 2024-01-21T19:59:38.309 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:38.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 msgr2=0x7f78c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 0x7f78c8061610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f78dc00a9d0 tx=0x7f78dc008040).stop 2024-01-21T19:59:38.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 msgr2=0x7f78e80c1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f78d8009f50 tx=0x7f78d8017000).stop 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 shutdown_connections 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f78c805f150 0x7f78c8061610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78e813ac10 0x7f78e80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78e80695b0 0x7f78e80bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 --2- 172.21.15.133:0/1785935875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78e813a830 0x7f78e80c1550 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 >> 172.21.15.133:0/1785935875 conn(0x7f78e80c7dc0 msgr2=0x7f78e80ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 shutdown_connections 2024-01-21T19:59:38.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.319+0000 7f78ece0a700 1 -- 172.21.15.133:0/1785935875 wait complete. 2024-01-21T19:59:38.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:38.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.452+0000 7f2aa5442700 1 Processor -- start 2024-01-21T19:59:38.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.452+0000 7f2aa5442700 1 -- start start 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2aa5442700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2aa00beb30 0x7f2aa0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2aa5442700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0065660 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2aa5442700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa0065f00 con 0x7f2aa0069ef0 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2aa5442700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa00bef10 con 0x7f2aa00beb30 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2a9effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2aa00beb30 0x7f2aa0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2a9effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2aa00beb30 0x7f2aa0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42200/0 (socket says 172.21.15.133:42200) 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2a9e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2aa00c3fb0 0x7f2aa00697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38532/0 (socket says 172.21.15.133:38532) 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.453+0000 7f2a9effd700 1 -- 172.21.15.133:0/3628777615 learned_addr learned my addr 172.21.15.133:0/3628777615 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9effd700 1 -- 172.21.15.133:0/3628777615 >> v1:172.21.15.178:6789/0 conn(0x7f2aa0069ef0 legacy=0x7f2aa0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:38.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9effd700 1 -- 172.21.15.133:0/3628777615 >> v1:172.21.15.133:6789/0 conn(0x7f2aa00c3fb0 legacy=0x7f2aa00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9effd700 1 -- 172.21.15.133:0/3628777615 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00c4740 con 0x7f2aa00beb30 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9dffb700 1 -- 172.21.15.133:0/3628777615 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420437038 0 0) 0x7f2aa0065660 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9effd700 1 --2- 172.21.15.133:0/3628777615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00beb30 0x7f2aa0155b80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f2a94006fd0 tx=0x7f2a940090f0).ready entity=mon.0 client_cookie=a1187acc17ec9567 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9dffb700 1 -- 172.21.15.133:0/3628777615 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400b600 con 0x7f2aa00beb30 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9dffb700 1 -- 172.21.15.133:0/3628777615 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9400b760 con 0x7f2aa00beb30 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.454+0000 7f2a9dffb700 1 -- 172.21.15.133:0/3628777615 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400bb00 con 0x7f2aa00beb30 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 -- 172.21.15.133:0/3628777615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00beb30 msgr2=0x7f2aa0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 --2- 172.21.15.133:0/3628777615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00beb30 0x7f2aa0155b80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f2a94006fd0 tx=0x7f2a940090f0).stop 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 -- 172.21.15.133:0/3628777615 shutdown_connections 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 --2- 172.21.15.133:0/3628777615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00beb30 0x7f2aa0155b80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 -- 172.21.15.133:0/3628777615 >> 172.21.15.133:0/3628777615 conn(0x7f2aa00c8010 msgr2=0x7f2aa00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 -- 172.21.15.133:0/3628777615 shutdown_connections 2024-01-21T19:59:38.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.455+0000 7f2aa5442700 1 -- 172.21.15.133:0/3628777615 wait complete. 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.456+0000 7f2aa5442700 1 Processor -- start 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.456+0000 7f2aa5442700 1 -- start start 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 0x7f2aa00bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 0x7f2aa00a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0164f10 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0165160 con 0x7f2aa00beb30 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa0165440 con 0x7f2aa0069ef0 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42204/0 (socket says 172.21.15.133:42204) 2024-01-21T19:59:38.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 -- 172.21.15.133:0/1335991265 learned_addr learned my addr 172.21.15.133:0/1335991265 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9effd700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 0x7f2aa00bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9e7fc700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 0x7f2aa00a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 -- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 msgr2=0x7f2aa00bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 0x7f2aa00bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 -- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 msgr2=0x7f2aa00a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 0x7f2aa00a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 -- 172.21.15.133:0/1335991265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94009370 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9effd700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 0x7f2aa00bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9e7fc700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 0x7f2aa00a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a9f7fe700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2a9800b810 tx=0x7f2a98009250).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800d580 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9800d700 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0165720 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800dac0 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.457+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa0165ce0 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.459+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa005fdf0 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.459+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a98010440 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.459+0000 7f2a877fe700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 0x7f2a8c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.459+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a9807a190 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.459+0000 7f2a9effd700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 0x7f2a8c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.460+0000 7f2a9effd700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 0x7f2a8c061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2a9400b3c0 tx=0x7f2a94017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.463+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a9804b400 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.625+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2aa006ac20 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.626+0000 7f2a877fe700 1 -- 172.21.15.133:0/1335991265 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a9804ea20 con 0x7f2aa00c3fb0 2024-01-21T19:59:38.618 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 msgr2=0x7f2a8c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 0x7f2a8c061610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2a9400b3c0 tx=0x7f2a94017000).stop 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 msgr2=0x7f2aa00a8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2a9800b810 tx=0x7f2a98009250).stop 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 shutdown_connections 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a8c05f150 0x7f2a8c061610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2aa00c3fb0 0x7f2aa00a8580 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa0069ef0 0x7f2aa00bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 --2- 172.21.15.133:0/1335991265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa00beb30 0x7f2aa00a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 >> 172.21.15.133:0/1335991265 conn(0x7f2aa00c8010 msgr2=0x7f2aa00c5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 shutdown_connections 2024-01-21T19:59:38.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.628+0000 7f2aa5442700 1 -- 172.21.15.133:0/1335991265 wait complete. 2024-01-21T19:59:38.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.759+0000 7f92445ef700 1 Processor -- start 2024-01-21T19:59:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.759+0000 7f92445ef700 1 -- start start 2024-01-21T19:59:38.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f92445ef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 0x7f923c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f92445ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f923c0c3fb0 0x7f923c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f92445ef700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f923c065660 con 0x7f923c069cd0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f92445ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f923c0bef10 con 0x7f923c0c3fb0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f92445ef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c156070 con 0x7f923c0beb30 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.760+0000 7f9241b8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f923c0c3fb0 0x7f923c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f923c0c3fb0 0x7f923c0697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42206/0 (socket says 172.21.15.133:42206) 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 -- 172.21.15.133:0/1425071391 learned_addr learned my addr 172.21.15.133:0/1425071391 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f924238b700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 0x7f923c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 -- 172.21.15.133:0/1425071391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 msgr2=0x7f923c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 0x7f923c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 -- 172.21.15.133:0/1425071391 >> v1:172.21.15.178:6789/0 conn(0x7f923c069cd0 legacy=0x7f923c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 -- 172.21.15.133:0/1425071391 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c065f00 con 0x7f923c0c3fb0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f924238b700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 0x7f923c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241b8a700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0c3fb0 0x7f923c0697e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9238006fd0 tx=0x7f92380090f0).ready entity=mon.0 client_cookie=d27f961222afff9c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241389700 1 -- 172.21.15.133:0/1425071391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800b600 con 0x7f923c0c3fb0 2024-01-21T19:59:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241389700 1 -- 172.21.15.133:0/1425071391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800b760 con 0x7f923c0c3fb0 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.761+0000 7f9241389700 1 -- 172.21.15.133:0/1425071391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800bb00 con 0x7f923c0c3fb0 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 -- 172.21.15.133:0/1425071391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0c3fb0 msgr2=0x7f923c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0c3fb0 0x7f923c0697e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f9238006fd0 tx=0x7f92380090f0).stop 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 -- 172.21.15.133:0/1425071391 shutdown_connections 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c0beb30 0x7f923c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 --2- 172.21.15.133:0/1425071391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0c3fb0 0x7f923c0697e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 -- 172.21.15.133:0/1425071391 >> 172.21.15.133:0/1425071391 conn(0x7f923c0c8010 msgr2=0x7f923c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 -- 172.21.15.133:0/1425071391 shutdown_connections 2024-01-21T19:59:38.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.762+0000 7f92445ef700 1 -- 172.21.15.133:0/1425071391 wait complete. 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.763+0000 7f92445ef700 1 Processor -- start 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.763+0000 7f92445ef700 1 -- start start 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c069cd0 0x7f923c0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0c3fb0 0x7f923c0bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0ad6f0 con 0x7f923c0beb30 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0ad990 con 0x7f923c0c3fb0 2024-01-21T19:59:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c0adc70 con 0x7f923c069cd0 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42216/0 (socket says 172.21.15.133:42216) 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 -- 172.21.15.133:0/4228405324 learned_addr learned my addr 172.21.15.133:0/4228405324 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f924238b700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c069cd0 0x7f923c0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9242b8c700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0c3fb0 0x7f923c0bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 -- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c069cd0 msgr2=0x7f923c0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c069cd0 0x7f923c0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 -- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0c3fb0 msgr2=0x7f923c0bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0c3fb0 0x7f923c0bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 -- 172.21.15.133:0/4228405324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238009370 con 0x7f923c0beb30 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9241b8a700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f923c068a00 tx=0x7f9238017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923800b8d0 con 0x7f923c0beb30 2024-01-21T19:59:38.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923800ba30 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238025420 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f923c0adf50 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.764+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923c0ab5a0 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.765+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923c152c70 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.766+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9238022020 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.766+0000 7f9232ffd700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 0x7f9220061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.766+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f923807bb30 con 0x7f923c0beb30 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.766+0000 7f924238b700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 0x7f9220061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:38.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.766+0000 7f924238b700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 0x7f9220061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f922c00a9d0 tx=0x7f922c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.770+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f923c152c70 con 0x7f923c0beb30 2024-01-21T19:59:38.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.936+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f923c152c10 con 0x7f923c0beb30 2024-01-21T19:59:38.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.936+0000 7f9232ffd700 1 -- 172.21.15.133:0/4228405324 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f923802a030 con 0x7f923c0beb30 2024-01-21T19:59:38.929 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 msgr2=0x7f9220061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 0x7f9220061610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f922c00a9d0 tx=0x7f922c008040).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 msgr2=0x7f923c0c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f923c068a00 tx=0x7f9238017000).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 shutdown_connections 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f922005f150 0x7f9220061610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0c3fb0 0x7f923c0bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f923c069cd0 0x7f923c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 --2- 172.21.15.133:0/4228405324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c0beb30 0x7f923c0c1410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:38.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 >> 172.21.15.133:0/4228405324 conn(0x7f923c0c8010 msgr2=0x7f923c0bd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:38.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 shutdown_connections 2024-01-21T19:59:38.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:38.938+0000 7f92445ef700 1 -- 172.21.15.133:0/4228405324 wait complete. 2024-01-21T19:59:38.980 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2024-01-21T19:59:38.980 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T19:59:38.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-01-21T19:59:39.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.105+0000 7fc7bf343700 1 Processor -- start 2024-01-21T19:59:39.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 -- start start 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7b813a620 0x7fc7b80a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7b8062e00 0x7fc7b8158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b81584f0 con 0x7fc7b813aa00 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80bd6f0 con 0x7fc7b8062e00 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bf343700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b80654e0 con 0x7fc7b813a620 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.106+0000 7fc7bd8e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7b8062e00 0x7fc7b8158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:39.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7b8062e00 0x7fc7b8158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42230/0 (socket says 172.21.15.133:42230) 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 -- 172.21.15.133:0/2561870610 learned_addr learned my addr 172.21.15.133:0/2561870610 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 -- 172.21.15.133:0/2561870610 >> v2:172.21.15.178:3300/0 conn(0x7fc7b813a620 msgr2=0x7fc7b80a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 --2- 172.21.15.133:0/2561870610 >> v2:172.21.15.178:3300/0 conn(0x7fc7b813a620 0x7fc7b80a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 -- 172.21.15.133:0/2561870610 >> v1:172.21.15.178:6789/0 conn(0x7fc7b813aa00 legacy=0x7fc7b80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 -- 172.21.15.133:0/2561870610 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8158730 con 0x7fc7b8062e00 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7bd8e0700 1 --2- 172.21.15.133:0/2561870610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b8158000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fc7b8068f20 tx=0x7fc7b0009840).ready entity=mon.0 client_cookie=6ab1d767d8a703f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7abfff700 1 -- 172.21.15.133:0/2561870610 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b000e070 con 0x7fc7b8062e00 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7abfff700 1 -- 172.21.15.133:0/2561870610 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b000ba10 con 0x7fc7b8062e00 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.107+0000 7fc7abfff700 1 -- 172.21.15.133:0/2561870610 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b000bd90 con 0x7fc7b8062e00 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 -- 172.21.15.133:0/2561870610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 msgr2=0x7fc7b8158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2561870610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b8158000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fc7b8068f20 tx=0x7fc7b0009840).stop 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 -- 172.21.15.133:0/2561870610 shutdown_connections 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2561870610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b8158000 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2561870610 >> v2:172.21.15.178:3300/0 conn(0x7fc7b813a620 0x7fc7b80a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:39.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 -- 172.21.15.133:0/2561870610 >> 172.21.15.133:0/2561870610 conn(0x7fc7b80c7dc0 msgr2=0x7fc7b80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:39.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 -- 172.21.15.133:0/2561870610 shutdown_connections 2024-01-21T19:59:39.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.108+0000 7fc7bf343700 1 -- 172.21.15.133:0/2561870610 wait complete. 2024-01-21T19:59:39.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.109+0000 7fc7bf343700 1 Processor -- start 2024-01-21T19:59:39.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.109+0000 7fc7bf343700 1 -- start start 2024-01-21T19:59:39.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7b813a620 0x7fc7b80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7b813aa00 0x7fc7b80a7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b81392f0 con 0x7fc7b8062e00 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80aa350 con 0x7fc7b813a620 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bf343700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b80aa7e0 con 0x7fc7b813aa00 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42244/0 (socket says 172.21.15.133:42244) 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 -- 172.21.15.133:0/2962191204 learned_addr learned my addr 172.21.15.133:0/2962191204 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bc8de700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7b813a620 0x7fc7b80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd8e0700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7b813aa00 0x7fc7b80a7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 -- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7b813aa00 msgr2=0x7fc7b80a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7b813aa00 0x7fc7b80a7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 -- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7b813a620 msgr2=0x7fc7b80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7b813a620 0x7fc7b80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 -- 172.21.15.133:0/2962191204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0009ae0 con 0x7fc7b8062e00 2024-01-21T19:59:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.110+0000 7fc7bd0df700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc7ac00b530 tx=0x7fc7ac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.111+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac002320 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.111+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0024a0 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.111+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac002860 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.111+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b80a9740 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.111+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b80a9ad0 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.112+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc7ac002c10 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.112+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b80aa630 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.112+0000 7fc7a9ffb700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 0x7fc79c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.112+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc7ac079f90 con 0x7fc7b8062e00 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.112+0000 7fc7bc8de700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 0x7fc79c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.113+0000 7fc7bc8de700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 0x7fc79c061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc7b813e340 tx=0x7fc7b4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:39.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.116+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc7ac04b260 con 0x7fc7b8062e00 2024-01-21T19:59:39.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:39.343+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7fc7b805e4f0 con 0x7fc7b8062e00 2024-01-21T19:59:40.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.102+0000 7fc7a9ffb700 1 -- 172.21.15.133:0/2962191204 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7ac04e880 con 0x7fc7b8062e00 2024-01-21T19:59:40.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 msgr2=0x7fc79c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 0x7fc79c061610 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fc7b813e340 tx=0x7fc7b4008040).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 msgr2=0x7fc7b81683b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc7ac00b530 tx=0x7fc7ac0090f0).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 shutdown_connections 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc79c05f150 0x7fc79c061610 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7b813aa00 0x7fc7b80a7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7b8062e00 0x7fc7b81683b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 --2- 172.21.15.133:0/2962191204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7b813a620 0x7fc7b80ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 >> 172.21.15.133:0/2962191204 conn(0x7fc7b80c7dc0 msgr2=0x7fc7b80a6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 shutdown_connections 2024-01-21T19:59:40.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.105+0000 7fc7bf343700 1 -- 172.21.15.133:0/2962191204 wait complete. 2024-01-21T19:59:40.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T19:59:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.245+0000 7f4c14eb3700 1 Processor -- start 2024-01-21T19:59:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.245+0000 7f4c14eb3700 1 -- start start 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c14eb3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c10062e00 0x7f4c1015d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c14eb3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100a50f0 con 0x7f4c101558c0 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c14eb3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100a4da0 con 0x7f4c10155ca0 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c14eb3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c100bde00 con 0x7f4c10062e00 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c0ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c10062e00 0x7f4c1015d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c0e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4c101558c0 0x7f4c100626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40406/0 (socket says 172.21.15.133:40406) 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.246+0000 7f4c0e59c700 1 -- 172.21.15.133:0/3124374233 learned_addr learned my addr 172.21.15.133:0/3124374233 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3124374233 >> v1:172.21.15.178:6789/0 conn(0x7f4c10155ca0 legacy=0x7f4c100bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3124374233 >> v1:172.21.15.133:6789/0 conn(0x7f4c101558c0 legacy=0x7f4c100626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3124374233 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100be0e0 con 0x7f4c10062e00 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0d59a700 1 -- 172.21.15.133:0/3124374233 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43133062 0 0) 0x7f4c100a50f0 con 0x7f4c101558c0 2024-01-21T19:59:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0ed9d700 1 --2- 172.21.15.133:0/3124374233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10062e00 0x7f4c1015d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f4c08009e60 tx=0x7f4c08009780).ready entity=mon.0 client_cookie=cefe1c1fdddd700 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0d59a700 1 -- 172.21.15.133:0/3124374233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800e070 con 0x7f4c10062e00 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0d59a700 1 -- 172.21.15.133:0/3124374233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0800bbf0 con 0x7f4c10062e00 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c0d59a700 1 -- 172.21.15.133:0/3124374233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08012410 con 0x7f4c10062e00 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3124374233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10062e00 msgr2=0x7f4c1015d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3124374233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10062e00 0x7f4c1015d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f4c08009e60 tx=0x7f4c08009780).stop 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3124374233 shutdown_connections 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3124374233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10062e00 0x7f4c1015d150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3124374233 >> 172.21.15.133:0/3124374233 conn(0x7f4c100c8010 msgr2=0x7f4c100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.247+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3124374233 shutdown_connections 2024-01-21T19:59:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.248+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3124374233 wait complete. 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.249+0000 7f4c14eb3700 1 Processor -- start 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.249+0000 7f4c14eb3700 1 -- start start 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 0x7f4c101471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c101558c0 0x7f4c10154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c10155110 con 0x7f4c10155ca0 2024-01-21T19:59:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c0d70 con 0x7f4c10062e00 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c0160 con 0x7f4c101558c0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47998/0 (socket says 172.21.15.133:47998) 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3114265502 learned_addr learned my addr 172.21.15.133:0/3114265502 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0e59c700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 0x7f4c101471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0dd9b700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c101558c0 0x7f4c10154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c101558c0 msgr2=0x7f4c10154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c101558c0 0x7f4c10154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 msgr2=0x7f4c101471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 0x7f4c101471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 -- 172.21.15.133:0/3114265502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08009a20 con 0x7f4c10155ca0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0e59c700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 0x7f4c101471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c0ed9d700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f4c10068a00 tx=0x7f4c100c3d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0801d630 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0801d790 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c100c0440 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0801db10 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.250+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c100c0a00 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.251+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c100c0ee0 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.252+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c08027460 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.252+0000 7f4bfeffd700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 0x7f4bf0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.252+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c0807c220 con 0x7f4c10155ca0 2024-01-21T19:59:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.252+0000 7f4c0e59c700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 0x7f4bf0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.252+0000 7f4c0e59c700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 0x7f4bf0061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4c04007fd0 tx=0x7f4c04009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:40.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.256+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c0804d490 con 0x7f4c10155ca0 2024-01-21T19:59:40.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.420+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4c10065210 con 0x7f4c10155ca0 2024-01-21T19:59:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.425+0000 7f4bfeffd700 1 -- 172.21.15.133:0/3114265502 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c08050ab0 con 0x7f4c10155ca0 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 msgr2=0x7f4bf0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 0x7f4bf0061610 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4c04007fd0 tx=0x7f4c04009040).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 msgr2=0x7f4c10154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f4c10068a00 tx=0x7f4c100c3d70).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 shutdown_connections 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4bf005f150 0x7f4bf0061610 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c10155ca0 0x7f4c10154c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c10062e00 0x7f4c101471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 --2- 172.21.15.133:0/3114265502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c101558c0 0x7f4c10154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 >> 172.21.15.133:0/3114265502 conn(0x7f4c100c8010 msgr2=0x7f4c10151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 shutdown_connections 2024-01-21T19:59:40.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:40.427+0000 7f4c14eb3700 1 -- 172.21.15.133:0/3114265502 wait complete. 2024-01-21T19:59:40.431 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T19:59:40.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T19:59:40.471 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T19:59:40.525 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T19:59:40.527 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T19:59:40.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T19:59:40.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-21T19:59:40.566 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:59:40.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:40.567 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T19:59:40.668 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-21T19:59:40.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T19:59:40.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-21T19:59:40.721 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:59:40.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:40.722 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-21T19:59:40.760 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-01-21T19:59:40.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T19:59:40.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-01-21T19:59:40.800 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T19:59:40.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:40.801 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-01-21T19:59:40.858 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-01-21T19:59:40.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T19:59:40.858 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-01-21T19:59:40.901 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T19:59:40.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T19:59:40.901 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-01-21T19:59:40.959 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T19:59:40.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.084+0000 7fb7e12a8700 1 Processor -- start 2024-01-21T19:59:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.084+0000 7fb7e12a8700 1 -- start start 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.084+0000 7fb7e12a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7e12a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc065000 con 0x7fb7dc065490 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7e12a8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc069540 con 0x7fb7dc065900 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7e12a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc065d60 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7da7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7dc065490 0x7fb7dc0a3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40410/0 (socket says 172.21.15.133:40410) 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48006/0 (socket says 172.21.15.133:48006) 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7da7fc700 1 -- 172.21.15.133:0/211938488 learned_addr learned my addr 172.21.15.133:0/211938488 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 -- 172.21.15.133:0/211938488 >> v1:172.21.15.178:6789/0 conn(0x7fb7dc065900 legacy=0x7fb7dc06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 -- 172.21.15.133:0/211938488 >> v1:172.21.15.133:6789/0 conn(0x7fb7dc065490 legacy=0x7fb7dc0a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 -- 172.21.15.133:0/211938488 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc064410 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7d9ffb700 1 -- 172.21.15.133:0/211938488 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505794574 0 0) 0x7fb7dc065000 con 0x7fb7dc065490 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7daffd700 1 --2- 172.21.15.133:0/211938488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb7cc00a900 tx=0x7fb7cc00a200).ready entity=mon.0 client_cookie=cb7eacb1a5002108 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7d9ffb700 1 -- 172.21.15.133:0/211938488 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00aea0 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7d9ffb700 1 -- 172.21.15.133:0/211938488 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00a270 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.085+0000 7fb7d9ffb700 1 -- 172.21.15.133:0/211938488 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00cb80 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 -- 172.21.15.133:0/211938488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0bc8a0 msgr2=0x7fb7dc0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/211938488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb7cc00a900 tx=0x7fb7cc00a200).stop 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 -- 172.21.15.133:0/211938488 shutdown_connections 2024-01-21T19:59:41.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/211938488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0bcc80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 -- 172.21.15.133:0/211938488 >> 172.21.15.133:0/211938488 conn(0x7fb7dc0c6ef0 msgr2=0x7fb7dc0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 -- 172.21.15.133:0/211938488 shutdown_connections 2024-01-21T19:59:41.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.086+0000 7fb7e12a8700 1 -- 172.21.15.133:0/211938488 wait complete. 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.087+0000 7fb7e12a8700 1 Processor -- start 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.087+0000 7fb7e12a8700 1 -- start start 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7dc065490 0x7fb7dc152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0a8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc092300 con 0x7fb7dc065900 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc091a60 con 0x7fb7dc065490 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7e12a8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc153110 con 0x7fb7dc0bc8a0 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48014/0 (socket says 172.21.15.133:48014) 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 -- 172.21.15.133:0/2146533475 learned_addr learned my addr 172.21.15.133:0/2146533475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7daffd700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7dc065490 0x7fb7dc152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7db7fe700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 -- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7dc0bc8a0 msgr2=0x7fb7dc0a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 -- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7dc065490 msgr2=0x7fb7dc152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7dc065490 0x7fb7dc152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.088+0000 7fb7da7fc700 1 -- 172.21.15.133:0/2146533475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc00a440 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7da7fc700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb7d0001eb0 tx=0x7fb7d0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00070d0 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0007230 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc091cb0 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00075d0 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.089+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc150590 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.090+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0924b0 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.090+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb7d0005bc0 con 0x7fb7dc065900 2024-01-21T19:59:41.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.090+0000 7fb7c37fe700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 0x7fb7c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.090+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7d0079b50 con 0x7fb7dc065900 2024-01-21T19:59:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.090+0000 7fb7daffd700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 0x7fb7c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.091+0000 7fb7daffd700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 0x7fb7c8061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb7cc006d30 tx=0x7fb7cc00a200).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.094+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb7dc0924b0 con 0x7fb7dc065900 2024-01-21T19:59:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.298+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7dc05fdf0 con 0x7fb7dc065900 2024-01-21T19:59:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.298+0000 7fb7c37fe700 1 -- 172.21.15.133:0/2146533475 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7fb7d0018030 con 0x7fb7dc065900 2024-01-21T19:59:41.290 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:41.291 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 msgr2=0x7fb7c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 0x7fb7c8061610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fb7cc006d30 tx=0x7fb7cc00a200).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 msgr2=0x7fb7dc1500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fb7d0001eb0 tx=0x7fb7d0007e90).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 shutdown_connections 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7c805f150 0x7fb7c8061610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7dc0bc8a0 0x7fb7dc0a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7dc065490 0x7fb7dc152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 --2- 172.21.15.133:0/2146533475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc065900 0x7fb7dc1500a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 >> 172.21.15.133:0/2146533475 conn(0x7fb7dc0c6ef0 msgr2=0x7fb7dc0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 shutdown_connections 2024-01-21T19:59:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.300+0000 7fb7e12a8700 1 -- 172.21.15.133:0/2146533475 wait complete. 2024-01-21T19:59:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:41.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.428+0000 7efce81b1700 1 Processor -- start 2024-01-21T19:59:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.428+0000 7efce81b1700 1 -- start start 2024-01-21T19:59:41.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce81b1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efce00c3c20 0x7efce013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce81b1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efce00bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce81b1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce00c64d0 con 0x7efce00c3840 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce81b1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce0067f10 con 0x7efce00c3c20 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce81b1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00681f0 con 0x7efce013a9e0 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce5f4d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efce00c3840 0x7efce00c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40420/0 (socket says 172.21.15.133:40420) 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce5f4d700 1 -- 172.21.15.133:0/812330682 learned_addr learned my addr 172.21.15.133:0/812330682 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce574c700 1 --2- 172.21.15.133:0/812330682 >> v2:172.21.15.178:3300/0 conn(0x7efce00c3c20 0x7efce013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce674e700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efce00bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635475464 0 0) 0x7efcdc001110 con 0x7efce00c3840 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc0033f0 con 0x7efce00c3840 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715501280 0 0) 0x7efccc0033f0 con 0x7efce00c3840 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 msgr2=0x7efce00bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efce00bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 >> v2:172.21.15.178:3300/0 conn(0x7efce00c3c20 msgr2=0x7efce013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 --2- 172.21.15.133:0/812330682 >> v2:172.21.15.178:3300/0 conn(0x7efce00c3c20 0x7efce013a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00684d0 con 0x7efce00c3840 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7efcdc001600 con 0x7efce00c3840 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 >> v1:172.21.15.133:6789/0 conn(0x7efce00c3840 legacy=0x7efce00c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efccc0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efccc003e10 0x7efccc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc004b80 0x7efccc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce0067f10 con 0x7efccc003e10 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00681f0 con 0x7efccc004b80 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efccc00b8e0 con 0x7efce013a9e0 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.429+0000 7efce574c700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efccc003e10 0x7efccc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce5f4d700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efccc0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce674e700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc004b80 0x7efccc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 -- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 msgr2=0x7efccc0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce013a9e0 0x7efccc0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 -- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc004b80 msgr2=0x7efccc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc004b80 0x7efccc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 -- 172.21.15.133:0/812330682 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0033f0 con 0x7efccc003e10 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce574c700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efccc003e10 0x7efccc004690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efcd0009ab0 tx=0x7efcd0009060).ready entity=mon.0 client_cookie=c01dba0f3ed0cae3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0009430 con 0x7efccc003e10 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000e640 con 0x7efccc003e10 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce4f4b700 1 -- 172.21.15.133:0/812330682 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000e9c0 con 0x7efccc003e10 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce81b1700 1 -- 172.21.15.133:0/812330682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efccc003e10 msgr2=0x7efccc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce81b1700 1 --2- 172.21.15.133:0/812330682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efccc003e10 0x7efccc004690 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efcd0009ab0 tx=0x7efcd0009060).stop 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce674e700 1 -- 172.21.15.133:0/812330682 reap_dead start 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce81b1700 1 -- 172.21.15.133:0/812330682 shutdown_connections 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.430+0000 7efce81b1700 1 -- 172.21.15.133:0/812330682 >> 172.21.15.133:0/812330682 conn(0x7efce0066a70 msgr2=0x7efce0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.431+0000 7efce81b1700 1 -- 172.21.15.133:0/812330682 shutdown_connections 2024-01-21T19:59:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.431+0000 7efce81b1700 1 -- 172.21.15.133:0/812330682 wait complete. 2024-01-21T19:59:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.432+0000 7efce81b1700 1 Processor -- start 2024-01-21T19:59:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.432+0000 7efce81b1700 1 -- start start 2024-01-21T19:59:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.432+0000 7efce81b1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc003e10 0x7efce0131ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.432+0000 7efce81b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.432+0000 7efce81b1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 0x7efce00c1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce81b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce01658c0 con 0x7efce0131fd0 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce81b1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c1f80 con 0x7efccc003e10 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce81b1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce00c2260 con 0x7efce0153e00 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48034/0 (socket says 172.21.15.133:48034) 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 -- 172.21.15.133:0/2400199339 learned_addr learned my addr 172.21.15.133:0/2400199339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce5f4d700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc003e10 0x7efce0131ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce674e700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 0x7efce00c1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 -- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 msgr2=0x7efce00c1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 0x7efce00c1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 -- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc003e10 msgr2=0x7efce0131ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc003e10 0x7efce0131ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 -- 172.21.15.133:0/2400199339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00c2540 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce674e700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 0x7efce00c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce574c700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efcd000e4b0 tx=0x7efcd001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000ed70 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000eed0 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce00c2820 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000ea00 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.433+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce00c1700 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.434+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce005fdf0 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.435+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efcd002f440 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.435+0000 7efcd67fc700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 0x7efcc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.435+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efcd007be70 con 0x7efce0131fd0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.435+0000 7efce5f4d700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 0x7efcc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.435+0000 7efce5f4d700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 0x7efcc4061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efcdc000e10 tx=0x7efcdc007900).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.439+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efcd004d0e0 con 0x7efce0131fd0 2024-01-21T19:59:41.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.602+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efce00c1d40 con 0x7efce0131fd0 2024-01-21T19:59:41.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.602+0000 7efcd67fc700 1 -- 172.21.15.133:0/2400199339 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7efce00c1d40 con 0x7efce0131fd0 2024-01-21T19:59:41.595 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:41.595 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:41.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 msgr2=0x7efcc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 0x7efcc4061610 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7efcdc000e10 tx=0x7efcdc007900).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 msgr2=0x7efce0153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efcd000e4b0 tx=0x7efcd001a000).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 shutdown_connections 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efcc405f150 0x7efcc4061610 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efce0153e00 0x7efce00c1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efccc003e10 0x7efce0131ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 --2- 172.21.15.133:0/2400199339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efce0131fd0 0x7efce0153910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 >> 172.21.15.133:0/2400199339 conn(0x7efce0066a70 msgr2=0x7efce00c8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 shutdown_connections 2024-01-21T19:59:41.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.604+0000 7efce81b1700 1 -- 172.21.15.133:0/2400199339 wait complete. 2024-01-21T19:59:41.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:04.740822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:05.352435+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T19:59:41.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.736+0000 7f1d22ccc700 1 Processor -- start 2024-01-21T19:59:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.736+0000 7f1d22ccc700 1 -- start start 2024-01-21T19:59:41.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d22ccc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d1c0c3840 0x7f1d1c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d22ccc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c0c6250 0x7f1d1c0bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d22ccc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c067f10 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d22ccc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0681f0 con 0x7f1d1c0c3840 2024-01-21T19:59:41.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d22ccc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0684d0 con 0x7f1d1c0c6250 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d1c0c5dc0 0x7f1d1c13a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40430/0 (socket says 172.21.15.133:40430) 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1bfff700 1 -- 172.21.15.133:0/2569346502 learned_addr learned my addr 172.21.15.133:0/2569346502 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c0c6250 0x7f1d1c0bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d20a68700 1 --2- 172.21.15.133:0/2569346502 >> v2:172.21.15.178:3300/0 conn(0x7f1d1c0c3840 0x7f1d1c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005831911 0 0) 0x7f1d1c067f10 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d0c0033f0 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1930823761 0 0) 0x7f1d0c0033f0 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c0c6250 msgr2=0x7f1d1c0bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c0c6250 0x7f1d1c0bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 >> v2:172.21.15.178:3300/0 conn(0x7f1d1c0c3840 msgr2=0x7f1d1c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 --2- 172.21.15.133:0/2569346502 >> v2:172.21.15.178:3300/0 conn(0x7f1d1c0c3840 0x7f1d1c0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0687b0 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1d08001470 con 0x7f1d1c0c5dc0 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 >> v1:172.21.15.133:6789/0 conn(0x7f1d1c0c5dc0 legacy=0x7f1d1c13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c0038e0 0x7f1d0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0c004690 0x7f1d0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c005000 0x7f1d0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0681f0 con 0x7f1d0c005000 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.737+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0684d0 con 0x7f1d0c0038e0 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c00be00 con 0x7f1d0c004690 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c0c6250 0x7f1d1c0bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d20a68700 1 --2- 172.21.15.133:0/2569346502 >> v2:172.21.15.178:3300/0 conn(0x7f1d1c0c3840 0x7f1d1c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1bfff700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0c004690 0x7f1d0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c005000 0x7f1d0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d20a68700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c0038e0 0x7f1d0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 -- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0c004690 msgr2=0x7f1d0c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0c004690 0x7f1d0c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 -- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c0038e0 msgr2=0x7f1d0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c0038e0 0x7f1d0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 -- 172.21.15.133:0/2569346502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0033f0 con 0x7f1d0c005000 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1bfff700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d0c004690 0x7f1d0c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d21269700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c005000 0x7f1d0c00b8e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1d1c0c6860 tx=0x7f1d1400b040).ready entity=mon.0 client_cookie=4b3efcca7b9205d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400eaa0 con 0x7f1d0c005000 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1400f040 con 0x7f1d0c005000 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.738+0000 7f1d1b7fe700 1 -- 172.21.15.133:0/2569346502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1400ee30 con 0x7f1d0c005000 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 -- 172.21.15.133:0/2569346502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c005000 msgr2=0x7f1d0c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/2569346502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d0c005000 0x7f1d0c00b8e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1d1c0c6860 tx=0x7f1d1400b040).stop 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d21269700 1 -- 172.21.15.133:0/2569346502 reap_dead start 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 -- 172.21.15.133:0/2569346502 shutdown_connections 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 -- 172.21.15.133:0/2569346502 >> 172.21.15.133:0/2569346502 conn(0x7f1d1c066a70 msgr2=0x7f1d1c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 -- 172.21.15.133:0/2569346502 shutdown_connections 2024-01-21T19:59:41.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.739+0000 7f1d22ccc700 1 -- 172.21.15.133:0/2569346502 wait complete. 2024-01-21T19:59:41.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.740+0000 7f1d22ccc700 1 Processor -- start 2024-01-21T19:59:41.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.740+0000 7f1d22ccc700 1 -- start start 2024-01-21T19:59:41.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c138c60 0x7f1d1c1644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d1c139040 0x7f1d1c13d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0c2630 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c13bad0 con 0x7f1d1c139040 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d22ccc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c13dd00 con 0x7f1d1c138c60 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48044/0 (socket says 172.21.15.133:48044) 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 -- 172.21.15.133:0/3113846534 learned_addr learned my addr 172.21.15.133:0/3113846534 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 -- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c138c60 msgr2=0x7f1d1c1644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c138c60 0x7f1d1c1644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d1bfff700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d1c139040 0x7f1d1c13d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 -- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d1c139040 msgr2=0x7f1d1c13d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d1c139040 0x7f1d1c13d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 -- 172.21.15.133:0/3113846534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c13b1a0 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.741+0000 7f1d21269700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1d1c0c8eb0 tx=0x7f1d14019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.742+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14014e90 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.742+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1401f420 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.742+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1401f820 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.742+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c13b480 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.742+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c1649b0 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.743+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c05fdf0 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.743+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1d140133c0 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.743+0000 7f1d197fa700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 0x7f1d000615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.743+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d1407bb60 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.743+0000 7f1d20a68700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 0x7f1d000615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:41.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.744+0000 7f1d20a68700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 0x7f1d000615e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1d10006f70 tx=0x7f1d10009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:41.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.748+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d1404cdd0 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.910+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1d1c068a90 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.911+0000 7f1d197fa700 1 -- 172.21.15.133:0/3113846534 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1d14024070 con 0x7f1d1c13d8a0 2024-01-21T19:59:41.903 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.912+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 msgr2=0x7f1d000615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.912+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 0x7f1d000615e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1d10006f70 tx=0x7f1d10009060).stop 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.912+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 msgr2=0x7f1d1c0c18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.912+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1d1c0c8eb0 tx=0x7f1d14019000).stop 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 shutdown_connections 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d0005f120 0x7f1d000615e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d1c13d8a0 0x7f1d1c0c18c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d1c138c60 0x7f1d1c1644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 --2- 172.21.15.133:0/3113846534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d1c139040 0x7f1d1c13d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 >> 172.21.15.133:0/3113846534 conn(0x7f1d1c066a70 msgr2=0x7f1d1c0c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 shutdown_connections 2024-01-21T19:59:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:41.913+0000 7f1d22ccc700 1 -- 172.21.15.133:0/3113846534 wait complete. 2024-01-21T19:59:41.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:42.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.044+0000 7f88767ab700 1 Processor -- start 2024-01-21T19:59:42.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.044+0000 7f88767ab700 1 -- start start 2024-01-21T19:59:42.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.044+0000 7f88767ab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8870154a90 0x7f88700a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.044+0000 7f88767ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700654f0 con 0x7f88700bc6d0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f88767ab700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870063700 con 0x7f88701546b0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f88767ab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870063950 con 0x7f8870154a90 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f8874d48700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f88700bc6d0 0x7f8870066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40442/0 (socket says 172.21.15.133:40442) 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f8874d48700 1 -- 172.21.15.133:0/4040620996 learned_addr learned my addr 172.21.15.133:0/4040620996 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> v2:172.21.15.178:3300/0 conn(0x7f8870154a90 0x7f88700a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091011656 0 0) 0x7f88700654f0 con 0x7f88700bc6d0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c0033f0 con 0x7f88700bc6d0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 252010580 0 0) 0x7f885c0033f0 con 0x7f88700bc6d0 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 >> v2:172.21.15.178:3300/0 conn(0x7f8870154a90 msgr2=0x7f88700a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 --2- 172.21.15.133:0/4040620996 >> v2:172.21.15.178:3300/0 conn(0x7f8870154a90 0x7f88700a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 >> v1:172.21.15.178:6789/0 conn(0x7f88701546b0 legacy=0x7f8870065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870065180 con 0x7f88700bc6d0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f88680017f0 con 0x7f88700bc6d0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> v2:172.21.15.178:3300/0 conn(0x7f8870154a90 0x7f88700a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 >> v1:172.21.15.133:6789/0 conn(0x7f88700bc6d0 legacy=0x7f8870066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885c0038e0 0x7f885c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f885c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885c005050 0x7f885c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870063950 con 0x7f885c004690 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c00bfe0 con 0x7f885c0038e0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c00c1a0 con 0x7f885c005050 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f885c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.045+0000 7f886ffff700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885c0038e0 0x7f885c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f8874d48700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885c005050 0x7f885c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 -- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885c005050 msgr2=0x7f885c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885c005050 0x7f885c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 -- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885c0038e0 msgr2=0x7f885c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885c0038e0 0x7f885c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f8874d48700 1 -- 172.21.15.133:0/4040620996 reap_dead start 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 -- 172.21.15.133:0/4040620996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0033f0 con 0x7f885c004690 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886f7fe700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f885c004b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8858006d80 tx=0x7f8858009060).ready entity=mon.0 client_cookie=d4eb2cdb63f2b4d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858009660 con 0x7f885c004690 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800e6e0 con 0x7f885c004690 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f886effd700 1 -- 172.21.15.133:0/4040620996 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800ea80 con 0x7f885c004690 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f88767ab700 1 -- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 msgr2=0x7f885c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.046+0000 7f88767ab700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f885c004b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8858006d80 tx=0x7f8858009060).stop 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.047+0000 7f88767ab700 1 -- 172.21.15.133:0/4040620996 shutdown_connections 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.047+0000 7f88767ab700 1 --2- 172.21.15.133:0/4040620996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f885c004b10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.047+0000 7f88767ab700 1 -- 172.21.15.133:0/4040620996 >> 172.21.15.133:0/4040620996 conn(0x7f88700c8200 msgr2=0x7f88700c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.047+0000 7f88767ab700 1 -- 172.21.15.133:0/4040620996 shutdown_connections 2024-01-21T19:59:42.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.047+0000 7f88767ab700 1 -- 172.21.15.133:0/4040620996 wait complete. 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.048+0000 7f88767ab700 1 Processor -- start 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.048+0000 7f88767ab700 1 -- start start 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 0x7f88701654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88700aa7b0 0x7f8870152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870151ba0 con 0x7f885c004690 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700bfd10 con 0x7f88700aa7b0 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870165da0 con 0x7f88700c1820 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48062/0 (socket says 172.21.15.133:48062) 2024-01-21T19:59:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 -- 172.21.15.133:0/3137282303 learned_addr learned my addr 172.21.15.133:0/3137282303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f8874d48700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88700aa7b0 0x7f8870152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886f7fe700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 0x7f88701654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 -- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 msgr2=0x7f88701654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 0x7f88701654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 -- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88700aa7b0 msgr2=0x7f8870152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88700aa7b0 0x7f8870152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 -- 172.21.15.133:0/3137282303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870166080 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886f7fe700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 0x7f88701654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886ffff700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f88600028f0 tx=0x7f8860007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860011590 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600116f0 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860011a70 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.049+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870166360 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.050+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8870165990 con 0x7f885c004690 2024-01-21T19:59:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.050+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88700bfff0 con 0x7f885c004690 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.051+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f88600133f0 con 0x7f885c004690 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.051+0000 7f886cff9700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 0x7f8850061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.051+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8860079ab0 con 0x7f885c004690 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.051+0000 7f886f7fe700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 0x7f8850061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.051+0000 7f886f7fe700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 0x7f8850061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f887015a1d0 tx=0x7f8858019000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.055+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8860049b00 con 0x7f885c004690 2024-01-21T19:59:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.219+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f887005fdf0 con 0x7f885c004690 2024-01-21T19:59:42.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.220+0000 7f886cff9700 1 -- 172.21.15.133:0/3137282303 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f886004add0 con 0x7f885c004690 2024-01-21T19:59:42.212 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 msgr2=0x7f8850061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 0x7f8850061610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f887015a1d0 tx=0x7f8858019000).stop 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 msgr2=0x7f88701516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f88600028f0 tx=0x7f8860007bb0).stop 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 shutdown_connections 2024-01-21T19:59:42.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f885005f150 0x7f8850061610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88700aa7b0 0x7f8870152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f885c004690 0x7f88701516b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 --2- 172.21.15.133:0/3137282303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700c1820 0x7f88701654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 >> 172.21.15.133:0/3137282303 conn(0x7f88700c8200 msgr2=0x7f88701563b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 shutdown_connections 2024-01-21T19:59:42.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.222+0000 7f88767ab700 1 -- 172.21.15.133:0/3137282303 wait complete. 2024-01-21T19:59:42.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T19:59:42.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.352+0000 7fdc57e04700 1 Processor -- start 2024-01-21T19:59:42.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.353+0000 7fdc57e04700 1 -- start start 2024-01-21T19:59:42.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.353+0000 7fdc57e04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdc501546b0 0x7fdc50154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.353+0000 7fdc57e04700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500654f0 con 0x7fdc500a9e30 2024-01-21T19:59:42.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.353+0000 7fdc57e04700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc50063700 con 0x7fdc500bc6d0 2024-01-21T19:59:42.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.353+0000 7fdc57e04700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc50063950 con 0x7fdc501546b0 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc5539f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdc500a9e30 0x7fdc50065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40456/0 (socket says 172.21.15.133:40456) 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc5539f700 1 -- 172.21.15.133:0/3863609098 learned_addr learned my addr 172.21.15.133:0/3863609098 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/3863609098 >> v2:172.21.15.178:3300/0 conn(0x7fdc501546b0 0x7fdc50154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959713306 0 0) 0x7fdc500654f0 con 0x7fdc500a9e30 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc3c0033f0 con 0x7fdc500a9e30 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217608627 0 0) 0x7fdc50063700 con 0x7fdc500bc6d0 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc500654f0 con 0x7fdc500bc6d0 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466240924 0 0) 0x7fdc3c0033f0 con 0x7fdc500a9e30 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 >> v2:172.21.15.178:3300/0 conn(0x7fdc501546b0 msgr2=0x7fdc50154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 --2- 172.21.15.133:0/3863609098 >> v2:172.21.15.178:3300/0 conn(0x7fdc501546b0 0x7fdc50154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 >> v1:172.21.15.178:6789/0 conn(0x7fdc500bc6d0 legacy=0x7fdc50066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50065180 con 0x7fdc500a9e30 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdc4c001470 con 0x7fdc500a9e30 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 >> v1:172.21.15.133:6789/0 conn(0x7fdc500a9e30 legacy=0x7fdc50065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 0x7fdc3c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c004690 0x7fdc3c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3c005050 0x7fdc3c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50063950 con 0x7fdc3c003a70 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c00bfc0 con 0x7fdc3c004690 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c00c180 con 0x7fdc3c005050 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 0x7fdc3c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc5539f700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c004690 0x7fdc3c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.354+0000 7fdc563a1700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3c005050 0x7fdc3c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 -- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3c005050 msgr2=0x7fdc3c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc3c005050 0x7fdc3c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 -- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c004690 msgr2=0x7fdc3c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c004690 0x7fdc3c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 -- 172.21.15.133:0/3863609098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0033f0 con 0x7fdc3c003a70 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc563a1700 1 -- 172.21.15.133:0/3863609098 reap_dead start 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc5539f700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c004690 0x7fdc3c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 0x7fdc3c003e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdc44009a80 tx=0x7fdc44009060).ready entity=mon.0 client_cookie=aa94ef20856d7d0f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44009430 con 0x7fdc3c003a70 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400e640 con 0x7fdc3c003a70 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc54b9e700 1 -- 172.21.15.133:0/3863609098 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400e9c0 con 0x7fdc3c003a70 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 -- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 msgr2=0x7fdc3c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 0x7fdc3c003e70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdc44009a80 tx=0x7fdc44009060).stop 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 -- 172.21.15.133:0/3863609098 shutdown_connections 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 --2- 172.21.15.133:0/3863609098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc3c003a70 0x7fdc3c003e70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 -- 172.21.15.133:0/3863609098 >> 172.21.15.133:0/3863609098 conn(0x7fdc500c8200 msgr2=0x7fdc500c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 -- 172.21.15.133:0/3863609098 shutdown_connections 2024-01-21T19:59:42.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.355+0000 7fdc57e04700 1 -- 172.21.15.133:0/3863609098 wait complete. 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 Processor -- start 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 -- start start 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c003a70 0x7fdc50141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc50141740 0x7fdc500a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500ab420 con 0x7fdc500a9520 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500aa810 con 0x7fdc3c003a70 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc57e04700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500aaaf0 con 0x7fdc50141740 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc563a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc563a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48074/0 (socket says 172.21.15.133:48074) 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.357+0000 7fdc563a1700 1 -- 172.21.15.133:0/2186767929 learned_addr learned my addr 172.21.15.133:0/2186767929 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c003a70 0x7fdc50141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc5539f700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc50141740 0x7fdc500a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 -- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc50141740 msgr2=0x7fdc500a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc50141740 0x7fdc500a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 -- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c003a70 msgr2=0x7fdc50141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c003a70 0x7fdc50141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 -- 172.21.15.133:0/2186767929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500aadd0 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc563a1700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fdc48007aa0 tx=0x7fdc48009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48003280 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480033e0 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc500ab0b0 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48006c50 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.358+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc50142430 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.359+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc50062900 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.359+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdc48003550 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.360+0000 7fdc427fc700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 0x7fdc34061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.360+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdc48079600 con 0x7fdc500a9520 2024-01-21T19:59:42.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.360+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 0x7fdc34061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.360+0000 7fdc55ba0700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 0x7fdc34061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fdc44006d50 tx=0x7fdc4401a000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.364+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdc4804a8d0 con 0x7fdc500a9520 2024-01-21T19:59:42.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.527+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc5005fdf0 con 0x7fdc500a9520 2024-01-21T19:59:42.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.527+0000 7fdc427fc700 1 -- 172.21.15.133:0/2186767929 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc4801c020 con 0x7fdc500a9520 2024-01-21T19:59:42.520 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 msgr2=0x7fdc34061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 0x7fdc34061610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fdc44006d50 tx=0x7fdc4401a000).stop 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 msgr2=0x7fdc50141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fdc48007aa0 tx=0x7fdc48009040).stop 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 shutdown_connections 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdc3405f150 0x7fdc34061610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc500a9520 0x7fdc50141d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc3c003a70 0x7fdc50141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 --2- 172.21.15.133:0/2186767929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc50141740 0x7fdc500a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.529+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 >> 172.21.15.133:0/2186767929 conn(0x7fdc500c8200 msgr2=0x7fdc500bdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.530+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 shutdown_connections 2024-01-21T19:59:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.530+0000 7fdc57e04700 1 -- 172.21.15.133:0/2186767929 wait complete. 2024-01-21T19:59:42.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T19:59:42.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.659+0000 7fe606270700 1 Processor -- start 2024-01-21T19:59:42.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 -- start start 2024-01-21T19:59:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6000c3c20 0x7fe60013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe60013a9e0 0x7fe6000bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000c64d0 con 0x7fe6000c3840 2024-01-21T19:59:42.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe600067f10 con 0x7fe6000c3c20 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.660+0000 7fe606270700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000681f0 con 0x7fe60013a9e0 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6000c3c20 0x7fe60013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6000c3c20 0x7fe60013a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48084/0 (socket says 172.21.15.133:48084) 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5fffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe6000c3840 0x7fe6000c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40462/0 (socket says 172.21.15.133:40462) 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 -- 172.21.15.133:0/3910965064 learned_addr learned my addr 172.21.15.133:0/3910965064 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe60480d700 1 --2- 172.21.15.133:0/3910965064 >> v2:172.21.15.178:3300/0 conn(0x7fe60013a9e0 0x7fe6000bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 -- 172.21.15.133:0/3910965064 >> v2:172.21.15.178:3300/0 conn(0x7fe60013a9e0 msgr2=0x7fe6000bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 --2- 172.21.15.133:0/3910965064 >> v2:172.21.15.178:3300/0 conn(0x7fe60013a9e0 0x7fe6000bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 -- 172.21.15.133:0/3910965064 >> v1:172.21.15.133:6789/0 conn(0x7fe6000c3840 legacy=0x7fe6000c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5feffd700 1 -- 172.21.15.133:0/3910965064 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913455946 0 0) 0x7fe5e8001110 con 0x7fe6000c3840 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 -- 172.21.15.133:0/3910965064 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000684d0 con 0x7fe6000c3c20 2024-01-21T19:59:42.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5ff7fe700 1 --2- 172.21.15.133:0/3910965064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6000c3c20 0x7fe60013a4f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe6000c8eb0 tx=0x7fe5f00090f0).ready entity=mon.0 client_cookie=18d9c7c0a02bdbef server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5feffd700 1 -- 172.21.15.133:0/3910965064 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000b600 con 0x7fe6000c3c20 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5feffd700 1 -- 172.21.15.133:0/3910965064 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f000b760 con 0x7fe6000c3c20 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.661+0000 7fe5feffd700 1 -- 172.21.15.133:0/3910965064 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f000bb00 con 0x7fe6000c3c20 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 -- 172.21.15.133:0/3910965064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6000c3c20 msgr2=0x7fe60013a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 --2- 172.21.15.133:0/3910965064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6000c3c20 0x7fe60013a4f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fe6000c8eb0 tx=0x7fe5f00090f0).stop 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 -- 172.21.15.133:0/3910965064 shutdown_connections 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 --2- 172.21.15.133:0/3910965064 >> v2:172.21.15.178:3300/0 conn(0x7fe60013a9e0 0x7fe6000bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 --2- 172.21.15.133:0/3910965064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6000c3c20 0x7fe60013a4f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 -- 172.21.15.133:0/3910965064 >> 172.21.15.133:0/3910965064 conn(0x7fe600066a70 msgr2=0x7fe600066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 -- 172.21.15.133:0/3910965064 shutdown_connections 2024-01-21T19:59:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.662+0000 7fe606270700 1 -- 172.21.15.133:0/3910965064 wait complete. 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.663+0000 7fe606270700 1 Processor -- start 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.663+0000 7fe606270700 1 -- start start 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6000c3840 0x7fe6001512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 0x7fe600137140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600137b20 con 0x7fe60013a9e0 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600064f60 con 0x7fe6000c3840 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe606270700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe600064350 con 0x7fe6000c3c20 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48100/0 (socket says 172.21.15.133:48100) 2024-01-21T19:59:42.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 -- 172.21.15.133:0/450917629 learned_addr learned my addr 172.21.15.133:0/450917629 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe5ff7fe700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 0x7fe600137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe5fffff700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6000c3840 0x7fe6001512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 -- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 msgr2=0x7fe600137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 0x7fe600137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 -- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6000c3840 msgr2=0x7fe6001512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6000c3840 0x7fe6001512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 -- 172.21.15.133:0/450917629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0009370 con 0x7fe60013a9e0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe5ff7fe700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 0x7fe600137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.664+0000 7fe60480d700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe5f800ceb0 tx=0x7fe5f8007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.665+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ae40 con 0x7fe60013a9e0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.665+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8016400 con 0x7fe60013a9e0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.665+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe600064630 con 0x7fe60013a9e0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.665+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80167a0 con 0x7fe60013a9e0 2024-01-21T19:59:42.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.665+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe600064bf0 con 0x7fe60013a9e0 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.666+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60005fdf0 con 0x7fe60013a9e0 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.666+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe5f8009030 con 0x7fe60013a9e0 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.666+0000 7fe5fcf74700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 0x7fe5e0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.666+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe5f807a640 con 0x7fe60013a9e0 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.666+0000 7fe5fffff700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 0x7fe5e0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.667+0000 7fe5fffff700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 0x7fe5e0061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe5e80015d0 tx=0x7fe5e8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.670+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5f804b9c0 con 0x7fe60013a9e0 2024-01-21T19:59:42.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.834+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe600068ec0 con 0x7fe60013a9e0 2024-01-21T19:59:42.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.834+0000 7fe5fcf74700 1 -- 172.21.15.133:0/450917629 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5f801b020 con 0x7fe60013a9e0 2024-01-21T19:59:42.827 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 msgr2=0x7fe5e0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 0x7fe5e0061610 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe5e80015d0 tx=0x7fe5e8009040).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 msgr2=0x7fe600137630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7fe5f800ceb0 tx=0x7fe5f8007870).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 shutdown_connections 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5e005f150 0x7fe5e0061610 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe60013a9e0 0x7fe600137630 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6000c3840 0x7fe6001512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 --2- 172.21.15.133:0/450917629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6000c3c20 0x7fe600137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.836+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 >> 172.21.15.133:0/450917629 conn(0x7fe600066a70 msgr2=0x7fe600151f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.837+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 shutdown_connections 2024-01-21T19:59:42.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.837+0000 7fe606270700 1 -- 172.21.15.133:0/450917629 wait complete. 2024-01-21T19:59:42.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:42.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.964+0000 7f6926ece700 1 Processor -- start 2024-01-21T19:59:42.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.964+0000 7f6926ece700 1 -- start start 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f6926ece700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69200c3840 0x7f69200c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f6926ece700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f69200bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f6926ece700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6920067f10 con 0x7f69200c5dc0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f6926ece700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69200681f0 con 0x7f69200c3840 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f6926ece700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200684d0 con 0x7f69200c6250 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f691ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f69200c5dc0 0x7f692013a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40468/0 (socket says 172.21.15.133:40468) 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.965+0000 7f691ffff700 1 -- 172.21.15.133:0/1470274291 learned_addr learned my addr 172.21.15.133:0/1470274291 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f6924c6a700 1 --2- 172.21.15.133:0/1470274291 >> v2:172.21.15.178:3300/0 conn(0x7f69200c3840 0x7f69200c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f692546b700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f69200bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756239841 0 0) 0x7f6920067f10 con 0x7f69200c5dc0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69100033f0 con 0x7f69200c5dc0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914971402 0 0) 0x7f69100033f0 con 0x7f69200c5dc0 2024-01-21T19:59:42.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 msgr2=0x7f69200bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f69200bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 >> v2:172.21.15.178:3300/0 conn(0x7f69200c3840 msgr2=0x7f69200c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 --2- 172.21.15.133:0/1470274291 >> v2:172.21.15.178:3300/0 conn(0x7f69200c3840 0x7f69200c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200687b0 con 0x7f69200c5dc0 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f690c001470 con 0x7f69200c5dc0 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 >> v1:172.21.15.133:6789/0 conn(0x7f69200c5dc0 legacy=0x7f692013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100038e0 0x7f6910003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6910004690 0x7f6910004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f6910005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200681f0 con 0x7f6910004690 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200684d0 con 0x7f69100038e0 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691000b8e0 con 0x7f69200c6250 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f691ffff700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6910004690 0x7f6910004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f6924c6a700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100038e0 0x7f6910003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.966+0000 7f692546b700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f6910005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 -- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 msgr2=0x7f6910005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69200c6250 0x7f6910005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 -- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100038e0 msgr2=0x7f6910003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69100038e0 0x7f6910003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 -- 172.21.15.133:0/1470274291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69100033f0 con 0x7f6910004690 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691ffff700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6910004690 0x7f6910004b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f690c00c240 tx=0x7f69201548e0).ready entity=mon.0 client_cookie=1fbc850624912996 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c007a60 con 0x7f6910004690 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c00cad0 con 0x7f6910004690 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f691f7fe700 1 -- 172.21.15.133:0/1470274291 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c00ce50 con 0x7f6910004690 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 -- 172.21.15.133:0/1470274291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6910004690 msgr2=0x7f6910004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 --2- 172.21.15.133:0/1470274291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6910004690 0x7f6910004b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f690c00c240 tx=0x7f69201548e0).stop 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f692546b700 1 -- 172.21.15.133:0/1470274291 reap_dead start 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 -- 172.21.15.133:0/1470274291 shutdown_connections 2024-01-21T19:59:42.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 -- 172.21.15.133:0/1470274291 >> 172.21.15.133:0/1470274291 conn(0x7f6920066a70 msgr2=0x7f6920066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 -- 172.21.15.133:0/1470274291 shutdown_connections 2024-01-21T19:59:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.967+0000 7f6926ece700 1 -- 172.21.15.133:0/1470274291 wait complete. 2024-01-21T19:59:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.969+0000 7f6926ece700 1 Processor -- start 2024-01-21T19:59:42.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.969+0000 7f6926ece700 1 -- start start 2024-01-21T19:59:42.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.969+0000 7f6926ece700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6910004690 0x7f6920154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.969+0000 7f6926ece700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6920137fb0 0x7f69200c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c2980 con 0x7f69200c1460 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920155240 con 0x7f6910004690 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c18e0 con 0x7f6920137fb0 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48116/0 (socket says 172.21.15.133:48116) 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 -- 172.21.15.133:0/2360756855 learned_addr learned my addr 172.21.15.133:0/2360756855 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f691ffff700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6920137fb0 0x7f69200c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6924c6a700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6910004690 0x7f6920154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 -- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6920137fb0 msgr2=0x7f69200c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6920137fb0 0x7f69200c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 -- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6910004690 msgr2=0x7f6920154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:42.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6910004690 0x7f6920154d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 -- 172.21.15.133:0/2360756855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200c1bc0 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f692546b700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f69180094d0 tx=0x7f691800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800e040 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800f040 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69200c1ea0 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800fe20 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.970+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69200c2460 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.971+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69200c2680 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.972+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6918015660 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.972+0000 7f691d7fa700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 0x7f6904061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.972+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f691807ac80 con 0x7f69200c1460 2024-01-21T19:59:42.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.972+0000 7f6924c6a700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 0x7f6904061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:42.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.972+0000 7f6924c6a700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 0x7f6904061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6914009270 tx=0x7f6914008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:42.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:42.976+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f691804bf50 con 0x7f69200c1460 2024-01-21T19:59:43.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.180+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6920068a90 con 0x7f69200c1460 2024-01-21T19:59:43.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.180+0000 7f691d7fa700 1 -- 172.21.15.133:0/2360756855 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f691804f570 con 0x7f69200c1460 2024-01-21T19:59:43.173 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:43.173 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:43.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 msgr2=0x7f6904061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 0x7f6904061610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f6914009270 tx=0x7f6914008040).stop 2024-01-21T19:59:43.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 msgr2=0x7f6920136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f69180094d0 tx=0x7f691800b040).stop 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 shutdown_connections 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f690405f150 0x7f6904061610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69200c1460 0x7f6920136fb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6910004690 0x7f6920154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 --2- 172.21.15.133:0/2360756855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6920137fb0 0x7f69200c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 >> 172.21.15.133:0/2360756855 conn(0x7f6920066a70 msgr2=0x7f6920064fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.182+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 shutdown_connections 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.183+0000 7f6926ece700 1 -- 172.21.15.133:0/2360756855 wait complete. 2024-01-21T19:59:43.176 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:43.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:43.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.309+0000 7f69df3b8700 1 Processor -- start 2024-01-21T19:59:43.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 -- start start 2024-01-21T19:59:43.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066e00 0x7f69d8153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69d80626f0 0x7f69d8062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d8153750 con 0x7f69d8155d30 2024-01-21T19:59:43.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d80671e0 con 0x7f69d8066e00 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.310+0000 7f69df3b8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d8063060 con 0x7f69d80626f0 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066e00 0x7f69d8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066e00 0x7f69d8153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48128/0 (socket says 172.21.15.133:48128) 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 -- 172.21.15.133:0/1700600556 learned_addr learned my addr 172.21.15.133:0/1700600556 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dc953700 1 --2- 172.21.15.133:0/1700600556 >> v2:172.21.15.178:3300/0 conn(0x7f69d80626f0 0x7f69d8062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 -- 172.21.15.133:0/1700600556 >> v2:172.21.15.178:3300/0 conn(0x7f69d80626f0 msgr2=0x7f69d8062b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 --2- 172.21.15.133:0/1700600556 >> v2:172.21.15.178:3300/0 conn(0x7f69d80626f0 0x7f69d8062b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 -- 172.21.15.133:0/1700600556 >> v1:172.21.15.178:6789/0 conn(0x7f69d8155d30 legacy=0x7f69d8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 -- 172.21.15.133:0/1700600556 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80662e0 con 0x7f69d8066e00 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69dd154700 1 --2- 172.21.15.133:0/1700600556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066e00 0x7f69d8153260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f69d80be780 tx=0x7f69cc0090f0).ready entity=mon.0 client_cookie=e82ad1768593f009 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69cbfff700 1 -- 172.21.15.133:0/1700600556 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00b5a0 con 0x7f69d8066e00 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69cbfff700 1 -- 172.21.15.133:0/1700600556 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc00b700 con 0x7f69d8066e00 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.311+0000 7f69cbfff700 1 -- 172.21.15.133:0/1700600556 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc00baa0 con 0x7f69d8066e00 2024-01-21T19:59:43.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 -- 172.21.15.133:0/1700600556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066e00 msgr2=0x7f69d8153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 --2- 172.21.15.133:0/1700600556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066e00 0x7f69d8153260 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f69d80be780 tx=0x7f69cc0090f0).stop 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 -- 172.21.15.133:0/1700600556 shutdown_connections 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 --2- 172.21.15.133:0/1700600556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066e00 0x7f69d8153260 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 --2- 172.21.15.133:0/1700600556 >> v2:172.21.15.178:3300/0 conn(0x7f69d80626f0 0x7f69d8062b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 -- 172.21.15.133:0/1700600556 >> 172.21.15.133:0/1700600556 conn(0x7f69d80c7dc0 msgr2=0x7f69d80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 -- 172.21.15.133:0/1700600556 shutdown_connections 2024-01-21T19:59:43.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.312+0000 7f69df3b8700 1 -- 172.21.15.133:0/1700600556 wait complete. 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.313+0000 7f69df3b8700 1 Processor -- start 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.313+0000 7f69df3b8700 1 -- start start 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 0x7f69d80a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 0x7f69d80a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80ade80 con 0x7f69d80626f0 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8143db0 con 0x7f69d8155d30 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80ad870 con 0x7f69d8066e00 2024-01-21T19:59:43.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48132/0 (socket says 172.21.15.133:48132) 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 -- 172.21.15.133:0/3141678688 learned_addr learned my addr 172.21.15.133:0/3141678688 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dc953700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 0x7f69d80a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd955700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 0x7f69d80a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 -- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 msgr2=0x7f69d80a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 0x7f69d80a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 -- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 msgr2=0x7f69d80a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 0x7f69d80a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 -- 172.21.15.133:0/3141678688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc009370 con 0x7f69d80626f0 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dc953700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 0x7f69d80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd955700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 0x7f69d80a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69dd154700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f69d8068de0 tx=0x7f69cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc006910 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc00b870 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc024470 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.314+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d80a87f0 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.315+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d80a8db0 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.316+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d80bf020 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.316+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f69cc021070 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.316+0000 7f69c9ffb700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 0x7f69bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.316+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f69cc07bd30 con 0x7f69d80626f0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.316+0000 7f69dc953700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 0x7f69bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.317+0000 7f69dc953700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 0x7f69bc061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f69d80c5530 tx=0x7f69d4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.320+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69cc04d000 con 0x7f69d80626f0 2024-01-21T19:59:43.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.487+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69d805fdf0 con 0x7f69d80626f0 2024-01-21T19:59:43.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.488+0000 7f69c9ffb700 1 -- 172.21.15.133:0/3141678688 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f69d805fdf0 con 0x7f69d80626f0 2024-01-21T19:59:43.481 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:43.481 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 msgr2=0x7f69bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 0x7f69bc061610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f69d80c5530 tx=0x7f69d4008040).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 msgr2=0x7f69d81438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f69d8068de0 tx=0x7f69cc015000).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 shutdown_connections 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f69bc05f150 0x7f69bc061610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69d8155d30 0x7f69d80a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d80626f0 0x7f69d81438c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 --2- 172.21.15.133:0/3141678688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69d8066e00 0x7f69d80a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 >> 172.21.15.133:0/3141678688 conn(0x7f69d80c7dc0 msgr2=0x7f69d814fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 shutdown_connections 2024-01-21T19:59:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.490+0000 7f69df3b8700 1 -- 172.21.15.133:0/3141678688 wait complete. 2024-01-21T19:59:43.495 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T19:59:43.495 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:43.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.618+0000 7f7531e80700 1 Processor -- start 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.618+0000 7f7531e80700 1 -- start start 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f7531e80700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f752c1546b0 0x7f752c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f7531e80700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f7531e80700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c0654f0 con 0x7f752c0a9e30 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f7531e80700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c063700 con 0x7f752c1546b0 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f7531e80700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c063950 con 0x7f752c0bc6d0 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f752c1546b0 0x7f752c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f752c1546b0 0x7f752c154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48148/0 (socket says 172.21.15.133:48148) 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 -- 172.21.15.133:0/3157525195 learned_addr learned my addr 172.21.15.133:0/3157525195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752affd700 1 --1- 172.21.15.133:0/3157525195 >> v1:172.21.15.133:6789/0 conn(0x7f752c0a9e30 0x7f752c065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40472/0 (socket says 172.21.15.133:40472) 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752bfff700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 -- 172.21.15.133:0/3157525195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 msgr2=0x7f752c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 -- 172.21.15.133:0/3157525195 >> v1:172.21.15.133:6789/0 conn(0x7f752c0a9e30 legacy=0x7f752c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 -- 172.21.15.133:0/3157525195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c065180 con 0x7f752c1546b0 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752a7fc700 1 -- 172.21.15.133:0/3157525195 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305421975 0 0) 0x7f752c0654f0 con 0x7f752c0a9e30 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752bfff700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752b7fe700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c154a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f751c006fd0 tx=0x7f751c0090f0).ready entity=mon.0 client_cookie=8e42cc6dcdedbf44 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752a7fc700 1 -- 172.21.15.133:0/3157525195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00b600 con 0x7f752c1546b0 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752a7fc700 1 -- 172.21.15.133:0/3157525195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00b760 con 0x7f752c1546b0 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.619+0000 7f752a7fc700 1 -- 172.21.15.133:0/3157525195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00bb00 con 0x7f752c1546b0 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 -- 172.21.15.133:0/3157525195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 msgr2=0x7f752c154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c154a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f751c006fd0 tx=0x7f751c0090f0).stop 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 -- 172.21.15.133:0/3157525195 shutdown_connections 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 --2- 172.21.15.133:0/3157525195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c154a90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 -- 172.21.15.133:0/3157525195 >> 172.21.15.133:0/3157525195 conn(0x7f752c0c8200 msgr2=0x7f752c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 -- 172.21.15.133:0/3157525195 shutdown_connections 2024-01-21T19:59:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.620+0000 7f7531e80700 1 -- 172.21.15.133:0/3157525195 wait complete. 2024-01-21T19:59:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.621+0000 7f7531e80700 1 Processor -- start 2024-01-21T19:59:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.621+0000 7f7531e80700 1 -- start start 2024-01-21T19:59:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c0a9e30 0x7f752c0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c168430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c148d80 con 0x7f752c1546b0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c168e10 con 0x7f752c0a9e30 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f7531e80700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c158860 con 0x7f752c0bc6d0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48160/0 (socket says 172.21.15.133:48160) 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 -- 172.21.15.133:0/4284770132 learned_addr learned my addr 172.21.15.133:0/4284770132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752b7fe700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c0a9e30 0x7f752c0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752affd700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c168430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 -- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 msgr2=0x7f752c168430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c168430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 -- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c0a9e30 msgr2=0x7f752c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c0a9e30 0x7f752c0acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.622+0000 7f752bfff700 1 -- 172.21.15.133:0/4284770132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c009370 con 0x7f752c1546b0 2024-01-21T19:59:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f752bfff700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f752400d100 tx=0x7f75240099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400dda0 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400f040 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c158b40 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524013600 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.623+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c0ab5b0 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.624+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c158cd0 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.624+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f75240139f0 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.624+0000 7f7513fff700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 0x7f7518061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.624+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f752407a880 con 0x7f752c1546b0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.624+0000 7f752b7fe700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 0x7f7518061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.625+0000 7f752b7fe700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 0x7f7518061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f752c0691a0 tx=0x7f751c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.628+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f752404baf0 con 0x7f752c1546b0 2024-01-21T19:59:43.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.831+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f752c05fdf0 con 0x7f752c1546b0 2024-01-21T19:59:43.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.831+0000 7f7513fff700 1 -- 172.21.15.133:0/4284770132 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f752404f110 con 0x7f752c1546b0 2024-01-21T19:59:43.824 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:43.824 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 msgr2=0x7f7518061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 0x7f7518061610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f752c0691a0 tx=0x7f751c017000).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 msgr2=0x7f752c168920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f752400d100 tx=0x7f75240099b0).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 shutdown_connections 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f751805f150 0x7f7518061610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f752c1546b0 0x7f752c168920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c0a9e30 0x7f752c0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 --2- 172.21.15.133:0/4284770132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f752c0bc6d0 0x7f752c168430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.833+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 >> 172.21.15.133:0/4284770132 conn(0x7f752c0c8200 msgr2=0x7f752c1530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.834+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 shutdown_connections 2024-01-21T19:59:43.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.834+0000 7f7531e80700 1 -- 172.21.15.133:0/4284770132 wait complete. 2024-01-21T19:59:43.827 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:43.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:43.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.962+0000 7f62dd6eb700 1 Processor -- start 2024-01-21T19:59:43.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.962+0000 7f62dd6eb700 1 -- start start 2024-01-21T19:59:43.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62dd6eb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62d80c8120 0x7f62d8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62dd6eb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d80c0e40 con 0x7f62d8154140 2024-01-21T19:59:43.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62dd6eb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d81549b0 con 0x7f62d8154520 2024-01-21T19:59:43.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62dd6eb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d80c6ae0 con 0x7f62d80c8120 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62d6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f62d8154140 0x7f62d80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40476/0 (socket says 172.21.15.133:40476) 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62d6ffd700 1 -- 172.21.15.133:0/2691383171 learned_addr learned my addr 172.21.15.133:0/2691383171 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183027473 0 0) 0x7f62d80c0e40 con 0x7f62d8154140 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c00033f0 con 0x7f62d8154140 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.963+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> v2:172.21.15.178:3300/0 conn(0x7f62d80c8120 0x7f62d8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620307608 0 0) 0x7f62c00033f0 con 0x7f62d8154140 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 >> v2:172.21.15.178:3300/0 conn(0x7f62d80c8120 msgr2=0x7f62d8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 --2- 172.21.15.133:0/2691383171 >> v2:172.21.15.178:3300/0 conn(0x7f62d80c8120 0x7f62d8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 >> v1:172.21.15.178:6789/0 conn(0x7f62d8154520 legacy=0x7f62d80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80c6800 con 0x7f62d8154140 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> v2:172.21.15.178:3300/0 conn(0x7f62d80c8120 0x7f62d8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f62cc001470 con 0x7f62d8154140 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 >> v1:172.21.15.133:6789/0 conn(0x7f62d8154140 legacy=0x7f62d80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c00038e0 0x7f62c0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0005050 0x7f62c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c6ae0 con 0x7f62c0004690 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c000bfe0 con 0x7f62c00038e0 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c000c1a0 con 0x7f62c0005050 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d6ffd700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c00038e0 0x7f62c0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d77fe700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0005050 0x7f62c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 -- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0005050 msgr2=0x7f62c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0005050 0x7f62c000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 -- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c00038e0 msgr2=0x7f62c0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c00038e0 0x7f62c0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 -- 172.21.15.133:0/2691383171 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00033f0 con 0x7f62c0004690 2024-01-21T19:59:43.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d77fe700 1 -- 172.21.15.133:0/2691383171 reap_dead start 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62c0004b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f62c800bad0 tx=0x7f62c8008040).ready entity=mon.0 client_cookie=d911b0c6cc965dac server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800b410 con 0x7f62c0004690 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800d5d0 con 0x7f62c0004690 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.964+0000 7f62d5ffb700 1 -- 172.21.15.133:0/2691383171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800d990 con 0x7f62c0004690 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 msgr2=0x7f62c0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62c0004b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f62c800bad0 tx=0x7f62c8008040).stop 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2691383171 shutdown_connections 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2691383171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62c0004b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2691383171 >> 172.21.15.133:0/2691383171 conn(0x7f62d805e1e0 msgr2=0x7f62d805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2691383171 shutdown_connections 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.965+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2691383171 wait complete. 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.966+0000 7f62dd6eb700 1 Processor -- start 2024-01-21T19:59:43.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.966+0000 7f62dd6eb700 1 -- start start 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62d8145720 0x7f62d8145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62d80cb6a0 0x7f62d80cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c9ae0 con 0x7f62c0004690 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c9d80 con 0x7f62d80cb6a0 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62dd6eb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80ca060 con 0x7f62d8145720 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62d6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62d6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48164/0 (socket says 172.21.15.133:48164) 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62d6ffd700 1 -- 172.21.15.133:0/2113252872 learned_addr learned my addr 172.21.15.133:0/2113252872 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62d8145720 0x7f62d8145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.967+0000 7f62d77fe700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62d80cb6a0 0x7f62d80cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 -- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62d8145720 msgr2=0x7f62d8145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62d8145720 0x7f62d8145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 -- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62d80cb6a0 msgr2=0x7f62d80cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62d80cb6a0 0x7f62d80cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 -- 172.21.15.133:0/2113252872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80ca340 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62d6ffd700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f62cc0049e0 tx=0x7f62cc001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc004e50 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc00f870 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80ca620 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc00fbf0 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.968+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d8168190 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.969+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d80ca860 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.969+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f62cc01c360 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.969+0000 7f62bf7fe700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 0x7f62c4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.970+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62cc079850 con 0x7f62c0004690 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.970+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 0x7f62c4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:43.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.970+0000 7f62d67fc700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 0x7f62c4061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f62c8008010 tx=0x7f62c8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:43.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:43.974+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f62cc049b00 con 0x7f62c0004690 2024-01-21T19:59:44.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.177+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d805fdf0 con 0x7f62c0004690 2024-01-21T19:59:44.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.178+0000 7f62bf7fe700 1 -- 172.21.15.133:0/2113252872 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f62cc019020 con 0x7f62c0004690 2024-01-21T19:59:44.170 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:44.170 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4251,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/440722347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":440722347},{"type":"v1","addr":"172.21.15.133:6835","nonce":440722347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/254347906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":254347906},{"type":"v1","addr":"172.21.15.133:6837","nonce":254347906}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3541390164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3541390164},{"type":"v1","addr":"172.21.15.178:6834","nonce":3541390164}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:06.385325+0000","modified":"2024-01-21T19:59:08.391173+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/287382996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":287382996},{"type":"v1","addr":"172.21.15.178:6835","nonce":287382996}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-01-21T19:59:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 msgr2=0x7f62c4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 0x7f62c4061610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f62c8008010 tx=0x7f62c8008040).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 msgr2=0x7f62d80cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f62cc0049e0 tx=0x7f62cc001e50).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 shutdown_connections 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f62c405f150 0x7f62c4061610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62d80cb6a0 0x7f62d80cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62c0004690 0x7f62d80cab40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 --2- 172.21.15.133:0/2113252872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62d8145720 0x7f62d8145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 >> 172.21.15.133:0/2113252872 conn(0x7f62d805e1e0 msgr2=0x7f62d80ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 shutdown_connections 2024-01-21T19:59:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.180+0000 7f62dd6eb700 1 -- 172.21.15.133:0/2113252872 wait complete. 2024-01-21T19:59:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2024-01-21T19:59:44.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.307+0000 7f70476dc700 1 Processor -- start 2024-01-21T19:59:44.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.307+0000 7f70476dc700 1 -- start start 2024-01-21T19:59:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f70476dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f70400beb30 0x7f7040155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f70476dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040065660 con 0x7f70400c3fb0 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f70476dc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040065f00 con 0x7f7040069ef0 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f70476dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400bef10 con 0x7f70400beb30 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7045478700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f70400beb30 0x7f7040155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7044c77700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f70400c3fb0 0x7f70400697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40484/0 (socket says 172.21.15.133:40484) 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7044c77700 1 -- 172.21.15.133:0/815688253 learned_addr learned my addr 172.21.15.133:0/815688253 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7045478700 1 -- 172.21.15.133:0/815688253 >> v1:172.21.15.178:6789/0 conn(0x7f7040069ef0 legacy=0x7f7040066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7045478700 1 -- 172.21.15.133:0/815688253 >> v1:172.21.15.133:6789/0 conn(0x7f70400c3fb0 legacy=0x7f70400697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7037fff700 1 -- 172.21.15.133:0/815688253 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726857283 0 0) 0x7f7040065660 con 0x7f70400c3fb0 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.308+0000 7f7045478700 1 -- 172.21.15.133:0/815688253 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400c4740 con 0x7f70400beb30 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f7045478700 1 --2- 172.21.15.133:0/815688253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f7040155b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f703c009760 tx=0x7f703c009060).ready entity=mon.0 client_cookie=d3ee8dfe55a1b0f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f7037fff700 1 -- 172.21.15.133:0/815688253 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c009120 con 0x7f70400beb30 2024-01-21T19:59:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f7037fff700 1 -- 172.21.15.133:0/815688253 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c00b580 con 0x7f70400beb30 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f7037fff700 1 -- 172.21.15.133:0/815688253 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00b900 con 0x7f70400beb30 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 -- 172.21.15.133:0/815688253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 msgr2=0x7f7040155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 --2- 172.21.15.133:0/815688253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f7040155b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f703c009760 tx=0x7f703c009060).stop 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 -- 172.21.15.133:0/815688253 shutdown_connections 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 --2- 172.21.15.133:0/815688253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f7040155b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 -- 172.21.15.133:0/815688253 >> 172.21.15.133:0/815688253 conn(0x7f70400c8010 msgr2=0x7f70400c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 -- 172.21.15.133:0/815688253 shutdown_connections 2024-01-21T19:59:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.309+0000 7f70476dc700 1 -- 172.21.15.133:0/815688253 wait complete. 2024-01-21T19:59:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.310+0000 7f70476dc700 1 Processor -- start 2024-01-21T19:59:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 -- start start 2024-01-21T19:59:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7040069ef0 0x7f70400ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 0x7f70400c1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ad3f0 con 0x7f70400beb30 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400ac7e0 con 0x7f70400c3fb0 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f70476dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400acac0 con 0x7f7040069ef0 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f7044c77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f7044c77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48180/0 (socket says 172.21.15.133:48180) 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.311+0000 7f7044c77700 1 -- 172.21.15.133:0/1463783329 learned_addr learned my addr 172.21.15.133:0/1463783329 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 -- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7040069ef0 msgr2=0x7f70400ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7040069ef0 0x7f70400ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 -- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 msgr2=0x7f70400c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7045c79700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 0x7f70400c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 0x7f70400c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 -- 172.21.15.133:0/1463783329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0092a0 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7045c79700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 0x7f70400c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7044c77700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f703000c4c0 tx=0x7f7030007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300072e0 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030007440 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70400acda0 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300057a0 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.312+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70400add70 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.313+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70400adf90 con 0x7f70400beb30 2024-01-21T19:59:44.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.313+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7030005b90 con 0x7f70400beb30 2024-01-21T19:59:44.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.314+0000 7f7035ffb700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 0x7f7024061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.314+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7030079a70 con 0x7f70400beb30 2024-01-21T19:59:44.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.314+0000 7f7045478700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 0x7f7024061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.314+0000 7f7045478700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 0x7f7024061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7040154e50 tx=0x7f703c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.318+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f703004ad40 con 0x7f70400beb30 2024-01-21T19:59:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.481+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f704005fdf0 con 0x7f70400beb30 2024-01-21T19:59:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.482+0000 7f7035ffb700 1 -- 172.21.15.133:0/1463783329 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f703004e360 con 0x7f70400beb30 2024-01-21T19:59:44.475 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:44.475 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:07.387183+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:04.740822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:05.352435+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 msgr2=0x7f7024061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 0x7f7024061610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7040154e50 tx=0x7f703c017000).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 msgr2=0x7f70401659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f703000c4c0 tx=0x7f7030007c10).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 shutdown_connections 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f702405f150 0x7f7024061610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400c3fb0 0x7f70400c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7040069ef0 0x7f70400ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 --2- 172.21.15.133:0/1463783329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70400beb30 0x7f70401659f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 >> 172.21.15.133:0/1463783329 conn(0x7f70400c8010 msgr2=0x7f7040139dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 shutdown_connections 2024-01-21T19:59:44.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.484+0000 7f70476dc700 1 -- 172.21.15.133:0/1463783329 wait complete. 2024-01-21T19:59:44.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T19:59:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.613+0000 7f7ba188c700 1 Processor -- start 2024-01-21T19:59:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.613+0000 7f7ba188c700 1 -- start start 2024-01-21T19:59:44.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7ba188c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b9c154d80 0x7f7b9c0c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7ba188c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0c3740 con 0x7f7b9c1559d0 2024-01-21T19:59:44.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7ba188c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0c22e0 con 0x7f7b9c1549a0 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7ba188c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c25c0 con 0x7f7b9c154d80 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b9c154d80 0x7f7b9c0c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7b9c1559d0 0x7f7b9c0a4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40486/0 (socket says 172.21.15.133:40486) 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9a7fc700 1 -- 172.21.15.133:0/1777703429 learned_addr learned my addr 172.21.15.133:0/1777703429 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1777703429 >> v1:172.21.15.178:6789/0 conn(0x7f7b9c1549a0 legacy=0x7f7b9c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1777703429 >> v1:172.21.15.133:6789/0 conn(0x7f7b9c1559d0 legacy=0x7f7b9c0a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b99ffb700 1 -- 172.21.15.133:0/1777703429 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448202239 0 0) 0x7f7b9c0c3740 con 0x7f7b9c1559d0 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.614+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1777703429 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0c28a0 con 0x7f7b9c154d80 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7b9b7fe700 1 --2- 172.21.15.133:0/1777703429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c154d80 0x7f7b9c0c3250 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7b94009e60 tx=0x7f7b94009780).ready entity=mon.0 client_cookie=ab8d205dce5df0af server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7b99ffb700 1 -- 172.21.15.133:0/1777703429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400e070 con 0x7f7b9c154d80 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7b99ffb700 1 -- 172.21.15.133:0/1777703429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400bbf0 con 0x7f7b9c154d80 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7b99ffb700 1 -- 172.21.15.133:0/1777703429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94012410 con 0x7f7b9c154d80 2024-01-21T19:59:44.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 -- 172.21.15.133:0/1777703429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c154d80 msgr2=0x7f7b9c0c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1777703429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c154d80 0x7f7b9c0c3250 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7b94009e60 tx=0x7f7b94009780).stop 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 -- 172.21.15.133:0/1777703429 shutdown_connections 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1777703429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c154d80 0x7f7b9c0c3250 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 -- 172.21.15.133:0/1777703429 >> 172.21.15.133:0/1777703429 conn(0x7f7b9c0c6ef0 msgr2=0x7f7b9c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 -- 172.21.15.133:0/1777703429 shutdown_connections 2024-01-21T19:59:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.615+0000 7f7ba188c700 1 -- 172.21.15.133:0/1777703429 wait complete. 2024-01-21T19:59:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 Processor -- start 2024-01-21T19:59:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 -- start start 2024-01-21T19:59:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 0x7f7b9c064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 0x7f7b9c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0ab370 con 0x7f7b9c1559d0 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0c6c50 con 0x7f7b9c154d80 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7ba188c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0649b0 con 0x7f7b9c1549a0 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7b9b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7b9b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48204/0 (socket says 172.21.15.133:48204) 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.617+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1750117038 learned_addr learned my addr 172.21.15.133:0/1750117038 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9a7fc700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 0x7f7b9c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9affd700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 0x7f7b9c064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 msgr2=0x7f7b9c064320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 0x7f7b9c064320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 msgr2=0x7f7b9c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:44.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 0x7f7b9c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 -- 172.21.15.133:0/1750117038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009a20 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9a7fc700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 0x7f7b9c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9affd700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 0x7f7b9c064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b9b7fe700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7b9400b6c0 tx=0x7f7b94009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940117d0 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b94011930 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c064c90 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94011cd0 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.618+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c065250 con 0x7f7b9c1559d0 2024-01-21T19:59:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.619+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c0ab570 con 0x7f7b9c1559d0 2024-01-21T19:59:44.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.620+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7b9401d630 con 0x7f7b9c1559d0 2024-01-21T19:59:44.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.620+0000 7f7b837fe700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 0x7f7b88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:44.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.620+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7b9407c2e0 con 0x7f7b9c1559d0 2024-01-21T19:59:44.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.620+0000 7f7b9affd700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 0x7f7b88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:44.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.621+0000 7f7b9affd700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 0x7f7b88061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7b900026f0 tx=0x7f7b90009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:44.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.624+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b9c0ab570 con 0x7f7b9c1559d0 2024-01-21T19:59:44.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:44.829+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7b9c0ab540 con 0x7f7b9c1559d0 2024-01-21T19:59:45.022 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:59:45.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T19:59:45.110 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T19:59:45.118+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T19:59:45.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.123+0000 7f7b837fe700 1 -- 172.21.15.133:0/1750117038 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7b94050fe0 con 0x7f7b9c1559d0 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 msgr2=0x7f7b88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 0x7f7b88061610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7b900026f0 tx=0x7f7b90009040).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 msgr2=0x7f7b9c0c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7b9400b6c0 tx=0x7f7b94009780).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 shutdown_connections 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b8805f150 0x7f7b88061610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b9c1559d0 0x7f7b9c0c4d00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b9c1549a0 0x7f7b9c064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 --2- 172.21.15.133:0/1750117038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b9c154d80 0x7f7b9c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 >> 172.21.15.133:0/1750117038 conn(0x7f7b9c0c6ef0 msgr2=0x7f7b9c0a5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 shutdown_connections 2024-01-21T19:59:45.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.125+0000 7f7ba188c700 1 -- 172.21.15.133:0/1750117038 wait complete. 2024-01-21T19:59:45.119 INFO:tasks.ceph.mds.d.smithi178.stderr: -1876> 2024-01-21T19:59:08.001+0000 7f1da3ee6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T19:59:45.119 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T19:59:45.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T19:59:45.141 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T19:59:45.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.296+0000 7f9dfdcc8700 1 Processor -- start 2024-01-21T19:59:45.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.296+0000 7f9dfdcc8700 1 -- start start 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.296+0000 7f9dfdcc8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813a620 0x7f9df80a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.296+0000 7f9dfdcc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9df813aa00 0x7f9df8158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9dfdcc8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df81584f0 con 0x7f9df80626f0 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9dfdcc8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80bd6f0 con 0x7f9df813aa00 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9dfdcc8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80654e0 con 0x7f9df813a620 2024-01-21T19:59:45.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9df813aa00 0x7f9df8158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9df813aa00 0x7f9df8158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48216/0 (socket says 172.21.15.133:48216) 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 -- 172.21.15.133:0/2089951102 learned_addr learned my addr 172.21.15.133:0/2089951102 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df77fe700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813a620 0x7f9df80a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 -- 172.21.15.133:0/2089951102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813a620 msgr2=0x7f9df80a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813a620 0x7f9df80a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 -- 172.21.15.133:0/2089951102 >> v1:172.21.15.178:6789/0 conn(0x7f9df80626f0 legacy=0x7f9df80695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 -- 172.21.15.133:0/2089951102 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df8158730 con 0x7f9df813aa00 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df6ffd700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df813aa00 0x7f9df8158000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9de8006fd0 tx=0x7f9de80090f0).ready entity=mon.0 client_cookie=ff5bb5a9be7c5936 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df67fc700 1 -- 172.21.15.133:0/2089951102 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de800b580 con 0x7f9df813aa00 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df67fc700 1 -- 172.21.15.133:0/2089951102 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de800b6e0 con 0x7f9df813aa00 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.297+0000 7f9df67fc700 1 -- 172.21.15.133:0/2089951102 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de800ba80 con 0x7f9df813aa00 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2089951102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df813aa00 msgr2=0x7f9df8158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df813aa00 0x7f9df8158000 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f9de8006fd0 tx=0x7f9de80090f0).stop 2024-01-21T19:59:45.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2089951102 shutdown_connections 2024-01-21T19:59:45.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813a620 0x7f9df80a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2089951102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df813aa00 0x7f9df8158000 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2089951102 >> 172.21.15.133:0/2089951102 conn(0x7f9df80c7dc0 msgr2=0x7f9df80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:45.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2089951102 shutdown_connections 2024-01-21T19:59:45.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.298+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2089951102 wait complete. 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.299+0000 7f9dfdcc8700 1 Processor -- start 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.300+0000 7f9dfdcc8700 1 -- start start 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.300+0000 7f9dfdcc8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9dfdcc8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df813a620 0x7f9df80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9dfdcc8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813aa00 0x7f9df8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9dfdcc8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80c01e0 con 0x7f9df80626f0 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9dfdcc8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80bfd20 con 0x7f9df813a620 2024-01-21T19:59:45.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9dfdcc8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80c0e20 con 0x7f9df813aa00 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48220/0 (socket says 172.21.15.133:48220) 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 -- 172.21.15.133:0/2764593372 learned_addr learned my addr 172.21.15.133:0/2764593372 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df7fff700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813aa00 0x7f9df8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 -- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813aa00 msgr2=0x7f9df8156990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813aa00 0x7f9df8156990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 -- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df813a620 msgr2=0x7f9df80ad9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df813a620 0x7f9df80ad9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 -- 172.21.15.133:0/2764593372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de8009370 con 0x7f9df80626f0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.301+0000 7f9df77fe700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f9de000e980 tx=0x7f9de0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.302+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000ee70 con 0x7f9df80626f0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.302+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de000c7f0 con 0x7f9df80626f0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.302+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df80adea0 con 0x7f9df80626f0 2024-01-21T19:59:45.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.302+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de000cb70 con 0x7f9df80626f0 2024-01-21T19:59:45.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.302+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df80c07d0 con 0x7f9df80626f0 2024-01-21T19:59:45.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.303+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df80c0630 con 0x7f9df80626f0 2024-01-21T19:59:45.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.303+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9de001b400 con 0x7f9df80626f0 2024-01-21T19:59:45.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.303+0000 7f9deffff700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 0x7f9dd8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:45.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.303+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9de007a840 con 0x7f9df80626f0 2024-01-21T19:59:45.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.304+0000 7f9df6ffd700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 0x7f9dd8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:45.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.304+0000 7f9df6ffd700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 0x7f9dd8061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9de8006fd0 tx=0x7f9de8017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:45.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.307+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9df80c0630 con 0x7f9df80626f0 2024-01-21T19:59:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:45.512+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9df80c0630 con 0x7f9df80626f0 2024-01-21T19:59:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.130+0000 7f9deffff700 1 -- 172.21.15.133:0/2764593372 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9df80c0630 con 0x7f9df80626f0 2024-01-21T19:59:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 msgr2=0x7f9dd8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 0x7f9dd8061610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f9de8006fd0 tx=0x7f9de8017000).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 msgr2=0x7f9df80bf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f9de000e980 tx=0x7f9de0009060).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 shutdown_connections 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9dd805f150 0x7f9dd8061610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9df813aa00 0x7f9df8156990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df80626f0 0x7f9df80bf830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 --2- 172.21.15.133:0/2764593372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9df813a620 0x7f9df80ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 >> 172.21.15.133:0/2764593372 conn(0x7f9df80c7dc0 msgr2=0x7f9df80c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 shutdown_connections 2024-01-21T19:59:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.133+0000 7f9dfdcc8700 1 -- 172.21.15.133:0/2764593372 wait complete. 2024-01-21T19:59:46.140 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T19:59:46.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.271+0000 7f61b3697700 1 Processor -- start 2024-01-21T19:59:46.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 -- start start 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac065cc0 con 0x7f61ac0bdce0 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac0c4620 con 0x7f61ac137750 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.272+0000 7f61b3697700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0c3df0 con 0x7f61ac0c3960 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1433700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b0c32700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f61ac0bdce0 0x7f61ac0c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:51248/0 (socket says 172.21.15.133:51248) 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1433700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:50136/0 (socket says 172.21.15.133:50136) 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b0c32700 1 -- 172.21.15.133:0/3638506962 learned_addr learned my addr 172.21.15.133:0/3638506962 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:46.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:51890/0 (socket says 172.21.15.133:51890) 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 -- 172.21.15.133:0/3638506962 >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 msgr2=0x7f61ac138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 --2- 172.21.15.133:0/3638506962 >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 -- 172.21.15.133:0/3638506962 >> v1:172.21.15.178:6789/0 conn(0x7f61ac0bdce0 legacy=0x7f61ac0c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 -- 172.21.15.133:0/3638506962 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0be630 con 0x7f61ac0c3960 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1433700 1 --2- 172.21.15.133:0/3638506962 >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.273+0000 7f61b1c34700 1 --2- 172.21.15.133:0/3638506962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f61a400d0d0 tx=0x7f61a400b990).ready entity=mon.2 client_cookie=f3d8bde765d827ae server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61a3fff700 1 -- 172.21.15.133:0/3638506962 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4010070 con 0x7f61ac0c3960 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61a3fff700 1 -- 172.21.15.133:0/3638506962 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400b2e0 con 0x7f61ac0c3960 2024-01-21T19:59:46.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61a3fff700 1 -- 172.21.15.133:0/3638506962 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400dd40 con 0x7f61ac0c3960 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 -- 172.21.15.133:0/3638506962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 msgr2=0x7f61ac0be140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 --2- 172.21.15.133:0/3638506962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f61a400d0d0 tx=0x7f61a400b990).stop 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 -- 172.21.15.133:0/3638506962 shutdown_connections 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 --2- 172.21.15.133:0/3638506962 >> v2:172.21.15.178:3300/0 conn(0x7f61ac137750 0x7f61ac138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 --2- 172.21.15.133:0/3638506962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0c3960 0x7f61ac0be140 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 -- 172.21.15.133:0/3638506962 >> 172.21.15.133:0/3638506962 conn(0x7f61ac0c7cd0 msgr2=0x7f61ac0c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 -- 172.21.15.133:0/3638506962 shutdown_connections 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.274+0000 7f61b3697700 1 -- 172.21.15.133:0/3638506962 wait complete. 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.275+0000 7f61b3697700 1 Processor -- start 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.275+0000 7f61b3697700 1 -- start start 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0bdce0 0x7f61ac14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61ac137750 0x7f61ac14c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ad040 con 0x7f61ac0c3960 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ac430 con 0x7f61ac137750 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b3697700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ac710 con 0x7f61ac0bdce0 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b0c32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b0c32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48226/0 (socket says 172.21.15.133:48226) 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.276+0000 7f61b0c32700 1 -- 172.21.15.133:0/137579731 learned_addr learned my addr 172.21.15.133:0/137579731 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b1c34700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61ac137750 0x7f61ac14c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b1433700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0bdce0 0x7f61ac14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 -- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0bdce0 msgr2=0x7f61ac14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0bdce0 0x7f61ac14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 -- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61ac137750 msgr2=0x7f61ac14c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61ac137750 0x7f61ac14c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 -- 172.21.15.133:0/137579731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0092a0 con 0x7f61ac0c3960 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b0c32700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f61a8001eb0 tx=0x7f61a8007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:46.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80072e0 con 0x7f61ac0c3960 2024-01-21T19:59:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a8007440 con 0x7f61ac0c3960 2024-01-21T19:59:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80057a0 con 0x7f61ac0c3960 2024-01-21T19:59:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a400bc30 con 0x7f61ac0c3960 2024-01-21T19:59:46.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.277+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac0accd0 con 0x7f61ac0c3960 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.278+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac0ad1b0 con 0x7f61ac0c3960 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.278+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f61a8005b10 con 0x7f61ac0c3960 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.279+0000 7f61a1ffb700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 0x7f6190061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.279+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f61a8079960 con 0x7f61ac0c3960 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.279+0000 7f61b1433700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 0x7f6190061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:46.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.279+0000 7f61b1433700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 0x7f6190061610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f619c009cc0 tx=0x7f619c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:46.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.283+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f61a804abe0 con 0x7f61ac0c3960 2024-01-21T19:59:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:46.450+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61ac0c4060 con 0x7f61ac0c3960 2024-01-21T19:59:47.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.134+0000 7f61a1ffb700 1 -- 172.21.15.133:0/137579731 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f61a804e200 con 0x7f61ac0c3960 2024-01-21T19:59:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 msgr2=0x7f6190061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 0x7f6190061610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f619c009cc0 tx=0x7f619c008040).stop 2024-01-21T19:59:47.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 msgr2=0x7f61ac0abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f61a8001eb0 tx=0x7f61a8007e50).stop 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 shutdown_connections 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f619005f150 0x7f6190061610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61ac137750 0x7f61ac14c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61ac0bdce0 0x7f61ac14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 --2- 172.21.15.133:0/137579731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61ac0c3960 0x7f61ac0abc20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 >> 172.21.15.133:0/137579731 conn(0x7f61ac0c7cd0 msgr2=0x7f61ac14f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 shutdown_connections 2024-01-21T19:59:47.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.138+0000 7f61b3697700 1 -- 172.21.15.133:0/137579731 wait complete. 2024-01-21T19:59:47.132 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T19:59:47.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T19:59:47.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.274+0000 7f4c3d9a7700 1 Processor -- start 2024-01-21T19:59:47.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.275+0000 7f4c3d9a7700 1 -- start start 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.275+0000 7f4c3d9a7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c38066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.275+0000 7f4c3d9a7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380c37c0 con 0x7f4c38157f30 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.275+0000 7f4c3d9a7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c381583b0 con 0x7f4c380c5330 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.275+0000 7f4c3d9a7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38158ed0 con 0x7f4c38066b50 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c367fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4c38157f30 0x7f4c380bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40498/0 (socket says 172.21.15.133:40498) 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c367fc700 1 -- 172.21.15.133:0/2411354904 learned_addr learned my addr 172.21.15.133:0/2411354904 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c36ffd700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c38066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130394392 0 0) 0x7f4c380c37c0 con 0x7f4c38157f30 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c240033f0 con 0x7f4c38157f30 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433298804 0 0) 0x7f4c240033f0 con 0x7f4c38157f30 2024-01-21T19:59:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 msgr2=0x7f4c38066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c38066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 >> v1:172.21.15.178:6789/0 conn(0x7f4c380c5330 legacy=0x7f4c38153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380c57c0 con 0x7f4c38157f30 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f4c20001470 con 0x7f4c38157f30 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 >> v1:172.21.15.133:6789/0 conn(0x7f4c38157f30 legacy=0x7f4c380bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c24003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c24003e40 0x7f4c24004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c24004b80 0x7f4c24005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38158ed0 con 0x7f4c24004b80 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2400ba10 con 0x7f4c24003e40 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2400bbd0 con 0x7f4c38066b50 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c377fe700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c24004b80 0x7f4c24005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c36ffd700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c24003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.276+0000 7f4c367fc700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c24003e40 0x7f4c24004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 -- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 msgr2=0x7f4c24003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38066b50 0x7f4c24003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 -- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c24003e40 msgr2=0x7f4c24004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c24003e40 0x7f4c24004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 -- 172.21.15.133:0/2411354904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c240033f0 con 0x7f4c24004b80 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c24004b80 0x7f4c24005000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f4c28001e30 tx=0x7f4c28007f30).ready entity=mon.0 client_cookie=4ecaa65879b4b680 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28006a20 con 0x7f4c24004b80 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28006b80 con 0x7f4c24004b80 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c35ffb700 1 -- 172.21.15.133:0/2411354904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800c5d0 con 0x7f4c24004b80 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/2411354904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c24004b80 msgr2=0x7f4c24005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/2411354904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c24004b80 0x7f4c24005000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f4c28001e30 tx=0x7f4c28007f30).stop 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c377fe700 1 -- 172.21.15.133:0/2411354904 reap_dead start 2024-01-21T19:59:47.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/2411354904 shutdown_connections 2024-01-21T19:59:47.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/2411354904 >> 172.21.15.133:0/2411354904 conn(0x7f4c380c8f60 msgr2=0x7f4c380c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:47.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/2411354904 shutdown_connections 2024-01-21T19:59:47.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.277+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/2411354904 wait complete. 2024-01-21T19:59:47.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.279+0000 7f4c3d9a7700 1 Processor -- start 2024-01-21T19:59:47.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.279+0000 7f4c3d9a7700 1 -- start start 2024-01-21T19:59:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.279+0000 7f4c3d9a7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c381448b0 0x7f4c380abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.279+0000 7f4c3d9a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c380c2920 0x7f4c38168030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c00a0 con 0x7f4c380acae0 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380c0380 con 0x7f4c380c2920 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380ac8d0 con 0x7f4c381448b0 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48254/0 (socket says 172.21.15.133:48254) 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 -- 172.21.15.133:0/3347566339 learned_addr learned my addr 172.21.15.133:0/3347566339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c36ffd700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c381448b0 0x7f4c380abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c377fe700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c380c2920 0x7f4c38168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 -- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c381448b0 msgr2=0x7f4c380abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c381448b0 0x7f4c380abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 -- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c380c2920 msgr2=0x7f4c38168030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c380c2920 0x7f4c38168030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 -- 172.21.15.133:0/3347566339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c380ae8d0 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c367fc700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4c20007f90 tx=0x7f4c380c3730).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20011590 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c200116f0 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380ae030 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20011a70 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.280+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c380ae5f0 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.281+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c380c04c0 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.282+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c2001d3b0 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.282+0000 7f4c2f7fe700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 0x7f4c18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.282+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f4c20079760 con 0x7f4c380acae0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.282+0000 7f4c36ffd700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 0x7f4c18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:47.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.282+0000 7f4c36ffd700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 0x7f4c18061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4c30006d50 tx=0x7f4c30008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:47.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.286+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c380c04c0 con 0x7f4c380acae0 2024-01-21T19:59:47.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:47.459+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c380c04c0 con 0x7f4c380acae0 2024-01-21T19:59:48.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.139+0000 7f4c2f7fe700 1 -- 172.21.15.133:0/3347566339 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c380c04c0 con 0x7f4c380acae0 2024-01-21T19:59:48.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 msgr2=0x7f4c18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:48.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 0x7f4c18061610 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4c30006d50 tx=0x7f4c30008040).stop 2024-01-21T19:59:48.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 msgr2=0x7f4c380ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4c20007f90 tx=0x7f4c380c3730).stop 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 shutdown_connections 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c1805f150 0x7f4c18061610 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c380c2920 0x7f4c38168030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c381448b0 0x7f4c380abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 --2- 172.21.15.133:0/3347566339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c380acae0 0x7f4c380ac3e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 >> 172.21.15.133:0/3347566339 conn(0x7f4c380c8f60 msgr2=0x7f4c380bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 shutdown_connections 2024-01-21T19:59:48.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.144+0000 7f4c3d9a7700 1 -- 172.21.15.133:0/3347566339 wait complete. 2024-01-21T19:59:48.138 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T19:59:48.151 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T19:59:48.151 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T19:59:48.151 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T19:59:48.152 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T19:59:48.152 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T19:59:48.152 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T19:59:48.152 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T19:59:48.152 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T19:59:48.152 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T19:59:48.152 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T19:59:48.153 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T19:59:48.153 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T19:59:48.153 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T19:59:48.153 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T19:59:48.153 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T19:59:48.153 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T19:59:48.161 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T19:59:48.161 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T19:59:48.162 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T19:59:48.162 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T19:59:48.163 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T19:59:48.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T19:59:48.170 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T19:59:48.171 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T19:59:48.205 INFO:tasks.ceph.mds.a:Started 2024-01-21T19:59:48.205 DEBUG:teuthology.parallel:result is None 2024-01-21T19:59:48.205 INFO:tasks.ceph.mds.c:Started 2024-01-21T19:59:48.206 DEBUG:teuthology.parallel:result is None 2024-01-21T19:59:48.212 INFO:tasks.ceph.mds.b:Started 2024-01-21T19:59:48.212 DEBUG:teuthology.parallel:result is None 2024-01-21T19:59:48.213 INFO:tasks.ceph.mds.d:Started 2024-01-21T19:59:48.213 DEBUG:teuthology.parallel:result is None 2024-01-21T19:59:48.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T19:59:48.284 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T19:59:48.285 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T19:59:48.291 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T19:59:48.291 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T19:59:48.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.357+0000 7f8ff47bb700 1 Processor -- start 2024-01-21T19:59:48.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.357+0000 7f8ff47bb700 1 -- start start 2024-01-21T19:59:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec154140 0x7f8fec158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fec154520 0x7f8fec0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fec0c6090 0x7f8fec0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0c6ae0 con 0x7f8fec0c6090 2024-01-21T19:59:48.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0c05e0 con 0x7f8fec154520 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0ab620 con 0x7f8fec154140 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fec0c6090 0x7f8fec0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fec0c6090 0x7f8fec0c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48270/0 (socket says 172.21.15.133:48270) 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 -- 172.21.15.133:0/2322221740 learned_addr learned my addr 172.21.15.133:0/2322221740 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff1d56700 1 --2- 172.21.15.133:0/2322221740 >> v2:172.21.15.178:3300/0 conn(0x7f8fec154520 0x7f8fec0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2557700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec154140 0x7f8fec158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 -- 172.21.15.133:0/2322221740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec154140 msgr2=0x7f8fec158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec154140 0x7f8fec158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 -- 172.21.15.133:0/2322221740 >> v2:172.21.15.178:3300/0 conn(0x7f8fec154520 msgr2=0x7f8fec0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 --2- 172.21.15.133:0/2322221740 >> v2:172.21.15.178:3300/0 conn(0x7f8fec154520 0x7f8fec0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 -- 172.21.15.133:0/2322221740 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0c0e40 con 0x7f8fec0c6090 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff2d58700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec0c6090 0x7f8fec0c7a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f8fec0cc130 tx=0x7f8fe4009840).ready entity=mon.0 client_cookie=3dc2a19cf2f6d108 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:48.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff1555700 1 -- 172.21.15.133:0/2322221740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400e070 con 0x7f8fec0c6090 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff1555700 1 -- 172.21.15.133:0/2322221740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400b970 con 0x7f8fec0c6090 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff1555700 1 -- 172.21.15.133:0/2322221740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400bcf0 con 0x7f8fec0c6090 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2322221740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec0c6090 msgr2=0x7f8fec0c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec0c6090 0x7f8fec0c7a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f8fec0cc130 tx=0x7f8fe4009840).stop 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2322221740 shutdown_connections 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec0c6090 0x7f8fec0c7a10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2322221740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec154140 0x7f8fec158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2322221740 >> v2:172.21.15.178:3300/0 conn(0x7f8fec154520 0x7f8fec0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2322221740 >> 172.21.15.133:0/2322221740 conn(0x7f8fec05e1e0 msgr2=0x7f8fec05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2322221740 shutdown_connections 2024-01-21T19:59:48.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.358+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2322221740 wait complete. 2024-01-21T19:59:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.359+0000 7f8ff47bb700 1 Processor -- start 2024-01-21T19:59:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.359+0000 7f8ff47bb700 1 -- start start 2024-01-21T19:59:48.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec0c6090 0x7f8fec0ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fec154520 0x7f8fec0b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c8ed0 con 0x7f8fec154140 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c91b0 con 0x7f8fec154520 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff47bb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c9490 con 0x7f8fec0c6090 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48284/0 (socket says 172.21.15.133:48284) 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 -- 172.21.15.133:0/2664959543 learned_addr learned my addr 172.21.15.133:0/2664959543 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff2d58700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fec154520 0x7f8fec0b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff2557700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec0c6090 0x7f8fec0ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 -- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec0c6090 msgr2=0x7f8fec0ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec0c6090 0x7f8fec0ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 -- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fec154520 msgr2=0x7f8fec0b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fec154520 0x7f8fec0b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.360+0000 7f8ff1d56700 1 -- 172.21.15.133:0/2664959543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4009ae0 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8ff1d56700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8fdc00e8d0 tx=0x7f8fdc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc012600 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc012760 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0c9770 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc012ae0 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.361+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec14dce0 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.362+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec05fdf0 con 0x7f8fec154140 2024-01-21T19:59:48.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.362+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8fdc01b400 con 0x7f8fec154140 2024-01-21T19:59:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.362+0000 7f8fe2ffd700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 0x7f8fd0061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.363+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f8fdc07a180 con 0x7f8fec154140 2024-01-21T19:59:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.363+0000 7f8ff2557700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 0x7f8fd0061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.363+0000 7f8ff2557700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 0x7f8fd0061640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8fe8009c30 tx=0x7f8fe8009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:48.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.368+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8fdc04b750 con 0x7f8fec154140 2024-01-21T19:59:48.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:48.546+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8fec0c00f0 con 0x7f8fec154140 2024-01-21T19:59:49.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.331+0000 7f8fe2ffd700 1 -- 172.21.15.133:0/2664959543 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8fdc04ed70 con 0x7f8fec154140 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 msgr2=0x7f8fd0061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 0x7f8fd0061640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f8fe8009c30 tx=0x7f8fe8009060).stop 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 msgr2=0x7f8fec0afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f8fdc00e8d0 tx=0x7f8fdc009060).stop 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 shutdown_connections 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8fd005f180 0x7f8fd0061640 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fec154520 0x7f8fec0b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fec0c6090 0x7f8fec0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 --2- 172.21.15.133:0/2664959543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fec154140 0x7f8fec0afc50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 >> 172.21.15.133:0/2664959543 conn(0x7f8fec05e1e0 msgr2=0x7f8fec0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 shutdown_connections 2024-01-21T19:59:49.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.333+0000 7f8ff47bb700 1 -- 172.21.15.133:0/2664959543 wait complete. 2024-01-21T19:59:49.326 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T19:59:49.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T19:59:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.470+0000 7fd941430700 1 Processor -- start 2024-01-21T19:59:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.470+0000 7fd941430700 1 -- start start 2024-01-21T19:59:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd941430700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd93c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd941430700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0654f0 con 0x7fd93c0a9e30 2024-01-21T19:59:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd941430700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c063700 con 0x7fd93c0bc6d0 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd941430700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c063950 con 0x7fd93c1546b0 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd93a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd93c0a9e30 0x7fd93c065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40514/0 (socket says 172.21.15.133:40514) 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd93a7fc700 1 -- 172.21.15.133:0/1220804107 learned_addr learned my addr 172.21.15.133:0/1220804107 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd93affd700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd93c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195728305 0 0) 0x7fd93c0654f0 con 0x7fd93c0a9e30 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9240033f0 con 0x7fd93c0a9e30 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 663511647 0 0) 0x7fd9240033f0 con 0x7fd93c0a9e30 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 msgr2=0x7fd93c154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd93c154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 >> v1:172.21.15.178:6789/0 conn(0x7fd93c0bc6d0 legacy=0x7fd93c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c065180 con 0x7fd93c0a9e30 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fd930001470 con 0x7fd93c0a9e30 2024-01-21T19:59:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 >> v1:172.21.15.133:6789/0 conn(0x7fd93c0a9e30 legacy=0x7fd93c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd924003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924003e00 0x7fd924004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd924005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c063950 con 0x7fd924004b80 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92400b990 con 0x7fd924003e00 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.471+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92400bb50 con 0x7fd93c1546b0 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd924005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93affd700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd924003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93a7fc700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924003e00 0x7fd924004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 -- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 msgr2=0x7fd924003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c1546b0 0x7fd924003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 -- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924003e00 msgr2=0x7fd924004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924003e00 0x7fd924004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 -- 172.21.15.133:0/1220804107 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240033f0 con 0x7fd924004b80 2024-01-21T19:59:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd924005000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd934001f20 tx=0x7fd934007f10).ready entity=mon.0 client_cookie=37ddbc1a9d5aabc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340017e0 con 0x7fd924004b80 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93400c6d0 con 0x7fd924004b80 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.472+0000 7fd939ffb700 1 -- 172.21.15.133:0/1220804107 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93400ca50 con 0x7fd924004b80 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 -- 172.21.15.133:0/1220804107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 msgr2=0x7fd924005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 --2- 172.21.15.133:0/1220804107 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd924005000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fd934001f20 tx=0x7fd934007f10).stop 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd93b7fe700 1 -- 172.21.15.133:0/1220804107 reap_dead start 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 -- 172.21.15.133:0/1220804107 shutdown_connections 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 -- 172.21.15.133:0/1220804107 >> 172.21.15.133:0/1220804107 conn(0x7fd93c0c8200 msgr2=0x7fd93c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 -- 172.21.15.133:0/1220804107 shutdown_connections 2024-01-21T19:59:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.473+0000 7fd941430700 1 -- 172.21.15.133:0/1220804107 wait complete. 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.474+0000 7fd941430700 1 Processor -- start 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 -- start start 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c14e120 0x7fd93c14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd93c0ac8f0 0x7fd93c0acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c14f4d0 con 0x7fd924004b80 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c14c700 con 0x7fd93c0ac8f0 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.475+0000 7fd941430700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0aa930 con 0x7fd93c14e120 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48302/0 (socket says 172.21.15.133:48302) 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 -- 172.21.15.133:0/2093910372 learned_addr learned my addr 172.21.15.133:0/2093910372 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd93c0ac8f0 0x7fd93c0acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 -- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c14e120 msgr2=0x7fd93c14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c14e120 0x7fd93c14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 -- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd93c0ac8f0 msgr2=0x7fd93c0acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd93c0ac8f0 0x7fd93c0acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 -- 172.21.15.133:0/2093910372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c14ec30 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd93affd700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fd92c0119c0 tx=0x7fd92c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00f8e0 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00fa40 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c14ef10 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00fdc0 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.476+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0ad260 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.477+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c0aac10 con 0x7fd924004b80 2024-01-21T19:59:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.478+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd92c014650 con 0x7fd924004b80 2024-01-21T19:59:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.478+0000 7fd9237fe700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 0x7fd928061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.478+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd92c07aa80 con 0x7fd924004b80 2024-01-21T19:59:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.478+0000 7fd93a7fc700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 0x7fd928061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.478+0000 7fd93a7fc700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 0x7fd928061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fd9300015a0 tx=0x7fd930001e70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.482+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd92c04c0a0 con 0x7fd924004b80 2024-01-21T19:59:49.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.710+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd93c0aa700 con 0x7fd924004b80 2024-01-21T19:59:49.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.711+0000 7fd9237fe700 1 -- 172.21.15.133:0/2093910372 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd93c0aa700 con 0x7fd924004b80 2024-01-21T19:59:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:49.702 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T19:59:49.702 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T19:59:49.703 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T19:59:49.704 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.706 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T19:59:49.707 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.708 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.709 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T19:59:49.712 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T19:59:49.713 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T19:59:49.714 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.715 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mds", 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61lgZYRBxAAEpZTUfiPepl8omeY6OtTRw==", 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mds" 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mgr", 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61lWZ8RBxAAW5HodOG1PmuOiiCrDpLnew==", 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.716 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-osd", 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61lmqgRBxAA9b1ES5nHkY3lfrNqPoLB2A==", 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-osd" 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd", 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61l0K8RBxAAfzOhADdt34HQqjgpPn3ZaQ==", 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.717 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61lSbcRBxAAEjQtSWFIEQLpYTAdQu+77A==", 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rgw", 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQB5d61lb74RBxAA4iL9Fa/kdMVYyHLdf2uAOg==", 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.718 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T19:59:49.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:49.720 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T19:59:49.720 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T19:59:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 msgr2=0x7fd928061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 0x7fd928061610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fd9300015a0 tx=0x7fd930001e70).stop 2024-01-21T19:59:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 msgr2=0x7fd93c14dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fd92c0119c0 tx=0x7fd92c009060).stop 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 shutdown_connections 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd92805f150 0x7fd928061610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd93c0ac8f0 0x7fd93c0acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd924004b80 0x7fd93c14dc30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 --2- 172.21.15.133:0/2093910372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd93c14e120 0x7fd93c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 >> 172.21.15.133:0/2093910372 conn(0x7fd93c0c8200 msgr2=0x7fd93c062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 shutdown_connections 2024-01-21T19:59:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.713+0000 7fd941430700 1 -- 172.21.15.133:0/2093910372 wait complete. 2024-01-21T19:59:49.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-21T19:59:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.849+0000 7fb60c9e6700 1 Processor -- start 2024-01-21T19:59:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.849+0000 7fb60c9e6700 1 -- start start 2024-01-21T19:59:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60c9e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb608062c10 0x7fb608062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60c9e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb608065d70 0x7fb6080bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60c9e6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6080634e0 con 0x7fb6080697e0 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60c9e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60806a130 con 0x7fb608062c10 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60c9e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60806a410 con 0x7fb608065d70 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb608062c10 0x7fb608062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb608062c10 0x7fb608062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48312/0 (socket says 172.21.15.133:48312) 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 -- 172.21.15.133:0/2181520233 learned_addr learned my addr 172.21.15.133:0/2181520233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb606d9d700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb608065d70 0x7fb6080bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 -- 172.21.15.133:0/2181520233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb608065d70 msgr2=0x7fb6080bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb608065d70 0x7fb6080bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 -- 172.21.15.133:0/2181520233 >> v1:172.21.15.178:6789/0 conn(0x7fb6080697e0 legacy=0x7fb608065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 -- 172.21.15.133:0/2181520233 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60806a6f0 con 0x7fb608062c10 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60659c700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608062ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fb5fc006fd0 tx=0x7fb5fc0090f0).ready entity=mon.0 client_cookie=8ae7294070f0482b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60559a700 1 -- 172.21.15.133:0/2181520233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00b600 con 0x7fb608062c10 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60559a700 1 -- 172.21.15.133:0/2181520233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00b760 con 0x7fb608062c10 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.850+0000 7fb60559a700 1 -- 172.21.15.133:0/2181520233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00bb00 con 0x7fb608062c10 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2181520233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 msgr2=0x7fb608062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608062ff0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fb5fc006fd0 tx=0x7fb5fc0090f0).stop 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2181520233 shutdown_connections 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608062ff0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2181520233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb608065d70 0x7fb6080bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2181520233 >> 172.21.15.133:0/2181520233 conn(0x7fb6080c8010 msgr2=0x7fb6080c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2181520233 shutdown_connections 2024-01-21T19:59:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.851+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2181520233 wait complete. 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.852+0000 7fb60c9e6700 1 Processor -- start 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.852+0000 7fb60c9e6700 1 -- start start 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 0x7fb608168b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6080697e0 0x7fb608169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608164fb0 con 0x7fb608062c10 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608165dd0 con 0x7fb608065d70 2024-01-21T19:59:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60c9e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081651c0 con 0x7fb6080697e0 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48324/0 (socket says 172.21.15.133:48324) 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 -- 172.21.15.133:0/2189871362 learned_addr learned my addr 172.21.15.133:0/2189871362 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb606d9d700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6080697e0 0x7fb608169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 -- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6080697e0 msgr2=0x7fb608169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6080697e0 0x7fb608169030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.853+0000 7fb60659c700 1 -- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 msgr2=0x7fb608168b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb605d9b700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 0x7fb608168b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb60659c700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 0x7fb608168b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb60659c700 1 -- 172.21.15.133:0/2189871362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc009370 con 0x7fb608062c10 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb605d9b700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 0x7fb608168b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb60659c700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fb6080692f0 tx=0x7fb5fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00bec0 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc00b8d0 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6081654a0 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc024470 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.854+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb608165a60 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.855+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60813b720 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.855+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb5fc021070 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.856+0000 7fb5f6ffd700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 0x7fb5e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.856+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb5fc07b8d0 con 0x7fb608062c10 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.856+0000 7fb605d9b700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 0x7fb5e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.856+0000 7fb605d9b700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 0x7fb5e8061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb6080c46d0 tx=0x7fb5f8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:49.860+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5fc04cef0 con 0x7fb608062c10 2024-01-21T19:59:50.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.092+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb6080bcf70 con 0x7fb608062c10 2024-01-21T19:59:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.095+0000 7fb5f6ffd700 1 -- 172.21.15.133:0/2189871362 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5fc050510 con 0x7fb608062c10 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 msgr2=0x7fb5e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 0x7fb5e8061610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb6080c46d0 tx=0x7fb5f8009040).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 msgr2=0x7fb608155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fb6080692f0 tx=0x7fb5fc017000).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 shutdown_connections 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5e805f150 0x7fb5e8061610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6080697e0 0x7fb608169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb608062c10 0x7fb608155840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 --2- 172.21.15.133:0/2189871362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb608065d70 0x7fb608168b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 >> 172.21.15.133:0/2189871362 conn(0x7fb6080c8010 msgr2=0x7fb60813b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 shutdown_connections 2024-01-21T19:59:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.097+0000 7fb60c9e6700 1 -- 172.21.15.133:0/2189871362 wait complete. 2024-01-21T19:59:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:50.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-21T19:59:50.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.226+0000 7fc8bd418700 1 Processor -- start 2024-01-21T19:59:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.226+0000 7fc8bd418700 1 -- start start 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8b813a810 0x7fc8b8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b80c51d0 0x7fc8b80626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 0x7fc8b8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b8154f60 con 0x7fc8b813a810 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b8155f90 con 0x7fc8b8062be0 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8bd418700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8063070 con 0x7fc8b80c51d0 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8b6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8b813a810 0x7fc8b8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8b6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc8b813a810 0x7fc8b8154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48336/0 (socket says 172.21.15.133:48336) 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.227+0000 7fc8b6ffd700 1 -- 172.21.15.133:0/1466624407 learned_addr learned my addr 172.21.15.133:0/1466624407 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b77fe700 1 --2- 172.21.15.133:0/1466624407 >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 0x7fc8b8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b67fc700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b80c51d0 0x7fc8b80626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 -- 172.21.15.133:0/1466624407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b80c51d0 msgr2=0x7fc8b80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b80c51d0 0x7fc8b80626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 -- 172.21.15.133:0/1466624407 >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 msgr2=0x7fc8b8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/1466624407 >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 0x7fc8b8157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 -- 172.21.15.133:0/1466624407 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8155a10 con 0x7fc8b813a810 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b77fe700 1 --2- 172.21.15.133:0/1466624407 >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 0x7fc8b8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b8154a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc8b8065a50 tx=0x7fc8ac0090f0).ready entity=mon.0 client_cookie=81d48244c6190604 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b5ffb700 1 -- 172.21.15.133:0/1466624407 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00b600 con 0x7fc8b813a810 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b5ffb700 1 -- 172.21.15.133:0/1466624407 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac00b760 con 0x7fc8b813a810 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8b5ffb700 1 -- 172.21.15.133:0/1466624407 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac00bb00 con 0x7fc8b813a810 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 -- 172.21.15.133:0/1466624407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 msgr2=0x7fc8b8154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b8154a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc8b8065a50 tx=0x7fc8ac0090f0).stop 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 -- 172.21.15.133:0/1466624407 shutdown_connections 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 --2- 172.21.15.133:0/1466624407 >> v2:172.21.15.178:3300/0 conn(0x7fc8b8062be0 0x7fc8b8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b8154a70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 --2- 172.21.15.133:0/1466624407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b80c51d0 0x7fc8b80626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 -- 172.21.15.133:0/1466624407 >> 172.21.15.133:0/1466624407 conn(0x7fc8b80c8850 msgr2=0x7fc8b80c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.228+0000 7fc8bd418700 1 -- 172.21.15.133:0/1466624407 shutdown_connections 2024-01-21T19:59:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.229+0000 7fc8bd418700 1 -- 172.21.15.133:0/1466624407 wait complete. 2024-01-21T19:59:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.230+0000 7fc8bd418700 1 Processor -- start 2024-01-21T19:59:50.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.230+0000 7fc8bd418700 1 -- start start 2024-01-21T19:59:50.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8062be0 0x7fc8b80ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80c51d0 0x7fc8b81395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80ac060 con 0x7fc8b813a810 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80ab450 con 0x7fc8b80c51d0 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80ab730 con 0x7fc8b8062be0 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48346/0 (socket says 172.21.15.133:48346) 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 -- 172.21.15.133:0/598452166 learned_addr learned my addr 172.21.15.133:0/598452166 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8062be0 0x7fc8b80ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b67fc700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80c51d0 0x7fc8b81395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 -- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8062be0 msgr2=0x7fc8b80ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8062be0 0x7fc8b80ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 -- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80c51d0 msgr2=0x7fc8b81395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80c51d0 0x7fc8b81395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 -- 172.21.15.133:0/598452166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009370 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8b77fe700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc8b000d180 tx=0x7fc8b0009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000dcc0 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000f040 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80aba10 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0013600 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.231+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b8139ac0 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.232+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b80ac1d0 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.233+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc8b00139f0 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.233+0000 7fc89f7fe700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.233+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc8b007a520 con 0x7fc8b813a810 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.233+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.233+0000 7fc8b6ffd700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 0x7fc8a4061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc8ac00b3c0 tx=0x7fc8ac017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.237+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc8b004bae0 con 0x7fc8b813a810 2024-01-21T19:59:50.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.465+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc8b8155170 con 0x7fc8b813a810 2024-01-21T19:59:50.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.471+0000 7fc89f7fe700 1 -- 172.21.15.133:0/598452166 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc8b004f100 con 0x7fc8b813a810 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.472+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 msgr2=0x7fc8a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.472+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 0x7fc8a4061610 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fc8ac00b3c0 tx=0x7fc8ac017000).stop 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.472+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 msgr2=0x7fc8b80696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.472+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fc8b000d180 tx=0x7fc8b0009a50).stop 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 shutdown_connections 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc8a405f150 0x7fc8a4061610 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8b813a810 0x7fc8b80696c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8062be0 0x7fc8b80ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 --2- 172.21.15.133:0/598452166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80c51d0 0x7fc8b81395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 >> 172.21.15.133:0/598452166 conn(0x7fc8b80c8850 msgr2=0x7fc8b80c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 shutdown_connections 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.473+0000 7fc8bd418700 1 -- 172.21.15.133:0/598452166 wait complete. 2024-01-21T19:59:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:50.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-21T19:59:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.601+0000 7f0c4c742700 1 Processor -- start 2024-01-21T19:59:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.601+0000 7f0c4c742700 1 -- start start 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4c742700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 0x7f0c440c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4c742700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 0x7f0c4413a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4c742700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c44067f10 con 0x7f0c440c6220 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4c742700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c440681f0 con 0x7f0c440c5dc0 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4c742700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440684d0 con 0x7f0c440c3840 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4acdf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0c440c6220 0x7f0c44157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39496/0 (socket says 172.21.15.133:39496) 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4acdf700 1 -- 172.21.15.133:0/4016199831 learned_addr learned my addr 172.21.15.133:0/4016199831 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c49cdd700 1 --2- 172.21.15.133:0/4016199831 >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 0x7f0c4413a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/4016199831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 0x7f0c440c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c494dc700 1 -- 172.21.15.133:0/4016199831 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153448513 0 0) 0x7f0c44067f10 con 0x7f0c440c6220 2024-01-21T19:59:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c494dc700 1 -- 172.21.15.133:0/4016199831 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c300033f0 con 0x7f0c440c6220 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4a4de700 1 -- 172.21.15.133:0/4016199831 >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 msgr2=0x7f0c4413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/4016199831 >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 0x7f0c4413a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4a4de700 1 -- 172.21.15.133:0/4016199831 >> v1:172.21.15.133:6789/0 conn(0x7f0c440c6220 legacy=0x7f0c44157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c4a4de700 1 -- 172.21.15.133:0/4016199831 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440687b0 con 0x7f0c440c3840 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.602+0000 7f0c49cdd700 1 --2- 172.21.15.133:0/4016199831 >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 0x7f0c4413a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/4016199831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 0x7f0c440c3c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0c40009760 tx=0x7f0c40009060).ready entity=mon.2 client_cookie=88754c3bf7ed14dc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c494dc700 1 -- 172.21.15.133:0/4016199831 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400090d0 con 0x7f0c440c3840 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c494dc700 1 -- 172.21.15.133:0/4016199831 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4000d4a0 con 0x7f0c440c3840 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c494dc700 1 -- 172.21.15.133:0/4016199831 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000d820 con 0x7f0c440c3840 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 -- 172.21.15.133:0/4016199831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 msgr2=0x7f0c440c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 --2- 172.21.15.133:0/4016199831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 0x7f0c440c3c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f0c40009760 tx=0x7f0c40009060).stop 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 -- 172.21.15.133:0/4016199831 shutdown_connections 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 --2- 172.21.15.133:0/4016199831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c3840 0x7f0c440c3c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 --2- 172.21.15.133:0/4016199831 >> v2:172.21.15.178:3300/0 conn(0x7f0c440c5dc0 0x7f0c4413a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 -- 172.21.15.133:0/4016199831 >> 172.21.15.133:0/4016199831 conn(0x7f0c44066a70 msgr2=0x7f0c44066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 -- 172.21.15.133:0/4016199831 shutdown_connections 2024-01-21T19:59:50.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.603+0000 7f0c4c742700 1 -- 172.21.15.133:0/4016199831 wait complete. 2024-01-21T19:59:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 Processor -- start 2024-01-21T19:59:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 -- start start 2024-01-21T19:59:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c440c3840 0x7f0c441688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c5dc0 0x7f0c44159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44165140 con 0x7f0c440c6220 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c44159d80 con 0x7f0c440c3840 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4c742700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c440aee50 con 0x7f0c440c5dc0 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4acdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4acdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34078/0 (socket says 172.21.15.133:34078) 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.605+0000 7f0c4acdf700 1 -- 172.21.15.133:0/2175735388 learned_addr learned my addr 172.21.15.133:0/2175735388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c440c3840 0x7f0c441688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c49cdd700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c5dc0 0x7f0c44159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 -- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c5dc0 msgr2=0x7f0c44159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c5dc0 0x7f0c44159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 -- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c440c3840 msgr2=0x7f0c441688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c440c3840 0x7f0c441688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 -- 172.21.15.133:0/2175735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340092a0 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4acdf700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0c3c005ad0 tx=0x7f0c3c001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c005d30 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c005e90 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c400092a0 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c007320 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.606+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c44164dd0 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.607+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c441652b0 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.607+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0c3c007710 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.608+0000 7f0c3affd700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 0x7f0c28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.608+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0c3c079dc0 con 0x7f0c440c6220 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.608+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 0x7f0c28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.608+0000 7f0c4a4de700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 0x7f0c28061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0c4000d260 tx=0x7f0c40016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.612+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c3c04b3e0 con 0x7f0c440c6220 2024-01-21T19:59:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.838+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0c44068a90 con 0x7f0c440c6220 2024-01-21T19:59:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.844+0000 7f0c3affd700 1 -- 172.21.15.133:0/2175735388 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0c3c04ea00 con 0x7f0c440c6220 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 msgr2=0x7f0c28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 0x7f0c28061610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f0c4000d260 tx=0x7f0c40016000).stop 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 msgr2=0x7f0c440ae640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f0c3c005ad0 tx=0x7f0c3c001650).stop 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 shutdown_connections 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c2805f150 0x7f0c28061610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c440c6220 0x7f0c440ae640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c440c3840 0x7f0c441688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 --2- 172.21.15.133:0/2175735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c440c5dc0 0x7f0c44159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 >> 172.21.15.133:0/2175735388 conn(0x7f0c44066a70 msgr2=0x7f0c440635b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 shutdown_connections 2024-01-21T19:59:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.846+0000 7f0c4c742700 1 -- 172.21.15.133:0/2175735388 wait complete. 2024-01-21T19:59:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:50.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-21T19:59:50.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.974+0000 7f08e9510700 1 Processor -- start 2024-01-21T19:59:50.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.974+0000 7f08e9510700 1 -- start start 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e9510700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08e40c3c10 0x7f08e40be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e9510700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 0x7f08e40a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e9510700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40bfa40 con 0x7f08e413b970 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e9510700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e40bee30 con 0x7f08e40c3c10 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e9510700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e40bf110 con 0x7f08e40be5f0 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08e40c3c10 0x7f08e40be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f08e413b970 0x7f08e40c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39508/0 (socket says 172.21.15.133:39508) 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e2ffd700 1 -- 172.21.15.133:0/3627347969 learned_addr learned my addr 172.21.15.133:0/3627347969 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e1ffb700 1 -- 172.21.15.133:0/3627347969 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993724658 0 0) 0x7f08e40bfa40 con 0x7f08e413b970 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e1ffb700 1 -- 172.21.15.133:0/3627347969 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc0033f0 con 0x7f08e413b970 2024-01-21T19:59:50.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e37fe700 1 --2- 172.21.15.133:0/3627347969 >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 0x7f08e40a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 -- 172.21.15.133:0/3627347969 >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 msgr2=0x7f08e40a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 --2- 172.21.15.133:0/3627347969 >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 0x7f08e40a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 -- 172.21.15.133:0/3627347969 >> v1:172.21.15.133:6789/0 conn(0x7f08e413b970 legacy=0x7f08e40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 -- 172.21.15.133:0/3627347969 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40bf3f0 con 0x7f08e40c3c10 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e37fe700 1 --2- 172.21.15.133:0/3627347969 >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 0x7f08e40a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.975+0000 7f08e27fc700 1 --2- 172.21.15.133:0/3627347969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e40be100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f08e406a7a0 tx=0x7f08d4009060).ready entity=mon.0 client_cookie=985d0a822748390e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e1ffb700 1 -- 172.21.15.133:0/3627347969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40090d0 con 0x7f08e40c3c10 2024-01-21T19:59:50.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e1ffb700 1 -- 172.21.15.133:0/3627347969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400f510 con 0x7f08e40c3c10 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e1ffb700 1 -- 172.21.15.133:0/3627347969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d400f890 con 0x7f08e40c3c10 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 -- 172.21.15.133:0/3627347969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 msgr2=0x7f08e40be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 --2- 172.21.15.133:0/3627347969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e40be100 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f08e406a7a0 tx=0x7f08d4009060).stop 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 -- 172.21.15.133:0/3627347969 shutdown_connections 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 --2- 172.21.15.133:0/3627347969 >> v2:172.21.15.178:3300/0 conn(0x7f08e40be5f0 0x7f08e40a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 --2- 172.21.15.133:0/3627347969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e40be100 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 -- 172.21.15.133:0/3627347969 >> 172.21.15.133:0/3627347969 conn(0x7f08e4066a70 msgr2=0x7f08e4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 -- 172.21.15.133:0/3627347969 shutdown_connections 2024-01-21T19:59:50.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.976+0000 7f08e9510700 1 -- 172.21.15.133:0/3627347969 wait complete. 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.977+0000 7f08e9510700 1 Processor -- start 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.977+0000 7f08e9510700 1 -- start start 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 0x7f08e4162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e413b970 0x7f08e41568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40bffa0 con 0x7f08e40c3c10 2024-01-21T19:59:50.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4163570 con 0x7f08e40be5f0 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e9510700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4162930 con 0x7f08e413b970 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34090/0 (socket says 172.21.15.133:34090) 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.978+0000 7f08e27fc700 1 -- 172.21.15.133:0/1112580914 learned_addr learned my addr 172.21.15.133:0/1112580914 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 -- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e413b970 msgr2=0x7f08e41568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e413b970 0x7f08e41568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e2ffd700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 0x7f08e4162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 -- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 msgr2=0x7f08e4162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 0x7f08e4162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 -- 172.21.15.133:0/1112580914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40092a0 con 0x7f08e40c3c10 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e2ffd700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 0x7f08e4162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:50.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e27fc700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f08e406a220 tx=0x7f08d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4006950 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d400f680 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d401b410 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e4162c10 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.979+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e41631d0 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.980+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e40c0150 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.980+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f08d401b800 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.981+0000 7f08cb7fe700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 0x7f08d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.981+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f08d407b730 con 0x7f08e40c3c10 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.981+0000 7f08e2ffd700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 0x7f08d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:50.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.981+0000 7f08e2ffd700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 0x7f08d0061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f08d8005750 tx=0x7f08d8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:50.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:50.985+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08e40c0150 con 0x7f08e40c3c10 2024-01-21T19:59:51.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.210+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f08e40c0150 con 0x7f08e40c3c10 2024-01-21T19:59:51.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.216+0000 7f08cb7fe700 1 -- 172.21.15.133:0/1112580914 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08e40c0150 con 0x7f08e40c3c10 2024-01-21T19:59:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 msgr2=0x7f08d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 0x7f08d0061610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f08d8005750 tx=0x7f08d8009040).stop 2024-01-21T19:59:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 msgr2=0x7f08e4151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f08e406a220 tx=0x7f08d4017000).stop 2024-01-21T19:59:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 shutdown_connections 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08d005f150 0x7f08d0061610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08e413b970 0x7f08e41568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08e40be5f0 0x7f08e4162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 --2- 172.21.15.133:0/1112580914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08e40c3c10 0x7f08e4151bd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 >> 172.21.15.133:0/1112580914 conn(0x7f08e4066a70 msgr2=0x7f08e40ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 shutdown_connections 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.218+0000 7f08e9510700 1 -- 172.21.15.133:0/1112580914 wait complete. 2024-01-21T19:59:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:51.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-21T19:59:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.347+0000 7ff330975700 1 Processor -- start 2024-01-21T19:59:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.347+0000 7ff330975700 1 -- start start 2024-01-21T19:59:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff330975700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff32c067d90 0x7ff32c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff330975700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 0x7ff32c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff330975700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0c6290 con 0x7ff32c137030 2024-01-21T19:59:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff330975700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c068370 con 0x7ff32c067d90 2024-01-21T19:59:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff330975700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c068650 con 0x7ff32c0c5930 2024-01-21T19:59:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff329d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff32c067d90 0x7ff32c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff32ad9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 0x7ff32c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff32a59c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff32c137030 0x7ff32c155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39320/0 (socket says 172.21.15.133:39320) 2024-01-21T19:59:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff32a59c700 1 -- 172.21.15.133:0/964585184 learned_addr learned my addr 172.21.15.133:0/964585184 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.348+0000 7ff32ad9d700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 0x7ff32c0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:39508/0 (socket says 172.21.15.133:39508) 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff32959a700 1 -- 172.21.15.133:0/964585184 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275658534 0 0) 0x7ff32c0c6290 con 0x7ff32c137030 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff32959a700 1 -- 172.21.15.133:0/964585184 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3140033f0 con 0x7ff32c137030 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff329d9b700 1 -- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 msgr2=0x7ff32c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff329d9b700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 0x7ff32c0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff329d9b700 1 -- 172.21.15.133:0/964585184 >> v1:172.21.15.178:6789/0 conn(0x7ff32c137030 legacy=0x7ff32c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff329d9b700 1 -- 172.21.15.133:0/964585184 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c068930 con 0x7ff32c067d90 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff329d9b700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c137410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff31c009760 tx=0x7ff31c009060).ready entity=mon.1 client_cookie=bedeca3b2de5fa6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff32959a700 1 -- 172.21.15.133:0/964585184 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0090d0 con 0x7ff32c067d90 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff32959a700 1 -- 172.21.15.133:0/964585184 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c00d4a0 con 0x7ff32c067d90 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.349+0000 7ff32959a700 1 -- 172.21.15.133:0/964585184 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00d820 con 0x7ff32c067d90 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 -- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 msgr2=0x7ff32c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c137410 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7ff31c009760 tx=0x7ff31c009060).stop 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 -- 172.21.15.133:0/964585184 shutdown_connections 2024-01-21T19:59:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c0c5930 0x7ff32c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 --2- 172.21.15.133:0/964585184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c137410 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 -- 172.21.15.133:0/964585184 >> 172.21.15.133:0/964585184 conn(0x7ff32c066a90 msgr2=0x7ff32c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 -- 172.21.15.133:0/964585184 shutdown_connections 2024-01-21T19:59:51.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.350+0000 7ff330975700 1 -- 172.21.15.133:0/964585184 wait complete. 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.351+0000 7ff330975700 1 Processor -- start 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 -- start start 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c165150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c137030 0x7ff32c166c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0add20 con 0x7ff32c0c5930 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.352+0000 7ff330975700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c168410 con 0x7ff32c067d90 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff330975700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c164480 con 0x7ff32c137030 2024-01-21T19:59:51.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34092/0 (socket says 172.21.15.133:34092) 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 -- 172.21.15.133:0/2544386287 learned_addr learned my addr 172.21.15.133:0/2544386287 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff32a59c700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff32ad9d700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c137030 0x7ff32c166c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 -- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c137030 msgr2=0x7ff32c166c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c137030 0x7ff32c166c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 -- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 msgr2=0x7ff32c165150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c165150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 -- 172.21.15.133:0/2544386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c0092a0 con 0x7ff32c0c5930 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff329d9b700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7ff31c009d50 tx=0x7ff31c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c006910 con 0x7ff32c0c5930 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c012910 con 0x7ff32c0c5930 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c164760 con 0x7ff32c0c5930 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c012cb0 con 0x7ff32c0c5930 2024-01-21T19:59:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.353+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c164d20 con 0x7ff32c0c5930 2024-01-21T19:59:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.354+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c05fdf0 con 0x7ff32c0c5930 2024-01-21T19:59:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.354+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff31c01c630 con 0x7ff32c0c5930 2024-01-21T19:59:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.355+0000 7ff31affd700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 0x7ff30c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.355+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff31c07b1b0 con 0x7ff32c0c5930 2024-01-21T19:59:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.355+0000 7ff32a59c700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 0x7ff30c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.355+0000 7ff32a59c700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 0x7ff30c061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff320007fd0 tx=0x7ff320009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.359+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff31c04c7d0 con 0x7ff32c0c5930 2024-01-21T19:59:51.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.589+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff32c137520 con 0x7ff32c0c5930 2024-01-21T19:59:51.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.593+0000 7ff31affd700 1 -- 172.21.15.133:0/2544386287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff31c04fdf0 con 0x7ff32c0c5930 2024-01-21T19:59:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 msgr2=0x7ff30c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 0x7ff30c061610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff320007fd0 tx=0x7ff320009040).stop 2024-01-21T19:59:51.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 msgr2=0x7ff32c167f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7ff31c009d50 tx=0x7ff31c016000).stop 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 shutdown_connections 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff30c05f150 0x7ff30c061610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c137030 0x7ff32c166c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c067d90 0x7ff32c165150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 --2- 172.21.15.133:0/2544386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff32c0c5930 0x7ff32c167f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 >> 172.21.15.133:0/2544386287 conn(0x7ff32c066a90 msgr2=0x7ff32c155290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 shutdown_connections 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.595+0000 7ff330975700 1 -- 172.21.15.133:0/2544386287 wait complete. 2024-01-21T19:59:51.587 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:51.598 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-21T19:59:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.723+0000 7f2121874700 1 Processor -- start 2024-01-21T19:59:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 -- start start 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f211c062ff0 0x7f211c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c069ef0 con 0x7f211c062c10 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c065fe0 con 0x7f211c062ff0 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.724+0000 7f2121874700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c06a130 con 0x7f211c065b50 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f211c062ff0 0x7f211c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f211c062c10 0x7f211c0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39514/0 (socket says 172.21.15.133:39514) 2024-01-21T19:59:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f211c062ff0 0x7f211c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34100/0 (socket says 172.21.15.133:34100) 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211affd700 1 -- 172.21.15.133:0/3471472778 learned_addr learned my addr 172.21.15.133:0/3471472778 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211b7fe700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 -- 172.21.15.133:0/3471472778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 msgr2=0x7f211c0bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 -- 172.21.15.133:0/3471472778 >> v1:172.21.15.133:6789/0 conn(0x7f211c062c10 legacy=0x7f211c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 -- 172.21.15.133:0/3471472778 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c06a410 con 0x7f211c062ff0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f2119ffb700 1 -- 172.21.15.133:0/3471472778 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201124433 0 0) 0x7f2104001110 con 0x7f211c062c10 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f211a7fc700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062ff0 0x7f211c065660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f210c009760 tx=0x7f210c009060).ready entity=mon.0 client_cookie=3f52a6f59954e95d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f2119ffb700 1 -- 172.21.15.133:0/3471472778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0090d0 con 0x7f211c062ff0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f2119ffb700 1 -- 172.21.15.133:0/3471472778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00b580 con 0x7f211c062ff0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.725+0000 7f2119ffb700 1 -- 172.21.15.133:0/3471472778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c00b900 con 0x7f211c062ff0 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 -- 172.21.15.133:0/3471472778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062ff0 msgr2=0x7f211c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062ff0 0x7f211c065660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f210c009760 tx=0x7f210c009060).stop 2024-01-21T19:59:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 -- 172.21.15.133:0/3471472778 shutdown_connections 2024-01-21T19:59:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 --2- 172.21.15.133:0/3471472778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062ff0 0x7f211c065660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 -- 172.21.15.133:0/3471472778 >> 172.21.15.133:0/3471472778 conn(0x7f211c0c8010 msgr2=0x7f211c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 -- 172.21.15.133:0/3471472778 shutdown_connections 2024-01-21T19:59:51.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.726+0000 7f2121874700 1 -- 172.21.15.133:0/3471472778 wait complete. 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.727+0000 7f2121874700 1 Processor -- start 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.727+0000 7f2121874700 1 -- start start 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c062ff0 0x7f211c0aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0ac590 con 0x7f211c062c10 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0acf10 con 0x7f211c062ff0 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f2121874700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0ab980 con 0x7f211c065b50 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34104/0 (socket says 172.21.15.133:34104) 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 -- 172.21.15.133:0/3532956550 learned_addr learned my addr 172.21.15.133:0/3532956550 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211a7fc700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c062ff0 0x7f211c0aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211b7fe700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 -- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 msgr2=0x7f211c0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 -- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c062ff0 msgr2=0x7f211c0aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c062ff0 0x7f211c0aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 -- 172.21.15.133:0/3532956550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0092a0 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211b7fe700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.728+0000 7f211affd700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f210400c460 tx=0x7f2104007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.729+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400ce80 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.729+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040072e0 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.729+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c0abc60 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.729+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104007660 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.729+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c0ac220 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.730+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c05fdf0 con 0x7f211c062c10 2024-01-21T19:59:51.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.730+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f21040059b0 con 0x7f211c062c10 2024-01-21T19:59:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.730+0000 7f21137fe700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 0x7f20fc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.730+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2104079330 con 0x7f211c062c10 2024-01-21T19:59:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.730+0000 7f211a7fc700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 0x7f20fc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:51.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.731+0000 7f211a7fc700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 0x7f20fc0615e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f211c13b7f0 tx=0x7f210c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:51.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.735+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f210404a950 con 0x7f211c062c10 2024-01-21T19:59:51.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.959+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f211c069ef0 con 0x7f211c062c10 2024-01-21T19:59:51.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.963+0000 7f21137fe700 1 -- 172.21.15.133:0/3532956550 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f211c069ef0 con 0x7f211c062c10 2024-01-21T19:59:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 msgr2=0x7f20fc0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 0x7f20fc0615e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f211c13b7f0 tx=0x7f210c017000).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 msgr2=0x7f211c165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f210400c460 tx=0x7f2104007e90).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 shutdown_connections 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f20fc05f120 0x7f20fc0615e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c065b50 0x7f211c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211c062c10 0x7f211c165680 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 --2- 172.21.15.133:0/3532956550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c062ff0 0x7f211c0aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 >> 172.21.15.133:0/3532956550 conn(0x7f211c0c8010 msgr2=0x7f211c0c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 shutdown_connections 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:51.965+0000 7f2121874700 1 -- 172.21.15.133:0/3532956550 wait complete. 2024-01-21T19:59:51.957 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2024-01-21T19:59:51.968 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.093+0000 7fdec9f3a700 1 Processor -- start 2024-01-21T19:59:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.093+0000 7fdec9f3a700 1 -- start start 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.093+0000 7fdec9f3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec9f3a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 0x7fdec40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec9f3a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdec4069cd0 0x7fdec4151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec9f3a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec40bef10 con 0x7fdec4069cd0 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec9f3a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdec4156070 con 0x7fdec40c3fb0 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec9f3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4065660 con 0x7fdec40beb30 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdec4069cd0 0x7fdec4151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdec4069cd0 0x7fdec4151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34120/0 (socket says 172.21.15.133:34120) 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 -- 172.21.15.133:0/2081365568 learned_addr learned my addr 172.21.15.133:0/2081365568 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec37fe700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec2ffd700 1 --2- 172.21.15.133:0/2081365568 >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 0x7fdec40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 -- 172.21.15.133:0/2081365568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 msgr2=0x7fdec4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 -- 172.21.15.133:0/2081365568 >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 msgr2=0x7fdec40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 --2- 172.21.15.133:0/2081365568 >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 0x7fdec40697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 -- 172.21.15.133:0/2081365568 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4065f00 con 0x7fdec4069cd0 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec2ffd700 1 --2- 172.21.15.133:0/2081365568 >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 0x7fdec40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec3fff700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec4151b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fdec40c5b20 tx=0x7fdebc009840).ready entity=mon.0 client_cookie=35b60943ad5d340d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec27fc700 1 -- 172.21.15.133:0/2081365568 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00e070 con 0x7fdec4069cd0 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec27fc700 1 -- 172.21.15.133:0/2081365568 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc00ba50 con 0x7fdec4069cd0 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.094+0000 7fdec27fc700 1 -- 172.21.15.133:0/2081365568 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc00bdd0 con 0x7fdec4069cd0 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2081365568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 msgr2=0x7fdec4151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec4151b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fdec40c5b20 tx=0x7fdebc009840).stop 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2081365568 shutdown_connections 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec4151b00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2081365568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2081365568 >> v2:172.21.15.178:3300/0 conn(0x7fdec40c3fb0 0x7fdec40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2081365568 >> 172.21.15.133:0/2081365568 conn(0x7fdec40c8010 msgr2=0x7fdec40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2081365568 shutdown_connections 2024-01-21T19:59:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.095+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2081365568 wait complete. 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.096+0000 7fdec9f3a700 1 Processor -- start 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.096+0000 7fdec9f3a700 1 -- start start 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40c3fb0 0x7fdec40abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40c0b80 con 0x7fdec4069cd0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4168750 con 0x7fdec40c3fb0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec9f3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4168a30 con 0x7fdec40beb30 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34134/0 (socket says 172.21.15.133:34134) 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 -- 172.21.15.133:0/2224393262 learned_addr learned my addr 172.21.15.133:0/2224393262 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 -- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 msgr2=0x7fdec4167e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec3fff700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40c3fb0 0x7fdec40abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 -- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40c3fb0 msgr2=0x7fdec40abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40c3fb0 0x7fdec40abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.097+0000 7fdec37fe700 1 -- 172.21.15.133:0/2224393262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc009ae0 con 0x7fdec4069cd0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdec37fe700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fdeb400c650 tx=0x7fdeb4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4010580 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40106e0 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec4168d10 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4010a60 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.098+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4168380 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.099+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec405fdf0 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.099+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdeb401b460 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.099+0000 7fdeabfff700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 0x7fdeb0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.099+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdeb4079dd0 con 0x7fdec4069cd0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.099+0000 7fdec2ffd700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 0x7fdeb0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.100+0000 7fdec2ffd700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 0x7fdeb0061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdeb8006fd0 tx=0x7fdeb8008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.103+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdeb404b390 con 0x7fdec4069cd0 2024-01-21T19:59:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.268+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdec406ac20 con 0x7fdec4069cd0 2024-01-21T19:59:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.269+0000 7fdeabfff700 1 -- 172.21.15.133:0/2224393262 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fdeb404e9b0 con 0x7fdec4069cd0 2024-01-21T19:59:52.260 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:52.261 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:49.327812+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 msgr2=0x7fdeb0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 0x7fdeb0061610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fdeb8006fd0 tx=0x7fdeb8008040).stop 2024-01-21T19:59:52.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 msgr2=0x7fdec40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fdeb400c650 tx=0x7fdeb4008040).stop 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 shutdown_connections 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdeb005f150 0x7fdeb0061610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40c3fb0 0x7fdec40abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdec4069cd0 0x7fdec40a5990 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 --2- 172.21.15.133:0/2224393262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdec40beb30 0x7fdec4167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 >> 172.21.15.133:0/2224393262 conn(0x7fdec40c8010 msgr2=0x7fdec40c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 shutdown_connections 2024-01-21T19:59:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.271+0000 7fdec9f3a700 1 -- 172.21.15.133:0/2224393262 wait complete. 2024-01-21T19:59:52.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T19:59:52.275 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T19:59:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.403+0000 7fb839f04700 1 Processor -- start 2024-01-21T19:59:52.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.403+0000 7fb839f04700 1 -- start start 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb839f04700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8340beb30 0x7fb834155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb839f04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 0x7fb8340697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb839f04700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb834065660 con 0x7fb834069cd0 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb839f04700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340bef10 con 0x7fb8340beb30 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb839f04700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb834156070 con 0x7fb8340c3fb0 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8340beb30 0x7fb834155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8340beb30 0x7fb834155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34150/0 (socket says 172.21.15.133:34150) 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 -- 172.21.15.133:0/921687023 learned_addr learned my addr 172.21.15.133:0/921687023 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb832ffd700 1 --2- 172.21.15.133:0/921687023 >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 0x7fb8340697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 -- 172.21.15.133:0/921687023 >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 msgr2=0x7fb8340697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:52.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 --2- 172.21.15.133:0/921687023 >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 0x7fb8340697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 -- 172.21.15.133:0/921687023 >> v1:172.21.15.178:6789/0 conn(0x7fb834069cd0 legacy=0x7fb834151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb8337fe700 1 -- 172.21.15.133:0/921687023 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834065f00 con 0x7fb8340beb30 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.404+0000 7fb832ffd700 1 --2- 172.21.15.133:0/921687023 >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 0x7fb8340697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb8337fe700 1 --2- 172.21.15.133:0/921687023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb834155b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fb83405ecd0 tx=0x7fb82800b3b0).ready entity=mon.0 client_cookie=239333a99bfd5349 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb8327fc700 1 -- 172.21.15.133:0/921687023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800dac0 con 0x7fb8340beb30 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb8327fc700 1 -- 172.21.15.133:0/921687023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800dc20 con 0x7fb8340beb30 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb8327fc700 1 -- 172.21.15.133:0/921687023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828010470 con 0x7fb8340beb30 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 -- 172.21.15.133:0/921687023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 msgr2=0x7fb834155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 --2- 172.21.15.133:0/921687023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb834155b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7fb83405ecd0 tx=0x7fb82800b3b0).stop 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 -- 172.21.15.133:0/921687023 shutdown_connections 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 --2- 172.21.15.133:0/921687023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb834155b80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 --2- 172.21.15.133:0/921687023 >> v2:172.21.15.178:3300/0 conn(0x7fb8340c3fb0 0x7fb8340697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 -- 172.21.15.133:0/921687023 >> 172.21.15.133:0/921687023 conn(0x7fb8340c8010 msgr2=0x7fb8340c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 -- 172.21.15.133:0/921687023 shutdown_connections 2024-01-21T19:59:52.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.405+0000 7fb839f04700 1 -- 172.21.15.133:0/921687023 wait complete. 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.406+0000 7fb839f04700 1 Processor -- start 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 -- start start 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 0x7fb834161670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8340c3fb0 0x7fb834138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c7110 con 0x7fb8340beb30 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c75a0 con 0x7fb834069cd0 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb839f04700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340c6500 con 0x7fb8340c3fb0 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.407+0000 7fb832ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34152/0 (socket says 172.21.15.133:34152) 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 -- 172.21.15.133:0/3099385987 learned_addr learned my addr 172.21.15.133:0/3099385987 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb8337fe700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 0x7fb834161670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb833fff700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8340c3fb0 0x7fb834138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 -- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8340c3fb0 msgr2=0x7fb834138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8340c3fb0 0x7fb834138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 -- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 msgr2=0x7fb834161670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 0x7fb834161670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 -- 172.21.15.133:0/3099385987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82800b610 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb8337fe700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 0x7fb834161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb832ffd700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fb82400c880 tx=0x7fb824008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824010580 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8240106e0 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8340c67e0 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb824010a60 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.408+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8340c6da0 con 0x7fb8340beb30 2024-01-21T19:59:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.409+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83405fdf0 con 0x7fb8340beb30 2024-01-21T19:59:52.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.409+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb82401b460 con 0x7fb8340beb30 2024-01-21T19:59:52.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.410+0000 7fb81bfff700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.410+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb824079e90 con 0x7fb8340beb30 2024-01-21T19:59:52.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.410+0000 7fb8337fe700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.410+0000 7fb8337fe700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb82800bfd0 tx=0x7fb82800b3b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.414+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb82404b450 con 0x7fb8340beb30 2024-01-21T19:59:52.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.575+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb83406ac20 con 0x7fb8340beb30 2024-01-21T19:59:52.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.575+0000 7fb81bfff700 1 -- 172.21.15.133:0/3099385987 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb82404ea70 con 0x7fb8340beb30 2024-01-21T19:59:52.567 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 msgr2=0x7fb820061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb82800bfd0 tx=0x7fb82800b3b0).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 msgr2=0x7fb8340c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fb82400c880 tx=0x7fb824008040).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 shutdown_connections 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8340c3fb0 0x7fb834138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb834069cd0 0x7fb834161670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 --2- 172.21.15.133:0/3099385987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8340beb30 0x7fb8340c5cb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 >> 172.21.15.133:0/3099385987 conn(0x7fb8340c8010 msgr2=0x7fb8340bd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 shutdown_connections 2024-01-21T19:59:52.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.577+0000 7fb839f04700 1 -- 172.21.15.133:0/3099385987 wait complete. 2024-01-21T19:59:52.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T19:59:52.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.708+0000 7f30ac480700 1 Processor -- start 2024-01-21T19:59:52.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.708+0000 7f30ac480700 1 -- start start 2024-01-21T19:59:52.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30ac480700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a41558c0 0x7f30a40626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30ac480700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a4155ca0 0x7f30a4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30ac480700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a40a50f0 con 0x7f30a40bd180 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30ac480700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a40630d0 con 0x7f30a4155ca0 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30ac480700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40a4da0 con 0x7f30a41558c0 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a4155ca0 0x7f30a4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30a4155ca0 0x7f30a4062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34160/0 (socket says 172.21.15.133:34160) 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 -- 172.21.15.133:0/1097888630 learned_addr learned my addr 172.21.15.133:0/1097888630 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30aa21c700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a41558c0 0x7f30a40626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 -- 172.21.15.133:0/1097888630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a41558c0 msgr2=0x7f30a40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a41558c0 0x7f30a40626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.709+0000 7f30a9a1b700 1 -- 172.21.15.133:0/1097888630 >> v1:172.21.15.178:6789/0 conn(0x7f30a40bd180 legacy=0x7f30a40bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30a9a1b700 1 -- 172.21.15.133:0/1097888630 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a40bde00 con 0x7f30a4155ca0 2024-01-21T19:59:52.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a4155ca0 0x7f30a4062be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f30a0006fd0 tx=0x7f30a00090f0).ready entity=mon.0 client_cookie=c6dbc06b6efffe0b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30a921a700 1 -- 172.21.15.133:0/1097888630 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000b600 con 0x7f30a4155ca0 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30a921a700 1 -- 172.21.15.133:0/1097888630 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a000b760 con 0x7f30a4155ca0 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30a921a700 1 -- 172.21.15.133:0/1097888630 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000bb00 con 0x7f30a4155ca0 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 -- 172.21.15.133:0/1097888630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a4155ca0 msgr2=0x7f30a4062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a4155ca0 0x7f30a4062be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f30a0006fd0 tx=0x7f30a00090f0).stop 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 -- 172.21.15.133:0/1097888630 shutdown_connections 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a41558c0 0x7f30a40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 --2- 172.21.15.133:0/1097888630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a4155ca0 0x7f30a4062be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 -- 172.21.15.133:0/1097888630 >> 172.21.15.133:0/1097888630 conn(0x7f30a40c8010 msgr2=0x7f30a40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 -- 172.21.15.133:0/1097888630 shutdown_connections 2024-01-21T19:59:52.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.710+0000 7f30ac480700 1 -- 172.21.15.133:0/1097888630 wait complete. 2024-01-21T19:59:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 Processor -- start 2024-01-21T19:59:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 -- start start 2024-01-21T19:59:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 0x7f30a4066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a4155ca0 0x7f30a40c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4165a80 con 0x7f30a40bd180 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a40adce0 con 0x7f30a41558c0 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30ac480700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a4164e70 con 0x7f30a4155ca0 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30aa21c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30aa21c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34168/0 (socket says 172.21.15.133:34168) 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.712+0000 7f30aa21c700 1 -- 172.21.15.133:0/3428298895 learned_addr learned my addr 172.21.15.133:0/3428298895 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 -- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a4155ca0 msgr2=0x7f30a40c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a4155ca0 0x7f30a40c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 -- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 msgr2=0x7f30a4066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 0x7f30a4066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 0x7f30a4066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 -- 172.21.15.133:0/3428298895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0009370 con 0x7f30a40bd180 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 0x7f30a4066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:52.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30aa21c700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f309400d890 tx=0x7f3094008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30940125f0 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3094012750 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a4165150 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3094012ad0 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.713+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a4165710 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.714+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a40abf40 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.714+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3094013480 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.715+0000 7f309affd700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 0x7f3088061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.715+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3094079c20 con 0x7f30a40bd180 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.715+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 0x7f3088061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.715+0000 7f30a9a1b700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 0x7f3088061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f30a40c8c50 tx=0x7f30a0017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:52.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.719+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f309404b1e0 con 0x7f30a40bd180 2024-01-21T19:59:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.881+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30a405fdf0 con 0x7f30a40bd180 2024-01-21T19:59:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.882+0000 7f309affd700 1 -- 172.21.15.133:0/3428298895 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f309404e800 con 0x7f30a40bd180 2024-01-21T19:59:52.873 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.883+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 msgr2=0x7f3088061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.883+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 0x7f3088061610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f30a40c8c50 tx=0x7f30a0017000).stop 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.883+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 msgr2=0x7f30a414f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.883+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f309400d890 tx=0x7f3094008040).stop 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.883+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 shutdown_connections 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f308805f150 0x7f3088061610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a4155ca0 0x7f30a40c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30a40bd180 0x7f30a414f1d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 --2- 172.21.15.133:0/3428298895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a41558c0 0x7f30a4066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 >> 172.21.15.133:0/3428298895 conn(0x7f30a40c8010 msgr2=0x7f30a4151070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 shutdown_connections 2024-01-21T19:59:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:52.884+0000 7f30ac480700 1 -- 172.21.15.133:0/3428298895 wait complete. 2024-01-21T19:59:52.887 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T19:59:53.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.012+0000 7fa87b66e700 1 Processor -- start 2024-01-21T19:59:53.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.012+0000 7fa87b66e700 1 -- start start 2024-01-21T19:59:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87b66e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 0x7fa8740c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87b66e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8740be810 0x7fa8740a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87b66e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8740bfa40 con 0x7fa8740c39f0 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87b66e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740c3e70 con 0x7fa8740be810 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87b66e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740bee30 con 0x7fa87413b970 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8740be810 0x7fa8740a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa878c09700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa8740c39f0 0x7fa8740be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39520/0 (socket says 172.21.15.133:39520) 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa878c09700 1 -- 172.21.15.133:0/2538583757 learned_addr learned my addr 172.21.15.133:0/2538583757 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87940a700 1 --2- 172.21.15.133:0/2538583757 >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 0x7fa8740c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 -- 172.21.15.133:0/2538583757 >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 msgr2=0x7fa8740c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 --2- 172.21.15.133:0/2538583757 >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 0x7fa8740c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 -- 172.21.15.133:0/2538583757 >> v1:172.21.15.133:6789/0 conn(0x7fa8740c39f0 legacy=0x7fa8740be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa86bfff700 1 -- 172.21.15.133:0/2538583757 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259794456 0 0) 0x7fa8740bfa40 con 0x7fa8740c39f0 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 -- 172.21.15.133:0/2538583757 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740bf110 con 0x7fa8740be810 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa87940a700 1 --2- 172.21.15.133:0/2538583757 >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 0x7fa8740c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.013+0000 7fa879c0b700 1 --2- 172.21.15.133:0/2538583757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8740be810 0x7fa8740a8ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa874065f70 tx=0x7fa86c009780).ready entity=mon.0 client_cookie=92304252f3e6067d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa86bfff700 1 -- 172.21.15.133:0/2538583757 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00e070 con 0x7fa8740be810 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa86bfff700 1 -- 172.21.15.133:0/2538583757 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00bc30 con 0x7fa8740be810 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa86bfff700 1 -- 172.21.15.133:0/2538583757 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c012410 con 0x7fa8740be810 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 -- 172.21.15.133:0/2538583757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8740be810 msgr2=0x7fa8740a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 --2- 172.21.15.133:0/2538583757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8740be810 0x7fa8740a8ab0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa874065f70 tx=0x7fa86c009780).stop 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 -- 172.21.15.133:0/2538583757 shutdown_connections 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 --2- 172.21.15.133:0/2538583757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8740be810 0x7fa8740a8ab0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 --2- 172.21.15.133:0/2538583757 >> v2:172.21.15.178:3300/0 conn(0x7fa87413b970 0x7fa8740c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 -- 172.21.15.133:0/2538583757 >> 172.21.15.133:0/2538583757 conn(0x7fa874066a70 msgr2=0x7fa874066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 -- 172.21.15.133:0/2538583757 shutdown_connections 2024-01-21T19:59:53.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.014+0000 7fa87b66e700 1 -- 172.21.15.133:0/2538583757 wait complete. 2024-01-21T19:59:53.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.015+0000 7fa87b66e700 1 Processor -- start 2024-01-21T19:59:53.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.015+0000 7fa87b66e700 1 -- start start 2024-01-21T19:59:53.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 0x7fa874164160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8740c39f0 0x7fa874167020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874065700 con 0x7fa87413b970 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa874063800 con 0x7fa8740be810 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87b66e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa874167510 con 0x7fa8740c39f0 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34194/0 (socket says 172.21.15.133:34194) 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 -- 172.21.15.133:0/25464675 learned_addr learned my addr 172.21.15.133:0/25464675 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa87940a700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 0x7fa874164160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa878c09700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8740c39f0 0x7fa874167020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 -- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8740c39f0 msgr2=0x7fa874167020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8740c39f0 0x7fa874167020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 -- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 msgr2=0x7fa874164160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.016+0000 7fa879c0b700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 0x7fa874164160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa879c0b700 1 -- 172.21.15.133:0/25464675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c009a20 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa87940a700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 0x7fa874164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa879c0b700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa87406a220 tx=0x7fa86c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c01d700 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c01d860 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa874164740 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c01dc00 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.017+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa874164d00 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.018+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa874063990 con 0x7fa87413b970 2024-01-21T19:59:53.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.018+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa86c027460 con 0x7fa87413b970 2024-01-21T19:59:53.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.019+0000 7fa869ffb700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 0x7fa858061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.019+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa86c07bf70 con 0x7fa87413b970 2024-01-21T19:59:53.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.019+0000 7fa87940a700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 0x7fa858061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.019+0000 7fa87940a700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 0x7fa858061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa870006fd0 tx=0x7fa870008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.023+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa86c0aab00 con 0x7fa87413b970 2024-01-21T19:59:53.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.189+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa87405fdf0 con 0x7fa87413b970 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.189+0000 7fa869ffb700 1 -- 172.21.15.133:0/25464675 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa86c04d530 con 0x7fa87413b970 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T19:59:53.181 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T19:59:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T19:59:53.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T19:59:53.182 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T19:59:53.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.191+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 msgr2=0x7fa858061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.191+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 0x7fa858061610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fa870006fd0 tx=0x7fa870008040).stop 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.191+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 msgr2=0x7fa8740a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.191+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fa87406a220 tx=0x7fa86c009780).stop 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 shutdown_connections 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa85805f150 0x7fa858061610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87413b970 0x7fa8740a04c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8740be810 0x7fa874164160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 --2- 172.21.15.133:0/25464675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8740c39f0 0x7fa874167020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 >> 172.21.15.133:0/25464675 conn(0x7fa874066a70 msgr2=0x7fa8740c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:53.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 shutdown_connections 2024-01-21T19:59:53.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.192+0000 7fa87b66e700 1 -- 172.21.15.133:0/25464675 wait complete. 2024-01-21T19:59:53.195 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T19:59:53.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T19:59:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.324+0000 7f9bbd7b7700 1 Processor -- start 2024-01-21T19:59:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.324+0000 7f9bbd7b7700 1 -- start start 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bbd7b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 0x7f9bb805e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bbd7b7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80c9040 con 0x7f9bb80c0a70 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bbd7b7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80c9290 con 0x7f9bb814ecb0 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bbd7b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c9570 con 0x7f9bb814e8d0 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bb77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9bb80c0a70 0x7f9bb8156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39524/0 (socket says 172.21.15.133:39524) 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.325+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3847554823 learned_addr learned my addr 172.21.15.133:0/3847554823 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb6ffd700 1 --2- 172.21.15.133:0/3847554823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 0x7f9bb805e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977518277 0 0) 0x7f9bb80c9040 con 0x7f9bb80c0a70 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00033f0 con 0x7f9bb80c0a70 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152523891 0 0) 0x7f9bb80c9290 con 0x7f9bb814ecb0 2024-01-21T19:59:53.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb80c9040 con 0x7f9bb814ecb0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3847554823 >> v1:172.21.15.178:6789/0 conn(0x7f9bb814ecb0 legacy=0x7f9bb8155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3847554823 >> v1:172.21.15.133:6789/0 conn(0x7f9bb80c0a70 legacy=0x7f9bb8156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3847554823 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80c9850 con 0x7f9bb814e8d0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb6ffd700 1 --2- 172.21.15.133:0/3847554823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 0x7f9bb805e9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9bac009790 tx=0x7f9bac009060).ready entity=mon.2 client_cookie=5c6c922ac62fa6d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00f510 con 0x7f9bb814e8d0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f670 con 0x7f9bb814e8d0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.326+0000 7f9bb5ffb700 1 -- 172.21.15.133:0/3847554823 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00f9f0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/3847554823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 msgr2=0x7f9bb805e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/3847554823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 0x7f9bb805e9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9bac009790 tx=0x7f9bac009060).stop 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/3847554823 shutdown_connections 2024-01-21T19:59:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/3847554823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814e8d0 0x7f9bb805e9c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/3847554823 >> 172.21.15.133:0/3847554823 conn(0x7f9bb8084eb0 msgr2=0x7f9bb80947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/3847554823 shutdown_connections 2024-01-21T19:59:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.327+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/3847554823 wait complete. 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.329+0000 7f9bbd7b7700 1 Processor -- start 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.329+0000 7f9bbd7b7700 1 -- start start 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bb80c0a70 0x7f9bb813bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814ecb0 0x7f9bb80c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80b0fb0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c4730 con 0x7f9bb80c0a70 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80aaf10 con 0x7f9bb814ecb0 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34208/0 (socket says 172.21.15.133:34208) 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 -- 172.21.15.133:0/522431262 learned_addr learned my addr 172.21.15.133:0/522431262 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb6ffd700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bb80c0a70 0x7f9bb813bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814ecb0 0x7f9bb80c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 -- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814ecb0 msgr2=0x7f9bb80c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814ecb0 0x7f9bb80c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 -- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bb80c0a70 msgr2=0x7f9bb813bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bb80c0a70 0x7f9bb813bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 -- 172.21.15.133:0/522431262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0092a0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bb67fc700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f9ba800c450 tx=0x7f9ba8007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8012400 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8012560 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80b09f0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8012920 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.330+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb80aaba0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80aa9e0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9ba801b3b0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9b9f7fe700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 0x7f9ba4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9ba80795f0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9bb6ffd700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 0x7f9ba4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.332+0000 7f9bb6ffd700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 0x7f9ba4061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9bac009fd0 tx=0x7f9bac017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:53.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.336+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9ba804abb0 con 0x7f9bb814e8d0 2024-01-21T19:59:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:53.501+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f9bb80c9b30 con 0x7f9bb814e8d0 2024-01-21T19:59:54.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.349+0000 7f9b9f7fe700 1 -- 172.21.15.133:0/522431262 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f9ba804e1d0 con 0x7f9bb814e8d0 2024-01-21T19:59:54.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 msgr2=0x7f9ba4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:54.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 0x7f9ba4061610 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f9bac009fd0 tx=0x7f9bac017000).stop 2024-01-21T19:59:54.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 msgr2=0x7f9bb80c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f9ba800c450 tx=0x7f9ba8007c60).stop 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 shutdown_connections 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ba405f150 0x7f9ba4061610 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bb814ecb0 0x7f9bb80c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bb80c0a70 0x7f9bb813bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 --2- 172.21.15.133:0/522431262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb814e8d0 0x7f9bb80c3d50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 >> 172.21.15.133:0/522431262 conn(0x7f9bb8084eb0 msgr2=0x7f9bb80a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 shutdown_connections 2024-01-21T19:59:54.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.355+0000 7f9bbd7b7700 1 -- 172.21.15.133:0/522431262 wait complete. 2024-01-21T19:59:54.349 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T19:59:54.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T19:59:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.494+0000 7fe5ac7b6700 1 Processor -- start 2024-01-21T19:59:54.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.494+0000 7fe5ac7b6700 1 -- start start 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5ac7b6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5a40c3c20 0x7fe5a413a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5ac7b6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 0x7fe5a40bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5ac7b6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a40c64d0 con 0x7fe5a40c3840 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5ac7b6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a4067f10 con 0x7fe5a40c3c20 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5ac7b6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a40681f0 con 0x7fe5a413a9e0 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5a40c3c20 0x7fe5a413a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5a40c3c20 0x7fe5a413a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34210/0 (socket says 172.21.15.133:34210) 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 -- 172.21.15.133:0/885280775 learned_addr learned my addr 172.21.15.133:0/885280775 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5aad53700 1 --2- 172.21.15.133:0/885280775 >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 0x7fe5a40bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 -- 172.21.15.133:0/885280775 >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 msgr2=0x7fe5a40bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 --2- 172.21.15.133:0/885280775 >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 0x7fe5a40bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 -- 172.21.15.133:0/885280775 >> v1:172.21.15.178:6789/0 conn(0x7fe5a40c3840 legacy=0x7fe5a40c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5a9d51700 1 -- 172.21.15.133:0/885280775 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40684d0 con 0x7fe5a40c3c20 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.495+0000 7fe5aad53700 1 --2- 172.21.15.133:0/885280775 >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 0x7fe5a40bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5a9d51700 1 --2- 172.21.15.133:0/885280775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a40c3c20 0x7fe5a413a4f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe5a40c8eb0 tx=0x7fe5a00090f0).ready entity=mon.0 client_cookie=a42319456815cf4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5a9550700 1 -- 172.21.15.133:0/885280775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000b5a0 con 0x7fe5a40c3c20 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5a9550700 1 -- 172.21.15.133:0/885280775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a000b700 con 0x7fe5a40c3c20 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5a9550700 1 -- 172.21.15.133:0/885280775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a000baa0 con 0x7fe5a40c3c20 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/885280775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a40c3c20 msgr2=0x7fe5a413a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/885280775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a40c3c20 0x7fe5a413a4f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe5a40c8eb0 tx=0x7fe5a00090f0).stop 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/885280775 shutdown_connections 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/885280775 >> v2:172.21.15.178:3300/0 conn(0x7fe5a413a9e0 0x7fe5a40bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/885280775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a40c3c20 0x7fe5a413a4f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/885280775 >> 172.21.15.133:0/885280775 conn(0x7fe5a4066a70 msgr2=0x7fe5a4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/885280775 shutdown_connections 2024-01-21T19:59:54.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.496+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/885280775 wait complete. 2024-01-21T19:59:54.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.498+0000 7fe5ac7b6700 1 Processor -- start 2024-01-21T19:59:54.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.498+0000 7fe5ac7b6700 1 -- start start 2024-01-21T19:59:54.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 0x7fe5a4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a40c3c20 0x7fe5a40c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a40c0720 con 0x7fe5a413a9e0 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4135770 con 0x7fe5a40c3c20 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5ac7b6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a4152c70 con 0x7fe5a40c3840 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34226/0 (socket says 172.21.15.133:34226) 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 -- 172.21.15.133:0/1537025074 learned_addr learned my addr 172.21.15.133:0/1537025074 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5a9d51700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a40c3c20 0x7fe5a40c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aa552700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 0x7fe5a4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 -- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 msgr2=0x7fe5a4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 0x7fe5a4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 -- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a40c3c20 msgr2=0x7fe5a40c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a40c3c20 0x7fe5a40c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aad53700 1 -- 172.21.15.133:0/1537025074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0009370 con 0x7fe5a413a9e0 2024-01-21T19:59:54.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.499+0000 7fe5aa552700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 0x7fe5a4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe5aad53700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe59c00a380 tx=0x7fe59c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00ae10 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59c00d650 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a4135490 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59c00d9f0 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.500+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a40c03b0 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.501+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a40c08d0 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.501+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe59c013070 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.501+0000 7fe59affd700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 0x7fe588061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.501+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fe59c07ab40 con 0x7fe5a413a9e0 2024-01-21T19:59:54.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.501+0000 7fe5aa552700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 0x7fe588061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:54.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.502+0000 7fe5aa552700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 0x7fe588061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe59400a820 tx=0x7fe594008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:54.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.506+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5a40c08d0 con 0x7fe5a413a9e0 2024-01-21T19:59:54.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:54.670+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe5a40c08d0 con 0x7fe5a413a9e0 2024-01-21T19:59:55.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.350+0000 7fe59affd700 1 -- 172.21.15.133:0/1537025074 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe5a40c08d0 con 0x7fe5a413a9e0 2024-01-21T19:59:55.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.356+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 msgr2=0x7fe588061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.356+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 0x7fe588061610 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe59400a820 tx=0x7fe594008040).stop 2024-01-21T19:59:55.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.356+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 msgr2=0x7fe5a4064580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.356+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe59c00a380 tx=0x7fe59c007900).stop 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 shutdown_connections 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58805f150 0x7fe588061610 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5a413a9e0 0x7fe5a4064580 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a40c3840 0x7fe5a4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 --2- 172.21.15.133:0/1537025074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a40c3c20 0x7fe5a40c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.358+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 >> 172.21.15.133:0/1537025074 conn(0x7fe5a4066a70 msgr2=0x7fe5a4066e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:55.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.359+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 shutdown_connections 2024-01-21T19:59:55.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.361+0000 7fe5ac7b6700 1 -- 172.21.15.133:0/1537025074 wait complete. 2024-01-21T19:59:55.361 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T19:59:55.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T19:59:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.510+0000 7fe7e1fa4700 1 Processor -- start 2024-01-21T19:59:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.510+0000 7fe7e1fa4700 1 -- start start 2024-01-21T19:59:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7e1fa4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7dc0beb30 0x7fe7dc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7e1fa4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 0x7fe7dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7e1fa4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc065660 con 0x7fe7dc069cd0 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7e1fa4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc0bef10 con 0x7fe7dc0beb30 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7e1fa4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc156070 con 0x7fe7dc0c3fb0 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7dc0beb30 0x7fe7dc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7dbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe7dc069cd0 0x7fe7dc151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39526/0 (socket says 172.21.15.133:39526) 2024-01-21T19:59:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7dbfff700 1 -- 172.21.15.133:0/3954325229 learned_addr learned my addr 172.21.15.133:0/3954325229 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3954325229 >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 msgr2=0x7fe7dc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7daffd700 1 --2- 172.21.15.133:0/3954325229 >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 0x7fe7dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7da7fc700 1 -- 172.21.15.133:0/3954325229 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613838914 0 0) 0x7fe7dc065660 con 0x7fe7dc069cd0 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 --2- 172.21.15.133:0/3954325229 >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 0x7fe7dc0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3954325229 >> v1:172.21.15.133:6789/0 conn(0x7fe7dc069cd0 legacy=0x7fe7dc151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3954325229 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc065f00 con 0x7fe7dc0beb30 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7daffd700 1 --2- 172.21.15.133:0/3954325229 >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 0x7fe7dc0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.511+0000 7fe7db7fe700 1 --2- 172.21.15.133:0/3954325229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc155b80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe7dc05ecd0 tx=0x7fe7d0009060).ready entity=mon.0 client_cookie=b5a0a15132fe1d8e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7da7fc700 1 -- 172.21.15.133:0/3954325229 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00090d0 con 0x7fe7dc0beb30 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7da7fc700 1 -- 172.21.15.133:0/3954325229 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d000b520 con 0x7fe7dc0beb30 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7da7fc700 1 -- 172.21.15.133:0/3954325229 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d000b8a0 con 0x7fe7dc0beb30 2024-01-21T19:59:55.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3954325229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc0beb30 msgr2=0x7fe7dc155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3954325229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc155b80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe7dc05ecd0 tx=0x7fe7d0009060).stop 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3954325229 shutdown_connections 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3954325229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc155b80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3954325229 >> v2:172.21.15.178:3300/0 conn(0x7fe7dc0c3fb0 0x7fe7dc0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3954325229 >> 172.21.15.133:0/3954325229 conn(0x7fe7dc0c8010 msgr2=0x7fe7dc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3954325229 shutdown_connections 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.512+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3954325229 wait complete. 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.513+0000 7fe7e1fa4700 1 Processor -- start 2024-01-21T19:59:55.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 -- start start 2024-01-21T19:59:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc0bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7dc0c3fb0 0x7fe7dc0c0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c0970 con 0x7fe7dc069cd0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0c5360 con 0x7fe7dc0beb30 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7e1fa4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1539b0 con 0x7fe7dc0c3fb0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34236/0 (socket says 172.21.15.133:34236) 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.514+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3126043805 learned_addr learned my addr 172.21.15.133:0/3126043805 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7daffd700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc0bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7dbfff700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7dc0c3fb0 0x7fe7dc0c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7dc0c3fb0 msgr2=0x7fe7dc0c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7dc0c3fb0 0x7fe7dc0c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7dc0beb30 msgr2=0x7fe7dc0bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc0bff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 -- 172.21.15.133:0/3126043805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d00092a0 con 0x7fe7dc069cd0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7db7fe700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe7d0011500 tx=0x7fe7d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d00119c0 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d0011b20 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc152da0 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d001b410 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.515+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc153360 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.516+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc069390 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.516+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe7d001b800 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.517+0000 7fe7c3fff700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 0x7fe7c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.517+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe7d007bbd0 con 0x7fe7dc069cd0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.517+0000 7fe7daffd700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 0x7fe7c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.517+0000 7fe7daffd700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 0x7fe7c8061610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe7dc069890 tx=0x7fe7cc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.521+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7d004ce40 con 0x7fe7dc069cd0 2024-01-21T19:59:55.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.731+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7dc06ac20 con 0x7fe7dc069cd0 2024-01-21T19:59:55.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.737+0000 7fe7c3fff700 1 -- 172.21.15.133:0/3126043805 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe7d001f020 con 0x7fe7dc069cd0 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.740+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 msgr2=0x7fe7c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.740+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 0x7fe7c8061610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe7dc069890 tx=0x7fe7cc008040).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.740+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 msgr2=0x7fe7dc137d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.740+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fe7d0011500 tx=0x7fe7d0017000).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 shutdown_connections 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c805f150 0x7fe7c8061610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7dc0c3fb0 0x7fe7dc0c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7dc069cd0 0x7fe7dc137d10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 --2- 172.21.15.133:0/3126043805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7dc0beb30 0x7fe7dc0bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 >> 172.21.15.133:0/3126043805 conn(0x7fe7dc0c8010 msgr2=0x7fe7dc0bd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.741+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 shutdown_connections 2024-01-21T19:59:55.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.742+0000 7fe7e1fa4700 1 -- 172.21.15.133:0/3126043805 wait complete. 2024-01-21T19:59:55.737 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 5 and data pool 6 2024-01-21T19:59:55.755 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.879+0000 7f6e12e0d700 1 Processor -- start 2024-01-21T19:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.879+0000 7f6e12e0d700 1 -- start start 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e12e0d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e0c0acbc0 0x7f6e0c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e12e0d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 0x7f6e0c0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e12e0d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c152d60 con 0x7f6e0c1521e0 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e12e0d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c065fd0 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e12e0d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c0653c0 con 0x7f6e0c066460 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e10ba9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e0c0acbc0 0x7f6e0c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e113aa700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e0c1521e0 0x7f6e0c152650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39534/0 (socket says 172.21.15.133:39534) 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.880+0000 7f6e113aa700 1 -- 172.21.15.133:0/1268354709 learned_addr learned my addr 172.21.15.133:0/1268354709 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0bfff700 1 --2- 172.21.15.133:0/1268354709 >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 0x7f6e0c0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e10ba9700 1 -- 172.21.15.133:0/1268354709 >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 msgr2=0x7f6e0c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1268354709 >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 0x7f6e0c0634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e10ba9700 1 -- 172.21.15.133:0/1268354709 >> v1:172.21.15.133:6789/0 conn(0x7f6e0c1521e0 legacy=0x7f6e0c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0b7fe700 1 -- 172.21.15.133:0/1268354709 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210921775 0 0) 0x7f6e04001490 con 0x7f6e0c1521e0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e10ba9700 1 -- 172.21.15.133:0/1268354709 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c0656a0 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0bfff700 1 --2- 172.21.15.133:0/1268354709 >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 0x7f6e0c0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1268354709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0acfa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6e0c0600a0 tx=0x7f6e00009060).ready entity=mon.0 client_cookie=4e77a248e6a19b30 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0b7fe700 1 -- 172.21.15.133:0/1268354709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000b580 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0b7fe700 1 -- 172.21.15.133:0/1268354709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0000b6e0 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e0b7fe700 1 -- 172.21.15.133:0/1268354709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000ba60 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1268354709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c0acbc0 msgr2=0x7f6e0c0acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1268354709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0acfa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6e0c0600a0 tx=0x7f6e00009060).stop 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1268354709 shutdown_connections 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1268354709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0acfa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1268354709 >> v2:172.21.15.178:3300/0 conn(0x7f6e0c066460 0x7f6e0c0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.881+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1268354709 >> 172.21.15.133:0/1268354709 conn(0x7f6e0c0c8200 msgr2=0x7f6e0c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.882+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1268354709 shutdown_connections 2024-01-21T19:59:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.882+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1268354709 wait complete. 2024-01-21T19:59:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.883+0000 7f6e12e0d700 1 Processor -- start 2024-01-21T19:59:55.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.883+0000 7f6e12e0d700 1 -- start start 2024-01-21T19:59:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 0x7f6e0c14fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0bfe80 con 0x7f6e0c1521e0 2024-01-21T19:59:55.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c0160 con 0x7f6e0c0acbc0 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c0c0440 con 0x7f6e0c066460 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34258/0 (socket says 172.21.15.133:34258) 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 -- 172.21.15.133:0/1662891283 learned_addr learned my addr 172.21.15.133:0/1662891283 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e0bfff700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 0x7f6e0c14fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 -- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 msgr2=0x7f6e0c14fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 0x7f6e0c14fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 -- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 msgr2=0x7f6e0c0a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 -- 172.21.15.133:0/1662891283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000092a0 con 0x7f6e0c1521e0 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e0bfff700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 0x7f6e0c14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:55.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e113aa700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6e0400c810 tx=0x7f6e040014c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005d10 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04005e70 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c0c0720 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04007320 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.884+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c150020 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.885+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c0c0c40 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.886+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6e04007710 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.886+0000 7f6e097fa700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.886+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6e0407a010 con 0x7f6e0c1521e0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.886+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:55.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.886+0000 7f6e10ba9700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 0x7f6df0061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6e0000b340 tx=0x7f6e00017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:55.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:55.890+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6e0c0c0c40 con 0x7f6e0c1521e0 2024-01-21T19:59:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.055+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0c05fdf0 con 0x7f6e0c1521e0 2024-01-21T19:59:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.055+0000 7f6e097fa700 1 -- 172.21.15.133:0/1662891283 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f6e0404b2e0 con 0x7f6e0c1521e0 2024-01-21T19:59:56.047 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:56.047 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:55.732218+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 msgr2=0x7f6df0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 0x7f6df0061610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f6e0000b340 tx=0x7f6e00017000).stop 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 msgr2=0x7f6e0c0c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6e0400c810 tx=0x7f6e040014c0).stop 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 shutdown_connections 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6df005f150 0x7f6df0061610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e0c1521e0 0x7f6e0c0c0f20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e0c066460 0x7f6e0c14fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 --2- 172.21.15.133:0/1662891283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e0c0acbc0 0x7f6e0c0a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 >> 172.21.15.133:0/1662891283 conn(0x7f6e0c0c8200 msgr2=0x7f6e0c0c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.057+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 shutdown_connections 2024-01-21T19:59:56.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.058+0000 7f6e12e0d700 1 -- 172.21.15.133:0/1662891283 wait complete. 2024-01-21T19:59:56.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.186+0000 7fcd781ec700 1 Processor -- start 2024-01-21T19:59:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.186+0000 7fcd781ec700 1 -- start start 2024-01-21T19:59:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd781ec700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd700beb30 0x7fcd70155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd781ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd70069ef0 0x7fcd70066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd781ec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd70065660 con 0x7fcd700c3fb0 2024-01-21T19:59:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd781ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd700bef10 con 0x7fcd70069ef0 2024-01-21T19:59:56.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd781ec700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd70156070 con 0x7fcd700beb30 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd70069ef0 0x7fcd70066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd75787700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcd700c3fb0 0x7fcd700697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39542/0 (socket says 172.21.15.133:39542) 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd75787700 1 -- 172.21.15.133:0/456589372 learned_addr learned my addr 172.21.15.133:0/456589372 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd75f88700 1 --2- 172.21.15.133:0/456589372 >> v2:172.21.15.178:3300/0 conn(0x7fcd700beb30 0x7fcd70155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 -- 172.21.15.133:0/456589372 >> v2:172.21.15.178:3300/0 conn(0x7fcd700beb30 msgr2=0x7fcd70155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 --2- 172.21.15.133:0/456589372 >> v2:172.21.15.178:3300/0 conn(0x7fcd700beb30 0x7fcd70155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 -- 172.21.15.133:0/456589372 >> v1:172.21.15.133:6789/0 conn(0x7fcd700c3fb0 legacy=0x7fcd700697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd74f86700 1 -- 172.21.15.133:0/456589372 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760804956 0 0) 0x7fcd70065660 con 0x7fcd700c3fb0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 -- 172.21.15.133:0/456589372 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70065f00 con 0x7fcd70069ef0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd76789700 1 --2- 172.21.15.133:0/456589372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd70069ef0 0x7fcd70066390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcd700650a0 tx=0x7fcd68009780).ready entity=mon.0 client_cookie=bafff7608996b066 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd74f86700 1 -- 172.21.15.133:0/456589372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800e070 con 0x7fcd70069ef0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd74f86700 1 -- 172.21.15.133:0/456589372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800bbf0 con 0x7fcd70069ef0 2024-01-21T19:59:56.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.187+0000 7fcd74f86700 1 -- 172.21.15.133:0/456589372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68012410 con 0x7fcd70069ef0 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 -- 172.21.15.133:0/456589372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd70069ef0 msgr2=0x7fcd70066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 --2- 172.21.15.133:0/456589372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd70069ef0 0x7fcd70066390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcd700650a0 tx=0x7fcd68009780).stop 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 -- 172.21.15.133:0/456589372 shutdown_connections 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 --2- 172.21.15.133:0/456589372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd70069ef0 0x7fcd70066390 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 --2- 172.21.15.133:0/456589372 >> v2:172.21.15.178:3300/0 conn(0x7fcd700beb30 0x7fcd70155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 -- 172.21.15.133:0/456589372 >> 172.21.15.133:0/456589372 conn(0x7fcd700c8010 msgr2=0x7fcd700c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 -- 172.21.15.133:0/456589372 shutdown_connections 2024-01-21T19:59:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.188+0000 7fcd781ec700 1 -- 172.21.15.133:0/456589372 wait complete. 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.189+0000 7fcd781ec700 1 Processor -- start 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.189+0000 7fcd781ec700 1 -- start start 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 0x7fcd70150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 0x7fcd70066b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70067540 con 0x7fcd700c3fb0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700a8b00 con 0x7fcd70069ef0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd781ec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700a8de0 con 0x7fcd700beb30 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34274/0 (socket says 172.21.15.133:34274) 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 -- 172.21.15.133:0/2211215033 learned_addr learned my addr 172.21.15.133:0/2211215033 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd75787700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 0x7fcd70066b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd75f88700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 0x7fcd70150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 -- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 msgr2=0x7fcd70066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 0x7fcd70066b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 -- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 msgr2=0x7fcd70150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 0x7fcd70150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 -- 172.21.15.133:0/2211215033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009a20 con 0x7fcd700c3fb0 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd75f88700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 0x7fcd70150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd75787700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 0x7fcd70066b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.190+0000 7fcd76789700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fcd68011000 tx=0x7fcd68009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.191+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680116d0 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.191+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68011830 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.191+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68011bf0 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.191+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd700a90c0 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.191+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd700a8740 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.192+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7005fdf0 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.192+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcd68003040 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.192+0000 7fcd627fc700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 0x7fcd54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.192+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcd6807c130 con 0x7fcd700c3fb0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.192+0000 7fcd75f88700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 0x7fcd54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.193+0000 7fcd75f88700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 0x7fcd54061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fcd6400aa10 tx=0x7fcd64008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.197+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd6804d400 con 0x7fcd700c3fb0 2024-01-21T19:59:56.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.362+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd7006ac20 con 0x7fcd700c3fb0 2024-01-21T19:59:56.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.363+0000 7fcd627fc700 1 -- 172.21.15.133:0/2211215033 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fcd68050a20 con 0x7fcd700c3fb0 2024-01-21T19:59:56.354 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:56.354 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:55.732218+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:56.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 msgr2=0x7fcd54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 0x7fcd54061610 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fcd6400aa10 tx=0x7fcd64008040).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 msgr2=0x7fcd70067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fcd68011000 tx=0x7fcd68009780).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 shutdown_connections 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd5405f150 0x7fcd54061610 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd700c3fb0 0x7fcd70067050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd70069ef0 0x7fcd70150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 --2- 172.21.15.133:0/2211215033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd700beb30 0x7fcd70066b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 >> 172.21.15.133:0/2211215033 conn(0x7fcd700c8010 msgr2=0x7fcd7013a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 shutdown_connections 2024-01-21T19:59:56.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.365+0000 7fcd781ec700 1 -- 172.21.15.133:0/2211215033 wait complete. 2024-01-21T19:59:56.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T19:59:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.496+0000 7fc539a7c700 1 Processor -- start 2024-01-21T19:59:56.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.496+0000 7fc539a7c700 1 -- start start 2024-01-21T19:59:56.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc539a7c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc534062e00 0x7fc53415d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc539a7c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340a50f0 con 0x7fc534155ca0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc539a7c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5340a4da0 con 0x7fc5341558c0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc539a7c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5340bde00 con 0x7fc534062e00 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc52bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc534155ca0 0x7fc5340bd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39558/0 (socket says 172.21.15.133:39558) 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc52bfff700 1 -- 172.21.15.133:0/3558932647 learned_addr learned my addr 172.21.15.133:0/3558932647 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc533fff700 1 --2- 172.21.15.133:0/3558932647 >> v2:172.21.15.133:3300/0 conn(0x7fc534062e00 0x7fc53415d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc532ffd700 1 -- 172.21.15.133:0/3558932647 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583149892 0 0) 0x7fc5340a50f0 con 0x7fc534155ca0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc532ffd700 1 -- 172.21.15.133:0/3558932647 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5200033f0 con 0x7fc534155ca0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc533fff700 1 -- 172.21.15.133:0/3558932647 >> v1:172.21.15.178:6789/0 conn(0x7fc5341558c0 legacy=0x7fc5340626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc533fff700 1 -- 172.21.15.133:0/3558932647 >> v1:172.21.15.133:6789/0 conn(0x7fc534155ca0 legacy=0x7fc5340bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc533fff700 1 -- 172.21.15.133:0/3558932647 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340be0e0 con 0x7fc534062e00 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc533fff700 1 --2- 172.21.15.133:0/3558932647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53415d150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc52c009e60 tx=0x7fc52c009780).ready entity=mon.0 client_cookie=3f4f344f54aa91b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc532ffd700 1 -- 172.21.15.133:0/3558932647 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00e070 con 0x7fc534062e00 2024-01-21T19:59:56.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc532ffd700 1 -- 172.21.15.133:0/3558932647 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00bb20 con 0x7fc534062e00 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.497+0000 7fc532ffd700 1 -- 172.21.15.133:0/3558932647 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00bea0 con 0x7fc534062e00 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 -- 172.21.15.133:0/3558932647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 msgr2=0x7fc53415d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 --2- 172.21.15.133:0/3558932647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53415d150 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc52c009e60 tx=0x7fc52c009780).stop 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 -- 172.21.15.133:0/3558932647 shutdown_connections 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 --2- 172.21.15.133:0/3558932647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53415d150 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 -- 172.21.15.133:0/3558932647 >> 172.21.15.133:0/3558932647 conn(0x7fc5340c8010 msgr2=0x7fc5340c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 -- 172.21.15.133:0/3558932647 shutdown_connections 2024-01-21T19:59:56.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.498+0000 7fc539a7c700 1 -- 172.21.15.133:0/3558932647 wait complete. 2024-01-21T19:59:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.499+0000 7fc539a7c700 1 Processor -- start 2024-01-21T19:59:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.499+0000 7fc539a7c700 1 -- start start 2024-01-21T19:59:56.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5341558c0 0x7fc5340bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534155ca0 0x7fc5340950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340bf820 con 0x7fc534062e00 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc534166cc0 con 0x7fc5341558c0 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc539a7c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5340ac610 con 0x7fc534155ca0 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34306/0 (socket says 172.21.15.133:34306) 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 -- 172.21.15.133:0/252587465 learned_addr learned my addr 172.21.15.133:0/252587465 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 -- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534155ca0 msgr2=0x7fc5340950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534155ca0 0x7fc5340950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc52bfff700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5341558c0 0x7fc5340bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 -- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5341558c0 msgr2=0x7fc5340bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5341558c0 0x7fc5340bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 -- 172.21.15.133:0/252587465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c009a20 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.500+0000 7fc5337fe700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc52400c470 tx=0x7fc524007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.501+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400f470 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.501+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400f5f0 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.501+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5340bf5a0 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.501+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400f9b0 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.501+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5341661e0 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.502+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53405fdf0 con 0x7fc534062e00 2024-01-21T19:59:56.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.502+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc524012400 con 0x7fc534062e00 2024-01-21T19:59:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.503+0000 7fc530f74700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 0x7fc514061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.503+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc524079f90 con 0x7fc534062e00 2024-01-21T19:59:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.503+0000 7fc52bfff700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 0x7fc514061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.503+0000 7fc52bfff700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 0x7fc514061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc51c005750 tx=0x7fc51c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.507+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc52404b270 con 0x7fc534062e00 2024-01-21T19:59:56.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.712+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc534065210 con 0x7fc534062e00 2024-01-21T19:59:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.736+0000 7fc530f74700 1 -- 172.21.15.133:0/252587465 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc524021030 con 0x7fc534062e00 2024-01-21T19:59:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.738+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 msgr2=0x7fc514061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.738+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 0x7fc514061610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc51c005750 tx=0x7fc51c009040).stop 2024-01-21T19:59:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.738+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 msgr2=0x7fc53414f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.738+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fc52400c470 tx=0x7fc524007de0).stop 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 shutdown_connections 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc51405f150 0x7fc514061610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534155ca0 0x7fc5340950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc534062e00 0x7fc53414f3e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 --2- 172.21.15.133:0/252587465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5341558c0 0x7fc5340bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 >> 172.21.15.133:0/252587465 conn(0x7fc5340c8010 msgr2=0x7fc5341549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.739+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 shutdown_connections 2024-01-21T19:59:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.740+0000 7fc539a7c700 1 -- 172.21.15.133:0/252587465 wait complete. 2024-01-21T19:59:56.743 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T19:59:56.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T19:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.870+0000 7f3b369a8700 1 Processor -- start 2024-01-21T19:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 -- start start 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b3013aa00 0x7f3b30158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b301584f0 con 0x7f3b3013a620 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b300bd6f0 con 0x7f3b3013aa00 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.871+0000 7f3b369a8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300654e0 con 0x7f3b30062e00 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b3013aa00 0x7f3b30158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b3013aa00 0x7f3b30158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34310/0 (socket says 172.21.15.133:34310) 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 -- 172.21.15.133:0/1618233338 learned_addr learned my addr 172.21.15.133:0/1618233338 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 -- 172.21.15.133:0/1618233338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 msgr2=0x7f3b300a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b2f7fe700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 -- 172.21.15.133:0/1618233338 >> v1:172.21.15.178:6789/0 conn(0x7f3b3013a620 legacy=0x7f3b300626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 -- 172.21.15.133:0/1618233338 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30158730 con 0x7f3b3013aa00 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b2f7fe700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b34f45700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013aa00 0x7f3b30158000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3b28009f20 tx=0x7f3b28009840).ready entity=mon.0 client_cookie=6b7cda82f5e9e95e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b2effd700 1 -- 172.21.15.133:0/1618233338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800e070 con 0x7f3b3013aa00 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b2effd700 1 -- 172.21.15.133:0/1618233338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2800ba40 con 0x7f3b3013aa00 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.872+0000 7f3b2effd700 1 -- 172.21.15.133:0/1618233338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2800bdc0 con 0x7f3b3013aa00 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 -- 172.21.15.133:0/1618233338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013aa00 msgr2=0x7f3b30158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013aa00 0x7f3b30158000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3b28009f20 tx=0x7f3b28009840).stop 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 -- 172.21.15.133:0/1618233338 shutdown_connections 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013aa00 0x7f3b30158000 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 --2- 172.21.15.133:0/1618233338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 -- 172.21.15.133:0/1618233338 >> 172.21.15.133:0/1618233338 conn(0x7f3b300c7dc0 msgr2=0x7f3b300c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:56.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 -- 172.21.15.133:0/1618233338 shutdown_connections 2024-01-21T19:59:56.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.873+0000 7f3b369a8700 1 -- 172.21.15.133:0/1618233338 wait complete. 2024-01-21T19:59:56.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.874+0000 7f3b369a8700 1 Processor -- start 2024-01-21T19:59:56.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.874+0000 7f3b369a8700 1 -- start start 2024-01-21T19:59:56.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b3013aa00 0x7f3b30154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300ac120 con 0x7f3b3013a620 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300acaa0 con 0x7f3b3013aa00 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b369a8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30164ef0 con 0x7f3b30062e00 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.875+0000 7f3b2f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34316/0 (socket says 172.21.15.133:34316) 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 -- 172.21.15.133:0/4258512728 learned_addr learned my addr 172.21.15.133:0/4258512728 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2ffff700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b34f45700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b3013aa00 0x7f3b30154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 -- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 msgr2=0x7f3b300abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 -- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b3013aa00 msgr2=0x7f3b30154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b3013aa00 0x7f3b30154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:56.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 -- 172.21.15.133:0/4258512728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b28009ae0 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2f7fe700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3b2000c8b0 tx=0x7f3b20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20010580 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200106e0 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30164650 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20010a60 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.876+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30164c10 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.877+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b300ac870 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.877+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3b2001b460 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.878+0000 7f3b2cff9700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 0x7f3b1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.878+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b2007a1f0 con 0x7f3b3013a620 2024-01-21T19:59:56.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.878+0000 7f3b2ffff700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 0x7f3b1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.878+0000 7f3b2ffff700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 0x7f3b1c061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3b240036e0 tx=0x7f3b24009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:56.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:56.882+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b300ac870 con 0x7f3b3013a620 2024-01-21T19:59:57.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.086+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3b300ac870 con 0x7f3b3013a620 2024-01-21T19:59:57.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.740+0000 7f3b2cff9700 1 -- 172.21.15.133:0/4258512728 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3b300ac870 con 0x7f3b3013a620 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 msgr2=0x7f3b1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 0x7f3b1c061610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f3b240036e0 tx=0x7f3b24009040).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 msgr2=0x7f3b300a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f3b2000c8b0 tx=0x7f3b20008040).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 shutdown_connections 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1c05f150 0x7f3b1c061610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b3013aa00 0x7f3b30154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062e00 0x7f3b300abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 --2- 172.21.15.133:0/4258512728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b3013a620 0x7f3b300a85a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 >> 172.21.15.133:0/4258512728 conn(0x7f3b300c7dc0 msgr2=0x7f3b300c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.742+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 shutdown_connections 2024-01-21T19:59:57.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.743+0000 7f3b369a8700 1 -- 172.21.15.133:0/4258512728 wait complete. 2024-01-21T19:59:57.748 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T19:59:57.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T19:59:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.879+0000 7fab13447700 1 Processor -- start 2024-01-21T19:59:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.879+0000 7fab13447700 1 -- start start 2024-01-21T19:59:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab0c13a620 0x7fab0c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab0c13aa00 0x7fab0c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c062b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c0bd6f0 con 0x7fab0c13a620 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab0c1584f0 con 0x7fab0c13aa00 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab13447700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0654e0 con 0x7fab0c0626f0 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab0c13a620 0x7fab0c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab0c13a620 0x7fab0c0a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34332/0 (socket says 172.21.15.133:34332) 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 -- 172.21.15.133:0/83010586 learned_addr learned my addr 172.21.15.133:0/83010586 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab119e4700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab109e2700 1 --2- 172.21.15.133:0/83010586 >> v2:172.21.15.178:3300/0 conn(0x7fab0c13aa00 0x7fab0c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 -- 172.21.15.133:0/83010586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 msgr2=0x7fab0c062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c062b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 -- 172.21.15.133:0/83010586 >> v2:172.21.15.178:3300/0 conn(0x7fab0c13aa00 msgr2=0x7fab0c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 --2- 172.21.15.133:0/83010586 >> v2:172.21.15.178:3300/0 conn(0x7fab0c13aa00 0x7fab0c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 -- 172.21.15.133:0/83010586 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c063070 con 0x7fab0c13a620 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab111e3700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c0a6e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fab0c13e3f0 tx=0x7fab080090f0).ready entity=mon.0 client_cookie=d3208ab22e649681 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.880+0000 7fab03fff700 1 -- 172.21.15.133:0/83010586 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800b600 con 0x7fab0c13a620 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab03fff700 1 -- 172.21.15.133:0/83010586 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800b760 con 0x7fab0c13a620 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab03fff700 1 -- 172.21.15.133:0/83010586 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800bb00 con 0x7fab0c13a620 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 -- 172.21.15.133:0/83010586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 msgr2=0x7fab0c0a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c0a6e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fab0c13e3f0 tx=0x7fab080090f0).stop 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 -- 172.21.15.133:0/83010586 shutdown_connections 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 --2- 172.21.15.133:0/83010586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c0a6e30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 --2- 172.21.15.133:0/83010586 >> v2:172.21.15.178:3300/0 conn(0x7fab0c13aa00 0x7fab0c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 -- 172.21.15.133:0/83010586 >> 172.21.15.133:0/83010586 conn(0x7fab0c0c7dc0 msgr2=0x7fab0c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 -- 172.21.15.133:0/83010586 shutdown_connections 2024-01-21T19:59:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.881+0000 7fab13447700 1 -- 172.21.15.133:0/83010586 wait complete. 2024-01-21T19:59:57.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.882+0000 7fab13447700 1 Processor -- start 2024-01-21T19:59:57.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.882+0000 7fab13447700 1 -- start start 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 0x7fab0c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a7b80 con 0x7fab0c13a620 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a7e60 con 0x7fab0c13aa00 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab13447700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c0a8140 con 0x7fab0c0626f0 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab109e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab109e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34336/0 (socket says 172.21.15.133:34336) 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab109e2700 1 -- 172.21.15.133:0/1674351385 learned_addr learned my addr 172.21.15.133:0/1674351385 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.883+0000 7fab111e3700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab119e4700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 0x7fab0c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 -- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 msgr2=0x7fab0c0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:57.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c0ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 -- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 msgr2=0x7fab0c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 0x7fab0c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 -- 172.21.15.133:0/1674351385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08009370 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab119e4700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 0x7fab0c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab109e2700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7faafc00d890 tx=0x7faafc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0125f0 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc012750 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc012ad0 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c0a8420 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.884+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c139dd0 con 0x7fab0c13a620 2024-01-21T19:59:57.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.885+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c0aae00 con 0x7fab0c13a620 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.885+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faafc013480 con 0x7fab0c13a620 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.886+0000 7fab01ffb700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.886+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faafc079eb0 con 0x7fab0c13a620 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.886+0000 7fab111e3700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.886+0000 7fab111e3700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 0x7faaf0061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fab08009fd0 tx=0x7fab08017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:57.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:57.890+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fab0c0aae00 con 0x7fab0c13a620 2024-01-21T19:59:58.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.096+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab0c05fdf0 con 0x7fab0c13a620 2024-01-21T19:59:58.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.096+0000 7fab01ffb700 1 -- 172.21.15.133:0/1674351385 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7faafc04b120 con 0x7fab0c13a620 2024-01-21T19:59:58.088 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:58.088 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T19:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.098+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 msgr2=0x7faaf0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.098+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 0x7faaf0061610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fab08009fd0 tx=0x7fab08017000).stop 2024-01-21T19:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.098+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 msgr2=0x7fab0c1398e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.098+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7faafc00d890 tx=0x7faafc008040).stop 2024-01-21T19:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 shutdown_connections 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faaf005f150 0x7faaf0061610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab0c13aa00 0x7fab0c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab0c0626f0 0x7fab0c0ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 --2- 172.21.15.133:0/1674351385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab0c13a620 0x7fab0c1398e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 >> 172.21.15.133:0/1674351385 conn(0x7fab0c0c7dc0 msgr2=0x7fab0c156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 shutdown_connections 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.099+0000 7fab13447700 1 -- 172.21.15.133:0/1674351385 wait complete. 2024-01-21T19:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T19:59:58.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T19:59:58.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.226+0000 7f6b66f76700 1 Processor -- start 2024-01-21T19:59:58.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.226+0000 7f6b66f76700 1 -- start start 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b66f76700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b600acbc0 0x7f6b600acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b66f76700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 0x7f6b60152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b66f76700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60065fd0 con 0x7f6b60066460 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b66f76700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b60063be0 con 0x7f6b600acbc0 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b66f76700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b600653c0 con 0x7f6b601521e0 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b600acbc0 0x7f6b600acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b600acbc0 0x7f6b600acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34344/0 (socket says 172.21.15.133:34344) 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b5ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b60066460 0x7f6b600634d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39570/0 (socket says 172.21.15.133:39570) 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 -- 172.21.15.133:0/4218731367 learned_addr learned my addr 172.21.15.133:0/4218731367 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b65513700 1 --2- 172.21.15.133:0/4218731367 >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 0x7f6b60152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 -- 172.21.15.133:0/4218731367 >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 msgr2=0x7f6b60152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b5f7fe700 1 -- 172.21.15.133:0/4218731367 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268317206 0 0) 0x7f6b60065fd0 con 0x7f6b60066460 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 --2- 172.21.15.133:0/4218731367 >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 0x7f6b60152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 -- 172.21.15.133:0/4218731367 >> v1:172.21.15.133:6789/0 conn(0x7f6b60066460 legacy=0x7f6b600634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b64d12700 1 -- 172.21.15.133:0/4218731367 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b600656a0 con 0x7f6b600acbc0 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.227+0000 7f6b65513700 1 --2- 172.21.15.133:0/4218731367 >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 0x7f6b60152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b64d12700 1 --2- 172.21.15.133:0/4218731367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600acbc0 0x7f6b600acfa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f6b6005e880 tx=0x7f6b540090f0).ready entity=mon.0 client_cookie=68132d8c65dbc31d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b5f7fe700 1 -- 172.21.15.133:0/4218731367 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400b600 con 0x7f6b600acbc0 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b5f7fe700 1 -- 172.21.15.133:0/4218731367 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400b760 con 0x7f6b600acbc0 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b5f7fe700 1 -- 172.21.15.133:0/4218731367 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400bae0 con 0x7f6b600acbc0 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 -- 172.21.15.133:0/4218731367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600acbc0 msgr2=0x7f6b600acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 --2- 172.21.15.133:0/4218731367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600acbc0 0x7f6b600acfa0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f6b6005e880 tx=0x7f6b540090f0).stop 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 -- 172.21.15.133:0/4218731367 shutdown_connections 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 --2- 172.21.15.133:0/4218731367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b600acbc0 0x7f6b600acfa0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 --2- 172.21.15.133:0/4218731367 >> v2:172.21.15.178:3300/0 conn(0x7f6b601521e0 0x7f6b60152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 -- 172.21.15.133:0/4218731367 >> 172.21.15.133:0/4218731367 conn(0x7f6b600c8200 msgr2=0x7f6b600c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 -- 172.21.15.133:0/4218731367 shutdown_connections 2024-01-21T19:59:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.228+0000 7f6b66f76700 1 -- 172.21.15.133:0/4218731367 wait complete. 2024-01-21T19:59:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.229+0000 7f6b66f76700 1 Processor -- start 2024-01-21T19:59:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.229+0000 7f6b66f76700 1 -- start start 2024-01-21T19:59:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b600acbc0 0x7f6b60152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b601521e0 0x7f6b600bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60154f50 con 0x7f6b60066460 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60155230 con 0x7f6b601521e0 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b66f76700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60155510 con 0x7f6b600acbc0 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.230+0000 7f6b64d12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34350/0 (socket says 172.21.15.133:34350) 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 -- 172.21.15.133:0/3756086565 learned_addr learned my addr 172.21.15.133:0/3756086565 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b65513700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b601521e0 0x7f6b600bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b5ffff700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b600acbc0 0x7f6b60152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 -- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b600acbc0 msgr2=0x7f6b60152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b600acbc0 0x7f6b60152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 -- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b601521e0 msgr2=0x7f6b600bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b601521e0 0x7f6b600bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 -- 172.21.15.133:0/3756086565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54009370 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b64d12700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f6b54009130 tx=0x7f6b54017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400bae0 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54000c90 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b601557f0 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5401c650 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.231+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b60150690 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.232+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60155d10 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.232+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6b5401ca00 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.233+0000 7f6b5d7fa700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 0x7f6b44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.233+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6b5407c090 con 0x7f6b60066460 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.233+0000 7f6b5ffff700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 0x7f6b44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.233+0000 7f6b5ffff700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 0x7f6b44061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b600c7090 tx=0x7f6b4c007180).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.237+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b60155d10 con 0x7f6b60066460 2024-01-21T19:59:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.400+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b60155d10 con 0x7f6b60066460 2024-01-21T19:59:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.401+0000 7f6b5d7fa700 1 -- 172.21.15.133:0/3756086565 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f6b60155d10 con 0x7f6b60066460 2024-01-21T19:59:58.395 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:58.395 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T19:59:56.734172+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T19:59:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 msgr2=0x7f6b44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 0x7f6b44061610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b600c7090 tx=0x7f6b4c007180).stop 2024-01-21T19:59:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 msgr2=0x7f6b600c1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f6b54009130 tx=0x7f6b54017000).stop 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 shutdown_connections 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6b4405f150 0x7f6b44061610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b601521e0 0x7f6b600bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b60066460 0x7f6b600c1290 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 --2- 172.21.15.133:0/3756086565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b600acbc0 0x7f6b60152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 >> 172.21.15.133:0/3756086565 conn(0x7f6b600c8200 msgr2=0x7f6b600c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 shutdown_connections 2024-01-21T19:59:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.403+0000 7f6b66f76700 1 -- 172.21.15.133:0/3756086565 wait complete. 2024-01-21T19:59:58.406 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T19:59:58.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.531+0000 7fca6a865700 1 Processor -- start 2024-01-21T19:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.531+0000 7fca6a865700 1 -- start start 2024-01-21T19:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.532+0000 7fca6a865700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca640beb30 0x7fca64155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.532+0000 7fca6a865700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 0x7fca640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.532+0000 7fca6a865700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca64065660 con 0x7fca64069cd0 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.532+0000 7fca6a865700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640bef10 con 0x7fca640beb30 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.532+0000 7fca6a865700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64156070 con 0x7fca640c3fb0 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca640beb30 0x7fca64155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca640beb30 0x7fca64155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34360/0 (socket says 172.21.15.133:34360) 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 -- 172.21.15.133:0/3074338524 learned_addr learned my addr 172.21.15.133:0/3074338524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca637fe700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 0x7fca640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 -- 172.21.15.133:0/3074338524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 msgr2=0x7fca640697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 0x7fca640697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 -- 172.21.15.133:0/3074338524 >> v1:172.21.15.178:6789/0 conn(0x7fca64069cd0 legacy=0x7fca64151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 -- 172.21.15.133:0/3074338524 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64065f00 con 0x7fca640beb30 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca637fe700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 0x7fca640697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca63fff700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640beb30 0x7fca64155b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fca4c006fd0 tx=0x7fca4c0090f0).ready entity=mon.0 client_cookie=f88895a4bc1281c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca62ffd700 1 -- 172.21.15.133:0/3074338524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00b600 con 0x7fca640beb30 2024-01-21T19:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca62ffd700 1 -- 172.21.15.133:0/3074338524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c00b760 con 0x7fca640beb30 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.533+0000 7fca62ffd700 1 -- 172.21.15.133:0/3074338524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00bb00 con 0x7fca640beb30 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 -- 172.21.15.133:0/3074338524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640beb30 msgr2=0x7fca64155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640beb30 0x7fca64155b80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fca4c006fd0 tx=0x7fca4c0090f0).stop 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 -- 172.21.15.133:0/3074338524 shutdown_connections 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640beb30 0x7fca64155b80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 --2- 172.21.15.133:0/3074338524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca640c3fb0 0x7fca640697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 -- 172.21.15.133:0/3074338524 >> 172.21.15.133:0/3074338524 conn(0x7fca640c8010 msgr2=0x7fca640c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 -- 172.21.15.133:0/3074338524 shutdown_connections 2024-01-21T19:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.534+0000 7fca6a865700 1 -- 172.21.15.133:0/3074338524 wait complete. 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.535+0000 7fca6a865700 1 Processor -- start 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.535+0000 7fca6a865700 1 -- start start 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 0x7fca64163930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca640beb30 0x7fca64139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640c01a0 con 0x7fca640c3fb0 2024-01-21T19:59:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64139860 con 0x7fca640beb30 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca6a865700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca640bf900 con 0x7fca64069cd0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34366/0 (socket says 172.21.15.133:34366) 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 -- 172.21.15.133:0/360961036 learned_addr learned my addr 172.21.15.133:0/360961036 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca63fff700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 0x7fca64163930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca637fe700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca640beb30 0x7fca64139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 -- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 msgr2=0x7fca64163930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 0x7fca64163930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 -- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca640beb30 msgr2=0x7fca64139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca640beb30 0x7fca64139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 -- 172.21.15.133:0/360961036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009370 con 0x7fca640c3fb0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca63fff700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 0x7fca64163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.536+0000 7fca68e02700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fca5c00b810 tx=0x7fca5c009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.537+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00d600 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.537+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c00d780 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.537+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c00db40 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.537+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca640bfbe0 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.537+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca640a7a80 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.538+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca640a7ca0 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.538+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fca5c019460 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.538+0000 7fca60ff9700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 0x7fca44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.538+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca5c07a2a0 con 0x7fca640c3fb0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.538+0000 7fca63fff700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 0x7fca44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.539+0000 7fca63fff700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 0x7fca44061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fca4c00b3c0 tx=0x7fca4c017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.543+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca5c04b510 con 0x7fca640c3fb0 2024-01-21T19:59:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.702+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca6406ac20 con 0x7fca4405f150 2024-01-21T19:59:58.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.711+0000 7fca60ff9700 1 -- 172.21.15.133:0/360961036 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325193 (secure 0 0 0) 0x7fca6406ac20 con 0x7fca4405f150 2024-01-21T19:59:58.708 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 msgr2=0x7fca44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 0x7fca44061610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fca4c00b3c0 tx=0x7fca4c017000).stop 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 msgr2=0x7fca640bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fca5c00b810 tx=0x7fca5c009290).stop 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 shutdown_connections 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca4405f150 0x7fca44061610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca640c3fb0 0x7fca640bf0b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca64069cd0 0x7fca64163930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 --2- 172.21.15.133:0/360961036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca640beb30 0x7fca64139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 >> 172.21.15.133:0/360961036 conn(0x7fca640c8010 msgr2=0x7fca64066bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 shutdown_connections 2024-01-21T19:59:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.715+0000 7fca6a865700 1 -- 172.21.15.133:0/360961036 wait complete. 2024-01-21T19:59:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:58.718 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-01-21T19:59:57.859494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379384,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595336,"statfs":{"total":773094113280,"available":770657624064,"internally_reserved":0,"allocated":2678784,"data_stored":1053446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4313,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279228"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327418+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:48.327418+0000","last_peered":"2024-01-21T19:59:48.327418+0000","last_clean":"2024-01-21T19:59:48.327418+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:48.327418+0000","last_undegraded":"2024-01-21T19:59:48.327418+0000","last_fullsized":"2024-01-21T19:59:48.327418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326732+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:48.326732+0000","last_peered":"2024-01-21T19:59:48.326732+0000","last_clean":"2024-01-21T19:59:48.326732+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:48.326732+0000","last_undegraded":"2024-01-21T19:59:48.326732+0000","last_fullsized":"2024-01-21T19:59:48.326732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.330512+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:48.330512+0000","last_peered":"2024-01-21T19:59:48.330512+0000","last_clean":"2024-01-21T19:59:48.330512+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:48.330512+0000","last_undegraded":"2024-01-21T19:59:48.330512+0000","last_fullsized":"2024-01-21T19:59:48.330512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326738+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:48.326738+0000","last_peered":"2024-01-21T19:59:48.326738+0000","last_clean":"2024-01-21T19:59:48.326738+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:48.326738+0000","last_undegraded":"2024-01-21T19:59:48.326738+0000","last_fullsized":"2024-01-21T19:59:48.326738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315004+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:48.315004+0000","last_peered":"2024-01-21T19:59:48.315004+0000","last_clean":"2024-01-21T19:59:48.315004+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:48.315004+0000","last_undegraded":"2024-01-21T19:59:48.315004+0000","last_fullsized":"2024-01-21T19:59:48.315004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315516+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:48.315516+0000","last_peered":"2024-01-21T19:59:48.315516+0000","last_clean":"2024-01-21T19:59:48.315516+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:48.315516+0000","last_undegraded":"2024-01-21T19:59:48.315516+0000","last_fullsized":"2024-01-21T19:59:48.315516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.316822+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:48.316822+0000","last_peered":"2024-01-21T19:59:48.316822+0000","last_clean":"2024-01-21T19:59:48.316822+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:48.316822+0000","last_undegraded":"2024-01-21T19:59:48.316822+0000","last_fullsized":"2024-01-21T19:59:48.316822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327992+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:48.327992+0000","last_peered":"2024-01-21T19:59:48.327992+0000","last_clean":"2024-01-21T19:59:48.327992+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:48.327992+0000","last_undegraded":"2024-01-21T19:59:48.327992+0000","last_fullsized":"2024-01-21T19:59:48.327992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.306410+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:48.306410+0000","last_peered":"2024-01-21T19:59:48.306410+0000","last_clean":"2024-01-21T19:59:48.306410+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:48.306410+0000","last_undegraded":"2024-01-21T19:59:48.306410+0000","last_fullsized":"2024-01-21T19:59:48.306410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:58.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:58.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.883+0000 7f90736b2700 1 Processor -- start 2024-01-21T19:59:58.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.883+0000 7f90736b2700 1 -- start start 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f90736b2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f90736b2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f90736b2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c067f10 con 0x7f906c0c5dc0 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f90736b2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0681f0 con 0x7f906c0c6220 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f90736b2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0684d0 con 0x7f906c0c3840 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f9071c4f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f907144e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f9071c4f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57242/0 (socket says 172.21.15.133:57242) 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f907144e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:39754/0 (socket says 172.21.15.133:39754) 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f9071c4f700 1 -- 172.21.15.133:0/124098174 learned_addr learned my addr 172.21.15.133:0/124098174 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.884+0000 7f9070c4d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f906c0c5dc0 0x7f906c13a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39388/0 (socket says 172.21.15.133:39388) 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f907144e700 1 -- 172.21.15.133:0/124098174 >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 msgr2=0x7f906c0bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f907144e700 1 --2- 172.21.15.133:0/124098174 >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f907144e700 1 -- 172.21.15.133:0/124098174 >> v1:172.21.15.178:6789/0 conn(0x7f906c0c5dc0 legacy=0x7f906c13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f9063fff700 1 -- 172.21.15.133:0/124098174 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530030584 0 0) 0x7f906c067f10 con 0x7f906c0c5dc0 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f907144e700 1 -- 172.21.15.133:0/124098174 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0687b0 con 0x7f906c0c3840 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f9071c4f700 1 --2- 172.21.15.133:0/124098174 >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f907144e700 1 --2- 172.21.15.133:0/124098174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9068009760 tx=0x7f9068009060).ready entity=mon.2 client_cookie=a8f258a9d96f17fb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f9063fff700 1 -- 172.21.15.133:0/124098174 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680090d0 con 0x7f906c0c3840 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f9063fff700 1 -- 172.21.15.133:0/124098174 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906800f510 con 0x7f906c0c3840 2024-01-21T19:59:58.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f9063fff700 1 -- 172.21.15.133:0/124098174 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906800f890 con 0x7f906c0c3840 2024-01-21T19:59:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f90736b2700 1 -- 172.21.15.133:0/124098174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 msgr2=0x7f906c0c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f90736b2700 1 --2- 172.21.15.133:0/124098174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9068009760 tx=0x7f9068009060).stop 2024-01-21T19:59:58.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f90736b2700 1 -- 172.21.15.133:0/124098174 shutdown_connections 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f90736b2700 1 --2- 172.21.15.133:0/124098174 >> v2:172.21.15.178:3300/0 conn(0x7f906c0c6220 0x7f906c0bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.885+0000 7f90736b2700 1 --2- 172.21.15.133:0/124098174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c3840 0x7f906c0c3c20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.886+0000 7f90736b2700 1 -- 172.21.15.133:0/124098174 >> 172.21.15.133:0/124098174 conn(0x7f906c066a70 msgr2=0x7f906c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.886+0000 7f90736b2700 1 -- 172.21.15.133:0/124098174 shutdown_connections 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.886+0000 7f90736b2700 1 -- 172.21.15.133:0/124098174 wait complete. 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.887+0000 7f90736b2700 1 Processor -- start 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.887+0000 7f90736b2700 1 -- start start 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.887+0000 7f90736b2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 0x7f906c152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 0x7f906c0641f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c156980 con 0x7f906c0c5dc0 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c153220 con 0x7f906c0c3840 2024-01-21T19:59:58.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c13ddd0 con 0x7f906c0c6220 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34378/0 (socket says 172.21.15.133:34378) 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 -- 172.21.15.133:0/2610166234 learned_addr learned my addr 172.21.15.133:0/2610166234 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9071c4f700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 0x7f906c0641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f907144e700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 0x7f906c152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 -- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 msgr2=0x7f906c0641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 0x7f906c0641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 -- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 msgr2=0x7f906c152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 0x7f906c152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 -- 172.21.15.133:0/2610166234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9064009ae0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f907144e700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 0x7f906c152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9071c4f700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 0x7f906c0641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9070c4d700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f905c00c4e0 tx=0x7f905c007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0072e0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c007440 con 0x7f906c0c5dc0 2024-01-21T19:59:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90680092a0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.888+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0058f0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.889+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c13d2f0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.890+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c13d150 con 0x7f906c0c5dc0 2024-01-21T19:59:58.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.890+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f905c005ce0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.890+0000 7f9061ffb700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 0x7f9050061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.890+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f905c0799e0 con 0x7f906c0c5dc0 2024-01-21T19:59:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.890+0000 7f907144e700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 0x7f9050061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:58.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.891+0000 7f907144e700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 0x7f9050061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9068009270 tx=0x7f9068017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:58.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:58.894+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f906c13d150 con 0x7f906c0c5dc0 2024-01-21T19:59:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.053+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f906c13d150 con 0x7f905005f150 2024-01-21T19:59:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.062+0000 7f9061ffb700 1 -- 172.21.15.133:0/2610166234 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325193 (secure 0 0 0) 0x7f906c13d150 con 0x7f905005f150 2024-01-21T19:59:59.056 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 msgr2=0x7f9050061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 0x7f9050061610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9068009270 tx=0x7f9068017000).stop 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 msgr2=0x7f906c155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f905c00c4e0 tx=0x7f905c007c60).stop 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 shutdown_connections 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f905005f150 0x7f9050061610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906c0c6220 0x7f906c0641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f906c0c3840 0x7f906c152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 --2- 172.21.15.133:0/2610166234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f906c0c5dc0 0x7f906c155dc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 >> 172.21.15.133:0/2610166234 conn(0x7f906c066a70 msgr2=0x7f906c0c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 shutdown_connections 2024-01-21T19:59:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.065+0000 7f90736b2700 1 -- 172.21.15.133:0/2610166234 wait complete. 2024-01-21T19:59:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:59.068 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-01-21T19:59:57.859494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379384,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595336,"statfs":{"total":773094113280,"available":770657624064,"internally_reserved":0,"allocated":2678784,"data_stored":1053446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4313,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279228"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327418+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:48.327418+0000","last_peered":"2024-01-21T19:59:48.327418+0000","last_clean":"2024-01-21T19:59:48.327418+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:48.327418+0000","last_undegraded":"2024-01-21T19:59:48.327418+0000","last_fullsized":"2024-01-21T19:59:48.327418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326732+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:48.326732+0000","last_peered":"2024-01-21T19:59:48.326732+0000","last_clean":"2024-01-21T19:59:48.326732+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:48.326732+0000","last_undegraded":"2024-01-21T19:59:48.326732+0000","last_fullsized":"2024-01-21T19:59:48.326732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.330512+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:48.330512+0000","last_peered":"2024-01-21T19:59:48.330512+0000","last_clean":"2024-01-21T19:59:48.330512+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:48.330512+0000","last_undegraded":"2024-01-21T19:59:48.330512+0000","last_fullsized":"2024-01-21T19:59:48.330512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326738+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:48.326738+0000","last_peered":"2024-01-21T19:59:48.326738+0000","last_clean":"2024-01-21T19:59:48.326738+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:48.326738+0000","last_undegraded":"2024-01-21T19:59:48.326738+0000","last_fullsized":"2024-01-21T19:59:48.326738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315004+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:48.315004+0000","last_peered":"2024-01-21T19:59:48.315004+0000","last_clean":"2024-01-21T19:59:48.315004+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:48.315004+0000","last_undegraded":"2024-01-21T19:59:48.315004+0000","last_fullsized":"2024-01-21T19:59:48.315004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315516+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:48.315516+0000","last_peered":"2024-01-21T19:59:48.315516+0000","last_clean":"2024-01-21T19:59:48.315516+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:48.315516+0000","last_undegraded":"2024-01-21T19:59:48.315516+0000","last_fullsized":"2024-01-21T19:59:48.315516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.316822+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:48.316822+0000","last_peered":"2024-01-21T19:59:48.316822+0000","last_clean":"2024-01-21T19:59:48.316822+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:48.316822+0000","last_undegraded":"2024-01-21T19:59:48.316822+0000","last_fullsized":"2024-01-21T19:59:48.316822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327992+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:48.327992+0000","last_peered":"2024-01-21T19:59:48.327992+0000","last_clean":"2024-01-21T19:59:48.327992+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:48.327992+0000","last_undegraded":"2024-01-21T19:59:48.327992+0000","last_fullsized":"2024-01-21T19:59:48.327992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.306410+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:48.306410+0000","last_peered":"2024-01-21T19:59:48.306410+0000","last_clean":"2024-01-21T19:59:48.306410+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:48.306410+0000","last_undegraded":"2024-01-21T19:59:48.306410+0000","last_fullsized":"2024-01-21T19:59:48.306410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:59.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:59.139 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T19:59:59.148+0000 7f1038b71700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T19:59:59.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.233+0000 7f8752191700 1 Processor -- start 2024-01-21T19:59:59.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.233+0000 7f8752191700 1 -- start start 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f874c1558c0 0x7f874c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874c155ca0 0x7f874c062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c0bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0630d0 con 0x7f874c155ca0 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0a50f0 con 0x7f874c1558c0 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f8752191700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0a4da0 con 0x7f874c0bd180 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874c155ca0 0x7f874c062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874c155ca0 0x7f874c062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34394/0 (socket says 172.21.15.133:34394) 2024-01-21T19:59:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 -- 172.21.15.133:0/1204266530 learned_addr learned my addr 172.21.15.133:0/1204266530 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 -- 172.21.15.133:0/1204266530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 msgr2=0x7f874c0bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 --2- 172.21.15.133:0/1204266530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c0bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874b7fe700 1 --2- 172.21.15.133:0/1204266530 >> v2:172.21.15.178:3300/0 conn(0x7f874c1558c0 0x7f874c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 -- 172.21.15.133:0/1204266530 >> v2:172.21.15.178:3300/0 conn(0x7f874c1558c0 msgr2=0x7f874c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 --2- 172.21.15.133:0/1204266530 >> v2:172.21.15.178:3300/0 conn(0x7f874c1558c0 0x7f874c0626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 -- 172.21.15.133:0/1204266530 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0bde00 con 0x7f874c155ca0 2024-01-21T19:59:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874affd700 1 --2- 172.21.15.133:0/1204266530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c155ca0 0x7f874c062be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f874c0692f0 tx=0x7f873c0090f0).ready entity=mon.0 client_cookie=b35568310b03f64e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874a7fc700 1 -- 172.21.15.133:0/1204266530 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b600 con 0x7f874c155ca0 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874a7fc700 1 -- 172.21.15.133:0/1204266530 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b760 con 0x7f874c155ca0 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.234+0000 7f874a7fc700 1 -- 172.21.15.133:0/1204266530 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00bb00 con 0x7f874c155ca0 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 -- 172.21.15.133:0/1204266530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c155ca0 msgr2=0x7f874c062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 --2- 172.21.15.133:0/1204266530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c155ca0 0x7f874c062be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f874c0692f0 tx=0x7f873c0090f0).stop 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 -- 172.21.15.133:0/1204266530 shutdown_connections 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 --2- 172.21.15.133:0/1204266530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c0bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 --2- 172.21.15.133:0/1204266530 >> v2:172.21.15.178:3300/0 conn(0x7f874c1558c0 0x7f874c0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 --2- 172.21.15.133:0/1204266530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c155ca0 0x7f874c062be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 -- 172.21.15.133:0/1204266530 >> 172.21.15.133:0/1204266530 conn(0x7f874c0c8010 msgr2=0x7f874c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 -- 172.21.15.133:0/1204266530 shutdown_connections 2024-01-21T19:59:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.235+0000 7f8752191700 1 -- 172.21.15.133:0/1204266530 wait complete. 2024-01-21T19:59:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.236+0000 7f8752191700 1 Processor -- start 2024-01-21T19:59:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.236+0000 7f8752191700 1 -- start start 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 0x7f874c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c165dd0 con 0x7f874c1558c0 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c1660b0 con 0x7f874c155ca0 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f8752191700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c166390 con 0x7f874c0bd180 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f874affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f874affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34396/0 (socket says 172.21.15.133:34396) 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.237+0000 7f874affd700 1 -- 172.21.15.133:0/3945567166 learned_addr learned my addr 172.21.15.133:0/3945567166 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874b7fe700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874bfff700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 0x7f874c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 -- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 msgr2=0x7f874c143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 -- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 msgr2=0x7f874c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 0x7f874c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 -- 172.21.15.133:0/3945567166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c009370 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874bfff700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 0x7f874c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f874affd700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f874c068a00 tx=0x7f873c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c0069b0 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b8d0 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c01c420 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c166670 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.238+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c162880 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.239+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c166b90 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.239+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f873c01c7d0 con 0x7f874c1558c0 2024-01-21T19:59:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.239+0000 7f8733fff700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 0x7f8738061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.240+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f873c07bcf0 con 0x7f874c1558c0 2024-01-21T19:59:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.240+0000 7f874b7fe700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 0x7f8738061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.240+0000 7f874b7fe700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 0x7f8738061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8740006fd0 tx=0x7f8740008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.244+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f874c166b90 con 0x7f874c1558c0 2024-01-21T19:59:59.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.400+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f874c166b90 con 0x7f873805f150 2024-01-21T19:59:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.408+0000 7f8733fff700 1 -- 172.21.15.133:0/3945567166 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325193 (secure 0 0 0) 0x7f874c166b90 con 0x7f873805f150 2024-01-21T19:59:59.403 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 msgr2=0x7f8738061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 0x7f8738061610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f8740006fd0 tx=0x7f8740008040).stop 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 msgr2=0x7f874c0ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f874c068a00 tx=0x7f873c017000).stop 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 shutdown_connections 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873805f150 0x7f8738061610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c155ca0 0x7f874c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c0bd180 0x7f874c143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 --2- 172.21.15.133:0/3945567166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874c1558c0 0x7f874c0ad270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 >> 172.21.15.133:0/3945567166 conn(0x7f874c0c8010 msgr2=0x7f874c152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 shutdown_connections 2024-01-21T19:59:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.411+0000 7f8752191700 1 -- 172.21.15.133:0/3945567166 wait complete. 2024-01-21T19:59:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T19:59:59.414 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-01-21T19:59:57.859494+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2379384,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752595336,"statfs":{"total":773094113280,"available":770657624064,"internally_reserved":0,"allocated":2678784,"data_stored":1053446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4313,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279228"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327418+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:48.327418+0000","last_peered":"2024-01-21T19:59:48.327418+0000","last_clean":"2024-01-21T19:59:48.327418+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:48.327418+0000","last_undegraded":"2024-01-21T19:59:48.327418+0000","last_fullsized":"2024-01-21T19:59:48.327418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326732+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:48.326732+0000","last_peered":"2024-01-21T19:59:48.326732+0000","last_clean":"2024-01-21T19:59:48.326732+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:48.326732+0000","last_undegraded":"2024-01-21T19:59:48.326732+0000","last_fullsized":"2024-01-21T19:59:48.326732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.330512+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:48.330512+0000","last_peered":"2024-01-21T19:59:48.330512+0000","last_clean":"2024-01-21T19:59:48.330512+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:48.330512+0000","last_undegraded":"2024-01-21T19:59:48.330512+0000","last_fullsized":"2024-01-21T19:59:48.330512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.326738+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:48.326738+0000","last_peered":"2024-01-21T19:59:48.326738+0000","last_clean":"2024-01-21T19:59:48.326738+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:48.326738+0000","last_undegraded":"2024-01-21T19:59:48.326738+0000","last_fullsized":"2024-01-21T19:59:48.326738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315004+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:48.315004+0000","last_peered":"2024-01-21T19:59:48.315004+0000","last_clean":"2024-01-21T19:59:48.315004+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:48.315004+0000","last_undegraded":"2024-01-21T19:59:48.315004+0000","last_fullsized":"2024-01-21T19:59:48.315004+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.315516+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:48.315516+0000","last_peered":"2024-01-21T19:59:48.315516+0000","last_clean":"2024-01-21T19:59:48.315516+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:48.315516+0000","last_undegraded":"2024-01-21T19:59:48.315516+0000","last_fullsized":"2024-01-21T19:59:48.315516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.316822+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:48.316822+0000","last_peered":"2024-01-21T19:59:48.316822+0000","last_clean":"2024-01-21T19:59:48.316822+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:48.316822+0000","last_undegraded":"2024-01-21T19:59:48.316822+0000","last_fullsized":"2024-01-21T19:59:48.316822+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.327992+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:48.327992+0000","last_peered":"2024-01-21T19:59:48.327992+0000","last_clean":"2024-01-21T19:59:48.327992+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:48.327992+0000","last_undegraded":"2024-01-21T19:59:48.327992+0000","last_fullsized":"2024-01-21T19:59:48.327992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:55.345239+0000","last_change":"2024-01-21T19:59:55.345239+0000","last_active":"2024-01-21T19:59:55.345239+0000","last_peered":"2024-01-21T19:59:55.345239+0000","last_clean":"2024-01-21T19:59:55.345239+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:55.345239+0000","last_undegraded":"2024-01-21T19:59:55.345239+0000","last_fullsized":"2024-01-21T19:59:55.345239+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T19:59:54.339019+0000","last_change":"2024-01-21T19:59:54.339019+0000","last_active":"2024-01-21T19:59:54.339019+0000","last_peered":"2024-01-21T19:59:54.339019+0000","last_clean":"2024-01-21T19:59:54.339019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T19:59:54.339019+0000","last_undegraded":"2024-01-21T19:59:54.339019+0000","last_fullsized":"2024-01-21T19:59:54.339019+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-01-21T19:59:48.306410+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:48.306410+0000","last_peered":"2024-01-21T19:59:48.306410+0000","last_clean":"2024-01-21T19:59:48.306410+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:48.306410+0000","last_undegraded":"2024-01-21T19:59:48.306410+0000","last_fullsized":"2024-01-21T19:59:48.306410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297420,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074420,"statfs":{"total":96636764160,"available":96332206080,"internally_reserved":0,"allocated":331776,"data_stored":130960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297424,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074416,"statfs":{"total":96636764160,"available":96332201984,"internally_reserved":0,"allocated":335872,"data_stored":131921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-01-21T19:59:59.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-01-21T19:59:59.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-01-21T19:59:59.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-01-21T19:59:59.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-01-21T19:59:59.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-01-21T19:59:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-01-21T19:59:59.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-01-21T19:59:59.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-01-21T19:59:59.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-01-21T19:59:59.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-01-21T19:59:59.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-01-21T19:59:59.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-01-21T19:59:59.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-01-21T19:59:59.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-01-21T19:59:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-01-21T19:59:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:55.345239+0000', 'last_change': '2024-01-21T19:59:55.345239+0000', 'last_active': '2024-01-21T19:59:55.345239+0000', 'last_peered': '2024-01-21T19:59:55.345239+0000', 'last_clean': '2024-01-21T19:59:55.345239+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:55.345239+0000', 'last_undegraded': '2024-01-21T19:59:55.345239+0000', 'last_fullsized': '2024-01-21T19:59:55.345239+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:55.345239+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-01-21T19:59:59.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T19:59:54.339019+0000', 'last_change': '2024-01-21T19:59:54.339019+0000', 'last_active': '2024-01-21T19:59:54.339019+0000', 'last_peered': '2024-01-21T19:59:54.339019+0000', 'last_clean': '2024-01-21T19:59:54.339019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T19:59:54.339019+0000', 'last_undegraded': '2024-01-21T19:59:54.339019+0000', 'last_fullsized': '2024-01-21T19:59:54.339019+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'last_clean_scrub_stamp': '2024-01-21T19:59:54.339019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T19:59:59.445 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T19:59:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.579+0000 7fa9e3049700 1 Processor -- start 2024-01-21T19:59:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.579+0000 7fa9e3049700 1 -- start start 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e3049700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc0a9d10 0x7fa9dc0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e3049700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9dc1558d0 0x7fa9dc063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e3049700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc063750 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e3049700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0640d0 con 0x7fa9dc1558d0 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e3049700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc05e380 con 0x7fa9dc0a9d10 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e15e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9dc1558d0 0x7fa9dc063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9dbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9dc0aa0f0 0x7fa9dc1551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39580/0 (socket says 172.21.15.133:39580) 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9dbfff700 1 -- 172.21.15.133:0/86434231 learned_addr learned my addr 172.21.15.133:0/86434231 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.580+0000 7fa9e0de5700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc0a9d10 0x7fa9dc0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e15e6700 1 -- 172.21.15.133:0/86434231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc0a9d10 msgr2=0x7fa9dc0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e15e6700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc0a9d10 0x7fa9dc0ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e15e6700 1 -- 172.21.15.133:0/86434231 >> v1:172.21.15.133:6789/0 conn(0x7fa9dc0aa0f0 legacy=0x7fa9dc1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9db7fe700 1 -- 172.21.15.133:0/86434231 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576112284 0 0) 0x7fa9dc063750 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e15e6700 1 -- 172.21.15.133:0/86434231 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc05e660 con 0x7fa9dc1558d0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e15e6700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc1558d0 0x7fa9dc063be0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fa9d4009e60 tx=0x7fa9d4009780).ready entity=mon.0 client_cookie=b2c5b936daf4040 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9db7fe700 1 -- 172.21.15.133:0/86434231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400e070 con 0x7fa9dc1558d0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9db7fe700 1 -- 172.21.15.133:0/86434231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d400bc30 con 0x7fa9dc1558d0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9db7fe700 1 -- 172.21.15.133:0/86434231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4012410 con 0x7fa9dc1558d0 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 -- 172.21.15.133:0/86434231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc1558d0 msgr2=0x7fa9dc063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc1558d0 0x7fa9dc063be0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fa9d4009e60 tx=0x7fa9d4009780).stop 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 -- 172.21.15.133:0/86434231 shutdown_connections 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc1558d0 0x7fa9dc063be0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 --2- 172.21.15.133:0/86434231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc0a9d10 0x7fa9dc0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 -- 172.21.15.133:0/86434231 >> 172.21.15.133:0/86434231 conn(0x7fa9dc0c8200 msgr2=0x7fa9dc0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 -- 172.21.15.133:0/86434231 shutdown_connections 2024-01-21T19:59:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.581+0000 7fa9e3049700 1 -- 172.21.15.133:0/86434231 wait complete. 2024-01-21T19:59:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.583+0000 7fa9e3049700 1 Processor -- start 2024-01-21T19:59:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.583+0000 7fa9e3049700 1 -- start start 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9dc0a9d10 0x7fa9dc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc1558d0 0x7fa9dc0a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0a0890 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0a0ae0 con 0x7fa9dc0a9d10 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0a0dc0 con 0x7fa9dc1558d0 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34416/0 (socket says 172.21.15.133:34416) 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 -- 172.21.15.133:0/446310696 learned_addr learned my addr 172.21.15.133:0/446310696 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 -- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc1558d0 msgr2=0x7fa9dc0a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc1558d0 0x7fa9dc0a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 -- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9dc0a9d10 msgr2=0x7fa9dc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9dc0a9d10 0x7fa9dc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 -- 172.21.15.133:0/446310696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009a20 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9dbfff700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa9c8001eb0 tx=0x7fa9c8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80072e0 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8007440 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc0a10a0 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80057a0 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.584+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc151d00 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.585+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc0a0c20 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.586+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa9c8005b50 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.586+0000 7fa9d97fa700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 0x7fa9c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.586+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa9c8079930 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.586+0000 7fa9e0de5700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 0x7fa9c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.586+0000 7fa9e0de5700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 0x7fa9c0061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa9d000b8f0 tx=0x7fa9d0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.590+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa9dc0a0c20 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.816+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa9dc0a0c20 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.816+0000 7fa9d97fa700 1 -- 172.21.15.133:0/446310696 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2634 (secure 0 0 0) 0x7fa9dc0a0c20 con 0x7fa9dc0aa0f0 2024-01-21T19:59:59.808 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T19:59:59.808 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2436489216,"bytes_avail":770657624064,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":12,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4977}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-01-21T19:59:55.859177+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-21T19:59:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 msgr2=0x7fa9c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 0x7fa9c0061610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fa9d000b8f0 tx=0x7fa9d0008040).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 msgr2=0x7fa9dc0a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fa9c8001eb0 tx=0x7fa9c8007c10).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 shutdown_connections 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa9c005f150 0x7fa9c0061610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9dc1558d0 0x7fa9dc0a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9dc0a9d10 0x7fa9dc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 --2- 172.21.15.133:0/446310696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9dc0aa0f0 0x7fa9dc0a18a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 >> 172.21.15.133:0/446310696 conn(0x7fa9dc0c8200 msgr2=0x7fa9dc0aa720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 shutdown_connections 2024-01-21T19:59:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.818+0000 7fa9e3049700 1 -- 172.21.15.133:0/446310696 wait complete. 2024-01-21T19:59:59.821 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T19:59:59.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T19:59:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.947+0000 7f536183f700 1 Processor -- start 2024-01-21T19:59:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.947+0000 7f536183f700 1 -- start start 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f536183f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f536183f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f535c065d70 0x7f535c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f536183f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0634e0 con 0x7f535c0697e0 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f536183f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c06a130 con 0x7f535c065d70 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f536183f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c06a410 con 0x7f535c062c10 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f535c065d70 0x7f535c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f535c065d70 0x7f535c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34428/0 (socket says 172.21.15.133:34428) 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 -- 172.21.15.133:0/1966587884 learned_addr learned my addr 172.21.15.133:0/1966587884 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 -- 172.21.15.133:0/1966587884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 msgr2=0x7f535c062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 --2- 172.21.15.133:0/1966587884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 -- 172.21.15.133:0/1966587884 >> v1:172.21.15.178:6789/0 conn(0x7f535c0697e0 legacy=0x7f535c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.948+0000 7f535b7fe700 1 -- 172.21.15.133:0/1966587884 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c06a6f0 con 0x7f535c065d70 2024-01-21T19:59:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f535b7fe700 1 --2- 172.21.15.133:0/1966587884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c0bd770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f5354009f20 tx=0x7f5354009840).ready entity=mon.0 client_cookie=678f36723843c56c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f5359ffb700 1 -- 172.21.15.133:0/1966587884 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e070 con 0x7f535c065d70 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f5359ffb700 1 -- 172.21.15.133:0/1966587884 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400ba40 con 0x7f535c065d70 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f5359ffb700 1 -- 172.21.15.133:0/1966587884 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400bdc0 con 0x7f535c065d70 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 -- 172.21.15.133:0/1966587884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 msgr2=0x7f535c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 --2- 172.21.15.133:0/1966587884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c0bd770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f5354009f20 tx=0x7f5354009840).stop 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 -- 172.21.15.133:0/1966587884 shutdown_connections 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 --2- 172.21.15.133:0/1966587884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c0bd770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 --2- 172.21.15.133:0/1966587884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 -- 172.21.15.133:0/1966587884 >> 172.21.15.133:0/1966587884 conn(0x7f535c0c8010 msgr2=0x7f535c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 -- 172.21.15.133:0/1966587884 shutdown_connections 2024-01-21T19:59:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.949+0000 7f536183f700 1 -- 172.21.15.133:0/1966587884 wait complete. 2024-01-21T19:59:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.951+0000 7f536183f700 1 Processor -- start 2024-01-21T19:59:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.951+0000 7f536183f700 1 -- start start 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.951+0000 7f536183f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c0be420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.951+0000 7f536183f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 0x7f535c13adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c13b2e0 con 0x7f535c065d70 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0a97b0 con 0x7f535c0697e0 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c0a9a90 con 0x7f535c062c10 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34430/0 (socket says 172.21.15.133:34430) 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 -- 172.21.15.133:0/961756271 learned_addr learned my addr 172.21.15.133:0/961756271 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535b7fe700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 0x7f535c13adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535affd700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c0be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 -- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 msgr2=0x7f535c0be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c0be420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 -- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 msgr2=0x7f535c13adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 0x7f535c13adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 -- 172.21.15.133:0/961756271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009ae0 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535b7fe700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 0x7f535c13adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f535a7fc700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f534c00c490 tx=0x7f534c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00f470 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c00f5d0 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c0a9d70 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c00f990 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.952+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c155310 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.953+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c069550 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.953+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f534c012400 con 0x7f535c065d70 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.954+0000 7f53437fe700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 0x7f5348061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T19:59:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.954+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f534c0796f0 con 0x7f535c065d70 2024-01-21T19:59:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.954+0000 7f535affd700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 0x7f5348061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T19:59:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.954+0000 7f535affd700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 0x7f5348061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f535000b870 tx=0x7f5350008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T19:59:59.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T19:59:59.958+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f534c048b00 con 0x7f535c065d70 2024-01-21T20:00:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.120+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f535c0bcf70 con 0x7f534805f150 2024-01-21T20:00:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.129+0000 7f53437fe700 1 -- 172.21.15.133:0/961756271 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339452 (secure 0 0 0) 0x7f535c0bcf70 con 0x7f534805f150 2024-01-21T20:00:00.124 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 msgr2=0x7f5348061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 0x7f5348061610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f535000b870 tx=0x7f5350008040).stop 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 msgr2=0x7f535c13a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f534c00c490 tx=0x7f534c007db0).stop 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 shutdown_connections 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f534805f150 0x7f5348061610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:00.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f535c0697e0 0x7f535c13adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f535c062c10 0x7f535c0be420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 --2- 172.21.15.133:0/961756271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f535c065d70 0x7f535c13a900 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 >> 172.21.15.133:0/961756271 conn(0x7f535c0c8010 msgr2=0x7f535c0c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 shutdown_connections 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:00.132+0000 7f536183f700 1 -- 172.21.15.133:0/961756271 wait complete. 2024-01-21T20:00:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:00:00.135 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-01-21T19:59:59.859848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379820,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594900,"statfs":{"total":773094113280,"available":770657177600,"internally_reserved":0,"allocated":3125248,"data_stored":1265618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4313,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279228"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751743+0000","last_change":"2024-01-21T19:59:55.746968+0000","last_active":"2024-01-21T19:59:55.751743+0000","last_peered":"2024-01-21T19:59:55.751743+0000","last_clean":"2024-01-21T19:59:55.751743+0000","last_became_active":"2024-01-21T19:59:55.746314+0000","last_became_peered":"2024-01-21T19:59:55.746314+0000","last_unstale":"2024-01-21T19:59:55.751743+0000","last_undegraded":"2024-01-21T19:59:55.751743+0000","last_fullsized":"2024-01-21T19:59:55.751743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.766257+0000","last_change":"2024-01-21T19:59:55.373245+0000","last_active":"2024-01-21T19:59:55.766257+0000","last_peered":"2024-01-21T19:59:55.766257+0000","last_clean":"2024-01-21T19:59:55.766257+0000","last_became_active":"2024-01-21T19:59:55.372970+0000","last_became_peered":"2024-01-21T19:59:55.372970+0000","last_unstale":"2024-01-21T19:59:55.766257+0000","last_undegraded":"2024-01-21T19:59:55.766257+0000","last_fullsized":"2024-01-21T19:59:55.766257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749380+0000","last_change":"2024-01-21T19:59:55.745713+0000","last_active":"2024-01-21T19:59:55.749380+0000","last_peered":"2024-01-21T19:59:55.749380+0000","last_clean":"2024-01-21T19:59:55.749380+0000","last_became_active":"2024-01-21T19:59:55.745436+0000","last_became_peered":"2024-01-21T19:59:55.745436+0000","last_unstale":"2024-01-21T19:59:55.749380+0000","last_undegraded":"2024-01-21T19:59:55.749380+0000","last_fullsized":"2024-01-21T19:59:55.749380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749857+0000","last_change":"2024-01-21T19:59:55.376791+0000","last_active":"2024-01-21T19:59:55.749857+0000","last_peered":"2024-01-21T19:59:55.749857+0000","last_clean":"2024-01-21T19:59:55.749857+0000","last_became_active":"2024-01-21T19:59:55.376496+0000","last_became_peered":"2024-01-21T19:59:55.376496+0000","last_unstale":"2024-01-21T19:59:55.749857+0000","last_undegraded":"2024-01-21T19:59:55.749857+0000","last_fullsized":"2024-01-21T19:59:55.749857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762064+0000","last_change":"2024-01-21T19:59:55.759386+0000","last_active":"2024-01-21T19:59:55.762064+0000","last_peered":"2024-01-21T19:59:55.762064+0000","last_clean":"2024-01-21T19:59:55.762064+0000","last_became_active":"2024-01-21T19:59:55.759121+0000","last_became_peered":"2024-01-21T19:59:55.759121+0000","last_unstale":"2024-01-21T19:59:55.762064+0000","last_undegraded":"2024-01-21T19:59:55.762064+0000","last_fullsized":"2024-01-21T19:59:55.762064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739554+0000","last_change":"2024-01-21T19:59:55.371162+0000","last_active":"2024-01-21T19:59:55.739554+0000","last_peered":"2024-01-21T19:59:55.739554+0000","last_clean":"2024-01-21T19:59:55.739554+0000","last_became_active":"2024-01-21T19:59:55.370835+0000","last_became_peered":"2024-01-21T19:59:55.370835+0000","last_unstale":"2024-01-21T19:59:55.739554+0000","last_undegraded":"2024-01-21T19:59:55.739554+0000","last_fullsized":"2024-01-21T19:59:55.739554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761269+0000","last_change":"2024-01-21T19:59:55.757355+0000","last_active":"2024-01-21T19:59:55.761269+0000","last_peered":"2024-01-21T19:59:55.761269+0000","last_clean":"2024-01-21T19:59:55.761269+0000","last_became_active":"2024-01-21T19:59:55.757067+0000","last_became_peered":"2024-01-21T19:59:55.757067+0000","last_unstale":"2024-01-21T19:59:55.761269+0000","last_undegraded":"2024-01-21T19:59:55.761269+0000","last_fullsized":"2024-01-21T19:59:55.761269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756723+0000","last_change":"2024-01-21T19:59:55.369705+0000","last_active":"2024-01-21T19:59:55.756723+0000","last_peered":"2024-01-21T19:59:55.756723+0000","last_clean":"2024-01-21T19:59:55.756723+0000","last_became_active":"2024-01-21T19:59:55.369346+0000","last_became_peered":"2024-01-21T19:59:55.369346+0000","last_unstale":"2024-01-21T19:59:55.756723+0000","last_undegraded":"2024-01-21T19:59:55.756723+0000","last_fullsized":"2024-01-21T19:59:55.756723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761940+0000","last_change":"2024-01-21T19:59:55.758245+0000","last_active":"2024-01-21T19:59:55.761940+0000","last_peered":"2024-01-21T19:59:55.761940+0000","last_clean":"2024-01-21T19:59:55.761940+0000","last_became_active":"2024-01-21T19:59:55.757819+0000","last_became_peered":"2024-01-21T19:59:55.757819+0000","last_unstale":"2024-01-21T19:59:55.761940+0000","last_undegraded":"2024-01-21T19:59:55.761940+0000","last_fullsized":"2024-01-21T19:59:55.761940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760443+0000","last_change":"2024-01-21T19:59:55.373797+0000","last_active":"2024-01-21T19:59:55.760443+0000","last_peered":"2024-01-21T19:59:55.760443+0000","last_clean":"2024-01-21T19:59:55.760443+0000","last_became_active":"2024-01-21T19:59:55.372960+0000","last_became_peered":"2024-01-21T19:59:55.372960+0000","last_unstale":"2024-01-21T19:59:55.760443+0000","last_undegraded":"2024-01-21T19:59:55.760443+0000","last_fullsized":"2024-01-21T19:59:55.760443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758597+0000","last_change":"2024-01-21T19:59:55.753442+0000","last_active":"2024-01-21T19:59:55.758597+0000","last_peered":"2024-01-21T19:59:55.758597+0000","last_clean":"2024-01-21T19:59:55.758597+0000","last_became_active":"2024-01-21T19:59:55.753124+0000","last_became_peered":"2024-01-21T19:59:55.753124+0000","last_unstale":"2024-01-21T19:59:55.758597+0000","last_undegraded":"2024-01-21T19:59:55.758597+0000","last_fullsized":"2024-01-21T19:59:55.758597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761377+0000","last_change":"2024-01-21T19:59:55.356374+0000","last_active":"2024-01-21T19:59:55.761377+0000","last_peered":"2024-01-21T19:59:55.761377+0000","last_clean":"2024-01-21T19:59:55.761377+0000","last_became_active":"2024-01-21T19:59:55.356145+0000","last_became_peered":"2024-01-21T19:59:55.356145+0000","last_unstale":"2024-01-21T19:59:55.761377+0000","last_undegraded":"2024-01-21T19:59:55.761377+0000","last_fullsized":"2024-01-21T19:59:55.761377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756946+0000","last_change":"2024-01-21T19:59:55.753382+0000","last_active":"2024-01-21T19:59:55.756946+0000","last_peered":"2024-01-21T19:59:55.756946+0000","last_clean":"2024-01-21T19:59:55.756946+0000","last_became_active":"2024-01-21T19:59:55.753098+0000","last_became_peered":"2024-01-21T19:59:55.753098+0000","last_unstale":"2024-01-21T19:59:55.756946+0000","last_undegraded":"2024-01-21T19:59:55.756946+0000","last_fullsized":"2024-01-21T19:59:55.756946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749794+0000","last_change":"2024-01-21T19:59:55.373253+0000","last_active":"2024-01-21T19:59:55.749794+0000","last_peered":"2024-01-21T19:59:55.749794+0000","last_clean":"2024-01-21T19:59:55.749794+0000","last_became_active":"2024-01-21T19:59:55.372998+0000","last_became_peered":"2024-01-21T19:59:55.372998+0000","last_unstale":"2024-01-21T19:59:55.749794+0000","last_undegraded":"2024-01-21T19:59:55.749794+0000","last_fullsized":"2024-01-21T19:59:55.749794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.753293+0000","last_change":"2024-01-21T19:59:55.748190+0000","last_active":"2024-01-21T19:59:55.753293+0000","last_peered":"2024-01-21T19:59:55.753293+0000","last_clean":"2024-01-21T19:59:55.753293+0000","last_became_active":"2024-01-21T19:59:55.747873+0000","last_became_peered":"2024-01-21T19:59:55.747873+0000","last_unstale":"2024-01-21T19:59:55.753293+0000","last_undegraded":"2024-01-21T19:59:55.753293+0000","last_fullsized":"2024-01-21T19:59:55.753293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750516+0000","last_change":"2024-01-21T19:59:55.375599+0000","last_active":"2024-01-21T19:59:55.750516+0000","last_peered":"2024-01-21T19:59:55.750516+0000","last_clean":"2024-01-21T19:59:55.750516+0000","last_became_active":"2024-01-21T19:59:55.375337+0000","last_became_peered":"2024-01-21T19:59:55.375337+0000","last_unstale":"2024-01-21T19:59:55.750516+0000","last_undegraded":"2024-01-21T19:59:55.750516+0000","last_fullsized":"2024-01-21T19:59:55.750516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749324+0000","last_change":"2024-01-21T19:59:55.744906+0000","last_active":"2024-01-21T19:59:55.749324+0000","last_peered":"2024-01-21T19:59:55.749324+0000","last_clean":"2024-01-21T19:59:55.749324+0000","last_became_active":"2024-01-21T19:59:55.744530+0000","last_became_peered":"2024-01-21T19:59:55.744530+0000","last_unstale":"2024-01-21T19:59:55.749324+0000","last_undegraded":"2024-01-21T19:59:55.749324+0000","last_fullsized":"2024-01-21T19:59:55.749324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.745667+0000","last_change":"2024-01-21T19:59:55.367440+0000","last_active":"2024-01-21T19:59:55.745667+0000","last_peered":"2024-01-21T19:59:55.745667+0000","last_clean":"2024-01-21T19:59:55.745667+0000","last_became_active":"2024-01-21T19:59:55.367189+0000","last_became_peered":"2024-01-21T19:59:55.367189+0000","last_unstale":"2024-01-21T19:59:55.745667+0000","last_undegraded":"2024-01-21T19:59:55.745667+0000","last_fullsized":"2024-01-21T19:59:55.745667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758187+0000","last_change":"2024-01-21T19:59:55.746849+0000","last_active":"2024-01-21T19:59:55.758187+0000","last_peered":"2024-01-21T19:59:55.758187+0000","last_clean":"2024-01-21T19:59:55.758187+0000","last_became_active":"2024-01-21T19:59:55.746520+0000","last_became_peered":"2024-01-21T19:59:55.746520+0000","last_unstale":"2024-01-21T19:59:55.758187+0000","last_undegraded":"2024-01-21T19:59:55.758187+0000","last_fullsized":"2024-01-21T19:59:55.758187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737314+0000","last_change":"2024-01-21T19:59:55.375081+0000","last_active":"2024-01-21T19:59:55.737314+0000","last_peered":"2024-01-21T19:59:55.737314+0000","last_clean":"2024-01-21T19:59:55.737314+0000","last_became_active":"2024-01-21T19:59:55.374619+0000","last_became_peered":"2024-01-21T19:59:55.374619+0000","last_unstale":"2024-01-21T19:59:55.737314+0000","last_undegraded":"2024-01-21T19:59:55.737314+0000","last_fullsized":"2024-01-21T19:59:55.737314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759590+0000","last_change":"2024-01-21T19:59:55.754753+0000","last_active":"2024-01-21T19:59:55.759590+0000","last_peered":"2024-01-21T19:59:55.759590+0000","last_clean":"2024-01-21T19:59:55.759590+0000","last_became_active":"2024-01-21T19:59:55.754391+0000","last_became_peered":"2024-01-21T19:59:55.754391+0000","last_unstale":"2024-01-21T19:59:55.759590+0000","last_undegraded":"2024-01-21T19:59:55.759590+0000","last_fullsized":"2024-01-21T19:59:55.759590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750995+0000","last_change":"2024-01-21T19:59:55.374008+0000","last_active":"2024-01-21T19:59:55.750995+0000","last_peered":"2024-01-21T19:59:55.750995+0000","last_clean":"2024-01-21T19:59:55.750995+0000","last_became_active":"2024-01-21T19:59:55.373696+0000","last_became_peered":"2024-01-21T19:59:55.373696+0000","last_unstale":"2024-01-21T19:59:55.750995+0000","last_undegraded":"2024-01-21T19:59:55.750995+0000","last_fullsized":"2024-01-21T19:59:55.750995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749657+0000","last_change":"2024-01-21T19:59:55.746660+0000","last_active":"2024-01-21T19:59:55.749657+0000","last_peered":"2024-01-21T19:59:55.749657+0000","last_clean":"2024-01-21T19:59:55.749657+0000","last_became_active":"2024-01-21T19:59:55.745857+0000","last_became_peered":"2024-01-21T19:59:55.745857+0000","last_unstale":"2024-01-21T19:59:55.749657+0000","last_undegraded":"2024-01-21T19:59:55.749657+0000","last_fullsized":"2024-01-21T19:59:55.749657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.763339+0000","last_change":"2024-01-21T19:59:55.358495+0000","last_active":"2024-01-21T19:59:55.763339+0000","last_peered":"2024-01-21T19:59:55.763339+0000","last_clean":"2024-01-21T19:59:55.763339+0000","last_became_active":"2024-01-21T19:59:55.358237+0000","last_became_peered":"2024-01-21T19:59:55.358237+0000","last_unstale":"2024-01-21T19:59:55.763339+0000","last_undegraded":"2024-01-21T19:59:55.763339+0000","last_fullsized":"2024-01-21T19:59:55.763339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761753+0000","last_change":"2024-01-21T19:59:55.759212+0000","last_active":"2024-01-21T19:59:55.761753+0000","last_peered":"2024-01-21T19:59:55.761753+0000","last_clean":"2024-01-21T19:59:55.761753+0000","last_became_active":"2024-01-21T19:59:55.758933+0000","last_became_peered":"2024-01-21T19:59:55.758933+0000","last_unstale":"2024-01-21T19:59:55.761753+0000","last_undegraded":"2024-01-21T19:59:55.761753+0000","last_fullsized":"2024-01-21T19:59:55.761753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751806+0000","last_change":"2024-01-21T19:59:55.361333+0000","last_active":"2024-01-21T19:59:55.751806+0000","last_peered":"2024-01-21T19:59:55.751806+0000","last_clean":"2024-01-21T19:59:55.751806+0000","last_became_active":"2024-01-21T19:59:55.361025+0000","last_became_peered":"2024-01-21T19:59:55.361025+0000","last_unstale":"2024-01-21T19:59:55.751806+0000","last_undegraded":"2024-01-21T19:59:55.751806+0000","last_fullsized":"2024-01-21T19:59:55.751806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756029+0000","last_change":"2024-01-21T19:59:55.744080+0000","last_active":"2024-01-21T19:59:55.756029+0000","last_peered":"2024-01-21T19:59:55.756029+0000","last_clean":"2024-01-21T19:59:55.756029+0000","last_became_active":"2024-01-21T19:59:55.743794+0000","last_became_peered":"2024-01-21T19:59:55.743794+0000","last_unstale":"2024-01-21T19:59:55.756029+0000","last_undegraded":"2024-01-21T19:59:55.756029+0000","last_fullsized":"2024-01-21T19:59:55.756029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.746641+0000","last_change":"2024-01-21T19:59:55.364558+0000","last_active":"2024-01-21T19:59:55.746641+0000","last_peered":"2024-01-21T19:59:55.746641+0000","last_clean":"2024-01-21T19:59:55.746641+0000","last_became_active":"2024-01-21T19:59:55.364280+0000","last_became_peered":"2024-01-21T19:59:55.364280+0000","last_unstale":"2024-01-21T19:59:55.746641+0000","last_undegraded":"2024-01-21T19:59:55.746641+0000","last_fullsized":"2024-01-21T19:59:55.746641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758347+0000","last_change":"2024-01-21T19:59:55.754428+0000","last_active":"2024-01-21T19:59:55.758347+0000","last_peered":"2024-01-21T19:59:55.758347+0000","last_clean":"2024-01-21T19:59:55.758347+0000","last_became_active":"2024-01-21T19:59:55.754149+0000","last_became_peered":"2024-01-21T19:59:55.754149+0000","last_unstale":"2024-01-21T19:59:55.758347+0000","last_undegraded":"2024-01-21T19:59:55.758347+0000","last_fullsized":"2024-01-21T19:59:55.758347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739014+0000","last_change":"2024-01-21T19:59:55.369516+0000","last_active":"2024-01-21T19:59:55.739014+0000","last_peered":"2024-01-21T19:59:55.739014+0000","last_clean":"2024-01-21T19:59:55.739014+0000","last_became_active":"2024-01-21T19:59:55.369201+0000","last_became_peered":"2024-01-21T19:59:55.369201+0000","last_unstale":"2024-01-21T19:59:55.739014+0000","last_undegraded":"2024-01-21T19:59:55.739014+0000","last_fullsized":"2024-01-21T19:59:55.739014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759548+0000","last_change":"2024-01-21T19:59:55.754536+0000","last_active":"2024-01-21T19:59:55.759548+0000","last_peered":"2024-01-21T19:59:55.759548+0000","last_clean":"2024-01-21T19:59:55.759548+0000","last_became_active":"2024-01-21T19:59:55.754257+0000","last_became_peered":"2024-01-21T19:59:55.754257+0000","last_unstale":"2024-01-21T19:59:55.759548+0000","last_undegraded":"2024-01-21T19:59:55.759548+0000","last_fullsized":"2024-01-21T19:59:55.759548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762235+0000","last_change":"2024-01-21T19:59:55.373602+0000","last_active":"2024-01-21T19:59:55.762235+0000","last_peered":"2024-01-21T19:59:55.762235+0000","last_clean":"2024-01-21T19:59:55.762235+0000","last_became_active":"2024-01-21T19:59:55.373309+0000","last_became_peered":"2024-01-21T19:59:55.373309+0000","last_unstale":"2024-01-21T19:59:55.762235+0000","last_undegraded":"2024-01-21T19:59:55.762235+0000","last_fullsized":"2024-01-21T19:59:55.762235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765864+0000","last_change":"2024-01-21T19:59:55.764267+0000","last_active":"2024-01-21T19:59:55.765864+0000","last_peered":"2024-01-21T19:59:55.765864+0000","last_clean":"2024-01-21T19:59:55.765864+0000","last_became_active":"2024-01-21T19:59:55.763788+0000","last_became_peered":"2024-01-21T19:59:55.763788+0000","last_unstale":"2024-01-21T19:59:55.765864+0000","last_undegraded":"2024-01-21T19:59:55.765864+0000","last_fullsized":"2024-01-21T19:59:55.765864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752923+0000","last_change":"2024-01-21T19:59:55.372084+0000","last_active":"2024-01-21T19:59:55.752923+0000","last_peered":"2024-01-21T19:59:55.752923+0000","last_clean":"2024-01-21T19:59:55.752923+0000","last_became_active":"2024-01-21T19:59:55.371805+0000","last_became_peered":"2024-01-21T19:59:55.371805+0000","last_unstale":"2024-01-21T19:59:55.752923+0000","last_undegraded":"2024-01-21T19:59:55.752923+0000","last_fullsized":"2024-01-21T19:59:55.752923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757145+0000","last_change":"2024-01-21T19:59:55.754404+0000","last_active":"2024-01-21T19:59:55.757145+0000","last_peered":"2024-01-21T19:59:55.757145+0000","last_clean":"2024-01-21T19:59:55.757145+0000","last_became_active":"2024-01-21T19:59:55.754179+0000","last_became_peered":"2024-01-21T19:59:55.754179+0000","last_unstale":"2024-01-21T19:59:55.757145+0000","last_undegraded":"2024-01-21T19:59:55.757145+0000","last_fullsized":"2024-01-21T19:59:55.757145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747289+0000","last_change":"2024-01-21T19:59:55.372690+0000","last_active":"2024-01-21T19:59:55.747289+0000","last_peered":"2024-01-21T19:59:55.747289+0000","last_clean":"2024-01-21T19:59:55.747289+0000","last_became_active":"2024-01-21T19:59:55.372142+0000","last_became_peered":"2024-01-21T19:59:55.372142+0000","last_unstale":"2024-01-21T19:59:55.747289+0000","last_undegraded":"2024-01-21T19:59:55.747289+0000","last_fullsized":"2024-01-21T19:59:55.747289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765740+0000","last_change":"2024-01-21T19:59:55.762703+0000","last_active":"2024-01-21T19:59:55.765740+0000","last_peered":"2024-01-21T19:59:55.765740+0000","last_clean":"2024-01-21T19:59:55.765740+0000","last_became_active":"2024-01-21T19:59:55.762465+0000","last_became_peered":"2024-01-21T19:59:55.762465+0000","last_unstale":"2024-01-21T19:59:55.765740+0000","last_undegraded":"2024-01-21T19:59:55.765740+0000","last_fullsized":"2024-01-21T19:59:55.765740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762646+0000","last_change":"2024-01-21T19:59:55.368961+0000","last_active":"2024-01-21T19:59:55.762646+0000","last_peered":"2024-01-21T19:59:55.762646+0000","last_clean":"2024-01-21T19:59:55.762646+0000","last_became_active":"2024-01-21T19:59:55.368718+0000","last_became_peered":"2024-01-21T19:59:55.368718+0000","last_unstale":"2024-01-21T19:59:55.762646+0000","last_undegraded":"2024-01-21T19:59:55.762646+0000","last_fullsized":"2024-01-21T19:59:55.762646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762311+0000","last_change":"2024-01-21T19:59:55.760704+0000","last_active":"2024-01-21T19:59:55.762311+0000","last_peered":"2024-01-21T19:59:55.762311+0000","last_clean":"2024-01-21T19:59:55.762311+0000","last_became_active":"2024-01-21T19:59:55.760394+0000","last_became_peered":"2024-01-21T19:59:55.760394+0000","last_unstale":"2024-01-21T19:59:55.762311+0000","last_undegraded":"2024-01-21T19:59:55.762311+0000","last_fullsized":"2024-01-21T19:59:55.762311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742399+0000","last_change":"2024-01-21T19:59:55.361374+0000","last_active":"2024-01-21T19:59:55.742399+0000","last_peered":"2024-01-21T19:59:55.742399+0000","last_clean":"2024-01-21T19:59:55.742399+0000","last_became_active":"2024-01-21T19:59:55.361049+0000","last_became_peered":"2024-01-21T19:59:55.361049+0000","last_unstale":"2024-01-21T19:59:55.742399+0000","last_undegraded":"2024-01-21T19:59:55.742399+0000","last_fullsized":"2024-01-21T19:59:55.742399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758149+0000","last_change":"2024-01-21T19:59:55.755648+0000","last_active":"2024-01-21T19:59:55.758149+0000","last_peered":"2024-01-21T19:59:55.758149+0000","last_clean":"2024-01-21T19:59:55.758149+0000","last_became_active":"2024-01-21T19:59:55.755428+0000","last_became_peered":"2024-01-21T19:59:55.755428+0000","last_unstale":"2024-01-21T19:59:55.758149+0000","last_undegraded":"2024-01-21T19:59:55.758149+0000","last_fullsized":"2024-01-21T19:59:55.758149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749886+0000","last_change":"2024-01-21T19:59:55.376582+0000","last_active":"2024-01-21T19:59:55.749886+0000","last_peered":"2024-01-21T19:59:55.749886+0000","last_clean":"2024-01-21T19:59:55.749886+0000","last_became_active":"2024-01-21T19:59:55.376311+0000","last_became_peered":"2024-01-21T19:59:55.376311+0000","last_unstale":"2024-01-21T19:59:55.749886+0000","last_undegraded":"2024-01-21T19:59:55.749886+0000","last_fullsized":"2024-01-21T19:59:55.749886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759914+0000","last_change":"2024-01-21T19:59:55.757306+0000","last_active":"2024-01-21T19:59:55.759914+0000","last_peered":"2024-01-21T19:59:55.759914+0000","last_clean":"2024-01-21T19:59:55.759914+0000","last_became_active":"2024-01-21T19:59:55.757029+0000","last_became_peered":"2024-01-21T19:59:55.757029+0000","last_unstale":"2024-01-21T19:59:55.759914+0000","last_undegraded":"2024-01-21T19:59:55.759914+0000","last_fullsized":"2024-01-21T19:59:55.759914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744900+0000","last_change":"2024-01-21T19:59:55.363516+0000","last_active":"2024-01-21T19:59:55.744900+0000","last_peered":"2024-01-21T19:59:55.744900+0000","last_clean":"2024-01-21T19:59:55.744900+0000","last_became_active":"2024-01-21T19:59:55.363245+0000","last_became_peered":"2024-01-21T19:59:55.363245+0000","last_unstale":"2024-01-21T19:59:55.744900+0000","last_undegraded":"2024-01-21T19:59:55.744900+0000","last_fullsized":"2024-01-21T19:59:55.744900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758325+0000","last_change":"2024-01-21T19:59:55.753507+0000","last_active":"2024-01-21T19:59:55.758325+0000","last_peered":"2024-01-21T19:59:55.758325+0000","last_clean":"2024-01-21T19:59:55.758325+0000","last_became_active":"2024-01-21T19:59:55.753320+0000","last_became_peered":"2024-01-21T19:59:55.753320+0000","last_unstale":"2024-01-21T19:59:55.758325+0000","last_undegraded":"2024-01-21T19:59:55.758325+0000","last_fullsized":"2024-01-21T19:59:55.758325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737117+0000","last_change":"2024-01-21T19:59:55.373554+0000","last_active":"2024-01-21T19:59:55.737117+0000","last_peered":"2024-01-21T19:59:55.737117+0000","last_clean":"2024-01-21T19:59:55.737117+0000","last_became_active":"2024-01-21T19:59:55.373275+0000","last_became_peered":"2024-01-21T19:59:55.373275+0000","last_unstale":"2024-01-21T19:59:55.737117+0000","last_undegraded":"2024-01-21T19:59:55.737117+0000","last_fullsized":"2024-01-21T19:59:55.737117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756337+0000","last_change":"2024-01-21T19:59:55.745944+0000","last_active":"2024-01-21T19:59:55.756337+0000","last_peered":"2024-01-21T19:59:55.756337+0000","last_clean":"2024-01-21T19:59:55.756337+0000","last_became_active":"2024-01-21T19:59:55.745626+0000","last_became_peered":"2024-01-21T19:59:55.745626+0000","last_unstale":"2024-01-21T19:59:55.756337+0000","last_undegraded":"2024-01-21T19:59:55.756337+0000","last_fullsized":"2024-01-21T19:59:55.756337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739184+0000","last_change":"2024-01-21T19:59:55.362467+0000","last_active":"2024-01-21T19:59:55.739184+0000","last_peered":"2024-01-21T19:59:55.739184+0000","last_clean":"2024-01-21T19:59:55.739184+0000","last_became_active":"2024-01-21T19:59:55.362183+0000","last_became_peered":"2024-01-21T19:59:55.362183+0000","last_unstale":"2024-01-21T19:59:55.739184+0000","last_undegraded":"2024-01-21T19:59:55.739184+0000","last_fullsized":"2024-01-21T19:59:55.739184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760246+0000","last_change":"2024-01-21T19:59:55.754755+0000","last_active":"2024-01-21T19:59:55.760246+0000","last_peered":"2024-01-21T19:59:55.760246+0000","last_clean":"2024-01-21T19:59:55.760246+0000","last_became_active":"2024-01-21T19:59:55.753918+0000","last_became_peered":"2024-01-21T19:59:55.753918+0000","last_unstale":"2024-01-21T19:59:55.760246+0000","last_undegraded":"2024-01-21T19:59:55.760246+0000","last_fullsized":"2024-01-21T19:59:55.760246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737490+0000","last_change":"2024-01-21T19:59:55.371080+0000","last_active":"2024-01-21T19:59:55.737490+0000","last_peered":"2024-01-21T19:59:55.737490+0000","last_clean":"2024-01-21T19:59:55.737490+0000","last_became_active":"2024-01-21T19:59:55.370769+0000","last_became_peered":"2024-01-21T19:59:55.370769+0000","last_unstale":"2024-01-21T19:59:55.737490+0000","last_undegraded":"2024-01-21T19:59:55.737490+0000","last_fullsized":"2024-01-21T19:59:55.737490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765854+0000","last_change":"2024-01-21T19:59:55.763188+0000","last_active":"2024-01-21T19:59:55.765854+0000","last_peered":"2024-01-21T19:59:55.765854+0000","last_clean":"2024-01-21T19:59:55.765854+0000","last_became_active":"2024-01-21T19:59:55.762873+0000","last_became_peered":"2024-01-21T19:59:55.762873+0000","last_unstale":"2024-01-21T19:59:55.765854+0000","last_undegraded":"2024-01-21T19:59:55.765854+0000","last_fullsized":"2024-01-21T19:59:55.765854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-21T19:59:56.740119+0000","last_change":"2024-01-21T19:59:55.368201+0000","last_active":"2024-01-21T19:59:56.740119+0000","last_peered":"2024-01-21T19:59:56.740119+0000","last_clean":"2024-01-21T19:59:56.740119+0000","last_became_active":"2024-01-21T19:59:55.367974+0000","last_became_peered":"2024-01-21T19:59:55.367974+0000","last_unstale":"2024-01-21T19:59:56.740119+0000","last_undegraded":"2024-01-21T19:59:56.740119+0000","last_fullsized":"2024-01-21T19:59:56.740119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.748003+0000","last_change":"2024-01-21T19:59:55.745552+0000","last_active":"2024-01-21T19:59:55.748003+0000","last_peered":"2024-01-21T19:59:55.748003+0000","last_clean":"2024-01-21T19:59:55.748003+0000","last_became_active":"2024-01-21T19:59:55.745322+0000","last_became_peered":"2024-01-21T19:59:55.745322+0000","last_unstale":"2024-01-21T19:59:55.748003+0000","last_undegraded":"2024-01-21T19:59:55.748003+0000","last_fullsized":"2024-01-21T19:59:55.748003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737913+0000","last_change":"2024-01-21T19:59:55.369534+0000","last_active":"2024-01-21T19:59:55.737913+0000","last_peered":"2024-01-21T19:59:55.737913+0000","last_clean":"2024-01-21T19:59:55.737913+0000","last_became_active":"2024-01-21T19:59:55.369094+0000","last_became_peered":"2024-01-21T19:59:55.369094+0000","last_unstale":"2024-01-21T19:59:55.737913+0000","last_undegraded":"2024-01-21T19:59:55.737913+0000","last_fullsized":"2024-01-21T19:59:55.737913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765744+0000","last_change":"2024-01-21T19:59:55.763418+0000","last_active":"2024-01-21T19:59:55.765744+0000","last_peered":"2024-01-21T19:59:55.765744+0000","last_clean":"2024-01-21T19:59:55.765744+0000","last_became_active":"2024-01-21T19:59:55.763154+0000","last_became_peered":"2024-01-21T19:59:55.763154+0000","last_unstale":"2024-01-21T19:59:55.765744+0000","last_undegraded":"2024-01-21T19:59:55.765744+0000","last_fullsized":"2024-01-21T19:59:55.765744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739598+0000","last_change":"2024-01-21T19:59:55.374246+0000","last_active":"2024-01-21T19:59:55.739598+0000","last_peered":"2024-01-21T19:59:55.739598+0000","last_clean":"2024-01-21T19:59:55.739598+0000","last_became_active":"2024-01-21T19:59:55.373927+0000","last_became_peered":"2024-01-21T19:59:55.373927+0000","last_unstale":"2024-01-21T19:59:55.739598+0000","last_undegraded":"2024-01-21T19:59:55.739598+0000","last_fullsized":"2024-01-21T19:59:55.739598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747920+0000","last_change":"2024-01-21T19:59:55.743479+0000","last_active":"2024-01-21T19:59:55.747920+0000","last_peered":"2024-01-21T19:59:55.747920+0000","last_clean":"2024-01-21T19:59:55.747920+0000","last_became_active":"2024-01-21T19:59:55.743220+0000","last_became_peered":"2024-01-21T19:59:55.743220+0000","last_unstale":"2024-01-21T19:59:55.747920+0000","last_undegraded":"2024-01-21T19:59:55.747920+0000","last_fullsized":"2024-01-21T19:59:55.747920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744889+0000","last_change":"2024-01-21T19:59:55.360545+0000","last_active":"2024-01-21T19:59:55.744889+0000","last_peered":"2024-01-21T19:59:55.744889+0000","last_clean":"2024-01-21T19:59:55.744889+0000","last_became_active":"2024-01-21T19:59:55.360258+0000","last_became_peered":"2024-01-21T19:59:55.360258+0000","last_unstale":"2024-01-21T19:59:55.744889+0000","last_undegraded":"2024-01-21T19:59:55.744889+0000","last_fullsized":"2024-01-21T19:59:55.744889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759934+0000","last_change":"2024-01-21T19:59:55.757670+0000","last_active":"2024-01-21T19:59:55.759934+0000","last_peered":"2024-01-21T19:59:55.759934+0000","last_clean":"2024-01-21T19:59:55.759934+0000","last_became_active":"2024-01-21T19:59:55.757376+0000","last_became_peered":"2024-01-21T19:59:55.757376+0000","last_unstale":"2024-01-21T19:59:55.759934+0000","last_undegraded":"2024-01-21T19:59:55.759934+0000","last_fullsized":"2024-01-21T19:59:55.759934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750029+0000","last_change":"2024-01-21T19:59:55.373333+0000","last_active":"2024-01-21T19:59:55.750029+0000","last_peered":"2024-01-21T19:59:55.750029+0000","last_clean":"2024-01-21T19:59:55.750029+0000","last_became_active":"2024-01-21T19:59:55.373061+0000","last_became_peered":"2024-01-21T19:59:55.373061+0000","last_unstale":"2024-01-21T19:59:55.750029+0000","last_undegraded":"2024-01-21T19:59:55.750029+0000","last_fullsized":"2024-01-21T19:59:55.750029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765826+0000","last_change":"2024-01-21T19:59:55.763801+0000","last_active":"2024-01-21T19:59:55.765826+0000","last_peered":"2024-01-21T19:59:55.765826+0000","last_clean":"2024-01-21T19:59:55.765826+0000","last_became_active":"2024-01-21T19:59:55.752147+0000","last_became_peered":"2024-01-21T19:59:55.752147+0000","last_unstale":"2024-01-21T19:59:55.765826+0000","last_undegraded":"2024-01-21T19:59:55.765826+0000","last_fullsized":"2024-01-21T19:59:55.765826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743172+0000","last_change":"2024-01-21T19:59:55.369796+0000","last_active":"2024-01-21T19:59:55.743172+0000","last_peered":"2024-01-21T19:59:55.743172+0000","last_clean":"2024-01-21T19:59:55.743172+0000","last_became_active":"2024-01-21T19:59:55.369528+0000","last_became_peered":"2024-01-21T19:59:55.369528+0000","last_unstale":"2024-01-21T19:59:55.743172+0000","last_undegraded":"2024-01-21T19:59:55.743172+0000","last_fullsized":"2024-01-21T19:59:55.743172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765009+0000","last_change":"2024-01-21T19:59:55.761721+0000","last_active":"2024-01-21T19:59:55.765009+0000","last_peered":"2024-01-21T19:59:55.765009+0000","last_clean":"2024-01-21T19:59:55.765009+0000","last_became_active":"2024-01-21T19:59:55.761450+0000","last_became_peered":"2024-01-21T19:59:55.761450+0000","last_unstale":"2024-01-21T19:59:55.765009+0000","last_undegraded":"2024-01-21T19:59:55.765009+0000","last_fullsized":"2024-01-21T19:59:55.765009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749967+0000","last_change":"2024-01-21T19:59:55.369599+0000","last_active":"2024-01-21T19:59:55.749967+0000","last_peered":"2024-01-21T19:59:55.749967+0000","last_clean":"2024-01-21T19:59:55.749967+0000","last_became_active":"2024-01-21T19:59:55.369315+0000","last_became_peered":"2024-01-21T19:59:55.369315+0000","last_unstale":"2024-01-21T19:59:55.749967+0000","last_undegraded":"2024-01-21T19:59:55.749967+0000","last_fullsized":"2024-01-21T19:59:55.749967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762287+0000","last_change":"2024-01-21T19:59:55.761095+0000","last_active":"2024-01-21T19:59:55.762287+0000","last_peered":"2024-01-21T19:59:55.762287+0000","last_clean":"2024-01-21T19:59:55.762287+0000","last_became_active":"2024-01-21T19:59:55.760821+0000","last_became_peered":"2024-01-21T19:59:55.760821+0000","last_unstale":"2024-01-21T19:59:55.762287+0000","last_undegraded":"2024-01-21T19:59:55.762287+0000","last_fullsized":"2024-01-21T19:59:55.762287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765844+0000","last_change":"2024-01-21T19:59:55.367367+0000","last_active":"2024-01-21T19:59:55.765844+0000","last_peered":"2024-01-21T19:59:55.765844+0000","last_clean":"2024-01-21T19:59:55.765844+0000","last_became_active":"2024-01-21T19:59:55.367089+0000","last_became_peered":"2024-01-21T19:59:55.367089+0000","last_unstale":"2024-01-21T19:59:55.765844+0000","last_undegraded":"2024-01-21T19:59:55.765844+0000","last_fullsized":"2024-01-21T19:59:55.765844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752012+0000","last_change":"2024-01-21T19:59:55.746376+0000","last_active":"2024-01-21T19:59:55.752012+0000","last_peered":"2024-01-21T19:59:55.752012+0000","last_clean":"2024-01-21T19:59:55.752012+0000","last_became_active":"2024-01-21T19:59:55.746121+0000","last_became_peered":"2024-01-21T19:59:55.746121+0000","last_unstale":"2024-01-21T19:59:55.752012+0000","last_undegraded":"2024-01-21T19:59:55.752012+0000","last_fullsized":"2024-01-21T19:59:55.752012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756529+0000","last_change":"2024-01-21T19:59:55.374085+0000","last_active":"2024-01-21T19:59:55.756529+0000","last_peered":"2024-01-21T19:59:55.756529+0000","last_clean":"2024-01-21T19:59:55.756529+0000","last_became_active":"2024-01-21T19:59:55.373807+0000","last_became_peered":"2024-01-21T19:59:55.373807+0000","last_unstale":"2024-01-21T19:59:55.756529+0000","last_undegraded":"2024-01-21T19:59:55.756529+0000","last_fullsized":"2024-01-21T19:59:55.756529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758099+0000","last_change":"2024-01-21T19:59:55.753352+0000","last_active":"2024-01-21T19:59:55.758099+0000","last_peered":"2024-01-21T19:59:55.758099+0000","last_clean":"2024-01-21T19:59:55.758099+0000","last_became_active":"2024-01-21T19:59:55.753148+0000","last_became_peered":"2024-01-21T19:59:55.753148+0000","last_unstale":"2024-01-21T19:59:55.758099+0000","last_undegraded":"2024-01-21T19:59:55.758099+0000","last_fullsized":"2024-01-21T19:59:55.758099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758601+0000","last_change":"2024-01-21T19:59:55.369691+0000","last_active":"2024-01-21T19:59:55.758601+0000","last_peered":"2024-01-21T19:59:55.758601+0000","last_clean":"2024-01-21T19:59:55.758601+0000","last_became_active":"2024-01-21T19:59:55.369379+0000","last_became_peered":"2024-01-21T19:59:55.369379+0000","last_unstale":"2024-01-21T19:59:55.758601+0000","last_undegraded":"2024-01-21T19:59:55.758601+0000","last_fullsized":"2024-01-21T19:59:55.758601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765968+0000","last_change":"2024-01-21T19:59:55.765487+0000","last_active":"2024-01-21T19:59:55.765968+0000","last_peered":"2024-01-21T19:59:55.765968+0000","last_clean":"2024-01-21T19:59:55.765968+0000","last_became_active":"2024-01-21T19:59:55.765256+0000","last_became_peered":"2024-01-21T19:59:55.765256+0000","last_unstale":"2024-01-21T19:59:55.765968+0000","last_undegraded":"2024-01-21T19:59:55.765968+0000","last_fullsized":"2024-01-21T19:59:55.765968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.745223+0000","last_change":"2024-01-21T19:59:55.363491+0000","last_active":"2024-01-21T19:59:55.745223+0000","last_peered":"2024-01-21T19:59:55.745223+0000","last_clean":"2024-01-21T19:59:55.745223+0000","last_became_active":"2024-01-21T19:59:55.362369+0000","last_became_peered":"2024-01-21T19:59:55.362369+0000","last_unstale":"2024-01-21T19:59:55.745223+0000","last_undegraded":"2024-01-21T19:59:55.745223+0000","last_fullsized":"2024-01-21T19:59:55.745223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747563+0000","last_change":"2024-01-21T19:59:55.742344+0000","last_active":"2024-01-21T19:59:55.747563+0000","last_peered":"2024-01-21T19:59:55.747563+0000","last_clean":"2024-01-21T19:59:55.747563+0000","last_became_active":"2024-01-21T19:59:55.742043+0000","last_became_peered":"2024-01-21T19:59:55.742043+0000","last_unstale":"2024-01-21T19:59:55.747563+0000","last_undegraded":"2024-01-21T19:59:55.747563+0000","last_fullsized":"2024-01-21T19:59:55.747563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739358+0000","last_change":"2024-01-21T19:59:55.376588+0000","last_active":"2024-01-21T19:59:55.739358+0000","last_peered":"2024-01-21T19:59:55.739358+0000","last_clean":"2024-01-21T19:59:55.739358+0000","last_became_active":"2024-01-21T19:59:55.376290+0000","last_became_peered":"2024-01-21T19:59:55.376290+0000","last_unstale":"2024-01-21T19:59:55.739358+0000","last_undegraded":"2024-01-21T19:59:55.739358+0000","last_fullsized":"2024-01-21T19:59:55.739358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756514+0000","last_change":"2024-01-21T19:59:55.744690+0000","last_active":"2024-01-21T19:59:55.756514+0000","last_peered":"2024-01-21T19:59:55.756514+0000","last_clean":"2024-01-21T19:59:55.756514+0000","last_became_active":"2024-01-21T19:59:55.744360+0000","last_became_peered":"2024-01-21T19:59:55.744360+0000","last_unstale":"2024-01-21T19:59:55.756514+0000","last_undegraded":"2024-01-21T19:59:55.756514+0000","last_fullsized":"2024-01-21T19:59:55.756514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749927+0000","last_change":"2024-01-21T19:59:55.368324+0000","last_active":"2024-01-21T19:59:55.749927+0000","last_peered":"2024-01-21T19:59:55.749927+0000","last_clean":"2024-01-21T19:59:55.749927+0000","last_became_active":"2024-01-21T19:59:55.368043+0000","last_became_peered":"2024-01-21T19:59:55.368043+0000","last_unstale":"2024-01-21T19:59:55.749927+0000","last_undegraded":"2024-01-21T19:59:55.749927+0000","last_fullsized":"2024-01-21T19:59:55.749927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758476+0000","last_change":"2024-01-21T19:59:55.756503+0000","last_active":"2024-01-21T19:59:55.758476+0000","last_peered":"2024-01-21T19:59:55.758476+0000","last_clean":"2024-01-21T19:59:55.758476+0000","last_became_active":"2024-01-21T19:59:55.756301+0000","last_became_peered":"2024-01-21T19:59:55.756301+0000","last_unstale":"2024-01-21T19:59:55.758476+0000","last_undegraded":"2024-01-21T19:59:55.758476+0000","last_fullsized":"2024-01-21T19:59:55.758476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736529+0000","last_change":"2024-01-21T19:59:55.371121+0000","last_active":"2024-01-21T19:59:55.736529+0000","last_peered":"2024-01-21T19:59:55.736529+0000","last_clean":"2024-01-21T19:59:55.736529+0000","last_became_active":"2024-01-21T19:59:55.370830+0000","last_became_peered":"2024-01-21T19:59:55.370830+0000","last_unstale":"2024-01-21T19:59:55.736529+0000","last_undegraded":"2024-01-21T19:59:55.736529+0000","last_fullsized":"2024-01-21T19:59:55.736529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762040+0000","last_change":"2024-01-21T19:59:55.759229+0000","last_active":"2024-01-21T19:59:55.762040+0000","last_peered":"2024-01-21T19:59:55.762040+0000","last_clean":"2024-01-21T19:59:55.762040+0000","last_became_active":"2024-01-21T19:59:55.758981+0000","last_became_peered":"2024-01-21T19:59:55.758981+0000","last_unstale":"2024-01-21T19:59:55.762040+0000","last_undegraded":"2024-01-21T19:59:55.762040+0000","last_fullsized":"2024-01-21T19:59:55.762040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744291+0000","last_change":"2024-01-21T19:59:55.366304+0000","last_active":"2024-01-21T19:59:55.744291+0000","last_peered":"2024-01-21T19:59:55.744291+0000","last_clean":"2024-01-21T19:59:55.744291+0000","last_became_active":"2024-01-21T19:59:55.366000+0000","last_became_peered":"2024-01-21T19:59:55.366000+0000","last_unstale":"2024-01-21T19:59:55.744291+0000","last_undegraded":"2024-01-21T19:59:55.744291+0000","last_fullsized":"2024-01-21T19:59:55.744291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751619+0000","last_change":"2024-01-21T19:59:55.746796+0000","last_active":"2024-01-21T19:59:55.751619+0000","last_peered":"2024-01-21T19:59:55.751619+0000","last_clean":"2024-01-21T19:59:55.751619+0000","last_became_active":"2024-01-21T19:59:55.745966+0000","last_became_peered":"2024-01-21T19:59:55.745966+0000","last_unstale":"2024-01-21T19:59:55.751619+0000","last_undegraded":"2024-01-21T19:59:55.751619+0000","last_fullsized":"2024-01-21T19:59:55.751619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751210+0000","last_change":"2024-01-21T19:59:55.367535+0000","last_active":"2024-01-21T19:59:55.751210+0000","last_peered":"2024-01-21T19:59:55.751210+0000","last_clean":"2024-01-21T19:59:55.751210+0000","last_became_active":"2024-01-21T19:59:55.367215+0000","last_became_peered":"2024-01-21T19:59:55.367215+0000","last_unstale":"2024-01-21T19:59:55.751210+0000","last_undegraded":"2024-01-21T19:59:55.751210+0000","last_fullsized":"2024-01-21T19:59:55.751210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765847+0000","last_change":"2024-01-21T19:59:55.764078+0000","last_active":"2024-01-21T19:59:55.765847+0000","last_peered":"2024-01-21T19:59:55.765847+0000","last_clean":"2024-01-21T19:59:55.765847+0000","last_became_active":"2024-01-21T19:59:55.763783+0000","last_became_peered":"2024-01-21T19:59:55.763783+0000","last_unstale":"2024-01-21T19:59:55.765847+0000","last_undegraded":"2024-01-21T19:59:55.765847+0000","last_fullsized":"2024-01-21T19:59:55.765847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739793+0000","last_change":"2024-01-21T19:59:55.359496+0000","last_active":"2024-01-21T19:59:55.739793+0000","last_peered":"2024-01-21T19:59:55.739793+0000","last_clean":"2024-01-21T19:59:55.739793+0000","last_became_active":"2024-01-21T19:59:55.358974+0000","last_became_peered":"2024-01-21T19:59:55.358974+0000","last_unstale":"2024-01-21T19:59:55.739793+0000","last_undegraded":"2024-01-21T19:59:55.739793+0000","last_fullsized":"2024-01-21T19:59:55.739793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757502+0000","last_change":"2024-01-21T19:59:55.756374+0000","last_active":"2024-01-21T19:59:55.757502+0000","last_peered":"2024-01-21T19:59:55.757502+0000","last_clean":"2024-01-21T19:59:55.757502+0000","last_became_active":"2024-01-21T19:59:55.756087+0000","last_became_peered":"2024-01-21T19:59:55.756087+0000","last_unstale":"2024-01-21T19:59:55.757502+0000","last_undegraded":"2024-01-21T19:59:55.757502+0000","last_fullsized":"2024-01-21T19:59:55.757502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756240+0000","last_change":"2024-01-21T19:59:55.371317+0000","last_active":"2024-01-21T19:59:55.756240+0000","last_peered":"2024-01-21T19:59:55.756240+0000","last_clean":"2024-01-21T19:59:55.756240+0000","last_became_active":"2024-01-21T19:59:55.370970+0000","last_became_peered":"2024-01-21T19:59:55.370970+0000","last_unstale":"2024-01-21T19:59:55.756240+0000","last_undegraded":"2024-01-21T19:59:55.756240+0000","last_fullsized":"2024-01-21T19:59:55.756240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757430+0000","last_change":"2024-01-21T19:59:55.752203+0000","last_active":"2024-01-21T19:59:55.757430+0000","last_peered":"2024-01-21T19:59:55.757430+0000","last_clean":"2024-01-21T19:59:55.757430+0000","last_became_active":"2024-01-21T19:59:55.751919+0000","last_became_peered":"2024-01-21T19:59:55.751919+0000","last_unstale":"2024-01-21T19:59:55.757430+0000","last_undegraded":"2024-01-21T19:59:55.757430+0000","last_fullsized":"2024-01-21T19:59:55.757430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761951+0000","last_change":"2024-01-21T19:59:55.367108+0000","last_active":"2024-01-21T19:59:55.761951+0000","last_peered":"2024-01-21T19:59:55.761951+0000","last_clean":"2024-01-21T19:59:55.761951+0000","last_became_active":"2024-01-21T19:59:55.366835+0000","last_became_peered":"2024-01-21T19:59:55.366835+0000","last_unstale":"2024-01-21T19:59:55.761951+0000","last_undegraded":"2024-01-21T19:59:55.761951+0000","last_fullsized":"2024-01-21T19:59:55.761951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749453+0000","last_change":"2024-01-21T19:59:55.745815+0000","last_active":"2024-01-21T19:59:55.749453+0000","last_peered":"2024-01-21T19:59:55.749453+0000","last_clean":"2024-01-21T19:59:55.749453+0000","last_became_active":"2024-01-21T19:59:55.745555+0000","last_became_peered":"2024-01-21T19:59:55.745555+0000","last_unstale":"2024-01-21T19:59:55.749453+0000","last_undegraded":"2024-01-21T19:59:55.749453+0000","last_fullsized":"2024-01-21T19:59:55.749453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762127+0000","last_change":"2024-01-21T19:59:55.377728+0000","last_active":"2024-01-21T19:59:55.762127+0000","last_peered":"2024-01-21T19:59:55.762127+0000","last_clean":"2024-01-21T19:59:55.762127+0000","last_became_active":"2024-01-21T19:59:55.377454+0000","last_became_peered":"2024-01-21T19:59:55.377454+0000","last_unstale":"2024-01-21T19:59:55.762127+0000","last_undegraded":"2024-01-21T19:59:55.762127+0000","last_fullsized":"2024-01-21T19:59:55.762127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.755013+0000","last_change":"2024-01-21T19:59:55.750763+0000","last_active":"2024-01-21T19:59:55.755013+0000","last_peered":"2024-01-21T19:59:55.755013+0000","last_clean":"2024-01-21T19:59:55.755013+0000","last_became_active":"2024-01-21T19:59:55.750488+0000","last_became_peered":"2024-01-21T19:59:55.750488+0000","last_unstale":"2024-01-21T19:59:55.755013+0000","last_undegraded":"2024-01-21T19:59:55.755013+0000","last_fullsized":"2024-01-21T19:59:55.755013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737126+0000","last_change":"2024-01-21T19:59:55.371088+0000","last_active":"2024-01-21T19:59:55.737126+0000","last_peered":"2024-01-21T19:59:55.737126+0000","last_clean":"2024-01-21T19:59:55.737126+0000","last_became_active":"2024-01-21T19:59:55.370781+0000","last_became_peered":"2024-01-21T19:59:55.370781+0000","last_unstale":"2024-01-21T19:59:55.737126+0000","last_undegraded":"2024-01-21T19:59:55.737126+0000","last_fullsized":"2024-01-21T19:59:55.737126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759959+0000","last_change":"2024-01-21T19:59:55.757730+0000","last_active":"2024-01-21T19:59:55.759959+0000","last_peered":"2024-01-21T19:59:55.759959+0000","last_clean":"2024-01-21T19:59:55.759959+0000","last_became_active":"2024-01-21T19:59:55.757509+0000","last_became_peered":"2024-01-21T19:59:55.757509+0000","last_unstale":"2024-01-21T19:59:55.759959+0000","last_undegraded":"2024-01-21T19:59:55.759959+0000","last_fullsized":"2024-01-21T19:59:55.759959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743054+0000","last_change":"2024-01-21T19:59:55.371155+0000","last_active":"2024-01-21T19:59:55.743054+0000","last_peered":"2024-01-21T19:59:55.743054+0000","last_clean":"2024-01-21T19:59:55.743054+0000","last_became_active":"2024-01-21T19:59:55.370862+0000","last_became_peered":"2024-01-21T19:59:55.370862+0000","last_unstale":"2024-01-21T19:59:55.743054+0000","last_undegraded":"2024-01-21T19:59:55.743054+0000","last_fullsized":"2024-01-21T19:59:55.743054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758963+0000","last_change":"2024-01-21T19:59:55.750802+0000","last_active":"2024-01-21T19:59:55.758963+0000","last_peered":"2024-01-21T19:59:55.758963+0000","last_clean":"2024-01-21T19:59:55.758963+0000","last_became_active":"2024-01-21T19:59:55.750543+0000","last_became_peered":"2024-01-21T19:59:55.750543+0000","last_unstale":"2024-01-21T19:59:55.758963+0000","last_undegraded":"2024-01-21T19:59:55.758963+0000","last_fullsized":"2024-01-21T19:59:55.758963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759803+0000","last_change":"2024-01-21T19:59:55.368659+0000","last_active":"2024-01-21T19:59:55.759803+0000","last_peered":"2024-01-21T19:59:55.759803+0000","last_clean":"2024-01-21T19:59:55.759803+0000","last_became_active":"2024-01-21T19:59:55.368310+0000","last_became_peered":"2024-01-21T19:59:55.368310+0000","last_unstale":"2024-01-21T19:59:55.759803+0000","last_undegraded":"2024-01-21T19:59:55.759803+0000","last_fullsized":"2024-01-21T19:59:55.759803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762156+0000","last_change":"2024-01-21T19:59:55.759725+0000","last_active":"2024-01-21T19:59:55.762156+0000","last_peered":"2024-01-21T19:59:55.762156+0000","last_clean":"2024-01-21T19:59:55.762156+0000","last_became_active":"2024-01-21T19:59:55.755263+0000","last_became_peered":"2024-01-21T19:59:55.755263+0000","last_unstale":"2024-01-21T19:59:55.762156+0000","last_undegraded":"2024-01-21T19:59:55.762156+0000","last_fullsized":"2024-01-21T19:59:55.762156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759621+0000","last_change":"2024-01-21T19:59:55.362989+0000","last_active":"2024-01-21T19:59:55.759621+0000","last_peered":"2024-01-21T19:59:55.759621+0000","last_clean":"2024-01-21T19:59:55.759621+0000","last_became_active":"2024-01-21T19:59:55.362727+0000","last_became_peered":"2024-01-21T19:59:55.362727+0000","last_unstale":"2024-01-21T19:59:55.759621+0000","last_undegraded":"2024-01-21T19:59:55.759621+0000","last_fullsized":"2024-01-21T19:59:55.759621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759760+0000","last_change":"2024-01-21T19:59:55.755291+0000","last_active":"2024-01-21T19:59:55.759760+0000","last_peered":"2024-01-21T19:59:55.759760+0000","last_clean":"2024-01-21T19:59:55.759760+0000","last_became_active":"2024-01-21T19:59:55.754955+0000","last_became_peered":"2024-01-21T19:59:55.754955+0000","last_unstale":"2024-01-21T19:59:55.759760+0000","last_undegraded":"2024-01-21T19:59:55.759760+0000","last_fullsized":"2024-01-21T19:59:55.759760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758706+0000","last_change":"2024-01-21T19:59:55.362928+0000","last_active":"2024-01-21T19:59:55.758706+0000","last_peered":"2024-01-21T19:59:55.758706+0000","last_clean":"2024-01-21T19:59:55.758706+0000","last_became_active":"2024-01-21T19:59:55.362463+0000","last_became_peered":"2024-01-21T19:59:55.362463+0000","last_unstale":"2024-01-21T19:59:55.758706+0000","last_undegraded":"2024-01-21T19:59:55.758706+0000","last_fullsized":"2024-01-21T19:59:55.758706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756605+0000","last_change":"2024-01-21T19:59:55.748989+0000","last_active":"2024-01-21T19:59:55.756605+0000","last_peered":"2024-01-21T19:59:55.756605+0000","last_clean":"2024-01-21T19:59:55.756605+0000","last_became_active":"2024-01-21T19:59:55.748730+0000","last_became_peered":"2024-01-21T19:59:55.748730+0000","last_unstale":"2024-01-21T19:59:55.756605+0000","last_undegraded":"2024-01-21T19:59:55.756605+0000","last_fullsized":"2024-01-21T19:59:55.756605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742444+0000","last_change":"2024-01-21T19:59:55.372152+0000","last_active":"2024-01-21T19:59:55.742444+0000","last_peered":"2024-01-21T19:59:55.742444+0000","last_clean":"2024-01-21T19:59:55.742444+0000","last_became_active":"2024-01-21T19:59:55.371855+0000","last_became_peered":"2024-01-21T19:59:55.371855+0000","last_unstale":"2024-01-21T19:59:55.742444+0000","last_undegraded":"2024-01-21T19:59:55.742444+0000","last_fullsized":"2024-01-21T19:59:55.742444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760674+0000","last_change":"2024-01-21T19:59:55.759053+0000","last_active":"2024-01-21T19:59:55.760674+0000","last_peered":"2024-01-21T19:59:55.760674+0000","last_clean":"2024-01-21T19:59:55.760674+0000","last_became_active":"2024-01-21T19:59:55.758805+0000","last_became_peered":"2024-01-21T19:59:55.758805+0000","last_unstale":"2024-01-21T19:59:55.760674+0000","last_undegraded":"2024-01-21T19:59:55.760674+0000","last_fullsized":"2024-01-21T19:59:55.760674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737061+0000","last_change":"2024-01-21T19:59:55.370154+0000","last_active":"2024-01-21T19:59:55.737061+0000","last_peered":"2024-01-21T19:59:55.737061+0000","last_clean":"2024-01-21T19:59:55.737061+0000","last_became_active":"2024-01-21T19:59:55.369128+0000","last_became_peered":"2024-01-21T19:59:55.369128+0000","last_unstale":"2024-01-21T19:59:55.737061+0000","last_undegraded":"2024-01-21T19:59:55.737061+0000","last_fullsized":"2024-01-21T19:59:55.737061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761735+0000","last_change":"2024-01-21T19:59:55.758437+0000","last_active":"2024-01-21T19:59:55.761735+0000","last_peered":"2024-01-21T19:59:55.761735+0000","last_clean":"2024-01-21T19:59:55.761735+0000","last_became_active":"2024-01-21T19:59:55.756727+0000","last_became_peered":"2024-01-21T19:59:55.756727+0000","last_unstale":"2024-01-21T19:59:55.761735+0000","last_undegraded":"2024-01-21T19:59:55.761735+0000","last_fullsized":"2024-01-21T19:59:55.761735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.755520+0000","last_change":"2024-01-21T19:59:55.377472+0000","last_active":"2024-01-21T19:59:55.755520+0000","last_peered":"2024-01-21T19:59:55.755520+0000","last_clean":"2024-01-21T19:59:55.755520+0000","last_became_active":"2024-01-21T19:59:55.377210+0000","last_became_peered":"2024-01-21T19:59:55.377210+0000","last_unstale":"2024-01-21T19:59:55.755520+0000","last_undegraded":"2024-01-21T19:59:55.755520+0000","last_fullsized":"2024-01-21T19:59:55.755520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.754654+0000","last_change":"2024-01-21T19:59:55.753615+0000","last_active":"2024-01-21T19:59:55.754654+0000","last_peered":"2024-01-21T19:59:55.754654+0000","last_clean":"2024-01-21T19:59:55.754654+0000","last_became_active":"2024-01-21T19:59:55.752706+0000","last_became_peered":"2024-01-21T19:59:55.752706+0000","last_unstale":"2024-01-21T19:59:55.754654+0000","last_undegraded":"2024-01-21T19:59:55.754654+0000","last_fullsized":"2024-01-21T19:59:55.754654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741731+0000","last_change":"2024-01-21T19:59:55.365385+0000","last_active":"2024-01-21T19:59:55.741731+0000","last_peered":"2024-01-21T19:59:55.741731+0000","last_clean":"2024-01-21T19:59:55.741731+0000","last_became_active":"2024-01-21T19:59:55.365110+0000","last_became_peered":"2024-01-21T19:59:55.365110+0000","last_unstale":"2024-01-21T19:59:55.741731+0000","last_undegraded":"2024-01-21T19:59:55.741731+0000","last_fullsized":"2024-01-21T19:59:55.741731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758507+0000","last_change":"2024-01-21T19:59:55.750876+0000","last_active":"2024-01-21T19:59:55.758507+0000","last_peered":"2024-01-21T19:59:55.758507+0000","last_clean":"2024-01-21T19:59:55.758507+0000","last_became_active":"2024-01-21T19:59:55.750601+0000","last_became_peered":"2024-01-21T19:59:55.750601+0000","last_unstale":"2024-01-21T19:59:55.758507+0000","last_undegraded":"2024-01-21T19:59:55.758507+0000","last_fullsized":"2024-01-21T19:59:55.758507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750238+0000","last_change":"2024-01-21T19:59:55.374198+0000","last_active":"2024-01-21T19:59:55.750238+0000","last_peered":"2024-01-21T19:59:55.750238+0000","last_clean":"2024-01-21T19:59:55.750238+0000","last_became_active":"2024-01-21T19:59:55.373903+0000","last_became_peered":"2024-01-21T19:59:55.373903+0000","last_unstale":"2024-01-21T19:59:55.750238+0000","last_undegraded":"2024-01-21T19:59:55.750238+0000","last_fullsized":"2024-01-21T19:59:55.750238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761925+0000","last_change":"2024-01-21T19:59:55.755470+0000","last_active":"2024-01-21T19:59:55.761925+0000","last_peered":"2024-01-21T19:59:55.761925+0000","last_clean":"2024-01-21T19:59:55.761925+0000","last_became_active":"2024-01-21T19:59:55.755213+0000","last_became_peered":"2024-01-21T19:59:55.755213+0000","last_unstale":"2024-01-21T19:59:55.761925+0000","last_undegraded":"2024-01-21T19:59:55.761925+0000","last_fullsized":"2024-01-21T19:59:55.761925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741509+0000","last_change":"2024-01-21T19:59:55.376767+0000","last_active":"2024-01-21T19:59:55.741509+0000","last_peered":"2024-01-21T19:59:55.741509+0000","last_clean":"2024-01-21T19:59:55.741509+0000","last_became_active":"2024-01-21T19:59:55.376481+0000","last_became_peered":"2024-01-21T19:59:55.376481+0000","last_unstale":"2024-01-21T19:59:55.741509+0000","last_undegraded":"2024-01-21T19:59:55.741509+0000","last_fullsized":"2024-01-21T19:59:55.741509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751862+0000","last_change":"2024-01-21T19:59:55.750322+0000","last_active":"2024-01-21T19:59:55.751862+0000","last_peered":"2024-01-21T19:59:55.751862+0000","last_clean":"2024-01-21T19:59:55.751862+0000","last_became_active":"2024-01-21T19:59:55.749826+0000","last_became_peered":"2024-01-21T19:59:55.749826+0000","last_unstale":"2024-01-21T19:59:55.751862+0000","last_undegraded":"2024-01-21T19:59:55.751862+0000","last_fullsized":"2024-01-21T19:59:55.751862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736326+0000","last_change":"2024-01-21T19:59:55.376688+0000","last_active":"2024-01-21T19:59:55.736326+0000","last_peered":"2024-01-21T19:59:55.736326+0000","last_clean":"2024-01-21T19:59:55.736326+0000","last_became_active":"2024-01-21T19:59:55.376145+0000","last_became_peered":"2024-01-21T19:59:55.376145+0000","last_unstale":"2024-01-21T19:59:55.736326+0000","last_undegraded":"2024-01-21T19:59:55.736326+0000","last_fullsized":"2024-01-21T19:59:55.736326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737138+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:55.737138+0000","last_peered":"2024-01-21T19:59:55.737138+0000","last_clean":"2024-01-21T19:59:55.737138+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:55.737138+0000","last_undegraded":"2024-01-21T19:59:55.737138+0000","last_fullsized":"2024-01-21T19:59:55.737138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761300+0000","last_change":"2024-01-21T19:59:55.757496+0000","last_active":"2024-01-21T19:59:55.761300+0000","last_peered":"2024-01-21T19:59:55.761300+0000","last_clean":"2024-01-21T19:59:55.761300+0000","last_became_active":"2024-01-21T19:59:55.757211+0000","last_became_peered":"2024-01-21T19:59:55.757211+0000","last_unstale":"2024-01-21T19:59:55.761300+0000","last_undegraded":"2024-01-21T19:59:55.761300+0000","last_fullsized":"2024-01-21T19:59:55.761300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736896+0000","last_change":"2024-01-21T19:59:55.374031+0000","last_active":"2024-01-21T19:59:55.736896+0000","last_peered":"2024-01-21T19:59:55.736896+0000","last_clean":"2024-01-21T19:59:55.736896+0000","last_became_active":"2024-01-21T19:59:55.373742+0000","last_became_peered":"2024-01-21T19:59:55.373742+0000","last_unstale":"2024-01-21T19:59:55.736896+0000","last_undegraded":"2024-01-21T19:59:55.736896+0000","last_fullsized":"2024-01-21T19:59:55.736896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739207+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:55.739207+0000","last_peered":"2024-01-21T19:59:55.739207+0000","last_clean":"2024-01-21T19:59:55.739207+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:55.739207+0000","last_undegraded":"2024-01-21T19:59:55.739207+0000","last_fullsized":"2024-01-21T19:59:55.739207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.766203+0000","last_change":"2024-01-21T19:59:55.765565+0000","last_active":"2024-01-21T19:59:55.766203+0000","last_peered":"2024-01-21T19:59:55.766203+0000","last_clean":"2024-01-21T19:59:55.766203+0000","last_became_active":"2024-01-21T19:59:55.765260+0000","last_became_peered":"2024-01-21T19:59:55.765260+0000","last_unstale":"2024-01-21T19:59:55.766203+0000","last_undegraded":"2024-01-21T19:59:55.766203+0000","last_fullsized":"2024-01-21T19:59:55.766203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742510+0000","last_change":"2024-01-21T19:59:55.364286+0000","last_active":"2024-01-21T19:59:55.742510+0000","last_peered":"2024-01-21T19:59:55.742510+0000","last_clean":"2024-01-21T19:59:55.742510+0000","last_became_active":"2024-01-21T19:59:55.363981+0000","last_became_peered":"2024-01-21T19:59:55.363981+0000","last_unstale":"2024-01-21T19:59:55.742510+0000","last_undegraded":"2024-01-21T19:59:55.742510+0000","last_fullsized":"2024-01-21T19:59:55.742510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741869+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:55.741869+0000","last_peered":"2024-01-21T19:59:55.741869+0000","last_clean":"2024-01-21T19:59:55.741869+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:55.741869+0000","last_undegraded":"2024-01-21T19:59:55.741869+0000","last_fullsized":"2024-01-21T19:59:55.741869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759669+0000","last_change":"2024-01-21T19:59:55.753872+0000","last_active":"2024-01-21T19:59:55.759669+0000","last_peered":"2024-01-21T19:59:55.759669+0000","last_clean":"2024-01-21T19:59:55.759669+0000","last_became_active":"2024-01-21T19:59:55.753611+0000","last_became_peered":"2024-01-21T19:59:55.753611+0000","last_unstale":"2024-01-21T19:59:55.759669+0000","last_undegraded":"2024-01-21T19:59:55.759669+0000","last_fullsized":"2024-01-21T19:59:55.759669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750312+0000","last_change":"2024-01-21T19:59:55.372783+0000","last_active":"2024-01-21T19:59:55.750312+0000","last_peered":"2024-01-21T19:59:55.750312+0000","last_clean":"2024-01-21T19:59:55.750312+0000","last_became_active":"2024-01-21T19:59:55.372347+0000","last_became_peered":"2024-01-21T19:59:55.372347+0000","last_unstale":"2024-01-21T19:59:55.750312+0000","last_undegraded":"2024-01-21T19:59:55.750312+0000","last_fullsized":"2024-01-21T19:59:55.750312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739432+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:55.739432+0000","last_peered":"2024-01-21T19:59:55.739432+0000","last_clean":"2024-01-21T19:59:55.739432+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:55.739432+0000","last_undegraded":"2024-01-21T19:59:55.739432+0000","last_fullsized":"2024-01-21T19:59:55.739432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750055+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:55.750055+0000","last_peered":"2024-01-21T19:59:55.750055+0000","last_clean":"2024-01-21T19:59:55.750055+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:55.750055+0000","last_undegraded":"2024-01-21T19:59:55.750055+0000","last_fullsized":"2024-01-21T19:59:55.750055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750748+0000","last_change":"2024-01-21T19:59:55.748096+0000","last_active":"2024-01-21T19:59:55.750748+0000","last_peered":"2024-01-21T19:59:55.750748+0000","last_clean":"2024-01-21T19:59:55.750748+0000","last_became_active":"2024-01-21T19:59:55.747837+0000","last_became_peered":"2024-01-21T19:59:55.747837+0000","last_unstale":"2024-01-21T19:59:55.750748+0000","last_undegraded":"2024-01-21T19:59:55.750748+0000","last_fullsized":"2024-01-21T19:59:55.750748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756384+0000","last_change":"2024-01-21T19:59:55.366315+0000","last_active":"2024-01-21T19:59:55.756384+0000","last_peered":"2024-01-21T19:59:55.756384+0000","last_clean":"2024-01-21T19:59:55.756384+0000","last_became_active":"2024-01-21T19:59:55.366053+0000","last_became_peered":"2024-01-21T19:59:55.366053+0000","last_unstale":"2024-01-21T19:59:55.756384+0000","last_undegraded":"2024-01-21T19:59:55.756384+0000","last_fullsized":"2024-01-21T19:59:55.756384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751071+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:55.751071+0000","last_peered":"2024-01-21T19:59:55.751071+0000","last_clean":"2024-01-21T19:59:55.751071+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:55.751071+0000","last_undegraded":"2024-01-21T19:59:55.751071+0000","last_fullsized":"2024-01-21T19:59:55.751071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752289+0000","last_change":"2024-01-21T19:59:55.750767+0000","last_active":"2024-01-21T19:59:55.752289+0000","last_peered":"2024-01-21T19:59:55.752289+0000","last_clean":"2024-01-21T19:59:55.752289+0000","last_became_active":"2024-01-21T19:59:55.750488+0000","last_became_peered":"2024-01-21T19:59:55.750488+0000","last_unstale":"2024-01-21T19:59:55.752289+0000","last_undegraded":"2024-01-21T19:59:55.752289+0000","last_fullsized":"2024-01-21T19:59:55.752289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743663+0000","last_change":"2024-01-21T19:59:55.376769+0000","last_active":"2024-01-21T19:59:55.743663+0000","last_peered":"2024-01-21T19:59:55.743663+0000","last_clean":"2024-01-21T19:59:55.743663+0000","last_became_active":"2024-01-21T19:59:55.376452+0000","last_became_peered":"2024-01-21T19:59:55.376452+0000","last_unstale":"2024-01-21T19:59:55.743663+0000","last_undegraded":"2024-01-21T19:59:55.743663+0000","last_fullsized":"2024-01-21T19:59:55.743663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751077+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:55.751077+0000","last_peered":"2024-01-21T19:59:55.751077+0000","last_clean":"2024-01-21T19:59:55.751077+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:55.751077+0000","last_undegraded":"2024-01-21T19:59:55.751077+0000","last_fullsized":"2024-01-21T19:59:55.751077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759319+0000","last_change":"2024-01-21T19:59:55.758240+0000","last_active":"2024-01-21T19:59:55.759319+0000","last_peered":"2024-01-21T19:59:55.759319+0000","last_clean":"2024-01-21T19:59:55.759319+0000","last_became_active":"2024-01-21T19:59:55.757955+0000","last_became_peered":"2024-01-21T19:59:55.757955+0000","last_unstale":"2024-01-21T19:59:55.759319+0000","last_undegraded":"2024-01-21T19:59:55.759319+0000","last_fullsized":"2024-01-21T19:59:55.759319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744210+0000","last_change":"2024-01-21T19:59:55.357570+0000","last_active":"2024-01-21T19:59:55.744210+0000","last_peered":"2024-01-21T19:59:55.744210+0000","last_clean":"2024-01-21T19:59:55.744210+0000","last_became_active":"2024-01-21T19:59:55.357272+0000","last_became_peered":"2024-01-21T19:59:55.357272+0000","last_unstale":"2024-01-21T19:59:55.744210+0000","last_undegraded":"2024-01-21T19:59:55.744210+0000","last_fullsized":"2024-01-21T19:59:55.744210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737405+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:55.737405+0000","last_peered":"2024-01-21T19:59:55.737405+0000","last_clean":"2024-01-21T19:59:55.737405+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:55.737405+0000","last_undegraded":"2024-01-21T19:59:55.737405+0000","last_fullsized":"2024-01-21T19:59:55.737405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765556+0000","last_change":"2024-01-21T19:59:55.763997+0000","last_active":"2024-01-21T19:59:55.765556+0000","last_peered":"2024-01-21T19:59:55.765556+0000","last_clean":"2024-01-21T19:59:55.765556+0000","last_became_active":"2024-01-21T19:59:55.763737+0000","last_became_peered":"2024-01-21T19:59:55.763737+0000","last_unstale":"2024-01-21T19:59:55.765556+0000","last_undegraded":"2024-01-21T19:59:55.765556+0000","last_fullsized":"2024-01-21T19:59:55.765556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.746333+0000","last_change":"2024-01-21T19:59:55.369000+0000","last_active":"2024-01-21T19:59:55.746333+0000","last_peered":"2024-01-21T19:59:55.746333+0000","last_clean":"2024-01-21T19:59:55.746333+0000","last_became_active":"2024-01-21T19:59:55.368682+0000","last_became_peered":"2024-01-21T19:59:55.368682+0000","last_unstale":"2024-01-21T19:59:55.746333+0000","last_undegraded":"2024-01-21T19:59:55.746333+0000","last_fullsized":"2024-01-21T19:59:55.746333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752118+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:55.752118+0000","last_peered":"2024-01-21T19:59:55.752118+0000","last_clean":"2024-01-21T19:59:55.752118+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:55.752118+0000","last_undegraded":"2024-01-21T19:59:55.752118+0000","last_fullsized":"2024-01-21T19:59:55.752118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":158387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":159258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":158864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.44},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.376},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45000000000000001}]},{"osd":5,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":157777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":160344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":152022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":160262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:00:03.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:00:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.283+0000 7fc3af7b0700 1 Processor -- start 2024-01-21T20:00:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.283+0000 7fc3af7b0700 1 -- start start 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc3a81558c0 0x7fc3a80626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3a8155ca0 0x7fc3a8062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a80bd180 0x7fc3a80bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a80630d0 con 0x7fc3a8155ca0 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a80a50f0 con 0x7fc3a81558c0 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3af7b0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80a4da0 con 0x7fc3a80bd180 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3acd4b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3a8155ca0 0x7fc3a8062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3acd4b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3a8155ca0 0x7fc3a8062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51166/0 (socket says 172.21.15.133:51166) 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3acd4b700 1 -- 172.21.15.133:0/771564791 learned_addr learned my addr 172.21.15.133:0/771564791 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3ad54c700 1 --2- 172.21.15.133:0/771564791 >> v2:172.21.15.178:3300/0 conn(0x7fc3a81558c0 0x7fc3a80626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.284+0000 7fc3add4d700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a80bd180 0x7fc3a80bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 -- 172.21.15.133:0/771564791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a80bd180 msgr2=0x7fc3a80bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a80bd180 0x7fc3a80bd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 -- 172.21.15.133:0/771564791 >> v2:172.21.15.178:3300/0 conn(0x7fc3a81558c0 msgr2=0x7fc3a80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 --2- 172.21.15.133:0/771564791 >> v2:172.21.15.178:3300/0 conn(0x7fc3a81558c0 0x7fc3a80626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 -- 172.21.15.133:0/771564791 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a80bde00 con 0x7fc3a8155ca0 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3acd4b700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a8062be0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc3a80692f0 tx=0x7fc3a40090f0).ready entity=mon.0 client_cookie=d59b58f1bd6ef78d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc39ffff700 1 -- 172.21.15.133:0/771564791 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400b600 con 0x7fc3a8155ca0 2024-01-21T20:00:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc39ffff700 1 -- 172.21.15.133:0/771564791 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a400b760 con 0x7fc3a8155ca0 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc39ffff700 1 -- 172.21.15.133:0/771564791 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400bb00 con 0x7fc3a8155ca0 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 -- 172.21.15.133:0/771564791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 msgr2=0x7fc3a8062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a8062be0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fc3a80692f0 tx=0x7fc3a40090f0).stop 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 -- 172.21.15.133:0/771564791 shutdown_connections 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a80bd180 0x7fc3a80bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/771564791 >> v2:172.21.15.178:3300/0 conn(0x7fc3a81558c0 0x7fc3a80626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/771564791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a8062be0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.285+0000 7fc3af7b0700 1 -- 172.21.15.133:0/771564791 >> 172.21.15.133:0/771564791 conn(0x7fc3a80c8010 msgr2=0x7fc3a80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.286+0000 7fc3af7b0700 1 -- 172.21.15.133:0/771564791 shutdown_connections 2024-01-21T20:00:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.286+0000 7fc3af7b0700 1 -- 172.21.15.133:0/771564791 wait complete. 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.287+0000 7fc3af7b0700 1 Processor -- start 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.287+0000 7fc3af7b0700 1 -- start start 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 0x7fc3a8066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 0x7fc3a80a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80aa370 con 0x7fc3a8155ca0 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a8168a60 con 0x7fc3a80bd180 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3af7b0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81685d0 con 0x7fc3a81558c0 2024-01-21T20:00:03.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51176/0 (socket says 172.21.15.133:51176) 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 -- 172.21.15.133:0/1560847826 learned_addr learned my addr 172.21.15.133:0/1560847826 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3ad54c700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 0x7fc3a8066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3acd4b700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 0x7fc3a80a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 -- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 msgr2=0x7fc3a80a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 0x7fc3a80a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 -- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 msgr2=0x7fc3a8066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 0x7fc3a8066eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 -- 172.21.15.133:0/1560847826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009370 con 0x7fc3a8155ca0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3acd4b700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 0x7fc3a80a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3ad54c700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 0x7fc3a8066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.288+0000 7fc3add4d700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc3a0009fd0 tx=0x7fc3a0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.289+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000ed50 con 0x7fc3a8155ca0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.289+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a000eeb0 con 0x7fc3a8155ca0 2024-01-21T20:00:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.289+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0014610 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.289+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a8065660 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.289+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a8167f80 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.290+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a8168740 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.290+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc3a001d3b0 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.290+0000 7fc39dffb700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 0x7fc38c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.290+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc3a007a7c0 con 0x7fc3a8155ca0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.290+0000 7fc3ad54c700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 0x7fc38c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.291+0000 7fc3ad54c700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 0x7fc38c061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc3a81518f0 tx=0x7fc398008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.294+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3a004ba30 con 0x7fc3a8155ca0 2024-01-21T20:00:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.458+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3a8065210 con 0x7fc38c05f150 2024-01-21T20:00:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.467+0000 7fc39dffb700 1 -- 172.21.15.133:0/1560847826 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339452 (secure 0 0 0) 0x7fc3a8065210 con 0x7fc38c05f150 2024-01-21T20:00:03.462 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 msgr2=0x7fc38c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 0x7fc38c061610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fc3a81518f0 tx=0x7fc398008040).stop 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 msgr2=0x7fc3a80a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fc3a0009fd0 tx=0x7fc3a0009900).stop 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 shutdown_connections 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc38c05f150 0x7fc38c061610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3a8155ca0 0x7fc3a80a9e80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3a80bd180 0x7fc3a8066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 --2- 172.21.15.133:0/1560847826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3a81558c0 0x7fc3a80a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 >> 172.21.15.133:0/1560847826 conn(0x7fc3a80c8010 msgr2=0x7fc3a8152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 shutdown_connections 2024-01-21T20:00:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.470+0000 7fc3af7b0700 1 -- 172.21.15.133:0/1560847826 wait complete. 2024-01-21T20:00:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:00:03.474 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-01-21T20:00:01.860380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379820,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594900,"statfs":{"total":773094113280,"available":770657177600,"internally_reserved":0,"allocated":3125248,"data_stored":1265618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4313,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279430"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751743+0000","last_change":"2024-01-21T19:59:55.746968+0000","last_active":"2024-01-21T19:59:55.751743+0000","last_peered":"2024-01-21T19:59:55.751743+0000","last_clean":"2024-01-21T19:59:55.751743+0000","last_became_active":"2024-01-21T19:59:55.746314+0000","last_became_peered":"2024-01-21T19:59:55.746314+0000","last_unstale":"2024-01-21T19:59:55.751743+0000","last_undegraded":"2024-01-21T19:59:55.751743+0000","last_fullsized":"2024-01-21T19:59:55.751743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.766257+0000","last_change":"2024-01-21T19:59:55.373245+0000","last_active":"2024-01-21T19:59:55.766257+0000","last_peered":"2024-01-21T19:59:55.766257+0000","last_clean":"2024-01-21T19:59:55.766257+0000","last_became_active":"2024-01-21T19:59:55.372970+0000","last_became_peered":"2024-01-21T19:59:55.372970+0000","last_unstale":"2024-01-21T19:59:55.766257+0000","last_undegraded":"2024-01-21T19:59:55.766257+0000","last_fullsized":"2024-01-21T19:59:55.766257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749380+0000","last_change":"2024-01-21T19:59:55.745713+0000","last_active":"2024-01-21T19:59:55.749380+0000","last_peered":"2024-01-21T19:59:55.749380+0000","last_clean":"2024-01-21T19:59:55.749380+0000","last_became_active":"2024-01-21T19:59:55.745436+0000","last_became_peered":"2024-01-21T19:59:55.745436+0000","last_unstale":"2024-01-21T19:59:55.749380+0000","last_undegraded":"2024-01-21T19:59:55.749380+0000","last_fullsized":"2024-01-21T19:59:55.749380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749857+0000","last_change":"2024-01-21T19:59:55.376791+0000","last_active":"2024-01-21T19:59:55.749857+0000","last_peered":"2024-01-21T19:59:55.749857+0000","last_clean":"2024-01-21T19:59:55.749857+0000","last_became_active":"2024-01-21T19:59:55.376496+0000","last_became_peered":"2024-01-21T19:59:55.376496+0000","last_unstale":"2024-01-21T19:59:55.749857+0000","last_undegraded":"2024-01-21T19:59:55.749857+0000","last_fullsized":"2024-01-21T19:59:55.749857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762064+0000","last_change":"2024-01-21T19:59:55.759386+0000","last_active":"2024-01-21T19:59:55.762064+0000","last_peered":"2024-01-21T19:59:55.762064+0000","last_clean":"2024-01-21T19:59:55.762064+0000","last_became_active":"2024-01-21T19:59:55.759121+0000","last_became_peered":"2024-01-21T19:59:55.759121+0000","last_unstale":"2024-01-21T19:59:55.762064+0000","last_undegraded":"2024-01-21T19:59:55.762064+0000","last_fullsized":"2024-01-21T19:59:55.762064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739554+0000","last_change":"2024-01-21T19:59:55.371162+0000","last_active":"2024-01-21T19:59:55.739554+0000","last_peered":"2024-01-21T19:59:55.739554+0000","last_clean":"2024-01-21T19:59:55.739554+0000","last_became_active":"2024-01-21T19:59:55.370835+0000","last_became_peered":"2024-01-21T19:59:55.370835+0000","last_unstale":"2024-01-21T19:59:55.739554+0000","last_undegraded":"2024-01-21T19:59:55.739554+0000","last_fullsized":"2024-01-21T19:59:55.739554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761269+0000","last_change":"2024-01-21T19:59:55.757355+0000","last_active":"2024-01-21T19:59:55.761269+0000","last_peered":"2024-01-21T19:59:55.761269+0000","last_clean":"2024-01-21T19:59:55.761269+0000","last_became_active":"2024-01-21T19:59:55.757067+0000","last_became_peered":"2024-01-21T19:59:55.757067+0000","last_unstale":"2024-01-21T19:59:55.761269+0000","last_undegraded":"2024-01-21T19:59:55.761269+0000","last_fullsized":"2024-01-21T19:59:55.761269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756723+0000","last_change":"2024-01-21T19:59:55.369705+0000","last_active":"2024-01-21T19:59:55.756723+0000","last_peered":"2024-01-21T19:59:55.756723+0000","last_clean":"2024-01-21T19:59:55.756723+0000","last_became_active":"2024-01-21T19:59:55.369346+0000","last_became_peered":"2024-01-21T19:59:55.369346+0000","last_unstale":"2024-01-21T19:59:55.756723+0000","last_undegraded":"2024-01-21T19:59:55.756723+0000","last_fullsized":"2024-01-21T19:59:55.756723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761940+0000","last_change":"2024-01-21T19:59:55.758245+0000","last_active":"2024-01-21T19:59:55.761940+0000","last_peered":"2024-01-21T19:59:55.761940+0000","last_clean":"2024-01-21T19:59:55.761940+0000","last_became_active":"2024-01-21T19:59:55.757819+0000","last_became_peered":"2024-01-21T19:59:55.757819+0000","last_unstale":"2024-01-21T19:59:55.761940+0000","last_undegraded":"2024-01-21T19:59:55.761940+0000","last_fullsized":"2024-01-21T19:59:55.761940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760443+0000","last_change":"2024-01-21T19:59:55.373797+0000","last_active":"2024-01-21T19:59:55.760443+0000","last_peered":"2024-01-21T19:59:55.760443+0000","last_clean":"2024-01-21T19:59:55.760443+0000","last_became_active":"2024-01-21T19:59:55.372960+0000","last_became_peered":"2024-01-21T19:59:55.372960+0000","last_unstale":"2024-01-21T19:59:55.760443+0000","last_undegraded":"2024-01-21T19:59:55.760443+0000","last_fullsized":"2024-01-21T19:59:55.760443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758597+0000","last_change":"2024-01-21T19:59:55.753442+0000","last_active":"2024-01-21T19:59:55.758597+0000","last_peered":"2024-01-21T19:59:55.758597+0000","last_clean":"2024-01-21T19:59:55.758597+0000","last_became_active":"2024-01-21T19:59:55.753124+0000","last_became_peered":"2024-01-21T19:59:55.753124+0000","last_unstale":"2024-01-21T19:59:55.758597+0000","last_undegraded":"2024-01-21T19:59:55.758597+0000","last_fullsized":"2024-01-21T19:59:55.758597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761377+0000","last_change":"2024-01-21T19:59:55.356374+0000","last_active":"2024-01-21T19:59:55.761377+0000","last_peered":"2024-01-21T19:59:55.761377+0000","last_clean":"2024-01-21T19:59:55.761377+0000","last_became_active":"2024-01-21T19:59:55.356145+0000","last_became_peered":"2024-01-21T19:59:55.356145+0000","last_unstale":"2024-01-21T19:59:55.761377+0000","last_undegraded":"2024-01-21T19:59:55.761377+0000","last_fullsized":"2024-01-21T19:59:55.761377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756946+0000","last_change":"2024-01-21T19:59:55.753382+0000","last_active":"2024-01-21T19:59:55.756946+0000","last_peered":"2024-01-21T19:59:55.756946+0000","last_clean":"2024-01-21T19:59:55.756946+0000","last_became_active":"2024-01-21T19:59:55.753098+0000","last_became_peered":"2024-01-21T19:59:55.753098+0000","last_unstale":"2024-01-21T19:59:55.756946+0000","last_undegraded":"2024-01-21T19:59:55.756946+0000","last_fullsized":"2024-01-21T19:59:55.756946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749794+0000","last_change":"2024-01-21T19:59:55.373253+0000","last_active":"2024-01-21T19:59:55.749794+0000","last_peered":"2024-01-21T19:59:55.749794+0000","last_clean":"2024-01-21T19:59:55.749794+0000","last_became_active":"2024-01-21T19:59:55.372998+0000","last_became_peered":"2024-01-21T19:59:55.372998+0000","last_unstale":"2024-01-21T19:59:55.749794+0000","last_undegraded":"2024-01-21T19:59:55.749794+0000","last_fullsized":"2024-01-21T19:59:55.749794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.753293+0000","last_change":"2024-01-21T19:59:55.748190+0000","last_active":"2024-01-21T19:59:55.753293+0000","last_peered":"2024-01-21T19:59:55.753293+0000","last_clean":"2024-01-21T19:59:55.753293+0000","last_became_active":"2024-01-21T19:59:55.747873+0000","last_became_peered":"2024-01-21T19:59:55.747873+0000","last_unstale":"2024-01-21T19:59:55.753293+0000","last_undegraded":"2024-01-21T19:59:55.753293+0000","last_fullsized":"2024-01-21T19:59:55.753293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750516+0000","last_change":"2024-01-21T19:59:55.375599+0000","last_active":"2024-01-21T19:59:55.750516+0000","last_peered":"2024-01-21T19:59:55.750516+0000","last_clean":"2024-01-21T19:59:55.750516+0000","last_became_active":"2024-01-21T19:59:55.375337+0000","last_became_peered":"2024-01-21T19:59:55.375337+0000","last_unstale":"2024-01-21T19:59:55.750516+0000","last_undegraded":"2024-01-21T19:59:55.750516+0000","last_fullsized":"2024-01-21T19:59:55.750516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749324+0000","last_change":"2024-01-21T19:59:55.744906+0000","last_active":"2024-01-21T19:59:55.749324+0000","last_peered":"2024-01-21T19:59:55.749324+0000","last_clean":"2024-01-21T19:59:55.749324+0000","last_became_active":"2024-01-21T19:59:55.744530+0000","last_became_peered":"2024-01-21T19:59:55.744530+0000","last_unstale":"2024-01-21T19:59:55.749324+0000","last_undegraded":"2024-01-21T19:59:55.749324+0000","last_fullsized":"2024-01-21T19:59:55.749324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.745667+0000","last_change":"2024-01-21T19:59:55.367440+0000","last_active":"2024-01-21T19:59:55.745667+0000","last_peered":"2024-01-21T19:59:55.745667+0000","last_clean":"2024-01-21T19:59:55.745667+0000","last_became_active":"2024-01-21T19:59:55.367189+0000","last_became_peered":"2024-01-21T19:59:55.367189+0000","last_unstale":"2024-01-21T19:59:55.745667+0000","last_undegraded":"2024-01-21T19:59:55.745667+0000","last_fullsized":"2024-01-21T19:59:55.745667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758187+0000","last_change":"2024-01-21T19:59:55.746849+0000","last_active":"2024-01-21T19:59:55.758187+0000","last_peered":"2024-01-21T19:59:55.758187+0000","last_clean":"2024-01-21T19:59:55.758187+0000","last_became_active":"2024-01-21T19:59:55.746520+0000","last_became_peered":"2024-01-21T19:59:55.746520+0000","last_unstale":"2024-01-21T19:59:55.758187+0000","last_undegraded":"2024-01-21T19:59:55.758187+0000","last_fullsized":"2024-01-21T19:59:55.758187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737314+0000","last_change":"2024-01-21T19:59:55.375081+0000","last_active":"2024-01-21T19:59:55.737314+0000","last_peered":"2024-01-21T19:59:55.737314+0000","last_clean":"2024-01-21T19:59:55.737314+0000","last_became_active":"2024-01-21T19:59:55.374619+0000","last_became_peered":"2024-01-21T19:59:55.374619+0000","last_unstale":"2024-01-21T19:59:55.737314+0000","last_undegraded":"2024-01-21T19:59:55.737314+0000","last_fullsized":"2024-01-21T19:59:55.737314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759590+0000","last_change":"2024-01-21T19:59:55.754753+0000","last_active":"2024-01-21T19:59:55.759590+0000","last_peered":"2024-01-21T19:59:55.759590+0000","last_clean":"2024-01-21T19:59:55.759590+0000","last_became_active":"2024-01-21T19:59:55.754391+0000","last_became_peered":"2024-01-21T19:59:55.754391+0000","last_unstale":"2024-01-21T19:59:55.759590+0000","last_undegraded":"2024-01-21T19:59:55.759590+0000","last_fullsized":"2024-01-21T19:59:55.759590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750995+0000","last_change":"2024-01-21T19:59:55.374008+0000","last_active":"2024-01-21T19:59:55.750995+0000","last_peered":"2024-01-21T19:59:55.750995+0000","last_clean":"2024-01-21T19:59:55.750995+0000","last_became_active":"2024-01-21T19:59:55.373696+0000","last_became_peered":"2024-01-21T19:59:55.373696+0000","last_unstale":"2024-01-21T19:59:55.750995+0000","last_undegraded":"2024-01-21T19:59:55.750995+0000","last_fullsized":"2024-01-21T19:59:55.750995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749657+0000","last_change":"2024-01-21T19:59:55.746660+0000","last_active":"2024-01-21T19:59:55.749657+0000","last_peered":"2024-01-21T19:59:55.749657+0000","last_clean":"2024-01-21T19:59:55.749657+0000","last_became_active":"2024-01-21T19:59:55.745857+0000","last_became_peered":"2024-01-21T19:59:55.745857+0000","last_unstale":"2024-01-21T19:59:55.749657+0000","last_undegraded":"2024-01-21T19:59:55.749657+0000","last_fullsized":"2024-01-21T19:59:55.749657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.763339+0000","last_change":"2024-01-21T19:59:55.358495+0000","last_active":"2024-01-21T19:59:55.763339+0000","last_peered":"2024-01-21T19:59:55.763339+0000","last_clean":"2024-01-21T19:59:55.763339+0000","last_became_active":"2024-01-21T19:59:55.358237+0000","last_became_peered":"2024-01-21T19:59:55.358237+0000","last_unstale":"2024-01-21T19:59:55.763339+0000","last_undegraded":"2024-01-21T19:59:55.763339+0000","last_fullsized":"2024-01-21T19:59:55.763339+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761753+0000","last_change":"2024-01-21T19:59:55.759212+0000","last_active":"2024-01-21T19:59:55.761753+0000","last_peered":"2024-01-21T19:59:55.761753+0000","last_clean":"2024-01-21T19:59:55.761753+0000","last_became_active":"2024-01-21T19:59:55.758933+0000","last_became_peered":"2024-01-21T19:59:55.758933+0000","last_unstale":"2024-01-21T19:59:55.761753+0000","last_undegraded":"2024-01-21T19:59:55.761753+0000","last_fullsized":"2024-01-21T19:59:55.761753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751806+0000","last_change":"2024-01-21T19:59:55.361333+0000","last_active":"2024-01-21T19:59:55.751806+0000","last_peered":"2024-01-21T19:59:55.751806+0000","last_clean":"2024-01-21T19:59:55.751806+0000","last_became_active":"2024-01-21T19:59:55.361025+0000","last_became_peered":"2024-01-21T19:59:55.361025+0000","last_unstale":"2024-01-21T19:59:55.751806+0000","last_undegraded":"2024-01-21T19:59:55.751806+0000","last_fullsized":"2024-01-21T19:59:55.751806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756029+0000","last_change":"2024-01-21T19:59:55.744080+0000","last_active":"2024-01-21T19:59:55.756029+0000","last_peered":"2024-01-21T19:59:55.756029+0000","last_clean":"2024-01-21T19:59:55.756029+0000","last_became_active":"2024-01-21T19:59:55.743794+0000","last_became_peered":"2024-01-21T19:59:55.743794+0000","last_unstale":"2024-01-21T19:59:55.756029+0000","last_undegraded":"2024-01-21T19:59:55.756029+0000","last_fullsized":"2024-01-21T19:59:55.756029+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.746641+0000","last_change":"2024-01-21T19:59:55.364558+0000","last_active":"2024-01-21T19:59:55.746641+0000","last_peered":"2024-01-21T19:59:55.746641+0000","last_clean":"2024-01-21T19:59:55.746641+0000","last_became_active":"2024-01-21T19:59:55.364280+0000","last_became_peered":"2024-01-21T19:59:55.364280+0000","last_unstale":"2024-01-21T19:59:55.746641+0000","last_undegraded":"2024-01-21T19:59:55.746641+0000","last_fullsized":"2024-01-21T19:59:55.746641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758347+0000","last_change":"2024-01-21T19:59:55.754428+0000","last_active":"2024-01-21T19:59:55.758347+0000","last_peered":"2024-01-21T19:59:55.758347+0000","last_clean":"2024-01-21T19:59:55.758347+0000","last_became_active":"2024-01-21T19:59:55.754149+0000","last_became_peered":"2024-01-21T19:59:55.754149+0000","last_unstale":"2024-01-21T19:59:55.758347+0000","last_undegraded":"2024-01-21T19:59:55.758347+0000","last_fullsized":"2024-01-21T19:59:55.758347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739014+0000","last_change":"2024-01-21T19:59:55.369516+0000","last_active":"2024-01-21T19:59:55.739014+0000","last_peered":"2024-01-21T19:59:55.739014+0000","last_clean":"2024-01-21T19:59:55.739014+0000","last_became_active":"2024-01-21T19:59:55.369201+0000","last_became_peered":"2024-01-21T19:59:55.369201+0000","last_unstale":"2024-01-21T19:59:55.739014+0000","last_undegraded":"2024-01-21T19:59:55.739014+0000","last_fullsized":"2024-01-21T19:59:55.739014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759548+0000","last_change":"2024-01-21T19:59:55.754536+0000","last_active":"2024-01-21T19:59:55.759548+0000","last_peered":"2024-01-21T19:59:55.759548+0000","last_clean":"2024-01-21T19:59:55.759548+0000","last_became_active":"2024-01-21T19:59:55.754257+0000","last_became_peered":"2024-01-21T19:59:55.754257+0000","last_unstale":"2024-01-21T19:59:55.759548+0000","last_undegraded":"2024-01-21T19:59:55.759548+0000","last_fullsized":"2024-01-21T19:59:55.759548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762235+0000","last_change":"2024-01-21T19:59:55.373602+0000","last_active":"2024-01-21T19:59:55.762235+0000","last_peered":"2024-01-21T19:59:55.762235+0000","last_clean":"2024-01-21T19:59:55.762235+0000","last_became_active":"2024-01-21T19:59:55.373309+0000","last_became_peered":"2024-01-21T19:59:55.373309+0000","last_unstale":"2024-01-21T19:59:55.762235+0000","last_undegraded":"2024-01-21T19:59:55.762235+0000","last_fullsized":"2024-01-21T19:59:55.762235+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765864+0000","last_change":"2024-01-21T19:59:55.764267+0000","last_active":"2024-01-21T19:59:55.765864+0000","last_peered":"2024-01-21T19:59:55.765864+0000","last_clean":"2024-01-21T19:59:55.765864+0000","last_became_active":"2024-01-21T19:59:55.763788+0000","last_became_peered":"2024-01-21T19:59:55.763788+0000","last_unstale":"2024-01-21T19:59:55.765864+0000","last_undegraded":"2024-01-21T19:59:55.765864+0000","last_fullsized":"2024-01-21T19:59:55.765864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752923+0000","last_change":"2024-01-21T19:59:55.372084+0000","last_active":"2024-01-21T19:59:55.752923+0000","last_peered":"2024-01-21T19:59:55.752923+0000","last_clean":"2024-01-21T19:59:55.752923+0000","last_became_active":"2024-01-21T19:59:55.371805+0000","last_became_peered":"2024-01-21T19:59:55.371805+0000","last_unstale":"2024-01-21T19:59:55.752923+0000","last_undegraded":"2024-01-21T19:59:55.752923+0000","last_fullsized":"2024-01-21T19:59:55.752923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757145+0000","last_change":"2024-01-21T19:59:55.754404+0000","last_active":"2024-01-21T19:59:55.757145+0000","last_peered":"2024-01-21T19:59:55.757145+0000","last_clean":"2024-01-21T19:59:55.757145+0000","last_became_active":"2024-01-21T19:59:55.754179+0000","last_became_peered":"2024-01-21T19:59:55.754179+0000","last_unstale":"2024-01-21T19:59:55.757145+0000","last_undegraded":"2024-01-21T19:59:55.757145+0000","last_fullsized":"2024-01-21T19:59:55.757145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747289+0000","last_change":"2024-01-21T19:59:55.372690+0000","last_active":"2024-01-21T19:59:55.747289+0000","last_peered":"2024-01-21T19:59:55.747289+0000","last_clean":"2024-01-21T19:59:55.747289+0000","last_became_active":"2024-01-21T19:59:55.372142+0000","last_became_peered":"2024-01-21T19:59:55.372142+0000","last_unstale":"2024-01-21T19:59:55.747289+0000","last_undegraded":"2024-01-21T19:59:55.747289+0000","last_fullsized":"2024-01-21T19:59:55.747289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765740+0000","last_change":"2024-01-21T19:59:55.762703+0000","last_active":"2024-01-21T19:59:55.765740+0000","last_peered":"2024-01-21T19:59:55.765740+0000","last_clean":"2024-01-21T19:59:55.765740+0000","last_became_active":"2024-01-21T19:59:55.762465+0000","last_became_peered":"2024-01-21T19:59:55.762465+0000","last_unstale":"2024-01-21T19:59:55.765740+0000","last_undegraded":"2024-01-21T19:59:55.765740+0000","last_fullsized":"2024-01-21T19:59:55.765740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762646+0000","last_change":"2024-01-21T19:59:55.368961+0000","last_active":"2024-01-21T19:59:55.762646+0000","last_peered":"2024-01-21T19:59:55.762646+0000","last_clean":"2024-01-21T19:59:55.762646+0000","last_became_active":"2024-01-21T19:59:55.368718+0000","last_became_peered":"2024-01-21T19:59:55.368718+0000","last_unstale":"2024-01-21T19:59:55.762646+0000","last_undegraded":"2024-01-21T19:59:55.762646+0000","last_fullsized":"2024-01-21T19:59:55.762646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762311+0000","last_change":"2024-01-21T19:59:55.760704+0000","last_active":"2024-01-21T19:59:55.762311+0000","last_peered":"2024-01-21T19:59:55.762311+0000","last_clean":"2024-01-21T19:59:55.762311+0000","last_became_active":"2024-01-21T19:59:55.760394+0000","last_became_peered":"2024-01-21T19:59:55.760394+0000","last_unstale":"2024-01-21T19:59:55.762311+0000","last_undegraded":"2024-01-21T19:59:55.762311+0000","last_fullsized":"2024-01-21T19:59:55.762311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742399+0000","last_change":"2024-01-21T19:59:55.361374+0000","last_active":"2024-01-21T19:59:55.742399+0000","last_peered":"2024-01-21T19:59:55.742399+0000","last_clean":"2024-01-21T19:59:55.742399+0000","last_became_active":"2024-01-21T19:59:55.361049+0000","last_became_peered":"2024-01-21T19:59:55.361049+0000","last_unstale":"2024-01-21T19:59:55.742399+0000","last_undegraded":"2024-01-21T19:59:55.742399+0000","last_fullsized":"2024-01-21T19:59:55.742399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758149+0000","last_change":"2024-01-21T19:59:55.755648+0000","last_active":"2024-01-21T19:59:55.758149+0000","last_peered":"2024-01-21T19:59:55.758149+0000","last_clean":"2024-01-21T19:59:55.758149+0000","last_became_active":"2024-01-21T19:59:55.755428+0000","last_became_peered":"2024-01-21T19:59:55.755428+0000","last_unstale":"2024-01-21T19:59:55.758149+0000","last_undegraded":"2024-01-21T19:59:55.758149+0000","last_fullsized":"2024-01-21T19:59:55.758149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749886+0000","last_change":"2024-01-21T19:59:55.376582+0000","last_active":"2024-01-21T19:59:55.749886+0000","last_peered":"2024-01-21T19:59:55.749886+0000","last_clean":"2024-01-21T19:59:55.749886+0000","last_became_active":"2024-01-21T19:59:55.376311+0000","last_became_peered":"2024-01-21T19:59:55.376311+0000","last_unstale":"2024-01-21T19:59:55.749886+0000","last_undegraded":"2024-01-21T19:59:55.749886+0000","last_fullsized":"2024-01-21T19:59:55.749886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759914+0000","last_change":"2024-01-21T19:59:55.757306+0000","last_active":"2024-01-21T19:59:55.759914+0000","last_peered":"2024-01-21T19:59:55.759914+0000","last_clean":"2024-01-21T19:59:55.759914+0000","last_became_active":"2024-01-21T19:59:55.757029+0000","last_became_peered":"2024-01-21T19:59:55.757029+0000","last_unstale":"2024-01-21T19:59:55.759914+0000","last_undegraded":"2024-01-21T19:59:55.759914+0000","last_fullsized":"2024-01-21T19:59:55.759914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744900+0000","last_change":"2024-01-21T19:59:55.363516+0000","last_active":"2024-01-21T19:59:55.744900+0000","last_peered":"2024-01-21T19:59:55.744900+0000","last_clean":"2024-01-21T19:59:55.744900+0000","last_became_active":"2024-01-21T19:59:55.363245+0000","last_became_peered":"2024-01-21T19:59:55.363245+0000","last_unstale":"2024-01-21T19:59:55.744900+0000","last_undegraded":"2024-01-21T19:59:55.744900+0000","last_fullsized":"2024-01-21T19:59:55.744900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758325+0000","last_change":"2024-01-21T19:59:55.753507+0000","last_active":"2024-01-21T19:59:55.758325+0000","last_peered":"2024-01-21T19:59:55.758325+0000","last_clean":"2024-01-21T19:59:55.758325+0000","last_became_active":"2024-01-21T19:59:55.753320+0000","last_became_peered":"2024-01-21T19:59:55.753320+0000","last_unstale":"2024-01-21T19:59:55.758325+0000","last_undegraded":"2024-01-21T19:59:55.758325+0000","last_fullsized":"2024-01-21T19:59:55.758325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737117+0000","last_change":"2024-01-21T19:59:55.373554+0000","last_active":"2024-01-21T19:59:55.737117+0000","last_peered":"2024-01-21T19:59:55.737117+0000","last_clean":"2024-01-21T19:59:55.737117+0000","last_became_active":"2024-01-21T19:59:55.373275+0000","last_became_peered":"2024-01-21T19:59:55.373275+0000","last_unstale":"2024-01-21T19:59:55.737117+0000","last_undegraded":"2024-01-21T19:59:55.737117+0000","last_fullsized":"2024-01-21T19:59:55.737117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756337+0000","last_change":"2024-01-21T19:59:55.745944+0000","last_active":"2024-01-21T19:59:55.756337+0000","last_peered":"2024-01-21T19:59:55.756337+0000","last_clean":"2024-01-21T19:59:55.756337+0000","last_became_active":"2024-01-21T19:59:55.745626+0000","last_became_peered":"2024-01-21T19:59:55.745626+0000","last_unstale":"2024-01-21T19:59:55.756337+0000","last_undegraded":"2024-01-21T19:59:55.756337+0000","last_fullsized":"2024-01-21T19:59:55.756337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739184+0000","last_change":"2024-01-21T19:59:55.362467+0000","last_active":"2024-01-21T19:59:55.739184+0000","last_peered":"2024-01-21T19:59:55.739184+0000","last_clean":"2024-01-21T19:59:55.739184+0000","last_became_active":"2024-01-21T19:59:55.362183+0000","last_became_peered":"2024-01-21T19:59:55.362183+0000","last_unstale":"2024-01-21T19:59:55.739184+0000","last_undegraded":"2024-01-21T19:59:55.739184+0000","last_fullsized":"2024-01-21T19:59:55.739184+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760246+0000","last_change":"2024-01-21T19:59:55.754755+0000","last_active":"2024-01-21T19:59:55.760246+0000","last_peered":"2024-01-21T19:59:55.760246+0000","last_clean":"2024-01-21T19:59:55.760246+0000","last_became_active":"2024-01-21T19:59:55.753918+0000","last_became_peered":"2024-01-21T19:59:55.753918+0000","last_unstale":"2024-01-21T19:59:55.760246+0000","last_undegraded":"2024-01-21T19:59:55.760246+0000","last_fullsized":"2024-01-21T19:59:55.760246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737490+0000","last_change":"2024-01-21T19:59:55.371080+0000","last_active":"2024-01-21T19:59:55.737490+0000","last_peered":"2024-01-21T19:59:55.737490+0000","last_clean":"2024-01-21T19:59:55.737490+0000","last_became_active":"2024-01-21T19:59:55.370769+0000","last_became_peered":"2024-01-21T19:59:55.370769+0000","last_unstale":"2024-01-21T19:59:55.737490+0000","last_undegraded":"2024-01-21T19:59:55.737490+0000","last_fullsized":"2024-01-21T19:59:55.737490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765854+0000","last_change":"2024-01-21T19:59:55.763188+0000","last_active":"2024-01-21T19:59:55.765854+0000","last_peered":"2024-01-21T19:59:55.765854+0000","last_clean":"2024-01-21T19:59:55.765854+0000","last_became_active":"2024-01-21T19:59:55.762873+0000","last_became_peered":"2024-01-21T19:59:55.762873+0000","last_unstale":"2024-01-21T19:59:55.765854+0000","last_undegraded":"2024-01-21T19:59:55.765854+0000","last_fullsized":"2024-01-21T19:59:55.765854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.26","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-01-21T19:59:56.740119+0000","last_change":"2024-01-21T19:59:55.368201+0000","last_active":"2024-01-21T19:59:56.740119+0000","last_peered":"2024-01-21T19:59:56.740119+0000","last_clean":"2024-01-21T19:59:56.740119+0000","last_became_active":"2024-01-21T19:59:55.367974+0000","last_became_peered":"2024-01-21T19:59:55.367974+0000","last_unstale":"2024-01-21T19:59:56.740119+0000","last_undegraded":"2024-01-21T19:59:56.740119+0000","last_fullsized":"2024-01-21T19:59:56.740119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.748003+0000","last_change":"2024-01-21T19:59:55.745552+0000","last_active":"2024-01-21T19:59:55.748003+0000","last_peered":"2024-01-21T19:59:55.748003+0000","last_clean":"2024-01-21T19:59:55.748003+0000","last_became_active":"2024-01-21T19:59:55.745322+0000","last_became_peered":"2024-01-21T19:59:55.745322+0000","last_unstale":"2024-01-21T19:59:55.748003+0000","last_undegraded":"2024-01-21T19:59:55.748003+0000","last_fullsized":"2024-01-21T19:59:55.748003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737913+0000","last_change":"2024-01-21T19:59:55.369534+0000","last_active":"2024-01-21T19:59:55.737913+0000","last_peered":"2024-01-21T19:59:55.737913+0000","last_clean":"2024-01-21T19:59:55.737913+0000","last_became_active":"2024-01-21T19:59:55.369094+0000","last_became_peered":"2024-01-21T19:59:55.369094+0000","last_unstale":"2024-01-21T19:59:55.737913+0000","last_undegraded":"2024-01-21T19:59:55.737913+0000","last_fullsized":"2024-01-21T19:59:55.737913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765744+0000","last_change":"2024-01-21T19:59:55.763418+0000","last_active":"2024-01-21T19:59:55.765744+0000","last_peered":"2024-01-21T19:59:55.765744+0000","last_clean":"2024-01-21T19:59:55.765744+0000","last_became_active":"2024-01-21T19:59:55.763154+0000","last_became_peered":"2024-01-21T19:59:55.763154+0000","last_unstale":"2024-01-21T19:59:55.765744+0000","last_undegraded":"2024-01-21T19:59:55.765744+0000","last_fullsized":"2024-01-21T19:59:55.765744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739598+0000","last_change":"2024-01-21T19:59:55.374246+0000","last_active":"2024-01-21T19:59:55.739598+0000","last_peered":"2024-01-21T19:59:55.739598+0000","last_clean":"2024-01-21T19:59:55.739598+0000","last_became_active":"2024-01-21T19:59:55.373927+0000","last_became_peered":"2024-01-21T19:59:55.373927+0000","last_unstale":"2024-01-21T19:59:55.739598+0000","last_undegraded":"2024-01-21T19:59:55.739598+0000","last_fullsized":"2024-01-21T19:59:55.739598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747920+0000","last_change":"2024-01-21T19:59:55.743479+0000","last_active":"2024-01-21T19:59:55.747920+0000","last_peered":"2024-01-21T19:59:55.747920+0000","last_clean":"2024-01-21T19:59:55.747920+0000","last_became_active":"2024-01-21T19:59:55.743220+0000","last_became_peered":"2024-01-21T19:59:55.743220+0000","last_unstale":"2024-01-21T19:59:55.747920+0000","last_undegraded":"2024-01-21T19:59:55.747920+0000","last_fullsized":"2024-01-21T19:59:55.747920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744889+0000","last_change":"2024-01-21T19:59:55.360545+0000","last_active":"2024-01-21T19:59:55.744889+0000","last_peered":"2024-01-21T19:59:55.744889+0000","last_clean":"2024-01-21T19:59:55.744889+0000","last_became_active":"2024-01-21T19:59:55.360258+0000","last_became_peered":"2024-01-21T19:59:55.360258+0000","last_unstale":"2024-01-21T19:59:55.744889+0000","last_undegraded":"2024-01-21T19:59:55.744889+0000","last_fullsized":"2024-01-21T19:59:55.744889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759934+0000","last_change":"2024-01-21T19:59:55.757670+0000","last_active":"2024-01-21T19:59:55.759934+0000","last_peered":"2024-01-21T19:59:55.759934+0000","last_clean":"2024-01-21T19:59:55.759934+0000","last_became_active":"2024-01-21T19:59:55.757376+0000","last_became_peered":"2024-01-21T19:59:55.757376+0000","last_unstale":"2024-01-21T19:59:55.759934+0000","last_undegraded":"2024-01-21T19:59:55.759934+0000","last_fullsized":"2024-01-21T19:59:55.759934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750029+0000","last_change":"2024-01-21T19:59:55.373333+0000","last_active":"2024-01-21T19:59:55.750029+0000","last_peered":"2024-01-21T19:59:55.750029+0000","last_clean":"2024-01-21T19:59:55.750029+0000","last_became_active":"2024-01-21T19:59:55.373061+0000","last_became_peered":"2024-01-21T19:59:55.373061+0000","last_unstale":"2024-01-21T19:59:55.750029+0000","last_undegraded":"2024-01-21T19:59:55.750029+0000","last_fullsized":"2024-01-21T19:59:55.750029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765826+0000","last_change":"2024-01-21T19:59:55.763801+0000","last_active":"2024-01-21T19:59:55.765826+0000","last_peered":"2024-01-21T19:59:55.765826+0000","last_clean":"2024-01-21T19:59:55.765826+0000","last_became_active":"2024-01-21T19:59:55.752147+0000","last_became_peered":"2024-01-21T19:59:55.752147+0000","last_unstale":"2024-01-21T19:59:55.765826+0000","last_undegraded":"2024-01-21T19:59:55.765826+0000","last_fullsized":"2024-01-21T19:59:55.765826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743172+0000","last_change":"2024-01-21T19:59:55.369796+0000","last_active":"2024-01-21T19:59:55.743172+0000","last_peered":"2024-01-21T19:59:55.743172+0000","last_clean":"2024-01-21T19:59:55.743172+0000","last_became_active":"2024-01-21T19:59:55.369528+0000","last_became_peered":"2024-01-21T19:59:55.369528+0000","last_unstale":"2024-01-21T19:59:55.743172+0000","last_undegraded":"2024-01-21T19:59:55.743172+0000","last_fullsized":"2024-01-21T19:59:55.743172+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765009+0000","last_change":"2024-01-21T19:59:55.761721+0000","last_active":"2024-01-21T19:59:55.765009+0000","last_peered":"2024-01-21T19:59:55.765009+0000","last_clean":"2024-01-21T19:59:55.765009+0000","last_became_active":"2024-01-21T19:59:55.761450+0000","last_became_peered":"2024-01-21T19:59:55.761450+0000","last_unstale":"2024-01-21T19:59:55.765009+0000","last_undegraded":"2024-01-21T19:59:55.765009+0000","last_fullsized":"2024-01-21T19:59:55.765009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749967+0000","last_change":"2024-01-21T19:59:55.369599+0000","last_active":"2024-01-21T19:59:55.749967+0000","last_peered":"2024-01-21T19:59:55.749967+0000","last_clean":"2024-01-21T19:59:55.749967+0000","last_became_active":"2024-01-21T19:59:55.369315+0000","last_became_peered":"2024-01-21T19:59:55.369315+0000","last_unstale":"2024-01-21T19:59:55.749967+0000","last_undegraded":"2024-01-21T19:59:55.749967+0000","last_fullsized":"2024-01-21T19:59:55.749967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762287+0000","last_change":"2024-01-21T19:59:55.761095+0000","last_active":"2024-01-21T19:59:55.762287+0000","last_peered":"2024-01-21T19:59:55.762287+0000","last_clean":"2024-01-21T19:59:55.762287+0000","last_became_active":"2024-01-21T19:59:55.760821+0000","last_became_peered":"2024-01-21T19:59:55.760821+0000","last_unstale":"2024-01-21T19:59:55.762287+0000","last_undegraded":"2024-01-21T19:59:55.762287+0000","last_fullsized":"2024-01-21T19:59:55.762287+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765844+0000","last_change":"2024-01-21T19:59:55.367367+0000","last_active":"2024-01-21T19:59:55.765844+0000","last_peered":"2024-01-21T19:59:55.765844+0000","last_clean":"2024-01-21T19:59:55.765844+0000","last_became_active":"2024-01-21T19:59:55.367089+0000","last_became_peered":"2024-01-21T19:59:55.367089+0000","last_unstale":"2024-01-21T19:59:55.765844+0000","last_undegraded":"2024-01-21T19:59:55.765844+0000","last_fullsized":"2024-01-21T19:59:55.765844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752012+0000","last_change":"2024-01-21T19:59:55.746376+0000","last_active":"2024-01-21T19:59:55.752012+0000","last_peered":"2024-01-21T19:59:55.752012+0000","last_clean":"2024-01-21T19:59:55.752012+0000","last_became_active":"2024-01-21T19:59:55.746121+0000","last_became_peered":"2024-01-21T19:59:55.746121+0000","last_unstale":"2024-01-21T19:59:55.752012+0000","last_undegraded":"2024-01-21T19:59:55.752012+0000","last_fullsized":"2024-01-21T19:59:55.752012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756529+0000","last_change":"2024-01-21T19:59:55.374085+0000","last_active":"2024-01-21T19:59:55.756529+0000","last_peered":"2024-01-21T19:59:55.756529+0000","last_clean":"2024-01-21T19:59:55.756529+0000","last_became_active":"2024-01-21T19:59:55.373807+0000","last_became_peered":"2024-01-21T19:59:55.373807+0000","last_unstale":"2024-01-21T19:59:55.756529+0000","last_undegraded":"2024-01-21T19:59:55.756529+0000","last_fullsized":"2024-01-21T19:59:55.756529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758099+0000","last_change":"2024-01-21T19:59:55.753352+0000","last_active":"2024-01-21T19:59:55.758099+0000","last_peered":"2024-01-21T19:59:55.758099+0000","last_clean":"2024-01-21T19:59:55.758099+0000","last_became_active":"2024-01-21T19:59:55.753148+0000","last_became_peered":"2024-01-21T19:59:55.753148+0000","last_unstale":"2024-01-21T19:59:55.758099+0000","last_undegraded":"2024-01-21T19:59:55.758099+0000","last_fullsized":"2024-01-21T19:59:55.758099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758601+0000","last_change":"2024-01-21T19:59:55.369691+0000","last_active":"2024-01-21T19:59:55.758601+0000","last_peered":"2024-01-21T19:59:55.758601+0000","last_clean":"2024-01-21T19:59:55.758601+0000","last_became_active":"2024-01-21T19:59:55.369379+0000","last_became_peered":"2024-01-21T19:59:55.369379+0000","last_unstale":"2024-01-21T19:59:55.758601+0000","last_undegraded":"2024-01-21T19:59:55.758601+0000","last_fullsized":"2024-01-21T19:59:55.758601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765968+0000","last_change":"2024-01-21T19:59:55.765487+0000","last_active":"2024-01-21T19:59:55.765968+0000","last_peered":"2024-01-21T19:59:55.765968+0000","last_clean":"2024-01-21T19:59:55.765968+0000","last_became_active":"2024-01-21T19:59:55.765256+0000","last_became_peered":"2024-01-21T19:59:55.765256+0000","last_unstale":"2024-01-21T19:59:55.765968+0000","last_undegraded":"2024-01-21T19:59:55.765968+0000","last_fullsized":"2024-01-21T19:59:55.765968+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.745223+0000","last_change":"2024-01-21T19:59:55.363491+0000","last_active":"2024-01-21T19:59:55.745223+0000","last_peered":"2024-01-21T19:59:55.745223+0000","last_clean":"2024-01-21T19:59:55.745223+0000","last_became_active":"2024-01-21T19:59:55.362369+0000","last_became_peered":"2024-01-21T19:59:55.362369+0000","last_unstale":"2024-01-21T19:59:55.745223+0000","last_undegraded":"2024-01-21T19:59:55.745223+0000","last_fullsized":"2024-01-21T19:59:55.745223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.747563+0000","last_change":"2024-01-21T19:59:55.742344+0000","last_active":"2024-01-21T19:59:55.747563+0000","last_peered":"2024-01-21T19:59:55.747563+0000","last_clean":"2024-01-21T19:59:55.747563+0000","last_became_active":"2024-01-21T19:59:55.742043+0000","last_became_peered":"2024-01-21T19:59:55.742043+0000","last_unstale":"2024-01-21T19:59:55.747563+0000","last_undegraded":"2024-01-21T19:59:55.747563+0000","last_fullsized":"2024-01-21T19:59:55.747563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739358+0000","last_change":"2024-01-21T19:59:55.376588+0000","last_active":"2024-01-21T19:59:55.739358+0000","last_peered":"2024-01-21T19:59:55.739358+0000","last_clean":"2024-01-21T19:59:55.739358+0000","last_became_active":"2024-01-21T19:59:55.376290+0000","last_became_peered":"2024-01-21T19:59:55.376290+0000","last_unstale":"2024-01-21T19:59:55.739358+0000","last_undegraded":"2024-01-21T19:59:55.739358+0000","last_fullsized":"2024-01-21T19:59:55.739358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756514+0000","last_change":"2024-01-21T19:59:55.744690+0000","last_active":"2024-01-21T19:59:55.756514+0000","last_peered":"2024-01-21T19:59:55.756514+0000","last_clean":"2024-01-21T19:59:55.756514+0000","last_became_active":"2024-01-21T19:59:55.744360+0000","last_became_peered":"2024-01-21T19:59:55.744360+0000","last_unstale":"2024-01-21T19:59:55.756514+0000","last_undegraded":"2024-01-21T19:59:55.756514+0000","last_fullsized":"2024-01-21T19:59:55.756514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749927+0000","last_change":"2024-01-21T19:59:55.368324+0000","last_active":"2024-01-21T19:59:55.749927+0000","last_peered":"2024-01-21T19:59:55.749927+0000","last_clean":"2024-01-21T19:59:55.749927+0000","last_became_active":"2024-01-21T19:59:55.368043+0000","last_became_peered":"2024-01-21T19:59:55.368043+0000","last_unstale":"2024-01-21T19:59:55.749927+0000","last_undegraded":"2024-01-21T19:59:55.749927+0000","last_fullsized":"2024-01-21T19:59:55.749927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758476+0000","last_change":"2024-01-21T19:59:55.756503+0000","last_active":"2024-01-21T19:59:55.758476+0000","last_peered":"2024-01-21T19:59:55.758476+0000","last_clean":"2024-01-21T19:59:55.758476+0000","last_became_active":"2024-01-21T19:59:55.756301+0000","last_became_peered":"2024-01-21T19:59:55.756301+0000","last_unstale":"2024-01-21T19:59:55.758476+0000","last_undegraded":"2024-01-21T19:59:55.758476+0000","last_fullsized":"2024-01-21T19:59:55.758476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736529+0000","last_change":"2024-01-21T19:59:55.371121+0000","last_active":"2024-01-21T19:59:55.736529+0000","last_peered":"2024-01-21T19:59:55.736529+0000","last_clean":"2024-01-21T19:59:55.736529+0000","last_became_active":"2024-01-21T19:59:55.370830+0000","last_became_peered":"2024-01-21T19:59:55.370830+0000","last_unstale":"2024-01-21T19:59:55.736529+0000","last_undegraded":"2024-01-21T19:59:55.736529+0000","last_fullsized":"2024-01-21T19:59:55.736529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762040+0000","last_change":"2024-01-21T19:59:55.759229+0000","last_active":"2024-01-21T19:59:55.762040+0000","last_peered":"2024-01-21T19:59:55.762040+0000","last_clean":"2024-01-21T19:59:55.762040+0000","last_became_active":"2024-01-21T19:59:55.758981+0000","last_became_peered":"2024-01-21T19:59:55.758981+0000","last_unstale":"2024-01-21T19:59:55.762040+0000","last_undegraded":"2024-01-21T19:59:55.762040+0000","last_fullsized":"2024-01-21T19:59:55.762040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744291+0000","last_change":"2024-01-21T19:59:55.366304+0000","last_active":"2024-01-21T19:59:55.744291+0000","last_peered":"2024-01-21T19:59:55.744291+0000","last_clean":"2024-01-21T19:59:55.744291+0000","last_became_active":"2024-01-21T19:59:55.366000+0000","last_became_peered":"2024-01-21T19:59:55.366000+0000","last_unstale":"2024-01-21T19:59:55.744291+0000","last_undegraded":"2024-01-21T19:59:55.744291+0000","last_fullsized":"2024-01-21T19:59:55.744291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751619+0000","last_change":"2024-01-21T19:59:55.746796+0000","last_active":"2024-01-21T19:59:55.751619+0000","last_peered":"2024-01-21T19:59:55.751619+0000","last_clean":"2024-01-21T19:59:55.751619+0000","last_became_active":"2024-01-21T19:59:55.745966+0000","last_became_peered":"2024-01-21T19:59:55.745966+0000","last_unstale":"2024-01-21T19:59:55.751619+0000","last_undegraded":"2024-01-21T19:59:55.751619+0000","last_fullsized":"2024-01-21T19:59:55.751619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751210+0000","last_change":"2024-01-21T19:59:55.367535+0000","last_active":"2024-01-21T19:59:55.751210+0000","last_peered":"2024-01-21T19:59:55.751210+0000","last_clean":"2024-01-21T19:59:55.751210+0000","last_became_active":"2024-01-21T19:59:55.367215+0000","last_became_peered":"2024-01-21T19:59:55.367215+0000","last_unstale":"2024-01-21T19:59:55.751210+0000","last_undegraded":"2024-01-21T19:59:55.751210+0000","last_fullsized":"2024-01-21T19:59:55.751210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765847+0000","last_change":"2024-01-21T19:59:55.764078+0000","last_active":"2024-01-21T19:59:55.765847+0000","last_peered":"2024-01-21T19:59:55.765847+0000","last_clean":"2024-01-21T19:59:55.765847+0000","last_became_active":"2024-01-21T19:59:55.763783+0000","last_became_peered":"2024-01-21T19:59:55.763783+0000","last_unstale":"2024-01-21T19:59:55.765847+0000","last_undegraded":"2024-01-21T19:59:55.765847+0000","last_fullsized":"2024-01-21T19:59:55.765847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739793+0000","last_change":"2024-01-21T19:59:55.359496+0000","last_active":"2024-01-21T19:59:55.739793+0000","last_peered":"2024-01-21T19:59:55.739793+0000","last_clean":"2024-01-21T19:59:55.739793+0000","last_became_active":"2024-01-21T19:59:55.358974+0000","last_became_peered":"2024-01-21T19:59:55.358974+0000","last_unstale":"2024-01-21T19:59:55.739793+0000","last_undegraded":"2024-01-21T19:59:55.739793+0000","last_fullsized":"2024-01-21T19:59:55.739793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757502+0000","last_change":"2024-01-21T19:59:55.756374+0000","last_active":"2024-01-21T19:59:55.757502+0000","last_peered":"2024-01-21T19:59:55.757502+0000","last_clean":"2024-01-21T19:59:55.757502+0000","last_became_active":"2024-01-21T19:59:55.756087+0000","last_became_peered":"2024-01-21T19:59:55.756087+0000","last_unstale":"2024-01-21T19:59:55.757502+0000","last_undegraded":"2024-01-21T19:59:55.757502+0000","last_fullsized":"2024-01-21T19:59:55.757502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756240+0000","last_change":"2024-01-21T19:59:55.371317+0000","last_active":"2024-01-21T19:59:55.756240+0000","last_peered":"2024-01-21T19:59:55.756240+0000","last_clean":"2024-01-21T19:59:55.756240+0000","last_became_active":"2024-01-21T19:59:55.370970+0000","last_became_peered":"2024-01-21T19:59:55.370970+0000","last_unstale":"2024-01-21T19:59:55.756240+0000","last_undegraded":"2024-01-21T19:59:55.756240+0000","last_fullsized":"2024-01-21T19:59:55.756240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.757430+0000","last_change":"2024-01-21T19:59:55.752203+0000","last_active":"2024-01-21T19:59:55.757430+0000","last_peered":"2024-01-21T19:59:55.757430+0000","last_clean":"2024-01-21T19:59:55.757430+0000","last_became_active":"2024-01-21T19:59:55.751919+0000","last_became_peered":"2024-01-21T19:59:55.751919+0000","last_unstale":"2024-01-21T19:59:55.757430+0000","last_undegraded":"2024-01-21T19:59:55.757430+0000","last_fullsized":"2024-01-21T19:59:55.757430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761951+0000","last_change":"2024-01-21T19:59:55.367108+0000","last_active":"2024-01-21T19:59:55.761951+0000","last_peered":"2024-01-21T19:59:55.761951+0000","last_clean":"2024-01-21T19:59:55.761951+0000","last_became_active":"2024-01-21T19:59:55.366835+0000","last_became_peered":"2024-01-21T19:59:55.366835+0000","last_unstale":"2024-01-21T19:59:55.761951+0000","last_undegraded":"2024-01-21T19:59:55.761951+0000","last_fullsized":"2024-01-21T19:59:55.761951+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.749453+0000","last_change":"2024-01-21T19:59:55.745815+0000","last_active":"2024-01-21T19:59:55.749453+0000","last_peered":"2024-01-21T19:59:55.749453+0000","last_clean":"2024-01-21T19:59:55.749453+0000","last_became_active":"2024-01-21T19:59:55.745555+0000","last_became_peered":"2024-01-21T19:59:55.745555+0000","last_unstale":"2024-01-21T19:59:55.749453+0000","last_undegraded":"2024-01-21T19:59:55.749453+0000","last_fullsized":"2024-01-21T19:59:55.749453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762127+0000","last_change":"2024-01-21T19:59:55.377728+0000","last_active":"2024-01-21T19:59:55.762127+0000","last_peered":"2024-01-21T19:59:55.762127+0000","last_clean":"2024-01-21T19:59:55.762127+0000","last_became_active":"2024-01-21T19:59:55.377454+0000","last_became_peered":"2024-01-21T19:59:55.377454+0000","last_unstale":"2024-01-21T19:59:55.762127+0000","last_undegraded":"2024-01-21T19:59:55.762127+0000","last_fullsized":"2024-01-21T19:59:55.762127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.755013+0000","last_change":"2024-01-21T19:59:55.750763+0000","last_active":"2024-01-21T19:59:55.755013+0000","last_peered":"2024-01-21T19:59:55.755013+0000","last_clean":"2024-01-21T19:59:55.755013+0000","last_became_active":"2024-01-21T19:59:55.750488+0000","last_became_peered":"2024-01-21T19:59:55.750488+0000","last_unstale":"2024-01-21T19:59:55.755013+0000","last_undegraded":"2024-01-21T19:59:55.755013+0000","last_fullsized":"2024-01-21T19:59:55.755013+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737126+0000","last_change":"2024-01-21T19:59:55.371088+0000","last_active":"2024-01-21T19:59:55.737126+0000","last_peered":"2024-01-21T19:59:55.737126+0000","last_clean":"2024-01-21T19:59:55.737126+0000","last_became_active":"2024-01-21T19:59:55.370781+0000","last_became_peered":"2024-01-21T19:59:55.370781+0000","last_unstale":"2024-01-21T19:59:55.737126+0000","last_undegraded":"2024-01-21T19:59:55.737126+0000","last_fullsized":"2024-01-21T19:59:55.737126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759959+0000","last_change":"2024-01-21T19:59:55.757730+0000","last_active":"2024-01-21T19:59:55.759959+0000","last_peered":"2024-01-21T19:59:55.759959+0000","last_clean":"2024-01-21T19:59:55.759959+0000","last_became_active":"2024-01-21T19:59:55.757509+0000","last_became_peered":"2024-01-21T19:59:55.757509+0000","last_unstale":"2024-01-21T19:59:55.759959+0000","last_undegraded":"2024-01-21T19:59:55.759959+0000","last_fullsized":"2024-01-21T19:59:55.759959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743054+0000","last_change":"2024-01-21T19:59:55.371155+0000","last_active":"2024-01-21T19:59:55.743054+0000","last_peered":"2024-01-21T19:59:55.743054+0000","last_clean":"2024-01-21T19:59:55.743054+0000","last_became_active":"2024-01-21T19:59:55.370862+0000","last_became_peered":"2024-01-21T19:59:55.370862+0000","last_unstale":"2024-01-21T19:59:55.743054+0000","last_undegraded":"2024-01-21T19:59:55.743054+0000","last_fullsized":"2024-01-21T19:59:55.743054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758963+0000","last_change":"2024-01-21T19:59:55.750802+0000","last_active":"2024-01-21T19:59:55.758963+0000","last_peered":"2024-01-21T19:59:55.758963+0000","last_clean":"2024-01-21T19:59:55.758963+0000","last_became_active":"2024-01-21T19:59:55.750543+0000","last_became_peered":"2024-01-21T19:59:55.750543+0000","last_unstale":"2024-01-21T19:59:55.758963+0000","last_undegraded":"2024-01-21T19:59:55.758963+0000","last_fullsized":"2024-01-21T19:59:55.758963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759803+0000","last_change":"2024-01-21T19:59:55.368659+0000","last_active":"2024-01-21T19:59:55.759803+0000","last_peered":"2024-01-21T19:59:55.759803+0000","last_clean":"2024-01-21T19:59:55.759803+0000","last_became_active":"2024-01-21T19:59:55.368310+0000","last_became_peered":"2024-01-21T19:59:55.368310+0000","last_unstale":"2024-01-21T19:59:55.759803+0000","last_undegraded":"2024-01-21T19:59:55.759803+0000","last_fullsized":"2024-01-21T19:59:55.759803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.762156+0000","last_change":"2024-01-21T19:59:55.759725+0000","last_active":"2024-01-21T19:59:55.762156+0000","last_peered":"2024-01-21T19:59:55.762156+0000","last_clean":"2024-01-21T19:59:55.762156+0000","last_became_active":"2024-01-21T19:59:55.755263+0000","last_became_peered":"2024-01-21T19:59:55.755263+0000","last_unstale":"2024-01-21T19:59:55.762156+0000","last_undegraded":"2024-01-21T19:59:55.762156+0000","last_fullsized":"2024-01-21T19:59:55.762156+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759621+0000","last_change":"2024-01-21T19:59:55.362989+0000","last_active":"2024-01-21T19:59:55.759621+0000","last_peered":"2024-01-21T19:59:55.759621+0000","last_clean":"2024-01-21T19:59:55.759621+0000","last_became_active":"2024-01-21T19:59:55.362727+0000","last_became_peered":"2024-01-21T19:59:55.362727+0000","last_unstale":"2024-01-21T19:59:55.759621+0000","last_undegraded":"2024-01-21T19:59:55.759621+0000","last_fullsized":"2024-01-21T19:59:55.759621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759760+0000","last_change":"2024-01-21T19:59:55.755291+0000","last_active":"2024-01-21T19:59:55.759760+0000","last_peered":"2024-01-21T19:59:55.759760+0000","last_clean":"2024-01-21T19:59:55.759760+0000","last_became_active":"2024-01-21T19:59:55.754955+0000","last_became_peered":"2024-01-21T19:59:55.754955+0000","last_unstale":"2024-01-21T19:59:55.759760+0000","last_undegraded":"2024-01-21T19:59:55.759760+0000","last_fullsized":"2024-01-21T19:59:55.759760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758706+0000","last_change":"2024-01-21T19:59:55.362928+0000","last_active":"2024-01-21T19:59:55.758706+0000","last_peered":"2024-01-21T19:59:55.758706+0000","last_clean":"2024-01-21T19:59:55.758706+0000","last_became_active":"2024-01-21T19:59:55.362463+0000","last_became_peered":"2024-01-21T19:59:55.362463+0000","last_unstale":"2024-01-21T19:59:55.758706+0000","last_undegraded":"2024-01-21T19:59:55.758706+0000","last_fullsized":"2024-01-21T19:59:55.758706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756605+0000","last_change":"2024-01-21T19:59:55.748989+0000","last_active":"2024-01-21T19:59:55.756605+0000","last_peered":"2024-01-21T19:59:55.756605+0000","last_clean":"2024-01-21T19:59:55.756605+0000","last_became_active":"2024-01-21T19:59:55.748730+0000","last_became_peered":"2024-01-21T19:59:55.748730+0000","last_unstale":"2024-01-21T19:59:55.756605+0000","last_undegraded":"2024-01-21T19:59:55.756605+0000","last_fullsized":"2024-01-21T19:59:55.756605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742444+0000","last_change":"2024-01-21T19:59:55.372152+0000","last_active":"2024-01-21T19:59:55.742444+0000","last_peered":"2024-01-21T19:59:55.742444+0000","last_clean":"2024-01-21T19:59:55.742444+0000","last_became_active":"2024-01-21T19:59:55.371855+0000","last_became_peered":"2024-01-21T19:59:55.371855+0000","last_unstale":"2024-01-21T19:59:55.742444+0000","last_undegraded":"2024-01-21T19:59:55.742444+0000","last_fullsized":"2024-01-21T19:59:55.742444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.760674+0000","last_change":"2024-01-21T19:59:55.759053+0000","last_active":"2024-01-21T19:59:55.760674+0000","last_peered":"2024-01-21T19:59:55.760674+0000","last_clean":"2024-01-21T19:59:55.760674+0000","last_became_active":"2024-01-21T19:59:55.758805+0000","last_became_peered":"2024-01-21T19:59:55.758805+0000","last_unstale":"2024-01-21T19:59:55.760674+0000","last_undegraded":"2024-01-21T19:59:55.760674+0000","last_fullsized":"2024-01-21T19:59:55.760674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737061+0000","last_change":"2024-01-21T19:59:55.370154+0000","last_active":"2024-01-21T19:59:55.737061+0000","last_peered":"2024-01-21T19:59:55.737061+0000","last_clean":"2024-01-21T19:59:55.737061+0000","last_became_active":"2024-01-21T19:59:55.369128+0000","last_became_peered":"2024-01-21T19:59:55.369128+0000","last_unstale":"2024-01-21T19:59:55.737061+0000","last_undegraded":"2024-01-21T19:59:55.737061+0000","last_fullsized":"2024-01-21T19:59:55.737061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761735+0000","last_change":"2024-01-21T19:59:55.758437+0000","last_active":"2024-01-21T19:59:55.761735+0000","last_peered":"2024-01-21T19:59:55.761735+0000","last_clean":"2024-01-21T19:59:55.761735+0000","last_became_active":"2024-01-21T19:59:55.756727+0000","last_became_peered":"2024-01-21T19:59:55.756727+0000","last_unstale":"2024-01-21T19:59:55.761735+0000","last_undegraded":"2024-01-21T19:59:55.761735+0000","last_fullsized":"2024-01-21T19:59:55.761735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.755520+0000","last_change":"2024-01-21T19:59:55.377472+0000","last_active":"2024-01-21T19:59:55.755520+0000","last_peered":"2024-01-21T19:59:55.755520+0000","last_clean":"2024-01-21T19:59:55.755520+0000","last_became_active":"2024-01-21T19:59:55.377210+0000","last_became_peered":"2024-01-21T19:59:55.377210+0000","last_unstale":"2024-01-21T19:59:55.755520+0000","last_undegraded":"2024-01-21T19:59:55.755520+0000","last_fullsized":"2024-01-21T19:59:55.755520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.754654+0000","last_change":"2024-01-21T19:59:55.753615+0000","last_active":"2024-01-21T19:59:55.754654+0000","last_peered":"2024-01-21T19:59:55.754654+0000","last_clean":"2024-01-21T19:59:55.754654+0000","last_became_active":"2024-01-21T19:59:55.752706+0000","last_became_peered":"2024-01-21T19:59:55.752706+0000","last_unstale":"2024-01-21T19:59:55.754654+0000","last_undegraded":"2024-01-21T19:59:55.754654+0000","last_fullsized":"2024-01-21T19:59:55.754654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741731+0000","last_change":"2024-01-21T19:59:55.365385+0000","last_active":"2024-01-21T19:59:55.741731+0000","last_peered":"2024-01-21T19:59:55.741731+0000","last_clean":"2024-01-21T19:59:55.741731+0000","last_became_active":"2024-01-21T19:59:55.365110+0000","last_became_peered":"2024-01-21T19:59:55.365110+0000","last_unstale":"2024-01-21T19:59:55.741731+0000","last_undegraded":"2024-01-21T19:59:55.741731+0000","last_fullsized":"2024-01-21T19:59:55.741731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.758507+0000","last_change":"2024-01-21T19:59:55.750876+0000","last_active":"2024-01-21T19:59:55.758507+0000","last_peered":"2024-01-21T19:59:55.758507+0000","last_clean":"2024-01-21T19:59:55.758507+0000","last_became_active":"2024-01-21T19:59:55.750601+0000","last_became_peered":"2024-01-21T19:59:55.750601+0000","last_unstale":"2024-01-21T19:59:55.758507+0000","last_undegraded":"2024-01-21T19:59:55.758507+0000","last_fullsized":"2024-01-21T19:59:55.758507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750238+0000","last_change":"2024-01-21T19:59:55.374198+0000","last_active":"2024-01-21T19:59:55.750238+0000","last_peered":"2024-01-21T19:59:55.750238+0000","last_clean":"2024-01-21T19:59:55.750238+0000","last_became_active":"2024-01-21T19:59:55.373903+0000","last_became_peered":"2024-01-21T19:59:55.373903+0000","last_unstale":"2024-01-21T19:59:55.750238+0000","last_undegraded":"2024-01-21T19:59:55.750238+0000","last_fullsized":"2024-01-21T19:59:55.750238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761925+0000","last_change":"2024-01-21T19:59:55.755470+0000","last_active":"2024-01-21T19:59:55.761925+0000","last_peered":"2024-01-21T19:59:55.761925+0000","last_clean":"2024-01-21T19:59:55.761925+0000","last_became_active":"2024-01-21T19:59:55.755213+0000","last_became_peered":"2024-01-21T19:59:55.755213+0000","last_unstale":"2024-01-21T19:59:55.761925+0000","last_undegraded":"2024-01-21T19:59:55.761925+0000","last_fullsized":"2024-01-21T19:59:55.761925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741509+0000","last_change":"2024-01-21T19:59:55.376767+0000","last_active":"2024-01-21T19:59:55.741509+0000","last_peered":"2024-01-21T19:59:55.741509+0000","last_clean":"2024-01-21T19:59:55.741509+0000","last_became_active":"2024-01-21T19:59:55.376481+0000","last_became_peered":"2024-01-21T19:59:55.376481+0000","last_unstale":"2024-01-21T19:59:55.741509+0000","last_undegraded":"2024-01-21T19:59:55.741509+0000","last_fullsized":"2024-01-21T19:59:55.741509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751862+0000","last_change":"2024-01-21T19:59:55.750322+0000","last_active":"2024-01-21T19:59:55.751862+0000","last_peered":"2024-01-21T19:59:55.751862+0000","last_clean":"2024-01-21T19:59:55.751862+0000","last_became_active":"2024-01-21T19:59:55.749826+0000","last_became_peered":"2024-01-21T19:59:55.749826+0000","last_unstale":"2024-01-21T19:59:55.751862+0000","last_undegraded":"2024-01-21T19:59:55.751862+0000","last_fullsized":"2024-01-21T19:59:55.751862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736326+0000","last_change":"2024-01-21T19:59:55.376688+0000","last_active":"2024-01-21T19:59:55.736326+0000","last_peered":"2024-01-21T19:59:55.736326+0000","last_clean":"2024-01-21T19:59:55.736326+0000","last_became_active":"2024-01-21T19:59:55.376145+0000","last_became_peered":"2024-01-21T19:59:55.376145+0000","last_unstale":"2024-01-21T19:59:55.736326+0000","last_undegraded":"2024-01-21T19:59:55.736326+0000","last_fullsized":"2024-01-21T19:59:55.736326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737138+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T19:59:55.737138+0000","last_peered":"2024-01-21T19:59:55.737138+0000","last_clean":"2024-01-21T19:59:55.737138+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T19:59:55.737138+0000","last_undegraded":"2024-01-21T19:59:55.737138+0000","last_fullsized":"2024-01-21T19:59:55.737138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.761300+0000","last_change":"2024-01-21T19:59:55.757496+0000","last_active":"2024-01-21T19:59:55.761300+0000","last_peered":"2024-01-21T19:59:55.761300+0000","last_clean":"2024-01-21T19:59:55.761300+0000","last_became_active":"2024-01-21T19:59:55.757211+0000","last_became_peered":"2024-01-21T19:59:55.757211+0000","last_unstale":"2024-01-21T19:59:55.761300+0000","last_undegraded":"2024-01-21T19:59:55.761300+0000","last_fullsized":"2024-01-21T19:59:55.761300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.736896+0000","last_change":"2024-01-21T19:59:55.374031+0000","last_active":"2024-01-21T19:59:55.736896+0000","last_peered":"2024-01-21T19:59:55.736896+0000","last_clean":"2024-01-21T19:59:55.736896+0000","last_became_active":"2024-01-21T19:59:55.373742+0000","last_became_peered":"2024-01-21T19:59:55.373742+0000","last_unstale":"2024-01-21T19:59:55.736896+0000","last_undegraded":"2024-01-21T19:59:55.736896+0000","last_fullsized":"2024-01-21T19:59:55.736896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739207+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T19:59:55.739207+0000","last_peered":"2024-01-21T19:59:55.739207+0000","last_clean":"2024-01-21T19:59:55.739207+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T19:59:55.739207+0000","last_undegraded":"2024-01-21T19:59:55.739207+0000","last_fullsized":"2024-01-21T19:59:55.739207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.766203+0000","last_change":"2024-01-21T19:59:55.765565+0000","last_active":"2024-01-21T19:59:55.766203+0000","last_peered":"2024-01-21T19:59:55.766203+0000","last_clean":"2024-01-21T19:59:55.766203+0000","last_became_active":"2024-01-21T19:59:55.765260+0000","last_became_peered":"2024-01-21T19:59:55.765260+0000","last_unstale":"2024-01-21T19:59:55.766203+0000","last_undegraded":"2024-01-21T19:59:55.766203+0000","last_fullsized":"2024-01-21T19:59:55.766203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.742510+0000","last_change":"2024-01-21T19:59:55.364286+0000","last_active":"2024-01-21T19:59:55.742510+0000","last_peered":"2024-01-21T19:59:55.742510+0000","last_clean":"2024-01-21T19:59:55.742510+0000","last_became_active":"2024-01-21T19:59:55.363981+0000","last_became_peered":"2024-01-21T19:59:55.363981+0000","last_unstale":"2024-01-21T19:59:55.742510+0000","last_undegraded":"2024-01-21T19:59:55.742510+0000","last_fullsized":"2024-01-21T19:59:55.742510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.741869+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T19:59:55.741869+0000","last_peered":"2024-01-21T19:59:55.741869+0000","last_clean":"2024-01-21T19:59:55.741869+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T19:59:55.741869+0000","last_undegraded":"2024-01-21T19:59:55.741869+0000","last_fullsized":"2024-01-21T19:59:55.741869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759669+0000","last_change":"2024-01-21T19:59:55.753872+0000","last_active":"2024-01-21T19:59:55.759669+0000","last_peered":"2024-01-21T19:59:55.759669+0000","last_clean":"2024-01-21T19:59:55.759669+0000","last_became_active":"2024-01-21T19:59:55.753611+0000","last_became_peered":"2024-01-21T19:59:55.753611+0000","last_unstale":"2024-01-21T19:59:55.759669+0000","last_undegraded":"2024-01-21T19:59:55.759669+0000","last_fullsized":"2024-01-21T19:59:55.759669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750312+0000","last_change":"2024-01-21T19:59:55.372783+0000","last_active":"2024-01-21T19:59:55.750312+0000","last_peered":"2024-01-21T19:59:55.750312+0000","last_clean":"2024-01-21T19:59:55.750312+0000","last_became_active":"2024-01-21T19:59:55.372347+0000","last_became_peered":"2024-01-21T19:59:55.372347+0000","last_unstale":"2024-01-21T19:59:55.750312+0000","last_undegraded":"2024-01-21T19:59:55.750312+0000","last_fullsized":"2024-01-21T19:59:55.750312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.739432+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T19:59:55.739432+0000","last_peered":"2024-01-21T19:59:55.739432+0000","last_clean":"2024-01-21T19:59:55.739432+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T19:59:55.739432+0000","last_undegraded":"2024-01-21T19:59:55.739432+0000","last_fullsized":"2024-01-21T19:59:55.739432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750055+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T19:59:55.750055+0000","last_peered":"2024-01-21T19:59:55.750055+0000","last_clean":"2024-01-21T19:59:55.750055+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T19:59:55.750055+0000","last_undegraded":"2024-01-21T19:59:55.750055+0000","last_fullsized":"2024-01-21T19:59:55.750055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.750748+0000","last_change":"2024-01-21T19:59:55.748096+0000","last_active":"2024-01-21T19:59:55.750748+0000","last_peered":"2024-01-21T19:59:55.750748+0000","last_clean":"2024-01-21T19:59:55.750748+0000","last_became_active":"2024-01-21T19:59:55.747837+0000","last_became_peered":"2024-01-21T19:59:55.747837+0000","last_unstale":"2024-01-21T19:59:55.750748+0000","last_undegraded":"2024-01-21T19:59:55.750748+0000","last_fullsized":"2024-01-21T19:59:55.750748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.756384+0000","last_change":"2024-01-21T19:59:55.366315+0000","last_active":"2024-01-21T19:59:55.756384+0000","last_peered":"2024-01-21T19:59:55.756384+0000","last_clean":"2024-01-21T19:59:55.756384+0000","last_became_active":"2024-01-21T19:59:55.366053+0000","last_became_peered":"2024-01-21T19:59:55.366053+0000","last_unstale":"2024-01-21T19:59:55.756384+0000","last_undegraded":"2024-01-21T19:59:55.756384+0000","last_fullsized":"2024-01-21T19:59:55.756384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751071+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T19:59:55.751071+0000","last_peered":"2024-01-21T19:59:55.751071+0000","last_clean":"2024-01-21T19:59:55.751071+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T19:59:55.751071+0000","last_undegraded":"2024-01-21T19:59:55.751071+0000","last_fullsized":"2024-01-21T19:59:55.751071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752289+0000","last_change":"2024-01-21T19:59:55.750767+0000","last_active":"2024-01-21T19:59:55.752289+0000","last_peered":"2024-01-21T19:59:55.752289+0000","last_clean":"2024-01-21T19:59:55.752289+0000","last_became_active":"2024-01-21T19:59:55.750488+0000","last_became_peered":"2024-01-21T19:59:55.750488+0000","last_unstale":"2024-01-21T19:59:55.752289+0000","last_undegraded":"2024-01-21T19:59:55.752289+0000","last_fullsized":"2024-01-21T19:59:55.752289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.743663+0000","last_change":"2024-01-21T19:59:55.376769+0000","last_active":"2024-01-21T19:59:55.743663+0000","last_peered":"2024-01-21T19:59:55.743663+0000","last_clean":"2024-01-21T19:59:55.743663+0000","last_became_active":"2024-01-21T19:59:55.376452+0000","last_became_peered":"2024-01-21T19:59:55.376452+0000","last_unstale":"2024-01-21T19:59:55.743663+0000","last_undegraded":"2024-01-21T19:59:55.743663+0000","last_fullsized":"2024-01-21T19:59:55.743663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.751077+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T19:59:55.751077+0000","last_peered":"2024-01-21T19:59:55.751077+0000","last_clean":"2024-01-21T19:59:55.751077+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T19:59:55.751077+0000","last_undegraded":"2024-01-21T19:59:55.751077+0000","last_fullsized":"2024-01-21T19:59:55.751077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.759319+0000","last_change":"2024-01-21T19:59:55.758240+0000","last_active":"2024-01-21T19:59:55.759319+0000","last_peered":"2024-01-21T19:59:55.759319+0000","last_clean":"2024-01-21T19:59:55.759319+0000","last_became_active":"2024-01-21T19:59:55.757955+0000","last_became_peered":"2024-01-21T19:59:55.757955+0000","last_unstale":"2024-01-21T19:59:55.759319+0000","last_undegraded":"2024-01-21T19:59:55.759319+0000","last_fullsized":"2024-01-21T19:59:55.759319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.744210+0000","last_change":"2024-01-21T19:59:55.357570+0000","last_active":"2024-01-21T19:59:55.744210+0000","last_peered":"2024-01-21T19:59:55.744210+0000","last_clean":"2024-01-21T19:59:55.744210+0000","last_became_active":"2024-01-21T19:59:55.357272+0000","last_became_peered":"2024-01-21T19:59:55.357272+0000","last_unstale":"2024-01-21T19:59:55.744210+0000","last_undegraded":"2024-01-21T19:59:55.744210+0000","last_fullsized":"2024-01-21T19:59:55.744210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.737405+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T19:59:55.737405+0000","last_peered":"2024-01-21T19:59:55.737405+0000","last_clean":"2024-01-21T19:59:55.737405+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T19:59:55.737405+0000","last_undegraded":"2024-01-21T19:59:55.737405+0000","last_fullsized":"2024-01-21T19:59:55.737405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.765556+0000","last_change":"2024-01-21T19:59:55.763997+0000","last_active":"2024-01-21T19:59:55.765556+0000","last_peered":"2024-01-21T19:59:55.765556+0000","last_clean":"2024-01-21T19:59:55.765556+0000","last_became_active":"2024-01-21T19:59:55.763737+0000","last_became_peered":"2024-01-21T19:59:55.763737+0000","last_unstale":"2024-01-21T19:59:55.765556+0000","last_undegraded":"2024-01-21T19:59:55.765556+0000","last_fullsized":"2024-01-21T19:59:55.765556+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:55.345239+0000","last_clean_scrub_stamp":"2024-01-21T19:59:55.345239+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.746333+0000","last_change":"2024-01-21T19:59:55.369000+0000","last_active":"2024-01-21T19:59:55.746333+0000","last_peered":"2024-01-21T19:59:55.746333+0000","last_clean":"2024-01-21T19:59:55.746333+0000","last_became_active":"2024-01-21T19:59:55.368682+0000","last_became_peered":"2024-01-21T19:59:55.368682+0000","last_unstale":"2024-01-21T19:59:55.746333+0000","last_undegraded":"2024-01-21T19:59:55.746333+0000","last_fullsized":"2024-01-21T19:59:55.746333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:54.339019+0000","last_clean_scrub_stamp":"2024-01-21T19:59:54.339019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-21T19:59:55.752118+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T19:59:55.752118+0000","last_peered":"2024-01-21T19:59:55.752118+0000","last_clean":"2024-01-21T19:59:55.752118+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T19:59:55.752118+0000","last_undegraded":"2024-01-21T19:59:55.752118+0000","last_fullsized":"2024-01-21T19:59:55.752118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":158387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":159258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":158864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.44},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"last":0.376},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"last":0.28799999999999998}]},{"osd":3,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45000000000000001}]},{"osd":5,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Sun Jan 21 19:59:58 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":157777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":158704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":405504,"data_stored":160344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":152022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":401408,"data_stored":160262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:00:03.481 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:00:03.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:00:03.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.646+0000 7f2d931e8700 1 Processor -- start 2024-01-21T20:00:03.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.646+0000 7f2d931e8700 1 -- start start 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d931e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c155cb0 0x7f2d8c156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d931e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 0x7f2d8c0be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d931e8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8c156650 con 0x7f2d8c1351d0 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d931e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8c0c61a0 con 0x7f2d8c155cb0 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d931e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0c5350 con 0x7f2d8c0bde60 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c155cb0 0x7f2d8c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d8c155cb0 0x7f2d8c156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51188/0 (socket says 172.21.15.133:51188) 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 -- 172.21.15.133:0/434018283 learned_addr learned my addr 172.21.15.133:0/434018283 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:03.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 -- 172.21.15.133:0/434018283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 msgr2=0x7f2d8c0be2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d91785700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 0x7f2d8c0be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 0x7f2d8c0be2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 -- 172.21.15.133:0/434018283 >> v1:172.21.15.178:6789/0 conn(0x7f2d8c1351d0 legacy=0x7f2d8c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 -- 172.21.15.133:0/434018283 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8c0c55d0 con 0x7f2d8c155cb0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d91785700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 0x7f2d8c0be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.647+0000 7f2d8bfff700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c156160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2d78006fd0 tx=0x7f2d780090f0).ready entity=mon.0 client_cookie=6c1bede68ad16f44 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d8b7fe700 1 -- 172.21.15.133:0/434018283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800b600 con 0x7f2d8c155cb0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d8b7fe700 1 -- 172.21.15.133:0/434018283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800b760 con 0x7f2d8c155cb0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d8b7fe700 1 -- 172.21.15.133:0/434018283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800bb00 con 0x7f2d8c155cb0 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 -- 172.21.15.133:0/434018283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c155cb0 msgr2=0x7f2d8c156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c156160 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2d78006fd0 tx=0x7f2d780090f0).stop 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 -- 172.21.15.133:0/434018283 shutdown_connections 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c0bde60 0x7f2d8c0be2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 --2- 172.21.15.133:0/434018283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c156160 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 -- 172.21.15.133:0/434018283 >> 172.21.15.133:0/434018283 conn(0x7f2d8c066a90 msgr2=0x7f2d8c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 -- 172.21.15.133:0/434018283 shutdown_connections 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.648+0000 7f2d931e8700 1 -- 172.21.15.133:0/434018283 wait complete. 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.649+0000 7f2d931e8700 1 Processor -- start 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.649+0000 7f2d931e8700 1 -- start start 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c1351d0 0x7f2d8c0a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c1396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c139bc0 con 0x7f2d8c0bde60 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0644c0 con 0x7f2d8c155cb0 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d931e8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8c0c9c80 con 0x7f2d8c1351d0 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d90f84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d90f84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51190/0 (socket says 172.21.15.133:51190) 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.650+0000 7f2d90f84700 1 -- 172.21.15.133:0/2262458782 learned_addr learned my addr 172.21.15.133:0/2262458782 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d91785700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c1396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d8bfff700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c1351d0 0x7f2d8c0a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 -- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c1351d0 msgr2=0x7f2d8c0a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c1351d0 0x7f2d8c0a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 -- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d8c155cb0 msgr2=0x7f2d8c1396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c1396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 -- 172.21.15.133:0/2262458782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009370 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d90f84700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2d8000b460 tx=0x7f2d80006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80012410 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80012590 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8c0c6db0 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80012950 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.651+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8c064750 con 0x7f2d8c0bde60 2024-01-21T20:00:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.652+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c05fdf0 con 0x7f2d8c0bde60 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.652+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2d80012d00 con 0x7f2d8c0bde60 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.653+0000 7f2d897fa700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 0x7f2d70061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.653+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2d8007a010 con 0x7f2d8c0bde60 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.653+0000 7f2d8bfff700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 0x7f2d70061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.653+0000 7f2d8bfff700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 0x7f2d70061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2d8c13bc00 tx=0x7f2d78017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:03.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.657+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d8004b2e0 con 0x7f2d8c0bde60 2024-01-21T20:00:03.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.893+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2d8c0c5870 con 0x7f2d8c0bde60 2024-01-21T20:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.900+0000 7f2d897fa700 1 -- 172.21.15.133:0/2262458782 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2d8004e900 con 0x7f2d8c0bde60 2024-01-21T20:00:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 msgr2=0x7f2d70061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 0x7f2d70061610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2d8c13bc00 tx=0x7f2d78017000).stop 2024-01-21T20:00:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 msgr2=0x7f2d8c0a8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2d8000b460 tx=0x7f2d80006f20).stop 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 shutdown_connections 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d7005f150 0x7f2d70061610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d8c155cb0 0x7f2d8c1396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d8c0bde60 0x7f2d8c0a8040 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 --2- 172.21.15.133:0/2262458782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d8c1351d0 0x7f2d8c0a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 >> 172.21.15.133:0/2262458782 conn(0x7f2d8c066a90 msgr2=0x7f2d8c1550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 shutdown_connections 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:03.902+0000 7f2d931e8700 1 -- 172.21.15.133:0/2262458782 wait complete. 2024-01-21T20:00:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:00:03.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:00:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.029+0000 7f48b6ebf700 1 Processor -- start 2024-01-21T20:00:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.029+0000 7f48b6ebf700 1 -- start start 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b6ebf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f48b013a830 0x7f48b00c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b6ebf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00c3890 con 0x7f48b00695b0 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b6ebf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00c3b70 con 0x7f48b013ac10 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b6ebf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00c3e50 con 0x7f48b013a830 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b545c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f48b00695b0 0x7f48b00699c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40074/0 (socket says 172.21.15.133:40074) 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b545c700 1 -- 172.21.15.133:0/1223178528 learned_addr learned my addr 172.21.15.133:0/1223178528 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499928185 0 0) 0x7f48b00c3890 con 0x7f48b00695b0 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a00033f0 con 0x7f48b00695b0 2024-01-21T20:00:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.030+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/1223178528 >> v2:172.21.15.178:3300/0 conn(0x7f48b013a830 0x7f48b00c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 44642852 0 0) 0x7f48a00033f0 con 0x7f48b00695b0 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 >> v2:172.21.15.178:3300/0 conn(0x7f48b013a830 msgr2=0x7f48b00c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 --2- 172.21.15.133:0/1223178528 >> v2:172.21.15.178:3300/0 conn(0x7f48b013a830 0x7f48b00c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 >> v1:172.21.15.178:6789/0 conn(0x7f48b013ac10 legacy=0x7f48b00bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00c4130 con 0x7f48b00695b0 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f48a80017f0 con 0x7f48b00695b0 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 >> v1:172.21.15.133:6789/0 conn(0x7f48b00695b0 legacy=0x7f48b00699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a0003930 0x7f48a0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 0x7f48a0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0005120 0x7f48a000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c3e50 con 0x7f48a0004690 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a000c030 con 0x7f48a0005120 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a000c1f0 con 0x7f48a0003930 2024-01-21T20:00:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 0x7f48a0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a0003930 0x7f48a0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48b545c700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0005120 0x7f48a000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 -- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a0003930 msgr2=0x7f48a0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a0003930 0x7f48a0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 -- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0005120 msgr2=0x7f48a000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0005120 0x7f48a000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 -- 172.21.15.133:0/1223178528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a00033f0 con 0x7f48a0004690 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48b545c700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0005120 0x7f48a000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48b545c700 1 -- 172.21.15.133:0/1223178528 reap_dead start 2024-01-21T20:00:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48affff700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 0x7f48a0004b10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f489c001700 tx=0x7f489c007bb0).ready entity=mon.0 client_cookie=5510d1cb3239252e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c007020 con 0x7f48a0004690 2024-01-21T20:00:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c007180 con 0x7f48a0004690 2024-01-21T20:00:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.031+0000 7f48af7fe700 1 -- 172.21.15.133:0/1223178528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c007520 con 0x7f48a0004690 2024-01-21T20:00:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 -- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 msgr2=0x7f48a0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 0x7f48a0004b10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f489c001700 tx=0x7f489c007bb0).stop 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 -- 172.21.15.133:0/1223178528 shutdown_connections 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/1223178528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48a0004690 0x7f48a0004b10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 -- 172.21.15.133:0/1223178528 >> 172.21.15.133:0/1223178528 conn(0x7f48b00c7dc0 msgr2=0x7f48b00c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 -- 172.21.15.133:0/1223178528 shutdown_connections 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.032+0000 7f48b6ebf700 1 -- 172.21.15.133:0/1223178528 wait complete. 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.033+0000 7f48b6ebf700 1 Processor -- start 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.033+0000 7f48b6ebf700 1 -- start start 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 0x7f48b0136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b0153240 0x7f48b01536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b015e1e0 con 0x7f48b00acd60 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0137250 con 0x7f48a0004690 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b6ebf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0161740 con 0x7f48b0153240 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51208/0 (socket says 172.21.15.133:51208) 2024-01-21T20:00:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 -- 172.21.15.133:0/2519024006 learned_addr learned my addr 172.21.15.133:0/2519024006 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 0x7f48b0136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 -- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b0153240 msgr2=0x7f48b01536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48b545c700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b0153240 0x7f48b01536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b0153240 0x7f48b01536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 -- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 msgr2=0x7f48b0136d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.034+0000 7f48affff700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 0x7f48b0136d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48affff700 1 -- 172.21.15.133:0/2519024006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00ad6d0 con 0x7f48b00acd60 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 0x7f48b0136d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48affff700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f489c0069b0 tx=0x7f489c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c006f40 con 0x7f48b00acd60 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c01e440 con 0x7f48b00acd60 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c01e800 con 0x7f48b00acd60 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b0161990 con 0x7f48b00acd60 2024-01-21T20:00:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.035+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b0161f50 con 0x7f48b00acd60 2024-01-21T20:00:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.036+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b005fdf0 con 0x7f48b00acd60 2024-01-21T20:00:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.036+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f489c012400 con 0x7f48b00acd60 2024-01-21T20:00:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.037+0000 7f48ad7fa700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 0x7f48940615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.037+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f489c07b2e0 con 0x7f48b00acd60 2024-01-21T20:00:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.037+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 0x7f48940615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.037+0000 7f48b4c5b700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 0x7f48940615e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f48a4009270 tx=0x7f48a4008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.041+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f489c04c490 con 0x7f48b00acd60 2024-01-21T20:00:04.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.248+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48b00c4410 con 0x7f48b00acd60 2024-01-21T20:00:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.248+0000 7f48ad7fa700 1 -- 172.21.15.133:0/2519024006 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f489c023020 con 0x7f48b00acd60 2024-01-21T20:00:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:00:04.240 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 msgr2=0x7f48940615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 0x7f48940615e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f48a4009270 tx=0x7f48a4008040).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 msgr2=0x7f48b00ad1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f489c0069b0 tx=0x7f489c016000).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 shutdown_connections 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f489405f120 0x7f48940615e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48b0153240 0x7f48b01536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a0004690 0x7f48b0136d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 --2- 172.21.15.133:0/2519024006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48b00acd60 0x7f48b00ad1e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.250+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 >> 172.21.15.133:0/2519024006 conn(0x7f48b00c7dc0 msgr2=0x7f48b00c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.251+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 shutdown_connections 2024-01-21T20:00:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.251+0000 7f48b6ebf700 1 -- 172.21.15.133:0/2519024006 wait complete. 2024-01-21T20:00:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T20:00:04.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T19:59:55.732556+0000', 'modified': '2024-01-21T19:59:57.738283+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4977}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4977': {'gid': 4977, 'name': 'd', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/1407215151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 1407215151}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 1407215151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:00:04.657 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:00:04.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-21T20:00:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.783+0000 7fd5b6538700 1 Processor -- start 2024-01-21T20:00:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.783+0000 7fd5b6538700 1 -- start start 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b6538700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 0x7fd5b00c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b6538700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b01563c0 0x7fd5b00bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b6538700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00c61a0 con 0x7fd5b00c3c60 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b6538700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00c5350 con 0x7fd5b01563c0 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b6538700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b00c55d0 con 0x7fd5b01351d0 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b01563c0 0x7fd5b00bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b01563c0 0x7fd5b00bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51214/0 (socket says 172.21.15.133:51214) 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/1424181832 learned_addr learned my addr 172.21.15.133:0/1424181832 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5affff700 1 --2- 172.21.15.133:0/1424181832 >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 0x7fd5b00c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/1424181832 >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 msgr2=0x7fd5b00c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/1424181832 >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 0x7fd5b00c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.784+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/1424181832 >> v1:172.21.15.178:6789/0 conn(0x7fd5b00c3c60 legacy=0x7fd5b0155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/1424181832 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00c5870 con 0x7fd5b01563c0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5affff700 1 --2- 172.21.15.133:0/1424181832 >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 0x7fd5b00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/1424181832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b01563c0 0x7fd5b00bde60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd5b006a630 tx=0x7fd5a8009840).ready entity=mon.0 client_cookie=b359f1b5deb2c5c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5aeffd700 1 -- 172.21.15.133:0/1424181832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800e070 con 0x7fd5b01563c0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5aeffd700 1 -- 172.21.15.133:0/1424181832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800ba50 con 0x7fd5b01563c0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5aeffd700 1 -- 172.21.15.133:0/1424181832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800bdd0 con 0x7fd5b01563c0 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 -- 172.21.15.133:0/1424181832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b01563c0 msgr2=0x7fd5b00bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1424181832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b01563c0 0x7fd5b00bde60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd5b006a630 tx=0x7fd5a8009840).stop 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 -- 172.21.15.133:0/1424181832 shutdown_connections 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1424181832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b01563c0 0x7fd5b00bde60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1424181832 >> v2:172.21.15.178:3300/0 conn(0x7fd5b01351d0 0x7fd5b00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 -- 172.21.15.133:0/1424181832 >> 172.21.15.133:0/1424181832 conn(0x7fd5b0066a90 msgr2=0x7fd5b0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 -- 172.21.15.133:0/1424181832 shutdown_connections 2024-01-21T20:00:04.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.785+0000 7fd5b6538700 1 -- 172.21.15.133:0/1424181832 wait complete. 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 Processor -- start 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 -- start start 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5b01351d0 0x7fd5b0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5b01563c0 0x7fd5b00c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0152a80 con 0x7fd5b00c3c60 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00ae460 con 0x7fd5b01351d0 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.787+0000 7fd5b6538700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00ae740 con 0x7fd5b01563c0 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51224/0 (socket says 172.21.15.133:51224) 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 -- 172.21.15.133:0/1119831203 learned_addr learned my addr 172.21.15.133:0/1119831203 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5b01351d0 0x7fd5b0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5b01563c0 0x7fd5b00c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 -- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5b01563c0 msgr2=0x7fd5b00c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5b01563c0 0x7fd5b00c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 -- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5b01351d0 msgr2=0x7fd5b0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5b01351d0 0x7fd5b0152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 -- 172.21.15.133:0/1119831203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009ae0 con 0x7fd5b00c3c60 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5affff700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fd5a400d890 tx=0x7fd5a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5acff9700 1 -- 172.21.15.133:0/1119831203 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011590 con 0x7fd5b00c3c60 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5acff9700 1 -- 172.21.15.133:0/1119831203 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40116f0 con 0x7fd5b00c3c60 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00aea20 con 0x7fd5b00c3c60 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5acff9700 1 -- 172.21.15.133:0/1119831203 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011a70 con 0x7fd5b00c3c60 2024-01-21T20:00:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.788+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b0150270 con 0x7fd5b00c3c60 2024-01-21T20:00:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.789+0000 7fd5acff9700 1 -- 172.21.15.133:0/1119831203 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd5a4012420 con 0x7fd5b00c3c60 2024-01-21T20:00:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.790+0000 7fd5acff9700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 0x7fd59c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.790+0000 7fd5acff9700 1 -- 172.21.15.133:0/1119831203 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5a4079af0 con 0x7fd5b00c3c60 2024-01-21T20:00:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.790+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 0x7fd59c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.790+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 0x7fd59c061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fd5b00c2ed0 tx=0x7fd5a0007d20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.792+0000 7fd5c7edbb80 1 Processor -- start 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.792+0000 7fd5c7edbb80 1 -- start start 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 0x560391e46a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 0x560391e41900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391dbd3d0 con 0x560391e41df0 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391d82be0 con 0x560391e46620 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560391d98260 con 0x560391e8f2c0 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51238/0 (socket says 172.21.15.133:51238) 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/638339620 learned_addr learned my addr 172.21.15.133:0/638339620 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 0x560391e41900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5affff700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 0x560391e46a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 msgr2=0x560391e41900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 0x560391e41900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 msgr2=0x560391e46a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 0x560391e46a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/638339620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560391d912f0 con 0x560391e41df0 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 0x560391e41900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5affff700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 0x560391e46a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd5a8009fd0 tx=0x7fd5a8009840).ready entity=mon.0 client_cookie=5d4e970eb005bda5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd595ffb700 1 -- 172.21.15.133:0/638339620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8022070 con 0x560391e41df0 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd595ffb700 1 -- 172.21.15.133:0/638339620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800bbc0 con 0x560391e41df0 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.793+0000 7fd595ffb700 1 -- 172.21.15.133:0/638339620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800bd70 con 0x560391e41df0 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/638339620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 msgr2=0x560391e42270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd5a8009fd0 tx=0x7fd5a8009840).stop 2024-01-21T20:00:04.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/638339620 shutdown_connections 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e42270 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e46620 0x560391e46a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/638339620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e8f2c0 0x560391e41900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/638339620 >> 172.21.15.133:0/638339620 conn(0x560391caf2e0 msgr2=0x560391e8f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/638339620 shutdown_connections 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.794+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/638339620 wait complete. 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.795+0000 7fd5c7edbb80 1 -- start start 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.795+0000 7fd5c7edbb80 1 Processor -- start 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e41df0 0x560391e754e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391e8a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391d983a0 con 0x560391e46620 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391d98620 con 0x560391e8f2c0 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560391d63990 con 0x560391e41df0 2024-01-21T20:00:04.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 10 client.0 ll_register_callbacks cb 0x560391e06610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51246/0 (socket says 172.21.15.133:51246) 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 -- 172.21.15.133:0/3712450403 learned_addr learned my addr 172.21.15.133:0/3712450403 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5affff700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e41df0 0x560391e754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391e8a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 -- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e41df0 msgr2=0x560391e754e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e41df0 0x560391e754e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 -- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 msgr2=0x560391e8a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391e8a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 -- 172.21.15.133:0/3712450403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a8017040 con 0x560391e46620 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fd5a0000c00 tx=0x7fd5a000a000).ready entity=mon.0 client_cookie=1fd8f52eba2e4ee8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd58effd700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:00:04.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a001d070 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5a00034d0 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560391e40df0 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a0003db0 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 10 client.5184 fetch_fsmap learned FSMap version 12 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.796+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x560391d8c520 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560391e40df0 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd5a0018900 con 0x560391e46620 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 10 client.5184 fetch_fsmap finished waiting for FSMap version 12 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 10 client.5184 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 20 client.5184 populate_metadata read hostname 'smithi133' 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e72bf0 0x560391e9ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 4 client.5184 mds_command: new command op to 4977 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 --> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560391d8dd60 con 0x560391e72bf0 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5affff700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e72bf0 0x560391e9ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd58effd700 10 client.5184 ms_handle_connect on v2:172.21.15.178:6832/1407215151 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.797+0000 7fd5affff700 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e72bf0 0x560391e9ec90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e1d69f8d1bb2ff8c server_cookie=353494e14963278f in_seq=0 out_seq=0 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd58effd700 1 -- 172.21.15.133:0/3712450403 <== mds.0 v2:172.21.15.178:6832/1407215151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x560391d8dd60 con 0x560391e72bf0 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd58effd700 10 client.5184 handle_command_reply: tid=0 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 client.5184 shutdown 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 msgr2=0x560391e8a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fd5a0000c00 tx=0x7fd5a000a000).stop 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 shutdown_connections 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391e8a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e72bf0 0x560391e9ec90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e41df0 0x560391e754e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/3712450403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e46620 0x560391e8a040 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 >> 172.21.15.133:0/3712450403 conn(0x560391caf2e0 msgr2=0x560391e46a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd58effd700 0 client.5184 ms_handle_reset on v2:172.21.15.178:6832/1407215151 2024-01-21T20:00:04.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 shutdown_connections 2024-01-21T20:00:04.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/3712450403 wait complete. 2024-01-21T20:00:04.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.798+0000 7fd5c7edbb80 20 client.5184 trim_cache size 0 max 16384 2024-01-21T20:00:04.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.815+0000 7fd5c7edbb80 1 Processor -- start 2024-01-21T20:00:04.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.815+0000 7fd5c7edbb80 1 -- start start 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e41df0 0x560391e73840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391e9dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391e459d0 con 0x560391e8f2c0 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391e42630 con 0x560391e41df0 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560391e6f9e0 con 0x560391e46620 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51256/0 (socket says 172.21.15.133:51256) 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/84612738 learned_addr learned my addr 172.21.15.133:0/84612738 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5affff700 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e41df0 0x560391e73840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391e9dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 msgr2=0x560391e9dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391e9dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e41df0 msgr2=0x560391e73840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e41df0 0x560391e73840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 -- 172.21.15.133:0/84612738 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560391d8c270 con 0x560391e8f2c0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fd5a800ba20 tx=0x7fd5a801e000).ready entity=mon.0 client_cookie=f3d2bb91d0e9ba71 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5967fc700 1 -- 172.21.15.133:0/84612738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8022040 con 0x560391e8f2c0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5967fc700 1 -- 172.21.15.133:0/84612738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800bd30 con 0x560391e8f2c0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.816+0000 7fd5967fc700 1 -- 172.21.15.133:0/84612738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8013a70 con 0x560391e8f2c0 2024-01-21T20:00:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/84612738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 msgr2=0x560391e9e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fd5a800ba20 tx=0x7fd5a801e000).stop 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/84612738 shutdown_connections 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e8f2c0 0x560391e9e150 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e41df0 0x560391e73840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/84612738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391e9dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/84612738 >> 172.21.15.133:0/84612738 conn(0x560391caf2e0 msgr2=0x560391e8f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/84612738 shutdown_connections 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/84612738 wait complete. 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.817+0000 7fd5c7edbb80 1 -- start start 2024-01-21T20:00:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.818+0000 7fd5c7edbb80 1 Processor -- start 2024-01-21T20:00:04.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391ef0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391ea4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391ea7d10 con 0x560391e41df0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560391e9d3f0 con 0x560391e8f2c0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560391ef0940 con 0x560391e46620 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5c7edbb80 10 client.0 ll_register_callbacks cb 0x560391e06610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51262/0 (socket says 172.21.15.133:51262) 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 -- 172.21.15.133:0/1389600783 learned_addr learned my addr 172.21.15.133:0/1389600783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391ef0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5b4ad5700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391ea4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 -- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 msgr2=0x560391ef0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391ef0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 -- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 msgr2=0x560391ea4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391ea4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.819+0000 7fd5affff700 1 -- 172.21.15.133:0/1389600783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560391d912f0 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5affff700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fd5a400b140 tx=0x7fd5a4050040).ready entity=mon.0 client_cookie=2871766d4066af4a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a405a070 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5a800bbc0 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5a404df10 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a4053040 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 10 client.5190 fetch_fsmap learned FSMap version 12 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x560391c05f80 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800bbc0 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 12) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd5a404a810 con 0x560391e41df0 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 10 client.5190 fetch_fsmap finished waiting for FSMap version 12 2024-01-21T20:00:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 10 client.5190 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 20 client.5190 populate_metadata read hostname 'smithi133' 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e6d340 0x560391e6d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 4 client.5190 mds_command: new command op to 4977 tid=0[{"prefix": "status"}] 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 --> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560391d847d0 con 0x560391e6d340 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.820+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e6d340 0x560391e6d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd58effd700 10 client.5190 ms_handle_connect on v2:172.21.15.178:6832/1407215151 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5af7fe700 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e6d340 0x560391e6d720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9a602a545577e3d2 server_cookie=b3b7aaa8ef6e9563 in_seq=0 out_seq=0 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd58effd700 1 -- 172.21.15.133:0/1389600783 <== mds.0 v2:172.21.15.178:6832/1407215151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560391d847d0 con 0x560391e6d340 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd58effd700 10 client.5190 handle_command_reply: tid=0 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 client.5190 shutdown 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 msgr2=0x560391e3d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fd5a400b140 tx=0x7fd5a4050040).stop 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 shutdown_connections 2024-01-21T20:00:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560391e8f2c0 0x560391ea4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560391e41df0 0x560391e3d4c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:6832/1407215151,v1:172.21.15.178:6835/1407215151] conn(0x560391e6d340 0x560391e6d720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 --2- 172.21.15.133:0/1389600783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560391e46620 0x560391ef0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd58effd700 0 client.5190 ms_handle_reset on v2:172.21.15.178:6832/1407215151 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 >> 172.21.15.133:0/1389600783 conn(0x560391caf2e0 msgr2=0x560391e44510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 shutdown_connections 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 1 -- 172.21.15.133:0/1389600783 wait complete. 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.821+0000 7fd5c7edbb80 20 client.5190 trim_cache size 0 max 16384 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:00:04.819 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4977, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.0876451770000006, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 12, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 34, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 34, 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 16.518905548999999 2024-01-21T20:00:04.820 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 msgr2=0x7fd59c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 0x7fd59c061610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fd5b00c2ed0 tx=0x7fd5a0007d20).stop 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 msgr2=0x7fd5b0151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fd5a400d890 tx=0x7fd5a4008040).stop 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 shutdown_connections 2024-01-21T20:00:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd59c05f150 0x7fd59c061610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5b01563c0 0x7fd5b00c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b00c3c60 0x7fd5b0151750 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 --2- 172.21.15.133:0/1119831203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5b01351d0 0x7fd5b0152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 >> 172.21.15.133:0/1119831203 conn(0x7fd5b0066a90 msgr2=0x7fd5b014f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 shutdown_connections 2024-01-21T20:00:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.822+0000 7fd5b6538700 1 -- 172.21.15.133:0/1119831203 wait complete. 2024-01-21T20:00:04.825 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:00:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.938+0000 7f7564179700 1 Processor -- start 2024-01-21T20:00:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.938+0000 7f7564179700 1 -- start start 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7564179700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f755c0a8200 0x7f755c0c3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7564179700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 0x7f755c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7564179700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0c9870 con 0x7f755c0be350 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7564179700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0c9d80 con 0x7f755c0a8200 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7564179700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c065890 con 0x7f755c0c3910 2024-01-21T20:00:04.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f755c0a8200 0x7f755c0c3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f755c0a8200 0x7f755c0c3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51272/0 (socket says 172.21.15.133:51272) 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 -- 172.21.15.133:0/160348226 learned_addr learned my addr 172.21.15.133:0/160348226 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 -- 172.21.15.133:0/160348226 >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 msgr2=0x7f755c0c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561714700 1 --2- 172.21.15.133:0/160348226 >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 0x7f755c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 --2- 172.21.15.133:0/160348226 >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 0x7f755c0c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 -- 172.21.15.133:0/160348226 >> v1:172.21.15.178:6789/0 conn(0x7f755c0be350 legacy=0x7f755c0be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 -- 172.21.15.133:0/160348226 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c0c78f0 con 0x7f755c0a8200 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561714700 1 --2- 172.21.15.133:0/160348226 >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 0x7f755c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7561f15700 1 --2- 172.21.15.133:0/160348226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0a8200 0x7f755c0c3420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f755c0c6c20 tx=0x7f754c009060).ready entity=mon.0 client_cookie=c816b2ac74014918 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7560f13700 1 -- 172.21.15.133:0/160348226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c005880 con 0x7f755c0a8200 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7560f13700 1 -- 172.21.15.133:0/160348226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c0059e0 con 0x7f755c0a8200 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.939+0000 7f7560f13700 1 -- 172.21.15.133:0/160348226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c005d60 con 0x7f755c0a8200 2024-01-21T20:00:04.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 -- 172.21.15.133:0/160348226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0a8200 msgr2=0x7f755c0c3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 --2- 172.21.15.133:0/160348226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0a8200 0x7f755c0c3420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f755c0c6c20 tx=0x7f754c009060).stop 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 -- 172.21.15.133:0/160348226 shutdown_connections 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 --2- 172.21.15.133:0/160348226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0a8200 0x7f755c0c3420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 --2- 172.21.15.133:0/160348226 >> v2:172.21.15.178:3300/0 conn(0x7f755c0c3910 0x7f755c0c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 -- 172.21.15.133:0/160348226 >> 172.21.15.133:0/160348226 conn(0x7f755c062f50 msgr2=0x7f755c0c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 -- 172.21.15.133:0/160348226 shutdown_connections 2024-01-21T20:00:04.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.940+0000 7f7564179700 1 -- 172.21.15.133:0/160348226 wait complete. 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.941+0000 7f7564179700 1 Processor -- start 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.941+0000 7f7564179700 1 -- start start 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c0a8200 0x7f755c0ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c0be350 0x7f755c0aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0a9780 con 0x7f755c0c3910 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0a8b70 con 0x7f755c0a8200 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7564179700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0a8e50 con 0x7f755c0be350 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51286/0 (socket says 172.21.15.133:51286) 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 -- 172.21.15.133:0/364393840 learned_addr learned my addr 172.21.15.133:0/364393840 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7561714700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c0be350 0x7f755c0aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7561f15700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c0a8200 0x7f755c0ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 -- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c0be350 msgr2=0x7f755c0aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c0be350 0x7f755c0aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 -- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c0a8200 msgr2=0x7f755c0ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c0a8200 0x7f755c0ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.942+0000 7f7562716700 1 -- 172.21.15.133:0/364393840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c009300 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f7562716700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f755400c810 tx=0x7f7554002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554010510 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554010670 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c0a9130 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554010a30 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.943+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c0674d0 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.944+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c0c9570 con 0x7f755c0c3910 2024-01-21T20:00:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.944+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7554012440 con 0x7f755c0c3910 2024-01-21T20:00:04.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.944+0000 7f75527fc700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 0x7f7540061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:04.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.945+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7554079c00 con 0x7f755c0c3910 2024-01-21T20:00:04.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.945+0000 7f7561f15700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 0x7f7540061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:04.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.945+0000 7f7561f15700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 0x7f7540061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f754c00b360 tx=0x7f754c016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:04.949+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7554048b00 con 0x7f755c0c3910 2024-01-21T20:00:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.151+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f755c0475e0 con 0x7f755c0c3910 2024-01-21T20:00:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.151+0000 7f75527fc700 1 -- 172.21.15.133:0/364393840 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7554080080 con 0x7f755c0c3910 2024-01-21T20:00:05.143 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:00:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 msgr2=0x7f7540061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 0x7f7540061610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f754c00b360 tx=0x7f754c016000).stop 2024-01-21T20:00:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 msgr2=0x7f755c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f755400c810 tx=0x7f7554002560).stop 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 shutdown_connections 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f754005f150 0x7f7540061610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f755c0c3910 0x7f755c0abdd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c0a8200 0x7f755c0ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 --2- 172.21.15.133:0/364393840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c0be350 0x7f755c0aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 >> 172.21.15.133:0/364393840 conn(0x7f755c062f50 msgr2=0x7f755c153980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 shutdown_connections 2024-01-21T20:00:05.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.153+0000 7f7564179700 1 -- 172.21.15.133:0/364393840 wait complete. 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:00:05.155 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:00:05.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.156 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:00:05.173 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:00:05.173 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:00:05.173 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:00:05.173 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.173 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42326sec preferred_lft 42326sec 2024-01-21T20:00:05.174 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:00:05.175 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:00:05.176 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:00:05.176 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:00:05.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.176 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:00:05.239 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:00:05.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.240 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:00:05.299 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:00:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:00:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:00:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:00:05.300 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:00:05.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.300 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:00:05.301 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:00:05.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:00:05.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:00:05.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:00:05.301 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:00:05.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.405 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:00:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:00:05.422 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:00:05.422 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:00:05.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.422 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:00:05.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.490 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:00:05.546 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:00:05.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:00:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:00:05.628 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:00:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:00:05.649 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:00:05.652 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:00:05.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:00:05.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:00:05.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:00:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.886+0000 7fb282774700 1 Processor -- start 2024-01-21T20:00:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.886+0000 7fb282774700 1 -- start start 2024-01-21T20:00:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb282774700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb282774700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb27c13aa00 0x7fb27c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb282774700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c1584f0 con 0x7fb27c0626f0 2024-01-21T20:00:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb282774700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0bd6f0 con 0x7fb27c13aa00 2024-01-21T20:00:05.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb282774700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0654e0 con 0x7fb27c13a620 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb27b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb27c13aa00 0x7fb27c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:41864/0 (socket says 172.21.15.133:41864) 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb27b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb27c13aa00 0x7fb27c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:55674/0 (socket says 172.21.15.133:55674) 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb27bfff700 1 -- 172.21.15.133:0/1357065009 learned_addr learned my addr 172.21.15.133:0/1357065009 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.887+0000 7fb280d11700 1 --1- 172.21.15.133:0/1357065009 >> v1:172.21.15.178:6789/0 conn(0x7fb27c0626f0 0x7fb27c0695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:41072/0 (socket says 172.21.15.133:41072) 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27b7fe700 1 -- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 msgr2=0x7fb27c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27b7fe700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27b7fe700 1 -- 172.21.15.133:0/1357065009 >> v1:172.21.15.178:6789/0 conn(0x7fb27c0626f0 legacy=0x7fb27c0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27b7fe700 1 -- 172.21.15.133:0/1357065009 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c158730 con 0x7fb27c13aa00 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27bfff700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27b7fe700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13aa00 0x7fb27c158000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb270009760 tx=0x7fb270009060).ready entity=mon.1 client_cookie=4a9ca5f7ba36f32c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:05.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27affd700 1 -- 172.21.15.133:0/1357065009 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2700090d0 con 0x7fb27c13aa00 2024-01-21T20:00:05.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27affd700 1 -- 172.21.15.133:0/1357065009 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000f510 con 0x7fb27c13aa00 2024-01-21T20:00:05.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.888+0000 7fb27affd700 1 -- 172.21.15.133:0/1357065009 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000f890 con 0x7fb27c13aa00 2024-01-21T20:00:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 -- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13aa00 msgr2=0x7fb27c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13aa00 0x7fb27c158000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb270009760 tx=0x7fb270009060).stop 2024-01-21T20:00:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 -- 172.21.15.133:0/1357065009 shutdown_connections 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13a620 0x7fb27c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 --2- 172.21.15.133:0/1357065009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13aa00 0x7fb27c158000 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 -- 172.21.15.133:0/1357065009 >> 172.21.15.133:0/1357065009 conn(0x7fb27c0c7dc0 msgr2=0x7fb27c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 -- 172.21.15.133:0/1357065009 shutdown_connections 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.889+0000 7fb282774700 1 -- 172.21.15.133:0/1357065009 wait complete. 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.890+0000 7fb282774700 1 Processor -- start 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.890+0000 7fb282774700 1 -- start start 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13a620 0x7fb27c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13aa00 0x7fb27c0ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c13ce00 con 0x7fb27c0626f0 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0c19e0 con 0x7fb27c13a620 2024-01-21T20:00:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb282774700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0c1cc0 con 0x7fb27c13aa00 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51300/0 (socket says 172.21.15.133:51300) 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 -- 172.21.15.133:0/1689159432 learned_addr learned my addr 172.21.15.133:0/1689159432 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27b7fe700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13a620 0x7fb27c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb280d11700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13aa00 0x7fb27c0ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 -- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13aa00 msgr2=0x7fb27c0ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13aa00 0x7fb27c0ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 -- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13a620 msgr2=0x7fb27c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13a620 0x7fb27c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.891+0000 7fb27bfff700 1 -- 172.21.15.133:0/1689159432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c009370 con 0x7fb27c0626f0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb27bfff700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb26c00ea20 tx=0x7fb26c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00ee60 con 0x7fb27c0626f0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c00c850 con 0x7fb27c0626f0 2024-01-21T20:00:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2700092a0 con 0x7fb27c0626f0 2024-01-21T20:00:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c00cbd0 con 0x7fb27c0626f0 2024-01-21T20:00:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.892+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c0bf0d0 con 0x7fb27c0626f0 2024-01-21T20:00:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.893+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c0bf320 con 0x7fb27c0626f0 2024-01-21T20:00:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.893+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb26c01b400 con 0x7fb27c0626f0 2024-01-21T20:00:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.893+0000 7fb278ff9700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 0x7fb268061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.894+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb26c07a700 con 0x7fb27c0626f0 2024-01-21T20:00:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.894+0000 7fb27b7fe700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 0x7fb268061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.894+0000 7fb27b7fe700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 0x7fb268061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb270009760 tx=0x7fb270017000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:05.898+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb26c04ba20 con 0x7fb27c0626f0 2024-01-21T20:00:06.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.086+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb27c06a6a0 con 0x7fb26805f150 2024-01-21T20:00:06.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.088+0000 7fb278ff9700 1 -- 172.21.15.133:0/1689159432 <== mgr.4104 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb27c06a6a0 con 0x7fb26805f150 2024-01-21T20:00:06.079 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:00:06.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:00:06.079 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:00:06.079 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:00:06.079 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 msgr2=0x7fb268061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 0x7fb268061610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb270009760 tx=0x7fb270017000).stop 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 msgr2=0x7fb27c139650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb26c00ea20 tx=0x7fb26c0090f0).stop 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 shutdown_connections 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb26805f150 0x7fb268061610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb27c13aa00 0x7fb27c0ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb27c0626f0 0x7fb27c139650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 --2- 172.21.15.133:0/1689159432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb27c13a620 0x7fb27c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.089+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 >> 172.21.15.133:0/1689159432 conn(0x7fb27c0c7dc0 msgr2=0x7fb27c156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.090+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 shutdown_connections 2024-01-21T20:00:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.090+0000 7fb282774700 1 -- 172.21.15.133:0/1689159432 wait complete. 2024-01-21T20:00:06.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:00:06.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.219+0000 7fdfdf7c8700 1 Processor -- start 2024-01-21T20:00:06.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.219+0000 7fdfdf7c8700 1 -- start start 2024-01-21T20:00:06.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdf7c8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8062c10 0x7fdfd8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdf7c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfd80697e0 0x7fdfd8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdf7c8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80634e0 con 0x7fdfd8069c40 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdf7c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd806a130 con 0x7fdfd80697e0 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdf7c8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806a410 con 0x7fdfd8062c10 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfd80697e0 0x7fdfd8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfd80697e0 0x7fdfd8065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51312/0 (socket says 172.21.15.133:51312) 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 -- 172.21.15.133:0/3265100195 learned_addr learned my addr 172.21.15.133:0/3265100195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdd564700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8062c10 0x7fdfd8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 -- 172.21.15.133:0/3265100195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8062c10 msgr2=0x7fdfd8062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8062c10 0x7fdfd8062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 -- 172.21.15.133:0/3265100195 >> v1:172.21.15.178:6789/0 conn(0x7fdfd8069c40 legacy=0x7fdfd81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 -- 172.21.15.133:0/3265100195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd806a6f0 con 0x7fdfd80697e0 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfdcd63700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8065660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fdfc8006fd0 tx=0x7fdfc80090f0).ready entity=mon.0 client_cookie=74ff026fcff7c4a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:06.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfcffff700 1 -- 172.21.15.133:0/3265100195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800b580 con 0x7fdfd80697e0 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfcffff700 1 -- 172.21.15.133:0/3265100195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800b6e0 con 0x7fdfd80697e0 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.220+0000 7fdfcffff700 1 -- 172.21.15.133:0/3265100195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800ba80 con 0x7fdfd80697e0 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/3265100195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 msgr2=0x7fdfd8065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8065660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fdfc8006fd0 tx=0x7fdfc80090f0).stop 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/3265100195 shutdown_connections 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8062c10 0x7fdfd8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/3265100195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8065660 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/3265100195 >> 172.21.15.133:0/3265100195 conn(0x7fdfd80c8010 msgr2=0x7fdfd80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/3265100195 shutdown_connections 2024-01-21T20:00:06.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.221+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/3265100195 wait complete. 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.222+0000 7fdfdf7c8700 1 Processor -- start 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.222+0000 7fdfdf7c8700 1 -- start start 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfd8062c10 0x7fdfd8153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 0x7fdfd8155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80a8db0 con 0x7fdfd80697e0 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80a81a0 con 0x7fdfd8062c10 2024-01-21T20:00:06.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdf7c8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80a8480 con 0x7fdfd8069c40 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51326/0 (socket says 172.21.15.133:51326) 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 -- 172.21.15.133:0/1615671498 learned_addr learned my addr 172.21.15.133:0/1615671498 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdd564700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfd8062c10 0x7fdfd8153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfddd65700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 0x7fdfd8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 -- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 msgr2=0x7fdfd8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 0x7fdfd8155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 -- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfd8062c10 msgr2=0x7fdfd8153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfd8062c10 0x7fdfd8153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 -- 172.21.15.133:0/1615671498 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009370 con 0x7fdfd80697e0 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfddd65700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 0x7fdfd8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.223+0000 7fdfdcd63700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fdfc8011000 tx=0x7fdfc8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:06.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.224+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8006970 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.224+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800be40 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.224+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd80a8760 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.224+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc801c420 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.224+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd80a7db0 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.225+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd805fdf0 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.225+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdfc801c810 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.225+0000 7fdfcdffb700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 0x7fdfbc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.226+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdfc807bd20 con 0x7fdfd80697e0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.226+0000 7fdfdd564700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 0x7fdfbc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:06.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.226+0000 7fdfdd564700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 0x7fdfbc061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdfd4009b90 tx=0x7fdfd4009060).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:06.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.230+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfc804cff0 con 0x7fdfd80697e0 2024-01-21T20:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.437+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fdfd80bcf70 con 0x7fdfd80697e0 2024-01-21T20:00:06.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.896+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fdfc8079af0 con 0x7fdfd80697e0 2024-01-21T20:00:06.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.897+0000 7fdfcdffb700 1 -- 172.21.15.133:0/1615671498 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v5) v1 ==== 92+0+0 (secure 0 0 0) 0x7fdfc8042f60 con 0x7fdfd80697e0 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 msgr2=0x7fdfbc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 0x7fdfbc061610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fdfd4009b90 tx=0x7fdfd4009060).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 msgr2=0x7fdfd8154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fdfc8011000 tx=0x7fdfc8017000).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 shutdown_connections 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfbc05f150 0x7fdfbc061610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfd8069c40 0x7fdfd8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfd8062c10 0x7fdfd8153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 --2- 172.21.15.133:0/1615671498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfd80697e0 0x7fdfd8154e50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 >> 172.21.15.133:0/1615671498 conn(0x7fdfd80c8010 msgr2=0x7fdfd80a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 shutdown_connections 2024-01-21T20:00:06.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:06.899+0000 7fdfdf7c8700 1 -- 172.21.15.133:0/1615671498 wait complete. 2024-01-21T20:00:06.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:00:07.024 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:07.032+0000 7f5c92d9a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:00:07.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 Processor -- start 2024-01-21T20:00:07.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 -- start start 2024-01-21T20:00:07.027 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:07.036+0000 7f7573b23680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5f013a830 0x7fb5f00c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5f013ac10 0x7fb5f00bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f00c3890 con 0x7fb5f00695b0 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00c3b70 con 0x7fb5f013ac10 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.036+0000 7fb5f6f8b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f00c3e50 con 0x7fb5f013a830 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5f013ac10 0x7fb5f00bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5f013ac10 0x7fb5f00bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51348/0 (socket says 172.21.15.133:51348) 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 -- 172.21.15.133:0/3260349512 learned_addr learned my addr 172.21.15.133:0/3260349512 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5f4d27700 1 --2- 172.21.15.133:0/3260349512 >> v2:172.21.15.178:3300/0 conn(0x7fb5f013a830 0x7fb5f00c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 -- 172.21.15.133:0/3260349512 >> v2:172.21.15.178:3300/0 conn(0x7fb5f013a830 msgr2=0x7fb5f00c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 --2- 172.21.15.133:0/3260349512 >> v2:172.21.15.178:3300/0 conn(0x7fb5f013a830 0x7fb5f00c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 -- 172.21.15.133:0/3260349512 >> v1:172.21.15.178:6789/0 conn(0x7fb5f00695b0 legacy=0x7fb5f00699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 -- 172.21.15.133:0/3260349512 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f00c4130 con 0x7fb5f013ac10 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5effff700 1 --2- 172.21.15.133:0/3260349512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f013ac10 0x7fb5f00bce60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fb5f0068230 tx=0x7fb5dc0090f0).ready entity=mon.0 client_cookie=8cd6ed49318f4e1c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5ef7fe700 1 -- 172.21.15.133:0/3260349512 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00b520 con 0x7fb5f013ac10 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5ef7fe700 1 -- 172.21.15.133:0/3260349512 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc00b680 con 0x7fb5f013ac10 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.037+0000 7fb5ef7fe700 1 -- 172.21.15.133:0/3260349512 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc00ba20 con 0x7fb5f013ac10 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/3260349512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f013ac10 msgr2=0x7fb5f00bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/3260349512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f013ac10 0x7fb5f00bce60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fb5f0068230 tx=0x7fb5dc0090f0).stop 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/3260349512 shutdown_connections 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/3260349512 >> v2:172.21.15.178:3300/0 conn(0x7fb5f013a830 0x7fb5f00c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/3260349512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f013ac10 0x7fb5f00bce60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/3260349512 >> 172.21.15.133:0/3260349512 conn(0x7fb5f00c7dc0 msgr2=0x7fb5f00c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/3260349512 shutdown_connections 2024-01-21T20:00:07.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.038+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/3260349512 wait complete. 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.039+0000 7fb5f6f8b700 1 Processor -- start 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.039+0000 7fb5f6f8b700 1 -- start start 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5f013a830 0x7fb5f00a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5f013ac10 0x7fb5f00626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f01624f0 con 0x7fb5f00695b0 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00aa460 con 0x7fb5f013a830 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f6f8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f00aa740 con 0x7fb5f013ac10 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51352/0 (socket says 172.21.15.133:51352) 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 -- 172.21.15.133:0/2108997020 learned_addr learned my addr 172.21.15.133:0/2108997020 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5effff700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5f013a830 0x7fb5f00a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f5528700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5f013ac10 0x7fb5f00626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 -- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5f013ac10 msgr2=0x7fb5f00626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5f013ac10 0x7fb5f00626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 -- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5f013a830 msgr2=0x7fb5f00a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5f013a830 0x7fb5f00a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.040+0000 7fb5f4d27700 1 -- 172.21.15.133:0/2108997020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009370 con 0x7fb5f00695b0 2024-01-21T20:00:07.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5f4d27700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fb5e400e950 tx=0x7fb5e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400c6a0 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e400c800 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f01626e0 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400cb80 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.041+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f01633d0 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f005fdf0 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fb5e401b400 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5ed7fa700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 0x7fb5d4061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5effff700 1 -- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 msgr2=0x7fb5d4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb5e407a7e0 con 0x7fb5f00695b0 2024-01-21T20:00:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.042+0000 7fb5effff700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 0x7fb5d4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:00:07.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.046+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5e404bb00 con 0x7fb5f00695b0 2024-01-21T20:00:07.088 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:07.096+0000 7f5c92d9a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:00:07.093 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:07.102+0000 7f7573b23680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:00:07.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.220+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb5f00c4410 con 0x7fb5f00695b0 2024-01-21T20:00:07.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.224+0000 7fb5ed7fa700 1 -- 172.21.15.133:0/2108997020 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v3)=0 v3) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb5f00c4410 con 0x7fb5f00695b0 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 msgr2=0x7fb5d4061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 0x7fb5d4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 msgr2=0x7fb5f0162ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fb5e400e950 tx=0x7fb5e4009060).stop 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 shutdown_connections 2024-01-21T20:00:07.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5d405f1a0 0x7fb5d4061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5f013ac10 0x7fb5f00626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5f00695b0 0x7fb5f0162ee0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 --2- 172.21.15.133:0/2108997020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5f013a830 0x7fb5f00a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 >> 172.21.15.133:0/2108997020 conn(0x7fb5f00c7dc0 msgr2=0x7fb5f0153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 shutdown_connections 2024-01-21T20:00:07.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.226+0000 7fb5f6f8b700 1 -- 172.21.15.133:0/2108997020 wait complete. 2024-01-21T20:00:07.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:07.229 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T20:00:07.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:07.251 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2024-01-21T20:00:07.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2024-01-21T20:00:07.363 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:07.371+0000 7f5c92d9a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:00:07.382 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:07.391+0000 7f7573b23680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:00:07.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.484+0000 7f00f29d6700 1 Processor -- start 2024-01-21T20:00:07.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.484+0000 7f00f29d6700 1 -- start start 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f29d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec14e8d0 0x7f00ec05e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f29d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f00ec14ecb0 0x7f00ec155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f29d6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec0c9040 con 0x7f00ec155a60 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f29d6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec0c9290 con 0x7f00ec14ecb0 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f29d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c9570 con 0x7f00ec14e8d0 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f00ec14ecb0 0x7f00ec155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f0f73700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f00ec155a60 0x7f00ec0c0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40082/0 (socket says 172.21.15.133:40082) 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00f0f73700 1 -- 172.21.15.133:0/812289746 learned_addr learned my addr 172.21.15.133:0/812289746 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00ebfff700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec14e8d0 0x7f00ec05e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eb7fe700 1 -- 172.21.15.133:0/812289746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec14e8d0 msgr2=0x7f00ec05e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:07.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec14e8d0 0x7f00ec05e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eb7fe700 1 -- 172.21.15.133:0/812289746 >> v1:172.21.15.133:6789/0 conn(0x7f00ec155a60 legacy=0x7f00ec0c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eaffd700 1 -- 172.21.15.133:0/812289746 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380105337 0 0) 0x7f00ec0c9040 con 0x7f00ec155a60 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.485+0000 7f00eb7fe700 1 -- 172.21.15.133:0/812289746 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec0c9850 con 0x7f00ec14ecb0 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14ecb0 0x7f00ec155570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f00e0009760 tx=0x7f00e0009060).ready entity=mon.0 client_cookie=22cfa50651786cbd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00eaffd700 1 -- 172.21.15.133:0/812289746 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000f510 con 0x7f00ec14ecb0 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00eaffd700 1 -- 172.21.15.133:0/812289746 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000f670 con 0x7f00ec14ecb0 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00eaffd700 1 -- 172.21.15.133:0/812289746 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000f9f0 con 0x7f00ec14ecb0 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 -- 172.21.15.133:0/812289746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14ecb0 msgr2=0x7f00ec155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14ecb0 0x7f00ec155570 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f00e0009760 tx=0x7f00e0009060).stop 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 -- 172.21.15.133:0/812289746 shutdown_connections 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec14e8d0 0x7f00ec05e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 --2- 172.21.15.133:0/812289746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14ecb0 0x7f00ec155570 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 -- 172.21.15.133:0/812289746 >> 172.21.15.133:0/812289746 conn(0x7f00ec084eb0 msgr2=0x7f00ec0947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.486+0000 7f00f29d6700 1 -- 172.21.15.133:0/812289746 shutdown_connections 2024-01-21T20:00:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.487+0000 7f00f29d6700 1 -- 172.21.15.133:0/812289746 wait complete. 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.488+0000 7f00f29d6700 1 Processor -- start 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.488+0000 7f00f29d6700 1 -- start start 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00ec14ecb0 0x7f00ec158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec155a60 0x7f00ec0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec14aa50 con 0x7f00ec14e8d0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c44d0 con 0x7f00ec14ecb0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec0c38c0 con 0x7f00ec155a60 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51364/0 (socket says 172.21.15.133:51364) 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 -- 172.21.15.133:0/1998004108 learned_addr learned my addr 172.21.15.133:0/1998004108 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f0f73700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec155a60 0x7f00ec0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00ec14ecb0 0x7f00ec158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec155a60 msgr2=0x7f00ec0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec155a60 0x7f00ec0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00ec14ecb0 msgr2=0x7f00ec158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00ec14ecb0 0x7f00ec158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00092a0 con 0x7f00ec14e8d0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00ebfff700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f00dc00e930 tx=0x7f00dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc012600 con 0x7f00ec14e8d0 2024-01-21T20:00:07.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc012760 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec0c3ba0 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc012ae0 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.489+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec0c4160 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f00dc01b400 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec1568c0 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00e8ff9700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00eb7fe700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f00dc07a6a0 con 0x7f00ec14e8d0 2024-01-21T20:00:07.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.491+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:00:07.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.495+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f00dc04b910 con 0x7f00ec14e8d0 2024-01-21T20:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.692+0000 7f00eb7fe700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.692+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:00:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:07.706+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00ec05fdf0 con 0x7f00d805f1a0 2024-01-21T20:00:07.977 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:07.985+0000 7f5c92d9a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:00:08.021 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.030+0000 7f7573b23680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:00:08.048 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.057+0000 7f5c92d9a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:00:08.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:08.093+0000 7f00eb7fe700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:08.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:08.093+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:00:08.093 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.102+0000 7f7573b23680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:00:08.235 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.243+0000 7f5c92d9a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:00:08.278 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.287+0000 7f7573b23680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:00:08.654 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.663+0000 7f5c92d9a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:00:08.697 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.706+0000 7f7573b23680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:00:08.757 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.766+0000 7f5c92d9a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:00:08.800 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.809+0000 7f7573b23680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:00:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:08.894+0000 7f00eb7fe700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:08.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:08.894+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:00:08.910 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.919+0000 7f5c92d9a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:00:08.954 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:08.963+0000 7f7573b23680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:00:08.985 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:08.993+0000 7f5c92d9a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:00:09.027 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:09.037+0000 7f7573b23680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:00:09.050 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:09.059+0000 7f5c92d9a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:00:09.094 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:09.103+0000 7f7573b23680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:00:09.304 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:09.313+0000 7f5c92d9a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:00:09.348 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:09.357+0000 7f7573b23680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:00:09.486 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:09.495+0000 7f5c92d9a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:00:09.530 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:09.539+0000 7f7573b23680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:00:10.137 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.145+0000 7f5c92d9a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:00:10.177 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.186+0000 7f7573b23680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:00:10.204 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.213+0000 7f5c92d9a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:00:10.245 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.254+0000 7f7573b23680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:00:10.279 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.287+0000 7f5c92d9a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:00:10.319 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.328+0000 7f7573b23680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:00:10.424 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.432+0000 7f5c92d9a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:00:10.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.472+0000 7f7573b23680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:00:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:10.495+0000 7f00eb7fe700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:00:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:10.495+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:00:10.493 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.502+0000 7f5c92d9a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:00:10.533 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.542+0000 7f7573b23680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:00:10.607 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.616+0000 7f5c92d9a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:00:10.647 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.656+0000 7f7573b23680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:00:10.713 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:10.722+0000 7f5c92d9a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:00:10.754 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:10.763+0000 7f7573b23680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:00:11.004 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:11.013+0000 7f5c92d9a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:00:11.043 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.053+0000 7f7573b23680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:00:11.073 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:00:11.082+0000 7f5c92d9a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:00:11.114 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.123+0000 7f7573b23680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:00:11.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:11.142+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 6) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f00dc078470 con 0x7f00ec14e8d0 2024-01-21T20:00:11.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:11.142+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d8061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:00:11.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:11.142+0000 7f00e8ff9700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:11.202 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.210+0000 7f74e78c3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.202 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.210+0000 7f74e78c3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.202 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.210+0000 7f74e78c3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.202 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.210+0000 7f74e78c3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.210+0000 7f74e78c3700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.211+0000 7f74ea8c9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.211+0000 7f74ea8c9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.211+0000 7f74ea8c9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.211+0000 7f74ea8c9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:11.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:00:11.211+0000 7f74ea8c9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:00:12.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.157+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f00dc0787f0 con 0x7f00ec14e8d0 2024-01-21T20:00:12.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.157+0000 7f00e8ff9700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.157+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00ec05fdf0 con 0x7f00d805f1a0 2024-01-21T20:00:12.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.158+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.159+0000 7f00eb7fe700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d80615e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f00ec083bb0 tx=0x7f00e0017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.189+0000 7f00e8ff9700 1 -- 172.21.15.133:0/1998004108 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f00ec05fdf0 con 0x7f00d805f1a0 2024-01-21T20:00:12.180 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir0 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.191+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 msgr2=0x7f00d80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.191+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d80615e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f00ec083bb0 tx=0x7f00e0017000).stop 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 msgr2=0x7f00ec14a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f00dc00e930 tx=0x7f00dc009060).stop 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 shutdown_connections 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f00d805f1a0 0x7f00d80615e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00ec155a60 0x7f00ec0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00ec14e8d0 0x7f00ec14a560 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 --2- 172.21.15.133:0/1998004108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00ec14ecb0 0x7f00ec158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 >> 172.21.15.133:0/1998004108 conn(0x7f00ec084eb0 msgr2=0x7f00ec0a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 shutdown_connections 2024-01-21T20:00:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.192+0000 7f00f29d6700 1 -- 172.21.15.133:0/1998004108 wait complete. 2024-01-21T20:00:12.196 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2024-01-21T20:00:12.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:12.196 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2024-01-21T20:00:12.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2024-01-21T20:00:12.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 Processor -- start 2024-01-21T20:00:12.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 -- start start 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d8c066990 0x7f9d8c066df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c0be990 con 0x7f9d8c0c3600 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8c15d1a0 con 0x7f9d8c142150 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.428+0000 7f9d92887700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d8c0672e0 con 0x7f9d8c066990 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d8c066990 0x7f9d8c066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d90e24700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9d8c0c3600 0x7f9d8c0637e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47238/0 (socket says 172.21.15.133:47238) 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d90e24700 1 -- 172.21.15.133:0/2785044988 learned_addr learned my addr 172.21.15.133:0/2785044988 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:12.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8b7fe700 1 -- 172.21.15.133:0/2785044988 >> v1:172.21.15.178:6789/0 conn(0x7f9d8c142150 legacy=0x7f9d8c0bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8b7fe700 1 -- 172.21.15.133:0/2785044988 >> v1:172.21.15.133:6789/0 conn(0x7f9d8c0c3600 legacy=0x7f9d8c0637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8b7fe700 1 -- 172.21.15.133:0/2785044988 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c0be060 con 0x7f9d8c066990 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8b7fe700 1 --2- 172.21.15.133:0/2785044988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c066df0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f9d80009760 tx=0x7f9d80009060).ready entity=mon.0 client_cookie=11c43d6f0e29e2f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8affd700 1 -- 172.21.15.133:0/2785044988 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000b520 con 0x7f9d8c066990 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8affd700 1 -- 172.21.15.133:0/2785044988 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8000b680 con 0x7f9d8c066990 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.429+0000 7f9d8affd700 1 -- 172.21.15.133:0/2785044988 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8000ba00 con 0x7f9d8c066990 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 -- 172.21.15.133:0/2785044988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 msgr2=0x7f9d8c066df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 --2- 172.21.15.133:0/2785044988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c066df0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f9d80009760 tx=0x7f9d80009060).stop 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 -- 172.21.15.133:0/2785044988 shutdown_connections 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 --2- 172.21.15.133:0/2785044988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c066df0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 -- 172.21.15.133:0/2785044988 >> 172.21.15.133:0/2785044988 conn(0x7f9d8c0c8f60 msgr2=0x7f9d8c0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 -- 172.21.15.133:0/2785044988 shutdown_connections 2024-01-21T20:00:12.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.430+0000 7f9d92887700 1 -- 172.21.15.133:0/2785044988 wait complete. 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.431+0000 7f9d92887700 1 Processor -- start 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.431+0000 7f9d92887700 1 -- start start 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d8c0c3600 0x7f9d8c0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d8c142150 0x7f9d8c0c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0a9130 con 0x7f9d8c066990 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c158300 con 0x7f9d8c142150 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d92887700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c0a8b20 con 0x7f9d8c0c3600 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37272/0 (socket says 172.21.15.133:37272) 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 -- 172.21.15.133:0/2568745193 learned_addr learned my addr 172.21.15.133:0/2568745193 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:12.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8b7fe700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d8c0c3600 0x7f9d8c0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d90e24700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d8c142150 0x7f9d8c0c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 -- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d8c0c3600 msgr2=0x7f9d8c0a95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d8c0c3600 0x7f9d8c0a95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 -- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d8c142150 msgr2=0x7f9d8c0c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d8c142150 0x7f9d8c0c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 -- 172.21.15.133:0/2568745193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800092a0 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.432+0000 7f9d8bfff700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9d7c00b460 tx=0x7f9d7c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.433+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012410 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.433+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c012590 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.433+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c169790 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.433+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c012950 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.433+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c169a70 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.434+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c0a9410 con 0x7f9d8c066990 2024-01-21T20:00:12.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.434+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f9d7c012d00 con 0x7f9d8c066990 2024-01-21T20:00:12.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.434+0000 7f9d88ff9700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 0x7f9d78061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.434+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f9d7c079ee0 con 0x7f9d8c066990 2024-01-21T20:00:12.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.434+0000 7f9d8b7fe700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 0x7f9d78061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.435+0000 7f9d8b7fe700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 0x7f9d78061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9d8c134c60 tx=0x7f9d80017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.438+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d7c04b2d0 con 0x7f9d8c066990 2024-01-21T20:00:12.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.626+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d8c05fdf0 con 0x7f9d7805f080 2024-01-21T20:00:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.630+0000 7f9d88ff9700 1 -- 172.21.15.133:0/2568745193 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9d8c05fdf0 con 0x7f9d7805f080 2024-01-21T20:00:12.659 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir1 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 msgr2=0x7f9d78061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 0x7f9d78061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9d8c134c60 tx=0x7f9d80017000).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 msgr2=0x7f9d8c157840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9d7c00b460 tx=0x7f9d7c006f20).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 shutdown_connections 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9d7805f080 0x7f9d78061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d8c142150 0x7f9d8c0c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d8c066990 0x7f9d8c157840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 --2- 172.21.15.133:0/2568745193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d8c0c3600 0x7f9d8c0a95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 >> 172.21.15.133:0/2568745193 conn(0x7f9d8c0c8f60 msgr2=0x7f9d8c0c3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:12.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 shutdown_connections 2024-01-21T20:00:12.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.632+0000 7f9d92887700 1 -- 172.21.15.133:0/2568745193 wait complete. 2024-01-21T20:00:12.662 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2024-01-21T20:00:12.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:12.662 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2024-01-21T20:00:12.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2024-01-21T20:00:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.853+0000 7fe2897fb700 1 Processor -- start 2024-01-21T20:00:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.853+0000 7fe2897fb700 1 -- start start 2024-01-21T20:00:12.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2897fb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe284064df0 0x7fe284154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2897fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe284069e30 con 0x7fe284150840 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2897fb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840bcb60 con 0x7fe284150460 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2897fb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2841552c0 con 0x7fe284064df0 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2827fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe284150840 0x7fe2840646e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47244/0 (socket says 172.21.15.133:47244) 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2827fc700 1 -- 172.21.15.133:0/1590855627 learned_addr learned my addr 172.21.15.133:0/1590855627 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972288179 0 0) 0x7fe284069e30 con 0x7fe284150840 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe2837fe700 1 --2- 172.21.15.133:0/1590855627 >> v2:172.21.15.178:3300/0 conn(0x7fe284064df0 0x7fe284154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.854+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe26c0033f0 con 0x7fe284150840 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3615857560 0 0) 0x7fe26c0033f0 con 0x7fe284150840 2024-01-21T20:00:12.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 >> v2:172.21.15.178:3300/0 conn(0x7fe284064df0 msgr2=0x7fe284154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 --2- 172.21.15.133:0/1590855627 >> v2:172.21.15.178:3300/0 conn(0x7fe284064df0 0x7fe284154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 >> v1:172.21.15.178:6789/0 conn(0x7fe284150460 legacy=0x7fe284068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284069220 con 0x7fe284150840 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe274001470 con 0x7fe284150840 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 >> v1:172.21.15.133:6789/0 conn(0x7fe284150840 legacy=0x7fe2840646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c0038e0 0x7fe26c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c004690 0x7fe26c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe26c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2841552c0 con 0x7fe26c005050 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00bfe0 con 0x7fe26c004690 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c00c1a0 con 0x7fe26c0038e0 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe26c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe282ffd700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c0038e0 0x7fe26c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2827fc700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c004690 0x7fe26c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 -- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c0038e0 msgr2=0x7fe26c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe26c0038e0 0x7fe26c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 -- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c004690 msgr2=0x7fe26c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe26c004690 0x7fe26c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 -- 172.21.15.133:0/1590855627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c0033f0 con 0x7fe26c005050 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 -- 172.21.15.133:0/1590855627 reap_dead start 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe2837fe700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe26c00b8e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe27c0094d0 tx=0x7fe27c00b040).ready entity=mon.0 client_cookie=c9161994ef7e02d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009ac0 con 0x7fe26c005050 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00f040 con 0x7fe26c005050 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.855+0000 7fe281ffb700 1 -- 172.21.15.133:0/1590855627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00ecb0 con 0x7fe26c005050 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 -- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 msgr2=0x7fe26c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe26c00b8e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fe27c0094d0 tx=0x7fe27c00b040).stop 2024-01-21T20:00:12.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 -- 172.21.15.133:0/1590855627 shutdown_connections 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 --2- 172.21.15.133:0/1590855627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe26c00b8e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 -- 172.21.15.133:0/1590855627 >> 172.21.15.133:0/1590855627 conn(0x7fe2840626f0 msgr2=0x7fe284062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 -- 172.21.15.133:0/1590855627 shutdown_connections 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.856+0000 7fe2897fb700 1 -- 172.21.15.133:0/1590855627 wait complete. 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.857+0000 7fe2897fb700 1 Processor -- start 2024-01-21T20:00:12.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.857+0000 7fe2897fb700 1 -- start start 2024-01-21T20:00:12.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 0x7fe28414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 0x7fe28414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28414ee90 con 0x7fe26c005050 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840c6740 con 0x7fe2840be110 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2897fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840ab070 con 0x7fe2840bdc90 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37284/0 (socket says 172.21.15.133:37284) 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 -- 172.21.15.133:0/2729530689 learned_addr learned my addr 172.21.15.133:0/2729530689 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2827fc700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 0x7fe28414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe2837fe700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 0x7fe28414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 -- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 msgr2=0x7fe28414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 0x7fe28414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 -- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 msgr2=0x7fe28414e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.858+0000 7fe282ffd700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 0x7fe28414e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:12.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe282ffd700 1 -- 172.21.15.133:0/2729530689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840ab350 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe2827fc700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 0x7fe28414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe2837fe700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 0x7fe28414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe282ffd700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe278002920 tx=0x7fe278007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800f6c0 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800f820 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2840ab630 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800fbc0 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.859+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2840c5d90 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.860+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 7) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe27801d3b0 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.860+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2840c6230 con 0x7fe26c005050 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.860+0000 7fe26b7fe700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 0x7fe270061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.860+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fe278079e90 con 0x7fe26c005050 2024-01-21T20:00:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.860+0000 7fe2827fc700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 0x7fe270061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.861+0000 7fe2827fc700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 0x7fe270061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe2740015a0 tx=0x7fe274009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:12.864+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe2840c6230 con 0x7fe26c005050 2024-01-21T20:00:13.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.050+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2840c6230 con 0x7fe27005f080 2024-01-21T20:00:13.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.056+0000 7fe26b7fe700 1 -- 172.21.15.133:0/2729530689 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe2840c6230 con 0x7fe27005f080 2024-01-21T20:00:13.048 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir2 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 msgr2=0x7fe270061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 0x7fe270061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe2740015a0 tx=0x7fe274009040).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 msgr2=0x7fe2840c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fe278002920 tx=0x7fe278007b90).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 shutdown_connections 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe27005f080 0x7fe270061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2840be110 0x7fe28414e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe26c005050 0x7fe2840c58a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 --2- 172.21.15.133:0/2729530689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2840bdc90 0x7fe28414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 >> 172.21.15.133:0/2729530689 conn(0x7fe2840626f0 msgr2=0x7fe28414d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:13.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 shutdown_connections 2024-01-21T20:00:13.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.058+0000 7fe2897fb700 1 -- 172.21.15.133:0/2729530689 wait complete. 2024-01-21T20:00:13.061 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2024-01-21T20:00:13.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:13.062 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2024-01-21T20:00:13.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2024-01-21T20:00:13.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.253+0000 7f01c6466700 1 Processor -- start 2024-01-21T20:00:13.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.253+0000 7f01c6466700 1 -- start start 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c6466700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01c00bf4f0 0x7f01c00c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c6466700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0063c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c6466700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00c3c60 con 0x7f01c0067d70 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c6466700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c0068cf0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c6466700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0064150 con 0x7f01c0063800 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c4a03700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01c0067d70 0x7f01c0068200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47260/0 (socket says 172.21.15.133:47260) 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01c4a03700 1 -- 172.21.15.133:0/2422471033 learned_addr learned my addr 172.21.15.133:0/2422471033 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:13.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01bffff700 1 --2- 172.21.15.133:0/2422471033 >> v2:172.21.15.178:3300/0 conn(0x7f01c00bf4f0 0x7f01c00c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01bf7fe700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090862529 0 0) 0x7f01c00c3c60 con 0x7f01c0067d70 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.254+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a80033f0 con 0x7f01c0067d70 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371075578 0 0) 0x7f01a80033f0 con 0x7f01c0067d70 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bffff700 1 -- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 msgr2=0x7f01c0063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bffff700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bffff700 1 -- 172.21.15.133:0/2422471033 >> v1:172.21.15.133:6789/0 conn(0x7f01c0067d70 legacy=0x7f01c0068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bffff700 1 -- 172.21.15.133:0/2422471033 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00bf8d0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bf7fe700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01bffff700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c00bf4f0 0x7f01c00c40f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f01b4009760 tx=0x7f01b4009060).ready entity=mon.1 client_cookie=db4b414066284f93 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80017f0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4011400 con 0x7f01c00bf4f0 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01beffd700 1 -- 172.21.15.133:0/2422471033 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4011780 con 0x7f01c00bf4f0 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01c6466700 1 -- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c00bf4f0 msgr2=0x7f01c00c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01c6466700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c00bf4f0 0x7f01c00c40f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f01b4009760 tx=0x7f01b4009060).stop 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.255+0000 7f01c6466700 1 -- 172.21.15.133:0/2422471033 shutdown_connections 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.256+0000 7f01c6466700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c00bf4f0 0x7f01c00c40f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.256+0000 7f01c6466700 1 --2- 172.21.15.133:0/2422471033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.256+0000 7f01c6466700 1 -- 172.21.15.133:0/2422471033 >> 172.21.15.133:0/2422471033 conn(0x7f01c0066a70 msgr2=0x7f01c0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.256+0000 7f01c6466700 1 -- 172.21.15.133:0/2422471033 shutdown_connections 2024-01-21T20:00:13.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.256+0000 7f01c6466700 1 -- 172.21.15.133:0/2422471033 wait complete. 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.257+0000 7f01c6466700 1 Processor -- start 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.257+0000 7f01c6466700 1 -- start start 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c0067d70 0x7f01c014ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c014f710 con 0x7f01c00bf4f0 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c01526d0 con 0x7f01c0067d70 2024-01-21T20:00:13.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0152380 con 0x7f01c0063800 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37290/0 (socket says 172.21.15.133:37290) 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 -- 172.21.15.133:0/233780903 learned_addr learned my addr 172.21.15.133:0/233780903 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01bf7fe700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c0067d70 0x7f01c014ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01bffff700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 -- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 msgr2=0x7f01c0147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 -- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c0067d70 msgr2=0x7f01c014ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c0067d70 0x7f01c014ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 -- 172.21.15.133:0/233780903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00092a0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c4a03700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f01b800c930 tx=0x7f01b8001cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8004c40 con 0x7f01c00bf4f0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b8004dc0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b40092a0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80073c0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.258+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c00c5c70 con 0x7f01c00bf4f0 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c00c62a0 con 0x7f01c00bf4f0 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f01b8007730 con 0x7f01c00bf4f0 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01bcff9700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 0x7f01ac061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f01b807a420 con 0x7f01c00bf4f0 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01bffff700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 0x7f01ac061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.260+0000 7f01bffff700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 0x7f01ac061810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f01b4006e00 tx=0x7f01b4016000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.264+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f01b804b440 con 0x7f01c00bf4f0 2024-01-21T20:00:13.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.452+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f01c005fdf0 con 0x7f01ac05f350 2024-01-21T20:00:13.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.455+0000 7f01bcff9700 1 -- 172.21.15.133:0/233780903 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f01c005fdf0 con 0x7f01ac05f350 2024-01-21T20:00:13.447 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir3 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 msgr2=0x7f01ac061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 0x7f01ac061810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f01b4006e00 tx=0x7f01b4016000).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 msgr2=0x7f01c014f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f01b800c930 tx=0x7f01b8001cf0).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 shutdown_connections 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f350 0x7f01ac061810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c00bf4f0 0x7f01c014f220 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c0063800 0x7f01c0147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 --2- 172.21.15.133:0/233780903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c0067d70 0x7f01c014ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 >> 172.21.15.133:0/233780903 conn(0x7f01c0066a70 msgr2=0x7f01c0157020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:13.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 shutdown_connections 2024-01-21T20:00:13.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.457+0000 7f01c6466700 1 -- 172.21.15.133:0/233780903 wait complete. 2024-01-21T20:00:13.460 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2024-01-21T20:00:13.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:13.461 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2024-01-21T20:00:13.479 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2024-01-21T20:00:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.648+0000 7fdb706a5700 1 Processor -- start 2024-01-21T20:00:13.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.648+0000 7fdb706a5700 1 -- start start 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb706a5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 0x7fdb68154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb706a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb68069510 0x7fdb680626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb706a5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6806a4b0 con 0x7fdb680699a0 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb706a5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb68069ef0 con 0x7fdb68069510 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb706a5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6806a1d0 con 0x7fdb68154250 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb6dc40700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb68069510 0x7fdb680626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb6ec42700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb680699a0 0x7fdb681580c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47268/0 (socket says 172.21.15.133:47268) 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb6ec42700 1 -- 172.21.15.133:0/3514636300 learned_addr learned my addr 172.21.15.133:0/3514636300 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.649+0000 7fdb6e441700 1 --2- 172.21.15.133:0/3514636300 >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 0x7fdb68154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6dc40700 1 -- 172.21.15.133:0/3514636300 >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 msgr2=0x7fdb68154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6dc40700 1 --2- 172.21.15.133:0/3514636300 >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 0x7fdb68154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6dc40700 1 -- 172.21.15.133:0/3514636300 >> v1:172.21.15.133:6789/0 conn(0x7fdb680699a0 legacy=0x7fdb681580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6d43f700 1 -- 172.21.15.133:0/3514636300 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129464313 0 0) 0x7fdb6806a4b0 con 0x7fdb680699a0 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6dc40700 1 -- 172.21.15.133:0/3514636300 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68065720 con 0x7fdb68069510 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6e441700 1 --2- 172.21.15.133:0/3514636300 >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 0x7fdb68154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6dc40700 1 --2- 172.21.15.133:0/3514636300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68069510 0x7fdb680626f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fdb6806aad0 tx=0x7fdb64009060).ready entity=mon.0 client_cookie=74792b592c36d271 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6d43f700 1 -- 172.21.15.133:0/3514636300 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400b580 con 0x7fdb68069510 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6d43f700 1 -- 172.21.15.133:0/3514636300 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6400b6e0 con 0x7fdb68069510 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb6d43f700 1 -- 172.21.15.133:0/3514636300 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400ba60 con 0x7fdb68069510 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 -- 172.21.15.133:0/3514636300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68069510 msgr2=0x7fdb680626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 --2- 172.21.15.133:0/3514636300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68069510 0x7fdb680626f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fdb6806aad0 tx=0x7fdb64009060).stop 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 -- 172.21.15.133:0/3514636300 shutdown_connections 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 --2- 172.21.15.133:0/3514636300 >> v2:172.21.15.178:3300/0 conn(0x7fdb68154250 0x7fdb68154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 --2- 172.21.15.133:0/3514636300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68069510 0x7fdb680626f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 -- 172.21.15.133:0/3514636300 >> 172.21.15.133:0/3514636300 conn(0x7fdb680c7d30 msgr2=0x7fdb680c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 -- 172.21.15.133:0/3514636300 shutdown_connections 2024-01-21T20:00:13.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.650+0000 7fdb706a5700 1 -- 172.21.15.133:0/3514636300 wait complete. 2024-01-21T20:00:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 Processor -- start 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 -- start start 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb68069510 0x7fdb68165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680699a0 0x7fdb6814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6814f060 con 0x7fdb68154250 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6814fed0 con 0x7fdb68069510 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb706a5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6814e450 con 0x7fdb680699a0 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.652+0000 7fdb6ec42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37310/0 (socket says 172.21.15.133:37310) 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 -- 172.21.15.133:0/1993850651 learned_addr learned my addr 172.21.15.133:0/1993850651 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 -- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680699a0 msgr2=0x7fdb6814f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680699a0 0x7fdb6814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 -- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb68069510 msgr2=0x7fdb68165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb68069510 0x7fdb68165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 -- 172.21.15.133:0/1993850651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640092a0 con 0x7fdb68154250 2024-01-21T20:00:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb6ec42700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fdb6000c7e0 tx=0x7fdb60007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60005d30 con 0x7fdb68154250 2024-01-21T20:00:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60005e90 con 0x7fdb68154250 2024-01-21T20:00:13.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6814e730 con 0x7fdb68154250 2024-01-21T20:00:13.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60007320 con 0x7fdb68154250 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.653+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6814ecf0 con 0x7fdb68154250 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.654+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6814f340 con 0x7fdb68154250 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.654+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fdb60007710 con 0x7fdb68154250 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.655+0000 7fdb5effd700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 0x7fdb4c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.655+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fdb6007a630 con 0x7fdb68154250 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.655+0000 7fdb6e441700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 0x7fdb4c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.655+0000 7fdb6e441700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 0x7fdb4c061810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb58006d80 tx=0x7fdb58008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:13.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.659+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb6004b650 con 0x7fdb68154250 2024-01-21T20:00:13.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.845+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb6814f1a0 con 0x7fdb4c05f350 2024-01-21T20:00:13.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.848+0000 7fdb5effd700 1 -- 172.21.15.133:0/1993850651 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fdb6814f1a0 con 0x7fdb4c05f350 2024-01-21T20:00:13.840 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir4 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.850+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 msgr2=0x7fdb4c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.850+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 0x7fdb4c061810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fdb58006d80 tx=0x7fdb58008040).stop 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.850+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 msgr2=0x7fdb6814f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.850+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fdb6000c7e0 tx=0x7fdb60007f90).stop 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 shutdown_connections 2024-01-21T20:00:13.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb4c05f350 0x7fdb4c061810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb68154250 0x7fdb6814f9e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb68069510 0x7fdb68165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 --2- 172.21.15.133:0/1993850651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb680699a0 0x7fdb6814f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 >> 172.21.15.133:0/1993850651 conn(0x7fdb680c7d30 msgr2=0x7fdb6814cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 shutdown_connections 2024-01-21T20:00:13.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:13.851+0000 7fdb706a5700 1 -- 172.21.15.133:0/1993850651 wait complete. 2024-01-21T20:00:13.854 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2024-01-21T20:00:13.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:13.854 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2024-01-21T20:00:13.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2024-01-21T20:00:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.042+0000 7f9093b8f700 1 Processor -- start 2024-01-21T20:00:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.042+0000 7f9093b8f700 1 -- start start 2024-01-21T20:00:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f9093b8f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f908c154630 0x7f908c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f9093b8f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c06a4b0 con 0x7f908c062be0 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f9093b8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c063010 con 0x7f908c154250 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f9093b8f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c154ac0 con 0x7f908c154630 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909112a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f908c154630 0x7f908c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909212c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f908c062be0 0x7f908c065f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47270/0 (socket says 172.21.15.133:47270) 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909212c700 1 -- 172.21.15.133:0/642819679 learned_addr learned my addr 172.21.15.133:0/642819679 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909112a700 1 -- 172.21.15.133:0/642819679 >> v1:172.21.15.178:6789/0 conn(0x7f908c154250 legacy=0x7f908c069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909112a700 1 -- 172.21.15.133:0/642819679 >> v1:172.21.15.133:6789/0 conn(0x7f908c062be0 legacy=0x7f908c065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f909112a700 1 -- 172.21.15.133:0/642819679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c069c20 con 0x7f908c154630 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.043+0000 7f9090929700 1 -- 172.21.15.133:0/642819679 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1024806497 0 0) 0x7f908c06a4b0 con 0x7f908c062be0 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f909112a700 1 --2- 172.21.15.133:0/642819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c154630 0x7f908c0626f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f9088009760 tx=0x7f9088009060).ready entity=mon.0 client_cookie=7c01f7c95a5f8431 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9090929700 1 -- 172.21.15.133:0/642819679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800b580 con 0x7f908c154630 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9090929700 1 -- 172.21.15.133:0/642819679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800b6e0 con 0x7f908c154630 2024-01-21T20:00:14.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9090929700 1 -- 172.21.15.133:0/642819679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800ba60 con 0x7f908c154630 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 -- 172.21.15.133:0/642819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c154630 msgr2=0x7f908c0626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 --2- 172.21.15.133:0/642819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c154630 0x7f908c0626f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f9088009760 tx=0x7f9088009060).stop 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 -- 172.21.15.133:0/642819679 shutdown_connections 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 --2- 172.21.15.133:0/642819679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c154630 0x7f908c0626f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 -- 172.21.15.133:0/642819679 >> 172.21.15.133:0/642819679 conn(0x7f908c0c7d30 msgr2=0x7f908c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 -- 172.21.15.133:0/642819679 shutdown_connections 2024-01-21T20:00:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.044+0000 7f9093b8f700 1 -- 172.21.15.133:0/642819679 wait complete. 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.045+0000 7f9093b8f700 1 Processor -- start 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 -- start start 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f908c154250 0x7f908c0a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908c154630 0x7f908c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0a8d00 con 0x7f908c062be0 2024-01-21T20:00:14.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c167f10 con 0x7f908c154250 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f9093b8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c158f90 con 0x7f908c154630 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f909192b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f909192b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37324/0 (socket says 172.21.15.133:37324) 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.046+0000 7f909192b700 1 -- 172.21.15.133:0/4810745 learned_addr learned my addr 172.21.15.133:0/4810745 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909112a700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f908c154250 0x7f908c0a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909212c700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908c154630 0x7f908c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 -- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908c154630 msgr2=0x7f908c14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908c154630 0x7f908c14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 -- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f908c154250 msgr2=0x7f908c0a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f908c154250 0x7f908c0a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 -- 172.21.15.133:0/4810745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880092a0 con 0x7f908c062be0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f909192b700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f907c00c440 tx=0x7f907c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00f470 con 0x7f908c062be0 2024-01-21T20:00:14.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00f5f0 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c14ee60 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00f9b0 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.047+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c14f420 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.048+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c05fdf0 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.048+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f907c012400 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.049+0000 7f90827fc700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 0x7f9070061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.049+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f907c079ad0 con 0x7f908c062be0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.049+0000 7f909112a700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 0x7f9070061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.049+0000 7f909112a700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 0x7f9070061810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f908c0c5e40 tx=0x7f9088017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.053+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f907c048b00 con 0x7f908c062be0 2024-01-21T20:00:14.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.243+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f908c0c6be0 con 0x7f907005f350 2024-01-21T20:00:14.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.247+0000 7f90827fc700 1 -- 172.21.15.133:0/4810745 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f908c0c6be0 con 0x7f907005f350 2024-01-21T20:00:14.238 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir5 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 msgr2=0x7f9070061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 0x7f9070061810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f908c0c5e40 tx=0x7f9088017000).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 msgr2=0x7f908c1589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f907c00c440 tx=0x7f907c007de0).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 shutdown_connections 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f907005f350 0x7f9070061810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f908c154630 0x7f908c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f908c062be0 0x7f908c1589d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 --2- 172.21.15.133:0/4810745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f908c154250 0x7f908c0a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 >> 172.21.15.133:0/4810745 conn(0x7f908c0c7d30 msgr2=0x7f908c0c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 shutdown_connections 2024-01-21T20:00:14.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.249+0000 7f9093b8f700 1 -- 172.21.15.133:0/4810745 wait complete. 2024-01-21T20:00:14.252 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2024-01-21T20:00:14.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:14.252 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2024-01-21T20:00:14.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2024-01-21T20:00:14.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.439+0000 7f8c38bfa700 1 Processor -- start 2024-01-21T20:00:14.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.439+0000 7f8c38bfa700 1 -- start start 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c38bfa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c340628b0 0x7f8c340bcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c38bfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c34063140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c38bfa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c340bd110 con 0x7f8c34062c90 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c38bfa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c34065e40 con 0x7f8c340628b0 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c38bfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34066120 con 0x7f8c341389e0 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c340628b0 0x7f8c340bcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c340628b0 0x7f8c340bcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37330/0 (socket says 172.21.15.133:37330) 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 -- 172.21.15.133:0/1994045561 learned_addr learned my addr 172.21.15.133:0/1994045561 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c32d9d700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c34063140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 -- 172.21.15.133:0/1994045561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 msgr2=0x7f8c34063140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c34063140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 -- 172.21.15.133:0/1994045561 >> v1:172.21.15.178:6789/0 conn(0x7f8c34062c90 legacy=0x7f8c341382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c3259c700 1 -- 172.21.15.133:0/1994045561 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34066400 con 0x7f8c340628b0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.440+0000 7f8c32d9d700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c34063140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c3259c700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340bcc20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f8c24009f20 tx=0x7f8c24009840).ready entity=mon.0 client_cookie=e47400d965fb0632 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c3159a700 1 -- 172.21.15.133:0/1994045561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400e070 con 0x7f8c340628b0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c3159a700 1 -- 172.21.15.133:0/1994045561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2400ba80 con 0x7f8c340628b0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c3159a700 1 -- 172.21.15.133:0/1994045561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2400be00 con 0x7f8c340628b0 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 -- 172.21.15.133:0/1994045561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 msgr2=0x7f8c340bcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340bcc20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f8c24009f20 tx=0x7f8c24009840).stop 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 -- 172.21.15.133:0/1994045561 shutdown_connections 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340bcc20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/1994045561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c34063140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 -- 172.21.15.133:0/1994045561 >> 172.21.15.133:0/1994045561 conn(0x7f8c340c7cc0 msgr2=0x7f8c340c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 -- 172.21.15.133:0/1994045561 shutdown_connections 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.441+0000 7f8c38bfa700 1 -- 172.21.15.133:0/1994045561 wait complete. 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 Processor -- start 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 -- start start 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 0x7f8c341575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c341334c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c341557a0 con 0x7f8c340628b0 2024-01-21T20:00:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34157aa0 con 0x7f8c34062c90 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.443+0000 7f8c38bfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c340acf80 con 0x7f8c341389e0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37334/0 (socket says 172.21.15.133:37334) 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 -- 172.21.15.133:0/75006371 learned_addr learned my addr 172.21.15.133:0/75006371 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c32d9d700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c341334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c31d9b700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 0x7f8c341575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 -- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 msgr2=0x7f8c341334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c341334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 -- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 msgr2=0x7f8c341575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 0x7f8c341575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 -- 172.21.15.133:0/75006371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24009ae0 con 0x7f8c340628b0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c31d9b700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 0x7f8c341575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c3259c700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f8c240072d0 tx=0x7f8c24009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24013cd0 con 0x7f8c340628b0 2024-01-21T20:00:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24013e30 con 0x7f8c340628b0 2024-01-21T20:00:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c340ad260 con 0x7f8c340628b0 2024-01-21T20:00:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2401e6c0 con 0x7f8c340628b0 2024-01-21T20:00:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.444+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c340ad820 con 0x7f8c340628b0 2024-01-21T20:00:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.445+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c34155a10 con 0x7f8c340628b0 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.446+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8c24003040 con 0x7f8c340628b0 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.446+0000 7f8c2affd700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 0x7f8c14061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.446+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f8c2407baa0 con 0x7f8c340628b0 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.446+0000 7f8c31d9b700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 0x7f8c14061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.446+0000 7f8c31d9b700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 0x7f8c14061810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8c34155410 tx=0x7f8c1c009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.450+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c2404c9b0 con 0x7f8c340628b0 2024-01-21T20:00:14.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.635+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c3406bd20 con 0x7f8c1405f350 2024-01-21T20:00:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.639+0000 7f8c2affd700 1 -- 172.21.15.133:0/75006371 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8c3406bd20 con 0x7f8c1405f350 2024-01-21T20:00:14.630 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir6 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.640+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 msgr2=0x7f8c14061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.640+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 0x7f8c14061810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8c34155410 tx=0x7f8c1c009040).stop 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.640+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 msgr2=0x7f8c340ac910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.640+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f8c240072d0 tx=0x7f8c24009840).stop 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 shutdown_connections 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8c1405f350 0x7f8c14061810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c341389e0 0x7f8c341334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c340628b0 0x7f8c340ac910 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 --2- 172.21.15.133:0/75006371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c34062c90 0x7f8c341575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 >> 172.21.15.133:0/75006371 conn(0x7f8c340c7cc0 msgr2=0x7f8c341392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 shutdown_connections 2024-01-21T20:00:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.641+0000 7f8c38bfa700 1 -- 172.21.15.133:0/75006371 wait complete. 2024-01-21T20:00:14.644 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2024-01-21T20:00:14.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:14.644 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2024-01-21T20:00:14.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2024-01-21T20:00:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.832+0000 7fa595d8b700 1 Processor -- start 2024-01-21T20:00:14.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.832+0000 7fa595d8b700 1 -- start start 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa595d8b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 0x7fa5900aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa595d8b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa590151bc0 0x7fa590152030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa595d8b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa590069a40 con 0x7fa5900694d0 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa595d8b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa590069d20 con 0x7fa590151bc0 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa595d8b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59006a000 con 0x7fa5900aa0f0 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa590151bc0 0x7fa590152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa5900694d0 0x7fa590066240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47282/0 (socket says 172.21.15.133:47282) 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58effd700 1 -- 172.21.15.133:0/8556572 learned_addr learned my addr 172.21.15.133:0/8556572 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:14.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58f7fe700 1 --2- 172.21.15.133:0/8556572 >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 0x7fa5900aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58e7fc700 1 -- 172.21.15.133:0/8556572 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842494614 0 0) 0x7fa590069a40 con 0x7fa5900694d0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58e7fc700 1 -- 172.21.15.133:0/8556572 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c0033f0 con 0x7fa5900694d0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58ffff700 1 -- 172.21.15.133:0/8556572 >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 msgr2=0x7fa5900aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58ffff700 1 --2- 172.21.15.133:0/8556572 >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 0x7fa5900aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58ffff700 1 -- 172.21.15.133:0/8556572 >> v1:172.21.15.133:6789/0 conn(0x7fa5900694d0 legacy=0x7fa590066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58ffff700 1 -- 172.21.15.133:0/8556572 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59006a2e0 con 0x7fa590151bc0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.833+0000 7fa58f7fe700 1 --2- 172.21.15.133:0/8556572 >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 0x7fa5900aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa58ffff700 1 --2- 172.21.15.133:0/8556572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa590151bc0 0x7fa590152030 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa5900c7c30 tx=0x7fa588009780).ready entity=mon.0 client_cookie=9dabd20480257013 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa58e7fc700 1 -- 172.21.15.133:0/8556572 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800e070 con 0x7fa590151bc0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa58e7fc700 1 -- 172.21.15.133:0/8556572 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58800bb60 con 0x7fa590151bc0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa58e7fc700 1 -- 172.21.15.133:0/8556572 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588012410 con 0x7fa590151bc0 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 -- 172.21.15.133:0/8556572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa590151bc0 msgr2=0x7fa590152030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 --2- 172.21.15.133:0/8556572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa590151bc0 0x7fa590152030 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa5900c7c30 tx=0x7fa588009780).stop 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 -- 172.21.15.133:0/8556572 shutdown_connections 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 --2- 172.21.15.133:0/8556572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa590151bc0 0x7fa590152030 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 --2- 172.21.15.133:0/8556572 >> v2:172.21.15.178:3300/0 conn(0x7fa5900aa0f0 0x7fa5900aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 -- 172.21.15.133:0/8556572 >> 172.21.15.133:0/8556572 conn(0x7fa5900c7d20 msgr2=0x7fa5900c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 -- 172.21.15.133:0/8556572 shutdown_connections 2024-01-21T20:00:14.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.834+0000 7fa595d8b700 1 -- 172.21.15.133:0/8556572 wait complete. 2024-01-21T20:00:14.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.835+0000 7fa595d8b700 1 Processor -- start 2024-01-21T20:00:14.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.836+0000 7fa595d8b700 1 -- start start 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.836+0000 7fa595d8b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5900694d0 0x7fa5900ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.836+0000 7fa595d8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.836+0000 7fa595d8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa590151bc0 0x7fa5901402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa595d8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5900add40 con 0x7fa5900aa0f0 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa595d8b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa590152c40 con 0x7fa5900694d0 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa595d8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa590153a60 con 0x7fa590151bc0 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37346/0 (socket says 172.21.15.133:37346) 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 -- 172.21.15.133:0/2120053830 learned_addr learned my addr 172.21.15.133:0/2120053830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 -- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa590151bc0 msgr2=0x7fa5901402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa590151bc0 0x7fa5901402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 -- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5900694d0 msgr2=0x7fa5900ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5900694d0 0x7fa5900ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:14.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 -- 172.21.15.133:0/2120053830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa588009a20 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa58effd700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa58000c420 tx=0x7fa580007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800072e0 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580007440 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa590152e50 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5800057a0 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.837+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa590153410 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.838+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59005fdf0 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.838+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fa580005bd0 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.839+0000 7fa587fff700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 0x7fa570061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.839+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fa580079a40 con 0x7fa5900aa0f0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.839+0000 7fa58f7fe700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 0x7fa570061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:14.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.839+0000 7fa58f7fe700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 0x7fa570061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa578006d80 tx=0x7fa578008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:14.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:14.843+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa58004aa60 con 0x7fa5900aa0f0 2024-01-21T20:00:15.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.030+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa590153bd0 con 0x7fa57005f350 2024-01-21T20:00:15.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.033+0000 7fa587fff700 1 -- 172.21.15.133:0/2120053830 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa590153bd0 con 0x7fa57005f350 2024-01-21T20:00:15.024 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir7 2024-01-21T20:00:15.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 msgr2=0x7fa570061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 0x7fa570061810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa578006d80 tx=0x7fa578008040).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 msgr2=0x7fa590152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa58000c420 tx=0x7fa580007c80).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 shutdown_connections 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa57005f350 0x7fa570061810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa590151bc0 0x7fa5901402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5900694d0 0x7fa5900ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 --2- 172.21.15.133:0/2120053830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5900aa0f0 0x7fa590152750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 >> 172.21.15.133:0/2120053830 conn(0x7fa5900c7d20 msgr2=0x7fa59014ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 shutdown_connections 2024-01-21T20:00:15.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.035+0000 7fa595d8b700 1 -- 172.21.15.133:0/2120053830 wait complete. 2024-01-21T20:00:15.038 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2024-01-21T20:00:15.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:15.038 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2024-01-21T20:00:15.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2024-01-21T20:00:15.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:00:15.100 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:00:15.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.229+0000 7f615c3a7700 1 Processor -- start 2024-01-21T20:00:15.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.229+0000 7f615c3a7700 1 -- start start 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f615c3a7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6154066b50 0x7f6154066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f615c3a7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6154157f30 0x7f61540c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f615c3a7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61540c37c0 con 0x7f61540bdec0 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f615c3a7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6154158ed0 con 0x7f6154157f30 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f615c3a7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61540c5820 con 0x7f6154066b50 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.230+0000 7f6159942700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6154157f30 0x7f61540c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6154157f30 0x7f61540c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37354/0 (socket says 172.21.15.133:37354) 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 -- 172.21.15.133:0/972314902 learned_addr learned my addr 172.21.15.133:0/972314902 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:15.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f615a143700 1 --2- 172.21.15.133:0/972314902 >> v2:172.21.15.178:3300/0 conn(0x7f6154066b50 0x7f6154066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 -- 172.21.15.133:0/972314902 >> v2:172.21.15.178:3300/0 conn(0x7f6154066b50 msgr2=0x7f6154066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 --2- 172.21.15.133:0/972314902 >> v2:172.21.15.178:3300/0 conn(0x7f6154066b50 0x7f6154066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 -- 172.21.15.133:0/972314902 >> v1:172.21.15.178:6789/0 conn(0x7f61540bdec0 legacy=0x7f6154153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 -- 172.21.15.133:0/972314902 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61541583b0 con 0x7f6154157f30 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159942700 1 --2- 172.21.15.133:0/972314902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540c5330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f61540c6a70 tx=0x7f61500090f0).ready entity=mon.0 client_cookie=d57d2415bfa71bd6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159141700 1 -- 172.21.15.133:0/972314902 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000b600 con 0x7f6154157f30 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159141700 1 -- 172.21.15.133:0/972314902 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615000b760 con 0x7f6154157f30 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.231+0000 7f6159141700 1 -- 172.21.15.133:0/972314902 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615000bb00 con 0x7f6154157f30 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 -- 172.21.15.133:0/972314902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 msgr2=0x7f61540c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 --2- 172.21.15.133:0/972314902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540c5330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f61540c6a70 tx=0x7f61500090f0).stop 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 -- 172.21.15.133:0/972314902 shutdown_connections 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 --2- 172.21.15.133:0/972314902 >> v2:172.21.15.178:3300/0 conn(0x7f6154066b50 0x7f6154066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 --2- 172.21.15.133:0/972314902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540c5330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 -- 172.21.15.133:0/972314902 >> 172.21.15.133:0/972314902 conn(0x7f61540c8f60 msgr2=0x7f61540c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 -- 172.21.15.133:0/972314902 shutdown_connections 2024-01-21T20:00:15.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.232+0000 7f615c3a7700 1 -- 172.21.15.133:0/972314902 wait complete. 2024-01-21T20:00:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.233+0000 7f615c3a7700 1 Processor -- start 2024-01-21T20:00:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.233+0000 7f615c3a7700 1 -- start start 2024-01-21T20:00:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6154066b50 0x7f6154141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61540bdec0 0x7f61540aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61540ab8d0 con 0x7f6154157f30 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6154165680 con 0x7f61540bdec0 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61541647b0 con 0x7f6154066b50 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37356/0 (socket says 172.21.15.133:37356) 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 -- 172.21.15.133:0/2769247843 learned_addr learned my addr 172.21.15.133:0/2769247843 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a143700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6154066b50 0x7f6154141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f6159942700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61540bdec0 0x7f61540aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 -- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6154066b50 msgr2=0x7f6154141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6154066b50 0x7f6154141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 -- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61540bdec0 msgr2=0x7f61540aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61540bdec0 0x7f61540aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 -- 172.21.15.133:0/2769247843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150009370 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615a944700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f614c002230 tx=0x7f614c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00e4a0 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00e600 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6154164a70 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00e980 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.234+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6154165030 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.235+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615405fdf0 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.236+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f614c01b3b0 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.236+0000 7f614affd700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 0x7f6138061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.236+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f614c079c20 con 0x7f6154157f30 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.236+0000 7f615a143700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 0x7f6138061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.237+0000 7f615a143700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 0x7f6138061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f61540a9ab0 tx=0x7f6144008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.240+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f614c048b00 con 0x7f6154157f30 2024-01-21T20:00:15.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.429+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6154158630 con 0x7f613805f350 2024-01-21T20:00:15.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.433+0000 7f614affd700 1 -- 172.21.15.133:0/2769247843 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6154158630 con 0x7f613805f350 2024-01-21T20:00:15.424 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir8 2024-01-21T20:00:15.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 msgr2=0x7f6138061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 0x7f6138061810 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f61540a9ab0 tx=0x7f6144008040).stop 2024-01-21T20:00:15.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 msgr2=0x7f61540ab3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f614c002230 tx=0x7f614c0015e0).stop 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 shutdown_connections 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f613805f350 0x7f6138061810 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6154157f30 0x7f61540ab3e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6154066b50 0x7f6154141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 --2- 172.21.15.133:0/2769247843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61540bdec0 0x7f61540aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 >> 172.21.15.133:0/2769247843 conn(0x7f61540c8f60 msgr2=0x7f615414d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 shutdown_connections 2024-01-21T20:00:15.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.435+0000 7f615c3a7700 1 -- 172.21.15.133:0/2769247843 wait complete. 2024-01-21T20:00:15.438 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2024-01-21T20:00:15.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:00:15.438 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2024-01-21T20:00:15.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2024-01-21T20:00:15.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.627+0000 7f77fda95700 1 Processor -- start 2024-01-21T20:00:15.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.627+0000 7f77fda95700 1 -- start start 2024-01-21T20:00:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77fda95700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8066b50 0x7f77f8066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77fda95700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80c37c0 con 0x7f77f80c5330 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77fda95700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f81583b0 con 0x7f77f8157f30 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77fda95700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8158ed0 con 0x7f77f8066b50 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f77f80c5330 0x7f77f8153e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47294/0 (socket says 172.21.15.133:47294) 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f7fff700 1 -- 172.21.15.133:0/2738883923 learned_addr learned my addr 172.21.15.133:0/2738883923 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f77fe700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8066b50 0x7f77f8066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028270777 0 0) 0x7f77f80c37c0 con 0x7f77f80c5330 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e00033f0 con 0x7f77f80c5330 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998957128 0 0) 0x7f77f81583b0 con 0x7f77f8157f30 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f80c37c0 con 0x7f77f8157f30 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702160001 0 0) 0x7f77e00033f0 con 0x7f77f80c5330 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8066b50 msgr2=0x7f77f8066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8066b50 0x7f77f8066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 >> v1:172.21.15.178:6789/0 conn(0x7f77f8157f30 legacy=0x7f77f80bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80c57c0 con 0x7f77f80c5330 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f77f00017f0 con 0x7f77f80c5330 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 >> v1:172.21.15.133:6789/0 conn(0x7f77f80c5330 legacy=0x7f77f8153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.628+0000 7f77f67fc700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0003aa0 0x7f77e0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77e0004690 0x7f77e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77e0005000 0x7f77e000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8158ed0 con 0x7f77e0004690 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000bf00 con 0x7f77e0005000 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000c0c0 con 0x7f77e0003aa0 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f77fe700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8066b50 0x7f77f8066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77e0004690 0x7f77e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f77fe700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0003aa0 0x7f77e0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f7fff700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77e0005000 0x7f77e000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 -- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0003aa0 msgr2=0x7f77e0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0003aa0 0x7f77e0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 -- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77e0005000 msgr2=0x7f77e000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77e0005000 0x7f77e000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 -- 172.21.15.133:0/2738883923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00033f0 con 0x7f77e0004690 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77e0004690 0x7f77e0004b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f77e8001860 tx=0x7f77e8007bb0).ready entity=mon.0 client_cookie=7e42c646aac56f48 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8007020 con 0x7f77e0004690 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8007180 con 0x7f77e0004690 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.629+0000 7f77f67fc700 1 -- 172.21.15.133:0/2738883923 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8007500 con 0x7f77e0004690 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 -- 172.21.15.133:0/2738883923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77e0004690 msgr2=0x7f77e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 --2- 172.21.15.133:0/2738883923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77e0004690 0x7f77e0004b10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f77e8001860 tx=0x7f77e8007bb0).stop 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77f7fff700 1 -- 172.21.15.133:0/2738883923 reap_dead start 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 -- 172.21.15.133:0/2738883923 shutdown_connections 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 -- 172.21.15.133:0/2738883923 >> 172.21.15.133:0/2738883923 conn(0x7f77f80c8f60 msgr2=0x7f77f80c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 -- 172.21.15.133:0/2738883923 shutdown_connections 2024-01-21T20:00:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.630+0000 7f77fda95700 1 -- 172.21.15.133:0/2738883923 wait complete. 2024-01-21T20:00:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.631+0000 7f77fda95700 1 Processor -- start 2024-01-21T20:00:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.631+0000 7f77fda95700 1 -- start start 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0004690 0x7f77f814a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f814ac20 0x7f77f80c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8153480 con 0x7f77f814de20 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c0cc0 con 0x7f77f814ac20 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77fda95700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8152ec0 con 0x7f77e0004690 2024-01-21T20:00:15.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37380/0 (socket says 172.21.15.133:37380) 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 -- 172.21.15.133:0/1678372362 learned_addr learned my addr 172.21.15.133:0/1678372362 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f77fe700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0004690 0x7f77f814a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f7fff700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f814ac20 0x7f77f80c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 -- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0004690 msgr2=0x7f77f814a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0004690 0x7f77f814a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 -- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f814ac20 msgr2=0x7f77f80c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f814ac20 0x7f77f80c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 -- 172.21.15.133:0/1678372362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f81531a0 con 0x7f77f814de20 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.632+0000 7f77f6ffd700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f77e8001e50 tx=0x7f77e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.633+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8007020 con 0x7f77f814de20 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.633+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8012610 con 0x7f77f814de20 2024-01-21T20:00:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.633+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f80c0950 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.633+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e8012990 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.633+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f8152a60 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.634+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f80c07b0 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.634+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f77e8012d00 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.634+0000 7f77dffff700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 0x7f77e4061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.634+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f77e807b3f0 con 0x7f77f814de20 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.634+0000 7f77f77fe700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 0x7f77e4061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.635+0000 7f77f77fe700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 0x7f77e4061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f77f80be950 tx=0x7f77ec009060).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.638+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f77f80c07b0 con 0x7f77f814de20 2024-01-21T20:00:15.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.826+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f77f80c07b0 con 0x7f77e405f350 2024-01-21T20:00:15.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.830+0000 7f77dffff700 1 -- 172.21.15.133:0/1678372362 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f77f80c07b0 con 0x7f77e405f350 2024-01-21T20:00:15.821 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/dir9 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 msgr2=0x7f77e4061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 0x7f77e4061810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f77f80be950 tx=0x7f77ec009060).stop 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 msgr2=0x7f77f8152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f77e8001e50 tx=0x7f77e8016000).stop 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 shutdown_connections 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f77e405f350 0x7f77e4061810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f814ac20 0x7f77f80c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77e0004690 0x7f77f814a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 --2- 172.21.15.133:0/1678372362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77f814de20 0x7f77f8152570 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 >> 172.21.15.133:0/1678372362 conn(0x7f77f80c8f60 msgr2=0x7f77f80c8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 shutdown_connections 2024-01-21T20:00:15.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.832+0000 7f77fda95700 1 -- 172.21.15.133:0/1678372362 wait complete. 2024-01-21T20:00:15.835 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2024-01-21T20:00:15.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2024-01-21T20:00:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.964+0000 7f586dbaa700 1 Processor -- start 2024-01-21T20:00:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.964+0000 7f586dbaa700 1 -- start start 2024-01-21T20:00:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f586dbaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680a8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f586dbaa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58680bdd70 0x7f5868153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f586dbaa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5868063f20 con 0x7f5868096410 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f586dbaa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5868096850 con 0x7f58680bdd70 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f586dbaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5868064200 con 0x7f5868096030 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f5867fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58680bdd70 0x7f5868153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f5866ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5868096410 0x7f5868063740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47306/0 (socket says 172.21.15.133:47306) 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.965+0000 7f5866ffd700 1 -- 172.21.15.133:0/1058243194 learned_addr learned my addr 172.21.15.133:0/1058243194 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f58677fe700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f5867fff700 1 -- 172.21.15.133:0/1058243194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 msgr2=0x7f58680a8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f5867fff700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680a8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f5867fff700 1 -- 172.21.15.133:0/1058243194 >> v1:172.21.15.133:6789/0 conn(0x7f5868096410 legacy=0x7f5868063740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f5867fff700 1 -- 172.21.15.133:0/1058243194 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58680644e0 con 0x7f58680bdd70 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f58667fc700 1 -- 172.21.15.133:0/1058243194 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731271603 0 0) 0x7f5868063f20 con 0x7f5868096410 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f5867fff700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868153f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5860009e60 tx=0x7f5860009780).ready entity=mon.0 client_cookie=fc66353042c7068e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f58667fc700 1 -- 172.21.15.133:0/1058243194 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000e070 con 0x7f58680bdd70 2024-01-21T20:00:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f58667fc700 1 -- 172.21.15.133:0/1058243194 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586000bb60 con 0x7f58680bdd70 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f58667fc700 1 -- 172.21.15.133:0/1058243194 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860012410 con 0x7f58680bdd70 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.966+0000 7f586dbaa700 1 -- 172.21.15.133:0/1058243194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 msgr2=0x7f5868153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868153f20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5860009e60 tx=0x7f5860009780).stop 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 -- 172.21.15.133:0/1058243194 shutdown_connections 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868153f20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1058243194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680a8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 -- 172.21.15.133:0/1058243194 >> 172.21.15.133:0/1058243194 conn(0x7f586805ec80 msgr2=0x7f58680c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 -- 172.21.15.133:0/1058243194 shutdown_connections 2024-01-21T20:00:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.967+0000 7f586dbaa700 1 -- 172.21.15.133:0/1058243194 wait complete. 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.968+0000 7f586dbaa700 1 Processor -- start 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.968+0000 7f586dbaa700 1 -- start start 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868096410 0x7f5868167260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868167c40 con 0x7f58680bdd70 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58680a9590 con 0x7f5868096410 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58680a9870 con 0x7f5868096030 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37406/0 (socket says 172.21.15.133:37406) 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 -- 172.21.15.133:0/1685870109 learned_addr learned my addr 172.21.15.133:0/1685870109 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f58677fe700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5866ffd700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868096410 0x7f5868167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 -- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 msgr2=0x7f58680aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 -- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868096410 msgr2=0x7f5868167260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868096410 0x7f5868167260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 -- 172.21.15.133:0/1685870109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5860009a20 con 0x7f58680bdd70 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f5867fff700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f586000b6c0 tx=0x7f5860009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586001d630 con 0x7f58680bdd70 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586001d790 con 0x7f58680bdd70 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58680a9b50 con 0x7f58680bdd70 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586001db30 con 0x7f58680bdd70 2024-01-21T20:00:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.969+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58680aa110 con 0x7f58680bdd70 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.970+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58680aa330 con 0x7f58680bdd70 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.971+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f5860003040 con 0x7f58680bdd70 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.971+0000 7f584ffff700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 0x7f5854061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.971+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f586007c650 con 0x7f58680bdd70 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.971+0000 7f58677fe700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 0x7f5854061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.972+0000 7f58677fe700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 0x7f5854061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f585c009270 tx=0x7f585c008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:15.975+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5860050f50 con 0x7f58680bdd70 2024-01-21T20:00:16.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.164+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f586805fdf0 con 0x7f585405f350 2024-01-21T20:00:16.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.170+0000 7f584ffff700 1 -- 172.21.15.133:0/1685870109 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f586805fdf0 con 0x7f585405f350 2024-01-21T20:00:16.161 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir0 2024-01-21T20:00:16.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 msgr2=0x7f5854061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 0x7f5854061810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f585c009270 tx=0x7f585c008040).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 msgr2=0x7f5868167750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f586000b6c0 tx=0x7f5860009780).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 shutdown_connections 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f585405f350 0x7f5854061810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58680bdd70 0x7f5868167750 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5868096030 0x7f58680aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 --2- 172.21.15.133:0/1685870109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5868096410 0x7f5868167260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 >> 172.21.15.133:0/1685870109 conn(0x7f586805ec80 msgr2=0x7f58680be280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 shutdown_connections 2024-01-21T20:00:16.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.172+0000 7f586dbaa700 1 -- 172.21.15.133:0/1685870109 wait complete. 2024-01-21T20:00:16.175 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2024-01-21T20:00:16.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2024-01-21T20:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.304+0000 7f1b1d9dd700 1 Processor -- start 2024-01-21T20:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.304+0000 7f1b1d9dd700 1 -- start start 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b1d9dd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b18154630 0x7f1b180626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b1d9dd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1806a4b0 con 0x7f1b18154250 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b1d9dd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b18063010 con 0x7f1b18062be0 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b1d9dd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b18154ac0 con 0x7f1b18154630 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b16ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1b18154250 0x7f1b18069510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47308/0 (socket says 172.21.15.133:47308) 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.305+0000 7f1b16ffd700 1 -- 172.21.15.133:0/3886944717 learned_addr learned my addr 172.21.15.133:0/3886944717 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363288370 0 0) 0x7f1b1806a4b0 con 0x7f1b18154250 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b000033f0 con 0x7f1b18154250 2024-01-21T20:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b167fc700 1 --2- 172.21.15.133:0/3886944717 >> v2:172.21.15.178:3300/0 conn(0x7f1b18154630 0x7f1b180626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30273836 0 0) 0x7f1b000033f0 con 0x7f1b18154250 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 >> v2:172.21.15.178:3300/0 conn(0x7f1b18154630 msgr2=0x7f1b180626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 --2- 172.21.15.133:0/3886944717 >> v2:172.21.15.178:3300/0 conn(0x7f1b18154630 0x7f1b180626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 >> v1:172.21.15.178:6789/0 conn(0x7f1b18062be0 legacy=0x7f1b18065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b18069c20 con 0x7f1b18154250 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1b0c001470 con 0x7f1b18154250 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 >> v1:172.21.15.133:6789/0 conn(0x7f1b18154250 legacy=0x7f1b18069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b00003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b00004690 0x7f1b00004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b00005000 0x7f1b0000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18154ac0 con 0x7f1b000038e0 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0000beb0 con 0x7f1b00005000 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0000c070 con 0x7f1b00004690 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b00003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b167fc700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b00004690 0x7f1b00004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b177fe700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b00005000 0x7f1b0000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 -- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b00004690 msgr2=0x7f1b00004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b00004690 0x7f1b00004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 -- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b00005000 msgr2=0x7f1b0000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b00005000 0x7f1b0000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b177fe700 1 -- 172.21.15.133:0/3886944717 reap_dead start 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 -- 172.21.15.133:0/3886944717 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000033f0 con 0x7f1b000038e0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b00003d00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f1b0c00c190 tx=0x7f1b0c001e50).ready entity=mon.0 client_cookie=560ede10fbf042c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.306+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c007a20 con 0x7f1b000038e0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c00cac0 con 0x7f1b000038e0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b15ffb700 1 -- 172.21.15.133:0/3886944717 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c00ce40 con 0x7f1b000038e0 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 msgr2=0x7f1b00003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b00003d00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f1b0c00c190 tx=0x7f1b0c001e50).stop 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/3886944717 shutdown_connections 2024-01-21T20:00:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/3886944717 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b00003d00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/3886944717 >> 172.21.15.133:0/3886944717 conn(0x7f1b180c7d30 msgr2=0x7f1b180c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/3886944717 shutdown_connections 2024-01-21T20:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.307+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/3886944717 wait complete. 2024-01-21T20:00:16.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.308+0000 7f1b1d9dd700 1 Processor -- start 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.308+0000 7f1b1d9dd700 1 -- start start 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b1815a650 0x7f1b1815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b180ab8d0 0x7f1b180abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18164f40 con 0x7f1b000038e0 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1815afc0 con 0x7f1b1815a650 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b1d9dd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b18158f00 con 0x7f1b180ab8d0 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37430/0 (socket says 172.21.15.133:37430) 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b16ffd700 1 -- 172.21.15.133:0/4099519256 learned_addr learned my addr 172.21.15.133:0/4099519256 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b177fe700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b180ab8d0 0x7f1b180abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.309+0000 7f1b167fc700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b1815a650 0x7f1b1815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 -- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b180ab8d0 msgr2=0x7f1b180abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b180ab8d0 0x7f1b180abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 -- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b1815a650 msgr2=0x7f1b1815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b1815a650 0x7f1b1815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 -- 172.21.15.133:0/4099519256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180ac600 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b16ffd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1b0c001ed0 tx=0x7f1b0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0073b0 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c007510 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b180ac8e0 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0048e0 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.310+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b180acea0 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.311+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1805fdf0 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.311+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f1b0c01c070 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.312+0000 7f1aff7fe700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 0x7f1b04061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.312+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f1b0c07ac30 con 0x7f1b000038e0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.312+0000 7f1b167fc700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 0x7f1b04061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.312+0000 7f1b167fc700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 0x7f1b04061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1b180c5440 tx=0x7f1b08008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.316+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b0c04bc50 con 0x7f1b000038e0 2024-01-21T20:00:16.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.505+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b18069ef0 con 0x7f1b0405f350 2024-01-21T20:00:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.509+0000 7f1aff7fe700 1 -- 172.21.15.133:0/4099519256 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b18069ef0 con 0x7f1b0405f350 2024-01-21T20:00:16.500 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir1 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 msgr2=0x7f1b04061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 0x7f1b04061810 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f1b180c5440 tx=0x7f1b08008040).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 msgr2=0x7f1b18158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1b0c001ed0 tx=0x7f1b0c015000).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 shutdown_connections 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b0405f350 0x7f1b04061810 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b180ab8d0 0x7f1b180abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b000038e0 0x7f1b18158a10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 --2- 172.21.15.133:0/4099519256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b1815a650 0x7f1b1815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 >> 172.21.15.133:0/4099519256 conn(0x7f1b180c7d30 msgr2=0x7f1b18152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 shutdown_connections 2024-01-21T20:00:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.511+0000 7f1b1d9dd700 1 -- 172.21.15.133:0/4099519256 wait complete. 2024-01-21T20:00:16.514 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2024-01-21T20:00:16.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2024-01-21T20:00:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.644+0000 7f0ddd35a700 1 Processor -- start 2024-01-21T20:00:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.644+0000 7f0ddd35a700 1 -- start start 2024-01-21T20:00:16.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0ddd35a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0dd80c0cf0 0x7f0dd80c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0ddd35a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dd814e3c0 0x7f0dd814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0ddd35a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd80c67a0 con 0x7f0dd80c9050 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0ddd35a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd81554f0 con 0x7f0dd814e3c0 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0ddd35a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd81557d0 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dd814e3c0 0x7f0dd814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd67fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0dd80c9050 0x7f0dd81549c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47316/0 (socket says 172.21.15.133:47316) 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd67fc700 1 -- 172.21.15.133:0/2586609195 learned_addr learned my addr 172.21.15.133:0/2586609195 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd6ffd700 1 --2- 172.21.15.133:0/2586609195 >> v2:172.21.15.178:3300/0 conn(0x7f0dd80c0cf0 0x7f0dd80c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 -- 172.21.15.133:0/2586609195 >> v2:172.21.15.178:3300/0 conn(0x7f0dd80c0cf0 msgr2=0x7f0dd80c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 --2- 172.21.15.133:0/2586609195 >> v2:172.21.15.178:3300/0 conn(0x7f0dd80c0cf0 0x7f0dd80c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 -- 172.21.15.133:0/2586609195 >> v1:172.21.15.133:6789/0 conn(0x7f0dd80c9050 legacy=0x7f0dd81549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 -- 172.21.15.133:0/2586609195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80c6430 con 0x7f0dd814e3c0 2024-01-21T20:00:16.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd77fe700 1 --2- 172.21.15.133:0/2586609195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd814e3c0 0x7f0dd814e7f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f0dd8084450 tx=0x7f0dd0009780).ready entity=mon.0 client_cookie=7311fa887668033c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd5ffb700 1 -- 172.21.15.133:0/2586609195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000e070 con 0x7f0dd814e3c0 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd5ffb700 1 -- 172.21.15.133:0/2586609195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000bc30 con 0x7f0dd814e3c0 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.645+0000 7f0dd5ffb700 1 -- 172.21.15.133:0/2586609195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0012410 con 0x7f0dd814e3c0 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 -- 172.21.15.133:0/2586609195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd814e3c0 msgr2=0x7f0dd814e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/2586609195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd814e3c0 0x7f0dd814e7f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f0dd8084450 tx=0x7f0dd0009780).stop 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 -- 172.21.15.133:0/2586609195 shutdown_connections 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/2586609195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd814e3c0 0x7f0dd814e7f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/2586609195 >> v2:172.21.15.178:3300/0 conn(0x7f0dd80c0cf0 0x7f0dd80c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 -- 172.21.15.133:0/2586609195 >> 172.21.15.133:0/2586609195 conn(0x7f0dd8084ee0 msgr2=0x7f0dd8094800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 -- 172.21.15.133:0/2586609195 shutdown_connections 2024-01-21T20:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.646+0000 7f0ddd35a700 1 -- 172.21.15.133:0/2586609195 wait complete. 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.647+0000 7f0ddd35a700 1 Processor -- start 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.647+0000 7f0ddd35a700 1 -- start start 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd80c9050 0x7f0dd8165270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd814e3c0 0x7f0dd80645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80aee50 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80ae280 con 0x7f0dd814e3c0 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0ddd35a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd80ae520 con 0x7f0dd80c9050 2024-01-21T20:00:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0dd6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0dd6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37450/0 (socket says 172.21.15.133:37450) 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0dd6ffd700 1 -- 172.21.15.133:0/3585008959 learned_addr learned my addr 172.21.15.133:0/3585008959 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0dd77fe700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd814e3c0 0x7f0dd80645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.648+0000 7f0dd67fc700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd80c9050 0x7f0dd8165270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 -- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd80c9050 msgr2=0x7f0dd8165270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd80c9050 0x7f0dd8165270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 -- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd814e3c0 msgr2=0x7f0dd80645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd814e3c0 0x7f0dd80645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 -- 172.21.15.133:0/3585008959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009a20 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dd6ffd700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0dcc006920 tx=0x7f0dcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011590 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0116f0 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd80ae800 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc011a70 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.649+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd8165760 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.650+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd805fdf0 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.650+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f0dcc01c460 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.650+0000 7f0dbf7fe700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 0x7f0dc4061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.651+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0dcc07a4f0 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.651+0000 7f0dd67fc700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 0x7f0dc4061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.651+0000 7f0dd67fc700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 0x7f0dc4061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0dc8007fd0 tx=0x7f0dc8007d30).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.655+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0dcc04b4b0 con 0x7f0dd80c0cf0 2024-01-21T20:00:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.841+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dd80aef90 con 0x7f0dc405f350 2024-01-21T20:00:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.844+0000 7f0dbf7fe700 1 -- 172.21.15.133:0/3585008959 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0dc8007530 con 0x7f0dc405f350 2024-01-21T20:00:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir2 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 msgr2=0x7f0dc4061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 0x7f0dc4061810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0dc8007fd0 tx=0x7f0dc8007d30).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 msgr2=0x7f0dd81647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f0dcc006920 tx=0x7f0dcc008040).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 shutdown_connections 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0dc405f350 0x7f0dc4061810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd814e3c0 0x7f0dd80645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd80c0cf0 0x7f0dd81647a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 --2- 172.21.15.133:0/3585008959 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd80c9050 0x7f0dd8165270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 >> 172.21.15.133:0/3585008959 conn(0x7f0dd8084ee0 msgr2=0x7f0dd80ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 shutdown_connections 2024-01-21T20:00:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.846+0000 7f0ddd35a700 1 -- 172.21.15.133:0/3585008959 wait complete. 2024-01-21T20:00:16.849 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2024-01-21T20:00:16.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2024-01-21T20:00:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.978+0000 7f8eca1ee700 1 Processor -- start 2024-01-21T20:00:16.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.978+0000 7f8eca1ee700 1 -- start start 2024-01-21T20:00:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ec40626f0 0x7f8ec4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec40bcc20 0x7f8ec40bd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ec4069480 0x7f8ec40698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec4158b10 con 0x7f8ec40626f0 2024-01-21T20:00:16.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec4157f00 con 0x7f8ec4069480 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8eca1ee700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec41581e0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8ec37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ec40626f0 0x7f8ec4062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8ec37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ec40626f0 0x7f8ec4062ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37454/0 (socket says 172.21.15.133:37454) 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.979+0000 7f8ec37fe700 1 -- 172.21.15.133:0/4025806555 learned_addr learned my addr 172.21.15.133:0/4025806555 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec2ffd700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec40bcc20 0x7f8ec40bd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec3fff700 1 --2- 172.21.15.133:0/4025806555 >> v2:172.21.15.178:3300/0 conn(0x7f8ec4069480 0x7f8ec40698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 -- 172.21.15.133:0/4025806555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec40bcc20 msgr2=0x7f8ec40bd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec40bcc20 0x7f8ec40bd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 -- 172.21.15.133:0/4025806555 >> v2:172.21.15.178:3300/0 conn(0x7f8ec4069480 msgr2=0x7f8ec40698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/4025806555 >> v2:172.21.15.178:3300/0 conn(0x7f8ec4069480 0x7f8ec40698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 -- 172.21.15.133:0/4025806555 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec41584c0 con 0x7f8ec40626f0 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40626f0 0x7f8ec4062ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f8ec40a74d0 tx=0x7f8eac0090f0).ready entity=mon.0 client_cookie=3de1c817eca8e1b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec27fc700 1 -- 172.21.15.133:0/4025806555 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00b600 con 0x7f8ec40626f0 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec27fc700 1 -- 172.21.15.133:0/4025806555 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00b760 con 0x7f8ec40626f0 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8ec27fc700 1 -- 172.21.15.133:0/4025806555 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00bb00 con 0x7f8ec40626f0 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 -- 172.21.15.133:0/4025806555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40626f0 msgr2=0x7f8ec4062ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40626f0 0x7f8ec4062ad0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f8ec40a74d0 tx=0x7f8eac0090f0).stop 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 -- 172.21.15.133:0/4025806555 shutdown_connections 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/4025806555 >> v2:172.21.15.178:3300/0 conn(0x7f8ec4069480 0x7f8ec40698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40626f0 0x7f8ec4062ad0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/4025806555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec40bcc20 0x7f8ec40bd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.980+0000 7f8eca1ee700 1 -- 172.21.15.133:0/4025806555 >> 172.21.15.133:0/4025806555 conn(0x7f8ec40c7cc0 msgr2=0x7f8ec40c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.981+0000 7f8eca1ee700 1 -- 172.21.15.133:0/4025806555 shutdown_connections 2024-01-21T20:00:16.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.981+0000 7f8eca1ee700 1 -- 172.21.15.133:0/4025806555 wait complete. 2024-01-21T20:00:16.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.982+0000 7f8eca1ee700 1 Processor -- start 2024-01-21T20:00:16.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.982+0000 7f8eca1ee700 1 -- start start 2024-01-21T20:00:16.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ec40626f0 0x7f8ec413b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec4069480 0x7f8ec413a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec413d0f0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec413d580 con 0x7f8ec40626f0 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec413c4e0 con 0x7f8ec4069480 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37460/0 (socket says 172.21.15.133:37460) 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 -- 172.21.15.133:0/1613988424 learned_addr learned my addr 172.21.15.133:0/1613988424 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec2ffd700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec4069480 0x7f8ec413a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ec40626f0 0x7f8ec413b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 -- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec4069480 msgr2=0x7f8ec413a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec4069480 0x7f8ec413a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 -- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ec40626f0 msgr2=0x7f8ec413b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ec40626f0 0x7f8ec413b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 -- 172.21.15.133:0/1613988424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009370 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ec3fff700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f8ebc007f20 tx=0x7f8ebc009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00eb90 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00ecf0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec413c7c0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc014610 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.983+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec413cd80 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.984+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec405fdf0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.985+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f8ebc014980 con 0x7f8ec40bcc20 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.985+0000 7f8ebbfff700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 0x7f8ea4061840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.985+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f8ebc07a8e0 con 0x7f8ec40bcc20 2024-01-21T20:00:16.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.985+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 0x7f8ea4061840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:16.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.985+0000 7f8ec37fe700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 0x7f8ea4061840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8eac00b3c0 tx=0x7f8eac017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:16.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:16.989+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ebc04b900 con 0x7f8ec40bcc20 2024-01-21T20:00:17.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.181+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ec405e550 con 0x7f8ea405f380 2024-01-21T20:00:17.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.185+0000 7f8ebbfff700 1 -- 172.21.15.133:0/1613988424 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8ec405e550 con 0x7f8ea405f380 2024-01-21T20:00:17.176 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir3 2024-01-21T20:00:17.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 msgr2=0x7f8ea4061840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 0x7f8ea4061840 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8eac00b3c0 tx=0x7f8eac017000).stop 2024-01-21T20:00:17.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 msgr2=0x7f8ec41681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f8ebc007f20 tx=0x7f8ebc009860).stop 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 shutdown_connections 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8ea405f380 0x7f8ea4061840 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ec40bcc20 0x7f8ec41681c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ec40626f0 0x7f8ec413b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 --2- 172.21.15.133:0/1613988424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ec4069480 0x7f8ec413a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 >> 172.21.15.133:0/1613988424 conn(0x7f8ec40c7cc0 msgr2=0x7f8ec40a68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 shutdown_connections 2024-01-21T20:00:17.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.187+0000 7f8eca1ee700 1 -- 172.21.15.133:0/1613988424 wait complete. 2024-01-21T20:00:17.190 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2024-01-21T20:00:17.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2024-01-21T20:00:17.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.320+0000 7f995fbb1700 1 Processor -- start 2024-01-21T20:00:17.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.320+0000 7f995fbb1700 1 -- start start 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995fbb1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9958154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995fbb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9958069e30 con 0x7f99580646e0 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995fbb1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9958069220 con 0x7f9958150460 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995fbb1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99581552c0 con 0x7f9958150840 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995e14e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f99580646e0 0x7f99580bbb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47328/0 (socket says 172.21.15.133:47328) 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.321+0000 7f995e14e700 1 -- 172.21.15.133:0/880263292 learned_addr learned my addr 172.21.15.133:0/880263292 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243325601 0 0) 0x7f9958069e30 con 0x7f99580646e0 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d14c700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9958154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99440033f0 con 0x7f99580646e0 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 955480820 0 0) 0x7f99440033f0 con 0x7f99580646e0 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 msgr2=0x7f9958154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9958154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 >> v1:172.21.15.178:6789/0 conn(0x7f9958150460 legacy=0x7f9958068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958069500 con 0x7f99580646e0 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f99500017f0 con 0x7f99580646e0 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 >> v1:172.21.15.133:6789/0 conn(0x7f99580646e0 legacy=0x7f99580bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9944003910 0x7f9944003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9944004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944004b80 0x7f9944005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99581552c0 con 0x7f9944003910 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994400b910 con 0x7f9944004b80 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994400bad0 con 0x7f9958150840 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9944003910 0x7f9944003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d14c700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9944004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995e14e700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944004b80 0x7f9944005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 -- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 msgr2=0x7f9944004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9958150840 0x7f9944004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 -- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944004b80 msgr2=0x7f9944005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944004b80 0x7f9944005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.322+0000 7f995d94d700 1 -- 172.21.15.133:0/880263292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440033f0 con 0x7f9944003910 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995d94d700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9944003910 0x7f9944003d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f9948001730 tx=0x7f9948007bb0).ready entity=mon.0 client_cookie=9881caa7803ab2e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948007020 con 0x7f9944003910 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948007180 con 0x7f9944003910 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995c94b700 1 -- 172.21.15.133:0/880263292 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948007500 con 0x7f9944003910 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 -- 172.21.15.133:0/880263292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9944003910 msgr2=0x7f9944003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 --2- 172.21.15.133:0/880263292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9944003910 0x7f9944003d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f9948001730 tx=0x7f9948007bb0).stop 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995e14e700 1 -- 172.21.15.133:0/880263292 reap_dead start 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 -- 172.21.15.133:0/880263292 shutdown_connections 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 -- 172.21.15.133:0/880263292 >> 172.21.15.133:0/880263292 conn(0x7f99580626f0 msgr2=0x7f9958062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 -- 172.21.15.133:0/880263292 shutdown_connections 2024-01-21T20:00:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.323+0000 7f995fbb1700 1 -- 172.21.15.133:0/880263292 wait complete. 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 Processor -- start 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 -- start start 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 0x7f995814c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99580beee0 0x7f9958151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9958153670 con 0x7f995814c510 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99580aa290 con 0x7f9944003910 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.325+0000 7f995fbb1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9958152900 con 0x7f99580beee0 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37476/0 (socket says 172.21.15.133:37476) 2024-01-21T20:00:17.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 -- 172.21.15.133:0/3898628393 learned_addr learned my addr 172.21.15.133:0/3898628393 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d94d700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 0x7f995814c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995e14e700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99580beee0 0x7f9958151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 -- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99580beee0 msgr2=0x7f9958151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99580beee0 0x7f9958151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 -- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 msgr2=0x7f995814c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 0x7f995814c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 -- 172.21.15.133:0/3898628393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958152be0 con 0x7f995814c510 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d94d700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 0x7f995814c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995d14c700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9954012b00 tx=0x7f995400a200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954010b20 con 0x7f995814c510 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954010c80 con 0x7f995814c510 2024-01-21T20:00:17.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954010df0 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99580a9c40 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.326+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9958152210 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.327+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995805fdf0 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.327+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f9954019020 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.328+0000 7f994e7fc700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 0x7f993c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.328+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f995407bd30 con 0x7f995814c510 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.328+0000 7f995d94d700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 0x7f993c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.328+0000 7f995d94d700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 0x7f993c061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9948001010 tx=0x7f9948015000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.332+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f995404cc50 con 0x7f995814c510 2024-01-21T20:00:17.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.520+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f99580bc2d0 con 0x7f993c05f350 2024-01-21T20:00:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.524+0000 7f994e7fc700 1 -- 172.21.15.133:0/3898628393 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f99580bc2d0 con 0x7f993c05f350 2024-01-21T20:00:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir4 2024-01-21T20:00:17.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 msgr2=0x7f993c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 0x7f993c061810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9948001010 tx=0x7f9948015000).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 msgr2=0x7f99580be9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f9954012b00 tx=0x7f995400a200).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 shutdown_connections 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f350 0x7f993c061810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99580beee0 0x7f9958151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9944003910 0x7f995814c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 --2- 172.21.15.133:0/3898628393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f995814c510 0x7f99580be9f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.525+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 >> 172.21.15.133:0/3898628393 conn(0x7f99580626f0 msgr2=0x7f99580c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.526+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 shutdown_connections 2024-01-21T20:00:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.526+0000 7f995fbb1700 1 -- 172.21.15.133:0/3898628393 wait complete. 2024-01-21T20:00:17.528 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2024-01-21T20:00:17.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2024-01-21T20:00:17.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.658+0000 7ff86a287700 1 Processor -- start 2024-01-21T20:00:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.658+0000 7ff86a287700 1 -- start start 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff86a287700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8640bdf20 0x7ff8640bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff86a287700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 0x7ff864151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff86a287700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8640c32e0 con 0x7ff8640be300 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff86a287700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff864152500 con 0x7ff8640bdf20 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff86a287700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8640c2ff0 con 0x7ff8640652b0 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff863fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8640bdf20 0x7ff8640bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff868824700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8640be300 0x7ff8640695c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47334/0 (socket says 172.21.15.133:47334) 2024-01-21T20:00:17.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.659+0000 7ff868824700 1 -- 172.21.15.133:0/3883195021 learned_addr learned my addr 172.21.15.133:0/3883195021 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff8637fe700 1 --2- 172.21.15.133:0/3883195021 >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 0x7ff864151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff863fff700 1 -- 172.21.15.133:0/3883195021 >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 msgr2=0x7ff864151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff863fff700 1 --2- 172.21.15.133:0/3883195021 >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 0x7ff864151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff863fff700 1 -- 172.21.15.133:0/3883195021 >> v1:172.21.15.133:6789/0 conn(0x7ff8640be300 legacy=0x7ff8640695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff863fff700 1 -- 172.21.15.133:0/3883195021 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864151a00 con 0x7ff8640bdf20 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff862ffd700 1 -- 172.21.15.133:0/3883195021 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449663957 0 0) 0x7ff8640c32e0 con 0x7ff8640be300 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff8637fe700 1 --2- 172.21.15.133:0/3883195021 >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 0x7ff864151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff863fff700 1 --2- 172.21.15.133:0/3883195021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640bcd60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7ff864068c70 tx=0x7ff84c009060).ready entity=mon.0 client_cookie=c495b5b56f45c11a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff862ffd700 1 -- 172.21.15.133:0/3883195021 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00b580 con 0x7ff8640bdf20 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff862ffd700 1 -- 172.21.15.133:0/3883195021 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00b6e0 con 0x7ff8640bdf20 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff862ffd700 1 -- 172.21.15.133:0/3883195021 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00ba60 con 0x7ff8640bdf20 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 -- 172.21.15.133:0/3883195021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 msgr2=0x7ff8640bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 --2- 172.21.15.133:0/3883195021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640bcd60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7ff864068c70 tx=0x7ff84c009060).stop 2024-01-21T20:00:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 -- 172.21.15.133:0/3883195021 shutdown_connections 2024-01-21T20:00:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 --2- 172.21.15.133:0/3883195021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640bcd60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 --2- 172.21.15.133:0/3883195021 >> v2:172.21.15.178:3300/0 conn(0x7ff8640652b0 0x7ff864151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.660+0000 7ff86a287700 1 -- 172.21.15.133:0/3883195021 >> 172.21.15.133:0/3883195021 conn(0x7ff8640c7d20 msgr2=0x7ff8640c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.661+0000 7ff86a287700 1 -- 172.21.15.133:0/3883195021 shutdown_connections 2024-01-21T20:00:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.661+0000 7ff86a287700 1 -- 172.21.15.133:0/3883195021 wait complete. 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.662+0000 7ff86a287700 1 Processor -- start 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.662+0000 7ff86a287700 1 -- start start 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8640652b0 0x7ff864146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 0x7ff864165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640a5520 con 0x7ff8640bdf20 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640a5800 con 0x7ff8640be300 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640a5ae0 con 0x7ff8640652b0 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37500/0 (socket says 172.21.15.133:37500) 2024-01-21T20:00:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 -- 172.21.15.133:0/1550564493 learned_addr learned my addr 172.21.15.133:0/1550564493 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff863fff700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8640652b0 0x7ff864146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff868824700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 0x7ff864165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 -- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8640652b0 msgr2=0x7ff864146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8640652b0 0x7ff864146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 -- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 msgr2=0x7ff864165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 0x7ff864165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 -- 172.21.15.133:0/1550564493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c0092a0 con 0x7ff8640bdf20 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff868824700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 0x7ff864165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff8637fe700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7ff85400c880 tx=0x7ff854008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854010580 con 0x7ff8640bdf20 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8540106e0 con 0x7ff8640bdf20 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640a5dc0 con 0x7ff8640bdf20 2024-01-21T20:00:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854010a60 con 0x7ff8640bdf20 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.663+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8640adc90 con 0x7ff8640bdf20 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.664+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8640a6130 con 0x7ff8640bdf20 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.665+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7ff85401b460 con 0x7ff8640bdf20 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.665+0000 7ff860f74700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 0x7ff844061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.665+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7ff85407a720 con 0x7ff8640bdf20 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.665+0000 7ff863fff700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 0x7ff844061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.665+0000 7ff863fff700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 0x7ff844061810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff84c009fd0 tx=0x7ff84c017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.669+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff85404b5d0 con 0x7ff8640bdf20 2024-01-21T20:00:17.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.857+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8640a5970 con 0x7ff84405f350 2024-01-21T20:00:17.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.860+0000 7ff860f74700 1 -- 172.21.15.133:0/1550564493 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff8640a5970 con 0x7ff84405f350 2024-01-21T20:00:17.851 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir5 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 msgr2=0x7ff844061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 0x7ff844061810 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff84c009fd0 tx=0x7ff84c017000).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 msgr2=0x7ff8640ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7ff85400c880 tx=0x7ff854008040).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 shutdown_connections 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff84405f350 0x7ff844061810 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8640be300 0x7ff864165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8640652b0 0x7ff864146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 --2- 172.21.15.133:0/1550564493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8640bdf20 0x7ff8640ad5d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 >> 172.21.15.133:0/1550564493 conn(0x7ff8640c7d20 msgr2=0x7ff8640c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 shutdown_connections 2024-01-21T20:00:17.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.862+0000 7ff86a287700 1 -- 172.21.15.133:0/1550564493 wait complete. 2024-01-21T20:00:17.865 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2024-01-21T20:00:17.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2024-01-21T20:00:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.994+0000 7fae21631700 1 Processor -- start 2024-01-21T20:00:17.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.994+0000 7fae21631700 1 -- start start 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae21631700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae1c14ecb0 0x7fae1c155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae21631700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c155a60 0x7fae1c0c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae21631700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0c9040 con 0x7fae1c14e8d0 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae21631700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0c9290 con 0x7fae1c14ecb0 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae21631700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c9570 con 0x7fae1c155a60 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae1a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae1c14ecb0 0x7fae1c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae1a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae1c14ecb0 0x7fae1c155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37516/0 (socket says 172.21.15.133:37516) 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae1a7fc700 1 -- 172.21.15.133:0/2533623460 learned_addr learned my addr 172.21.15.133:0/2533623460 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.995+0000 7fae1b7fe700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c155a60 0x7fae1c0c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae1a7fc700 1 -- 172.21.15.133:0/2533623460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c155a60 msgr2=0x7fae1c0c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae1a7fc700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c155a60 0x7fae1c0c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae1a7fc700 1 -- 172.21.15.133:0/2533623460 >> v1:172.21.15.178:6789/0 conn(0x7fae1c14e8d0 legacy=0x7fae1c05e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae1a7fc700 1 -- 172.21.15.133:0/2533623460 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0c9850 con 0x7fae1c14ecb0 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae1a7fc700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c155570 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fae0c006fd0 tx=0x7fae0c0090f0).ready entity=mon.0 client_cookie=83bd2e59e369850b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae19ffb700 1 -- 172.21.15.133:0/2533623460 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00b580 con 0x7fae1c14ecb0 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae19ffb700 1 -- 172.21.15.133:0/2533623460 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00b6e0 con 0x7fae1c14ecb0 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae19ffb700 1 -- 172.21.15.133:0/2533623460 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00ba60 con 0x7fae1c14ecb0 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae21631700 1 -- 172.21.15.133:0/2533623460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 msgr2=0x7fae1c155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.996+0000 7fae21631700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c155570 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fae0c006fd0 tx=0x7fae0c0090f0).stop 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 -- 172.21.15.133:0/2533623460 shutdown_connections 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c155a60 0x7fae1c0c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 --2- 172.21.15.133:0/2533623460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c155570 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 -- 172.21.15.133:0/2533623460 >> 172.21.15.133:0/2533623460 conn(0x7fae1c084eb0 msgr2=0x7fae1c0947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:17.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 -- 172.21.15.133:0/2533623460 shutdown_connections 2024-01-21T20:00:17.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.997+0000 7fae21631700 1 -- 172.21.15.133:0/2533623460 wait complete. 2024-01-21T20:00:17.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.998+0000 7fae21631700 1 Processor -- start 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.998+0000 7fae21631700 1 -- start start 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c14e8d0 0x7fae1c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c155a60 0x7fae1c0c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0aba40 con 0x7fae1c14ecb0 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c8e20 con 0x7fae1c155a60 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae21631700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0c8860 con 0x7fae1c14e8d0 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae1a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae1a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37524/0 (socket says 172.21.15.133:37524) 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:17.999+0000 7fae1a7fc700 1 -- 172.21.15.133:0/1079188566 learned_addr learned my addr 172.21.15.133:0/1079188566 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1b7fe700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c155a60 0x7fae1c0c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1affd700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c14e8d0 0x7fae1c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 -- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c14e8d0 msgr2=0x7fae1c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c14e8d0 0x7fae1c0c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 -- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c155a60 msgr2=0x7fae1c0c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c155a60 0x7fae1c0c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 -- 172.21.15.133:0/1079188566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009370 con 0x7fae1c14ecb0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae1a7fc700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fae0c009130 tx=0x7fae0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00b850 con 0x7fae1c14ecb0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00b9b0 con 0x7fae1c14ecb0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c0c8b40 con 0x7fae1c14ecb0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c01c670 con 0x7fae1c14ecb0 2024-01-21T20:00:17.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.000+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c0c8430 con 0x7fae1c14ecb0 2024-01-21T20:00:17.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.001+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c0c8620 con 0x7fae1c14ecb0 2024-01-21T20:00:17.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.001+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7fae0c01ca60 con 0x7fae1c14ecb0 2024-01-21T20:00:17.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.002+0000 7fae037fe700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 0x7fae08061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:17.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.002+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fae0c07c1e0 con 0x7fae1c14ecb0 2024-01-21T20:00:17.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.002+0000 7fae1affd700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 0x7fae08061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:17.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.002+0000 7fae1affd700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 0x7fae08061810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae100036d0 tx=0x7fae10009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:17.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.006+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae1c0c8620 con 0x7fae1c14ecb0 2024-01-21T20:00:18.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.193+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fae1c0c8620 con 0x7fae0805f350 2024-01-21T20:00:18.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.196+0000 7fae037fe700 1 -- 172.21.15.133:0/1079188566 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fae1c0c8620 con 0x7fae0805f350 2024-01-21T20:00:18.187 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir6 2024-01-21T20:00:18.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 msgr2=0x7fae08061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 0x7fae08061810 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae100036d0 tx=0x7fae10009040).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 msgr2=0x7fae1c0abed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fae0c009130 tx=0x7fae0c017000).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 shutdown_connections 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fae0805f350 0x7fae08061810 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae1c155a60 0x7fae1c0c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae1c14e8d0 0x7fae1c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 --2- 172.21.15.133:0/1079188566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae1c14ecb0 0x7fae1c0abed0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 >> 172.21.15.133:0/1079188566 conn(0x7fae1c084eb0 msgr2=0x7fae1c14cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 shutdown_connections 2024-01-21T20:00:18.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.198+0000 7fae21631700 1 -- 172.21.15.133:0/1079188566 wait complete. 2024-01-21T20:00:18.201 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2024-01-21T20:00:18.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2024-01-21T20:00:18.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.331+0000 7f4db1d90700 1 Processor -- start 2024-01-21T20:00:18.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.331+0000 7f4db1d90700 1 -- start start 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4db1d90700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dac063e10 0x7f4dac069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4db1d90700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 0x7f4dac0c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4db1d90700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac065440 con 0x7f4dac154050 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4db1d90700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0a4d90 con 0x7f4dac063e10 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4db1d90700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac069cd0 con 0x7f4dac0668e0 2024-01-21T20:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dac063e10 0x7f4dac069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4dab7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4dac154050 0x7f4dac063700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47336/0 (socket says 172.21.15.133:47336) 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4dab7fe700 1 -- 172.21.15.133:0/1235918029 learned_addr learned my addr 172.21.15.133:0/1235918029 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4dabfff700 1 --2- 172.21.15.133:0/1235918029 >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 0x7f4dac0c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 -- 172.21.15.133:0/1235918029 >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 msgr2=0x7f4dac0c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 --2- 172.21.15.133:0/1235918029 >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 0x7f4dac0c1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 -- 172.21.15.133:0/1235918029 >> v1:172.21.15.133:6789/0 conn(0x7f4dac154050 legacy=0x7f4dac063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 -- 172.21.15.133:0/1235918029 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac069fb0 con 0x7f4dac063e10 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daa7fc700 1 -- 172.21.15.133:0/1235918029 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680127400 0 0) 0x7f4dac065440 con 0x7f4dac154050 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4dabfff700 1 --2- 172.21.15.133:0/1235918029 >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 0x7f4dac0c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.332+0000 7f4daaffd700 1 --2- 172.21.15.133:0/1235918029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac063e10 0x7f4dac069550 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4dac06a410 tx=0x7f4d9c009060).ready entity=mon.0 client_cookie=d2c8fb04468f4581 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4daa7fc700 1 -- 172.21.15.133:0/1235918029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00b580 con 0x7f4dac063e10 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4daa7fc700 1 -- 172.21.15.133:0/1235918029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00b6e0 con 0x7f4dac063e10 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4daa7fc700 1 -- 172.21.15.133:0/1235918029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00ba60 con 0x7f4dac063e10 2024-01-21T20:00:18.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 -- 172.21.15.133:0/1235918029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac063e10 msgr2=0x7f4dac069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 --2- 172.21.15.133:0/1235918029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac063e10 0x7f4dac069550 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4dac06a410 tx=0x7f4d9c009060).stop 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 -- 172.21.15.133:0/1235918029 shutdown_connections 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 --2- 172.21.15.133:0/1235918029 >> v2:172.21.15.178:3300/0 conn(0x7f4dac0668e0 0x7f4dac0c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 --2- 172.21.15.133:0/1235918029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac063e10 0x7f4dac069550 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 -- 172.21.15.133:0/1235918029 >> 172.21.15.133:0/1235918029 conn(0x7f4dac0c4a10 msgr2=0x7f4dac068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 -- 172.21.15.133:0/1235918029 shutdown_connections 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.333+0000 7f4db1d90700 1 -- 172.21.15.133:0/1235918029 wait complete. 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.334+0000 7f4db1d90700 1 Processor -- start 2024-01-21T20:00:18.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.334+0000 7f4db1d90700 1 -- start start 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 0x7f4dac14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 0x7f4dac14b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac14a750 con 0x7f4dac154050 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac14c190 con 0x7f4dac063e10 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4db1d90700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac1513c0 con 0x7f4dac0668e0 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4dabfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4dabfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37530/0 (socket says 172.21.15.133:37530) 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.335+0000 7f4dabfff700 1 -- 172.21.15.133:0/4290639643 learned_addr learned my addr 172.21.15.133:0/4290639643 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4daaffd700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 0x7f4dac14b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dab7fe700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 0x7f4dac14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 -- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 msgr2=0x7f4dac14b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 0x7f4dac14b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 -- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 msgr2=0x7f4dac14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 0x7f4dac14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 -- 172.21.15.133:0/4290639643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0092a0 con 0x7f4dac154050 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4daaffd700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 0x7f4dac14b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dab7fe700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 0x7f4dac14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4dabfff700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4da400a380 tx=0x7f4da4007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400ae10 con 0x7f4dac154050 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400d650 con 0x7f4dac154050 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac1516a0 con 0x7f4dac154050 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da400d9d0 con 0x7f4dac154050 2024-01-21T20:00:18.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.336+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac151c60 con 0x7f4dac154050 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.337+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac151e50 con 0x7f4dac154050 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.337+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f4da4013070 con 0x7f4dac154050 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.337+0000 7f4da3fff700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 0x7f4d8c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.338+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f4da407ad60 con 0x7f4dac154050 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.338+0000 7f4dab7fe700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 0x7f4d8c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.338+0000 7f4dab7fe700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 0x7f4d8c061810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4d940016f0 tx=0x7f4d94009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.342+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4da404bd80 con 0x7f4dac154050 2024-01-21T20:00:18.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.533+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dac05fdf0 con 0x7f4d8c05f350 2024-01-21T20:00:18.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.536+0000 7f4da3fff700 1 -- 172.21.15.133:0/4290639643 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4dac05fdf0 con 0x7f4d8c05f350 2024-01-21T20:00:18.528 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir7 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 msgr2=0x7f4d8c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 0x7f4d8c061810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4d940016f0 tx=0x7f4d94009040).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 msgr2=0x7f4dac0a8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f4da400a380 tx=0x7f4da4007900).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 shutdown_connections 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d8c05f350 0x7f4d8c061810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dac154050 0x7f4dac0a8280 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dac063e10 0x7f4dac14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 --2- 172.21.15.133:0/4290639643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dac0668e0 0x7f4dac14b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 >> 172.21.15.133:0/4290639643 conn(0x7f4dac0c4a10 msgr2=0x7f4dac0bcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:18.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.538+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 shutdown_connections 2024-01-21T20:00:18.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.539+0000 7f4db1d90700 1 -- 172.21.15.133:0/4290639643 wait complete. 2024-01-21T20:00:18.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2024-01-21T20:00:18.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2024-01-21T20:00:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.672+0000 7f0c53153700 1 Processor -- start 2024-01-21T20:00:18.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.672+0000 7f0c53153700 1 -- start start 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c53153700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c4c066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c53153700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0c4c0c5330 0x7f0c4c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c53153700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0c37c0 con 0x7f0c4c157f30 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c53153700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c158ed0 con 0x7f0c4c0c5330 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c53153700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c1583b0 con 0x7f0c4c066b50 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c4bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0c4c157f30 0x7f0c4c0bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47350/0 (socket says 172.21.15.133:47350) 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.673+0000 7f0c4bfff700 1 -- 172.21.15.133:0/2373625297 learned_addr learned my addr 172.21.15.133:0/2373625297 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c516f0700 1 --2- 172.21.15.133:0/2373625297 >> v2:172.21.15.178:3300/0 conn(0x7f0c4c0c5330 0x7f0c4c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c50eef700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c4c066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098971238 0 0) 0x7f0c4c0c37c0 con 0x7f0c4c157f30 2024-01-21T20:00:18.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c0033f0 con 0x7f0c4c157f30 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1608704143 0 0) 0x7f0c3c0033f0 con 0x7f0c4c157f30 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 msgr2=0x7f0c4c066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c4c066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 >> v2:172.21.15.178:3300/0 conn(0x7f0c4c0c5330 msgr2=0x7f0c4c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 --2- 172.21.15.133:0/2373625297 >> v2:172.21.15.178:3300/0 conn(0x7f0c4c0c5330 0x7f0c4c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0c57c0 con 0x7f0c4c157f30 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0c38001470 con 0x7f0c4c157f30 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 >> v1:172.21.15.133:6789/0 conn(0x7f0c4c157f30 legacy=0x7f0c4c0bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c3c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c003e10 0x7f0c3c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c3c004b80 0x7f0c3c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c158ed0 con 0x7f0c3c003e10 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c1583b0 con 0x7f0c3c004b80 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c00b8e0 con 0x7f0c4c066b50 2024-01-21T20:00:18.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c003e10 0x7f0c3c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c50eef700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c3c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c516f0700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c3c004b80 0x7f0c3c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 -- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 msgr2=0x7f0c3c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c066b50 0x7f0c3c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 -- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c3c004b80 msgr2=0x7f0c3c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c3c004b80 0x7f0c3c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 -- 172.21.15.133:0/2373625297 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0033f0 con 0x7f0c3c003e10 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.674+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c003e10 0x7f0c3c004690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f0c3800c210 tx=0x7f0c4c0c3730).ready entity=mon.0 client_cookie=9abb785aa8ca8a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38007a60 con 0x7f0c3c003e10 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3800caa0 con 0x7f0c3c003e10 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c4b7fe700 1 -- 172.21.15.133:0/2373625297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800ce20 con 0x7f0c3c003e10 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 -- 172.21.15.133:0/2373625297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c003e10 msgr2=0x7f0c3c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 --2- 172.21.15.133:0/2373625297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c3c003e10 0x7f0c3c004690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f0c3800c210 tx=0x7f0c4c0c3730).stop 2024-01-21T20:00:18.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c516f0700 1 -- 172.21.15.133:0/2373625297 reap_dead start 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 -- 172.21.15.133:0/2373625297 shutdown_connections 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 -- 172.21.15.133:0/2373625297 >> 172.21.15.133:0/2373625297 conn(0x7f0c4c0c8f60 msgr2=0x7f0c4c0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 -- 172.21.15.133:0/2373625297 shutdown_connections 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.675+0000 7f0c53153700 1 -- 172.21.15.133:0/2373625297 wait complete. 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.676+0000 7f0c53153700 1 Processor -- start 2024-01-21T20:00:18.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.676+0000 7f0c53153700 1 -- start start 2024-01-21T20:00:18.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0c16a0 0x7f0c4c0ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c153680 0x7f0c4c0c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0ab230 con 0x7f0c4c152d30 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0ad8c0 con 0x7f0c4c0c16a0 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c53153700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c150770 con 0x7f0c4c153680 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c4bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37554/0 (socket says 172.21.15.133:37554) 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c4bfff700 1 -- 172.21.15.133:0/1570866961 learned_addr learned my addr 172.21.15.133:0/1570866961 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c50eef700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0c16a0 0x7f0c4c0ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.677+0000 7f0c516f0700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c153680 0x7f0c4c0c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 -- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c153680 msgr2=0x7f0c4c0c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c153680 0x7f0c4c0c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 -- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0c16a0 msgr2=0x7f0c4c0ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0c16a0 0x7f0c4c0ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 -- 172.21.15.133:0/1570866961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c150a50 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c4bfff700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0c38000fd0 tx=0x7f0c38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380075f0 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38004770 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0aabe0 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38004b10 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.678+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c14dfd0 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.679+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c05fdf0 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.679+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f0c38013450 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.679+0000 7f0c497fa700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 0x7f0c30061840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.680+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0c3807b040 con 0x7f0c4c152d30 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.680+0000 7f0c50eef700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 0x7f0c30061840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.680+0000 7f0c50eef700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 0x7f0c30061840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0c40006c40 tx=0x7f0c40008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:18.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.683+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c3804c000 con 0x7f0c4c152d30 2024-01-21T20:00:18.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.876+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c4c158630 con 0x7f0c3005f380 2024-01-21T20:00:18.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.880+0000 7f0c497fa700 1 -- 172.21.15.133:0/1570866961 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0c4c158630 con 0x7f0c3005f380 2024-01-21T20:00:18.871 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir8 2024-01-21T20:00:18.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 msgr2=0x7f0c30061840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 0x7f0c30061840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0c40006c40 tx=0x7f0c40008040).stop 2024-01-21T20:00:18.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 msgr2=0x7f0c4c153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:18.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0c38000fd0 tx=0x7f0c38015000).stop 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 shutdown_connections 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c3005f380 0x7f0c30061840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c4c153680 0x7f0c4c0c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c4c0c16a0 0x7f0c4c0ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 --2- 172.21.15.133:0/1570866961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c4c152d30 0x7f0c4c153190 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 >> 172.21.15.133:0/1570866961 conn(0x7f0c4c0c8f60 msgr2=0x7f0c4c0c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 shutdown_connections 2024-01-21T20:00:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:18.882+0000 7f0c53153700 1 -- 172.21.15.133:0/1570866961 wait complete. 2024-01-21T20:00:18.885 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2024-01-21T20:00:18.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2024-01-21T20:00:19.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.015+0000 7f792fd6f700 1 Processor -- start 2024-01-21T20:00:19.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.015+0000 7f792fd6f700 1 -- start start 2024-01-21T20:00:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792fd6f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928063e10 0x7f7928069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792fd6f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79280668e0 0x7f79280c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792fd6f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7928065440 con 0x7f7928154050 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792fd6f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280a4d90 con 0x7f79280668e0 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792fd6f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7928069cd0 con 0x7f7928063e10 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79280668e0 0x7f79280c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792db0b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7928154050 0x7f7928063700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47366/0 (socket says 172.21.15.133:47366) 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792db0b700 1 -- 172.21.15.133:0/3957524430 learned_addr learned my addr 172.21.15.133:0/3957524430 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792d30a700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928063e10 0x7f7928069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 -- 172.21.15.133:0/3957524430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928063e10 msgr2=0x7f7928069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928063e10 0x7f7928069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 -- 172.21.15.133:0/3957524430 >> v1:172.21.15.133:6789/0 conn(0x7f7928154050 legacy=0x7f7928063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792cb09700 1 -- 172.21.15.133:0/3957524430 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383723327 0 0) 0x7f7928065440 con 0x7f7928154050 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 -- 172.21.15.133:0/3957524430 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928069fb0 con 0x7f79280668e0 2024-01-21T20:00:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.016+0000 7f792e30c700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280c1aa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7920009e60 tx=0x7f7920009780).ready entity=mon.0 client_cookie=df12784feeeb2c6e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792cb09700 1 -- 172.21.15.133:0/3957524430 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000e070 con 0x7f79280668e0 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792cb09700 1 -- 172.21.15.133:0/3957524430 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000bc30 con 0x7f79280668e0 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792cb09700 1 -- 172.21.15.133:0/3957524430 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920012410 con 0x7f79280668e0 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 -- 172.21.15.133:0/3957524430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 msgr2=0x7f79280c1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280c1aa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7920009e60 tx=0x7f7920009780).stop 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 -- 172.21.15.133:0/3957524430 shutdown_connections 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280c1aa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 --2- 172.21.15.133:0/3957524430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928063e10 0x7f7928069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 -- 172.21.15.133:0/3957524430 >> 172.21.15.133:0/3957524430 conn(0x7f79280c4a10 msgr2=0x7f7928068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 -- 172.21.15.133:0/3957524430 shutdown_connections 2024-01-21T20:00:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.017+0000 7f792fd6f700 1 -- 172.21.15.133:0/3957524430 wait complete. 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.018+0000 7f792fd6f700 1 Processor -- start 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.018+0000 7f792fd6f700 1 -- start start 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7928063e10 0x7f79280bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928154050 0x7f79280c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928164400 con 0x7f79280668e0 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c1080 con 0x7f7928063e10 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792fd6f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c1510 con 0x7f7928154050 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792d30a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792d30a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37562/0 (socket says 172.21.15.133:37562) 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.019+0000 7f792d30a700 1 -- 172.21.15.133:0/2651277509 learned_addr learned my addr 172.21.15.133:0/2651277509 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792e30c700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928154050 0x7f79280c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 -- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928154050 msgr2=0x7f79280c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928154050 0x7f79280c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 -- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7928063e10 msgr2=0x7f79280bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7928063e10 0x7f79280bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 -- 172.21.15.133:0/2651277509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7920009a20 con 0x7f79280668e0 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792d30a700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f791800c880 tx=0x7f7918008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918010580 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79180106e0 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7918010a60 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79280c0190 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.020+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79280c0750 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.021+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792805fdf0 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.021+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 8) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f791801b460 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.022+0000 7f791e7fc700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 0x7f790c061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.022+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f791807a5d0 con 0x7f79280668e0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.022+0000 7f792db0b700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 0x7f790c061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:00:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.022+0000 7f792db0b700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 0x7f790c061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f79281509f0 tx=0x7f7924007a50).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:00:19.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.026+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f791804b480 con 0x7f79280668e0 2024-01-21T20:00:19.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.219+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f79280c11f0 con 0x7f790c05f350 2024-01-21T20:00:19.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.222+0000 7f791e7fc700 1 -- 172.21.15.133:0/2651277509 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f79280c11f0 con 0x7f790c05f350 2024-01-21T20:00:19.214 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/dir9 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 msgr2=0x7f790c061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 0x7f790c061810 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f79281509f0 tx=0x7f7924007a50).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 msgr2=0x7f79280abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f791800c880 tx=0x7f7918008040).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 shutdown_connections 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790c05f350 0x7f790c061810 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7928154050 0x7f79280c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7928063e10 0x7f79280bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 --2- 172.21.15.133:0/2651277509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79280668e0 0x7f79280abc80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:00:19.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 >> 172.21.15.133:0/2651277509 conn(0x7f79280c4a10 msgr2=0x7f79280bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:00:19.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 shutdown_connections 2024-01-21T20:00:19.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:00:19.224+0000 7f792fd6f700 1 -- 172.21.15.133:0/2651277509 wait complete. 2024-01-21T20:00:19.227 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2024-01-21T20:00:45.179 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:00:45.183 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:01:00.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:01:00.175+0000 7f74d509e700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:01:00.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:01:00.175+0000 7f74d509e700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:01:00.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:01:00.175+0000 7f74d509e700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:01:00.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:01:00.175+0000 7f74d509e700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:01:00.166 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:01:00.175+0000 7f74d509e700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:01:15.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:01:15.255 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:01:45.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:01:45.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:02:15.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:02:15.423 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:02:45.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:02:45.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:03:15.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:03:15.669 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:03:45.761 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:03:45.765 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:04:15.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:04:15.835 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:04:45.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:04:45.907 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:05:16.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:05:16.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:05:46.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:05:46.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:06:16.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:06:16.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:06:46.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:06:46.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:07:16.322 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:07:16.326 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:07:46.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:07:46.398 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:08:16.513 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:08:16.516 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:08:46.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:08:46.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:09:16.681 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:09:16.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:09:46.759 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:09:46.762 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:10:16.832 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:10:16.837 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:10:46.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:10:46.913 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:11:16.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:11:16.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:11:19.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2024-01-21T20:11:19.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.373+0000 7fd06e7d9700 1 Processor -- start 2024-01-21T20:11:19.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.373+0000 7fd06e7d9700 1 -- start start 2024-01-21T20:11:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06e7d9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd068150de0 0x7fd0681511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06e7d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd068069510 0x7fd068069980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06e7d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0680be2b0 con 0x7fd0680bd130 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06e7d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd068069e70 con 0x7fd068069510 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06e7d9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0680be740 con 0x7fd068150de0 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd068069510 0x7fd068069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd068069510 0x7fd068069980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41552/0 (socket says 172.21.15.133:41552) 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 -- 172.21.15.133:0/2496663922 learned_addr learned my addr 172.21.15.133:0/2496663922 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd0677fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd0680bd130 0x7fd0680c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35310/0 (socket says 172.21.15.133:35310) 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd067fff700 1 --2- 172.21.15.133:0/2496663922 >> v2:172.21.15.178:3300/0 conn(0x7fd068150de0 0x7fd0681511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 -- 172.21.15.133:0/2496663922 >> v2:172.21.15.178:3300/0 conn(0x7fd068150de0 msgr2=0x7fd0681511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 --2- 172.21.15.133:0/2496663922 >> v2:172.21.15.178:3300/0 conn(0x7fd068150de0 0x7fd0681511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 -- 172.21.15.133:0/2496663922 >> v1:172.21.15.133:6789/0 conn(0x7fd0680bd130 legacy=0x7fd0680c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 -- 172.21.15.133:0/2496663922 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680bd6a0 con 0x7fd068069510 2024-01-21T20:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd066ffd700 1 -- 172.21.15.133:0/2496663922 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772353522 0 0) 0x7fd0680be2b0 con 0x7fd0680bd130 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd06cd76700 1 --2- 172.21.15.133:0/2496663922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068069510 0x7fd068069980 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fd06805eb80 tx=0x7fd06000ba50).ready entity=mon.0 client_cookie=21d16598ed850d91 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd066ffd700 1 -- 172.21.15.133:0/2496663922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060010070 con 0x7fd068069510 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd066ffd700 1 -- 172.21.15.133:0/2496663922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000de90 con 0x7fd068069510 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.374+0000 7fd066ffd700 1 -- 172.21.15.133:0/2496663922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000b2e0 con 0x7fd068069510 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 -- 172.21.15.133:0/2496663922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068069510 msgr2=0x7fd068069980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/2496663922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068069510 0x7fd068069980 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fd06805eb80 tx=0x7fd06000ba50).stop 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 -- 172.21.15.133:0/2496663922 shutdown_connections 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/2496663922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068069510 0x7fd068069980 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/2496663922 >> v2:172.21.15.178:3300/0 conn(0x7fd068150de0 0x7fd0681511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 -- 172.21.15.133:0/2496663922 >> 172.21.15.133:0/2496663922 conn(0x7fd0680c7d30 msgr2=0x7fd0680c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 -- 172.21.15.133:0/2496663922 shutdown_connections 2024-01-21T20:11:19.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.375+0000 7fd06e7d9700 1 -- 172.21.15.133:0/2496663922 wait complete. 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.376+0000 7fd06e7d9700 1 Processor -- start 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 -- start start 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd068069510 0x7fd068168380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0680bd130 0x7fd0680c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068168940 con 0x7fd068150de0 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680c1220 con 0x7fd068069510 2024-01-21T20:11:19.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06e7d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680a5bc0 con 0x7fd0680bd130 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06cd76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06cd76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41558/0 (socket says 172.21.15.133:41558) 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.377+0000 7fd06cd76700 1 -- 172.21.15.133:0/3568888844 learned_addr learned my addr 172.21.15.133:0/3568888844 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd067fff700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd068069510 0x7fd068168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd0677fe700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0680bd130 0x7fd0680c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 -- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0680bd130 msgr2=0x7fd0680c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0680bd130 0x7fd0680c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 -- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd068069510 msgr2=0x7fd068168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd068069510 0x7fd068168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 -- 172.21.15.133:0/3568888844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06000bcf0 con 0x7fd068150de0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06cd76700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd06000da40 tx=0x7fd06000ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000b0d0 con 0x7fd068150de0 2024-01-21T20:11:19.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000b230 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0680c05e0 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06001e660 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.378+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680c0b60 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.379+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0680c1360 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.379+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd060003040 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.380+0000 7fd064ff9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 0x7fd054061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.380+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd06007b980 con 0x7fd068150de0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.380+0000 7fd067fff700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 0x7fd054061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.380+0000 7fd067fff700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 0x7fd054061780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd068145710 tx=0x7fd058008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.384+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0680c1360 con 0x7fd068150de0 2024-01-21T20:11:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.573+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0680c1360 con 0x7fd05405f2c0 2024-01-21T20:11:19.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.577+0000 7fd064ff9700 1 -- 172.21.15.133:0/3568888844 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd0680c1360 con 0x7fd05405f2c0 2024-01-21T20:11:19.567 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2024-01-21T20:11:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 msgr2=0x7fd054061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 0x7fd054061780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd068145710 tx=0x7fd058008040).stop 2024-01-21T20:11:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 msgr2=0x7fd0680a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fd06000da40 tx=0x7fd06000ba50).stop 2024-01-21T20:11:19.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 shutdown_connections 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05405f2c0 0x7fd054061780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd068150de0 0x7fd0680a9c00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd068069510 0x7fd068168380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 --2- 172.21.15.133:0/3568888844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0680bd130 0x7fd0680c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 >> 172.21.15.133:0/3568888844 conn(0x7fd0680c7d30 msgr2=0x7fd06814b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 shutdown_connections 2024-01-21T20:11:19.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.579+0000 7fd06e7d9700 1 -- 172.21.15.133:0/3568888844 wait complete. 2024-01-21T20:11:19.580 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2024-01-21T20:11:19.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2024-01-21T20:11:19.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.712+0000 7f1562f47700 1 Processor -- start 2024-01-21T20:11:19.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.712+0000 7f1562f47700 1 -- start start 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f1562f47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f155c0bd130 0x7f155c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f1562f47700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0be2b0 con 0x7f155c069510 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f1562f47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0be740 con 0x7f155c150de0 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f1562f47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0bd6a0 con 0x7f155c0bd130 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f155c0bd130 0x7f155c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f155c0bd130 0x7f155c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41560/0 (socket says 172.21.15.133:41560) 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f15614e4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f155c069510 0x7f155c065680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35324/0 (socket says 172.21.15.133:35324) 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 -- 172.21.15.133:0/2289149244 learned_addr learned my addr 172.21.15.133:0/2289149244 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:19.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 -- 172.21.15.133:0/2289149244 >> v1:172.21.15.178:6789/0 conn(0x7f155c150de0 legacy=0x7f155c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 -- 172.21.15.133:0/2289149244 >> v1:172.21.15.133:6789/0 conn(0x7f155c069510 legacy=0x7f155c065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 -- 172.21.15.133:0/2289149244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0bd980 con 0x7f155c0bd130 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155b7fe700 1 -- 172.21.15.133:0/2289149244 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013526886 0 0) 0x7f155c0be2b0 con 0x7f155c069510 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.713+0000 7f155bfff700 1 --2- 172.21.15.133:0/2289149244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c0bd130 0x7f155c1511c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1548006fd0 tx=0x7f154800b3b0).ready entity=mon.0 client_cookie=7251c2a1e23ce656 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f155b7fe700 1 -- 172.21.15.133:0/2289149244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154800db00 con 0x7f155c0bd130 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f155b7fe700 1 -- 172.21.15.133:0/2289149244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154800dc60 con 0x7f155c0bd130 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f155b7fe700 1 -- 172.21.15.133:0/2289149244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1548010470 con 0x7f155c0bd130 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 -- 172.21.15.133:0/2289149244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c0bd130 msgr2=0x7f155c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 --2- 172.21.15.133:0/2289149244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c0bd130 0x7f155c1511c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1548006fd0 tx=0x7f154800b3b0).stop 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 -- 172.21.15.133:0/2289149244 shutdown_connections 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 --2- 172.21.15.133:0/2289149244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c0bd130 0x7f155c1511c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 -- 172.21.15.133:0/2289149244 >> 172.21.15.133:0/2289149244 conn(0x7f155c0c7d30 msgr2=0x7f155c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 -- 172.21.15.133:0/2289149244 shutdown_connections 2024-01-21T20:11:19.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.714+0000 7f1562f47700 1 -- 172.21.15.133:0/2289149244 wait complete. 2024-01-21T20:11:19.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.715+0000 7f1562f47700 1 Processor -- start 2024-01-21T20:11:19.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.715+0000 7f1562f47700 1 -- start start 2024-01-21T20:11:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 0x7f155c0ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 0x7f155c0aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c152cc0 con 0x7f155c150de0 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0acb40 con 0x7f155c0bd130 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f1562f47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0aa910 con 0x7f155c069510 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f15614e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f15614e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41576/0 (socket says 172.21.15.133:41576) 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.716+0000 7f15614e4700 1 -- 172.21.15.133:0/1618082094 learned_addr learned my addr 172.21.15.133:0/1618082094 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f155bfff700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 0x7f155c0aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 -- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 msgr2=0x7f155c0ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f1560ce3700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 0x7f155c0ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 0x7f155c0ac650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 -- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 msgr2=0x7f155c0aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 0x7f155c0aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 -- 172.21.15.133:0/1618082094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154800b610 con 0x7f155c150de0 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f155bfff700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 0x7f155c0aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:19.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f1560ce3700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 0x7f155c0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15614e4700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f155400c790 tx=0x7f1554001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554005c70 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1554005dd0 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c0acd90 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554007340 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.717+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c0ad350 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.718+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c152e70 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.718+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f15540076f0 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.719+0000 7f15597fa700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 0x7f1540061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.719+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f155407a510 con 0x7f155c150de0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.719+0000 7f1560ce3700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 0x7f1540061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:19.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.719+0000 7f1560ce3700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 0x7f1540061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f155000a8a0 tx=0x7f1550008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:19.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.723+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f155c152e70 con 0x7f155c150de0 2024-01-21T20:11:19.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.914+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f155c152e70 con 0x7f154005f2c0 2024-01-21T20:11:19.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.917+0000 7f15597fa700 1 -- 172.21.15.133:0/1618082094 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f155c152e70 con 0x7f154005f2c0 2024-01-21T20:11:19.907 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2024-01-21T20:11:19.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 msgr2=0x7f1540061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 0x7f1540061780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f155000a8a0 tx=0x7f1550008040).stop 2024-01-21T20:11:19.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 msgr2=0x7f155c0a77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:19.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f155400c790 tx=0x7f1554001520).stop 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 shutdown_connections 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f154005f2c0 0x7f1540061780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f155c150de0 0x7f155c0a77d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f155c069510 0x7f155c0ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 --2- 172.21.15.133:0/1618082094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f155c0bd130 0x7f155c0aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 >> 172.21.15.133:0/1618082094 conn(0x7f155c0c7d30 msgr2=0x7f155c0c66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 shutdown_connections 2024-01-21T20:11:19.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:19.919+0000 7f1562f47700 1 -- 172.21.15.133:0/1618082094 wait complete. 2024-01-21T20:11:19.921 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2024-01-21T20:11:19.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2024-01-21T20:11:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.051+0000 7f1c2eefe700 1 Processor -- start 2024-01-21T20:11:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.051+0000 7f1c2eefe700 1 -- start start 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2eefe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c280bdf20 0x7f1c280bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2eefe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c280c32e0 con 0x7f1c280652b0 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2eefe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c280c2ff0 con 0x7f1c28069cd0 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2eefe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c28152500 con 0x7f1c280bdf20 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2cc9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c280bdf20 0x7f1c280bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2cc9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c280bdf20 0x7f1c280bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41588/0 (socket says 172.21.15.133:41588) 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c27fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c280652b0 0x7f1c280695c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35340/0 (socket says 172.21.15.133:35340) 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.052+0000 7f1c2cc9a700 1 -- 172.21.15.133:0/400022002 learned_addr learned my addr 172.21.15.133:0/400022002 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c2cc9a700 1 -- 172.21.15.133:0/400022002 >> v1:172.21.15.178:6789/0 conn(0x7f1c28069cd0 legacy=0x7f1c280c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:20.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c2cc9a700 1 -- 172.21.15.133:0/400022002 >> v1:172.21.15.133:6789/0 conn(0x7f1c280652b0 legacy=0x7f1c280695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c2cc9a700 1 -- 172.21.15.133:0/400022002 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28151c60 con 0x7f1c280bdf20 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c277fe700 1 -- 172.21.15.133:0/400022002 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586427662 0 0) 0x7f1c280c32e0 con 0x7f1c280652b0 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c2cc9a700 1 --2- 172.21.15.133:0/400022002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280bcd60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f1c1c006fd0 tx=0x7f1c1c0090f0).ready entity=mon.0 client_cookie=e4c927e19191a87f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c277fe700 1 -- 172.21.15.133:0/400022002 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00b600 con 0x7f1c280bdf20 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c277fe700 1 -- 172.21.15.133:0/400022002 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00b760 con 0x7f1c280bdf20 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.053+0000 7f1c277fe700 1 -- 172.21.15.133:0/400022002 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00bae0 con 0x7f1c280bdf20 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 -- 172.21.15.133:0/400022002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 msgr2=0x7f1c280bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/400022002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280bcd60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f1c1c006fd0 tx=0x7f1c1c0090f0).stop 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 -- 172.21.15.133:0/400022002 shutdown_connections 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/400022002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280bcd60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 -- 172.21.15.133:0/400022002 >> 172.21.15.133:0/400022002 conn(0x7f1c280c7d20 msgr2=0x7f1c280c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 -- 172.21.15.133:0/400022002 shutdown_connections 2024-01-21T20:11:20.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.054+0000 7f1c2eefe700 1 -- 172.21.15.133:0/400022002 wait complete. 2024-01-21T20:11:20.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.055+0000 7f1c2eefe700 1 Processor -- start 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.055+0000 7f1c2eefe700 1 -- start start 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 0x7f1c2814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 0x7f1c280a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280aa140 con 0x7f1c280bdf20 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2814c9c0 con 0x7f1c28069cd0 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2814ed60 con 0x7f1c280652b0 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41590/0 (socket says 172.21.15.133:41590) 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 -- 172.21.15.133:0/418977457 learned_addr learned my addr 172.21.15.133:0/418977457 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c27fff700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 0x7f1c280a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2cc9a700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 0x7f1c2814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 -- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 msgr2=0x7f1c2814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 0x7f1c2814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 -- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 msgr2=0x7f1c280a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 0x7f1c280a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 -- 172.21.15.133:0/418977457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c009370 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c27fff700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 0x7f1c280a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2cc9a700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 0x7f1c2814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2d49b700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1c2000b840 tx=0x7f1c200092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000d600 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000d7a0 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000db60 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.056+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2814f040 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.057+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2814f600 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.058+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2805fdf0 con 0x7f1c280bdf20 2024-01-21T20:11:20.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.058+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1c20019460 con 0x7f1c280bdf20 2024-01-21T20:11:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.058+0000 7f1c257fa700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 0x7f1c0c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.058+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1c2007a6d0 con 0x7f1c280bdf20 2024-01-21T20:11:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.058+0000 7f1c2cc9a700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 0x7f1c0c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.059+0000 7f1c2cc9a700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 0x7f1c0c061780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1c1c009130 tx=0x7f1c1c017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.062+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c2004b6f0 con 0x7f1c280bdf20 2024-01-21T20:11:20.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.253+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c280aa830 con 0x7f1c0c05f2c0 2024-01-21T20:11:20.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.257+0000 7f1c257fa700 1 -- 172.21.15.133:0/418977457 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1c280aa830 con 0x7f1c0c05f2c0 2024-01-21T20:11:20.247 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 msgr2=0x7f1c0c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 0x7f1c0c061780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1c1c009130 tx=0x7f1c1c017000).stop 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 msgr2=0x7f1c280a5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1c2000b840 tx=0x7f1c200092d0).stop 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 shutdown_connections 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c0c05f2c0 0x7f1c0c061780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c280bdf20 0x7f1c280a5010 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c280652b0 0x7f1c2814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 --2- 172.21.15.133:0/418977457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c28069cd0 0x7f1c280a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 >> 172.21.15.133:0/418977457 conn(0x7f1c280c7d20 msgr2=0x7f1c2814e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 shutdown_connections 2024-01-21T20:11:20.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.259+0000 7f1c2eefe700 1 -- 172.21.15.133:0/418977457 wait complete. 2024-01-21T20:11:20.260 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2024-01-21T20:11:20.261 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2024-01-21T20:11:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.391+0000 7f1a60b83700 1 Processor -- start 2024-01-21T20:11:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.391+0000 7f1a60b83700 1 -- start start 2024-01-21T20:11:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.392+0000 7f1a60b83700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a5c151c00 0x7f1a5c063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.392+0000 7f1a60b83700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c154920 con 0x7f1a5c069e80 2024-01-21T20:11:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.392+0000 7f1a60b83700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c154c00 con 0x7f1a5c151fe0 2024-01-21T20:11:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.392+0000 7f1a60b83700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c1555a0 con 0x7f1a5c151c00 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1a5c069e80 0x7f1a5c064d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36420/0 (socket says 172.21.15.133:36420) 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5ad9d700 1 -- 172.21.15.133:0/1635054491 learned_addr learned my addr 172.21.15.133:0/1635054491 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5a59c700 1 --2- 172.21.15.133:0/1635054491 >> v2:172.21.15.178:3300/0 conn(0x7f1a5c151c00 0x7f1a5c063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221115991 0 0) 0x7f1a5c154920 con 0x7f1a5c069e80 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a440033f0 con 0x7f1a5c069e80 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5a59c700 1 -- 172.21.15.133:0/1635054491 >> v1:172.21.15.178:6789/0 conn(0x7f1a5c151fe0 legacy=0x7f1a5c069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5a59c700 1 -- 172.21.15.133:0/1635054491 >> v1:172.21.15.133:6789/0 conn(0x7f1a5c069e80 legacy=0x7f1a5c064d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622856984 0 0) 0x7f1a440033f0 con 0x7f1a5c069e80 2024-01-21T20:11:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5a59c700 1 -- 172.21.15.133:0/1635054491 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c154ee0 con 0x7f1a5c151c00 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5a59c700 1 --2- 172.21.15.133:0/1635054491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c063700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1a50009760 tx=0x7f1a50009060).ready entity=mon.1 client_cookie=b126b89285a714c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540017f0 con 0x7f1a5c151c00 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50011400 con 0x7f1a5c151c00 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.393+0000 7f1a5959a700 1 -- 172.21.15.133:0/1635054491 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50011780 con 0x7f1a5c151c00 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 -- 172.21.15.133:0/1635054491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 msgr2=0x7f1a5c063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 --2- 172.21.15.133:0/1635054491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c063700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f1a50009760 tx=0x7f1a50009060).stop 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 -- 172.21.15.133:0/1635054491 shutdown_connections 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 --2- 172.21.15.133:0/1635054491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c063700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 -- 172.21.15.133:0/1635054491 >> 172.21.15.133:0/1635054491 conn(0x7f1a5c0c49e0 msgr2=0x7f1a5c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 -- 172.21.15.133:0/1635054491 shutdown_connections 2024-01-21T20:11:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.394+0000 7f1a60b83700 1 -- 172.21.15.133:0/1635054491 wait complete. 2024-01-21T20:11:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.395+0000 7f1a60b83700 1 Processor -- start 2024-01-21T20:11:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.395+0000 7f1a60b83700 1 -- start start 2024-01-21T20:11:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c069e80 0x7f1a5c14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c0aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0c12b0 con 0x7f1a5c151fe0 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1500d0 con 0x7f1a5c151c00 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a60b83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c158e80 con 0x7f1a5c069e80 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a5ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a5ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38220/0 (socket says 172.21.15.133:38220) 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.396+0000 7f1a5ad9d700 1 -- 172.21.15.133:0/4176553178 learned_addr learned my addr 172.21.15.133:0/4176553178 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5a59c700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c069e80 0x7f1a5c14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a59d9b700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c0aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 -- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c069e80 msgr2=0x7f1a5c14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c069e80 0x7f1a5c14f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 -- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 msgr2=0x7f1a5c0aa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c0aa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 -- 172.21.15.133:0/4176553178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a500092a0 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a59d9b700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a5ad9d700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1a5400cb70 tx=0x7f1a54001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004c40 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54004da0 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c1508e0 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54007380 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.397+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c150320 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.398+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c05fdf0 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.398+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1a54007730 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.398+0000 7f1a4affd700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 0x7f1a3c061750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.399+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1a5407a480 con 0x7f1a5c151fe0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.399+0000 7f1a5a59c700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 0x7f1a3c061750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.399+0000 7f1a5a59c700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 0x7f1a3c061750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a50009760 tx=0x7f1a50014000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.403+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a5404b500 con 0x7f1a5c151fe0 2024-01-21T20:11:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.595+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a5c158fc0 con 0x7f1a3c05f290 2024-01-21T20:11:20.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.598+0000 7f1a4affd700 1 -- 172.21.15.133:0/4176553178 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1a5c158fc0 con 0x7f1a3c05f290 2024-01-21T20:11:20.588 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2024-01-21T20:11:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 msgr2=0x7f1a3c061750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 0x7f1a3c061750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a50009760 tx=0x7f1a50014000).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 msgr2=0x7f1a5c158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1a5400cb70 tx=0x7f1a54001e20).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 shutdown_connections 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1a3c05f290 0x7f1a3c061750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a5c151fe0 0x7f1a5c158050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c069e80 0x7f1a5c14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 --2- 172.21.15.133:0/4176553178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c151c00 0x7f1a5c0aa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 >> 172.21.15.133:0/4176553178 conn(0x7f1a5c0c49e0 msgr2=0x7f1a5c0bc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 shutdown_connections 2024-01-21T20:11:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.600+0000 7f1a60b83700 1 -- 172.21.15.133:0/4176553178 wait complete. 2024-01-21T20:11:20.602 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2024-01-21T20:11:20.602 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2024-01-21T20:11:20.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.732+0000 7fed1fa7c700 1 Processor -- start 2024-01-21T20:11:20.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.732+0000 7fed1fa7c700 1 -- start start 2024-01-21T20:11:20.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1fa7c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed180bda90 0x7fed180694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1fa7c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180c23b0 con 0x7fed180c3850 2024-01-21T20:11:20.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1fa7c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed18067600 con 0x7fed1813a7b0 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1fa7c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed180663c0 con 0x7fed180bda90 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1d017700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed180bda90 0x7fed180694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1d017700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed180bda90 0x7fed180694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38236/0 (socket says 172.21.15.133:38236) 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1d017700 1 -- 172.21.15.133:0/3626207143 learned_addr learned my addr 172.21.15.133:0/3626207143 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.733+0000 7fed1e019700 1 --1- 172.21.15.133:0/3626207143 >> v1:172.21.15.133:6789/0 conn(0x7fed180c3850 0x7fed1815ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36422/0 (socket says 172.21.15.133:36422) 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1d017700 1 -- 172.21.15.133:0/3626207143 >> v1:172.21.15.178:6789/0 conn(0x7fed1813a7b0 legacy=0x7fed18066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1d017700 1 -- 172.21.15.133:0/3626207143 >> v1:172.21.15.133:6789/0 conn(0x7fed180c3850 legacy=0x7fed1815ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1d017700 1 -- 172.21.15.133:0/3626207143 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180678e0 con 0x7fed180bda90 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1c816700 1 -- 172.21.15.133:0/3626207143 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682819319 0 0) 0x7fed180c23b0 con 0x7fed180c3850 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1d017700 1 --2- 172.21.15.133:0/3626207143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180bda90 0x7fed180694d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fed14006fd0 tx=0x7fed1400b3b0).ready entity=mon.0 client_cookie=30c82fc98a52a215 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1c816700 1 -- 172.21.15.133:0/3626207143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1400db40 con 0x7fed180bda90 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1c816700 1 -- 172.21.15.133:0/3626207143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1400dca0 con 0x7fed180bda90 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1c816700 1 -- 172.21.15.133:0/3626207143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed14010680 con 0x7fed180bda90 2024-01-21T20:11:20.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3626207143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180bda90 msgr2=0x7fed180694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3626207143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180bda90 0x7fed180694d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fed14006fd0 tx=0x7fed1400b3b0).stop 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3626207143 shutdown_connections 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3626207143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180bda90 0x7fed180694d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3626207143 >> 172.21.15.133:0/3626207143 conn(0x7fed180c7d20 msgr2=0x7fed180c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3626207143 shutdown_connections 2024-01-21T20:11:20.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.734+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3626207143 wait complete. 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 Processor -- start 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 -- start start 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed1813a7b0 0x7fed180accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed180ab1c0 0x7fed180a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180ac730 con 0x7fed180c3850 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180ab690 con 0x7fed180ab1c0 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1fa7c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180ab970 con 0x7fed1813a7b0 2024-01-21T20:11:20.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1d818700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1d818700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38244/0 (socket says 172.21.15.133:38244) 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.736+0000 7fed1d818700 1 -- 172.21.15.133:0/3409352239 learned_addr learned my addr 172.21.15.133:0/3409352239 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 -- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed1813a7b0 msgr2=0x7fed180accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed1813a7b0 0x7fed180accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 -- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed180ab1c0 msgr2=0x7fed180a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed180ab1c0 0x7fed180a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 -- 172.21.15.133:0/3409352239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1400b610 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1d818700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fed0800b460 tx=0x7fed08006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08012410 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08012590 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08012950 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed180abc50 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.737+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed180ac210 con 0x7fed180c3850 2024-01-21T20:11:20.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.738+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1805fdf0 con 0x7fed180c3850 2024-01-21T20:11:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.738+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fed08012cc0 con 0x7fed180c3850 2024-01-21T20:11:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.739+0000 7fed0e777700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 0x7fecfc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.739+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fed0807a280 con 0x7fed180c3850 2024-01-21T20:11:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.739+0000 7fed1d017700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 0x7fecfc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.739+0000 7fed1d017700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 0x7fecfc061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fed1400bfd0 tx=0x7fed1400b3b0).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:20.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.743+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fed0804b300 con 0x7fed180c3850 2024-01-21T20:11:20.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.933+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed18067bc0 con 0x7fecfc05f2c0 2024-01-21T20:11:20.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.936+0000 7fed0e777700 1 -- 172.21.15.133:0/3409352239 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fed18067bc0 con 0x7fecfc05f2c0 2024-01-21T20:11:20.926 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.938+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 msgr2=0x7fecfc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.938+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 0x7fecfc061780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fed1400bfd0 tx=0x7fed1400b3b0).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 msgr2=0x7fed180aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fed0800b460 tx=0x7fed08006f20).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 shutdown_connections 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fecfc05f2c0 0x7fecfc061780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed180ab1c0 0x7fed180a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed180c3850 0x7fed180aacd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 --2- 172.21.15.133:0/3409352239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed1813a7b0 0x7fed180accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 >> 172.21.15.133:0/3409352239 conn(0x7fed180c7d20 msgr2=0x7fed180c4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 shutdown_connections 2024-01-21T20:11:20.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:20.939+0000 7fed1fa7c700 1 -- 172.21.15.133:0/3409352239 wait complete. 2024-01-21T20:11:20.940 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2024-01-21T20:11:20.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2024-01-21T20:11:21.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.073+0000 7fde377a3700 1 Processor -- start 2024-01-21T20:11:21.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.073+0000 7fde377a3700 1 -- start start 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde377a3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 0x7fde3005e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde377a3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300c9040 con 0x7fde3014ecb0 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde377a3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde300c9290 con 0x7fde300c0a70 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde377a3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde300c9570 con 0x7fde3014e8d0 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde34d3e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde3014ecb0 0x7fde30155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36428/0 (socket says 172.21.15.133:36428) 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde34d3e700 1 -- 172.21.15.133:0/3841921710 learned_addr learned my addr 172.21.15.133:0/3841921710 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.074+0000 7fde3553f700 1 --2- 172.21.15.133:0/3841921710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 0x7fde3005e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521662766 0 0) 0x7fde300c9040 con 0x7fde3014ecb0 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1c0033f0 con 0x7fde3014ecb0 2024-01-21T20:11:21.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416793648 0 0) 0x7fde300c9290 con 0x7fde300c0a70 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde300c9040 con 0x7fde300c0a70 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078173581 0 0) 0x7fde1c0033f0 con 0x7fde3014ecb0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde3553f700 1 -- 172.21.15.133:0/3841921710 >> v1:172.21.15.178:6789/0 conn(0x7fde300c0a70 legacy=0x7fde30156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde3553f700 1 -- 172.21.15.133:0/3841921710 >> v1:172.21.15.133:6789/0 conn(0x7fde3014ecb0 legacy=0x7fde30155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde3553f700 1 -- 172.21.15.133:0/3841921710 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300c9850 con 0x7fde3014e8d0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde3553f700 1 --2- 172.21.15.133:0/3841921710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 0x7fde3005e9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fde20009790 tx=0x7fde20009060).ready entity=mon.2 client_cookie=12caeede46e53cbf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c001470 con 0x7fde3014e8d0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde20011400 con 0x7fde3014e8d0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.075+0000 7fde27fff700 1 -- 172.21.15.133:0/3841921710 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde20011780 con 0x7fde3014e8d0 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 -- 172.21.15.133:0/3841921710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 msgr2=0x7fde3005e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 --2- 172.21.15.133:0/3841921710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 0x7fde3005e9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fde20009790 tx=0x7fde20009060).stop 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 -- 172.21.15.133:0/3841921710 shutdown_connections 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 --2- 172.21.15.133:0/3841921710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014e8d0 0x7fde3005e9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 -- 172.21.15.133:0/3841921710 >> 172.21.15.133:0/3841921710 conn(0x7fde30084eb0 msgr2=0x7fde300947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 -- 172.21.15.133:0/3841921710 shutdown_connections 2024-01-21T20:11:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.076+0000 7fde377a3700 1 -- 172.21.15.133:0/3841921710 wait complete. 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.077+0000 7fde377a3700 1 Processor -- start 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.077+0000 7fde377a3700 1 -- start start 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde300c0a70 0x7fde3013c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014ecb0 0x7fde300aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde300b0430 con 0x7fde3014e8d0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30096870 con 0x7fde300c0a70 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde377a3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde30157350 con 0x7fde3014ecb0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38256/0 (socket says 172.21.15.133:38256) 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 -- 172.21.15.133:0/2622044183 learned_addr learned my addr 172.21.15.133:0/2622044183 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde3553f700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde300c0a70 0x7fde3013c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde35d40700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014ecb0 0x7fde300aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 -- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014ecb0 msgr2=0x7fde300aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014ecb0 0x7fde300aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 -- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde300c0a70 msgr2=0x7fde3013c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde300c0a70 0x7fde3013c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 -- 172.21.15.133:0/2622044183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200092a0 con 0x7fde3014e8d0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.078+0000 7fde34d3e700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fde2c00c5c0 tx=0x7fde2c001620).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.079+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0072e0 con 0x7fde3014e8d0 2024-01-21T20:11:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.079+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c007440 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.079+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30156740 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.079+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c0057a0 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.079+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30156d00 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.080+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3005fdf0 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.080+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fde2c005b50 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.080+0000 7fde25ffb700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 0x7fde14061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.081+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fde2c079dc0 con 0x7fde3014e8d0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.081+0000 7fde3553f700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 0x7fde14061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.081+0000 7fde3553f700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 0x7fde14061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fde200096e0 tx=0x7fde20016000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.085+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde2c04ae40 con 0x7fde3014e8d0 2024-01-21T20:11:21.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.274+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde30084c50 con 0x7fde1405f2c0 2024-01-21T20:11:21.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.278+0000 7fde25ffb700 1 -- 172.21.15.133:0/2622044183 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fde30084c50 con 0x7fde1405f2c0 2024-01-21T20:11:21.268 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2024-01-21T20:11:21.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 msgr2=0x7fde14061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 0x7fde14061780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fde200096e0 tx=0x7fde20016000).stop 2024-01-21T20:11:21.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 msgr2=0x7fde300afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fde2c00c5c0 tx=0x7fde2c001620).stop 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 shutdown_connections 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde1405f2c0 0x7fde14061780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde3014ecb0 0x7fde300aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde300c0a70 0x7fde3013c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 --2- 172.21.15.133:0/2622044183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde3014e8d0 0x7fde300afa50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 >> 172.21.15.133:0/2622044183 conn(0x7fde30084eb0 msgr2=0x7fde300c8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 shutdown_connections 2024-01-21T20:11:21.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.280+0000 7fde377a3700 1 -- 172.21.15.133:0/2622044183 wait complete. 2024-01-21T20:11:21.282 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2024-01-21T20:11:21.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2024-01-21T20:11:21.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.413+0000 7f0ca809b700 1 Processor -- start 2024-01-21T20:11:21.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.413+0000 7f0ca809b700 1 -- start start 2024-01-21T20:11:21.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ca0154050 0x7f0ca0069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ca00c1aa0 0x7f0ca0063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00c1f20 con 0x7f0ca0154050 2024-01-21T20:11:21.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00a4d90 con 0x7f0ca00c1aa0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca809b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0065440 con 0x7f0ca0063bf0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ca0154050 0x7f0ca0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ca0154050 0x7f0ca0069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38268/0 (socket says 172.21.15.133:38268) 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 -- 172.21.15.133:0/4286099626 learned_addr learned my addr 172.21.15.133:0/4286099626 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca6638700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5636700 1 --2- 172.21.15.133:0/4286099626 >> v2:172.21.15.178:3300/0 conn(0x7f0ca00c1aa0 0x7f0ca0063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 -- 172.21.15.133:0/4286099626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 msgr2=0x7f0ca00658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 -- 172.21.15.133:0/4286099626 >> v2:172.21.15.178:3300/0 conn(0x7f0ca00c1aa0 msgr2=0x7f0ca0063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/4286099626 >> v2:172.21.15.178:3300/0 conn(0x7f0ca00c1aa0 0x7f0ca0063700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 -- 172.21.15.133:0/4286099626 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0064030 con 0x7f0ca0154050 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca0069550 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f0ca00ad650 tx=0x7f0c9c0090f0).ready entity=mon.0 client_cookie=d9b2de23f5641233 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.414+0000 7f0ca4e35700 1 -- 172.21.15.133:0/4286099626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00b600 con 0x7f0ca0154050 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca4e35700 1 -- 172.21.15.133:0/4286099626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c00b760 con 0x7f0ca0154050 2024-01-21T20:11:21.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca4e35700 1 -- 172.21.15.133:0/4286099626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00bae0 con 0x7f0ca0154050 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 -- 172.21.15.133:0/4286099626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 msgr2=0x7f0ca0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca0069550 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f0ca00ad650 tx=0x7f0c9c0090f0).stop 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 -- 172.21.15.133:0/4286099626 shutdown_connections 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 --2- 172.21.15.133:0/4286099626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca0069550 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 --2- 172.21.15.133:0/4286099626 >> v2:172.21.15.178:3300/0 conn(0x7f0ca00c1aa0 0x7f0ca0063700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 -- 172.21.15.133:0/4286099626 >> 172.21.15.133:0/4286099626 conn(0x7f0ca00c4a10 msgr2=0x7f0ca0068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 -- 172.21.15.133:0/4286099626 shutdown_connections 2024-01-21T20:11:21.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.415+0000 7f0ca809b700 1 -- 172.21.15.133:0/4286099626 wait complete. 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.416+0000 7f0ca809b700 1 Processor -- start 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.416+0000 7f0ca809b700 1 -- start start 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 0x7f0ca00a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00c0050 con 0x7f0ca0154050 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00bf4b0 con 0x7f0ca00c1aa0 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca809b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00bf720 con 0x7f0ca0063bf0 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38278/0 (socket says 172.21.15.133:38278) 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 -- 172.21.15.133:0/1662273173 learned_addr learned my addr 172.21.15.133:0/1662273173 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca5636700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 0x7f0ca00a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 -- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 msgr2=0x7f0ca00ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 -- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 msgr2=0x7f0ca00a9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 0x7f0ca00a9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca6638700 1 -- 172.21.15.133:0/1662273173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c009370 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.417+0000 7f0ca5636700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 0x7f0ca00a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0ca6638700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f0c98009fa0 tx=0x7f0c98009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800ed20 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800ee80 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca00bfa00 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98014610 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.418+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca00c1200 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.419+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca005fdf0 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.419+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f0c9801d3b0 con 0x7f0ca0154050 2024-01-21T20:11:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.419+0000 7f0c967fc700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 0x7f0c84061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.419+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f0c9807aae0 con 0x7f0ca0154050 2024-01-21T20:11:21.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.419+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 0x7f0c84061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.420+0000 7f0ca5e37700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 0x7f0c84061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0c9c009130 tx=0x7f0c9c017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.424+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c9804bb00 con 0x7f0ca0154050 2024-01-21T20:11:21.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.611+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ca0069cd0 con 0x7f0c8405f2c0 2024-01-21T20:11:21.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.615+0000 7f0c967fc700 1 -- 172.21.15.133:0/1662273173 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0ca0069cd0 con 0x7f0c8405f2c0 2024-01-21T20:11:21.605 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 msgr2=0x7f0c84061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 0x7f0c84061780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0c9c009130 tx=0x7f0c9c017000).stop 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 msgr2=0x7f0ca014f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f0c98009fa0 tx=0x7f0c98009900).stop 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 shutdown_connections 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c8405f2c0 0x7f0c84061780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca0154050 0x7f0ca014f680 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca0063bf0 0x7f0ca00ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 --2- 172.21.15.133:0/1662273173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca00c1aa0 0x7f0ca00a9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 >> 172.21.15.133:0/1662273173 conn(0x7f0ca00c4a10 msgr2=0x7f0ca0065b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 shutdown_connections 2024-01-21T20:11:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.617+0000 7f0ca809b700 1 -- 172.21.15.133:0/1662273173 wait complete. 2024-01-21T20:11:21.618 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2024-01-21T20:11:21.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2024-01-21T20:11:21.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.749+0000 7fd511568700 1 Processor -- start 2024-01-21T20:11:21.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.749+0000 7fd511568700 1 -- start start 2024-01-21T20:11:21.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd511568700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd50c154630 0x7fd50c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd511568700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c06a4b0 con 0x7fd50c062be0 2024-01-21T20:11:21.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd511568700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c063010 con 0x7fd50c154250 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd511568700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c154ac0 con 0x7fd50c154630 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd50a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd50c154630 0x7fd50c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd50a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd50c154630 0x7fd50c0626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38290/0 (socket says 172.21.15.133:38290) 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd50b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd50c062be0 0x7fd50c065f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36436/0 (socket says 172.21.15.133:36436) 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.750+0000 7fd50a7fc700 1 -- 172.21.15.133:0/3992853043 learned_addr learned my addr 172.21.15.133:0/3992853043 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd50a7fc700 1 -- 172.21.15.133:0/3992853043 >> v1:172.21.15.178:6789/0 conn(0x7fd50c154250 legacy=0x7fd50c069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd50a7fc700 1 -- 172.21.15.133:0/3992853043 >> v1:172.21.15.133:6789/0 conn(0x7fd50c062be0 legacy=0x7fd50c065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd50a7fc700 1 -- 172.21.15.133:0/3992853043 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c069c20 con 0x7fd50c154630 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd50a7fc700 1 --2- 172.21.15.133:0/3992853043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154630 0x7fd50c0626f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd4fc006fd0 tx=0x7fd4fc0090f0).ready entity=mon.0 client_cookie=d1f928b331dcc49c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd509ffb700 1 -- 172.21.15.133:0/3992853043 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00b600 con 0x7fd50c154630 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd509ffb700 1 -- 172.21.15.133:0/3992853043 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc00b760 con 0x7fd50c154630 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd509ffb700 1 -- 172.21.15.133:0/3992853043 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00bae0 con 0x7fd50c154630 2024-01-21T20:11:21.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd511568700 1 -- 172.21.15.133:0/3992853043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154630 msgr2=0x7fd50c0626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd511568700 1 --2- 172.21.15.133:0/3992853043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154630 0x7fd50c0626f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd4fc006fd0 tx=0x7fd4fc0090f0).stop 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd511568700 1 -- 172.21.15.133:0/3992853043 shutdown_connections 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd511568700 1 --2- 172.21.15.133:0/3992853043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154630 0x7fd50c0626f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.751+0000 7fd511568700 1 -- 172.21.15.133:0/3992853043 >> 172.21.15.133:0/3992853043 conn(0x7fd50c0c7d30 msgr2=0x7fd50c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.752+0000 7fd511568700 1 -- 172.21.15.133:0/3992853043 shutdown_connections 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.752+0000 7fd511568700 1 -- 172.21.15.133:0/3992853043 wait complete. 2024-01-21T20:11:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.753+0000 7fd511568700 1 Processor -- start 2024-01-21T20:11:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.753+0000 7fd511568700 1 -- start start 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 0x7fd50c143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c154630 0x7fd50c152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c153060 con 0x7fd50c154250 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0a8010 con 0x7fd50c154630 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd511568700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c152100 con 0x7fd50c062be0 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd50a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd50a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38294/0 (socket says 172.21.15.133:38294) 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.754+0000 7fd50a7fc700 1 -- 172.21.15.133:0/1025167125 learned_addr learned my addr 172.21.15.133:0/1025167125 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50affd700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 0x7fd50c143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50b7fe700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c154630 0x7fd50c152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 -- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 msgr2=0x7fd50c143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 0x7fd50c143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 -- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c154630 msgr2=0x7fd50c152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c154630 0x7fd50c152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 -- 172.21.15.133:0/1025167125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc009370 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50affd700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 0x7fd50c143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd50a7fc700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd50c069020 tx=0x7fd4fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00bae0 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc000c90 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0a76e0 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc01c630 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.755+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c0a7ca0 con 0x7fd50c154250 2024-01-21T20:11:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.756+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0a81a0 con 0x7fd50c154250 2024-01-21T20:11:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.756+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd4fc01c9a0 con 0x7fd50c154250 2024-01-21T20:11:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.757+0000 7fd4f37fe700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 0x7fd4f8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.757+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd4fc07c240 con 0x7fd50c154250 2024-01-21T20:11:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.757+0000 7fd50affd700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 0x7fd4f8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.757+0000 7fd50affd700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 0x7fd4f8061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd50c153ca0 tx=0x7fd500009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.761+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd4fc04d2c0 con 0x7fd50c154250 2024-01-21T20:11:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.950+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd50c05fdf0 con 0x7fd4f805f2c0 2024-01-21T20:11:21.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.954+0000 7fd4f37fe700 1 -- 172.21.15.133:0/1025167125 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd50c05fdf0 con 0x7fd4f805f2c0 2024-01-21T20:11:21.944 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 msgr2=0x7fd4f8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 0x7fd4f8061780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fd50c153ca0 tx=0x7fd500009040).stop 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 msgr2=0x7fd50c152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd50c069020 tx=0x7fd4fc017000).stop 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 shutdown_connections 2024-01-21T20:11:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f805f2c0 0x7fd4f8061780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c154630 0x7fd50c152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c062be0 0x7fd50c143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 --2- 172.21.15.133:0/1025167125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c154250 0x7fd50c152680 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 >> 172.21.15.133:0/1025167125 conn(0x7fd50c0c7d30 msgr2=0x7fd50c14f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 shutdown_connections 2024-01-21T20:11:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:21.956+0000 7fd511568700 1 -- 172.21.15.133:0/1025167125 wait complete. 2024-01-21T20:11:21.958 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2024-01-21T20:11:21.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2024-01-21T20:11:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.090+0000 7fc9bab0c700 1 Processor -- start 2024-01-21T20:11:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.090+0000 7fc9bab0c700 1 -- start start 2024-01-21T20:11:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9bab0c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9b4154050 0x7fc9b4069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9bab0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9b40c1aa0 0x7fc9b4063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9bab0c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b4065440 con 0x7fc9b4063bf0 2024-01-21T20:11:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9bab0c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b40c1f20 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9bab0c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b40a4d90 con 0x7fc9b4154050 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9b40c1aa0 0x7fc9b4063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9b40c1aa0 0x7fc9b4063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38302/0 (socket says 172.21.15.133:38302) 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b90a9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc9b4063bf0 0x7fc9b40658d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36446/0 (socket says 172.21.15.133:36446) 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 -- 172.21.15.133:0/428174479 learned_addr learned my addr 172.21.15.133:0/428174479 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b88a8700 1 --2- 172.21.15.133:0/428174479 >> v2:172.21.15.178:3300/0 conn(0x7fc9b4154050 0x7fc9b4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 -- 172.21.15.133:0/428174479 >> v2:172.21.15.178:3300/0 conn(0x7fc9b4154050 msgr2=0x7fc9b4069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 --2- 172.21.15.133:0/428174479 >> v2:172.21.15.178:3300/0 conn(0x7fc9b4154050 0x7fc9b4069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 -- 172.21.15.133:0/428174479 >> v1:172.21.15.133:6789/0 conn(0x7fc9b4063bf0 legacy=0x7fc9b40658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 -- 172.21.15.133:0/428174479 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4064030 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b37fe700 1 -- 172.21.15.133:0/428174479 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86169530 0 0) 0x7fc9b4065440 con 0x7fc9b4063bf0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.091+0000 7fc9b3fff700 1 --2- 172.21.15.133:0/428174479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b4063700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc9b406a320 tx=0x7fc9a00090f0).ready entity=mon.0 client_cookie=dda0ada3c950913b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9b37fe700 1 -- 172.21.15.133:0/428174479 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000b600 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9b37fe700 1 -- 172.21.15.133:0/428174479 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000b760 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9b37fe700 1 -- 172.21.15.133:0/428174479 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000bae0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 -- 172.21.15.133:0/428174479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 msgr2=0x7fc9b4063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/428174479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b4063700 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc9b406a320 tx=0x7fc9a00090f0).stop 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 -- 172.21.15.133:0/428174479 shutdown_connections 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/428174479 >> v2:172.21.15.178:3300/0 conn(0x7fc9b4154050 0x7fc9b4069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/428174479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b4063700 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 -- 172.21.15.133:0/428174479 >> 172.21.15.133:0/428174479 conn(0x7fc9b40c4a10 msgr2=0x7fc9b4068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 -- 172.21.15.133:0/428174479 shutdown_connections 2024-01-21T20:11:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.092+0000 7fc9bab0c700 1 -- 172.21.15.133:0/428174479 wait complete. 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.093+0000 7fc9bab0c700 1 Processor -- start 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.093+0000 7fc9bab0c700 1 -- start start 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b4063bf0 0x7fc9b414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9b4154050 0x7fc9b40bf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40a7d00 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40a70f0 con 0x7fc9b4063bf0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9bab0c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b40a73d0 con 0x7fc9b4154050 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38314/0 (socket says 172.21.15.133:38314) 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9b3fff700 1 -- 172.21.15.133:0/3493641421 learned_addr learned my addr 172.21.15.133:0/3493641421 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9b90a9700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9b4154050 0x7fc9b40bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.094+0000 7fc9b88a8700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b4063bf0 0x7fc9b414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 -- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9b4154050 msgr2=0x7fc9b40bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9b4154050 0x7fc9b40bf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 -- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b4063bf0 msgr2=0x7fc9b414fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b4063bf0 0x7fc9b414fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 -- 172.21.15.133:0/3493641421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009370 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b3fff700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc9a0009130 tx=0x7fc9a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000bea0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a000b8d0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b40a76b0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a001c670 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.095+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b40ab1b0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.096+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b405fdf0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.096+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fc9a001c9e0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.097+0000 7fc9b17fa700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 0x7fc998061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.097+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fc9a007c1d0 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.097+0000 7fc9b88a8700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 0x7fc998061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.097+0000 7fc9b88a8700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 0x7fc998061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc9a800bb10 tx=0x7fc9a8008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.101+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9a004d250 con 0x7fc9b40c1aa0 2024-01-21T20:11:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.289+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9b4069cd0 con 0x7fc99805f2c0 2024-01-21T20:11:22.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.293+0000 7fc9b17fa700 1 -- 172.21.15.133:0/3493641421 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc9b4069cd0 con 0x7fc99805f2c0 2024-01-21T20:11:22.283 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 msgr2=0x7fc998061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 0x7fc998061780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc9a800bb10 tx=0x7fc9a8008040).stop 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 msgr2=0x7fc9b40ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc9a0009130 tx=0x7fc9a0017000).stop 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 shutdown_connections 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc99805f2c0 0x7fc998061780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9b4154050 0x7fc9b40bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9b4063bf0 0x7fc9b414fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 --2- 172.21.15.133:0/3493641421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9b40c1aa0 0x7fc9b40ac710 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 >> 172.21.15.133:0/3493641421 conn(0x7fc9b40c4a10 msgr2=0x7fc9b40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:22.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 shutdown_connections 2024-01-21T20:11:22.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.295+0000 7fc9bab0c700 1 -- 172.21.15.133:0/3493641421 wait complete. 2024-01-21T20:11:22.297 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2024-01-21T20:11:22.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2024-01-21T20:11:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.427+0000 7f974cbef700 1 Processor -- start 2024-01-21T20:11:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.427+0000 7f974cbef700 1 -- start start 2024-01-21T20:11:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974cbef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f97480ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974cbef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97481566f0 con 0x7f97480ab5d0 2024-01-21T20:11:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974cbef700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480aba40 con 0x7f9748152010 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974cbef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748067400 con 0x7f97481523f0 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f9746d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f97480ab5d0 0x7f97480bdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36452/0 (socket says 172.21.15.133:36452) 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f9746d9d700 1 -- 172.21.15.133:0/1449486612 learned_addr learned my addr 172.21.15.133:0/1449486612 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f9745d9b700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f97480ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790365333 0 0) 0x7f97481566f0 con 0x7f97480ab5d0 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.428+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97300033f0 con 0x7f97480ab5d0 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946959758 0 0) 0x7f97480aba40 con 0x7f9748152010 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97481566f0 con 0x7f9748152010 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509196270 0 0) 0x7f97300033f0 con 0x7f97480ab5d0 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 msgr2=0x7f97480ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f97480ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 >> v1:172.21.15.178:6789/0 conn(0x7f9748152010 legacy=0x7f97480669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748155dc0 con 0x7f97480ab5d0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f97400017f0 con 0x7f97480ab5d0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 >> v1:172.21.15.133:6789/0 conn(0x7f97480ab5d0 legacy=0x7f97480bdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f9730003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9730004000 0x7f9730004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9730004b80 0x7f9730005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748067400 con 0x7f9730004000 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973000b9c0 con 0x7f9730004b80 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973000bb80 con 0x7f97481523f0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9730004000 0x7f9730004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9746d9d700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9730004b80 0x7f9730005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974659c700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f9730003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 -- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 msgr2=0x7f9730003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f9730003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 -- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9730004b80 msgr2=0x7f9730005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9730004b80 0x7f9730005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 -- 172.21.15.133:0/1449486612 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300033f0 con 0x7f9730004000 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974659c700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97481523f0 0x7f9730003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9746d9d700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9730004b80 0x7f9730005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f9745d9b700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9730004000 0x7f9730004690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f9738006d80 tx=0x7f9738009060).ready entity=mon.0 client_cookie=cfec629390c95ee7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738009e90 con 0x7f9730004000 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9738009430 con 0x7f9730004000 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.429+0000 7f974559a700 1 -- 172.21.15.133:0/1449486612 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800e820 con 0x7f9730004000 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 -- 172.21.15.133:0/1449486612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9730004000 msgr2=0x7f9730004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 --2- 172.21.15.133:0/1449486612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9730004000 0x7f9730004690 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f9738006d80 tx=0x7f9738009060).stop 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f9746d9d700 1 -- 172.21.15.133:0/1449486612 reap_dead start 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 -- 172.21.15.133:0/1449486612 shutdown_connections 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 -- 172.21.15.133:0/1449486612 >> 172.21.15.133:0/1449486612 conn(0x7f97480c8f60 msgr2=0x7f97480c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 -- 172.21.15.133:0/1449486612 shutdown_connections 2024-01-21T20:11:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.430+0000 7f974cbef700 1 -- 172.21.15.133:0/1449486612 wait complete. 2024-01-21T20:11:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.431+0000 7f974cbef700 1 Processor -- start 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.431+0000 7f974cbef700 1 -- start start 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9730004000 0x7f974814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 0x7f97481551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974814c060 con 0x7f97480c1b50 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748163900 con 0x7f9748154d40 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974cbef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480c25e0 con 0x7f9730004000 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38324/0 (socket says 172.21.15.133:38324) 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 -- 172.21.15.133:0/4126591475 learned_addr learned my addr 172.21.15.133:0/4126591475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f974659c700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9730004000 0x7f974814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9746d9d700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 0x7f97481551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 -- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9730004000 msgr2=0x7f974814bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9730004000 0x7f974814bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 -- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 msgr2=0x7f97481551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 0x7f97481551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9745d9b700 1 -- 172.21.15.133:0/4126591475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480c28c0 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.432+0000 7f9746d9d700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 0x7f97481551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f9745d9b700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f973000b990 tx=0x7f973801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973801d990 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973801db10 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748163590 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738026440 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.433+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748155690 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.434+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480c2b00 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.435+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f973802f440 con 0x7f97480c1b50 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.435+0000 7f9736ffd700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 0x7f9728061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.435+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f973807c160 con 0x7f97480c1b50 2024-01-21T20:11:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.436+0000 7f974659c700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 0x7f9728061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.436+0000 7f974659c700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 0x7f9728061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f973c007a40 tx=0x7f973c009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.439+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f973804d240 con 0x7f97480c1b50 2024-01-21T20:11:22.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.629+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f97480c2ab0 con 0x7f972805f2c0 2024-01-21T20:11:22.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.632+0000 7f9736ffd700 1 -- 172.21.15.133:0/4126591475 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f97480c2ab0 con 0x7f972805f2c0 2024-01-21T20:11:22.622 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2024-01-21T20:11:22.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 msgr2=0x7f9728061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 0x7f9728061780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f973c007a40 tx=0x7f973c009040).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 msgr2=0x7f97480c1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f973000b990 tx=0x7f973801a000).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 shutdown_connections 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f972805f2c0 0x7f9728061780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9748154d40 0x7f97481551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9730004000 0x7f974814bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 --2- 172.21.15.133:0/4126591475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97480c1b50 0x7f97480c1fd0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 >> 172.21.15.133:0/4126591475 conn(0x7f97480c8f60 msgr2=0x7f97480c87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 shutdown_connections 2024-01-21T20:11:22.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.634+0000 7f974cbef700 1 -- 172.21.15.133:0/4126591475 wait complete. 2024-01-21T20:11:22.636 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2024-01-21T20:11:22.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:22.636 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:22.656 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:22.656 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:22.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2024-01-21T20:11:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.824+0000 7fe537935700 1 Processor -- start 2024-01-21T20:11:22.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.824+0000 7fe537935700 1 -- start start 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe537935700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5300bda90 0x7fe5300694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe537935700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5300c23b0 con 0x7fe5300c3850 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe537935700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe530067600 con 0x7fe53013a7b0 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe537935700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5300663c0 con 0x7fe5300bda90 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe535ed2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5300c3850 0x7fe53015ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36458/0 (socket says 172.21.15.133:36458) 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe535ed2700 1 -- 172.21.15.133:0/84703328 learned_addr learned my addr 172.21.15.133:0/84703328 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe534ed0700 1 --2- 172.21.15.133:0/84703328 >> v2:172.21.15.178:3300/0 conn(0x7fe5300bda90 0x7fe5300694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031782855 0 0) 0x7fe5300c23b0 con 0x7fe5300c3850 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.825+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c0033f0 con 0x7fe5300c3850 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443163533 0 0) 0x7fe530067600 con 0x7fe53013a7b0 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5300c23b0 con 0x7fe53013a7b0 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2649908210 0 0) 0x7fe51c0033f0 con 0x7fe5300c3850 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 >> v2:172.21.15.178:3300/0 conn(0x7fe5300bda90 msgr2=0x7fe5300694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 --2- 172.21.15.133:0/84703328 >> v2:172.21.15.178:3300/0 conn(0x7fe5300bda90 0x7fe5300694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 >> v1:172.21.15.178:6789/0 conn(0x7fe53013a7b0 legacy=0x7fe530066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300678e0 con 0x7fe5300c3850 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe5280017f0 con 0x7fe5300c3850 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 >> v1:172.21.15.133:6789/0 conn(0x7fe5300c3850 legacy=0x7fe53015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe51c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c004690 0x7fe51c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c005000 0x7fe51c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300663c0 con 0x7fe51c003a70 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c00bf60 con 0x7fe51c005000 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c00c0d0 con 0x7fe51c004690 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe51c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe535ed2700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c005000 0x7fe51c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe534ed0700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c004690 0x7fe51c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 -- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c004690 msgr2=0x7fe51c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c004690 0x7fe51c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 -- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c005000 msgr2=0x7fe51c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe51c005000 0x7fe51c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 -- 172.21.15.133:0/84703328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51c0033f0 con 0x7fe51c003a70 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe535ed2700 1 -- 172.21.15.133:0/84703328 reap_dead start 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe534ed0700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe51c004690 0x7fe51c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:22.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe5356d1700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe51c003e70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fe5200018d0 tx=0x7fe520007bb0).ready entity=mon.0 client_cookie=c1bb29ea469032d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520007020 con 0x7fe51c003a70 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520007180 con 0x7fe51c003a70 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.826+0000 7fe527fff700 1 -- 172.21.15.133:0/84703328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520007500 con 0x7fe51c003a70 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 -- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 msgr2=0x7fe51c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe51c003e70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fe5200018d0 tx=0x7fe520007bb0).stop 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 -- 172.21.15.133:0/84703328 shutdown_connections 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 --2- 172.21.15.133:0/84703328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe51c003e70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 -- 172.21.15.133:0/84703328 >> 172.21.15.133:0/84703328 conn(0x7fe5300c7d20 msgr2=0x7fe5300c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 -- 172.21.15.133:0/84703328 shutdown_connections 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.827+0000 7fe537935700 1 -- 172.21.15.133:0/84703328 wait complete. 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.828+0000 7fe537935700 1 Processor -- start 2024-01-21T20:11:22.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.828+0000 7fe537935700 1 -- start start 2024-01-21T20:11:22.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5300a0730 0x7fe530138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300a0bb0 0x7fe530138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300acef0 con 0x7fe51c003a70 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300ad1d0 con 0x7fe5300a0730 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe537935700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300ad4b0 con 0x7fe5300a0bb0 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38344/0 (socket says 172.21.15.133:38344) 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 -- 172.21.15.133:0/3626726773 learned_addr learned my addr 172.21.15.133:0/3626726773 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe535ed2700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300a0bb0 0x7fe530138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe534ed0700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5300a0730 0x7fe530138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 -- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300a0bb0 msgr2=0x7fe530138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300a0bb0 0x7fe530138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 -- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5300a0730 msgr2=0x7fe530138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5300a0730 0x7fe530138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.829+0000 7fe5356d1700 1 -- 172.21.15.133:0/3626726773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300ad790 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe5356d1700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe51c0045c0 tx=0x7fe520015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520012610 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520012770 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300ada70 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520012920 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.830+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5301536f0 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.831+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5300ad310 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.831+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe52001b040 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.832+0000 7fe525ffb700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 0x7fe514061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.832+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe52007aac0 con 0x7fe51c003a70 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.832+0000 7fe534ed0700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 0x7fe514061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:22.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.832+0000 7fe534ed0700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 0x7fe514061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe53005a340 tx=0x7fe52c008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:22.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:22.836+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5300ad310 con 0x7fe51c003a70 2024-01-21T20:11:23.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.022+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5300ad310 con 0x7fe51405f2c0 2024-01-21T20:11:23.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.024+0000 7fe525ffb700 1 -- 172.21.15.133:0/3626726773 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe5300ad310 con 0x7fe51405f2c0 2024-01-21T20:11:23.014 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:23.014 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:12", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 msgr2=0x7fe514061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 0x7fe514061780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe53005a340 tx=0x7fe52c008040).stop 2024-01-21T20:11:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 msgr2=0x7fe5300ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fe51c0045c0 tx=0x7fe520015000).stop 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 shutdown_connections 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe51405f2c0 0x7fe514061780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5300a0bb0 0x7fe530138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe51c003a70 0x7fe5300ac960 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 --2- 172.21.15.133:0/3626726773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5300a0730 0x7fe530138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 >> 172.21.15.133:0/3626726773 conn(0x7fe5300c7d20 msgr2=0x7fe5300c7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 shutdown_connections 2024-01-21T20:11:23.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.026+0000 7fe537935700 1 -- 172.21.15.133:0/3626726773 wait complete. 2024-01-21T20:11:23.028 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:12", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.028 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:12', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:23.028 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:23.028 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:23.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:23.028 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-01-21T20:11:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:23.047 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:23.048 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:23.048 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:23.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2024-01-21T20:11:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.217+0000 7fda6e74f700 1 Processor -- start 2024-01-21T20:11:23.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.217+0000 7fda6e74f700 1 -- start start 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda6e74f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda68065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda6e74f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680c3450 con 0x7fda6814e9d0 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda6e74f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda68151c00 con 0x7fda68069480 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda6e74f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda68065780 con 0x7fda6806a430 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda67fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fda6814e9d0 0x7fda681514f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36470/0 (socket says 172.21.15.133:36470) 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda67fff700 1 -- 172.21.15.133:0/1509913016 learned_addr learned my addr 172.21.15.133:0/1509913016 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda677fe700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda68065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756654744 0 0) 0x7fda680c3450 con 0x7fda6814e9d0 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.218+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda500033f0 con 0x7fda6814e9d0 2024-01-21T20:11:23.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263748772 0 0) 0x7fda500033f0 con 0x7fda6814e9d0 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 msgr2=0x7fda68065290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda68065290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 >> v1:172.21.15.178:6789/0 conn(0x7fda68069480 legacy=0x7fda680c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680c3120 con 0x7fda6814e9d0 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fda5c001470 con 0x7fda6814e9d0 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 >> v1:172.21.15.133:6789/0 conn(0x7fda6814e9d0 legacy=0x7fda681514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda50003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda50004b80 0x7fda50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda68065780 con 0x7fda50003e00 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5000b8e0 con 0x7fda50004b80 2024-01-21T20:11:23.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5000baa0 con 0x7fda6806a430 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda67fff700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda50003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda6ccec700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda50004b80 0x7fda50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 -- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 msgr2=0x7fda50003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6806a430 0x7fda50003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 -- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda50004b80 msgr2=0x7fda50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda50004b80 0x7fda50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 -- 172.21.15.133:0/1509913016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500033f0 con 0x7fda50003e00 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.219+0000 7fda677fe700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda50004690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda6806a870 tx=0x7fda58009060).ready entity=mon.0 client_cookie=b4bb88adb52952e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58009430 con 0x7fda50003e00 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58009e70 con 0x7fda50003e00 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda66ffd700 1 -- 172.21.15.133:0/1509913016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800e850 con 0x7fda50003e00 2024-01-21T20:11:23.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 -- 172.21.15.133:0/1509913016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 msgr2=0x7fda50004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 --2- 172.21.15.133:0/1509913016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda50004690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fda6806a870 tx=0x7fda58009060).stop 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6ccec700 1 -- 172.21.15.133:0/1509913016 reap_dead start 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 -- 172.21.15.133:0/1509913016 shutdown_connections 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 -- 172.21.15.133:0/1509913016 >> 172.21.15.133:0/1509913016 conn(0x7fda680c7cc0 msgr2=0x7fda680c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 -- 172.21.15.133:0/1509913016 shutdown_connections 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.220+0000 7fda6e74f700 1 -- 172.21.15.133:0/1509913016 wait complete. 2024-01-21T20:11:23.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.221+0000 7fda6e74f700 1 Processor -- start 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 -- start start 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 0x7fda680aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda68149cb0 0x7fda68167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680aa750 con 0x7fda50003e00 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6814f4a0 con 0x7fda680a52e0 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6e74f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda68168780 con 0x7fda68149cb0 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38352/0 (socket says 172.21.15.133:38352) 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda67fff700 1 -- 172.21.15.133:0/923297105 learned_addr learned my addr 172.21.15.133:0/923297105 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:23.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.222+0000 7fda6ccec700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda68149cb0 0x7fda68167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda677fe700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 0x7fda680aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 -- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda68149cb0 msgr2=0x7fda68167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda68149cb0 0x7fda68167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 -- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 msgr2=0x7fda680aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 0x7fda680aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 -- 172.21.15.133:0/923297105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680a57e0 con 0x7fda50003e00 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda677fe700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 0x7fda680aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda67fff700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fda5c0049e0 tx=0x7fda5c001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00f660 con 0x7fda50003e00 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00f7c0 con 0x7fda50003e00 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680a5ac0 con 0x7fda50003e00 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00fb40 con 0x7fda50003e00 2024-01-21T20:11:23.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.223+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6814f130 con 0x7fda50003e00 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.224+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6805fdf0 con 0x7fda50003e00 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.224+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fda5c01d3b0 con 0x7fda50003e00 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.224+0000 7fda64ff9700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 0x7fda54061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.225+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fda5c079e50 con 0x7fda50003e00 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.225+0000 7fda677fe700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 0x7fda54061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.225+0000 7fda677fe700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 0x7fda54061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fda68150990 tx=0x7fda5801a000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.229+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda5c04af20 con 0x7fda50003e00 2024-01-21T20:11:23.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.421+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda68151e60 con 0x7fda5405f2c0 2024-01-21T20:11:23.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.422+0000 7fda64ff9700 1 -- 172.21.15.133:0/923297105 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fda68151e60 con 0x7fda5405f2c0 2024-01-21T20:11:23.412 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:23.412 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:12", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 msgr2=0x7fda54061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 0x7fda54061780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fda68150990 tx=0x7fda5801a000).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 msgr2=0x7fda680a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fda5c0049e0 tx=0x7fda5c001e70).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 shutdown_connections 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fda5405f2c0 0x7fda54061780 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda68149cb0 0x7fda68167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda50003e00 0x7fda680a7760 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 --2- 172.21.15.133:0/923297105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda680a52e0 0x7fda680aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.424+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 >> 172.21.15.133:0/923297105 conn(0x7fda680c7cc0 msgr2=0x7fda680c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.425+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 shutdown_connections 2024-01-21T20:11:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.425+0000 7fda6e74f700 1 -- 172.21.15.133:0/923297105 wait complete. 2024-01-21T20:11:23.426 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:12", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.426 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:12', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:23.426 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:23.426 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:23.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:23.427 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:23.445 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:23.446 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:23.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2024-01-21T20:11:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.614+0000 7f6f478bc700 1 Processor -- start 2024-01-21T20:11:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.615+0000 7f6f478bc700 1 -- start start 2024-01-21T20:11:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.615+0000 7f6f478bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f40069be0 0x7f6f4015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.615+0000 7f6f478bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f400c23b0 con 0x7f6f400bda90 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.615+0000 7f6f478bc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f40067600 con 0x7f6f4013a7b0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.615+0000 7f6f478bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f400663c0 con 0x7f6f40069be0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f40069be0 0x7f6f4015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f44e57700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6f400bda90 0x7f6f400694d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36472/0 (socket says 172.21.15.133:36472) 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6f40069be0 0x7f6f4015bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38362/0 (socket says 172.21.15.133:38362) 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f44e57700 1 -- 172.21.15.133:0/3562089495 learned_addr learned my addr 172.21.15.133:0/3562089495 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 -- 172.21.15.133:0/3562089495 >> v1:172.21.15.178:6789/0 conn(0x7f6f4013a7b0 legacy=0x7f6f40066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 -- 172.21.15.133:0/3562089495 >> v1:172.21.15.133:6789/0 conn(0x7f6f400bda90 legacy=0x7f6f400694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 -- 172.21.15.133:0/3562089495 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400678e0 con 0x7f6f40069be0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f45e59700 1 --2- 172.21.15.133:0/3562089495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f4015bba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6f38009e60 tx=0x7f6f38009780).ready entity=mon.0 client_cookie=6ea441f3893c649f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f37fff700 1 -- 172.21.15.133:0/3562089495 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800e070 con 0x7f6f40069be0 2024-01-21T20:11:23.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f37fff700 1 -- 172.21.15.133:0/3562089495 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800bc30 con 0x7f6f40069be0 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.616+0000 7f6f37fff700 1 -- 172.21.15.133:0/3562089495 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38012410 con 0x7f6f40069be0 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 -- 172.21.15.133:0/3562089495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 msgr2=0x7f6f4015bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 --2- 172.21.15.133:0/3562089495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f4015bba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f6f38009e60 tx=0x7f6f38009780).stop 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 -- 172.21.15.133:0/3562089495 shutdown_connections 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 --2- 172.21.15.133:0/3562089495 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f4015bba0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 -- 172.21.15.133:0/3562089495 >> 172.21.15.133:0/3562089495 conn(0x7f6f400c7d20 msgr2=0x7f6f400c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 -- 172.21.15.133:0/3562089495 shutdown_connections 2024-01-21T20:11:23.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.617+0000 7f6f478bc700 1 -- 172.21.15.133:0/3562089495 wait complete. 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.618+0000 7f6f478bc700 1 Processor -- start 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.618+0000 7f6f478bc700 1 -- start start 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f4013a7b0 0x7f6f400c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f400c71d0 0x7f6f40150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400befb0 con 0x7f6f40069be0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400bf7e0 con 0x7f6f400c71d0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c7630 con 0x7f6f4013a7b0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38372/0 (socket says 172.21.15.133:38372) 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 -- 172.21.15.133:0/1099888783 learned_addr learned my addr 172.21.15.133:0/1099888783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f44e57700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f4013a7b0 0x7f6f400c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45e59700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f400c71d0 0x7f6f40150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 -- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f4013a7b0 msgr2=0x7f6f400c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f4013a7b0 0x7f6f400c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 -- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f400c71d0 msgr2=0x7f6f40150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f400c71d0 0x7f6f40150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 -- 172.21.15.133:0/1099888783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38009a20 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f45658700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6f3000c440 tx=0x7f6f30007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30007020 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30007180 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30007520 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.619+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f40150fc0 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.620+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f400bf470 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f400c8430 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6f300068b0 con 0x7f6f40069be0 2024-01-21T20:11:23.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f35ffb700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 0x7f6f24061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f6f30079900 con 0x7f6f40069be0 2024-01-21T20:11:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f44e57700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 0x7f6f24061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:23.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.621+0000 7f6f44e57700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 0x7f6f24061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6f400aaa70 tx=0x7f6f3c009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:23.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.625+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f30047b00 con 0x7f6f40069be0 2024-01-21T20:11:23.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.815+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f400c2da0 con 0x7f6f2405f2c0 2024-01-21T20:11:23.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.817+0000 7f6f35ffb700 1 -- 172.21.15.133:0/1099888783 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6f400c2da0 con 0x7f6f2405f2c0 2024-01-21T20:11:23.806 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:23.806 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 msgr2=0x7f6f24061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 0x7f6f24061780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6f400aaa70 tx=0x7f6f3c009040).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 msgr2=0x7f6f401626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f6f3000c440 tx=0x7f6f30007e00).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 shutdown_connections 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.818+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f2405f2c0 0x7f6f24061780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f400c71d0 0x7f6f40150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f40069be0 0x7f6f401626f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 --2- 172.21.15.133:0/1099888783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f4013a7b0 0x7f6f400c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 >> 172.21.15.133:0/1099888783 conn(0x7f6f400c7d20 msgr2=0x7f6f400c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 shutdown_connections 2024-01-21T20:11:23.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:23.819+0000 7f6f478bc700 1 -- 172.21.15.133:0/1099888783 wait complete. 2024-01-21T20:11:23.820 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:23.820 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:13', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:23.820 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:23.820 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:23.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:23.821 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-01-21T20:11:23.839 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:23.839 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:23.839 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:23.839 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:23.840 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:23.840 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:23.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2024-01-21T20:11:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.008+0000 7f1c67d5b700 1 Processor -- start 2024-01-21T20:11:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.008+0000 7f1c67d5b700 1 -- start start 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.009+0000 7f1c67d5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c600bcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.009+0000 7f1c67d5b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6006a8e0 con 0x7f1c60154590 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.009+0000 7f1c67d5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c60066860 con 0x7f1c60066cf0 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.009+0000 7f1c67d5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60065c50 con 0x7f1c600657b0 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.009+0000 7f1c65af7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c60154590 0x7f1c6006a1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36480/0 (socket says 172.21.15.133:36480) 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c65af7700 1 -- 172.21.15.133:0/1008862492 learned_addr learned my addr 172.21.15.133:0/1008862492 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c600bcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175946010 0 0) 0x7f1c50001110 con 0x7f1c60154590 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c4c0033f0 con 0x7f1c60154590 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2429955990 0 0) 0x7f1c4c0033f0 con 0x7f1c60154590 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 msgr2=0x7f1c600bcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c600bcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 >> v1:172.21.15.178:6789/0 conn(0x7f1c60066cf0 legacy=0x7f1c600a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60065f30 con 0x7f1c60154590 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1c50001600 con 0x7f1c60154590 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 >> v1:172.21.15.133:6789/0 conn(0x7f1c60154590 legacy=0x7f1c6006a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c4c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c4c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c4c004b80 0x7f1c4c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60065c50 con 0x7f1c4c003e00 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c00b8e0 con 0x7f1c4c004b80 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c00baa0 con 0x7f1c600657b0 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c4c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c65af7700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c4c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.010+0000 7f1c662f8700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c4c004b80 0x7f1c4c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 -- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 msgr2=0x7f1c4c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600657b0 0x7f1c4c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 -- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c4c004b80 msgr2=0x7f1c4c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c4c004b80 0x7f1c4c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 -- 172.21.15.133:0/1008862492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0033f0 con 0x7f1c4c003e00 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c662f8700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c4c004b80 0x7f1c4c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c4c004690 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1c5c009a80 tx=0x7f1c5c009060).ready entity=mon.0 client_cookie=c09ec1f9eb2a14b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c009430 con 0x7f1c4c003e00 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00e640 con 0x7f1c4c003e00 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c64af5700 1 -- 172.21.15.133:0/1008862492 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00e9c0 con 0x7f1c4c003e00 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1008862492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 msgr2=0x7f1c4c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1008862492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c4c004690 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f1c5c009a80 tx=0x7f1c5c009060).stop 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c662f8700 1 -- 172.21.15.133:0/1008862492 reap_dead start 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1008862492 shutdown_connections 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1008862492 >> 172.21.15.133:0/1008862492 conn(0x7f1c600c7cd0 msgr2=0x7f1c600c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.011+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1008862492 shutdown_connections 2024-01-21T20:11:24.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.012+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1008862492 wait complete. 2024-01-21T20:11:24.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 Processor -- start 2024-01-21T20:11:24.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 -- start start 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c601504c0 0x7f1c600abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600c4770 0x7f1c600a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600ac4d0 con 0x7f1c4c003e00 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60150940 con 0x7f1c601504c0 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c67d5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600c04a0 con 0x7f1c600c4770 2024-01-21T20:11:24.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.013+0000 7f1c65af7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38386/0 (socket says 172.21.15.133:38386) 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 -- 172.21.15.133:0/1684727123 learned_addr learned my addr 172.21.15.133:0/1684727123 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c662f8700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600c4770 0x7f1c600a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c601504c0 0x7f1c600abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 -- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600c4770 msgr2=0x7f1c600a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600c4770 0x7f1c600a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 -- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c601504c0 msgr2=0x7f1c600abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c601504c0 0x7f1c600abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 -- 172.21.15.133:0/1684727123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600bfc80 con 0x7f1c4c003e00 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c65af7700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1c50004a70 tx=0x7f1c500078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000f870 con 0x7f1c4c003e00 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000f9d0 con 0x7f1c4c003e00 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000fd50 con 0x7f1c4c003e00 2024-01-21T20:11:24.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600bf3e0 con 0x7f1c4c003e00 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.014+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600bf9a0 con 0x7f1c4c003e00 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.015+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6005fdf0 con 0x7f1c4c003e00 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.015+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f1c50015620 con 0x7f1c4c003e00 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.016+0000 7f1c567fc700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 0x7f1c44061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.016+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f1c5007a6d0 con 0x7f1c4c003e00 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.016+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 0x7f1c44061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.016+0000 7f1c652f6700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 0x7f1c44061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1c600c7ad0 tx=0x7f1c5c01a000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.020+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c5004b750 con 0x7f1c4c003e00 2024-01-21T20:11:24.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.206+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c6006a8e0 con 0x7f1c4405f2c0 2024-01-21T20:11:24.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.207+0000 7f1c567fc700 1 -- 172.21.15.133:0/1684727123 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1c6006a8e0 con 0x7f1c4405f2c0 2024-01-21T20:11:24.197 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:24.197 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 msgr2=0x7f1c44061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 0x7f1c44061780 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1c600c7ad0 tx=0x7f1c5c01a000).stop 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 msgr2=0x7f1c600bed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f1c50004a70 tx=0x7f1c500078d0).stop 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 shutdown_connections 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4405f2c0 0x7f1c44061780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c600c4770 0x7f1c600a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c4c003e00 0x7f1c600bed70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 --2- 172.21.15.133:0/1684727123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c601504c0 0x7f1c600abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 >> 172.21.15.133:0/1684727123 conn(0x7f1c600c7cd0 msgr2=0x7f1c600c3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 shutdown_connections 2024-01-21T20:11:24.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.209+0000 7f1c67d5b700 1 -- 172.21.15.133:0/1684727123 wait complete. 2024-01-21T20:11:24.210 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.211 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:13', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:24.211 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:24.211 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:24.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:24.211 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:24.230 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:24.231 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:24.231 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:24.231 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:24.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2024-01-21T20:11:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.400+0000 7f0653263700 1 Processor -- start 2024-01-21T20:11:24.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.400+0000 7f0653263700 1 -- start start 2024-01-21T20:11:24.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0653263700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f064c154050 0x7f064c069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0653263700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f064c063e10 0x7f064c154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0653263700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c065440 con 0x7f064c0c1aa0 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0653263700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0c1f20 con 0x7f064c154050 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0653263700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0a4d90 con 0x7f064c063e10 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0650fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f064c154050 0x7f064c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0650fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f064c154050 0x7f064c069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38392/0 (socket says 172.21.15.133:38392) 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0650fff700 1 -- 172.21.15.133:0/1610151905 learned_addr learned my addr 172.21.15.133:0/1610151905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.401+0000 7f0651800700 1 --2- 172.21.15.133:0/1610151905 >> v2:172.21.15.178:3300/0 conn(0x7f064c063e10 0x7f064c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0650fff700 1 -- 172.21.15.133:0/1610151905 >> v2:172.21.15.178:3300/0 conn(0x7f064c063e10 msgr2=0x7f064c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0650fff700 1 --2- 172.21.15.133:0/1610151905 >> v2:172.21.15.178:3300/0 conn(0x7f064c063e10 0x7f064c154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0650fff700 1 -- 172.21.15.133:0/1610151905 >> v1:172.21.15.178:6789/0 conn(0x7f064c0c1aa0 legacy=0x7f064c063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0650fff700 1 -- 172.21.15.133:0/1610151905 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c069cd0 con 0x7f064c154050 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0650fff700 1 --2- 172.21.15.133:0/1610151905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c154050 0x7f064c069550 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f064c06a3e0 tx=0x7f06400090f0).ready entity=mon.0 client_cookie=f1c5da0f21ca7f78 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f064b7fe700 1 -- 172.21.15.133:0/1610151905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000b520 con 0x7f064c154050 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f064b7fe700 1 -- 172.21.15.133:0/1610151905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000b680 con 0x7f064c154050 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f064b7fe700 1 -- 172.21.15.133:0/1610151905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000ba00 con 0x7f064c154050 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0653263700 1 -- 172.21.15.133:0/1610151905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c154050 msgr2=0x7f064c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.402+0000 7f0653263700 1 --2- 172.21.15.133:0/1610151905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c154050 0x7f064c069550 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f064c06a3e0 tx=0x7f06400090f0).stop 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 -- 172.21.15.133:0/1610151905 shutdown_connections 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 --2- 172.21.15.133:0/1610151905 >> v2:172.21.15.178:3300/0 conn(0x7f064c063e10 0x7f064c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 --2- 172.21.15.133:0/1610151905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c154050 0x7f064c069550 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 -- 172.21.15.133:0/1610151905 >> 172.21.15.133:0/1610151905 conn(0x7f064c0c4a10 msgr2=0x7f064c068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 -- 172.21.15.133:0/1610151905 shutdown_connections 2024-01-21T20:11:24.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.403+0000 7f0653263700 1 -- 172.21.15.133:0/1610151905 wait complete. 2024-01-21T20:11:24.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.404+0000 7f0653263700 1 Processor -- start 2024-01-21T20:11:24.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.404+0000 7f0653263700 1 -- start start 2024-01-21T20:11:24.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f064c0c1aa0 0x7f064c0a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f064c154050 0x7f064c0a7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0a8b30 con 0x7f064c063e10 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0a8240 con 0x7f064c0c1aa0 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0a84e0 con 0x7f064c154050 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38396/0 (socket says 172.21.15.133:38396) 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 -- 172.21.15.133:0/2842537124 learned_addr learned my addr 172.21.15.133:0/2842537124 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 -- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f064c154050 msgr2=0x7f064c0a7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0651800700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f064c154050 0x7f064c0a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f064c154050 0x7f064c0a7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 -- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f064c0c1aa0 msgr2=0x7f064c0a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f064c0c1aa0 0x7f064c0a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:24.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 -- 172.21.15.133:0/2842537124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009370 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0650fff700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0640009130 tx=0x7f0640017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000be90 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000b7f0 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0a87c0 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064001c670 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.405+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c143420 con 0x7f064c063e10 2024-01-21T20:11:24.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.406+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0aa4e0 con 0x7f064c063e10 2024-01-21T20:11:24.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.407+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f064001ca20 con 0x7f064c063e10 2024-01-21T20:11:24.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.407+0000 7f06497fa700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 0x7f0630061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.408+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f064007c560 con 0x7f064c063e10 2024-01-21T20:11:24.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.408+0000 7f064bfff700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 0x7f0630061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.408+0000 7f064bfff700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 0x7f0630061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f064c0c65f0 tx=0x7f06380079c0).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.411+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f064004d6a0 con 0x7f064c063e10 2024-01-21T20:11:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.601+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f064c05fdf0 con 0x7f063005f2c0 2024-01-21T20:11:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.603+0000 7f06497fa700 1 -- 172.21.15.133:0/2842537124 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f064c05fdf0 con 0x7f063005f2c0 2024-01-21T20:11:24.592 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:24.593 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 msgr2=0x7f0630061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 0x7f0630061780 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f064c0c65f0 tx=0x7f06380079c0).stop 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 msgr2=0x7f064c142f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f0640009130 tx=0x7f0640017000).stop 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 shutdown_connections 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f063005f2c0 0x7f0630061780 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f064c154050 0x7f064c0a7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f064c063e10 0x7f064c142f30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 --2- 172.21.15.133:0/2842537124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f064c0c1aa0 0x7f064c0a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:24.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 >> 172.21.15.133:0/2842537124 conn(0x7f064c0c4a10 msgr2=0x7f064c0c6860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 shutdown_connections 2024-01-21T20:11:24.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.605+0000 7f0653263700 1 -- 172.21.15.133:0/2842537124 wait complete. 2024-01-21T20:11:24.606 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:13", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.607 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:13', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:24.607 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:24.607 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:24.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:24.607 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-01-21T20:11:24.625 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:24.625 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:24.626 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:24.626 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:24.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2024-01-21T20:11:24.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.795+0000 7fe7b7cfa700 1 Processor -- start 2024-01-21T20:11:24.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.795+0000 7fe7b7cfa700 1 -- start start 2024-01-21T20:11:24.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 0x7fe7b0062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b00698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b0158b10 con 0x7fe7b00bcc20 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b0157f00 con 0x7fe7b00626f0 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b7cfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b01581e0 con 0x7fe7b0069480 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b5295700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b5295700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38410/0 (socket says 172.21.15.133:38410) 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b5295700 1 -- 172.21.15.133:0/378086980 learned_addr learned my addr 172.21.15.133:0/378086980 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b6297700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b00698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.796+0000 7fe7b5a96700 1 --2- 172.21.15.133:0/378086980 >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 0x7fe7b0062ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 -- 172.21.15.133:0/378086980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 msgr2=0x7fe7b00698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b00698d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 -- 172.21.15.133:0/378086980 >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 msgr2=0x7fe7b0062ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:24.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 --2- 172.21.15.133:0/378086980 >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 0x7fe7b0062ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 -- 172.21.15.133:0/378086980 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b01584c0 con 0x7fe7b00bcc20 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5a96700 1 --2- 172.21.15.133:0/378086980 >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 0x7fe7b0062ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b6297700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b00698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b5295700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fe7b005ec00 tx=0x7fe7ac0090f0).ready entity=mon.0 client_cookie=e784014b78d5c1f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b4a94700 1 -- 172.21.15.133:0/378086980 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00b600 con 0x7fe7b00bcc20 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b4a94700 1 -- 172.21.15.133:0/378086980 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00b760 con 0x7fe7b00bcc20 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b4a94700 1 -- 172.21.15.133:0/378086980 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00bb00 con 0x7fe7b00bcc20 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/378086980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 msgr2=0x7fe7b00bd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fe7b005ec00 tx=0x7fe7ac0090f0).stop 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/378086980 shutdown_connections 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b00698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/378086980 >> v2:172.21.15.178:3300/0 conn(0x7fe7b00626f0 0x7fe7b0062ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/378086980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b00bd0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.797+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/378086980 >> 172.21.15.133:0/378086980 conn(0x7fe7b00c7cc0 msgr2=0x7fe7b00c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.798+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/378086980 shutdown_connections 2024-01-21T20:11:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.798+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/378086980 wait complete. 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 Processor -- start 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 -- start start 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00626f0 0x7fe7b0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b013a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c0e20 con 0x7fe7b00bcc20 2024-01-21T20:11:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b0151190 con 0x7fe7b00626f0 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.799+0000 7fe7b7cfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b00c1630 con 0x7fe7b0069480 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38416/0 (socket says 172.21.15.133:38416) 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 -- 172.21.15.133:0/1733051854 learned_addr learned my addr 172.21.15.133:0/1733051854 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b5a96700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00626f0 0x7fe7b0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b5295700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 -- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 msgr2=0x7fe7b013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 -- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00626f0 msgr2=0x7fe7b0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00626f0 0x7fe7b0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 -- 172.21.15.133:0/1733051854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009370 con 0x7fe7b00bcc20 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b6297700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fe7a8007f60 tx=0x7fe7a8009930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800db80 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a800f040 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80133f0 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b00c0210 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.800+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b00c07d0 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.801+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b005fdf0 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.801+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe7a80137e0 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.802+0000 7fe7a67fc700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 0x7fe794061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.802+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fe7a807aa00 con 0x7fe7b00bcc20 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.802+0000 7fe7b5a96700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 0x7fe794061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.802+0000 7fe7b5a96700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 0x7fe794061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe7a0006fd0 tx=0x7fe7a0008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.806+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7a804ba80 con 0x7fe7b00bcc20 2024-01-21T20:11:24.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.992+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe7b00c2080 con 0x7fe79405f2c0 2024-01-21T20:11:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.993+0000 7fe7a67fc700 1 -- 172.21.15.133:0/1733051854 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe7b00c2080 con 0x7fe79405f2c0 2024-01-21T20:11:24.983 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:24.983 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:14", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 msgr2=0x7fe794061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 0x7fe794061780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fe7a0006fd0 tx=0x7fe7a0008040).stop 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 msgr2=0x7fe7b0155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fe7a8007f60 tx=0x7fe7a8009930).stop 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 shutdown_connections 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe79405f2c0 0x7fe794061780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7b00bcc20 0x7fe7b0155c50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7b00626f0 0x7fe7b0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 --2- 172.21.15.133:0/1733051854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7b0069480 0x7fe7b013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:24.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 >> 172.21.15.133:0/1733051854 conn(0x7fe7b00c7cc0 msgr2=0x7fe7b00a68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:24.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 shutdown_connections 2024-01-21T20:11:24.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:24.995+0000 7fe7b7cfa700 1 -- 172.21.15.133:0/1733051854 wait complete. 2024-01-21T20:11:24.997 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:14", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:24.997 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:14', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:24.997 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:24.997 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:24.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:24.997 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:25.016 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:25.017 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:25.017 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:25.017 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:25.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2024-01-21T20:11:25.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.187+0000 7fa48f1bf700 1 Processor -- start 2024-01-21T20:11:25.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.187+0000 7fa48f1bf700 1 -- start start 2024-01-21T20:11:25.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa488066b50 0x7fa488066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 0x7fa4880c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880bdec0 0x7fa488153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa488158ed0 con 0x7fa488066b50 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4880c5820 con 0x7fa488157f30 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48f1bf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880c37c0 con 0x7fa4880bdec0 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48cf5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa488066b50 0x7fa488066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48cf5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa488066b50 0x7fa488066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38432/0 (socket says 172.21.15.133:38432) 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48cf5b700 1 -- 172.21.15.133:0/637879652 learned_addr learned my addr 172.21.15.133:0/637879652 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48d75c700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880bdec0 0x7fa488153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa487fff700 1 --2- 172.21.15.133:0/637879652 >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 0x7fa4880c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48cf5b700 1 -- 172.21.15.133:0/637879652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880bdec0 msgr2=0x7fa488153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.188+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880bdec0 0x7fa488153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48cf5b700 1 -- 172.21.15.133:0/637879652 >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 msgr2=0x7fa4880c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/637879652 >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 0x7fa4880c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48cf5b700 1 -- 172.21.15.133:0/637879652 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4881583b0 con 0x7fa488066b50 2024-01-21T20:11:25.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa487fff700 1 --2- 172.21.15.133:0/637879652 >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 0x7fa4880c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488066b50 0x7fa488066f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa488066560 tx=0x7fa47c0090f0).ready entity=mon.0 client_cookie=bdf4dd7e3622921b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa4877fe700 1 -- 172.21.15.133:0/637879652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00b600 con 0x7fa488066b50 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa4877fe700 1 -- 172.21.15.133:0/637879652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00b760 con 0x7fa488066b50 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa4877fe700 1 -- 172.21.15.133:0/637879652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00bb00 con 0x7fa488066b50 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 -- 172.21.15.133:0/637879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488066b50 msgr2=0x7fa488066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488066b50 0x7fa488066f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa488066560 tx=0x7fa47c0090f0).stop 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 -- 172.21.15.133:0/637879652 shutdown_connections 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880bdec0 0x7fa488153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/637879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488066b50 0x7fa488066f30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/637879652 >> v2:172.21.15.178:3300/0 conn(0x7fa488157f30 0x7fa4880c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 -- 172.21.15.133:0/637879652 >> 172.21.15.133:0/637879652 conn(0x7fa4880c8f60 msgr2=0x7fa4880c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 -- 172.21.15.133:0/637879652 shutdown_connections 2024-01-21T20:11:25.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.189+0000 7fa48f1bf700 1 -- 172.21.15.133:0/637879652 wait complete. 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.191+0000 7fa48f1bf700 1 Processor -- start 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.191+0000 7fa48f1bf700 1 -- start start 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.191+0000 7fa48f1bf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa488066b50 0x7fa4880abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.191+0000 7fa48f1bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4880bdec0 0x7fa4881683b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880ac3e0 con 0x7fa488157f30 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4881688a0 con 0x7fa4880bdec0 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880ace70 con 0x7fa488066b50 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38438/0 (socket says 172.21.15.133:38438) 2024-01-21T20:11:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 -- 172.21.15.133:0/1156923658 learned_addr learned my addr 172.21.15.133:0/1156923658 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa488066b50 0x7fa4880abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa487fff700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4880bdec0 0x7fa4881683b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 -- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa488066b50 msgr2=0x7fa4880abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa488066b50 0x7fa4880abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 -- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4880bdec0 msgr2=0x7fa4881683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4880bdec0 0x7fa4881683b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 -- 172.21.15.133:0/1156923658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009370 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48d75c700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa480009fd0 tx=0x7fa480009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48000ed50 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48000eeb0 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480014610 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488165690 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.192+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4880ac5d0 con 0x7fa488157f30 2024-01-21T20:11:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.193+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa488165470 con 0x7fa488157f30 2024-01-21T20:11:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.194+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fa48001d3b0 con 0x7fa488157f30 2024-01-21T20:11:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.194+0000 7fa4857fa700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 0x7fa46c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.194+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fa48007aa90 con 0x7fa488157f30 2024-01-21T20:11:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.194+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 0x7fa46c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.194+0000 7fa48cf5b700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 0x7fa46c061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa47c00b3c0 tx=0x7fa47c017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.198+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa48004bab0 con 0x7fa488157f30 2024-01-21T20:11:25.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.388+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa488165820 con 0x7fa46c05f2c0 2024-01-21T20:11:25.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.390+0000 7fa4857fa700 1 -- 172.21.15.133:0/1156923658 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fa488165820 con 0x7fa46c05f2c0 2024-01-21T20:11:25.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:25.380 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:14", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:25.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 msgr2=0x7fa46c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 0x7fa46c061780 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa47c00b3c0 tx=0x7fa47c017000).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 msgr2=0x7fa488157780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa480009fd0 tx=0x7fa480009900).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 shutdown_connections 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa46c05f2c0 0x7fa46c061780 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488157f30 0x7fa488157780 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa488066b50 0x7fa4880abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 --2- 172.21.15.133:0/1156923658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4880bdec0 0x7fa4881683b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.391+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 >> 172.21.15.133:0/1156923658 conn(0x7fa4880c8f60 msgr2=0x7fa4880c8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.392+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 shutdown_connections 2024-01-21T20:11:25.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.392+0000 7fa48f1bf700 1 -- 172.21.15.133:0/1156923658 wait complete. 2024-01-21T20:11:25.393 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:14", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:25.393 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:14', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:25.393 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:25.393 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:25.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:25.394 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-01-21T20:11:25.412 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:25.412 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:25.413 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:25.413 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:25.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2024-01-21T20:11:25.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.581+0000 7fd5a578d700 1 Processor -- start 2024-01-21T20:11:25.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.581+0000 7fd5a578d700 1 -- start start 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd5a578d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a00c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd5a578d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5a00673e0 0x7fd5a00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd5a578d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00654c0 con 0x7fd5a0154480 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd5a578d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00c2e40 con 0x7fd5a00673e0 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd5a578d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00c1d80 con 0x7fd5a01540a0 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd59e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5a00673e0 0x7fd5a00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd59e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5a00673e0 0x7fd5a00c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38442/0 (socket says 172.21.15.133:38442) 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd59e7fc700 1 -- 172.21.15.133:0/1569907526 learned_addr learned my addr 172.21.15.133:0/1569907526 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.582+0000 7fd59f7fe700 1 --1- 172.21.15.133:0/1569907526 >> v1:172.21.15.133:6789/0 conn(0x7fd5a0154480 0x7fd5a0157e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36486/0 (socket says 172.21.15.133:36486) 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59effd700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a00c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59e7fc700 1 -- 172.21.15.133:0/1569907526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 msgr2=0x7fd5a00c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59e7fc700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a00c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59e7fc700 1 -- 172.21.15.133:0/1569907526 >> v1:172.21.15.133:6789/0 conn(0x7fd5a0154480 legacy=0x7fd5a0157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59e7fc700 1 -- 172.21.15.133:0/1569907526 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0064e70 con 0x7fd5a00673e0 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59dffb700 1 -- 172.21.15.133:0/1569907526 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246775768 0 0) 0x7fd5a00654c0 con 0x7fd5a0154480 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59e7fc700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a00673e0 0x7fd5a00c2950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd590006fd0 tx=0x7fd5900090f0).ready entity=mon.0 client_cookie=f749ba63b5b4dcb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59dffb700 1 -- 172.21.15.133:0/1569907526 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000b580 con 0x7fd5a00673e0 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59dffb700 1 -- 172.21.15.133:0/1569907526 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000b6e0 con 0x7fd5a00673e0 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.583+0000 7fd59dffb700 1 -- 172.21.15.133:0/1569907526 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000ba80 con 0x7fd5a00673e0 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 -- 172.21.15.133:0/1569907526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a00673e0 msgr2=0x7fd5a00c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a00673e0 0x7fd5a00c2950 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fd590006fd0 tx=0x7fd5900090f0).stop 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 -- 172.21.15.133:0/1569907526 shutdown_connections 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a00c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 --2- 172.21.15.133:0/1569907526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a00673e0 0x7fd5a00c2950 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 -- 172.21.15.133:0/1569907526 >> 172.21.15.133:0/1569907526 conn(0x7fd5a00c49c0 msgr2=0x7fd5a0068d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 -- 172.21.15.133:0/1569907526 shutdown_connections 2024-01-21T20:11:25.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.584+0000 7fd5a578d700 1 -- 172.21.15.133:0/1569907526 wait complete. 2024-01-21T20:11:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.585+0000 7fd5a578d700 1 Processor -- start 2024-01-21T20:11:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.585+0000 7fd5a578d700 1 -- start start 2024-01-21T20:11:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a00673e0 0x7fd5a014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a0156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00aa3e0 con 0x7fd5a0154480 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00aa6c0 con 0x7fd5a00673e0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0157410 con 0x7fd5a01540a0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38454/0 (socket says 172.21.15.133:38454) 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 -- 172.21.15.133:0/3055847333 learned_addr learned my addr 172.21.15.133:0/3055847333 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59e7fc700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a0156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59effd700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a00673e0 0x7fd5a014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 -- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 msgr2=0x7fd5a0156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a0156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 -- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a00673e0 msgr2=0x7fd5a014cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a00673e0 0x7fd5a014cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 -- 172.21.15.133:0/3055847333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009370 con 0x7fd5a0154480 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd59f7fe700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fd59800c730 tx=0x7fd598001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598005c70 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd598005dd0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.586+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a01576f0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.587+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598007300 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.587+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a014cff0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.587+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a00a9ee0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.588+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fd5980076b0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.588+0000 7fd5877fe700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 0x7fd58c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.588+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7fd598079ff0 con 0x7fd5a0154480 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.588+0000 7fd59effd700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 0x7fd58c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.589+0000 7fd59effd700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 0x7fd58c061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd594009c30 tx=0x7fd594009060).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.592+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd59804aff0 con 0x7fd5a0154480 2024-01-21T20:11:25.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.779+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5a00aa830 con 0x7fd58c05f2c0 2024-01-21T20:11:25.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.781+0000 7fd5877fe700 1 -- 172.21.15.133:0/3055847333 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd5a00aa830 con 0x7fd58c05f2c0 2024-01-21T20:11:25.771 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:25.771 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 msgr2=0x7fd58c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 0x7fd58c061780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd594009c30 tx=0x7fd594009060).stop 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 msgr2=0x7fd5a00bd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fd59800c730 tx=0x7fd598001520).stop 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 shutdown_connections 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd58c05f2c0 0x7fd58c061780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5a0154480 0x7fd5a00bd540 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a00673e0 0x7fd5a014cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 --2- 172.21.15.133:0/3055847333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a01540a0 0x7fd5a0156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 >> 172.21.15.133:0/3055847333 conn(0x7fd5a00c49c0 msgr2=0x7fd5a00c2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 shutdown_connections 2024-01-21T20:11:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.783+0000 7fd5a578d700 1 -- 172.21.15.133:0/3055847333 wait complete. 2024-01-21T20:11:25.785 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:25.785 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:15', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:25.785 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:25.785 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:25.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:25.785 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:25.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:25.804 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:25.805 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2024-01-21T20:11:25.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.973+0000 7f2ae0f15700 1 Processor -- start 2024-01-21T20:11:25.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.973+0000 7f2ae0f15700 1 -- start start 2024-01-21T20:11:25.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ae0f15700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2adc154250 0x7f2adc154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ae0f15700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc06a4b0 con 0x7f2adc069510 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ae0f15700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2adc069ef0 con 0x7f2adc062e00 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ae0f15700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc06a1d0 con 0x7f2adc154250 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ada59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2adc154250 0x7f2adc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ad9d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2adc069510 0x7f2adc0626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36498/0 (socket says 172.21.15.133:36498) 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.974+0000 7f2ad9d9b700 1 -- 172.21.15.133:0/623351386 learned_addr learned my addr 172.21.15.133:0/623351386 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ada59c700 1 -- 172.21.15.133:0/623351386 >> v1:172.21.15.178:6789/0 conn(0x7f2adc062e00 legacy=0x7f2adc065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ada59c700 1 -- 172.21.15.133:0/623351386 >> v1:172.21.15.133:6789/0 conn(0x7f2adc069510 legacy=0x7f2adc0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ad959a700 1 -- 172.21.15.133:0/623351386 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565831142 0 0) 0x7f2adc06a4b0 con 0x7f2adc069510 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ada59c700 1 -- 172.21.15.133:0/623351386 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc065720 con 0x7f2adc154250 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ada59c700 1 --2- 172.21.15.133:0/623351386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc154250 0x7f2adc154630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f2ad0009760 tx=0x7f2ad0009060).ready entity=mon.0 client_cookie=1cb81f7b8555ab4f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ad959a700 1 -- 172.21.15.133:0/623351386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000b580 con 0x7f2adc154250 2024-01-21T20:11:25.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ad959a700 1 -- 172.21.15.133:0/623351386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000b6e0 con 0x7f2adc154250 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.975+0000 7f2ad959a700 1 -- 172.21.15.133:0/623351386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000ba60 con 0x7f2adc154250 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 -- 172.21.15.133:0/623351386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc154250 msgr2=0x7f2adc154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/623351386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc154250 0x7f2adc154630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f2ad0009760 tx=0x7f2ad0009060).stop 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 -- 172.21.15.133:0/623351386 shutdown_connections 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/623351386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc154250 0x7f2adc154630 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 -- 172.21.15.133:0/623351386 >> 172.21.15.133:0/623351386 conn(0x7f2adc0c7d30 msgr2=0x7f2adc0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 -- 172.21.15.133:0/623351386 shutdown_connections 2024-01-21T20:11:25.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.976+0000 7f2ae0f15700 1 -- 172.21.15.133:0/623351386 wait complete. 2024-01-21T20:11:25.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.977+0000 7f2ae0f15700 1 Processor -- start 2024-01-21T20:11:25.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.977+0000 7f2ae0f15700 1 -- start start 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2adc062e00 0x7f2adc150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2adc154250 0x7f2adc164680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc1518c0 con 0x7f2adc069510 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0a78a0 con 0x7f2adc154250 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ae0f15700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0a7b80 con 0x7f2adc062e00 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38474/0 (socket says 172.21.15.133:38474) 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 -- 172.21.15.133:0/1175944825 learned_addr learned my addr 172.21.15.133:0/1175944825 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ada59c700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2adc062e00 0x7f2adc150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2adad9d700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2adc154250 0x7f2adc164680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 -- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2adc062e00 msgr2=0x7f2adc150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2adc062e00 0x7f2adc150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 -- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2adc154250 msgr2=0x7f2adc164680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2adc154250 0x7f2adc164680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.978+0000 7f2ad9d9b700 1 -- 172.21.15.133:0/1175944825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00092a0 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2ad9d9b700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2acc00c4c0 tx=0x7f2acc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0072e0 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc007440 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0a7e60 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc0057a0 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.979+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc1514d0 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.980+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc05fdf0 con 0x7f2adc069510 2024-01-21T20:11:25.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.980+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f2acc005b90 con 0x7f2adc069510 2024-01-21T20:11:25.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.980+0000 7f2acaffd700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 0x7f2abc061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:25.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.980+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f2acc079df0 con 0x7f2adc069510 2024-01-21T20:11:25.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.980+0000 7f2ada59c700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 0x7f2abc061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:25.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.981+0000 7f2ada59c700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 0x7f2abc061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2ad000b340 tx=0x7f2ad0017000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:25.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:25.985+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2acc04ae70 con 0x7f2adc069510 2024-01-21T20:11:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.173+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2adc0c8ab0 con 0x7f2abc05f2c0 2024-01-21T20:11:26.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.174+0000 7f2acaffd700 1 -- 172.21.15.133:0/1175944825 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f2adc0c8ab0 con 0x7f2abc05f2c0 2024-01-21T20:11:26.164 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:26.164 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 msgr2=0x7f2abc061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 0x7f2abc061780 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2ad000b340 tx=0x7f2ad0017000).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 msgr2=0x7f2adc143660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f2acc00c4c0 tx=0x7f2acc007c10).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 shutdown_connections 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2abc05f2c0 0x7f2abc061780 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2adc154250 0x7f2adc164680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2adc062e00 0x7f2adc150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 --2- 172.21.15.133:0/1175944825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2adc069510 0x7f2adc143660 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 >> 172.21.15.133:0/1175944825 conn(0x7f2adc0c7d30 msgr2=0x7f2adc14f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 shutdown_connections 2024-01-21T20:11:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.176+0000 7f2ae0f15700 1 -- 172.21.15.133:0/1175944825 wait complete. 2024-01-21T20:11:26.177 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:26.177 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:15', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:26.178 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:26.178 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:26.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:26.178 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:26.196 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:26.197 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:26.197 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:26.197 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:26.197 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:26.198 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_01_00_UTC', 'scheduled-2024-01-21-20_02_00_UTC', 'scheduled-2024-01-21-20_03_00_UTC', 'scheduled-2024-01-21-20_04_00_UTC', 'scheduled-2024-01-21-20_05_00_UTC', 'scheduled-2024-01-21-20_06_00_UTC', 'scheduled-2024-01-21-20_07_00_UTC', 'scheduled-2024-01-21-20_08_00_UTC', 'scheduled-2024-01-21-20_09_00_UTC', 'scheduled-2024-01-21-20_10_00_UTC', 'scheduled-2024-01-21-20_11_00_UTC'] 2024-01-21T20:11:26.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2024-01-21T20:11:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.367+0000 7f7ce896d700 1 Processor -- start 2024-01-21T20:11:26.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.367+0000 7f7ce896d700 1 -- start start 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce896d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 0x7f7ce4065290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce896d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ce41565f0 0x7f7ce4152630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce896d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce4156b30 con 0x7f7ce4065780 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce896d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce40695b0 con 0x7f7ce41565f0 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce896d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce40bccc0 con 0x7f7ce41386c0 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ce41565f0 0x7f7ce4152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ce41565f0 0x7f7ce4152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38484/0 (socket says 172.21.15.133:38484) 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 -- 172.21.15.133:0/636149994 learned_addr learned my addr 172.21.15.133:0/636149994 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce259c700 1 --2- 172.21.15.133:0/636149994 >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 0x7f7ce4065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 -- 172.21.15.133:0/636149994 >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 msgr2=0x7f7ce4065290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 --2- 172.21.15.133:0/636149994 >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 0x7f7ce4065290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 -- 172.21.15.133:0/636149994 >> v1:172.21.15.178:6789/0 conn(0x7f7ce4065780 legacy=0x7f7ce4069a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 -- 172.21.15.133:0/636149994 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40bcfa0 con 0x7f7ce41565f0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce259c700 1 --2- 172.21.15.133:0/636149994 >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 0x7f7ce4065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce2d9d700 1 --2- 172.21.15.133:0/636149994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce41565f0 0x7f7ce4152630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7ce405ec60 tx=0x7f7cdc009840).ready entity=mon.0 client_cookie=890305ac26c9418 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce159a700 1 -- 172.21.15.133:0/636149994 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00e070 con 0x7f7ce41565f0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce159a700 1 -- 172.21.15.133:0/636149994 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc00ba10 con 0x7f7ce41565f0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.368+0000 7f7ce159a700 1 -- 172.21.15.133:0/636149994 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00bd90 con 0x7f7ce41565f0 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 -- 172.21.15.133:0/636149994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce41565f0 msgr2=0x7f7ce4152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 --2- 172.21.15.133:0/636149994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce41565f0 0x7f7ce4152630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f7ce405ec60 tx=0x7f7cdc009840).stop 2024-01-21T20:11:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 -- 172.21.15.133:0/636149994 shutdown_connections 2024-01-21T20:11:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 --2- 172.21.15.133:0/636149994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce41565f0 0x7f7ce4152630 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 --2- 172.21.15.133:0/636149994 >> v2:172.21.15.178:3300/0 conn(0x7f7ce41386c0 0x7f7ce4065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 -- 172.21.15.133:0/636149994 >> 172.21.15.133:0/636149994 conn(0x7f7ce40c7cc0 msgr2=0x7f7ce40c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 -- 172.21.15.133:0/636149994 shutdown_connections 2024-01-21T20:11:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.369+0000 7f7ce896d700 1 -- 172.21.15.133:0/636149994 wait complete. 2024-01-21T20:11:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.370+0000 7f7ce896d700 1 Processor -- start 2024-01-21T20:11:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.370+0000 7f7ce896d700 1 -- start start 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41386c0 0x7f7ce40c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce41565f0 0x7f7ce40bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40aa200 con 0x7f7ce4065780 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40a95f0 con 0x7f7ce41386c0 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce896d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce40a98d0 con 0x7f7ce41565f0 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38490/0 (socket says 172.21.15.133:38490) 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce259c700 1 -- 172.21.15.133:0/768518398 learned_addr learned my addr 172.21.15.133:0/768518398 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce2d9d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce41565f0 0x7f7ce40bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.371+0000 7f7ce1d9b700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41386c0 0x7f7ce40c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 -- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce41565f0 msgr2=0x7f7ce40bf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce41565f0 0x7f7ce40bf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 -- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41386c0 msgr2=0x7f7ce40c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41386c0 0x7f7ce40c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 -- 172.21.15.133:0/768518398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc009ae0 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce259c700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7cd400c880 tx=0x7f7cd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4010580 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd40106e0 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce40a9bb0 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4010a60 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.372+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce414fbf0 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.373+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce405fdf0 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.373+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7cd401b460 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.373+0000 7f7cd2ffd700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 0x7f7cc4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.374+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f7cd407a540 con 0x7f7ce4065780 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.374+0000 7f7ce1d9b700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 0x7f7cc4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.374+0000 7f7ce1d9b700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 0x7f7cc4061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7ce414ff60 tx=0x7f7cd8009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.378+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7cd404b560 con 0x7f7ce4065780 2024-01-21T20:11:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.565+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ce40aa050 con 0x7f7cc405f2c0 2024-01-21T20:11:26.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.566+0000 7f7cd2ffd700 1 -- 172.21.15.133:0/768518398 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7ce40aa050 con 0x7f7cc405f2c0 2024-01-21T20:11:26.556 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:26.556 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 msgr2=0x7f7cc4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 0x7f7cc4061780 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7ce414ff60 tx=0x7f7cd8009040).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 msgr2=0x7f7ce41367b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f7cd400c880 tx=0x7f7cd4008040).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 shutdown_connections 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cc405f2c0 0x7f7cc4061780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce41565f0 0x7f7ce40bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce4065780 0x7f7ce41367b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 --2- 172.21.15.133:0/768518398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce41386c0 0x7f7ce40c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 >> 172.21.15.133:0/768518398 conn(0x7f7ce40c7cc0 msgr2=0x7f7ce40c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 shutdown_connections 2024-01-21T20:11:26.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.568+0000 7f7ce896d700 1 -- 172.21.15.133:0/768518398 wait complete. 2024-01-21T20:11:26.569 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:00:15", "first": "2024-01-21T20:01:00", "last": "2024-01-21T20:11:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-01-21T20:11:26.569 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:00:15', 'first': '2024-01-21T20:01:00', 'last': '2024-01-21T20:11:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-01-21T20:11:26.570 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T20:11:26.570 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T20:11:26.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2024-01-21T20:11:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.700+0000 7f8f2e796700 1 Processor -- start 2024-01-21T20:11:26.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.700+0000 7f8f2e796700 1 -- start start 2024-01-21T20:11:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f2e796700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f280ab7f0 0x7f8f2815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f2e796700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f281566f0 con 0x7f8f28152010 2024-01-21T20:11:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f2e796700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f280beef0 con 0x7f8f281523f0 2024-01-21T20:11:26.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f2e796700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f28067400 con 0x7f8f280ab7f0 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f27fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f28152010 0x7f8f280669b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36500/0 (socket says 172.21.15.133:36500) 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f27fff700 1 -- 172.21.15.133:0/3974422737 learned_addr learned my addr 172.21.15.133:0/3974422737 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747644728 0 0) 0x7f8f281566f0 con 0x7f8f28152010 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3974422737 >> v2:172.21.15.178:3300/0 conn(0x7f8f280ab7f0 0x7f8f2815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.701+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f100033f0 con 0x7f8f28152010 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809580333 0 0) 0x7f8f100033f0 con 0x7f8f28152010 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 >> v2:172.21.15.178:3300/0 conn(0x7f8f280ab7f0 msgr2=0x7f8f2815d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 --2- 172.21.15.133:0/3974422737 >> v2:172.21.15.178:3300/0 conn(0x7f8f280ab7f0 0x7f8f2815d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 >> v1:172.21.15.178:6789/0 conn(0x7f8f281523f0 legacy=0x7f8f280ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28155dc0 con 0x7f8f28152010 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8f18001470 con 0x7f8f28152010 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 >> v1:172.21.15.133:6789/0 conn(0x7f8f28152010 legacy=0x7f8f280669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f100038e0 0x7f8f10003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f10004690 0x7f8f10004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f1000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28067400 con 0x7f8f10005000 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1000bf60 con 0x7f8f10004690 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1000c0f0 con 0x7f8f100038e0 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f1000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f27fff700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f100038e0 0x7f8f10003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f277fe700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f10004690 0x7f8f10004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 -- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f100038e0 msgr2=0x7f8f10003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f100038e0 0x7f8f10003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 -- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f10004690 msgr2=0x7f8f10004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f10004690 0x7f8f10004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 -- 172.21.15.133:0/3974422737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100033f0 con 0x7f8f10005000 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 -- 172.21.15.133:0/3974422737 reap_dead start 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f1000b8e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f8f2000e210 tx=0x7f8f2000b040).ready entity=mon.0 client_cookie=12071e2e5a80d916 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20009ac0 con 0x7f8f10005000 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2000f040 con 0x7f8f10005000 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.702+0000 7f8f26ffd700 1 -- 172.21.15.133:0/3974422737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000ed10 con 0x7f8f10005000 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 -- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 msgr2=0x7f8f1000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f1000b8e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f8f2000e210 tx=0x7f8f2000b040).stop 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 -- 172.21.15.133:0/3974422737 shutdown_connections 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3974422737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f1000b8e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 -- 172.21.15.133:0/3974422737 >> 172.21.15.133:0/3974422737 conn(0x7f8f280c8f60 msgr2=0x7f8f280c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 -- 172.21.15.133:0/3974422737 shutdown_connections 2024-01-21T20:11:26.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.703+0000 7f8f2e796700 1 -- 172.21.15.133:0/3974422737 wait complete. 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.704+0000 7f8f2e796700 1 Processor -- start 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.704+0000 7f8f2e796700 1 -- start start 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 0x7f8f280c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 0x7f8f280c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280c3260 con 0x7f8f10005000 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f281546f0 con 0x7f8f2813d840 2024-01-21T20:11:26.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2e796700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28153d50 con 0x7f8f28163010 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38510/0 (socket says 172.21.15.133:38510) 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 -- 172.21.15.133:0/3571022514 learned_addr learned my addr 172.21.15.133:0/3571022514 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f277fe700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 0x7f8f280c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 0x7f8f280c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 -- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 msgr2=0x7f8f280c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 0x7f8f280c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 -- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 msgr2=0x7f8f280c0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 0x7f8f280c0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f27fff700 1 -- 172.21.15.133:0/3571022514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28154030 con 0x7f8f10005000 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f277fe700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 0x7f8f280c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.705+0000 7f8f2cd33700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 0x7f8f280c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f27fff700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f8f18004a10 tx=0x7f8f18001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800f660 con 0x7f8f10005000 2024-01-21T20:11:26.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1800f7c0 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800fb40 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f28154310 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.706+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f280c2e40 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.707+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f28154830 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.707+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f8f18015410 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.707+0000 7f8f24ff9700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 0x7f8f14061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.708+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7f8f1807a670 con 0x7f8f10005000 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.708+0000 7f8f277fe700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 0x7f8f14061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.708+0000 7f8f277fe700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 0x7f8f14061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f1c007cc0 tx=0x7f8f1c009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:26.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.712+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f28154830 con 0x7f8f10005000 2024-01-21T20:11:26.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.899+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f28153ec0 con 0x7f8f1405f2c0 2024-01-21T20:11:26.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.903+0000 7f8f24ff9700 1 -- 172.21.15.133:0/3571022514 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8f28153ec0 con 0x7f8f1405f2c0 2024-01-21T20:11:26.892 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir0 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 msgr2=0x7f8f14061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 0x7f8f14061780 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f1c007cc0 tx=0x7f8f1c009040).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 msgr2=0x7f8f280ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f8f18004a10 tx=0x7f8f18001e50).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 shutdown_connections 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f1405f2c0 0x7f8f14061780 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f2813d840 0x7f8f280c0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f10005000 0x7f8f280ad1b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 --2- 172.21.15.133:0/3571022514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f28163010 0x7f8f280c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 >> 172.21.15.133:0/3571022514 conn(0x7f8f280c8f60 msgr2=0x7f8f2814c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:26.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 shutdown_connections 2024-01-21T20:11:26.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:26.905+0000 7f8f2e796700 1 -- 172.21.15.133:0/3571022514 wait complete. 2024-01-21T20:11:26.906 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2024-01-21T20:11:26.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:26.907 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-01-21T20:11:26.924 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:26.924 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:26.924 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:26.925 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:26.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:26.925 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:26.988 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:26.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:26.989 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:27.052 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:27.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.052 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:27.116 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:27.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.116 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:27.181 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:27.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.181 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:27.246 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:27.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.247 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:27.311 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:27.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.311 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:27.377 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:27.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.378 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:27.441 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:27.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.441 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:27.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:27.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.507 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:27.570 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:27.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.571 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:27.633 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:27.634 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2024-01-21T20:11:27.694 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2024-01-21T20:11:27.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.864+0000 7ff6196d7700 1 Processor -- start 2024-01-21T20:11:27.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.864+0000 7ff6196d7700 1 -- start start 2024-01-21T20:11:27.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.864+0000 7ff6196d7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 0x7ff614152020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.864+0000 7ff6196d7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6140c2420 0x7ff6140c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6196d7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff614069290 con 0x7ff6140c11f0 2024-01-21T20:11:27.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6196d7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6140c2dc0 con 0x7ff6140c2420 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6196d7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff614155ad0 con 0x7ff6140c4110 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6140c2420 0x7ff6140c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6140c2420 0x7ff6140c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38514/0 (socket says 172.21.15.133:38514) 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 -- 172.21.15.133:0/652827498 learned_addr learned my addr 172.21.15.133:0/652827498 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff612ffd700 1 --2- 172.21.15.133:0/652827498 >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 0x7ff614152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 -- 172.21.15.133:0/652827498 >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 msgr2=0x7ff614152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 --2- 172.21.15.133:0/652827498 >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 0x7ff614152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 -- 172.21.15.133:0/652827498 >> v1:172.21.15.178:6789/0 conn(0x7ff6140c11f0 legacy=0x7ff6140c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 -- 172.21.15.133:0/652827498 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614152510 con 0x7ff6140c2420 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff612ffd700 1 --2- 172.21.15.133:0/652827498 >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 0x7ff614152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff6127fc700 1 --2- 172.21.15.133:0/652827498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c2420 0x7ff6140c28d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff6140c7c60 tx=0x7ff6080090f0).ready entity=mon.0 client_cookie=52b27dae3de9fb5e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff611ffb700 1 -- 172.21.15.133:0/652827498 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800b5a0 con 0x7ff6140c2420 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff611ffb700 1 -- 172.21.15.133:0/652827498 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60800b700 con 0x7ff6140c2420 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.865+0000 7ff611ffb700 1 -- 172.21.15.133:0/652827498 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800ba80 con 0x7ff6140c2420 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 -- 172.21.15.133:0/652827498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c2420 msgr2=0x7ff6140c28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 --2- 172.21.15.133:0/652827498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c2420 0x7ff6140c28d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff6140c7c60 tx=0x7ff6080090f0).stop 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 -- 172.21.15.133:0/652827498 shutdown_connections 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 --2- 172.21.15.133:0/652827498 >> v2:172.21.15.178:3300/0 conn(0x7ff6140c4110 0x7ff614152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 --2- 172.21.15.133:0/652827498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c2420 0x7ff6140c28d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 -- 172.21.15.133:0/652827498 >> 172.21.15.133:0/652827498 conn(0x7ff6140626f0 msgr2=0x7ff614062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 -- 172.21.15.133:0/652827498 shutdown_connections 2024-01-21T20:11:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.866+0000 7ff6196d7700 1 -- 172.21.15.133:0/652827498 wait complete. 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.867+0000 7ff6196d7700 1 Processor -- start 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.867+0000 7ff6196d7700 1 -- start start 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6140c11f0 0x7ff61414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6140c2420 0x7ff61413a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614165650 con 0x7ff6140c4110 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140bdc90 con 0x7ff6140c2420 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6196d7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61414d470 con 0x7ff6140c11f0 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38530/0 (socket says 172.21.15.133:38530) 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 -- 172.21.15.133:0/179081229 learned_addr learned my addr 172.21.15.133:0/179081229 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff612ffd700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6140c11f0 0x7ff61414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6127fc700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6140c2420 0x7ff61413a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 -- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6140c11f0 msgr2=0x7ff61414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6140c11f0 0x7ff61414d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 -- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6140c2420 msgr2=0x7ff61413a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6140c2420 0x7ff61413a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.868+0000 7ff6137fe700 1 -- 172.21.15.133:0/179081229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608009370 con 0x7ff6140c4110 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff6137fe700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff60c00c810 tx=0x7ff60c002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c010510 con 0x7ff6140c4110 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c010670 con 0x7ff6140c4110 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614165370 con 0x7ff6140c4110 2024-01-21T20:11:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c010a30 con 0x7ff6140c4110 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.869+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61414d100 con 0x7ff6140c4110 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.870+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61414d5e0 con 0x7ff6140c4110 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.870+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff60c012440 con 0x7ff6140c4110 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.870+0000 7ff5fb7fe700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 0x7ff6000617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.870+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff60c079ef0 con 0x7ff6140c4110 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.870+0000 7ff612ffd700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 0x7ff6000617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.871+0000 7ff612ffd700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 0x7ff6000617b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff60400ab40 tx=0x7ff604008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:27.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:27.875+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff60c048b00 con 0x7ff6140c4110 2024-01-21T20:11:28.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.063+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff61405fdf0 con 0x7ff60005f2f0 2024-01-21T20:11:28.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.066+0000 7ff5fb7fe700 1 -- 172.21.15.133:0/179081229 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff61405fdf0 con 0x7ff60005f2f0 2024-01-21T20:11:28.056 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir1 2024-01-21T20:11:28.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 msgr2=0x7ff6000617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:28.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 0x7ff6000617b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff60400ab40 tx=0x7ff604008040).stop 2024-01-21T20:11:28.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 msgr2=0x7ff614064760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:28.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7ff60c00c810 tx=0x7ff60c002560).stop 2024-01-21T20:11:28.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 shutdown_connections 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff60005f2f0 0x7ff6000617b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6140c4110 0x7ff614064760 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6140c11f0 0x7ff61414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 --2- 172.21.15.133:0/179081229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6140c2420 0x7ff61413a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 >> 172.21.15.133:0/179081229 conn(0x7ff6140626f0 msgr2=0x7ff6140bd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 shutdown_connections 2024-01-21T20:11:28.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:28.068+0000 7ff6196d7700 1 -- 172.21.15.133:0/179081229 wait complete. 2024-01-21T20:11:28.070 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2024-01-21T20:11:28.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.070 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:28.088 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:28.089 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:28.089 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:28.089 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:28.089 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:28.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.089 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:28.155 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:28.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.155 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:28.218 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:28.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.219 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:28.282 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:28.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.282 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:28.344 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:28.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.345 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:28.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:28.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.408 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:28.471 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:28.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.472 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:28.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:28.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.535 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:28.599 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:28.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.600 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:28.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:28.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.663 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:28.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:28.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.725 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:28.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:28.788 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2024-01-21T20:11:28.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2024-01-21T20:11:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.018+0000 7ff702d06700 1 Processor -- start 2024-01-21T20:11:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.018+0000 7ff702d06700 1 -- start start 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff702d06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff702d06700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6fc062e00 0x7ff6fc065f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff702d06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc06a4b0 con 0x7ff6fc069510 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff702d06700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc069ef0 con 0x7ff6fc062e00 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff702d06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc06a1d0 con 0x7ff6fc154250 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff7012a3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6fc062e00 0x7ff6fc065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff6fbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff6fc069510 0x7ff6fc0626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36512/0 (socket says 172.21.15.133:36512) 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff7012a3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff6fc062e00 0x7ff6fc065f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38546/0 (socket says 172.21.15.133:38546) 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.019+0000 7ff6fbfff700 1 -- 172.21.15.133:0/1931624268 learned_addr learned my addr 172.21.15.133:0/1931624268 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff700aa2700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff7012a3700 1 -- 172.21.15.133:0/1931624268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 msgr2=0x7ff6fc154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff7012a3700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff7012a3700 1 -- 172.21.15.133:0/1931624268 >> v1:172.21.15.133:6789/0 conn(0x7ff6fc069510 legacy=0x7ff6fc0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff7012a3700 1 -- 172.21.15.133:0/1931624268 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc065720 con 0x7ff6fc062e00 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff6fb7fe700 1 -- 172.21.15.133:0/1931624268 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609524546 0 0) 0x7ff6fc06a4b0 con 0x7ff6fc069510 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff700aa2700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff7012a3700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc065f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff6f4009e60 tx=0x7ff6f4009780).ready entity=mon.0 client_cookie=f41f35d909976845 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff6fb7fe700 1 -- 172.21.15.133:0/1931624268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400e070 con 0x7ff6fc062e00 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff6fb7fe700 1 -- 172.21.15.133:0/1931624268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400bc30 con 0x7ff6fc062e00 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff6fb7fe700 1 -- 172.21.15.133:0/1931624268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4012410 con 0x7ff6fc062e00 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff702d06700 1 -- 172.21.15.133:0/1931624268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 msgr2=0x7ff6fc065f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.020+0000 7ff702d06700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc065f20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7ff6f4009e60 tx=0x7ff6f4009780).stop 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 -- 172.21.15.133:0/1931624268 shutdown_connections 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc065f20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 --2- 172.21.15.133:0/1931624268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 -- 172.21.15.133:0/1931624268 >> 172.21.15.133:0/1931624268 conn(0x7ff6fc0c7d30 msgr2=0x7ff6fc0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:29.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 -- 172.21.15.133:0/1931624268 shutdown_connections 2024-01-21T20:11:29.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.021+0000 7ff702d06700 1 -- 172.21.15.133:0/1931624268 wait complete. 2024-01-21T20:11:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.022+0000 7ff702d06700 1 Processor -- start 2024-01-21T20:11:29.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.022+0000 7ff702d06700 1 -- start start 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6fc069510 0x7ff6fc0a8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc0aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0adbc0 con 0x7ff6fc062e00 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc167860 con 0x7ff6fc069510 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff702d06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ad600 con 0x7ff6fc154250 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38556/0 (socket says 172.21.15.133:38556) 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 -- 172.21.15.133:0/3969093696 learned_addr learned my addr 172.21.15.133:0/3969093696 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff6fbfff700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6fc069510 0x7ff6fc0a8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff7012a3700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc0aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 -- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 msgr2=0x7ff6fc0aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc0aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 -- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6fc069510 msgr2=0x7ff6fc0a8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6fc069510 0x7ff6fc0a8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 -- 172.21.15.133:0/3969093696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009a20 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.023+0000 7ff700aa2700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff6f000c880 tx=0x7ff6f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.024+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0010580 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.024+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00106e0 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.024+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0ad8e0 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.024+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0010a60 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.024+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0ab180 con 0x7ff6fc062e00 2024-01-21T20:11:29.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.025+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0ab340 con 0x7ff6fc062e00 2024-01-21T20:11:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.025+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ff6f001b460 con 0x7ff6fc062e00 2024-01-21T20:11:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.025+0000 7ff6f97fa700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 0x7ff6e0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.026+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6322+0+0 (secure 0 0 0) 0x7ff6f007a350 con 0x7ff6fc062e00 2024-01-21T20:11:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.026+0000 7ff6fbfff700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 0x7ff6e0061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:29.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.026+0000 7ff6fbfff700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 0x7ff6e0061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff6fc158a10 tx=0x7ff6e8007bb0).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:29.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.030+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff6f004b370 con 0x7ff6fc062e00 2024-01-21T20:11:29.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.243+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6fc05fdf0 con 0x7ff6e005f2c0 2024-01-21T20:11:29.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.246+0000 7ff6f97fa700 1 -- 172.21.15.133:0/3969093696 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff6fc05fdf0 con 0x7ff6e005f2c0 2024-01-21T20:11:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir2 2024-01-21T20:11:29.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.248+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 msgr2=0x7ff6e0061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.248+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 0x7ff6e0061780 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff6fc158a10 tx=0x7ff6e8007bb0).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.248+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 msgr2=0x7ff6fc14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.248+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7ff6f000c880 tx=0x7ff6f0008040).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 shutdown_connections 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff6e005f2c0 0x7ff6e0061780 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6fc154250 0x7ff6fc0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff6fc062e00 0x7ff6fc14d820 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 --2- 172.21.15.133:0/3969093696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6fc069510 0x7ff6fc0a8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 >> 172.21.15.133:0/3969093696 conn(0x7ff6fc0c7d30 msgr2=0x7ff6fc0c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 shutdown_connections 2024-01-21T20:11:29.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:29.249+0000 7ff702d06700 1 -- 172.21.15.133:0/3969093696 wait complete. 2024-01-21T20:11:29.250 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2024-01-21T20:11:29.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.250 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-01-21T20:11:29.268 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:29.268 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:29.268 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:29.269 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:29.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.269 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:29.343 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:29.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.343 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:29.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:29.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.408 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:29.469 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:29.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.470 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:29.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:29.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.532 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:29.608 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:29.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.609 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:29.671 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:29.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.672 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:29.734 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:29.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.734 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:29.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:29.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.797 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:29.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:29.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.859 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:29.922 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:29.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:29.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:29.985 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2024-01-21T20:11:30.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2024-01-21T20:11:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.239+0000 7f7fc04b8700 1 Processor -- start 2024-01-21T20:11:30.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.239+0000 7f7fc04b8700 1 -- start start 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fc04b8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7fb80a85d0 0x7f7fb81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fc04b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 0x7f7fb8066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fc04b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb81564e0 con 0x7f7fb8151de0 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fc04b8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb80c3ea0 con 0x7f7fb80a85d0 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fc04b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8155e90 con 0x7f7fb8156970 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fbda53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7fb80a85d0 0x7f7fb81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fbda53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7fb80a85d0 0x7f7fb81521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56936/0 (socket says 172.21.15.133:56936) 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fbda53700 1 -- 172.21.15.133:0/1848525439 learned_addr learned my addr 172.21.15.133:0/1848525439 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.240+0000 7f7fbe254700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7fb8151de0 0x7f7fb80c3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35976/0 (socket says 172.21.15.133:35976) 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbea55700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 0x7f7fb8066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbda53700 1 -- 172.21.15.133:0/1848525439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 msgr2=0x7f7fb8066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:30.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbda53700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 0x7f7fb8066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbda53700 1 -- 172.21.15.133:0/1848525439 >> v1:172.21.15.133:6789/0 conn(0x7f7fb8151de0 legacy=0x7f7fb80c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbd252700 1 -- 172.21.15.133:0/1848525439 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124885143 0 0) 0x7f7fb81564e0 con 0x7f7fb8151de0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbda53700 1 -- 172.21.15.133:0/1848525439 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb8156170 con 0x7f7fb80a85d0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbea55700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 0x7f7fb8066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbda53700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb80a85d0 0x7f7fb81521c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f7fb4006fd0 tx=0x7f7fb40090f0).ready entity=mon.0 client_cookie=8e0f486a627bcb8c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbd252700 1 -- 172.21.15.133:0/1848525439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400b600 con 0x7f7fb80a85d0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbd252700 1 -- 172.21.15.133:0/1848525439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400b760 con 0x7f7fb80a85d0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fbd252700 1 -- 172.21.15.133:0/1848525439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400bae0 con 0x7f7fb80a85d0 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1848525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb80a85d0 msgr2=0x7f7fb81521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb80a85d0 0x7f7fb81521c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f7fb4006fd0 tx=0x7f7fb40090f0).stop 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1848525439 shutdown_connections 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb8156970 0x7f7fb8066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1848525439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb80a85d0 0x7f7fb81521c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.241+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1848525439 >> 172.21.15.133:0/1848525439 conn(0x7f7fb80c8f60 msgr2=0x7f7fb80c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.242+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1848525439 shutdown_connections 2024-01-21T20:11:30.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.242+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1848525439 wait complete. 2024-01-21T20:11:30.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 Processor -- start 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 -- start start 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb80a85d0 0x7f7fb80c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb8151de0 0x7f7fb813f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.243+0000 7f7fc04b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8154960 con 0x7f7fb8156970 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fc04b8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8153d50 con 0x7f7fb8151de0 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fc04b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb8154030 con 0x7f7fb80a85d0 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56952/0 (socket says 172.21.15.133:56952) 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 -- 172.21.15.133:0/1206258159 learned_addr learned my addr 172.21.15.133:0/1206258159 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbe254700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb80a85d0 0x7f7fb80c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbda53700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb8151de0 0x7f7fb813f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 -- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb80a85d0 msgr2=0x7f7fb80c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb80a85d0 0x7f7fb80c00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 -- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb8151de0 msgr2=0x7f7fb813f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb8151de0 0x7f7fb813f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 -- 172.21.15.133:0/1206258159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009370 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fbea55700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f7fb000cef0 tx=0x7f7fb0007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000ad20 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000ae80 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0016610 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb8154310 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.244+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80c0590 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.245+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb80c4490 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.246+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7fb00203f0 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.246+0000 7f7faeffd700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 0x7f7f9c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.246+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6842+0+0 (secure 0 0 0) 0x7f7fb007b090 con 0x7f7fb8156970 2024-01-21T20:11:30.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.246+0000 7f7fbe254700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 0x7f7f9c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.246+0000 7f7fbe254700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 0x7f7f9c061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7fa80011e0 tx=0x7f7fa8007bd0).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:30.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.250+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7fb004beb0 con 0x7f7fb8156970 2024-01-21T20:11:30.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.438+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fb8154aa0 con 0x7f7f9c05f2c0 2024-01-21T20:11:30.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.442+0000 7f7faeffd700 1 -- 172.21.15.133:0/1206258159 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7fb8154aa0 con 0x7f7f9c05f2c0 2024-01-21T20:11:30.431 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir3 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 msgr2=0x7f7f9c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 0x7f7f9c061780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7fa80011e0 tx=0x7f7fa8007bd0).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 msgr2=0x7f7fb8153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f7fb000cef0 tx=0x7f7fb0007860).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 shutdown_connections 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f9c05f2c0 0x7f7f9c061780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7fb8156970 0x7f7fb8153200 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb80a85d0 0x7f7fb80c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 --2- 172.21.15.133:0/1206258159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb8151de0 0x7f7fb813f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 >> 172.21.15.133:0/1206258159 conn(0x7f7fb80c8f60 msgr2=0x7f7fb80abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 shutdown_connections 2024-01-21T20:11:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:30.444+0000 7f7fc04b8700 1 -- 172.21.15.133:0/1206258159 wait complete. 2024-01-21T20:11:30.445 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2024-01-21T20:11:30.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.445 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-01-21T20:11:30.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:30.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:30.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:30.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:30.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:30.464 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:30.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.464 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:30.529 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:30.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.529 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:30.596 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:30.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.596 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:30.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:30.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.660 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:30.723 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:30.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.724 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:30.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:30.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.786 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:30.850 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:30.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.850 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:30.913 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:30.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.914 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:30.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:30.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:30.977 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:31.039 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:31.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.040 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:31.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:31.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.122 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:31.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.184 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2024-01-21T20:11:31.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2024-01-21T20:11:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.424+0000 7f1194eeb700 1 Processor -- start 2024-01-21T20:11:31.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.424+0000 7f1194eeb700 1 -- start start 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.425+0000 7f1194eeb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 0x7f1190066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.425+0000 7f1194eeb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 0x7f1190153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.425+0000 7f1194eeb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900c37c0 con 0x7f1190157f30 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.425+0000 7f1194eeb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1190158ed0 con 0x7f11900c5330 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.425+0000 7f1194eeb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11901583b0 con 0x7f1190066b50 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118dd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1190157f30 0x7f11900bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35982/0 (socket says 172.21.15.133:35982) 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118dd9b700 1 -- 172.21.15.133:0/259499787 learned_addr learned my addr 172.21.15.133:0/259499787 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:31.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118ed9d700 1 --2- 172.21.15.133:0/259499787 >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 0x7f1190153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 --2- 172.21.15.133:0/259499787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 0x7f1190066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118d59a700 1 -- 172.21.15.133:0/259499787 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134640502 0 0) 0x7f11900c37c0 con 0x7f1190157f30 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118d59a700 1 -- 172.21.15.133:0/259499787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11780033f0 con 0x7f1190157f30 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 -- 172.21.15.133:0/259499787 >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 msgr2=0x7f1190153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 --2- 172.21.15.133:0/259499787 >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 0x7f1190153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 -- 172.21.15.133:0/259499787 >> v1:172.21.15.133:6789/0 conn(0x7f1190157f30 legacy=0x7f11900bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 -- 172.21.15.133:0/259499787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900c57c0 con 0x7f1190066b50 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118ed9d700 1 --2- 172.21.15.133:0/259499787 >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 0x7f1190153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118e59c700 1 --2- 172.21.15.133:0/259499787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 0x7f1190066f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1184009760 tx=0x7f1184009060).ready entity=mon.2 client_cookie=40c4ca4f6c6a30de server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118d59a700 1 -- 172.21.15.133:0/259499787 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840090d0 con 0x7f1190066b50 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118d59a700 1 -- 172.21.15.133:0/259499787 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400d4a0 con 0x7f1190066b50 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.426+0000 7f118d59a700 1 -- 172.21.15.133:0/259499787 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400d820 con 0x7f1190066b50 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 -- 172.21.15.133:0/259499787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 msgr2=0x7f1190066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 --2- 172.21.15.133:0/259499787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 0x7f1190066f30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1184009760 tx=0x7f1184009060).stop 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 -- 172.21.15.133:0/259499787 shutdown_connections 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 --2- 172.21.15.133:0/259499787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1190066b50 0x7f1190066f30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 --2- 172.21.15.133:0/259499787 >> v2:172.21.15.178:3300/0 conn(0x7f11900c5330 0x7f1190153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 -- 172.21.15.133:0/259499787 >> 172.21.15.133:0/259499787 conn(0x7f11900c8f60 msgr2=0x7f11900c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 -- 172.21.15.133:0/259499787 shutdown_connections 2024-01-21T20:11:31.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.427+0000 7f1194eeb700 1 -- 172.21.15.133:0/259499787 wait complete. 2024-01-21T20:11:31.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.429+0000 7f1194eeb700 1 Processor -- start 2024-01-21T20:11:31.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.429+0000 7f1194eeb700 1 -- start start 2024-01-21T20:11:31.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1190066b50 0x7f11900c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11900c5330 0x7f1190167e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900ac260 con 0x7f1190157f30 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190168670 con 0x7f1190066b50 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1190168950 con 0x7f11900c5330 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56956/0 (socket says 172.21.15.133:56956) 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 -- 172.21.15.133:0/1791283134 learned_addr learned my addr 172.21.15.133:0/1791283134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118e59c700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1190066b50 0x7f11900c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118dd9b700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11900c5330 0x7f1190167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 -- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11900c5330 msgr2=0x7f1190167e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11900c5330 0x7f1190167e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 -- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1190066b50 msgr2=0x7f11900c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1190066b50 0x7f11900c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 -- 172.21.15.133:0/1791283134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009a20 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f118ed9d700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1188009fc0 tx=0x7f118800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800cbd0 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800f040 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11840092a0 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.430+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188013400 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.431+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900abef0 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.432+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900ac410 con 0x7f1190157f30 2024-01-21T20:11:31.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.432+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f11880137f0 con 0x7f1190157f30 2024-01-21T20:11:31.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.432+0000 7f117effd700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 0x7f11700617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:31.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.432+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f118807b090 con 0x7f1190157f30 2024-01-21T20:11:31.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.432+0000 7f118e59c700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 0x7f11700617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:31.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.433+0000 7f118e59c700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 0x7f11700617b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f118400d260 tx=0x7f1184016000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:31.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.436+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f11900ac410 con 0x7f1190157f30 2024-01-21T20:11:31.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.623+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f11900ac3a0 con 0x7f117005f2f0 2024-01-21T20:11:31.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.626+0000 7f117effd700 1 -- 172.21.15.133:0/1791283134 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f11900ac3a0 con 0x7f117005f2f0 2024-01-21T20:11:31.616 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir4 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 msgr2=0x7f11700617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 0x7f11700617b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f118400d260 tx=0x7f1184016000).stop 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 msgr2=0x7f11901449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f1188009fc0 tx=0x7f118800b040).stop 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 shutdown_connections 2024-01-21T20:11:31.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117005f2f0 0x7f11700617b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1190157f30 0x7f11901449b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1190066b50 0x7f11900c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 --2- 172.21.15.133:0/1791283134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11900c5330 0x7f1190167e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 >> 172.21.15.133:0/1791283134 conn(0x7f11900c8f60 msgr2=0x7f11900c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 shutdown_connections 2024-01-21T20:11:31.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:31.628+0000 7f1194eeb700 1 -- 172.21.15.133:0/1791283134 wait complete. 2024-01-21T20:11:31.629 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2024-01-21T20:11:31.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.630 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:31.648 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:31.649 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:31.649 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:31.649 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:31.649 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:31.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:31.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.649 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:31.714 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:31.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.714 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:31.777 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:31.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.778 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:31.841 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:31.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.841 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:31.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:31.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.905 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:31.969 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:31.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:31.969 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:32.033 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:32.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.033 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:32.106 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:32.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.106 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:32.169 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:32.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.169 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:32.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:32.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.232 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:32.293 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:32.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.294 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:32.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.366 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2024-01-21T20:11:32.425 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2024-01-21T20:11:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.596+0000 7f149af4c700 1 Processor -- start 2024-01-21T20:11:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.596+0000 7f149af4c700 1 -- start start 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f149af4c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1494154250 0x7f1494154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f149af4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 0x7f14940626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f149af4c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149406a4b0 con 0x7f1494069970 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f149af4c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1494069ef0 con 0x7f1494154250 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f149af4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149406a1d0 con 0x7f1494069510 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f14994e9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1494069970 0x7f14941580c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35988/0 (socket says 172.21.15.133:35988) 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.597+0000 7f14994e9700 1 -- 172.21.15.133:0/1911658160 learned_addr learned my addr 172.21.15.133:0/1911658160 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:32.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1493fff700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 0x7f14940626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 --2- 172.21.15.133:0/1911658160 >> v2:172.21.15.178:3300/0 conn(0x7f1494154250 0x7f1494154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027649763 0 0) 0x7f149406a4b0 con 0x7f1494069970 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14840033f0 con 0x7f1494069970 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2127309973 0 0) 0x7f14840033f0 con 0x7f1494069970 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 -- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 msgr2=0x7f14940626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 0x7f14940626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 -- 172.21.15.133:0/1911658160 >> v1:172.21.15.133:6789/0 conn(0x7f1494069970 legacy=0x7f14941580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 -- 172.21.15.133:0/1911658160 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494065720 con 0x7f1494154250 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1493fff700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 0x7f14940626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f1498ce8700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494154250 0x7f1494154630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1488009760 tx=0x7f1488009060).ready entity=mon.1 client_cookie=5b661530a85b9784 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0017f0 con 0x7f1494154250 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488011400 con 0x7f1494154250 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.598+0000 7f14937fe700 1 -- 172.21.15.133:0/1911658160 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488011780 con 0x7f1494154250 2024-01-21T20:11:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 -- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494154250 msgr2=0x7f1494154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494154250 0x7f1494154630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1488009760 tx=0x7f1488009060).stop 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 -- 172.21.15.133:0/1911658160 shutdown_connections 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494154250 0x7f1494154630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 --2- 172.21.15.133:0/1911658160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494069510 0x7f14940626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 -- 172.21.15.133:0/1911658160 >> 172.21.15.133:0/1911658160 conn(0x7f14940c7d30 msgr2=0x7f14940c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 -- 172.21.15.133:0/1911658160 shutdown_connections 2024-01-21T20:11:32.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.599+0000 7f149af4c700 1 -- 172.21.15.133:0/1911658160 wait complete. 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.600+0000 7f149af4c700 1 Processor -- start 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.600+0000 7f149af4c700 1 -- start start 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494069510 0x7f14940a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494154250 0x7f1494155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14940aa940 con 0x7f1494069970 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494156ba0 con 0x7f1494069510 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f149af4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940a9dc0 con 0x7f1494154250 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56960/0 (socket says 172.21.15.133:56960) 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 -- 172.21.15.133:0/970572848 learned_addr learned my addr 172.21.15.133:0/970572848 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1498ce8700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494069510 0x7f14940a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f14994e9700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494154250 0x7f1494155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 -- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494154250 msgr2=0x7f1494155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494154250 0x7f1494155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 -- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494069510 msgr2=0x7f14940a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494069510 0x7f14940a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 -- 172.21.15.133:0/970572848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800092a0 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.601+0000 7f1493fff700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f148000ea20 tx=0x7f1480009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.602+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000ee60 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.602+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148000c850 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.602+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000cbd0 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.602+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14880092a0 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.602+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14940aa660 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.603+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14940aa1c0 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.603+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f148001b400 con 0x7f1494069970 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.603+0000 7f14917fa700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 0x7f1478061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:32.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.603+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7050+0+0 (secure 0 0 0) 0x7f148007ac80 con 0x7f1494069970 2024-01-21T20:11:32.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.604+0000 7f1498ce8700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 0x7f1478061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:32.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.604+0000 7f1498ce8700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 0x7f1478061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1488006be0 tx=0x7f1488016000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:32.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.608+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f148004b9d0 con 0x7f1494069970 2024-01-21T20:11:32.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.794+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f149405fdf0 con 0x7f147805f2c0 2024-01-21T20:11:32.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.797+0000 7f14917fa700 1 -- 172.21.15.133:0/970572848 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f149405fdf0 con 0x7f147805f2c0 2024-01-21T20:11:32.787 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir5 2024-01-21T20:11:32.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 msgr2=0x7f1478061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 0x7f1478061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1488006be0 tx=0x7f1488016000).stop 2024-01-21T20:11:32.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 msgr2=0x7f149414c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:32.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f148000ea20 tx=0x7f1480009060).stop 2024-01-21T20:11:32.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 shutdown_connections 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f147805f2c0 0x7f1478061780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1494154250 0x7f1494155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1494069510 0x7f14940a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 --2- 172.21.15.133:0/970572848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1494069970 0x7f149414c810 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 >> 172.21.15.133:0/970572848 conn(0x7f14940c7d30 msgr2=0x7f14940a48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 shutdown_connections 2024-01-21T20:11:32.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:32.799+0000 7f149af4c700 1 -- 172.21.15.133:0/970572848 wait complete. 2024-01-21T20:11:32.801 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2024-01-21T20:11:32.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.801 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-01-21T20:11:32.818 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:32.818 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:32.819 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:32.820 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:32.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.820 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:32.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:32.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.885 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:32.949 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:32.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:32.949 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:33.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:33.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.012 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:33.105 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:33.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.105 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:33.143 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:33.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.143 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:33.206 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:33.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.206 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:33.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:33.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.269 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:33.331 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:33.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.331 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:33.395 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:33.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.395 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:33.457 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:33.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.458 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:33.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.520 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2024-01-21T20:11:33.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2024-01-21T20:11:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.750+0000 7f6117ae8700 1 Processor -- start 2024-01-21T20:11:33.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 -- start start 2024-01-21T20:11:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f6110066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61100c5330 0x7f6110153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61100c37c0 con 0x7f6110157f30 2024-01-21T20:11:33.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6110158ed0 con 0x7f61100c5330 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.751+0000 7f6117ae8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61101583b0 con 0x7f6110066b50 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6115083700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6110157f30 0x7f61100bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35996/0 (socket says 172.21.15.133:35996) 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6115083700 1 -- 172.21.15.133:0/751839536 learned_addr learned my addr 172.21.15.133:0/751839536 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6115884700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f6110066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653322021 0 0) 0x7f61100c37c0 con 0x7f6110157f30 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6116085700 1 --2- 172.21.15.133:0/751839536 >> v2:172.21.15.178:3300/0 conn(0x7f61100c5330 0x7f6110153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc0033f0 con 0x7f6110157f30 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078478393 0 0) 0x7f60fc0033f0 con 0x7f6110157f30 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 msgr2=0x7f6110066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f6110066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 >> v2:172.21.15.178:3300/0 conn(0x7f61100c5330 msgr2=0x7f6110153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 --2- 172.21.15.133:0/751839536 >> v2:172.21.15.178:3300/0 conn(0x7f61100c5330 0x7f6110153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100c57c0 con 0x7f6110157f30 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f610c001470 con 0x7f6110157f30 2024-01-21T20:11:33.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 >> v1:172.21.15.133:6789/0 conn(0x7f6110157f30 legacy=0x7f61100bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60fc0038e0 0x7f60fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60fc004690 0x7f60fc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f60fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110158ed0 con 0x7f60fc0038e0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61101583b0 con 0x7f60fc004690 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc00b8e0 con 0x7f6110066b50 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6115884700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60fc0038e0 0x7f60fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.752+0000 7f6115083700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60fc004690 0x7f60fc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6116085700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f60fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 -- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 msgr2=0x7f60fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6110066b50 0x7f60fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 -- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60fc004690 msgr2=0x7f60fc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60fc004690 0x7f60fc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 -- 172.21.15.133:0/751839536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0033f0 con 0x7f60fc0038e0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6115884700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60fc0038e0 0x7f60fc003d00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f6100009a80 tx=0x7f6100009060).ready entity=mon.0 client_cookie=90d5f320d9448aa6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:33.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100009430 con 0x7f60fc0038e0 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000e640 con 0x7f60fc0038e0 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6114882700 1 -- 172.21.15.133:0/751839536 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000e9c0 con 0x7f60fc0038e0 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6117ae8700 1 -- 172.21.15.133:0/751839536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60fc0038e0 msgr2=0x7f60fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6117ae8700 1 --2- 172.21.15.133:0/751839536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60fc0038e0 0x7f60fc003d00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f6100009a80 tx=0x7f6100009060).stop 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6116085700 1 -- 172.21.15.133:0/751839536 reap_dead start 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6117ae8700 1 -- 172.21.15.133:0/751839536 shutdown_connections 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.753+0000 7f6117ae8700 1 -- 172.21.15.133:0/751839536 >> 172.21.15.133:0/751839536 conn(0x7f61100c8f60 msgr2=0x7f61100c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.754+0000 7f6117ae8700 1 -- 172.21.15.133:0/751839536 shutdown_connections 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.754+0000 7f6117ae8700 1 -- 172.21.15.133:0/751839536 wait complete. 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 Processor -- start 2024-01-21T20:11:33.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 -- start start 2024-01-21T20:11:33.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60fc0038e0 0x7f61100c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61100c8960 0x7f6110167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110168c70 con 0x7f6110168320 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c0420 con 0x7f61100c8960 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.755+0000 7f6117ae8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61100c0700 con 0x7f60fc0038e0 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56974/0 (socket says 172.21.15.133:56974) 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 -- 172.21.15.133:0/33017766 learned_addr learned my addr 172.21.15.133:0/33017766 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6115083700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61100c8960 0x7f6110167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6115884700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60fc0038e0 0x7f61100c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 -- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60fc0038e0 msgr2=0x7f61100c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60fc0038e0 0x7f61100c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 -- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61100c8960 msgr2=0x7f6110167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61100c8960 0x7f6110167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 -- 172.21.15.133:0/33017766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61100c09e0 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6116085700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f61100be5d0 tx=0x7f610800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800e040 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800f040 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61100c0cc0 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800fd70 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.756+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100c00a0 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.757+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61100c1160 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.757+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f6108015660 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.758+0000 7f6106777700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 0x7f60f4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.758+0000 7f6115884700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 0x7f60f4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.758+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7034+0+0 (secure 0 0 0) 0x7f610807b130 con 0x7f6110168320 2024-01-21T20:11:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.758+0000 7f6115884700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 0x7f60f4061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6100009a80 tx=0x7f610001a000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:33.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.762+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f610804bef0 con 0x7f6110168320 2024-01-21T20:11:33.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.948+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f611005fdf0 con 0x7f60f405f2c0 2024-01-21T20:11:33.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.951+0000 7f6106777700 1 -- 172.21.15.133:0/33017766 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f611005fdf0 con 0x7f60f405f2c0 2024-01-21T20:11:33.941 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir6 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 msgr2=0x7f60f4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 0x7f60f4061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6100009a80 tx=0x7f610001a000).stop 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 msgr2=0x7f6110168780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f61100be5d0 tx=0x7f610800b040).stop 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 shutdown_connections 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f60f405f2c0 0x7f60f4061780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6110168320 0x7f6110168780 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60fc0038e0 0x7f61100c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 --2- 172.21.15.133:0/33017766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61100c8960 0x7f6110167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 >> 172.21.15.133:0/33017766 conn(0x7f61100c8f60 msgr2=0x7f61100c4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 shutdown_connections 2024-01-21T20:11:33.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:33.953+0000 7f6117ae8700 1 -- 172.21.15.133:0/33017766 wait complete. 2024-01-21T20:11:33.954 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2024-01-21T20:11:33.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.954 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:33.973 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:33.974 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:33.974 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:33.974 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:33.974 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:33.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:33.974 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:34.039 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:34.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.039 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:34.144 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:34.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.144 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:34.174 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:34.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.174 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:34.237 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:34.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.237 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:34.300 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:34.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.300 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:34.364 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:34.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.364 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:34.428 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:34.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.428 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:34.492 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:34.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.492 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:34.555 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:34.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.555 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:34.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:34.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.618 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:34.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:34.681 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2024-01-21T20:11:34.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2024-01-21T20:11:34.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.912+0000 7fee883de700 1 Processor -- start 2024-01-21T20:11:34.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.912+0000 7fee883de700 1 -- start start 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee883de700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee801520e0 0x7fee801524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee883de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800aa5c0 con 0x7fee800c1600 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee883de700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee800c4910 con 0x7fee800aba60 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee883de700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee80066140 con 0x7fee801520e0 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee85979700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fee800c1600 0x7fee800bc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36004/0 (socket says 172.21.15.133:36004) 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee85979700 1 -- 172.21.15.133:0/1676300343 learned_addr learned my addr 172.21.15.133:0/1676300343 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954274582 0 0) 0x7fee800aa5c0 con 0x7fee800c1600 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee8617a700 1 --2- 172.21.15.133:0/1676300343 >> v2:172.21.15.178:3300/0 conn(0x7fee801520e0 0x7fee801524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.913+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee6c0033f0 con 0x7fee800c1600 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842567637 0 0) 0x7fee6c0033f0 con 0x7fee800c1600 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 >> v2:172.21.15.178:3300/0 conn(0x7fee801520e0 msgr2=0x7fee801524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 --2- 172.21.15.133:0/1676300343 >> v2:172.21.15.178:3300/0 conn(0x7fee801520e0 0x7fee801524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 >> v1:172.21.15.178:6789/0 conn(0x7fee800aba60 legacy=0x7fee800626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80069fa0 con 0x7fee800c1600 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fee7c001470 con 0x7fee800c1600 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 >> v1:172.21.15.133:6789/0 conn(0x7fee800c1600 legacy=0x7fee800bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 0x7fee6c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c004690 0x7fee6c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c005000 0x7fee6c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80066140 con 0x7fee6c0038e0 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00bf60 con 0x7fee6c005000 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c00c0f0 con 0x7fee6c004690 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 0x7fee6c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85979700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c004690 0x7fee6c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8697b700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c005000 0x7fee6c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 -- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c004690 msgr2=0x7fee6c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c004690 0x7fee6c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 -- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c005000 msgr2=0x7fee6c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c005000 0x7fee6c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 -- 172.21.15.133:0/1676300343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0033f0 con 0x7fee6c0038e0 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8697b700 1 -- 172.21.15.133:0/1676300343 reap_dead start 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee8617a700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 0x7fee6c003d00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fee70006fd0 tx=0x7fee70006f40).ready entity=mon.0 client_cookie=c30aa766d4c37e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70009430 con 0x7fee6c0038e0 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000e640 con 0x7fee6c0038e0 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.914+0000 7fee85178700 1 -- 172.21.15.133:0/1676300343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000e9c0 con 0x7fee6c0038e0 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 -- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 msgr2=0x7fee6c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 0x7fee6c003d00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fee70006fd0 tx=0x7fee70006f40).stop 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 -- 172.21.15.133:0/1676300343 shutdown_connections 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 --2- 172.21.15.133:0/1676300343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee6c0038e0 0x7fee6c003d00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 -- 172.21.15.133:0/1676300343 >> 172.21.15.133:0/1676300343 conn(0x7fee800c7f00 msgr2=0x7fee800c3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 -- 172.21.15.133:0/1676300343 shutdown_connections 2024-01-21T20:11:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.915+0000 7fee883de700 1 -- 172.21.15.133:0/1676300343 wait complete. 2024-01-21T20:11:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.917+0000 7fee883de700 1 Processor -- start 2024-01-21T20:11:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.917+0000 7fee883de700 1 -- start start 2024-01-21T20:11:34.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c0038e0 0x7fee8014a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80157470 0x7fee801578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee80158e90 con 0x7fee80158120 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee800bf4c0 con 0x7fee6c0038e0 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee800beb90 con 0x7fee80157470 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56990/0 (socket says 172.21.15.133:56990) 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 -- 172.21.15.133:0/1028478158 learned_addr learned my addr 172.21.15.133:0/1028478158 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8617a700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c0038e0 0x7fee8014a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee85979700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80157470 0x7fee801578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 -- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80157470 msgr2=0x7fee801578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80157470 0x7fee801578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 -- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c0038e0 msgr2=0x7fee8014a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c0038e0 0x7fee8014a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 -- 172.21.15.133:0/1028478158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee800bee70 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee8697b700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fee8005e760 tx=0x7fee78007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78006c30 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee78006d90 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee800bf150 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee78007260 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.918+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee80158a90 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.919+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8005fdf0 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.920+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fee78007650 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.920+0000 7fee76ffd700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 0x7fee64061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.920+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7098+0+0 (secure 0 0 0) 0x7fee78079c80 con 0x7fee80158120 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.920+0000 7fee8617a700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 0x7fee64061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:34.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.920+0000 7fee8617a700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 0x7fee64061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fee70006fa0 tx=0x7fee7001a000).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:34.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:34.924+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee7804aab0 con 0x7fee80158120 2024-01-21T20:11:35.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.120+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fee801511b0 con 0x7fee6405f2c0 2024-01-21T20:11:35.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.123+0000 7fee76ffd700 1 -- 172.21.15.133:0/1028478158 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fee801511b0 con 0x7fee6405f2c0 2024-01-21T20:11:35.113 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir7 2024-01-21T20:11:35.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 msgr2=0x7fee64061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:35.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 0x7fee64061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fee70006fa0 tx=0x7fee7001a000).stop 2024-01-21T20:11:35.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 msgr2=0x7fee801585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:35.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fee8005e760 tx=0x7fee78007f30).stop 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 shutdown_connections 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee6405f2c0 0x7fee64061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee80158120 0x7fee801585a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c0038e0 0x7fee8014a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 --2- 172.21.15.133:0/1028478158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee80157470 0x7fee801578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.125+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 >> 172.21.15.133:0/1028478158 conn(0x7fee800c7f00 msgr2=0x7fee80064c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.126+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 shutdown_connections 2024-01-21T20:11:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:35.126+0000 7fee883de700 1 -- 172.21.15.133:0/1028478158 wait complete. 2024-01-21T20:11:35.127 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2024-01-21T20:11:35.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.128 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-01-21T20:11:35.145 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:35.145 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:35.146 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:35.147 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:35.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.147 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:35.224 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:35.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.225 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:35.288 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:35.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.289 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:35.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:35.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.352 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:35.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:35.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.416 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:35.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:35.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.480 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:35.547 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:35.548 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.548 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:35.611 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:35.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.611 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:35.675 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:35.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.675 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:35.739 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:35.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.740 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:35.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:35.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.804 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:35.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:35.868 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2024-01-21T20:11:35.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2024-01-21T20:11:36.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.109+0000 7f7cf828e700 1 Processor -- start 2024-01-21T20:11:36.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.109+0000 7f7cf828e700 1 -- start start 2024-01-21T20:11:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf828e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 0x7f7cf0066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf828e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7cf0157f30 0x7f7cf00c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf828e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf00c37c0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf828e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf0158ed0 con 0x7f7cf0157f30 2024-01-21T20:11:36.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf828e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf00c5820 con 0x7f7cf0066b50 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7cf0157f30 0x7f7cf00c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf682b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7cf00bdec0 0x7f7cf0153e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36020/0 (socket says 172.21.15.133:36020) 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf682b700 1 -- 172.21.15.133:0/37687042 learned_addr learned my addr 172.21.15.133:0/37687042 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf602a700 1 --2- 172.21.15.133:0/37687042 >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 0x7f7cf0066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 -- 172.21.15.133:0/37687042 >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 msgr2=0x7f7cf0066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 --2- 172.21.15.133:0/37687042 >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 0x7f7cf0066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5028700 1 -- 172.21.15.133:0/37687042 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132867055 0 0) 0x7f7cf00c37c0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 -- 172.21.15.133:0/37687042 >> v1:172.21.15.133:6789/0 conn(0x7f7cf00bdec0 legacy=0x7f7cf0153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 -- 172.21.15.133:0/37687042 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf01583b0 con 0x7f7cf0157f30 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf602a700 1 --2- 172.21.15.133:0/37687042 >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 0x7f7cf0066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:36.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5829700 1 --2- 172.21.15.133:0/37687042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf0157f30 0x7f7cf00c5330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f7cf00c6a70 tx=0x7f7ce0009060).ready entity=mon.0 client_cookie=807790a251950425 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5028700 1 -- 172.21.15.133:0/37687042 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00090d0 con 0x7f7cf0157f30 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5028700 1 -- 172.21.15.133:0/37687042 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce000b520 con 0x7f7cf0157f30 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.110+0000 7f7cf5028700 1 -- 172.21.15.133:0/37687042 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000b8a0 con 0x7f7cf0157f30 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 -- 172.21.15.133:0/37687042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf0157f30 msgr2=0x7f7cf00c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 --2- 172.21.15.133:0/37687042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf0157f30 0x7f7cf00c5330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f7cf00c6a70 tx=0x7f7ce0009060).stop 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 -- 172.21.15.133:0/37687042 shutdown_connections 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 --2- 172.21.15.133:0/37687042 >> v2:172.21.15.178:3300/0 conn(0x7f7cf0066b50 0x7f7cf0066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 --2- 172.21.15.133:0/37687042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf0157f30 0x7f7cf00c5330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 -- 172.21.15.133:0/37687042 >> 172.21.15.133:0/37687042 conn(0x7f7cf00c8f60 msgr2=0x7f7cf00c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 -- 172.21.15.133:0/37687042 shutdown_connections 2024-01-21T20:11:36.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.111+0000 7f7cf828e700 1 -- 172.21.15.133:0/37687042 wait complete. 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.113+0000 7f7cf828e700 1 Processor -- start 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.113+0000 7f7cf828e700 1 -- start start 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cf0066b50 0x7f7cf013c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cf0157f30 0x7f7cf0165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf013c710 con 0x7f7cf00bdec0 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0166010 con 0x7f7cf0066b50 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01662f0 con 0x7f7cf0157f30 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57002/0 (socket says 172.21.15.133:57002) 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 -- 172.21.15.133:0/3693262045 learned_addr learned my addr 172.21.15.133:0/3693262045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:36.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf602a700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cf0066b50 0x7f7cf013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf682b700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cf0157f30 0x7f7cf0165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 -- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cf0157f30 msgr2=0x7f7cf0165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cf0157f30 0x7f7cf0165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 -- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cf0066b50 msgr2=0x7f7cf013c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cf0066b50 0x7f7cf013c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 -- 172.21.15.133:0/3693262045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00092a0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf5829700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f7ce0009eb0 tx=0x7f7ce0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0011a40 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce0011ba0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.114+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf01665d0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.115+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce001b440 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.115+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf0166b90 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.116+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf0166d80 con 0x7f7cf00bdec0 2024-01-21T20:11:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.116+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7ce001b830 con 0x7f7cf00bdec0 2024-01-21T20:11:36.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.116+0000 7f7ce6f78700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 0x7f7cd4061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:36.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.117+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7066+0+0 (secure 0 0 0) 0x7f7ce007bfc0 con 0x7f7cf00bdec0 2024-01-21T20:11:36.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.117+0000 7f7cf602a700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 0x7f7cd4061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:36.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.117+0000 7f7cf602a700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 0x7f7cd4061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7cec00abd0 tx=0x7f7cec008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.121+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ce004cd60 con 0x7f7cf00bdec0 2024-01-21T20:11:36.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.346+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cf0158630 con 0x7f7cd405f2c0 2024-01-21T20:11:36.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.351+0000 7f7ce6f78700 1 -- 172.21.15.133:0/3693262045 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7cf0158630 con 0x7f7cd405f2c0 2024-01-21T20:11:36.340 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir8 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 msgr2=0x7f7cd4061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 0x7f7cd4061780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f7cec00abd0 tx=0x7f7cec008040).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 msgr2=0x7f7cf01670b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f7ce0009eb0 tx=0x7f7ce0017000).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 shutdown_connections 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7cd405f2c0 0x7f7cd4061780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cf0157f30 0x7f7cf0165550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cf0066b50 0x7f7cf013c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 --2- 172.21.15.133:0/3693262045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf00bdec0 0x7f7cf01670b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 >> 172.21.15.133:0/3693262045 conn(0x7f7cf00c8f60 msgr2=0x7f7cf00aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 shutdown_connections 2024-01-21T20:11:36.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:36.353+0000 7f7cf828e700 1 -- 172.21.15.133:0/3693262045 wait complete. 2024-01-21T20:11:36.354 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2024-01-21T20:11:36.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.354 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:36.373 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:36.374 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:36.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.374 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:36.438 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:36.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.438 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:36.501 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:36.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.501 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:36.564 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:36.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.564 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:36.627 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:36.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.627 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:36.690 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:36.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.690 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:36.752 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:36.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.753 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:36.814 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:36.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.815 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:36.876 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:36.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.877 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:36.938 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:36.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:36.939 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:37.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:37.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.001 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:37.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.064 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2024-01-21T20:11:37.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2024-01-21T20:11:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.297+0000 7f717c0a6700 1 Processor -- start 2024-01-21T20:11:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 -- start start 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174154250 0x7f7174154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7174069510 0x7f71740626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717406a4b0 con 0x7f7174069970 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7174069ef0 con 0x7f7174069510 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.298+0000 7f717c0a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717406a1d0 con 0x7f7174154250 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7174069510 0x7f71740626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f717a643700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7174069970 0x7f71741580c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36030/0 (socket says 172.21.15.133:36030) 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f717a643700 1 -- 172.21.15.133:0/650067132 learned_addr learned my addr 172.21.15.133:0/650067132 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7174069510 0x7f71740626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57010/0 (socket says 172.21.15.133:57010) 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179e42700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174154250 0x7f7174154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 -- 172.21.15.133:0/650067132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174154250 msgr2=0x7f7174154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174154250 0x7f7174154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 -- 172.21.15.133:0/650067132 >> v1:172.21.15.133:6789/0 conn(0x7f7174069970 legacy=0x7f71741580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 -- 172.21.15.133:0/650067132 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174065720 con 0x7f7174069510 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7178e40700 1 -- 172.21.15.133:0/650067132 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435679811 0 0) 0x7f717406a4b0 con 0x7f7174069970 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7179641700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069510 0x7f71740626f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7170009760 tx=0x7f7170009060).ready entity=mon.0 client_cookie=33f3a729b2f988bb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7178e40700 1 -- 172.21.15.133:0/650067132 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000b580 con 0x7f7174069510 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7178e40700 1 -- 172.21.15.133:0/650067132 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000b6e0 con 0x7f7174069510 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.299+0000 7f7178e40700 1 -- 172.21.15.133:0/650067132 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000ba60 con 0x7f7174069510 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 -- 172.21.15.133:0/650067132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069510 msgr2=0x7f71740626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069510 0x7f71740626f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7170009760 tx=0x7f7170009060).stop 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 -- 172.21.15.133:0/650067132 shutdown_connections 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174154250 0x7f7174154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 --2- 172.21.15.133:0/650067132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069510 0x7f71740626f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 -- 172.21.15.133:0/650067132 >> 172.21.15.133:0/650067132 conn(0x7f71740c7d30 msgr2=0x7f71740c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:37.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 -- 172.21.15.133:0/650067132 shutdown_connections 2024-01-21T20:11:37.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.300+0000 7f717c0a6700 1 -- 172.21.15.133:0/650067132 wait complete. 2024-01-21T20:11:37.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.301+0000 7f717c0a6700 1 Processor -- start 2024-01-21T20:11:37.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.301+0000 7f717c0a6700 1 -- start start 2024-01-21T20:11:37.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174069510 0x7f717414b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 0x7f71741528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740a89b0 con 0x7f7174069970 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71740ab760 con 0x7f7174154250 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740aae30 con 0x7f7174069510 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57020/0 (socket says 172.21.15.133:57020) 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 -- 172.21.15.133:0/4177359468 learned_addr learned my addr 172.21.15.133:0/4177359468 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179e42700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174069510 0x7f717414b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717a643700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 0x7f71741528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 -- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174069510 msgr2=0x7f717414b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174069510 0x7f717414b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 -- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 msgr2=0x7f71741528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 0x7f71741528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 -- 172.21.15.133:0/4177359468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700092a0 con 0x7f7174069970 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717a643700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 0x7f71741528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:37.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f7179641700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f7170011000 tx=0x7f7170017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000b850 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000b9b0 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71740ab110 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717001b690 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.302+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71740a85a0 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.303+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717405fdf0 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.303+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f717001bac0 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.304+0000 7f716a7fc700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 0x7f7158061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.304+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f717007c0c0 con 0x7f7174069970 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.304+0000 7f7179e42700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 0x7f7158061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.304+0000 7f7179e42700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 0x7f7158061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7174153620 tx=0x7f7164008040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.308+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f717004ce30 con 0x7f7174069970 2024-01-21T20:11:37.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.523+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7174065a00 con 0x7f715805f2c0 2024-01-21T20:11:37.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.528+0000 7f716a7fc700 1 -- 172.21.15.133:0/4177359468 <== mgr.5217 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7174065a00 con 0x7f715805f2c0 2024-01-21T20:11:37.518 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/dir9 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 msgr2=0x7f7158061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 0x7f7158061780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f7174153620 tx=0x7f7164008040).stop 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 msgr2=0x7f71740a80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f7170011000 tx=0x7f7170017000).stop 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 shutdown_connections 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f715805f2c0 0x7f7158061780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7174154250 0x7f71741528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7174069510 0x7f717414b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 --2- 172.21.15.133:0/4177359468 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7174069970 0x7f71740a80b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 >> 172.21.15.133:0/4177359468 conn(0x7f71740c7d30 msgr2=0x7f71740a6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 shutdown_connections 2024-01-21T20:11:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:37.533+0000 7f717c0a6700 1 -- 172.21.15.133:0/4177359468 wait complete. 2024-01-21T20:11:37.539 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2024-01-21T20:11:37.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.539 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-01-21T20:11:37.557 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:37.557 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:37.557 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:37.558 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_01_00_UTC 2024-01-21T20:11:37.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.558 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_01_00_UTC) 2024-01-21T20:11:37.626 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_02_00_UTC 2024-01-21T20:11:37.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.627 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_02_00_UTC) 2024-01-21T20:11:37.690 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_03_00_UTC 2024-01-21T20:11:37.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.691 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_03_00_UTC) 2024-01-21T20:11:37.754 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_04_00_UTC 2024-01-21T20:11:37.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.754 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_04_00_UTC) 2024-01-21T20:11:37.818 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_05_00_UTC 2024-01-21T20:11:37.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.818 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_05_00_UTC) 2024-01-21T20:11:37.881 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_06_00_UTC 2024-01-21T20:11:37.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.881 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_06_00_UTC) 2024-01-21T20:11:37.944 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_07_00_UTC 2024-01-21T20:11:37.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:37.945 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_07_00_UTC) 2024-01-21T20:11:38.007 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_08_00_UTC 2024-01-21T20:11:38.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:38.008 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_08_00_UTC) 2024-01-21T20:11:38.071 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_09_00_UTC 2024-01-21T20:11:38.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:38.072 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_09_00_UTC) 2024-01-21T20:11:38.143 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_10_00_UTC 2024-01-21T20:11:38.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:38.144 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_10_00_UTC) 2024-01-21T20:11:38.206 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_11_00_UTC 2024-01-21T20:11:38.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:38.206 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-01-21-20_11_00_UTC) 2024-01-21T20:11:38.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:38.269 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2024-01-21T20:11:38.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:11:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.507+0000 7fe0373af700 1 Processor -- start 2024-01-21T20:11:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 -- start start 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe0300a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0300bc6d0 0x7fe030066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0300654f0 con 0x7fe0301546b0 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe030063700 con 0x7fe0300bc6d0 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.508+0000 7fe0373af700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe030063950 con 0x7fe030154a90 2024-01-21T20:11:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03514b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe0301546b0 0x7fe030065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36034/0 (socket says 172.21.15.133:36034) 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03514b700 1 -- 172.21.15.133:0/4101728871 learned_addr learned my addr 172.21.15.133:0/4101728871 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 --2- 172.21.15.133:0/4101728871 >> v2:172.21.15.133:3300/0 conn(0x7fe0300bc6d0 0x7fe030066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe027fff700 1 -- 172.21.15.133:0/4101728871 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679700731 0 0) 0x7fe0300654f0 con 0x7fe0301546b0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe027fff700 1 -- 172.21.15.133:0/4101728871 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe01c0033f0 con 0x7fe0301546b0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03494a700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe0300a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 -- 172.21.15.133:0/4101728871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 msgr2=0x7fe0300a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe0300a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 -- 172.21.15.133:0/4101728871 >> v1:172.21.15.133:6789/0 conn(0x7fe0301546b0 legacy=0x7fe030065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 -- 172.21.15.133:0/4101728871 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030065180 con 0x7fe0300bc6d0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe03594c700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0300bc6d0 0x7fe030066090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fe028009e60 tx=0x7fe028009780).ready entity=mon.0 client_cookie=333bb387dc21352a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe027fff700 1 -- 172.21.15.133:0/4101728871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02800e070 con 0x7fe0300bc6d0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe027fff700 1 -- 172.21.15.133:0/4101728871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02800bb60 con 0x7fe0300bc6d0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.509+0000 7fe027fff700 1 -- 172.21.15.133:0/4101728871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe028012410 con 0x7fe0300bc6d0 2024-01-21T20:11:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 -- 172.21.15.133:0/4101728871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0300bc6d0 msgr2=0x7fe030066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0300bc6d0 0x7fe030066090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7fe028009e60 tx=0x7fe028009780).stop 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 -- 172.21.15.133:0/4101728871 shutdown_connections 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0300bc6d0 0x7fe030066090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 --2- 172.21.15.133:0/4101728871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe0300a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 -- 172.21.15.133:0/4101728871 >> 172.21.15.133:0/4101728871 conn(0x7fe0300c8200 msgr2=0x7fe0300c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 -- 172.21.15.133:0/4101728871 shutdown_connections 2024-01-21T20:11:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.510+0000 7fe0373af700 1 -- 172.21.15.133:0/4101728871 wait complete. 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.511+0000 7fe0373af700 1 Processor -- start 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.511+0000 7fe0373af700 1 -- start start 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0300bc6d0 0x7fe0300c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe03014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03014f580 con 0x7fe0301546b0 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300aa720 con 0x7fe0300bc6d0 2024-01-21T20:11:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0300c1920 con 0x7fe030154a90 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57036/0 (socket says 172.21.15.133:57036) 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 -- 172.21.15.133:0/2279255433 learned_addr learned my addr 172.21.15.133:0/2279255433 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03594c700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe03014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03514b700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0300bc6d0 0x7fe0300c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 -- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 msgr2=0x7fe03014e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe03014e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 -- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0300bc6d0 msgr2=0x7fe0300c1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0300bc6d0 0x7fe0300c1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 -- 172.21.15.133:0/2279255433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe028009a20 con 0x7fe0301546b0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe03494a700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fe02000d890 tx=0x7fe020008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000f520 con 0x7fe0301546b0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000f680 con 0x7fe0301546b0 2024-01-21T20:11:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe030168680 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.512+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000fa00 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.513+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe030168c40 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.514+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 10) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fe020013480 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.514+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0300aa890 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.514+0000 7fe025ffb700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 0x7fe014061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.514+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6746+0+0 (secure 0 0 0) 0x7fe02007a200 con 0x7fe0301546b0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.514+0000 7fe03514b700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 0x7fe014061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:38.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.515+0000 7fe03514b700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 0x7fe014061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe030067030 tx=0x7fe02c009040).ready entity=mgr.5217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.518+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe02004eab0 con 0x7fe0301546b0 2024-01-21T20:11:38.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:38.750+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe0300c4c80 con 0x7fe0301546b0 2024-01-21T20:11:39.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.088+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe020077be0 con 0x7fe0301546b0 2024-01-21T20:11:39.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.090+0000 7fe025ffb700 1 -- 172.21.15.133:0/2279255433 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v11) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe020071f20 con 0x7fe0301546b0 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 msgr2=0x7fe014061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 0x7fe014061780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe030067030 tx=0x7fe02c009040).stop 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 msgr2=0x7fe0300ab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fe02000d890 tx=0x7fe020008040).stop 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 shutdown_connections 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe01405f2c0 0x7fe014061780 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe030154a90 0x7fe03014e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0300bc6d0 0x7fe0300c1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 --2- 172.21.15.133:0/2279255433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0301546b0 0x7fe0300ab920 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 >> 172.21.15.133:0/2279255433 conn(0x7fe0300c8200 msgr2=0x7fe0300694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:39.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 shutdown_connections 2024-01-21T20:11:39.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.092+0000 7fe0373af700 1 -- 172.21.15.133:0/2279255433 wait complete. 2024-01-21T20:11:39.094 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:11:39.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:11:39.137 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:11:39.185 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:11:39.185 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:11:39.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:11:39.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:11:39.224 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:39.234+0000 7f5446e99680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:11:39.231 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:39.241+0000 7f26338a5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:11:39.233 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:11:39.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:11:39.233 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:11:39.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:39.293 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:39.304+0000 7f5446e99680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:11:39.304 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:39.314+0000 7f26338a5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:11:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.424+0000 7f80347d9700 1 Processor -- start 2024-01-21T20:11:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.424+0000 7f80347d9700 1 -- start start 2024-01-21T20:11:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f80347d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f80347d9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f80347d9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c065000 con 0x7f802c065490 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f80347d9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c065d50 con 0x7f802c0658d0 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f80347d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c069540 con 0x7f802c0bc8a0 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f8032575700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f8032d76700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f8032575700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:36904/0 (socket says 172.21.15.133:36904) 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f8032575700 1 -- 172.21.15.133:0/1686086362 learned_addr learned my addr 172.21.15.133:0/1686086362 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.425+0000 7f8032d76700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:49028/0 (socket says 172.21.15.133:49028) 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032575700 1 -- 172.21.15.133:0/1686086362 >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 msgr2=0x7f802c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032575700 1 --2- 172.21.15.133:0/1686086362 >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032575700 1 -- 172.21.15.133:0/1686086362 >> v1:172.21.15.178:6789/0 conn(0x7f802c065490 legacy=0x7f802c0a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032575700 1 -- 172.21.15.133:0/1686086362 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c064410 con 0x7f802c0bc8a0 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032d76700 1 --2- 172.21.15.133:0/1686086362 >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8032575700 1 --2- 172.21.15.133:0/1686086362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8028006fd0 tx=0x7f80280090f0).ready entity=mon.2 client_cookie=1736d0e9c2c07b1b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8031573700 1 -- 172.21.15.133:0/1686086362 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800b580 con 0x7f802c0bc8a0 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8031573700 1 -- 172.21.15.133:0/1686086362 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800b6e0 con 0x7f802c0bc8a0 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f8031573700 1 -- 172.21.15.133:0/1686086362 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800ba80 con 0x7f802c0bc8a0 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f80347d9700 1 -- 172.21.15.133:0/1686086362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 msgr2=0x7f802c0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f80347d9700 1 --2- 172.21.15.133:0/1686086362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8028006fd0 tx=0x7f80280090f0).stop 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f80347d9700 1 -- 172.21.15.133:0/1686086362 shutdown_connections 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f80347d9700 1 --2- 172.21.15.133:0/1686086362 >> v2:172.21.15.178:3300/0 conn(0x7f802c0658d0 0x7f802c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.426+0000 7f80347d9700 1 --2- 172.21.15.133:0/1686086362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0bcc80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.427+0000 7f80347d9700 1 -- 172.21.15.133:0/1686086362 >> 172.21.15.133:0/1686086362 conn(0x7f802c0c6ef0 msgr2=0x7f802c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.427+0000 7f80347d9700 1 -- 172.21.15.133:0/1686086362 shutdown_connections 2024-01-21T20:11:39.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.427+0000 7f80347d9700 1 -- 172.21.15.133:0/1686086362 wait complete. 2024-01-21T20:11:39.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 Processor -- start 2024-01-21T20:11:39.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 -- start start 2024-01-21T20:11:39.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f802c0658d0 0x7f802c139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c150860 con 0x7f802c065490 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c152790 con 0x7f802c0658d0 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.428+0000 7f80347d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0a6b40 con 0x7f802c0bc8a0 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57052/0 (socket says 172.21.15.133:57052) 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 -- 172.21.15.133:0/3212641745 learned_addr learned my addr 172.21.15.133:0/3212641745 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8031d74700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f802c0658d0 0x7f802c139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032d76700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 msgr2=0x7f802c0a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f802c0658d0 msgr2=0x7f802c139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f802c0658d0 0x7f802c139780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 -- 172.21.15.133:0/3212641745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009a20 con 0x7f802c065490 2024-01-21T20:11:39.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032d76700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8032575700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8028009ea0 tx=0x7f8028017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028006950 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800be40 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8028009370 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802801d430 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.429+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c0a7100 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.430+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f802801d820 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.431+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c05fdf0 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.431+0000 7f8022ffd700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 0x7f8010061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.431+0000 7f8031d74700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 msgr2=0x7f8010061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.431+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7638+0+0 (secure 0 0 0) 0x7f802807c430 con 0x7f802c065490 2024-01-21T20:11:39.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.431+0000 7f8031d74700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 0x7f8010061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:39.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.435+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f802804cf90 con 0x7f802c065490 2024-01-21T20:11:39.605 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:39.615+0000 7f26338a5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:11:39.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.632+0000 7f8031d74700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 msgr2=0x7f8010061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:39.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.632+0000 7f8031d74700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 0x7f8010061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:39.663 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:39.673+0000 7f5446e99680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:11:39.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.751+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f802c0bd9b0 con 0x7f802c065490 2024-01-21T20:11:39.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.752+0000 7f8022ffd700 1 -- 172.21.15.133:0/3212641745 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7f8028021090 con 0x7f802c065490 2024-01-21T20:11:39.741 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:39.742 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 msgr2=0x7f8010061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 0x7f8010061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 msgr2=0x7f802c150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8028009ea0 tx=0x7f8028017000).stop 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 shutdown_connections 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f801005f270 0x7f8010061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f802c0bc8a0 0x7f802c0a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c065490 0x7f802c150370 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 --2- 172.21.15.133:0/3212641745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f802c0658d0 0x7f802c139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 >> 172.21.15.133:0/3212641745 conn(0x7f802c0c6ef0 msgr2=0x7f802c0aa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 shutdown_connections 2024-01-21T20:11:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.754+0000 7f80347d9700 1 -- 172.21.15.133:0/3212641745 wait complete. 2024-01-21T20:11:39.745 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T20:11:39.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:39.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.886+0000 7f9a5919b700 1 Processor -- start 2024-01-21T20:11:39.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.886+0000 7f9a5919b700 1 -- start start 2024-01-21T20:11:39.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5919b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 0x7f9a54137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5919b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a540c5930 0x7f9a540c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5919b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a540c62b0 con 0x7f9a54137030 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5919b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a54068370 con 0x7f9a540c5930 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5919b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a54068650 con 0x7f9a54067d90 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a52d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9a54137030 0x7f9a54155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36058/0 (socket says 172.21.15.133:36058) 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a52d9d700 1 -- 172.21.15.133:0/277313044 learned_addr learned my addr 172.21.15.133:0/277313044 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5259c700 1 --2- 172.21.15.133:0/277313044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 0x7f9a54137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a5359e700 1 --2- 172.21.15.133:0/277313044 >> v2:172.21.15.178:3300/0 conn(0x7f9a540c5930 0x7f9a540c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a51d9b700 1 -- 172.21.15.133:0/277313044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992594852 0 0) 0x7f9a540c62b0 con 0x7f9a54137030 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.887+0000 7f9a51d9b700 1 -- 172.21.15.133:0/277313044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a3c0033f0 con 0x7f9a54137030 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5259c700 1 -- 172.21.15.133:0/277313044 >> v2:172.21.15.178:3300/0 conn(0x7f9a540c5930 msgr2=0x7f9a540c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5259c700 1 --2- 172.21.15.133:0/277313044 >> v2:172.21.15.178:3300/0 conn(0x7f9a540c5930 0x7f9a540c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5259c700 1 -- 172.21.15.133:0/277313044 >> v1:172.21.15.133:6789/0 conn(0x7f9a54137030 legacy=0x7f9a54155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5259c700 1 -- 172.21.15.133:0/277313044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54068930 con 0x7f9a54067d90 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5259c700 1 --2- 172.21.15.133:0/277313044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 0x7f9a54137410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9a48009760 tx=0x7f9a48009060).ready entity=mon.2 client_cookie=67201d0ebe2883b7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a51d9b700 1 -- 172.21.15.133:0/277313044 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a480090d0 con 0x7f9a54067d90 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a51d9b700 1 -- 172.21.15.133:0/277313044 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800d4a0 con 0x7f9a54067d90 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a51d9b700 1 -- 172.21.15.133:0/277313044 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800d820 con 0x7f9a54067d90 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 -- 172.21.15.133:0/277313044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 msgr2=0x7f9a54137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 --2- 172.21.15.133:0/277313044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 0x7f9a54137410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9a48009760 tx=0x7f9a48009060).stop 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 -- 172.21.15.133:0/277313044 shutdown_connections 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 --2- 172.21.15.133:0/277313044 >> v2:172.21.15.178:3300/0 conn(0x7f9a540c5930 0x7f9a540c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 --2- 172.21.15.133:0/277313044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a54067d90 0x7f9a54137410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.888+0000 7f9a5919b700 1 -- 172.21.15.133:0/277313044 >> 172.21.15.133:0/277313044 conn(0x7f9a54066a90 msgr2=0x7f9a54066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.889+0000 7f9a5919b700 1 -- 172.21.15.133:0/277313044 shutdown_connections 2024-01-21T20:11:39.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.889+0000 7f9a5919b700 1 -- 172.21.15.133:0/277313044 wait complete. 2024-01-21T20:11:39.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.890+0000 7f9a5919b700 1 Processor -- start 2024-01-21T20:11:39.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.890+0000 7f9a5919b700 1 -- start start 2024-01-21T20:11:39.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 0x7f9a540acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a54137030 0x7f9a541383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540abf60 con 0x7f9a54067d90 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540ac1b0 con 0x7f9a54137030 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5919b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540ac490 con 0x7f9a540c5930 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a52d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a52d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:57056/0 (socket says 172.21.15.133:57056) 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a52d9d700 1 -- 172.21.15.133:0/3016038151 learned_addr learned my addr 172.21.15.133:0/3016038151 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 0x7f9a540acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5359e700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a54137030 0x7f9a541383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 -- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a54137030 msgr2=0x7f9a541383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a54137030 0x7f9a541383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 -- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 msgr2=0x7f9a541368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a5259c700 1 -- 172.21.15.133:0/3016038151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a480092a0 con 0x7f9a540c5930 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.891+0000 7f9a52d9d700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:39.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a5259c700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 0x7f9a540acf70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9a48013000 tx=0x7f9a48016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48006990 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a480127f0 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a48012b70 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a540ac770 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.892+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a54136dc0 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.893+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9a48026460 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.893+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a540acc10 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.893+0000 7f9a3b7fe700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 0x7f9a40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.893+0000 7f9a52d9d700 1 -- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 msgr2=0x7f9a40061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.894+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7638+0+0 (secure 0 0 0) 0x7f9a4807bcf0 con 0x7f9a540c5930 2024-01-21T20:11:39.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.894+0000 7f9a52d9d700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 0x7f9a40061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:39.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:39.898+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a4804c730 con 0x7f9a540c5930 2024-01-21T20:11:40.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.074+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a5405fdf0 con 0x7f9a540c5930 2024-01-21T20:11:40.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.076+0000 7f9a3b7fe700 1 -- 172.21.15.133:0/3016038151 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18206 (secure 0 0 0) 0x7f9a4804fd50 con 0x7f9a540c5930 2024-01-21T20:11:40.066 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:40.066 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:40.025544+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2594876400":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6832/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6833/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:0/3194509186":"2024-01-22T20:00:11.136676+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":105,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 msgr2=0x7f9a40061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 0x7f9a40061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 msgr2=0x7f9a540acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 0x7f9a540acf70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9a48013000 tx=0x7f9a48016000).stop 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 shutdown_connections 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a4005f270 0x7f9a40061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a54137030 0x7f9a541383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a54067d90 0x7f9a541368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 --2- 172.21.15.133:0/3016038151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a540c5930 0x7f9a540acf70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 >> 172.21.15.133:0/3016038151 conn(0x7f9a54066a90 msgr2=0x7f9a540c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 shutdown_connections 2024-01-21T20:11:40.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.079+0000 7f9a5919b700 1 -- 172.21.15.133:0/3016038151 wait complete. 2024-01-21T20:11:40.086 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T19:59:53.523734+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T19:59:54.693354+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 221, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:11:40.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:11:40.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.233+0000 7fc4bb977700 1 Processor -- start 2024-01-21T20:11:40.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.233+0000 7fc4bb977700 1 -- start start 2024-01-21T20:11:40.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4bb977700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4b4154140 0x7fc4b4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4bb977700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b40c0e40 con 0x7fc4b4154520 2024-01-21T20:11:40.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4bb977700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b41549b0 con 0x7fc4b40c8120 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4bb977700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b40c6ae0 con 0x7fc4b4154140 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b8f12700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4b4154520 0x7fc4b40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36068/0 (socket says 172.21.15.133:36068) 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b8f12700 1 -- 172.21.15.133:0/1190257492 learned_addr learned my addr 172.21.15.133:0/1190257492 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b9713700 1 --2- 172.21.15.133:0/1190257492 >> v2:172.21.15.178:3300/0 conn(0x7fc4b4154140 0x7fc4b4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284225619 0 0) 0x7fc4b40c0e40 con 0x7fc4b4154520 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a00033f0 con 0x7fc4b4154520 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860777520 0 0) 0x7fc4b41549b0 con 0x7fc4b40c8120 2024-01-21T20:11:40.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b40c0e40 con 0x7fc4b40c8120 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b9713700 1 -- 172.21.15.133:0/1190257492 >> v1:172.21.15.178:6789/0 conn(0x7fc4b40c8120 legacy=0x7fc4b40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b9713700 1 -- 172.21.15.133:0/1190257492 >> v1:172.21.15.133:6789/0 conn(0x7fc4b4154520 legacy=0x7fc4b40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1798656864 0 0) 0x7fc4a00033f0 con 0x7fc4b4154520 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.235+0000 7fc4b9713700 1 -- 172.21.15.133:0/1190257492 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40c6800 con 0x7fc4b4154140 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.236+0000 7fc4b9713700 1 --2- 172.21.15.133:0/1190257492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154140 0x7fc4b4158bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc4b0009790 tx=0x7fc4b0009060).ready entity=mon.1 client_cookie=3fcf50b6083b7d02 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.236+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4001470 con 0x7fc4b4154140 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.236+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0011400 con 0x7fc4b4154140 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.236+0000 7fc4abfff700 1 -- 172.21.15.133:0/1190257492 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0011780 con 0x7fc4b4154140 2024-01-21T20:11:40.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 -- 172.21.15.133:0/1190257492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154140 msgr2=0x7fc4b4158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 --2- 172.21.15.133:0/1190257492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154140 0x7fc4b4158bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fc4b0009790 tx=0x7fc4b0009060).stop 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 -- 172.21.15.133:0/1190257492 shutdown_connections 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 --2- 172.21.15.133:0/1190257492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154140 0x7fc4b4158bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 -- 172.21.15.133:0/1190257492 >> 172.21.15.133:0/1190257492 conn(0x7fc4b405e1e0 msgr2=0x7fc4b405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 -- 172.21.15.133:0/1190257492 shutdown_connections 2024-01-21T20:11:40.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.237+0000 7fc4bb977700 1 -- 172.21.15.133:0/1190257492 wait complete. 2024-01-21T20:11:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.239+0000 7fc4bb977700 1 Processor -- start 2024-01-21T20:11:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.239+0000 7fc4bb977700 1 -- start start 2024-01-21T20:11:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4b4154140 0x7fc4b41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154520 0x7fc4b4144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4147b90 con 0x7fc4b40c8120 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4147e70 con 0x7fc4b4154520 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4bb977700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4148150 con 0x7fc4b4154140 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52650/0 (socket says 172.21.15.133:52650) 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 -- 172.21.15.133:0/390109655 learned_addr learned my addr 172.21.15.133:0/390109655 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b8f12700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4b4154140 0x7fc4b41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9f14700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154520 0x7fc4b4144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4b4154140 msgr2=0x7fc4b41534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4b4154140 0x7fc4b41534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154520 msgr2=0x7fc4b4144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154520 0x7fc4b4144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.240+0000 7fc4b9713700 1 -- 172.21.15.133:0/390109655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00092a0 con 0x7fc4b40c8120 2024-01-21T20:11:40.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4b9713700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc4b406afd0 tx=0x7fc4b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0010740 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00108a0 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0010c20 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b4148430 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.241+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b4145180 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.242+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b40ae520 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.242+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc4b0027460 con 0x7fc4b40c8120 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.243+0000 7fc4a9ffb700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 0x7fc498061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.243+0000 7fc4b8f12700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 msgr2=0x7fc498061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.243+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fc4b007ba20 con 0x7fc4b40c8120 2024-01-21T20:11:40.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.243+0000 7fc4b8f12700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 0x7fc498061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:40.237 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:40.235+0000 7f26338a5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:11:40.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.247+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc4b004c7f0 con 0x7fc4b40c8120 2024-01-21T20:11:40.298 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:40.307+0000 7f26338a5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:11:40.351 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:40.351+0000 7f5446e99680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:11:40.414 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:40.425+0000 7f5446e99680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:11:40.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.444+0000 7fc4b8f12700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 msgr2=0x7fc498061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:40.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.444+0000 7fc4b8f12700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 0x7fc498061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.452+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc4b405fdf0 con 0x7fc4b40c8120 2024-01-21T20:11:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.453+0000 7fc4a9ffb700 1 -- 172.21.15.133:0/390109655 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc4b004fe10 con 0x7fc4b40c8120 2024-01-21T20:11:40.443 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 msgr2=0x7fc498061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 0x7fc498061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 msgr2=0x7fc4b4147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc4b406afd0 tx=0x7fc4b0016000).stop 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 shutdown_connections 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc49805f270 0x7fc498061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4b4154520 0x7fc4b4144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4b40c8120 0x7fc4b4147570 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 --2- 172.21.15.133:0/390109655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4b4154140 0x7fc4b41534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 >> 172.21.15.133:0/390109655 conn(0x7fc4b405e1e0 msgr2=0x7fc4b40c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 shutdown_connections 2024-01-21T20:11:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.455+0000 7fc4bb977700 1 -- 172.21.15.133:0/390109655 wait complete. 2024-01-21T20:11:40.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:11:40.483 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:40.493+0000 7f26338a5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:11:40.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.592+0000 7f75234fd700 1 Processor -- start 2024-01-21T20:11:40.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.593+0000 7f75234fd700 1 -- start start 2024-01-21T20:11:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f75234fd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f751c13a620 0x7f751c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f75234fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 0x7f751c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f75234fd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c1584f0 con 0x7f751c0626f0 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f75234fd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c0bd6f0 con 0x7f751c13a620 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f75234fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0654e0 con 0x7f751c13aa00 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521299700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f751c13a620 0x7f751c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521a9a700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f751c0626f0 0x7f751c0695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39152/0 (socket says 172.21.15.133:39152) 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7520a98700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 0x7f751c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521a9a700 1 -- 172.21.15.133:0/2965391931 learned_addr learned my addr 172.21.15.133:0/2965391931 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7513fff700 1 -- 172.21.15.133:0/2965391931 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308591877 0 0) 0x7f7514001490 con 0x7f751c0626f0 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7513fff700 1 -- 172.21.15.133:0/2965391931 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75080033f0 con 0x7f751c0626f0 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521299700 1 -- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 msgr2=0x7f751c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521299700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 0x7f751c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521299700 1 -- 172.21.15.133:0/2965391931 >> v1:172.21.15.178:6789/0 conn(0x7f751c0626f0 legacy=0x7f751c0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7521299700 1 -- 172.21.15.133:0/2965391931 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c158730 con 0x7f751c13a620 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.594+0000 7f7520a98700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 0x7f751c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f7521299700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13a620 0x7f751c0a6e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518009060).ready entity=mon.1 client_cookie=bd10e46a4bc75569 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f7513fff700 1 -- 172.21.15.133:0/2965391931 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518009120 con 0x7f751c13a620 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f7513fff700 1 -- 172.21.15.133:0/2965391931 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800d4a0 con 0x7f751c13a620 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f7513fff700 1 -- 172.21.15.133:0/2965391931 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751800d820 con 0x7f751c13a620 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 -- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13a620 msgr2=0x7f751c0a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13a620 0x7f751c0a6e30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f7518009760 tx=0x7f7518009060).stop 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 -- 172.21.15.133:0/2965391931 shutdown_connections 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13a620 0x7f751c0a6e30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 --2- 172.21.15.133:0/2965391931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c13aa00 0x7f751c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 -- 172.21.15.133:0/2965391931 >> 172.21.15.133:0/2965391931 conn(0x7f751c0c7dc0 msgr2=0x7f751c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.595+0000 7f75234fd700 1 -- 172.21.15.133:0/2965391931 shutdown_connections 2024-01-21T20:11:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.596+0000 7f75234fd700 1 -- 172.21.15.133:0/2965391931 wait complete. 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 Processor -- start 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 -- start start 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c0626f0 0x7f751c167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13aa00 0x7f751c168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c168820 con 0x7f751c13a620 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c167c40 con 0x7f751c13aa00 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.597+0000 7f75234fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c13c960 con 0x7f751c0626f0 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52660/0 (socket says 172.21.15.133:52660) 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 -- 172.21.15.133:0/2563746009 learned_addr learned my addr 172.21.15.133:0/2563746009 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7521299700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c0626f0 0x7f751c167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7521a9a700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13aa00 0x7f751c168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 -- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c0626f0 msgr2=0x7f751c167750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c0626f0 0x7f751c167750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 -- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13aa00 msgr2=0x7f751c168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13aa00 0x7f751c168330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 -- 172.21.15.133:0/2563746009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0092a0 con 0x7f751c13a620 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7520a98700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f750c00ea20 tx=0x7f750c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00ee60 con 0x7f751c13a620 2024-01-21T20:11:40.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c00c850 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75180092a0 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c00cbd0 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.598+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c0c1da0 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.599+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c05fdf0 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.600+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f750c01b400 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.600+0000 7f7511ffb700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 0x7f7500061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.600+0000 7f7521299700 1 -- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 msgr2=0x7f7500061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.600+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f750c07abe0 con 0x7f751c13a620 2024-01-21T20:11:40.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.600+0000 7f7521299700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 0x7f7500061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:40.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.604+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f750c04ba60 con 0x7f751c13a620 2024-01-21T20:11:40.616 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:40.627+0000 7f5446e99680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:11:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.777+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f751c06a6a0 con 0x7f751c13a620 2024-01-21T20:11:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.777+0000 7f7511ffb700 1 -- 172.21.15.133:0/2563746009 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7f750c04f080 con 0x7f751c13a620 2024-01-21T20:11:40.767 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:11:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 msgr2=0x7f7500061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 0x7f7500061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 msgr2=0x7f751c167e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f750c00ea20 tx=0x7f750c009060).stop 2024-01-21T20:11:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 shutdown_connections 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f750005f270 0x7f7500061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f751c13aa00 0x7f751c168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f751c0626f0 0x7f751c167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 --2- 172.21.15.133:0/2563746009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f751c13a620 0x7f751c167e40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 >> 172.21.15.133:0/2563746009 conn(0x7f751c0c7dc0 msgr2=0x7f751c1397b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 shutdown_connections 2024-01-21T20:11:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.779+0000 7f75234fd700 1 -- 172.21.15.133:0/2563746009 wait complete. 2024-01-21T20:11:40.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:11:40.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.915+0000 7f1d9d0e6700 1 Processor -- start 2024-01-21T20:11:40.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.915+0000 7f1d9d0e6700 1 -- start start 2024-01-21T20:11:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9d0e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d980bf780 0x7f1d980c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9d0e6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d98152f70 0x7f1d980c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9d0e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d98068760 con 0x7f1d980bfb60 2024-01-21T20:11:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9d0e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d980c3ee0 con 0x7f1d980bf780 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9d0e6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d981535d0 con 0x7f1d98152f70 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d980bf780 0x7f1d980c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d980bfb60 0x7f1d98152860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50632/0 (socket says 172.21.15.133:50632) 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9659c700 1 -- 172.21.15.133:0/1815143264 learned_addr learned my addr 172.21.15.133:0/1815143264 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d9759e700 1 --2- 172.21.15.133:0/1815143264 >> v2:172.21.15.178:3300/0 conn(0x7f1d98152f70 0x7f1d980c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 -- 172.21.15.133:0/1815143264 >> v2:172.21.15.178:3300/0 conn(0x7f1d98152f70 msgr2=0x7f1d980c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 --2- 172.21.15.133:0/1815143264 >> v2:172.21.15.178:3300/0 conn(0x7f1d98152f70 0x7f1d980c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 -- 172.21.15.133:0/1815143264 >> v1:172.21.15.133:6789/0 conn(0x7f1d980bfb60 legacy=0x7f1d98152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 -- 172.21.15.133:0/1815143264 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98067e30 con 0x7f1d980bf780 2024-01-21T20:11:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d95d9b700 1 -- 172.21.15.133:0/1815143264 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767276010 0 0) 0x7f1d98068760 con 0x7f1d980bfb60 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.916+0000 7f1d96d9d700 1 --2- 172.21.15.133:0/1815143264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d980bf780 0x7f1d980c3500 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d98152710 tx=0x7f1d8c009060).ready entity=mon.0 client_cookie=93de91c222eecb4c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d95d9b700 1 -- 172.21.15.133:0/1815143264 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0090d0 con 0x7f1d980bf780 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d95d9b700 1 -- 172.21.15.133:0/1815143264 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00f510 con 0x7f1d980bf780 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d95d9b700 1 -- 172.21.15.133:0/1815143264 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00f890 con 0x7f1d980bf780 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/1815143264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d980bf780 msgr2=0x7f1d980c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/1815143264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d980bf780 0x7f1d980c3500 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d98152710 tx=0x7f1d8c009060).stop 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/1815143264 shutdown_connections 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/1815143264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d980bf780 0x7f1d980c3500 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/1815143264 >> v2:172.21.15.178:3300/0 conn(0x7f1d98152f70 0x7f1d980c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/1815143264 >> 172.21.15.133:0/1815143264 conn(0x7f1d98066a90 msgr2=0x7f1d98066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/1815143264 shutdown_connections 2024-01-21T20:11:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.917+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/1815143264 wait complete. 2024-01-21T20:11:40.910 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:40.916+0000 7f26338a5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.919+0000 7f1d9d0e6700 1 Processor -- start 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.919+0000 7f1d9d0e6700 1 -- start start 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.919+0000 7f1d9d0e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d980bf780 0x7f1d9814df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d980bfb60 0x7f1d9814e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9814f530 con 0x7f1d98152f70 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9814c180 con 0x7f1d980bfb60 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d980c1f10 con 0x7f1d980bf780 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52674/0 (socket says 172.21.15.133:52674) 2024-01-21T20:11:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9659c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d980bfb60 0x7f1d9814e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 -- 172.21.15.133:0/2724750955 learned_addr learned my addr 172.21.15.133:0/2724750955 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d96d9d700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d980bf780 0x7f1d9814df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 -- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d980bf780 msgr2=0x7f1d9814df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d980bf780 0x7f1d9814df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 -- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d980bfb60 msgr2=0x7f1d9814e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d980bfb60 0x7f1d9814e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 -- 172.21.15.133:0/2724750955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0092a0 con 0x7f1d98152f70 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9759e700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1d90009df0 tx=0x7f1d9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000caa0 con 0x7f1d98152f70 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000f040 con 0x7f1d98152f70 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000ce10 con 0x7f1d98152f70 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9814ec90 con 0x7f1d98152f70 2024-01-21T20:11:40.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.920+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9814f250 con 0x7f1d98152f70 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9805fdf0 con 0x7f1d98152f70 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f1d90013610 con 0x7f1d98152f70 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d7f7fe700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 0x7f1d84061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d96d9d700 1 -- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 msgr2=0x7f1d84061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f1d9007ad70 con 0x7f1d98152f70 2024-01-21T20:11:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.922+0000 7f1d96d9d700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 0x7f1d84061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:40.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:40.926+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d9004bba0 con 0x7f1d98152f70 2024-01-21T20:11:41.009 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.019+0000 7f26338a5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:11:41.059 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.070+0000 7f5446e99680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:11:41.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.099+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d980bea40 con 0x7f1d98152f70 2024-01-21T20:11:41.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.099+0000 7f1d7f7fe700 1 -- 172.21.15.133:0/2724750955 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d9004f1c0 con 0x7f1d98152f70 2024-01-21T20:11:41.089 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:11:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 msgr2=0x7f1d84061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 0x7f1d84061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 msgr2=0x7f1d98161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f1d90009df0 tx=0x7f1d9000b040).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 shutdown_connections 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1d8405f270 0x7f1d84061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d98152f70 0x7f1d98161c90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d980bf780 0x7f1d9814df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 --2- 172.21.15.133:0/2724750955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d980bfb60 0x7f1d9814e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 >> 172.21.15.133:0/2724750955 conn(0x7f1d98066a90 msgr2=0x7f1d980bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 shutdown_connections 2024-01-21T20:11:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.101+0000 7f1d9d0e6700 1 -- 172.21.15.133:0/2724750955 wait complete. 2024-01-21T20:11:41.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:11:41.163 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.173+0000 7f26338a5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:11:41.172 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.182+0000 7f5446e99680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:11:41.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.235+0000 7fdccd7b5700 1 Processor -- start 2024-01-21T20:11:41.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.235+0000 7fdccd7b5700 1 -- start start 2024-01-21T20:11:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdccd7b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcc8154140 0x7fdcc8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdccd7b5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdcc80c8120 0x7fdcc80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdccd7b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80ab620 con 0x7fdcc8154520 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdccd7b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc80c6ae0 con 0x7fdcc8154140 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdccd7b5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc80c05e0 con 0x7fdcc80c8120 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdcc6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcc8154140 0x7fdcc8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdcc67fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdcc8154520 0x7fdcc80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50636/0 (socket says 172.21.15.133:50636) 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdcc67fc700 1 -- 172.21.15.133:0/2107991971 learned_addr learned my addr 172.21.15.133:0/2107991971 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.236+0000 7fdcc77fe700 1 --2- 172.21.15.133:0/2107991971 >> v2:172.21.15.178:3300/0 conn(0x7fdcc80c8120 0x7fdcc80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/2107991971 >> v2:172.21.15.178:3300/0 conn(0x7fdcc80c8120 msgr2=0x7fdcc80ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/2107991971 >> v2:172.21.15.178:3300/0 conn(0x7fdcc80c8120 0x7fdcc80ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/2107991971 >> v1:172.21.15.133:6789/0 conn(0x7fdcc8154520 legacy=0x7fdcc80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/2107991971 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80c0e40 con 0x7fdcc8154140 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc5ffb700 1 -- 172.21.15.133:0/2107991971 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090580021 0 0) 0x7fdcc80ab620 con 0x7fdcc8154520 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/2107991971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc8158bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fdcbc009760 tx=0x7fdcbc009060).ready entity=mon.0 client_cookie=68d00a09c1477700 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc5ffb700 1 -- 172.21.15.133:0/2107991971 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0090d0 con 0x7fdcc8154140 2024-01-21T20:11:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc5ffb700 1 -- 172.21.15.133:0/2107991971 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00f510 con 0x7fdcc8154140 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdcc5ffb700 1 -- 172.21.15.133:0/2107991971 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00f890 con 0x7fdcc8154140 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdccd7b5700 1 -- 172.21.15.133:0/2107991971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 msgr2=0x7fdcc8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.237+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/2107991971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc8158bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fdcbc009760 tx=0x7fdcbc009060).stop 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 -- 172.21.15.133:0/2107991971 shutdown_connections 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/2107991971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc8158bb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/2107991971 >> v2:172.21.15.178:3300/0 conn(0x7fdcc80c8120 0x7fdcc80ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 -- 172.21.15.133:0/2107991971 >> 172.21.15.133:0/2107991971 conn(0x7fdcc805e1e0 msgr2=0x7fdcc805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 -- 172.21.15.133:0/2107991971 shutdown_connections 2024-01-21T20:11:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.238+0000 7fdccd7b5700 1 -- 172.21.15.133:0/2107991971 wait complete. 2024-01-21T20:11:41.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.239+0000 7fdccd7b5700 1 Processor -- start 2024-01-21T20:11:41.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.239+0000 7fdccd7b5700 1 -- start start 2024-01-21T20:11:41.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 0x7fdcc8164550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc8154520 0x7fdcc80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81557a0 con 0x7fdcc8154140 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8154b90 con 0x7fdcc8154520 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdccd7b5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8154e70 con 0x7fdcc80c8120 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52688/0 (socket says 172.21.15.133:52688) 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc67fc700 1 -- 172.21.15.133:0/1929226746 learned_addr learned my addr 172.21.15.133:0/1929226746 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 0x7fdcc8164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc77fe700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc8154520 0x7fdcc80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc8154520 msgr2=0x7fdcc80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc8154520 0x7fdcc80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 msgr2=0x7fdcc814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 -- 172.21.15.133:0/1929226746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0092a0 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc67fc700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcc6ffd700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 0x7fdcc8164550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdcbc014000 tx=0x7fdcbc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.240+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00f890 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.241+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc006950 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.241+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00fe80 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.241+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc8155150 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.241+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc8164a40 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc805fdf0 con 0x7fdcc80c8120 2024-01-21T20:11:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fdcbc01b620 con 0x7fdcc80c8120 2024-01-21T20:11:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdcaf7fe700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 0x7fdcb4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdcc67fc700 1 -- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 msgr2=0x7fdcb4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fdcbc07bf90 con 0x7fdcc80c8120 2024-01-21T20:11:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.242+0000 7fdcc67fc700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 0x7fdcb4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.246+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdcbc04cca0 con 0x7fdcc80c8120 2024-01-21T20:11:41.239 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.249+0000 7f26338a5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:11:41.306 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.316+0000 7f26338a5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:11:41.333 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.343+0000 7f5446e99680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:11:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.418+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcc80aa980 con 0x7fdcc80c8120 2024-01-21T20:11:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.418+0000 7fdcaf7fe700 1 -- 172.21.15.133:0/1929226746 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcbc029020 con 0x7fdcc80c8120 2024-01-21T20:11:41.408 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:11:41.410 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.420+0000 7f5446e99680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 msgr2=0x7fdcb4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 0x7fdcb4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 msgr2=0x7fdcc8164550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 0x7fdcc8164550 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fdcbc014000 tx=0x7fdcbc017000).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 shutdown_connections 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdcb405f270 0x7fdcb4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdcc8154520 0x7fdcc80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdcc80c8120 0x7fdcc8164550 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 --2- 172.21.15.133:0/1929226746 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc8154140 0x7fdcc814d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 >> 172.21.15.133:0/1929226746 conn(0x7fdcc805e1e0 msgr2=0x7fdcc814daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 shutdown_connections 2024-01-21T20:11:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.420+0000 7fdccd7b5700 1 -- 172.21.15.133:0/1929226746 wait complete. 2024-01-21T20:11:41.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:41.483 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.493+0000 7f5446e99680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:11:41.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.551+0000 7fb48d946700 1 Processor -- start 2024-01-21T20:11:41.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.551+0000 7fb48d946700 1 -- start start 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb48d946700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 0x7fb488158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb48d946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 0x7fb4880ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb48d946700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880ab620 con 0x7fb488154520 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb48d946700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880c6ae0 con 0x7fb488154140 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb48d946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880c05e0 con 0x7fb4880c8120 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb4877fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 0x7fb4880ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb486ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 0x7fb488158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb4867fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb488154520 0x7fb4880c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39164/0 (socket says 172.21.15.133:39164) 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.552+0000 7fb4867fc700 1 -- 172.21.15.133:0/571024252 learned_addr learned my addr 172.21.15.133:0/571024252 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb485ffb700 1 -- 172.21.15.133:0/571024252 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632205438 0 0) 0x7fb4880ab620 con 0x7fb488154520 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb485ffb700 1 -- 172.21.15.133:0/571024252 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4700033f0 con 0x7fb488154520 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb4877fe700 1 -- 172.21.15.133:0/571024252 >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 msgr2=0x7fb488158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb4877fe700 1 --2- 172.21.15.133:0/571024252 >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 0x7fb488158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb4877fe700 1 -- 172.21.15.133:0/571024252 >> v1:172.21.15.178:6789/0 conn(0x7fb488154520 legacy=0x7fb4880c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb4877fe700 1 -- 172.21.15.133:0/571024252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880c0e40 con 0x7fb4880c8120 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb486ffd700 1 --2- 172.21.15.133:0/571024252 >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 0x7fb488158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb4877fe700 1 --2- 172.21.15.133:0/571024252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 0x7fb4880ab130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb480009e60 tx=0x7fb480009780).ready entity=mon.2 client_cookie=dd4a2f286d96ceaf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb485ffb700 1 -- 172.21.15.133:0/571024252 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000e070 con 0x7fb4880c8120 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb485ffb700 1 -- 172.21.15.133:0/571024252 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48000bab0 con 0x7fb4880c8120 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.553+0000 7fb485ffb700 1 -- 172.21.15.133:0/571024252 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48000be30 con 0x7fb4880c8120 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 -- 172.21.15.133:0/571024252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 msgr2=0x7fb4880ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 --2- 172.21.15.133:0/571024252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 0x7fb4880ab130 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb480009e60 tx=0x7fb480009780).stop 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 -- 172.21.15.133:0/571024252 shutdown_connections 2024-01-21T20:11:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 --2- 172.21.15.133:0/571024252 >> v2:172.21.15.178:3300/0 conn(0x7fb488154140 0x7fb488158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 --2- 172.21.15.133:0/571024252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880c8120 0x7fb4880ab130 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 -- 172.21.15.133:0/571024252 >> 172.21.15.133:0/571024252 conn(0x7fb48805e1e0 msgr2=0x7fb48805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 -- 172.21.15.133:0/571024252 shutdown_connections 2024-01-21T20:11:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.554+0000 7fb48d946700 1 -- 172.21.15.133:0/571024252 wait complete. 2024-01-21T20:11:41.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.555+0000 7fb48d946700 1 Processor -- start 2024-01-21T20:11:41.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.555+0000 7fb48d946700 1 -- start start 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880c8120 0x7fb48814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 0x7fb48814e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 0x7fb48814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48814ec40 con 0x7fb488154140 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881521b0 con 0x7fb4880c8120 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb48d946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881523e0 con 0x7fb488154520 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 0x7fb48814e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb486ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880c8120 0x7fb48814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 0x7fb48814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 0x7fb48814e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52694/0 (socket says 172.21.15.133:52694) 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4867fc700 1 -- 172.21.15.133:0/3488373709 learned_addr learned my addr 172.21.15.133:0/3488373709 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880c8120 msgr2=0x7fb48814cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880c8120 0x7fb48814cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 msgr2=0x7fb48814e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 0x7fb48814e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 -- 172.21.15.133:0/3488373709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4780092a0 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.556+0000 7fb4877fe700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 0x7fb48814e750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb480014000 tx=0x7fb48805ed40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.557+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480013e40 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.557+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48001d630 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.557+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48001d9f0 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.557+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480009a20 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.557+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb488152c80 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48805fdf0 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb480003040 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb46f7fe700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 0x7fb474061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb486ffd700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 msgr2=0x7fb474061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fb48007c320 con 0x7fb488154520 2024-01-21T20:11:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.558+0000 7fb486ffd700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 0x7fb474061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:41.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.562+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb48004d150 con 0x7fb488154520 2024-01-21T20:11:41.562 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.573+0000 7f26338a5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:11:41.745 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:41.755+0000 7f26338a5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:11:41.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.759+0000 7fb486ffd700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 msgr2=0x7fb474061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:41.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.759+0000 7fb486ffd700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 0x7fb474061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:41.750 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.760+0000 7f5446e99680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:11:41.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.774+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4880c00f0 con 0x7fb488154520 2024-01-21T20:11:41.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.775+0000 7fb46f7fe700 1 -- 172.21.15.133:0/3488373709 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fb480050770 con 0x7fb488154520 2024-01-21T20:11:41.765 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:41.765 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T20:11:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 msgr2=0x7fb474061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 0x7fb474061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 msgr2=0x7fb48814e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 0x7fb48814e750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb480014000 tx=0x7fb48805ed40).stop 2024-01-21T20:11:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 shutdown_connections 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb47405f270 0x7fb474061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488154520 0x7fb48814e750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880c8120 0x7fb48814cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 --2- 172.21.15.133:0/3488373709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb488154140 0x7fb48814e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 >> 172.21.15.133:0/3488373709 conn(0x7fb48805e1e0 msgr2=0x7fb4880c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 shutdown_connections 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.777+0000 7fb48d946700 1 -- 172.21.15.133:0/3488373709 wait complete. 2024-01-21T20:11:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T20:11:41.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.912+0000 7f5248b99700 1 Processor -- start 2024-01-21T20:11:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.912+0000 7f5248b99700 1 -- start start 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5248b99700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52441351d0 0x7f52440c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5248b99700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5248b99700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5244156650 con 0x7f52441561a0 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5248b99700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440c61a0 con 0x7f52441351d0 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5248b99700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440c5350 con 0x7f52440c3c60 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f524259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52441351d0 0x7f52440c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f524259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52441351d0 0x7f52440c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52708/0 (socket says 172.21.15.133:52708) 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f524259c700 1 -- 172.21.15.133:0/2031149911 learned_addr learned my addr 172.21.15.133:0/2031149911 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:41.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.913+0000 7f5242d9d700 1 --1- 172.21.15.133:0/2031149911 >> v1:172.21.15.133:6789/0 conn(0x7f52441561a0 0x7f52441526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50638/0 (socket says 172.21.15.133:50638) 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f5241d9b700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524259c700 1 -- 172.21.15.133:0/2031149911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 msgr2=0x7f5244155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524259c700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524259c700 1 -- 172.21.15.133:0/2031149911 >> v1:172.21.15.133:6789/0 conn(0x7f52441561a0 legacy=0x7f52441526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524259c700 1 -- 172.21.15.133:0/2031149911 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440c55d0 con 0x7f52441351d0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524159a700 1 -- 172.21.15.133:0/2031149911 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255770181 0 0) 0x7f523c001490 con 0x7f52441561a0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524259c700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441351d0 0x7f52440c3770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f5234006fd0 tx=0x7f52340090f0).ready entity=mon.0 client_cookie=c6ee7b8c0a2bb703 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524159a700 1 -- 172.21.15.133:0/2031149911 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400b580 con 0x7f52441351d0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524159a700 1 -- 172.21.15.133:0/2031149911 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400b6e0 con 0x7f52441351d0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.914+0000 7f524159a700 1 -- 172.21.15.133:0/2031149911 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400ba80 con 0x7f52441351d0 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 -- 172.21.15.133:0/2031149911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441351d0 msgr2=0x7f52440c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441351d0 0x7f52440c3770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f5234006fd0 tx=0x7f52340090f0).stop 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 -- 172.21.15.133:0/2031149911 shutdown_connections 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441351d0 0x7f52440c3770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 --2- 172.21.15.133:0/2031149911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 -- 172.21.15.133:0/2031149911 >> 172.21.15.133:0/2031149911 conn(0x7f5244066a90 msgr2=0x7f5244066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:41.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 -- 172.21.15.133:0/2031149911 shutdown_connections 2024-01-21T20:11:41.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.915+0000 7f5248b99700 1 -- 172.21.15.133:0/2031149911 wait complete. 2024-01-21T20:11:41.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.916+0000 7f5248b99700 1 Processor -- start 2024-01-21T20:11:41.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.916+0000 7f5248b99700 1 -- start start 2024-01-21T20:11:41.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52441351d0 0x7f5244151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5244150fd0 con 0x7f52441561a0 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52441503c0 con 0x7f52441351d0 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5248b99700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52441506a0 con 0x7f52440c3c60 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5242d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f524259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f524259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:42086/0 (socket says 172.21.15.133:42086) 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5242d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52724/0 (socket says 172.21.15.133:52724) 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f524259c700 1 -- 172.21.15.133:0/1274506285 learned_addr learned my addr 172.21.15.133:0/1274506285 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.917+0000 7f5241d9b700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52441351d0 0x7f5244151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 -- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52441351d0 msgr2=0x7f5244151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52441351d0 0x7f5244151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 -- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 msgr2=0x7f52440c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 -- 172.21.15.133:0/1274506285 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009370 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5242d9d700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f524259c700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5234009ea0 tx=0x7f5234017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234006d90 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523400be40 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400ba80 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5244150980 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.918+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440c7f20 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.919+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52441512b0 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.919+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f523401c630 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.920+0000 7f5232ffd700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.920+0000 7f5241d9b700 1 -- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 msgr2=0x7f5224061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.920+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f523407c0e0 con 0x7f52440c3c60 2024-01-21T20:11:41.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.920+0000 7f5241d9b700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:41.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:41.924+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f523404ce50 con 0x7f52440c3c60 2024-01-21T20:11:41.945 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:41.956+0000 7f5446e99680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:11:42.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.097+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f524405fdf0 con 0x7f52440c3c60 2024-01-21T20:11:42.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.098+0000 7f5232ffd700 1 -- 172.21.15.133:0/1274506285 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18206 (secure 0 0 0) 0x7f523402a020 con 0x7f52440c3c60 2024-01-21T20:11:42.088 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:42.088 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:40.025544+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2594876400":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6832/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6833/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:0/3194509186":"2024-01-22T20:00:11.136676+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":105,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 msgr2=0x7f5224061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 msgr2=0x7f5244151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5234009ea0 tx=0x7f5234017000).stop 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 shutdown_connections 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52441561a0 0x7f52440c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52440c3c60 0x7f5244151460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 --2- 172.21.15.133:0/1274506285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52441351d0 0x7f5244151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 >> 172.21.15.133:0/1274506285 conn(0x7f5244066a90 msgr2=0x7f52441395f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 shutdown_connections 2024-01-21T20:11:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.100+0000 7f5248b99700 1 -- 172.21.15.133:0/1274506285 wait complete. 2024-01-21T20:11:42.103 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:11:42.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.231+0000 7feef9f7a700 1 Processor -- start 2024-01-21T20:11:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.231+0000 7feef9f7a700 1 -- start start 2024-01-21T20:11:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef9f7a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feef4062ff0 0x7feef4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef9f7a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feef4065b50 0x7feef40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef9f7a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef4069ef0 con 0x7feef4062c10 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef9f7a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef4065fe0 con 0x7feef4065b50 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef9f7a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef406a130 con 0x7feef4062ff0 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feef4062c10 0x7feef40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50644/0 (socket says 172.21.15.133:50644) 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feef4065b50 0x7feef40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef37fe700 1 -- 172.21.15.133:0/3913159661 learned_addr learned my addr 172.21.15.133:0/3913159661 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef2ffd700 1 --2- 172.21.15.133:0/3913159661 >> v2:172.21.15.178:3300/0 conn(0x7feef4062ff0 0x7feef4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef27fc700 1 -- 172.21.15.133:0/3913159661 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516074012 0 0) 0x7feee4001110 con 0x7feef4062c10 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef27fc700 1 -- 172.21.15.133:0/3913159661 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc0033f0 con 0x7feef4062c10 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef3fff700 1 -- 172.21.15.133:0/3913159661 >> v2:172.21.15.178:3300/0 conn(0x7feef4062ff0 msgr2=0x7feef4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.232+0000 7feef3fff700 1 --2- 172.21.15.133:0/3913159661 >> v2:172.21.15.178:3300/0 conn(0x7feef4062ff0 0x7feef4065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef3fff700 1 -- 172.21.15.133:0/3913159661 >> v1:172.21.15.133:6789/0 conn(0x7feef4062c10 legacy=0x7feef40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef3fff700 1 -- 172.21.15.133:0/3913159661 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef406a410 con 0x7feef4065b50 2024-01-21T20:11:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef3fff700 1 --2- 172.21.15.133:0/3913159661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4065b50 0x7feef40bd770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7feef40c9080 tx=0x7feeec009780).ready entity=mon.0 client_cookie=80e96e1cb705f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef27fc700 1 -- 172.21.15.133:0/3913159661 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00e070 con 0x7feef4065b50 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef27fc700 1 -- 172.21.15.133:0/3913159661 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00bab0 con 0x7feef4065b50 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef27fc700 1 -- 172.21.15.133:0/3913159661 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00be30 con 0x7feef4065b50 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 -- 172.21.15.133:0/3913159661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4065b50 msgr2=0x7feef40bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 --2- 172.21.15.133:0/3913159661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4065b50 0x7feef40bd770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7feef40c9080 tx=0x7feeec009780).stop 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 -- 172.21.15.133:0/3913159661 shutdown_connections 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 --2- 172.21.15.133:0/3913159661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4065b50 0x7feef40bd770 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 --2- 172.21.15.133:0/3913159661 >> v2:172.21.15.178:3300/0 conn(0x7feef4062ff0 0x7feef4065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 -- 172.21.15.133:0/3913159661 >> 172.21.15.133:0/3913159661 conn(0x7feef40c8010 msgr2=0x7feef40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 -- 172.21.15.133:0/3913159661 shutdown_connections 2024-01-21T20:11:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.233+0000 7feef9f7a700 1 -- 172.21.15.133:0/3913159661 wait complete. 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 Processor -- start 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 -- start start 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4062c10 0x7feef4164f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef4065b50 0x7feef40ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef41582e0 con 0x7feef4062ff0 2024-01-21T20:11:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40ac2e0 con 0x7feef4062c10 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.235+0000 7feef9f7a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40aba40 con 0x7feef4065b50 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52738/0 (socket says 172.21.15.133:52738) 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 -- 172.21.15.133:0/4116468609 learned_addr learned my addr 172.21.15.133:0/4116468609 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef37fe700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4062c10 0x7feef4164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef3fff700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef4065b50 0x7feef40ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef4065b50 msgr2=0x7feef40ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef4065b50 0x7feef40ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4062c10 msgr2=0x7feef4164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4062c10 0x7feef4164f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 -- 172.21.15.133:0/4116468609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009a20 con 0x7feef4062ff0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef2ffd700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7feee800e900 tx=0x7feee8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8012600 con 0x7feef4062ff0 2024-01-21T20:11:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee8012760 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef40abd20 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8012ae0 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.236+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef4158590 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7feee801b400 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef405fdf0 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feedbfff700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 0x7feee0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feef37fe700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 msgr2=0x7feee0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7feee807a9f0 con 0x7feef4062ff0 2024-01-21T20:11:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.238+0000 7feef37fe700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 0x7feee0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.242+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feee804b7c0 con 0x7feef4062ff0 2024-01-21T20:11:42.397 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.407+0000 7f26338a5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:11:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.439+0000 7feef37fe700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 msgr2=0x7feee0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:42.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.439+0000 7feef37fe700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 0x7feee0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:42.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.455+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feef406a6f0 con 0x7feef4062ff0 2024-01-21T20:11:42.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.456+0000 7feedbfff700 1 -- 172.21.15.133:0/4116468609 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7feee8016020 con 0x7feef4062ff0 2024-01-21T20:11:42.445 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:42.445 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 msgr2=0x7feee0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 0x7feee0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 msgr2=0x7feef40aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7feee800e900 tx=0x7feee8009060).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 shutdown_connections 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feee005f270 0x7feee0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feef4065b50 0x7feef40ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feef4062c10 0x7feef4164f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 --2- 172.21.15.133:0/4116468609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feef4062ff0 0x7feef40aafc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 >> 172.21.15.133:0/4116468609 conn(0x7feef40c8010 msgr2=0x7feef40bd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 shutdown_connections 2024-01-21T20:11:42.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.458+0000 7feef9f7a700 1 -- 172.21.15.133:0/4116468609 wait complete. 2024-01-21T20:11:42.449 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T20:11:42.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:42.464 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.474+0000 7f26338a5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:11:42.538 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.548+0000 7f26338a5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:11:42.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.593+0000 7fb95b0f4700 1 Processor -- start 2024-01-21T20:11:42.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.593+0000 7fb95b0f4700 1 -- start start 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb95b0f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb954155ca0 0x7fb9540bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb95b0f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9540a50f0 con 0x7fb954062e00 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb95b0f4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9540a4da0 con 0x7fb9541558c0 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb95b0f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9540bde00 con 0x7fb954155ca0 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb953fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb954155ca0 0x7fb9540bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.594+0000 7fb959691700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb954062e00 0x7fb9540a5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50646/0 (socket says 172.21.15.133:50646) 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb959691700 1 -- 172.21.15.133:0/754465674 learned_addr learned my addr 172.21.15.133:0/754465674 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb953fff700 1 -- 172.21.15.133:0/754465674 >> v1:172.21.15.178:6789/0 conn(0x7fb9541558c0 legacy=0x7fb9540626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb953fff700 1 -- 172.21.15.133:0/754465674 >> v1:172.21.15.133:6789/0 conn(0x7fb954062e00 legacy=0x7fb9540a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb953fff700 1 -- 172.21.15.133:0/754465674 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9540be0e0 con 0x7fb954155ca0 2024-01-21T20:11:42.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb953fff700 1 --2- 172.21.15.133:0/754465674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540bd180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fb940009760 tx=0x7fb940009060).ready entity=mon.0 client_cookie=2886562874ec4e13 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb9537fe700 1 -- 172.21.15.133:0/754465674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940009120 con 0x7fb954155ca0 2024-01-21T20:11:42.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb9537fe700 1 -- 172.21.15.133:0/754465674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94000b580 con 0x7fb954155ca0 2024-01-21T20:11:42.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.595+0000 7fb9537fe700 1 -- 172.21.15.133:0/754465674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94000b900 con 0x7fb954155ca0 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 -- 172.21.15.133:0/754465674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 msgr2=0x7fb9540bd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/754465674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540bd180 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7fb940009760 tx=0x7fb940009060).stop 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 -- 172.21.15.133:0/754465674 shutdown_connections 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/754465674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540bd180 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 -- 172.21.15.133:0/754465674 >> 172.21.15.133:0/754465674 conn(0x7fb9540c8010 msgr2=0x7fb9540c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 -- 172.21.15.133:0/754465674 shutdown_connections 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.596+0000 7fb95b0f4700 1 -- 172.21.15.133:0/754465674 wait complete. 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.597+0000 7fb95b0f4700 1 Processor -- start 2024-01-21T20:11:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.597+0000 7fb95b0f4700 1 -- start start 2024-01-21T20:11:42.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb954062e00 0x7fb95414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9541558c0 0x7fb954141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9541507d0 con 0x7fb954155ca0 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95414fbc0 con 0x7fb9541558c0 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb95b0f4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95414fea0 con 0x7fb954062e00 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52766/0 (socket says 172.21.15.133:52766) 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 -- 172.21.15.133:0/379357850 learned_addr learned my addr 172.21.15.133:0/379357850 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb958e90700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb954062e00 0x7fb95414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb953fff700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9541558c0 0x7fb954141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb954062e00 msgr2=0x7fb95414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb954062e00 0x7fb95414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9541558c0 msgr2=0x7fb954141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9541558c0 0x7fb954141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.598+0000 7fb959691700 1 -- 172.21.15.133:0/379357850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9400092a0 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb959691700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fb94c00c7c0 tx=0x7fb94c001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c005d30 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c005e90 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb954150180 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0072e0 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.599+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95414f7f0 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95405fdf0 con 0x7fb954155ca0 2024-01-21T20:11:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb94c0076d0 con 0x7fb954155ca0 2024-01-21T20:11:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb9517fa700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 0x7fb938061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb958e90700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 msgr2=0x7fb938061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fb94c079f20 con 0x7fb954155ca0 2024-01-21T20:11:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.600+0000 7fb958e90700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 0x7fb938061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.604+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb94c04ad50 con 0x7fb954155ca0 2024-01-21T20:11:42.638 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:42.648+0000 7f5446e99680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:11:42.681 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.692+0000 7f26338a5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:11:42.708 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:42.719+0000 7f5446e99680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:11:42.751 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.761+0000 7f26338a5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:11:42.785 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:42.796+0000 7f5446e99680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:11:42.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.801+0000 7fb958e90700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 msgr2=0x7fb938061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:42.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.801+0000 7fb958e90700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 0x7fb938061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:42.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.818+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb95405f970 con 0x7fb954155ca0 2024-01-21T20:11:42.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.819+0000 7fb9517fa700 1 -- 172.21.15.133:0/379357850 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4498 (secure 0 0 0) 0x7fb94c04e370 con 0x7fb954155ca0 2024-01-21T20:11:42.808 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:42.808 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T19:59:55.732556+0000","modified":"2024-01-21T19:59:57.738283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4977},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4977":{"gid":4977,"name":"d","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/1407215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1407215151},{"type":"v1","addr":"172.21.15.178:6835","nonce":1407215151}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.820+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 msgr2=0x7fb938061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.820+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 0x7fb938061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.820+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 msgr2=0x7fb9540a97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.820+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fb94c00c7c0 tx=0x7fb94c001560).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 shutdown_connections 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb93805f270 0x7fb938061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb954155ca0 0x7fb9540a97e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb954062e00 0x7fb95414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 --2- 172.21.15.133:0/379357850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9541558c0 0x7fb954141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 >> 172.21.15.133:0/379357850 conn(0x7fb9540c8010 msgr2=0x7fb954152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 shutdown_connections 2024-01-21T20:11:42.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.821+0000 7fb95b0f4700 1 -- 172.21.15.133:0/379357850 wait complete. 2024-01-21T20:11:42.812 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 12 2024-01-21T20:11:42.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:42.864 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.874+0000 7f26338a5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:11:42.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.952+0000 7f97ccc77700 1 Processor -- start 2024-01-21T20:11:42.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.952+0000 7f97ccc77700 1 -- start start 2024-01-21T20:11:42.942 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:42.952+0000 7f5446e99680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:11:42.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97ccc77700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97c80c8120 0x7f97c8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97ccc77700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c80c0e40 con 0x7f97c8154520 2024-01-21T20:11:42.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97ccc77700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c81549b0 con 0x7f97c8154140 2024-01-21T20:11:42.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97ccc77700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c80c6ae0 con 0x7f97c80c8120 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f97c8154520 0x7f97c80c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50654/0 (socket says 172.21.15.133:50654) 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c6d9d700 1 -- 172.21.15.133:0/3708537279 learned_addr learned my addr 172.21.15.133:0/3708537279 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c5d9b700 1 --2- 172.21.15.133:0/3708537279 >> v2:172.21.15.178:3300/0 conn(0x7f97c80c8120 0x7f97c8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019801311 0 0) 0x7f97c80c0e40 con 0x7f97c8154520 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b00033f0 con 0x7f97c8154520 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650708478 0 0) 0x7f97c81549b0 con 0x7f97c8154140 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c80c0e40 con 0x7f97c8154140 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c5d9b700 1 -- 172.21.15.133:0/3708537279 >> v1:172.21.15.178:6789/0 conn(0x7f97c8154140 legacy=0x7f97c80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c5d9b700 1 -- 172.21.15.133:0/3708537279 >> v1:172.21.15.133:6789/0 conn(0x7f97c8154520 legacy=0x7f97c80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.953+0000 7f97c5d9b700 1 -- 172.21.15.133:0/3708537279 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c80c6800 con 0x7f97c80c8120 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97c5d9b700 1 --2- 172.21.15.133:0/3708537279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c80c8120 0x7f97c8158bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f97bc009760 tx=0x7f97bc009060).ready entity=mon.1 client_cookie=e779b04e2e6aef0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00d4a0 con 0x7f97c80c8120 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc00d600 con 0x7f97c80c8120 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97c559a700 1 -- 172.21.15.133:0/3708537279 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00d980 con 0x7f97c80c8120 2024-01-21T20:11:42.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 -- 172.21.15.133:0/3708537279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c80c8120 msgr2=0x7f97c8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 --2- 172.21.15.133:0/3708537279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c80c8120 0x7f97c8158bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f97bc009760 tx=0x7f97bc009060).stop 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 -- 172.21.15.133:0/3708537279 shutdown_connections 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 --2- 172.21.15.133:0/3708537279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c80c8120 0x7f97c8158bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 -- 172.21.15.133:0/3708537279 >> 172.21.15.133:0/3708537279 conn(0x7f97c805e1e0 msgr2=0x7f97c805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 -- 172.21.15.133:0/3708537279 shutdown_connections 2024-01-21T20:11:42.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.954+0000 7f97ccc77700 1 -- 172.21.15.133:0/3708537279 wait complete. 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.956+0000 7f97ccc77700 1 Processor -- start 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.956+0000 7f97ccc77700 1 -- start start 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97c8154140 0x7f97c80b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c8154520 0x7f97c8155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8155aa0 con 0x7f97c80c8120 2024-01-21T20:11:42.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8154e90 con 0x7f97c8154520 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97ccc77700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c8155170 con 0x7f97c8154140 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97c659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97c659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52778/0 (socket says 172.21.15.133:52778) 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97c659c700 1 -- 172.21.15.133:0/963355247 learned_addr learned my addr 172.21.15.133:0/963355247 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97c6d9d700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c8154520 0x7f97c8155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.957+0000 7f97c5d9b700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97c8154140 0x7f97c80b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 -- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97c8154140 msgr2=0x7f97c80b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97c8154140 0x7f97c80b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 -- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c8154520 msgr2=0x7f97c8155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c8154520 0x7f97c8155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 -- 172.21.15.133:0/963355247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0092a0 con 0x7f97c80c8120 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97c659c700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f97b800c490 tx=0x7f97b8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800ce40 con 0x7f97c80c8120 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b800f470 con 0x7f97c80c8120 2024-01-21T20:11:42.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c8155450 con 0x7f97c80c8120 2024-01-21T20:11:42.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b800f810 con 0x7f97c80c8120 2024-01-21T20:11:42.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.958+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c80b0f30 con 0x7f97c80c8120 2024-01-21T20:11:42.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.959+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f97b800fbc0 con 0x7f97c80c8120 2024-01-21T20:11:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.959+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c805fdf0 con 0x7f97c80c8120 2024-01-21T20:11:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.959+0000 7f97b6ffd700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 0x7f97a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.960+0000 7f97c5d9b700 1 -- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 msgr2=0x7f97a8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.960+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f97b8079cb0 con 0x7f97c80c8120 2024-01-21T20:11:42.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.960+0000 7f97c5d9b700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 0x7f97a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:42.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:42.964+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f97b804aa20 con 0x7f97c80c8120 2024-01-21T20:11:42.972 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:42.982+0000 7f26338a5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:11:43.017 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.027+0000 7f5446e99680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:11:43.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.137+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97c80aa980 con 0x7f97c80c8120 2024-01-21T20:11:43.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.138+0000 7f97b6ffd700 1 -- 172.21.15.133:0/963355247 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18206 (secure 0 0 0) 0x7f97b804e040 con 0x7f97c80c8120 2024-01-21T20:11:43.128 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:43.128 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:40.025544+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-01-21T19:59:53.523734+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-01-21T19:59:54.693354+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.31","mappings":[{"from":5,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2594876400":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6832/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:6833/43404":"2024-01-22T20:00:11.136676+0000","172.21.15.133:0/3194509186":"2024-01-22T20:00:11.136676+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":105,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:43.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 msgr2=0x7f97a8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:43.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 0x7f97a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:43.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 msgr2=0x7f97c81530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f97b800c490 tx=0x7f97b8007c90).stop 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 shutdown_connections 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f97a805f270 0x7f97a8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97c8154520 0x7f97c8155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c80c8120 0x7f97c81530a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 --2- 172.21.15.133:0/963355247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97c8154140 0x7f97c80b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 >> 172.21.15.133:0/963355247 conn(0x7f97c805e1e0 msgr2=0x7f97c814da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 shutdown_connections 2024-01-21T20:11:43.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.140+0000 7f97ccc77700 1 -- 172.21.15.133:0/963355247 wait complete. 2024-01-21T20:11:43.138 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.148+0000 7f5446e99680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:11:43.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:11:43.253 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.263+0000 7f5446e99680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:11:43.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.272+0000 7f34f266b700 1 Processor -- start 2024-01-21T20:11:43.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.272+0000 7f34f266b700 1 -- start start 2024-01-21T20:11:43.263 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:43.273+0000 7f26338a5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.273+0000 7f34f266b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec0c8120 0x7f34ec158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.273+0000 7f34f266b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34ec154520 0x7f34ec0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.273+0000 7f34f266b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec0ab620 con 0x7f34ec154140 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.273+0000 7f34f266b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec0c6ae0 con 0x7f34ec154520 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.273+0000 7f34f266b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0c05e0 con 0x7f34ec0c8120 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34ec154520 0x7f34ec0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34eb7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec0c8120 0x7f34ec158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:43.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34ec154520 0x7f34ec0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52788/0 (socket says 172.21.15.133:52788) 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 -- 172.21.15.133:0/538891877 learned_addr learned my addr 172.21.15.133:0/538891877 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34ebfff700 1 --1- 172.21.15.133:0/538891877 >> v1:172.21.15.178:6789/0 conn(0x7f34ec154140 0x7f34ec0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39192/0 (socket says 172.21.15.133:39192) 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 -- 172.21.15.133:0/538891877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec0c8120 msgr2=0x7f34ec158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 --2- 172.21.15.133:0/538891877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec0c8120 0x7f34ec158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34eaffd700 1 -- 172.21.15.133:0/538891877 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786577960 0 0) 0x7f34ec0ab620 con 0x7f34ec154140 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 -- 172.21.15.133:0/538891877 >> v1:172.21.15.178:6789/0 conn(0x7f34ec154140 legacy=0x7f34ec0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 -- 172.21.15.133:0/538891877 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec0c0e40 con 0x7f34ec154520 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34f0c08700 1 --2- 172.21.15.133:0/538891877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec154520 0x7f34ec0ab130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f34e4009f20 tx=0x7f34e4009840).ready entity=mon.0 client_cookie=e78f8f2465c2cdb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34eaffd700 1 -- 172.21.15.133:0/538891877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400e070 con 0x7f34ec154520 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34eaffd700 1 -- 172.21.15.133:0/538891877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e400b9d0 con 0x7f34ec154520 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.274+0000 7f34eaffd700 1 -- 172.21.15.133:0/538891877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400bd50 con 0x7f34ec154520 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 -- 172.21.15.133:0/538891877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec154520 msgr2=0x7f34ec0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 --2- 172.21.15.133:0/538891877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec154520 0x7f34ec0ab130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f34e4009f20 tx=0x7f34e4009840).stop 2024-01-21T20:11:43.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 -- 172.21.15.133:0/538891877 shutdown_connections 2024-01-21T20:11:43.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 --2- 172.21.15.133:0/538891877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec154520 0x7f34ec0ab130 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 --2- 172.21.15.133:0/538891877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec0c8120 0x7f34ec158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 -- 172.21.15.133:0/538891877 >> 172.21.15.133:0/538891877 conn(0x7f34ec05e1e0 msgr2=0x7f34ec05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:43.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 -- 172.21.15.133:0/538891877 shutdown_connections 2024-01-21T20:11:43.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.275+0000 7f34f266b700 1 -- 172.21.15.133:0/538891877 wait complete. 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.276+0000 7f34f266b700 1 Processor -- start 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.276+0000 7f34f266b700 1 -- start start 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec154140 0x7f34ec156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec154520 0x7f34ec157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec164870 con 0x7f34ec0c8120 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec14d570 con 0x7f34ec154140 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f266b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0af040 con 0x7f34ec154520 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52794/0 (socket says 172.21.15.133:52794) 2024-01-21T20:11:43.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 -- 172.21.15.133:0/1702563691 learned_addr learned my addr 172.21.15.133:0/1702563691 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34eb7fe700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec154140 0x7f34ec156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34f0c08700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec154520 0x7f34ec157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec154520 msgr2=0x7f34ec157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec154520 0x7f34ec157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec154140 msgr2=0x7f34ec156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec154140 0x7f34ec156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 -- 172.21.15.133:0/1702563691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4009ae0 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.277+0000 7f34ebfff700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f34dc00c560 tx=0x7f34dc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.278+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0072e0 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.278+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc007440 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.278+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec0afea0 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.278+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0058f0 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.278+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec0af570 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.279+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec05fdf0 con 0x7f34ec0c8120 2024-01-21T20:11:43.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.279+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 11) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f34dc005ce0 con 0x7f34ec0c8120 2024-01-21T20:11:43.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.279+0000 7f34e8ff9700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 0x7f34d8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:43.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.280+0000 7f34eb7fe700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 msgr2=0x7f34d8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:43.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.280+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f34dc079f30 con 0x7f34ec0c8120 2024-01-21T20:11:43.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.280+0000 7f34eb7fe700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 0x7f34d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:11:43.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.284+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f34dc04ad60 con 0x7f34ec0c8120 2024-01-21T20:11:43.334 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:11:43.345+0000 7f26338a5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:11:43.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.481+0000 7f34eb7fe700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 msgr2=0x7f34d8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:11:43.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.481+0000 7f34eb7fe700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 0x7f34d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:11:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.501+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f34ec0aa980 con 0x7f34ec0c8120 2024-01-21T20:11:43.556 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.566+0000 7f5446e99680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:11:43.626 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.637+0000 7f5446e99680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:11:43.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.655+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 12) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f34dc077860 con 0x7f34ec0c8120 2024-01-21T20:11:43.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.655+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 msgr2=0x7f34d8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:11:43.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:43.655+0000 7f34e8ff9700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 0x7f34d8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:43.650 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T20:11:43.660+0000 7f103536a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:11:43.650 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T20:11:43.660+0000 7f103536a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:11:43.650 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T20:11:43.660+0000 7f103536a700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:11:43.664 INFO:tasks.ceph.mds.d.smithi178.stderr: -4> 2024-01-21T20:11:43.660+0000 7f103536a700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:11:43.664 INFO:tasks.ceph.mds.d.smithi178.stderr: -3> 2024-01-21T20:11:43.660+0000 7f103536a700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:11:43.664 INFO:tasks.ceph.mds.d.smithi178.stderr: -1> 2024-01-21T20:11:43.660+0000 7f103536a700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:11:43.683 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:11:43.704 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c344a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.704 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c344a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c344a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c344a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c344a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c0444700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c0444700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c0444700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.705 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c0444700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:43.706 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:11:43.715+0000 7f53c0444700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:11:44.086 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:11:44.096+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:11:44.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.099+0000 7f34e8ff9700 1 -- 172.21.15.133:0/1702563691 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34dc074180 con 0x7f34ec0c8120 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 msgr2=0x7f34ec14d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f34dc00c560 tx=0x7f34dc007c90).stop 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 shutdown_connections 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f34d805f270 0x7f34d8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34ec154520 0x7f34ec157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34ec0c8120 0x7f34ec14d080 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 --2- 172.21.15.133:0/1702563691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec154140 0x7f34ec156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 >> 172.21.15.133:0/1702563691 conn(0x7f34ec05e1e0 msgr2=0x7f34ec0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 shutdown_connections 2024-01-21T20:11:44.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.101+0000 7f34f266b700 1 -- 172.21.15.133:0/1702563691 wait complete. 2024-01-21T20:11:44.092 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:11:44.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:11:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.231+0000 7f7fa40b5700 1 Processor -- start 2024-01-21T20:11:44.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.231+0000 7f7fa40b5700 1 -- start start 2024-01-21T20:11:44.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa40b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:44.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa40b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9c0c64d0 con 0x7f7f9c13a9e0 2024-01-21T20:11:44.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa40b5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9c067f10 con 0x7f7f9c0c3840 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa40b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9c0681f0 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa1650700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa1650700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52872/0 (socket says 172.21.15.133:52872) 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.232+0000 7f7fa1650700 1 -- 172.21.15.133:0/2802761181 learned_addr learned my addr 172.21.15.133:0/2802761181 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa1650700 1 -- 172.21.15.133:0/2802761181 >> v1:172.21.15.178:6789/0 conn(0x7f7f9c0c3840 legacy=0x7f7f9c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa1650700 1 -- 172.21.15.133:0/2802761181 >> v1:172.21.15.133:6789/0 conn(0x7f7f9c13a9e0 legacy=0x7f7f9c0bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa1650700 1 -- 172.21.15.133:0/2802761181 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0684d0 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa1650700 1 --2- 172.21.15.133:0/2802761181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f7f8c006fd0 tx=0x7f7f8c0090f0).ready entity=mon.0 client_cookie=cf2bced8cd863ab9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa0e4f700 1 -- 172.21.15.133:0/2802761181 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00b600 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa0e4f700 1 -- 172.21.15.133:0/2802761181 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8c00b760 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa0e4f700 1 -- 172.21.15.133:0/2802761181 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00bb00 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa40b5700 1 -- 172.21.15.133:0/2802761181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3c20 msgr2=0x7f7f9c13a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/2802761181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f7f8c006fd0 tx=0x7f7f8c0090f0).stop 2024-01-21T20:11:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa40b5700 1 -- 172.21.15.133:0/2802761181 shutdown_connections 2024-01-21T20:11:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/2802761181 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13a4f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.233+0000 7f7fa40b5700 1 -- 172.21.15.133:0/2802761181 >> 172.21.15.133:0/2802761181 conn(0x7f7f9c066a70 msgr2=0x7f7f9c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.234+0000 7f7fa40b5700 1 -- 172.21.15.133:0/2802761181 shutdown_connections 2024-01-21T20:11:44.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.234+0000 7f7fa40b5700 1 -- 172.21.15.133:0/2802761181 wait complete. 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.235+0000 7f7fa40b5700 1 Processor -- start 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.235+0000 7f7fa40b5700 1 -- start start 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 0x7f7f9c138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c136a40 con 0x7f7f9c0c3840 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c1336d0 con 0x7f7f9c0c3c20 2024-01-21T20:11:44.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa40b5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c1356d0 con 0x7f7f9c13a9e0 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52878/0 (socket says 172.21.15.133:52878) 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 -- 172.21.15.133:0/1918944788 learned_addr learned my addr 172.21.15.133:0/1918944788 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1650700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa2652700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 0x7f7f9c138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 -- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 msgr2=0x7f7f9c138ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 0x7f7f9c138ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 -- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f9c0c3c20 msgr2=0x7f7f9c13da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa1e51700 1 -- 172.21.15.133:0/1918944788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c009370 con 0x7f7f9c0c3840 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.236+0000 7f7fa2652700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 0x7f7f9c138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7fa1e51700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7f9800c440 tx=0x7f7f98007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98012400 con 0x7f7f9c0c3840 2024-01-21T20:11:44.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98012560 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98012900 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c132ac0 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.237+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9c133100 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.238+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9c05fdf0 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.238+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 12) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f7f9801b3b0 con 0x7f7f9c0c3840 2024-01-21T20:11:44.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.238+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7136+0+0 (secure 0 0 0) 0x7f7f98079ad0 con 0x7f7f9c0c3840 2024-01-21T20:11:44.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.242+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7f9804ab20 con 0x7f7f9c0c3840 2024-01-21T20:11:44.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.444+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7f9c133420 con 0x7f7f9c0c3840 2024-01-21T20:11:44.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.658+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7f98077680 con 0x7f7f9c0c3840 2024-01-21T20:11:44.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.659+0000 7f7f927fc700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 0x7f7f80067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:44.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.659+0000 7f7fa1650700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 0x7f7f80067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:44.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:44.660+0000 7f7fa1650700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 0x7f7f80067ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f7f8c009130 tx=0x7f7f8c017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.106+0000 7f7f927fc700 1 -- 172.21.15.133:0/1918944788 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f980703d0 con 0x7f7f9c0c3840 2024-01-21T20:11:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 msgr2=0x7f7f80067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 0x7f7f80067ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f7f8c009130 tx=0x7f7f8c017000).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 msgr2=0x7f7f9c1351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7f9800c440 tx=0x7f7f98007db0).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 shutdown_connections 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7f800302f0 0x7f7f80067ff0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9c13a9e0 0x7f7f9c138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f9c0c3840 0x7f7f9c1351e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 --2- 172.21.15.133:0/1918944788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f9c0c3c20 0x7f7f9c13da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 >> 172.21.15.133:0/1918944788 conn(0x7f7f9c066a70 msgr2=0x7f7f9c153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:45.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 shutdown_connections 2024-01-21T20:11:45.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.108+0000 7f7fa40b5700 1 -- 172.21.15.133:0/1918944788 wait complete. 2024-01-21T20:11:45.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:11:45.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.249+0000 7f370a022700 1 Processor -- start 2024-01-21T20:11:45.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.249+0000 7f370a022700 1 -- start start 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f370a022700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37040656b0 0x7f37040a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f370a022700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3704152340 0x7f37040bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f370a022700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37040a6de0 con 0x7f3704151f60 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f370a022700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704065e20 con 0x7f37040656b0 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f370a022700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3704065b40 con 0x7f3704152340 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f3702ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37040656b0 0x7f37040a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f3702ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37040656b0 0x7f37040a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52886/0 (socket says 172.21.15.133:52886) 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.250+0000 7f3702ffd700 1 -- 172.21.15.133:0/162076807 learned_addr learned my addr 172.21.15.133:0/162076807 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3702ffd700 1 -- 172.21.15.133:0/162076807 >> v2:172.21.15.178:3300/0 conn(0x7f3704152340 msgr2=0x7f37040bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3703fff700 1 --2- 172.21.15.133:0/162076807 >> v2:172.21.15.178:3300/0 conn(0x7f3704152340 0x7f37040bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3702ffd700 1 --2- 172.21.15.133:0/162076807 >> v2:172.21.15.178:3300/0 conn(0x7f3704152340 0x7f37040bd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3702ffd700 1 -- 172.21.15.133:0/162076807 >> v1:172.21.15.178:6789/0 conn(0x7f3704151f60 legacy=0x7f3704063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3702ffd700 1 -- 172.21.15.133:0/162076807 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37040699e0 con 0x7f37040656b0 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f3702ffd700 1 --2- 172.21.15.133:0/162076807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37040656b0 0x7f37040a68f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f3704068830 tx=0x7f36f40090f0).ready entity=mon.0 client_cookie=ab3b413ad184873d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f37027fc700 1 -- 172.21.15.133:0/162076807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400b5a0 con 0x7f37040656b0 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f37027fc700 1 -- 172.21.15.133:0/162076807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f400b700 con 0x7f37040656b0 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f37027fc700 1 -- 172.21.15.133:0/162076807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f400baa0 con 0x7f37040656b0 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 -- 172.21.15.133:0/162076807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37040656b0 msgr2=0x7f37040a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 --2- 172.21.15.133:0/162076807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37040656b0 0x7f37040a68f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f3704068830 tx=0x7f36f40090f0).stop 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 -- 172.21.15.133:0/162076807 shutdown_connections 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 --2- 172.21.15.133:0/162076807 >> v2:172.21.15.178:3300/0 conn(0x7f3704152340 0x7f37040bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 --2- 172.21.15.133:0/162076807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37040656b0 0x7f37040a68f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.251+0000 7f370a022700 1 -- 172.21.15.133:0/162076807 >> 172.21.15.133:0/162076807 conn(0x7f37040c4a10 msgr2=0x7f3704068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.252+0000 7f370a022700 1 -- 172.21.15.133:0/162076807 shutdown_connections 2024-01-21T20:11:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.252+0000 7f370a022700 1 -- 172.21.15.133:0/162076807 wait complete. 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.253+0000 7f370a022700 1 Processor -- start 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.253+0000 7f370a022700 1 -- start start 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3704152340 0x7f37040a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37040a8ed0 0x7f37041657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040a7220 con 0x7f3704151f60 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37040bf880 con 0x7f37040a8ed0 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37040aa940 con 0x7f3704152340 2024-01-21T20:11:45.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52896/0 (socket says 172.21.15.133:52896) 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 -- 172.21.15.133:0/992924660 learned_addr learned my addr 172.21.15.133:0/992924660 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f3703fff700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37040a8ed0 0x7f37041657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f3702ffd700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3704152340 0x7f37040a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 -- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3704152340 msgr2=0x7f37040a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3704152340 0x7f37040a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 -- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37040a8ed0 msgr2=0x7f37041657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37040a8ed0 0x7f37041657d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 -- 172.21.15.133:0/992924660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f4009370 con 0x7f3704151f60 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f37037fe700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f36ec00b490 tx=0x7f36ec009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec012410 con 0x7f3704151f60 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec0125b0 con 0x7f3704151f60 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37040acda0 con 0x7f3704151f60 2024-01-21T20:11:45.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec012970 con 0x7f3704151f60 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.254+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37040ad360 con 0x7f3704151f60 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.255+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370405fdf0 con 0x7f3704151f60 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.256+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f36ec012d20 con 0x7f3704151f60 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.256+0000 7f36fbfff700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 0x7f36e40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.256+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7136+0+0 (secure 0 0 0) 0x7f36ec07a190 con 0x7f3704151f60 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.256+0000 7f3702ffd700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 0x7f36e40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:45.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.256+0000 7f3702ffd700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 0x7f36e40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36f4009130 tx=0x7f36f4015000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:45.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.260+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f36ec04b240 con 0x7f3704151f60 2024-01-21T20:11:45.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:45.425+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3704069cc0 con 0x7f3704151f60 2024-01-21T20:11:46.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.109+0000 7f36fbfff700 1 -- 172.21.15.133:0/992924660 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7f36ec04e860 con 0x7f3704151f60 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 msgr2=0x7f36e40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 0x7f36e40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f36f4009130 tx=0x7f36f4015000).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 msgr2=0x7f37040aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f36ec00b490 tx=0x7f36ec009060).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 shutdown_connections 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f36e405f030 0x7f36e40614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37040a8ed0 0x7f37041657d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3704151f60 0x7f37040aa450 secure :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0x7f36ec00b490 tx=0x7f36ec009060).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 --2- 172.21.15.133:0/992924660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3704152340 0x7f37040a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 >> 172.21.15.133:0/992924660 conn(0x7f37040c4a10 msgr2=0x7f37040c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 shutdown_connections 2024-01-21T20:11:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.116+0000 7f370a022700 1 -- 172.21.15.133:0/992924660 wait complete. 2024-01-21T20:11:46.109 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:11:46.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:11:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.257+0000 7f0eca190700 1 Processor -- start 2024-01-21T20:11:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.257+0000 7f0eca190700 1 -- start start 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0eca190700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 0x7f0ec4151f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0eca190700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40c4210 con 0x7f0ec40c3140 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0eca190700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4152480 con 0x7f0ec414edc0 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0eca190700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40c3600 con 0x7f0ec414e9e0 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0ec3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0ec40c3140 0x7f0ec40657d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50662/0 (socket says 172.21.15.133:50662) 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.258+0000 7f0ec3fff700 1 -- 172.21.15.133:0/80444497 learned_addr learned my addr 172.21.15.133:0/80444497 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec37fe700 1 --2- 172.21.15.133:0/80444497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 0x7f0ec4151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561408476 0 0) 0x7f0ec40c4210 con 0x7f0ec40c3140 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb00033f0 con 0x7f0ec40c3140 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357050976 0 0) 0x7f0ec4152480 con 0x7f0ec414edc0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec40c4210 con 0x7f0ec414edc0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3200503138 0 0) 0x7f0eb00033f0 con 0x7f0ec40c3140 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec37fe700 1 -- 172.21.15.133:0/80444497 >> v1:172.21.15.178:6789/0 conn(0x7f0ec414edc0 legacy=0x7f0ec40694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec37fe700 1 -- 172.21.15.133:0/80444497 >> v1:172.21.15.133:6789/0 conn(0x7f0ec40c3140 legacy=0x7f0ec40657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec37fe700 1 -- 172.21.15.133:0/80444497 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40c38e0 con 0x7f0ec414e9e0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec37fe700 1 --2- 172.21.15.133:0/80444497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 0x7f0ec4151f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0eac009790 tx=0x7f0eac009060).ready entity=mon.2 client_cookie=98bcaf743455bd64 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc0017f0 con 0x7f0ec414e9e0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac011400 con 0x7f0ec414e9e0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.259+0000 7f0ec27fc700 1 -- 172.21.15.133:0/80444497 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac011780 con 0x7f0ec414e9e0 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 -- 172.21.15.133:0/80444497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 msgr2=0x7f0ec4151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 --2- 172.21.15.133:0/80444497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 0x7f0ec4151f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0eac009790 tx=0x7f0eac009060).stop 2024-01-21T20:11:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 -- 172.21.15.133:0/80444497 shutdown_connections 2024-01-21T20:11:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 --2- 172.21.15.133:0/80444497 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414e9e0 0x7f0ec4151f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 -- 172.21.15.133:0/80444497 >> 172.21.15.133:0/80444497 conn(0x7f0ec40642d0 msgr2=0x7f0ec40c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 -- 172.21.15.133:0/80444497 shutdown_connections 2024-01-21T20:11:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.260+0000 7f0eca190700 1 -- 172.21.15.133:0/80444497 wait complete. 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.261+0000 7f0eca190700 1 Processor -- start 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.261+0000 7f0eca190700 1 -- start start 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec414e9e0 0x7f0ec40ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414edc0 0x7f0ec40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40ab530 con 0x7f0ec40c3140 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40a89e0 con 0x7f0ec414e9e0 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0eca190700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40a8cc0 con 0x7f0ec414edc0 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52910/0 (socket says 172.21.15.133:52910) 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 -- 172.21.15.133:0/1065211748 learned_addr learned my addr 172.21.15.133:0/1065211748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec3fff700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414edc0 0x7f0ec40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec2ffd700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec414e9e0 0x7f0ec40ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 -- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414edc0 msgr2=0x7f0ec40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414edc0 0x7f0ec40ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 -- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec414e9e0 msgr2=0x7f0ec40ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec414e9e0 0x7f0ec40ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.262+0000 7f0ec37fe700 1 -- 172.21.15.133:0/1065211748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0092a0 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0ec37fe700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0eac009d80 tx=0x7f0eac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0108e0 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac010a40 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec40a8fa0 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac010dc0 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.263+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40a86b0 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.264+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec40ab300 con 0x7f0ec40c3140 2024-01-21T20:11:46.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.264+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 13) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0eac01d640 con 0x7f0ec40c3140 2024-01-21T20:11:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.264+0000 7f0ebbfff700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 0x7f0ea40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.265+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6698+0+0 (secure 0 0 0) 0x7f0eac07b6a0 con 0x7f0ec40c3140 2024-01-21T20:11:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.265+0000 7f0ec2ffd700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 0x7f0ea40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.265+0000 7f0ec2ffd700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 0x7f0ea40614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0ec40aa0c0 tx=0x7f0eb4007bd0).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:46.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.269+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ec40ab300 con 0x7f0ec40c3140 2024-01-21T20:11:46.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.431+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ec40ab300 con 0x7f0ec40c3140 2024-01-21T20:11:46.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:46.666+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0eac079400 con 0x7f0ec40c3140 2024-01-21T20:11:47.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.112+0000 7f0ebbfff700 1 -- 172.21.15.133:0/1065211748 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0eac0429e0 con 0x7f0ec40c3140 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 msgr2=0x7f0ea40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 0x7f0ea40614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0ec40aa0c0 tx=0x7f0eb4007bd0).stop 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 msgr2=0x7f0ec40a81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f0eac009d80 tx=0x7f0eac016000).stop 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 shutdown_connections 2024-01-21T20:11:47.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ea405f030 0x7f0ea40614f0 secure :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0x7f0ec40aa0c0 tx=0x7f0eb4007bd0).stop 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ec414edc0 0x7f0ec40ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ec40c3140 0x7f0ec40a81c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 --2- 172.21.15.133:0/1065211748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec414e9e0 0x7f0ec40ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.115+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 >> 172.21.15.133:0/1065211748 conn(0x7f0ec40642d0 msgr2=0x7f0ec40bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.117+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 shutdown_connections 2024-01-21T20:11:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.117+0000 7f0eca190700 1 -- 172.21.15.133:0/1065211748 wait complete. 2024-01-21T20:11:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:11:47.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:11:47.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:11:47.120 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:11:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.287+0000 7fae0770b700 1 Processor -- start 2024-01-21T20:11:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.287+0000 7fae0770b700 1 -- start start 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae0770b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 0x7fae00154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae0770b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae000a9e30 0x7fae000bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae0770b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000654f0 con 0x7fae00065980 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae0770b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae00063700 con 0x7fae000a9e30 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae0770b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00063950 con 0x7fae001546b0 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae04ca6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae000a9e30 0x7fae000bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae05ca8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae00065980 0x7fae00065e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50678/0 (socket says 172.21.15.133:50678) 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae05ca8700 1 -- 172.21.15.133:0/1185095410 learned_addr learned my addr 172.21.15.133:0/1185095410 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.288+0000 7fae04ca6700 1 --2- 172.21.15.133:0/1185095410 >> v2:172.21.15.133:3300/0 conn(0x7fae000a9e30 0x7fae000bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52920/0 (socket says 172.21.15.133:52920) 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae054a7700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 0x7fae00154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae04ca6700 1 -- 172.21.15.133:0/1185095410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 msgr2=0x7fae00154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae04ca6700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 0x7fae00154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fadf7fff700 1 -- 172.21.15.133:0/1185095410 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459949014 0 0) 0x7fae000654f0 con 0x7fae00065980 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae04ca6700 1 -- 172.21.15.133:0/1185095410 >> v1:172.21.15.133:6789/0 conn(0x7fae00065980 legacy=0x7fae00065e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae04ca6700 1 -- 172.21.15.133:0/1185095410 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00065180 con 0x7fae000a9e30 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae054a7700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 0x7fae00154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae04ca6700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae000a9e30 0x7fae000bc6d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fadf0009760 tx=0x7fadf0009060).ready entity=mon.0 client_cookie=be22058cdeaf91fa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fadf7fff700 1 -- 172.21.15.133:0/1185095410 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf00090d0 con 0x7fae000a9e30 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fadf7fff700 1 -- 172.21.15.133:0/1185095410 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000b580 con 0x7fae000a9e30 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fadf7fff700 1 -- 172.21.15.133:0/1185095410 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000b900 con 0x7fae000a9e30 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 -- 172.21.15.133:0/1185095410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae000a9e30 msgr2=0x7fae000bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae000a9e30 0x7fae000bc6d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fadf0009760 tx=0x7fadf0009060).stop 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 -- 172.21.15.133:0/1185095410 shutdown_connections 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae001546b0 0x7fae00154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 --2- 172.21.15.133:0/1185095410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae000a9e30 0x7fae000bc6d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.289+0000 7fae0770b700 1 -- 172.21.15.133:0/1185095410 >> 172.21.15.133:0/1185095410 conn(0x7fae000c8200 msgr2=0x7fae000c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.290+0000 7fae0770b700 1 -- 172.21.15.133:0/1185095410 shutdown_connections 2024-01-21T20:11:47.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.290+0000 7fae0770b700 1 -- 172.21.15.133:0/1185095410 wait complete. 2024-01-21T20:11:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 Processor -- start 2024-01-21T20:11:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 -- start start 2024-01-21T20:11:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae00065980 0x7fae0013e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae000a9e30 0x7fae0014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0014f670 con 0x7fae001546b0 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0013eb00 con 0x7fae000a9e30 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.291+0000 7fae0770b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000aae10 con 0x7fae00065980 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52924/0 (socket says 172.21.15.133:52924) 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 -- 172.21.15.133:0/1130500879 learned_addr learned my addr 172.21.15.133:0/1130500879 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 -- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae00065980 msgr2=0x7fae0013e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae054a7700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae00065980 0x7fae0013e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae00065980 0x7fae0013e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 -- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae000a9e30 msgr2=0x7fae0014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae000a9e30 0x7fae0014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 -- 172.21.15.133:0/1130500879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00092a0 con 0x7fae001546b0 2024-01-21T20:11:47.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae05ca8700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fadf800c760 tx=0x7fadf8001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8005d30 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8005e90 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae000ab0f0 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8007340 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.292+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0014f150 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.293+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0014f340 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.294+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fadf80076f0 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.294+0000 7fadf5ffb700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 0x7fade4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.294+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7fadf807a290 con 0x7fae001546b0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.294+0000 7fae054a7700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 0x7fade4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.294+0000 7fae054a7700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 0x7fade4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fadfc00b850 tx=0x7fadfc008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.298+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fadf804b4e0 con 0x7fae001546b0 2024-01-21T20:11:47.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.462+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fae0005fdf0 con 0x7fae001546b0 2024-01-21T20:11:47.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.466+0000 7fadf5ffb700 1 -- 172.21.15.133:0/1130500879 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v4) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadf80079a0 con 0x7fae001546b0 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 msgr2=0x7fade4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 0x7fade4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fadfc00b850 tx=0x7fadfc008040).stop 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 msgr2=0x7fae0014df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fadf800c760 tx=0x7fadf8001520).stop 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 shutdown_connections 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fade405f150 0x7fade4061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae001546b0 0x7fae0014df50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae00065980 0x7fae0013e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 --2- 172.21.15.133:0/1130500879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae000a9e30 0x7fae0014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:47.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 >> 172.21.15.133:0/1130500879 conn(0x7fae000c8200 msgr2=0x7fae000bcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 shutdown_connections 2024-01-21T20:11:47.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.468+0000 7fae0770b700 1 -- 172.21.15.133:0/1130500879 wait complete. 2024-01-21T20:11:47.469 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:11:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.596+0000 7f3b377d2700 1 Processor -- start 2024-01-21T20:11:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.596+0000 7f3b377d2700 1 -- start start 2024-01-21T20:11:47.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.597+0000 7f3b377d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b30062ff0 0x7f3b30065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.597+0000 7f3b377d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b30069ef0 con 0x7f3b30065b50 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.597+0000 7f3b377d2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b30065fe0 con 0x7f3b30062c10 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.597+0000 7f3b377d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3006a130 con 0x7f3b30062ff0 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.597+0000 7f3b34d6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b30062ff0 0x7f3b30065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b30062ff0 0x7f3b30065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52930/0 (socket says 172.21.15.133:52930) 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 -- 172.21.15.133:0/223710000 learned_addr learned my addr 172.21.15.133:0/223710000 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b35d6f700 1 --1- 172.21.15.133:0/223710000 >> v1:172.21.15.133:6789/0 conn(0x7f3b30065b50 0x7f3b300bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50688/0 (socket says 172.21.15.133:50688) 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 -- 172.21.15.133:0/223710000 >> v1:172.21.15.178:6789/0 conn(0x7f3b30062c10 legacy=0x7f3b300697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 -- 172.21.15.133:0/223710000 >> v1:172.21.15.133:6789/0 conn(0x7f3b30065b50 legacy=0x7f3b300bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b27fff700 1 -- 172.21.15.133:0/223710000 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1726969187 0 0) 0x7f3b28001490 con 0x7f3b30065b50 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 -- 172.21.15.133:0/223710000 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3006a410 con 0x7f3b30062ff0 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b34d6d700 1 --2- 172.21.15.133:0/223710000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30062ff0 0x7f3b30065660 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f3b2c006fd0 tx=0x7f3b2c0090f0).ready entity=mon.0 client_cookie=186c33df6dd2b7cf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b27fff700 1 -- 172.21.15.133:0/223710000 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00b600 con 0x7f3b30062ff0 2024-01-21T20:11:47.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b27fff700 1 -- 172.21.15.133:0/223710000 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c00b760 con 0x7f3b30062ff0 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.598+0000 7f3b27fff700 1 -- 172.21.15.133:0/223710000 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00bb00 con 0x7f3b30062ff0 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 -- 172.21.15.133:0/223710000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30062ff0 msgr2=0x7f3b30065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 --2- 172.21.15.133:0/223710000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30062ff0 0x7f3b30065660 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f3b2c006fd0 tx=0x7f3b2c0090f0).stop 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 -- 172.21.15.133:0/223710000 shutdown_connections 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 --2- 172.21.15.133:0/223710000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30062ff0 0x7f3b30065660 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 -- 172.21.15.133:0/223710000 >> 172.21.15.133:0/223710000 conn(0x7f3b300c8010 msgr2=0x7f3b300c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 -- 172.21.15.133:0/223710000 shutdown_connections 2024-01-21T20:11:47.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.599+0000 7f3b377d2700 1 -- 172.21.15.133:0/223710000 wait complete. 2024-01-21T20:11:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.600+0000 7f3b377d2700 1 Processor -- start 2024-01-21T20:11:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.600+0000 7f3b377d2700 1 -- start start 2024-01-21T20:11:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062c10 0x7f3b3013a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b30062ff0 0x7f3b300acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300ad570 con 0x7f3b30065b50 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300aafc0 con 0x7f3b30062ff0 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b377d2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300abb40 con 0x7f3b30062c10 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.601+0000 7f3b35d6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52934/0 (socket says 172.21.15.133:52934) 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 -- 172.21.15.133:0/3925177028 learned_addr learned my addr 172.21.15.133:0/3925177028 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b34d6d700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b30062ff0 0x7f3b300acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b3556e700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062c10 0x7f3b3013a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 -- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062c10 msgr2=0x7f3b3013a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062c10 0x7f3b3013a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 -- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b30062ff0 msgr2=0x7f3b300acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b30062ff0 0x7f3b300acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.602+0000 7f3b35d6f700 1 -- 172.21.15.133:0/3925177028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009370 con 0x7f3b30065b50 2024-01-21T20:11:47.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.606+0000 7f3b35d6f700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f3b2800c810 tx=0x7f3b28007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.606+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28005c70 con 0x7f3b30065b50 2024-01-21T20:11:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.606+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b300abfd0 con 0x7f3b30065b50 2024-01-21T20:11:47.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.607+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b300ab4f0 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.607+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b28007110 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.607+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b28007280 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.608+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3b280076b0 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.608+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b10005120 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.609+0000 7f3b25ffb700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 0x7f3b14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.609+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f3b28079fb0 con 0x7f3b30065b50 2024-01-21T20:11:47.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.609+0000 7f3b3556e700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 0x7f3b14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.610+0000 7f3b3556e700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 0x7f3b14061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3b30168180 tx=0x7f3b20008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.615+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b2804b1a0 con 0x7f3b30065b50 2024-01-21T20:11:47.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.785+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3b10005d70 con 0x7f3b30065b50 2024-01-21T20:11:47.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.788+0000 7f3b25ffb700 1 -- 172.21.15.133:0/3925177028 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v5) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3b28007e60 con 0x7f3b30065b50 2024-01-21T20:11:47.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 msgr2=0x7f3b14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 0x7f3b14061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3b30168180 tx=0x7f3b20008040).stop 2024-01-21T20:11:47.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 msgr2=0x7f3b300ad080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f3b2800c810 tx=0x7f3b28007dd0).stop 2024-01-21T20:11:47.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 shutdown_connections 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b1405f150 0x7f3b14061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b30065b50 0x7f3b300ad080 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b30062c10 0x7f3b3013a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 --2- 172.21.15.133:0/3925177028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b30062ff0 0x7f3b300acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 >> 172.21.15.133:0/3925177028 conn(0x7f3b300c8010 msgr2=0x7f3b300c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 shutdown_connections 2024-01-21T20:11:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.790+0000 7f3b377d2700 1 -- 172.21.15.133:0/3925177028 wait complete. 2024-01-21T20:11:47.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-01-21T20:11:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.919+0000 7f3d87dbc700 1 Processor -- start 2024-01-21T20:11:47.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.919+0000 7f3d87dbc700 1 -- start start 2024-01-21T20:11:47.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d87dbc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d80062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d87dbc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d80065d70 0x7f3d800bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d87dbc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800634e0 con 0x7f3d800697e0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d87dbc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8006a130 con 0x7f3d80065d70 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d87dbc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8006a410 con 0x7f3d80062c10 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d85357700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3d800697e0 0x7f3d80065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50696/0 (socket says 172.21.15.133:50696) 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d85357700 1 -- 172.21.15.133:0/543501752 learned_addr learned my addr 172.21.15.133:0/543501752 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d86359700 1 --2- 172.21.15.133:0/543501752 >> v2:172.21.15.178:3300/0 conn(0x7f3d80065d70 0x7f3d800bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297656875 0 0) 0x7f3d800634e0 con 0x7f3d800697e0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d85b58700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d80062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c0033f0 con 0x7f3d800697e0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4180468075 0 0) 0x7f3d6c0033f0 con 0x7f3d800697e0 2024-01-21T20:11:47.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 msgr2=0x7f3d80062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d80062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 >> v2:172.21.15.178:3300/0 conn(0x7f3d80065d70 msgr2=0x7f3d800bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 --2- 172.21.15.133:0/543501752 >> v2:172.21.15.178:3300/0 conn(0x7f3d80065d70 0x7f3d800bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8006a6f0 con 0x7f3d800697e0 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3d70001470 con 0x7f3d800697e0 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 >> v1:172.21.15.133:6789/0 conn(0x7f3d800697e0 legacy=0x7f3d80065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.920+0000 7f3d84b56700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c0038e0 0x7f3d6c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d6c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c004b80 0x7f3d6c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8006a130 con 0x7f3d6c0038e0 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8006a410 con 0x7f3d6c004b80 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c00b8e0 con 0x7f3d80062c10 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c0038e0 0x7f3d6c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85357700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d6c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d86359700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c004b80 0x7f3d6c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 -- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 msgr2=0x7f3d6c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d80062c10 0x7f3d6c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 -- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c004b80 msgr2=0x7f3d6c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c004b80 0x7f3d6c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 -- 172.21.15.133:0/543501752 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0033f0 con 0x7f3d6c0038e0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d85b58700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c0038e0 0x7f3d6c003d00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f3d7c009a80 tx=0x7f3d7c009060).ready entity=mon.0 client_cookie=d4922dbf3fada264 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c009430 con 0x7f3d6c0038e0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00e640 con 0x7f3d6c0038e0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.921+0000 7f3d84b56700 1 -- 172.21.15.133:0/543501752 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00e9c0 con 0x7f3d6c0038e0 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 -- 172.21.15.133:0/543501752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c0038e0 msgr2=0x7f3d6c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/543501752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d6c0038e0 0x7f3d6c003d00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f3d7c009a80 tx=0x7f3d7c009060).stop 2024-01-21T20:11:47.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d86359700 1 -- 172.21.15.133:0/543501752 reap_dead start 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 -- 172.21.15.133:0/543501752 shutdown_connections 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 -- 172.21.15.133:0/543501752 >> 172.21.15.133:0/543501752 conn(0x7f3d800c8010 msgr2=0x7f3d800c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 -- 172.21.15.133:0/543501752 shutdown_connections 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.922+0000 7f3d87dbc700 1 -- 172.21.15.133:0/543501752 wait complete. 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.923+0000 7f3d87dbc700 1 Processor -- start 2024-01-21T20:11:47.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.923+0000 7f3d87dbc700 1 -- start start 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 0x7f3d800bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d8013cb60 0x7f3d800ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800acb20 con 0x7f3d8013cfc0 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80158ce0 con 0x7f3d6c0038e0 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80158720 con 0x7f3d8013cb60 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52958/0 (socket says 172.21.15.133:52958) 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 -- 172.21.15.133:0/2409189966 learned_addr learned my addr 172.21.15.133:0/2409189966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d85357700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d8013cb60 0x7f3d800ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d85b58700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 0x7f3d800bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 -- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d8013cb60 msgr2=0x7f3d800ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d8013cb60 0x7f3d800ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 -- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 msgr2=0x7f3d800bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 0x7f3d800bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 -- 172.21.15.133:0/2409189966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80158a00 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d85b58700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 0x7f3d800bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d86359700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3d800c5e10 tx=0x7f3d7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800e070 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78011c30 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d800a8fe0 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78016450 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.924+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d80157930 con 0x7f3d8013cfc0 2024-01-21T20:11:47.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.925+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d800a8e40 con 0x7f3d8013cfc0 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.926+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3d78016800 con 0x7f3d8013cfc0 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.926+0000 7f3d767fc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 0x7f3d64061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.926+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f3d7807a4d0 con 0x7f3d8013cfc0 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.926+0000 7f3d85b58700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 0x7f3d64061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.926+0000 7f3d85b58700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 0x7f3d64061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3d7c006d50 tx=0x7f3d7c01a000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:47.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:47.930+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d800a8e40 con 0x7f3d8013cfc0 2024-01-21T20:11:48.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:48.158+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f3d800a8e40 con 0x7f3d8013cfc0 2024-01-21T20:11:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.118+0000 7f3d767fc700 1 -- 172.21.15.133:0/2409189966 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v444) v1 ==== 158+0+0 (secure 0 0 0) 0x7f3d800a8e40 con 0x7f3d8013cfc0 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 msgr2=0x7f3d64061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 0x7f3d64061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3d7c006d50 tx=0x7f3d7c01a000).stop 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 msgr2=0x7f3d800ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3d800c5e10 tx=0x7f3d7800b040).stop 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 shutdown_connections 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d6405f180 0x7f3d64061640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d8013cfc0 0x7f3d800ac630 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6c0038e0 0x7f3d800bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 --2- 172.21.15.133:0/2409189966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d8013cb60 0x7f3d800ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 >> 172.21.15.133:0/2409189966 conn(0x7f3d800c8010 msgr2=0x7f3d800be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 shutdown_connections 2024-01-21T20:11:49.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.121+0000 7f3d87dbc700 1 -- 172.21.15.133:0/2409189966 wait complete. 2024-01-21T20:11:49.125 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2024-01-21T20:11:49.125 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2024-01-21T20:11:49.125 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:11:49.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2024-01-21T20:11:49.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.258+0000 7f1800f28700 1 Processor -- start 2024-01-21T20:11:49.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.258+0000 7f1800f28700 1 -- start start 2024-01-21T20:11:49.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17fc137030 0x7f17fc067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17fc137410 0x7f17fc155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5930 0x7f17fc0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc0c6290 con 0x7f17fc137410 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc1557f0 con 0x7f17fc137030 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f1800f28700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc068370 con 0x7f17fc0c5930 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17fc137410 0x7f17fc155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17fc137410 0x7f17fc155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52964/0 (socket says 172.21.15.133:52964) 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 -- 172.21.15.133:0/2283780829 learned_addr learned my addr 172.21.15.133:0/2283780829 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17fa59c700 1 --2- 172.21.15.133:0/2283780829 >> v2:172.21.15.178:3300/0 conn(0x7f17fc137030 0x7f17fc067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17fad9d700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5930 0x7f17fc0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 -- 172.21.15.133:0/2283780829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5930 msgr2=0x7f17fc0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5930 0x7f17fc0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 -- 172.21.15.133:0/2283780829 >> v2:172.21.15.178:3300/0 conn(0x7f17fc137030 msgr2=0x7f17fc067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/2283780829 >> v2:172.21.15.178:3300/0 conn(0x7f17fc137030 0x7f17fc067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.259+0000 7f17f9d9b700 1 -- 172.21.15.133:0/2283780829 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc068650 con 0x7f17fc137410 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc137410 0x7f17fc155300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f17fc0c8e10 tx=0x7f17ec0090f0).ready entity=mon.0 client_cookie=bef393bf570684ea server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f17f959a700 1 -- 172.21.15.133:0/2283780829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00b600 con 0x7f17fc137410 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f17f959a700 1 -- 172.21.15.133:0/2283780829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00b760 con 0x7f17fc137410 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f17f959a700 1 -- 172.21.15.133:0/2283780829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00bb00 con 0x7f17fc137410 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 -- 172.21.15.133:0/2283780829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc137410 msgr2=0x7f17fc155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc137410 0x7f17fc155300 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f17fc0c8e10 tx=0x7f17ec0090f0).stop 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 -- 172.21.15.133:0/2283780829 shutdown_connections 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5930 0x7f17fc0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 --2- 172.21.15.133:0/2283780829 >> v2:172.21.15.178:3300/0 conn(0x7f17fc137030 0x7f17fc067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 --2- 172.21.15.133:0/2283780829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc137410 0x7f17fc155300 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 -- 172.21.15.133:0/2283780829 >> 172.21.15.133:0/2283780829 conn(0x7f17fc066a90 msgr2=0x7f17fc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 -- 172.21.15.133:0/2283780829 shutdown_connections 2024-01-21T20:11:49.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.260+0000 7f1800f28700 1 -- 172.21.15.133:0/2283780829 wait complete. 2024-01-21T20:11:49.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 Processor -- start 2024-01-21T20:11:49.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 -- start start 2024-01-21T20:11:49.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc137030 0x7f17fc13c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 0x7f17fc13c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0c0690 con 0x7f17fc0c5930 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0c2000 con 0x7f17fc137410 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f1800f28700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc167ec0 con 0x7f17fc137030 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.262+0000 7f17fa59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52974/0 (socket says 172.21.15.133:52974) 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 -- 172.21.15.133:0/3309080264 learned_addr learned my addr 172.21.15.133:0/3309080264 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fad9d700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 0x7f17fc13c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc137030 0x7f17fc13c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 -- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc137030 msgr2=0x7f17fc13c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc137030 0x7f17fc13c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 -- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 msgr2=0x7f17fc13c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 0x7f17fc13c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 -- 172.21.15.133:0/3309080264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec009370 con 0x7f17fc0c5930 2024-01-21T20:11:49.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fad9d700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 0x7f17fc13c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17fa59c700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f17f000d8c0 tx=0x7f17f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00095b0 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0009710 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc1681a0 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0009a90 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.263+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc0c0320 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.264+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc0bfe70 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.264+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f17f0013480 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.265+0000 7f17eaffd700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 0x7f17dc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.265+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f17f007a2d0 con 0x7f17fc0c5930 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.265+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 0x7f17dc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.265+0000 7f17f9d9b700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 0x7f17dc061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f17ec009fd0 tx=0x7f17ec017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.269+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f17f004b4c0 con 0x7f17fc0c5930 2024-01-21T20:11:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:49.498+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f17fc06bd20 con 0x7f17fc0c5930 2024-01-21T20:11:50.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.123+0000 7f17eaffd700 1 -- 172.21.15.133:0/3309080264 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v445) v1 ==== 157+0+0 (secure 0 0 0) 0x7f17f004eae0 con 0x7f17fc0c5930 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 msgr2=0x7f17dc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 0x7f17dc061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f17ec009fd0 tx=0x7f17ec017000).stop 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 msgr2=0x7f17fc13d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f17f000d8c0 tx=0x7f17f0008040).stop 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 shutdown_connections 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f17dc05f150 0x7f17dc061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc137410 0x7f17fc13c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17fc0c5930 0x7f17fc13d3f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 --2- 172.21.15.133:0/3309080264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc137030 0x7f17fc13c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 >> 172.21.15.133:0/3309080264 conn(0x7f17fc066a90 msgr2=0x7f17fc1559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:50.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 shutdown_connections 2024-01-21T20:11:50.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.126+0000 7f1800f28700 1 -- 172.21.15.133:0/3309080264 wait complete. 2024-01-21T20:11:50.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:11:50.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.264+0000 7fca4d298700 1 Processor -- start 2024-01-21T20:11:50.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.264+0000 7fca4d298700 1 -- start start 2024-01-21T20:11:50.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca4d298700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca4813a830 0x7fca480c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca4d298700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 0x7fca480699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca4d298700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca480c3890 con 0x7fca4813ac10 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca4d298700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca480c3b70 con 0x7fca4813a830 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca4d298700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca480c3e50 con 0x7fca480695b0 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca46ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca4813a830 0x7fca480c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca46ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca4813a830 0x7fca480c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42648/0 (socket says 172.21.15.133:42648) 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.265+0000 7fca46ffd700 1 -- 172.21.15.133:0/2984414724 learned_addr learned my addr 172.21.15.133:0/2984414724 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca477fe700 1 --2- 172.21.15.133:0/2984414724 >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 0x7fca480699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca46ffd700 1 -- 172.21.15.133:0/2984414724 >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 msgr2=0x7fca480699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca46ffd700 1 --2- 172.21.15.133:0/2984414724 >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 0x7fca480699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca46ffd700 1 -- 172.21.15.133:0/2984414724 >> v1:172.21.15.178:6789/0 conn(0x7fca4813ac10 legacy=0x7fca480bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca46ffd700 1 -- 172.21.15.133:0/2984414724 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca480c4130 con 0x7fca4813a830 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca477fe700 1 --2- 172.21.15.133:0/2984414724 >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 0x7fca480699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca46ffd700 1 --2- 172.21.15.133:0/2984414724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813a830 0x7fca480c3220 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fca480c2450 tx=0x7fca3c0090f0).ready entity=mon.0 client_cookie=a4be2656ec980ead server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca45ffb700 1 -- 172.21.15.133:0/2984414724 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00b5a0 con 0x7fca4813a830 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca45ffb700 1 -- 172.21.15.133:0/2984414724 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00b700 con 0x7fca4813a830 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca45ffb700 1 -- 172.21.15.133:0/2984414724 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00baa0 con 0x7fca4813a830 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 -- 172.21.15.133:0/2984414724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813a830 msgr2=0x7fca480c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 --2- 172.21.15.133:0/2984414724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813a830 0x7fca480c3220 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fca480c2450 tx=0x7fca3c0090f0).stop 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 -- 172.21.15.133:0/2984414724 shutdown_connections 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 --2- 172.21.15.133:0/2984414724 >> v2:172.21.15.178:3300/0 conn(0x7fca480695b0 0x7fca480699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 --2- 172.21.15.133:0/2984414724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813a830 0x7fca480c3220 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 -- 172.21.15.133:0/2984414724 >> 172.21.15.133:0/2984414724 conn(0x7fca480c7dc0 msgr2=0x7fca480c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 -- 172.21.15.133:0/2984414724 shutdown_connections 2024-01-21T20:11:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.266+0000 7fca4d298700 1 -- 172.21.15.133:0/2984414724 wait complete. 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.268+0000 7fca4d298700 1 Processor -- start 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.268+0000 7fca4d298700 1 -- start start 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480695b0 0x7fca480bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca4813a830 0x7fca481509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c1d40 con 0x7fca4813ac10 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c18b0 con 0x7fca480695b0 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c0ca0 con 0x7fca4813a830 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42650/0 (socket says 172.21.15.133:42650) 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 -- 172.21.15.133:0/2294180012 learned_addr learned my addr 172.21.15.133:0/2294180012 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 -- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca4813a830 msgr2=0x7fca481509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca4813a830 0x7fca481509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 -- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480695b0 msgr2=0x7fca480bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480695b0 0x7fca480bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 -- 172.21.15.133:0/2294180012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009370 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca477fe700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fca4000cef0 tx=0x7fca40007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000ae00 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40016400 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca480c0f80 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40016780 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.269+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca480c1540 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.270+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4805fdf0 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.271+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fca400203f0 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.271+0000 7fca2f7fe700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 0x7fca34061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.271+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7fca4007acc0 con 0x7fca4813ac10 2024-01-21T20:11:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.271+0000 7fca46ffd700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 0x7fca34061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.271+0000 7fca46ffd700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 0x7fca34061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fca3c009130 tx=0x7fca3c015000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.275+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca4004beb0 con 0x7fca4813ac10 2024-01-21T20:11:50.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.439+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fca480c1a20 con 0x7fca4813ac10 2024-01-21T20:11:50.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.443+0000 7fca2f7fe700 1 -- 172.21.15.133:0/2294180012 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca480c1a20 con 0x7fca4813ac10 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 msgr2=0x7fca34061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 0x7fca34061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fca3c009130 tx=0x7fca3c015000).stop 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 msgr2=0x7fca480c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fca4000cef0 tx=0x7fca40007860).stop 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 shutdown_connections 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f150 0x7fca34061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4813ac10 0x7fca480c81a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480695b0 0x7fca480bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:50.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 --2- 172.21.15.133:0/2294180012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca4813a830 0x7fca481509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:50.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 >> 172.21.15.133:0/2294180012 conn(0x7fca480c7dc0 msgr2=0x7fca48154060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:50.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 shutdown_connections 2024-01-21T20:11:50.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.445+0000 7fca4d298700 1 -- 172.21.15.133:0/2294180012 wait complete. 2024-01-21T20:11:50.446 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:11:50.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:11:50.487 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:11:50.534 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:11:50.534 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:11:50.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.660+0000 7f12ee3fb700 1 Processor -- start 2024-01-21T20:11:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.660+0000 7f12ee3fb700 1 -- start start 2024-01-21T20:11:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ee3fb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 0x7f12e8153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ee3fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12e80626f0 0x7f12e8062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ee3fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e8153750 con 0x7f12e8155d30 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ee3fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80671e0 con 0x7f12e80626f0 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ee3fb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e8063060 con 0x7f12e8066e00 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12e80626f0 0x7f12e8062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12e80626f0 0x7f12e8062b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42652/0 (socket says 172.21.15.133:42652) 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 -- 172.21.15.133:0/3658095040 learned_addr learned my addr 172.21.15.133:0/3658095040 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12ec998700 1 --1- 172.21.15.133:0/3658095040 >> v1:172.21.15.133:6789/0 conn(0x7f12e8155d30 0x7f12e8156170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40130/0 (socket says 172.21.15.133:40130) 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e7fff700 1 --2- 172.21.15.133:0/3658095040 >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 0x7f12e8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 -- 172.21.15.133:0/3658095040 >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 msgr2=0x7f12e8153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3658095040 >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 0x7f12e8153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 -- 172.21.15.133:0/3658095040 >> v1:172.21.15.133:6789/0 conn(0x7f12e8155d30 legacy=0x7f12e8156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 -- 172.21.15.133:0/3658095040 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80662e0 con 0x7f12e80626f0 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e6ffd700 1 -- 172.21.15.133:0/3658095040 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493304350 0 0) 0x7f12e8153750 con 0x7f12e8155d30 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e7fff700 1 --2- 172.21.15.133:0/3658095040 >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 0x7f12e8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3658095040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80626f0 0x7f12e8062b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f12e80c4660 tx=0x7f12dc0090f0).ready entity=mon.0 client_cookie=a7dce809109a66fa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e6ffd700 1 -- 172.21.15.133:0/3658095040 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00b600 con 0x7f12e80626f0 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e6ffd700 1 -- 172.21.15.133:0/3658095040 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00b760 con 0x7f12e80626f0 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.661+0000 7f12e6ffd700 1 -- 172.21.15.133:0/3658095040 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00bb00 con 0x7f12e80626f0 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3658095040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80626f0 msgr2=0x7f12e8062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3658095040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80626f0 0x7f12e8062b70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f12e80c4660 tx=0x7f12dc0090f0).stop 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3658095040 shutdown_connections 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3658095040 >> v2:172.21.15.178:3300/0 conn(0x7f12e8066e00 0x7f12e8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3658095040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e80626f0 0x7f12e8062b70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3658095040 >> 172.21.15.133:0/3658095040 conn(0x7f12e80c7dc0 msgr2=0x7f12e80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3658095040 shutdown_connections 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.662+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3658095040 wait complete. 2024-01-21T20:11:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.663+0000 7f12ee3fb700 1 Processor -- start 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.663+0000 7f12ee3fb700 1 -- start start 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e80626f0 0x7f12e8163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 0x7f12e80abec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80adb30 con 0x7f12e8066e00 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81645c0 con 0x7f12e80626f0 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ee3fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81648a0 con 0x7f12e8155d30 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42654/0 (socket says 172.21.15.133:42654) 2024-01-21T20:11:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 -- 172.21.15.133:0/3786442613 learned_addr learned my addr 172.21.15.133:0/3786442613 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e7fff700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e80626f0 0x7f12e8163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ec998700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 0x7f12e80abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 -- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 msgr2=0x7f12e80abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 0x7f12e80abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 -- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e80626f0 msgr2=0x7f12e8163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e80626f0 0x7f12e8163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 -- 172.21.15.133:0/3786442613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009370 con 0x7f12e8066e00 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12ec998700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 0x7f12e80abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.664+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f12e8068de0 tx=0x7f12dc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.665+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc006970 con 0x7f12e8066e00 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.665+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00bec0 con 0x7f12e8066e00 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.665+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00bb00 con 0x7f12e8066e00 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.665+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8164b80 con 0x7f12e8066e00 2024-01-21T20:11:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.665+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80a4970 con 0x7f12e8066e00 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.666+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e805fdf0 con 0x7f12e8066e00 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.666+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f12dc021070 con 0x7f12e8066e00 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.666+0000 7f12e4ff9700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 0x7f12d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.666+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6255+0+0 (secure 0 0 0) 0x7f12dc07bd70 con 0x7f12e8066e00 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.666+0000 7f12e7fff700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 0x7f12d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.667+0000 7f12e7fff700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 0x7f12d4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f12e81674a0 tx=0x7f12d8008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.670+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f12dc04d070 con 0x7f12e8066e00 2024-01-21T20:11:50.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.875+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12e8063450 con 0x7f12e8066e00 2024-01-21T20:11:50.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.876+0000 7f12e4ff9700 1 -- 172.21.15.133:0/3786442613 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f12dc029070 con 0x7f12e8066e00 2024-01-21T20:11:50.866 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:50.866 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":14,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3743439414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3743439414},{"type":"v1","addr":"172.21.15.133:6836","nonce":3743439414}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4807,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1346397322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1346397322},{"type":"v1","addr":"172.21.15.178:6834","nonce":1346397322}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4971,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1112168142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1112168142},{"type":"v1","addr":"172.21.15.133:6837","nonce":1112168142}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2552475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2552475847},{"type":"v1","addr":"172.21.15.178:6835","nonce":2552475847}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 msgr2=0x7f12d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 0x7f12d4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f12e81674a0 tx=0x7f12d8008040).stop 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 msgr2=0x7f12e80a5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f12e8068de0 tx=0x7f12dc017000).stop 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 shutdown_connections 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12d405f150 0x7f12d4061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e8155d30 0x7f12e80abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e80626f0 0x7f12e8163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 --2- 172.21.15.133:0/3786442613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12e8066e00 0x7f12e80a5d50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 >> 172.21.15.133:0/3786442613 conn(0x7f12e80c7dc0 msgr2=0x7f12e81555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 shutdown_connections 2024-01-21T20:11:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:50.878+0000 7f12ee3fb700 1 -- 172.21.15.133:0/3786442613 wait complete. 2024-01-21T20:11:50.869 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 14 2024-01-21T20:11:50.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:11:50.880 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:11:50.880 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:11:50.880 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:11:50.881 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:11:50.881 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:11:50.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:11:50.881 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:11:50.881 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:11:50.881 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:11:50.881 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:11:50.881 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:11:50.882 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:11:50.882 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:11:50.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:11:50.882 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:11:50.891 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:11:50.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:11:50.892 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:11:50.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:11:50.893 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:11:50.894 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:11:50.894 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:11:50.894 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:11:50.934 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:11:50.934 DEBUG:teuthology.parallel:result is None 2024-01-21T20:11:50.935 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:11:50.935 DEBUG:teuthology.parallel:result is None 2024-01-21T20:11:50.936 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:11:50.936 DEBUG:teuthology.parallel:result is None 2024-01-21T20:11:50.937 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:11:50.937 DEBUG:teuthology.parallel:result is None 2024-01-21T20:11:50.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:11:51.009 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:11:51.010 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:11:51.021 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:11:51.022 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:11:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.074+0000 7fc54d8ca700 1 Processor -- start 2024-01-21T20:11:51.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.074+0000 7fc54d8ca700 1 -- start start 2024-01-21T20:11:51.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc54d8ca700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc548158bb0 0x7fc548154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc54d8ca700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480c0e40 con 0x7fc5480c8120 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc54d8ca700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5480c6800 con 0x7fc548154140 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc54d8ca700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc548154a10 con 0x7fc548158bb0 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc5467fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc5480c8120 0x7fc5480c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40132/0 (socket says 172.21.15.133:40132) 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc5467fc700 1 -- 172.21.15.133:0/3702432961 learned_addr learned my addr 172.21.15.133:0/3702432961 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc5477fe700 1 --2- 172.21.15.133:0/3702432961 >> v2:172.21.15.178:3300/0 conn(0x7fc548158bb0 0x7fc548154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006089861 0 0) 0x7fc5480c0e40 con 0x7fc5480c8120 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.075+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5340033f0 con 0x7fc5480c8120 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147166335 0 0) 0x7fc5340033f0 con 0x7fc5480c8120 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 >> v2:172.21.15.178:3300/0 conn(0x7fc548158bb0 msgr2=0x7fc548154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 --2- 172.21.15.133:0/3702432961 >> v2:172.21.15.178:3300/0 conn(0x7fc548158bb0 0x7fc548154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 >> v1:172.21.15.178:6789/0 conn(0x7fc548154140 legacy=0x7fc5480c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:51.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480c07f0 con 0x7fc5480c8120 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc530001470 con 0x7fc5480c8120 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 >> v1:172.21.15.133:6789/0 conn(0x7fc5480c8120 legacy=0x7fc5480c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 0x7fc534003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534004690 0x7fc534004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc534005000 0x7fc53400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53400bf60 con 0x7fc5340038e0 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53400c0a0 con 0x7fc534005000 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53400c230 con 0x7fc534004690 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc5477fe700 1 --2- 172.21.15.133:0/3702432961 >> v2:172.21.15.178:3300/0 conn(0x7fc548158bb0 0x7fc548154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 0x7fc534003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc5467fc700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534004690 0x7fc534004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc5477fe700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc534005000 0x7fc53400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 -- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534004690 msgr2=0x7fc534004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc534004690 0x7fc534004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 -- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc534005000 msgr2=0x7fc53400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc534005000 0x7fc53400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 -- 172.21.15.133:0/3702432961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340033f0 con 0x7fc5340038e0 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc5477fe700 1 -- 172.21.15.133:0/3702432961 reap_dead start 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc546ffd700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 0x7fc534003d00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fc540001730 tx=0x7fc540007bb0).ready entity=mon.0 client_cookie=3edc055042527e8c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540007020 con 0x7fc5340038e0 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc540007180 con 0x7fc5340038e0 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.076+0000 7fc545ffb700 1 -- 172.21.15.133:0/3702432961 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc540007520 con 0x7fc5340038e0 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 -- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 msgr2=0x7fc534003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:51.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 0x7fc534003d00 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fc540001730 tx=0x7fc540007bb0).stop 2024-01-21T20:11:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 -- 172.21.15.133:0/3702432961 shutdown_connections 2024-01-21T20:11:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/3702432961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5340038e0 0x7fc534003d00 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 -- 172.21.15.133:0/3702432961 >> 172.21.15.133:0/3702432961 conn(0x7fc54805e1e0 msgr2=0x7fc54805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 -- 172.21.15.133:0/3702432961 shutdown_connections 2024-01-21T20:11:51.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.077+0000 7fc54d8ca700 1 -- 172.21.15.133:0/3702432961 wait complete. 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.079+0000 7fc54d8ca700 1 Processor -- start 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.079+0000 7fc54d8ca700 1 -- start start 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 0x7fc548150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 0x7fc5480c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480ca890 con 0x7fc54814afe0 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480cab70 con 0x7fc54814b460 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5480afa20 con 0x7fc5340038e0 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42684/0 (socket says 172.21.15.133:42684) 2024-01-21T20:11:51.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 -- 172.21.15.133:0/2914292763 learned_addr learned my addr 172.21.15.133:0/2914292763 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc546ffd700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 0x7fc548150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5477fe700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 0x7fc5480c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 -- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 msgr2=0x7fc548150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 0x7fc548150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 -- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 msgr2=0x7fc5480c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 0x7fc5480c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 -- 172.21.15.133:0/2914292763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5480afd00 con 0x7fc54814afe0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc546ffd700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 0x7fc548150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5477fe700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 0x7fc5480c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc5467fc700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fc5300047e0 tx=0x7fc530001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53000f670 con 0x7fc54814afe0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000f7d0 con 0x7fc54814afe0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53000fb70 con 0x7fc54814afe0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5480affe0 con 0x7fc54814afe0 2024-01-21T20:11:51.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.080+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5480af530 con 0x7fc54814afe0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.081+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5480c77d0 con 0x7fc54814afe0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.082+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc530015410 con 0x7fc54814afe0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.082+0000 7fc53f7fe700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 0x7fc528061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.082+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6255+0+0 (secure 0 0 0) 0x7fc53007a520 con 0x7fc54814afe0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.082+0000 7fc546ffd700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 0x7fc528061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.082+0000 7fc546ffd700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 0x7fc528061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc548167d50 tx=0x7fc540015000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.086+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc53004b710 con 0x7fc54814afe0 2024-01-21T20:11:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:51.264+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc5480cad00 con 0x7fc54814afe0 2024-01-21T20:11:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.130+0000 7fc53f7fe700 1 -- 172.21.15.133:0/2914292763 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v58) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc53004ed30 con 0x7fc54814afe0 2024-01-21T20:11:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 msgr2=0x7fc528061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 0x7fc528061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fc548167d50 tx=0x7fc540015000).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 msgr2=0x7fc5480af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fc5300047e0 tx=0x7fc530001e50).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 shutdown_connections 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc52805f150 0x7fc528061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc54814b460 0x7fc5480c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5340038e0 0x7fc548150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.132+0000 7fc54d8ca700 1 --2- 172.21.15.133:0/2914292763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc54814afe0 0x7fc5480af040 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.133+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 >> 172.21.15.133:0/2914292763 conn(0x7fc54805e1e0 msgr2=0x7fc54814be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.133+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 shutdown_connections 2024-01-21T20:11:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.133+0000 7fc54d8ca700 1 -- 172.21.15.133:0/2914292763 wait complete. 2024-01-21T20:11:52.124 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:11:52.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:11:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.270+0000 7fe3e1512700 1 Processor -- start 2024-01-21T20:11:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.270+0000 7fe3e1512700 1 -- start start 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3e1512700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3dc153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3e1512700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc153750 con 0x7fe3dc0626f0 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3e1512700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc0671e0 con 0x7fe3dc062b70 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3e1512700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc156b50 con 0x7fe3dc066e00 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3da7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe3dc0626f0 0x7fe3dc155d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40146/0 (socket says 172.21.15.133:40146) 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.271+0000 7fe3da7fc700 1 -- 172.21.15.133:0/3506681055 learned_addr learned my addr 172.21.15.133:0/3506681055 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042333318 0 0) 0x7fe3dc153750 con 0x7fe3dc0626f0 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c80033f0 con 0x7fe3dc0626f0 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3daffd700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3dc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2852729175 0 0) 0x7fe3c80033f0 con 0x7fe3dc0626f0 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 msgr2=0x7fe3dc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3dc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 >> v1:172.21.15.178:6789/0 conn(0x7fe3dc062b70 legacy=0x7fe3dc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0662e0 con 0x7fe3dc0626f0 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe3cc001470 con 0x7fe3dc0626f0 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 >> v1:172.21.15.133:6789/0 conn(0x7fe3dc0626f0 legacy=0x7fe3dc155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3c8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c8003e40 0x7fe3c8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8004b80 0x7fe3c8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc156b50 con 0x7fe3c8003e40 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c800ba10 con 0x7fe3c8004b80 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c800bbd0 con 0x7fe3dc066e00 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c8003e40 0x7fe3c8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3daffd700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3c8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3db7fe700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8004b80 0x7fe3c8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 -- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 msgr2=0x7fe3c8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc066e00 0x7fe3c8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 -- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8004b80 msgr2=0x7fe3c8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8004b80 0x7fe3c8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.272+0000 7fe3da7fc700 1 -- 172.21.15.133:0/3506681055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80033f0 con 0x7fe3c8003e40 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3da7fc700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c8003e40 0x7fe3c8004690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fe3cc00c160 tx=0x7fe3cc001e50).ready entity=mon.0 client_cookie=7cf6073c04d393c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc007a20 con 0x7fe3c8003e40 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3cc00ca90 con 0x7fe3c8003e40 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3d9ffb700 1 -- 172.21.15.133:0/3506681055 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc00ce10 con 0x7fe3c8003e40 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 -- 172.21.15.133:0/3506681055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c8003e40 msgr2=0x7fe3c8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 --2- 172.21.15.133:0/3506681055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3c8003e40 0x7fe3c8004690 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fe3cc00c160 tx=0x7fe3cc001e50).stop 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3db7fe700 1 -- 172.21.15.133:0/3506681055 reap_dead start 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 -- 172.21.15.133:0/3506681055 shutdown_connections 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 -- 172.21.15.133:0/3506681055 >> 172.21.15.133:0/3506681055 conn(0x7fe3dc0c7dc0 msgr2=0x7fe3dc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 -- 172.21.15.133:0/3506681055 shutdown_connections 2024-01-21T20:11:52.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.273+0000 7fe3e1512700 1 -- 172.21.15.133:0/3506681055 wait complete. 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 Processor -- start 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 -- start start 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8003e40 0x7fe3dc0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc0c15a0 0x7fe3dc0a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c1aa0 con 0x7fe3dc14ec90 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c3550 con 0x7fe3c8003e40 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3e1512700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0c3830 con 0x7fe3dc0c15a0 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42696/0 (socket says 172.21.15.133:42696) 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.275+0000 7fe3db7fe700 1 -- 172.21.15.133:0/1905426569 learned_addr learned my addr 172.21.15.133:0/1905426569 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3da7fc700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc0c15a0 0x7fe3dc0a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3daffd700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8003e40 0x7fe3dc0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 -- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc0c15a0 msgr2=0x7fe3dc0a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc0c15a0 0x7fe3dc0a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 -- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8003e40 msgr2=0x7fe3dc0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8003e40 0x7fe3dc0c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 -- 172.21.15.133:0/1905426569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0c3b10 con 0x7fe3dc14ec90 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3db7fe700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe3dc0c4630 tx=0x7fe3d4007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4012590 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d4012710 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc0a4e70 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4012ad0 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.276+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc14f2d0 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.277+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc05fdf0 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.277+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe3d401d460 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.278+0000 7fe3d37fe700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 0x7fe3bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.278+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe3d407a090 con 0x7fe3dc14ec90 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.278+0000 7fe3daffd700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 0x7fe3bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.278+0000 7fe3daffd700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 0x7fe3bc061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe3c4006d80 tx=0x7fe3c4008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.282+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe3d404b420 con 0x7fe3dc14ec90 2024-01-21T20:11:52.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.507+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe3dc063450 con 0x7fe3dc14ec90 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.508+0000 7fe3d37fe700 1 -- 172.21.15.133:0/1905426569 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe3d404ea40 con 0x7fe3dc14ec90 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.502 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:11:52.503 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.504 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:11:52.505 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.507 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:11:52.508 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:11:52.509 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.510 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:52.511 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:11:52.511 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 msgr2=0x7fe3bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 0x7fe3bc061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe3c4006d80 tx=0x7fe3c4008040).stop 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 msgr2=0x7fe3dc1527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe3dc0c4630 tx=0x7fe3d4007f30).stop 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 shutdown_connections 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe3bc05f150 0x7fe3bc061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3dc14ec90 0x7fe3dc1527f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3c8003e40 0x7fe3dc0c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 --2- 172.21.15.133:0/1905426569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3dc0c15a0 0x7fe3dc0a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 >> 172.21.15.133:0/1905426569 conn(0x7fe3dc0c7dc0 msgr2=0x7fe3dc0a7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 shutdown_connections 2024-01-21T20:11:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.510+0000 7fe3e1512700 1 -- 172.21.15.133:0/1905426569 wait complete. 2024-01-21T20:11:52.513 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:52.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.639+0000 7fb511fee700 1 Processor -- start 2024-01-21T20:11:52.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.639+0000 7fb511fee700 1 -- start start 2024-01-21T20:11:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb511fee700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb50c14ea40 0x7fb50c0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb511fee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb50c0c5ce0 0x7fb50c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb511fee700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c14ee20 con 0x7fb50c0bcf10 2024-01-21T20:11:52.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb511fee700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0bed10 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb511fee700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0c6600 con 0x7fb50c14ea40 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb50c0c5ce0 0x7fb50c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb50c0c5ce0 0x7fb50c0c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42698/0 (socket says 172.21.15.133:42698) 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 -- 172.21.15.133:0/1057260294 learned_addr learned my addr 172.21.15.133:0/1057260294 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 -- 172.21.15.133:0/1057260294 >> v2:172.21.15.178:3300/0 conn(0x7fb50c14ea40 msgr2=0x7fb50c0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 --2- 172.21.15.133:0/1057260294 >> v2:172.21.15.178:3300/0 conn(0x7fb50c14ea40 0x7fb50c0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 -- 172.21.15.133:0/1057260294 >> v1:172.21.15.133:6789/0 conn(0x7fb50c0bcf10 legacy=0x7fb50c0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 -- 172.21.15.133:0/1057260294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0bea30 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.640+0000 7fb50bfff700 1 --2- 172.21.15.133:0/1057260294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c0c6110 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb50c064d10 tx=0x7fb504009840).ready entity=mon.0 client_cookie=740da5e787d92ab4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb50a7fc700 1 -- 172.21.15.133:0/1057260294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e070 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb50a7fc700 1 -- 172.21.15.133:0/1057260294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400ba50 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb50a7fc700 1 -- 172.21.15.133:0/1057260294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400bdd0 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 -- 172.21.15.133:0/1057260294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c0c5ce0 msgr2=0x7fb50c0c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 --2- 172.21.15.133:0/1057260294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c0c6110 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fb50c064d10 tx=0x7fb504009840).stop 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 -- 172.21.15.133:0/1057260294 shutdown_connections 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 --2- 172.21.15.133:0/1057260294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c0c6110 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 --2- 172.21.15.133:0/1057260294 >> v2:172.21.15.178:3300/0 conn(0x7fb50c14ea40 0x7fb50c0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 -- 172.21.15.133:0/1057260294 >> 172.21.15.133:0/1057260294 conn(0x7fb50c0c7de0 msgr2=0x7fb50c0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 -- 172.21.15.133:0/1057260294 shutdown_connections 2024-01-21T20:11:52.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.641+0000 7fb511fee700 1 -- 172.21.15.133:0/1057260294 wait complete. 2024-01-21T20:11:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.642+0000 7fb511fee700 1 Processor -- start 2024-01-21T20:11:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 -- start start 2024-01-21T20:11:52.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb50c0bcf10 0x7fb50c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c19a0 con 0x7fb50c14ea40 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c0af0 con 0x7fb50c0c5ce0 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb511fee700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0c0d90 con 0x7fb50c0bcf10 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb50bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb50bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42700/0 (socket says 172.21.15.133:42700) 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.643+0000 7fb50bfff700 1 -- 172.21.15.133:0/3250025476 learned_addr learned my addr 172.21.15.133:0/3250025476 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50b7fe700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb50c0bcf10 0x7fb50c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50affd700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 -- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb50c0bcf10 msgr2=0x7fb50c0c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb50c0bcf10 0x7fb50c0c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 -- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb50c0c5ce0 msgr2=0x7fb50c14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 -- 172.21.15.133:0/3250025476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009ae0 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb50bfff700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb50c068de0 tx=0x7fb504009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5040092e0 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50401d410 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0c1070 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50401d7d0 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.644+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0c1630 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.645+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c0c1b10 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.645+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb50401dbc0 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.646+0000 7fb4f3fff700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 0x7fb4f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.646+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb50407bb80 con 0x7fb50c14ea40 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.646+0000 7fb50b7fe700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 0x7fb4f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.646+0000 7fb50b7fe700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 0x7fb4f8061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb50c066450 tx=0x7fb500006f10).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.650+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb50404cf70 con 0x7fb50c14ea40 2024-01-21T20:11:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.814+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb50c05fdf0 con 0x7fb50c14ea40 2024-01-21T20:11:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.815+0000 7fb4f3fff700 1 -- 172.21.15.133:0/3250025476 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14600 (secure 0 0 0) 0x7fb504050e60 con 0x7fb50c14ea40 2024-01-21T20:11:52.805 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:52.805 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":58,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:52.124480+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 msgr2=0x7fb4f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 0x7fb4f8061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb50c066450 tx=0x7fb500006f10).stop 2024-01-21T20:11:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 msgr2=0x7fb50c0bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fb50c068de0 tx=0x7fb504009840).stop 2024-01-21T20:11:52.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 shutdown_connections 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4f805f150 0x7fb4f8061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb50c14ea40 0x7fb50c0bef30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb50c0bcf10 0x7fb50c0c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 --2- 172.21.15.133:0/3250025476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb50c0c5ce0 0x7fb50c14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 >> 172.21.15.133:0/3250025476 conn(0x7fb50c0c7de0 msgr2=0x7fb50c14d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 shutdown_connections 2024-01-21T20:11:52.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.817+0000 7fb511fee700 1 -- 172.21.15.133:0/3250025476 wait complete. 2024-01-21T20:11:52.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:11:52.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:11:52.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.947+0000 7f4c6d527700 1 Processor -- start 2024-01-21T20:11:52.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.947+0000 7f4c6d527700 1 -- start start 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c6d527700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c68063f10 0x7f4c680be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c6d527700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c680be7b0 0x7f4c680c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c6d527700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c680bf030 con 0x7f4c6813aab0 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c6d527700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680bf310 con 0x7f4c680be7b0 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c6d527700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680bf5f0 con 0x7f4c68063f10 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c680be7b0 0x7f4c680c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c680be7b0 0x7f4c680c3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42716/0 (socket says 172.21.15.133:42716) 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 -- 172.21.15.133:0/1649339465 learned_addr learned my addr 172.21.15.133:0/1649339465 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c66ffd700 1 --1- 172.21.15.133:0/1649339465 >> v1:172.21.15.133:6789/0 conn(0x7f4c6813aab0 0x7f4c68063800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40160/0 (socket says 172.21.15.133:40160) 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c667fc700 1 --2- 172.21.15.133:0/1649339465 >> v2:172.21.15.178:3300/0 conn(0x7f4c68063f10 0x7f4c680be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 -- 172.21.15.133:0/1649339465 >> v2:172.21.15.178:3300/0 conn(0x7f4c68063f10 msgr2=0x7f4c680be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 --2- 172.21.15.133:0/1649339465 >> v2:172.21.15.178:3300/0 conn(0x7f4c68063f10 0x7f4c680be2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 -- 172.21.15.133:0/1649339465 >> v1:172.21.15.133:6789/0 conn(0x7f4c6813aab0 legacy=0x7f4c68063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 -- 172.21.15.133:0/1649339465 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c680bf8d0 con 0x7f4c680be7b0 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.948+0000 7f4c677fe700 1 --2- 172.21.15.133:0/1649339465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680be7b0 0x7f4c680c3970 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4c68067ba0 tx=0x7f4c60009840).ready entity=mon.0 client_cookie=7b895d9f009f33ec server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c65ffb700 1 -- 172.21.15.133:0/1649339465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000e070 con 0x7f4c680be7b0 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c65ffb700 1 -- 172.21.15.133:0/1649339465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000ba50 con 0x7f4c680be7b0 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c65ffb700 1 -- 172.21.15.133:0/1649339465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000bdd0 con 0x7f4c680be7b0 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 -- 172.21.15.133:0/1649339465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680be7b0 msgr2=0x7f4c680c3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 --2- 172.21.15.133:0/1649339465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680be7b0 0x7f4c680c3970 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4c68067ba0 tx=0x7f4c60009840).stop 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 -- 172.21.15.133:0/1649339465 shutdown_connections 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 --2- 172.21.15.133:0/1649339465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680be7b0 0x7f4c680c3970 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 --2- 172.21.15.133:0/1649339465 >> v2:172.21.15.178:3300/0 conn(0x7f4c68063f10 0x7f4c680be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 -- 172.21.15.133:0/1649339465 >> 172.21.15.133:0/1649339465 conn(0x7f4c680c8f90 msgr2=0x7f4c680c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 -- 172.21.15.133:0/1649339465 shutdown_connections 2024-01-21T20:11:52.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.949+0000 7f4c6d527700 1 -- 172.21.15.133:0/1649339465 wait complete. 2024-01-21T20:11:52.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.950+0000 7f4c6d527700 1 Processor -- start 2024-01-21T20:11:52.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.950+0000 7f4c6d527700 1 -- start start 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 0x7f4c681646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c6813aab0 0x7f4c680c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68167ab0 con 0x7f4c68063f10 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680ad440 con 0x7f4c680be7b0 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c6d527700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c680c32f0 con 0x7f4c6813aab0 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c66ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42730/0 (socket says 172.21.15.133:42730) 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.951+0000 7f4c66ffd700 1 -- 172.21.15.133:0/3703579203 learned_addr learned my addr 172.21.15.133:0/3703579203 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c677fe700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c6813aab0 0x7f4c680c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c667fc700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 0x7f4c681646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 -- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c6813aab0 msgr2=0x7f4c680c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c6813aab0 0x7f4c680c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 -- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 msgr2=0x7f4c681646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:52.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 0x7f4c681646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 -- 172.21.15.133:0/3703579203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60009ae0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c667fc700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 0x7f4c681646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c66ffd700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4c5c00c410 tx=0x7f4c5c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0072e0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c007440 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c680c2d30 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c005910 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.952+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c680ad0d0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.953+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6805fdf0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.953+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c5c005cc0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.954+0000 7f4c4f7fe700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 0x7f4c54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.954+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4c5c0795a0 con 0x7f4c68063f10 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.954+0000 7f4c667fc700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 0x7f4c54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:52.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.954+0000 7f4c667fc700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 0x7f4c54061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4c680aefa0 tx=0x7f4c58008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:52.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:52.958+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c5c04a990 con 0x7f4c68063f10 2024-01-21T20:11:53.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.119+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4c6813ae90 con 0x7f4c68063f10 2024-01-21T20:11:53.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.120+0000 7f4c4f7fe700 1 -- 172.21.15.133:0/3703579203 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v58) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4c5c018070 con 0x7f4c68063f10 2024-01-21T20:11:53.110 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:11:53.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 msgr2=0x7f4c54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 0x7f4c54061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4c680aefa0 tx=0x7f4c58008040).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 msgr2=0x7f4c68154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4c5c00c410 tx=0x7f4c5c007e10).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 shutdown_connections 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c5405f150 0x7f4c54061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.121+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c6813aab0 0x7f4c680c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.122+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c68063f10 0x7f4c68154350 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.122+0000 7f4c6d527700 1 --2- 172.21.15.133:0/3703579203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c680be7b0 0x7f4c681646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.122+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 >> 172.21.15.133:0/3703579203 conn(0x7f4c680c8f90 msgr2=0x7f4c680c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.122+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 shutdown_connections 2024-01-21T20:11:53.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.122+0000 7f4c6d527700 1 -- 172.21.15.133:0/3703579203 wait complete. 2024-01-21T20:11:53.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:11:53.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.252+0000 7f007cc7a700 1 Processor -- start 2024-01-21T20:11:53.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.252+0000 7f007cc7a700 1 -- start start 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.253+0000 7f007cc7a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0078137030 0x7f0078067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.253+0000 7f007cc7a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00780c5930 0x7f00780c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.253+0000 7f007cc7a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00780c6250 con 0x7f0078137410 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.253+0000 7f007cc7a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0078068370 con 0x7f0078137030 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.253+0000 7f007cc7a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0078068650 con 0x7f00780c5930 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0078137030 0x7f0078067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0078137030 0x7f0078067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42734/0 (socket says 172.21.15.133:42734) 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 -- 172.21.15.133:0/790857682 learned_addr learned my addr 172.21.15.133:0/790857682 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f0075d9b700 1 --1- 172.21.15.133:0/790857682 >> v1:172.21.15.133:6789/0 conn(0x7f0078137410 0x7f0078155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40168/0 (socket says 172.21.15.133:40168) 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 -- 172.21.15.133:0/790857682 >> v2:172.21.15.178:3300/0 conn(0x7f00780c5930 msgr2=0x7f00780c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 --2- 172.21.15.133:0/790857682 >> v2:172.21.15.178:3300/0 conn(0x7f00780c5930 0x7f00780c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 -- 172.21.15.133:0/790857682 >> v1:172.21.15.133:6789/0 conn(0x7f0078137410 legacy=0x7f0078155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 -- 172.21.15.133:0/790857682 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078068930 con 0x7f0078137030 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007659c700 1 --2- 172.21.15.133:0/790857682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078067d90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f0078066070 tx=0x7f00680090f0).ready entity=mon.0 client_cookie=2d6854170330c586 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007559a700 1 -- 172.21.15.133:0/790857682 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800b600 con 0x7f0078137030 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007559a700 1 -- 172.21.15.133:0/790857682 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800b760 con 0x7f0078137030 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.254+0000 7f007559a700 1 -- 172.21.15.133:0/790857682 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800bb00 con 0x7f0078137030 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 -- 172.21.15.133:0/790857682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 msgr2=0x7f0078067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 --2- 172.21.15.133:0/790857682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078067d90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f0078066070 tx=0x7f00680090f0).stop 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 -- 172.21.15.133:0/790857682 shutdown_connections 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 --2- 172.21.15.133:0/790857682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078067d90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 --2- 172.21.15.133:0/790857682 >> v2:172.21.15.178:3300/0 conn(0x7f00780c5930 0x7f00780c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 -- 172.21.15.133:0/790857682 >> 172.21.15.133:0/790857682 conn(0x7f0078066a90 msgr2=0x7f0078066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 -- 172.21.15.133:0/790857682 shutdown_connections 2024-01-21T20:11:53.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.255+0000 7f007cc7a700 1 -- 172.21.15.133:0/790857682 wait complete. 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.256+0000 7f007cc7a700 1 Processor -- start 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.256+0000 7f007cc7a700 1 -- start start 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00780c5930 0x7f0078138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0078137410 0x7f00780c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00781380f0 con 0x7f0078137030 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078139960 con 0x7f00780c5930 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007cc7a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078137aa0 con 0x7f0078137410 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42742/0 (socket says 172.21.15.133:42742) 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 -- 172.21.15.133:0/2853554541 learned_addr learned my addr 172.21.15.133:0/2853554541 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f007659c700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00780c5930 0x7f0078138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0076d9d700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0078137410 0x7f00780c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 -- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0078137410 msgr2=0x7f00780c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0078137410 0x7f00780c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 -- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00780c5930 msgr2=0x7f0078138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00780c5930 0x7f0078138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 -- 172.21.15.133:0/2853554541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009370 con 0x7f0078137030 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f0075d9b700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f006000c4c0 tx=0x7f0060007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600072e0 con 0x7f0078137030 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.257+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060007440 con 0x7f0078137030 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.258+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600058f0 con 0x7f0078137030 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.258+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078137d80 con 0x7f0078137030 2024-01-21T20:11:53.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.258+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00781394e0 con 0x7f0078137030 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.259+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00781382a0 con 0x7f0078137030 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.259+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0060005ce0 con 0x7f0078137030 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.259+0000 7f006effd700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.259+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0060079710 con 0x7f0078137030 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.259+0000 7f007659c700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.260+0000 7f007659c700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 0x7f0058061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0068009fd0 tx=0x7f0068017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.263+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f00781382a0 con 0x7f0078137030 2024-01-21T20:11:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.426+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f007805fdf0 con 0x7f0078137030 2024-01-21T20:11:53.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.426+0000 7f006effd700 1 -- 172.21.15.133:0/2853554541 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0060018020 con 0x7f0078137030 2024-01-21T20:11:53.416 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 msgr2=0x7f0058061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 0x7f0058061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0068009fd0 tx=0x7f0068017000).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 msgr2=0x7f0078138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f006000c4c0 tx=0x7f0060007db0).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 shutdown_connections 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005805f150 0x7f0058061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0078137410 0x7f00780c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00780c5930 0x7f0078138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 --2- 172.21.15.133:0/2853554541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0078137030 0x7f0078138580 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.428+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 >> 172.21.15.133:0/2853554541 conn(0x7f0078066a90 msgr2=0x7f00780c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.429+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 shutdown_connections 2024-01-21T20:11:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.429+0000 7f007cc7a700 1 -- 172.21.15.133:0/2853554541 wait complete. 2024-01-21T20:11:53.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:11:53.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.556+0000 7f26674b4700 1 Processor -- start 2024-01-21T20:11:53.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.556+0000 7f26674b4700 1 -- start start 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f26674b4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26600c3c10 0x7f26600be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f26674b4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26600be5f0 0x7f26600a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f26674b4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26600bfa40 con 0x7f266013b970 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f26674b4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26600bee30 con 0x7f26600c3c10 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f26674b4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600bf110 con 0x7f26600be5f0 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f2664a4f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26600c3c10 0x7f26600be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f2664a4f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26600c3c10 0x7f26600be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42746/0 (socket says 172.21.15.133:42746) 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.557+0000 7f2664a4f700 1 -- 172.21.15.133:0/2408815130 learned_addr learned my addr 172.21.15.133:0/2408815130 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2665a51700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26600be5f0 0x7f26600a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2664a4f700 1 -- 172.21.15.133:0/2408815130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26600be5f0 msgr2=0x7f26600a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:53.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2664a4f700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26600be5f0 0x7f26600a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2664a4f700 1 -- 172.21.15.133:0/2408815130 >> v1:172.21.15.133:6789/0 conn(0x7f266013b970 legacy=0x7f26600c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2664a4f700 1 -- 172.21.15.133:0/2408815130 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600bf3f0 con 0x7f26600c3c10 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2664a4f700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600c3c10 0x7f26600be100 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f265c006fd0 tx=0x7f265c0090f0).ready entity=mon.0 client_cookie=96ede62bdd8f7314 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2657fff700 1 -- 172.21.15.133:0/2408815130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00b600 con 0x7f26600c3c10 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2657fff700 1 -- 172.21.15.133:0/2408815130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c00b760 con 0x7f26600c3c10 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f2657fff700 1 -- 172.21.15.133:0/2408815130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c00bb00 con 0x7f26600c3c10 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f26674b4700 1 -- 172.21.15.133:0/2408815130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600c3c10 msgr2=0x7f26600be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.558+0000 7f26674b4700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600c3c10 0x7f26600be100 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f265c006fd0 tx=0x7f265c0090f0).stop 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 -- 172.21.15.133:0/2408815130 shutdown_connections 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26600be5f0 0x7f26600a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 --2- 172.21.15.133:0/2408815130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600c3c10 0x7f26600be100 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 -- 172.21.15.133:0/2408815130 >> 172.21.15.133:0/2408815130 conn(0x7f2660066a70 msgr2=0x7f2660066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 -- 172.21.15.133:0/2408815130 shutdown_connections 2024-01-21T20:11:53.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.559+0000 7f26674b4700 1 -- 172.21.15.133:0/2408815130 wait complete. 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.560+0000 7f26674b4700 1 Processor -- start 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.560+0000 7f26674b4700 1 -- start start 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26600c3c10 0x7f2660154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f266013b970 0x7f26601563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660155300 con 0x7f26600be5f0 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26601555e0 con 0x7f26600c3c10 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26601558c0 con 0x7f266013b970 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42758/0 (socket says 172.21.15.133:42758) 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 -- 172.21.15.133:0/2887628891 learned_addr learned my addr 172.21.15.133:0/2887628891 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2664a4f700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26600c3c10 0x7f2660154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665a51700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f266013b970 0x7f26601563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 -- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f266013b970 msgr2=0x7f26601563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f266013b970 0x7f26601563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 -- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26600c3c10 msgr2=0x7f2660154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26600c3c10 0x7f2660154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 -- 172.21.15.133:0/2887628891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009370 con 0x7f26600be5f0 2024-01-21T20:11:53.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2665250700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f265000c440 tx=0x7f2650007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650007020 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650007180 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650007520 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2660155ba0 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.561+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26600ab280 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266005fdf0 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f26500068b0 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f2655ffb700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 0x7f2644061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2650079480 con 0x7f26600be5f0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f2664a4f700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 0x7f2644061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.563+0000 7f2664a4f700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 0x7f2644061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f26600c4010 tx=0x7f265c017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.567+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2650047b00 con 0x7f26600be5f0 2024-01-21T20:11:53.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.733+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f26600bf6d0 con 0x7f26600be5f0 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.733+0000 7f2655ffb700 1 -- 172.21.15.133:0/2887628891 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+143 (secure 0 0 0) 0x7f265004a870 con 0x7f26600be5f0 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:11:53.723 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:11:53.724 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:11:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 msgr2=0x7f2644061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 0x7f2644061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f26600c4010 tx=0x7f265c017000).stop 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 msgr2=0x7f26600aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f265000c440 tx=0x7f2650007e00).stop 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 shutdown_connections 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f264405f150 0x7f2644061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f266013b970 0x7f26601563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26600be5f0 0x7f26600aad90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 --2- 172.21.15.133:0/2887628891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26600c3c10 0x7f2660154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 >> 172.21.15.133:0/2887628891 conn(0x7f2660066a70 msgr2=0x7f26600abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 shutdown_connections 2024-01-21T20:11:53.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.735+0000 7f26674b4700 1 -- 172.21.15.133:0/2887628891 wait complete. 2024-01-21T20:11:53.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:11:53.737 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:11:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.867+0000 7feac2155700 1 Processor -- start 2024-01-21T20:11:53.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.867+0000 7feac2155700 1 -- start start 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feac2155700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feabc150c90 0x7feabc151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feac2155700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feabc069940 0x7feabc063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feac2155700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feabc069750 con 0x7feabc069da0 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feac2155700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc067720 con 0x7feabc150c90 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feac2155700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feabc066680 con 0x7feabc069940 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feabb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feabc150c90 0x7feabc151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feabb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feabc150c90 0x7feabc151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42772/0 (socket says 172.21.15.133:42772) 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.868+0000 7feabb7fe700 1 -- 172.21.15.133:0/3508334699 learned_addr learned my addr 172.21.15.133:0/3508334699 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabaffd700 1 --2- 172.21.15.133:0/3508334699 >> v2:172.21.15.178:3300/0 conn(0x7feabc069940 0x7feabc063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabb7fe700 1 -- 172.21.15.133:0/3508334699 >> v2:172.21.15.178:3300/0 conn(0x7feabc069940 msgr2=0x7feabc063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabb7fe700 1 --2- 172.21.15.133:0/3508334699 >> v2:172.21.15.178:3300/0 conn(0x7feabc069940 0x7feabc063700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabb7fe700 1 -- 172.21.15.133:0/3508334699 >> v1:172.21.15.178:6789/0 conn(0x7feabc069da0 legacy=0x7feabc0bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabb7fe700 1 -- 172.21.15.133:0/3508334699 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feabc066960 con 0x7feabc150c90 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feabb7fe700 1 --2- 172.21.15.133:0/3508334699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc150c90 0x7feabc151070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7feabc0c52a0 tx=0x7feaa400b3b0).ready entity=mon.0 client_cookie=f61b939ec086d78b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feaba7fc700 1 -- 172.21.15.133:0/3508334699 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400da40 con 0x7feabc150c90 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feaba7fc700 1 -- 172.21.15.133:0/3508334699 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400dba0 con 0x7feabc150c90 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.869+0000 7feaba7fc700 1 -- 172.21.15.133:0/3508334699 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4010470 con 0x7feabc150c90 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 -- 172.21.15.133:0/3508334699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc150c90 msgr2=0x7feabc151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 --2- 172.21.15.133:0/3508334699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc150c90 0x7feabc151070 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7feabc0c52a0 tx=0x7feaa400b3b0).stop 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 -- 172.21.15.133:0/3508334699 shutdown_connections 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 --2- 172.21.15.133:0/3508334699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc150c90 0x7feabc151070 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 --2- 172.21.15.133:0/3508334699 >> v2:172.21.15.178:3300/0 conn(0x7feabc069940 0x7feabc063700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 -- 172.21.15.133:0/3508334699 >> 172.21.15.133:0/3508334699 conn(0x7feabc0c4a10 msgr2=0x7feabc068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 -- 172.21.15.133:0/3508334699 shutdown_connections 2024-01-21T20:11:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.870+0000 7feac2155700 1 -- 172.21.15.133:0/3508334699 wait complete. 2024-01-21T20:11:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.871+0000 7feac2155700 1 Processor -- start 2024-01-21T20:11:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.871+0000 7feac2155700 1 -- start start 2024-01-21T20:11:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feabc069da0 0x7feabc0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feabc150c90 0x7feabc0c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc1632f0 con 0x7feabc069940 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feabc160330 con 0x7feabc150c90 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feabc160610 con 0x7feabc069da0 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42774/0 (socket says 172.21.15.133:42774) 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 -- 172.21.15.133:0/2206400735 learned_addr learned my addr 172.21.15.133:0/2206400735 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabaffd700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feabc069da0 0x7feabc0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabbfff700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feabc150c90 0x7feabc0c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 -- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feabc069da0 msgr2=0x7feabc0a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feabc069da0 0x7feabc0a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 -- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feabc150c90 msgr2=0x7feabc0c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feabc150c90 0x7feabc0c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 -- 172.21.15.133:0/2206400735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa400b610 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feabb7fe700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7feaa400b3f0 tx=0x7feabc065bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4019450 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa401f040 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.872+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feabc1608f0 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.873+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40197e0 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.873+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feabc0a09b0 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.874+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feabc05fdf0 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.874+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7feaa4019b50 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.874+0000 7feab3fff700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 0x7fea9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.874+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feaa407dc80 con 0x7feabc069940 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.874+0000 7feabaffd700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 0x7fea9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.875+0000 7feabaffd700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 0x7fea9c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7feabc05e850 tx=0x7feaac009060).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:53.879+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feaa404f070 con 0x7feabc069940 2024-01-21T20:11:54.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:54.042+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7feabc066c40 con 0x7feabc069940 2024-01-21T20:11:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.033+0000 7feab3fff700 1 -- 172.21.15.133:0/2206400735 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 152+0+0 (secure 0 0 0) 0x7feaa4052690 con 0x7feabc069940 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 msgr2=0x7fea9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 0x7fea9c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7feabc05e850 tx=0x7feaac009060).stop 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 msgr2=0x7feabc0a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7feaa400b3f0 tx=0x7feabc065bc0).stop 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 shutdown_connections 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea9c05f150 0x7fea9c061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feabc150c90 0x7feabc0c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feabc069940 0x7feabc0a04c0 secure :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0x7feaa400b3f0 tx=0x7feabc065bc0).stop 2024-01-21T20:11:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 --2- 172.21.15.133:0/2206400735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feabc069da0 0x7feabc0a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.037+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 >> 172.21.15.133:0/2206400735 conn(0x7feabc0c4a10 msgr2=0x7feabc0a8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.038+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 shutdown_connections 2024-01-21T20:11:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.038+0000 7feac2155700 1 -- 172.21.15.133:0/2206400735 wait complete. 2024-01-21T20:11:55.033 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:11:55.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:11:55.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.184+0000 7fdf9fd46700 1 Processor -- start 2024-01-21T20:11:55.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.184+0000 7fdf9fd46700 1 -- start start 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9fd46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf98155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9fd46700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf980c3fb0 0x7fdf98066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9fd46700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98065660 con 0x7fdf980beb30 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9fd46700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980bef10 con 0x7fdf980c3fb0 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9fd46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156070 con 0x7fdf98069ef0 2024-01-21T20:11:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9dae2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf980beb30 0x7fdf980697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40180/0 (socket says 172.21.15.133:40180) 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9dae2700 1 -- 172.21.15.133:0/1360007846 learned_addr learned my addr 172.21.15.133:0/1360007846 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9e2e3700 1 --2- 172.21.15.133:0/1360007846 >> v2:172.21.15.178:3300/0 conn(0x7fdf980c3fb0 0x7fdf98066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf98155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552160032 0 0) 0x7fdf98065660 con 0x7fdf980beb30 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf840033f0 con 0x7fdf980beb30 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 855756482 0 0) 0x7fdf840033f0 con 0x7fdf980beb30 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 msgr2=0x7fdf98155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf98155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 >> v2:172.21.15.178:3300/0 conn(0x7fdf980c3fb0 msgr2=0x7fdf98066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 --2- 172.21.15.133:0/1360007846 >> v2:172.21.15.178:3300/0 conn(0x7fdf980c3fb0 0x7fdf98066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98065f00 con 0x7fdf980beb30 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdf88001470 con 0x7fdf980beb30 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 >> v1:172.21.15.133:6789/0 conn(0x7fdf980beb30 legacy=0x7fdf980697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf84003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf84004690 0x7fdf84004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf84005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980bef10 con 0x7fdf84003910 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98156070 con 0x7fdf84004690 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8400b8e0 con 0x7fdf98069ef0 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.185+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf84003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf84004690 0x7fdf84004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9e2e3700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf84005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 -- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 msgr2=0x7fdf84005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf84005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 -- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf84004690 msgr2=0x7fdf84004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf84004690 0x7fdf84004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 -- 172.21.15.133:0/1360007846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf840033f0 con 0x7fdf84003910 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9e2e3700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98069ef0 0x7fdf84005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf84003d30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdf8800c190 tx=0x7fdf88001e50).ready entity=mon.0 client_cookie=230d49036e344b1e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88007a20 con 0x7fdf84003910 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8800cac0 con 0x7fdf84003910 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9cae0700 1 -- 172.21.15.133:0/1360007846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800ce40 con 0x7fdf84003910 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9fd46700 1 -- 172.21.15.133:0/1360007846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 msgr2=0x7fdf84003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/1360007846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf84003d30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fdf8800c190 tx=0x7fdf88001e50).stop 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.186+0000 7fdf9e2e3700 1 -- 172.21.15.133:0/1360007846 reap_dead start 2024-01-21T20:11:55.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.187+0000 7fdf9fd46700 1 -- 172.21.15.133:0/1360007846 shutdown_connections 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.187+0000 7fdf9fd46700 1 -- 172.21.15.133:0/1360007846 >> 172.21.15.133:0/1360007846 conn(0x7fdf980c8010 msgr2=0x7fdf980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.187+0000 7fdf9fd46700 1 -- 172.21.15.133:0/1360007846 shutdown_connections 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.187+0000 7fdf9fd46700 1 -- 172.21.15.133:0/1360007846 wait complete. 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.188+0000 7fdf9fd46700 1 Processor -- start 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.188+0000 7fdf9fd46700 1 -- start start 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 0x7fdf980a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 0x7fdf980c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c7680 con 0x7fdf84003910 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c73a0 con 0x7fdf980c0ff0 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980c0510 con 0x7fdf980c6e30 2024-01-21T20:11:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42804/0 (socket says 172.21.15.133:42804) 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 -- 172.21.15.133:0/2428742163 learned_addr learned my addr 172.21.15.133:0/2428742163 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9e2e3700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 0x7fdf980c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 0x7fdf980a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 -- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 msgr2=0x7fdf980a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 0x7fdf980a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 -- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 msgr2=0x7fdf980c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 0x7fdf980c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 -- 172.21.15.133:0/2428742163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980c07f0 con 0x7fdf84003910 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9e2e3700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 0x7fdf980c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 0x7fdf980a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9dae2700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fdf8800ca90 tx=0x7fdf88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880076c0 con 0x7fdf84003910 2024-01-21T20:11:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880046b0 con 0x7fdf84003910 2024-01-21T20:11:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980c0ad0 con 0x7fdf84003910 2024-01-21T20:11:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88004a50 con 0x7fdf84003910 2024-01-21T20:11:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.189+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf98066670 con 0x7fdf84003910 2024-01-21T20:11:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.190+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf980c0370 con 0x7fdf84003910 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.191+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdf88020480 con 0x7fdf84003910 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.191+0000 7fdf8e7fc700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 0x7fdf7c061600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.191+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6195+0+0 (secure 0 0 0) 0x7fdf8807b140 con 0x7fdf84003910 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.191+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 0x7fdf7c061600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.192+0000 7fdf9d2e1700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 0x7fdf7c061600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdf94009270 tx=0x7fdf94008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.196+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf980c0370 con 0x7fdf84003910 2024-01-21T20:11:55.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:55.358+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf980c0370 con 0x7fdf84003910 2024-01-21T20:11:56.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.038+0000 7fdf8e7fc700 1 -- 172.21.15.133:0/2428742163 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf980c0370 con 0x7fdf84003910 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 msgr2=0x7fdf7c061600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 0x7fdf7c061600 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fdf94009270 tx=0x7fdf94008040).stop 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 msgr2=0x7fdf980ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fdf8800ca90 tx=0x7fdf88015000).stop 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 shutdown_connections 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf7c05f140 0x7fdf7c061600 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fdf94009270 tx=0x7fdf94008040).stop 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf980c0ff0 0x7fdf980c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf84003910 0x7fdf980ad1f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 --2- 172.21.15.133:0/2428742163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf980c6e30 0x7fdf980a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.042+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 >> 172.21.15.133:0/2428742163 conn(0x7fdf980c8010 msgr2=0x7fdf9813a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.044+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 shutdown_connections 2024-01-21T20:11:56.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.044+0000 7fdf9fd46700 1 -- 172.21.15.133:0/2428742163 wait complete. 2024-01-21T20:11:56.050 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:11:56.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:11:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.191+0000 7f7161afc700 1 Processor -- start 2024-01-21T20:11:56.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.191+0000 7f7161afc700 1 -- start start 2024-01-21T20:11:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f715c0beb30 0x7f715c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f715c0c3fb0 0x7f715c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c069cd0 0x7f715c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c0bef10 con 0x7f715c0beb30 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715c156070 con 0x7f715c0c3fb0 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f7161afc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c065660 con 0x7f715c069cd0 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f715c0beb30 0x7f715c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f715c0beb30 0x7f715c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42814/0 (socket says 172.21.15.133:42814) 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 -- 172.21.15.133:0/34122436 learned_addr learned my addr 172.21.15.133:0/34122436 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715affd700 1 --2- 172.21.15.133:0/34122436 >> v2:172.21.15.178:3300/0 conn(0x7f715c0c3fb0 0x7f715c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715bfff700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c069cd0 0x7f715c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 -- 172.21.15.133:0/34122436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c069cd0 msgr2=0x7f715c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c069cd0 0x7f715c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 -- 172.21.15.133:0/34122436 >> v2:172.21.15.178:3300/0 conn(0x7f715c0c3fb0 msgr2=0x7f715c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:56.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 --2- 172.21.15.133:0/34122436 >> v2:172.21.15.178:3300/0 conn(0x7f715c0c3fb0 0x7f715c0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.192+0000 7f715b7fe700 1 -- 172.21.15.133:0/34122436 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c065f00 con 0x7f715c0beb30 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f715b7fe700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c155b80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f715c05ecd0 tx=0x7f71440090f0).ready entity=mon.0 client_cookie=31350ee85ff7fe7b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f715a7fc700 1 -- 172.21.15.133:0/34122436 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400b600 con 0x7f715c0beb30 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f715a7fc700 1 -- 172.21.15.133:0/34122436 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400b760 con 0x7f715c0beb30 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f715a7fc700 1 -- 172.21.15.133:0/34122436 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400bb00 con 0x7f715c0beb30 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 -- 172.21.15.133:0/34122436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 msgr2=0x7f715c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c155b80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f715c05ecd0 tx=0x7f71440090f0).stop 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 -- 172.21.15.133:0/34122436 shutdown_connections 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c069cd0 0x7f715c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 --2- 172.21.15.133:0/34122436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c155b80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 --2- 172.21.15.133:0/34122436 >> v2:172.21.15.178:3300/0 conn(0x7f715c0c3fb0 0x7f715c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 -- 172.21.15.133:0/34122436 >> 172.21.15.133:0/34122436 conn(0x7f715c0c8010 msgr2=0x7f715c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 -- 172.21.15.133:0/34122436 shutdown_connections 2024-01-21T20:11:56.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.193+0000 7f7161afc700 1 -- 172.21.15.133:0/34122436 wait complete. 2024-01-21T20:11:56.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.194+0000 7f7161afc700 1 Processor -- start 2024-01-21T20:11:56.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 -- start start 2024-01-21T20:11:56.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 0x7f715c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c0c3fb0 0x7f715c0a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0a63c0 con 0x7f715c0beb30 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0a57b0 con 0x7f715c069cd0 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f7161afc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715c0a5a90 con 0x7f715c0c3fb0 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f715affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f715affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42822/0 (socket says 172.21.15.133:42822) 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.195+0000 7f715affd700 1 -- 172.21.15.133:0/1008958242 learned_addr learned my addr 172.21.15.133:0/1008958242 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715b7fe700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 0x7f715c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715bfff700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c0c3fb0 0x7f715c0a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 -- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c0c3fb0 msgr2=0x7f715c0a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c0c3fb0 0x7f715c0a7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 -- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 msgr2=0x7f715c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 0x7f715c0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 -- 172.21.15.133:0/1008958242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7144009370 con 0x7f715c0beb30 2024-01-21T20:11:56.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715b7fe700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 0x7f715c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f715affd700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f714c00d890 tx=0x7f714c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0125f0 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c012750 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c0a5d70 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c012ad0 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.196+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715c0bf5a0 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.197+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715c0a6570 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.197+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f714c013480 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.198+0000 7f7153fff700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 0x7f713c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.198+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6577+0+0 (secure 0 0 0) 0x7f714c07a4f0 con 0x7f715c0beb30 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.198+0000 7f715b7fe700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 0x7f713c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.198+0000 7f715b7fe700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 0x7f713c061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7144009fd0 tx=0x7f7144017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.202+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f715c0a6570 con 0x7f715c0beb30 2024-01-21T20:11:56.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.407+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f715c05fdf0 con 0x7f715c0beb30 2024-01-21T20:11:56.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.412+0000 7f7153fff700 1 -- 172.21.15.133:0/1008958242 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v16) v1 ==== 172+0+0 (secure 0 0 0) 0x7f714c04b590 con 0x7f715c0beb30 2024-01-21T20:11:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.416+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 msgr2=0x7f713c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.416+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 0x7f713c061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7144009fd0 tx=0x7f7144017000).stop 2024-01-21T20:11:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.416+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 msgr2=0x7f715c0a7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.416+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f714c00d890 tx=0x7f714c008040).stop 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 shutdown_connections 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f713c05f150 0x7f713c061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f715c0c3fb0 0x7f715c0a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f715c069cd0 0x7f715c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 --2- 172.21.15.133:0/1008958242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715c0beb30 0x7f715c0a7950 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.423+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 >> 172.21.15.133:0/1008958242 conn(0x7f715c0c8010 msgr2=0x7f715c0bdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.424+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 shutdown_connections 2024-01-21T20:11:56.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.425+0000 7f7161afc700 1 -- 172.21.15.133:0/1008958242 wait complete. 2024-01-21T20:11:56.427 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 7 and data pool 8 2024-01-21T20:11:56.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:56.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.560+0000 7f313049a700 1 Processor -- start 2024-01-21T20:11:56.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.560+0000 7f313049a700 1 -- start start 2024-01-21T20:11:56.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31280acbc0 0x7f31280acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3128066460 0x7f31280634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31281521e0 0x7f3128152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3128065fd0 con 0x7f31280acbc0 2024-01-21T20:11:56.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31280653c0 con 0x7f3128066460 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f313049a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280656a0 con 0x7f31281521e0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31280acbc0 0x7f31280acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31280acbc0 0x7f31280acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42828/0 (socket says 172.21.15.133:42828) 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 -- 172.21.15.133:0/2306678904 learned_addr learned my addr 172.21.15.133:0/2306678904 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312da35700 1 --2- 172.21.15.133:0/2306678904 >> v2:172.21.15.178:3300/0 conn(0x7f3128066460 0x7f31280634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312ea37700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31281521e0 0x7f3128152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 -- 172.21.15.133:0/2306678904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31281521e0 msgr2=0x7f3128152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31281521e0 0x7f3128152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 -- 172.21.15.133:0/2306678904 >> v2:172.21.15.178:3300/0 conn(0x7f3128066460 msgr2=0x7f31280634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 --2- 172.21.15.133:0/2306678904 >> v2:172.21.15.178:3300/0 conn(0x7f3128066460 0x7f31280634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 -- 172.21.15.133:0/2306678904 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128065980 con 0x7f31280acbc0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312e236700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280acbc0 0x7f31280acfa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f31280600a0 tx=0x7f31240090f0).ready entity=mon.0 client_cookie=3b5bac5b11b3237d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312d234700 1 -- 172.21.15.133:0/2306678904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400f510 con 0x7f31280acbc0 2024-01-21T20:11:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312d234700 1 -- 172.21.15.133:0/2306678904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400f670 con 0x7f31280acbc0 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.561+0000 7f312d234700 1 -- 172.21.15.133:0/2306678904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400fa10 con 0x7f31280acbc0 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 -- 172.21.15.133:0/2306678904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280acbc0 msgr2=0x7f31280acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280acbc0 0x7f31280acfa0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f31280600a0 tx=0x7f31240090f0).stop 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 -- 172.21.15.133:0/2306678904 shutdown_connections 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31281521e0 0x7f3128152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 --2- 172.21.15.133:0/2306678904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31280acbc0 0x7f31280acfa0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 --2- 172.21.15.133:0/2306678904 >> v2:172.21.15.178:3300/0 conn(0x7f3128066460 0x7f31280634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 -- 172.21.15.133:0/2306678904 >> 172.21.15.133:0/2306678904 conn(0x7f31280c8200 msgr2=0x7f31280c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 -- 172.21.15.133:0/2306678904 shutdown_connections 2024-01-21T20:11:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.562+0000 7f313049a700 1 -- 172.21.15.133:0/2306678904 wait complete. 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.564+0000 7f313049a700 1 Processor -- start 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.564+0000 7f313049a700 1 -- start start 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3128066460 0x7f3128142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 0x7f3128062f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3128063940 con 0x7f31281521e0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31280bf700 con 0x7f31280acbc0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31280be810 con 0x7f3128066460 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42842/0 (socket says 172.21.15.133:42842) 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 -- 172.21.15.133:0/1887491265 learned_addr learned my addr 172.21.15.133:0/1887491265 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312da35700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 0x7f3128062f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312e236700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3128066460 0x7f3128142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 -- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3128066460 msgr2=0x7f3128142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3128066460 0x7f3128142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 -- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 msgr2=0x7f3128062f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 0x7f3128062f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 -- 172.21.15.133:0/1887491265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009370 con 0x7f31281521e0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312da35700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 0x7f3128062f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f312ea37700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3120009df0 tx=0x7f312000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000cb50 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312000f040 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31280beaf0 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000cec0 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.565+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31280bf0b0 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.566+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31280bf890 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.567+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3120013610 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.567+0000 7f311effd700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 0x7f310c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.567+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f312007ac70 con 0x7f31281521e0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.567+0000 7f312e236700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 0x7f310c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.567+0000 7f312e236700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 0x7f310c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f31280600a0 tx=0x7f3124016000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.571+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f312004bd10 con 0x7f31281521e0 2024-01-21T20:11:56.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.734+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3128065c60 con 0x7f31281521e0 2024-01-21T20:11:56.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.735+0000 7f311effd700 1 -- 172.21.15.133:0/1887491265 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17829 (secure 0 0 0) 0x7f312004f330 con 0x7f31281521e0 2024-01-21T20:11:56.725 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:56.725 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":61,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:56.408777+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 msgr2=0x7f310c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 0x7f310c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f31280600a0 tx=0x7f3124016000).stop 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 msgr2=0x7f3128063450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3120009df0 tx=0x7f312000b040).stop 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 shutdown_connections 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f310c05f150 0x7f310c061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31281521e0 0x7f3128063450 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3128066460 0x7f3128142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 --2- 172.21.15.133:0/1887491265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31280acbc0 0x7f3128062f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 >> 172.21.15.133:0/1887491265 conn(0x7f31280c8200 msgr2=0x7f3128069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 shutdown_connections 2024-01-21T20:11:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.737+0000 7f313049a700 1 -- 172.21.15.133:0/1887491265 wait complete. 2024-01-21T20:11:56.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:56.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.865+0000 7f669d2c6700 1 Processor -- start 2024-01-21T20:11:56.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.865+0000 7f669d2c6700 1 -- start start 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.865+0000 7f669d2c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 0x7f66980bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f669d2c6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6698065000 con 0x7f6698065490 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f669d2c6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6698069540 con 0x7f66980658d0 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f669d2c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698065d50 con 0x7f66980bc8a0 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f66967fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6698065490 0x7f66980a3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40192/0 (socket says 172.21.15.133:40192) 2024-01-21T20:11:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f66967fc700 1 -- 172.21.15.133:0/2905233738 learned_addr learned my addr 172.21.15.133:0/2905233738 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6696ffd700 1 --2- 172.21.15.133:0/2905233738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 0x7f66980bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014915907 0 0) 0x7f6698065000 con 0x7f6698065490 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6680004500 con 0x7f6698065490 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364084009 0 0) 0x7f6698069540 con 0x7f66980658d0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6698065000 con 0x7f66980658d0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6696ffd700 1 -- 172.21.15.133:0/2905233738 >> v1:172.21.15.178:6789/0 conn(0x7f66980658d0 legacy=0x7f669806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6696ffd700 1 -- 172.21.15.133:0/2905233738 >> v1:172.21.15.133:6789/0 conn(0x7f6698065490 legacy=0x7f66980a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991635577 0 0) 0x7f6680004500 con 0x7f6698065490 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6696ffd700 1 -- 172.21.15.133:0/2905233738 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698064410 con 0x7f66980bc8a0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.866+0000 7f6696ffd700 1 --2- 172.21.15.133:0/2905233738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 0x7f66980bcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6688009790 tx=0x7f6688009060).ready entity=mon.2 client_cookie=44a603a6cbdc8ea4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c001470 con 0x7f66980bc8a0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66880090d0 con 0x7f66980bc8a0 2024-01-21T20:11:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f6695ffb700 1 -- 172.21.15.133:0/2905233738 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688011610 con 0x7f66980bc8a0 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 -- 172.21.15.133:0/2905233738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 msgr2=0x7f66980bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 --2- 172.21.15.133:0/2905233738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 0x7f66980bcc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6688009790 tx=0x7f6688009060).stop 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 -- 172.21.15.133:0/2905233738 shutdown_connections 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 --2- 172.21.15.133:0/2905233738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66980bc8a0 0x7f66980bcc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 -- 172.21.15.133:0/2905233738 >> 172.21.15.133:0/2905233738 conn(0x7f66980c6ef0 msgr2=0x7f66980c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 -- 172.21.15.133:0/2905233738 shutdown_connections 2024-01-21T20:11:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.867+0000 7f669d2c6700 1 -- 172.21.15.133:0/2905233738 wait complete. 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.868+0000 7f669d2c6700 1 Processor -- start 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.868+0000 7f669d2c6700 1 -- start start 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6698065490 0x7f66980aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66980658d0 0x7f66980ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980ab850 con 0x7f66980bc8a0 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980acaf0 con 0x7f66980658d0 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f669d2c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698094370 con 0x7f6698065490 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f66977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f66977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42858/0 (socket says 172.21.15.133:42858) 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f66977fe700 1 -- 172.21.15.133:0/69982463 learned_addr learned my addr 172.21.15.133:0/69982463 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f6696ffd700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6698065490 0x7f66980aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.869+0000 7f66967fc700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66980658d0 0x7f66980ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 -- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6698065490 msgr2=0x7f66980aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6698065490 0x7f66980aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 -- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66980658d0 msgr2=0x7f66980ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66980658d0 0x7f66980ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 -- 172.21.15.133:0/69982463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880092a0 con 0x7f66980bc8a0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f66977fe700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f669000c740 tx=0x7f669000ca50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000e4a0 con 0x7f66980bc8a0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000e600 con 0x7f66980bc8a0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980ac660 con 0x7f66980bc8a0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000e980 con 0x7f66980bc8a0 2024-01-21T20:11:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.870+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66980ac010 con 0x7f66980bc8a0 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.871+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66980ac7f0 con 0x7f66980bc8a0 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.871+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f669000ed30 con 0x7f66980bc8a0 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.872+0000 7f667f7fe700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 0x7f6684061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.872+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f6690079a40 con 0x7f66980bc8a0 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.872+0000 7f6696ffd700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 0x7f6684061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.872+0000 7f6696ffd700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 0x7f6684061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f66880096e0 tx=0x7f6688016000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:56.876+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6690048b00 con 0x7f66980bc8a0 2024-01-21T20:11:57.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.038+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66980bd9b0 con 0x7f66980bc8a0 2024-01-21T20:11:57.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.039+0000 7f667f7fe700 1 -- 172.21.15.133:0/69982463 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17829 (secure 0 0 0) 0x7f6690017070 con 0x7f66980bc8a0 2024-01-21T20:11:57.029 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:57.029 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":61,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:56.408777+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 msgr2=0x7f6684061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 0x7f6684061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f66880096e0 tx=0x7f6688016000).stop 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 msgr2=0x7f6698152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f669000c740 tx=0x7f669000ca50).stop 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 shutdown_connections 2024-01-21T20:11:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f668405f150 0x7f6684061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980bc8a0 0x7f6698152f90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6698065490 0x7f66980aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 --2- 172.21.15.133:0/69982463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66980658d0 0x7f66980ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 >> 172.21.15.133:0/69982463 conn(0x7f66980c6ef0 msgr2=0x7f66980a4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 shutdown_connections 2024-01-21T20:11:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.041+0000 7f669d2c6700 1 -- 172.21.15.133:0/69982463 wait complete. 2024-01-21T20:11:57.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:11:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.173+0000 7efbef42d700 1 Processor -- start 2024-01-21T20:11:57.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.173+0000 7efbef42d700 1 -- start start 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbef42d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 0x7efbe813a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbef42d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efbe813a9e0 0x7efbe80bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbef42d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbe80c64d0 con 0x7efbe80c3840 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbef42d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbe80c4080 con 0x7efbe813a9e0 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbef42d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe8067f10 con 0x7efbe80c3c20 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.174+0000 7efbed9ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efbe813a9e0 0x7efbe80bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efbe813a9e0 0x7efbe80bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42864/0 (socket says 172.21.15.133:42864) 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 -- 172.21.15.133:0/565564002 learned_addr learned my addr 172.21.15.133:0/565564002 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:57.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbec9c8700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 0x7efbe813a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 -- 172.21.15.133:0/565564002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 msgr2=0x7efbe813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 0x7efbe813a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 -- 172.21.15.133:0/565564002 >> v1:172.21.15.133:6789/0 conn(0x7efbe80c3840 legacy=0x7efbe80c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 -- 172.21.15.133:0/565564002 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe80681f0 con 0x7efbe813a9e0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbec9c8700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 0x7efbe813a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbed9ca700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe813a9e0 0x7efbe80bdf60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7efbe0009f20 tx=0x7efbe0009840).ready entity=mon.0 client_cookie=afc9ba2d0a979983 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbdffff700 1 -- 172.21.15.133:0/565564002 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000e070 con 0x7efbe813a9e0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbdffff700 1 -- 172.21.15.133:0/565564002 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe000ba80 con 0x7efbe813a9e0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.175+0000 7efbdffff700 1 -- 172.21.15.133:0/565564002 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe000be00 con 0x7efbe813a9e0 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 -- 172.21.15.133:0/565564002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe813a9e0 msgr2=0x7efbe80bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe813a9e0 0x7efbe80bdf60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7efbe0009f20 tx=0x7efbe0009840).stop 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 -- 172.21.15.133:0/565564002 shutdown_connections 2024-01-21T20:11:57.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe813a9e0 0x7efbe80bdf60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 --2- 172.21.15.133:0/565564002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe80c3c20 0x7efbe813a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 -- 172.21.15.133:0/565564002 >> 172.21.15.133:0/565564002 conn(0x7efbe8066a70 msgr2=0x7efbe8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 -- 172.21.15.133:0/565564002 shutdown_connections 2024-01-21T20:11:57.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.176+0000 7efbef42d700 1 -- 172.21.15.133:0/565564002 wait complete. 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.177+0000 7efbef42d700 1 Processor -- start 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.177+0000 7efbef42d700 1 -- start start 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efbe80c3c20 0x7efbe80ac650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 0x7efbe8153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe80c1bb0 con 0x7efbe80c3840 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbe80c29d0 con 0x7efbe80c3c20 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbe80acb40 con 0x7efbe813a9e0 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42878/0 (socket says 172.21.15.133:42878) 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 -- 172.21.15.133:0/3525016839 learned_addr learned my addr 172.21.15.133:0/3525016839 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed9ca700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 0x7efbe8153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbec9c8700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efbe80c3c20 0x7efbe80ac650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 -- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 msgr2=0x7efbe8153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 0x7efbe8153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 -- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efbe80c3c20 msgr2=0x7efbe80ac650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efbe80c3c20 0x7efbe80ac650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 -- 172.21.15.133:0/3525016839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe0009ae0 con 0x7efbe80c3840 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed9ca700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 0x7efbe8153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbed1c9700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7efbd800c4c0 tx=0x7efbd8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbd8007020 con 0x7efbe80c3840 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbd8001e90 con 0x7efbe80c3840 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbe80c1dc0 con 0x7efbe80c3840 2024-01-21T20:11:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.178+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbd80073b0 con 0x7efbe80c3840 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.179+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbe80c2380 con 0x7efbe80c3840 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.180+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbe805fdf0 con 0x7efbe80c3840 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.180+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efbd80068b0 con 0x7efbe80c3840 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.180+0000 7efbddffb700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 0x7efbcc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.180+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6677+0+0 (secure 0 0 0) 0x7efbd8079c40 con 0x7efbe80c3840 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.180+0000 7efbec9c8700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 0x7efbcc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.181+0000 7efbec9c8700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 0x7efbcc061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efbe4006d80 tx=0x7efbe4008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.184+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efbd804ace0 con 0x7efbe80c3840 2024-01-21T20:11:57.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.390+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efbe80c64d0 con 0x7efbe80c3840 2024-01-21T20:11:57.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.412+0000 7efbddffb700 1 -- 172.21.15.133:0/3525016839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7efbe80c64d0 con 0x7efbe80c3840 2024-01-21T20:11:57.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 msgr2=0x7efbcc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 0x7efbcc061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7efbe4006d80 tx=0x7efbe4008040).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 msgr2=0x7efbe80c16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7efbd800c4c0 tx=0x7efbd8007e00).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 shutdown_connections 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efbcc05f150 0x7efbcc061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efbe813a9e0 0x7efbe8153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efbe80c3840 0x7efbe80c16c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 --2- 172.21.15.133:0/3525016839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efbe80c3c20 0x7efbe80ac650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 >> 172.21.15.133:0/3525016839 conn(0x7efbe8066a70 msgr2=0x7efbe8159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 shutdown_connections 2024-01-21T20:11:57.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.415+0000 7efbef42d700 1 -- 172.21.15.133:0/3525016839 wait complete. 2024-01-21T20:11:57.417 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:11:57.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:11:57.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.546+0000 7f53b3316700 1 Processor -- start 2024-01-21T20:11:57.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.546+0000 7f53b3316700 1 -- start start 2024-01-21T20:11:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b3316700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53ac066310 0x7f53ac0a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b3316700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac0c4720 0x7f53ac0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b3316700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac0c50c0 con 0x7f53ac1542e0 2024-01-21T20:11:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b3316700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac0a77f0 con 0x7f53ac066310 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b3316700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac066810 con 0x7f53ac0c4720 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53ac066310 0x7f53ac0a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53ac066310 0x7f53ac0a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42892/0 (socket says 172.21.15.133:42892) 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 -- 172.21.15.133:0/185303449 learned_addr learned my addr 172.21.15.133:0/185303449 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 -- 172.21.15.133:0/185303449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac0c4720 msgr2=0x7f53ac0c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 --2- 172.21.15.133:0/185303449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac0c4720 0x7f53ac0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 -- 172.21.15.133:0/185303449 >> v1:172.21.15.178:6789/0 conn(0x7f53ac1542e0 legacy=0x7f53ac0a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 -- 172.21.15.133:0/185303449 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac066af0 con 0x7f53ac066310 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53b08b1700 1 --2- 172.21.15.133:0/185303449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac066310 0x7f53ac0a7300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f539c006fd0 tx=0x7f539c0090f0).ready entity=mon.0 client_cookie=9e50fcfeb4e20ca6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.547+0000 7f53a3fff700 1 -- 172.21.15.133:0/185303449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00b600 con 0x7f53ac066310 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53a3fff700 1 -- 172.21.15.133:0/185303449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c00b760 con 0x7f53ac066310 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53a3fff700 1 -- 172.21.15.133:0/185303449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c00bb00 con 0x7f53ac066310 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 -- 172.21.15.133:0/185303449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac066310 msgr2=0x7f53ac0a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 --2- 172.21.15.133:0/185303449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac066310 0x7f53ac0a7300 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f539c006fd0 tx=0x7f539c0090f0).stop 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 -- 172.21.15.133:0/185303449 shutdown_connections 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 --2- 172.21.15.133:0/185303449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac0c4720 0x7f53ac0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 --2- 172.21.15.133:0/185303449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac066310 0x7f53ac0a7300 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 -- 172.21.15.133:0/185303449 >> 172.21.15.133:0/185303449 conn(0x7f53ac065920 msgr2=0x7f53ac0c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 -- 172.21.15.133:0/185303449 shutdown_connections 2024-01-21T20:11:57.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.548+0000 7f53b3316700 1 -- 172.21.15.133:0/185303449 wait complete. 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.549+0000 7f53b3316700 1 Processor -- start 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.549+0000 7f53b3316700 1 -- start start 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 0x7f53ac0a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 0x7f53ac0a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac154bc0 con 0x7f53ac1542e0 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac1504a0 con 0x7f53ac0c4720 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b3316700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0a9650 con 0x7f53ac066310 2024-01-21T20:11:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b18b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b18b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42902/0 (socket says 172.21.15.133:42902) 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b18b3700 1 -- 172.21.15.133:0/3309577933 learned_addr learned my addr 172.21.15.133:0/3309577933 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b08b1700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 0x7f53ac0a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.550+0000 7f53b10b2700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 0x7f53ac0a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 -- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 msgr2=0x7f53ac0a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 0x7f53ac0a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 -- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 msgr2=0x7f53ac0a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 0x7f53ac0a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 -- 172.21.15.133:0/3309577933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009370 con 0x7f53ac1542e0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b10b2700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 0x7f53ac0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b08b1700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 0x7f53ac0a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b18b3700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f53a400b790 tx=0x7f53a4009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400d620 con 0x7f53ac1542e0 2024-01-21T20:11:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a400d7a0 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac0aa6a0 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400db60 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.551+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac0aac20 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.552+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac05fdf0 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.552+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f53a400f480 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.553+0000 7f53a1ffb700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 0x7f5390061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.553+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f53a407a580 con 0x7f53ac1542e0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.553+0000 7f53b10b2700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 0x7f5390061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.553+0000 7f53b10b2700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 0x7f5390061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f53a80026f0 tx=0x7f53a8009040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.557+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f53a404b5c0 con 0x7f53ac1542e0 2024-01-21T20:11:57.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:57.761+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53ac0a8950 con 0x7f53ac1542e0 2024-01-21T20:11:58.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.419+0000 7f53a1ffb700 1 -- 172.21.15.133:0/3309577933 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53a404ebe0 con 0x7f53ac1542e0 2024-01-21T20:11:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.421+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 msgr2=0x7f5390061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.421+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 0x7f5390061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f53a80026f0 tx=0x7f53a8009040).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.421+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 msgr2=0x7f53ac0a8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.421+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f53a400b790 tx=0x7f53a4009330).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 shutdown_connections 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f539005f150 0x7f5390061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53ac1542e0 0x7f53ac0a8040 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53ac066310 0x7f53ac0a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 --2- 172.21.15.133:0/3309577933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53ac0c4720 0x7f53ac0a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 >> 172.21.15.133:0/3309577933 conn(0x7f53ac065920 msgr2=0x7f53ac0c5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 shutdown_connections 2024-01-21T20:11:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.422+0000 7f53b3316700 1 -- 172.21.15.133:0/3309577933 wait complete. 2024-01-21T20:11:58.426 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:11:58.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:11:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.554+0000 7f3fbb59e700 1 Processor -- start 2024-01-21T20:11:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.554+0000 7f3fbb59e700 1 -- start start 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.555+0000 7f3fbb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 0x7f3fbc063790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.555+0000 7f3fbb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.555+0000 7f3fbb59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc0c3c10 con 0x7f3fbc150cc0 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.555+0000 7f3fbb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc0c3730 con 0x7f3fbc0c3280 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.555+0000 7f3fbb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc069210 con 0x7f3fbc1510a0 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42904/0 (socket says 172.21.15.133:42904) 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 -- 172.21.15.133:0/3796211390 learned_addr learned my addr 172.21.15.133:0/3796211390 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fb9d9b700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 0x7f3fbc063790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 -- 172.21.15.133:0/3796211390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 msgr2=0x7f3fbc063790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 0x7f3fbc063790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 -- 172.21.15.133:0/3796211390 >> v1:172.21.15.178:6789/0 conn(0x7f3fbc150cc0 legacy=0x7f3fbc0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 -- 172.21.15.133:0/3796211390 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc0c3930 con 0x7f3fbc0c3280 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fb9d9b700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 0x7f3fbc063790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fbad9d700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3fb400d1a0 tx=0x7f3fb400ba50).ready entity=mon.0 client_cookie=438abc56847c0062 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fb959a700 1 -- 172.21.15.133:0/3796211390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4010070 con 0x7f3fbc0c3280 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fb959a700 1 -- 172.21.15.133:0/3796211390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400b0d0 con 0x7f3fbc0c3280 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.556+0000 7f3fb959a700 1 -- 172.21.15.133:0/3796211390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400b450 con 0x7f3fbc0c3280 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 -- 172.21.15.133:0/3796211390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc0c3280 msgr2=0x7f3fbc0bc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f3fb400d1a0 tx=0x7f3fb400ba50).stop 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 -- 172.21.15.133:0/3796211390 shutdown_connections 2024-01-21T20:11:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc0c3280 0x7f3fbc0bc2f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/3796211390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc1510a0 0x7f3fbc063790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 -- 172.21.15.133:0/3796211390 >> 172.21.15.133:0/3796211390 conn(0x7f3fbc0c7370 msgr2=0x7f3fbc0c7780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 -- 172.21.15.133:0/3796211390 shutdown_connections 2024-01-21T20:11:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.557+0000 7f3fbb59e700 1 -- 172.21.15.133:0/3796211390 wait complete. 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.558+0000 7f3fbb59e700 1 Processor -- start 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.558+0000 7f3fbb59e700 1 -- start start 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc0c3280 0x7f3fbc146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fbc1510a0 0x7f3fbc0be900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc150090 con 0x7f3fbc150cc0 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc153560 con 0x7f3fbc1510a0 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0bef90 con 0x7f3fbc0c3280 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42912/0 (socket says 172.21.15.133:42912) 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 -- 172.21.15.133:0/273428584 learned_addr learned my addr 172.21.15.133:0/273428584 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fbad9d700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fbc1510a0 0x7f3fbc0be900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fba59c700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc0c3280 0x7f3fbc146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 -- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc0c3280 msgr2=0x7f3fbc146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc0c3280 0x7f3fbc146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 -- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fbc1510a0 msgr2=0x7f3fbc0be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fbc1510a0 0x7f3fbc0be900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.559+0000 7f3fb9d9b700 1 -- 172.21.15.133:0/273428584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb400bcf0 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fb9d9b700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3fac006fd0 tx=0x7f3fac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac016070 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac011590 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0bf270 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac011910 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.560+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc153b00 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.561+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc06c7b0 con 0x7f3fbc150cc0 2024-01-21T20:11:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.561+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3fac011d00 con 0x7f3fbc150cc0 2024-01-21T20:11:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.561+0000 7f3fb2ffd700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 0x7f3f9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.561+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f3fac079d50 con 0x7f3fbc150cc0 2024-01-21T20:11:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.562+0000 7f3fba59c700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 0x7f3f9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.562+0000 7f3fba59c700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 0x7f3f9c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3fa4003900 tx=0x7f3fa4007d40).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.566+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3fac07d030 con 0x7f3fbc150cc0 2024-01-21T20:11:58.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.769+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fbc069ba0 con 0x7f3fbc150cc0 2024-01-21T20:11:58.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.770+0000 7f3fb2ffd700 1 -- 172.21.15.133:0/273428584 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f3fac04ad90 con 0x7f3fbc150cc0 2024-01-21T20:11:58.761 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:58.761 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 msgr2=0x7f3f9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 0x7f3f9c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3fa4003900 tx=0x7f3fa4007d40).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 msgr2=0x7f3fbc0be410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f3fac006fd0 tx=0x7f3fac008040).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 shutdown_connections 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3f9c05f150 0x7f3f9c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fbc1510a0 0x7f3fbc0be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fbc0c3280 0x7f3fbc146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 --2- 172.21.15.133:0/273428584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fbc150cc0 0x7f3fbc0be410 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 >> 172.21.15.133:0/273428584 conn(0x7f3fbc0c7370 msgr2=0x7f3fbc0bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 shutdown_connections 2024-01-21T20:11:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.772+0000 7f3fbb59e700 1 -- 172.21.15.133:0/273428584 wait complete. 2024-01-21T20:11:58.764 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:11:58.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:11:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.899+0000 7f54ec88d700 1 Processor -- start 2024-01-21T20:11:58.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.899+0000 7f54ec88d700 1 -- start start 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54ec88d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e8062c10 0x7f54e8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54ec88d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80634e0 con 0x7f54e80697e0 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54ec88d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e806a130 con 0x7f54e8065d70 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54ec88d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e806a410 con 0x7f54e8062c10 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e5d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f54e80697e0 0x7f54e8065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40210/0 (socket says 172.21.15.133:40210) 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e5d9b700 1 -- 172.21.15.133:0/3670191170 learned_addr learned my addr 172.21.15.133:0/3670191170 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e659c700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e8062c10 0x7f54e8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776122210 0 0) 0x7f54e80634e0 con 0x7f54e80697e0 2024-01-21T20:11:58.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d00033f0 con 0x7f54e80697e0 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535309717 0 0) 0x7f54e806a130 con 0x7f54e8065d70 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.900+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54e80634e0 con 0x7f54e8065d70 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2843827898 0 0) 0x7f54d00033f0 con 0x7f54e80697e0 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e8062c10 msgr2=0x7f54e8062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e8062c10 0x7f54e8062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 >> v1:172.21.15.178:6789/0 conn(0x7f54e8065d70 legacy=0x7f54e80bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e806a6f0 con 0x7f54e80697e0 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f54dc001470 con 0x7f54e80697e0 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 >> v1:172.21.15.133:6789/0 conn(0x7f54e80697e0 legacy=0x7f54e8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0003aa0 0x7f54d0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d0004690 0x7f54d0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0005050 0x7f54d000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e806a410 con 0x7f54d0004690 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d000bf60 con 0x7f54d0003aa0 2024-01-21T20:11:58.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d000c120 con 0x7f54d0005050 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e659c700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e8062c10 0x7f54e8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d0004690 0x7f54d0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e6d9d700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0005050 0x7f54d000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e659c700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0003aa0 0x7f54d0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 -- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0005050 msgr2=0x7f54d000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54d0005050 0x7f54d000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 -- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0003aa0 msgr2=0x7f54d0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0003aa0 0x7f54d0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 -- 172.21.15.133:0/3670191170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d00033f0 con 0x7f54d0004690 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e659c700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0003aa0 0x7f54d0003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e5d9b700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d0004690 0x7f54d0004b10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f54dc007f50 tx=0x7f54dc001d40).ready entity=mon.0 client_cookie=24ac5c9fcd390d85 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00c960 con 0x7f54d0004690 2024-01-21T20:11:58.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00cac0 con 0x7f54d0004690 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.901+0000 7f54e559a700 1 -- 172.21.15.133:0/3670191170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00ce80 con 0x7f54d0004690 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 -- 172.21.15.133:0/3670191170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d0004690 msgr2=0x7f54d0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 --2- 172.21.15.133:0/3670191170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54d0004690 0x7f54d0004b10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f54dc007f50 tx=0x7f54dc001d40).stop 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54e6d9d700 1 -- 172.21.15.133:0/3670191170 reap_dead start 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 -- 172.21.15.133:0/3670191170 shutdown_connections 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 -- 172.21.15.133:0/3670191170 >> 172.21.15.133:0/3670191170 conn(0x7f54e80c8010 msgr2=0x7f54e80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 -- 172.21.15.133:0/3670191170 shutdown_connections 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.902+0000 7f54ec88d700 1 -- 172.21.15.133:0/3670191170 wait complete. 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.903+0000 7f54ec88d700 1 Processor -- start 2024-01-21T20:11:58.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.903+0000 7f54ec88d700 1 -- start start 2024-01-21T20:11:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0004690 0x7f54e80adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e80a8a80 0x7f54e80a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80aba90 con 0x7f54e80a93f0 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80ae070 con 0x7f54d0004690 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54ec88d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80a9870 con 0x7f54e80a8a80 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42936/0 (socket says 172.21.15.133:42936) 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 -- 172.21.15.133:0/2654244085 learned_addr learned my addr 172.21.15.133:0/2654244085 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e659c700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0004690 0x7f54e80adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e5d9b700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e80a8a80 0x7f54e80a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 -- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e80a8a80 msgr2=0x7f54e80a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e80a8a80 0x7f54e80a8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 -- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0004690 msgr2=0x7f54e80adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0004690 0x7f54e80adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:58.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.904+0000 7f54e6d9d700 1 -- 172.21.15.133:0/2654244085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e81393e0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54e6d9d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f54e80c5e10 tx=0x7f54e0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0002ea0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e00040d0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e81396c0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e000ca00 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.905+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e80ab720 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.906+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e805fdf0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.906+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f54e0014430 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.906+0000 7f54d6ffd700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 0x7f54c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.907+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f54e0079df0 con 0x7f54e80a93f0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.907+0000 7f54e659c700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 0x7f54c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:58.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.907+0000 7f54e659c700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 0x7f54c8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f54d8006d80 tx=0x7f54d8008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:58.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:58.911+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54e0049b00 con 0x7f54e80a93f0 2024-01-21T20:11:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.076+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54e80bcf70 con 0x7f54e80a93f0 2024-01-21T20:11:59.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.077+0000 7f54d6ffd700 1 -- 172.21.15.133:0/2654244085 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+17816 (secure 0 0 0) 0x7f54e80bcf70 con 0x7f54e80a93f0 2024-01-21T20:11:59.068 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:59.068 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:11:57.410878+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 msgr2=0x7f54c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 0x7f54c8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f54d8006d80 tx=0x7f54d8008040).stop 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 msgr2=0x7f54e80abf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f54e80c5e10 tx=0x7f54e0007f30).stop 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 shutdown_connections 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54c805f150 0x7f54c8061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54e80a93f0 0x7f54e80abf20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54d0004690 0x7f54e80adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 --2- 172.21.15.133:0/2654244085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54e80a8a80 0x7f54e80a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 >> 172.21.15.133:0/2654244085 conn(0x7f54e80c8010 msgr2=0x7f54e8065660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 shutdown_connections 2024-01-21T20:11:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.079+0000 7f54ec88d700 1 -- 172.21.15.133:0/2654244085 wait complete. 2024-01-21T20:11:59.082 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:11:59.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:11:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.207+0000 7ff3413db700 1 Processor -- start 2024-01-21T20:11:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.207+0000 7ff3413db700 1 -- start start 2024-01-21T20:11:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff3413db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff33c069ef0 0x7ff33c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff3413db700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c065660 con 0x7ff33c0beb30 2024-01-21T20:11:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff3413db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c065f00 con 0x7ff33c0c3fb0 2024-01-21T20:11:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff3413db700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33c0bef10 con 0x7ff33c069ef0 2024-01-21T20:11:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff33a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff33c069ef0 0x7ff33c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff33a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff33c069ef0 0x7ff33c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42948/0 (socket says 172.21.15.133:42948) 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.208+0000 7ff33a7fc700 1 -- 172.21.15.133:0/2999019743 learned_addr learned my addr 172.21.15.133:0/2999019743 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff33a7fc700 1 -- 172.21.15.133:0/2999019743 >> v1:172.21.15.178:6789/0 conn(0x7ff33c0c3fb0 legacy=0x7ff33c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff33a7fc700 1 -- 172.21.15.133:0/2999019743 >> v1:172.21.15.133:6789/0 conn(0x7ff33c0beb30 legacy=0x7ff33c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff33a7fc700 1 -- 172.21.15.133:0/2999019743 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0c4740 con 0x7ff33c069ef0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff33a7fc700 1 --2- 172.21.15.133:0/2999019743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c155b80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ff32c006fd0 tx=0x7ff32c0090f0).ready entity=mon.0 client_cookie=7d9625da22c789ba server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff339ffb700 1 -- 172.21.15.133:0/2999019743 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00b600 con 0x7ff33c069ef0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff339ffb700 1 -- 172.21.15.133:0/2999019743 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c00b760 con 0x7ff33c069ef0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff339ffb700 1 -- 172.21.15.133:0/2999019743 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c00bb00 con 0x7ff33c069ef0 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 -- 172.21.15.133:0/2999019743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 msgr2=0x7ff33c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 --2- 172.21.15.133:0/2999019743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c155b80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7ff32c006fd0 tx=0x7ff32c0090f0).stop 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 -- 172.21.15.133:0/2999019743 shutdown_connections 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 --2- 172.21.15.133:0/2999019743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c155b80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 -- 172.21.15.133:0/2999019743 >> 172.21.15.133:0/2999019743 conn(0x7ff33c0c8010 msgr2=0x7ff33c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 -- 172.21.15.133:0/2999019743 shutdown_connections 2024-01-21T20:11:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.209+0000 7ff3413db700 1 -- 172.21.15.133:0/2999019743 wait complete. 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 Processor -- start 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 -- start start 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff33c0beb30 0x7ff33c163750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff33c0c3fb0 0x7ff33c0a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c162d70 con 0x7ff33c069ef0 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0a8880 con 0x7ff33c0beb30 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.211+0000 7ff3413db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c1632c0 con 0x7ff33c0c3fb0 2024-01-21T20:11:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42964/0 (socket says 172.21.15.133:42964) 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 -- 172.21.15.133:0/1862130761 learned_addr learned my addr 172.21.15.133:0/1862130761 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 -- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff33c0c3fb0 msgr2=0x7ff33c0a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33a7fc700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff33c0beb30 0x7ff33c163750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff33c0c3fb0 0x7ff33c0a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 -- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff33c0beb30 msgr2=0x7ff33c163750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff33c0beb30 0x7ff33c163750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 -- 172.21.15.133:0/1862130761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c009370 con 0x7ff33c069ef0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff33affd700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7ff33000c470 tx=0x7ff330007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000f470 con 0x7ff33c069ef0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000f5d0 con 0x7ff33c069ef0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c139a20 con 0x7ff33c069ef0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000f970 con 0x7ff33c069ef0 2024-01-21T20:11:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.212+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0a85a0 con 0x7ff33c069ef0 2024-01-21T20:11:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.213+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c1635a0 con 0x7ff33c069ef0 2024-01-21T20:11:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.214+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff33000fd20 con 0x7ff33c069ef0 2024-01-21T20:11:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.214+0000 7ff3237fe700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 0x7ff328061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.214+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7ff3300799a0 con 0x7ff33c069ef0 2024-01-21T20:11:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.214+0000 7ff33a7fc700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 0x7ff328061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.214+0000 7ff33a7fc700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 0x7ff328061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff32c006fd0 tx=0x7ff32c017000).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.218+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff33004aa40 con 0x7ff33c069ef0 2024-01-21T20:11:59.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.377+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff33c05fdf0 con 0x7ff32805f150 2024-01-21T20:11:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.387+0000 7ff3237fe700 1 -- 172.21.15.133:0/1862130761 <== mgr.5655 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350103 (secure 0 0 0) 0x7ff33c05fdf0 con 0x7ff32805f150 2024-01-21T20:11:59.383 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 msgr2=0x7ff328061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 0x7ff328061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff32c006fd0 tx=0x7ff32c017000).stop 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 msgr2=0x7ff33c139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7ff33000c470 tx=0x7ff330007dc0).stop 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 shutdown_connections 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff32805f150 0x7ff328061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff33c0c3fb0 0x7ff33c0a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff33c069ef0 0x7ff33c139530 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 --2- 172.21.15.133:0/1862130761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff33c0beb30 0x7ff33c163750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 >> 172.21.15.133:0/1862130761 conn(0x7ff33c0c8010 msgr2=0x7ff33c0626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 shutdown_connections 2024-01-21T20:11:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.391+0000 7ff3413db700 1 -- 172.21.15.133:0/1862130761 wait complete. 2024-01-21T20:11:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:11:59.394 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:11:57.665163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2410808,"kb_used_data":5368,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752563912,"statfs":{"total":773094113280,"available":770625445888,"internally_reserved":0,"allocated":5496832,"data_stored":2671750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15006739,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-724,"num_write_kb":-15559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.443031"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:52.016746+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:11:52.016746+0000","last_peered":"2024-01-21T20:11:52.016746+0000","last_clean":"2024-01-21T20:11:52.016746+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:11:52.016746+0000","last_undegraded":"2024-01-21T20:11:52.016746+0000","last_fullsized":"2024-01-21T20:11:52.016746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.057200+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:11:51.057200+0000","last_peered":"2024-01-21T20:11:51.057200+0000","last_clean":"2024-01-21T20:11:51.057200+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:11:51.057200+0000","last_undegraded":"2024-01-21T20:11:51.057200+0000","last_fullsized":"2024-01-21T20:11:51.057200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.060413+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:11:51.060413+0000","last_peered":"2024-01-21T20:11:51.060413+0000","last_clean":"2024-01-21T20:11:51.060413+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:11:51.060413+0000","last_undegraded":"2024-01-21T20:11:51.060413+0000","last_fullsized":"2024-01-21T20:11:51.060413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.057213+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:11:51.057213+0000","last_peered":"2024-01-21T20:11:51.057213+0000","last_clean":"2024-01-21T20:11:51.057213+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:11:51.057213+0000","last_undegraded":"2024-01-21T20:11:51.057213+0000","last_fullsized":"2024-01-21T20:11:51.057213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.736488+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:11:51.736488+0000","last_peered":"2024-01-21T20:11:51.736488+0000","last_clean":"2024-01-21T20:11:51.736488+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:11:51.736488+0000","last_undegraded":"2024-01-21T20:11:51.736488+0000","last_fullsized":"2024-01-21T20:11:51.736488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.736522+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:11:51.736522+0000","last_peered":"2024-01-21T20:11:51.736522+0000","last_clean":"2024-01-21T20:11:51.736522+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:11:51.736522+0000","last_undegraded":"2024-01-21T20:11:51.736522+0000","last_fullsized":"2024-01-21T20:11:51.736522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.736481+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:11:51.736481+0000","last_peered":"2024-01-21T20:11:51.736481+0000","last_clean":"2024-01-21T20:11:51.736481+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:11:51.736481+0000","last_undegraded":"2024-01-21T20:11:51.736481+0000","last_fullsized":"2024-01-21T20:11:51.736481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-01-21T20:11:52.016734+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:11:52.016734+0000","last_peered":"2024-01-21T20:11:52.016734+0000","last_clean":"2024-01-21T20:11:52.016734+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:11:52.016734+0000","last_undegraded":"2024-01-21T20:11:52.016734+0000","last_fullsized":"2024-01-21T20:11:52.016734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:56.030617+0000","last_change":"2024-01-21T20:11:56.030617+0000","last_active":"2024-01-21T20:11:56.030617+0000","last_peered":"2024-01-21T20:11:56.030617+0000","last_clean":"2024-01-21T20:11:56.030617+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:56.030617+0000","last_undegraded":"2024-01-21T20:11:56.030617+0000","last_fullsized":"2024-01-21T20:11:56.030617+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:11:55.028489+0000","last_change":"2024-01-21T20:11:55.028489+0000","last_active":"2024-01-21T20:11:55.028489+0000","last_peered":"2024-01-21T20:11:55.028489+0000","last_clean":"2024-01-21T20:11:55.028489+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:11:55.028489+0000","last_undegraded":"2024-01-21T20:11:55.028489+0000","last_fullsized":"2024-01-21T20:11:55.028489+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-21T20:11:51.052024+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:11:51.052024+0000","last_peered":"2024-01-21T20:11:51.052024+0000","last_clean":"2024-01-21T20:11:51.052024+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:11:51.052024+0000","last_undegraded":"2024-01-21T20:11:51.052024+0000","last_fullsized":"2024-01-21T20:11:51.052024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301860,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069980,"statfs":{"total":96636764160,"available":96327659520,"internally_reserved":0,"allocated":684032,"data_stored":333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.35799999999999998,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.79300000000000004,"15min":0.81000000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.80300000000000005,"15min":1.47},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56399999999999995,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":0.78100000000000003,"15min":0.91100000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75900000000000001,"15min":0.79700000000000004},"last":0.65600000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.4930000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.81799999999999995,"15min":1.5229999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":1.514},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.31},"max":{"1min":0.626,"5min":0.72099999999999997,"15min":0.755},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.71699999999999997,"5min":0.82499999999999996,"15min":0.84799999999999998},"last":0.71299999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.81399999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.83299999999999996},"last":0.626}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.82499999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.88400000000000001},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.57799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.25800000000000001},"max":{"1min":0.72099999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.63100000000000001,"15min":0.60399999999999998},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":1.083,"15min":1.083},"last":0.56200000000000006}]},{"osd":1,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":1.107,"15min":1.107},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.442,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69399999999999995,"5min":1.016,"15min":1.016},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60099999999999998,"15min":0.57099999999999995},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47099999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.67300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.44400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":1.069,"15min":1.069},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.54400000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.318},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.36899999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.373,"5min":0.314,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.435}]},{"osd":7,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66700000000000004,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.40300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.20999999999999999},"max":{"1min":0.54600000000000004,"5min":0.60599999999999998,"15min":0.61399999999999999},"last":0.379},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.247},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.627},"last":0.39200000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.38900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.19400000000000001},"max":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29999999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.43099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.247},"max":{"1min":0.624,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.628}]},{"osd":5,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67100000000000004,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.53500000000000003,"5min":0.47299999999999998,"15min":0.47199999999999998},"max":{"1min":0.94399999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.44900000000000001,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.44},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.75}]},{"osd":7,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.63100000000000001},"min":{"1min":0.495,"5min":0.42799999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.71899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":684032,"data_stored":333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.20599999999999999},"max":{"1min":0.51700000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32300000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41499999999999998,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.375},{"interface":"front","average":{"1min":0.433,"5min":0.44400000000000001,"15min":0.42399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.316}]},{"osd":3,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":0.54700000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27100000000000002},"max":{"1min":0.58399999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60899999999999999},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.41799999999999998},"max":{"1min":0.86699999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.54300000000000004,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":0.79500000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.755},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.58599999999999997,"5min":0.45800000000000002,"15min":0.44600000000000001},"max":{"1min":0.83699999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39400000000000002,"15min":0.39700000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.91500000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.53300000000000003,"5min":0.60899999999999999,"15min":0.93799999999999994},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52700000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53500000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.433}]},{"osd":3,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.42999999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":0.625,"15min":0.64300000000000002},"last":0.372},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.44700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39500000000000002},"max":{"1min":0.78400000000000003,"5min":0.84599999999999997,"15min":0.95499999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.66800000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85099999999999998,"5min":0.91600000000000004,"15min":0.96899999999999997},"last":0.76000000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38600000000000001},"max":{"1min":0.77700000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.36599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98699999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":0.999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.64000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.93400000000000005},"last":0.623}]},{"osd":7,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79000000000000004,"5min":0.88500000000000001,"15min":0.92900000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79500000000000004,"5min":0.94899999999999995,"15min":0.96499999999999997},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.61299999999999999},"last":0.28699999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.37},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.22700000000000001},"max":{"1min":0.55900000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41399999999999998,"15min":0.39900000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.312}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34399999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":1.087},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.95399999999999996},"last":0.46300000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.86199999999999999,"5min":0.90800000000000003,"15min":1.044},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.38400000000000001},"max":{"1min":0.83999999999999997,"5min":0.88500000000000001,"15min":0.98799999999999999},"last":0.45300000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":0.89400000000000002,"15min":1.0269999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.88800000000000001,"5min":0.98999999999999999,"15min":1},"last":0.44600000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":0.96699999999999997,"15min":3.3330000000000002},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.441},"max":{"1min":0.89500000000000002,"5min":0.93300000000000005,"15min":1.0820000000000001},"last":0.51300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":301864,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069976,"statfs":{"total":96636764160,"available":96327655424,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.66900000000000004,"5min":0.79200000000000004,"15min":1.379},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.37},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":1.139},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.621,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":1.8220000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":2.3140000000000001},"last":0.39200000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":1.7130000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":0.752,"15min":2.262},"last":0.441}]},{"osd":3,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":1.2470000000000001},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.68000000000000005,"5min":0.754,"15min":1.7410000000000001},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":2.3530000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77600000000000002,"15min":1.296},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.79500000000000004,"15min":1.7629999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54100000000000004,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.35999999999999999,"15min":0.316},"max":{"1min":0.64300000000000002,"5min":0.80000000000000004,"15min":2.3839999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":1.3280000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.73899999999999999,"5min":0.83499999999999996,"15min":1.8839999999999999},"last":0.61399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065880,"statfs":{"total":96636764160,"available":96323461120,"internally_reserved":0,"allocated":688128,"data_stored":334209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.33000000000000002},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":1.4690000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.36799999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.83899999999999997},"last":0.55700000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.79100000000000004,"15min":1.446},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.76400000000000001,"15min":0.78000000000000003},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":1.4970000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.378},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":1.425},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.68899999999999995,"5min":0.76800000000000002,"15min":0.79400000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.78600000000000003,"15min":1.492},"last":0.623}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.96199999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66000000000000003,"5min":0.752,"15min":0.752},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.752,"15min":0.98199999999999998},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":1.0289999999999999},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:11:59.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:11:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.557+0000 7f86bcf45700 1 Processor -- start 2024-01-21T20:11:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.557+0000 7f86bcf45700 1 -- start start 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.558+0000 7f86bcf45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86b8067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.558+0000 7f86bcf45700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b8068370 con 0x7f86b8137410 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.558+0000 7f86bcf45700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b8068650 con 0x7f86b80c5930 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.558+0000 7f86bcf45700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8068930 con 0x7f86b8137030 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b5d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86b8137410 0x7f86b8155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40232/0 (socket says 172.21.15.133:40232) 2024-01-21T20:11:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b5d9b700 1 -- 172.21.15.133:0/409890697 learned_addr learned my addr 172.21.15.133:0/409890697 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b659c700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86b8067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509650039 0 0) 0x7f86b8068370 con 0x7f86b8137410 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a40033f0 con 0x7f86b8137410 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506334822 0 0) 0x7f86a40033f0 con 0x7f86b8137410 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 msgr2=0x7f86b8067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86b8067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 >> v1:172.21.15.178:6789/0 conn(0x7f86b80c5930 legacy=0x7f86b815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8068c10 con 0x7f86b8137410 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f86a8001470 con 0x7f86b8137410 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 >> v1:172.21.15.133:6789/0 conn(0x7f86b8137410 legacy=0x7f86b8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86a4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a4003e40 0x7f86a4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4004b80 0x7f86a4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8068930 con 0x7f86a4003e40 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a400ba10 con 0x7f86a4004b80 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a400bbd0 con 0x7f86b8137030 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b5d9b700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a4003e40 0x7f86a4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.559+0000 7f86b659c700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86a4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b6d9d700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4004b80 0x7f86a4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 -- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 msgr2=0x7f86a4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b8137030 0x7f86a4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 -- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4004b80 msgr2=0x7f86a4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4004b80 0x7f86a4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 -- 172.21.15.133:0/409890697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40033f0 con 0x7f86a4003e40 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b6d9d700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4004b80 0x7f86a4005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b5d9b700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a4003e40 0x7f86a4004690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f86a800c160 tx=0x7f86a8001e50).ready entity=mon.0 client_cookie=6915aaf776c1c614 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a8007a20 con 0x7f86a4003e40 2024-01-21T20:11:59.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a800ca90 con 0x7f86a4003e40 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b559a700 1 -- 172.21.15.133:0/409890697 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a800ce10 con 0x7f86a4003e40 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86bcf45700 1 -- 172.21.15.133:0/409890697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a4003e40 msgr2=0x7f86a4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86bcf45700 1 --2- 172.21.15.133:0/409890697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a4003e40 0x7f86a4004690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f86a800c160 tx=0x7f86a8001e50).stop 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86b6d9d700 1 -- 172.21.15.133:0/409890697 reap_dead start 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86bcf45700 1 -- 172.21.15.133:0/409890697 shutdown_connections 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.560+0000 7f86bcf45700 1 -- 172.21.15.133:0/409890697 >> 172.21.15.133:0/409890697 conn(0x7f86b8066a90 msgr2=0x7f86b8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.561+0000 7f86bcf45700 1 -- 172.21.15.133:0/409890697 shutdown_connections 2024-01-21T20:11:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.561+0000 7f86bcf45700 1 -- 172.21.15.133:0/409890697 wait complete. 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.562+0000 7f86bcf45700 1 Processor -- start 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.562+0000 7f86bcf45700 1 -- start start 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4003e40 0x7f86b80c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b813caa0 0x7f86b81361e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80c2620 con 0x7f86b80c4640 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80c17b0 con 0x7f86a4003e40 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b80c4f70 con 0x7f86b813caa0 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42970/0 (socket says 172.21.15.133:42970) 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 -- 172.21.15.133:0/3468998966 learned_addr learned my addr 172.21.15.133:0/3468998966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b659c700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4003e40 0x7f86b80c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b5d9b700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b813caa0 0x7f86b81361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 -- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b813caa0 msgr2=0x7f86b81361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b813caa0 0x7f86b81361e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 -- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4003e40 msgr2=0x7f86b80c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4003e40 0x7f86b80c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 -- 172.21.15.133:0/3468998966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80c1a10 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86b6d9d700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f86b0000f80 tx=0x7f86b0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0010520 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0010680 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b80c1cf0 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0010a20 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.563+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b80c22b0 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.564+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b805fdf0 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.565+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f86b0003070 con 0x7f86b80c4640 2024-01-21T20:11:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.565+0000 7f86aeffd700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 0x7f8698061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.565+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f86b0079dd0 con 0x7f86b80c4640 2024-01-21T20:11:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.565+0000 7f86b659c700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 0x7f8698061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.565+0000 7f86b659c700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 0x7f8698061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f86b813d900 tx=0x7f86a0008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.569+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86b0049b00 con 0x7f86b80c4640 2024-01-21T20:11:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.730+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86b806bd20 con 0x7f869805f150 2024-01-21T20:11:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.739+0000 7f86aeffd700 1 -- 172.21.15.133:0/3468998966 <== mgr.5655 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361461 (secure 0 0 0) 0x7f86b806bd20 con 0x7f869805f150 2024-01-21T20:11:59.734 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:11:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 msgr2=0x7f8698061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 0x7f8698061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f86b813d900 tx=0x7f86a0008040).stop 2024-01-21T20:11:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 msgr2=0x7f86b80c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f86b0000f80 tx=0x7f86b0009040).stop 2024-01-21T20:11:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 shutdown_connections 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f869805f150 0x7f8698061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b80c4640 0x7f86b80c4a80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86a4003e40 0x7f86b80c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 --2- 172.21.15.133:0/3468998966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b813caa0 0x7f86b81361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 >> 172.21.15.133:0/3468998966 conn(0x7f86b8066a90 msgr2=0x7f86b80c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 shutdown_connections 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.743+0000 7f86bcf45700 1 -- 172.21.15.133:0/3468998966 wait complete. 2024-01-21T20:11:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:11:59.746 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T20:11:59.665543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":218,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2411256,"kb_used_data":5816,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752563464,"statfs":{"total":773094113280,"available":770624987136,"internally_reserved":0,"allocated":5955584,"data_stored":2908418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15006739,"num_objects":-26,"num_object_clones":0,"num_object_copies":-52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-724,"num_write_kb":-15559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.443031"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438368+0000","last_change":"2024-01-21T20:11:56.429539+0000","last_active":"2024-01-21T20:11:56.438368+0000","last_peered":"2024-01-21T20:11:56.438368+0000","last_clean":"2024-01-21T20:11:56.438368+0000","last_became_active":"2024-01-21T20:11:56.429157+0000","last_became_peered":"2024-01-21T20:11:56.429157+0000","last_unstale":"2024-01-21T20:11:56.438368+0000","last_undegraded":"2024-01-21T20:11:56.438368+0000","last_fullsized":"2024-01-21T20:11:56.438368+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.434441+0000","last_change":"2024-01-21T20:11:56.059245+0000","last_active":"2024-01-21T20:11:56.434441+0000","last_peered":"2024-01-21T20:11:56.434441+0000","last_clean":"2024-01-21T20:11:56.434441+0000","last_became_active":"2024-01-21T20:11:56.058959+0000","last_became_peered":"2024-01-21T20:11:56.058959+0000","last_unstale":"2024-01-21T20:11:56.434441+0000","last_undegraded":"2024-01-21T20:11:56.434441+0000","last_fullsized":"2024-01-21T20:11:56.434441+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440402+0000","last_change":"2024-01-21T20:11:56.436806+0000","last_active":"2024-01-21T20:11:56.440402+0000","last_peered":"2024-01-21T20:11:56.440402+0000","last_clean":"2024-01-21T20:11:56.440402+0000","last_became_active":"2024-01-21T20:11:56.436401+0000","last_became_peered":"2024-01-21T20:11:56.436401+0000","last_unstale":"2024-01-21T20:11:56.440402+0000","last_undegraded":"2024-01-21T20:11:56.440402+0000","last_fullsized":"2024-01-21T20:11:56.440402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.414586+0000","last_change":"2024-01-21T20:11:56.051941+0000","last_active":"2024-01-21T20:11:56.414586+0000","last_peered":"2024-01-21T20:11:56.414586+0000","last_clean":"2024-01-21T20:11:56.414586+0000","last_became_active":"2024-01-21T20:11:56.051748+0000","last_became_peered":"2024-01-21T20:11:56.051748+0000","last_unstale":"2024-01-21T20:11:56.414586+0000","last_undegraded":"2024-01-21T20:11:56.414586+0000","last_fullsized":"2024-01-21T20:11:56.414586+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444980+0000","last_change":"2024-01-21T20:11:56.433203+0000","last_active":"2024-01-21T20:11:56.444980+0000","last_peered":"2024-01-21T20:11:56.444980+0000","last_clean":"2024-01-21T20:11:56.444980+0000","last_became_active":"2024-01-21T20:11:56.432965+0000","last_became_peered":"2024-01-21T20:11:56.432965+0000","last_unstale":"2024-01-21T20:11:56.444980+0000","last_undegraded":"2024-01-21T20:11:56.444980+0000","last_fullsized":"2024-01-21T20:11:56.444980+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420261+0000","last_change":"2024-01-21T20:11:56.050184+0000","last_active":"2024-01-21T20:11:56.420261+0000","last_peered":"2024-01-21T20:11:56.420261+0000","last_clean":"2024-01-21T20:11:56.420261+0000","last_became_active":"2024-01-21T20:11:56.049916+0000","last_became_peered":"2024-01-21T20:11:56.049916+0000","last_unstale":"2024-01-21T20:11:56.420261+0000","last_undegraded":"2024-01-21T20:11:56.420261+0000","last_fullsized":"2024-01-21T20:11:56.420261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433287+0000","last_change":"2024-01-21T20:11:56.426628+0000","last_active":"2024-01-21T20:11:56.433287+0000","last_peered":"2024-01-21T20:11:56.433287+0000","last_clean":"2024-01-21T20:11:56.433287+0000","last_became_active":"2024-01-21T20:11:56.426325+0000","last_became_peered":"2024-01-21T20:11:56.426325+0000","last_unstale":"2024-01-21T20:11:56.433287+0000","last_undegraded":"2024-01-21T20:11:56.433287+0000","last_fullsized":"2024-01-21T20:11:56.433287+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439252+0000","last_change":"2024-01-21T20:11:56.063534+0000","last_active":"2024-01-21T20:11:56.439252+0000","last_peered":"2024-01-21T20:11:56.439252+0000","last_clean":"2024-01-21T20:11:56.439252+0000","last_became_active":"2024-01-21T20:11:56.062447+0000","last_became_peered":"2024-01-21T20:11:56.062447+0000","last_unstale":"2024-01-21T20:11:56.439252+0000","last_undegraded":"2024-01-21T20:11:56.439252+0000","last_fullsized":"2024-01-21T20:11:56.439252+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441887+0000","last_change":"2024-01-21T20:11:56.439802+0000","last_active":"2024-01-21T20:11:56.441887+0000","last_peered":"2024-01-21T20:11:56.441887+0000","last_clean":"2024-01-21T20:11:56.441887+0000","last_became_active":"2024-01-21T20:11:56.439562+0000","last_became_peered":"2024-01-21T20:11:56.439562+0000","last_unstale":"2024-01-21T20:11:56.441887+0000","last_undegraded":"2024-01-21T20:11:56.441887+0000","last_fullsized":"2024-01-21T20:11:56.441887+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.424526+0000","last_change":"2024-01-21T20:11:56.047428+0000","last_active":"2024-01-21T20:11:56.424526+0000","last_peered":"2024-01-21T20:11:56.424526+0000","last_clean":"2024-01-21T20:11:56.424526+0000","last_became_active":"2024-01-21T20:11:56.047168+0000","last_became_peered":"2024-01-21T20:11:56.047168+0000","last_unstale":"2024-01-21T20:11:56.424526+0000","last_undegraded":"2024-01-21T20:11:56.424526+0000","last_fullsized":"2024-01-21T20:11:56.424526+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439036+0000","last_change":"2024-01-21T20:11:56.435269+0000","last_active":"2024-01-21T20:11:56.439036+0000","last_peered":"2024-01-21T20:11:56.439036+0000","last_clean":"2024-01-21T20:11:56.439036+0000","last_became_active":"2024-01-21T20:11:56.434969+0000","last_became_peered":"2024-01-21T20:11:56.434969+0000","last_unstale":"2024-01-21T20:11:56.439036+0000","last_undegraded":"2024-01-21T20:11:56.439036+0000","last_fullsized":"2024-01-21T20:11:56.439036+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3a","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.434806+0000","last_change":"2024-01-21T20:11:56.054775+0000","last_active":"2024-01-21T20:11:56.434806+0000","last_peered":"2024-01-21T20:11:56.434806+0000","last_clean":"2024-01-21T20:11:56.434806+0000","last_became_active":"2024-01-21T20:11:56.054464+0000","last_became_peered":"2024-01-21T20:11:56.054464+0000","last_unstale":"2024-01-21T20:11:56.434806+0000","last_undegraded":"2024-01-21T20:11:56.434806+0000","last_fullsized":"2024-01-21T20:11:56.434806+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433199+0000","last_change":"2024-01-21T20:11:56.425798+0000","last_active":"2024-01-21T20:11:56.433199+0000","last_peered":"2024-01-21T20:11:56.433199+0000","last_clean":"2024-01-21T20:11:56.433199+0000","last_became_active":"2024-01-21T20:11:56.425502+0000","last_became_peered":"2024-01-21T20:11:56.425502+0000","last_unstale":"2024-01-21T20:11:56.433199+0000","last_undegraded":"2024-01-21T20:11:56.433199+0000","last_fullsized":"2024-01-21T20:11:56.433199+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420480+0000","last_change":"2024-01-21T20:11:56.061037+0000","last_active":"2024-01-21T20:11:56.420480+0000","last_peered":"2024-01-21T20:11:56.420480+0000","last_clean":"2024-01-21T20:11:56.420480+0000","last_became_active":"2024-01-21T20:11:56.060703+0000","last_became_peered":"2024-01-21T20:11:56.060703+0000","last_unstale":"2024-01-21T20:11:56.420480+0000","last_undegraded":"2024-01-21T20:11:56.420480+0000","last_fullsized":"2024-01-21T20:11:56.420480+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441475+0000","last_change":"2024-01-21T20:11:56.437809+0000","last_active":"2024-01-21T20:11:56.441475+0000","last_peered":"2024-01-21T20:11:56.441475+0000","last_clean":"2024-01-21T20:11:56.441475+0000","last_became_active":"2024-01-21T20:11:56.437540+0000","last_became_peered":"2024-01-21T20:11:56.437540+0000","last_unstale":"2024-01-21T20:11:56.441475+0000","last_undegraded":"2024-01-21T20:11:56.441475+0000","last_fullsized":"2024-01-21T20:11:56.441475+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.421262+0000","last_change":"2024-01-21T20:11:56.054228+0000","last_active":"2024-01-21T20:11:56.421262+0000","last_peered":"2024-01-21T20:11:56.421262+0000","last_clean":"2024-01-21T20:11:56.421262+0000","last_became_active":"2024-01-21T20:11:56.053829+0000","last_became_peered":"2024-01-21T20:11:56.053829+0000","last_unstale":"2024-01-21T20:11:56.421262+0000","last_undegraded":"2024-01-21T20:11:56.421262+0000","last_fullsized":"2024-01-21T20:11:56.421262+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441510+0000","last_change":"2024-01-21T20:11:56.438304+0000","last_active":"2024-01-21T20:11:56.441510+0000","last_peered":"2024-01-21T20:11:56.441510+0000","last_clean":"2024-01-21T20:11:56.441510+0000","last_became_active":"2024-01-21T20:11:56.438051+0000","last_became_peered":"2024-01-21T20:11:56.438051+0000","last_unstale":"2024-01-21T20:11:56.441510+0000","last_undegraded":"2024-01-21T20:11:56.441510+0000","last_fullsized":"2024-01-21T20:11:56.441510+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.421302+0000","last_change":"2024-01-21T20:11:56.062527+0000","last_active":"2024-01-21T20:11:56.421302+0000","last_peered":"2024-01-21T20:11:56.421302+0000","last_clean":"2024-01-21T20:11:56.421302+0000","last_became_active":"2024-01-21T20:11:56.062053+0000","last_became_peered":"2024-01-21T20:11:56.062053+0000","last_unstale":"2024-01-21T20:11:56.421302+0000","last_undegraded":"2024-01-21T20:11:56.421302+0000","last_fullsized":"2024-01-21T20:11:56.421302+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444908+0000","last_change":"2024-01-21T20:11:56.432566+0000","last_active":"2024-01-21T20:11:56.444908+0000","last_peered":"2024-01-21T20:11:56.444908+0000","last_clean":"2024-01-21T20:11:56.444908+0000","last_became_active":"2024-01-21T20:11:56.432311+0000","last_became_peered":"2024-01-21T20:11:56.432311+0000","last_unstale":"2024-01-21T20:11:56.444908+0000","last_undegraded":"2024-01-21T20:11:56.444908+0000","last_fullsized":"2024-01-21T20:11:56.444908+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.423143+0000","last_change":"2024-01-21T20:11:56.063664+0000","last_active":"2024-01-21T20:11:56.423143+0000","last_peered":"2024-01-21T20:11:56.423143+0000","last_clean":"2024-01-21T20:11:56.423143+0000","last_became_active":"2024-01-21T20:11:56.063311+0000","last_became_peered":"2024-01-21T20:11:56.063311+0000","last_unstale":"2024-01-21T20:11:56.423143+0000","last_undegraded":"2024-01-21T20:11:56.423143+0000","last_fullsized":"2024-01-21T20:11:56.423143+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433259+0000","last_change":"2024-01-21T20:11:56.425582+0000","last_active":"2024-01-21T20:11:56.433259+0000","last_peered":"2024-01-21T20:11:56.433259+0000","last_clean":"2024-01-21T20:11:56.433259+0000","last_became_active":"2024-01-21T20:11:56.424947+0000","last_became_peered":"2024-01-21T20:11:56.424947+0000","last_unstale":"2024-01-21T20:11:56.433259+0000","last_undegraded":"2024-01-21T20:11:56.433259+0000","last_fullsized":"2024-01-21T20:11:56.433259+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420717+0000","last_change":"2024-01-21T20:11:56.059362+0000","last_active":"2024-01-21T20:11:56.420717+0000","last_peered":"2024-01-21T20:11:56.420717+0000","last_clean":"2024-01-21T20:11:56.420717+0000","last_became_active":"2024-01-21T20:11:56.059066+0000","last_became_peered":"2024-01-21T20:11:56.059066+0000","last_unstale":"2024-01-21T20:11:56.420717+0000","last_undegraded":"2024-01-21T20:11:56.420717+0000","last_fullsized":"2024-01-21T20:11:56.420717+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.437010+0000","last_change":"2024-01-21T20:11:56.435135+0000","last_active":"2024-01-21T20:11:56.437010+0000","last_peered":"2024-01-21T20:11:56.437010+0000","last_clean":"2024-01-21T20:11:56.437010+0000","last_became_active":"2024-01-21T20:11:56.434832+0000","last_became_peered":"2024-01-21T20:11:56.434832+0000","last_unstale":"2024-01-21T20:11:56.437010+0000","last_undegraded":"2024-01-21T20:11:56.437010+0000","last_fullsized":"2024-01-21T20:11:56.437010+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.34","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.436722+0000","last_change":"2024-01-21T20:11:56.057665+0000","last_active":"2024-01-21T20:11:56.436722+0000","last_peered":"2024-01-21T20:11:56.436722+0000","last_clean":"2024-01-21T20:11:56.436722+0000","last_became_active":"2024-01-21T20:11:56.053841+0000","last_became_peered":"2024-01-21T20:11:56.053841+0000","last_unstale":"2024-01-21T20:11:56.436722+0000","last_undegraded":"2024-01-21T20:11:56.436722+0000","last_fullsized":"2024-01-21T20:11:56.436722+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440450+0000","last_change":"2024-01-21T20:11:56.437016+0000","last_active":"2024-01-21T20:11:56.440450+0000","last_peered":"2024-01-21T20:11:56.440450+0000","last_clean":"2024-01-21T20:11:56.440450+0000","last_became_active":"2024-01-21T20:11:56.436468+0000","last_became_peered":"2024-01-21T20:11:56.436468+0000","last_unstale":"2024-01-21T20:11:56.440450+0000","last_undegraded":"2024-01-21T20:11:56.440450+0000","last_fullsized":"2024-01-21T20:11:56.440450+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.426839+0000","last_change":"2024-01-21T20:11:56.056075+0000","last_active":"2024-01-21T20:11:56.426839+0000","last_peered":"2024-01-21T20:11:56.426839+0000","last_clean":"2024-01-21T20:11:56.426839+0000","last_became_active":"2024-01-21T20:11:56.055868+0000","last_became_peered":"2024-01-21T20:11:56.055868+0000","last_unstale":"2024-01-21T20:11:56.426839+0000","last_undegraded":"2024-01-21T20:11:56.426839+0000","last_fullsized":"2024-01-21T20:11:56.426839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445054+0000","last_change":"2024-01-21T20:11:56.434428+0000","last_active":"2024-01-21T20:11:56.445054+0000","last_peered":"2024-01-21T20:11:56.445054+0000","last_clean":"2024-01-21T20:11:56.445054+0000","last_became_active":"2024-01-21T20:11:56.434156+0000","last_became_peered":"2024-01-21T20:11:56.434156+0000","last_unstale":"2024-01-21T20:11:56.445054+0000","last_undegraded":"2024-01-21T20:11:56.445054+0000","last_fullsized":"2024-01-21T20:11:56.445054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.422195+0000","last_change":"2024-01-21T20:11:56.063204+0000","last_active":"2024-01-21T20:11:56.422195+0000","last_peered":"2024-01-21T20:11:56.422195+0000","last_clean":"2024-01-21T20:11:56.422195+0000","last_became_active":"2024-01-21T20:11:56.062342+0000","last_became_peered":"2024-01-21T20:11:56.062342+0000","last_unstale":"2024-01-21T20:11:56.422195+0000","last_undegraded":"2024-01-21T20:11:56.422195+0000","last_fullsized":"2024-01-21T20:11:56.422195+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.434001+0000","last_change":"2024-01-21T20:11:56.427526+0000","last_active":"2024-01-21T20:11:56.434001+0000","last_peered":"2024-01-21T20:11:56.434001+0000","last_clean":"2024-01-21T20:11:56.434001+0000","last_became_active":"2024-01-21T20:11:56.427079+0000","last_became_peered":"2024-01-21T20:11:56.427079+0000","last_unstale":"2024-01-21T20:11:56.434001+0000","last_undegraded":"2024-01-21T20:11:56.434001+0000","last_fullsized":"2024-01-21T20:11:56.434001+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.417544+0000","last_change":"2024-01-21T20:11:56.044183+0000","last_active":"2024-01-21T20:11:56.417544+0000","last_peered":"2024-01-21T20:11:56.417544+0000","last_clean":"2024-01-21T20:11:56.417544+0000","last_became_active":"2024-01-21T20:11:56.043908+0000","last_became_peered":"2024-01-21T20:11:56.043908+0000","last_unstale":"2024-01-21T20:11:56.417544+0000","last_undegraded":"2024-01-21T20:11:56.417544+0000","last_fullsized":"2024-01-21T20:11:56.417544+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433800+0000","last_change":"2024-01-21T20:11:56.426962+0000","last_active":"2024-01-21T20:11:56.433800+0000","last_peered":"2024-01-21T20:11:56.433800+0000","last_clean":"2024-01-21T20:11:56.433800+0000","last_became_active":"2024-01-21T20:11:56.426682+0000","last_became_peered":"2024-01-21T20:11:56.426682+0000","last_unstale":"2024-01-21T20:11:56.433800+0000","last_undegraded":"2024-01-21T20:11:56.433800+0000","last_fullsized":"2024-01-21T20:11:56.433800+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.30","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445170+0000","last_change":"2024-01-21T20:11:56.066520+0000","last_active":"2024-01-21T20:11:56.445170+0000","last_peered":"2024-01-21T20:11:56.445170+0000","last_clean":"2024-01-21T20:11:56.445170+0000","last_became_active":"2024-01-21T20:11:56.066291+0000","last_became_peered":"2024-01-21T20:11:56.066291+0000","last_unstale":"2024-01-21T20:11:56.445170+0000","last_undegraded":"2024-01-21T20:11:56.445170+0000","last_fullsized":"2024-01-21T20:11:56.445170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431266+0000","last_change":"2024-01-21T20:11:56.427323+0000","last_active":"2024-01-21T20:11:56.431266+0000","last_peered":"2024-01-21T20:11:56.431266+0000","last_clean":"2024-01-21T20:11:56.431266+0000","last_became_active":"2024-01-21T20:11:56.426744+0000","last_became_peered":"2024-01-21T20:11:56.426744+0000","last_unstale":"2024-01-21T20:11:56.431266+0000","last_undegraded":"2024-01-21T20:11:56.431266+0000","last_fullsized":"2024-01-21T20:11:56.431266+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419896+0000","last_change":"2024-01-21T20:11:56.049502+0000","last_active":"2024-01-21T20:11:56.419896+0000","last_peered":"2024-01-21T20:11:56.419896+0000","last_clean":"2024-01-21T20:11:56.419896+0000","last_became_active":"2024-01-21T20:11:56.049208+0000","last_became_peered":"2024-01-21T20:11:56.049208+0000","last_unstale":"2024-01-21T20:11:56.419896+0000","last_undegraded":"2024-01-21T20:11:56.419896+0000","last_fullsized":"2024-01-21T20:11:56.419896+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445032+0000","last_change":"2024-01-21T20:11:56.434201+0000","last_active":"2024-01-21T20:11:56.445032+0000","last_peered":"2024-01-21T20:11:56.445032+0000","last_clean":"2024-01-21T20:11:56.445032+0000","last_became_active":"2024-01-21T20:11:56.433964+0000","last_became_peered":"2024-01-21T20:11:56.433964+0000","last_unstale":"2024-01-21T20:11:56.445032+0000","last_undegraded":"2024-01-21T20:11:56.445032+0000","last_fullsized":"2024-01-21T20:11:56.445032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420615+0000","last_change":"2024-01-21T20:11:56.054786+0000","last_active":"2024-01-21T20:11:56.420615+0000","last_peered":"2024-01-21T20:11:56.420615+0000","last_clean":"2024-01-21T20:11:56.420615+0000","last_became_active":"2024-01-21T20:11:56.054506+0000","last_became_peered":"2024-01-21T20:11:56.054506+0000","last_unstale":"2024-01-21T20:11:56.420615+0000","last_undegraded":"2024-01-21T20:11:56.420615+0000","last_fullsized":"2024-01-21T20:11:56.420615+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440431+0000","last_change":"2024-01-21T20:11:56.433649+0000","last_active":"2024-01-21T20:11:56.440431+0000","last_peered":"2024-01-21T20:11:56.440431+0000","last_clean":"2024-01-21T20:11:56.440431+0000","last_became_active":"2024-01-21T20:11:56.433324+0000","last_became_peered":"2024-01-21T20:11:56.433324+0000","last_unstale":"2024-01-21T20:11:56.440431+0000","last_undegraded":"2024-01-21T20:11:56.440431+0000","last_fullsized":"2024-01-21T20:11:56.440431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2d","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445451+0000","last_change":"2024-01-21T20:11:56.062632+0000","last_active":"2024-01-21T20:11:56.445451+0000","last_peered":"2024-01-21T20:11:56.445451+0000","last_clean":"2024-01-21T20:11:56.445451+0000","last_became_active":"2024-01-21T20:11:56.062347+0000","last_became_peered":"2024-01-21T20:11:56.062347+0000","last_unstale":"2024-01-21T20:11:56.445451+0000","last_undegraded":"2024-01-21T20:11:56.445451+0000","last_fullsized":"2024-01-21T20:11:56.445451+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445349+0000","last_change":"2024-01-21T20:11:56.439413+0000","last_active":"2024-01-21T20:11:56.445349+0000","last_peered":"2024-01-21T20:11:56.445349+0000","last_clean":"2024-01-21T20:11:56.445349+0000","last_became_active":"2024-01-21T20:11:56.439143+0000","last_became_peered":"2024-01-21T20:11:56.439143+0000","last_unstale":"2024-01-21T20:11:56.445349+0000","last_undegraded":"2024-01-21T20:11:56.445349+0000","last_fullsized":"2024-01-21T20:11:56.445349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.413299+0000","last_change":"2024-01-21T20:11:56.064687+0000","last_active":"2024-01-21T20:11:56.413299+0000","last_peered":"2024-01-21T20:11:56.413299+0000","last_clean":"2024-01-21T20:11:56.413299+0000","last_became_active":"2024-01-21T20:11:56.064402+0000","last_became_peered":"2024-01-21T20:11:56.064402+0000","last_unstale":"2024-01-21T20:11:56.413299+0000","last_undegraded":"2024-01-21T20:11:56.413299+0000","last_fullsized":"2024-01-21T20:11:56.413299+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438555+0000","last_change":"2024-01-21T20:11:56.435534+0000","last_active":"2024-01-21T20:11:56.438555+0000","last_peered":"2024-01-21T20:11:56.438555+0000","last_clean":"2024-01-21T20:11:56.438555+0000","last_became_active":"2024-01-21T20:11:56.435149+0000","last_became_peered":"2024-01-21T20:11:56.435149+0000","last_unstale":"2024-01-21T20:11:56.438555+0000","last_undegraded":"2024-01-21T20:11:56.438555+0000","last_fullsized":"2024-01-21T20:11:56.438555+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439351+0000","last_change":"2024-01-21T20:11:56.053714+0000","last_active":"2024-01-21T20:11:56.439351+0000","last_peered":"2024-01-21T20:11:56.439351+0000","last_clean":"2024-01-21T20:11:56.439351+0000","last_became_active":"2024-01-21T20:11:56.053258+0000","last_became_peered":"2024-01-21T20:11:56.053258+0000","last_unstale":"2024-01-21T20:11:56.439351+0000","last_undegraded":"2024-01-21T20:11:56.439351+0000","last_fullsized":"2024-01-21T20:11:56.439351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438317+0000","last_change":"2024-01-21T20:11:56.429353+0000","last_active":"2024-01-21T20:11:56.438317+0000","last_peered":"2024-01-21T20:11:56.438317+0000","last_clean":"2024-01-21T20:11:56.438317+0000","last_became_active":"2024-01-21T20:11:56.425996+0000","last_became_peered":"2024-01-21T20:11:56.425996+0000","last_unstale":"2024-01-21T20:11:56.438317+0000","last_undegraded":"2024-01-21T20:11:56.438317+0000","last_fullsized":"2024-01-21T20:11:56.438317+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.422100+0000","last_change":"2024-01-21T20:11:56.063245+0000","last_active":"2024-01-21T20:11:56.422100+0000","last_peered":"2024-01-21T20:11:56.422100+0000","last_clean":"2024-01-21T20:11:56.422100+0000","last_became_active":"2024-01-21T20:11:56.062952+0000","last_became_peered":"2024-01-21T20:11:56.062952+0000","last_unstale":"2024-01-21T20:11:56.422100+0000","last_undegraded":"2024-01-21T20:11:56.422100+0000","last_fullsized":"2024-01-21T20:11:56.422100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441418+0000","last_change":"2024-01-21T20:11:56.435545+0000","last_active":"2024-01-21T20:11:56.441418+0000","last_peered":"2024-01-21T20:11:56.441418+0000","last_clean":"2024-01-21T20:11:56.441418+0000","last_became_active":"2024-01-21T20:11:56.435155+0000","last_became_peered":"2024-01-21T20:11:56.435155+0000","last_unstale":"2024-01-21T20:11:56.441418+0000","last_undegraded":"2024-01-21T20:11:56.441418+0000","last_fullsized":"2024-01-21T20:11:56.441418+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.430078+0000","last_change":"2024-01-21T20:11:56.053262+0000","last_active":"2024-01-21T20:11:56.430078+0000","last_peered":"2024-01-21T20:11:56.430078+0000","last_clean":"2024-01-21T20:11:56.430078+0000","last_became_active":"2024-01-21T20:11:56.052916+0000","last_became_peered":"2024-01-21T20:11:56.052916+0000","last_unstale":"2024-01-21T20:11:56.430078+0000","last_undegraded":"2024-01-21T20:11:56.430078+0000","last_fullsized":"2024-01-21T20:11:56.430078+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444987+0000","last_change":"2024-01-21T20:11:56.432856+0000","last_active":"2024-01-21T20:11:56.444987+0000","last_peered":"2024-01-21T20:11:56.444987+0000","last_clean":"2024-01-21T20:11:56.444987+0000","last_became_active":"2024-01-21T20:11:56.429921+0000","last_became_peered":"2024-01-21T20:11:56.429921+0000","last_unstale":"2024-01-21T20:11:56.444987+0000","last_undegraded":"2024-01-21T20:11:56.444987+0000","last_fullsized":"2024-01-21T20:11:56.444987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.427745+0000","last_change":"2024-01-21T20:11:56.052596+0000","last_active":"2024-01-21T20:11:56.427745+0000","last_peered":"2024-01-21T20:11:56.427745+0000","last_clean":"2024-01-21T20:11:56.427745+0000","last_became_active":"2024-01-21T20:11:56.052138+0000","last_became_peered":"2024-01-21T20:11:56.052138+0000","last_unstale":"2024-01-21T20:11:56.427745+0000","last_undegraded":"2024-01-21T20:11:56.427745+0000","last_fullsized":"2024-01-21T20:11:56.427745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444926+0000","last_change":"2024-01-21T20:11:56.432575+0000","last_active":"2024-01-21T20:11:56.444926+0000","last_peered":"2024-01-21T20:11:56.444926+0000","last_clean":"2024-01-21T20:11:56.444926+0000","last_became_active":"2024-01-21T20:11:56.432365+0000","last_became_peered":"2024-01-21T20:11:56.432365+0000","last_unstale":"2024-01-21T20:11:56.444926+0000","last_undegraded":"2024-01-21T20:11:56.444926+0000","last_fullsized":"2024-01-21T20:11:56.444926+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.430501+0000","last_change":"2024-01-21T20:11:56.058615+0000","last_active":"2024-01-21T20:11:56.430501+0000","last_peered":"2024-01-21T20:11:56.430501+0000","last_clean":"2024-01-21T20:11:56.430501+0000","last_became_active":"2024-01-21T20:11:56.058304+0000","last_became_peered":"2024-01-21T20:11:56.058304+0000","last_unstale":"2024-01-21T20:11:56.430501+0000","last_undegraded":"2024-01-21T20:11:56.430501+0000","last_fullsized":"2024-01-21T20:11:56.430501+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438995+0000","last_change":"2024-01-21T20:11:56.434884+0000","last_active":"2024-01-21T20:11:56.438995+0000","last_peered":"2024-01-21T20:11:56.438995+0000","last_clean":"2024-01-21T20:11:56.438995+0000","last_became_active":"2024-01-21T20:11:56.434611+0000","last_became_peered":"2024-01-21T20:11:56.434611+0000","last_unstale":"2024-01-21T20:11:56.438995+0000","last_undegraded":"2024-01-21T20:11:56.438995+0000","last_fullsized":"2024-01-21T20:11:56.438995+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.412865+0000","last_change":"2024-01-21T20:11:56.058855+0000","last_active":"2024-01-21T20:11:56.412865+0000","last_peered":"2024-01-21T20:11:56.412865+0000","last_clean":"2024-01-21T20:11:56.412865+0000","last_became_active":"2024-01-21T20:11:56.058582+0000","last_became_peered":"2024-01-21T20:11:56.058582+0000","last_unstale":"2024-01-21T20:11:56.412865+0000","last_undegraded":"2024-01-21T20:11:56.412865+0000","last_fullsized":"2024-01-21T20:11:56.412865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441494+0000","last_change":"2024-01-21T20:11:56.437809+0000","last_active":"2024-01-21T20:11:56.441494+0000","last_peered":"2024-01-21T20:11:56.441494+0000","last_clean":"2024-01-21T20:11:56.441494+0000","last_became_active":"2024-01-21T20:11:56.437514+0000","last_became_peered":"2024-01-21T20:11:56.437514+0000","last_unstale":"2024-01-21T20:11:56.441494+0000","last_undegraded":"2024-01-21T20:11:56.441494+0000","last_fullsized":"2024-01-21T20:11:56.441494+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420348+0000","last_change":"2024-01-21T20:11:56.049488+0000","last_active":"2024-01-21T20:11:56.420348+0000","last_peered":"2024-01-21T20:11:56.420348+0000","last_clean":"2024-01-21T20:11:56.420348+0000","last_became_active":"2024-01-21T20:11:56.049191+0000","last_became_peered":"2024-01-21T20:11:56.049191+0000","last_unstale":"2024-01-21T20:11:56.420348+0000","last_undegraded":"2024-01-21T20:11:56.420348+0000","last_fullsized":"2024-01-21T20:11:56.420348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440641+0000","last_change":"2024-01-21T20:11:56.439935+0000","last_active":"2024-01-21T20:11:56.440641+0000","last_peered":"2024-01-21T20:11:56.440641+0000","last_clean":"2024-01-21T20:11:56.440641+0000","last_became_active":"2024-01-21T20:11:56.439609+0000","last_became_peered":"2024-01-21T20:11:56.439609+0000","last_unstale":"2024-01-21T20:11:56.440641+0000","last_undegraded":"2024-01-21T20:11:56.440641+0000","last_fullsized":"2024-01-21T20:11:56.440641+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.415209+0000","last_change":"2024-01-21T20:11:56.054451+0000","last_active":"2024-01-21T20:11:56.415209+0000","last_peered":"2024-01-21T20:11:56.415209+0000","last_clean":"2024-01-21T20:11:56.415209+0000","last_became_active":"2024-01-21T20:11:56.053583+0000","last_became_peered":"2024-01-21T20:11:56.053583+0000","last_unstale":"2024-01-21T20:11:56.415209+0000","last_undegraded":"2024-01-21T20:11:56.415209+0000","last_fullsized":"2024-01-21T20:11:56.415209+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439003+0000","last_change":"2024-01-21T20:11:56.438271+0000","last_active":"2024-01-21T20:11:56.439003+0000","last_peered":"2024-01-21T20:11:56.439003+0000","last_clean":"2024-01-21T20:11:56.439003+0000","last_became_active":"2024-01-21T20:11:56.437970+0000","last_became_peered":"2024-01-21T20:11:56.437970+0000","last_unstale":"2024-01-21T20:11:56.439003+0000","last_undegraded":"2024-01-21T20:11:56.439003+0000","last_fullsized":"2024-01-21T20:11:56.439003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.432080+0000","last_change":"2024-01-21T20:11:56.058726+0000","last_active":"2024-01-21T20:11:56.432080+0000","last_peered":"2024-01-21T20:11:56.432080+0000","last_clean":"2024-01-21T20:11:56.432080+0000","last_became_active":"2024-01-21T20:11:56.058447+0000","last_became_peered":"2024-01-21T20:11:56.058447+0000","last_unstale":"2024-01-21T20:11:56.432080+0000","last_undegraded":"2024-01-21T20:11:56.432080+0000","last_fullsized":"2024-01-21T20:11:56.432080+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.436042+0000","last_change":"2024-01-21T20:11:56.428777+0000","last_active":"2024-01-21T20:11:56.436042+0000","last_peered":"2024-01-21T20:11:56.436042+0000","last_clean":"2024-01-21T20:11:56.436042+0000","last_became_active":"2024-01-21T20:11:56.428497+0000","last_became_peered":"2024-01-21T20:11:56.428497+0000","last_unstale":"2024-01-21T20:11:56.436042+0000","last_undegraded":"2024-01-21T20:11:56.436042+0000","last_fullsized":"2024-01-21T20:11:56.436042+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420440+0000","last_change":"2024-01-21T20:11:56.049357+0000","last_active":"2024-01-21T20:11:56.420440+0000","last_peered":"2024-01-21T20:11:56.420440+0000","last_clean":"2024-01-21T20:11:56.420440+0000","last_became_active":"2024-01-21T20:11:56.049073+0000","last_became_peered":"2024-01-21T20:11:56.049073+0000","last_unstale":"2024-01-21T20:11:56.420440+0000","last_undegraded":"2024-01-21T20:11:56.420440+0000","last_fullsized":"2024-01-21T20:11:56.420440+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.434025+0000","last_change":"2024-01-21T20:11:56.428099+0000","last_active":"2024-01-21T20:11:56.434025+0000","last_peered":"2024-01-21T20:11:56.434025+0000","last_clean":"2024-01-21T20:11:56.434025+0000","last_became_active":"2024-01-21T20:11:56.427812+0000","last_became_peered":"2024-01-21T20:11:56.427812+0000","last_unstale":"2024-01-21T20:11:56.434025+0000","last_undegraded":"2024-01-21T20:11:56.434025+0000","last_fullsized":"2024-01-21T20:11:56.434025+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.417454+0000","last_change":"2024-01-21T20:11:56.053494+0000","last_active":"2024-01-21T20:11:56.417454+0000","last_peered":"2024-01-21T20:11:56.417454+0000","last_clean":"2024-01-21T20:11:56.417454+0000","last_became_active":"2024-01-21T20:11:56.053142+0000","last_became_peered":"2024-01-21T20:11:56.053142+0000","last_unstale":"2024-01-21T20:11:56.417454+0000","last_undegraded":"2024-01-21T20:11:56.417454+0000","last_fullsized":"2024-01-21T20:11:56.417454+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444836+0000","last_change":"2024-01-21T20:11:56.431958+0000","last_active":"2024-01-21T20:11:56.444836+0000","last_peered":"2024-01-21T20:11:56.444836+0000","last_clean":"2024-01-21T20:11:56.444836+0000","last_became_active":"2024-01-21T20:11:56.430759+0000","last_became_peered":"2024-01-21T20:11:56.430759+0000","last_unstale":"2024-01-21T20:11:56.444836+0000","last_undegraded":"2024-01-21T20:11:56.444836+0000","last_fullsized":"2024-01-21T20:11:56.444836+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.412865+0000","last_change":"2024-01-21T20:11:56.059307+0000","last_active":"2024-01-21T20:11:56.412865+0000","last_peered":"2024-01-21T20:11:56.412865+0000","last_clean":"2024-01-21T20:11:56.412865+0000","last_became_active":"2024-01-21T20:11:56.058457+0000","last_became_peered":"2024-01-21T20:11:56.058457+0000","last_unstale":"2024-01-21T20:11:56.412865+0000","last_undegraded":"2024-01-21T20:11:56.412865+0000","last_fullsized":"2024-01-21T20:11:56.412865+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.436527+0000","last_change":"2024-01-21T20:11:56.427528+0000","last_active":"2024-01-21T20:11:56.436527+0000","last_peered":"2024-01-21T20:11:56.436527+0000","last_clean":"2024-01-21T20:11:56.436527+0000","last_became_active":"2024-01-21T20:11:56.427234+0000","last_became_peered":"2024-01-21T20:11:56.427234+0000","last_unstale":"2024-01-21T20:11:56.436527+0000","last_undegraded":"2024-01-21T20:11:56.436527+0000","last_fullsized":"2024-01-21T20:11:56.436527+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438763+0000","last_change":"2024-01-21T20:11:56.055744+0000","last_active":"2024-01-21T20:11:56.438763+0000","last_peered":"2024-01-21T20:11:56.438763+0000","last_clean":"2024-01-21T20:11:56.438763+0000","last_became_active":"2024-01-21T20:11:56.055455+0000","last_became_peered":"2024-01-21T20:11:56.055455+0000","last_unstale":"2024-01-21T20:11:56.438763+0000","last_undegraded":"2024-01-21T20:11:56.438763+0000","last_fullsized":"2024-01-21T20:11:56.438763+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.426790+0000","last_change":"2024-01-21T20:11:56.423753+0000","last_active":"2024-01-21T20:11:56.426790+0000","last_peered":"2024-01-21T20:11:56.426790+0000","last_clean":"2024-01-21T20:11:56.426790+0000","last_became_active":"2024-01-21T20:11:56.422830+0000","last_became_peered":"2024-01-21T20:11:56.422830+0000","last_unstale":"2024-01-21T20:11:56.426790+0000","last_undegraded":"2024-01-21T20:11:56.426790+0000","last_fullsized":"2024-01-21T20:11:56.426790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.428932+0000","last_change":"2024-01-21T20:11:56.053778+0000","last_active":"2024-01-21T20:11:56.428932+0000","last_peered":"2024-01-21T20:11:56.428932+0000","last_clean":"2024-01-21T20:11:56.428932+0000","last_became_active":"2024-01-21T20:11:56.053527+0000","last_became_peered":"2024-01-21T20:11:56.053527+0000","last_unstale":"2024-01-21T20:11:56.428932+0000","last_undegraded":"2024-01-21T20:11:56.428932+0000","last_fullsized":"2024-01-21T20:11:56.428932+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438967+0000","last_change":"2024-01-21T20:11:56.438270+0000","last_active":"2024-01-21T20:11:56.438967+0000","last_peered":"2024-01-21T20:11:56.438967+0000","last_clean":"2024-01-21T20:11:56.438967+0000","last_became_active":"2024-01-21T20:11:56.437907+0000","last_became_peered":"2024-01-21T20:11:56.437907+0000","last_unstale":"2024-01-21T20:11:56.438967+0000","last_undegraded":"2024-01-21T20:11:56.438967+0000","last_fullsized":"2024-01-21T20:11:56.438967+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439243+0000","last_change":"2024-01-21T20:11:56.057391+0000","last_active":"2024-01-21T20:11:56.439243+0000","last_peered":"2024-01-21T20:11:56.439243+0000","last_clean":"2024-01-21T20:11:56.439243+0000","last_became_active":"2024-01-21T20:11:56.057108+0000","last_became_peered":"2024-01-21T20:11:56.057108+0000","last_unstale":"2024-01-21T20:11:56.439243+0000","last_undegraded":"2024-01-21T20:11:56.439243+0000","last_fullsized":"2024-01-21T20:11:56.439243+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441390+0000","last_change":"2024-01-21T20:11:56.436364+0000","last_active":"2024-01-21T20:11:56.441390+0000","last_peered":"2024-01-21T20:11:56.441390+0000","last_clean":"2024-01-21T20:11:56.441390+0000","last_became_active":"2024-01-21T20:11:56.436101+0000","last_became_peered":"2024-01-21T20:11:56.436101+0000","last_unstale":"2024-01-21T20:11:56.441390+0000","last_undegraded":"2024-01-21T20:11:56.441390+0000","last_fullsized":"2024-01-21T20:11:56.441390+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.415126+0000","last_change":"2024-01-21T20:11:56.054292+0000","last_active":"2024-01-21T20:11:56.415126+0000","last_peered":"2024-01-21T20:11:56.415126+0000","last_clean":"2024-01-21T20:11:56.415126+0000","last_became_active":"2024-01-21T20:11:56.053289+0000","last_became_peered":"2024-01-21T20:11:56.053289+0000","last_unstale":"2024-01-21T20:11:56.415126+0000","last_undegraded":"2024-01-21T20:11:56.415126+0000","last_fullsized":"2024-01-21T20:11:56.415126+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.432941+0000","last_change":"2024-01-21T20:11:56.428891+0000","last_active":"2024-01-21T20:11:56.432941+0000","last_peered":"2024-01-21T20:11:56.432941+0000","last_clean":"2024-01-21T20:11:56.432941+0000","last_became_active":"2024-01-21T20:11:56.428631+0000","last_became_peered":"2024-01-21T20:11:56.428631+0000","last_unstale":"2024-01-21T20:11:56.432941+0000","last_undegraded":"2024-01-21T20:11:56.432941+0000","last_fullsized":"2024-01-21T20:11:56.432941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.422214+0000","last_change":"2024-01-21T20:11:56.064731+0000","last_active":"2024-01-21T20:11:56.422214+0000","last_peered":"2024-01-21T20:11:56.422214+0000","last_clean":"2024-01-21T20:11:56.422214+0000","last_became_active":"2024-01-21T20:11:56.064065+0000","last_became_peered":"2024-01-21T20:11:56.064065+0000","last_unstale":"2024-01-21T20:11:56.422214+0000","last_undegraded":"2024-01-21T20:11:56.422214+0000","last_fullsized":"2024-01-21T20:11:56.422214+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440300+0000","last_change":"2024-01-21T20:11:56.435310+0000","last_active":"2024-01-21T20:11:56.440300+0000","last_peered":"2024-01-21T20:11:56.440300+0000","last_clean":"2024-01-21T20:11:56.440300+0000","last_became_active":"2024-01-21T20:11:56.435024+0000","last_became_peered":"2024-01-21T20:11:56.435024+0000","last_unstale":"2024-01-21T20:11:56.440300+0000","last_undegraded":"2024-01-21T20:11:56.440300+0000","last_fullsized":"2024-01-21T20:11:56.440300+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420558+0000","last_change":"2024-01-21T20:11:56.049623+0000","last_active":"2024-01-21T20:11:56.420558+0000","last_peered":"2024-01-21T20:11:56.420558+0000","last_clean":"2024-01-21T20:11:56.420558+0000","last_became_active":"2024-01-21T20:11:56.048404+0000","last_became_peered":"2024-01-21T20:11:56.048404+0000","last_unstale":"2024-01-21T20:11:56.420558+0000","last_undegraded":"2024-01-21T20:11:56.420558+0000","last_fullsized":"2024-01-21T20:11:56.420558+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441436+0000","last_change":"2024-01-21T20:11:56.436454+0000","last_active":"2024-01-21T20:11:56.441436+0000","last_peered":"2024-01-21T20:11:56.441436+0000","last_clean":"2024-01-21T20:11:56.441436+0000","last_became_active":"2024-01-21T20:11:56.436178+0000","last_became_peered":"2024-01-21T20:11:56.436178+0000","last_unstale":"2024-01-21T20:11:56.441436+0000","last_undegraded":"2024-01-21T20:11:56.441436+0000","last_fullsized":"2024-01-21T20:11:56.441436+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.430357+0000","last_change":"2024-01-21T20:11:56.053092+0000","last_active":"2024-01-21T20:11:56.430357+0000","last_peered":"2024-01-21T20:11:56.430357+0000","last_clean":"2024-01-21T20:11:56.430357+0000","last_became_active":"2024-01-21T20:11:56.052824+0000","last_became_peered":"2024-01-21T20:11:56.052824+0000","last_unstale":"2024-01-21T20:11:56.430357+0000","last_undegraded":"2024-01-21T20:11:56.430357+0000","last_fullsized":"2024-01-21T20:11:56.430357+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.440176+0000","last_change":"2024-01-21T20:11:56.434608+0000","last_active":"2024-01-21T20:11:56.440176+0000","last_peered":"2024-01-21T20:11:56.440176+0000","last_clean":"2024-01-21T20:11:56.440176+0000","last_became_active":"2024-01-21T20:11:56.434159+0000","last_became_peered":"2024-01-21T20:11:56.434159+0000","last_unstale":"2024-01-21T20:11:56.440176+0000","last_undegraded":"2024-01-21T20:11:56.440176+0000","last_fullsized":"2024-01-21T20:11:56.440176+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.421354+0000","last_change":"2024-01-21T20:11:56.054069+0000","last_active":"2024-01-21T20:11:56.421354+0000","last_peered":"2024-01-21T20:11:56.421354+0000","last_clean":"2024-01-21T20:11:56.421354+0000","last_became_active":"2024-01-21T20:11:56.053547+0000","last_became_peered":"2024-01-21T20:11:56.053547+0000","last_unstale":"2024-01-21T20:11:56.421354+0000","last_undegraded":"2024-01-21T20:11:56.421354+0000","last_fullsized":"2024-01-21T20:11:56.421354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.436938+0000","last_change":"2024-01-21T20:11:56.434776+0000","last_active":"2024-01-21T20:11:56.436938+0000","last_peered":"2024-01-21T20:11:56.436938+0000","last_clean":"2024-01-21T20:11:56.436938+0000","last_became_active":"2024-01-21T20:11:56.434530+0000","last_became_peered":"2024-01-21T20:11:56.434530+0000","last_unstale":"2024-01-21T20:11:56.436938+0000","last_undegraded":"2024-01-21T20:11:56.436938+0000","last_fullsized":"2024-01-21T20:11:56.436938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419408+0000","last_change":"2024-01-21T20:11:56.060518+0000","last_active":"2024-01-21T20:11:56.419408+0000","last_peered":"2024-01-21T20:11:56.419408+0000","last_clean":"2024-01-21T20:11:56.419408+0000","last_became_active":"2024-01-21T20:11:56.060235+0000","last_became_peered":"2024-01-21T20:11:56.060235+0000","last_unstale":"2024-01-21T20:11:56.419408+0000","last_undegraded":"2024-01-21T20:11:56.419408+0000","last_fullsized":"2024-01-21T20:11:56.419408+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431123+0000","last_change":"2024-01-21T20:11:56.426866+0000","last_active":"2024-01-21T20:11:56.431123+0000","last_peered":"2024-01-21T20:11:56.431123+0000","last_clean":"2024-01-21T20:11:56.431123+0000","last_became_active":"2024-01-21T20:11:56.426646+0000","last_became_peered":"2024-01-21T20:11:56.426646+0000","last_unstale":"2024-01-21T20:11:56.431123+0000","last_undegraded":"2024-01-21T20:11:56.431123+0000","last_fullsized":"2024-01-21T20:11:56.431123+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420955+0000","last_change":"2024-01-21T20:11:56.054751+0000","last_active":"2024-01-21T20:11:56.420955+0000","last_peered":"2024-01-21T20:11:56.420955+0000","last_clean":"2024-01-21T20:11:56.420955+0000","last_became_active":"2024-01-21T20:11:56.054458+0000","last_became_peered":"2024-01-21T20:11:56.054458+0000","last_unstale":"2024-01-21T20:11:56.420955+0000","last_undegraded":"2024-01-21T20:11:56.420955+0000","last_fullsized":"2024-01-21T20:11:56.420955+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445343+0000","last_change":"2024-01-21T20:11:56.439500+0000","last_active":"2024-01-21T20:11:56.445343+0000","last_peered":"2024-01-21T20:11:56.445343+0000","last_clean":"2024-01-21T20:11:56.445343+0000","last_became_active":"2024-01-21T20:11:56.439230+0000","last_became_peered":"2024-01-21T20:11:56.439230+0000","last_unstale":"2024-01-21T20:11:56.445343+0000","last_undegraded":"2024-01-21T20:11:56.445343+0000","last_fullsized":"2024-01-21T20:11:56.445343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"61'3","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.439017+0000","last_change":"2024-01-21T20:11:56.060981+0000","last_active":"2024-01-21T20:11:56.439017+0000","last_peered":"2024-01-21T20:11:56.439017+0000","last_clean":"2024-01-21T20:11:56.439017+0000","last_became_active":"2024-01-21T20:11:56.060710+0000","last_became_peered":"2024-01-21T20:11:56.060710+0000","last_unstale":"2024-01-21T20:11:56.439017+0000","last_undegraded":"2024-01-21T20:11:56.439017+0000","last_fullsized":"2024-01-21T20:11:56.439017+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.432918+0000","last_change":"2024-01-21T20:11:56.432046+0000","last_active":"2024-01-21T20:11:56.432918+0000","last_peered":"2024-01-21T20:11:56.432918+0000","last_clean":"2024-01-21T20:11:56.432918+0000","last_became_active":"2024-01-21T20:11:56.431770+0000","last_became_peered":"2024-01-21T20:11:56.431770+0000","last_unstale":"2024-01-21T20:11:56.432918+0000","last_undegraded":"2024-01-21T20:11:56.432918+0000","last_fullsized":"2024-01-21T20:11:56.432918+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438800+0000","last_change":"2024-01-21T20:11:56.053463+0000","last_active":"2024-01-21T20:11:56.438800+0000","last_peered":"2024-01-21T20:11:56.438800+0000","last_clean":"2024-01-21T20:11:56.438800+0000","last_became_active":"2024-01-21T20:11:56.049261+0000","last_became_peered":"2024-01-21T20:11:56.049261+0000","last_unstale":"2024-01-21T20:11:56.438800+0000","last_undegraded":"2024-01-21T20:11:56.438800+0000","last_fullsized":"2024-01-21T20:11:56.438800+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431272+0000","last_change":"2024-01-21T20:11:56.427805+0000","last_active":"2024-01-21T20:11:56.431272+0000","last_peered":"2024-01-21T20:11:56.431272+0000","last_clean":"2024-01-21T20:11:56.431272+0000","last_became_active":"2024-01-21T20:11:56.425480+0000","last_became_peered":"2024-01-21T20:11:56.425480+0000","last_unstale":"2024-01-21T20:11:56.431272+0000","last_undegraded":"2024-01-21T20:11:56.431272+0000","last_fullsized":"2024-01-21T20:11:56.431272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.436251+0000","last_change":"2024-01-21T20:11:56.064934+0000","last_active":"2024-01-21T20:11:56.436251+0000","last_peered":"2024-01-21T20:11:56.436251+0000","last_clean":"2024-01-21T20:11:56.436251+0000","last_became_active":"2024-01-21T20:11:56.064673+0000","last_became_peered":"2024-01-21T20:11:56.064673+0000","last_unstale":"2024-01-21T20:11:56.436251+0000","last_undegraded":"2024-01-21T20:11:56.436251+0000","last_fullsized":"2024-01-21T20:11:56.436251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445004+0000","last_change":"2024-01-21T20:11:56.433434+0000","last_active":"2024-01-21T20:11:56.445004+0000","last_peered":"2024-01-21T20:11:56.445004+0000","last_clean":"2024-01-21T20:11:56.445004+0000","last_became_active":"2024-01-21T20:11:56.431208+0000","last_became_peered":"2024-01-21T20:11:56.431208+0000","last_unstale":"2024-01-21T20:11:56.445004+0000","last_undegraded":"2024-01-21T20:11:56.445004+0000","last_fullsized":"2024-01-21T20:11:56.445004+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.430313+0000","last_change":"2024-01-21T20:11:56.062918+0000","last_active":"2024-01-21T20:11:56.430313+0000","last_peered":"2024-01-21T20:11:56.430313+0000","last_clean":"2024-01-21T20:11:56.430313+0000","last_became_active":"2024-01-21T20:11:56.062683+0000","last_became_peered":"2024-01-21T20:11:56.062683+0000","last_unstale":"2024-01-21T20:11:56.430313+0000","last_undegraded":"2024-01-21T20:11:56.430313+0000","last_fullsized":"2024-01-21T20:11:56.430313+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441400+0000","last_change":"2024-01-21T20:11:56.435394+0000","last_active":"2024-01-21T20:11:56.441400+0000","last_peered":"2024-01-21T20:11:56.441400+0000","last_clean":"2024-01-21T20:11:56.441400+0000","last_became_active":"2024-01-21T20:11:56.434832+0000","last_became_peered":"2024-01-21T20:11:56.434832+0000","last_unstale":"2024-01-21T20:11:56.441400+0000","last_undegraded":"2024-01-21T20:11:56.441400+0000","last_fullsized":"2024-01-21T20:11:56.441400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420591+0000","last_change":"2024-01-21T20:11:56.057817+0000","last_active":"2024-01-21T20:11:56.420591+0000","last_peered":"2024-01-21T20:11:56.420591+0000","last_clean":"2024-01-21T20:11:56.420591+0000","last_became_active":"2024-01-21T20:11:56.057545+0000","last_became_peered":"2024-01-21T20:11:56.057545+0000","last_unstale":"2024-01-21T20:11:56.420591+0000","last_undegraded":"2024-01-21T20:11:56.420591+0000","last_fullsized":"2024-01-21T20:11:56.420591+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444865+0000","last_change":"2024-01-21T20:11:56.432140+0000","last_active":"2024-01-21T20:11:56.444865+0000","last_peered":"2024-01-21T20:11:56.444865+0000","last_clean":"2024-01-21T20:11:56.444865+0000","last_became_active":"2024-01-21T20:11:56.431191+0000","last_became_peered":"2024-01-21T20:11:56.431191+0000","last_unstale":"2024-01-21T20:11:56.444865+0000","last_undegraded":"2024-01-21T20:11:56.444865+0000","last_fullsized":"2024-01-21T20:11:56.444865+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"61'4","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438939+0000","last_change":"2024-01-21T20:11:56.049636+0000","last_active":"2024-01-21T20:11:56.438939+0000","last_peered":"2024-01-21T20:11:56.438939+0000","last_clean":"2024-01-21T20:11:56.438939+0000","last_became_active":"2024-01-21T20:11:56.049366+0000","last_became_peered":"2024-01-21T20:11:56.049366+0000","last_unstale":"2024-01-21T20:11:56.438939+0000","last_undegraded":"2024-01-21T20:11:56.438939+0000","last_fullsized":"2024-01-21T20:11:56.438939+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438999+0000","last_change":"2024-01-21T20:11:56.431736+0000","last_active":"2024-01-21T20:11:56.438999+0000","last_peered":"2024-01-21T20:11:56.438999+0000","last_clean":"2024-01-21T20:11:56.438999+0000","last_became_active":"2024-01-21T20:11:56.431497+0000","last_became_peered":"2024-01-21T20:11:56.431497+0000","last_unstale":"2024-01-21T20:11:56.438999+0000","last_undegraded":"2024-01-21T20:11:56.438999+0000","last_fullsized":"2024-01-21T20:11:56.438999+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.435553+0000","last_change":"2024-01-21T20:11:56.063363+0000","last_active":"2024-01-21T20:11:56.435553+0000","last_peered":"2024-01-21T20:11:56.435553+0000","last_clean":"2024-01-21T20:11:56.435553+0000","last_became_active":"2024-01-21T20:11:56.063090+0000","last_became_peered":"2024-01-21T20:11:56.063090+0000","last_unstale":"2024-01-21T20:11:56.435553+0000","last_undegraded":"2024-01-21T20:11:56.435553+0000","last_fullsized":"2024-01-21T20:11:56.435553+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433230+0000","last_change":"2024-01-21T20:11:56.425626+0000","last_active":"2024-01-21T20:11:56.433230+0000","last_peered":"2024-01-21T20:11:56.433230+0000","last_clean":"2024-01-21T20:11:56.433230+0000","last_became_active":"2024-01-21T20:11:56.425188+0000","last_became_peered":"2024-01-21T20:11:56.425188+0000","last_unstale":"2024-01-21T20:11:56.433230+0000","last_undegraded":"2024-01-21T20:11:56.433230+0000","last_fullsized":"2024-01-21T20:11:56.433230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.426446+0000","last_change":"2024-01-21T20:11:56.053282+0000","last_active":"2024-01-21T20:11:56.426446+0000","last_peered":"2024-01-21T20:11:56.426446+0000","last_clean":"2024-01-21T20:11:56.426446+0000","last_became_active":"2024-01-21T20:11:56.053045+0000","last_became_peered":"2024-01-21T20:11:56.053045+0000","last_unstale":"2024-01-21T20:11:56.426446+0000","last_undegraded":"2024-01-21T20:11:56.426446+0000","last_fullsized":"2024-01-21T20:11:56.426446+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.432651+0000","last_change":"2024-01-21T20:11:56.429241+0000","last_active":"2024-01-21T20:11:56.432651+0000","last_peered":"2024-01-21T20:11:56.432651+0000","last_clean":"2024-01-21T20:11:56.432651+0000","last_became_active":"2024-01-21T20:11:56.428912+0000","last_became_peered":"2024-01-21T20:11:56.428912+0000","last_unstale":"2024-01-21T20:11:56.432651+0000","last_undegraded":"2024-01-21T20:11:56.432651+0000","last_fullsized":"2024-01-21T20:11:56.432651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431618+0000","last_change":"2024-01-21T20:11:56.055173+0000","last_active":"2024-01-21T20:11:56.431618+0000","last_peered":"2024-01-21T20:11:56.431618+0000","last_clean":"2024-01-21T20:11:56.431618+0000","last_became_active":"2024-01-21T20:11:56.054879+0000","last_became_peered":"2024-01-21T20:11:56.054879+0000","last_unstale":"2024-01-21T20:11:56.431618+0000","last_undegraded":"2024-01-21T20:11:56.431618+0000","last_fullsized":"2024-01-21T20:11:56.431618+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438422+0000","last_change":"2024-01-21T20:11:56.432228+0000","last_active":"2024-01-21T20:11:56.438422+0000","last_peered":"2024-01-21T20:11:56.438422+0000","last_clean":"2024-01-21T20:11:56.438422+0000","last_became_active":"2024-01-21T20:11:56.431973+0000","last_became_peered":"2024-01-21T20:11:56.431973+0000","last_unstale":"2024-01-21T20:11:56.438422+0000","last_undegraded":"2024-01-21T20:11:56.438422+0000","last_fullsized":"2024-01-21T20:11:56.438422+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.430470+0000","last_change":"2024-01-21T20:11:56.058958+0000","last_active":"2024-01-21T20:11:56.430470+0000","last_peered":"2024-01-21T20:11:56.430470+0000","last_clean":"2024-01-21T20:11:56.430470+0000","last_became_active":"2024-01-21T20:11:56.058687+0000","last_became_peered":"2024-01-21T20:11:56.058687+0000","last_unstale":"2024-01-21T20:11:56.430470+0000","last_undegraded":"2024-01-21T20:11:56.430470+0000","last_fullsized":"2024-01-21T20:11:56.430470+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431248+0000","last_change":"2024-01-21T20:11:56.427544+0000","last_active":"2024-01-21T20:11:56.431248+0000","last_peered":"2024-01-21T20:11:56.431248+0000","last_clean":"2024-01-21T20:11:56.431248+0000","last_became_active":"2024-01-21T20:11:56.427153+0000","last_became_peered":"2024-01-21T20:11:56.427153+0000","last_unstale":"2024-01-21T20:11:56.431248+0000","last_undegraded":"2024-01-21T20:11:56.431248+0000","last_fullsized":"2024-01-21T20:11:56.431248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"61'1","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433229+0000","last_change":"2024-01-21T20:11:56.052641+0000","last_active":"2024-01-21T20:11:56.433229+0000","last_peered":"2024-01-21T20:11:56.433229+0000","last_clean":"2024-01-21T20:11:56.433229+0000","last_became_active":"2024-01-21T20:11:56.052332+0000","last_became_peered":"2024-01-21T20:11:56.052332+0000","last_unstale":"2024-01-21T20:11:56.433229+0000","last_undegraded":"2024-01-21T20:11:56.433229+0000","last_fullsized":"2024-01-21T20:11:56.433229+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438478+0000","last_change":"2024-01-21T20:11:56.434741+0000","last_active":"2024-01-21T20:11:56.438478+0000","last_peered":"2024-01-21T20:11:56.438478+0000","last_clean":"2024-01-21T20:11:56.438478+0000","last_became_active":"2024-01-21T20:11:56.434007+0000","last_became_peered":"2024-01-21T20:11:56.434007+0000","last_unstale":"2024-01-21T20:11:56.438478+0000","last_undegraded":"2024-01-21T20:11:56.438478+0000","last_fullsized":"2024-01-21T20:11:56.438478+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.418058+0000","last_change":"2024-01-21T20:11:56.055653+0000","last_active":"2024-01-21T20:11:56.418058+0000","last_peered":"2024-01-21T20:11:56.418058+0000","last_clean":"2024-01-21T20:11:56.418058+0000","last_became_active":"2024-01-21T20:11:56.055053+0000","last_became_peered":"2024-01-21T20:11:56.055053+0000","last_unstale":"2024-01-21T20:11:56.418058+0000","last_undegraded":"2024-01-21T20:11:56.418058+0000","last_fullsized":"2024-01-21T20:11:56.418058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445171+0000","last_change":"2024-01-21T20:11:56.437448+0000","last_active":"2024-01-21T20:11:56.445171+0000","last_peered":"2024-01-21T20:11:56.445171+0000","last_clean":"2024-01-21T20:11:56.445171+0000","last_became_active":"2024-01-21T20:11:56.437182+0000","last_became_peered":"2024-01-21T20:11:56.437182+0000","last_unstale":"2024-01-21T20:11:56.445171+0000","last_undegraded":"2024-01-21T20:11:56.445171+0000","last_fullsized":"2024-01-21T20:11:56.445171+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.423810+0000","last_change":"2024-01-21T20:11:56.059112+0000","last_active":"2024-01-21T20:11:56.423810+0000","last_peered":"2024-01-21T20:11:56.423810+0000","last_clean":"2024-01-21T20:11:56.423810+0000","last_became_active":"2024-01-21T20:11:56.058720+0000","last_became_peered":"2024-01-21T20:11:56.058720+0000","last_unstale":"2024-01-21T20:11:56.423810+0000","last_undegraded":"2024-01-21T20:11:56.423810+0000","last_fullsized":"2024-01-21T20:11:56.423810+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433821+0000","last_change":"2024-01-21T20:11:56.427141+0000","last_active":"2024-01-21T20:11:56.433821+0000","last_peered":"2024-01-21T20:11:56.433821+0000","last_clean":"2024-01-21T20:11:56.433821+0000","last_became_active":"2024-01-21T20:11:56.426380+0000","last_became_peered":"2024-01-21T20:11:56.426380+0000","last_unstale":"2024-01-21T20:11:56.433821+0000","last_undegraded":"2024-01-21T20:11:56.433821+0000","last_fullsized":"2024-01-21T20:11:56.433821+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.412969+0000","last_change":"2024-01-21T20:11:56.053726+0000","last_active":"2024-01-21T20:11:56.412969+0000","last_peered":"2024-01-21T20:11:56.412969+0000","last_clean":"2024-01-21T20:11:56.412969+0000","last_became_active":"2024-01-21T20:11:56.053523+0000","last_became_peered":"2024-01-21T20:11:56.053523+0000","last_unstale":"2024-01-21T20:11:56.412969+0000","last_undegraded":"2024-01-21T20:11:56.412969+0000","last_fullsized":"2024-01-21T20:11:56.412969+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445151+0000","last_change":"2024-01-21T20:11:56.434695+0000","last_active":"2024-01-21T20:11:56.445151+0000","last_peered":"2024-01-21T20:11:56.445151+0000","last_clean":"2024-01-21T20:11:56.445151+0000","last_became_active":"2024-01-21T20:11:56.434438+0000","last_became_peered":"2024-01-21T20:11:56.434438+0000","last_unstale":"2024-01-21T20:11:56.445151+0000","last_undegraded":"2024-01-21T20:11:56.445151+0000","last_fullsized":"2024-01-21T20:11:56.445151+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.420039+0000","last_change":"2024-01-21T20:11:56.048221+0000","last_active":"2024-01-21T20:11:56.420039+0000","last_peered":"2024-01-21T20:11:56.420039+0000","last_clean":"2024-01-21T20:11:56.420039+0000","last_became_active":"2024-01-21T20:11:56.047478+0000","last_became_peered":"2024-01-21T20:11:56.047478+0000","last_unstale":"2024-01-21T20:11:56.420039+0000","last_undegraded":"2024-01-21T20:11:56.420039+0000","last_fullsized":"2024-01-21T20:11:56.420039+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.423651+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:11:56.423651+0000","last_peered":"2024-01-21T20:11:56.423651+0000","last_clean":"2024-01-21T20:11:56.423651+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:11:56.423651+0000","last_undegraded":"2024-01-21T20:11:56.423651+0000","last_fullsized":"2024-01-21T20:11:56.423651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.433128+0000","last_change":"2024-01-21T20:11:56.430158+0000","last_active":"2024-01-21T20:11:56.433128+0000","last_peered":"2024-01-21T20:11:56.433128+0000","last_clean":"2024-01-21T20:11:56.433128+0000","last_became_active":"2024-01-21T20:11:56.429631+0000","last_became_peered":"2024-01-21T20:11:56.429631+0000","last_unstale":"2024-01-21T20:11:56.433128+0000","last_undegraded":"2024-01-21T20:11:56.433128+0000","last_fullsized":"2024-01-21T20:11:56.433128+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"61'2","reported_seq":12,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.445304+0000","last_change":"2024-01-21T20:11:56.062671+0000","last_active":"2024-01-21T20:11:56.445304+0000","last_peered":"2024-01-21T20:11:56.445304+0000","last_clean":"2024-01-21T20:11:56.445304+0000","last_became_active":"2024-01-21T20:11:56.062370+0000","last_became_peered":"2024-01-21T20:11:56.062370+0000","last_unstale":"2024-01-21T20:11:56.445304+0000","last_undegraded":"2024-01-21T20:11:56.445304+0000","last_fullsized":"2024-01-21T20:11:56.445304+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.414127+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:11:56.414127+0000","last_peered":"2024-01-21T20:11:56.414127+0000","last_clean":"2024-01-21T20:11:56.414127+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:11:56.414127+0000","last_undegraded":"2024-01-21T20:11:56.414127+0000","last_fullsized":"2024-01-21T20:11:56.414127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441249+0000","last_change":"2024-01-21T20:11:56.433596+0000","last_active":"2024-01-21T20:11:56.441249+0000","last_peered":"2024-01-21T20:11:56.441249+0000","last_clean":"2024-01-21T20:11:56.441249+0000","last_became_active":"2024-01-21T20:11:56.433345+0000","last_became_peered":"2024-01-21T20:11:56.433345+0000","last_unstale":"2024-01-21T20:11:56.441249+0000","last_undegraded":"2024-01-21T20:11:56.441249+0000","last_fullsized":"2024-01-21T20:11:56.441249+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.422602+0000","last_change":"2024-01-21T20:11:56.061485+0000","last_active":"2024-01-21T20:11:56.422602+0000","last_peered":"2024-01-21T20:11:56.422602+0000","last_clean":"2024-01-21T20:11:56.422602+0000","last_became_active":"2024-01-21T20:11:56.061196+0000","last_became_peered":"2024-01-21T20:11:56.061196+0000","last_unstale":"2024-01-21T20:11:56.422602+0000","last_undegraded":"2024-01-21T20:11:56.422602+0000","last_fullsized":"2024-01-21T20:11:56.422602+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.413419+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:11:56.413419+0000","last_peered":"2024-01-21T20:11:56.413419+0000","last_clean":"2024-01-21T20:11:56.413419+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:11:56.413419+0000","last_undegraded":"2024-01-21T20:11:56.413419+0000","last_fullsized":"2024-01-21T20:11:56.413419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.438522+0000","last_change":"2024-01-21T20:11:56.435218+0000","last_active":"2024-01-21T20:11:56.438522+0000","last_peered":"2024-01-21T20:11:56.438522+0000","last_clean":"2024-01-21T20:11:56.438522+0000","last_became_active":"2024-01-21T20:11:56.434045+0000","last_became_peered":"2024-01-21T20:11:56.434045+0000","last_unstale":"2024-01-21T20:11:56.438522+0000","last_undegraded":"2024-01-21T20:11:56.438522+0000","last_fullsized":"2024-01-21T20:11:56.438522+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.422963+0000","last_change":"2024-01-21T20:11:56.065090+0000","last_active":"2024-01-21T20:11:56.422963+0000","last_peered":"2024-01-21T20:11:56.422963+0000","last_clean":"2024-01-21T20:11:56.422963+0000","last_became_active":"2024-01-21T20:11:56.064144+0000","last_became_peered":"2024-01-21T20:11:56.064144+0000","last_unstale":"2024-01-21T20:11:56.422963+0000","last_undegraded":"2024-01-21T20:11:56.422963+0000","last_fullsized":"2024-01-21T20:11:56.422963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.414628+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:11:56.414628+0000","last_peered":"2024-01-21T20:11:56.414628+0000","last_clean":"2024-01-21T20:11:56.414628+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:11:56.414628+0000","last_undegraded":"2024-01-21T20:11:56.414628+0000","last_fullsized":"2024-01-21T20:11:56.414628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419378+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:11:56.419378+0000","last_peered":"2024-01-21T20:11:56.419378+0000","last_clean":"2024-01-21T20:11:56.419378+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:11:56.419378+0000","last_undegraded":"2024-01-21T20:11:56.419378+0000","last_fullsized":"2024-01-21T20:11:56.419378+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.428737+0000","last_change":"2024-01-21T20:11:56.423501+0000","last_active":"2024-01-21T20:11:56.428737+0000","last_peered":"2024-01-21T20:11:56.428737+0000","last_clean":"2024-01-21T20:11:56.428737+0000","last_became_active":"2024-01-21T20:11:56.423211+0000","last_became_peered":"2024-01-21T20:11:56.423211+0000","last_unstale":"2024-01-21T20:11:56.428737+0000","last_undegraded":"2024-01-21T20:11:56.428737+0000","last_fullsized":"2024-01-21T20:11:56.428737+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419716+0000","last_change":"2024-01-21T20:11:56.065245+0000","last_active":"2024-01-21T20:11:56.419716+0000","last_peered":"2024-01-21T20:11:56.419716+0000","last_clean":"2024-01-21T20:11:56.419716+0000","last_became_active":"2024-01-21T20:11:56.065007+0000","last_became_peered":"2024-01-21T20:11:56.065007+0000","last_unstale":"2024-01-21T20:11:56.419716+0000","last_undegraded":"2024-01-21T20:11:56.419716+0000","last_fullsized":"2024-01-21T20:11:56.419716+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419481+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:11:56.419481+0000","last_peered":"2024-01-21T20:11:56.419481+0000","last_clean":"2024-01-21T20:11:56.419481+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:11:56.419481+0000","last_undegraded":"2024-01-21T20:11:56.419481+0000","last_fullsized":"2024-01-21T20:11:56.419481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.441352+0000","last_change":"2024-01-21T20:11:56.435327+0000","last_active":"2024-01-21T20:11:56.441352+0000","last_peered":"2024-01-21T20:11:56.441352+0000","last_clean":"2024-01-21T20:11:56.441352+0000","last_became_active":"2024-01-21T20:11:56.435054+0000","last_became_peered":"2024-01-21T20:11:56.435054+0000","last_unstale":"2024-01-21T20:11:56.441352+0000","last_undegraded":"2024-01-21T20:11:56.441352+0000","last_fullsized":"2024-01-21T20:11:56.441352+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.414976+0000","last_change":"2024-01-21T20:11:56.057485+0000","last_active":"2024-01-21T20:11:56.414976+0000","last_peered":"2024-01-21T20:11:56.414976+0000","last_clean":"2024-01-21T20:11:56.414976+0000","last_became_active":"2024-01-21T20:11:56.057200+0000","last_became_peered":"2024-01-21T20:11:56.057200+0000","last_unstale":"2024-01-21T20:11:56.414976+0000","last_undegraded":"2024-01-21T20:11:56.414976+0000","last_fullsized":"2024-01-21T20:11:56.414976+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.421036+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:11:56.421036+0000","last_peered":"2024-01-21T20:11:56.421036+0000","last_clean":"2024-01-21T20:11:56.421036+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:11:56.421036+0000","last_undegraded":"2024-01-21T20:11:56.421036+0000","last_fullsized":"2024-01-21T20:11:56.421036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.444752+0000","last_change":"2024-01-21T20:11:56.430528+0000","last_active":"2024-01-21T20:11:56.444752+0000","last_peered":"2024-01-21T20:11:56.444752+0000","last_clean":"2024-01-21T20:11:56.444752+0000","last_became_active":"2024-01-21T20:11:56.429970+0000","last_became_peered":"2024-01-21T20:11:56.429970+0000","last_unstale":"2024-01-21T20:11:56.444752+0000","last_undegraded":"2024-01-21T20:11:56.444752+0000","last_fullsized":"2024-01-21T20:11:56.444752+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.419053+0000","last_change":"2024-01-21T20:11:56.049749+0000","last_active":"2024-01-21T20:11:56.419053+0000","last_peered":"2024-01-21T20:11:56.419053+0000","last_clean":"2024-01-21T20:11:56.419053+0000","last_became_active":"2024-01-21T20:11:56.049422+0000","last_became_peered":"2024-01-21T20:11:56.049422+0000","last_unstale":"2024-01-21T20:11:56.419053+0000","last_undegraded":"2024-01-21T20:11:56.419053+0000","last_fullsized":"2024-01-21T20:11:56.419053+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.423511+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:11:56.423511+0000","last_peered":"2024-01-21T20:11:56.423511+0000","last_clean":"2024-01-21T20:11:56.423511+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:11:56.423511+0000","last_undegraded":"2024-01-21T20:11:56.423511+0000","last_fullsized":"2024-01-21T20:11:56.423511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.429531+0000","last_change":"2024-01-21T20:11:56.424404+0000","last_active":"2024-01-21T20:11:56.429531+0000","last_peered":"2024-01-21T20:11:56.429531+0000","last_clean":"2024-01-21T20:11:56.429531+0000","last_became_active":"2024-01-21T20:11:56.424076+0000","last_became_peered":"2024-01-21T20:11:56.424076+0000","last_unstale":"2024-01-21T20:11:56.429531+0000","last_undegraded":"2024-01-21T20:11:56.429531+0000","last_fullsized":"2024-01-21T20:11:56.429531+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:56.030617+0000","last_clean_scrub_stamp":"2024-01-21T20:11:56.030617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.418244+0000","last_change":"2024-01-21T20:11:56.055823+0000","last_active":"2024-01-21T20:11:56.418244+0000","last_peered":"2024-01-21T20:11:56.418244+0000","last_clean":"2024-01-21T20:11:56.418244+0000","last_became_active":"2024-01-21T20:11:56.055398+0000","last_became_peered":"2024-01-21T20:11:56.055398+0000","last_unstale":"2024-01-21T20:11:56.418244+0000","last_undegraded":"2024-01-21T20:11:56.418244+0000","last_fullsized":"2024-01-21T20:11:56.418244+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:11:55.028489+0000","last_clean_scrub_stamp":"2024-01-21T20:11:55.028489+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-01-21T20:11:56.431556+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:11:56.431556+0000","last_peered":"2024-01-21T20:11:56.431556+0000","last_clean":"2024-01-21T20:11:56.431556+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:11:56.431556+0000","last_undegraded":"2024-01-21T20:11:56.431556+0000","last_fullsized":"2024-01-21T20:11:56.431556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301920,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069920,"statfs":{"total":96636764160,"available":96327598080,"internally_reserved":0,"allocated":745472,"data_stored":362933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.42299999999999999,"5min":0.35799999999999998,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.79300000000000004,"15min":0.81000000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.63600000000000001,"15min":0.62},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.77400000000000002,"5min":0.80300000000000005,"15min":1.47},"last":0.57499999999999996}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56399999999999995,"15min":0.54300000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68899999999999995,"5min":0.78100000000000003,"15min":0.91100000000000003},"last":0.504},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.54300000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75900000000000001,"15min":0.79700000000000004},"last":0.49199999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.54400000000000004},"min":{"1min":0.47599999999999998,"5min":0.39300000000000002,"15min":0.32300000000000001},"max":{"1min":0.68700000000000006,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":1.4930000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.747,"5min":0.81799999999999995,"15min":1.5229999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.36399999999999999},"max":{"1min":0.80000000000000004,"5min":0.83699999999999997,"15min":1.514},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47799999999999998,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.316,"15min":0.31},"max":{"1min":0.626,"5min":0.72099999999999997,"15min":0.755},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.432,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.71699999999999997,"5min":0.82499999999999996,"15min":0.84799999999999998},"last":0.69799999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.51200000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.309},"max":{"1min":0.72499999999999998,"5min":0.74399999999999999,"15min":0.81399999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51300000000000001,"15min":0.52200000000000002},"min":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35399999999999998},"max":{"1min":0.76700000000000002,"5min":0.77400000000000002,"15min":0.83299999999999996},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.32900000000000001},"max":{"1min":0.77100000000000002,"5min":0.81499999999999995,"15min":0.82499999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.752,"5min":0.79300000000000004,"15min":0.88400000000000001},"last":0.748}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301916,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069924,"statfs":{"total":96636764160,"available":96327602176,"internally_reserved":0,"allocated":741376,"data_stored":363286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.57799999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.25800000000000001},"max":{"1min":0.72099999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.63100000000000001,"15min":0.60399999999999998},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":1.083,"15min":1.083},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.54600000000000004},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.755,"5min":1.107,"15min":1.107},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.55600000000000005},"min":{"1min":0.442,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69399999999999995,"5min":1.016,"15min":1.016},"last":0.66800000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58099999999999996,"15min":0.54500000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.33600000000000002},"max":{"1min":0.72699999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.60099999999999998,"15min":0.57099999999999995},"min":{"1min":0.47499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58999999999999997,"15min":0.57499999999999996},"min":{"1min":0.48899999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.67300000000000004,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.56499999999999995},"min":{"1min":0.44400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.71199999999999997,"5min":1.069,"15min":1.069},"last":0.64800000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.44800000000000001,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":0.54400000000000004,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.47799999999999998,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.34399999999999997,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58299999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.373,"5min":0.314,"15min":0.312},"max":{"1min":0.69299999999999995,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.71999999999999997,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:11:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53100000000000003,"15min":0.54800000000000004},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65800000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.39000000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.66700000000000004,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297820,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074020,"statfs":{"total":96636764160,"available":96331796480,"internally_reserved":0,"allocated":741376,"data_stored":363306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.38},"min":{"1min":0.26200000000000001,"5min":0.24399999999999999,"15min":0.20999999999999999},"max":{"1min":0.54600000000000004,"5min":0.60599999999999998,"15min":0.61399999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45000000000000001,"15min":0.42099999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.247},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.627},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.38900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.251},"max":{"1min":0.58499999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.19400000000000001},"max":{"1min":0.63700000000000001,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.46000000000000002,"15min":0.43099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.26100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.371},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.40300000000000002},"min":{"1min":0.31,"5min":0.30399999999999999,"15min":0.247},"max":{"1min":0.624,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.316}]},{"osd":4,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.63400000000000001,"15min":0.60899999999999999},"min":{"1min":0.47299999999999998,"5min":0.40400000000000003,"15min":0.379},"max":{"1min":0.82999999999999996,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.63500000000000001,"15min":0.60599999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.379},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.499}]},{"osd":5,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67100000000000004,"15min":0.63600000000000001},"min":{"1min":0.441,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.53500000000000003,"5min":0.47299999999999998,"15min":0.47199999999999998},"max":{"1min":0.94399999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.48299999999999998,"5min":0.44900000000000001,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.67700000000000005},"min":{"1min":0.57599999999999996,"5min":0.46600000000000003,"15min":0.44},"max":{"1min":0.97699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.45600000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:11:21 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66700000000000004,"15min":0.63100000000000001},"min":{"1min":0.495,"5min":0.42799999999999999,"15min":0.40100000000000002},"max":{"1min":0.88800000000000001,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.64900000000000002},"min":{"1min":0.5,"5min":0.45800000000000002,"15min":0.41899999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575006,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297824,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074016,"statfs":{"total":96636764160,"available":96331792384,"internally_reserved":0,"allocated":745472,"data_stored":362381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.37,"15min":0.35699999999999998},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.20599999999999999},"max":{"1min":0.51700000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40999999999999998,"15min":0.38500000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.24099999999999999},"max":{"1min":0.60899999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32300000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41499999999999998,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.245,"15min":0.23499999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.375},{"interface":"front","average":{"1min":0.433,"5min":0.44400000000000001,"15min":0.42399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.26600000000000001},"max":{"1min":0.57299999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.316}]},{"osd":3,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.42399999999999999,"15min":0.40300000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.22},"max":{"1min":0.54700000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.435,"15min":0.41699999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27100000000000002},"max":{"1min":0.58399999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.39400000000000002},"max":{"1min":0.80700000000000005,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60899999999999999},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.41799999999999998},"max":{"1min":0.86699999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.46700000000000003,"5min":0.433,"15min":0.41799999999999998},"max":{"1min":0.77500000000000002,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.54700000000000004,"5min":0.42999999999999999,"15min":0.40100000000000002},"max":{"1min":0.78200000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67000000000000004,"15min":0.65100000000000002},"min":{"1min":0.54300000000000004,"5min":0.44500000000000001,"15min":0.42299999999999999},"max":{"1min":0.79500000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.42799999999999999},"max":{"1min":0.85999999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:11:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65500000000000003,"15min":0.64500000000000002},"min":{"1min":0.51400000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.84999999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.755},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64200000000000002},"min":{"1min":0.58599999999999997,"5min":0.45800000000000002,"15min":0.44600000000000001},"max":{"1min":0.83699999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":364752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39400000000000002,"15min":0.39700000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54400000000000004,"5min":0.57099999999999995,"15min":0.91500000000000004},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.42299999999999999,"15min":0.41899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.53300000000000003,"5min":0.60899999999999999,"15min":0.93799999999999994},"last":0.29399999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52700000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53500000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.31900000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.42999999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.55600000000000005,"5min":0.625,"15min":0.64300000000000002},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.46700000000000003,"15min":0.44700000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63400000000000001,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.39500000000000002},"max":{"1min":0.78400000000000003,"5min":0.84599999999999997,"15min":0.95499999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.66800000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85099999999999998,"5min":0.91600000000000004,"15min":0.96899999999999997},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65300000000000002,"15min":0.624},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.38600000000000001},"max":{"1min":0.77700000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64100000000000001,"15min":0.621},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.36599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.98699999999999999},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.628},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82599999999999996,"5min":0.98199999999999998,"15min":0.999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.66400000000000003,"15min":0.64000000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85999999999999999,"5min":0.93100000000000005,"15min":0.93400000000000005},"last":0.68300000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:11:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65700000000000003,"15min":0.63500000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79000000000000004,"5min":0.88500000000000001,"15min":0.92900000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.67800000000000005,"15min":0.65500000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.79500000000000004,"5min":0.94899999999999995,"15min":0.96499999999999997},"last":0.73699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":363882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.39100000000000001,"15min":0.38300000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.54000000000000004,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.432,"15min":0.40600000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.61299999999999999},"last":0.313}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.38900000000000001,"15min":0.37},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.22700000000000001},"max":{"1min":0.55900000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.41399999999999998,"15min":0.39900000000000002},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.33500000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.45800000000000002,"15min":0.437},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.27700000000000002},"max":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.67000000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47199999999999998,"15min":0.45400000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64500000000000002,"15min":0.63500000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":0.92200000000000004,"15min":1.087},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.63800000000000001,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":0.89300000000000002,"15min":0.95399999999999996},"last":0.53400000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.86199999999999999,"5min":0.90800000000000003,"15min":1.044},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.65100000000000002,"15min":0.63900000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.38400000000000001},"max":{"1min":0.83999999999999997,"5min":0.88500000000000001,"15min":0.98799999999999999},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":0.89400000000000002,"15min":1.0269999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.88800000000000001,"5min":0.98999999999999999,"15min":1},"last":0.52100000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.67200000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.86199999999999999,"5min":0.96699999999999997,"15min":3.3330000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.441},"max":{"1min":0.89500000000000002,"5min":0.93300000000000005,"15min":1.0820000000000001},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301916,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069924,"statfs":{"total":96636764160,"available":96327602176,"internally_reserved":0,"allocated":741376,"data_stored":363770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60799999999999998,"15min":0.58299999999999996},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.33100000000000002},"max":{"1min":0.66900000000000004,"5min":0.79200000000000004,"15min":1.379},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.40400000000000003,"5min":0.372,"15min":0.37},"max":{"1min":0.70099999999999996,"5min":0.77800000000000002,"15min":1.139},"last":0.58099999999999996}]},{"osd":1,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.621,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.70999999999999996,"5min":0.80000000000000004,"15min":1.8220000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.627,"15min":0.626},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.38300000000000001},"max":{"1min":0.70099999999999996,"5min":0.77400000000000002,"15min":2.3140000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65900000000000003,"5min":0.81799999999999995,"15min":1.7130000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72799999999999998,"5min":0.752,"15min":2.262},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.68700000000000006,"5min":0.78900000000000003,"15min":1.2470000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59599999999999997,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.34899999999999998},"max":{"1min":0.68000000000000005,"5min":0.754,"15min":1.7410000000000001},"last":0.50600000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.312},"max":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":2.3530000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.49299999999999999,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.32900000000000001},"max":{"1min":0.66900000000000004,"5min":0.77600000000000002,"15min":1.296},"last":0.625}]},{"osd":6,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.5,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.316},"max":{"1min":0.70599999999999996,"5min":0.79500000000000004,"15min":1.7629999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54100000000000004,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.35999999999999999,"15min":0.316},"max":{"1min":0.64300000000000002,"5min":0.80000000000000004,"15min":2.3839999999999999},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:11:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72599999999999998,"5min":0.80900000000000005,"15min":1.3280000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.73899999999999999,"5min":0.83499999999999996,"15min":1.8839999999999999},"last":0.62}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306012,"kb_used_data":724,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065828,"statfs":{"total":96636764160,"available":96323407872,"internally_reserved":0,"allocated":741376,"data_stored":364108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61199999999999999,"15min":0.59499999999999997},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.33000000000000002},"max":{"1min":0.752,"5min":0.80700000000000005,"15min":1.4690000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.61699999999999999,"15min":0.59999999999999998},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.36799999999999999},"max":{"1min":0.72399999999999998,"5min":0.80400000000000005,"15min":0.83899999999999997},"last":0.54700000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.32100000000000001},"max":{"1min":0.69499999999999995,"5min":0.79100000000000004,"15min":1.446},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.41399999999999998,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.71799999999999997,"5min":0.76400000000000001,"15min":0.78000000000000003},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":1.4970000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.378},"max":{"1min":0.72699999999999998,"5min":0.81499999999999995,"15min":1.425},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59399999999999997,"15min":0.58899999999999997},"min":{"1min":0.40999999999999998,"5min":0.36899999999999999,"15min":0.36699999999999999},"max":{"1min":0.68899999999999995,"5min":0.76800000000000002,"15min":0.79400000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.495},"min":{"1min":0.39200000000000002,"5min":0.32300000000000001,"15min":0.29399999999999998},"max":{"1min":0.60099999999999998,"5min":0.71099999999999997,"15min":0.78200000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55800000000000005,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.78600000000000003,"15min":1.492},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48799999999999999,"15min":0.51100000000000001},"min":{"1min":0.36199999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.63800000000000001,"5min":0.74199999999999999,"15min":0.96199999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66000000000000003,"5min":0.752,"15min":0.752},"last":0.51600000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:11:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.71199999999999997,"5min":0.752,"15min":0.98199999999999998},"last":0.501},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.58499999999999996},"min":{"1min":0.45000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":1.0289999999999999},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:11:59.751 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:11:59.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:11:59.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.918+0000 7fc4051fb700 1 Processor -- start 2024-01-21T20:11:59.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.918+0000 7fc4051fb700 1 -- start start 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc4051fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc40013a830 0x7fc4000c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc4051fb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc40013ac10 0x7fc4000bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc4051fb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000c3890 con 0x7fc4000695b0 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc4051fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000c3b70 con 0x7fc40013a830 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc4051fb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000c3e50 con 0x7fc40013ac10 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc3fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc40013a830 0x7fc4000c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc3fed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc40013a830 0x7fc4000c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42984/0 (socket says 172.21.15.133:42984) 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.919+0000 7fc3fed9d700 1 -- 172.21.15.133:0/387185014 learned_addr learned my addr 172.21.15.133:0/387185014 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fe59c700 1 --2- 172.21.15.133:0/387185014 >> v2:172.21.15.178:3300/0 conn(0x7fc40013ac10 0x7fc4000bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fed9d700 1 -- 172.21.15.133:0/387185014 >> v2:172.21.15.178:3300/0 conn(0x7fc40013ac10 msgr2=0x7fc4000bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fed9d700 1 --2- 172.21.15.133:0/387185014 >> v2:172.21.15.178:3300/0 conn(0x7fc40013ac10 0x7fc4000bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fed9d700 1 -- 172.21.15.133:0/387185014 >> v1:172.21.15.178:6789/0 conn(0x7fc4000695b0 legacy=0x7fc4000699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:11:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fed9d700 1 -- 172.21.15.133:0/387185014 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000c4130 con 0x7fc40013a830 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fed9d700 1 --2- 172.21.15.133:0/387185014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc40013a830 0x7fc4000c3220 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fc4000694b0 tx=0x7fc3f80090f0).ready entity=mon.0 client_cookie=5cb19f892ffcdfed server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fdd9b700 1 -- 172.21.15.133:0/387185014 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800b600 con 0x7fc40013a830 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fdd9b700 1 -- 172.21.15.133:0/387185014 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f800b760 con 0x7fc40013a830 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc3fdd9b700 1 -- 172.21.15.133:0/387185014 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800bb00 con 0x7fc40013a830 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc4051fb700 1 -- 172.21.15.133:0/387185014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc40013a830 msgr2=0x7fc4000c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.920+0000 7fc4051fb700 1 --2- 172.21.15.133:0/387185014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc40013a830 0x7fc4000c3220 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fc4000694b0 tx=0x7fc3f80090f0).stop 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 -- 172.21.15.133:0/387185014 shutdown_connections 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 --2- 172.21.15.133:0/387185014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc40013a830 0x7fc4000c3220 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 --2- 172.21.15.133:0/387185014 >> v2:172.21.15.178:3300/0 conn(0x7fc40013ac10 0x7fc4000bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 -- 172.21.15.133:0/387185014 >> 172.21.15.133:0/387185014 conn(0x7fc4000c7dc0 msgr2=0x7fc4000c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 -- 172.21.15.133:0/387185014 shutdown_connections 2024-01-21T20:11:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.921+0000 7fc4051fb700 1 -- 172.21.15.133:0/387185014 wait complete. 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.922+0000 7fc4051fb700 1 Processor -- start 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.922+0000 7fc4051fb700 1 -- start start 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40013a830 0x7fc4000a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40013ac10 0x7fc4001506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000abab0 con 0x7fc4000695b0 2024-01-21T20:11:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000aaea0 con 0x7fc40013a830 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc4051fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000ab180 con 0x7fc40013ac10 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42988/0 (socket says 172.21.15.133:42988) 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 -- 172.21.15.133:0/1592032293 learned_addr learned my addr 172.21.15.133:0/1592032293 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fe59c700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40013a830 0x7fc4000a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3ff59e700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40013ac10 0x7fc4001506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 -- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40013ac10 msgr2=0x7fc4001506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40013ac10 0x7fc4001506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 -- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40013a830 msgr2=0x7fc4000a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40013a830 0x7fc4000a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.923+0000 7fc3fed9d700 1 -- 172.21.15.133:0/1592032293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8009370 con 0x7fc4000695b0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc3fed9d700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc400068c60 tx=0x7fc3f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8006d90 con 0x7fc4000695b0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f800bec0 con 0x7fc4000695b0 2024-01-21T20:11:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8024470 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4000ab460 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.924+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4000adc80 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.925+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40005fdf0 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.925+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc3f8021070 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.925+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 0x7fc3e0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.925+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7fc3f807bd00 con 0x7fc4000695b0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.925+0000 7fc3fe59c700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 0x7fc3e0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:11:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.926+0000 7fc3fe59c700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 0x7fc3e0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc4000aa860 tx=0x7fc3e8008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:11:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:11:59.929+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc3f804cda0 con 0x7fc4000695b0 2024-01-21T20:12:00.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.160+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc4000abd90 con 0x7fc4000695b0 2024-01-21T20:12:00.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.163+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1592032293 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc3f80503c0 con 0x7fc4000695b0 2024-01-21T20:12:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 msgr2=0x7fc3e0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 0x7fc3e0061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc4000aa860 tx=0x7fc3e8008040).stop 2024-01-21T20:12:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 msgr2=0x7fc4000ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fc400068c60 tx=0x7fc3f8017000).stop 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 shutdown_connections 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3e005f150 0x7fc3e0061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40013ac10 0x7fc4001506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4000695b0 0x7fc4000ad790 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 --2- 172.21.15.133:0/1592032293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40013a830 0x7fc4000a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 >> 172.21.15.133:0/1592032293 conn(0x7fc4000c7dc0 msgr2=0x7fc4000c7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 shutdown_connections 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.165+0000 7fc4051fb700 1 -- 172.21.15.133:0/1592032293 wait complete. 2024-01-21T20:12:00.157 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:12:00.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:12:00.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.293+0000 7f9655cec700 1 Processor -- start 2024-01-21T20:12:00.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.293+0000 7f9655cec700 1 -- start start 2024-01-21T20:12:00.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f9655cec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f9650065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f9655cec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96501511f0 con 0x7f96500bd360 2024-01-21T20:12:00.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f9655cec700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9650065b20 con 0x7f96500a9e30 2024-01-21T20:12:00.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f9655cec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500c2240 con 0x7f96500c2b00 2024-01-21T20:12:00.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f964ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f96500bd360 0x7f9650154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40758/0 (socket says 172.21.15.133:40758) 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f964ffff700 1 -- 172.21.15.133:0/3136800814 learned_addr learned my addr 172.21.15.133:0/3136800814 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738421697 0 0) 0x7f9648001490 con 0x7f96500bd360 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c0033f0 con 0x7f96500bd360 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.294+0000 7f964effd700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f9650065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630657796 0 0) 0x7f963c0033f0 con 0x7f96500bd360 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 msgr2=0x7f9650065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f9650065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 >> v1:172.21.15.178:6789/0 conn(0x7f96500a9e30 legacy=0x7f96500bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500c2f60 con 0x7f96500bd360 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f9648001980 con 0x7f96500bd360 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 >> v1:172.21.15.133:6789/0 conn(0x7f96500bd360 legacy=0x7f9650154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f963c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f963c003ef0 0x7f963c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c004b80 0x7f963c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500c2240 con 0x7f963c003ef0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963c00bb20 con 0x7f963c004b80 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c00bce0 con 0x7f96500c2b00 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f963c003ef0 0x7f963c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964f7fe700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f963c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964ffff700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c004b80 0x7f963c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 -- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 msgr2=0x7f963c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96500c2b00 0x7f963c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 -- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c004b80 msgr2=0x7f963c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c004b80 0x7f963c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 -- 172.21.15.133:0/3136800814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c0033f0 con 0x7f963c003ef0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964ffff700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c004b80 0x7f963c005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964effd700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f963c003ef0 0x7f963c004690 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f9640009ae0 tx=0x7f9640008040).ready entity=mon.0 client_cookie=163b062ca138e6d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:00.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000c070 con 0x7f963c003ef0 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000e5e0 con 0x7f963c003ef0 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.295+0000 7f964e7fc700 1 -- 172.21.15.133:0/3136800814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640009420 con 0x7f963c003ef0 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 -- 172.21.15.133:0/3136800814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f963c003ef0 msgr2=0x7f963c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 --2- 172.21.15.133:0/3136800814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f963c003ef0 0x7f963c004690 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f9640009ae0 tx=0x7f9640008040).stop 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f964ffff700 1 -- 172.21.15.133:0/3136800814 reap_dead start 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 -- 172.21.15.133:0/3136800814 shutdown_connections 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 -- 172.21.15.133:0/3136800814 >> 172.21.15.133:0/3136800814 conn(0x7f96500c8200 msgr2=0x7f96500c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 -- 172.21.15.133:0/3136800814 shutdown_connections 2024-01-21T20:12:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.296+0000 7f9655cec700 1 -- 172.21.15.133:0/3136800814 wait complete. 2024-01-21T20:12:00.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.297+0000 7f9655cec700 1 Processor -- start 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.297+0000 7f9655cec700 1 -- start start 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c003ef0 0x7f965013f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96501557a0 0x7f9650155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965014e9b0 con 0x7f96500ac970 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9650156110 con 0x7f963c003ef0 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f9655cec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500ad2e0 con 0x7f96501557a0 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34492/0 (socket says 172.21.15.133:34492) 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 -- 172.21.15.133:0/2460238848 learned_addr learned my addr 172.21.15.133:0/2460238848 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964f7fe700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c003ef0 0x7f965013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964effd700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96501557a0 0x7f9650155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 -- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96501557a0 msgr2=0x7f9650155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96501557a0 0x7f9650155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 -- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c003ef0 msgr2=0x7f965013f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c003ef0 0x7f965013f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.298+0000 7f964ffff700 1 -- 172.21.15.133:0/2460238848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965014dd30 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f964ffff700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f965005f8e0 tx=0x7f9648001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800e600 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964800e760 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800eb20 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965014e010 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.299+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965014e5d0 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.300+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965014e790 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.300+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9648014440 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.300+0000 7f9647fff700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 0x7f9630061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.301+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f9648079700 con 0x7f96500ac970 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.301+0000 7f964f7fe700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 0x7f9630061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.301+0000 7f964f7fe700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 0x7f9630061640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9638007fd0 tx=0x7f9638007bb0).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:00.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.305+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f964804a740 con 0x7f96500ac970 2024-01-21T20:12:00.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.508+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96501511f0 con 0x7f96500ac970 2024-01-21T20:12:00.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.508+0000 7f9647fff700 1 -- 172.21.15.133:0/2460238848 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f96501511f0 con 0x7f96500ac970 2024-01-21T20:12:00.499 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:12:00.499 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:12:00.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 msgr2=0x7f9630061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 0x7f9630061640 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9638007fd0 tx=0x7f9638007bb0).stop 2024-01-21T20:12:00.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 msgr2=0x7f96500acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:00.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f965005f8e0 tx=0x7f9648001980).stop 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 shutdown_connections 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f963005f180 0x7f9630061640 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96500ac970 0x7f96500acdf0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f963c003ef0 0x7f965013f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 --2- 172.21.15.133:0/2460238848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96501557a0 0x7f9650155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 >> 172.21.15.133:0/2460238848 conn(0x7f96500c8200 msgr2=0x7f96500c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 shutdown_connections 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:00.510+0000 7f9655cec700 1 -- 172.21.15.133:0/2460238848 wait complete. 2024-01-21T20:12:00.502 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:12:00.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:11:56.409183+0000', 'modified': '2024-01-21T20:11:58.414842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5838}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5838': {'gid': 5838, 'name': 'c', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/715878707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 715878707}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 715878707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:12:00.916 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:12:00.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-21T20:12:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.043+0000 7f299f395700 1 Processor -- start 2024-01-21T20:12:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.043+0000 7f299f395700 1 -- start start 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f299813b970 0x7f29980c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29980c39f0 0x7f29980be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 0x7f29980c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980bfa40 con 0x7f299813b970 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980c3e70 con 0x7f29980c39f0 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299f395700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980bee30 con 0x7f29980be5f0 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299d131700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f299813b970 0x7f29980c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.044+0000 7f299d131700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f299813b970 0x7f29980c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34504/0 (socket says 172.21.15.133:34504) 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 -- 172.21.15.133:0/3596542470 learned_addr learned my addr 172.21.15.133:0/3596542470 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299c930700 1 --2- 172.21.15.133:0/3596542470 >> v2:172.21.15.178:3300/0 conn(0x7f29980c39f0 0x7f29980be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d932700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 0x7f29980c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 -- 172.21.15.133:0/3596542470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 msgr2=0x7f29980c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 0x7f29980c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 -- 172.21.15.133:0/3596542470 >> v2:172.21.15.178:3300/0 conn(0x7f29980c39f0 msgr2=0x7f29980be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 --2- 172.21.15.133:0/3596542470 >> v2:172.21.15.178:3300/0 conn(0x7f29980c39f0 0x7f29980be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 -- 172.21.15.133:0/3596542470 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980bf110 con 0x7f299813b970 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d932700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 0x7f29980c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f299d131700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299813b970 0x7f29980c3500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f29980c8ed0 tx=0x7f29940090f0).ready entity=mon.0 client_cookie=f70d12db1a71124 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f298bfff700 1 -- 172.21.15.133:0/3596542470 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400b520 con 0x7f299813b970 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f298bfff700 1 -- 172.21.15.133:0/3596542470 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400b680 con 0x7f299813b970 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.045+0000 7f298bfff700 1 -- 172.21.15.133:0/3596542470 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400ba20 con 0x7f299813b970 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 -- 172.21.15.133:0/3596542470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299813b970 msgr2=0x7f29980c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299813b970 0x7f29980c3500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f29980c8ed0 tx=0x7f29940090f0).stop 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 -- 172.21.15.133:0/3596542470 shutdown_connections 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29980be5f0 0x7f29980c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 --2- 172.21.15.133:0/3596542470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299813b970 0x7f29980c3500 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 --2- 172.21.15.133:0/3596542470 >> v2:172.21.15.178:3300/0 conn(0x7f29980c39f0 0x7f29980be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 -- 172.21.15.133:0/3596542470 >> 172.21.15.133:0/3596542470 conn(0x7f2998066a70 msgr2=0x7f2998066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 -- 172.21.15.133:0/3596542470 shutdown_connections 2024-01-21T20:12:01.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.046+0000 7f299f395700 1 -- 172.21.15.133:0/3596542470 wait complete. 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.047+0000 7f299f395700 1 Processor -- start 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.047+0000 7f299f395700 1 -- start start 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 0x7f29981384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f299813b970 0x7f29981389a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981537d0 con 0x7f29980be5f0 2024-01-21T20:12:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998156670 con 0x7f29980c39f0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299f395700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2998153210 con 0x7f299813b970 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299d131700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299d131700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34516/0 (socket says 172.21.15.133:34516) 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.048+0000 7f299d131700 1 -- 172.21.15.133:0/3742603312 learned_addr learned my addr 172.21.15.133:0/3742603312 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d932700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f299813b970 0x7f29981389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299c930700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 0x7f29981384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 -- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f299813b970 msgr2=0x7f29981389a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f299813b970 0x7f29981389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 -- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 msgr2=0x7f29981384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 0x7f29981384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 -- 172.21.15.133:0/3742603312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994009370 con 0x7f29980be5f0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299c930700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 0x7f29981384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299d131700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f2994006fd0 tx=0x7f2994017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f2989ffb700 1 -- 172.21.15.133:0/3742603312 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994000bc0 con 0x7f29980be5f0 2024-01-21T20:12:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f2989ffb700 1 -- 172.21.15.133:0/3742603312 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400b7f0 con 0x7f29980be5f0 2024-01-21T20:12:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29981534f0 con 0x7f29980be5f0 2024-01-21T20:12:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f2989ffb700 1 -- 172.21.15.133:0/3742603312 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994000d20 con 0x7f29980be5f0 2024-01-21T20:12:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.049+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980c7e10 con 0x7f29980be5f0 2024-01-21T20:12:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.050+0000 7f2989ffb700 1 -- 172.21.15.133:0/3742603312 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f299401d640 con 0x7f29980be5f0 2024-01-21T20:12:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.051+0000 7f2989ffb700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 0x7f297c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.051+0000 7f2989ffb700 1 -- 172.21.15.133:0/3742603312 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f299407be90 con 0x7f29980be5f0 2024-01-21T20:12:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.051+0000 7f299c930700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 0x7f297c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.051+0000 7f299c930700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 0x7f297c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f298c006d80 tx=0x7f298c008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.053+0000 7f29b0d38b80 1 Processor -- start 2024-01-21T20:12:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.053+0000 7f29b0d38b80 1 -- start start 2024-01-21T20:12:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad115a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad111270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad08c3d0 con 0x55d2ad15e2c0 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad051be0 con 0x55d2ad110df0 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad067260 con 0x55d2ad115620 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34518/0 (socket says 172.21.15.133:34518) 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f299c930700 1 -- 172.21.15.133:0/1281480027 learned_addr learned my addr 172.21.15.133:0/1281480027 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f299d131700 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad115a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.054+0000 7f299d932700 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad111270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 -- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 msgr2=0x55d2ad115a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad115a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 -- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 msgr2=0x55d2ad111270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad111270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 -- 172.21.15.133:0/1281480027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2ad0602f0 con 0x55d2ad15e2c0 2024-01-21T20:12:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.055+0000 7f299c930700 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f298c010890 tx=0x7f298c015000).ready entity=mon.0 client_cookie=29070f5078e14c27 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.056+0000 7f2982ffd700 1 -- 172.21.15.133:0/1281480027 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0147f0 con 0x55d2ad15e2c0 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.056+0000 7f2982ffd700 1 -- 172.21.15.133:0/1281480027 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c014950 con 0x55d2ad15e2c0 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.056+0000 7f2982ffd700 1 -- 172.21.15.133:0/1281480027 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c014cd0 con 0x55d2ad15e2c0 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- 172.21.15.133:0/1281480027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 msgr2=0x55d2ad110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f298c010890 tx=0x7f298c015000).stop 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- 172.21.15.133:0/1281480027 shutdown_connections 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad111270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad115a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/1281480027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad15e2c0 0x55d2ad110900 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- 172.21.15.133:0/1281480027 >> 172.21.15.133:0/1281480027 conn(0x55d2acf7e2e0 msgr2=0x55d2ad15e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- 172.21.15.133:0/1281480027 shutdown_connections 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- 172.21.15.133:0/1281480027 wait complete. 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 -- start start 2024-01-21T20:12:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.057+0000 7f29b0d38b80 1 Processor -- start 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad143370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad15e2c0 0x55d2ad157220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad0673a0 con 0x55d2ad115620 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad067620 con 0x55d2ad110df0 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad032990 con 0x55d2ad15e2c0 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f29b0d38b80 10 client.0 ll_register_callbacks cb 0x55d2ad0d5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34526/0 (socket says 172.21.15.133:34526) 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.058+0000 7f299c930700 1 -- 172.21.15.133:0/759683183 learned_addr learned my addr 172.21.15.133:0/759683183 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299d131700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299d932700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad15e2c0 0x55d2ad157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 -- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad15e2c0 msgr2=0x55d2ad157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad15e2c0 0x55d2ad157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 -- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 msgr2=0x55d2ad143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 -- 172.21.15.133:0/759683183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c00e030 con 0x55d2ad115620 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299d131700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f299c930700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f298c022040 tx=0x7f298c01f000).ready entity=mon.0 client_cookie=1f741c7a02230b2e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c0147f0 con 0x55d2ad115620 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f298c01fdf0 con 0x55d2ad115620 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2ad10fdf0 con 0x55d2ad115620 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f298c029650 con 0x55d2ad115620 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 10 client.5985 fetch_fsmap learned FSMap version 18 2024-01-21T20:12:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55d2ad05b520 con 0x55d2ad115620 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2ad10fdf0 con 0x55d2ad115620 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f298c0297b0 con 0x55d2ad115620 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 10 client.5985 fetch_fsmap finished waiting for FSMap version 18 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 10 client.5985 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 20 client.5985 populate_metadata read hostname 'smithi133' 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad1612b0 0x55d2ad161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 4 client.5985 mds_command: new command op to 5838 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.059+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 --> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2ad05cd60 con 0x55d2ad1612b0 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f299d131700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad1612b0 0x55d2ad161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f299d131700 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad1612b0 0x55d2ad161690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8e155370fbdf4ef3 server_cookie=bea1a5dd529d1b42 in_seq=0 out_seq=0 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f2977fff700 10 client.5985 ms_handle_connect on v2:172.21.15.133:6835/715878707 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f2977fff700 1 -- 172.21.15.133:0/759683183 <== mds.0 v2:172.21.15.133:6835/715878707 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55d2ad05cd60 con 0x55d2ad1612b0 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f2977fff700 10 client.5985 handle_command_reply: tid=0 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f29b0d38b80 1 client.5985 shutdown 2024-01-21T20:12:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 msgr2=0x55d2ad1116d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.060+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f298c022040 tx=0x7f298c01f000).stop 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 shutdown_connections 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad1612b0 0x55d2ad161690 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad15e2c0 0x55d2ad157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad110df0 0x55d2ad143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f2977fff700 0 client.5985 ms_handle_reset on v2:172.21.15.133:6835/715878707 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/759683183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1116d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 >> 172.21.15.133:0/759683183 conn(0x55d2acf7e2e0 msgr2=0x55d2ad115a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 shutdown_connections 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 1 -- 172.21.15.133:0/759683183 wait complete. 2024-01-21T20:12:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.061+0000 7f29b0d38b80 20 client.5985 trim_cache size 0 max 16384 2024-01-21T20:12:01.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.077+0000 7f29b0d38b80 1 Processor -- start 2024-01-21T20:12:01.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.077+0000 7f29b0d38b80 1 -- start start 2024-01-21T20:12:01.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad16cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad143d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad116e60 con 0x55d2ad110df0 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad160880 con 0x55d2ad15e2c0 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad110af0 con 0x55d2ad115620 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34542/0 (socket says 172.21.15.133:34542) 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 -- 172.21.15.133:0/3700611383 learned_addr learned my addr 172.21.15.133:0/3700611383 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 -- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 msgr2=0x55d2ad16cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad16cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 -- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 msgr2=0x55d2ad143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.078+0000 7f299d131700 1 -- 172.21.15.133:0/3700611383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2ad05b270 con 0x55d2ad110df0 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f299d131700 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f299400b5d0 tx=0x7f2994028040).ready entity=mon.0 client_cookie=99e5a1fdfe4836d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29837fe700 1 -- 172.21.15.133:0/3700611383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994034070 con 0x55d2ad110df0 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29837fe700 1 -- 172.21.15.133:0/3700611383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299404ecd0 con 0x55d2ad110df0 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29837fe700 1 -- 172.21.15.133:0/3700611383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994079a30 con 0x55d2ad110df0 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 -- 172.21.15.133:0/3700611383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 msgr2=0x55d2ad16ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f299400b5d0 tx=0x7f2994028040).stop 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 -- 172.21.15.133:0/3700611383 shutdown_connections 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad110df0 0x55d2ad16ca30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/3700611383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad115620 0x55d2ad16cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 -- 172.21.15.133:0/3700611383 >> 172.21.15.133:0/3700611383 conn(0x55d2acf7e2e0 msgr2=0x55d2ad156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 -- 172.21.15.133:0/3700611383 shutdown_connections 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.079+0000 7f29b0d38b80 1 -- 172.21.15.133:0/3700611383 wait complete. 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.080+0000 7f29b0d38b80 1 -- start start 2024-01-21T20:12:01.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.080+0000 7f29b0d38b80 1 Processor -- start 2024-01-21T20:12:01.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 0x55d2ad15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad1407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad15b060 con 0x55d2ad115620 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad1b9db0 con 0x55d2ad15e2c0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d2ad1c0490 con 0x55d2ad110df0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f29b0d38b80 10 client.0 ll_register_callbacks cb 0x55d2ad0d5610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34554/0 (socket says 172.21.15.133:34554) 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 -- 172.21.15.133:0/2798297137 learned_addr learned my addr 172.21.15.133:0/2798297137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299d131700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 0x55d2ad15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299d932700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad1407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 -- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 msgr2=0x55d2ad15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 0x55d2ad15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 -- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 msgr2=0x55d2ad1407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad1407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 -- 172.21.15.133:0/2798297137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29980c7e10 con 0x55d2ad115620 2024-01-21T20:12:01.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299d131700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 0x55d2ad15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299d932700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad1407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f299c930700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f298c0091e0 tx=0x7f298c028000).ready entity=mon.0 client_cookie=ab8a6229663fa1f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.081+0000 7f2977fff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c01f610 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f298c014410 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f298c014950 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f298c0147e0 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 10 client.5991 fetch_fsmap learned FSMap version 18 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55d2aced4f80 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c014950 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f298c041320 con 0x55d2ad115620 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 10 client.5991 fetch_fsmap finished waiting for FSMap version 18 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 10 client.5991 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:12:01.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 20 client.5991 populate_metadata read hostname 'smithi133' 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad143d00 0x55d2ad1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 4 client.5991 mds_command: new command op to 5838 tid=0[{"prefix": "status"}] 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 --> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d2ad0537d0 con 0x55d2ad143d00 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f299d131700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad143d00 0x55d2ad1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f2977fff700 10 client.5991 ms_handle_connect on v2:172.21.15.133:6835/715878707 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.082+0000 7f299d131700 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad143d00 0x55d2ad1440e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fdae4e618682e66 server_cookie=e6b66710077ab96a in_seq=0 out_seq=0 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f2977fff700 1 -- 172.21.15.133:0/2798297137 <== mds.0 v2:172.21.15.133:6835/715878707 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55d2ad0537d0 con 0x55d2ad143d00 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f2977fff700 10 client.5991 handle_command_reply: tid=0 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 client.5991 shutdown 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 msgr2=0x55d2ad1b98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f298c0091e0 tx=0x7f298c028000).stop 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 shutdown_connections 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:6835/715878707,v1:172.21.15.133:6837/715878707] conn(0x55d2ad143d00 0x55d2ad1440e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d2ad15e2c0 0x55d2ad1407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d2ad110df0 0x55d2ad15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f2977fff700 0 client.5991 ms_handle_reset on v2:172.21.15.133:6835/715878707 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 --2- 172.21.15.133:0/2798297137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d2ad115620 0x55d2ad1b98c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 >> 172.21.15.133:0/2798297137 conn(0x55d2acf7e2e0 msgr2=0x55d2ad156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 shutdown_connections 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 1 -- 172.21.15.133:0/2798297137 wait complete. 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f29b0d38b80 20 client.5991 trim_cache size 0 max 16384 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5838, 2024-01-21T20:12:01.080 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 4.673762354, 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 18, 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 62, 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 62, 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 10.061854769 2024-01-21T20:12:01.081 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 msgr2=0x7f297c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 0x7f297c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f298c006d80 tx=0x7f298c008040).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 msgr2=0x7f2998137f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.083+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f2994006fd0 tx=0x7f2994017000).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 shutdown_connections 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f297c05f150 0x7f297c061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f299813b970 0x7f29981389a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29980be5f0 0x7f2998137f20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 --2- 172.21.15.133:0/3742603312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29980c39f0 0x7f29981384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 >> 172.21.15.133:0/3742603312 conn(0x7f2998066a70 msgr2=0x7f299813a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 shutdown_connections 2024-01-21T20:12:01.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.084+0000 7f299f395700 1 -- 172.21.15.133:0/3742603312 wait complete. 2024-01-21T20:12:01.086 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:12:01.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.197+0000 7fe7e4bc6700 1 Processor -- start 2024-01-21T20:12:01.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.197+0000 7fe7e4bc6700 1 -- start start 2024-01-21T20:12:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.198+0000 7fe7e4bc6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e0063430 0x7fe7e0154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.198+0000 7fe7e4bc6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7e00bde30 0x7fe7e00be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.198+0000 7fe7e4bc6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e0155530 con 0x7fe7e0153e90 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.198+0000 7fe7e4bc6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00c5f20 con 0x7fe7e00bde30 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.198+0000 7fe7e4bc6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00be780 con 0x7fe7e0063430 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7e00bde30 0x7fe7e00be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7e00bde30 0x7fe7e00be290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34570/0 (socket says 172.21.15.133:34570) 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 -- 172.21.15.133:0/2067843644 learned_addr learned my addr 172.21.15.133:0/2067843644 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ddd9b700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e0063430 0x7fe7e0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 -- 172.21.15.133:0/2067843644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e0063430 msgr2=0x7fe7e0154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e0063430 0x7fe7e0154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 -- 172.21.15.133:0/2067843644 >> v1:172.21.15.178:6789/0 conn(0x7fe7e0153e90 legacy=0x7fe7e00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 -- 172.21.15.133:0/2067843644 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e0154920 con 0x7fe7e00bde30 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7ded9d700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e00bde30 0x7fe7e00be290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe7d8009f20 tx=0x7fe7d8009840).ready entity=mon.0 client_cookie=73a3c3ce3a8e9b3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7dd59a700 1 -- 172.21.15.133:0/2067843644 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800e070 con 0x7fe7e00bde30 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7dd59a700 1 -- 172.21.15.133:0/2067843644 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800ba80 con 0x7fe7e00bde30 2024-01-21T20:12:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.199+0000 7fe7dd59a700 1 -- 172.21.15.133:0/2067843644 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800be00 con 0x7fe7e00bde30 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/2067843644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e00bde30 msgr2=0x7fe7e00be290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e00bde30 0x7fe7e00be290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fe7d8009f20 tx=0x7fe7d8009840).stop 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/2067843644 shutdown_connections 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e00bde30 0x7fe7e00be290 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/2067843644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e0063430 0x7fe7e0154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/2067843644 >> 172.21.15.133:0/2067843644 conn(0x7fe7e00c7cb0 msgr2=0x7fe7e00c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/2067843644 shutdown_connections 2024-01-21T20:12:01.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.200+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/2067843644 wait complete. 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.201+0000 7fe7e4bc6700 1 Processor -- start 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.201+0000 7fe7e4bc6700 1 -- start start 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e00bde30 0x7fe7e00a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7e0153e90 0x7fe7e0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0165080 con 0x7fe7e0152030 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00a8710 con 0x7fe7e0153e90 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7e4bc6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0164a30 con 0x7fe7e00bde30 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34582/0 (socket says 172.21.15.133:34582) 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 -- 172.21.15.133:0/3957147029 learned_addr learned my addr 172.21.15.133:0/3957147029 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ddd9b700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7e0153e90 0x7fe7e0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7de59c700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e00bde30 0x7fe7e00a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 -- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e00bde30 msgr2=0x7fe7e00a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e00bde30 0x7fe7e00a7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 -- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7e0153e90 msgr2=0x7fe7e0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7e0153e90 0x7fe7e0151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.202+0000 7fe7ded9d700 1 -- 172.21.15.133:0/3957147029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009ae0 con 0x7fe7e0152030 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7ded9d700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fe7e0068a00 tx=0x7fe7d8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8013e90 con 0x7fe7e0152030 2024-01-21T20:12:01.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d80092e0 con 0x7fe7e0152030 2024-01-21T20:12:01.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e0164d10 con 0x7fe7e0152030 2024-01-21T20:12:01.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d801e6c0 con 0x7fe7e0152030 2024-01-21T20:12:01.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.203+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00a83b0 con 0x7fe7e0152030 2024-01-21T20:12:01.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.204+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e00c5a00 con 0x7fe7e0152030 2024-01-21T20:12:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.204+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe7d8003040 con 0x7fe7e0152030 2024-01-21T20:12:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.204+0000 7fe7ceffd700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 0x7fe7c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.205+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7fe7d807b960 con 0x7fe7e0152030 2024-01-21T20:12:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.205+0000 7fe7de59c700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 0x7fe7c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:01.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.205+0000 7fe7de59c700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 0x7fe7c0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe7e00c37f0 tx=0x7fe7d0009040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:01.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.209+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe7e00c5a00 con 0x7fe7e0152030 2024-01-21T20:12:01.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.415+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe7e00c5a00 con 0x7fe7e0152030 2024-01-21T20:12:01.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.415+0000 7fe7ceffd700 1 -- 172.21.15.133:0/3957147029 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe7e00c5a00 con 0x7fe7e0152030 2024-01-21T20:12:01.406 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 msgr2=0x7fe7c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 0x7fe7c0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe7e00c37f0 tx=0x7fe7d0009040).stop 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 msgr2=0x7fe7e014f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fe7e0068a00 tx=0x7fe7d8009840).stop 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 shutdown_connections 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe7c005f150 0x7fe7c0061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7e0152030 0x7fe7e014f420 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7e00bde30 0x7fe7e00a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 --2- 172.21.15.133:0/3957147029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7e0153e90 0x7fe7e0151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:01.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 >> 172.21.15.133:0/3957147029 conn(0x7fe7e00c7cb0 msgr2=0x7fe7e0152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:01.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 shutdown_connections 2024-01-21T20:12:01.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:01.417+0000 7fe7e4bc6700 1 -- 172.21.15.133:0/3957147029 wait complete. 2024-01-21T20:12:01.418 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:12:01.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:12:01.419 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:12:01.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.419 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:12:01.437 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41610sec preferred_lft 41610sec 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.438 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:12:01.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.439 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:12:01.440 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:12:01.447+0000 7fefa66fe700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:12:01.465 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:12:01.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.466 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:12:01.525 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:12:01.525 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:12:01.525 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:12:01.526 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:12:01.526 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:12:01.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:12:01.526 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:12:01.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.631 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:12:01.647 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:12:01.647 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:12:01.648 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:12:01.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.648 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:12:01.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.714 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:12:01.771 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:12:01.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:12:01.852 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:12:01.852 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:12:01.874 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:12:01.874 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:12:01.876 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:12:01.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:12:01.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:12:01.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:12:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.112+0000 7f046643e700 1 Processor -- start 2024-01-21T20:12:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.112+0000 7f046643e700 1 -- start start 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f046643e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0460062e00 0x7f04600a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f046643e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f046013aa00 0x7f0460158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f046643e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04601584f0 con 0x7f046013a620 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f046643e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04600bd6f0 con 0x7f046013aa00 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f046643e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04600654e0 con 0x7f0460062e00 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f04649db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f046013aa00 0x7f0460158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f04649db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f046013aa00 0x7f0460158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34588/0 (socket says 172.21.15.133:34588) 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.113+0000 7f04649db700 1 -- 172.21.15.133:0/2744773152 learned_addr learned my addr 172.21.15.133:0/2744773152 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f045f7fe700 1 --2- 172.21.15.133:0/2744773152 >> v2:172.21.15.178:3300/0 conn(0x7f0460062e00 0x7f04600a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f04649db700 1 -- 172.21.15.133:0/2744773152 >> v2:172.21.15.178:3300/0 conn(0x7f0460062e00 msgr2=0x7f04600a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f04649db700 1 --2- 172.21.15.133:0/2744773152 >> v2:172.21.15.178:3300/0 conn(0x7f0460062e00 0x7f04600a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f04649db700 1 -- 172.21.15.133:0/2744773152 >> v1:172.21.15.178:6789/0 conn(0x7f046013a620 legacy=0x7f04600626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f04649db700 1 -- 172.21.15.133:0/2744773152 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460158730 con 0x7f046013aa00 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f04649db700 1 --2- 172.21.15.133:0/2744773152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460158000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f046013e3f0 tx=0x7f0458009840).ready entity=mon.0 client_cookie=baed7f1390b08311 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f045effd700 1 -- 172.21.15.133:0/2744773152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800e070 con 0x7f046013aa00 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f045effd700 1 -- 172.21.15.133:0/2744773152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800ba10 con 0x7f046013aa00 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f045effd700 1 -- 172.21.15.133:0/2744773152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800bd90 con 0x7f046013aa00 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 -- 172.21.15.133:0/2744773152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 msgr2=0x7f0460158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 --2- 172.21.15.133:0/2744773152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460158000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f046013e3f0 tx=0x7f0458009840).stop 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 -- 172.21.15.133:0/2744773152 shutdown_connections 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 --2- 172.21.15.133:0/2744773152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460158000 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 --2- 172.21.15.133:0/2744773152 >> v2:172.21.15.178:3300/0 conn(0x7f0460062e00 0x7f04600a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.114+0000 7f046643e700 1 -- 172.21.15.133:0/2744773152 >> 172.21.15.133:0/2744773152 conn(0x7f04600c7dc0 msgr2=0x7f04600c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.115+0000 7f046643e700 1 -- 172.21.15.133:0/2744773152 shutdown_connections 2024-01-21T20:12:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.115+0000 7f046643e700 1 -- 172.21.15.133:0/2744773152 wait complete. 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.116+0000 7f046643e700 1 Processor -- start 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.116+0000 7f046643e700 1 -- start start 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 0x7f04600aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 0x7f0460156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460139e60 con 0x7f046013aa00 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04600acf40 con 0x7f046013a620 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f046643e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04600ac610 con 0x7f0460062e00 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f04649db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f04649db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34602/0 (socket says 172.21.15.133:34602) 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.117+0000 7f04649db700 1 -- 172.21.15.133:0/822621713 learned_addr learned my addr 172.21.15.133:0/822621713 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:02.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045f7fe700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 0x7f0460156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045ffff700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 0x7f04600aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 -- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 msgr2=0x7f04600aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 0x7f04600aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 -- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 msgr2=0x7f0460156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 0x7f0460156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 -- 172.21.15.133:0/822621713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0458009ae0 con 0x7f046013aa00 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045f7fe700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 0x7f0460156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045ffff700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 0x7f04600aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f04649db700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0458009540 tx=0x7f0458009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04580092e0 con 0x7f046013aa00 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045801e470 con 0x7f046013aa00 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045801e830 con 0x7f046013aa00 2024-01-21T20:12:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04600ac8f0 con 0x7f046013aa00 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.118+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0460156fa0 con 0x7f046013aa00 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.119+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04600ad0d0 con 0x7f046013aa00 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.119+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0458003040 con 0x7f046013aa00 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.120+0000 7f045cff9700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 0x7f044c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.120+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f045807b950 con 0x7f046013aa00 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.120+0000 7f045ffff700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 0x7f044c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.120+0000 7f045ffff700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 0x7f044c061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f045400a8a0 tx=0x7f0454008040).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.124+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f045804c9f0 con 0x7f046013aa00 2024-01-21T20:12:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.312+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f04601584f0 con 0x7f044c05f150 2024-01-21T20:12:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.314+0000 7f045cff9700 1 -- 172.21.15.133:0/822621713 <== mgr.5655 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f04601584f0 con 0x7f044c05f150 2024-01-21T20:12:02.304 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:12:02.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:12:02.304 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:12:02.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:12:02.305 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 msgr2=0x7f044c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 0x7f044c061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f045400a8a0 tx=0x7f0454008040).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 msgr2=0x7f0460139610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0458009540 tx=0x7f0458009840).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 shutdown_connections 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044c05f150 0x7f044c061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f046013aa00 0x7f0460139610 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0460062e00 0x7f04600aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 --2- 172.21.15.133:0/822621713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f046013a620 0x7f0460156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 >> 172.21.15.133:0/822621713 conn(0x7f04600c7dc0 msgr2=0x7f0460157870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 shutdown_connections 2024-01-21T20:12:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.316+0000 7f046643e700 1 -- 172.21.15.133:0/822621713 wait complete. 2024-01-21T20:12:02.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:12:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.445+0000 7f3af7a2f700 1 Processor -- start 2024-01-21T20:12:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.445+0000 7f3af7a2f700 1 -- start start 2024-01-21T20:12:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af7a2f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af7a2f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3af00c5dc0 0x7f3af013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af7a2f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af0067f10 con 0x7f3af00c6220 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af7a2f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00681f0 con 0x7f3af00c5dc0 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af7a2f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00684d0 con 0x7f3af00c3840 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af5fcc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3af00c6220 0x7f3af0157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40764/0 (socket says 172.21.15.133:40764) 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.446+0000 7f3af5fcc700 1 -- 172.21.15.133:0/3470481078 learned_addr learned my addr 172.21.15.133:0/3470481078 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322584841 0 0) 0x7f3af0067f10 con 0x7f3af00c6220 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 --2- 172.21.15.133:0/3470481078 >> v2:172.21.15.178:3300/0 conn(0x7f3af00c5dc0 0x7f3af013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af57cb700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3adc0033f0 con 0x7f3af00c6220 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304688840 0 0) 0x7f3adc0033f0 con 0x7f3af00c6220 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 msgr2=0x7f3af00c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af00c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 >> v2:172.21.15.178:3300/0 conn(0x7f3af00c5dc0 msgr2=0x7f3af013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 --2- 172.21.15.133:0/3470481078 >> v2:172.21.15.178:3300/0 conn(0x7f3af00c5dc0 0x7f3af013a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00687b0 con 0x7f3af00c6220 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3ae80017f0 con 0x7f3af00c6220 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 >> v1:172.21.15.133:6789/0 conn(0x7f3af00c6220 legacy=0x7f3af0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0038e0 0x7f3adc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3adc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc004b80 0x7f3adc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00681f0 con 0x7f3adc004b80 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00684d0 con 0x7f3adc0038e0 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc00b8e0 con 0x7f3af00c3840 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af57cb700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0038e0 0x7f3adc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3adc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af5fcc700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc004b80 0x7f3adc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 -- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0038e0 msgr2=0x7f3adc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0038e0 0x7f3adc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 -- 172.21.15.133:0/3470481078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc004b80 msgr2=0x7f3adc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc004b80 0x7f3adc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af4fca700 1 -- 172.21.15.133:0/3470481078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc0033f0 con 0x7f3af00c3840 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af5fcc700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc004b80 0x7f3adc005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.447+0000 7f3af57cb700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0038e0 0x7f3adc003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af4fca700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3adc004690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3af006a220 tx=0x7f3aec009060).ready entity=mon.2 client_cookie=785b10cee3ee8c89 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec009e90 con 0x7f3af00c3840 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec009430 con 0x7f3af00c3840 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3ae7fff700 1 -- 172.21.15.133:0/3470481078 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00e850 con 0x7f3af00c3840 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 -- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 msgr2=0x7f3adc004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/3470481078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3adc004690 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3af006a220 tx=0x7f3aec009060).stop 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af5fcc700 1 -- 172.21.15.133:0/3470481078 reap_dead start 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 -- 172.21.15.133:0/3470481078 shutdown_connections 2024-01-21T20:12:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 -- 172.21.15.133:0/3470481078 >> 172.21.15.133:0/3470481078 conn(0x7f3af0066a70 msgr2=0x7f3af0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 -- 172.21.15.133:0/3470481078 shutdown_connections 2024-01-21T20:12:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.448+0000 7f3af7a2f700 1 -- 172.21.15.133:0/3470481078 wait complete. 2024-01-21T20:12:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.450+0000 7f3af7a2f700 1 Processor -- start 2024-01-21T20:12:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.450+0000 7f3af7a2f700 1 -- start start 2024-01-21T20:12:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.450+0000 7f3af7a2f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af0164930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af01392f0 0x7f3af0139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af01545d0 con 0x7f3af00c1220 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0139c60 con 0x7f3af01392f0 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00ac0f0 con 0x7f3af00c3840 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34618/0 (socket says 172.21.15.133:34618) 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 -- 172.21.15.133:0/148420474 learned_addr learned my addr 172.21.15.133:0/148420474 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af4fca700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af01392f0 0x7f3af0139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af57cb700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af0164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 -- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 msgr2=0x7f3af0164930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af0164930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 -- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af01392f0 msgr2=0x7f3af0139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af01392f0 0x7f3af0139770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 -- 172.21.15.133:0/148420474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00c1f80 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af5fcc700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f3ae8000f80 tx=0x7f3af01548e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8001800 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae800c7b0 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af00c2260 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.451+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800cb70 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.452+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af00c2820 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 14) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3ae801d450 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af00ac420 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3ae5ffb700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 0x7f3ad4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f3ae807a040 con 0x7f3af00c1220 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3af57cb700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 0x7f3ad4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.453+0000 7f3af57cb700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 0x7f3ad4061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3ae0006d80 tx=0x7f3ae0009060).ready entity=mgr.5655 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.457+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ae804b080 con 0x7f3af00c1220 2024-01-21T20:12:02.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:02.665+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3af005fdf0 con 0x7f3af00c1220 2024-01-21T20:12:03.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.064+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f3ae8077be0 con 0x7f3af00c1220 2024-01-21T20:12:03.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.065+0000 7f3ae5ffb700 1 -- 172.21.15.133:0/148420474 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v15) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3ae80770c0 con 0x7f3af00c1220 2024-01-21T20:12:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 msgr2=0x7f3ad4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 0x7f3ad4061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3ae0006d80 tx=0x7f3ae0009060).stop 2024-01-21T20:12:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 msgr2=0x7f3af00c1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f3ae8000f80 tx=0x7f3af01548e0).stop 2024-01-21T20:12:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 shutdown_connections 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3ad405f150 0x7f3ad4061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af00c1220 0x7f3af00c1680 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af00c3840 0x7f3af0164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 --2- 172.21.15.133:0/148420474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af01392f0 0x7f3af0139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.067+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 >> 172.21.15.133:0/148420474 conn(0x7f3af0066a70 msgr2=0x7f3af00c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.068+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 shutdown_connections 2024-01-21T20:12:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.068+0000 7f3af7a2f700 1 -- 172.21.15.133:0/148420474 wait complete. 2024-01-21T20:12:03.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:12:03.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.206+0000 7f3c96b54700 1 Processor -- start 2024-01-21T20:12:03.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.206+0000 7f3c96b54700 1 -- start start 2024-01-21T20:12:03.198 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:03.207+0000 7f9de4b4a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c96b54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c90067d90 0x7f3c90137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c96b54700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c96b54700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900c6290 con 0x7f3c90137030 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c96b54700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c90068370 con 0x7f3c90067d90 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c96b54700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90068650 con 0x7f3c900c5930 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c8ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c90067d90 0x7f3c90137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c8ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c90067d90 0x7f3c90137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34642/0 (socket says 172.21.15.133:34642) 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c948f0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3c90137030 0x7f3c90155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40792/0 (socket says 172.21.15.133:40792) 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c8ffff700 1 -- 172.21.15.133:0/1138617093 learned_addr learned my addr 172.21.15.133:0/1138617093 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.207+0000 7f3c950f1700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8f7fe700 1 -- 172.21.15.133:0/1138617093 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138825564 0 0) 0x7f3c900c6290 con 0x7f3c90137030 2024-01-21T20:12:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8f7fe700 1 -- 172.21.15.133:0/1138617093 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c800033f0 con 0x7f3c90137030 2024-01-21T20:12:03.200 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f92321d8680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8ffff700 1 -- 172.21.15.133:0/1138617093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 msgr2=0x7f3c900c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8ffff700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8ffff700 1 -- 172.21.15.133:0/1138617093 >> v1:172.21.15.133:6789/0 conn(0x7f3c90137030 legacy=0x7f3c90155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8ffff700 1 -- 172.21.15.133:0/1138617093 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90068930 con 0x7f3c90067d90 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8ffff700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90067d90 0x7f3c90137410 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f3c7c006fd0 tx=0x7f3c7c0090f0).ready entity=mon.0 client_cookie=20f5543111000e45 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8f7fe700 1 -- 172.21.15.133:0/1138617093 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00f510 con 0x7f3c90067d90 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8f7fe700 1 -- 172.21.15.133:0/1138617093 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c00f670 con 0x7f3c90067d90 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c8f7fe700 1 -- 172.21.15.133:0/1138617093 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00fa10 con 0x7f3c90067d90 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 -- 172.21.15.133:0/1138617093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90067d90 msgr2=0x7f3c90137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90067d90 0x7f3c90137410 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f3c7c006fd0 tx=0x7f3c7c0090f0).stop 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 -- 172.21.15.133:0/1138617093 shutdown_connections 2024-01-21T20:12:03.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 --2- 172.21.15.133:0/1138617093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90067d90 0x7f3c90137410 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.208+0000 7f3c96b54700 1 -- 172.21.15.133:0/1138617093 >> 172.21.15.133:0/1138617093 conn(0x7f3c90066a90 msgr2=0x7f3c90066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.209+0000 7f3c96b54700 1 -- 172.21.15.133:0/1138617093 shutdown_connections 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.209+0000 7f3c96b54700 1 -- 172.21.15.133:0/1138617093 wait complete. 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.210+0000 7f3c96b54700 1 Processor -- start 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.210+0000 7f3c96b54700 1 -- start start 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90067d90 0x7f3c9014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900adf50 con 0x7f3c90137030 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90156cb0 con 0x7f3c90067d90 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c96b54700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900ad620 con 0x7f3c900c5930 2024-01-21T20:12:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34646/0 (socket says 172.21.15.133:34646) 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 -- 172.21.15.133:0/4084141246 learned_addr learned my addr 172.21.15.133:0/4084141246 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c948f0700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90067d90 0x7f3c9014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c8ffff700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 -- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 msgr2=0x7f3c900ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 -- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90067d90 msgr2=0x7f3c9014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90067d90 0x7f3c9014dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 -- 172.21.15.133:0/4084141246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c009370 con 0x7f3c90137030 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c950f1700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f3c88009df0 tx=0x7f3c8800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.211+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800caa0 con 0x7f3c90137030 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.212+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800f040 con 0x7f3c90137030 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.212+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800ce10 con 0x7f3c90137030 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.212+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900ad900 con 0x7f3c90137030 2024-01-21T20:12:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.212+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900ae8d0 con 0x7f3c90137030 2024-01-21T20:12:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.213+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900ae0c0 con 0x7f3c90137030 2024-01-21T20:12:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.213+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f3c88013610 con 0x7f3c90137030 2024-01-21T20:12:03.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.214+0000 7f3c8d7fa700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 0x7f3c74061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.214+0000 7f3c948f0700 1 -- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 msgr2=0x7f3c74061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:03.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.214+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f3c8807ac40 con 0x7f3c90137030 2024-01-21T20:12:03.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.214+0000 7f3c948f0700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 0x7f3c74061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:12:03.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.218+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c8804bc20 con 0x7f3c90137030 2024-01-21T20:12:03.261 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:03.271+0000 7f9de4b4a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:12:03.265 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:03.274+0000 7f92321d8680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:12:03.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.390+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3c9005fdf0 con 0x7f3c90137030 2024-01-21T20:12:03.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.393+0000 7f3c8d7fa700 1 -- 172.21.15.133:0/4084141246 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v7)=0 v7) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3c8804f240 con 0x7f3c90137030 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 msgr2=0x7f3c74061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 0x7f3c74061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 msgr2=0x7f3c90156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f3c88009df0 tx=0x7f3c8800b040).stop 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 shutdown_connections 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c7405f1a0 0x7f3c74061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:03.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c90137030 0x7f3c90156480 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c90067d90 0x7f3c9014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 --2- 172.21.15.133:0/4084141246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c900c5930 0x7f3c900ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 >> 172.21.15.133:0/4084141246 conn(0x7f3c90066a90 msgr2=0x7f3c90155240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:03.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 shutdown_connections 2024-01-21T20:12:03.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.395+0000 7f3c96b54700 1 -- 172.21.15.133:0/4084141246 wait complete. 2024-01-21T20:12:03.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:03.399 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T20:12:03.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2024-01-21T20:12:03.535 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:03.544+0000 7f9de4b4a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:12:03.550 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:03.560+0000 7f92321d8680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:12:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.593+0000 7fb5d7477700 1 Processor -- start 2024-01-21T20:12:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 -- start start 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d005e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d00c9040 con 0x7fb5d014ecb0 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d00c13a0 con 0x7fb5d00c0a70 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.594+0000 7fb5d7477700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d00c9290 con 0x7fb5d014e8d0 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d4a12700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5d014ecb0 0x7fb5d0155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40808/0 (socket says 172.21.15.133:40808) 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34658/0 (socket says 172.21.15.133:34658) 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d4a12700 1 -- 172.21.15.133:0/947956951 learned_addr learned my addr 172.21.15.133:0/947956951 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5213700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d005e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 -- 172.21.15.133:0/947956951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 msgr2=0x7fb5d005e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d005e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 -- 172.21.15.133:0/947956951 >> v1:172.21.15.133:6789/0 conn(0x7fb5d014ecb0 legacy=0x7fb5d0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5c7fff700 1 -- 172.21.15.133:0/947956951 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442383519 0 0) 0x7fb5d00c9040 con 0x7fb5d014ecb0 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 -- 172.21.15.133:0/947956951 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d00c9570 con 0x7fb5d00c0a70 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5d5a14700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb5c8009e60 tx=0x7fb5c8009780).ready entity=mon.0 client_cookie=782b493862fcd757 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5c7fff700 1 -- 172.21.15.133:0/947956951 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800e070 con 0x7fb5d00c0a70 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5c7fff700 1 -- 172.21.15.133:0/947956951 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800bb60 con 0x7fb5d00c0a70 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.595+0000 7fb5c7fff700 1 -- 172.21.15.133:0/947956951 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8012410 con 0x7fb5d00c0a70 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 -- 172.21.15.133:0/947956951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 msgr2=0x7fb5d00c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fb5c8009e60 tx=0x7fb5c8009780).stop 2024-01-21T20:12:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 -- 172.21.15.133:0/947956951 shutdown_connections 2024-01-21T20:12:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00c0eb0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 --2- 172.21.15.133:0/947956951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d005e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 -- 172.21.15.133:0/947956951 >> 172.21.15.133:0/947956951 conn(0x7fb5d0084eb0 msgr2=0x7fb5d00947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 -- 172.21.15.133:0/947956951 shutdown_connections 2024-01-21T20:12:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.596+0000 7fb5d7477700 1 -- 172.21.15.133:0/947956951 wait complete. 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.597+0000 7fb5d7477700 1 Processor -- start 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.597+0000 7fb5d7477700 1 -- start start 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d01676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d014ecb0 0x7fb5d00af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d0164370 con 0x7fb5d00c0a70 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01685d0 con 0x7fb5d014ecb0 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d7477700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d01570d0 con 0x7fb5d014e8d0 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34660/0 (socket says 172.21.15.133:34660) 2024-01-21T20:12:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 -- 172.21.15.133:0/3980885775 learned_addr learned my addr 172.21.15.133:0/3980885775 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d01676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5a14700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d014ecb0 0x7fb5d00af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 msgr2=0x7fb5d01676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d01676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d014ecb0 msgr2=0x7fb5d00af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d014ecb0 0x7fb5d00af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c8009a20 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.598+0000 7fb5d5213700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fb5cc00e980 tx=0x7fb5cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.599+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc012600 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.599+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc012760 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.599+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc012ae0 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.599+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d00afa20 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.599+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d0168010 con 0x7fb5d00c0a70 2024-01-21T20:12:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.600+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 15) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fb5cc01b400 con 0x7fb5d00c0a70 2024-01-21T20:12:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.600+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d00c0630 con 0x7fb5d00c0a70 2024-01-21T20:12:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.600+0000 7fb5c5ffb700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.600+0000 7fb5d4a12700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.600+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6677+0+0 (secure 0 0 0) 0x7fb5cc07a930 con 0x7fb5d00c0a70 2024-01-21T20:12:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.601+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:12:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.605+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5cc04b970 con 0x7fb5d00c0a70 2024-01-21T20:12:03.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.802+0000 7fb5d4a12700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:03.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.802+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:12:03.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:03.802+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d005fdf0 con 0x7fb5b405f1a0 2024-01-21T20:12:04.149 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:04.159+0000 7f9de4b4a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:12:04.178 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:04.187+0000 7f92321d8680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:12:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:04.203+0000 7fb5d4a12700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:04.203+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:12:04.220 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:04.230+0000 7f9de4b4a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:12:04.251 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:04.260+0000 7f92321d8680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:12:04.406 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:04.416+0000 7f9de4b4a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:12:04.438 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:04.448+0000 7f92321d8680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:12:04.827 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:04.837+0000 7f9de4b4a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:12:04.857 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:04.867+0000 7f92321d8680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:12:04.930 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:04.940+0000 7f9de4b4a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:12:04.959 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:04.969+0000 7f92321d8680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:12:04.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:05.004+0000 7fb5d4a12700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:04.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:05.004+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:12:05.082 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:05.092+0000 7f9de4b4a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:12:05.111 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:05.121+0000 7f92321d8680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:12:05.156 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:05.166+0000 7f9de4b4a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:12:05.185 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:05.195+0000 7f92321d8680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:12:05.223 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:05.233+0000 7f9de4b4a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:12:05.252 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:05.261+0000 7f92321d8680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:12:05.478 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:05.488+0000 7f9de4b4a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:12:05.507 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:05.517+0000 7f92321d8680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:12:05.660 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:05.670+0000 7f9de4b4a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:12:05.689 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:05.699+0000 7f92321d8680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:12:06.307 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.317+0000 7f9de4b4a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:12:06.338 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.347+0000 7f92321d8680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:12:06.375 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.385+0000 7f9de4b4a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:12:06.406 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.415+0000 7f92321d8680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:12:06.449 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.459+0000 7f9de4b4a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:12:06.481 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.490+0000 7f92321d8680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:12:06.594 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.605+0000 7f9de4b4a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:12:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:06.605+0000 7fb5d4a12700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:12:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:06.605+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:12:06.628 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.637+0000 7f92321d8680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:12:06.664 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.675+0000 7f9de4b4a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:12:06.698 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.708+0000 7f92321d8680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:12:06.780 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.790+0000 7f9de4b4a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:12:06.813 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.822+0000 7f92321d8680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:12:06.887 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:06.897+0000 7f9de4b4a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:12:06.920 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:06.929+0000 7f92321d8680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:12:07.178 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:07.188+0000 7f9de4b4a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:12:07.209 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.219+0000 7f92321d8680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:12:07.248 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:12:07.258+0000 7f9de4b4a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:12:07.280 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.289+0000 7f92321d8680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:12:07.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:07.309+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 16) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fb5cc07cd50 con 0x7fb5d00c0a70 2024-01-21T20:12:07.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:07.309+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b4061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:12:07.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:07.309+0000 7fb5c5ffb700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a4f76700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a777b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a4f76700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a777b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a777b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a4f76700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a777b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a777b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a4f76700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:07.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:12:07.371+0000 7f91a4f76700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:12:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.334+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb5cc078850 con 0x7fb5d00c0a70 2024-01-21T20:12:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.334+0000 7fb5c5ffb700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.334+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d005fdf0 con 0x7fb5b405f1a0 2024-01-21T20:12:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.335+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.337+0000 7fb5d4a12700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b40615e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb5d0167600 tx=0x7fb5c0007dd0).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.353+0000 7fb5c5ffb700 1 -- 172.21.15.133:0/3980885775 <== mgr.6018 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb5d005fdf0 con 0x7fb5b405f1a0 2024-01-21T20:12:08.343 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T20:12:08.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 msgr2=0x7fb5b40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b40615e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fb5d0167600 tx=0x7fb5c0007dd0).stop 2024-01-21T20:12:08.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 msgr2=0x7fb5d00aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fb5cc00e980 tx=0x7fb5cc009060).stop 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 shutdown_connections 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b405f1a0 0x7fb5b40615e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d014ecb0 0x7fb5d00af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d00c0a70 0x7fb5d00aeb90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 --2- 172.21.15.133:0/3980885775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d014e8d0 0x7fb5d01676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 >> 172.21.15.133:0/3980885775 conn(0x7fb5d0084eb0 msgr2=0x7fb5d00a9790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 shutdown_connections 2024-01-21T20:12:08.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.356+0000 7fb5d7477700 1 -- 172.21.15.133:0/3980885775 wait complete. 2024-01-21T20:12:08.361 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T20:12:08.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2024-01-21T20:12:08.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.496+0000 7f08c3295700 1 Processor -- start 2024-01-21T20:12:08.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.496+0000 7f08c3295700 1 -- start start 2024-01-21T20:12:08.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c3295700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc13a7b0 0x7f08bc066b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c3295700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08bc0bda90 0x7f08bc0694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c3295700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0c23b0 con 0x7f08bc067080 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c3295700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0663c0 con 0x7f08bc13a7b0 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c3295700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc067600 con 0x7f08bc0bda90 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c1031700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc13a7b0 0x7f08bc066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c1031700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08bc13a7b0 0x7f08bc066b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34750/0 (socket says 172.21.15.133:34750) 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c1031700 1 -- 172.21.15.133:0/667118312 learned_addr learned my addr 172.21.15.133:0/667118312 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.497+0000 7f08c1832700 1 --1- 172.21.15.133:0/667118312 >> v1:172.21.15.133:6789/0 conn(0x7f08bc067080 0x7f08bc0c2840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40822/0 (socket says 172.21.15.133:40822) 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c0830700 1 --2- 172.21.15.133:0/667118312 >> v2:172.21.15.178:3300/0 conn(0x7f08bc0bda90 0x7f08bc0694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c1031700 1 -- 172.21.15.133:0/667118312 >> v2:172.21.15.178:3300/0 conn(0x7f08bc0bda90 msgr2=0x7f08bc0694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c1031700 1 --2- 172.21.15.133:0/667118312 >> v2:172.21.15.178:3300/0 conn(0x7f08bc0bda90 0x7f08bc0694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c1031700 1 -- 172.21.15.133:0/667118312 >> v1:172.21.15.133:6789/0 conn(0x7f08bc067080 legacy=0x7f08bc0c2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08b3fff700 1 -- 172.21.15.133:0/667118312 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249397601 0 0) 0x7f08bc0c23b0 con 0x7f08bc067080 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c1031700 1 -- 172.21.15.133:0/667118312 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0678e0 con 0x7f08bc13a7b0 2024-01-21T20:12:08.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c1031700 1 --2- 172.21.15.133:0/667118312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc13a7b0 0x7f08bc066b90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f08bc068460 tx=0x7f08ac00b3b0).ready entity=mon.0 client_cookie=c79fbf77732adc4c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08b3fff700 1 -- 172.21.15.133:0/667118312 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00db10 con 0x7f08bc13a7b0 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08b3fff700 1 -- 172.21.15.133:0/667118312 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac00dc70 con 0x7f08bc13a7b0 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08b3fff700 1 -- 172.21.15.133:0/667118312 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac010470 con 0x7f08bc13a7b0 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.498+0000 7f08c3295700 1 -- 172.21.15.133:0/667118312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc13a7b0 msgr2=0x7f08bc066b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 --2- 172.21.15.133:0/667118312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc13a7b0 0x7f08bc066b90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f08bc068460 tx=0x7f08ac00b3b0).stop 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 -- 172.21.15.133:0/667118312 shutdown_connections 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 --2- 172.21.15.133:0/667118312 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc13a7b0 0x7f08bc066b90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 --2- 172.21.15.133:0/667118312 >> v2:172.21.15.178:3300/0 conn(0x7f08bc0bda90 0x7f08bc0694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 -- 172.21.15.133:0/667118312 >> 172.21.15.133:0/667118312 conn(0x7f08bc0c7d20 msgr2=0x7f08bc0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 -- 172.21.15.133:0/667118312 shutdown_connections 2024-01-21T20:12:08.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.499+0000 7f08c3295700 1 -- 172.21.15.133:0/667118312 wait complete. 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.500+0000 7f08c3295700 1 Processor -- start 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.500+0000 7f08c3295700 1 -- start start 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08bc13a7b0 0x7f08bc0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08bc138a50 0x7f08bc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc161840 con 0x7f08bc067080 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc160cc0 con 0x7f08bc138a50 2024-01-21T20:12:08.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc160fa0 con 0x7f08bc13a7b0 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34764/0 (socket says 172.21.15.133:34764) 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 -- 172.21.15.133:0/1127243119 learned_addr learned my addr 172.21.15.133:0/1127243119 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1832700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08bc138a50 0x7f08bc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c0830700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08bc13a7b0 0x7f08bc0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 -- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08bc13a7b0 msgr2=0x7f08bc0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08bc13a7b0 0x7f08bc0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 -- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08bc138a50 msgr2=0x7f08bc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08bc138a50 0x7f08bc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 -- 172.21.15.133:0/1127243119 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac00b610 con 0x7f08bc067080 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c1031700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f08ac00b3f0 tx=0x7f08bc0674f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac020070 con 0x7f08bc067080 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac000d10 con 0x7f08bc067080 2024-01-21T20:12:08.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac019890 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc161280 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.501+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1619b0 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.502+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc05fdf0 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.503+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f08ac019c00 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.503+0000 7f08b1f76700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 0x7f08a0061510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.503+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f08ac07dd80 con 0x7f08bc067080 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.503+0000 7f08c0830700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 0x7f08a0061510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.503+0000 7f08c0830700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 0x7f08a0061510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f08bc0add70 tx=0x7f08b8008040).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.508+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f08ac04ef40 con 0x7f08bc067080 2024-01-21T20:12:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.696+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08bc1548d0 con 0x7f08a005f050 2024-01-21T20:12:08.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.701+0000 7f08b1f76700 1 -- 172.21.15.133:0/1127243119 <== mgr.6018 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f08bc1548d0 con 0x7f08a005f050 2024-01-21T20:12:08.691 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T20:12:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.703+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 msgr2=0x7f08a0061510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.703+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 0x7f08a0061510 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f08bc0add70 tx=0x7f08b8008040).stop 2024-01-21T20:12:08.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 msgr2=0x7f08bc138560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f08ac00b3f0 tx=0x7f08bc0674f0).stop 2024-01-21T20:12:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 shutdown_connections 2024-01-21T20:12:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f08a005f050 0x7f08a0061510 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08bc138a50 0x7f08bc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08bc067080 0x7f08bc138560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 --2- 172.21.15.133:0/1127243119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08bc13a7b0 0x7f08bc0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.704+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 >> 172.21.15.133:0/1127243119 conn(0x7f08bc0c7d20 msgr2=0x7f08bc0c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:08.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.705+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 shutdown_connections 2024-01-21T20:12:08.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.705+0000 7f08c3295700 1 -- 172.21.15.133:0/1127243119 wait complete. 2024-01-21T20:12:08.707 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T20:12:08.707 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2024-01-21-20_13_00 in ~52s... 2024-01-21T20:12:08.707 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2024-01-21-20_14_00 in ~112s... 2024-01-21T20:12:08.707 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2024-01-21T20:12:08.708 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2024-01-21T20:12:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.836+0000 7fefbb122700 1 Processor -- start 2024-01-21T20:12:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.836+0000 7fefbb122700 1 -- start start 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefbb122700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fefb4063700 0x7fefb4063b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefbb122700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40a5200 con 0x7fefb41545e0 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefbb122700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb4064080 con 0x7fefb4154200 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefbb122700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb4069b20 con 0x7fefb4063700 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefb41545e0 0x7fefb40c3590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40828/0 (socket says 172.21.15.133:40828) 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb3fff700 1 -- 172.21.15.133:0/3819220955 learned_addr learned my addr 172.21.15.133:0/3819220955 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb96bf700 1 --2- 172.21.15.133:0/3819220955 >> v2:172.21.15.178:3300/0 conn(0x7fefb4063700 0x7fefb4063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1689831794 0 0) 0x7fefb40a5200 con 0x7fefb41545e0 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa40033f0 con 0x7fefb41545e0 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188719275 0 0) 0x7fefb4064080 con 0x7fefb4154200 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb40a5200 con 0x7fefb4154200 2024-01-21T20:12:08.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275405113 0 0) 0x7fefa40033f0 con 0x7fefb41545e0 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 >> v2:172.21.15.178:3300/0 conn(0x7fefb4063700 msgr2=0x7fefb4063b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3819220955 >> v2:172.21.15.178:3300/0 conn(0x7fefb4063700 0x7fefb4063b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 >> v1:172.21.15.178:6789/0 conn(0x7fefb4154200 legacy=0x7fefb40c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb4069dc0 con 0x7fefb41545e0 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fefa0001470 con 0x7fefb41545e0 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb96bf700 1 --2- 172.21.15.133:0/3819220955 >> v2:172.21.15.178:3300/0 conn(0x7fefb4063700 0x7fefb4063b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 >> v1:172.21.15.133:6789/0 conn(0x7fefb41545e0 legacy=0x7fefb40c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 0x7fefa4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefa4004690 0x7fefa4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4005050 0x7fefa400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4069b20 con 0x7fefa4003a70 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa400bfc0 con 0x7fefa4005050 2024-01-21T20:12:08.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa400c180 con 0x7fefa4004690 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 0x7fefa4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb3fff700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefa4004690 0x7fefa4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb96bf700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4005050 0x7fefa400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 -- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefa4004690 msgr2=0x7fefa4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefa4004690 0x7fefa4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 -- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4005050 msgr2=0x7fefa400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4005050 0x7fefa400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 -- 172.21.15.133:0/3819220955 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa40033f0 con 0x7fefa4003a70 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb96bf700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4005050 0x7fefa400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb96bf700 1 -- 172.21.15.133:0/3819220955 reap_dead start 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 0x7fefa4003e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fefa8001890 tx=0x7fefa8007bb0).ready entity=mon.0 client_cookie=27c32644dafec962 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007020 con 0x7fefa4003a70 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8007180 con 0x7fefa4003a70 2024-01-21T20:12:08.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.838+0000 7fefb37fe700 1 -- 172.21.15.133:0/3819220955 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8007520 con 0x7fefa4003a70 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 -- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 msgr2=0x7fefa4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 0x7fefa4003e70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fefa8001890 tx=0x7fefa8007bb0).stop 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 -- 172.21.15.133:0/3819220955 shutdown_connections 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 --2- 172.21.15.133:0/3819220955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefa4003a70 0x7fefa4003e70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 -- 172.21.15.133:0/3819220955 >> 172.21.15.133:0/3819220955 conn(0x7fefb40c4a10 msgr2=0x7fefb4068d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 -- 172.21.15.133:0/3819220955 shutdown_connections 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.839+0000 7fefbb122700 1 -- 172.21.15.133:0/3819220955 wait complete. 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.840+0000 7fefbb122700 1 Processor -- start 2024-01-21T20:12:08.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.840+0000 7fefbb122700 1 -- start start 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 0x7fefb40c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb415a760 0x7fefb40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb414a4b0 con 0x7fefb4065980 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40ad4f0 con 0x7fefa4003a70 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefbb122700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40c28c0 con 0x7fefb415a760 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34780/0 (socket says 172.21.15.133:34780) 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 -- 172.21.15.133:0/4230503135 learned_addr learned my addr 172.21.15.133:0/4230503135 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 0x7fefb40c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb3fff700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb415a760 0x7fefb40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 -- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb415a760 msgr2=0x7fefb40ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb415a760 0x7fefb40ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 -- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 msgr2=0x7fefb40c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 0x7fefb40c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.841+0000 7fefb96bf700 1 -- 172.21.15.133:0/4230503135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb415abf0 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 0x7fefb40c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefb96bf700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fefb4068190 tx=0x7fefac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00e070 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac011db0 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb415aed0 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac016660 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.842+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb40c2df0 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.843+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb40c3010 con 0x7fefb4065980 2024-01-21T20:12:08.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.843+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 17) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fefac016a50 con 0x7fefb4065980 2024-01-21T20:12:08.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.843+0000 7fefb17fa700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 0x7fef98061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:12:08.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.843+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fefac07ab20 con 0x7fefb4065980 2024-01-21T20:12:08.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.844+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 0x7fef98061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:12:08.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.844+0000 7fefb8ebe700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 0x7fef98061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fefa8000c00 tx=0x7fefa8015000).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:12:08.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:08.849+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fefac04bc80 con 0x7fefb4065980 2024-01-21T20:12:09.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.035+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefb405fdf0 con 0x7fef9805f080 2024-01-21T20:12:09.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.039+0000 7fefb17fa700 1 -- 172.21.15.133:0/4230503135 <== mgr.6018 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7fefb405fdf0 con 0x7fef9805f080 2024-01-21T20:12:09.028 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:12:09.029 INFO:teuthology.orchestra.run.smithi133.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 msgr2=0x7fef98061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 0x7fef98061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fefa8000c00 tx=0x7fefa8015000).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 msgr2=0x7fefb4152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fefb4068190 tx=0x7fefac00b040).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 shutdown_connections 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9805f080 0x7fef98061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb4065980 0x7fefb4152c50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefa4003a70 0x7fefb40c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 --2- 172.21.15.133:0/4230503135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb415a760 0x7fefb40ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 >> 172.21.15.133:0/4230503135 conn(0x7fefb40c4a10 msgr2=0x7fefb40c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 shutdown_connections 2024-01-21T20:12:09.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:12:09.040+0000 7fefbb122700 1 -- 172.21.15.133:0/4230503135 wait complete. 2024-01-21T20:12:09.042 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2024-01-21T20:12:09.042 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2024-01-21T20:12:09.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:09.043 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:10.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:10.061 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:11.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:11.083 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:12.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:12.109 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:13.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:13.131 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:14.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:14.155 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:15.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:15.178 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:16.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:16.201 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:17.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:12:17.183 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:12:17.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:17.224 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:18.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:18.245 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:19.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:19.268 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:20.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:20.291 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:21.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:21.315 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:22.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:22.338 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:23.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:23.362 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:24.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:24.386 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:25.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:25.410 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:26.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:26.432 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:27.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:27.457 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:28.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:28.480 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:29.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:29.503 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:30.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:30.527 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:31.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:31.549 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:32.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:32.573 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:33.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:33.597 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:34.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:34.619 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:35.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:35.642 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:36.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:36.665 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:37.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:37.688 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:38.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:38.709 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:39.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:39.732 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:40.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:40.755 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:41.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:41.778 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:42.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:42.802 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:43.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:43.824 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:44.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:44.847 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:45.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:45.871 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:46.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:46.893 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:47.252 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:12:47.255 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:12:47.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:47.916 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:48.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:48.939 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:49.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:49.961 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:50.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:50.985 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:52.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:52.008 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:53.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:53.031 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:54.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:54.053 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:55.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:55.076 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:56.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:56.099 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:57.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:57.122 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:58.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:58.144 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:12:59.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:12:59.168 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:00.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:00.191 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:00.696 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:13:00.705+0000 7f9197f5c700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:13:00.696 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:13:00.706+0000 7f9197f5c700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:13:00.696 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:13:00.706+0000 7f9197f5c700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:13:00.696 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:13:00.706+0000 7f9197f5c700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:13:00.696 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:13:00.706+0000 7f9197f5c700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:13:01.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:01.214 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:01.235 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:01.236 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2024-01-21-20_13_00_UTC'] 2024-01-21T20:13:01.236 DEBUG:tasks.cephfs.test_snap_schedules:exec=1705867928.707736, now = 1705867981.2362509, timo = 52 2024-01-21T20:13:02.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:02.236 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:02.255 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:03.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:03.258 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:03.279 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:04.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:04.280 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:04.302 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:05.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:05.304 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:05.325 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:06.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:06.327 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:06.348 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:07.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:07.350 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:07.371 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:08.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:08.372 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:08.393 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:09.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:09.395 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:09.416 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:10.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:10.418 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:10.439 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:11.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:11.441 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:11.463 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:12.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:12.464 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:12.485 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:13.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:13.486 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:13.507 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:14.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:14.509 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:14.529 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:15.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:15.531 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:15.552 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:16.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:16.554 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:16.574 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:17.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:13:17.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:13:17.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:17.575 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:18.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:18.596 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:18.618 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:19.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:19.620 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:19.642 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:20.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:20.643 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:20.664 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:21.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:21.667 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:21.689 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:22.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:22.691 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:22.713 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:23.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:23.714 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:23.736 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:24.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:24.737 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:24.758 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:25.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:25.760 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:25.781 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:26.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:26.783 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:26.804 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:27.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:27.806 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:27.827 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:28.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:28.829 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:28.849 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:29.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:29.851 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:29.872 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:30.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:30.874 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:30.895 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:31.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:31.897 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:31.918 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:32.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:32.919 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:32.940 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:33.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:33.941 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:33.963 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:34.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:34.965 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:34.986 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:35.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:35.988 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:36.009 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:37.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:37.011 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:37.032 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:38.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:38.033 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:38.055 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:39.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:39.057 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:39.078 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:40.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:40.079 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:40.100 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:41.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:41.102 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:41.124 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:42.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:42.126 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:42.147 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:43.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:43.150 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:43.170 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:44.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:44.172 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:44.193 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:45.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:45.196 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:45.218 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:46.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:46.220 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:46.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:47.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:47.243 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:47.264 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:47.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:13:47.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:13:48.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:48.266 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:48.288 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:49.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:49.290 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:49.311 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:50.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:50.312 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:50.333 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:51.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:51.336 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:51.358 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:52.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:52.360 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:52.381 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:53.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:53.382 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:53.404 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:54.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:54.406 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:54.427 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:55.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:55.429 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:55.449 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:56.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:56.451 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:56.473 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:57.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:57.474 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:57.495 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:58.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:58.496 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:58.517 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:13:59.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:13:59.519 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:13:59.540 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:14:00.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:00.542 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:14:00.563 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:14:01.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:01.565 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:14:01.586 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:14:01.586 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_14_00_UTC 2024-01-21T20:14:01.587 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2024-01-21-20_14_00_UTC'] 2024-01-21T20:14:01.587 DEBUG:tasks.cephfs.test_snap_schedules:exec=1705867928.707736, now = 1705868041.5877705, timo = 112 2024-01-21T20:14:02.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2024-01-21T20:14:02.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.733+0000 7f1598c34700 1 Processor -- start 2024-01-21T20:14:02.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.733+0000 7f1598c34700 1 -- start start 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1598c34700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f1594066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1598c34700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 0x7f15940c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1598c34700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940c37c0 con 0x7f15940bdec0 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1598c34700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1594158ed0 con 0x7f1594157f30 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1598c34700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c5820 con 0x7f1594066b50 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1591d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 0x7f15940c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f159259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f1594066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.734+0000 7f1592d9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f15940bdec0 0x7f1594153e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:55500/0 (socket says 172.21.15.133:55500) 2024-01-21T20:14:02.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f1592d9d700 1 -- 172.21.15.133:0/79345495 learned_addr learned my addr 172.21.15.133:0/79345495 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159259c700 1 -- 172.21.15.133:0/79345495 >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 msgr2=0x7f15940c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159259c700 1 --2- 172.21.15.133:0/79345495 >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 0x7f15940c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159259c700 1 -- 172.21.15.133:0/79345495 >> v1:172.21.15.178:6789/0 conn(0x7f15940bdec0 legacy=0x7f1594153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159259c700 1 -- 172.21.15.133:0/79345495 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15941583b0 con 0x7f1594066b50 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f1591d9b700 1 --2- 172.21.15.133:0/79345495 >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 0x7f15940c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159259c700 1 --2- 172.21.15.133:0/79345495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f1594066f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1588009760 tx=0x7f1588009060).ready entity=mon.2 client_cookie=3ea75efec1feb647 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159159a700 1 -- 172.21.15.133:0/79345495 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15880090d0 con 0x7f1594066b50 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159159a700 1 -- 172.21.15.133:0/79345495 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800f510 con 0x7f1594066b50 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.735+0000 7f159159a700 1 -- 172.21.15.133:0/79345495 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158800f890 con 0x7f1594066b50 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 -- 172.21.15.133:0/79345495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 msgr2=0x7f1594066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 --2- 172.21.15.133:0/79345495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f1594066f30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1588009760 tx=0x7f1588009060).stop 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 -- 172.21.15.133:0/79345495 shutdown_connections 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 --2- 172.21.15.133:0/79345495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f1594066f30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 --2- 172.21.15.133:0/79345495 >> v2:172.21.15.178:3300/0 conn(0x7f1594157f30 0x7f15940c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 -- 172.21.15.133:0/79345495 >> 172.21.15.133:0/79345495 conn(0x7f15940c8f60 msgr2=0x7f15940c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 -- 172.21.15.133:0/79345495 shutdown_connections 2024-01-21T20:14:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.736+0000 7f1598c34700 1 -- 172.21.15.133:0/79345495 wait complete. 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.737+0000 7f1598c34700 1 Processor -- start 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.737+0000 7f1598c34700 1 -- start start 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f15940c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15940bdec0 0x7f1594168700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159414ba30 con 0x7f1594157f30 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c1480 con 0x7f15940bdec0 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1598c34700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c01d0 con 0x7f1594066b50 2024-01-21T20:14:02.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1592d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1592d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47976/0 (socket says 172.21.15.133:47976) 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1592d9d700 1 -- 172.21.15.133:0/3775590169 learned_addr learned my addr 172.21.15.133:0/3775590169 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f159259c700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f15940c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.738+0000 7f1591d9b700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15940bdec0 0x7f1594168700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 -- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 msgr2=0x7f15940c0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f15940c0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 -- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15940bdec0 msgr2=0x7f1594168700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15940bdec0 0x7f1594168700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 -- 172.21.15.133:0/3775590169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840092a0 con 0x7f1594157f30 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1592d9d700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f158c00c790 tx=0x7f158c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c005d30 con 0x7f1594157f30 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c005e90 con 0x7f1594157f30 2024-01-21T20:14:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15880092a0 con 0x7f1594157f30 2024-01-21T20:14:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c007320 con 0x7f1594157f30 2024-01-21T20:14:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.739+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940c0790 con 0x7f1594157f30 2024-01-21T20:14:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.740+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159405fdf0 con 0x7f1594157f30 2024-01-21T20:14:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.740+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f158c0076d0 con 0x7f1594157f30 2024-01-21T20:14:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.741+0000 7f1582ffd700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 0x7f1574061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.741+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7f158c07a870 con 0x7f1594157f30 2024-01-21T20:14:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.741+0000 7f159259c700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 0x7f1574061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.741+0000 7f159259c700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 0x7f1574061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1588009fd0 tx=0x7f1588017000).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.745+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f158c04b670 con 0x7f1594157f30 2024-01-21T20:14:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.934+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f15940c0340 con 0x7f157405f2c0 2024-01-21T20:14:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.938+0000 7f1582ffd700 1 -- 172.21.15.133:0/3775590169 <== mgr.6018 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f15940c0340 con 0x7f157405f2c0 2024-01-21T20:14:02.928 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path snap_test_dir1 2024-01-21T20:14:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 msgr2=0x7f1574061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 0x7f1574061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1588009fd0 tx=0x7f1588017000).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 msgr2=0x7f15940637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f158c00c790 tx=0x7f158c0015e0).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 shutdown_connections 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f157405f2c0 0x7f1574061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1594157f30 0x7f15940637e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1594066b50 0x7f15940c0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 --2- 172.21.15.133:0/3775590169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15940bdec0 0x7f1594168700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 >> 172.21.15.133:0/3775590169 conn(0x7f15940c8f60 msgr2=0x7f15940c7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 shutdown_connections 2024-01-21T20:14:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:02.940+0000 7f1598c34700 1 -- 172.21.15.133:0/3775590169 wait complete. 2024-01-21T20:14:02.942 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-01-21T20:14:02.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:02.942 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:14:02.960 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:14:02.960 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_14_00_UTC 2024-01-21T20:14:02.960 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_13_00_UTC 2024-01-21T20:14:02.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:02.960 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_13_00_UTC) 2024-01-21T20:14:03.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_14_00_UTC 2024-01-21T20:14:03.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:03.022 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_14_00_UTC) 2024-01-21T20:14:03.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:03.084 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T20:14:03.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:14:03.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 Processor -- start 2024-01-21T20:14:03.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 -- start start 2024-01-21T20:14:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c066e00 0x7fea1c153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c153750 con 0x7fea1c062b70 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c0671e0 con 0x7fea1c0626f0 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.313+0000 7fea22f68700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c156b50 con 0x7fea1c066e00 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c066e00 0x7fea1c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c066e00 0x7fea1c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47984/0 (socket says 172.21.15.133:47984) 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea21505700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea1c062b70 0x7fea1c156440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46538/0 (socket says 172.21.15.133:46538) 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 -- 172.21.15.133:0/1051349660 learned_addr learned my addr 172.21.15.133:0/1051349660 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 -- 172.21.15.133:0/1051349660 >> v1:172.21.15.178:6789/0 conn(0x7fea1c0626f0 legacy=0x7fea1c155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 -- 172.21.15.133:0/1051349660 >> v1:172.21.15.133:6789/0 conn(0x7fea1c062b70 legacy=0x7fea1c156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 -- 172.21.15.133:0/1051349660 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0662e0 con 0x7fea1c066e00 2024-01-21T20:14:03.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea1b7fe700 1 -- 172.21.15.133:0/1051349660 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876040466 0 0) 0x7fea1c153750 con 0x7fea1c062b70 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea20d04700 1 --2- 172.21.15.133:0/1051349660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c066e00 0x7fea1c153260 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fea10006fd0 tx=0x7fea100090f0).ready entity=mon.0 client_cookie=82b5049369acdd1b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea1b7fe700 1 -- 172.21.15.133:0/1051349660 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000b600 con 0x7fea1c066e00 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea1b7fe700 1 -- 172.21.15.133:0/1051349660 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000b760 con 0x7fea1c066e00 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.314+0000 7fea1b7fe700 1 -- 172.21.15.133:0/1051349660 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1000bb00 con 0x7fea1c066e00 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 -- 172.21.15.133:0/1051349660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c066e00 msgr2=0x7fea1c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 --2- 172.21.15.133:0/1051349660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c066e00 0x7fea1c153260 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fea10006fd0 tx=0x7fea100090f0).stop 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 -- 172.21.15.133:0/1051349660 shutdown_connections 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 --2- 172.21.15.133:0/1051349660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c066e00 0x7fea1c153260 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 -- 172.21.15.133:0/1051349660 >> 172.21.15.133:0/1051349660 conn(0x7fea1c0c7dc0 msgr2=0x7fea1c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:03.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 -- 172.21.15.133:0/1051349660 shutdown_connections 2024-01-21T20:14:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.315+0000 7fea22f68700 1 -- 172.21.15.133:0/1051349660 wait complete. 2024-01-21T20:14:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.316+0000 7fea22f68700 1 Processor -- start 2024-01-21T20:14:03.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.316+0000 7fea22f68700 1 -- start start 2024-01-21T20:14:03.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0626f0 0x7fea1c14ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:03.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:03.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c066e00 0x7fea1c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:03.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c14f450 con 0x7fea1c062b70 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0bef70 con 0x7fea1c066e00 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea22f68700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0c40e0 con 0x7fea1c0626f0 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47990/0 (socket says 172.21.15.133:47990) 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 -- 172.21.15.133:0/156182184 learned_addr learned my addr 172.21.15.133:0/156182184 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea21505700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c066e00 0x7fea1c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea20d04700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0626f0 0x7fea1c14ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 -- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0626f0 msgr2=0x7fea1c14ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0626f0 0x7fea1c14ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:03.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 -- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c066e00 msgr2=0x7fea1c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c066e00 0x7fea1c0c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 -- 172.21.15.133:0/156182184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10009370 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.317+0000 7fea1bfff700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fea0800c4c0 tx=0x7fea08007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.318+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08007020 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.318+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea08001e90 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.318+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0c34d0 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.318+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea080073b0 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.318+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0c3a90 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.319+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c0c4250 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.319+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 20) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fea080068b0 con 0x7fea1c062b70 2024-01-21T20:14:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.319+0000 7fea197fa700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 0x7fea00061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.319+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7fea0807a260 con 0x7fea1c062b70 2024-01-21T20:14:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.319+0000 7fea20d04700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 0x7fea00061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.320+0000 7fea20d04700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 0x7fea00061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea10009130 tx=0x7fea10017000).ready entity=mgr.6018 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.323+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fea0804afa0 con 0x7fea1c062b70 2024-01-21T20:14:03.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:03.535+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fea1c069990 con 0x7fea1c062b70 2024-01-21T20:14:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.187+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fea08077aa0 con 0x7fea1c062b70 2024-01-21T20:14:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.188+0000 7fea197fa700 1 -- 172.21.15.133:0/156182184 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v21) v1 ==== 93+0+0 (secure 0 0 0) 0x7fea08072310 con 0x7fea1c062b70 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.190+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 msgr2=0x7fea00061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.190+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 0x7fea00061780 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fea10009130 tx=0x7fea10017000).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.190+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 msgr2=0x7fea1c0c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.190+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fea0800c4c0 tx=0x7fea08007e00).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 shutdown_connections 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea0005f2c0 0x7fea00061780 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea1c066e00 0x7fea1c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea1c0626f0 0x7fea1c14ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 --2- 172.21.15.133:0/156182184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c062b70 0x7fea1c0c2a50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 >> 172.21.15.133:0/156182184 conn(0x7fea1c0c7dc0 msgr2=0x7fea1c0c6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 shutdown_connections 2024-01-21T20:14:04.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.191+0000 7fea22f68700 1 -- 172.21.15.133:0/156182184 wait complete. 2024-01-21T20:14:04.196 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:14:04.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:04.242 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:04.287 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:14:04.287 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:14:04.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:04.288 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:04.322 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:04.332+0000 7f7b757fe680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:04.324 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:04.334+0000 7fb385d99680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:04.334 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:14:04.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:04.334 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:14:04.385 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:04.395+0000 7f7b757fe680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:04.389 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:04.400+0000 7fb385d99680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:04.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:04.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.562+0000 7f1dc2527700 1 Processor -- start 2024-01-21T20:14:04.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.562+0000 7f1dc2527700 1 -- start start 2024-01-21T20:14:04.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc2527700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc2527700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dbc1563c0 0x7f1dbc0bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc2527700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc0c61a0 con 0x7f1dbc0c3c60 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc2527700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc0c5350 con 0x7f1dbc1563c0 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc2527700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0c55d0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dc0ac4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1dbc1563c0 0x7f1dbc0bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dbb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1dbc0c3c60 0x7f1dbc155cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46544/0 (socket says 172.21.15.133:46544) 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dbb7fe700 1 -- 172.21.15.133:0/834002964 learned_addr learned my addr 172.21.15.133:0/834002964 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.563+0000 7f1dbbfff700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc0ac4700 1 -- 172.21.15.133:0/834002964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 msgr2=0x7f1dbc0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc0ac4700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc0c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc0ac4700 1 -- 172.21.15.133:0/834002964 >> v1:172.21.15.133:6789/0 conn(0x7f1dbc0c3c60 legacy=0x7f1dbc155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc0ac4700 1 -- 172.21.15.133:0/834002964 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc0c5870 con 0x7f1dbc1563c0 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dbaffd700 1 -- 172.21.15.133:0/834002964 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697517775 0 0) 0x7f1dbc0c61a0 con 0x7f1dbc0c3c60 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc0ac4700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0bde60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f1db4009e60 tx=0x7f1db4009780).ready entity=mon.0 client_cookie=e2914f0cd977f9a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dbaffd700 1 -- 172.21.15.133:0/834002964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400e070 con 0x7f1dbc1563c0 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dbaffd700 1 -- 172.21.15.133:0/834002964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db400bb60 con 0x7f1dbc1563c0 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dbaffd700 1 -- 172.21.15.133:0/834002964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4012410 con 0x7f1dbc1563c0 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc2527700 1 -- 172.21.15.133:0/834002964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 msgr2=0x7f1dbc0bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.564+0000 7f1dc2527700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0bde60 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f1db4009e60 tx=0x7f1db4009780).stop 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 -- 172.21.15.133:0/834002964 shutdown_connections 2024-01-21T20:14:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0bde60 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 --2- 172.21.15.133:0/834002964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc0c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 -- 172.21.15.133:0/834002964 >> 172.21.15.133:0/834002964 conn(0x7f1dbc066a90 msgr2=0x7f1dbc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 -- 172.21.15.133:0/834002964 shutdown_connections 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.565+0000 7f1dc2527700 1 -- 172.21.15.133:0/834002964 wait complete. 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.566+0000 7f1dc2527700 1 Processor -- start 2024-01-21T20:14:04.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.566+0000 7f1dc2527700 1 -- start start 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dbc0c3c60 0x7f1dbc0652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0c7ce0 con 0x7f1dbc1563c0 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0657c0 con 0x7f1dbc0c3c60 2024-01-21T20:14:04.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc2527700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc0c70d0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc0ac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc0ac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48016/0 (socket says 172.21.15.133:48016) 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc0ac4700 1 -- 172.21.15.133:0/3894723708 learned_addr learned my addr 172.21.15.133:0/3894723708 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbbfff700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dbc0c3c60 0x7f1dbc0652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dbc0c3c60 msgr2=0x7f1dbc0652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dbc0c3c60 0x7f1dbc0652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 msgr2=0x7f1dbc0ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 -- 172.21.15.133:0/3894723708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4009a20 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dc0ac4700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1dbb7fe700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc14da20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1dbc067ab0 tx=0x7f1db0007dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.567+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00070d0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.568+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0007230 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.568+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc0c73b0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.568+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00075b0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.568+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc0c7970 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc05fdf0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f1db00059b0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1db8ff9700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 0x7f1da8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1dbbfff700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 msgr2=0x7f1da8061760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7f1db0079ce0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.569+0000 7f1dbbfff700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 0x7f1da8061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:04.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.573+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1db007e070 con 0x7f1dbc1351d0 2024-01-21T20:14:04.659 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:04.669+0000 7f7b757fe680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:04.680 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:04.691+0000 7fb385d99680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:04.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.770+0000 7f1dbbfff700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 msgr2=0x7f1da8061760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.770+0000 7f1dbbfff700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 0x7f1da8061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:04.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.787+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dbc06bd20 con 0x7f1dbc1351d0 2024-01-21T20:14:04.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.787+0000 7f1db8ff9700 1 -- 172.21.15.133:0/3894723708 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f1db004aae0 con 0x7f1dbc1351d0 2024-01-21T20:14:04.777 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:04.777 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 msgr2=0x7f1da8061760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 0x7f1da8061760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 msgr2=0x7f1dbc14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc14da20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f1dbc067ab0 tx=0x7f1db0007dd0).stop 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 shutdown_connections 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1da805f2a0 0x7f1da8061760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1dbc1563c0 0x7f1dbc0ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1dbc0c3c60 0x7f1dbc0652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 --2- 172.21.15.133:0/3894723708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1dbc1351d0 0x7f1dbc14da20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 >> 172.21.15.133:0/3894723708 conn(0x7f1dbc066a90 msgr2=0x7f1dbc134760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:04.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 shutdown_connections 2024-01-21T20:14:04.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.789+0000 7f1dc2527700 1 -- 172.21.15.133:0/3894723708 wait complete. 2024-01-21T20:14:04.781 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:14:04.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.921+0000 7feac6b10700 1 Processor -- start 2024-01-21T20:14:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.921+0000 7feac6b10700 1 -- start start 2024-01-21T20:14:04.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac6b10700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac0062c10 0x7feac0062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac6b10700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feac0065d70 0x7feac00bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac6b10700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feac00634e0 con 0x7feac00697e0 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac6b10700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac006a130 con 0x7feac0065d70 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac6b10700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac006a410 con 0x7feac0062c10 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac50ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feac0065d70 0x7feac00bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feabffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feac00697e0 0x7feac0065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46552/0 (socket says 172.21.15.133:46552) 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feabffff700 1 -- 172.21.15.133:0/1519533239 learned_addr learned my addr 172.21.15.133:0/1519533239 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac48ac700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac0062c10 0x7feac0062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feabf7fe700 1 -- 172.21.15.133:0/1519533239 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812997028 0 0) 0x7feac00634e0 con 0x7feac00697e0 2024-01-21T20:14:04.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feabf7fe700 1 -- 172.21.15.133:0/1519533239 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feab00033f0 con 0x7feac00697e0 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac50ad700 1 -- 172.21.15.133:0/1519533239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac0062c10 msgr2=0x7feac0062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac50ad700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac0062c10 0x7feac0062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac50ad700 1 -- 172.21.15.133:0/1519533239 >> v1:172.21.15.133:6789/0 conn(0x7feac00697e0 legacy=0x7feac0065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.922+0000 7feac50ad700 1 -- 172.21.15.133:0/1519533239 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac006a6f0 con 0x7feac0065d70 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac50ad700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac00bd770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7feab8009e60 tx=0x7feab8009780).ready entity=mon.0 client_cookie=c6807c9820e9280a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feabf7fe700 1 -- 172.21.15.133:0/1519533239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800e070 con 0x7feac0065d70 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feabf7fe700 1 -- 172.21.15.133:0/1519533239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800bab0 con 0x7feac0065d70 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feabf7fe700 1 -- 172.21.15.133:0/1519533239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800be30 con 0x7feac0065d70 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 -- 172.21.15.133:0/1519533239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 msgr2=0x7feac00bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac00bd770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7feab8009e60 tx=0x7feab8009780).stop 2024-01-21T20:14:04.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 -- 172.21.15.133:0/1519533239 shutdown_connections 2024-01-21T20:14:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac00bd770 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 --2- 172.21.15.133:0/1519533239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac0062c10 0x7feac0062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 -- 172.21.15.133:0/1519533239 >> 172.21.15.133:0/1519533239 conn(0x7feac00c8010 msgr2=0x7feac00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 -- 172.21.15.133:0/1519533239 shutdown_connections 2024-01-21T20:14:04.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.923+0000 7feac6b10700 1 -- 172.21.15.133:0/1519533239 wait complete. 2024-01-21T20:14:04.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.924+0000 7feac6b10700 1 Processor -- start 2024-01-21T20:14:04.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 -- start start 2024-01-21T20:14:04.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac0062c10 0x7feac0139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac00697e0 0x7feac0164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00a7af0 con 0x7feac0065d70 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac00a7d40 con 0x7feac0062c10 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.925+0000 7feac6b10700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac00a8020 con 0x7feac00697e0 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48032/0 (socket says 172.21.15.133:48032) 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 -- 172.21.15.133:0/2329169813 learned_addr learned my addr 172.21.15.133:0/2329169813 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feac50ad700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac00697e0 0x7feac0164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feac48ac700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac0062c10 0x7feac0139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:04.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 -- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac00697e0 msgr2=0x7feac0164bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac00697e0 0x7feac0164bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 -- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac0062c10 msgr2=0x7feac0139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac0062c10 0x7feac0139e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 -- 172.21.15.133:0/2329169813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab8009a20 con 0x7feac0065d70 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabffff700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7feaac00c4c0 tx=0x7feaac007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac00ce70 con 0x7feac0065d70 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac0072e0 con 0x7feac0065d70 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac00a8300 con 0x7feac0065d70 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaac0057a0 con 0x7feac0065d70 2024-01-21T20:14:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.926+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac013a330 con 0x7feac0065d70 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7feaac005bd0 con 0x7feac0065d70 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feabd7fa700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 0x7feaa4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feac48ac700 1 -- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 msgr2=0x7feaa4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7feaac079e00 con 0x7feac0065d70 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feac48ac700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 0x7feaa4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.928+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac005fdf0 con 0x7feac0065d70 2024-01-21T20:14:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:04.936+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7feaac018070 con 0x7feac0065d70 2024-01-21T20:14:05.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.108+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feac00c5ab0 con 0x7feac0065d70 2024-01-21T20:14:05.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.110+0000 7feabd7fa700 1 -- 172.21.15.133:0/2329169813 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18251 (secure 0 0 0) 0x7feaac04ac00 con 0x7feac0065d70 2024-01-21T20:14:05.100 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:05.100 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":65,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:13:09.062496+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/428102360":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6833/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6832/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:0/3780247849":"2024-01-22T20:12:07.304572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:05.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 msgr2=0x7feaa4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 0x7feaa4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 msgr2=0x7feac0164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7feaac00c4c0 tx=0x7feaac007c50).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 shutdown_connections 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7feaa405f270 0x7feaa4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feac00697e0 0x7feac0164bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feac0062c10 0x7feac0139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 --2- 172.21.15.133:0/2329169813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feac0065d70 0x7feac0164700 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 >> 172.21.15.133:0/2329169813 conn(0x7feac00c8010 msgr2=0x7feac00c7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 shutdown_connections 2024-01-21T20:14:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.113+0000 7feac6b10700 1 -- 172.21.15.133:0/2329169813 wait complete. 2024-01-21T20:14:05.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:11:54.065802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:11:55.381802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:14:05.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:14:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.251+0000 7f8319838700 1 Processor -- start 2024-01-21T20:14:05.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.251+0000 7f8319838700 1 -- start start 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8319838700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f831414b6c0 0x7f83140c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8319838700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 0x7f83140bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8319838700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140c46d0 con 0x7f83140c3450 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8319838700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140c38d0 con 0x7f831414b6c0 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8319838700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831414baa0 con 0x7f8314069cc0 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f83127fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83140c3450 0x7f83140695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46554/0 (socket says 172.21.15.133:46554) 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f83127fc700 1 -- 172.21.15.133:0/346808965 learned_addr learned my addr 172.21.15.133:0/346808965 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:05.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8312ffd700 1 --2- 172.21.15.133:0/346808965 >> v2:172.21.15.178:3300/0 conn(0x7f831414b6c0 0x7f83140c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f83137fe700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 0x7f83140bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494315089 0 0) 0x7f83140c46d0 con 0x7f83140c3450 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82fc0033f0 con 0x7f83140c3450 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 401794044 0 0) 0x7f82fc0033f0 con 0x7f83140c3450 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 msgr2=0x7f83140bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 0x7f83140bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 >> v2:172.21.15.178:3300/0 conn(0x7f831414b6c0 msgr2=0x7f83140c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 --2- 172.21.15.133:0/346808965 >> v2:172.21.15.178:3300/0 conn(0x7f831414b6c0 0x7f83140c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140c3ac0 con 0x7f83140c3450 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8308001470 con 0x7f83140c3450 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 >> v1:172.21.15.133:6789/0 conn(0x7f83140c3450 legacy=0x7f83140695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f82fc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 0x7f82fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82fc004b80 0x7f82fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831414baa0 con 0x7f82fc0038e0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc00b8e0 con 0x7f82fc004b80 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.252+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc00ba20 con 0x7f8314069cc0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f82fc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f83137fe700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82fc004b80 0x7f82fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 -- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 msgr2=0x7f82fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314069cc0 0x7f82fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 -- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82fc004b80 msgr2=0x7f82fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82fc004b80 0x7f82fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 -- 172.21.15.133:0/346808965 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0033f0 con 0x7f82fc0038e0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8312ffd700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f82fc003d00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8304009a80 tx=0x7f8304009060).ready entity=mon.0 client_cookie=5b1eb6fd0e85c032 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304009430 con 0x7f82fc0038e0 2024-01-21T20:14:05.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304013650 con 0x7f82fc0038e0 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.253+0000 7f8311ffb700 1 -- 172.21.15.133:0/346808965 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040139d0 con 0x7f82fc0038e0 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 -- 172.21.15.133:0/346808965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 msgr2=0x7f82fc003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 --2- 172.21.15.133:0/346808965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f82fc003d00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8304009a80 tx=0x7f8304009060).stop 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f83137fe700 1 -- 172.21.15.133:0/346808965 reap_dead start 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 -- 172.21.15.133:0/346808965 shutdown_connections 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 -- 172.21.15.133:0/346808965 >> 172.21.15.133:0/346808965 conn(0x7f83140c7de0 msgr2=0x7f83140c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 -- 172.21.15.133:0/346808965 shutdown_connections 2024-01-21T20:14:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.254+0000 7f8319838700 1 -- 172.21.15.133:0/346808965 wait complete. 2024-01-21T20:14:05.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.255+0000 7f8319838700 1 Processor -- start 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.255+0000 7f8319838700 1 -- start start 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140bee80 0x7f8314155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8314147870 0x7f83140626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831414a1e0 con 0x7f82fc0038e0 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140bf300 con 0x7f8314147870 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8319838700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8314155b00 con 0x7f83140bee80 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48050/0 (socket says 172.21.15.133:48050) 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 -- 172.21.15.133:0/4259202428 learned_addr learned my addr 172.21.15.133:0/4259202428 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f83137fe700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8314147870 0x7f83140626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140bee80 msgr2=0x7f8314155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140bee80 0x7f8314155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8314147870 msgr2=0x7f83140626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.256+0000 7f8312ffd700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8314147870 0x7f83140626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f8312ffd700 1 -- 172.21.15.133:0/4259202428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314153910 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f8312ffd700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f830400e4b0 tx=0x7f830401c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304021070 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83040137c0 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83140a9f70 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830401c6c0 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.257+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314149c20 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.258+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831405fdf0 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.258+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f8304019070 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.259+0000 7f82fb7fe700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 0x7f8300061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.259+0000 7f83127fc700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 msgr2=0x7f8300061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.259+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7f830407f920 con 0x7f82fc0038e0 2024-01-21T20:14:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.259+0000 7f83127fc700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 0x7f8300061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:05.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.263+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f83040506c0 con 0x7f82fc0038e0 2024-01-21T20:14:05.272 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:05.282+0000 7f7b757fe680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:05.330 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:05.341+0000 7fb385d99680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:05.343 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:05.353+0000 7f7b757fe680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:05.404 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:05.415+0000 7fb385d99680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:05.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.460+0000 7f83127fc700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 msgr2=0x7f8300061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:05.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.460+0000 7f83127fc700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 0x7f8300061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:05.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.467+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f831406bdd0 con 0x7f82fc0038e0 2024-01-21T20:14:05.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.467+0000 7f82fb7fe700 1 -- 172.21.15.133:0/4259202428 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v65) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8304053ce0 con 0x7f82fc0038e0 2024-01-21T20:14:05.457 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:14:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 msgr2=0x7f8300061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 0x7f8300061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 msgr2=0x7f8314149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f830400e4b0 tx=0x7f830401c000).stop 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 shutdown_connections 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f830005f270 0x7f8300061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8314147870 0x7f83140626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82fc0038e0 0x7f8314149310 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 --2- 172.21.15.133:0/4259202428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140bee80 0x7f8314155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 >> 172.21.15.133:0/4259202428 conn(0x7f83140c7de0 msgr2=0x7f8314066b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 shutdown_connections 2024-01-21T20:14:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.469+0000 7f8319838700 1 -- 172.21.15.133:0/4259202428 wait complete. 2024-01-21T20:14:05.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:14:05.529 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:05.539+0000 7f7b757fe680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.603+0000 7fdd315c2700 1 Processor -- start 2024-01-21T20:14:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.603+0000 7fdd315c2700 1 -- start start 2024-01-21T20:14:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd315c2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd2c0c8120 0x7fdd2c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd315c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c0c0e40 con 0x7fdd2c154140 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd315c2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2c1549b0 con 0x7fdd2c154520 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd315c2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd2c0c6ae0 con 0x7fdd2c0c8120 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd2c154140 0x7fdd2c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46570/0 (socket says 172.21.15.133:46570) 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2affd700 1 -- 172.21.15.133:0/1730988930 learned_addr learned my addr 172.21.15.133:0/1730988930 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2a7fc700 1 --2- 172.21.15.133:0/1730988930 >> v2:172.21.15.178:3300/0 conn(0x7fdd2c0c8120 0x7fdd2c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743766345 0 0) 0x7fdd2c0c0e40 con 0x7fdd2c154140 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd140033f0 con 0x7fdd2c154140 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/1730988930 >> v1:172.21.15.178:6789/0 conn(0x7fdd2c154520 legacy=0x7fdd2c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255744891 0 0) 0x7fdd2c1549b0 con 0x7fdd2c154520 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/1730988930 >> v1:172.21.15.133:6789/0 conn(0x7fdd2c154140 legacy=0x7fdd2c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.604+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/1730988930 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c0c6800 con 0x7fdd2c0c8120 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd2a7fc700 1 --2- 172.21.15.133:0/1730988930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c158bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdd20009760 tx=0x7fdd20009060).ready entity=mon.1 client_cookie=487a50390a69ac6b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f510 con 0x7fdd2c0c8120 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000f670 con 0x7fdd2c0c8120 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd29ffb700 1 -- 172.21.15.133:0/1730988930 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f9f0 con 0x7fdd2c0c8120 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 -- 172.21.15.133:0/1730988930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 msgr2=0x7fdd2c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 --2- 172.21.15.133:0/1730988930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c158bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fdd20009760 tx=0x7fdd20009060).stop 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 -- 172.21.15.133:0/1730988930 shutdown_connections 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 --2- 172.21.15.133:0/1730988930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c158bb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 -- 172.21.15.133:0/1730988930 >> 172.21.15.133:0/1730988930 conn(0x7fdd2c05e1e0 msgr2=0x7fdd2c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 -- 172.21.15.133:0/1730988930 shutdown_connections 2024-01-21T20:14:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.605+0000 7fdd315c2700 1 -- 172.21.15.133:0/1730988930 wait complete. 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.607+0000 7fdd315c2700 1 Processor -- start 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.607+0000 7fdd315c2700 1 -- start start 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2c154520 0x7fdd2c0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c150fa0 con 0x7fdd2c154140 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0ae110 con 0x7fdd2c0c8120 2024-01-21T20:14:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd315c2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2c0ae3f0 con 0x7fdd2c154520 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48064/0 (socket says 172.21.15.133:48064) 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/4079090210 learned_addr learned my addr 172.21.15.133:0/4079090210 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2affd700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2b7fe700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2c154520 0x7fdd2c0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2c154520 msgr2=0x7fdd2c0abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2c154520 0x7fdd2c0abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 msgr2=0x7fdd2c0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2a7fc700 1 -- 172.21.15.133:0/4079090210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd200092a0 con 0x7fdd2c154140 2024-01-21T20:14:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.608+0000 7fdd2affd700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd2a7fc700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fdd20009e00 tx=0x7fdd20017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000f7e0 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000f940 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2001b660 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2c0ae6d0 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.609+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2c1421c0 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.610+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2c05fdf0 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.610+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fdd2001b9d0 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.611+0000 7fdd137fe700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 0x7fdd18061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.611+0000 7fdd2affd700 1 -- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 msgr2=0x7fdd18061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.611+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7fdd2007c120 con 0x7fdd2c154140 2024-01-21T20:14:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.611+0000 7fdd2affd700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 0x7fdd18061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:05.604 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:05.611+0000 7fb385d99680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.615+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd2004cf20 con 0x7fdd2c154140 2024-01-21T20:14:05.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.783+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd2c0c00f0 con 0x7fdd2c154140 2024-01-21T20:14:05.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.784+0000 7fdd137fe700 1 -- 172.21.15.133:0/4079090210 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v65) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd200280a0 con 0x7fdd2c154140 2024-01-21T20:14:05.773 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:14:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 msgr2=0x7fdd18061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 0x7fdd18061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 msgr2=0x7fdd2c141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fdd20009e00 tx=0x7fdd20017000).stop 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 shutdown_connections 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd1805f270 0x7fdd18061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2c154520 0x7fdd2c0abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2c0c8120 0x7fdd2c0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 --2- 172.21.15.133:0/4079090210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd2c154140 0x7fdd2c141cd0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.785+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 >> 172.21.15.133:0/4079090210 conn(0x7fdd2c05e1e0 msgr2=0x7fdd2c14d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.786+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 shutdown_connections 2024-01-21T20:14:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.786+0000 7fdd315c2700 1 -- 172.21.15.133:0/4079090210 wait complete. 2024-01-21T20:14:05.789 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:14:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.922+0000 7f3b823c4700 1 Processor -- start 2024-01-21T20:14:05.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.922+0000 7f3b823c4700 1 -- start start 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b823c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 0x7f3b7c0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b823c4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b7c0c39f0 0x7f3b7c0be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b823c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c0bfa40 con 0x7f3b7c0be5f0 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b823c4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c3e70 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b823c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0bee30 con 0x7f3b7c13b970 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b80961700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3b7c0be5f0 0x7f3b7c0c5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46578/0 (socket says 172.21.15.133:46578) 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b80961700 1 -- 172.21.15.133:0/2061340137 learned_addr learned my addr 172.21.15.133:0/2061340137 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 --2- 172.21.15.133:0/2061340137 >> v2:172.21.15.178:3300/0 conn(0x7f3b7c0c39f0 0x7f3b7c0be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7bfff700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 0x7f3b7c0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7affd700 1 -- 172.21.15.133:0/2061340137 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319838761 0 0) 0x7f3b7c0bfa40 con 0x7f3b7c0be5f0 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7affd700 1 -- 172.21.15.133:0/2061340137 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b640033f0 con 0x7f3b7c0be5f0 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 -- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 msgr2=0x7f3b7c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 0x7f3b7c0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 -- 172.21.15.133:0/2061340137 >> v1:172.21.15.133:6789/0 conn(0x7f3b7c0be5f0 legacy=0x7f3b7c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 -- 172.21.15.133:0/2061340137 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c0bf110 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7bfff700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 0x7f3b7c0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.923+0000 7f3b7b7fe700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c0be100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3b70009760 tx=0x7f3b70009060).ready entity=mon.1 client_cookie=d0ba471ba83f070a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b7affd700 1 -- 172.21.15.133:0/2061340137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700090d0 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b7affd700 1 -- 172.21.15.133:0/2061340137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7000d4a0 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b7affd700 1 -- 172.21.15.133:0/2061340137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000d820 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 -- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 msgr2=0x7f3b7c0be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c0be100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f3b70009760 tx=0x7f3b70009060).stop 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 -- 172.21.15.133:0/2061340137 shutdown_connections 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c13b970 0x7f3b7c0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2061340137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c0be100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 -- 172.21.15.133:0/2061340137 >> 172.21.15.133:0/2061340137 conn(0x7f3b7c066a70 msgr2=0x7f3b7c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 -- 172.21.15.133:0/2061340137 shutdown_connections 2024-01-21T20:14:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.924+0000 7f3b823c4700 1 -- 172.21.15.133:0/2061340137 wait complete. 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.926+0000 7f3b823c4700 1 Processor -- start 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.926+0000 7f3b823c4700 1 -- start start 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c0be5f0 0x7f3b7c137a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c165250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c152760 con 0x7f3b7c13b970 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c165c30 con 0x7f3b7c0c39f0 2024-01-21T20:14:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b823c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c0c0f70 con 0x7f3b7c0be5f0 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b7b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b7bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c0be5f0 0x7f3b7c137a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48068/0 (socket says 172.21.15.133:48068) 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 -- 172.21.15.133:0/2227711719 learned_addr learned my addr 172.21.15.133:0/2227711719 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 -- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c0be5f0 msgr2=0x7f3b7c137a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c0be5f0 0x7f3b7c137a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.927+0000 7f3b80961700 1 -- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 msgr2=0x7f3b7c165250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b80961700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c165250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b80961700 1 -- 172.21.15.133:0/2227711719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0092a0 con 0x7f3b7c13b970 2024-01-21T20:14:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b7b7fe700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b80961700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3b74005ad0 tx=0x7f3b740015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74005d30 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74005e90 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740072e0 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b700092a0 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.928+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c0c14f0 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.929+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c05fdf0 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.929+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3b740076d0 con 0x7f3b7c13b970 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.930+0000 7f3b78ff9700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 0x7f3b68061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.930+0000 7f3b7bfff700 1 -- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 msgr2=0x7f3b68061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.930+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6965+0+0 (secure 0 0 0) 0x7f3b74079fa0 con 0x7f3b7c13b970 2024-01-21T20:14:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.930+0000 7f3b7bfff700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 0x7f3b68061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:05.937+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3b7404ad40 con 0x7f3b7c13b970 2024-01-21T20:14:05.952 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:05.962+0000 7f7b757fe680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:06.044 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.054+0000 7fb385d99680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:06.055 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.065+0000 7f7b757fe680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:06.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.109+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b7c067850 con 0x7f3b7c13b970 2024-01-21T20:14:06.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.109+0000 7f3b78ff9700 1 -- 172.21.15.133:0/2227711719 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b7404e360 con 0x7f3b7c13b970 2024-01-21T20:14:06.099 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:14:06.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 msgr2=0x7f3b68061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:06.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 0x7f3b68061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 msgr2=0x7f3b7c165740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f3b74005ad0 tx=0x7f3b740015b0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 shutdown_connections 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3b6805f270 0x7f3b68061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b7c13b970 0x7f3b7c165740 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b7c0be5f0 0x7f3b7c137a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.111+0000 7f3b823c4700 1 --2- 172.21.15.133:0/2227711719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b7c0c39f0 0x7f3b7c165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.112+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 >> 172.21.15.133:0/2227711719 conn(0x7f3b7c066a70 msgr2=0x7f3b7c0c7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.112+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 shutdown_connections 2024-01-21T20:14:06.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.112+0000 7f3b823c4700 1 -- 172.21.15.133:0/2227711719 wait complete. 2024-01-21T20:14:06.113 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:14:06.155 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.165+0000 7fb385d99680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:06.210 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.220+0000 7f7b757fe680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 Processor -- start 2024-01-21T20:14:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 -- start start 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154140 0x7fc778158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7780c8120 0x7fc7780ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7780ab620 con 0x7fc778154520 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7780c6ae0 con 0x7fc7780c8120 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.261+0000 7fc77d47e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780c05e0 con 0x7fc778154140 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7780c8120 0x7fc7780ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7767fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc778154520 0x7fc7780c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46580/0 (socket says 172.21.15.133:46580) 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7767fc700 1 -- 172.21.15.133:0/3819364498 learned_addr learned my addr 172.21.15.133:0/3819364498 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 --2- 172.21.15.133:0/3819364498 >> v2:172.21.15.133:3300/0 conn(0x7fc7780c8120 0x7fc7780ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48076/0 (socket says 172.21.15.133:48076) 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc776ffd700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154140 0x7fc778158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 -- 172.21.15.133:0/3819364498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154140 msgr2=0x7fc778158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154140 0x7fc778158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 -- 172.21.15.133:0/3819364498 >> v1:172.21.15.133:6789/0 conn(0x7fc778154520 legacy=0x7fc7780c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc775ffb700 1 -- 172.21.15.133:0/3819364498 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281908542 0 0) 0x7fc7780ab620 con 0x7fc778154520 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 -- 172.21.15.133:0/3819364498 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780c0e40 con 0x7fc7780c8120 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc7777fe700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc7780ab130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fc770009e60 tx=0x7fc770009780).ready entity=mon.0 client_cookie=a51280a82f33ec5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc775ffb700 1 -- 172.21.15.133:0/3819364498 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77000e070 con 0x7fc7780c8120 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc775ffb700 1 -- 172.21.15.133:0/3819364498 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77000bb60 con 0x7fc7780c8120 2024-01-21T20:14:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.262+0000 7fc775ffb700 1 -- 172.21.15.133:0/3819364498 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770012410 con 0x7fc7780c8120 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 -- 172.21.15.133:0/3819364498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 msgr2=0x7fc7780ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc7780ab130 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fc770009e60 tx=0x7fc770009780).stop 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 -- 172.21.15.133:0/3819364498 shutdown_connections 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc7780ab130 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 --2- 172.21.15.133:0/3819364498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154140 0x7fc778158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 -- 172.21.15.133:0/3819364498 >> 172.21.15.133:0/3819364498 conn(0x7fc77805e1e0 msgr2=0x7fc77805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 -- 172.21.15.133:0/3819364498 shutdown_connections 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.263+0000 7fc77d47e700 1 -- 172.21.15.133:0/3819364498 wait complete. 2024-01-21T20:14:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.265+0000 7fc77d47e700 1 Processor -- start 2024-01-21T20:14:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.265+0000 7fc77d47e700 1 -- start start 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc778154140 0x7fc7781565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154520 0x7fc778156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778155e30 con 0x7fc7780c8120 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc778155870 con 0x7fc778154140 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc77d47e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc778155b50 con 0x7fc778154520 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48088/0 (socket says 172.21.15.133:48088) 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 -- 172.21.15.133:0/1149994940 learned_addr learned my addr 172.21.15.133:0/1149994940 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc7777fe700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154520 0x7fc778156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc7767fc700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc778154140 0x7fc7781565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 -- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154520 msgr2=0x7fc778156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154520 0x7fc778156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 -- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc778154140 msgr2=0x7fc7781565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc778154140 0x7fc7781565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.266+0000 7fc776ffd700 1 -- 172.21.15.133:0/1149994940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770009a20 con 0x7fc7780c8120 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc776ffd700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc76800e930 tx=0x7fc768009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768012600 con 0x7fc7780c8120 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768012760 con 0x7fc7780c8120 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768012ae0 con 0x7fc7780c8120 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7780ae1a0 con 0x7fc7780c8120 2024-01-21T20:14:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.267+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7781554d0 con 0x7fc7780c8120 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.268+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7780ae640 con 0x7fc7780c8120 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.269+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc76801b400 con 0x7fc7780c8120 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.269+0000 7fc75f7fe700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 0x7fc764061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.269+0000 7fc7767fc700 1 -- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 msgr2=0x7fc764061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.269+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fc76807b1b0 con 0x7fc7780c8120 2024-01-21T20:14:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.269+0000 7fc7767fc700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 0x7fc764061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.273+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc76804bf20 con 0x7fc7780c8120 2024-01-21T20:14:06.293 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.304+0000 7f7b757fe680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:06.327 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.337+0000 7fb385d99680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:06.360 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.370+0000 7f7b757fe680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:06.403 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.414+0000 7fb385d99680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.444+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7780ae7f0 con 0x7fc7780c8120 2024-01-21T20:14:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.445+0000 7fc75f7fe700 1 -- 172.21.15.133:0/1149994940 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc76804f540 con 0x7fc7780c8120 2024-01-21T20:14:06.434 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 msgr2=0x7fc764061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 0x7fc764061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 msgr2=0x7fc77814c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc76800e930 tx=0x7fc768009060).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 shutdown_connections 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc76405f270 0x7fc764061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc778154520 0x7fc778156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7780c8120 0x7fc77814c9a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 --2- 172.21.15.133:0/1149994940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc778154140 0x7fc7781565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 >> 172.21.15.133:0/1149994940 conn(0x7fc77805e1e0 msgr2=0x7fc7780c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 shutdown_connections 2024-01-21T20:14:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.447+0000 7fc77d47e700 1 -- 172.21.15.133:0/1149994940 wait complete. 2024-01-21T20:14:06.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:06.474 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.485+0000 7fb385d99680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:06.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.604+0000 7f66eba6a700 1 Processor -- start 2024-01-21T20:14:06.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.604+0000 7f66eba6a700 1 -- start start 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 0x7f66e4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66e40c6090 0x7f66e40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40c6ae0 con 0x7f66e40c6090 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40c05e0 con 0x7f66e4154140 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66eba6a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40ab620 con 0x7f66e4154520 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66e40c6090 0x7f66e40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66e40c6090 0x7f66e40c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48102/0 (socket says 172.21.15.133:48102) 2024-01-21T20:14:06.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 -- 172.21.15.133:0/2874838091 learned_addr learned my addr 172.21.15.133:0/2874838091 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66e9806700 1 --2- 172.21.15.133:0/2874838091 >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 0x7f66e4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66e9005700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 -- 172.21.15.133:0/2874838091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 msgr2=0x7f66e40ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 -- 172.21.15.133:0/2874838091 >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 msgr2=0x7f66e4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.605+0000 7f66ea007700 1 --2- 172.21.15.133:0/2874838091 >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 0x7f66e4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66ea007700 1 -- 172.21.15.133:0/2874838091 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40c0e40 con 0x7f66e40c6090 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66e9806700 1 --2- 172.21.15.133:0/2874838091 >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 0x7f66e4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66ea007700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e40c7a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f66e4083d70 tx=0x7f66dc009840).ready entity=mon.0 client_cookie=b473c9f169d1ba99 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66e8804700 1 -- 172.21.15.133:0/2874838091 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00e070 con 0x7f66e40c6090 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66e8804700 1 -- 172.21.15.133:0/2874838091 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc00b970 con 0x7f66e40c6090 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66e8804700 1 -- 172.21.15.133:0/2874838091 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00bcf0 con 0x7f66e40c6090 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 -- 172.21.15.133:0/2874838091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 msgr2=0x7f66e40c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e40c7a10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f66e4083d70 tx=0x7f66dc009840).stop 2024-01-21T20:14:06.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 -- 172.21.15.133:0/2874838091 shutdown_connections 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e40c7a10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2874838091 >> v2:172.21.15.178:3300/0 conn(0x7f66e4154140 0x7f66e4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2874838091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.606+0000 7f66eba6a700 1 -- 172.21.15.133:0/2874838091 >> 172.21.15.133:0/2874838091 conn(0x7f66e405e1e0 msgr2=0x7f66e405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.607+0000 7f66eba6a700 1 -- 172.21.15.133:0/2874838091 shutdown_connections 2024-01-21T20:14:06.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.607+0000 7f66eba6a700 1 -- 172.21.15.133:0/2874838091 wait complete. 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.608+0000 7f66eba6a700 1 Processor -- start 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.608+0000 7f66eba6a700 1 -- start start 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.608+0000 7f66eba6a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e4154140 0x7f66e40ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40ad160 con 0x7f66e40c6090 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4164f10 con 0x7f66e4154140 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e4164600 con 0x7f66e4154520 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48114/0 (socket says 172.21.15.133:48114) 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 -- 172.21.15.133:0/2069673177 learned_addr learned my addr 172.21.15.133:0/2069673177 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66ea007700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9005700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e4154140 0x7f66e40ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 msgr2=0x7f66e40acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40acc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e4154140 msgr2=0x7f66e40ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e4154140 0x7f66e40ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 -- 172.21.15.133:0/2069673177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00092a0 con 0x7f66e40c6090 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66e9806700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f66e000ea20 tx=0x7f66e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e000ee60 con 0x7f66e40c6090 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e000c7f0 con 0x7f66e40c6090 2024-01-21T20:14:06.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e000cb70 con 0x7f66e40c6090 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc009ae0 con 0x7f66e40c6090 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.609+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e41648c0 con 0x7f66e40c6090 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.610+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e41651f0 con 0x7f66e40c6090 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.611+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f66e001b400 con 0x7f66e40c6090 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.611+0000 7f66da777700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 0x7f66c8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.611+0000 7f66e9005700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 msgr2=0x7f66c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:06.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.611+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f66e007ac20 con 0x7f66e40c6090 2024-01-21T20:14:06.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.611+0000 7f66e9005700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 0x7f66c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:06.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.615+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f66e004ba40 con 0x7f66e40c6090 2024-01-21T20:14:06.615 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.626+0000 7f7b757fe680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:06.746 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.757+0000 7fb385d99680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:06.800 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:06.810+0000 7f7b757fe680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.812+0000 7f66e9005700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 msgr2=0x7f66c8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.812+0000 7f66e9005700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 0x7f66c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:06.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.828+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66e405fdf0 con 0x7f66e40c6090 2024-01-21T20:14:06.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.828+0000 7f66da777700 1 -- 172.21.15.133:0/2069673177 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f66e004f060 con 0x7f66e40c6090 2024-01-21T20:14:06.818 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:06.818 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 msgr2=0x7f66c8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 0x7f66c8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 msgr2=0x7f66e4135790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f66e000ea20 tx=0x7f66e0009060).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 shutdown_connections 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f66c805f270 0x7f66c8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66e4154520 0x7f66e40acc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66e40c6090 0x7f66e4135790 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 --2- 172.21.15.133:0/2069673177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66e4154140 0x7f66e40ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 >> 172.21.15.133:0/2069673177 conn(0x7f66e405e1e0 msgr2=0x7f66e40c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 shutdown_connections 2024-01-21T20:14:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.831+0000 7f66eba6a700 1 -- 172.21.15.133:0/2069673177 wait complete. 2024-01-21T20:14:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:14:06.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:06.938 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:06.949+0000 7fb385d99680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:06.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.964+0000 7f65e38ac700 1 Processor -- start 2024-01-21T20:14:06.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.964+0000 7f65e38ac700 1 -- start start 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e38ac700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65dc0c6040 0x7f65dc159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e38ac700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 0x7f65dc162360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e38ac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc068ef0 con 0x7f65dc152ba0 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e38ac700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc159c50 con 0x7f65dc0c6040 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e38ac700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc063b00 con 0x7f65dc067d90 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e1648700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f65dc152ba0 0x7f65dc0c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46582/0 (socket says 172.21.15.133:46582) 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.965+0000 7f65e1648700 1 -- 172.21.15.133:0/736579789 learned_addr learned my addr 172.21.15.133:0/736579789 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 --2- 172.21.15.133:0/736579789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 0x7f65dc162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e0e47700 1 --2- 172.21.15.133:0/736579789 >> v2:172.21.15.178:3300/0 conn(0x7f65dc0c6040 0x7f65dc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65d3fff700 1 -- 172.21.15.133:0/736579789 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336713967 0 0) 0x7f65dc068ef0 con 0x7f65dc152ba0 2024-01-21T20:14:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65d3fff700 1 -- 172.21.15.133:0/736579789 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c80033f0 con 0x7f65dc152ba0 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 -- 172.21.15.133:0/736579789 >> v2:172.21.15.178:3300/0 conn(0x7f65dc0c6040 msgr2=0x7f65dc159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 --2- 172.21.15.133:0/736579789 >> v2:172.21.15.178:3300/0 conn(0x7f65dc0c6040 0x7f65dc159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 -- 172.21.15.133:0/736579789 >> v1:172.21.15.133:6789/0 conn(0x7f65dc152ba0 legacy=0x7f65dc0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 -- 172.21.15.133:0/736579789 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0682e0 con 0x7f65dc067d90 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65e1e49700 1 --2- 172.21.15.133:0/736579789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 0x7f65dc162360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f65d4009e60 tx=0x7f65d4009780).ready entity=mon.2 client_cookie=b14cfdfd263ca530 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65d3fff700 1 -- 172.21.15.133:0/736579789 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d400e070 con 0x7f65dc067d90 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65d3fff700 1 -- 172.21.15.133:0/736579789 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d400bab0 con 0x7f65dc067d90 2024-01-21T20:14:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.966+0000 7f65d3fff700 1 -- 172.21.15.133:0/736579789 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d400be30 con 0x7f65dc067d90 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 -- 172.21.15.133:0/736579789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 msgr2=0x7f65dc162360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 --2- 172.21.15.133:0/736579789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 0x7f65dc162360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f65d4009e60 tx=0x7f65d4009780).stop 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 -- 172.21.15.133:0/736579789 shutdown_connections 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 --2- 172.21.15.133:0/736579789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc067d90 0x7f65dc162360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 --2- 172.21.15.133:0/736579789 >> v2:172.21.15.178:3300/0 conn(0x7f65dc0c6040 0x7f65dc159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 -- 172.21.15.133:0/736579789 >> 172.21.15.133:0/736579789 conn(0x7f65dc066a90 msgr2=0x7f65dc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 -- 172.21.15.133:0/736579789 shutdown_connections 2024-01-21T20:14:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.967+0000 7f65e38ac700 1 -- 172.21.15.133:0/736579789 wait complete. 2024-01-21T20:14:06.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.969+0000 7f65e38ac700 1 Processor -- start 2024-01-21T20:14:06.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.969+0000 7f65e38ac700 1 -- start start 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc0c6040 0x7f65dc13b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc152ba0 0x7f65dc157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0a9630 con 0x7f65dc067d90 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0a9910 con 0x7f65dc152ba0 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.970+0000 7f65e38ac700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc0a9bf0 con 0x7f65dc0c6040 2024-01-21T20:14:06.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48122/0 (socket says 172.21.15.133:48122) 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 -- 172.21.15.133:0/2220689810 learned_addr learned my addr 172.21.15.133:0/2220689810 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1e49700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc152ba0 0x7f65dc157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e0e47700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc0c6040 0x7f65dc13b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 -- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc0c6040 msgr2=0x7f65dc13b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc0c6040 0x7f65dc13b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 -- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc152ba0 msgr2=0x7f65dc157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc152ba0 0x7f65dc157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 -- 172.21.15.133:0/2220689810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4009a20 con 0x7f65dc067d90 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e1648700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f65d800c590 tx=0x7f65d8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80072e0 con 0x7f65dc067d90 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8007440 con 0x7f65dc067d90 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc0a9ed0 con 0x7f65dc067d90 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.971+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80057a0 con 0x7f65dc067d90 2024-01-21T20:14:06.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.972+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc13b590 con 0x7f65dc067d90 2024-01-21T20:14:06.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.972+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc05fdf0 con 0x7f65dc067d90 2024-01-21T20:14:06.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.973+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f65d8005bd0 con 0x7f65dc067d90 2024-01-21T20:14:06.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.973+0000 7f65d1ffb700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 0x7f65c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:06.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.973+0000 7f65e0e47700 1 -- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 msgr2=0x7f65c0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:06.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.973+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f65d8079c00 con 0x7f65dc067d90 2024-01-21T20:14:06.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.974+0000 7f65e0e47700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 0x7f65c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:06.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:06.977+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f65d804a910 con 0x7f65dc067d90 2024-01-21T20:14:07.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.148+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65dc158400 con 0x7f65dc067d90 2024-01-21T20:14:07.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.149+0000 7f65d1ffb700 1 -- 172.21.15.133:0/2220689810 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18360 (secure 0 0 0) 0x7f65d8018020 con 0x7f65dc067d90 2024-01-21T20:14:07.139 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:07.139 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":66,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:06.184406+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/428102360":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6833/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6832/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:0/3780247849":"2024-01-22T20:12:07.304572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 msgr2=0x7f65c0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 0x7f65c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 msgr2=0x7f65dc0aa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f65d800c590 tx=0x7f65d8007c80).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 shutdown_connections 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65c005f270 0x7f65c0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc152ba0 0x7f65dc157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65dc067d90 0x7f65dc0aa6d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 --2- 172.21.15.133:0/2220689810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc0c6040 0x7f65dc13b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 >> 172.21.15.133:0/2220689810 conn(0x7f65dc066a90 msgr2=0x7f65dc0c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 shutdown_connections 2024-01-21T20:14:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.151+0000 7f65e38ac700 1 -- 172.21.15.133:0/2220689810 wait complete. 2024-01-21T20:14:07.153 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:14:07.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.282+0000 7f269e2cd700 1 Processor -- start 2024-01-21T20:14:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.282+0000 7f269e2cd700 1 -- start start 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f269e2cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26980a9e30 0x7f26980c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f269e2cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2698065fb0 0x7f26980bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f269e2cd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26981511f0 con 0x7f26980bd140 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f269e2cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26980c2ff0 con 0x7f26980a9e30 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f269e2cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698065b20 con 0x7f2698065fb0 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f2697fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26980a9e30 0x7f26980c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f2697fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26980a9e30 0x7f26980c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48132/0 (socket says 172.21.15.133:48132) 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f2697fff700 1 -- 172.21.15.133:0/2616686558 learned_addr learned my addr 172.21.15.133:0/2616686558 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.283+0000 7f26977fe700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2698065fb0 0x7f26980bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2697fff700 1 -- 172.21.15.133:0/2616686558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2698065fb0 msgr2=0x7f26980bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2697fff700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2698065fb0 0x7f26980bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2697fff700 1 -- 172.21.15.133:0/2616686558 >> v1:172.21.15.178:6789/0 conn(0x7f26980bd140 legacy=0x7f26980626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2696ffd700 1 -- 172.21.15.133:0/2616686558 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032407228 0 0) 0x7f2690001490 con 0x7f26980bd140 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2697fff700 1 -- 172.21.15.133:0/2616686558 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26980c2240 con 0x7f26980a9e30 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2697fff700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980a9e30 0x7f26980c2b00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f2688006fd0 tx=0x7f26880090f0).ready entity=mon.0 client_cookie=aadcf573757bca57 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2696ffd700 1 -- 172.21.15.133:0/2616686558 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800b580 con 0x7f26980a9e30 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2696ffd700 1 -- 172.21.15.133:0/2616686558 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268800b6e0 con 0x7f26980a9e30 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f2696ffd700 1 -- 172.21.15.133:0/2616686558 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268800ba80 con 0x7f26980a9e30 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 -- 172.21.15.133:0/2616686558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980a9e30 msgr2=0x7f26980c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980a9e30 0x7f26980c2b00 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f2688006fd0 tx=0x7f26880090f0).stop 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 -- 172.21.15.133:0/2616686558 shutdown_connections 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980a9e30 0x7f26980c2b00 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 --2- 172.21.15.133:0/2616686558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2698065fb0 0x7f26980bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 -- 172.21.15.133:0/2616686558 >> 172.21.15.133:0/2616686558 conn(0x7f26980c8200 msgr2=0x7f26980c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 -- 172.21.15.133:0/2616686558 shutdown_connections 2024-01-21T20:14:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.284+0000 7f269e2cd700 1 -- 172.21.15.133:0/2616686558 wait complete. 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.286+0000 7f269e2cd700 1 Processor -- start 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.286+0000 7f269e2cd700 1 -- start start 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.286+0000 7f269e2cd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 0x7f269814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26981526e0 con 0x7f26980bd140 2024-01-21T20:14:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26981500d0 con 0x7f2698065fb0 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2698151db0 con 0x7f26980a9e30 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2697fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2697fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:35270/0 (socket says 172.21.15.133:35270) 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48144/0 (socket says 172.21.15.133:48144) 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2697fff700 1 -- 172.21.15.133:0/3465358793 learned_addr learned my addr 172.21.15.133:0/3465358793 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f26977fe700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 0x7f269814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 msgr2=0x7f269814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 0x7f269814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 msgr2=0x7f269814e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 -- 172.21.15.133:0/3465358793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688009370 con 0x7f26980bd140 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f26977fe700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 0x7f269814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2697fff700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269c86a700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f269000c7e0 tx=0x7f2690001480).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000f470 con 0x7f26980bd140 2024-01-21T20:14:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269000f5d0 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2698152090 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000f970 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.287+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269814fd20 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.288+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269805fdf0 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.289+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f2690012400 con 0x7f26980bd140 2024-01-21T20:14:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.289+0000 7f2694f74700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 0x7f2684061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.289+0000 7f2697fff700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 msgr2=0x7f2684061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.289+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f2690079c20 con 0x7f26980bd140 2024-01-21T20:14:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.289+0000 7f2697fff700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 0x7f2684061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:07.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.293+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2690048b00 con 0x7f26980bd140 2024-01-21T20:14:07.451 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.461+0000 7f7b757fe680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.490+0000 7f2697fff700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 msgr2=0x7f2684061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:07.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.490+0000 7f2697fff700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 0x7f2684061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:07.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.507+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26981511f0 con 0x7f26980bd140 2024-01-21T20:14:07.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.507+0000 7f2694f74700 1 -- 172.21.15.133:0/3465358793 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f26981511f0 con 0x7f26980bd140 2024-01-21T20:14:07.497 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:07.497 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 msgr2=0x7f2684061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 0x7f2684061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 msgr2=0x7f26980c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f269000c7e0 tx=0x7f2690001480).stop 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 shutdown_connections 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f268405f270 0x7f2684061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26980bd140 0x7f26980c54c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2698065fb0 0x7f269814e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 --2- 172.21.15.133:0/3465358793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26980a9e30 0x7f269814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 >> 172.21.15.133:0/3465358793 conn(0x7f26980c8200 msgr2=0x7f2698064fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 shutdown_connections 2024-01-21T20:14:07.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.509+0000 7f269e2cd700 1 -- 172.21.15.133:0/3465358793 wait complete. 2024-01-21T20:14:07.500 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:14:07.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:07.519 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.529+0000 7f7b757fe680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:07.593 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.603+0000 7f7b757fe680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:07.626 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:07.636+0000 7fb385d99680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:07.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.642+0000 7f4d66a20700 1 Processor -- start 2024-01-21T20:14:07.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.642+0000 7f4d66a20700 1 -- start start 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.643+0000 7f4d66a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137030 0x7f4d60067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.643+0000 7f4d66a20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d60137410 0x7f4d60155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.643+0000 7f4d66a20700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d601557f0 con 0x7f4d600c5930 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.643+0000 7f4d66a20700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60068370 con 0x7f4d60137410 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.643+0000 7f4d66a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60068650 con 0x7f4d60137030 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d60137410 0x7f4d60155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d60137410 0x7f4d60155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48160/0 (socket says 172.21.15.133:48160) 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3010691572 learned_addr learned my addr 172.21.15.133:0/3010691572 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5ffff700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137030 0x7f4d60067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3010691572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137030 msgr2=0x7f4d60067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137030 0x7f4d60067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3010691572 >> v1:172.21.15.178:6789/0 conn(0x7f4d600c5930 legacy=0x7f4d60157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3010691572 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60068930 con 0x7f4d60137410 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5f7fe700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60137410 0x7f4d60155300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f4d54006fd0 tx=0x7f4d540090f0).ready entity=mon.0 client_cookie=aebf9da5911202c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5effd700 1 -- 172.21.15.133:0/3010691572 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400b580 con 0x7f4d60137410 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5effd700 1 -- 172.21.15.133:0/3010691572 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400b6e0 con 0x7f4d60137410 2024-01-21T20:14:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.644+0000 7f4d5effd700 1 -- 172.21.15.133:0/3010691572 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400ba80 con 0x7f4d60137410 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 -- 172.21.15.133:0/3010691572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60137410 msgr2=0x7f4d60155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60137410 0x7f4d60155300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f4d54006fd0 tx=0x7f4d540090f0).stop 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 -- 172.21.15.133:0/3010691572 shutdown_connections 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137030 0x7f4d60067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3010691572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d60137410 0x7f4d60155300 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 -- 172.21.15.133:0/3010691572 >> 172.21.15.133:0/3010691572 conn(0x7f4d60066a90 msgr2=0x7f4d60066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 -- 172.21.15.133:0/3010691572 shutdown_connections 2024-01-21T20:14:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.645+0000 7f4d66a20700 1 -- 172.21.15.133:0/3010691572 wait complete. 2024-01-21T20:14:07.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.646+0000 7f4d66a20700 1 Processor -- start 2024-01-21T20:14:07.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.646+0000 7f4d66a20700 1 -- start start 2024-01-21T20:14:07.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d60137030 0x7f4d600ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137410 0x7f4d600acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60164730 con 0x7f4d600c5930 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6013cf70 con 0x7f4d60137030 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d66a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d60164940 con 0x7f4d60137410 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48164/0 (socket says 172.21.15.133:48164) 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d5ffff700 1 -- 172.21.15.133:0/3773771191 learned_addr learned my addr 172.21.15.133:0/3773771191 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d5f7fe700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d60137030 0x7f4d600ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.647+0000 7f4d64fbd700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137410 0x7f4d600acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137410 msgr2=0x7f4d600acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137410 0x7f4d600acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d60137030 msgr2=0x7f4d600ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d60137030 0x7f4d600ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 -- 172.21.15.133:0/3773771191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54009370 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5ffff700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f4d5000e930 tx=0x7f4d50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50012600 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50012760 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d60164be0 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50012ae0 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.648+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d601651a0 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.649+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4d5001b400 con 0x7f4d600c5930 2024-01-21T20:14:07.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.649+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d601657f0 con 0x7f4d600c5930 2024-01-21T20:14:07.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.650+0000 7f4d5cff9700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 0x7f4d4c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.650+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 msgr2=0x7f4d4c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:07.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.650+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7f4d5007abb0 con 0x7f4d600c5930 2024-01-21T20:14:07.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.650+0000 7f4d5f7fe700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 0x7f4d4c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:07.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.654+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d5004b920 con 0x7f4d600c5930 2024-01-21T20:14:07.700 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:07.711+0000 7fb385d99680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:07.739 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.750+0000 7f7b757fe680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:07.777 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:07.788+0000 7fb385d99680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:07.809 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.820+0000 7f7b757fe680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.851+0000 7f4d5f7fe700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 msgr2=0x7f4d4c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.851+0000 7f4d5f7fe700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 0x7f4d4c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:07.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.865+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d6005fdf0 con 0x7f4d600c5930 2024-01-21T20:14:07.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.865+0000 7f4d5cff9700 1 -- 172.21.15.133:0/3773771191 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4492 (secure 0 0 0) 0x7f4d5004ef40 con 0x7f4d600c5930 2024-01-21T20:14:07.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:07.855 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:11:56.409183+0000","modified":"2024-01-21T20:11:58.414842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5838},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5838":{"gid":5838,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/715878707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":715878707},{"type":"v1","addr":"172.21.15.133:6837","nonce":715878707}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2024-01-21T20:14:07.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 msgr2=0x7f4d4c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:07.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 0x7f4d4c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 msgr2=0x7f4d60167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f4d5000e930 tx=0x7f4d50009060).stop 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 shutdown_connections 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4d4c05f270 0x7f4d4c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d60137410 0x7f4d600acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d600c5930 0x7f4d60167300 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 --2- 172.21.15.133:0/3773771191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d60137030 0x7f4d600ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.867+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 >> 172.21.15.133:0/3773771191 conn(0x7f4d60066a90 msgr2=0x7f4d600c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.868+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 shutdown_connections 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.868+0000 7f4d66a20700 1 -- 172.21.15.133:0/3773771191 wait complete. 2024-01-21T20:14:07.858 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 18 2024-01-21T20:14:07.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:07.923 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:07.933+0000 7f7b757fe680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:07.931 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:07.942+0000 7fb385d99680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:07.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.998+0000 7ff471ac7700 1 Processor -- start 2024-01-21T20:14:07.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.998+0000 7ff471ac7700 1 -- start start 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff471ac7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff471ac7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 0x7ff46c13a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff471ac7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c067f10 con 0x7ff46c0c6220 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff471ac7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0681f0 con 0x7ff46c0c5dc0 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff471ac7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0684d0 con 0x7ff46c0c3840 2024-01-21T20:14:07.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff46affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 0x7ff46c13a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff46bfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff46c0c6220 0x7ff46c157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:55566/0 (socket says 172.21.15.133:55566) 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:40586/0 (socket says 172.21.15.133:40586) 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:07.999+0000 7ff46bfff700 1 -- 172.21.15.133:0/3482492755 learned_addr learned my addr 172.21.15.133:0/3482492755 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46a7fc700 1 -- 172.21.15.133:0/3482492755 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187732067 0 0) 0x7ff46c067f10 con 0x7ff46c0c6220 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46b7fe700 1 -- 172.21.15.133:0/3482492755 >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 msgr2=0x7ff46c13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46b7fe700 1 --2- 172.21.15.133:0/3482492755 >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 0x7ff46c13a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46b7fe700 1 -- 172.21.15.133:0/3482492755 >> v1:172.21.15.178:6789/0 conn(0x7ff46c0c6220 legacy=0x7ff46c157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46b7fe700 1 -- 172.21.15.133:0/3482492755 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0687b0 con 0x7ff46c0c3840 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46affd700 1 --2- 172.21.15.133:0/3482492755 >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 0x7ff46c13a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46b7fe700 1 --2- 172.21.15.133:0/3482492755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff45c009e60 tx=0x7ff45c009780).ready entity=mon.2 client_cookie=fc7dd57b60a1bd54 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46a7fc700 1 -- 172.21.15.133:0/3482492755 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00e070 con 0x7ff46c0c3840 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46a7fc700 1 -- 172.21.15.133:0/3482492755 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c00bb60 con 0x7ff46c0c3840 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff46a7fc700 1 -- 172.21.15.133:0/3482492755 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c012410 con 0x7ff46c0c3840 2024-01-21T20:14:07.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff471ac7700 1 -- 172.21.15.133:0/3482492755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 msgr2=0x7ff46c0c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.000+0000 7ff471ac7700 1 --2- 172.21.15.133:0/3482492755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff45c009e60 tx=0x7ff45c009780).stop 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 -- 172.21.15.133:0/3482492755 shutdown_connections 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 --2- 172.21.15.133:0/3482492755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c3840 0x7ff46c0c3c20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 --2- 172.21.15.133:0/3482492755 >> v2:172.21.15.178:3300/0 conn(0x7ff46c0c5dc0 0x7ff46c13a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 -- 172.21.15.133:0/3482492755 >> 172.21.15.133:0/3482492755 conn(0x7ff46c066a70 msgr2=0x7ff46c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 -- 172.21.15.133:0/3482492755 shutdown_connections 2024-01-21T20:14:07.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.001+0000 7ff471ac7700 1 -- 172.21.15.133:0/3482492755 wait complete. 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.002+0000 7ff471ac7700 1 Processor -- start 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.002+0000 7ff471ac7700 1 -- start start 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff46c0c5dc0 0x7ff46c165290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c6220 0x7ff46c139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1534d0 con 0x7ff46c0c3840 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0bffa0 con 0x7ff46c0c5dc0 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff471ac7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c165780 con 0x7ff46c0c6220 2024-01-21T20:14:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48178/0 (socket says 172.21.15.133:48178) 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 -- 172.21.15.133:0/2349258545 learned_addr learned my addr 172.21.15.133:0/2349258545 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46affd700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff46c0c5dc0 0x7ff46c165290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46bfff700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c6220 0x7ff46c139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 -- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c6220 msgr2=0x7ff46c139650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c6220 0x7ff46c139650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 -- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff46c0c5dc0 msgr2=0x7ff46c165290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff46c0c5dc0 0x7ff46c165290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 -- 172.21.15.133:0/2349258545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4600092a0 con 0x7ff46c0c3840 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff46b7fe700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff45c00b6c0 tx=0x7ff46c1548e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.003+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00bee0 con 0x7ff46c0c3840 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.004+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c01d420 con 0x7ff46c0c3840 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.004+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c009a20 con 0x7ff46c0c3840 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.004+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c01d7c0 con 0x7ff46c0c3840 2024-01-21T20:14:07.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.004+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c0ac770 con 0x7ff46c0c3840 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.005+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c05fdf0 con 0x7ff46c0c3840 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.005+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff45c003040 con 0x7ff46c0c3840 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.005+0000 7ff453fff700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 0x7ff458061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.006+0000 7ff46affd700 1 -- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 msgr2=0x7ff458061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.006+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7ff45c07c230 con 0x7ff46c0c3840 2024-01-21T20:14:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.006+0000 7ff46affd700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 0x7ff458061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:07.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.009+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff45c04d000 con 0x7ff46c0c3840 2024-01-21T20:14:08.005 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.016+0000 7fb385d99680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:08.031 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:08.041+0000 7f7b757fe680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:08.125 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.136+0000 7fb385d99680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:08.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.180+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff46c139f60 con 0x7ff46c0c3840 2024-01-21T20:14:08.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.181+0000 7ff453fff700 1 -- 172.21.15.133:0/2349258545 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18360 (secure 0 0 0) 0x7ff45c050620 con 0x7ff46c0c3840 2024-01-21T20:14:08.171 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:08.171 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":66,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:06.184406+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:11:54.065802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-01-21T20:11:55.381802+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.12","mappings":[{"from":0,"to":4}]},{"pgid":"7.32","mappings":[{"from":0,"to":5}]},{"pgid":"8.1","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/428102360":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6833/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:6832/43404":"2024-01-22T20:12:07.304572+0000","172.21.15.133:0/3780247849":"2024-01-22T20:12:07.304572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 msgr2=0x7ff458061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 0x7ff458061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 msgr2=0x7ff46c0abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7ff45c00b6c0 tx=0x7ff46c1548e0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 shutdown_connections 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff45805f270 0x7ff458061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff46c0c6220 0x7ff46c139650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff46c0c3840 0x7ff46c0abeb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 --2- 172.21.15.133:0/2349258545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff46c0c5dc0 0x7ff46c165290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 >> 172.21.15.133:0/2349258545 conn(0x7ff46c066a70 msgr2=0x7ff46c064000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 shutdown_connections 2024-01-21T20:14:08.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.183+0000 7ff471ac7700 1 -- 172.21.15.133:0/2349258545 wait complete. 2024-01-21T20:14:08.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:14:08.243 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.254+0000 7fb385d99680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.316+0000 7fe18817f700 1 Processor -- start 2024-01-21T20:14:08.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.317+0000 7fe18817f700 1 -- start start 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.317+0000 7fe18817f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1800beb30 0x7fe180155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe18817f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180065660 con 0x7fe1800c3fb0 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe18817f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180065f00 con 0x7fe180069ef0 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe18817f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800bef10 con 0x7fe1800beb30 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe18571a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe1800c3fb0 0x7fe1800697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46598/0 (socket says 172.21.15.133:46598) 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe18571a700 1 -- 172.21.15.133:0/335772254 learned_addr learned my addr 172.21.15.133:0/335772254 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe185f1b700 1 --2- 172.21.15.133:0/335772254 >> v2:172.21.15.178:3300/0 conn(0x7fe1800beb30 0x7fe180155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe184f19700 1 -- 172.21.15.133:0/335772254 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524644299 0 0) 0x7fe180065660 con 0x7fe1800c3fb0 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe184f19700 1 -- 172.21.15.133:0/335772254 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe16c0033f0 con 0x7fe1800c3fb0 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe185f1b700 1 -- 172.21.15.133:0/335772254 >> v1:172.21.15.178:6789/0 conn(0x7fe180069ef0 legacy=0x7fe180066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe185f1b700 1 -- 172.21.15.133:0/335772254 >> v1:172.21.15.133:6789/0 conn(0x7fe1800c3fb0 legacy=0x7fe1800697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe185f1b700 1 -- 172.21.15.133:0/335772254 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800c4740 con 0x7fe1800beb30 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe185f1b700 1 --2- 172.21.15.133:0/335772254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800beb30 0x7fe180155b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe17c009760 tx=0x7fe17c009060).ready entity=mon.1 client_cookie=496bfdbf7c14ff4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe184f19700 1 -- 172.21.15.133:0/335772254 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0090d0 con 0x7fe1800beb30 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe184f19700 1 -- 172.21.15.133:0/335772254 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00f510 con 0x7fe1800beb30 2024-01-21T20:14:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.318+0000 7fe184f19700 1 -- 172.21.15.133:0/335772254 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00f890 con 0x7fe1800beb30 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 -- 172.21.15.133:0/335772254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800beb30 msgr2=0x7fe180155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 --2- 172.21.15.133:0/335772254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800beb30 0x7fe180155b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe17c009760 tx=0x7fe17c009060).stop 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 -- 172.21.15.133:0/335772254 shutdown_connections 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 --2- 172.21.15.133:0/335772254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800beb30 0x7fe180155b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 -- 172.21.15.133:0/335772254 >> 172.21.15.133:0/335772254 conn(0x7fe1800c8010 msgr2=0x7fe1800c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 -- 172.21.15.133:0/335772254 shutdown_connections 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.319+0000 7fe18817f700 1 -- 172.21.15.133:0/335772254 wait complete. 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.320+0000 7fe18817f700 1 Processor -- start 2024-01-21T20:14:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.320+0000 7fe18817f700 1 -- start start 2024-01-21T20:14:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180069ef0 0x7fe180153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c3fb0 0x7fe180164d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c6570 con 0x7fe1800beb30 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801548c0 con 0x7fe1800c3fb0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18817f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180154ba0 con 0x7fe180069ef0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18571a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18571a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48188/0 (socket says 172.21.15.133:48188) 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18571a700 1 -- 172.21.15.133:0/2908673821 learned_addr learned my addr 172.21.15.133:0/2908673821 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe18671c700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c3fb0 0x7fe180164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.321+0000 7fe185f1b700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180069ef0 0x7fe180153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180069ef0 msgr2=0x7fe180153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180069ef0 0x7fe180153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c3fb0 msgr2=0x7fe180164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c3fb0 0x7fe180164d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 -- 172.21.15.133:0/2908673821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0092a0 con 0x7fe1800beb30 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18571a700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fe17000c590 tx=0x7fe170007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700072e0 con 0x7fe1800beb30 2024-01-21T20:14:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170007440 con 0x7fe1800beb30 2024-01-21T20:14:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1800c6200 con 0x7fe1800beb30 2024-01-21T20:14:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700057a0 con 0x7fe1800beb30 2024-01-21T20:14:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.322+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe180154400 con 0x7fe1800beb30 2024-01-21T20:14:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.323+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 21) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fe170005bd0 con 0x7fe1800beb30 2024-01-21T20:14:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.323+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800c6060 con 0x7fe1800beb30 2024-01-21T20:14:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.324+0000 7fe1767fc700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 0x7fe164061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.324+0000 7fe185f1b700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 msgr2=0x7fe164061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.324+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 7021+0+0 (secure 0 0 0) 0x7fe170079f20 con 0x7fe1800beb30 2024-01-21T20:14:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.324+0000 7fe185f1b700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 0x7fe164061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.328+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe1800c6060 con 0x7fe1800beb30 2024-01-21T20:14:08.322 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:08.333+0000 7f7b757fe680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:08.393 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:08.403+0000 7f7b757fe680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:08.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.525+0000 7fe185f1b700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 msgr2=0x7fe164061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:08.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.525+0000 7fe185f1b700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 0x7fe164061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:08.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.555+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe1800c6060 con 0x7fe1800beb30 2024-01-21T20:14:08.557 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.567+0000 7fb385d99680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:08.627 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.638+0000 7fb385d99680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.657+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 22) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fe17001bdb0 con 0x7fe1800beb30 2024-01-21T20:14:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.658+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 msgr2=0x7fe164061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:08.658+0000 7fe1767fc700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 0x7fe164061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:08.652 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:14:08.662+0000 7fefa2ef7700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:14:08.652 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:14:08.663+0000 7fefa2ef7700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:14:08.652 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:14:08.663+0000 7fefa2ef7700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:14:08.667 INFO:tasks.ceph.mds.c.smithi133.stderr: -4> 2024-01-21T20:14:08.662+0000 7fefa2ef7700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:14:08.667 INFO:tasks.ceph.mds.c.smithi133.stderr: -3> 2024-01-21T20:14:08.663+0000 7fefa2ef7700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:14:08.667 INFO:tasks.ceph.mds.c.smithi133.stderr: -1> 2024-01-21T20:14:08.663+0000 7fefa2ef7700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:14:08.687 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.719+0000 7fb2feb43700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.719+0000 7fb2feb43700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.719+0000 7fb2feb43700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.719+0000 7fb2feb43700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.719+0000 7fb2feb43700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.709 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.720+0000 7fb30234a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.710 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.720+0000 7fb30234a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.710 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.720+0000 7fb30234a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.710 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.720+0000 7fb30234a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:08.710 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:08.720+0000 7fb30234a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:09.185 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:14:09.196+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:14:09.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.205+0000 7fe1767fc700 1 -- 172.21.15.133:0/2908673821 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe170074140 con 0x7fe1800beb30 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 msgr2=0x7fe1800c0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fe17000c590 tx=0x7fe170007c80).stop 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 shutdown_connections 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f270 0x7fe164061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1800c3fb0 0x7fe180164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe180069ef0 0x7fe180153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 --2- 172.21.15.133:0/2908673821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800beb30 0x7fe1800c0500 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 >> 172.21.15.133:0/2908673821 conn(0x7fe1800c8010 msgr2=0x7fe1800626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:09.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 shutdown_connections 2024-01-21T20:14:09.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.207+0000 7fe18817f700 1 -- 172.21.15.133:0/2908673821 wait complete. 2024-01-21T20:14:09.198 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:14:09.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:14:09.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.341+0000 7efdc47e1700 1 Processor -- start 2024-01-21T20:14:09.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.341+0000 7efdc47e1700 1 -- start start 2024-01-21T20:14:09.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc47e1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efdbc13ac00 0x7efdbc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc47e1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc0c64d0 con 0x7efdbc0c3c20 2024-01-21T20:14:09.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc47e1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc067f10 con 0x7efdbc0c3840 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc47e1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0681f0 con 0x7efdbc13ac00 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc1d7c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efdbc0c3c20 0x7efdbc13a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46614/0 (socket says 172.21.15.133:46614) 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc1d7c700 1 -- 172.21.15.133:0/4048365335 learned_addr learned my addr 172.21.15.133:0/4048365335 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.342+0000 7efdc2d7e700 1 --2- 172.21.15.133:0/4048365335 >> v2:172.21.15.178:3300/0 conn(0x7efdbc13ac00 0x7efdbc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479365439 0 0) 0x7efdb8001110 con 0x7efdbc0c3c20 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda80033f0 con 0x7efdbc0c3c20 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113191185 0 0) 0x7efdbc067f10 con 0x7efdbc0c3840 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb8001110 con 0x7efdbc0c3840 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677691739 0 0) 0x7efda80033f0 con 0x7efdbc0c3c20 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 >> v2:172.21.15.178:3300/0 conn(0x7efdbc13ac00 msgr2=0x7efdbc15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 --2- 172.21.15.133:0/4048365335 >> v2:172.21.15.178:3300/0 conn(0x7efdbc13ac00 0x7efdbc15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 >> v1:172.21.15.178:6789/0 conn(0x7efdbc0c3840 legacy=0x7efdbc0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc0684d0 con 0x7efdbc0c3c20 2024-01-21T20:14:09.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7efdb8001600 con 0x7efdbc0c3c20 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 >> v1:172.21.15.133:6789/0 conn(0x7efdbc0c3c20 legacy=0x7efdbc13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efda8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efda8004690 0x7efda8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efda8005050 0x7efda800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc0681f0 con 0x7efda8003a70 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda800bfc0 con 0x7efda8005050 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda800c180 con 0x7efda8004690 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efda8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc2d7e700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efda8005050 0x7efda800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efda8004690 0x7efda8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 -- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efda8004690 msgr2=0x7efda8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efda8004690 0x7efda8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 -- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efda8005050 msgr2=0x7efda800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efda8005050 0x7efda800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc2d7e700 1 -- 172.21.15.133:0/4048365335 reap_dead start 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 -- 172.21.15.133:0/4048365335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80033f0 con 0x7efda8003a70 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efda8004690 0x7efda8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc257d700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efda8003e70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7efdac001890 tx=0x7efdac007bb0).ready entity=mon.0 client_cookie=a5edd288a97f37f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac007020 con 0x7efda8003a70 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac007180 con 0x7efda8003a70 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.343+0000 7efdc157b700 1 -- 172.21.15.133:0/4048365335 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac007500 con 0x7efda8003a70 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 -- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 msgr2=0x7efda8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efda8003e70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7efdac001890 tx=0x7efdac007bb0).stop 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 -- 172.21.15.133:0/4048365335 shutdown_connections 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 --2- 172.21.15.133:0/4048365335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efda8003e70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 -- 172.21.15.133:0/4048365335 >> 172.21.15.133:0/4048365335 conn(0x7efdbc066a70 msgr2=0x7efdbc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:09.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 -- 172.21.15.133:0/4048365335 shutdown_connections 2024-01-21T20:14:09.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.344+0000 7efdc47e1700 1 -- 172.21.15.133:0/4048365335 wait complete. 2024-01-21T20:14:09.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.345+0000 7efdc47e1700 1 Processor -- start 2024-01-21T20:14:09.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.345+0000 7efdc47e1700 1 -- start start 2024-01-21T20:14:09.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 0x7efdbc0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efdbc0acbf0 0x7efdbc0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc13bcb0 con 0x7efda8003a70 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc13dfe0 con 0x7efdbc0acbf0 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc47e1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc13bf00 con 0x7efdbc0c80a0 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc257d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc257d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48286/0 (socket says 172.21.15.133:48286) 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc257d700 1 -- 172.21.15.133:0/2071976555 learned_addr learned my addr 172.21.15.133:0/2071976555 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc2d7e700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efdbc0acbf0 0x7efdbc0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 0x7efdbc0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc257d700 1 -- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 msgr2=0x7efdbc0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.346+0000 7efdc257d700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 0x7efdbc0ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc257d700 1 -- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efdbc0acbf0 msgr2=0x7efdbc0ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc257d700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efdbc0acbf0 0x7efdbc0ae320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:09.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc257d700 1 -- 172.21.15.133:0/2071976555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc13c1e0 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 0x7efdbc0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc257d700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7efda800bf90 tx=0x7efdac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac018030 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac013670 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc0c78a0 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac013a10 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.347+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc0ac130 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.348+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc0c7ef0 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.348+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 22) v1 ==== 75270+0+0 (secure 0 0 0) 0x7efdac0123c0 con 0x7efda8003a70 2024-01-21T20:14:09.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.348+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7251+0+0 (secure 0 0 0) 0x7efdac07a820 con 0x7efda8003a70 2024-01-21T20:14:09.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.353+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efdac04b7f0 con 0x7efda8003a70 2024-01-21T20:14:09.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.561+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efdbc05fdf0 con 0x7efda8003a70 2024-01-21T20:14:09.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.660+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7efdac078350 con 0x7efda8003a70 2024-01-21T20:14:09.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.660+0000 7efdb2ffd700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 0x7efda00681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:09.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.660+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 0x7efda00681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:09.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:09.661+0000 7efdc1d7c700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 0x7efda00681d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7efdb8001730 tx=0x7efdb8009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.206+0000 7efdb2ffd700 1 -- 172.21.15.133:0/2071976555 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7efdac06b9a0 con 0x7efda8003a70 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 msgr2=0x7efda00681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 0x7efda00681d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7efdb8001730 tx=0x7efdb8009040).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 msgr2=0x7efdbc13daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7efda800bf90 tx=0x7efdac015000).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 shutdown_connections 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efda00302f0 0x7efda00681d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efdbc0acbf0 0x7efdbc0ae320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efda8003a70 0x7efdbc13daf0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 --2- 172.21.15.133:0/2071976555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdbc0c80a0 0x7efdbc0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 >> 172.21.15.133:0/2071976555 conn(0x7efdbc066a70 msgr2=0x7efdbc0beac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 shutdown_connections 2024-01-21T20:14:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.209+0000 7efdc47e1700 1 -- 172.21.15.133:0/2071976555 wait complete. 2024-01-21T20:14:10.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:14:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.349+0000 7f04611fd700 1 Processor -- start 2024-01-21T20:14:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.349+0000 7f04611fd700 1 -- start start 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f04611fd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f045c151f60 0x7f045c0a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f04611fd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0a6de0 con 0x7f045c152340 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f04611fd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c065e20 con 0x7f045c0656b0 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f04611fd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c065b40 con 0x7f045c151f60 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f045c151f60 0x7f045c0a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f045c151f60 0x7f045c0a68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42264/0 (socket says 172.21.15.133:42264) 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 -- 172.21.15.133:0/2357761084 learned_addr learned my addr 172.21.15.133:0/2357761084 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 -- 172.21.15.133:0/2357761084 >> v1:172.21.15.178:6789/0 conn(0x7f045c0656b0 legacy=0x7f045c063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 -- 172.21.15.133:0/2357761084 >> v1:172.21.15.133:6789/0 conn(0x7f045c152340 legacy=0x7f045c0bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 -- 172.21.15.133:0/2357761084 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0699e0 con 0x7f045c151f60 2024-01-21T20:14:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f045ad9d700 1 --2- 172.21.15.133:0/2357761084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0a68f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f044c006fd0 tx=0x7f044c0090f0).ready entity=mon.0 client_cookie=7c0230cc779c880f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f0459d9b700 1 -- 172.21.15.133:0/2357761084 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00b600 con 0x7f045c151f60 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f0459d9b700 1 -- 172.21.15.133:0/2357761084 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00b760 con 0x7f045c151f60 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.350+0000 7f0459d9b700 1 -- 172.21.15.133:0/2357761084 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00bb00 con 0x7f045c151f60 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 -- 172.21.15.133:0/2357761084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 msgr2=0x7f045c0a68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 --2- 172.21.15.133:0/2357761084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0a68f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f044c006fd0 tx=0x7f044c0090f0).stop 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 -- 172.21.15.133:0/2357761084 shutdown_connections 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 --2- 172.21.15.133:0/2357761084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0a68f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 -- 172.21.15.133:0/2357761084 >> 172.21.15.133:0/2357761084 conn(0x7f045c0c4a10 msgr2=0x7f045c068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 -- 172.21.15.133:0/2357761084 shutdown_connections 2024-01-21T20:14:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.351+0000 7f04611fd700 1 -- 172.21.15.133:0/2357761084 wait complete. 2024-01-21T20:14:10.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.352+0000 7f04611fd700 1 Processor -- start 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.352+0000 7f04611fd700 1 -- start start 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 0x7f045c165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 0x7f045c0aac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0c1aa0 con 0x7f045c151f60 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c165680 con 0x7f045c146b70 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f04611fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c151010 con 0x7f045c152340 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f045ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f045ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42270/0 (socket says 172.21.15.133:42270) 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f045ad9d700 1 -- 172.21.15.133:0/2053544748 learned_addr learned my addr 172.21.15.133:0/2053544748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f045b59e700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 0x7f045c0aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:10.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.353+0000 7f045a59c700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 0x7f045c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 -- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 msgr2=0x7f045c165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 0x7f045c165190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 -- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 msgr2=0x7f045c0aac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 0x7f045c0aac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 -- 172.21.15.133:0/2053544748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009370 con 0x7f045c151f60 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045b59e700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 0x7f045c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045a59c700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 0x7f045c165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f045ad9d700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f044c009f50 tx=0x7f044c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00b8d0 con 0x7f045c151f60 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00ba30 con 0x7f045c151f60 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c024680 con 0x7f045c151f60 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c1512f0 con 0x7f045c151f60 2024-01-21T20:14:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.354+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0c1fd0 con 0x7f045c151f60 2024-01-21T20:14:10.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.355+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c05fdf0 con 0x7f045c151f60 2024-01-21T20:14:10.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.355+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f044c021070 con 0x7f045c151f60 2024-01-21T20:14:10.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.356+0000 7f04437fe700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 0x7f04480614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:10.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.356+0000 7f045a59c700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 0x7f04480614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:10.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.356+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 7251+0+0 (secure 0 0 0) 0x7f044c07c090 con 0x7f045c151f60 2024-01-21T20:14:10.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.356+0000 7f045a59c700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 0x7f04480614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f045c0aa6f0 tx=0x7f0450009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:10.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.360+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f044c04d060 con 0x7f045c151f60 2024-01-21T20:14:10.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:10.524+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f045c069cc0 con 0x7f045c151f60 2024-01-21T20:14:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.208+0000 7f04437fe700 1 -- 172.21.15.133:0/2053544748 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f044c050680 con 0x7f045c151f60 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 msgr2=0x7f04480614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 0x7f04480614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f045c0aa6f0 tx=0x7f0450009040).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 msgr2=0x7f045c0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f044c009f50 tx=0x7f044c017000).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 shutdown_connections 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f044805f030 0x7f04480614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f045c146b70 0x7f045c0aac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f045c151f60 0x7f045c0acd30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 --2- 172.21.15.133:0/2053544748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f045c152340 0x7f045c165190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 >> 172.21.15.133:0/2053544748 conn(0x7f045c0c4a10 msgr2=0x7f045c0c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 shutdown_connections 2024-01-21T20:14:11.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.213+0000 7f04611fd700 1 -- 172.21.15.133:0/2053544748 wait complete. 2024-01-21T20:14:11.204 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:14:11.218 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:14:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.352+0000 7f8343e3b700 1 Processor -- start 2024-01-21T20:14:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.352+0000 7f8343e3b700 1 -- start start 2024-01-21T20:14:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8343e3b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f833c13a7b0 0x7f833c066b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8343e3b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c0c23b0 con 0x7f833c0bda90 2024-01-21T20:14:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8343e3b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833c067600 con 0x7f833c069be0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8343e3b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833c0663c0 con 0x7f833c13a7b0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8341bd7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f833c13a7b0 0x7f833c066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8341bd7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f833c13a7b0 0x7f833c066b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42272/0 (socket says 172.21.15.133:42272) 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f8341bd7700 1 -- 172.21.15.133:0/2514150511 learned_addr learned my addr 172.21.15.133:0/2514150511 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.353+0000 7f83413d6700 1 --1- 172.21.15.133:0/2514150511 >> v1:172.21.15.133:6789/0 conn(0x7f833c0bda90 0x7f833c0694d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36842/0 (socket says 172.21.15.133:36842) 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8341bd7700 1 -- 172.21.15.133:0/2514150511 >> v1:172.21.15.178:6789/0 conn(0x7f833c069be0 legacy=0x7f833c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8341bd7700 1 -- 172.21.15.133:0/2514150511 >> v1:172.21.15.133:6789/0 conn(0x7f833c0bda90 legacy=0x7f833c0694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8341bd7700 1 -- 172.21.15.133:0/2514150511 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0678e0 con 0x7f833c13a7b0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8341bd7700 1 --2- 172.21.15.133:0/2514150511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c13a7b0 0x7f833c066b90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f832c006fd0 tx=0x7f832c0090f0).ready entity=mon.0 client_cookie=513511dea17d5fb6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8340bd5700 1 -- 172.21.15.133:0/2514150511 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00b600 con 0x7f833c13a7b0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8340bd5700 1 -- 172.21.15.133:0/2514150511 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c00b760 con 0x7f833c13a7b0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8340bd5700 1 -- 172.21.15.133:0/2514150511 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00bae0 con 0x7f833c13a7b0 2024-01-21T20:14:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8343e3b700 1 -- 172.21.15.133:0/2514150511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c13a7b0 msgr2=0x7f833c066b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8343e3b700 1 --2- 172.21.15.133:0/2514150511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c13a7b0 0x7f833c066b90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f832c006fd0 tx=0x7f832c0090f0).stop 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8343e3b700 1 -- 172.21.15.133:0/2514150511 shutdown_connections 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8343e3b700 1 --2- 172.21.15.133:0/2514150511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c13a7b0 0x7f833c066b90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.354+0000 7f8343e3b700 1 -- 172.21.15.133:0/2514150511 >> 172.21.15.133:0/2514150511 conn(0x7f833c0c7d20 msgr2=0x7f833c0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.355+0000 7f8343e3b700 1 -- 172.21.15.133:0/2514150511 shutdown_connections 2024-01-21T20:14:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.355+0000 7f8343e3b700 1 -- 172.21.15.133:0/2514150511 wait complete. 2024-01-21T20:14:11.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 Processor -- start 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 -- start start 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f833c13a7b0 0x7f833c0aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f833c0ab690 0x7f833c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0a5de0 con 0x7f833c069be0 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0ac000 con 0x7f833c13a7b0 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.356+0000 7f8343e3b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c0a54d0 con 0x7f833c0ab690 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42278/0 (socket says 172.21.15.133:42278) 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 -- 172.21.15.133:0/3386329596 learned_addr learned my addr 172.21.15.133:0/3386329596 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 -- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f833c0ab690 msgr2=0x7f833c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f833c0ab690 0x7f833c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 -- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f833c13a7b0 msgr2=0x7f833c0aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f833c13a7b0 0x7f833c0aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 -- 172.21.15.133:0/3386329596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c009370 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8341bd7700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f833c0690e0 tx=0x7f832c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00b8d0 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c00ba30 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c01b660 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833c0a5790 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.357+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833c0aa510 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.358+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f833c0a5c30 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.359+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 23) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f832c01b9d0 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.359+0000 7f83327fc700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 0x7f83200614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.359+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6755+0+0 (secure 0 0 0) 0x7f832c07bd50 con 0x7f833c069be0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.359+0000 7f83413d6700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 0x7f83200614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.359+0000 7f83413d6700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 0x7f83200614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f833c139ee0 tx=0x7f83380079b0).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.363+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f832c04cf70 con 0x7f833c069be0 2024-01-21T20:14:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.526+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f833c05fdf0 con 0x7f833c069be0 2024-01-21T20:14:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:11.665+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f832c079a70 con 0x7f833c069be0 2024-01-21T20:14:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.212+0000 7f83327fc700 1 -- 172.21.15.133:0/3386329596 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f832c042840 con 0x7f833c069be0 2024-01-21T20:14:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 msgr2=0x7f83200614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 0x7f83200614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f833c139ee0 tx=0x7f83380079b0).stop 2024-01-21T20:14:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 msgr2=0x7f833c0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f833c0690e0 tx=0x7f832c017000).stop 2024-01-21T20:14:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 shutdown_connections 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f832005f030 0x7f83200614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f833c0ab690 0x7f833c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c069be0 0x7f833c0a6270 secure :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0x7f833c0690e0 tx=0x7f832c017000).stop 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 --2- 172.21.15.133:0/3386329596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f833c13a7b0 0x7f833c0aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.217+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 >> 172.21.15.133:0/3386329596 conn(0x7f833c0c7d20 msgr2=0x7f833c0c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.218+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 shutdown_connections 2024-01-21T20:14:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.218+0000 7f8343e3b700 1 -- 172.21.15.133:0/3386329596 wait complete. 2024-01-21T20:14:12.211 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:14:12.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:14:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.351+0000 7f17a1bf4700 1 Processor -- start 2024-01-21T20:14:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.352+0000 7f17a1bf4700 1 -- start start 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.352+0000 7f17a1bf4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f179c062e00 0x7f179c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.352+0000 7f17a1bf4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0654e0 con 0x7f179c13aa00 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.352+0000 7f17a1bf4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c158730 con 0x7f179c13a620 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.352+0000 7f17a1bf4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0bd6f0 con 0x7f179c062e00 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f179c13aa00 0x7f179c065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36852/0 (socket says 172.21.15.133:36852) 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179bfff700 1 -- 172.21.15.133:0/648028666 learned_addr learned my addr 172.21.15.133:0/648028666 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179affd700 1 --2- 172.21.15.133:0/648028666 >> v2:172.21.15.178:3300/0 conn(0x7f179c062e00 0x7f179c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199991001 0 0) 0x7f179c0654e0 con 0x7f179c13aa00 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17840033f0 con 0x7f179c13aa00 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1952164366 0 0) 0x7f17840033f0 con 0x7f179c13aa00 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 >> v2:172.21.15.178:3300/0 conn(0x7f179c062e00 msgr2=0x7f179c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 --2- 172.21.15.133:0/648028666 >> v2:172.21.15.178:3300/0 conn(0x7f179c062e00 0x7f179c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 >> v1:172.21.15.178:6789/0 conn(0x7f179c13a620 legacy=0x7f179c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c158a10 con 0x7f179c13aa00 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f17940017f0 con 0x7f179c13aa00 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 >> v1:172.21.15.133:6789/0 conn(0x7f179c13aa00 legacy=0x7f179c065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f1784003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784004690 0x7f1784004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1784005050 0x7f178400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0bd6f0 con 0x7f17840038e0 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178400bfe0 con 0x7f1784005050 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178400c1a0 con 0x7f1784004690 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179b7fe700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f1784003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179bfff700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1784005050 0x7f178400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.353+0000 7f179affd700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784004690 0x7f1784004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 -- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784004690 msgr2=0x7f1784004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784004690 0x7f1784004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 -- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1784005050 msgr2=0x7f178400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1784005050 0x7f178400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 -- 172.21.15.133:0/648028666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840033f0 con 0x7f17840038e0 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179bfff700 1 -- 172.21.15.133:0/648028666 reap_dead start 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179affd700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784004690 0x7f1784004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179b7fe700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f1784003d00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f1790001700 tx=0x7f1790007bb0).ready entity=mon.0 client_cookie=c8d19024495974e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790007020 con 0x7f17840038e0 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790007180 con 0x7f17840038e0 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f179a7fc700 1 -- 172.21.15.133:0/648028666 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790007520 con 0x7f17840038e0 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f17a1bf4700 1 -- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 msgr2=0x7f1784003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f1784003d00 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f1790001700 tx=0x7f1790007bb0).stop 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f17a1bf4700 1 -- 172.21.15.133:0/648028666 shutdown_connections 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/648028666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f1784003d00 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.354+0000 7f17a1bf4700 1 -- 172.21.15.133:0/648028666 >> 172.21.15.133:0/648028666 conn(0x7f179c0c7dc0 msgr2=0x7f179c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.355+0000 7f17a1bf4700 1 -- 172.21.15.133:0/648028666 shutdown_connections 2024-01-21T20:14:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.355+0000 7f17a1bf4700 1 -- 172.21.15.133:0/648028666 wait complete. 2024-01-21T20:14:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.356+0000 7f17a1bf4700 1 Processor -- start 2024-01-21T20:14:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.356+0000 7f17a1bf4700 1 -- start start 2024-01-21T20:14:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 0x7f179c0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 0x7f179c065cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0ab260 con 0x7f17840038e0 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c13b1d0 con 0x7f179c065870 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c13bd50 con 0x7f179c139970 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42294/0 (socket says 172.21.15.133:42294) 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 -- 172.21.15.133:0/3072867943 learned_addr learned my addr 172.21.15.133:0/3072867943 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179affd700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 0x7f179c0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179bfff700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 0x7f179c065cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 -- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 msgr2=0x7f179c0aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 0x7f179c0aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 -- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 msgr2=0x7f179c065cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 0x7f179c065cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 -- 172.21.15.133:0/3072867943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c139df0 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179affd700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 0x7f179c0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179bfff700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 0x7f179c065cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f179b7fe700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f17900069b0 tx=0x7f1790016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790001ea0 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790006f40 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c0661e0 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179001e6d0 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.357+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c13b700 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.358+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c13c030 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.358+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1790012400 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.359+0000 7f1783fff700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 0x7f1788061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.359+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f179007af40 con 0x7f17840038e0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.359+0000 7f179affd700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 0x7f1788061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.359+0000 7f179affd700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 0x7f1788061640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f178c009270 tx=0x7f178c008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.363+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f179004c110 con 0x7f17840038e0 2024-01-21T20:14:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.534+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f179c05fdf0 con 0x7f17840038e0 2024-01-21T20:14:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.538+0000 7f1783fff700 1 -- 172.21.15.133:0/3072867943 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1790023070 con 0x7f17840038e0 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 msgr2=0x7f1788061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 0x7f1788061640 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f178c009270 tx=0x7f178c008040).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 msgr2=0x7f179c13ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f17900069b0 tx=0x7f1790016000).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 shutdown_connections 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f178805f180 0x7f1788061640 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f179c065870 0x7f179c065cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17840038e0 0x7f179c13ddf0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 --2- 172.21.15.133:0/3072867943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f179c139970 0x7f179c0aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 >> 172.21.15.133:0/3072867943 conn(0x7f179c0c7dc0 msgr2=0x7f179c0c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 shutdown_connections 2024-01-21T20:14:12.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.540+0000 7f17a1bf4700 1 -- 172.21.15.133:0/3072867943 wait complete. 2024-01-21T20:14:12.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:14:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.670+0000 7f11912a0700 1 Processor -- start 2024-01-21T20:14:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.670+0000 7f11912a0700 1 -- start start 2024-01-21T20:14:12.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f11912a0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 0x7f118c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f11912a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f118c0aa0f0 0x7f118c063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f11912a0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c063750 con 0x7f118c0c4920 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f11912a0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c0640d0 con 0x7f118c0aa0f0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f11912a0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c05e380 con 0x7f118c0a9d10 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f118a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f118c0aa0f0 0x7f118c063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f118a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f118c0aa0f0 0x7f118c063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42308/0 (socket says 172.21.15.133:42308) 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.671+0000 7f118a7fc700 1 -- 172.21.15.133:0/1027936419 learned_addr learned my addr 172.21.15.133:0/1027936419 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118affd700 1 --2- 172.21.15.133:0/1027936419 >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 0x7f118c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118a7fc700 1 -- 172.21.15.133:0/1027936419 >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 msgr2=0x7f118c0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118a7fc700 1 --2- 172.21.15.133:0/1027936419 >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 0x7f118c0ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118a7fc700 1 -- 172.21.15.133:0/1027936419 >> v1:172.21.15.133:6789/0 conn(0x7f118c0c4920 legacy=0x7f118c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118a7fc700 1 -- 172.21.15.133:0/1027936419 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c05e660 con 0x7f118c0aa0f0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118affd700 1 --2- 172.21.15.133:0/1027936419 >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 0x7f118c0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f118a7fc700 1 --2- 172.21.15.133:0/1027936419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0aa0f0 0x7f118c063be0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f118c05f0d0 tx=0x7f117c0090f0).ready entity=mon.0 client_cookie=9b23fa49417c606d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f1189ffb700 1 -- 172.21.15.133:0/1027936419 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00b600 con 0x7f118c0aa0f0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f1189ffb700 1 -- 172.21.15.133:0/1027936419 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c00b760 con 0x7f118c0aa0f0 2024-01-21T20:14:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f1189ffb700 1 -- 172.21.15.133:0/1027936419 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c00bb00 con 0x7f118c0aa0f0 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 -- 172.21.15.133:0/1027936419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0aa0f0 msgr2=0x7f118c063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 --2- 172.21.15.133:0/1027936419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0aa0f0 0x7f118c063be0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f118c05f0d0 tx=0x7f117c0090f0).stop 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 -- 172.21.15.133:0/1027936419 shutdown_connections 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 --2- 172.21.15.133:0/1027936419 >> v2:172.21.15.178:3300/0 conn(0x7f118c0a9d10 0x7f118c0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 --2- 172.21.15.133:0/1027936419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0aa0f0 0x7f118c063be0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 -- 172.21.15.133:0/1027936419 >> 172.21.15.133:0/1027936419 conn(0x7f118c0c8200 msgr2=0x7f118c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 -- 172.21.15.133:0/1027936419 shutdown_connections 2024-01-21T20:14:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.672+0000 7f11912a0700 1 -- 172.21.15.133:0/1027936419 wait complete. 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.674+0000 7f11912a0700 1 Processor -- start 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.674+0000 7f11912a0700 1 -- start start 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 0x7f118c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 0x7f118c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c152df0 con 0x7f118c0c4920 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0bfbc0 con 0x7f118c0aa0f0 2024-01-21T20:14:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0bf600 con 0x7f118c0a9d10 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42314/0 (socket says 172.21.15.133:42314) 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 -- 172.21.15.133:0/2736013949 learned_addr learned my addr 172.21.15.133:0/2736013949 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118a7fc700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 0x7f118c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118affd700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 0x7f118c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 -- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 msgr2=0x7f118c150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 0x7f118c150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 -- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 msgr2=0x7f118c157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 0x7f118c157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 -- 172.21.15.133:0/2736013949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c009370 con 0x7f118c0c4920 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118a7fc700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 0x7f118c157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118affd700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 0x7f118c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f118b7fe700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f118400c7c0 tx=0x7f1184001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184010510 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1184010670 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0bf8e0 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.675+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840109f0 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.676+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c150d60 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c152fa0 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f118401b400 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f11737fe700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 0x7f1178061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f118407a040 con 0x7f118c0c4920 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f118affd700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 0x7f1178061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.677+0000 7f118affd700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 0x7f1178061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f118c0c39a0 tx=0x7f1180008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.681+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f118c152fa0 con 0x7f118c0c4920 2024-01-21T20:14:12.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.845+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f118c152f30 con 0x7f118c0c4920 2024-01-21T20:14:12.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.849+0000 7f11737fe700 1 -- 172.21.15.133:0/2736013949 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v9) v1 ==== 120+0+0 (secure 0 0 0) 0x7f118404b210 con 0x7f118c0c4920 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 msgr2=0x7f1178061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 0x7f1178061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f118c0c39a0 tx=0x7f1180008040).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 msgr2=0x7f118c158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f118400c7c0 tx=0x7f1184001510).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 shutdown_connections 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f117805f150 0x7f1178061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f118c0c4920 0x7f118c158370 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f118c0a9d10 0x7f118c150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 --2- 172.21.15.133:0/2736013949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f118c0aa0f0 0x7f118c157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 >> 172.21.15.133:0/2736013949 conn(0x7f118c0c8200 msgr2=0x7f118c0c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 shutdown_connections 2024-01-21T20:14:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.851+0000 7f11912a0700 1 -- 172.21.15.133:0/2736013949 wait complete. 2024-01-21T20:14:12.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2024-01-21T20:14:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.979+0000 7f549f9e6700 1 Processor -- start 2024-01-21T20:14:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.979+0000 7f549f9e6700 1 -- start start 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549f9e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5498137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549f9e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5498068370 con 0x7f5498067d90 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549f9e6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5498068650 con 0x7f5498137030 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549f9e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5498068930 con 0x7f54980c6040 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549cf81700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5498067d90 0x7f54980c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36882/0 (socket says 172.21.15.133:36882) 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549cf81700 1 -- 172.21.15.133:0/4023547561 learned_addr learned my addr 172.21.15.133:0/4023547561 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245828852 0 0) 0x7f5498068370 con 0x7f5498067d90 2024-01-21T20:14:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f549df83700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5498137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.980+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54840033f0 con 0x7f5498067d90 2024-01-21T20:14:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748966254 0 0) 0x7f54840033f0 con 0x7f5498067d90 2024-01-21T20:14:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 msgr2=0x7f5498137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5498137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 >> v1:172.21.15.178:6789/0 conn(0x7f5498137030 legacy=0x7f5498155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5498068c10 con 0x7f5498067d90 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f5494001470 con 0x7f5498067d90 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 >> v1:172.21.15.133:6789/0 conn(0x7f5498067d90 legacy=0x7f54980c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5484003910 0x7f5484003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5484004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5484004b80 0x7f5484005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498068930 con 0x7f5484004b80 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548400b9c0 con 0x7f5484003910 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548400bb80 con 0x7f54980c6040 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5484004b80 0x7f5484005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549cf81700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5484004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549d782700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5484003910 0x7f5484003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 -- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 msgr2=0x7f5484004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54980c6040 0x7f5484004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 -- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5484003910 msgr2=0x7f5484003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5484003910 0x7f5484003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 -- 172.21.15.133:0/4023547561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840033f0 con 0x7f5484004b80 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.981+0000 7f549df83700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5484004b80 0x7f5484005000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f54900094d0 tx=0x7f549000b040).ready entity=mon.0 client_cookie=2ec52f72ec484384 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490009ae0 con 0x7f5484004b80 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549000f040 con 0x7f5484004b80 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f548ffff700 1 -- 172.21.15.133:0/4023547561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549000ec60 con 0x7f5484004b80 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 -- 172.21.15.133:0/4023547561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5484004b80 msgr2=0x7f5484005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 --2- 172.21.15.133:0/4023547561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5484004b80 0x7f5484005000 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f54900094d0 tx=0x7f549000b040).stop 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549df83700 1 -- 172.21.15.133:0/4023547561 reap_dead start 2024-01-21T20:14:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 -- 172.21.15.133:0/4023547561 shutdown_connections 2024-01-21T20:14:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 -- 172.21.15.133:0/4023547561 >> 172.21.15.133:0/4023547561 conn(0x7f5498066a90 msgr2=0x7f5498066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 -- 172.21.15.133:0/4023547561 shutdown_connections 2024-01-21T20:14:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.982+0000 7f549f9e6700 1 -- 172.21.15.133:0/4023547561 wait complete. 2024-01-21T20:14:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.984+0000 7f549f9e6700 1 Processor -- start 2024-01-21T20:14:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.984+0000 7f549f9e6700 1 -- start start 2024-01-21T20:14:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5498135970 0x7f5498167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54981681d0 0x7f5498137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498168710 con 0x7f5498153a60 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ac940 con 0x7f54981681d0 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ac050 con 0x7f5498135970 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42338/0 (socket says 172.21.15.133:42338) 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 -- 172.21.15.133:0/1996363393 learned_addr learned my addr 172.21.15.133:0/1996363393 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549cf81700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5498135970 0x7f5498167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549df83700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54981681d0 0x7f5498137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 -- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5498135970 msgr2=0x7f5498167ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5498135970 0x7f5498167ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 -- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54981681d0 msgr2=0x7f5498137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54981681d0 0x7f5498137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 -- 172.21.15.133:0/1996363393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980ac2f0 con 0x7f5498153a60 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549d782700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f5488003f10 tx=0x7f5488007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880114c0 con 0x7f5498153a60 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488011620 con 0x7f5498153a60 2024-01-21T20:14:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54980ac5d0 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.985+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880119a0 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.986+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498154080 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.987+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549805fdf0 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.987+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5488011d10 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.987+0000 7f548dffb700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 0x7f547c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.987+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f5488079a90 con 0x7f5498153a60 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.987+0000 7f549cf81700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 0x7f547c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:12.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.988+0000 7f549cf81700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 0x7f547c061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f54940010e0 tx=0x7f5494001e50).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:12.991+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5488049b00 con 0x7f5498153a60 2024-01-21T20:14:13.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:13.217+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f549806bd20 con 0x7f5498153a60 2024-01-21T20:14:14.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.217+0000 7f548dffb700 1 -- 172.21.15.133:0/1996363393 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v532) v1 ==== 154+0+0 (secure 0 0 0) 0x7f548804ad70 con 0x7f5498153a60 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 msgr2=0x7f547c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 0x7f547c061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f54940010e0 tx=0x7f5494001e50).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 msgr2=0x7f54981677f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f5488003f10 tx=0x7f5488007bb0).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 shutdown_connections 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f547c05f150 0x7f547c061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54981681d0 0x7f5498137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5498153a60 0x7f54981677f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 --2- 172.21.15.133:0/1996363393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5498135970 0x7f5498167ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 >> 172.21.15.133:0/1996363393 conn(0x7f5498066a90 msgr2=0x7f54980c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 shutdown_connections 2024-01-21T20:14:14.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.220+0000 7f549f9e6700 1 -- 172.21.15.133:0/1996363393 wait complete. 2024-01-21T20:14:14.224 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2024-01-21T20:14:14.224 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2024-01-21T20:14:14.224 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:14:14.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2024-01-21T20:14:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.356+0000 7f2576bfb700 1 Processor -- start 2024-01-21T20:14:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 -- start start 2024-01-21T20:14:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25701521e0 0x7f25701525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2570065fd0 con 0x7f2570066460 2024-01-21T20:14:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2570063be0 con 0x7f25701521e0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2576bfb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700653c0 con 0x7f25700acbc0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.357+0000 7f2575198700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25701521e0 0x7f25701525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25701521e0 0x7f25701525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42348/0 (socket says 172.21.15.133:42348) 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 -- 172.21.15.133:0/3151942833 learned_addr learned my addr 172.21.15.133:0/3151942833 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 -- 172.21.15.133:0/3151942833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 msgr2=0x7f25700acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 --2- 172.21.15.133:0/3151942833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 -- 172.21.15.133:0/3151942833 >> v1:172.21.15.178:6789/0 conn(0x7f2570066460 legacy=0x7f25700634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 -- 172.21.15.133:0/3151942833 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700656a0 con 0x7f25701521e0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2575198700 1 --2- 172.21.15.133:0/3151942833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f25701525f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2568009f20 tx=0x7f2568009840).ready entity=mon.0 client_cookie=44970feea0d2f365 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f256f7fe700 1 -- 172.21.15.133:0/3151942833 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256800e070 con 0x7f25701521e0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f256f7fe700 1 -- 172.21.15.133:0/3151942833 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256800ba40 con 0x7f25701521e0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f256f7fe700 1 -- 172.21.15.133:0/3151942833 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256800bdc0 con 0x7f25701521e0 2024-01-21T20:14:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2576bfb700 1 -- 172.21.15.133:0/3151942833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 msgr2=0x7f25701525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.358+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3151942833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f25701525f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f2568009f20 tx=0x7f2568009840).stop 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 -- 172.21.15.133:0/3151942833 shutdown_connections 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3151942833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f25701525f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3151942833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 -- 172.21.15.133:0/3151942833 >> 172.21.15.133:0/3151942833 conn(0x7f25700c8200 msgr2=0x7f25700c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 -- 172.21.15.133:0/3151942833 shutdown_connections 2024-01-21T20:14:14.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.359+0000 7f2576bfb700 1 -- 172.21.15.133:0/3151942833 wait complete. 2024-01-21T20:14:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.360+0000 7f2576bfb700 1 Processor -- start 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.360+0000 7f2576bfb700 1 -- start start 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 0x7f257014f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257014dc30 con 0x7f25701521e0 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2570152790 con 0x7f2570066460 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2576bfb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25701631b0 con 0x7f25700acbc0 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2575198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2575198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42352/0 (socket says 172.21.15.133:42352) 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.361+0000 7f2575198700 1 -- 172.21.15.133:0/3869823405 learned_addr learned my addr 172.21.15.133:0/3869823405 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2574997700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 0x7f257014f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f256ffff700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 -- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 msgr2=0x7f25700be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 -- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 msgr2=0x7f257014f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 0x7f257014f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 -- 172.21.15.133:0/3869823405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568009ae0 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f256ffff700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2574997700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 0x7f257014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2575198700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f25700687b0 tx=0x7f2568009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25680092e0 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256801d410 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256801d810 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2570162bf0 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.362+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257014d850 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.363+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257014dd70 con 0x7f25701521e0 2024-01-21T20:14:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.363+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f256801dc40 con 0x7f25701521e0 2024-01-21T20:14:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.364+0000 7f256d7fa700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 0x7f2554061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.364+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f256807bfb0 con 0x7f25701521e0 2024-01-21T20:14:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.364+0000 7f2574997700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 0x7f2554061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.364+0000 7f2574997700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 0x7f2554061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2570155d60 tx=0x7f2564008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.368+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f25680aab00 con 0x7f25701521e0 2024-01-21T20:14:14.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:14.595+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f257005fdf0 con 0x7f25701521e0 2024-01-21T20:14:15.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.223+0000 7f256d7fa700 1 -- 172.21.15.133:0/3869823405 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v533) v1 ==== 159+0+0 (secure 0 0 0) 0x7f257014dd70 con 0x7f25701521e0 2024-01-21T20:14:15.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.225+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 msgr2=0x7f2554061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.225+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 0x7f2554061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2570155d60 tx=0x7f2564008040).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 msgr2=0x7f2570162210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f25700687b0 tx=0x7f2568009840).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 shutdown_connections 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f255405f150 0x7f2554061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25701521e0 0x7f2570162210 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2570066460 0x7f257014f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 --2- 172.21.15.133:0/3869823405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25700acbc0 0x7f25700be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 >> 172.21.15.133:0/3869823405 conn(0x7f25700c8200 msgr2=0x7f25700c3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 shutdown_connections 2024-01-21T20:14:15.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.226+0000 7f2576bfb700 1 -- 172.21.15.133:0/3869823405 wait complete. 2024-01-21T20:14:15.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:14:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.364+0000 7fda22752700 1 Processor -- start 2024-01-21T20:14:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.364+0000 7fda22752700 1 -- start start 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda1c0beb30 0x7fda1c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda1c0c3fb0 0x7fda1c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c069cd0 0x7fda1c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c0bef10 con 0x7fda1c0beb30 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c156070 con 0x7fda1c0c3fb0 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda22752700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c065660 con 0x7fda1c069cd0 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda1c0beb30 0x7fda1c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda1c0beb30 0x7fda1c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42368/0 (socket says 172.21.15.133:42368) 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda1bfff700 1 -- 172.21.15.133:0/2623630929 learned_addr learned my addr 172.21.15.133:0/2623630929 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda20cef700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c069cd0 0x7fda1c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.365+0000 7fda1b7fe700 1 --2- 172.21.15.133:0/2623630929 >> v2:172.21.15.178:3300/0 conn(0x7fda1c0c3fb0 0x7fda1c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 -- 172.21.15.133:0/2623630929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c069cd0 msgr2=0x7fda1c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c069cd0 0x7fda1c151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 -- 172.21.15.133:0/2623630929 >> v2:172.21.15.178:3300/0 conn(0x7fda1c0c3fb0 msgr2=0x7fda1c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 --2- 172.21.15.133:0/2623630929 >> v2:172.21.15.178:3300/0 conn(0x7fda1c0c3fb0 0x7fda1c0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 -- 172.21.15.133:0/2623630929 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c065f00 con 0x7fda1c0beb30 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1bfff700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c0beb30 0x7fda1c155b80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fda1c05ecd0 tx=0x7fda040090f0).ready entity=mon.0 client_cookie=a370b5e06ba8e796 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1affd700 1 -- 172.21.15.133:0/2623630929 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400b600 con 0x7fda1c0beb30 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1affd700 1 -- 172.21.15.133:0/2623630929 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b760 con 0x7fda1c0beb30 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda1affd700 1 -- 172.21.15.133:0/2623630929 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400bb00 con 0x7fda1c0beb30 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 -- 172.21.15.133:0/2623630929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c0beb30 msgr2=0x7fda1c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c0beb30 0x7fda1c155b80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fda1c05ecd0 tx=0x7fda040090f0).stop 2024-01-21T20:14:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 -- 172.21.15.133:0/2623630929 shutdown_connections 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c069cd0 0x7fda1c151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 --2- 172.21.15.133:0/2623630929 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c0beb30 0x7fda1c155b80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 --2- 172.21.15.133:0/2623630929 >> v2:172.21.15.178:3300/0 conn(0x7fda1c0c3fb0 0x7fda1c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 -- 172.21.15.133:0/2623630929 >> 172.21.15.133:0/2623630929 conn(0x7fda1c0c8010 msgr2=0x7fda1c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 -- 172.21.15.133:0/2623630929 shutdown_connections 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.366+0000 7fda22752700 1 -- 172.21.15.133:0/2623630929 wait complete. 2024-01-21T20:14:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.368+0000 7fda22752700 1 Processor -- start 2024-01-21T20:14:15.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.368+0000 7fda22752700 1 -- start start 2024-01-21T20:14:15.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.368+0000 7fda22752700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda1c0beb30 0x7fda1c0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c0c3fb0 0x7fda1c153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0c0130 con 0x7fda1c069cd0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0bf520 con 0x7fda1c0beb30 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c0bf800 con 0x7fda1c0c3fb0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42372/0 (socket says 172.21.15.133:42372) 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 -- 172.21.15.133:0/1968574009 learned_addr learned my addr 172.21.15.133:0/1968574009 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda20cef700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c0c3fb0 0x7fda1c153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 -- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c0c3fb0 msgr2=0x7fda1c153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c0c3fb0 0x7fda1c153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 -- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda1c0beb30 msgr2=0x7fda1c0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda1c0beb30 0x7fda1c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 -- 172.21.15.133:0/1968574009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009370 con 0x7fda1c069cd0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda1bfff700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fda1c068a00 tx=0x7fda04017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400bec0 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400b8d0 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1c0bfae0 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04024470 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.369+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c0bf0b0 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.370+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c0bf2d0 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.371+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fda04021070 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.371+0000 7fda18ff9700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 0x7fd9fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.371+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fda0407bc10 con 0x7fda1c069cd0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.371+0000 7fda1b7fe700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 0x7fd9fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.371+0000 7fda1b7fe700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 0x7fd9fc061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fda1c0c59d0 tx=0x7fda0c008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.375+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fda0404cef0 con 0x7fda1c069cd0 2024-01-21T20:14:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.537+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fda1c05fdf0 con 0x7fda1c069cd0 2024-01-21T20:14:15.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.541+0000 7fda18ff9700 1 -- 172.21.15.133:0/1968574009 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda1c05fdf0 con 0x7fda1c069cd0 2024-01-21T20:14:15.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 msgr2=0x7fd9fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 0x7fd9fc061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fda1c0c59d0 tx=0x7fda0c008040).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 msgr2=0x7fda1c0c1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fda1c068a00 tx=0x7fda04017000).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 shutdown_connections 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd9fc05f150 0x7fd9fc061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda1c0c3fb0 0x7fda1c153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda1c069cd0 0x7fda1c0c1780 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 --2- 172.21.15.133:0/1968574009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda1c0beb30 0x7fda1c0c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 >> 172.21.15.133:0/1968574009 conn(0x7fda1c0c8010 msgr2=0x7fda1c13aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:15.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 shutdown_connections 2024-01-21T20:14:15.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.543+0000 7fda22752700 1 -- 172.21.15.133:0/1968574009 wait complete. 2024-01-21T20:14:15.544 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:14:15.544 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:15.592 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:15.649 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:14:15.649 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:14:15.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.775+0000 7fdae6f0f700 1 Processor -- start 2024-01-21T20:14:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.775+0000 7fdae6f0f700 1 -- start start 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdae6f0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdae0069ef0 0x7fdae0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdae6f0f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae0065660 con 0x7fdae00c3fb0 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdae6f0f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae0065f00 con 0x7fdae00beb30 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdae6f0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae00bef10 con 0x7fdae0069ef0 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdadffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdae0069ef0 0x7fdae0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdadffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdae0069ef0 0x7fdae0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42380/0 (socket says 172.21.15.133:42380) 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdadffff700 1 -- 172.21.15.133:0/3097726441 learned_addr learned my addr 172.21.15.133:0/3097726441 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdae54ac700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdae00c3fb0 0x7fdae0066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36898/0 (socket says 172.21.15.133:36898) 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdadffff700 1 -- 172.21.15.133:0/3097726441 >> v1:172.21.15.178:6789/0 conn(0x7fdae00beb30 legacy=0x7fdae00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.776+0000 7fdadffff700 1 -- 172.21.15.133:0/3097726441 >> v1:172.21.15.133:6789/0 conn(0x7fdae00c3fb0 legacy=0x7fdae0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdadffff700 1 -- 172.21.15.133:0/3097726441 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae00c4740 con 0x7fdae0069ef0 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdadffff700 1 --2- 172.21.15.133:0/3097726441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae0069ef0 0x7fdae0155b80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fdacc006fd0 tx=0x7fdacc0090f0).ready entity=mon.0 client_cookie=94962cff4c722450 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdadf7fe700 1 -- 172.21.15.133:0/3097726441 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00b600 con 0x7fdae0069ef0 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdadf7fe700 1 -- 172.21.15.133:0/3097726441 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00b760 con 0x7fdae0069ef0 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdadf7fe700 1 -- 172.21.15.133:0/3097726441 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00bb00 con 0x7fdae0069ef0 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 -- 172.21.15.133:0/3097726441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae0069ef0 msgr2=0x7fdae0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/3097726441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae0069ef0 0x7fdae0155b80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fdacc006fd0 tx=0x7fdacc0090f0).stop 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 -- 172.21.15.133:0/3097726441 shutdown_connections 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/3097726441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae0069ef0 0x7fdae0155b80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 -- 172.21.15.133:0/3097726441 >> 172.21.15.133:0/3097726441 conn(0x7fdae00c8010 msgr2=0x7fdae00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 -- 172.21.15.133:0/3097726441 shutdown_connections 2024-01-21T20:14:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.777+0000 7fdae6f0f700 1 -- 172.21.15.133:0/3097726441 wait complete. 2024-01-21T20:14:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.778+0000 7fdae6f0f700 1 Processor -- start 2024-01-21T20:14:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 -- start start 2024-01-21T20:14:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdae0069ef0 0x7fdae012fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdae00beb30 0x7fdae0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0155c40 con 0x7fdae00c3fb0 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0162d70 con 0x7fdae00beb30 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.779+0000 7fdae6f0f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae0163010 con 0x7fdae0069ef0 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42392/0 (socket says 172.21.15.133:42392) 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 -- 172.21.15.133:0/2651372075 learned_addr learned my addr 172.21.15.133:0/2651372075 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdadffff700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdae00beb30 0x7fdae0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae4cab700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdae0069ef0 0x7fdae012fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 -- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdae0069ef0 msgr2=0x7fdae012fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdae0069ef0 0x7fdae012fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 -- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdae00beb30 msgr2=0x7fdae0155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdae00beb30 0x7fdae0155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 -- 172.21.15.133:0/2651372075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009370 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae54ac700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fdad800c790 tx=0x7fdad80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8005c70 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad8005dd0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae01632f0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8007320 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.780+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae01638b0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.781+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae0163ad0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.781+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdad80076d0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.782+0000 7fdadd7fa700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 0x7fdac4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.782+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6283+0+0 (secure 0 0 0) 0x7fdad807a110 con 0x7fdae00c3fb0 2024-01-21T20:14:15.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.782+0000 7fdae4cab700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 0x7fdac4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:15.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.782+0000 7fdae4cab700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 0x7fdac4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdad4003860 tx=0x7fdad4007d40).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.786+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdad804b340 con 0x7fdae00c3fb0 2024-01-21T20:14:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.991+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdae01300c0 con 0x7fdae00c3fb0 2024-01-21T20:14:15.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.992+0000 7fdadd7fa700 1 -- 172.21.15.133:0/2651372075 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fdad804e960 con 0x7fdae00c3fb0 2024-01-21T20:14:15.981 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:15.981 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/392740783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":392740783},{"type":"v1","addr":"172.21.15.133:6836","nonce":392740783}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5093,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2553059535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2553059535},{"type":"v1","addr":"172.21.15.178:6834","nonce":2553059535}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5096,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/946545288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":946545288},{"type":"v1","addr":"172.21.15.178:6835","nonce":946545288}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":5695,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3518857980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3518857980},{"type":"v1","addr":"172.21.15.133:6837","nonce":3518857980}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2024-01-21T20:14:15.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.993+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 msgr2=0x7fdac4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.993+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 0x7fdac4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdad4003860 tx=0x7fdad4007d40).stop 2024-01-21T20:14:15.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.993+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 msgr2=0x7fdae0155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:15.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.993+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fdad800c790 tx=0x7fdad80015e0).stop 2024-01-21T20:14:15.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 shutdown_connections 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdac405f150 0x7fdac4061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdae00c3fb0 0x7fdae0155750 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdae0069ef0 0x7fdae012fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 --2- 172.21.15.133:0/2651372075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdae00beb30 0x7fdae0155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 >> 172.21.15.133:0/2651372075 conn(0x7fdae00c8010 msgr2=0x7fdae00bdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 shutdown_connections 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:15.994+0000 7fdae6f0f700 1 -- 172.21.15.133:0/2651372075 wait complete. 2024-01-21T20:14:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 20 2024-01-21T20:14:15.995 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:14:15.995 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:14:15.996 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:14:15.996 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:15.996 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:14:15.996 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:14:15.996 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:14:15.996 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:15.996 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:14:15.997 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:14:15.997 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:14:15.997 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:15.997 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:14:15.997 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:14:15.997 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:14:15.997 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:16.004 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:14:16.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:14:16.005 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:14:16.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:14:16.008 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:14:16.008 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:14:16.009 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:14:16.009 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:14:16.046 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:14:16.047 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:16.047 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:14:16.047 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:16.051 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:14:16.051 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:16.052 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:14:16.052 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:16.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:14:16.124 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:14:16.124 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:14:16.137 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:14:16.137 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.188+0000 7f2a87b3e700 1 Processor -- start 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.189+0000 7f2a87b3e700 1 -- start start 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.189+0000 7f2a87b3e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a801559d0 0x7f2a800c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.189+0000 7f2a87b3e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a80154d80 0x7f2a800a4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.189+0000 7f2a87b3e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800c3740 con 0x7f2a801549a0 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.189+0000 7f2a87b3e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800c22e0 con 0x7f2a801559d0 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a87b3e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800c25c0 con 0x7f2a80154d80 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a801559d0 0x7f2a800c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a801559d0 0x7f2a800c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42448/0 (socket says 172.21.15.133:42448) 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 -- 172.21.15.133:0/451001619 learned_addr learned my addr 172.21.15.133:0/451001619 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a860db700 1 --2- 172.21.15.133:0/451001619 >> v2:172.21.15.178:3300/0 conn(0x7f2a80154d80 0x7f2a800a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 -- 172.21.15.133:0/451001619 >> v2:172.21.15.178:3300/0 conn(0x7f2a80154d80 msgr2=0x7f2a800a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 --2- 172.21.15.133:0/451001619 >> v2:172.21.15.178:3300/0 conn(0x7f2a80154d80 0x7f2a800a4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 -- 172.21.15.133:0/451001619 >> v1:172.21.15.178:6789/0 conn(0x7f2a801549a0 legacy=0x7f2a801552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 -- 172.21.15.133:0/451001619 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800c28a0 con 0x7f2a801559d0 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a850d9700 1 --2- 172.21.15.133:0/451001619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800c3250 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f2a80067fd0 tx=0x7f2a7c0090f0).ready entity=mon.0 client_cookie=ac6b5d14c7ace1e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a848d8700 1 -- 172.21.15.133:0/451001619 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00b600 con 0x7f2a801559d0 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a848d8700 1 -- 172.21.15.133:0/451001619 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00b760 con 0x7f2a801559d0 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.190+0000 7f2a848d8700 1 -- 172.21.15.133:0/451001619 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00bb00 con 0x7f2a801559d0 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 -- 172.21.15.133:0/451001619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 msgr2=0x7f2a800c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/451001619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800c3250 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f2a80067fd0 tx=0x7f2a7c0090f0).stop 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 -- 172.21.15.133:0/451001619 shutdown_connections 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/451001619 >> v2:172.21.15.178:3300/0 conn(0x7f2a80154d80 0x7f2a800a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/451001619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800c3250 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 -- 172.21.15.133:0/451001619 >> 172.21.15.133:0/451001619 conn(0x7f2a800c6ef0 msgr2=0x7f2a800c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 -- 172.21.15.133:0/451001619 shutdown_connections 2024-01-21T20:14:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.191+0000 7f2a87b3e700 1 -- 172.21.15.133:0/451001619 wait complete. 2024-01-21T20:14:16.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.192+0000 7f2a87b3e700 1 Processor -- start 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 -- start start 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a801549a0 0x7f2a800abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a80154d80 0x7f2a80151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800aab30 con 0x7f2a801559d0 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ac3f0 con 0x7f2a80154d80 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.193+0000 7f2a87b3e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80151710 con 0x7f2a801549a0 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42458/0 (socket says 172.21.15.133:42458) 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 -- 172.21.15.133:0/790618982 learned_addr learned my addr 172.21.15.133:0/790618982 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a850d9700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a80154d80 0x7f2a80151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a858da700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a801549a0 0x7f2a800abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 -- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a801549a0 msgr2=0x7f2a800abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a801549a0 0x7f2a800abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 -- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a80154d80 msgr2=0x7f2a80151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a80154d80 0x7f2a80151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 -- 172.21.15.133:0/790618982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009370 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a860db700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f2a78007f20 tx=0x7f2a78009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800eb90 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7800ecf0 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78014610 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a800bd520 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.194+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800acba0 con 0x7f2a801559d0 2024-01-21T20:14:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.195+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8005fdf0 con 0x7f2a801559d0 2024-01-21T20:14:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.196+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a78014980 con 0x7f2a801559d0 2024-01-21T20:14:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.196+0000 7f2a767fc700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 0x7f2a64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.196+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6283+0+0 (secure 0 0 0) 0x7f2a7807a610 con 0x7f2a801559d0 2024-01-21T20:14:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.196+0000 7f2a858da700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 0x7f2a64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.196+0000 7f2a858da700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 0x7f2a64061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2a70000c00 tx=0x7f2a70007d20).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:16.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.200+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a7804b840 con 0x7f2a801559d0 2024-01-21T20:14:16.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:16.378+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2a80064100 con 0x7f2a801559d0 2024-01-21T20:14:17.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.229+0000 7f2a767fc700 1 -- 172.21.15.133:0/790618982 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2a7800ee60 con 0x7f2a801559d0 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.231+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 msgr2=0x7f2a64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.231+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 0x7f2a64061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f2a70000c00 tx=0x7f2a70007d20).stop 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.231+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 msgr2=0x7f2a800bd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.231+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f2a78007f20 tx=0x7f2a78009860).stop 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 shutdown_connections 2024-01-21T20:14:17.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a6405f150 0x7f2a64061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a801559d0 0x7f2a800bd030 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a801549a0 0x7f2a800abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 --2- 172.21.15.133:0/790618982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a80154d80 0x7f2a80151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 >> 172.21.15.133:0/790618982 conn(0x7f2a800c6ef0 msgr2=0x7f2a800c5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 shutdown_connections 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.232+0000 7f2a87b3e700 1 -- 172.21.15.133:0/790618982 wait complete. 2024-01-21T20:14:17.222 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:14:17.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:14:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.367+0000 7f3aa7763700 1 Processor -- start 2024-01-21T20:14:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.368+0000 7f3aa7763700 1 -- start start 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa7763700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3aa00c3840 0x7f3aa00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa7763700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa00bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa7763700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa0067f10 con 0x7f3aa00c5dc0 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa7763700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00681f0 con 0x7f3aa00c3840 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa7763700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa00684d0 con 0x7f3aa00c6250 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa5d00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa00bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3aa00c3840 0x7f3aa00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa4cfe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3aa00c5dc0 0x7f3aa013a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:51844/0 (socket says 172.21.15.133:51844) 2024-01-21T20:14:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa4cfe700 1 -- 172.21.15.133:0/3101498330 learned_addr learned my addr 172.21.15.133:0/3101498330 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 -- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 msgr2=0x7f3aa00bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa00bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 -- 172.21.15.133:0/3101498330 >> v1:172.21.15.178:6789/0 conn(0x7f3aa00c5dc0 legacy=0x7f3aa013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 -- 172.21.15.133:0/3101498330 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00687b0 con 0x7f3aa00c3840 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa5d00700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa00bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.369+0000 7f3aa54ff700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c3840 0x7f3aa00c3c20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3a9c009760 tx=0x7f3a9c009060).ready entity=mon.1 client_cookie=a153012f1b9c1741 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3a93fff700 1 -- 172.21.15.133:0/3101498330 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c0090d0 con 0x7f3aa00c3840 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3a93fff700 1 -- 172.21.15.133:0/3101498330 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00f510 con 0x7f3aa00c3840 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3a93fff700 1 -- 172.21.15.133:0/3101498330 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00f890 con 0x7f3aa00c3840 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 -- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c3840 msgr2=0x7f3aa00c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c3840 0x7f3aa00c3c20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f3a9c009760 tx=0x7f3a9c009060).stop 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 -- 172.21.15.133:0/3101498330 shutdown_connections 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c3840 0x7f3aa00c3c20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 --2- 172.21.15.133:0/3101498330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa00bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 -- 172.21.15.133:0/3101498330 >> 172.21.15.133:0/3101498330 conn(0x7f3aa0066a70 msgr2=0x7f3aa0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 -- 172.21.15.133:0/3101498330 shutdown_connections 2024-01-21T20:14:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.370+0000 7f3aa7763700 1 -- 172.21.15.133:0/3101498330 wait complete. 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.371+0000 7f3aa7763700 1 Processor -- start 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.371+0000 7f3aa7763700 1 -- start start 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c5dc0 0x7f3aa00abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa0152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0156170 con 0x7f3aa00c3840 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa013ce70 con 0x7f3aa00c5dc0 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa7763700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa013cb90 con 0x7f3aa00c6250 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa54ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa54ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42472/0 (socket says 172.21.15.133:42472) 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa54ff700 1 -- 172.21.15.133:0/1321451808 learned_addr learned my addr 172.21.15.133:0/1321451808 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa5d00700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa0152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.372+0000 7f3aa4cfe700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c5dc0 0x7f3aa00abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 -- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 msgr2=0x7f3aa0152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa0152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 -- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c5dc0 msgr2=0x7f3aa00abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c5dc0 0x7f3aa00abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 -- 172.21.15.133:0/1321451808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009a20 con 0x7f3aa00c3840 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa5d00700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa0152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa54ff700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f3a9c009150 tx=0x7f3a9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c00f680 con 0x7f3aa00c3840 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c00f7e0 con 0x7f3aa00c3840 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c01b660 con 0x7f3aa00c3840 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c0092a0 con 0x7f3aa00c3840 2024-01-21T20:14:17.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.373+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa0155e00 con 0x7f3aa00c3840 2024-01-21T20:14:17.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.374+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa005fdf0 con 0x7f3aa00c3840 2024-01-21T20:14:17.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.374+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3a9c01ba50 con 0x7f3aa00c3840 2024-01-21T20:14:17.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.375+0000 7f3a91ffb700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 0x7f3a84061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.375+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3a9c07bac0 con 0x7f3aa00c3840 2024-01-21T20:14:17.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.375+0000 7f3aa4cfe700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 0x7f3a84061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.375+0000 7f3aa4cfe700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 0x7f3a84061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3aa00aede0 tx=0x7f3a94009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.379+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3a9c04cea0 con 0x7f3aa00c3840 2024-01-21T20:14:17.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:14:17.512 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.616+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3aa0156450 con 0x7f3aa00c3840 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.616+0000 7f3a91ffb700 1 -- 172.21.15.133:0/1321451808 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3a9c07be60 con 0x7f3aa00c3840 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:14:17.607 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.609 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:14:17.610 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.611 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.613 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.614 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.615 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:17.616 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:14:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 msgr2=0x7f3a84061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 0x7f3a84061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3aa00aede0 tx=0x7f3a94009040).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 msgr2=0x7f3aa013c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f3a9c009150 tx=0x7f3a9c017000).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 shutdown_connections 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3a8405f150 0x7f3a84061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa00c6250 0x7f3aa0152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aa00c3840 0x7f3aa013c570 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 --2- 172.21.15.133:0/1321451808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa00c5dc0 0x7f3aa00abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 >> 172.21.15.133:0/1321451808 conn(0x7f3aa0066a70 msgr2=0x7f3aa015a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 shutdown_connections 2024-01-21T20:14:17.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.618+0000 7f3aa7763700 1 -- 172.21.15.133:0/1321451808 wait complete. 2024-01-21T20:14:17.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.787+0000 7f1bac6b5700 1 Processor -- start 2024-01-21T20:14:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.787+0000 7f1bac6b5700 1 -- start start 2024-01-21T20:14:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1bac6b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ba414ea40 0x7f1ba40c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1bac6b5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ba40c5ce0 0x7f1ba40c6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1bac6b5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba414ee20 con 0x7f1ba40bcf10 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1bac6b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40bed10 con 0x7f1ba414ea40 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1bac6b5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40c6600 con 0x7f1ba40c5ce0 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ba414ea40 0x7f1ba40c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ba414ea40 0x7f1ba40c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42486/0 (socket says 172.21.15.133:42486) 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 -- 172.21.15.133:0/1921777066 learned_addr learned my addr 172.21.15.133:0/1921777066 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baac52700 1 --2- 172.21.15.133:0/1921777066 >> v2:172.21.15.178:3300/0 conn(0x7f1ba40c5ce0 0x7f1ba40c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 -- 172.21.15.133:0/1921777066 >> v2:172.21.15.178:3300/0 conn(0x7f1ba40c5ce0 msgr2=0x7f1ba40c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 --2- 172.21.15.133:0/1921777066 >> v2:172.21.15.178:3300/0 conn(0x7f1ba40c5ce0 0x7f1ba40c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 -- 172.21.15.133:0/1921777066 >> v1:172.21.15.133:6789/0 conn(0x7f1ba40bcf10 legacy=0x7f1ba40630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 -- 172.21.15.133:0/1921777066 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba40bea30 con 0x7f1ba414ea40 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1ba944f700 1 -- 172.21.15.133:0/1921777066 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932052325 0 0) 0x7f1ba0001110 con 0x7f1ba40bcf10 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1baa451700 1 --2- 172.21.15.133:0/1921777066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba414ea40 0x7f1ba40c77e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1ba40be390 tx=0x7f1b940090f0).ready entity=mon.0 client_cookie=31dfa4615bc41f24 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1ba944f700 1 -- 172.21.15.133:0/1921777066 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400b600 con 0x7f1ba414ea40 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1ba944f700 1 -- 172.21.15.133:0/1921777066 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400b760 con 0x7f1ba414ea40 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.788+0000 7f1ba944f700 1 -- 172.21.15.133:0/1921777066 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400bb00 con 0x7f1ba414ea40 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 -- 172.21.15.133:0/1921777066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba414ea40 msgr2=0x7f1ba40c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/1921777066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba414ea40 0x7f1ba40c77e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1ba40be390 tx=0x7f1b940090f0).stop 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 -- 172.21.15.133:0/1921777066 shutdown_connections 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/1921777066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba414ea40 0x7f1ba40c77e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/1921777066 >> v2:172.21.15.178:3300/0 conn(0x7f1ba40c5ce0 0x7f1ba40c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 -- 172.21.15.133:0/1921777066 >> 172.21.15.133:0/1921777066 conn(0x7f1ba40c7de0 msgr2=0x7f1ba40c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 -- 172.21.15.133:0/1921777066 shutdown_connections 2024-01-21T20:14:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.789+0000 7f1bac6b5700 1 -- 172.21.15.133:0/1921777066 wait complete. 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.790+0000 7f1bac6b5700 1 Processor -- start 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.790+0000 7f1bac6b5700 1 -- start start 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ba40c5ce0 0x7f1ba40c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ba414ea40 0x7f1ba41550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c50f0 con 0x7f1ba40bcf10 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40a98d0 con 0x7f1ba414ea40 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1bac6b5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c5340 con 0x7f1ba40c5ce0 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42492/0 (socket says 172.21.15.133:42492) 2024-01-21T20:14:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 -- 172.21.15.133:0/3930533087 learned_addr learned my addr 172.21.15.133:0/3930533087 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baac52700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ba414ea40 0x7f1ba41550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1ba9c50700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ba40c5ce0 0x7f1ba40c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 -- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ba40c5ce0 msgr2=0x7f1ba40c1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ba40c5ce0 0x7f1ba40c1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 -- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ba414ea40 msgr2=0x7f1ba41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ba414ea40 0x7f1ba41550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 -- 172.21.15.133:0/3930533087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94009370 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.791+0000 7f1baa451700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f1b94006fd0 tx=0x7f1b94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.792+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9400bec0 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.792+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9400b8d0 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.792+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9401c420 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.792+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba40c5620 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.792+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba40c5900 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.793+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba40a9bb0 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.793+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b9401c850 con 0x7f1ba40bcf10 2024-01-21T20:14:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.793+0000 7f1b9affd700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 0x7f1b88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.793+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1b9407bbb0 con 0x7f1ba40bcf10 2024-01-21T20:14:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.793+0000 7f1ba9c50700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 0x7f1b88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.794+0000 7f1ba9c50700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 0x7f1b88061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1ba414d610 tx=0x7f1ba0009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.798+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b9404cf90 con 0x7f1ba40bcf10 2024-01-21T20:14:17.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.962+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ba40a7170 con 0x7f1ba40bcf10 2024-01-21T20:14:17.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.963+0000 7f1b9affd700 1 -- 172.21.15.133:0/3930533087 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+14644 (secure 0 0 0) 0x7f1b9402a030 con 0x7f1ba40bcf10 2024-01-21T20:14:17.952 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:17.952 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":75,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:17.223495+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.964+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 msgr2=0x7f1b88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.964+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 0x7f1b88061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1ba414d610 tx=0x7f1ba0009040).stop 2024-01-21T20:14:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.964+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 msgr2=0x7f1ba40a9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.964+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f1b94006fd0 tx=0x7f1b94017000).stop 2024-01-21T20:14:17.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 shutdown_connections 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b8805f150 0x7f1b88061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ba414ea40 0x7f1ba41550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba40bcf10 0x7f1ba40a9d60 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 --2- 172.21.15.133:0/3930533087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ba40c5ce0 0x7f1ba40c1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 >> 172.21.15.133:0/3930533087 conn(0x7f1ba40c7de0 msgr2=0x7f1ba414d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 shutdown_connections 2024-01-21T20:14:17.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:17.965+0000 7f1bac6b5700 1 -- 172.21.15.133:0/3930533087 wait complete. 2024-01-21T20:14:17.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:14:17.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:14:18.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.095+0000 7f04a81ae700 1 Processor -- start 2024-01-21T20:14:18.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.095+0000 7f04a81ae700 1 -- start start 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a81ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a00beb30 0x7f04a0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a81ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 0x7f04a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a81ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a0065660 con 0x7f04a0069cd0 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a81ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00bef10 con 0x7f04a00beb30 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a81ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0156070 con 0x7f04a00c3fb0 2024-01-21T20:14:18.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a5f4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a00beb30 0x7f04a0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a5f4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a00beb30 0x7f04a0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42508/0 (socket says 172.21.15.133:42508) 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a5f4a700 1 -- 172.21.15.133:0/3504408182 learned_addr learned my addr 172.21.15.133:0/3504408182 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a674b700 1 --1- 172.21.15.133:0/3504408182 >> v1:172.21.15.133:6789/0 conn(0x7f04a0069cd0 0x7f04a0151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36924/0 (socket says 172.21.15.133:36924) 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.096+0000 7f04a5749700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 0x7f04a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5f4a700 1 -- 172.21.15.133:0/3504408182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 msgr2=0x7f04a00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5f4a700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 0x7f04a00697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5f4a700 1 -- 172.21.15.133:0/3504408182 >> v1:172.21.15.133:6789/0 conn(0x7f04a0069cd0 legacy=0x7f04a0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5f4a700 1 -- 172.21.15.133:0/3504408182 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0065f00 con 0x7f04a00beb30 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a4f48700 1 -- 172.21.15.133:0/3504408182 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408810969 0 0) 0x7f04a0065660 con 0x7f04a0069cd0 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5749700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 0x7f04a00697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a5f4a700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0155b80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f0490006fd0 tx=0x7f04900090f0).ready entity=mon.0 client_cookie=3a46a5e67f51a734 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a4f48700 1 -- 172.21.15.133:0/3504408182 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000b600 con 0x7f04a00beb30 2024-01-21T20:14:18.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a4f48700 1 -- 172.21.15.133:0/3504408182 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049000b760 con 0x7f04a00beb30 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a4f48700 1 -- 172.21.15.133:0/3504408182 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000bb00 con 0x7f04a00beb30 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 -- 172.21.15.133:0/3504408182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 msgr2=0x7f04a0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0155b80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f0490006fd0 tx=0x7f04900090f0).stop 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 -- 172.21.15.133:0/3504408182 shutdown_connections 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0155b80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 --2- 172.21.15.133:0/3504408182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a00c3fb0 0x7f04a00697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.097+0000 7f04a81ae700 1 -- 172.21.15.133:0/3504408182 >> 172.21.15.133:0/3504408182 conn(0x7f04a00c8010 msgr2=0x7f04a00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.098+0000 7f04a81ae700 1 -- 172.21.15.133:0/3504408182 shutdown_connections 2024-01-21T20:14:18.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.098+0000 7f04a81ae700 1 -- 172.21.15.133:0/3504408182 wait complete. 2024-01-21T20:14:18.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 Processor -- start 2024-01-21T20:14:18.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 -- start start 2024-01-21T20:14:18.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a0069cd0 0x7f04a00ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a00c3fb0 0x7f04a00a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00a6190 con 0x7f04a00beb30 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00bf2e0 con 0x7f04a00c3fb0 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.099+0000 7f04a81ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00a6ec0 con 0x7f04a0069cd0 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42518/0 (socket says 172.21.15.133:42518) 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 -- 172.21.15.133:0/2043996414 learned_addr learned my addr 172.21.15.133:0/2043996414 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 -- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a0069cd0 msgr2=0x7f04a00ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a0069cd0 0x7f04a00ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 -- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a00c3fb0 msgr2=0x7f04a00a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a00c3fb0 0x7f04a00a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 -- 172.21.15.133:0/2043996414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009370 con 0x7f04a00beb30 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a5749700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f049c00d860 tx=0x7f049c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c011590 con 0x7f04a00beb30 2024-01-21T20:14:18.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c0116f0 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c011a70 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a00a58f0 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.100+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a00a5eb0 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.101+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a00bf090 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.102+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f049c01c460 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.102+0000 7f04967fc700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 0x7f0484061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.102+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f049c079fc0 con 0x7f04a00beb30 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.102+0000 7f04a5f4a700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 0x7f0484061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.102+0000 7f04a5f4a700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 0x7f0484061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f049000b3c0 tx=0x7f0490017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.106+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f049c0a8b00 con 0x7f04a00beb30 2024-01-21T20:14:18.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.268+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04a005fdf0 con 0x7f04a00beb30 2024-01-21T20:14:18.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.268+0000 7f04967fc700 1 -- 172.21.15.133:0/2043996414 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f049c04b340 con 0x7f04a00beb30 2024-01-21T20:14:18.258 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 msgr2=0x7f0484061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 0x7f0484061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f049000b3c0 tx=0x7f0490017000).stop 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 msgr2=0x7f04a0139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f049c00d860 tx=0x7f049c008040).stop 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 shutdown_connections 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048405f150 0x7f0484061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a00c3fb0 0x7f04a00a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a0069cd0 0x7f04a00ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:18.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 --2- 172.21.15.133:0/2043996414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a00beb30 0x7f04a0139120 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 >> 172.21.15.133:0/2043996414 conn(0x7f04a00c8010 msgr2=0x7f04a013a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 shutdown_connections 2024-01-21T20:14:18.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.270+0000 7f04a81ae700 1 -- 172.21.15.133:0/2043996414 wait complete. 2024-01-21T20:14:18.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:14:18.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.401+0000 7f13558c2700 1 Processor -- start 2024-01-21T20:14:18.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.401+0000 7f13558c2700 1 -- start start 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f13558c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13501545a0 0x7f13500c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f13558c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500c89d0 con 0x7f13500aa360 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f13558c2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500c7dc0 con 0x7f13500c67b0 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f13558c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500c80a0 con 0x7f13501545a0 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13501545a0 0x7f13500c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13500aa360 0x7f13500c60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36932/0 (socket says 172.21.15.133:36932) 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134e7fc700 1 -- 172.21.15.133:0/1665547015 learned_addr learned my addr 172.21.15.133:0/1665547015 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134dffb700 1 -- 172.21.15.133:0/1665547015 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906181518 0 0) 0x7f13500c89d0 con 0x7f13500aa360 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134dffb700 1 -- 172.21.15.133:0/1665547015 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13380033f0 con 0x7f13500aa360 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134effd700 1 -- 172.21.15.133:0/1665547015 >> v1:172.21.15.178:6789/0 conn(0x7f13500c67b0 legacy=0x7f13500c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134effd700 1 -- 172.21.15.133:0/1665547015 >> v1:172.21.15.133:6789/0 conn(0x7f13500aa360 legacy=0x7f13500c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.402+0000 7f134effd700 1 -- 172.21.15.133:0/1665547015 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500c8380 con 0x7f13501545a0 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f134effd700 1 --2- 172.21.15.133:0/1665547015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500c77b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1344009760 tx=0x7f1344009060).ready entity=mon.0 client_cookie=b951659a3888fe7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f134dffb700 1 -- 172.21.15.133:0/1665547015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440090d0 con 0x7f13501545a0 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f134dffb700 1 -- 172.21.15.133:0/1665547015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400f510 con 0x7f13501545a0 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f134dffb700 1 -- 172.21.15.133:0/1665547015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400f890 con 0x7f13501545a0 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 -- 172.21.15.133:0/1665547015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 msgr2=0x7f13500c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 --2- 172.21.15.133:0/1665547015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500c77b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f1344009760 tx=0x7f1344009060).stop 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 -- 172.21.15.133:0/1665547015 shutdown_connections 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 --2- 172.21.15.133:0/1665547015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500c77b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 -- 172.21.15.133:0/1665547015 >> 172.21.15.133:0/1665547015 conn(0x7f13500649d0 msgr2=0x7f1350064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 -- 172.21.15.133:0/1665547015 shutdown_connections 2024-01-21T20:14:18.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.403+0000 7f13558c2700 1 -- 172.21.15.133:0/1665547015 wait complete. 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 Processor -- start 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 -- start start 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13500aa360 0x7f1350144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13500c67b0 0x7f13500affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501564f0 con 0x7f13501545a0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500b09b0 con 0x7f13500aa360 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.405+0000 7f13558c2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13501452d0 con 0x7f13500c67b0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42524/0 (socket says 172.21.15.133:42524) 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 -- 172.21.15.133:0/2646267031 learned_addr learned my addr 172.21.15.133:0/2646267031 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134effd700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13500aa360 0x7f1350144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134e7fc700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13500c67b0 0x7f13500affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 -- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13500c67b0 msgr2=0x7f13500affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13500c67b0 0x7f13500affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 -- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13500aa360 msgr2=0x7f1350144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13500aa360 0x7f1350144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 -- 172.21.15.133:0/2646267031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13440092a0 con 0x7f13501545a0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f134f7fe700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f134800c790 tx=0x7f13480015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348010510 con 0x7f13501545a0 2024-01-21T20:14:18.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348010670 con 0x7f13501545a0 2024-01-21T20:14:18.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480109f0 con 0x7f13501545a0 2024-01-21T20:14:18.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1350155870 con 0x7f13501545a0 2024-01-21T20:14:18.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.406+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350155e30 con 0x7f13501545a0 2024-01-21T20:14:18.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.407+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135005fdf0 con 0x7f13501545a0 2024-01-21T20:14:18.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.407+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f134801b400 con 0x7f13501545a0 2024-01-21T20:14:18.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.408+0000 7f13377fe700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 0x7f133c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.408+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1348079eb0 con 0x7f13501545a0 2024-01-21T20:14:18.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.408+0000 7f134effd700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 0x7f133c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.408+0000 7f134effd700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 0x7f133c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f13501679a0 tx=0x7f1344017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.412+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f134804b230 con 0x7f13501545a0 2024-01-21T20:14:18.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.574+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13500c8660 con 0x7f13501545a0 2024-01-21T20:14:18.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.574+0000 7f13377fe700 1 -- 172.21.15.133:0/2646267031 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f134804e850 con 0x7f13501545a0 2024-01-21T20:14:18.564 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 msgr2=0x7f133c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 0x7f133c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f13501679a0 tx=0x7f1344017000).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 msgr2=0x7f13500b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f134800c790 tx=0x7f13480015e0).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 shutdown_connections 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f133c05f150 0x7f133c061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13501545a0 0x7f13500b04c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13500aa360 0x7f1350144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 --2- 172.21.15.133:0/2646267031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13500c67b0 0x7f13500affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 >> 172.21.15.133:0/2646267031 conn(0x7f13500649d0 msgr2=0x7f13500c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 shutdown_connections 2024-01-21T20:14:18.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.576+0000 7f13558c2700 1 -- 172.21.15.133:0/2646267031 wait complete. 2024-01-21T20:14:18.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:14:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.705+0000 7f045846d700 1 Processor -- start 2024-01-21T20:14:18.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.705+0000 7f045846d700 1 -- start start 2024-01-21T20:14:18.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04500beb30 0x7f0450155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500c3fb0 0x7f04500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0450069cd0 0x7f0450151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04500bef10 con 0x7f04500beb30 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0450156070 con 0x7f0450069cd0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.706+0000 7f045846d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450065660 con 0x7f04500c3fb0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04500beb30 0x7f0450155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04500beb30 0x7f0450155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42540/0 (socket says 172.21.15.133:42540) 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 -- 172.21.15.133:0/391476384 learned_addr learned my addr 172.21.15.133:0/391476384 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 -- 172.21.15.133:0/391476384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500c3fb0 msgr2=0x7f04500697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0455a08700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500c3fb0 0x7f04500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500c3fb0 0x7f04500697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456a0a700 1 --2- 172.21.15.133:0/391476384 >> v2:172.21.15.178:3300/0 conn(0x7f0450069cd0 0x7f0450151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 -- 172.21.15.133:0/391476384 >> v2:172.21.15.178:3300/0 conn(0x7f0450069cd0 msgr2=0x7f0450151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 --2- 172.21.15.133:0/391476384 >> v2:172.21.15.178:3300/0 conn(0x7f0450069cd0 0x7f0450151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 -- 172.21.15.133:0/391476384 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450065f00 con 0x7f04500beb30 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0456209700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500beb30 0x7f0450155b80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f04500a76d0 tx=0x7f044c00b3b0).ready entity=mon.0 client_cookie=7a135aa0b0fa5b01 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0455207700 1 -- 172.21.15.133:0/391476384 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c00db10 con 0x7f04500beb30 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0455207700 1 -- 172.21.15.133:0/391476384 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c00dc70 con 0x7f04500beb30 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.707+0000 7f0455207700 1 -- 172.21.15.133:0/391476384 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c010470 con 0x7f04500beb30 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 -- 172.21.15.133:0/391476384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500beb30 msgr2=0x7f0450155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500beb30 0x7f0450155b80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f04500a76d0 tx=0x7f044c00b3b0).stop 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 -- 172.21.15.133:0/391476384 shutdown_connections 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 --2- 172.21.15.133:0/391476384 >> v2:172.21.15.178:3300/0 conn(0x7f0450069cd0 0x7f0450151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500beb30 0x7f0450155b80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 --2- 172.21.15.133:0/391476384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500c3fb0 0x7f04500697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 -- 172.21.15.133:0/391476384 >> 172.21.15.133:0/391476384 conn(0x7f04500c8010 msgr2=0x7f04500c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 -- 172.21.15.133:0/391476384 shutdown_connections 2024-01-21T20:14:18.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.708+0000 7f045846d700 1 -- 172.21.15.133:0/391476384 wait complete. 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.709+0000 7f045846d700 1 Processor -- start 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.709+0000 7f045846d700 1 -- start start 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 0x7f04500c1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500beb30 0x7f0450152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04501544d0 con 0x7f04500c3fb0 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450153160 con 0x7f0450069cd0 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450153430 con 0x7f04500beb30 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42554/0 (socket says 172.21.15.133:42554) 2024-01-21T20:14:18.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 -- 172.21.15.133:0/3239395824 learned_addr learned my addr 172.21.15.133:0/3239395824 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456209700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 0x7f04500c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0455a08700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500beb30 0x7f0450152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 -- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500beb30 msgr2=0x7f0450152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500beb30 0x7f0450152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 -- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 msgr2=0x7f04500c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 0x7f04500c1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 -- 172.21.15.133:0/3239395824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c00b610 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456209700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 0x7f04500c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0456a0a700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f044800cdb0 tx=0x7f04480077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800aa80 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044800abe0 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0450153710 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044800f400 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.710+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0450153cd0 con 0x7f04500c3fb0 2024-01-21T20:14:18.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.711+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0450155e00 con 0x7f04500c3fb0 2024-01-21T20:14:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.712+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f044800d040 con 0x7f04500c3fb0 2024-01-21T20:14:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.712+0000 7f0446ffd700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 0x7f0434061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.712+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f044807a1b0 con 0x7f04500c3fb0 2024-01-21T20:14:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.712+0000 7f0456209700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 0x7f0434061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:18.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.713+0000 7f0456209700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 0x7f0434061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f044c00bfd0 tx=0x7f044c00b3b0).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:18.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.716+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f044804b590 con 0x7f04500c3fb0 2024-01-21T20:14:18.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.880+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f045006ac20 con 0x7f04500c3fb0 2024-01-21T20:14:18.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.881+0000 7f0446ffd700 1 -- 172.21.15.133:0/3239395824 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+143 (secure 0 0 0) 0x7f044801d020 con 0x7f04500c3fb0 2024-01-21T20:14:18.871 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:18.871 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:14:18.871 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:18.871 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:18.872 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:14:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 msgr2=0x7f0434061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 0x7f0434061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f044c00bfd0 tx=0x7f044c00b3b0).stop 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 msgr2=0x7f0450150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f044800cdb0 tx=0x7f04480077d0).stop 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 shutdown_connections 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f043405f150 0x7f0434061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04500c3fb0 0x7f0450150d50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0450069cd0 0x7f04500c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 --2- 172.21.15.133:0/3239395824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04500beb30 0x7f0450152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:18.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 >> 172.21.15.133:0/3239395824 conn(0x7f04500c8010 msgr2=0x7f0450155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:18.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 shutdown_connections 2024-01-21T20:14:18.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:18.883+0000 7f045846d700 1 -- 172.21.15.133:0/3239395824 wait complete. 2024-01-21T20:14:18.885 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:14:18.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:14:19.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.016+0000 7f9955fc0700 1 Processor -- start 2024-01-21T20:14:19.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.016+0000 7f9955fc0700 1 -- start start 2024-01-21T20:14:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f9955fc0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99500638c0 0x7f9950063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f9955fc0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500667c0 con 0x7f99500bc8b0 2024-01-21T20:14:19.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f9955fc0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9950065e90 con 0x7f99500bc400 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f9955fc0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9950066170 con 0x7f99500638c0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f994ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f99500bc8b0 0x7f99500c2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36940/0 (socket says 172.21.15.133:36940) 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f994ffff700 1 -- 172.21.15.133:0/3269261837 learned_addr learned my addr 172.21.15.133:0/3269261837 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f994f7fe700 1 --2- 172.21.15.133:0/3269261837 >> v2:172.21.15.178:3300/0 conn(0x7f99500638c0 0x7f9950063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818288000 0 0) 0x7f99500667c0 con 0x7f99500bc8b0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.017+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9938004500 con 0x7f99500bc8b0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 92504817 0 0) 0x7f9938004500 con 0x7f99500bc8b0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994f7fe700 1 -- 172.21.15.133:0/3269261837 >> v1:172.21.15.178:6789/0 conn(0x7f99500bc400 legacy=0x7f9950066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994f7fe700 1 -- 172.21.15.133:0/3269261837 >> v1:172.21.15.133:6789/0 conn(0x7f99500bc8b0 legacy=0x7f99500c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994f7fe700 1 -- 172.21.15.133:0/3269261837 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950066450 con 0x7f99500638c0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994f7fe700 1 --2- 172.21.15.133:0/3269261837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500638c0 0x7f9950063ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9944009760 tx=0x7f9944009060).ready entity=mon.1 client_cookie=3988f887b8c62da1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480017f0 con 0x7f99500638c0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944011400 con 0x7f99500638c0 2024-01-21T20:14:19.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f994e7fc700 1 -- 172.21.15.133:0/3269261837 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944011780 con 0x7f99500638c0 2024-01-21T20:14:19.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 -- 172.21.15.133:0/3269261837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500638c0 msgr2=0x7f9950063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3269261837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500638c0 0x7f9950063ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9944009760 tx=0x7f9944009060).stop 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 -- 172.21.15.133:0/3269261837 shutdown_connections 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3269261837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500638c0 0x7f9950063ca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 -- 172.21.15.133:0/3269261837 >> 172.21.15.133:0/3269261837 conn(0x7f99500c4a10 msgr2=0x7f9950068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 -- 172.21.15.133:0/3269261837 shutdown_connections 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.018+0000 7f9955fc0700 1 -- 172.21.15.133:0/3269261837 wait complete. 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.020+0000 7f9955fc0700 1 Processor -- start 2024-01-21T20:14:19.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.020+0000 7f9955fc0700 1 -- start start 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500bc400 0x7f99500aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99500bc8b0 0x7f99500aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500abce0 con 0x7f99500638c0 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500aae30 con 0x7f99500bc400 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500ab0d0 con 0x7f99500bc8b0 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42564/0 (socket says 172.21.15.133:42564) 2024-01-21T20:14:19.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 -- 172.21.15.133:0/3000193466 learned_addr learned my addr 172.21.15.133:0/3000193466 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994ffff700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99500bc8b0 0x7f99500aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994effd700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500bc400 0x7f99500aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 -- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99500bc8b0 msgr2=0x7f99500aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99500bc8b0 0x7f99500aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 -- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500bc400 msgr2=0x7f99500aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500bc400 0x7f99500aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 -- 172.21.15.133:0/3000193466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99440092a0 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f994f7fe700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9944009e00 tx=0x7f9944014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944010a20 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944010b80 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500ab3b0 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994401d400 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.021+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500ab970 con 0x7f99500638c0 2024-01-21T20:14:19.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.022+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995005fdf0 con 0x7f99500638c0 2024-01-21T20:14:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.023+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9944018070 con 0x7f99500638c0 2024-01-21T20:14:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.023+0000 7f9937fff700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 0x7f993c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.023+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f994407ba40 con 0x7f99500638c0 2024-01-21T20:14:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.023+0000 7f994effd700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 0x7f993c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:19.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.023+0000 7f994effd700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 0x7f993c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f99500a82e0 tx=0x7f9940009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:19.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.027+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f994407de60 con 0x7f99500638c0 2024-01-21T20:14:19.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:19.191+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f99500abb00 con 0x7f99500638c0 2024-01-21T20:14:20.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.060+0000 7f9937fff700 1 -- 172.21.15.133:0/3000193466 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 152+0+0 (secure 0 0 0) 0x7f9944021020 con 0x7f99500638c0 2024-01-21T20:14:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.064+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 msgr2=0x7f993c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.064+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 0x7f993c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f99500a82e0 tx=0x7f9940009040).stop 2024-01-21T20:14:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.064+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 msgr2=0x7f99500ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.064+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f9944009e00 tx=0x7f9944014000).stop 2024-01-21T20:14:20.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 shutdown_connections 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f993c05f150 0x7f993c061610 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0x7f99500a82e0 tx=0x7f9940009040).stop 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99500bc8b0 0x7f99500aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99500638c0 0x7f99500ac170 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 --2- 172.21.15.133:0/3000193466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99500bc400 0x7f99500aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.065+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 >> 172.21.15.133:0/3000193466 conn(0x7f99500c4a10 msgr2=0x7f9950068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:20.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.066+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 shutdown_connections 2024-01-21T20:14:20.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.066+0000 7f9955fc0700 1 -- 172.21.15.133:0/3000193466 wait complete. 2024-01-21T20:14:20.060 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:14:20.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:14:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.212+0000 7f96971a2700 1 Processor -- start 2024-01-21T20:14:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.212+0000 7f96971a2700 1 -- start start 2024-01-21T20:14:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96971a2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9690069a60 0x7f9690152840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96971a2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f96900c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96971a2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96900c5c20 con 0x7f969013a790 2024-01-21T20:14:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96971a2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9690066860 con 0x7f9690069a60 2024-01-21T20:14:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96971a2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c5e80 con 0x7f9690152020 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96961a0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f969013a790 0x7f9690069350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36956/0 (socket says 172.21.15.133:36956) 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.213+0000 7f96961a0700 1 -- 172.21.15.133:0/3666003273 learned_addr learned my addr 172.21.15.133:0/3666003273 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f96969a1700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f96900c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 --2- 172.21.15.133:0/3666003273 >> v2:172.21.15.178:3300/0 conn(0x7f9690069a60 0x7f9690152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135280005 0 0) 0x7f96900c5c20 con 0x7f969013a790 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f967c0033f0 con 0x7f969013a790 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590917859 0 0) 0x7f967c0033f0 con 0x7f969013a790 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 msgr2=0x7f96900c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f96900c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 >> v2:172.21.15.178:3300/0 conn(0x7f9690069a60 msgr2=0x7f9690152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 --2- 172.21.15.133:0/3666003273 >> v2:172.21.15.178:3300/0 conn(0x7f9690069a60 0x7f9690152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900c6160 con 0x7f969013a790 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f968c001470 con 0x7f969013a790 2024-01-21T20:14:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 >> v1:172.21.15.133:6789/0 conn(0x7f969013a790 legacy=0x7f9690069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f967c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c003e10 0x7f967c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c004b80 0x7f967c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690066860 con 0x7f967c003e10 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c5e80 con 0x7f967c004b80 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967c00b8e0 con 0x7f9690152020 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c003e10 0x7f967c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f96961a0700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f967c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f96969a1700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c004b80 0x7f967c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 -- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 msgr2=0x7f967c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9690152020 0x7f967c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 -- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c004b80 msgr2=0x7f967c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f967c004b80 0x7f967c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.214+0000 7f969599f700 1 -- 172.21.15.133:0/3666003273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0033f0 con 0x7f967c003e10 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f969599f700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c003e10 0x7f967c004690 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f9684009a80 tx=0x7f9684009060).ready entity=mon.0 client_cookie=9fbc4aa206a129de server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684009430 con 0x7f967c003e10 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400e640 con 0x7f967c003e10 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f969519e700 1 -- 172.21.15.133:0/3666003273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400e9c0 con 0x7f967c003e10 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 -- 172.21.15.133:0/3666003273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c003e10 msgr2=0x7f967c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 --2- 172.21.15.133:0/3666003273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967c003e10 0x7f967c004690 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f9684009a80 tx=0x7f9684009060).stop 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96969a1700 1 -- 172.21.15.133:0/3666003273 reap_dead start 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 -- 172.21.15.133:0/3666003273 shutdown_connections 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 -- 172.21.15.133:0/3666003273 >> 172.21.15.133:0/3666003273 conn(0x7f96900c7bd0 msgr2=0x7f96900c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 -- 172.21.15.133:0/3666003273 shutdown_connections 2024-01-21T20:14:20.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.215+0000 7f96971a2700 1 -- 172.21.15.133:0/3666003273 wait complete. 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.216+0000 7f96971a2700 1 Processor -- start 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.216+0000 7f96971a2700 1 -- start start 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c003e10 0x7f96900acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 0x7f9690136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a7f40 con 0x7f96900c3080 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900c3510 con 0x7f9690139140 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f96971a2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900a78f0 con 0x7f967c003e10 2024-01-21T20:14:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f969599f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f969599f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42582/0 (socket says 172.21.15.133:42582) 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.217+0000 7f969599f700 1 -- 172.21.15.133:0/233371034 learned_addr learned my addr 172.21.15.133:0/233371034 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f96961a0700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c003e10 0x7f96900acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f96969a1700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 0x7f9690136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 -- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c003e10 msgr2=0x7f96900acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c003e10 0x7f96900acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 -- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 msgr2=0x7f9690136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 0x7f9690136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 -- 172.21.15.133:0/233371034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900a7bd0 con 0x7f96900c3080 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f96969a1700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 0x7f9690136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f969599f700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f968400e4b0 tx=0x7f968401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400ed70 con 0x7f96900c3080 2024-01-21T20:14:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400eed0 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900ad420 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400ea00 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.218+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96901395a0 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.219+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969006c7b0 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.220+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f968402f440 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.220+0000 7f9682ffd700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.220+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f968407c4a0 con 0x7f96900c3080 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.220+0000 7f96961a0700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.221+0000 7f96961a0700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 0x7f9674061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f968c000e10 tx=0x7f968c009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.224+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f968404d670 con 0x7f96900c3080 2024-01-21T20:14:20.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:20.387+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f969006a120 con 0x7f96900c3080 2024-01-21T20:14:21.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.064+0000 7f9682ffd700 1 -- 172.21.15.133:0/233371034 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9684016020 con 0x7f96900c3080 2024-01-21T20:14:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.070+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 msgr2=0x7f9674061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.070+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 0x7f9674061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f968c000e10 tx=0x7f968c009040).stop 2024-01-21T20:14:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.070+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 msgr2=0x7f96900a8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.070+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f968400e4b0 tx=0x7f968401a000).stop 2024-01-21T20:14:21.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 shutdown_connections 2024-01-21T20:14:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f967405f150 0x7f9674061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9690139140 0x7f9690136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967c003e10 0x7f96900acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 --2- 172.21.15.133:0/233371034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96900c3080 0x7f96900a8160 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.071+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 >> 172.21.15.133:0/233371034 conn(0x7f96900c7bd0 msgr2=0x7f96900626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.081+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 shutdown_connections 2024-01-21T20:14:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.082+0000 7f96971a2700 1 -- 172.21.15.133:0/233371034 wait complete. 2024-01-21T20:14:21.076 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:14:21.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:14:21.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.225+0000 7f86cf470700 1 Processor -- start 2024-01-21T20:14:21.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 -- start start 2024-01-21T20:14:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86c8062ff0 0x7f86c8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86c80bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c8069ef0 con 0x7f86c8062c10 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c8065fe0 con 0x7f86c8062ff0 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.226+0000 7f86cf470700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c806a130 con 0x7f86c8065b50 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cd20c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86c8062c10 0x7f86c80697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35908/0 (socket says 172.21.15.133:35908) 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cd20c700 1 -- 172.21.15.133:0/360607141 learned_addr learned my addr 172.21.15.133:0/360607141 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cda0d700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86c80bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cca0b700 1 --2- 172.21.15.133:0/360607141 >> v2:172.21.15.178:3300/0 conn(0x7f86c8062ff0 0x7f86c8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594707006 0 0) 0x7f86b8001110 con 0x7f86c8062c10 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b40033f0 con 0x7f86c8062c10 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3296936611 0 0) 0x7f86b40033f0 con 0x7f86c8062c10 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 msgr2=0x7f86c80bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86c80bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 >> v2:172.21.15.178:3300/0 conn(0x7f86c8062ff0 msgr2=0x7f86c8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 --2- 172.21.15.133:0/360607141 >> v2:172.21.15.178:3300/0 conn(0x7f86c8062ff0 0x7f86c8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c806a410 con 0x7f86c8062c10 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f86b8001600 con 0x7f86c8062c10 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cca0b700 1 --2- 172.21.15.133:0/360607141 >> v2:172.21.15.178:3300/0 conn(0x7f86c8062ff0 0x7f86c8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 >> v1:172.21.15.133:6789/0 conn(0x7f86c8062c10 legacy=0x7f86c80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b40038e0 0x7f86b4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86b4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b4004b80 0x7f86b4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8065fe0 con 0x7f86b4004b80 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c806a130 con 0x7f86b40038e0 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b400b8e0 con 0x7f86c8065b50 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cda0d700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b4004b80 0x7f86b4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cd20c700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b40038e0 0x7f86b4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.227+0000 7f86cca0b700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86b4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 -- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 msgr2=0x7f86b4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86c8065b50 0x7f86b4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 -- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b40038e0 msgr2=0x7f86b4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b40038e0 0x7f86b4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 -- 172.21.15.133:0/360607141 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40033f0 con 0x7f86b4004b80 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b4004b80 0x7f86b4005000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f86c000e240 tx=0x7f86c000b040).ready entity=mon.0 client_cookie=e5d938bd98d71d2e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0009ac0 con 0x7f86b4004b80 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c000f040 con 0x7f86b4004b80 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86bffff700 1 -- 172.21.15.133:0/360607141 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000ed00 con 0x7f86b4004b80 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 -- 172.21.15.133:0/360607141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b4004b80 msgr2=0x7f86b4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 --2- 172.21.15.133:0/360607141 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86b4004b80 0x7f86b4005000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f86c000e240 tx=0x7f86c000b040).stop 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cda0d700 1 -- 172.21.15.133:0/360607141 reap_dead start 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 -- 172.21.15.133:0/360607141 shutdown_connections 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 -- 172.21.15.133:0/360607141 >> 172.21.15.133:0/360607141 conn(0x7f86c80c8010 msgr2=0x7f86c80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 -- 172.21.15.133:0/360607141 shutdown_connections 2024-01-21T20:14:21.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.228+0000 7f86cf470700 1 -- 172.21.15.133:0/360607141 wait complete. 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 Processor -- start 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 -- start start 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4004b80 0x7f86c81586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86c8165370 0x7f86c80c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8158b90 con 0x7f86c8154e50 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81557a0 con 0x7f86c8165370 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.230+0000 7f86cf470700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81657f0 con 0x7f86b4004b80 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44692/0 (socket says 172.21.15.133:44692) 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 -- 172.21.15.133:0/441371152 learned_addr learned my addr 172.21.15.133:0/441371152 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cca0b700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86c8165370 0x7f86c80c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cd20c700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4004b80 0x7f86c81586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 -- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4004b80 msgr2=0x7f86c81586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4004b80 0x7f86c81586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 -- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86c8165370 msgr2=0x7f86c80c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86c8165370 0x7f86c80c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 -- 172.21.15.133:0/441371152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80c6440 con 0x7f86c8154e50 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cda0d700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f86c0014000 tx=0x7f86c001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0021030 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00139f0 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80c6720 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0013db0 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.231+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c80c6ce0 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.232+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80a7260 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.235+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f86c0024070 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.235+0000 7f86bdffb700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 0x7f86ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.235+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f86c0022070 con 0x7f86c8154e50 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.235+0000 7f86cd20c700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 0x7f86ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.235+0000 7f86cd20c700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 0x7f86ac061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f86b8001730 tx=0x7f86b8007900).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.238+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86c004d7e0 con 0x7f86c8154e50 2024-01-21T20:14:21.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.441+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f86c805fdf0 con 0x7f86c8154e50 2024-01-21T20:14:21.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.447+0000 7f86bdffb700 1 -- 172.21.15.133:0/441371152 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v22) v1 ==== 173+0+0 (secure 0 0 0) 0x7f86c0050e00 con 0x7f86c8154e50 2024-01-21T20:14:21.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 msgr2=0x7f86ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 0x7f86ac061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f86b8001730 tx=0x7f86b8007900).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 msgr2=0x7f86c81552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f86c0014000 tx=0x7f86c001a000).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 shutdown_connections 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86ac05f150 0x7f86ac061610 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7f86b8001730 tx=0x7f86b8007900).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86c8154e50 0x7f86c81552b0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4004b80 0x7f86c81586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 --2- 172.21.15.133:0/441371152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86c8165370 0x7f86c80c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.454+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 >> 172.21.15.133:0/441371152 conn(0x7f86c80c8010 msgr2=0x7f86c80697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.455+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 shutdown_connections 2024-01-21T20:14:21.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.455+0000 7f86cf470700 1 -- 172.21.15.133:0/441371152 wait complete. 2024-01-21T20:14:21.450 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 9 and data pool 10 2024-01-21T20:14:21.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:21.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.592+0000 7ff406bb9700 1 Processor -- start 2024-01-21T20:14:21.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.592+0000 7ff406bb9700 1 -- start start 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff406bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff400155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff406bb9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff400065660 con 0x7ff400069ef0 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff406bb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff400065f00 con 0x7ff4000c3fb0 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff406bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000bef10 con 0x7ff4000beb30 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff405156700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff400069ef0 0x7ff400066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35918/0 (socket says 172.21.15.133:35918) 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff405156700 1 -- 172.21.15.133:0/1512743223 learned_addr learned my addr 172.21.15.133:0/1512743223 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff404955700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff400155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357993289 0 0) 0x7ff400065660 con 0x7ff400069ef0 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f0005600 con 0x7ff400069ef0 2024-01-21T20:14:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275564249 0 0) 0x7ff3f0005600 con 0x7ff400069ef0 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 msgr2=0x7ff400155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff400155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 >> v1:172.21.15.178:6789/0 conn(0x7ff4000c3fb0 legacy=0x7ff4000697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.593+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000c4740 con 0x7ff400069ef0 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff3f80017f0 con 0x7ff400069ef0 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 >> v1:172.21.15.133:6789/0 conn(0x7ff400069ef0 legacy=0x7ff400066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3f0005b20 0x7ff3f0005f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff3f00068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f0006d90 0x7ff3f0007210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000bef10 con 0x7ff3f0005b20 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f000dbd0 con 0x7ff3f0006d90 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f000dd90 con 0x7ff4000beb30 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3f0005b20 0x7ff3f0005f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3fffff700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff3f00068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff405156700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f0006d90 0x7ff3f0007210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 -- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 msgr2=0x7ff3f00068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4000beb30 0x7ff3f00068a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 -- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f0006d90 msgr2=0x7ff3f0007210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f0006d90 0x7ff3f0007210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 -- 172.21.15.133:0/1512743223 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0005600 con 0x7ff3f0005b20 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff405156700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f0006d90 0x7ff3f0007210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff404955700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3f0005b20 0x7ff3f0005f40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7ff3f4006d80 tx=0x7ff3f4009060).ready entity=mon.0 client_cookie=6836abfb19d0dab2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4009e90 con 0x7ff3f0005b20 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4009430 con 0x7ff3f0005b20 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.594+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/1512743223 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400e850 con 0x7ff3f0005b20 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 -- 172.21.15.133:0/1512743223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3f0005b20 msgr2=0x7ff3f0005f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 --2- 172.21.15.133:0/1512743223 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3f0005b20 0x7ff3f0005f40 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7ff3f4006d80 tx=0x7ff3f4009060).stop 2024-01-21T20:14:21.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff405156700 1 -- 172.21.15.133:0/1512743223 reap_dead start 2024-01-21T20:14:21.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 -- 172.21.15.133:0/1512743223 shutdown_connections 2024-01-21T20:14:21.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 -- 172.21.15.133:0/1512743223 >> 172.21.15.133:0/1512743223 conn(0x7ff4000c8010 msgr2=0x7ff4000c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 -- 172.21.15.133:0/1512743223 shutdown_connections 2024-01-21T20:14:21.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.595+0000 7ff406bb9700 1 -- 172.21.15.133:0/1512743223 wait complete. 2024-01-21T20:14:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.596+0000 7ff406bb9700 1 Processor -- start 2024-01-21T20:14:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.596+0000 7ff406bb9700 1 -- start start 2024-01-21T20:14:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f0005b20 0x7ff4000c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4000c0740 0x7ff4000a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4001535a0 con 0x7ff400139250 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000c0ee0 con 0x7ff4000c0740 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff406bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff400152c70 con 0x7ff3f0005b20 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44704/0 (socket says 172.21.15.133:44704) 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 -- 172.21.15.133:0/2461986994 learned_addr learned my addr 172.21.15.133:0/2461986994 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff404955700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f0005b20 0x7ff4000c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff3fffff700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4000c0740 0x7ff4000a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 -- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f0005b20 msgr2=0x7ff4000c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f0005b20 0x7ff4000c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 -- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4000c0740 msgr2=0x7ff4000a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4000c0740 0x7ff4000a7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 -- 172.21.15.133:0/2461986994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400152f50 con 0x7ff400139250 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.597+0000 7ff405156700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7ff3f8001350 tx=0x7ff3f8007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.598+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800e5a0 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.598+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800e720 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.598+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800eae0 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.598+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff400153230 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.598+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4000c0bc0 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.599+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff400153710 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.599+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff3f8014430 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.600+0000 7ff3fd7fa700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 0x7ff3e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.600+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff3f807a090 con 0x7ff400139250 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.600+0000 7ff404955700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 0x7ff3e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.600+0000 7ff404955700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 0x7ff3e4061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff3f40095a0 tx=0x7ff3f401a000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.604+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff3f8049b00 con 0x7ff400139250 2024-01-21T20:14:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.767+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff40005fdf0 con 0x7ff400139250 2024-01-21T20:14:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.768+0000 7ff3fd7fa700 1 -- 172.21.15.133:0/2461986994 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17875 (secure 0 0 0) 0x7ff3f804b0b0 con 0x7ff400139250 2024-01-21T20:14:21.757 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:21.757 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":78,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:21.443032+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 msgr2=0x7ff3e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 0x7ff3e4061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff3f40095a0 tx=0x7ff3f401a000).stop 2024-01-21T20:14:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 msgr2=0x7ff4000aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7ff3f8001350 tx=0x7ff3f8007ec0).stop 2024-01-21T20:14:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 shutdown_connections 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3e405f150 0x7ff3e4061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff400139250 0x7ff4000aafc0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.769+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f0005b20 0x7ff4000c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.770+0000 7ff406bb9700 1 --2- 172.21.15.133:0/2461986994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4000c0740 0x7ff4000a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.770+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 >> 172.21.15.133:0/2461986994 conn(0x7ff4000c8010 msgr2=0x7ff400066390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.770+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 shutdown_connections 2024-01-21T20:14:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.770+0000 7ff406bb9700 1 -- 172.21.15.133:0/2461986994 wait complete. 2024-01-21T20:14:21.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:21.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.896+0000 7fd210fc9700 1 Processor -- start 2024-01-21T20:14:21.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.897+0000 7fd210fc9700 1 -- start start 2024-01-21T20:14:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.897+0000 7fd210fc9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c066460 0x7fd20c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd210fc9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd20c1521e0 0x7fd20c152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd210fc9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c065fd0 con 0x7fd20c0acbc0 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd210fc9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c063be0 con 0x7fd20c1521e0 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd210fc9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0653c0 con 0x7fd20c066460 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd20c1521e0 0x7fd20c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd20c1521e0 0x7fd20c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44708/0 (socket says 172.21.15.133:44708) 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 -- 172.21.15.133:0/1382909180 learned_addr learned my addr 172.21.15.133:0/1382909180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd209d9b700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c066460 0x7fd20c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 -- 172.21.15.133:0/1382909180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c066460 msgr2=0x7fd20c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c066460 0x7fd20c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 -- 172.21.15.133:0/1382909180 >> v1:172.21.15.178:6789/0 conn(0x7fd20c0acbc0 legacy=0x7fd20c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 -- 172.21.15.133:0/1382909180 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0656a0 con 0x7fd20c1521e0 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20ad9d700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c152610 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd204009f20 tx=0x7fd204009840).ready entity=mon.0 client_cookie=b82a0bcac033972 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20959a700 1 -- 172.21.15.133:0/1382909180 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400e070 con 0x7fd20c1521e0 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20959a700 1 -- 172.21.15.133:0/1382909180 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400b9d0 con 0x7fd20c1521e0 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.898+0000 7fd20959a700 1 -- 172.21.15.133:0/1382909180 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400bd50 con 0x7fd20c1521e0 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 -- 172.21.15.133:0/1382909180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 msgr2=0x7fd20c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c152610 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fd204009f20 tx=0x7fd204009840).stop 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 -- 172.21.15.133:0/1382909180 shutdown_connections 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c152610 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 --2- 172.21.15.133:0/1382909180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c066460 0x7fd20c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 -- 172.21.15.133:0/1382909180 >> 172.21.15.133:0/1382909180 conn(0x7fd20c0c8200 msgr2=0x7fd20c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 -- 172.21.15.133:0/1382909180 shutdown_connections 2024-01-21T20:14:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.899+0000 7fd210fc9700 1 -- 172.21.15.133:0/1382909180 wait complete. 2024-01-21T20:14:21.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.901+0000 7fd210fc9700 1 Processor -- start 2024-01-21T20:14:21.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.901+0000 7fd210fc9700 1 -- start start 2024-01-21T20:14:21.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c066460 0x7fd20c151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0acbc0 0x7fd20c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c069f00 con 0x7fd20c1521e0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c1638f0 con 0x7fd20c066460 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c156fc0 con 0x7fd20c0acbc0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44720/0 (socket says 172.21.15.133:44720) 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 -- 172.21.15.133:0/19667854 learned_addr learned my addr 172.21.15.133:0/19667854 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd209d9b700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0acbc0 0x7fd20c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20a59c700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c066460 0x7fd20c151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 -- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0acbc0 msgr2=0x7fd20c069520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0acbc0 0x7fd20c069520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 -- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c066460 msgr2=0x7fd20c151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c066460 0x7fd20c151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 -- 172.21.15.133:0/19667854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204009ae0 con 0x7fd20c1521e0 2024-01-21T20:14:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd20ad9d700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd20c0687b0 tx=0x7fd204009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040092e0 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20401e470 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c1572a0 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20401e7f0 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.902+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c163580 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.903+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c163a80 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.904+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd204003040 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.904+0000 7fd1faffd700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.904+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fd20407b9e0 con 0x7fd20c1521e0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.904+0000 7fd20a59c700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:21.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.905+0000 7fd20a59c700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd20c165840 tx=0x7fd1fc009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:21.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:21.908+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd20404ca80 con 0x7fd20c1521e0 2024-01-21T20:14:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.071+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd20c065980 con 0x7fd20c1521e0 2024-01-21T20:14:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.072+0000 7fd1faffd700 1 -- 172.21.15.133:0/19667854 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+17875 (secure 0 0 0) 0x7fd204023070 con 0x7fd20c1521e0 2024-01-21T20:14:22.061 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:22.062 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":78,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:21.443032+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 msgr2=0x7fd1ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd20c165840 tx=0x7fd1fc009040).stop 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 msgr2=0x7fd20c069a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd20c0687b0 tx=0x7fd204009840).stop 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 shutdown_connections 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd20c1521e0 0x7fd20c069a10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c066460 0x7fd20c151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 --2- 172.21.15.133:0/19667854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0acbc0 0x7fd20c069520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 >> 172.21.15.133:0/19667854 conn(0x7fd20c0c8200 msgr2=0x7fd20c0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 shutdown_connections 2024-01-21T20:14:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.074+0000 7fd210fc9700 1 -- 172.21.15.133:0/19667854 wait complete. 2024-01-21T20:14:22.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:14:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.204+0000 7f96bacaa700 1 Processor -- start 2024-01-21T20:14:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.204+0000 7f96bacaa700 1 -- start start 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96bacaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96bacaa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96b40c3fb0 0x7f96b4066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96bacaa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b4065660 con 0x7f96b40beb30 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96bacaa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b40bef10 con 0x7f96b40c3fb0 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96bacaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4156070 con 0x7f96b4069ef0 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96b40c3fb0 0x7f96b4066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96b40c3fb0 0x7f96b4066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44726/0 (socket says 172.21.15.133:44726) 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b8a46700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f96b40beb30 0x7f96b40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35930/0 (socket says 172.21.15.133:35930) 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 -- 172.21.15.133:0/3894843937 learned_addr learned my addr 172.21.15.133:0/3894843937 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b3fff700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 -- 172.21.15.133:0/3894843937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 msgr2=0x7f96b4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 -- 172.21.15.133:0/3894843937 >> v1:172.21.15.133:6789/0 conn(0x7f96b40beb30 legacy=0x7f96b40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 -- 172.21.15.133:0/3894843937 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4065f00 con 0x7f96b40c3fb0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b37fe700 1 -- 172.21.15.133:0/3894843937 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78031580 0 0) 0x7f96b4065660 con 0x7f96b40beb30 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b3fff700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b9247700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40c3fb0 0x7f96b4066390 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f96ac00d1d0 tx=0x7f96ac00ba50).ready entity=mon.0 client_cookie=6c566bb40a19f567 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b37fe700 1 -- 172.21.15.133:0/3894843937 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac010070 con 0x7f96b40c3fb0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b37fe700 1 -- 172.21.15.133:0/3894843937 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac00b0d0 con 0x7f96b40c3fb0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.206+0000 7f96b37fe700 1 -- 172.21.15.133:0/3894843937 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac00b450 con 0x7f96b40c3fb0 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 -- 172.21.15.133:0/3894843937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40c3fb0 msgr2=0x7f96b4066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40c3fb0 0x7f96b4066390 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f96ac00d1d0 tx=0x7f96ac00ba50).stop 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 -- 172.21.15.133:0/3894843937 shutdown_connections 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40c3fb0 0x7f96b4066390 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 --2- 172.21.15.133:0/3894843937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 -- 172.21.15.133:0/3894843937 >> 172.21.15.133:0/3894843937 conn(0x7f96b40c8010 msgr2=0x7f96b40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 -- 172.21.15.133:0/3894843937 shutdown_connections 2024-01-21T20:14:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.207+0000 7f96bacaa700 1 -- 172.21.15.133:0/3894843937 wait complete. 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.209+0000 7f96bacaa700 1 Processor -- start 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.209+0000 7f96bacaa700 1 -- start start 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b41381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96b40c3fb0 0x7f96b4153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4138690 con 0x7f96b40beb30 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40bf810 con 0x7f96b40c3fb0 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40a6500 con 0x7f96b4069ef0 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44728/0 (socket says 172.21.15.133:44728) 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 -- 172.21.15.133:0/1775048881 learned_addr learned my addr 172.21.15.133:0/1775048881 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b8a46700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b41381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 -- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 msgr2=0x7f96b41381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b41381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b9247700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96b40c3fb0 0x7f96b4153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 -- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96b40c3fb0 msgr2=0x7f96b4153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96b40c3fb0 0x7f96b4153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 -- 172.21.15.133:0/1775048881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac00bcf0 con 0x7f96b40beb30 2024-01-21T20:14:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b8a46700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b41381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b3fff700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f96a000d890 tx=0x7f96a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00125f0 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0012750 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b41615d0 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.210+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a0012ad0 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.211+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40a5f40 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.212+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b40bf9c0 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.212+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f96a0013480 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.212+0000 7f96b17fa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 0x7f9698061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.212+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f96a007a5d0 con 0x7f96b40beb30 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.212+0000 7f96b8a46700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 0x7f9698061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.213+0000 7f96b8a46700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 0x7f9698061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f96b40a7450 tx=0x7f96a8009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.216+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96b40bf9c0 con 0x7f96b40beb30 2024-01-21T20:14:22.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.424+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f96b40bf9c0 con 0x7f96b40beb30 2024-01-21T20:14:22.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.447+0000 7f96b17fa700 1 -- 172.21.15.133:0/1775048881 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f96b40bf9c0 con 0x7f96b40beb30 2024-01-21T20:14:22.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 msgr2=0x7f9698061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 0x7f9698061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f96b40a7450 tx=0x7f96a8009040).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 msgr2=0x7f96b40a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f96a000d890 tx=0x7f96a0008040).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 shutdown_connections 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f969805f150 0x7f9698061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96b40c3fb0 0x7f96b4153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96b4069ef0 0x7f96b41381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 --2- 172.21.15.133:0/1775048881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96b40beb30 0x7f96b40a5770 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 >> 172.21.15.133:0/1775048881 conn(0x7f96b40c8010 msgr2=0x7f96b4066da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 shutdown_connections 2024-01-21T20:14:22.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.449+0000 7f96bacaa700 1 -- 172.21.15.133:0/1775048881 wait complete. 2024-01-21T20:14:22.451 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:14:22.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:14:22.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.580+0000 7f0e59d52700 1 Processor -- start 2024-01-21T20:14:22.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.580+0000 7f0e59d52700 1 -- start start 2024-01-21T20:14:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e59d52700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e54069ef0 0x7f0e54155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e59d52700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e540c3fb0 0x7f0e54066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e59d52700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e54065660 con 0x7f0e540beb30 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e59d52700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e540bef10 con 0x7f0e540c3fb0 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e59d52700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e54156070 con 0x7f0e54069ef0 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e540c3fb0 0x7f0e54066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e537fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e540beb30 0x7f0e540697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35934/0 (socket says 172.21.15.133:35934) 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e537fe700 1 -- 172.21.15.133:0/3799305238 learned_addr learned my addr 172.21.15.133:0/3799305238 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 -- 172.21.15.133:0/3799305238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e54069ef0 msgr2=0x7f0e54155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 --2- 172.21.15.133:0/3799305238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e54069ef0 0x7f0e54155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 -- 172.21.15.133:0/3799305238 >> v1:172.21.15.133:6789/0 conn(0x7f0e540beb30 legacy=0x7f0e540697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 -- 172.21.15.133:0/3799305238 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54065f00 con 0x7f0e540c3fb0 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e527fc700 1 -- 172.21.15.133:0/3799305238 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210551137 0 0) 0x7f0e54065660 con 0x7f0e540beb30 2024-01-21T20:14:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e53fff700 1 --2- 172.21.15.133:0/3799305238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e540c3fb0 0x7f0e54066390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f0e4c00d100 tx=0x7f0e4c00b990).ready entity=mon.0 client_cookie=e82900fe176003b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e527fc700 1 -- 172.21.15.133:0/3799305238 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c010070 con 0x7f0e540c3fb0 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e527fc700 1 -- 172.21.15.133:0/3799305238 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c00dde0 con 0x7f0e540c3fb0 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.581+0000 7f0e527fc700 1 -- 172.21.15.133:0/3799305238 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00b2e0 con 0x7f0e540c3fb0 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 -- 172.21.15.133:0/3799305238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e540c3fb0 msgr2=0x7f0e54066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 --2- 172.21.15.133:0/3799305238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e540c3fb0 0x7f0e54066390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f0e4c00d100 tx=0x7f0e4c00b990).stop 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 -- 172.21.15.133:0/3799305238 shutdown_connections 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 --2- 172.21.15.133:0/3799305238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e540c3fb0 0x7f0e54066390 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 --2- 172.21.15.133:0/3799305238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e54069ef0 0x7f0e54155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 -- 172.21.15.133:0/3799305238 >> 172.21.15.133:0/3799305238 conn(0x7f0e540c8010 msgr2=0x7f0e540c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 -- 172.21.15.133:0/3799305238 shutdown_connections 2024-01-21T20:14:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.582+0000 7f0e59d52700 1 -- 172.21.15.133:0/3799305238 wait complete. 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.583+0000 7f0e59d52700 1 Processor -- start 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.583+0000 7f0e59d52700 1 -- start start 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e540beb30 0x7f0e540a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e540c3fb0 0x7f0e540a8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540a5cb0 con 0x7f0e54069ef0 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540a56f0 con 0x7f0e540c3fb0 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e59d52700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540a59d0 con 0x7f0e540beb30 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44752/0 (socket says 172.21.15.133:44752) 2024-01-21T20:14:22.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 -- 172.21.15.133:0/449793536 learned_addr learned my addr 172.21.15.133:0/449793536 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e52ffd700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e540beb30 0x7f0e540a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 -- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e540beb30 msgr2=0x7f0e540a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e53fff700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e540c3fb0 0x7f0e540a8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e540beb30 0x7f0e540a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 -- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e540c3fb0 msgr2=0x7f0e540a8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e540c3fb0 0x7f0e540a8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.584+0000 7f0e537fe700 1 -- 172.21.15.133:0/449793536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c00bc30 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e537fe700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f0e4400c4e0 tx=0x7f0e44007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440072e0 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e44007440 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e540bf1e0 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e440057a0 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.585+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540a5290 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.586+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5405fdf0 con 0x7f0e54069ef0 2024-01-21T20:14:22.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.586+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e44005bd0 con 0x7f0e54069ef0 2024-01-21T20:14:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.586+0000 7f0e3bfff700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 0x7f0e40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.586+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f0e44079ed0 con 0x7f0e54069ef0 2024-01-21T20:14:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.586+0000 7f0e52ffd700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 0x7f0e40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:22.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.587+0000 7f0e52ffd700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 0x7f0e40061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0e540634d0 tx=0x7f0e48008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:22.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.591+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0e4404aef0 con 0x7f0e54069ef0 2024-01-21T20:14:22.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:22.799+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0e540c4740 con 0x7f0e54069ef0 2024-01-21T20:14:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.456+0000 7f0e3bfff700 1 -- 172.21.15.133:0/449793536 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0e44018030 con 0x7f0e54069ef0 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 msgr2=0x7f0e40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 0x7f0e40061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0e540634d0 tx=0x7f0e48008040).stop 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 msgr2=0x7f0e540a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f0e4400c4e0 tx=0x7f0e44007c70).stop 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 shutdown_connections 2024-01-21T20:14:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e4005f150 0x7f0e40061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e540c3fb0 0x7f0e540a8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e54069ef0 0x7f0e540a9850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 --2- 172.21.15.133:0/449793536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e540beb30 0x7f0e540a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 >> 172.21.15.133:0/449793536 conn(0x7f0e540c8010 msgr2=0x7f0e540bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 shutdown_connections 2024-01-21T20:14:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.458+0000 7f0e59d52700 1 -- 172.21.15.133:0/449793536 wait complete. 2024-01-21T20:14:23.461 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:14:23.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.591+0000 7f36a68ad700 1 Processor -- start 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.591+0000 7f36a68ad700 1 -- start start 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f36a68ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36a0062ff0 0x7f36a0065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f36a68ad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a0069ef0 con 0x7f36a0062c10 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f36a68ad700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a0065fe0 con 0x7f36a0065b50 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f36a68ad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a006a130 con 0x7f36a0062ff0 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36a0062ff0 0x7f36a0065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36a0062ff0 0x7f36a0065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44768/0 (socket says 172.21.15.133:44768) 2024-01-21T20:14:23.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 -- 172.21.15.133:0/370866798 learned_addr learned my addr 172.21.15.133:0/370866798 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369ffff700 1 --1- 172.21.15.133:0/370866798 >> v1:172.21.15.133:6789/0 conn(0x7f36a0062c10 0x7f36a00697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35938/0 (socket says 172.21.15.133:35938) 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369effd700 1 -- 172.21.15.133:0/370866798 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051694299 0 0) 0x7f3690001110 con 0x7f36a0062c10 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 -- 172.21.15.133:0/370866798 >> v1:172.21.15.178:6789/0 conn(0x7f36a0065b50 legacy=0x7f36a00bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 -- 172.21.15.133:0/370866798 >> v1:172.21.15.133:6789/0 conn(0x7f36a0062c10 legacy=0x7f36a00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 -- 172.21.15.133:0/370866798 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a006a410 con 0x7f36a0062ff0 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369f7fe700 1 --2- 172.21.15.133:0/370866798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062ff0 0x7f36a0065660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f36940090f0).ready entity=mon.0 client_cookie=226b51e85df00baa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369effd700 1 -- 172.21.15.133:0/370866798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400b600 con 0x7f36a0062ff0 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369effd700 1 -- 172.21.15.133:0/370866798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369400b760 con 0x7f36a0062ff0 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.592+0000 7f369effd700 1 -- 172.21.15.133:0/370866798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369400bb00 con 0x7f36a0062ff0 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 -- 172.21.15.133:0/370866798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062ff0 msgr2=0x7f36a0065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 --2- 172.21.15.133:0/370866798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062ff0 0x7f36a0065660 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f36940090f0).stop 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 -- 172.21.15.133:0/370866798 shutdown_connections 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 --2- 172.21.15.133:0/370866798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062ff0 0x7f36a0065660 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 -- 172.21.15.133:0/370866798 >> 172.21.15.133:0/370866798 conn(0x7f36a00c8010 msgr2=0x7f36a00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:23.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 -- 172.21.15.133:0/370866798 shutdown_connections 2024-01-21T20:14:23.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.593+0000 7f36a68ad700 1 -- 172.21.15.133:0/370866798 wait complete. 2024-01-21T20:14:23.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.594+0000 7f36a68ad700 1 Processor -- start 2024-01-21T20:14:23.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.594+0000 7f36a68ad700 1 -- start start 2024-01-21T20:14:23.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a0062ff0 0x7f36a00c00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a0065b50 0x7f36a0139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00ad170 con 0x7f36a0062c10 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00adf90 con 0x7f36a0062ff0 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f36a68ad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c05c0 con 0x7f36a0065b50 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f369ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f369ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44780/0 (socket says 172.21.15.133:44780) 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.595+0000 7f369ffff700 1 -- 172.21.15.133:0/4043753938 learned_addr learned my addr 172.21.15.133:0/4043753938 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 -- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a0065b50 msgr2=0x7f36a0139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a0065b50 0x7f36a0139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 -- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a0062ff0 msgr2=0x7f36a00c00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a0062ff0 0x7f36a00c00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 -- 172.21.15.133:0/4043753938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3694009370 con 0x7f36a0062c10 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369ffff700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f369000c490 tx=0x7f3690007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900072e0 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690007440 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a00ad380 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690005930 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.596+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a00ad9c0 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.597+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00c1a70 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.598+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3690005d20 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.598+0000 7f369cff9700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 0x7f368c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.598+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f369007a0f0 con 0x7f36a0062c10 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.598+0000 7f369f7fe700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 0x7f368c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.599+0000 7f369f7fe700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 0x7f368c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f3694017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.602+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f369004b170 con 0x7f36a0062c10 2024-01-21T20:14:23.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.806+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36a005fdf0 con 0x7f36a0062c10 2024-01-21T20:14:23.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.806+0000 7f369cff9700 1 -- 172.21.15.133:0/4043753938 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f36900531a0 con 0x7f36a0062c10 2024-01-21T20:14:23.796 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:23.796 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 msgr2=0x7f368c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 0x7f368c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3694006fd0 tx=0x7f3694017000).stop 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 msgr2=0x7f36a00acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f369000c490 tx=0x7f3690007de0).stop 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 shutdown_connections 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f368c05f150 0x7f368c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a0065b50 0x7f36a0139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36a0062c10 0x7f36a00acc80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 --2- 172.21.15.133:0/4043753938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a0062ff0 0x7f36a00c00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 >> 172.21.15.133:0/4043753938 conn(0x7f36a00c8010 msgr2=0x7f36a00a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 shutdown_connections 2024-01-21T20:14:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.808+0000 7f36a68ad700 1 -- 172.21.15.133:0/4043753938 wait complete. 2024-01-21T20:14:23.800 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:23.810 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.936+0000 7fe188311700 1 Processor -- start 2024-01-21T20:14:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.936+0000 7fe188311700 1 -- start start 2024-01-21T20:14:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe188311700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe1800c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe188311700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe188311700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe180069f10 con 0x7fe18013a830 2024-01-21T20:14:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe188311700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1800c3890 con 0x7fe1800695b0 2024-01-21T20:14:23.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe188311700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c3b70 con 0x7fe18013ac10 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.937+0000 7fe1868ae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe1800c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1860ad700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe18013a830 0x7fe1800bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:60018/0 (socket says 172.21.15.133:60018) 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1868ae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:60702/0 (socket says 172.21.15.133:60702) 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1860ad700 1 -- 172.21.15.133:0/1697117295 learned_addr learned my addr 172.21.15.133:0/1697117295 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 -- 172.21.15.133:0/1697117295 >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 msgr2=0x7fe180069a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 --2- 172.21.15.133:0/1697117295 >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 -- 172.21.15.133:0/1697117295 >> v1:172.21.15.178:6789/0 conn(0x7fe18013a830 legacy=0x7fe1800bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 -- 172.21.15.133:0/1697117295 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800c3e50 con 0x7fe18013ac10 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1868ae700 1 --2- 172.21.15.133:0/1697117295 >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1858ac700 1 --2- 172.21.15.133:0/1697117295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe1800c3220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe17c009760 tx=0x7fe17c009060).ready entity=mon.2 client_cookie=1c28bf51fdaea23d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1850ab700 1 -- 172.21.15.133:0/1697117295 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0090d0 con 0x7fe18013ac10 2024-01-21T20:14:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1850ab700 1 -- 172.21.15.133:0/1697117295 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00f510 con 0x7fe18013ac10 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.938+0000 7fe1850ab700 1 -- 172.21.15.133:0/1697117295 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00f890 con 0x7fe18013ac10 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 -- 172.21.15.133:0/1697117295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 msgr2=0x7fe1800c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 --2- 172.21.15.133:0/1697117295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe1800c3220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fe17c009760 tx=0x7fe17c009060).stop 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 -- 172.21.15.133:0/1697117295 shutdown_connections 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 --2- 172.21.15.133:0/1697117295 >> v2:172.21.15.178:3300/0 conn(0x7fe1800695b0 0x7fe180069a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 --2- 172.21.15.133:0/1697117295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe1800c3220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 -- 172.21.15.133:0/1697117295 >> 172.21.15.133:0/1697117295 conn(0x7fe1800c7dc0 msgr2=0x7fe1800c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 -- 172.21.15.133:0/1697117295 shutdown_connections 2024-01-21T20:14:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.939+0000 7fe188311700 1 -- 172.21.15.133:0/1697117295 wait complete. 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.940+0000 7fe188311700 1 Processor -- start 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.940+0000 7fe188311700 1 -- start start 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18013a830 0x7fe1801655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe180167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c1f50 con 0x7fe1800695b0 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c62a0 con 0x7fe18013a830 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800c1c70 con 0x7fe18013ac10 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44796/0 (socket says 172.21.15.133:44796) 2024-01-21T20:14:23.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 -- 172.21.15.133:0/4107628868 learned_addr learned my addr 172.21.15.133:0/4107628868 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1868ae700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe180167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1858ac700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18013a830 0x7fe1801655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 -- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 msgr2=0x7fe180167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe180167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 -- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18013a830 msgr2=0x7fe1801655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18013a830 0x7fe1801655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 -- 172.21.15.133:0/4107628868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009a20 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe1860ad700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fe17400c410 tx=0x7fe174007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400ce30 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740072e0 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740057a0 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.941+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c0092a0 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.942+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1800c5f30 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.942+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18005fdf0 con 0x7fe1800695b0 2024-01-21T20:14:23.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.943+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe174005b50 con 0x7fe1800695b0 2024-01-21T20:14:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.943+0000 7fe172ffd700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 0x7fe164061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.943+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fe174079aa0 con 0x7fe1800695b0 2024-01-21T20:14:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.943+0000 7fe1858ac700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 0x7fe164061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:23.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.943+0000 7fe1858ac700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 0x7fe164061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe17c009fd0 tx=0x7fe17c017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:23.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:23.947+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe17404ab20 con 0x7fe1800695b0 2024-01-21T20:14:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.111+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1800671a0 con 0x7fe1800695b0 2024-01-21T20:14:24.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.112+0000 7fe172ffd700 1 -- 172.21.15.133:0/4107628868 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+17862 (secure 0 0 0) 0x7fe17404e140 con 0x7fe1800695b0 2024-01-21T20:14:24.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:24.102 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:22.445251+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 msgr2=0x7fe164061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 0x7fe164061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fe17c009fd0 tx=0x7fe17c017000).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 msgr2=0x7fe1800a6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fe17400c410 tx=0x7fe174007e50).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 shutdown_connections 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe16405f150 0x7fe164061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18013ac10 0x7fe180167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1800695b0 0x7fe1800a6f50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 --2- 172.21.15.133:0/4107628868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18013a830 0x7fe1801655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 >> 172.21.15.133:0/4107628868 conn(0x7fe1800c7dc0 msgr2=0x7fe1800ab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 shutdown_connections 2024-01-21T20:14:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.114+0000 7fe188311700 1 -- 172.21.15.133:0/4107628868 wait complete. 2024-01-21T20:14:24.116 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:14:24.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:14:24.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.242+0000 7f4fda0ca700 1 Processor -- start 2024-01-21T20:14:24.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.242+0000 7f4fda0ca700 1 -- start start 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fda0ca700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c3840 0x7f4fd40c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fda0ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fd40c6220 0x7f4fd40bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fda0ca700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd4067f10 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fda0ca700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40681f0 con 0x7f4fd40c6220 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fda0ca700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40684d0 con 0x7f4fd40c3840 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fd40c6220 0x7f4fd40bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fd40c6220 0x7f4fd40bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44802/0 (socket says 172.21.15.133:44802) 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 -- 172.21.15.133:0/2614196477 learned_addr learned my addr 172.21.15.133:0/2614196477 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:24.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd37fe700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c3840 0x7f4fd40c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 -- 172.21.15.133:0/2614196477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c3840 msgr2=0x7f4fd40c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c3840 0x7f4fd40c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 -- 172.21.15.133:0/2614196477 >> v1:172.21.15.178:6789/0 conn(0x7f4fd40c5dc0 legacy=0x7f4fd413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 -- 172.21.15.133:0/2614196477 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40687b0 con 0x7f4fd40c6220 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.243+0000 7f4fd3fff700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c6220 0x7f4fd40bdf60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f4fcc009f20 tx=0x7f4fcc009840).ready entity=mon.0 client_cookie=14e67515f8887173 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fd27fc700 1 -- 172.21.15.133:0/2614196477 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00e070 con 0x7f4fd40c6220 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fd27fc700 1 -- 172.21.15.133:0/2614196477 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00ba40 con 0x7f4fd40c6220 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fd27fc700 1 -- 172.21.15.133:0/2614196477 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc00bdc0 con 0x7f4fd40c6220 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2614196477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c6220 msgr2=0x7f4fd40bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c6220 0x7f4fd40bdf60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f4fcc009f20 tx=0x7f4fcc009840).stop 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2614196477 shutdown_connections 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c6220 0x7f4fd40bdf60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2614196477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c3840 0x7f4fd40c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2614196477 >> 172.21.15.133:0/2614196477 conn(0x7f4fd4066a70 msgr2=0x7f4fd4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2614196477 shutdown_connections 2024-01-21T20:14:24.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.244+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2614196477 wait complete. 2024-01-21T20:14:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.245+0000 7f4fda0ca700 1 Processor -- start 2024-01-21T20:14:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 -- start start 2024-01-21T20:14:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd40c3840 0x7f4fd4150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 0x7f4fd4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4152ac0 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4151eb0 con 0x7f4fd40c3840 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fda0ca700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4152190 con 0x7f4fd40c6220 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fd2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fd2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44812/0 (socket says 172.21.15.133:44812) 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.246+0000 7f4fd2ffd700 1 -- 172.21.15.133:0/2137752358 learned_addr learned my addr 172.21.15.133:0/2137752358 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd3fff700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 0x7f4fd4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 -- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 msgr2=0x7f4fd4155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 0x7f4fd4155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd37fe700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd40c3840 0x7f4fd4150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 -- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd40c3840 msgr2=0x7f4fd4150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd40c3840 0x7f4fd4150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 -- 172.21.15.133:0/2137752358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009ae0 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd3fff700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 0x7f4fd4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:24.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fd2ffd700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f4fc400c490 tx=0x7f4fc4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f470 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400f5d0 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f990 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4152470 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.247+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4151ad0 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.248+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4136820 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.248+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4fc4012400 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.249+0000 7f4fbbfff700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 0x7f4fc0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.249+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f4fc40799d0 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.249+0000 7f4fd37fe700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 0x7f4fc0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.249+0000 7f4fd37fe700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 0x7f4fc0061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4fc8006fd0 tx=0x7f4fc8008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.253+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4fc4048b00 con 0x7f4fd40c5dc0 2024-01-21T20:14:24.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.413+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fd4152c00 con 0x7f4fc005f150 2024-01-21T20:14:24.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.423+0000 7f4fbbfff700 1 -- 172.21.15.133:0/2137752358 <== mgr.6120 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350057 (secure 0 0 0) 0x7f4fd4152c00 con 0x7f4fc005f150 2024-01-21T20:14:24.417 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 msgr2=0x7f4fc0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 0x7f4fc0061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4fc8006fd0 tx=0x7f4fc8008040).stop 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 msgr2=0x7f4fd4139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f4fc400c490 tx=0x7f4fc4007db0).stop 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 shutdown_connections 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4fc005f150 0x7f4fc0061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd40c6220 0x7f4fd4155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd40c3840 0x7f4fd4150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 --2- 172.21.15.133:0/2137752358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd40c5dc0 0x7f4fd4139780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 >> 172.21.15.133:0/2137752358 conn(0x7f4fd4066a70 msgr2=0x7f4fd40c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 shutdown_connections 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.426+0000 7f4fda0ca700 1 -- 172.21.15.133:0/2137752358 wait complete. 2024-01-21T20:14:24.421 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:14:24.428 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:14:22.667550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2412504,"kb_used_data":7064,"kb_used_omap":0,"kb_used_meta":2405376,"kb_avail":752562216,"statfs":{"total":773094113280,"available":770623709184,"internally_reserved":0,"allocated":7233536,"data_stored":3638078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2463105024},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27604,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-79,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.541305"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.236333+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:14:16.236333+0000","last_peered":"2024-01-21T20:14:16.236333+0000","last_clean":"2024-01-21T20:14:16.236333+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:14:16.236333+0000","last_undegraded":"2024-01-21T20:14:16.236333+0000","last_fullsized":"2024-01-21T20:14:16.236333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.168297+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:14:16.168297+0000","last_peered":"2024-01-21T20:14:16.168297+0000","last_clean":"2024-01-21T20:14:16.168297+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:14:16.168297+0000","last_undegraded":"2024-01-21T20:14:16.168297+0000","last_fullsized":"2024-01-21T20:14:16.168297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.922577+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:14:16.922577+0000","last_peered":"2024-01-21T20:14:16.922577+0000","last_clean":"2024-01-21T20:14:16.922577+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:14:16.922577+0000","last_undegraded":"2024-01-21T20:14:16.922577+0000","last_fullsized":"2024-01-21T20:14:16.922577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.168311+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:14:16.168311+0000","last_peered":"2024-01-21T20:14:16.168311+0000","last_clean":"2024-01-21T20:14:16.168311+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:14:16.168311+0000","last_undegraded":"2024-01-21T20:14:16.168311+0000","last_fullsized":"2024-01-21T20:14:16.168311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.922541+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:14:16.922541+0000","last_peered":"2024-01-21T20:14:16.922541+0000","last_clean":"2024-01-21T20:14:16.922541+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:14:16.922541+0000","last_undegraded":"2024-01-21T20:14:16.922541+0000","last_fullsized":"2024-01-21T20:14:16.922541+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.922584+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:14:16.922584+0000","last_peered":"2024-01-21T20:14:16.922584+0000","last_clean":"2024-01-21T20:14:16.922584+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:14:16.922584+0000","last_undegraded":"2024-01-21T20:14:16.922584+0000","last_fullsized":"2024-01-21T20:14:16.922584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.922544+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:14:16.922544+0000","last_peered":"2024-01-21T20:14:16.922544+0000","last_clean":"2024-01-21T20:14:16.922544+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:14:16.922544+0000","last_undegraded":"2024-01-21T20:14:16.922544+0000","last_fullsized":"2024-01-21T20:14:16.922544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.236321+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:14:16.236321+0000","last_peered":"2024-01-21T20:14:16.236321+0000","last_clean":"2024-01-21T20:14:16.236321+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:14:16.236321+0000","last_undegraded":"2024-01-21T20:14:16.236321+0000","last_fullsized":"2024-01-21T20:14:16.236321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:21.058839+0000","last_change":"2024-01-21T20:14:21.058839+0000","last_active":"2024-01-21T20:14:21.058839+0000","last_peered":"2024-01-21T20:14:21.058839+0000","last_clean":"2024-01-21T20:14:21.058839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:21.058839+0000","last_undegraded":"2024-01-21T20:14:21.058839+0000","last_fullsized":"2024-01-21T20:14:21.058839+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:20.057102+0000","last_change":"2024-01-21T20:14:20.057102+0000","last_active":"2024-01-21T20:14:20.057102+0000","last_peered":"2024-01-21T20:14:20.057102+0000","last_clean":"2024-01-21T20:14:20.057102+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:20.057102+0000","last_undegraded":"2024-01-21T20:14:20.057102+0000","last_fullsized":"2024-01-21T20:14:20.057102+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-21T20:14:16.626124+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:14:16.626124+0000","last_peered":"2024-01-21T20:14:16.626124+0000","last_clean":"2024-01-21T20:14:16.626124+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:14:16.626124+0000","last_undegraded":"2024-01-21T20:14:16.626124+0000","last_fullsized":"2024-01-21T20:14:16.626124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302072,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069768,"statfs":{"total":96636764160,"available":96327442432,"internally_reserved":0,"allocated":901120,"data_stored":454039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.79300000000000004,"15min":0.81000000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.47},"last":0.622}]},{"osd":1,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.43099999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.871,"15min":0.91100000000000003},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.45500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.755,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.503}]},{"osd":3,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.81799999999999995,"15min":1.5229999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.80000000000000004,"15min":1.514},"last":0.45500000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84799999999999998},"last":0.51500000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.497,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.59999999999999998,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.46500000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.437}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.35699999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.81699999999999995,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.746,"5min":1.083,"15min":1.083},"last":0.77700000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.44700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.72499999999999998,"5min":1.107,"15min":1.107},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.47399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74399999999999999,"5min":1.016,"15min":1.016},"last":0.70099999999999996}]},{"osd":2,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.58299999999999996}]},{"osd":3,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.439,"5min":0.371,"15min":0.371},"max":{"1min":0.71699999999999997,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57299999999999995,"15min":0.56999999999999995},"min":{"1min":0.47899999999999998,"5min":0.39000000000000001,"15min":0.378},"max":{"1min":0.752,"5min":1.069,"15min":1.069},"last":0.73499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.44700000000000001,"15min":0.45700000000000002},"min":{"1min":0.33500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73299999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.754},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.375,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.71999999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50600000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.312},"max":{"1min":0.77300000000000002,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56699999999999995,"15min":0.56799999999999995},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77100000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.40400000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75900000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54300000000000004,"15min":0.54200000000000004},"min":{"1min":0.42499999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78900000000000003,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.61399999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.433},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.247},"max":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.442}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":0.53700000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40100000000000002,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.19400000000000001},"max":{"1min":0.52300000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.41499999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.437},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.54100000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.313,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.34000000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.48999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.69999999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.505,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.876,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.56100000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89000000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.748}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":0.879,"15min":0.99299999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.91400000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.70999999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.872,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.57299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":901120,"data_stored":454039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.217,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.26300000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54100000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.48799999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42499999999999999,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44500000000000001,"15min":0.434},"min":{"1min":0.35399999999999998,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.58399999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54400000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85599999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70099999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86599999999999999,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.624},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.74199999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.54100000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65500000000000003,"15min":0.66000000000000003},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66800000000000004,"15min":0.65100000000000002},"min":{"1min":0.58299999999999996,"5min":0.379,"15min":0.379},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.372,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.31900000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.30099999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.30299999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35799999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.85499999999999998,"15min":0.95499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.55000000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.79100000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.96699999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.628,"15min":0.625},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.98699999999999999},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":1.2,"15min":1.2},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64400000000000002},"min":{"1min":0.51700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.56999999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.84299999999999997,"15min":0.92900000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":1.216,"15min":1.216},"last":0.48999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302076,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46000000000000002,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.185,"15min":0.185},"max":{"1min":0.626,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.49199999999999999,"15min":0.441},"min":{"1min":0.34000000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.57099999999999995,"5min":7.532,"15min":7.532},"last":0.34599999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.249},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57299999999999995,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.315}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51300000000000001,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60499999999999998,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.377},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.436}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.379,"15min":0.377},"max":{"1min":0.85099999999999998,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.68700000000000006,"15min":0.65200000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68200000000000005,"15min":0.64300000000000002},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69899999999999995,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.66600000000000004},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.622},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.91300000000000003,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72599999999999998,"15min":0.68899999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86899999999999999,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.63400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302076,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069764,"statfs":{"total":96636764160,"available":96327438336,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.77100000000000002,"15min":1.379},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.139},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.52300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.44900000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.81799999999999995,"15min":1.7130000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":2.262},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.7410000000000001},"last":0.59799999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46899999999999997,"15min":0.49399999999999999},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":2.3530000000000002},"last":0.495},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63900000000000001,"5min":0.77600000000000002,"15min":1.296},"last":0.48299999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.39200000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.79500000000000004,"15min":1.7629999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.316},"max":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":2.3839999999999999},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":1.3280000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":1.8839999999999999},"last":0.628}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065668,"statfs":{"total":96636764160,"available":96323244032,"internally_reserved":0,"allocated":905216,"data_stored":455000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.53700000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":1.252,"15min":1.252},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.40500000000000003}]},{"osd":3,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.425},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.32600000000000001,"15min":0.29699999999999999},"max":{"1min":0.78300000000000003,"5min":1.008,"15min":1.492},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60699999999999998,"5min":1.891,"15min":1.891},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.40300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74199999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:14:24.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:14:24.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.594+0000 7f6046e23700 1 Processor -- start 2024-01-21T20:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.594+0000 7f6046e23700 1 -- start start 2024-01-21T20:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6046e23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6040067d90 0x7f6040137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6046e23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6040068370 con 0x7f6040137030 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6046e23700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6040068650 con 0x7f60400c5930 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6046e23700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6040068930 con 0x7f6040067d90 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6040067d90 0x7f6040137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6044bbf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6040137030 0x7f6040155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35940/0 (socket says 172.21.15.133:35940) 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f6044bbf700 1 -- 172.21.15.133:0/1447298510 learned_addr learned my addr 172.21.15.133:0/1447298510 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603ffff700 1 -- 172.21.15.133:0/1447298510 >> v1:172.21.15.178:6789/0 conn(0x7f60400c5930 legacy=0x7f60400c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603ffff700 1 -- 172.21.15.133:0/1447298510 >> v1:172.21.15.133:6789/0 conn(0x7f6040137030 legacy=0x7f6040155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603ffff700 1 -- 172.21.15.133:0/1447298510 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040068c10 con 0x7f6040067d90 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603f7fe700 1 -- 172.21.15.133:0/1447298510 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522398018 0 0) 0x7f6040068370 con 0x7f6040137030 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603ffff700 1 --2- 172.21.15.133:0/1447298510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f6040137410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c009060).ready entity=mon.0 client_cookie=d8b2fdbdbb9901b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603f7fe700 1 -- 172.21.15.133:0/1447298510 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0090d0 con 0x7f6040067d90 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603f7fe700 1 -- 172.21.15.133:0/1447298510 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00b520 con 0x7f6040067d90 2024-01-21T20:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.595+0000 7f603f7fe700 1 -- 172.21.15.133:0/1447298510 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c00b8a0 con 0x7f6040067d90 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 -- 172.21.15.133:0/1447298510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 msgr2=0x7f6040137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 --2- 172.21.15.133:0/1447298510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f6040137410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f602c009760 tx=0x7f602c009060).stop 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 -- 172.21.15.133:0/1447298510 shutdown_connections 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 --2- 172.21.15.133:0/1447298510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f6040137410 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 -- 172.21.15.133:0/1447298510 >> 172.21.15.133:0/1447298510 conn(0x7f6040066a90 msgr2=0x7f6040066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 -- 172.21.15.133:0/1447298510 shutdown_connections 2024-01-21T20:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.596+0000 7f6046e23700 1 -- 172.21.15.133:0/1447298510 wait complete. 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.597+0000 7f6046e23700 1 Processor -- start 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.597+0000 7f6046e23700 1 -- start start 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 0x7f60400c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 0x7f604015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c4460 con 0x7f6040067d90 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c3ea0 con 0x7f6040137030 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6046e23700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c4180 con 0x7f60400c5930 2024-01-21T20:14:24.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44844/0 (socket says 172.21.15.133:44844) 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 -- 172.21.15.133:0/3589957576 learned_addr learned my addr 172.21.15.133:0/3589957576 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f603ffff700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 0x7f60400c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f60453c0700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 0x7f604015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 -- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 msgr2=0x7f60400c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 0x7f60400c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 -- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 msgr2=0x7f604015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 0x7f604015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f6044bbf700 1 -- 172.21.15.133:0/3589957576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0092a0 con 0x7f6040067d90 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f603ffff700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 0x7f60400c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.598+0000 7f60453c0700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 0x7f604015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f6044bbf700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f603400c4e0 tx=0x7f6034007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340072e0 con 0x7f6040067d90 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034007440 con 0x7f6040067d90 2024-01-21T20:14:24.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340057a0 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400c1420 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.599+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60400c4b70 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.600+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60400c1940 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.600+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6034005bd0 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.600+0000 7f603d7fa700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 0x7f6024061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.600+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f6034079d80 con 0x7f6040067d90 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.600+0000 7f603ffff700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 0x7f6024061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.601+0000 7f603ffff700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 0x7f6024061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6040067370 tx=0x7f602c017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.604+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f60400c1940 con 0x7f6040067d90 2024-01-21T20:14:24.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.768+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60400c1940 con 0x7f602405f150 2024-01-21T20:14:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.777+0000 7f603d7fa700 1 -- 172.21.15.133:0/3589957576 <== mgr.6120 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361310 (secure 0 0 0) 0x7f60400c1940 con 0x7f602405f150 2024-01-21T20:14:24.771 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:24.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 msgr2=0x7f6024061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 0x7f6024061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6040067370 tx=0x7f602c017000).stop 2024-01-21T20:14:24.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 msgr2=0x7f60400c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f603400c4e0 tx=0x7f6034007c70).stop 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 shutdown_connections 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f602405f150 0x7f6024061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6040137030 0x7f604015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6040067d90 0x7f60400c34e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 --2- 172.21.15.133:0/3589957576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60400c5930 0x7f60400c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 >> 172.21.15.133:0/3589957576 conn(0x7f6040066a90 msgr2=0x7f60400c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 shutdown_connections 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.781+0000 7f6046e23700 1 -- 172.21.15.133:0/3589957576 wait complete. 2024-01-21T20:14:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:14:24.782 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T20:14:24.667959+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2417048,"kb_used_data":7512,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752557672,"statfs":{"total":773094113280,"available":770619056128,"internally_reserved":0,"allocated":7692288,"data_stored":3875642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27604,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-79,"num_write_kb":-64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.541305"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.465578+0000","last_change":"2024-01-21T20:14:21.463040+0000","last_active":"2024-01-21T20:14:21.465578+0000","last_peered":"2024-01-21T20:14:21.465578+0000","last_clean":"2024-01-21T20:14:21.465578+0000","last_became_active":"2024-01-21T20:14:21.462764+0000","last_became_peered":"2024-01-21T20:14:21.462764+0000","last_unstale":"2024-01-21T20:14:21.465578+0000","last_undegraded":"2024-01-21T20:14:21.465578+0000","last_fullsized":"2024-01-21T20:14:21.465578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3f","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.464089+0000","last_change":"2024-01-21T20:14:21.079093+0000","last_active":"2024-01-21T20:14:21.464089+0000","last_peered":"2024-01-21T20:14:21.464089+0000","last_clean":"2024-01-21T20:14:21.464089+0000","last_became_active":"2024-01-21T20:14:21.078578+0000","last_became_peered":"2024-01-21T20:14:21.078578+0000","last_unstale":"2024-01-21T20:14:21.464089+0000","last_undegraded":"2024-01-21T20:14:21.464089+0000","last_fullsized":"2024-01-21T20:14:21.464089+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462823+0000","last_change":"2024-01-21T20:14:21.460692+0000","last_active":"2024-01-21T20:14:21.462823+0000","last_peered":"2024-01-21T20:14:21.462823+0000","last_clean":"2024-01-21T20:14:21.462823+0000","last_became_active":"2024-01-21T20:14:21.460261+0000","last_became_peered":"2024-01-21T20:14:21.460261+0000","last_unstale":"2024-01-21T20:14:21.462823+0000","last_undegraded":"2024-01-21T20:14:21.462823+0000","last_fullsized":"2024-01-21T20:14:21.462823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450517+0000","last_change":"2024-01-21T20:14:21.095122+0000","last_active":"2024-01-21T20:14:21.450517+0000","last_peered":"2024-01-21T20:14:21.450517+0000","last_clean":"2024-01-21T20:14:21.450517+0000","last_became_active":"2024-01-21T20:14:21.094762+0000","last_became_peered":"2024-01-21T20:14:21.094762+0000","last_unstale":"2024-01-21T20:14:21.450517+0000","last_undegraded":"2024-01-21T20:14:21.450517+0000","last_fullsized":"2024-01-21T20:14:21.450517+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.465592+0000","last_change":"2024-01-21T20:14:21.462305+0000","last_active":"2024-01-21T20:14:21.465592+0000","last_peered":"2024-01-21T20:14:21.465592+0000","last_clean":"2024-01-21T20:14:21.465592+0000","last_became_active":"2024-01-21T20:14:21.462091+0000","last_became_peered":"2024-01-21T20:14:21.462091+0000","last_unstale":"2024-01-21T20:14:21.465592+0000","last_undegraded":"2024-01-21T20:14:21.465592+0000","last_fullsized":"2024-01-21T20:14:21.465592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.449858+0000","last_change":"2024-01-21T20:14:21.084100+0000","last_active":"2024-01-21T20:14:21.449858+0000","last_peered":"2024-01-21T20:14:21.449858+0000","last_clean":"2024-01-21T20:14:21.449858+0000","last_became_active":"2024-01-21T20:14:21.083812+0000","last_became_peered":"2024-01-21T20:14:21.083812+0000","last_unstale":"2024-01-21T20:14:21.449858+0000","last_undegraded":"2024-01-21T20:14:21.449858+0000","last_fullsized":"2024-01-21T20:14:21.449858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.480636+0000","last_change":"2024-01-21T20:14:21.474983+0000","last_active":"2024-01-21T20:14:21.480636+0000","last_peered":"2024-01-21T20:14:21.480636+0000","last_clean":"2024-01-21T20:14:21.480636+0000","last_became_active":"2024-01-21T20:14:21.474749+0000","last_became_peered":"2024-01-21T20:14:21.474749+0000","last_unstale":"2024-01-21T20:14:21.480636+0000","last_undegraded":"2024-01-21T20:14:21.480636+0000","last_fullsized":"2024-01-21T20:14:21.480636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476244+0000","last_change":"2024-01-21T20:14:21.081661+0000","last_active":"2024-01-21T20:14:21.476244+0000","last_peered":"2024-01-21T20:14:21.476244+0000","last_clean":"2024-01-21T20:14:21.476244+0000","last_became_active":"2024-01-21T20:14:21.080800+0000","last_became_peered":"2024-01-21T20:14:21.080800+0000","last_unstale":"2024-01-21T20:14:21.476244+0000","last_undegraded":"2024-01-21T20:14:21.476244+0000","last_fullsized":"2024-01-21T20:14:21.476244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474653+0000","last_change":"2024-01-21T20:14:21.469448+0000","last_active":"2024-01-21T20:14:21.474653+0000","last_peered":"2024-01-21T20:14:21.474653+0000","last_clean":"2024-01-21T20:14:21.474653+0000","last_became_active":"2024-01-21T20:14:21.469015+0000","last_became_peered":"2024-01-21T20:14:21.469015+0000","last_unstale":"2024-01-21T20:14:21.474653+0000","last_undegraded":"2024-01-21T20:14:21.474653+0000","last_fullsized":"2024-01-21T20:14:21.474653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474303+0000","last_change":"2024-01-21T20:14:21.082279+0000","last_active":"2024-01-21T20:14:21.474303+0000","last_peered":"2024-01-21T20:14:21.474303+0000","last_clean":"2024-01-21T20:14:21.474303+0000","last_became_active":"2024-01-21T20:14:21.081973+0000","last_became_peered":"2024-01-21T20:14:21.081973+0000","last_unstale":"2024-01-21T20:14:21.474303+0000","last_undegraded":"2024-01-21T20:14:21.474303+0000","last_fullsized":"2024-01-21T20:14:21.474303+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.469964+0000","last_change":"2024-01-21T20:14:21.460640+0000","last_active":"2024-01-21T20:14:21.469964+0000","last_peered":"2024-01-21T20:14:21.469964+0000","last_clean":"2024-01-21T20:14:21.469964+0000","last_became_active":"2024-01-21T20:14:21.460313+0000","last_became_peered":"2024-01-21T20:14:21.460313+0000","last_unstale":"2024-01-21T20:14:21.469964+0000","last_undegraded":"2024-01-21T20:14:21.469964+0000","last_fullsized":"2024-01-21T20:14:21.469964+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478149+0000","last_change":"2024-01-21T20:14:21.079450+0000","last_active":"2024-01-21T20:14:21.478149+0000","last_peered":"2024-01-21T20:14:21.478149+0000","last_clean":"2024-01-21T20:14:21.478149+0000","last_became_active":"2024-01-21T20:14:21.079170+0000","last_became_peered":"2024-01-21T20:14:21.079170+0000","last_unstale":"2024-01-21T20:14:21.478149+0000","last_undegraded":"2024-01-21T20:14:21.478149+0000","last_fullsized":"2024-01-21T20:14:21.478149+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472666+0000","last_change":"2024-01-21T20:14:21.460518+0000","last_active":"2024-01-21T20:14:21.472666+0000","last_peered":"2024-01-21T20:14:21.472666+0000","last_clean":"2024-01-21T20:14:21.472666+0000","last_became_active":"2024-01-21T20:14:21.460079+0000","last_became_peered":"2024-01-21T20:14:21.460079+0000","last_unstale":"2024-01-21T20:14:21.472666+0000","last_undegraded":"2024-01-21T20:14:21.472666+0000","last_fullsized":"2024-01-21T20:14:21.472666+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453611+0000","last_change":"2024-01-21T20:14:21.082874+0000","last_active":"2024-01-21T20:14:21.453611+0000","last_peered":"2024-01-21T20:14:21.453611+0000","last_clean":"2024-01-21T20:14:21.453611+0000","last_became_active":"2024-01-21T20:14:21.082602+0000","last_became_peered":"2024-01-21T20:14:21.082602+0000","last_unstale":"2024-01-21T20:14:21.453611+0000","last_undegraded":"2024-01-21T20:14:21.453611+0000","last_fullsized":"2024-01-21T20:14:21.453611+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474626+0000","last_change":"2024-01-21T20:14:21.468678+0000","last_active":"2024-01-21T20:14:21.474626+0000","last_peered":"2024-01-21T20:14:21.474626+0000","last_clean":"2024-01-21T20:14:21.474626+0000","last_became_active":"2024-01-21T20:14:21.468320+0000","last_became_peered":"2024-01-21T20:14:21.468320+0000","last_unstale":"2024-01-21T20:14:21.474626+0000","last_undegraded":"2024-01-21T20:14:21.474626+0000","last_fullsized":"2024-01-21T20:14:21.474626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450326+0000","last_change":"2024-01-21T20:14:21.076572+0000","last_active":"2024-01-21T20:14:21.450326+0000","last_peered":"2024-01-21T20:14:21.450326+0000","last_clean":"2024-01-21T20:14:21.450326+0000","last_became_active":"2024-01-21T20:14:21.076286+0000","last_became_peered":"2024-01-21T20:14:21.076286+0000","last_unstale":"2024-01-21T20:14:21.450326+0000","last_undegraded":"2024-01-21T20:14:21.450326+0000","last_fullsized":"2024-01-21T20:14:21.450326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478234+0000","last_change":"2024-01-21T20:14:21.476980+0000","last_active":"2024-01-21T20:14:21.478234+0000","last_peered":"2024-01-21T20:14:21.478234+0000","last_clean":"2024-01-21T20:14:21.478234+0000","last_became_active":"2024-01-21T20:14:21.475851+0000","last_became_peered":"2024-01-21T20:14:21.475851+0000","last_unstale":"2024-01-21T20:14:21.478234+0000","last_undegraded":"2024-01-21T20:14:21.478234+0000","last_fullsized":"2024-01-21T20:14:21.478234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.456941+0000","last_change":"2024-01-21T20:14:21.082579+0000","last_active":"2024-01-21T20:14:21.456941+0000","last_peered":"2024-01-21T20:14:21.456941+0000","last_clean":"2024-01-21T20:14:21.456941+0000","last_became_active":"2024-01-21T20:14:21.082258+0000","last_became_peered":"2024-01-21T20:14:21.082258+0000","last_unstale":"2024-01-21T20:14:21.456941+0000","last_undegraded":"2024-01-21T20:14:21.456941+0000","last_fullsized":"2024-01-21T20:14:21.456941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.465284+0000","last_change":"2024-01-21T20:14:21.464235+0000","last_active":"2024-01-21T20:14:21.465284+0000","last_peered":"2024-01-21T20:14:21.465284+0000","last_clean":"2024-01-21T20:14:21.465284+0000","last_became_active":"2024-01-21T20:14:21.463932+0000","last_became_peered":"2024-01-21T20:14:21.463932+0000","last_unstale":"2024-01-21T20:14:21.465284+0000","last_undegraded":"2024-01-21T20:14:21.465284+0000","last_fullsized":"2024-01-21T20:14:21.465284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.457803+0000","last_change":"2024-01-21T20:14:21.088451+0000","last_active":"2024-01-21T20:14:21.457803+0000","last_peered":"2024-01-21T20:14:21.457803+0000","last_clean":"2024-01-21T20:14:21.457803+0000","last_became_active":"2024-01-21T20:14:21.087934+0000","last_became_peered":"2024-01-21T20:14:21.087934+0000","last_unstale":"2024-01-21T20:14:21.457803+0000","last_undegraded":"2024-01-21T20:14:21.457803+0000","last_fullsized":"2024-01-21T20:14:21.457803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.464750+0000","last_change":"2024-01-21T20:14:21.460917+0000","last_active":"2024-01-21T20:14:21.464750+0000","last_peered":"2024-01-21T20:14:21.464750+0000","last_clean":"2024-01-21T20:14:21.464750+0000","last_became_active":"2024-01-21T20:14:21.460090+0000","last_became_peered":"2024-01-21T20:14:21.460090+0000","last_unstale":"2024-01-21T20:14:21.464750+0000","last_undegraded":"2024-01-21T20:14:21.464750+0000","last_fullsized":"2024-01-21T20:14:21.464750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.456009+0000","last_change":"2024-01-21T20:14:21.088289+0000","last_active":"2024-01-21T20:14:21.456009+0000","last_peered":"2024-01-21T20:14:21.456009+0000","last_clean":"2024-01-21T20:14:21.456009+0000","last_became_active":"2024-01-21T20:14:21.087951+0000","last_became_peered":"2024-01-21T20:14:21.087951+0000","last_unstale":"2024-01-21T20:14:21.456009+0000","last_undegraded":"2024-01-21T20:14:21.456009+0000","last_fullsized":"2024-01-21T20:14:21.456009+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472773+0000","last_change":"2024-01-21T20:14:21.468350+0000","last_active":"2024-01-21T20:14:21.472773+0000","last_peered":"2024-01-21T20:14:21.472773+0000","last_clean":"2024-01-21T20:14:21.472773+0000","last_became_active":"2024-01-21T20:14:21.466807+0000","last_became_peered":"2024-01-21T20:14:21.466807+0000","last_unstale":"2024-01-21T20:14:21.472773+0000","last_undegraded":"2024-01-21T20:14:21.472773+0000","last_fullsized":"2024-01-21T20:14:21.472773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478876+0000","last_change":"2024-01-21T20:14:21.081839+0000","last_active":"2024-01-21T20:14:21.478876+0000","last_peered":"2024-01-21T20:14:21.478876+0000","last_clean":"2024-01-21T20:14:21.478876+0000","last_became_active":"2024-01-21T20:14:21.081322+0000","last_became_peered":"2024-01-21T20:14:21.081322+0000","last_unstale":"2024-01-21T20:14:21.478876+0000","last_undegraded":"2024-01-21T20:14:21.478876+0000","last_fullsized":"2024-01-21T20:14:21.478876+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477973+0000","last_change":"2024-01-21T20:14:21.470320+0000","last_active":"2024-01-21T20:14:21.477973+0000","last_peered":"2024-01-21T20:14:21.477973+0000","last_clean":"2024-01-21T20:14:21.477973+0000","last_became_active":"2024-01-21T20:14:21.470098+0000","last_became_peered":"2024-01-21T20:14:21.470098+0000","last_unstale":"2024-01-21T20:14:21.477973+0000","last_undegraded":"2024-01-21T20:14:21.477973+0000","last_fullsized":"2024-01-21T20:14:21.477973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.33","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475575+0000","last_change":"2024-01-21T20:14:21.082998+0000","last_active":"2024-01-21T20:14:21.475575+0000","last_peered":"2024-01-21T20:14:21.475575+0000","last_clean":"2024-01-21T20:14:21.475575+0000","last_became_active":"2024-01-21T20:14:21.082709+0000","last_became_peered":"2024-01-21T20:14:21.082709+0000","last_unstale":"2024-01-21T20:14:21.475575+0000","last_undegraded":"2024-01-21T20:14:21.475575+0000","last_fullsized":"2024-01-21T20:14:21.475575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.471870+0000","last_change":"2024-01-21T20:14:21.464831+0000","last_active":"2024-01-21T20:14:21.471870+0000","last_peered":"2024-01-21T20:14:21.471870+0000","last_clean":"2024-01-21T20:14:21.471870+0000","last_became_active":"2024-01-21T20:14:21.460754+0000","last_became_peered":"2024-01-21T20:14:21.460754+0000","last_unstale":"2024-01-21T20:14:21.471870+0000","last_undegraded":"2024-01-21T20:14:21.471870+0000","last_fullsized":"2024-01-21T20:14:21.471870+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.456219+0000","last_change":"2024-01-21T20:14:21.075885+0000","last_active":"2024-01-21T20:14:21.456219+0000","last_peered":"2024-01-21T20:14:21.456219+0000","last_clean":"2024-01-21T20:14:21.456219+0000","last_became_active":"2024-01-21T20:14:21.075656+0000","last_became_peered":"2024-01-21T20:14:21.075656+0000","last_unstale":"2024-01-21T20:14:21.456219+0000","last_undegraded":"2024-01-21T20:14:21.456219+0000","last_fullsized":"2024-01-21T20:14:21.456219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.460551+0000","last_change":"2024-01-21T20:14:21.458991+0000","last_active":"2024-01-21T20:14:21.460551+0000","last_peered":"2024-01-21T20:14:21.460551+0000","last_clean":"2024-01-21T20:14:21.460551+0000","last_became_active":"2024-01-21T20:14:21.458698+0000","last_became_peered":"2024-01-21T20:14:21.458698+0000","last_unstale":"2024-01-21T20:14:21.460551+0000","last_undegraded":"2024-01-21T20:14:21.460551+0000","last_fullsized":"2024-01-21T20:14:21.460551+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453712+0000","last_change":"2024-01-21T20:14:21.093669+0000","last_active":"2024-01-21T20:14:21.453712+0000","last_peered":"2024-01-21T20:14:21.453712+0000","last_clean":"2024-01-21T20:14:21.453712+0000","last_became_active":"2024-01-21T20:14:21.093368+0000","last_became_peered":"2024-01-21T20:14:21.093368+0000","last_unstale":"2024-01-21T20:14:21.453712+0000","last_undegraded":"2024-01-21T20:14:21.453712+0000","last_fullsized":"2024-01-21T20:14:21.453712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475028+0000","last_change":"2024-01-21T20:14:21.469743+0000","last_active":"2024-01-21T20:14:21.475028+0000","last_peered":"2024-01-21T20:14:21.475028+0000","last_clean":"2024-01-21T20:14:21.475028+0000","last_became_active":"2024-01-21T20:14:21.469375+0000","last_became_peered":"2024-01-21T20:14:21.469375+0000","last_unstale":"2024-01-21T20:14:21.475028+0000","last_undegraded":"2024-01-21T20:14:21.475028+0000","last_fullsized":"2024-01-21T20:14:21.475028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472890+0000","last_change":"2024-01-21T20:14:21.090168+0000","last_active":"2024-01-21T20:14:21.472890+0000","last_peered":"2024-01-21T20:14:21.472890+0000","last_clean":"2024-01-21T20:14:21.472890+0000","last_became_active":"2024-01-21T20:14:21.089847+0000","last_became_peered":"2024-01-21T20:14:21.089847+0000","last_unstale":"2024-01-21T20:14:21.472890+0000","last_undegraded":"2024-01-21T20:14:21.472890+0000","last_fullsized":"2024-01-21T20:14:21.472890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.480771+0000","last_change":"2024-01-21T20:14:21.476732+0000","last_active":"2024-01-21T20:14:21.480771+0000","last_peered":"2024-01-21T20:14:21.480771+0000","last_clean":"2024-01-21T20:14:21.480771+0000","last_became_active":"2024-01-21T20:14:21.476473+0000","last_became_peered":"2024-01-21T20:14:21.476473+0000","last_unstale":"2024-01-21T20:14:21.480771+0000","last_undegraded":"2024-01-21T20:14:21.480771+0000","last_fullsized":"2024-01-21T20:14:21.480771+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450171+0000","last_change":"2024-01-21T20:14:21.085655+0000","last_active":"2024-01-21T20:14:21.450171+0000","last_peered":"2024-01-21T20:14:21.450171+0000","last_clean":"2024-01-21T20:14:21.450171+0000","last_became_active":"2024-01-21T20:14:21.085353+0000","last_became_peered":"2024-01-21T20:14:21.085353+0000","last_unstale":"2024-01-21T20:14:21.450171+0000","last_undegraded":"2024-01-21T20:14:21.450171+0000","last_fullsized":"2024-01-21T20:14:21.450171+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476811+0000","last_change":"2024-01-21T20:14:21.472537+0000","last_active":"2024-01-21T20:14:21.476811+0000","last_peered":"2024-01-21T20:14:21.476811+0000","last_clean":"2024-01-21T20:14:21.476811+0000","last_became_active":"2024-01-21T20:14:21.472250+0000","last_became_peered":"2024-01-21T20:14:21.472250+0000","last_unstale":"2024-01-21T20:14:21.476811+0000","last_undegraded":"2024-01-21T20:14:21.476811+0000","last_fullsized":"2024-01-21T20:14:21.476811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450194+0000","last_change":"2024-01-21T20:14:21.090709+0000","last_active":"2024-01-21T20:14:21.450194+0000","last_peered":"2024-01-21T20:14:21.450194+0000","last_clean":"2024-01-21T20:14:21.450194+0000","last_became_active":"2024-01-21T20:14:21.090445+0000","last_became_peered":"2024-01-21T20:14:21.090445+0000","last_unstale":"2024-01-21T20:14:21.450194+0000","last_undegraded":"2024-01-21T20:14:21.450194+0000","last_fullsized":"2024-01-21T20:14:21.450194+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477652+0000","last_change":"2024-01-21T20:14:21.473704+0000","last_active":"2024-01-21T20:14:21.477652+0000","last_peered":"2024-01-21T20:14:21.477652+0000","last_clean":"2024-01-21T20:14:21.477652+0000","last_became_active":"2024-01-21T20:14:21.473413+0000","last_became_peered":"2024-01-21T20:14:21.473413+0000","last_unstale":"2024-01-21T20:14:21.477652+0000","last_undegraded":"2024-01-21T20:14:21.477652+0000","last_fullsized":"2024-01-21T20:14:21.477652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.464424+0000","last_change":"2024-01-21T20:14:21.078896+0000","last_active":"2024-01-21T20:14:21.464424+0000","last_peered":"2024-01-21T20:14:21.464424+0000","last_clean":"2024-01-21T20:14:21.464424+0000","last_became_active":"2024-01-21T20:14:21.078610+0000","last_became_peered":"2024-01-21T20:14:21.078610+0000","last_unstale":"2024-01-21T20:14:21.464424+0000","last_undegraded":"2024-01-21T20:14:21.464424+0000","last_fullsized":"2024-01-21T20:14:21.464424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.467928+0000","last_change":"2024-01-21T20:14:21.463602+0000","last_active":"2024-01-21T20:14:21.467928+0000","last_peered":"2024-01-21T20:14:21.467928+0000","last_clean":"2024-01-21T20:14:21.467928+0000","last_became_active":"2024-01-21T20:14:21.463357+0000","last_became_peered":"2024-01-21T20:14:21.463357+0000","last_unstale":"2024-01-21T20:14:21.467928+0000","last_undegraded":"2024-01-21T20:14:21.467928+0000","last_fullsized":"2024-01-21T20:14:21.467928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.452267+0000","last_change":"2024-01-21T20:14:21.082816+0000","last_active":"2024-01-21T20:14:21.452267+0000","last_peered":"2024-01-21T20:14:21.452267+0000","last_clean":"2024-01-21T20:14:21.452267+0000","last_became_active":"2024-01-21T20:14:21.082494+0000","last_became_peered":"2024-01-21T20:14:21.082494+0000","last_unstale":"2024-01-21T20:14:21.452267+0000","last_undegraded":"2024-01-21T20:14:21.452267+0000","last_fullsized":"2024-01-21T20:14:21.452267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.463155+0000","last_change":"2024-01-21T20:14:21.460442+0000","last_active":"2024-01-21T20:14:21.463155+0000","last_peered":"2024-01-21T20:14:21.463155+0000","last_clean":"2024-01-21T20:14:21.463155+0000","last_became_active":"2024-01-21T20:14:21.459891+0000","last_became_peered":"2024-01-21T20:14:21.459891+0000","last_unstale":"2024-01-21T20:14:21.463155+0000","last_undegraded":"2024-01-21T20:14:21.463155+0000","last_fullsized":"2024-01-21T20:14:21.463155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478059+0000","last_change":"2024-01-21T20:14:21.088615+0000","last_active":"2024-01-21T20:14:21.478059+0000","last_peered":"2024-01-21T20:14:21.478059+0000","last_clean":"2024-01-21T20:14:21.478059+0000","last_became_active":"2024-01-21T20:14:21.088362+0000","last_became_peered":"2024-01-21T20:14:21.088362+0000","last_unstale":"2024-01-21T20:14:21.478059+0000","last_undegraded":"2024-01-21T20:14:21.478059+0000","last_fullsized":"2024-01-21T20:14:21.478059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.469481+0000","last_change":"2024-01-21T20:14:21.461097+0000","last_active":"2024-01-21T20:14:21.469481+0000","last_peered":"2024-01-21T20:14:21.469481+0000","last_clean":"2024-01-21T20:14:21.469481+0000","last_became_active":"2024-01-21T20:14:21.460815+0000","last_became_peered":"2024-01-21T20:14:21.460815+0000","last_unstale":"2024-01-21T20:14:21.469481+0000","last_undegraded":"2024-01-21T20:14:21.469481+0000","last_fullsized":"2024-01-21T20:14:21.469481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451059+0000","last_change":"2024-01-21T20:14:21.086742+0000","last_active":"2024-01-21T20:14:21.451059+0000","last_peered":"2024-01-21T20:14:21.451059+0000","last_clean":"2024-01-21T20:14:21.451059+0000","last_became_active":"2024-01-21T20:14:21.086296+0000","last_became_peered":"2024-01-21T20:14:21.086296+0000","last_unstale":"2024-01-21T20:14:21.451059+0000","last_undegraded":"2024-01-21T20:14:21.451059+0000","last_fullsized":"2024-01-21T20:14:21.451059+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.463951+0000","last_change":"2024-01-21T20:14:21.460723+0000","last_active":"2024-01-21T20:14:21.463951+0000","last_peered":"2024-01-21T20:14:21.463951+0000","last_clean":"2024-01-21T20:14:21.463951+0000","last_became_active":"2024-01-21T20:14:21.460417+0000","last_became_peered":"2024-01-21T20:14:21.460417+0000","last_unstale":"2024-01-21T20:14:21.463951+0000","last_undegraded":"2024-01-21T20:14:21.463951+0000","last_fullsized":"2024-01-21T20:14:21.463951+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.452274+0000","last_change":"2024-01-21T20:14:21.085838+0000","last_active":"2024-01-21T20:14:21.452274+0000","last_peered":"2024-01-21T20:14:21.452274+0000","last_clean":"2024-01-21T20:14:21.452274+0000","last_became_active":"2024-01-21T20:14:21.085586+0000","last_became_peered":"2024-01-21T20:14:21.085586+0000","last_unstale":"2024-01-21T20:14:21.452274+0000","last_undegraded":"2024-01-21T20:14:21.452274+0000","last_fullsized":"2024-01-21T20:14:21.452274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475010+0000","last_change":"2024-01-21T20:14:21.469601+0000","last_active":"2024-01-21T20:14:21.475010+0000","last_peered":"2024-01-21T20:14:21.475010+0000","last_clean":"2024-01-21T20:14:21.475010+0000","last_became_active":"2024-01-21T20:14:21.469051+0000","last_became_peered":"2024-01-21T20:14:21.469051+0000","last_unstale":"2024-01-21T20:14:21.475010+0000","last_undegraded":"2024-01-21T20:14:21.475010+0000","last_fullsized":"2024-01-21T20:14:21.475010+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453274+0000","last_change":"2024-01-21T20:14:21.083403+0000","last_active":"2024-01-21T20:14:21.453274+0000","last_peered":"2024-01-21T20:14:21.453274+0000","last_clean":"2024-01-21T20:14:21.453274+0000","last_became_active":"2024-01-21T20:14:21.082976+0000","last_became_peered":"2024-01-21T20:14:21.082976+0000","last_unstale":"2024-01-21T20:14:21.453274+0000","last_undegraded":"2024-01-21T20:14:21.453274+0000","last_fullsized":"2024-01-21T20:14:21.453274+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.480673+0000","last_change":"2024-01-21T20:14:21.475315+0000","last_active":"2024-01-21T20:14:21.480673+0000","last_peered":"2024-01-21T20:14:21.480673+0000","last_clean":"2024-01-21T20:14:21.480673+0000","last_became_active":"2024-01-21T20:14:21.475064+0000","last_became_peered":"2024-01-21T20:14:21.475064+0000","last_unstale":"2024-01-21T20:14:21.480673+0000","last_undegraded":"2024-01-21T20:14:21.480673+0000","last_fullsized":"2024-01-21T20:14:21.480673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.447501+0000","last_change":"2024-01-21T20:14:21.093741+0000","last_active":"2024-01-21T20:14:21.447501+0000","last_peered":"2024-01-21T20:14:21.447501+0000","last_clean":"2024-01-21T20:14:21.447501+0000","last_became_active":"2024-01-21T20:14:21.093431+0000","last_became_peered":"2024-01-21T20:14:21.093431+0000","last_unstale":"2024-01-21T20:14:21.447501+0000","last_undegraded":"2024-01-21T20:14:21.447501+0000","last_fullsized":"2024-01-21T20:14:21.447501+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477347+0000","last_change":"2024-01-21T20:14:21.471350+0000","last_active":"2024-01-21T20:14:21.477347+0000","last_peered":"2024-01-21T20:14:21.477347+0000","last_clean":"2024-01-21T20:14:21.477347+0000","last_became_active":"2024-01-21T20:14:21.471069+0000","last_became_peered":"2024-01-21T20:14:21.471069+0000","last_unstale":"2024-01-21T20:14:21.477347+0000","last_undegraded":"2024-01-21T20:14:21.477347+0000","last_fullsized":"2024-01-21T20:14:21.477347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.466433+0000","last_change":"2024-01-21T20:14:21.085289+0000","last_active":"2024-01-21T20:14:21.466433+0000","last_peered":"2024-01-21T20:14:21.466433+0000","last_clean":"2024-01-21T20:14:21.466433+0000","last_became_active":"2024-01-21T20:14:21.084798+0000","last_became_peered":"2024-01-21T20:14:21.084798+0000","last_unstale":"2024-01-21T20:14:21.466433+0000","last_undegraded":"2024-01-21T20:14:21.466433+0000","last_fullsized":"2024-01-21T20:14:21.466433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477074+0000","last_change":"2024-01-21T20:14:21.472853+0000","last_active":"2024-01-21T20:14:21.477074+0000","last_peered":"2024-01-21T20:14:21.477074+0000","last_clean":"2024-01-21T20:14:21.477074+0000","last_became_active":"2024-01-21T20:14:21.472605+0000","last_became_peered":"2024-01-21T20:14:21.472605+0000","last_unstale":"2024-01-21T20:14:21.477074+0000","last_undegraded":"2024-01-21T20:14:21.477074+0000","last_fullsized":"2024-01-21T20:14:21.477074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451031+0000","last_change":"2024-01-21T20:14:21.083314+0000","last_active":"2024-01-21T20:14:21.451031+0000","last_peered":"2024-01-21T20:14:21.451031+0000","last_clean":"2024-01-21T20:14:21.451031+0000","last_became_active":"2024-01-21T20:14:21.083015+0000","last_became_peered":"2024-01-21T20:14:21.083015+0000","last_unstale":"2024-01-21T20:14:21.451031+0000","last_undegraded":"2024-01-21T20:14:21.451031+0000","last_fullsized":"2024-01-21T20:14:21.451031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477821+0000","last_change":"2024-01-21T20:14:21.473389+0000","last_active":"2024-01-21T20:14:21.477821+0000","last_peered":"2024-01-21T20:14:21.477821+0000","last_clean":"2024-01-21T20:14:21.477821+0000","last_became_active":"2024-01-21T20:14:21.473130+0000","last_became_peered":"2024-01-21T20:14:21.473130+0000","last_unstale":"2024-01-21T20:14:21.477821+0000","last_undegraded":"2024-01-21T20:14:21.477821+0000","last_fullsized":"2024-01-21T20:14:21.477821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.447076+0000","last_change":"2024-01-21T20:14:21.081870+0000","last_active":"2024-01-21T20:14:21.447076+0000","last_peered":"2024-01-21T20:14:21.447076+0000","last_clean":"2024-01-21T20:14:21.447076+0000","last_became_active":"2024-01-21T20:14:21.081600+0000","last_became_peered":"2024-01-21T20:14:21.081600+0000","last_unstale":"2024-01-21T20:14:21.447076+0000","last_undegraded":"2024-01-21T20:14:21.447076+0000","last_fullsized":"2024-01-21T20:14:21.447076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472874+0000","last_change":"2024-01-21T20:14:21.465062+0000","last_active":"2024-01-21T20:14:21.472874+0000","last_peered":"2024-01-21T20:14:21.472874+0000","last_clean":"2024-01-21T20:14:21.472874+0000","last_became_active":"2024-01-21T20:14:21.464777+0000","last_became_peered":"2024-01-21T20:14:21.464777+0000","last_unstale":"2024-01-21T20:14:21.472874+0000","last_undegraded":"2024-01-21T20:14:21.472874+0000","last_fullsized":"2024-01-21T20:14:21.472874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451662+0000","last_change":"2024-01-21T20:14:21.082022+0000","last_active":"2024-01-21T20:14:21.451662+0000","last_peered":"2024-01-21T20:14:21.451662+0000","last_clean":"2024-01-21T20:14:21.451662+0000","last_became_active":"2024-01-21T20:14:21.081739+0000","last_became_peered":"2024-01-21T20:14:21.081739+0000","last_unstale":"2024-01-21T20:14:21.451662+0000","last_undegraded":"2024-01-21T20:14:21.451662+0000","last_fullsized":"2024-01-21T20:14:21.451662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.466546+0000","last_change":"2024-01-21T20:14:21.465665+0000","last_active":"2024-01-21T20:14:21.466546+0000","last_peered":"2024-01-21T20:14:21.466546+0000","last_clean":"2024-01-21T20:14:21.466546+0000","last_became_active":"2024-01-21T20:14:21.465375+0000","last_became_peered":"2024-01-21T20:14:21.465375+0000","last_unstale":"2024-01-21T20:14:21.466546+0000","last_undegraded":"2024-01-21T20:14:21.466546+0000","last_fullsized":"2024-01-21T20:14:21.466546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.449736+0000","last_change":"2024-01-21T20:14:21.081684+0000","last_active":"2024-01-21T20:14:21.449736+0000","last_peered":"2024-01-21T20:14:21.449736+0000","last_clean":"2024-01-21T20:14:21.449736+0000","last_became_active":"2024-01-21T20:14:21.081414+0000","last_became_peered":"2024-01-21T20:14:21.081414+0000","last_unstale":"2024-01-21T20:14:21.449736+0000","last_undegraded":"2024-01-21T20:14:21.449736+0000","last_fullsized":"2024-01-21T20:14:21.449736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474661+0000","last_change":"2024-01-21T20:14:21.472395+0000","last_active":"2024-01-21T20:14:21.474661+0000","last_peered":"2024-01-21T20:14:21.474661+0000","last_clean":"2024-01-21T20:14:21.474661+0000","last_became_active":"2024-01-21T20:14:21.472127+0000","last_became_peered":"2024-01-21T20:14:21.472127+0000","last_unstale":"2024-01-21T20:14:21.474661+0000","last_undegraded":"2024-01-21T20:14:21.474661+0000","last_fullsized":"2024-01-21T20:14:21.474661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.446760+0000","last_change":"2024-01-21T20:14:21.071039+0000","last_active":"2024-01-21T20:14:21.446760+0000","last_peered":"2024-01-21T20:14:21.446760+0000","last_clean":"2024-01-21T20:14:21.446760+0000","last_became_active":"2024-01-21T20:14:21.070741+0000","last_became_peered":"2024-01-21T20:14:21.070741+0000","last_unstale":"2024-01-21T20:14:21.446760+0000","last_undegraded":"2024-01-21T20:14:21.446760+0000","last_fullsized":"2024-01-21T20:14:21.446760+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472781+0000","last_change":"2024-01-21T20:14:21.465910+0000","last_active":"2024-01-21T20:14:21.472781+0000","last_peered":"2024-01-21T20:14:21.472781+0000","last_clean":"2024-01-21T20:14:21.472781+0000","last_became_active":"2024-01-21T20:14:21.465608+0000","last_became_peered":"2024-01-21T20:14:21.465608+0000","last_unstale":"2024-01-21T20:14:21.472781+0000","last_undegraded":"2024-01-21T20:14:21.472781+0000","last_fullsized":"2024-01-21T20:14:21.472781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451704+0000","last_change":"2024-01-21T20:14:21.090155+0000","last_active":"2024-01-21T20:14:21.451704+0000","last_peered":"2024-01-21T20:14:21.451704+0000","last_clean":"2024-01-21T20:14:21.451704+0000","last_became_active":"2024-01-21T20:14:21.089873+0000","last_became_peered":"2024-01-21T20:14:21.089873+0000","last_unstale":"2024-01-21T20:14:21.451704+0000","last_undegraded":"2024-01-21T20:14:21.451704+0000","last_fullsized":"2024-01-21T20:14:21.451704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476837+0000","last_change":"2024-01-21T20:14:21.471924+0000","last_active":"2024-01-21T20:14:21.476837+0000","last_peered":"2024-01-21T20:14:21.476837+0000","last_clean":"2024-01-21T20:14:21.476837+0000","last_became_active":"2024-01-21T20:14:21.471321+0000","last_became_peered":"2024-01-21T20:14:21.471321+0000","last_unstale":"2024-01-21T20:14:21.476837+0000","last_undegraded":"2024-01-21T20:14:21.476837+0000","last_fullsized":"2024-01-21T20:14:21.476837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477745+0000","last_change":"2024-01-21T20:14:21.093707+0000","last_active":"2024-01-21T20:14:21.477745+0000","last_peered":"2024-01-21T20:14:21.477745+0000","last_clean":"2024-01-21T20:14:21.477745+0000","last_became_active":"2024-01-21T20:14:21.093405+0000","last_became_peered":"2024-01-21T20:14:21.093405+0000","last_unstale":"2024-01-21T20:14:21.477745+0000","last_undegraded":"2024-01-21T20:14:21.477745+0000","last_fullsized":"2024-01-21T20:14:21.477745+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477676+0000","last_change":"2024-01-21T20:14:21.474669+0000","last_active":"2024-01-21T20:14:21.477676+0000","last_peered":"2024-01-21T20:14:21.477676+0000","last_clean":"2024-01-21T20:14:21.477676+0000","last_became_active":"2024-01-21T20:14:21.474064+0000","last_became_peered":"2024-01-21T20:14:21.474064+0000","last_unstale":"2024-01-21T20:14:21.477676+0000","last_undegraded":"2024-01-21T20:14:21.477676+0000","last_fullsized":"2024-01-21T20:14:21.477676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475438+0000","last_change":"2024-01-21T20:14:21.087368+0000","last_active":"2024-01-21T20:14:21.475438+0000","last_peered":"2024-01-21T20:14:21.475438+0000","last_clean":"2024-01-21T20:14:21.475438+0000","last_became_active":"2024-01-21T20:14:21.087092+0000","last_became_peered":"2024-01-21T20:14:21.087092+0000","last_unstale":"2024-01-21T20:14:21.475438+0000","last_undegraded":"2024-01-21T20:14:21.475438+0000","last_fullsized":"2024-01-21T20:14:21.475438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.459152+0000","last_change":"2024-01-21T20:14:21.457446+0000","last_active":"2024-01-21T20:14:21.459152+0000","last_peered":"2024-01-21T20:14:21.459152+0000","last_clean":"2024-01-21T20:14:21.459152+0000","last_became_active":"2024-01-21T20:14:21.457175+0000","last_became_peered":"2024-01-21T20:14:21.457175+0000","last_unstale":"2024-01-21T20:14:21.459152+0000","last_undegraded":"2024-01-21T20:14:21.459152+0000","last_fullsized":"2024-01-21T20:14:21.459152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474604+0000","last_change":"2024-01-21T20:14:21.089693+0000","last_active":"2024-01-21T20:14:21.474604+0000","last_peered":"2024-01-21T20:14:21.474604+0000","last_clean":"2024-01-21T20:14:21.474604+0000","last_became_active":"2024-01-21T20:14:21.089406+0000","last_became_peered":"2024-01-21T20:14:21.089406+0000","last_unstale":"2024-01-21T20:14:21.474604+0000","last_undegraded":"2024-01-21T20:14:21.474604+0000","last_fullsized":"2024-01-21T20:14:21.474604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.464779+0000","last_change":"2024-01-21T20:14:21.463785+0000","last_active":"2024-01-21T20:14:21.464779+0000","last_peered":"2024-01-21T20:14:21.464779+0000","last_clean":"2024-01-21T20:14:21.464779+0000","last_became_active":"2024-01-21T20:14:21.460184+0000","last_became_peered":"2024-01-21T20:14:21.460184+0000","last_unstale":"2024-01-21T20:14:21.464779+0000","last_undegraded":"2024-01-21T20:14:21.464779+0000","last_fullsized":"2024-01-21T20:14:21.464779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450848+0000","last_change":"2024-01-21T20:14:21.095058+0000","last_active":"2024-01-21T20:14:21.450848+0000","last_peered":"2024-01-21T20:14:21.450848+0000","last_clean":"2024-01-21T20:14:21.450848+0000","last_became_active":"2024-01-21T20:14:21.094727+0000","last_became_peered":"2024-01-21T20:14:21.094727+0000","last_unstale":"2024-01-21T20:14:21.450848+0000","last_undegraded":"2024-01-21T20:14:21.450848+0000","last_fullsized":"2024-01-21T20:14:21.450848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.469970+0000","last_change":"2024-01-21T20:14:21.459925+0000","last_active":"2024-01-21T20:14:21.469970+0000","last_peered":"2024-01-21T20:14:21.469970+0000","last_clean":"2024-01-21T20:14:21.469970+0000","last_became_active":"2024-01-21T20:14:21.459647+0000","last_became_peered":"2024-01-21T20:14:21.459647+0000","last_unstale":"2024-01-21T20:14:21.469970+0000","last_undegraded":"2024-01-21T20:14:21.469970+0000","last_fullsized":"2024-01-21T20:14:21.469970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451695+0000","last_change":"2024-01-21T20:14:21.081480+0000","last_active":"2024-01-21T20:14:21.451695+0000","last_peered":"2024-01-21T20:14:21.451695+0000","last_clean":"2024-01-21T20:14:21.451695+0000","last_became_active":"2024-01-21T20:14:21.081178+0000","last_became_peered":"2024-01-21T20:14:21.081178+0000","last_unstale":"2024-01-21T20:14:21.451695+0000","last_undegraded":"2024-01-21T20:14:21.451695+0000","last_fullsized":"2024-01-21T20:14:21.451695+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462881+0000","last_change":"2024-01-21T20:14:21.460268+0000","last_active":"2024-01-21T20:14:21.462881+0000","last_peered":"2024-01-21T20:14:21.462881+0000","last_clean":"2024-01-21T20:14:21.462881+0000","last_became_active":"2024-01-21T20:14:21.459997+0000","last_became_peered":"2024-01-21T20:14:21.459997+0000","last_unstale":"2024-01-21T20:14:21.462881+0000","last_undegraded":"2024-01-21T20:14:21.462881+0000","last_fullsized":"2024-01-21T20:14:21.462881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451147+0000","last_change":"2024-01-21T20:14:21.086553+0000","last_active":"2024-01-21T20:14:21.451147+0000","last_peered":"2024-01-21T20:14:21.451147+0000","last_clean":"2024-01-21T20:14:21.451147+0000","last_became_active":"2024-01-21T20:14:21.085959+0000","last_became_peered":"2024-01-21T20:14:21.085959+0000","last_unstale":"2024-01-21T20:14:21.451147+0000","last_undegraded":"2024-01-21T20:14:21.451147+0000","last_fullsized":"2024-01-21T20:14:21.451147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476764+0000","last_change":"2024-01-21T20:14:21.473468+0000","last_active":"2024-01-21T20:14:21.476764+0000","last_peered":"2024-01-21T20:14:21.476764+0000","last_clean":"2024-01-21T20:14:21.476764+0000","last_became_active":"2024-01-21T20:14:21.473152+0000","last_became_peered":"2024-01-21T20:14:21.473152+0000","last_unstale":"2024-01-21T20:14:21.476764+0000","last_undegraded":"2024-01-21T20:14:21.476764+0000","last_fullsized":"2024-01-21T20:14:21.476764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453202+0000","last_change":"2024-01-21T20:14:21.080923+0000","last_active":"2024-01-21T20:14:21.453202+0000","last_peered":"2024-01-21T20:14:21.453202+0000","last_clean":"2024-01-21T20:14:21.453202+0000","last_became_active":"2024-01-21T20:14:21.080634+0000","last_became_peered":"2024-01-21T20:14:21.080634+0000","last_unstale":"2024-01-21T20:14:21.453202+0000","last_undegraded":"2024-01-21T20:14:21.453202+0000","last_fullsized":"2024-01-21T20:14:21.453202+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.470077+0000","last_change":"2024-01-21T20:14:21.464630+0000","last_active":"2024-01-21T20:14:21.470077+0000","last_peered":"2024-01-21T20:14:21.470077+0000","last_clean":"2024-01-21T20:14:21.470077+0000","last_became_active":"2024-01-21T20:14:21.464306+0000","last_became_peered":"2024-01-21T20:14:21.464306+0000","last_unstale":"2024-01-21T20:14:21.470077+0000","last_undegraded":"2024-01-21T20:14:21.470077+0000","last_fullsized":"2024-01-21T20:14:21.470077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453588+0000","last_change":"2024-01-21T20:14:21.080957+0000","last_active":"2024-01-21T20:14:21.453588+0000","last_peered":"2024-01-21T20:14:21.453588+0000","last_clean":"2024-01-21T20:14:21.453588+0000","last_became_active":"2024-01-21T20:14:21.080689+0000","last_became_peered":"2024-01-21T20:14:21.080689+0000","last_unstale":"2024-01-21T20:14:21.453588+0000","last_undegraded":"2024-01-21T20:14:21.453588+0000","last_fullsized":"2024-01-21T20:14:21.453588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.468276+0000","last_change":"2024-01-21T20:14:21.466083+0000","last_active":"2024-01-21T20:14:21.468276+0000","last_peered":"2024-01-21T20:14:21.468276+0000","last_clean":"2024-01-21T20:14:21.468276+0000","last_became_active":"2024-01-21T20:14:21.465810+0000","last_became_peered":"2024-01-21T20:14:21.465810+0000","last_unstale":"2024-01-21T20:14:21.468276+0000","last_undegraded":"2024-01-21T20:14:21.468276+0000","last_fullsized":"2024-01-21T20:14:21.468276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450706+0000","last_change":"2024-01-21T20:14:21.094881+0000","last_active":"2024-01-21T20:14:21.450706+0000","last_peered":"2024-01-21T20:14:21.450706+0000","last_clean":"2024-01-21T20:14:21.450706+0000","last_became_active":"2024-01-21T20:14:21.094587+0000","last_became_peered":"2024-01-21T20:14:21.094587+0000","last_unstale":"2024-01-21T20:14:21.450706+0000","last_undegraded":"2024-01-21T20:14:21.450706+0000","last_fullsized":"2024-01-21T20:14:21.450706+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478083+0000","last_change":"2024-01-21T20:14:21.473805+0000","last_active":"2024-01-21T20:14:21.478083+0000","last_peered":"2024-01-21T20:14:21.478083+0000","last_clean":"2024-01-21T20:14:21.478083+0000","last_became_active":"2024-01-21T20:14:21.473079+0000","last_became_peered":"2024-01-21T20:14:21.473079+0000","last_unstale":"2024-01-21T20:14:21.478083+0000","last_undegraded":"2024-01-21T20:14:21.478083+0000","last_fullsized":"2024-01-21T20:14:21.478083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.458353+0000","last_change":"2024-01-21T20:14:21.093829+0000","last_active":"2024-01-21T20:14:21.458353+0000","last_peered":"2024-01-21T20:14:21.458353+0000","last_clean":"2024-01-21T20:14:21.458353+0000","last_became_active":"2024-01-21T20:14:21.093501+0000","last_became_peered":"2024-01-21T20:14:21.093501+0000","last_unstale":"2024-01-21T20:14:21.458353+0000","last_undegraded":"2024-01-21T20:14:21.458353+0000","last_fullsized":"2024-01-21T20:14:21.458353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477398+0000","last_change":"2024-01-21T20:14:21.476234+0000","last_active":"2024-01-21T20:14:21.477398+0000","last_peered":"2024-01-21T20:14:21.477398+0000","last_clean":"2024-01-21T20:14:21.477398+0000","last_became_active":"2024-01-21T20:14:21.475963+0000","last_became_peered":"2024-01-21T20:14:21.475963+0000","last_unstale":"2024-01-21T20:14:21.477398+0000","last_undegraded":"2024-01-21T20:14:21.477398+0000","last_fullsized":"2024-01-21T20:14:21.477398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.461895+0000","last_change":"2024-01-21T20:14:21.095207+0000","last_active":"2024-01-21T20:14:21.461895+0000","last_peered":"2024-01-21T20:14:21.461895+0000","last_clean":"2024-01-21T20:14:21.461895+0000","last_became_active":"2024-01-21T20:14:21.094529+0000","last_became_peered":"2024-01-21T20:14:21.094529+0000","last_unstale":"2024-01-21T20:14:21.461895+0000","last_undegraded":"2024-01-21T20:14:21.461895+0000","last_fullsized":"2024-01-21T20:14:21.461895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.465150+0000","last_change":"2024-01-21T20:14:21.462748+0000","last_active":"2024-01-21T20:14:21.465150+0000","last_peered":"2024-01-21T20:14:21.465150+0000","last_clean":"2024-01-21T20:14:21.465150+0000","last_became_active":"2024-01-21T20:14:21.462465+0000","last_became_peered":"2024-01-21T20:14:21.462465+0000","last_unstale":"2024-01-21T20:14:21.465150+0000","last_undegraded":"2024-01-21T20:14:21.465150+0000","last_fullsized":"2024-01-21T20:14:21.465150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.463762+0000","last_change":"2024-01-21T20:14:21.088637+0000","last_active":"2024-01-21T20:14:21.463762+0000","last_peered":"2024-01-21T20:14:21.463762+0000","last_clean":"2024-01-21T20:14:21.463762+0000","last_became_active":"2024-01-21T20:14:21.088041+0000","last_became_peered":"2024-01-21T20:14:21.088041+0000","last_unstale":"2024-01-21T20:14:21.463762+0000","last_undegraded":"2024-01-21T20:14:21.463762+0000","last_fullsized":"2024-01-21T20:14:21.463762+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.463365+0000","last_change":"2024-01-21T20:14:21.461564+0000","last_active":"2024-01-21T20:14:21.463365+0000","last_peered":"2024-01-21T20:14:21.463365+0000","last_clean":"2024-01-21T20:14:21.463365+0000","last_became_active":"2024-01-21T20:14:21.461044+0000","last_became_peered":"2024-01-21T20:14:21.461044+0000","last_unstale":"2024-01-21T20:14:21.463365+0000","last_undegraded":"2024-01-21T20:14:21.463365+0000","last_fullsized":"2024-01-21T20:14:21.463365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.471715+0000","last_change":"2024-01-21T20:14:21.082647+0000","last_active":"2024-01-21T20:14:21.471715+0000","last_peered":"2024-01-21T20:14:21.471715+0000","last_clean":"2024-01-21T20:14:21.471715+0000","last_became_active":"2024-01-21T20:14:21.082343+0000","last_became_peered":"2024-01-21T20:14:21.082343+0000","last_unstale":"2024-01-21T20:14:21.471715+0000","last_undegraded":"2024-01-21T20:14:21.471715+0000","last_fullsized":"2024-01-21T20:14:21.471715+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474606+0000","last_change":"2024-01-21T20:14:21.469612+0000","last_active":"2024-01-21T20:14:21.474606+0000","last_peered":"2024-01-21T20:14:21.474606+0000","last_clean":"2024-01-21T20:14:21.474606+0000","last_became_active":"2024-01-21T20:14:21.469146+0000","last_became_peered":"2024-01-21T20:14:21.469146+0000","last_unstale":"2024-01-21T20:14:21.474606+0000","last_undegraded":"2024-01-21T20:14:21.474606+0000","last_fullsized":"2024-01-21T20:14:21.474606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462558+0000","last_change":"2024-01-21T20:14:21.093853+0000","last_active":"2024-01-21T20:14:21.462558+0000","last_peered":"2024-01-21T20:14:21.462558+0000","last_clean":"2024-01-21T20:14:21.462558+0000","last_became_active":"2024-01-21T20:14:21.093552+0000","last_became_peered":"2024-01-21T20:14:21.093552+0000","last_unstale":"2024-01-21T20:14:21.462558+0000","last_undegraded":"2024-01-21T20:14:21.462558+0000","last_fullsized":"2024-01-21T20:14:21.462558+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474753+0000","last_change":"2024-01-21T20:14:21.469303+0000","last_active":"2024-01-21T20:14:21.474753+0000","last_peered":"2024-01-21T20:14:21.474753+0000","last_clean":"2024-01-21T20:14:21.474753+0000","last_became_active":"2024-01-21T20:14:21.468123+0000","last_became_peered":"2024-01-21T20:14:21.468123+0000","last_unstale":"2024-01-21T20:14:21.474753+0000","last_undegraded":"2024-01-21T20:14:21.474753+0000","last_fullsized":"2024-01-21T20:14:21.474753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.452355+0000","last_change":"2024-01-21T20:14:21.084880+0000","last_active":"2024-01-21T20:14:21.452355+0000","last_peered":"2024-01-21T20:14:21.452355+0000","last_clean":"2024-01-21T20:14:21.452355+0000","last_became_active":"2024-01-21T20:14:21.084652+0000","last_became_peered":"2024-01-21T20:14:21.084652+0000","last_unstale":"2024-01-21T20:14:21.452355+0000","last_undegraded":"2024-01-21T20:14:21.452355+0000","last_fullsized":"2024-01-21T20:14:21.452355+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.480617+0000","last_change":"2024-01-21T20:14:21.473655+0000","last_active":"2024-01-21T20:14:21.480617+0000","last_peered":"2024-01-21T20:14:21.480617+0000","last_clean":"2024-01-21T20:14:21.480617+0000","last_became_active":"2024-01-21T20:14:21.473354+0000","last_became_peered":"2024-01-21T20:14:21.473354+0000","last_unstale":"2024-01-21T20:14:21.480617+0000","last_undegraded":"2024-01-21T20:14:21.480617+0000","last_fullsized":"2024-01-21T20:14:21.480617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.468263+0000","last_change":"2024-01-21T20:14:21.079510+0000","last_active":"2024-01-21T20:14:21.468263+0000","last_peered":"2024-01-21T20:14:21.468263+0000","last_clean":"2024-01-21T20:14:21.468263+0000","last_became_active":"2024-01-21T20:14:21.079158+0000","last_became_peered":"2024-01-21T20:14:21.079158+0000","last_unstale":"2024-01-21T20:14:21.468263+0000","last_undegraded":"2024-01-21T20:14:21.468263+0000","last_fullsized":"2024-01-21T20:14:21.468263+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472985+0000","last_change":"2024-01-21T20:14:21.465804+0000","last_active":"2024-01-21T20:14:21.472985+0000","last_peered":"2024-01-21T20:14:21.472985+0000","last_clean":"2024-01-21T20:14:21.472985+0000","last_became_active":"2024-01-21T20:14:21.465521+0000","last_became_peered":"2024-01-21T20:14:21.465521+0000","last_unstale":"2024-01-21T20:14:21.472985+0000","last_undegraded":"2024-01-21T20:14:21.472985+0000","last_fullsized":"2024-01-21T20:14:21.472985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475139+0000","last_change":"2024-01-21T20:14:21.081551+0000","last_active":"2024-01-21T20:14:21.475139+0000","last_peered":"2024-01-21T20:14:21.475139+0000","last_clean":"2024-01-21T20:14:21.475139+0000","last_became_active":"2024-01-21T20:14:21.081335+0000","last_became_peered":"2024-01-21T20:14:21.081335+0000","last_unstale":"2024-01-21T20:14:21.475139+0000","last_undegraded":"2024-01-21T20:14:21.475139+0000","last_fullsized":"2024-01-21T20:14:21.475139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.469841+0000","last_change":"2024-01-21T20:14:21.459006+0000","last_active":"2024-01-21T20:14:21.469841+0000","last_peered":"2024-01-21T20:14:21.469841+0000","last_clean":"2024-01-21T20:14:21.469841+0000","last_became_active":"2024-01-21T20:14:21.458410+0000","last_became_peered":"2024-01-21T20:14:21.458410+0000","last_unstale":"2024-01-21T20:14:21.469841+0000","last_undegraded":"2024-01-21T20:14:21.469841+0000","last_fullsized":"2024-01-21T20:14:21.469841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.466564+0000","last_change":"2024-01-21T20:14:21.080318+0000","last_active":"2024-01-21T20:14:21.466564+0000","last_peered":"2024-01-21T20:14:21.466564+0000","last_clean":"2024-01-21T20:14:21.466564+0000","last_became_active":"2024-01-21T20:14:21.080002+0000","last_became_peered":"2024-01-21T20:14:21.080002+0000","last_unstale":"2024-01-21T20:14:21.466564+0000","last_undegraded":"2024-01-21T20:14:21.466564+0000","last_fullsized":"2024-01-21T20:14:21.466564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474934+0000","last_change":"2024-01-21T20:14:21.470552+0000","last_active":"2024-01-21T20:14:21.474934+0000","last_peered":"2024-01-21T20:14:21.474934+0000","last_clean":"2024-01-21T20:14:21.474934+0000","last_became_active":"2024-01-21T20:14:21.470312+0000","last_became_peered":"2024-01-21T20:14:21.470312+0000","last_unstale":"2024-01-21T20:14:21.474934+0000","last_undegraded":"2024-01-21T20:14:21.474934+0000","last_fullsized":"2024-01-21T20:14:21.474934+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451881+0000","last_change":"2024-01-21T20:14:21.089510+0000","last_active":"2024-01-21T20:14:21.451881+0000","last_peered":"2024-01-21T20:14:21.451881+0000","last_clean":"2024-01-21T20:14:21.451881+0000","last_became_active":"2024-01-21T20:14:21.089157+0000","last_became_peered":"2024-01-21T20:14:21.089157+0000","last_unstale":"2024-01-21T20:14:21.451881+0000","last_undegraded":"2024-01-21T20:14:21.451881+0000","last_fullsized":"2024-01-21T20:14:21.451881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476794+0000","last_change":"2024-01-21T20:14:21.471441+0000","last_active":"2024-01-21T20:14:21.476794+0000","last_peered":"2024-01-21T20:14:21.476794+0000","last_clean":"2024-01-21T20:14:21.476794+0000","last_became_active":"2024-01-21T20:14:21.471171+0000","last_became_peered":"2024-01-21T20:14:21.471171+0000","last_unstale":"2024-01-21T20:14:21.476794+0000","last_undegraded":"2024-01-21T20:14:21.476794+0000","last_fullsized":"2024-01-21T20:14:21.476794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.455880+0000","last_change":"2024-01-21T20:14:21.088223+0000","last_active":"2024-01-21T20:14:21.455880+0000","last_peered":"2024-01-21T20:14:21.455880+0000","last_clean":"2024-01-21T20:14:21.455880+0000","last_became_active":"2024-01-21T20:14:21.087916+0000","last_became_peered":"2024-01-21T20:14:21.087916+0000","last_unstale":"2024-01-21T20:14:21.455880+0000","last_undegraded":"2024-01-21T20:14:21.455880+0000","last_fullsized":"2024-01-21T20:14:21.455880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475804+0000","last_change":"2024-01-21T20:14:21.464551+0000","last_active":"2024-01-21T20:14:21.475804+0000","last_peered":"2024-01-21T20:14:21.475804+0000","last_clean":"2024-01-21T20:14:21.475804+0000","last_became_active":"2024-01-21T20:14:21.464277+0000","last_became_peered":"2024-01-21T20:14:21.464277+0000","last_unstale":"2024-01-21T20:14:21.475804+0000","last_undegraded":"2024-01-21T20:14:21.475804+0000","last_fullsized":"2024-01-21T20:14:21.475804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451436+0000","last_change":"2024-01-21T20:14:21.085815+0000","last_active":"2024-01-21T20:14:21.451436+0000","last_peered":"2024-01-21T20:14:21.451436+0000","last_clean":"2024-01-21T20:14:21.451436+0000","last_became_active":"2024-01-21T20:14:21.085485+0000","last_became_peered":"2024-01-21T20:14:21.085485+0000","last_unstale":"2024-01-21T20:14:21.451436+0000","last_undegraded":"2024-01-21T20:14:21.451436+0000","last_fullsized":"2024-01-21T20:14:21.451436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462970+0000","last_change":"2024-01-21T20:14:21.461090+0000","last_active":"2024-01-21T20:14:21.462970+0000","last_peered":"2024-01-21T20:14:21.462970+0000","last_clean":"2024-01-21T20:14:21.462970+0000","last_became_active":"2024-01-21T20:14:21.460747+0000","last_became_peered":"2024-01-21T20:14:21.460747+0000","last_unstale":"2024-01-21T20:14:21.462970+0000","last_undegraded":"2024-01-21T20:14:21.462970+0000","last_fullsized":"2024-01-21T20:14:21.462970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451244+0000","last_change":"2024-01-21T20:14:21.080055+0000","last_active":"2024-01-21T20:14:21.451244+0000","last_peered":"2024-01-21T20:14:21.451244+0000","last_clean":"2024-01-21T20:14:21.451244+0000","last_became_active":"2024-01-21T20:14:21.079776+0000","last_became_peered":"2024-01-21T20:14:21.079776+0000","last_unstale":"2024-01-21T20:14:21.451244+0000","last_undegraded":"2024-01-21T20:14:21.451244+0000","last_fullsized":"2024-01-21T20:14:21.451244+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.468005+0000","last_change":"2024-01-21T20:14:21.463700+0000","last_active":"2024-01-21T20:14:21.468005+0000","last_peered":"2024-01-21T20:14:21.468005+0000","last_clean":"2024-01-21T20:14:21.468005+0000","last_became_active":"2024-01-21T20:14:21.463389+0000","last_became_peered":"2024-01-21T20:14:21.463389+0000","last_unstale":"2024-01-21T20:14:21.468005+0000","last_undegraded":"2024-01-21T20:14:21.468005+0000","last_fullsized":"2024-01-21T20:14:21.468005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453295+0000","last_change":"2024-01-21T20:14:21.081086+0000","last_active":"2024-01-21T20:14:21.453295+0000","last_peered":"2024-01-21T20:14:21.453295+0000","last_clean":"2024-01-21T20:14:21.453295+0000","last_became_active":"2024-01-21T20:14:21.080794+0000","last_became_peered":"2024-01-21T20:14:21.080794+0000","last_unstale":"2024-01-21T20:14:21.453295+0000","last_undegraded":"2024-01-21T20:14:21.453295+0000","last_fullsized":"2024-01-21T20:14:21.453295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.478113+0000","last_change":"2024-01-21T20:14:21.474797+0000","last_active":"2024-01-21T20:14:21.478113+0000","last_peered":"2024-01-21T20:14:21.478113+0000","last_clean":"2024-01-21T20:14:21.478113+0000","last_became_active":"2024-01-21T20:14:21.474440+0000","last_became_peered":"2024-01-21T20:14:21.474440+0000","last_unstale":"2024-01-21T20:14:21.478113+0000","last_undegraded":"2024-01-21T20:14:21.478113+0000","last_fullsized":"2024-01-21T20:14:21.478113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.456115+0000","last_change":"2024-01-21T20:14:21.080848+0000","last_active":"2024-01-21T20:14:21.456115+0000","last_peered":"2024-01-21T20:14:21.456115+0000","last_clean":"2024-01-21T20:14:21.456115+0000","last_became_active":"2024-01-21T20:14:21.080540+0000","last_became_peered":"2024-01-21T20:14:21.080540+0000","last_unstale":"2024-01-21T20:14:21.456115+0000","last_undegraded":"2024-01-21T20:14:21.456115+0000","last_fullsized":"2024-01-21T20:14:21.456115+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472850+0000","last_change":"2024-01-21T20:14:21.469878+0000","last_active":"2024-01-21T20:14:21.472850+0000","last_peered":"2024-01-21T20:14:21.472850+0000","last_clean":"2024-01-21T20:14:21.472850+0000","last_became_active":"2024-01-21T20:14:21.466768+0000","last_became_peered":"2024-01-21T20:14:21.466768+0000","last_unstale":"2024-01-21T20:14:21.472850+0000","last_undegraded":"2024-01-21T20:14:21.472850+0000","last_fullsized":"2024-01-21T20:14:21.472850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.475072+0000","last_change":"2024-01-21T20:14:21.095214+0000","last_active":"2024-01-21T20:14:21.475072+0000","last_peered":"2024-01-21T20:14:21.475072+0000","last_clean":"2024-01-21T20:14:21.475072+0000","last_became_active":"2024-01-21T20:14:21.094742+0000","last_became_peered":"2024-01-21T20:14:21.094742+0000","last_unstale":"2024-01-21T20:14:21.475072+0000","last_undegraded":"2024-01-21T20:14:21.475072+0000","last_fullsized":"2024-01-21T20:14:21.475072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.455770+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:14:21.455770+0000","last_peered":"2024-01-21T20:14:21.455770+0000","last_clean":"2024-01-21T20:14:21.455770+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:14:21.455770+0000","last_undegraded":"2024-01-21T20:14:21.455770+0000","last_fullsized":"2024-01-21T20:14:21.455770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476697+0000","last_change":"2024-01-21T20:14:21.471629+0000","last_active":"2024-01-21T20:14:21.476697+0000","last_peered":"2024-01-21T20:14:21.476697+0000","last_clean":"2024-01-21T20:14:21.476697+0000","last_became_active":"2024-01-21T20:14:21.471234+0000","last_became_peered":"2024-01-21T20:14:21.471234+0000","last_unstale":"2024-01-21T20:14:21.476697+0000","last_undegraded":"2024-01-21T20:14:21.476697+0000","last_fullsized":"2024-01-21T20:14:21.476697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.449592+0000","last_change":"2024-01-21T20:14:21.088941+0000","last_active":"2024-01-21T20:14:21.449592+0000","last_peered":"2024-01-21T20:14:21.449592+0000","last_clean":"2024-01-21T20:14:21.449592+0000","last_became_active":"2024-01-21T20:14:21.088539+0000","last_became_peered":"2024-01-21T20:14:21.088539+0000","last_unstale":"2024-01-21T20:14:21.449592+0000","last_undegraded":"2024-01-21T20:14:21.449592+0000","last_fullsized":"2024-01-21T20:14:21.449592+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462752+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:14:21.462752+0000","last_peered":"2024-01-21T20:14:21.462752+0000","last_clean":"2024-01-21T20:14:21.462752+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:14:21.462752+0000","last_undegraded":"2024-01-21T20:14:21.462752+0000","last_fullsized":"2024-01-21T20:14:21.462752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474627+0000","last_change":"2024-01-21T20:14:21.470848+0000","last_active":"2024-01-21T20:14:21.474627+0000","last_peered":"2024-01-21T20:14:21.474627+0000","last_clean":"2024-01-21T20:14:21.474627+0000","last_became_active":"2024-01-21T20:14:21.470583+0000","last_became_peered":"2024-01-21T20:14:21.470583+0000","last_unstale":"2024-01-21T20:14:21.474627+0000","last_undegraded":"2024-01-21T20:14:21.474627+0000","last_fullsized":"2024-01-21T20:14:21.474627+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.462667+0000","last_change":"2024-01-21T20:14:21.081164+0000","last_active":"2024-01-21T20:14:21.462667+0000","last_peered":"2024-01-21T20:14:21.462667+0000","last_clean":"2024-01-21T20:14:21.462667+0000","last_became_active":"2024-01-21T20:14:21.080779+0000","last_became_peered":"2024-01-21T20:14:21.080779+0000","last_unstale":"2024-01-21T20:14:21.462667+0000","last_undegraded":"2024-01-21T20:14:21.462667+0000","last_fullsized":"2024-01-21T20:14:21.462667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.446869+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:14:21.446869+0000","last_peered":"2024-01-21T20:14:21.446869+0000","last_clean":"2024-01-21T20:14:21.446869+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:14:21.446869+0000","last_undegraded":"2024-01-21T20:14:21.446869+0000","last_fullsized":"2024-01-21T20:14:21.446869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476826+0000","last_change":"2024-01-21T20:14:21.471898+0000","last_active":"2024-01-21T20:14:21.476826+0000","last_peered":"2024-01-21T20:14:21.476826+0000","last_clean":"2024-01-21T20:14:21.476826+0000","last_became_active":"2024-01-21T20:14:21.471621+0000","last_became_peered":"2024-01-21T20:14:21.471621+0000","last_unstale":"2024-01-21T20:14:21.476826+0000","last_undegraded":"2024-01-21T20:14:21.476826+0000","last_fullsized":"2024-01-21T20:14:21.476826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450414+0000","last_change":"2024-01-21T20:14:21.081451+0000","last_active":"2024-01-21T20:14:21.450414+0000","last_peered":"2024-01-21T20:14:21.450414+0000","last_clean":"2024-01-21T20:14:21.450414+0000","last_became_active":"2024-01-21T20:14:21.081163+0000","last_became_peered":"2024-01-21T20:14:21.081163+0000","last_unstale":"2024-01-21T20:14:21.450414+0000","last_undegraded":"2024-01-21T20:14:21.450414+0000","last_fullsized":"2024-01-21T20:14:21.450414+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":68,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.461519+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:14:21.461519+0000","last_peered":"2024-01-21T20:14:21.461519+0000","last_clean":"2024-01-21T20:14:21.461519+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:14:21.461519+0000","last_undegraded":"2024-01-21T20:14:21.461519+0000","last_fullsized":"2024-01-21T20:14:21.461519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.451810+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:14:21.451810+0000","last_peered":"2024-01-21T20:14:21.451810+0000","last_clean":"2024-01-21T20:14:21.451810+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:14:21.451810+0000","last_undegraded":"2024-01-21T20:14:21.451810+0000","last_fullsized":"2024-01-21T20:14:21.451810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.466827+0000","last_change":"2024-01-21T20:14:21.458665+0000","last_active":"2024-01-21T20:14:21.466827+0000","last_peered":"2024-01-21T20:14:21.466827+0000","last_clean":"2024-01-21T20:14:21.466827+0000","last_became_active":"2024-01-21T20:14:21.458455+0000","last_became_peered":"2024-01-21T20:14:21.458455+0000","last_unstale":"2024-01-21T20:14:21.466827+0000","last_undegraded":"2024-01-21T20:14:21.466827+0000","last_fullsized":"2024-01-21T20:14:21.466827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.472420+0000","last_change":"2024-01-21T20:14:21.089104+0000","last_active":"2024-01-21T20:14:21.472420+0000","last_peered":"2024-01-21T20:14:21.472420+0000","last_clean":"2024-01-21T20:14:21.472420+0000","last_became_active":"2024-01-21T20:14:21.084699+0000","last_became_peered":"2024-01-21T20:14:21.084699+0000","last_unstale":"2024-01-21T20:14:21.472420+0000","last_undegraded":"2024-01-21T20:14:21.472420+0000","last_fullsized":"2024-01-21T20:14:21.472420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.453401+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:14:21.453401+0000","last_peered":"2024-01-21T20:14:21.453401+0000","last_clean":"2024-01-21T20:14:21.453401+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:14:21.453401+0000","last_undegraded":"2024-01-21T20:14:21.453401+0000","last_fullsized":"2024-01-21T20:14:21.453401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.476486+0000","last_change":"2024-01-21T20:14:21.468691+0000","last_active":"2024-01-21T20:14:21.476486+0000","last_peered":"2024-01-21T20:14:21.476486+0000","last_clean":"2024-01-21T20:14:21.476486+0000","last_became_active":"2024-01-21T20:14:21.468428+0000","last_became_peered":"2024-01-21T20:14:21.468428+0000","last_unstale":"2024-01-21T20:14:21.476486+0000","last_undegraded":"2024-01-21T20:14:21.476486+0000","last_fullsized":"2024-01-21T20:14:21.476486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.460709+0000","last_change":"2024-01-21T20:14:21.084173+0000","last_active":"2024-01-21T20:14:21.460709+0000","last_peered":"2024-01-21T20:14:21.460709+0000","last_clean":"2024-01-21T20:14:21.460709+0000","last_became_active":"2024-01-21T20:14:21.083842+0000","last_became_peered":"2024-01-21T20:14:21.083842+0000","last_unstale":"2024-01-21T20:14:21.460709+0000","last_undegraded":"2024-01-21T20:14:21.460709+0000","last_fullsized":"2024-01-21T20:14:21.460709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.450464+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:14:21.450464+0000","last_peered":"2024-01-21T20:14:21.450464+0000","last_clean":"2024-01-21T20:14:21.450464+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:14:21.450464+0000","last_undegraded":"2024-01-21T20:14:21.450464+0000","last_fullsized":"2024-01-21T20:14:21.450464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.477338+0000","last_change":"2024-01-21T20:14:21.472657+0000","last_active":"2024-01-21T20:14:21.477338+0000","last_peered":"2024-01-21T20:14:21.477338+0000","last_clean":"2024-01-21T20:14:21.477338+0000","last_became_active":"2024-01-21T20:14:21.472358+0000","last_became_peered":"2024-01-21T20:14:21.472358+0000","last_unstale":"2024-01-21T20:14:21.477338+0000","last_undegraded":"2024-01-21T20:14:21.477338+0000","last_fullsized":"2024-01-21T20:14:21.477338+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.449955+0000","last_change":"2024-01-21T20:14:21.095346+0000","last_active":"2024-01-21T20:14:21.449955+0000","last_peered":"2024-01-21T20:14:21.449955+0000","last_clean":"2024-01-21T20:14:21.449955+0000","last_became_active":"2024-01-21T20:14:21.094939+0000","last_became_peered":"2024-01-21T20:14:21.094939+0000","last_unstale":"2024-01-21T20:14:21.449955+0000","last_undegraded":"2024-01-21T20:14:21.449955+0000","last_fullsized":"2024-01-21T20:14:21.449955+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.457876+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:14:21.457876+0000","last_peered":"2024-01-21T20:14:21.457876+0000","last_clean":"2024-01-21T20:14:21.457876+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:14:21.457876+0000","last_undegraded":"2024-01-21T20:14:21.457876+0000","last_fullsized":"2024-01-21T20:14:21.457876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.474606+0000","last_change":"2024-01-21T20:14:21.469213+0000","last_active":"2024-01-21T20:14:21.474606+0000","last_peered":"2024-01-21T20:14:21.474606+0000","last_clean":"2024-01-21T20:14:21.474606+0000","last_became_active":"2024-01-21T20:14:21.468925+0000","last_became_peered":"2024-01-21T20:14:21.468925+0000","last_unstale":"2024-01-21T20:14:21.474606+0000","last_undegraded":"2024-01-21T20:14:21.474606+0000","last_fullsized":"2024-01-21T20:14:21.474606+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:21.058839+0000","last_clean_scrub_stamp":"2024-01-21T20:14:21.058839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.452362+0000","last_change":"2024-01-21T20:14:21.078104+0000","last_active":"2024-01-21T20:14:21.452362+0000","last_peered":"2024-01-21T20:14:21.452362+0000","last_clean":"2024-01-21T20:14:21.452362+0000","last_became_active":"2024-01-21T20:14:21.075359+0000","last_became_peered":"2024-01-21T20:14:21.075359+0000","last_unstale":"2024-01-21T20:14:21.452362+0000","last_undegraded":"2024-01-21T20:14:21.452362+0000","last_fullsized":"2024-01-21T20:14:21.452362+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:20.057102+0000","last_clean_scrub_stamp":"2024-01-21T20:14:20.057102+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-01-21T20:14:21.459633+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:14:21.459633+0000","last_peered":"2024-01-21T20:14:21.459633+0000","last_clean":"2024-01-21T20:14:21.459633+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:14:21.459633+0000","last_undegraded":"2024-01-21T20:14:21.459633+0000","last_fullsized":"2024-01-21T20:14:21.459633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":484174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.59799999999999998,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.79300000000000004,"15min":0.81000000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61899999999999999,"15min":0.621},"min":{"1min":0.53200000000000003,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.746,"5min":0.77400000000000002,"15min":1.47},"last":0.438}]},{"osd":1,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.43099999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.871,"15min":0.91100000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.42199999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55500000000000005,"15min":0.55200000000000005},"min":{"1min":0.45500000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69599999999999995,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.755,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.58099999999999996},"min":{"1min":0.41799999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.79500000000000004,"5min":0.81799999999999995,"15min":1.5229999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58899999999999997,"15min":0.60099999999999998},"min":{"1min":0.45000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.80000000000000004,"15min":1.514},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.32100000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67500000000000004,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55200000000000005,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.29599999999999999,"15min":0.28399999999999997},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.84799999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.497,"15min":0.505},"min":{"1min":0.36599999999999999,"5min":0.33400000000000002,"15min":0.309},"max":{"1min":0.66700000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.51700000000000002},"min":{"1min":0.35699999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.59999999999999998,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.40899999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:13:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.71099999999999997,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75600000000000001,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302128,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069712,"statfs":{"total":96636764160,"available":96327385088,"internally_reserved":0,"allocated":958464,"data_stored":484153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.55000000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.50600000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.437},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.34699999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.497}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302140,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069700,"statfs":{"total":96636764160,"available":96327372800,"internally_reserved":0,"allocated":970752,"data_stored":484875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.38900000000000001},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":0.60599999999999998,"15min":0.61399999999999999},"last":0.308},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.433},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.247},"max":{"1min":0.58299999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40200000000000002,"15min":0.39700000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.251},"max":{"1min":0.53700000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40100000000000002,"15min":0.40000000000000002},"min":{"1min":0.315,"5min":0.27100000000000002,"15min":0.19400000000000001},"max":{"1min":0.52300000000000002,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.442,"15min":0.437},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.54100000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.313,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.56399999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61399999999999999,"15min":0.61099999999999999},"min":{"1min":0.48999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.505,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.876,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.56100000000000005,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.89000000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":0.879,"15min":0.99299999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68100000000000005,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.91400000000000003,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.51900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.746},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.41899999999999998},"max":{"1min":0.872,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.64200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298024,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073816,"statfs":{"total":96636764160,"available":96331587584,"internally_reserved":0,"allocated":950272,"data_stored":483158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.36299999999999999},"min":{"1min":0.22,"5min":0.217,"15min":0.20599999999999999},"max":{"1min":0.56999999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.245},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40500000000000003,"15min":0.39500000000000002},"min":{"1min":0.26300000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54100000000000004,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.42499999999999999,"15min":0.40999999999999998},"min":{"1min":0.28399999999999997,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.312},{"interface":"front","average":{"1min":0.44,"5min":0.44500000000000001,"15min":0.434},"min":{"1min":0.35399999999999998,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.58399999999999996,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.32400000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42599999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.73199999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.374},{"interface":"front","average":{"1min":0.437,"5min":0.43099999999999999,"15min":0.42399999999999999},"min":{"1min":0.31900000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.54400000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61699999999999999,"15min":0.61299999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.85599999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.625},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.629,"15min":0.61599999999999999},"min":{"1min":0.42599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.86499999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.86599999999999999,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56499999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.65400000000000003},"min":{"1min":0.54100000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88700000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65500000000000003,"15min":0.66000000000000003},"min":{"1min":0.47899999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65500000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66800000000000004,"15min":0.65100000000000002},"min":{"1min":0.58299999999999996,"5min":0.379,"15min":0.379},"max":{"1min":0.91700000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":484743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39100000000000001,"15min":0.39800000000000002},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.41099999999999998,"15min":0.42199999999999999},"min":{"1min":0.372,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.375}]},{"osd":1,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.38900000000000001,"15min":0.39100000000000001},"min":{"1min":0.28799999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.30299999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44700000000000001,"15min":0.45400000000000001},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.438}]},{"osd":4,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.53400000000000003,"5min":0.41699999999999998,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.85499999999999998,"15min":0.95499999999999996},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.55000000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.79100000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.627,"15min":0.627},"min":{"1min":0.48099999999999998,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.96699999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.628,"15min":0.625},"min":{"1min":0.50900000000000001,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.83499999999999996,"5min":0.84099999999999997,"15min":0.98699999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":1.2,"15min":1.2},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.64400000000000002},"min":{"1min":0.51700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:13:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.51100000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.84299999999999997,"15min":0.92900000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84899999999999998,"5min":1.216,"15min":1.216},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":484743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46000000000000002,"15min":0.41299999999999998},"min":{"1min":0.251,"5min":0.185,"15min":0.185},"max":{"1min":0.626,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.49199999999999999,"15min":0.441},"min":{"1min":0.34000000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.57099999999999995,"5min":7.532,"15min":7.532},"last":0.35699999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.45000000000000001,"15min":0.40300000000000002},"min":{"1min":0.28599999999999998,"5min":0.217,"15min":0.217},"max":{"1min":0.64200000000000002,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.43099999999999999},"min":{"1min":0.27100000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.57299999999999995,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.51300000000000001,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60499999999999998,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53600000000000003,"15min":0.48699999999999999},"min":{"1min":0.39200000000000002,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.32700000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69299999999999995,"15min":0.65700000000000003},"min":{"1min":0.44700000000000001,"5min":0.379,"15min":0.377},"max":{"1min":0.85099999999999998,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.68700000000000006,"15min":0.65200000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.621}]},{"osd":5,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.68200000000000005,"15min":0.64300000000000002},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.79300000000000004,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69899999999999995,"15min":0.66500000000000004},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.38400000000000001},"max":{"1min":0.94399999999999995,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.57799999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.66600000000000004},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.91300000000000003,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.628},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.69399999999999995,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:13:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.91300000000000003,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.72599999999999998,"15min":0.68899999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.86899999999999999,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.64800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302132,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069708,"statfs":{"total":96636764160,"available":96327380992,"internally_reserved":0,"allocated":962560,"data_stored":484763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.70899999999999996,"5min":0.77100000000000002,"15min":1.379},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.69899999999999995,"5min":0.77800000000000002,"15min":1.139},"last":0.628}]},{"osd":1,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.61499999999999999},"min":{"1min":0.52300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.70299999999999996,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.622},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.51300000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.73299999999999998,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56499999999999995,"15min":0.57999999999999996},"min":{"1min":0.44500000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.81799999999999995,"15min":1.7130000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55900000000000005,"15min":0.57899999999999996},"min":{"1min":0.47299999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.755,"5min":0.79800000000000004,"15min":2.262},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.46000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.505},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.7410000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46899999999999997,"15min":0.49399999999999999},"min":{"1min":0.34999999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":2.3530000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.49099999999999999,"15min":0.498},"min":{"1min":0.35399999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63900000000000001,"5min":0.77600000000000002,"15min":1.296},"last":0.45400000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.39200000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.79500000000000004,"15min":1.7629999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.52900000000000003,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.36599999999999999,"15min":0.316},"max":{"1min":0.73799999999999999,"5min":0.80000000000000004,"15min":2.3839999999999999},"last":0.44}]},{"osd":7,"last update":"Sun Jan 21 20:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.80900000000000005,"15min":1.3280000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57099999999999995,"15min":0.58699999999999997},"min":{"1min":0.42299999999999999,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.83499999999999996,"15min":1.8839999999999999},"last":0.47199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":485033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.48799999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.60699999999999998},"min":{"1min":0.53700000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75800000000000001,"5min":1.252,"15min":1.252},"last":0.628}]},{"osd":1,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.745,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.32700000000000001},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58899999999999997,"15min":0.56599999999999995},"min":{"1min":0.40799999999999997,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.70199999999999996,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56200000000000006,"15min":0.57099999999999995},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72699999999999998,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57399999999999995,"15min":0.58099999999999996},"min":{"1min":0.45700000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":1.425},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.73599999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.48799999999999999,"15min":0.49099999999999999},"min":{"1min":0.35699999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.57199999999999995},"min":{"1min":0.38100000000000001,"5min":0.32600000000000001,"15min":0.29699999999999999},"max":{"1min":0.78300000000000003,"5min":1.008,"15min":1.492},"last":0.375}]},{"osd":6,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.39700000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60699999999999998,"5min":1.891,"15min":1.891},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.40300000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.77000000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:13:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.53500000000000003},"min":{"1min":0.40699999999999997,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.751,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.57299999999999995},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.74199999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:14:24.788 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:14:24.789 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:14:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.954+0000 7fdfe1795700 1 Processor -- start 2024-01-21T20:14:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 -- start start 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdfdc0c3840 0x7fdfdc0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc067f10 con 0x7fdfdc0c6220 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0681f0 con 0x7fdfdc0c3840 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.955+0000 7fdfe1795700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0684d0 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfdaffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdfdc0c3840 0x7fdfdc0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfdb7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdfdc0c6220 0x7fdfdc157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:60040/0 (socket says 172.21.15.133:60040) 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:37356/0 (socket says 172.21.15.133:37356) 2024-01-21T20:14:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfdb7fe700 1 -- 172.21.15.133:0/2744300024 learned_addr learned my addr 172.21.15.133:0/2744300024 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 -- 172.21.15.133:0/2744300024 >> v2:172.21.15.178:3300/0 conn(0x7fdfdc0c3840 msgr2=0x7fdfdc0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 --2- 172.21.15.133:0/2744300024 >> v2:172.21.15.178:3300/0 conn(0x7fdfdc0c3840 0x7fdfdc0c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 -- 172.21.15.133:0/2744300024 >> v1:172.21.15.178:6789/0 conn(0x7fdfdc0c6220 legacy=0x7fdfdc157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 -- 172.21.15.133:0/2744300024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0687b0 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfda7fc700 1 --2- 172.21.15.133:0/2744300024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fdfcc009760 tx=0x7fdfcc009060).ready entity=mon.2 client_cookie=ec1b1b2d9ec1e7f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfd9ffb700 1 -- 172.21.15.133:0/2744300024 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc0090d0 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfd9ffb700 1 -- 172.21.15.133:0/2744300024 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00f510 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.956+0000 7fdfd9ffb700 1 -- 172.21.15.133:0/2744300024 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00f890 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 -- 172.21.15.133:0/2744300024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 msgr2=0x7fdfdc13a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 --2- 172.21.15.133:0/2744300024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fdfcc009760 tx=0x7fdfcc009060).stop 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 -- 172.21.15.133:0/2744300024 shutdown_connections 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 --2- 172.21.15.133:0/2744300024 >> v2:172.21.15.178:3300/0 conn(0x7fdfdc0c3840 0x7fdfdc0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 --2- 172.21.15.133:0/2744300024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c5dc0 0x7fdfdc13a4f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 -- 172.21.15.133:0/2744300024 >> 172.21.15.133:0/2744300024 conn(0x7fdfdc066a70 msgr2=0x7fdfdc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 -- 172.21.15.133:0/2744300024 shutdown_connections 2024-01-21T20:14:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.957+0000 7fdfe1795700 1 -- 172.21.15.133:0/2744300024 wait complete. 2024-01-21T20:14:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.958+0000 7fdfe1795700 1 Processor -- start 2024-01-21T20:14:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.958+0000 7fdfe1795700 1 -- start start 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c3840 0x7fdfdc131730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 0x7fdfdc152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc13bc20 con 0x7fdfdc0c6220 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc13b310 con 0x7fdfdc0c5dc0 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfe1795700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0aeec0 con 0x7fdfdc0c3840 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfdb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44858/0 (socket says 172.21.15.133:44858) 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfdb7fe700 1 -- 172.21.15.133:0/1170636642 learned_addr learned my addr 172.21.15.133:0/1170636642 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfdaffd700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c3840 0x7fdfdc131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.959+0000 7fdfda7fc700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 0x7fdfdc152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 -- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c3840 msgr2=0x7fdfdc131730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c3840 0x7fdfdc131730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 -- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 msgr2=0x7fdfdc152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 0x7fdfdc152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 -- 172.21.15.133:0/1170636642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0092a0 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfda7fc700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 0x7fdfdc152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfdb7fe700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fdfd400c7c0 tx=0x7fdfd4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4005d30 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4005e90 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc13b5d0 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4007320 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.960+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc0ac040 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.961+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdfd4007710 con 0x7fdfdc0c6220 2024-01-21T20:14:24.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.961+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc13bd90 con 0x7fdfdc0c6220 2024-01-21T20:14:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.962+0000 7fdfc37fe700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 0x7fdfc8061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.962+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fdfd407a390 con 0x7fdfdc0c6220 2024-01-21T20:14:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.962+0000 7fdfdaffd700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 0x7fdfc8061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.962+0000 7fdfdaffd700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 0x7fdfc8061640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfd0009bc0 tx=0x7fdfd0008040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:24.966+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfd404b410 con 0x7fdfdc0c6220 2024-01-21T20:14:25.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.192+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdfdc05fdf0 con 0x7fdfdc0c6220 2024-01-21T20:14:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.196+0000 7fdfc37fe700 1 -- 172.21.15.133:0/1170636642 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdfd404ea30 con 0x7fdfdc0c6220 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 msgr2=0x7fdfc8061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 0x7fdfc8061640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdfd0009bc0 tx=0x7fdfd0008040).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 msgr2=0x7fdfdc0ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fdfd400c7c0 tx=0x7fdfd4001510).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 shutdown_connections 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfc805f180 0x7fdfc8061640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfdc0c6220 0x7fdfdc0ae450 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0c3840 0x7fdfdc131730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 --2- 172.21.15.133:0/1170636642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc0c5dc0 0x7fdfdc152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 >> 172.21.15.133:0/1170636642 conn(0x7fdfdc066a70 msgr2=0x7fdfdc0bf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 shutdown_connections 2024-01-21T20:14:25.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.198+0000 7fdfe1795700 1 -- 172.21.15.133:0/1170636642 wait complete. 2024-01-21T20:14:25.189 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:14:25.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.326+0000 7f7bd02a3700 1 Processor -- start 2024-01-21T20:14:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.326+0000 7f7bd02a3700 1 -- start start 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 0x7f7bc80634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc8065fd0 con 0x7f7bc80acbc0 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc80653c0 con 0x7f7bc8066460 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bd02a3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80656a0 con 0x7f7bc81521e0 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44874/0 (socket says 172.21.15.133:44874) 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 -- 172.21.15.133:0/3619891079 learned_addr learned my addr 172.21.15.133:0/3619891079 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bcd83e700 1 --2- 172.21.15.133:0/3619891079 >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 0x7f7bc80634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce840700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 -- 172.21.15.133:0/3619891079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 msgr2=0x7f7bc8152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 -- 172.21.15.133:0/3619891079 >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 msgr2=0x7f7bc80634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 --2- 172.21.15.133:0/3619891079 >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 0x7f7bc80634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 -- 172.21.15.133:0/3619891079 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8065980 con 0x7f7bc80acbc0 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bcd83e700 1 --2- 172.21.15.133:0/3619891079 >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 0x7f7bc80634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bce03f700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f7bc80600a0 tx=0x7f7bc40090f0).ready entity=mon.0 client_cookie=4999a68666a24879 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bcd03d700 1 -- 172.21.15.133:0/3619891079 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400b600 con 0x7f7bc80acbc0 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bcd03d700 1 -- 172.21.15.133:0/3619891079 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400b760 con 0x7f7bc80acbc0 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.327+0000 7f7bcd03d700 1 -- 172.21.15.133:0/3619891079 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400bb00 con 0x7f7bc80acbc0 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 -- 172.21.15.133:0/3619891079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc80acbc0 msgr2=0x7f7bc80acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f7bc80600a0 tx=0x7f7bc40090f0).stop 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 -- 172.21.15.133:0/3619891079 shutdown_connections 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc81521e0 0x7f7bc8152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/3619891079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80acfa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/3619891079 >> v2:172.21.15.178:3300/0 conn(0x7f7bc8066460 0x7f7bc80634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 -- 172.21.15.133:0/3619891079 >> 172.21.15.133:0/3619891079 conn(0x7f7bc80c8200 msgr2=0x7f7bc80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 -- 172.21.15.133:0/3619891079 shutdown_connections 2024-01-21T20:14:25.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.328+0000 7f7bd02a3700 1 -- 172.21.15.133:0/3619891079 wait complete. 2024-01-21T20:14:25.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.329+0000 7f7bd02a3700 1 Processor -- start 2024-01-21T20:14:25.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.329+0000 7f7bd02a3700 1 -- start start 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc8066460 0x7f7bc8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8153620 con 0x7f7bc81521e0 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8154480 con 0x7f7bc80acbc0 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bd02a3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80ab000 con 0x7f7bc8066460 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44886/0 (socket says 172.21.15.133:44886) 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 -- 172.21.15.133:0/2225437723 learned_addr learned my addr 172.21.15.133:0/2225437723 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:25.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce03f700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc8066460 0x7f7bc8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bcd83e700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 -- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc8066460 msgr2=0x7f7bc8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc8066460 0x7f7bc8154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 -- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 msgr2=0x7f7bc80abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.330+0000 7f7bce840700 1 -- 172.21.15.133:0/2225437723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009370 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bce840700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f7bc000cdb0 tx=0x7f7bc00077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000a9d0 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000ab30 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc8153870 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000f400 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.331+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc8153e30 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.332+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc81545f0 con 0x7f7bc81521e0 2024-01-21T20:14:25.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.332+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7bc000d040 con 0x7f7bc81521e0 2024-01-21T20:14:25.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.332+0000 7f7bbaf78700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 0x7f7bac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:25.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.332+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f7bc007a380 con 0x7f7bc81521e0 2024-01-21T20:14:25.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.333+0000 7f7bce03f700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 0x7f7bac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:25.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.333+0000 7f7bce03f700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 0x7f7bac061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7bc4009fd0 tx=0x7f7bc4017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:25.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.336+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bc004b3a0 con 0x7f7bc81521e0 2024-01-21T20:14:25.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.542+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc8065c60 con 0x7f7bc81521e0 2024-01-21T20:14:25.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.543+0000 7f7bbaf78700 1 -- 172.21.15.133:0/2225437723 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f7bc001d070 con 0x7f7bc81521e0 2024-01-21T20:14:25.533 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:25.533 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 msgr2=0x7f7bac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 0x7f7bac061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f7bc4009fd0 tx=0x7f7bc4017000).stop 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 msgr2=0x7f7bc80ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f7bc000cdb0 tx=0x7f7bc00077d0).stop 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 shutdown_connections 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7bac05f150 0x7f7bac061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc81521e0 0x7f7bc80ac040 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc8066460 0x7f7bc8154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 --2- 172.21.15.133:0/2225437723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc80acbc0 0x7f7bc80abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:25.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 >> 172.21.15.133:0/2225437723 conn(0x7f7bc80c8200 msgr2=0x7f7bc80c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:25.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 shutdown_connections 2024-01-21T20:14:25.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:25.545+0000 7f7bd02a3700 1 -- 172.21.15.133:0/2225437723 wait complete. 2024-01-21T20:14:25.536 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:25.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:14:21.443345+0000', 'modified': '2024-01-21T20:14:23.451757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6312': {'gid': 6312, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6834/206816937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 206816937}, {'type': 'v1', 'addr': '172.21.15.178:6834', 'nonce': 206816937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:14:25.949 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:14:25.949 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-21T20:14:26.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.078+0000 7ff9f6010700 1 Processor -- start 2024-01-21T20:14:26.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.078+0000 7ff9f6010700 1 -- start start 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9f6010700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff9f00beb30 0x7ff9f0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9f6010700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f0065660 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9f6010700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f0065f00 con 0x7ff9f0069ef0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9f6010700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f00bef10 con 0x7ff9f00beb30 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9eeffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff9f00c3fb0 0x7ff9f00697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35954/0 (socket says 172.21.15.133:35954) 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.079+0000 7ff9eeffd700 1 -- 172.21.15.133:0/1075549092 learned_addr learned my addr 172.21.15.133:0/1075549092 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1075549092 >> v2:172.21.15.178:3300/0 conn(0x7ff9f00beb30 0x7ff9f0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3935759424 0 0) 0x7ff9f0065660 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9dc0033f0 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4079299957 0 0) 0x7ff9dc0033f0 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 >> v2:172.21.15.178:3300/0 conn(0x7ff9f00beb30 msgr2=0x7ff9f0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 --2- 172.21.15.133:0/1075549092 >> v2:172.21.15.178:3300/0 conn(0x7ff9f00beb30 0x7ff9f0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 >> v1:172.21.15.178:6789/0 conn(0x7ff9f0069ef0 legacy=0x7ff9f0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00c4740 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff9d8001470 con 0x7ff9f00c3fb0 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 >> v1:172.21.15.133:6789/0 conn(0x7ff9f00c3fb0 legacy=0x7ff9f00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9dc0038e0 0x7ff9dc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9dc004690 0x7ff9dc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9dc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00bef10 con 0x7ff9dc005050 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc00bfe0 con 0x7ff9dc004690 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9dc00c1a0 con 0x7ff9dc0038e0 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9dc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9dc0038e0 0x7ff9dc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9dc004690 0x7ff9dc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 -- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9dc0038e0 msgr2=0x7ff9dc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9dc0038e0 0x7ff9dc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 -- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9dc004690 msgr2=0x7ff9dc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9dc004690 0x7ff9dc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.080+0000 7ff9effff700 1 -- 172.21.15.133:0/1075549092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc0033f0 con 0x7ff9dc005050 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9effff700 1 -- 172.21.15.133:0/1075549092 reap_dead start 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9effff700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9dc00b8e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7ff9f006a2f0 tx=0x7ff9e8007f30).ready entity=mon.0 client_cookie=355a3a8f980d1601 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8006a20 con 0x7ff9dc005050 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e8006b80 con 0x7ff9dc005050 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9ee7fc700 1 -- 172.21.15.133:0/1075549092 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007020 con 0x7ff9dc005050 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 -- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 msgr2=0x7ff9dc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9dc00b8e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7ff9f006a2f0 tx=0x7ff9e8007f30).stop 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 -- 172.21.15.133:0/1075549092 shutdown_connections 2024-01-21T20:14:26.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1075549092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9dc00b8e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 -- 172.21.15.133:0/1075549092 >> 172.21.15.133:0/1075549092 conn(0x7ff9f00c8010 msgr2=0x7ff9f00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 -- 172.21.15.133:0/1075549092 shutdown_connections 2024-01-21T20:14:26.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.081+0000 7ff9f6010700 1 -- 172.21.15.133:0/1075549092 wait complete. 2024-01-21T20:14:26.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.083+0000 7ff9f6010700 1 Processor -- start 2024-01-21T20:14:26.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.083+0000 7ff9f6010700 1 -- start start 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9f00a5d70 0x7ff9f00a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9f00ad5a0 0x7ff9f00ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00bfd60 con 0x7ff9dc005050 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00a66e0 con 0x7ff9f00a5d70 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9f6010700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f00bf150 con 0x7ff9f00ad5a0 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44906/0 (socket says 172.21.15.133:44906) 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 -- 172.21.15.133:0/1998060595 learned_addr learned my addr 172.21.15.133:0/1998060595 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9f00a5d70 0x7ff9f00a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9effff700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9f00ad5a0 0x7ff9f00ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 -- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9f00ad5a0 msgr2=0x7ff9f00ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9f00ad5a0 0x7ff9f00ada20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 -- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9f00a5d70 msgr2=0x7ff9f00a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9f00a5d70 0x7ff9f00a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.084+0000 7ff9ef7fe700 1 -- 172.21.15.133:0/1998060595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00bf430 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ff9e00119c0 tx=0x7ff9e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9e7fff700 1 -- 172.21.15.133:0/1998060595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0013680 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9e7fff700 1 -- 172.21.15.133:0/1998060595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e00137e0 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f00bf710 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9e7fff700 1 -- 172.21.15.133:0/1998060595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0013b60 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.085+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f00adf10 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.086+0000 7ff9e7fff700 1 -- 172.21.15.133:0/1998060595 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff9e0014440 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.086+0000 7ff9e7fff700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 0x7ff9d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.087+0000 7ff9e7fff700 1 -- 172.21.15.133:0/1998060595 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff9e007aed0 con 0x7ff9dc005050 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.087+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 0x7ff9d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.087+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 0x7ff9d0061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff9d8001200 tx=0x7ff9d8001e50).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.088+0000 7ffa079b3b80 1 Processor -- start 2024-01-21T20:14:26.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 -- start start 2024-01-21T20:14:26.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d59a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d59223d0 con 0x5580d59f42c0 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d58e7be0 con 0x5580d59ab620 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.089+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d58fd260 con 0x5580d59a6df0 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44910/0 (socket says 172.21.15.133:44910) 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 -- 172.21.15.133:0/2788079957 learned_addr learned my addr 172.21.15.133:0/2788079957 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 -- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 msgr2=0x5580d59a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d59a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 -- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 msgr2=0x5580d59aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 -- 172.21.15.133:0/2788079957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580d58f62f0 con 0x5580d59f42c0 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7ff9d80047a0 tx=0x7ff9d8006000).ready entity=mon.0 client_cookie=7194b8adef80290c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9e57fa700 1 -- 172.21.15.133:0/2788079957 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8007ea0 con 0x5580d59f42c0 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9e57fa700 1 -- 172.21.15.133:0/2788079957 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8017630 con 0x5580d59f42c0 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.090+0000 7ff9e57fa700 1 -- 172.21.15.133:0/2788079957 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80179b0 con 0x5580d59f42c0 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- 172.21.15.133:0/2788079957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 msgr2=0x5580d59a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7ff9d80047a0 tx=0x7ff9d8006000).stop 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- 172.21.15.133:0/2788079957 shutdown_connections 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d59a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/2788079957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59a6900 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- 172.21.15.133:0/2788079957 >> 172.21.15.133:0/2788079957 conn(0x5580d58142e0 msgr2=0x5580d59f4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- 172.21.15.133:0/2788079957 shutdown_connections 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- 172.21.15.133:0/2788079957 wait complete. 2024-01-21T20:14:26.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.091+0000 7ffa079b3b80 1 -- start start 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 Processor -- start 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59eda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59ab620 0x5580d59d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d58fd3a0 con 0x5580d59f42c0 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d58fd620 con 0x5580d59a6df0 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d58c8990 con 0x5580d59ab620 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ffa079b3b80 10 client.0 ll_register_callbacks cb 0x5580d596b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ff9effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ff9effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44912/0 (socket says 172.21.15.133:44912) 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ff9effff700 1 -- 172.21.15.133:0/1938835946 learned_addr learned my addr 172.21.15.133:0/1938835946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59ab620 0x5580d59d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.092+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 -- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59ab620 msgr2=0x5580d59d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59ab620 0x5580d59d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 -- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 msgr2=0x5580d59eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 -- 172.21.15.133:0/1938835946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f00c4740 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9effff700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff9f0152c40 tx=0x7ff9e8016000).ready entity=mon.0 client_cookie=cdc557a276e6e008 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80075a0 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff9e8007700 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580d59a5df0 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e800c590 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 10 client.6453 fetch_fsmap learned FSMap version 24 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5580d58f1520 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5580d59a5df0 con 0x5580d59f42c0 2024-01-21T20:14:26.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9e800c6f0 con 0x5580d59f42c0 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 10 client.6453 fetch_fsmap finished waiting for FSMap version 24 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 10 client.6453 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 20 client.6453 populate_metadata read hostname 'smithi133' 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59d6450 0x5580d59d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 4 client.6453 mds_command: new command op to 6312 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.093+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 --> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580d58f2d60 con 0x5580d59d6450 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.094+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59d6450 0x5580d59d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.094+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59d6450 0x5580d59d6830 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b26ba7f0aa132cd server_cookie=fdc411ce2fcda7a1 in_seq=0 out_seq=0 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.094+0000 7ff9ce7fc700 10 client.6453 ms_handle_connect on v2:172.21.15.178:6832/206816937 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1938835946 <== mds.0 v2:172.21.15.178:6832/206816937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5580d58f2d60 con 0x5580d59d6450 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ff9ce7fc700 10 client.6453 handle_command_reply: tid=0 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 client.6453 shutdown 2024-01-21T20:14:26.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 msgr2=0x5580d59d9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7ff9f0152c40 tx=0x7ff9e8016000).stop 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 shutdown_connections 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59d9e30 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59d6450 0x5580d59d6830 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1938835946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59ab620 0x5580d59d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ff9ce7fc700 0 client.6453 ms_handle_reset on v2:172.21.15.178:6832/206816937 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 >> 172.21.15.133:0/1938835946 conn(0x5580d58142e0 msgr2=0x5580d59a9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 shutdown_connections 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1938835946 wait complete. 2024-01-21T20:14:26.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.095+0000 7ffa079b3b80 20 client.6453 trim_cache size 0 max 16384 2024-01-21T20:14:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.111+0000 7ffa079b3b80 1 Processor -- start 2024-01-21T20:14:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.111+0000 7ffa079b3b80 1 -- start start 2024-01-21T20:14:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59f42c0 0x5580d59a9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d59acca0 con 0x5580d59ab620 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d59d2cd0 con 0x5580d59a6df0 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d59ae1f0 con 0x5580d59f42c0 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ff9eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44916/0 (socket says 172.21.15.133:44916) 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ff9eeffd700 1 -- 172.21.15.133:0/845735065 learned_addr learned my addr 172.21.15.133:0/845735065 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.112+0000 7ff9effff700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59f42c0 0x5580d59a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 -- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59f42c0 msgr2=0x5580d59a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59f42c0 0x5580d59a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 -- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 msgr2=0x5580d59d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59d18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 -- 172.21.15.133:0/845735065 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f00c6ca0 con 0x5580d59ab620 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7ff9d8007820 tx=0x7ff9d8017000).ready entity=mon.0 client_cookie=11307076418d790a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9e5ffb700 1 -- 172.21.15.133:0/845735065 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d802a070 con 0x5580d59ab620 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9e5ffb700 1 -- 172.21.15.133:0/845735065 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d802b040 con 0x5580d59ab620 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ff9e5ffb700 1 -- 172.21.15.133:0/845735065 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80179b0 con 0x5580d59ab620 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 -- 172.21.15.133:0/845735065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 msgr2=0x5580d59d1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7ff9d8007820 tx=0x7ff9d8017000).stop 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 -- 172.21.15.133:0/845735065 shutdown_connections 2024-01-21T20:14:26.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59f42c0 0x5580d59a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59a6df0 0x5580d59d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/845735065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59ab620 0x5580d59d1db0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.113+0000 7ffa079b3b80 1 -- 172.21.15.133:0/845735065 >> 172.21.15.133:0/845735065 conn(0x5580d58142e0 msgr2=0x5580d59f4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.114+0000 7ffa079b3b80 1 -- 172.21.15.133:0/845735065 shutdown_connections 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.114+0000 7ffa079b3b80 1 -- 172.21.15.133:0/845735065 wait complete. 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.114+0000 7ffa079b3b80 1 -- start start 2024-01-21T20:14:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.114+0000 7ffa079b3b80 1 Processor -- start 2024-01-21T20:14:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d5a5dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d59ac3e0 con 0x5580d59f42c0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580d5a19210 con 0x5580d59ab620 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.115+0000 7ffa079b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580d59d2070 con 0x5580d59a6df0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ffa079b3b80 10 client.0 ll_register_callbacks cb 0x5580d59ecd00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44922/0 (socket says 172.21.15.133:44922) 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 -- 172.21.15.133:0/1080046326 learned_addr learned my addr 172.21.15.133:0/1080046326 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d5a5dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9eeffd700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 -- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 msgr2=0x5580d5a5dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d5a5dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 -- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 msgr2=0x5580d59aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 -- 172.21.15.133:0/1080046326 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580d58f62f0 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d5a5dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9effff700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7ff9e800c3c0 tx=0x7ff9e801f040).ready entity=mon.0 client_cookie=5a83b8d811ab59e1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007ea0 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff9e800c7a0 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff9d8017630 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9e8007cc0 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ffa079b3b80 10 client.6459 fetch_fsmap learned FSMap version 24 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5580d58f1270 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8017630 con 0x5580d59f42c0 2024-01-21T20:14:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.116+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 24) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff9e8025820 con 0x5580d59f42c0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 10 client.6459 fetch_fsmap finished waiting for FSMap version 24 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 10 client.6459 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 20 client.6459 populate_metadata read hostname 'smithi133' 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59ed9a0 0x5580d5a18360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 4 client.6459 mds_command: new command op to 6312 tid=0[{"prefix": "status"}] 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 --> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5580d58e97d0 con 0x5580d59ed9a0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59ed9a0 0x5580d5a18360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ef7fe700 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59ed9a0 0x5580d5a18360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a2b34c5bc7e99907 server_cookie=9578bf0efeae4c33 in_seq=0 out_seq=0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ce7fc700 10 client.6459 ms_handle_connect on v2:172.21.15.178:6832/206816937 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ce7fc700 1 -- 172.21.15.133:0/1080046326 <== mds.0 v2:172.21.15.178:6832/206816937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5580d58e97d0 con 0x5580d59ed9a0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ce7fc700 10 client.6459 handle_command_reply: tid=0 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 client.6459 shutdown 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 msgr2=0x5580d59abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7ff9e800c3c0 tx=0x7ff9e801f040).stop 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 shutdown_connections 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5580d59f42c0 0x5580d59abef0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:6832/206816937,v1:172.21.15.178:6834/206816937] conn(0x5580d59ed9a0 0x5580d5a18360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5580d59a6df0 0x5580d5a5dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 --2- 172.21.15.133:0/1080046326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580d59ab620 0x5580d59aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ff9ce7fc700 0 client.6459 ms_handle_reset on v2:172.21.15.178:6832/206816937 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.117+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 >> 172.21.15.133:0/1080046326 conn(0x5580d58142e0 msgr2=0x5580d59efdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 shutdown_connections 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ffa079b3b80 1 -- 172.21.15.133:0/1080046326 wait complete. 2024-01-21T20:14:26.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ffa079b3b80 20 client.6459 trim_cache size 0 max 16384 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6312, 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:14:26.115 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 4.6730646350000002, 2024-01-21T20:14:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 24, 2024-01-21T20:14:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 79, 2024-01-21T20:14:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 79, 2024-01-21T20:14:26.116 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 9.9678491390000001 2024-01-21T20:14:26.116 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 msgr2=0x7ff9d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 0x7ff9d0061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff9d8001200 tx=0x7ff9d8001e50).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 msgr2=0x7ff9f0139b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ff9e00119c0 tx=0x7ff9e0009060).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 shutdown_connections 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9d005f150 0x7ff9d0061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9f00ad5a0 0x7ff9f00ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9dc005050 0x7ff9f0139b50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 --2- 172.21.15.133:0/1998060595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9f00a5d70 0x7ff9f00a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 >> 172.21.15.133:0/1998060595 conn(0x7ff9f00c8010 msgr2=0x7ff9f00bdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 shutdown_connections 2024-01-21T20:14:26.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.118+0000 7ff9f6010700 1 -- 172.21.15.133:0/1998060595 wait complete. 2024-01-21T20:14:26.120 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:14:26.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.233+0000 7ff214bda700 1 Processor -- start 2024-01-21T20:14:26.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.233+0000 7ff214bda700 1 -- start start 2024-01-21T20:14:26.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff214bda700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff210153e90 0x7ff210154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff214bda700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100bde30 0x7ff2100be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff214bda700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100be7d0 con 0x7ff210063430 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff214bda700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff210155530 con 0x7ff210153e90 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff214bda700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c5f20 con 0x7ff2100bde30 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff20e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff210153e90 0x7ff210154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff20e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff210153e90 0x7ff210154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44924/0 (socket says 172.21.15.133:44924) 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff20e59c700 1 -- 172.21.15.133:0/3422140903 learned_addr learned my addr 172.21.15.133:0/3422140903 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.234+0000 7ff20ed9d700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100bde30 0x7ff2100be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20e59c700 1 -- 172.21.15.133:0/3422140903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100bde30 msgr2=0x7ff2100be2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20e59c700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100bde30 0x7ff2100be2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20e59c700 1 -- 172.21.15.133:0/3422140903 >> v1:172.21.15.178:6789/0 conn(0x7ff210063430 legacy=0x7ff2100c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20e59c700 1 -- 172.21.15.133:0/3422140903 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210154920 con 0x7ff210153e90 2024-01-21T20:14:26.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20e59c700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff210153e90 0x7ff210154270 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ff204006fd0 tx=0x7ff2040090f0).ready entity=mon.0 client_cookie=9a79e04d0504a741 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20d59a700 1 -- 172.21.15.133:0/3422140903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400b580 con 0x7ff210153e90 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20d59a700 1 -- 172.21.15.133:0/3422140903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400b6e0 con 0x7ff210153e90 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff20d59a700 1 -- 172.21.15.133:0/3422140903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400ba60 con 0x7ff210153e90 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 -- 172.21.15.133:0/3422140903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff210153e90 msgr2=0x7ff210154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff210153e90 0x7ff210154270 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ff204006fd0 tx=0x7ff2040090f0).stop 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 -- 172.21.15.133:0/3422140903 shutdown_connections 2024-01-21T20:14:26.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff210153e90 0x7ff210154270 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 --2- 172.21.15.133:0/3422140903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100bde30 0x7ff2100be2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.235+0000 7ff214bda700 1 -- 172.21.15.133:0/3422140903 >> 172.21.15.133:0/3422140903 conn(0x7ff2100c7cb0 msgr2=0x7ff2100c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.236+0000 7ff214bda700 1 -- 172.21.15.133:0/3422140903 shutdown_connections 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.236+0000 7ff214bda700 1 -- 172.21.15.133:0/3422140903 wait complete. 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.237+0000 7ff214bda700 1 Processor -- start 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.237+0000 7ff214bda700 1 -- start start 2024-01-21T20:14:26.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153e90 0x7ff210165460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 0x7ff2100a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100a7690 con 0x7ff2100bde30 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100bed50 con 0x7ff210153e90 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff214bda700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210165950 con 0x7ff210150b90 2024-01-21T20:14:26.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff20e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44930/0 (socket says 172.21.15.133:44930) 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.238+0000 7ff20e59c700 1 -- 172.21.15.133:0/2784123228 learned_addr learned my addr 172.21.15.133:0/2784123228 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20ed9d700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 0x7ff2100a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20dd9b700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153e90 0x7ff210165460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 -- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 msgr2=0x7ff2100a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 0x7ff2100a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 -- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153e90 msgr2=0x7ff210165460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153e90 0x7ff210165460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 -- 172.21.15.133:0/2784123228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204009370 con 0x7ff2100bde30 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20ed9d700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 0x7ff2100a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff20e59c700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff204009130 tx=0x7ff204017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20400b850 con 0x7ff2100bde30 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20400b9b0 con 0x7ff2100bde30 2024-01-21T20:14:26.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20401b660 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210151100 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.239+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2101516c0 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.240+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2100475e0 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.240+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff20401ba50 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.241+0000 7ff1feffd700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 0x7ff1f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.241+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff20407b260 con 0x7ff2100bde30 2024-01-21T20:14:26.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.241+0000 7ff20dd9b700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 0x7ff1f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:26.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.241+0000 7ff20dd9b700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 0x7ff1f0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff2101528f0 tx=0x7ff200009040).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:26.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.245+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff20404c390 con 0x7ff2100bde30 2024-01-21T20:14:26.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.452+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff21006ab50 con 0x7ff2100bde30 2024-01-21T20:14:26.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.452+0000 7ff1feffd700 1 -- 172.21.15.133:0/2784123228 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff204021070 con 0x7ff2100bde30 2024-01-21T20:14:26.442 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 msgr2=0x7ff1f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 0x7ff1f0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff2101528f0 tx=0x7ff200009040).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 msgr2=0x7ff2100aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff204009130 tx=0x7ff204017000).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 shutdown_connections 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f005f150 0x7ff1f0061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff210150b90 0x7ff2100a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100bde30 0x7ff2100aa170 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 --2- 172.21.15.133:0/2784123228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153e90 0x7ff210165460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 >> 172.21.15.133:0/2784123228 conn(0x7ff2100c7cb0 msgr2=0x7ff2100694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 shutdown_connections 2024-01-21T20:14:26.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:26.454+0000 7ff214bda700 1 -- 172.21.15.133:0/2784123228 wait complete. 2024-01-21T20:14:26.454 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:14:26.454 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:14:26.455 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:14:26.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.455 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:14:26.473 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:14:26.473 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:14:26.473 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:14:26.473 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.473 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41465sec preferred_lft 41465sec 2024-01-21T20:14:26.474 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:14:26.475 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:26.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.476 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:14:26.535 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T20:14:26.545+0000 7f9637b07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:14:26.539 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:14:26.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.540 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:14:26.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:14:26.600 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:14:26.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.705 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:14:26.721 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:14:26.721 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:14:26.721 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:14:26.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:14:26.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.788 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:26.845 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:14:26.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:26.926 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:26.926 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:14:26.948 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:26.948 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:14:26.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:14:26.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:26.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:27.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:14:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.185+0000 7f485c1c2700 1 Processor -- start 2024-01-21T20:14:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.185+0000 7f485c1c2700 1 -- start start 2024-01-21T20:14:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485c1c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f485413a620 0x7f48540a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485c1c2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f485413aa00 0x7f4854158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485c1c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48541584f0 con 0x7f48540626f0 2024-01-21T20:14:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485c1c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48540bd6f0 con 0x7f485413a620 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485c1c2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540654e0 con 0x7f485413aa00 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f485413a620 0x7f48540a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485a75f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f48540626f0 0x7f48540695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35968/0 (socket says 172.21.15.133:35968) 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f485413a620 0x7f48540a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44932/0 (socket says 172.21.15.133:44932) 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485a75f700 1 -- 172.21.15.133:0/3192493204 learned_addr learned my addr 172.21.15.133:0/3192493204 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f485975d700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f485413aa00 0x7f4854158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 -- 172.21.15.133:0/3192493204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f485413aa00 msgr2=0x7f4854158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f485413aa00 0x7f4854158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 -- 172.21.15.133:0/3192493204 >> v1:172.21.15.133:6789/0 conn(0x7f48540626f0 legacy=0x7f48540695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4858f5c700 1 -- 172.21.15.133:0/3192493204 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731970159 0 0) 0x7f484c001490 con 0x7f48540626f0 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.186+0000 7f4859f5e700 1 -- 172.21.15.133:0/3192493204 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854158730 con 0x7f485413a620 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f4859f5e700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413a620 0x7f48540a6e30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f4844009760 tx=0x7f4844009060).ready entity=mon.0 client_cookie=a318e939648e49f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f4858f5c700 1 -- 172.21.15.133:0/3192493204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440090d0 con 0x7f485413a620 2024-01-21T20:14:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f4858f5c700 1 -- 172.21.15.133:0/3192493204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400b580 con 0x7f485413a620 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f4858f5c700 1 -- 172.21.15.133:0/3192493204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400b900 con 0x7f485413a620 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 -- 172.21.15.133:0/3192493204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413a620 msgr2=0x7f48540a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413a620 0x7f48540a6e30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f4844009760 tx=0x7f4844009060).stop 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 -- 172.21.15.133:0/3192493204 shutdown_connections 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413a620 0x7f48540a6e30 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 --2- 172.21.15.133:0/3192493204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f485413aa00 0x7f4854158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 -- 172.21.15.133:0/3192493204 >> 172.21.15.133:0/3192493204 conn(0x7f48540c7dc0 msgr2=0x7f48540c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 -- 172.21.15.133:0/3192493204 shutdown_connections 2024-01-21T20:14:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.187+0000 7f485c1c2700 1 -- 172.21.15.133:0/3192493204 wait complete. 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.188+0000 7f485c1c2700 1 Processor -- start 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 -- start start 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48540626f0 0x7f48540aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 0x7f48540a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540aa470 con 0x7f485413aa00 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48540a9860 con 0x7f485413a620 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485c1c2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48540a9b40 con 0x7f48540626f0 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485a75f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485a75f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44940/0 (socket says 172.21.15.133:44940) 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.189+0000 7f485a75f700 1 -- 172.21.15.133:0/935013169 learned_addr learned my addr 172.21.15.133:0/935013169 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f4859f5e700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48540626f0 0x7f48540aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485975d700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 0x7f48540a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 -- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48540626f0 msgr2=0x7f48540aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48540626f0 0x7f48540aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 -- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 msgr2=0x7f48540a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 0x7f48540a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 -- 172.21.15.133:0/935013169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440092a0 con 0x7f485413aa00 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485975d700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 0x7f48540a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485a75f700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f484c00c7e0 tx=0x7f484c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c005d30 con 0x7f485413aa00 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c005e90 con 0x7f485413aa00 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48540a9e20 con 0x7f485413aa00 2024-01-21T20:14:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c007320 con 0x7f485413aa00 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.190+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48540ab080 con 0x7f485413aa00 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.191+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48540aa620 con 0x7f485413aa00 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.191+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f484c0076d0 con 0x7f485413aa00 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.191+0000 7f484a7fc700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 0x7f4838061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.192+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f484c07a2f0 con 0x7f485413aa00 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.192+0000 7f4859f5e700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 0x7f4838061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.192+0000 7f4859f5e700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 0x7f4838061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f484400b340 tx=0x7f4844017000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.196+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f484c04b370 con 0x7f485413aa00 2024-01-21T20:14:27.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.385+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f48541584f0 con 0x7f483805f150 2024-01-21T20:14:27.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.387+0000 7f484a7fc700 1 -- 172.21.15.133:0/935013169 <== mgr.6120 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f48541584f0 con 0x7f483805f150 2024-01-21T20:14:27.376 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:14:27.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:27.376 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:14:27.376 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:27.377 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 msgr2=0x7f4838061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 0x7f4838061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f484400b340 tx=0x7f4844017000).stop 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 msgr2=0x7f48540a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f484c00c7e0 tx=0x7f484c007dd0).stop 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 shutdown_connections 2024-01-21T20:14:27.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f483805f150 0x7f4838061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f485413aa00 0x7f48540a91d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48540626f0 0x7f48540aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 --2- 172.21.15.133:0/935013169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f485413a620 0x7f48540a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.388+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 >> 172.21.15.133:0/935013169 conn(0x7f48540c7dc0 msgr2=0x7f48541576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.389+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 shutdown_connections 2024-01-21T20:14:27.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.389+0000 7f485c1c2700 1 -- 172.21.15.133:0/935013169 wait complete. 2024-01-21T20:14:27.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:14:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.519+0000 7ff8c9f9b700 1 Processor -- start 2024-01-21T20:14:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.519+0000 7ff8c9f9b700 1 -- start start 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c9f9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8c40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c9f9b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c4063750 con 0x7ff8c40a9d10 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c9f9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c405e380 con 0x7ff8c41558d0 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c9f9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c405e660 con 0x7ff8c40aa0f0 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8c40a9d10 0x7ff8c41551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35972/0 (socket says 172.21.15.133:35972) 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.520+0000 7ff8c37fe700 1 -- 172.21.15.133:0/2198122108 learned_addr learned my addr 172.21.15.133:0/2198122108 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8c40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947939362 0 0) 0x7ff8c4063750 con 0x7ff8c40a9d10 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8b00033f0 con 0x7ff8c40a9d10 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971013104 0 0) 0x7ff8c405e380 con 0x7ff8c41558d0 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c4063750 con 0x7ff8c41558d0 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1610120915 0 0) 0x7ff8b00033f0 con 0x7ff8c40a9d10 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 msgr2=0x7ff8c40ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8c40ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 >> v1:172.21.15.178:6789/0 conn(0x7ff8c41558d0 legacy=0x7ff8c40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40633e0 con 0x7ff8c40a9d10 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff8ac001470 con 0x7ff8c40a9d10 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 >> v1:172.21.15.133:6789/0 conn(0x7ff8c40a9d10 legacy=0x7ff8c41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b0003aa0 0x7ff8b0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8b0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8b0005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c405e660 con 0x7ff8b0004690 2024-01-21T20:14:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b000b990 con 0x7ff8b0003aa0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b000bb50 con 0x7ff8c40aa0f0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8b0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c37fe700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b0003aa0 0x7ff8b0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c3fff700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8b0005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 -- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 msgr2=0x7ff8b0005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8b0005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 -- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b0003aa0 msgr2=0x7ff8b0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b0003aa0 0x7ff8b0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c2ffd700 1 -- 172.21.15.133:0/2198122108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00033f0 con 0x7ff8b0004690 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.521+0000 7ff8c3fff700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c40aa0f0 0x7ff8b0005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8b0004b10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7ff8b4009a80 tx=0x7ff8b4009060).ready entity=mon.0 client_cookie=36cff491c24423ba server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4009430 con 0x7ff8b0004690 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400e640 con 0x7ff8b0004690 2024-01-21T20:14:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c27fc700 1 -- 172.21.15.133:0/2198122108 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400e9c0 con 0x7ff8b0004690 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/2198122108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 msgr2=0x7ff8b0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/2198122108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8b0004b10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7ff8b4009a80 tx=0x7ff8b4009060).stop 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c3fff700 1 -- 172.21.15.133:0/2198122108 reap_dead start 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/2198122108 shutdown_connections 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/2198122108 >> 172.21.15.133:0/2198122108 conn(0x7ff8c40c8200 msgr2=0x7ff8c40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/2198122108 shutdown_connections 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.522+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/2198122108 wait complete. 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.523+0000 7ff8c9f9b700 1 Processor -- start 2024-01-21T20:14:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 -- start start 2024-01-21T20:14:27.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c4146690 0x7ff8c40a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8c40a4260 0x7ff8c4064fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40a35d0 con 0x7ff8b0004690 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c4146b10 con 0x7ff8c40a4260 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c9f9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c40a46e0 con 0x7ff8c4146690 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44956/0 (socket says 172.21.15.133:44956) 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.524+0000 7ff8c37fe700 1 -- 172.21.15.133:0/806320337 learned_addr learned my addr 172.21.15.133:0/806320337 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 -- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c4146690 msgr2=0x7ff8c40a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c4146690 0x7ff8c40a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c4146690 0x7ff8c40a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 -- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8c40a4260 msgr2=0x7ff8c4064fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8c40a4260 0x7ff8c4064fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 -- 172.21.15.133:0/806320337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4146d90 con 0x7ff8b0004690 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c37fe700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7ff8ac000e10 tx=0x7ff8ac001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac011590 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0116f0 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c4147070 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac011ab0 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.525+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c4147630 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.526+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c405fdf0 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.526+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 24) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff8ac015410 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.527+0000 7ff8bbfff700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 0x7ff8a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.527+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff8ac07a5b0 con 0x7ff8b0004690 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.527+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 0x7ff8a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:27.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.527+0000 7ff8c2ffd700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 0x7ff8a4061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff8c41556e0 tx=0x7ff8b401a000).ready entity=mgr.6120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:27.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.531+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff8ac04b5d0 con 0x7ff8b0004690 2024-01-21T20:14:27.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:27.740+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7ff8c40662a0 con 0x7ff8b0004690 2024-01-21T20:14:28.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.475+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 25) v1 ==== 75463+0+0 (secure 0 0 0) 0x7ff8ac078130 con 0x7ff8b0004690 2024-01-21T20:14:28.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.476+0000 7ff8bbfff700 1 -- 172.21.15.133:0/806320337 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v25) v1 ==== 92+0+0 (secure 0 0 0) 0x7ff8ac073940 con 0x7ff8b0004690 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 msgr2=0x7ff8a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 0x7ff8a4061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff8c41556e0 tx=0x7ff8b401a000).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 msgr2=0x7ff8c40a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7ff8ac000e10 tx=0x7ff8ac001e10).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 shutdown_connections 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8a405f150 0x7ff8a4061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8c40a4260 0x7ff8c4064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b0004690 0x7ff8c40a04c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 --2- 172.21.15.133:0/806320337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8c4146690 0x7ff8c40a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 >> 172.21.15.133:0/806320337 conn(0x7ff8c40c8200 msgr2=0x7ff8c4153a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 shutdown_connections 2024-01-21T20:14:28.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.479+0000 7ff8c9f9b700 1 -- 172.21.15.133:0/806320337 wait complete. 2024-01-21T20:14:28.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:14:28.606 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:28.616+0000 7fdd22d60680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.622+0000 7f750a099700 1 Processor -- start 2024-01-21T20:14:28.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.622+0000 7f750a099700 1 -- start start 2024-01-21T20:14:28.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f750a099700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f7504155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:28.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f750a099700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504065660 con 0x7f7504069ef0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f750a099700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504065f00 con 0x7f75040c3fb0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f750a099700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040bef10 con 0x7f75040beb30 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f7503fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7504069ef0 0x7f7504066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35994/0 (socket says 172.21.15.133:35994) 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f7503fff700 1 -- 172.21.15.133:0/977255480 learned_addr learned my addr 172.21.15.133:0/977255480 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f75037fe700 1 --2- 172.21.15.133:0/977255480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f7504155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.623+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800599834 0 0) 0x7f7504065660 con 0x7f7504069ef0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f00033f0 con 0x7f7504069ef0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749950094 0 0) 0x7f7504065f00 con 0x7f75040c3fb0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7504065660 con 0x7f75040c3fb0 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75037fe700 1 -- 172.21.15.133:0/977255480 >> v1:172.21.15.178:6789/0 conn(0x7f75040c3fb0 legacy=0x7f75040697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75037fe700 1 -- 172.21.15.133:0/977255480 >> v1:172.21.15.133:6789/0 conn(0x7f7504069ef0 legacy=0x7f7504066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75037fe700 1 -- 172.21.15.133:0/977255480 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75040c4740 con 0x7f75040beb30 2024-01-21T20:14:28.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75037fe700 1 --2- 172.21.15.133:0/977255480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f7504155b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f74f4009790 tx=0x7f74f4009060).ready entity=mon.2 client_cookie=7959cff80963ca68 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40090d0 con 0x7f75040beb30 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400f510 con 0x7f75040beb30 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.624+0000 7f75027fc700 1 -- 172.21.15.133:0/977255480 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400f890 con 0x7f75040beb30 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 -- 172.21.15.133:0/977255480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 msgr2=0x7f7504155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 --2- 172.21.15.133:0/977255480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f7504155b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f74f4009790 tx=0x7f74f4009060).stop 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 -- 172.21.15.133:0/977255480 shutdown_connections 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 --2- 172.21.15.133:0/977255480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f7504155b80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 -- 172.21.15.133:0/977255480 >> 172.21.15.133:0/977255480 conn(0x7f75040c8010 msgr2=0x7f75040c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 -- 172.21.15.133:0/977255480 shutdown_connections 2024-01-21T20:14:28.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.625+0000 7f750a099700 1 -- 172.21.15.133:0/977255480 wait complete. 2024-01-21T20:14:28.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.626+0000 7f750a099700 1 Processor -- start 2024-01-21T20:14:28.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.626+0000 7f750a099700 1 -- start start 2024-01-21T20:14:28.617 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:28.626+0000 7f2c8c487680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7504069ef0 0x7f75041381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f75040abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040ac490 con 0x7f75040c3fb0 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c0250 con 0x7f7504069ef0 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f750a099700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c0af0 con 0x7f75040beb30 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44990/0 (socket says 172.21.15.133:44990) 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 -- 172.21.15.133:0/3313620092 learned_addr learned my addr 172.21.15.133:0/3313620092 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f75037fe700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7504069ef0 0x7f75041381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7502ffd700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f75040abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:28.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 -- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 msgr2=0x7f75040abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f75040abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 -- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7504069ef0 msgr2=0x7f75041381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7504069ef0 0x7f75041381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 -- 172.21.15.133:0/3313620092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40092a0 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f7503fff700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f74fc001560 tx=0x7f74fc0015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.627+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc005d30 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.628+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc005e90 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.628+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75040bfe70 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.628+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc007300 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.628+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75040c0780 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.629+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75040c0ca0 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.629+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f74fc007670 con 0x7f75040c3fb0 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.630+0000 7f74fbfff700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 0x7f74e4061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:28.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.630+0000 7f75037fe700 1 -- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 msgr2=0x7f74e4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:28.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.630+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f74fc079a90 con 0x7f75040c3fb0 2024-01-21T20:14:28.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.630+0000 7f75037fe700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 0x7f74e4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:28.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.634+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f75040c0ca0 con 0x7f75040c3fb0 2024-01-21T20:14:28.670 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:28.680+0000 7fdd22d60680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:28.682 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:28.693+0000 7f2c8c487680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.807+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f750405fdf0 con 0x7f75040c3fb0 2024-01-21T20:14:28.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.812+0000 7f74fbfff700 1 -- 172.21.15.133:0/3313620092 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74fc018020 con 0x7f75040c3fb0 2024-01-21T20:14:28.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 msgr2=0x7f74e4061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 0x7f74e4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 msgr2=0x7f75040abfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f74fc001560 tx=0x7f74fc0015b0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 shutdown_connections 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f74e405f1a0 0x7f74e4061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75040c3fb0 0x7f75040abfa0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7504069ef0 0x7f75041381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 --2- 172.21.15.133:0/3313620092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75040beb30 0x7f75040abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 >> 172.21.15.133:0/3313620092 conn(0x7f75040c8010 msgr2=0x7f75040697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 shutdown_connections 2024-01-21T20:14:28.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:28.814+0000 7f750a099700 1 -- 172.21.15.133:0/3313620092 wait complete. 2024-01-21T20:14:28.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:28.816 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T20:14:28.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2024-01-21T20:14:28.946 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:28.956+0000 7fdd22d60680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:28.972 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:28.983+0000 7f2c8c487680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:29.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.010+0000 7f7e49a78700 1 Processor -- start 2024-01-21T20:14:29.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 -- start start 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e44066b50 0x7f7e44066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e440c5330 0x7f7e44153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e440c37c0 con 0x7f7e44157f30 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e44158ed0 con 0x7f7e440c5330 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.011+0000 7f7e49a78700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e441583b0 con 0x7f7e44066b50 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e440c5330 0x7f7e44153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e42ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7e44157f30 0x7f7e440bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:36002/0 (socket says 172.21.15.133:36002) 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e440c5330 0x7f7e44153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44996/0 (socket says 172.21.15.133:44996) 2024-01-21T20:14:29.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e42ffd700 1 -- 172.21.15.133:0/2891225504 learned_addr learned my addr 172.21.15.133:0/2891225504 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e437fe700 1 --2- 172.21.15.133:0/2891225504 >> v2:172.21.15.178:3300/0 conn(0x7f7e44066b50 0x7f7e44066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 -- 172.21.15.133:0/2891225504 >> v2:172.21.15.178:3300/0 conn(0x7f7e44066b50 msgr2=0x7f7e44066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 --2- 172.21.15.133:0/2891225504 >> v2:172.21.15.178:3300/0 conn(0x7f7e44066b50 0x7f7e44066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 -- 172.21.15.133:0/2891225504 >> v1:172.21.15.133:6789/0 conn(0x7f7e44157f30 legacy=0x7f7e440bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 -- 172.21.15.133:0/2891225504 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44158630 con 0x7f7e440c5330 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e43fff700 1 --2- 172.21.15.133:0/2891225504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e44153e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7e440c6a70 tx=0x7f7e3c009060).ready entity=mon.0 client_cookie=e9c676a02215ec2e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e427fc700 1 -- 172.21.15.133:0/2891225504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c0090d0 con 0x7f7e440c5330 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e427fc700 1 -- 172.21.15.133:0/2891225504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00f510 con 0x7f7e440c5330 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.012+0000 7f7e427fc700 1 -- 172.21.15.133:0/2891225504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00f890 con 0x7f7e440c5330 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 -- 172.21.15.133:0/2891225504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 msgr2=0x7f7e44153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 --2- 172.21.15.133:0/2891225504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e44153e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7e440c6a70 tx=0x7f7e3c009060).stop 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 -- 172.21.15.133:0/2891225504 shutdown_connections 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 --2- 172.21.15.133:0/2891225504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e44153e50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:29.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 --2- 172.21.15.133:0/2891225504 >> v2:172.21.15.178:3300/0 conn(0x7f7e44066b50 0x7f7e44066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:29.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 -- 172.21.15.133:0/2891225504 >> 172.21.15.133:0/2891225504 conn(0x7f7e440c8f60 msgr2=0x7f7e440c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:29.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 -- 172.21.15.133:0/2891225504 shutdown_connections 2024-01-21T20:14:29.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.013+0000 7f7e49a78700 1 -- 172.21.15.133:0/2891225504 wait complete. 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.014+0000 7f7e49a78700 1 Processor -- start 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.014+0000 7f7e49a78700 1 -- start start 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e44066b50 0x7f7e440c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e440c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e44157f30 0x7f7e440c06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e440c3080 con 0x7f7e440c5330 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4414b3c0 con 0x7f7e44157f30 2024-01-21T20:14:29.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e49a78700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4414aed0 con 0x7f7e44066b50 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e42ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e440c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e437fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e44066b50 0x7f7e440c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e43fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e44157f30 0x7f7e440c06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e42ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e440c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45004/0 (socket says 172.21.15.133:45004) 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.015+0000 7f7e42ffd700 1 -- 172.21.15.133:0/331437259 learned_addr learned my addr 172.21.15.133:0/331437259 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e44066b50 msgr2=0x7f7e440c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e44066b50 0x7f7e440c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e44157f30 msgr2=0x7f7e440c06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e44157f30 0x7f7e440c06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0092a0 con 0x7f7e440c5330 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e42ffd700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e440c5330 0x7f7e440c00a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f7e2c001eb0 tx=0x7f7e2c007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0070d0 con 0x7f7e440c5330 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c007230 con 0x7f7e440c5330 2024-01-21T20:14:29.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0075d0 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e49a78700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e440c2ac0 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.016+0000 7f7e49a78700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e440ac000 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.017+0000 7f7e49a78700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4405fdf0 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.017+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 25) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f7e2c0059b0 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.018+0000 7f7e3bfff700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.018+0000 7f7e437fe700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.018+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f7e2c079ac0 con 0x7f7e440c5330 2024-01-21T20:14:29.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.018+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:29.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.022+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7e2c04ab40 con 0x7f7e440c5330 2024-01-21T20:14:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.219+0000 7f7e437fe700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:29.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.219+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:29.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.222+0000 7f7e49a78700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e44158910 con 0x7f7e2405f1a0 2024-01-21T20:14:29.567 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:29.578+0000 7fdd22d60680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:29.601 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:29.612+0000 7f2c8c487680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.620+0000 7f7e437fe700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:29.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:29.620+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:14:29.639 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:29.650+0000 7fdd22d60680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:29.673 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:29.684+0000 7f2c8c487680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:29.826 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:29.837+0000 7fdd22d60680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:29.860 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:29.870+0000 7f2c8c487680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:30.246 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.256+0000 7fdd22d60680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:30.279 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.290+0000 7f2c8c487680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:30.348 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.359+0000 7fdd22d60680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:30.382 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.393+0000 7f2c8c487680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:30.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:30.421+0000 7f7e437fe700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:30.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:30.421+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:14:30.501 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.512+0000 7fdd22d60680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:30.535 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.546+0000 7f2c8c487680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:30.576 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.586+0000 7fdd22d60680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:30.609 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.620+0000 7f2c8c487680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:30.643 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.653+0000 7fdd22d60680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:30.676 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.687+0000 7f2c8c487680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:30.897 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:30.907+0000 7fdd22d60680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:30.931 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:30.942+0000 7f2c8c487680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:31.080 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:31.091+0000 7fdd22d60680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:31.113 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:31.123+0000 7f2c8c487680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:31.733 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:31.743+0000 7fdd22d60680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:31.760 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:31.771+0000 7f2c8c487680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:31.801 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:31.811+0000 7fdd22d60680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:31.828 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:31.839+0000 7f2c8c487680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:31.876 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:31.886+0000 7fdd22d60680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:31.903 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:31.914+0000 7f2c8c487680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:32.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:32.022+0000 7f7e437fe700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:32.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:32.022+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:14:32.021 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.031+0000 7fdd22d60680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:32.050 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.061+0000 7f2c8c487680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:32.092 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.102+0000 7fdd22d60680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:32.120 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.131+0000 7f2c8c487680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:32.207 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.217+0000 7fdd22d60680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:32.235 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.246+0000 7f2c8c487680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:32.314 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.324+0000 7fdd22d60680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:32.343 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.354+0000 7f2c8c487680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:32.604 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.615+0000 7fdd22d60680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:32.633 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.644+0000 7f2c8c487680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:32.675 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:32.685+0000 7fdd22d60680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:32.704 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.715+0000 7f2c8c487680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:32.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:32.734+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 26) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f7e2c077640 con 0x7f7e440c5330 2024-01-21T20:14:32.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:32.734+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 msgr2=0x7f7e24061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:32.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:32.734+0000 7f7e3bfff700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e24061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:32.786 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.796+0000 7f2bff225700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.786 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.796+0000 7f2bff225700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.786 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.796+0000 7f2bff225700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.796+0000 7f2bff225700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.796+0000 7f2bff225700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.797+0000 7f2c0322d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.797+0000 7f2c0322d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.797+0000 7f2c0322d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.797+0000 7f2c0322d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:32.787 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:32.797+0000 7f2c0322d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.760+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f7e2c0779c0 con 0x7f7e440c5330 2024-01-21T20:14:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.761+0000 7f7e3bfff700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e240615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.761+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e44158910 con 0x7f7e2405f1a0 2024-01-21T20:14:33.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.763+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e240615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.765+0000 7f7e437fe700 1 --2- 172.21.15.133:0/331437259 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e2405f1a0 0x7f7e240615e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f7e34009e10 tx=0x7f7e3400b040).ready entity=mgr.6492 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:33.756 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:33.767+0000 7f2c0a23b700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2024-01-21T20:14:33.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.767+0000 7f7e3bfff700 1 -- 172.21.15.133:0/331437259 <== mgr.6492 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f7e44158910 con 0x7f7e2405f1a0 2024-01-21T20:14:33.758 INFO:teuthology.orchestra.run.smithi133.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2024-01-21T20:14:33.762 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-21T20:14:33.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:33.762 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T20:14:33.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:14:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.956+0000 7fe0a3493700 1 Processor -- start 2024-01-21T20:14:33.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 -- start start 2024-01-21T20:14:33.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe09c13ac10 0x7fe09c0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c0695b0 0x7fe09c069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c069ef0 con 0x7fe09c13a830 2024-01-21T20:14:33.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0c3890 con 0x7fe09c13ac10 2024-01-21T20:14:33.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.957+0000 7fe0a3493700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c3b70 con 0x7fe09c0695b0 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe09c13ac10 0x7fe09c0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe09c13ac10 0x7fe09c0c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32892/0 (socket says 172.21.15.133:32892) 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 -- 172.21.15.133:0/2322862145 learned_addr learned my addr 172.21.15.133:0/2322862145 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a1a30700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c0695b0 0x7fe09c069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 -- 172.21.15.133:0/2322862145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c0695b0 msgr2=0x7fe09c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c0695b0 0x7fe09c069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 -- 172.21.15.133:0/2322862145 >> v1:172.21.15.133:6789/0 conn(0x7fe09c13a830 legacy=0x7fe09c0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 -- 172.21.15.133:0/2322862145 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0c3e50 con 0x7fe09c13ac10 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe0a0a2e700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c13ac10 0x7fe09c0c3220 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fe098006fd0 tx=0x7fe0980090f0).ready entity=mon.0 client_cookie=416ce54ea2d2bde6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe093fff700 1 -- 172.21.15.133:0/2322862145 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800b600 con 0x7fe09c13ac10 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe093fff700 1 -- 172.21.15.133:0/2322862145 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800b760 con 0x7fe09c13ac10 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.958+0000 7fe093fff700 1 -- 172.21.15.133:0/2322862145 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800bb00 con 0x7fe09c13ac10 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 -- 172.21.15.133:0/2322862145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c13ac10 msgr2=0x7fe09c0c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:33.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c13ac10 0x7fe09c0c3220 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fe098006fd0 tx=0x7fe0980090f0).stop 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 -- 172.21.15.133:0/2322862145 shutdown_connections 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c0695b0 0x7fe09c069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 --2- 172.21.15.133:0/2322862145 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c13ac10 0x7fe09c0c3220 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 -- 172.21.15.133:0/2322862145 >> 172.21.15.133:0/2322862145 conn(0x7fe09c0c7dc0 msgr2=0x7fe09c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 -- 172.21.15.133:0/2322862145 shutdown_connections 2024-01-21T20:14:33.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.959+0000 7fe0a3493700 1 -- 172.21.15.133:0/2322862145 wait complete. 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.960+0000 7fe0a3493700 1 Processor -- start 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.960+0000 7fe0a3493700 1 -- start start 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c13a830 0x7fe09c0a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c13ac10 0x7fe09c152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0c0770 con 0x7fe09c0695b0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c165420 con 0x7fe09c13ac10 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c165700 con 0x7fe09c13a830 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32904/0 (socket says 172.21.15.133:32904) 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 -- 172.21.15.133:0/473638309 learned_addr learned my addr 172.21.15.133:0/473638309 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a0a2e700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c13a830 0x7fe09c0a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a1a30700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c13ac10 0x7fe09c152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 -- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c13a830 msgr2=0x7fe09c0a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c13a830 0x7fe09c0a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 -- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c13ac10 msgr2=0x7fe09c152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c13ac10 0x7fe09c152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 -- 172.21.15.133:0/473638309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009370 con 0x7fe09c0695b0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a122f700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fe08c00c4c0 tx=0x7fe08c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c007020 con 0x7fe09c0695b0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c001e90 con 0x7fe09c0695b0 2024-01-21T20:14:33.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0073b0 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.961+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c1659e0 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.962+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0a7ce0 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.963+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c05fdf0 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.963+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 27) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fe08c0068b0 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.963+0000 7fe091ffb700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 0x7fe080061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.963+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fe08c079c90 con 0x7fe09c0695b0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.963+0000 7fe0a0a2e700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 0x7fe080061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:33.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.964+0000 7fe0a0a2e700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 0x7fe080061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe09c13b060 tx=0x7fe098017000).ready entity=mgr.6492 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:33.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:33.967+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe08c04ae40 con 0x7fe09c0695b0 2024-01-21T20:14:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:34.177+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fe09c0c4130 con 0x7fe09c0695b0 2024-01-21T20:14:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.067+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe08c077940 con 0x7fe09c0695b0 2024-01-21T20:14:35.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.068+0000 7fe091ffb700 1 -- 172.21.15.133:0/473638309 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v28) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe08c072700 con 0x7fe09c0695b0 2024-01-21T20:14:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 msgr2=0x7fe080061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 0x7fe080061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fe09c13b060 tx=0x7fe098017000).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 msgr2=0x7fe09c0a77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fe08c00c4c0 tx=0x7fe08c007e00).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 shutdown_connections 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe08005f080 0x7fe080061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c13ac10 0x7fe09c152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe09c0695b0 0x7fe09c0a77f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 --2- 172.21.15.133:0/473638309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c13a830 0x7fe09c0a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 >> 172.21.15.133:0/473638309 conn(0x7fe09c0c7dc0 msgr2=0x7fe09c0ad6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 shutdown_connections 2024-01-21T20:14:35.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.071+0000 7fe0a3493700 1 -- 172.21.15.133:0/473638309 wait complete. 2024-01-21T20:14:35.076 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:14:35.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:35.136 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:35.178 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:14:35.178 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:14:35.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:14:35.179 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:35.198 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:35.209+0000 7fa0df803680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:35.205 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:35.214+0000 7f9aa0835680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:35.220 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:14:35.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:35.221 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:14:35.264 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:35.275+0000 7fa0df803680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:35.270 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:35.280+0000 7f9aa0835680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:35.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.446+0000 7fde10a6b700 1 Processor -- start 2024-01-21T20:14:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.446+0000 7fde10a6b700 1 -- start start 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde10a6b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 0x7fde0c156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde10a6b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 0x7fde0c0be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde10a6b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c156650 con 0x7fde0c1351d0 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde10a6b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0c61a0 con 0x7fde0c155cb0 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde10a6b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c5350 con 0x7fde0c0bde60 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde0c1351d0 0x7fde0c0c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52102/0 (socket says 172.21.15.133:52102) 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0a59c700 1 -- 172.21.15.133:0/3584092298 learned_addr learned my addr 172.21.15.133:0/3584092298 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde09d9b700 1 --2- 172.21.15.133:0/3584092298 >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 0x7fde0c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/3584092298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 0x7fde0c0be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0959a700 1 -- 172.21.15.133:0/3584092298 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139214288 0 0) 0x7fddfc001110 con 0x7fde0c1351d0 2024-01-21T20:14:35.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0959a700 1 -- 172.21.15.133:0/3584092298 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf40033f0 con 0x7fde0c1351d0 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 -- 172.21.15.133:0/3584092298 >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 msgr2=0x7fde0c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/3584092298 >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 0x7fde0c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 -- 172.21.15.133:0/3584092298 >> v1:172.21.15.133:6789/0 conn(0x7fde0c1351d0 legacy=0x7fde0c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 -- 172.21.15.133:0/3584092298 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0c55d0 con 0x7fde0c0bde60 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde09d9b700 1 --2- 172.21.15.133:0/3584092298 >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 0x7fde0c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.448+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/3584092298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 0x7fde0c0be2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fde04009e60 tx=0x7fde04009780).ready entity=mon.2 client_cookie=47147cef87dbfb3d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde0959a700 1 -- 172.21.15.133:0/3584092298 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400e070 con 0x7fde0c0bde60 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde0959a700 1 -- 172.21.15.133:0/3584092298 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400bab0 con 0x7fde0c0bde60 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde0959a700 1 -- 172.21.15.133:0/3584092298 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400be30 con 0x7fde0c0bde60 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 -- 172.21.15.133:0/3584092298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 msgr2=0x7fde0c0be2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 --2- 172.21.15.133:0/3584092298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 0x7fde0c0be2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fde04009e60 tx=0x7fde04009780).stop 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 -- 172.21.15.133:0/3584092298 shutdown_connections 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 --2- 172.21.15.133:0/3584092298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c0bde60 0x7fde0c0be2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 --2- 172.21.15.133:0/3584092298 >> v2:172.21.15.178:3300/0 conn(0x7fde0c155cb0 0x7fde0c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 -- 172.21.15.133:0/3584092298 >> 172.21.15.133:0/3584092298 conn(0x7fde0c066a90 msgr2=0x7fde0c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:35.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 -- 172.21.15.133:0/3584092298 shutdown_connections 2024-01-21T20:14:35.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.449+0000 7fde10a6b700 1 -- 172.21.15.133:0/3584092298 wait complete. 2024-01-21T20:14:35.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 Processor -- start 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 -- start start 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde0c0bde60 0x7fde0c167230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 0x7fde0c0a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c7100 con 0x7fde0c155cb0 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c6db0 con 0x7fde0c0bde60 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.451+0000 7fde10a6b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0651f0 con 0x7fde0c1351d0 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde09d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 0x7fde0c0a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32928/0 (socket says 172.21.15.133:32928) 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0a59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde0c0bde60 0x7fde0c167230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 -- 172.21.15.133:0/2829932030 learned_addr learned my addr 172.21.15.133:0/2829932030 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 msgr2=0x7fde0c0a7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 0x7fde0c0a7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde0c0bde60 msgr2=0x7fde0c167230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde0c0bde60 0x7fde0c167230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 -- 172.21.15.133:0/2829932030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde000092a0 con 0x7fde0c155cb0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde09d9b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 0x7fde0c0a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde0ad9d700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fde0400b610 tx=0x7fde04009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04013e90 con 0x7fde0c155cb0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0401d630 con 0x7fde0c155cb0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde04009a20 con 0x7fde0c155cb0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0401d9f0 con 0x7fde0c155cb0 2024-01-21T20:14:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.452+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0c8350 con 0x7fde0c155cb0 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.454+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fde04003040 con 0x7fde0c155cb0 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.454+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0c7270 con 0x7fde0c155cb0 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.455+0000 7fddfaffd700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 0x7fddec0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.455+0000 7fde0a59c700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 msgr2=0x7fddec0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.455+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fde0407c590 con 0x7fde0c155cb0 2024-01-21T20:14:35.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.455+0000 7fde0a59c700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 0x7fddec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:35.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.459+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde04050bd0 con 0x7fde0c155cb0 2024-01-21T20:14:35.539 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:35.550+0000 7fa0df803680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:35.558 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:35.568+0000 7f9aa0835680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:35.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.656+0000 7fde0a59c700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 msgr2=0x7fddec0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:35.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.656+0000 7fde0a59c700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 0x7fddec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.674+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0c05fdf0 con 0x7fde0c155cb0 2024-01-21T20:14:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.674+0000 7fddfaffd700 1 -- 172.21.15.133:0/2829932030 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7fde040507c0 con 0x7fde0c155cb0 2024-01-21T20:14:35.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:35.665 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 msgr2=0x7fddec0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 0x7fddec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 msgr2=0x7fde0c0accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fde0400b610 tx=0x7fde04009780).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 shutdown_connections 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddec05f300 0x7fddec0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde0c155cb0 0x7fde0c0accf0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde0c0bde60 0x7fde0c167230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 --2- 172.21.15.133:0/2829932030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde0c1351d0 0x7fde0c0a7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 >> 172.21.15.133:0/2829932030 conn(0x7fde0c066a90 msgr2=0x7fde0c133d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 shutdown_connections 2024-01-21T20:14:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.676+0000 7fde10a6b700 1 -- 172.21.15.133:0/2829932030 wait complete. 2024-01-21T20:14:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:35.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:35.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.806+0000 7fb804a71700 1 Processor -- start 2024-01-21T20:14:35.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.806+0000 7fb804a71700 1 -- start start 2024-01-21T20:14:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb804a71700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 0x7fb800067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb804a71700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb8000c5930 0x7fb8000c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb804a71700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000c62d0 con 0x7fb800137410 2024-01-21T20:14:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb804a71700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb800068370 con 0x7fb8000c5930 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb804a71700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb800068650 con 0x7fb800137030 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fdd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb800137410 0x7fb800155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52112/0 (socket says 172.21.15.133:52112) 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fdd9b700 1 -- 172.21.15.133:0/2189080409 learned_addr learned my addr 172.21.15.133:0/2189080409 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fed9d700 1 --2- 172.21.15.133:0/2189080409 >> v2:172.21.15.178:3300/0 conn(0x7fb8000c5930 0x7fb8000c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fe59c700 1 --2- 172.21.15.133:0/2189080409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 0x7fb800067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fd59a700 1 -- 172.21.15.133:0/2189080409 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216446151 0 0) 0x7fb7f4001110 con 0x7fb800137410 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.807+0000 7fb7fd59a700 1 -- 172.21.15.133:0/2189080409 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e80033f0 con 0x7fb800137410 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fe59c700 1 -- 172.21.15.133:0/2189080409 >> v2:172.21.15.178:3300/0 conn(0x7fb8000c5930 msgr2=0x7fb8000c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fe59c700 1 --2- 172.21.15.133:0/2189080409 >> v2:172.21.15.178:3300/0 conn(0x7fb8000c5930 0x7fb8000c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fe59c700 1 -- 172.21.15.133:0/2189080409 >> v1:172.21.15.133:6789/0 conn(0x7fb800137410 legacy=0x7fb800155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fe59c700 1 -- 172.21.15.133:0/2189080409 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800068930 con 0x7fb800137030 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fe59c700 1 --2- 172.21.15.133:0/2189080409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 0x7fb800067d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb7f0009760 tx=0x7fb7f0009060).ready entity=mon.2 client_cookie=50f83f12700a0c80 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fd59a700 1 -- 172.21.15.133:0/2189080409 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00090d0 con 0x7fb800137030 2024-01-21T20:14:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fd59a700 1 -- 172.21.15.133:0/2189080409 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000d4a0 con 0x7fb800137030 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb7fd59a700 1 -- 172.21.15.133:0/2189080409 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000d820 con 0x7fb800137030 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 -- 172.21.15.133:0/2189080409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 msgr2=0x7fb800067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 --2- 172.21.15.133:0/2189080409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 0x7fb800067d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb7f0009760 tx=0x7fb7f0009060).stop 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 -- 172.21.15.133:0/2189080409 shutdown_connections 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 --2- 172.21.15.133:0/2189080409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb800137030 0x7fb800067d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 --2- 172.21.15.133:0/2189080409 >> v2:172.21.15.178:3300/0 conn(0x7fb8000c5930 0x7fb8000c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.808+0000 7fb804a71700 1 -- 172.21.15.133:0/2189080409 >> 172.21.15.133:0/2189080409 conn(0x7fb800066a90 msgr2=0x7fb800066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.809+0000 7fb804a71700 1 -- 172.21.15.133:0/2189080409 shutdown_connections 2024-01-21T20:14:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.809+0000 7fb804a71700 1 -- 172.21.15.133:0/2189080409 wait complete. 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.810+0000 7fb804a71700 1 Processor -- start 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.810+0000 7fb804a71700 1 -- start start 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8000c5930 0x7fb8000c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb800137410 0x7fb800157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800168770 con 0x7fb800137030 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800167ba0 con 0x7fb800137410 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb800167e40 con 0x7fb8000c5930 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32938/0 (socket says 172.21.15.133:32938) 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 -- 172.21.15.133:0/900225764 learned_addr learned my addr 172.21.15.133:0/900225764 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fe59c700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8000c5930 0x7fb8000c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fed9d700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb800137410 0x7fb800157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 -- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8000c5930 msgr2=0x7fb8000c04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8000c5930 0x7fb8000c04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 -- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb800137410 msgr2=0x7fb800157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb800137410 0x7fb800157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 -- 172.21.15.133:0/900225764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00092a0 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7fdd9b700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fb7f400c4a0 tx=0x7fb7f4007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40070d0 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4007230 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb800168120 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40075f0 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.811+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb800158310 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb7f40059b0 con 0x7fb800137030 2024-01-21T20:14:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8001688b0 con 0x7fb800137030 2024-01-21T20:14:35.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb7eeffd700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 0x7fb7e00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:35.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb7fe59c700 1 -- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 msgr2=0x7fb7e00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:35.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fb7f4079b90 con 0x7fb800137030 2024-01-21T20:14:35.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.813+0000 7fb7fe59c700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 0x7fb7e00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:35.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:35.817+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb8001688b0 con 0x7fb800137030 2024-01-21T20:14:35.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.002+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8001688b0 con 0x7fb800137030 2024-01-21T20:14:35.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.003+0000 7fb7eeffd700 1 -- 172.21.15.133:0/900225764 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18108 (secure 0 0 0) 0x7fb8001688b0 con 0x7fb800137030 2024-01-21T20:14:35.996 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:35.996 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":80,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:32.728583+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/766800863":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6833/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6832/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:0/1458407255":"2024-01-22T20:14:32.728543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 msgr2=0x7fb7e00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 0x7fb7e00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 msgr2=0x7fb800135c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fb7f400c4a0 tx=0x7fb7f4007a90).stop 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 shutdown_connections 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb7e005f300 0x7fb7e00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb800137410 0x7fb800157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8000c5930 0x7fb8000c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 --2- 172.21.15.133:0/900225764 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb800137030 0x7fb800135c30 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:35.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.005+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 >> 172.21.15.133:0/900225764 conn(0x7fb800066a90 msgr2=0x7fb800066e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:35.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.006+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 shutdown_connections 2024-01-21T20:14:35.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.006+0000 7fb804a71700 1 -- 172.21.15.133:0/900225764 wait complete. 2024-01-21T20:14:36.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '70', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:14:19.214897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:14:20.411417+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:14:36.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:14:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.144+0000 7ff9784fe700 1 Processor -- start 2024-01-21T20:14:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.144+0000 7ff9784fe700 1 -- start start 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff9784fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff970158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff9784fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700c0e40 con 0x7ff970154140 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff9784fe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff970154980 con 0x7ff970154520 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff9784fe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700c6ae0 con 0x7ff9700c8120 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff97629a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff970154140 0x7ff9700c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52116/0 (socket says 172.21.15.133:52116) 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff97629a700 1 -- 172.21.15.133:0/3910499448 learned_addr learned my addr 172.21.15.133:0/3910499448 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975a99700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff970158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27325913 0 0) 0x7ff9700c0e40 con 0x7ff970154140 2024-01-21T20:14:36.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff95c0033f0 con 0x7ff970154140 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433949146 0 0) 0x7ff970154980 con 0x7ff970154520 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9700c0e40 con 0x7ff970154520 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060117614 0 0) 0x7ff95c0033f0 con 0x7ff970154140 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 msgr2=0x7ff970158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff970158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 >> v1:172.21.15.178:6789/0 conn(0x7ff970154520 legacy=0x7ff9700c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700c6800 con 0x7ff970154140 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff96c001470 con 0x7ff970154140 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 >> v1:172.21.15.133:6789/0 conn(0x7ff970154140 legacy=0x7ff9700c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff95c003aa0 0x7ff95c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff95c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff95c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700c6ae0 con 0x7ff95c004690 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00b940 con 0x7ff95c003aa0 2024-01-21T20:14:36.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.145+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95c00bb00 con 0x7ff9700c8120 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff95c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff97629a700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff95c003aa0 0x7ff95c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff976a9b700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff95c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 -- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 msgr2=0x7ff95c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9700c8120 0x7ff95c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 -- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff95c003aa0 msgr2=0x7ff95c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff95c003aa0 0x7ff95c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 -- 172.21.15.133:0/3910499448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c0033f0 con 0x7ff95c004690 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975a99700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff95c004b10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7ff960009a80 tx=0x7ff960009060).ready entity=mon.0 client_cookie=b875d5189e1decfb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960009430 con 0x7ff95c004690 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000e640 con 0x7ff95c004690 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.146+0000 7ff975298700 1 -- 172.21.15.133:0/3910499448 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000e9c0 con 0x7ff95c004690 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 -- 172.21.15.133:0/3910499448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 msgr2=0x7ff95c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 --2- 172.21.15.133:0/3910499448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff95c004b10 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7ff960009a80 tx=0x7ff960009060).stop 2024-01-21T20:14:36.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff976a9b700 1 -- 172.21.15.133:0/3910499448 reap_dead start 2024-01-21T20:14:36.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 -- 172.21.15.133:0/3910499448 shutdown_connections 2024-01-21T20:14:36.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 -- 172.21.15.133:0/3910499448 >> 172.21.15.133:0/3910499448 conn(0x7ff97005e1e0 msgr2=0x7ff97005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 -- 172.21.15.133:0/3910499448 shutdown_connections 2024-01-21T20:14:36.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.147+0000 7ff9784fe700 1 -- 172.21.15.133:0/3910499448 wait complete. 2024-01-21T20:14:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.148+0000 7ff9784fe700 1 Processor -- start 2024-01-21T20:14:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.148+0000 7ff9784fe700 1 -- start start 2024-01-21T20:14:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9700c9080 0x7ff9701641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9701646d0 0x7ff970167fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700aff80 con 0x7ff95c004690 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff970168e10 con 0x7ff9700c9080 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff9784fe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700af370 con 0x7ff9701646d0 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32956/0 (socket says 172.21.15.133:32956) 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 -- 172.21.15.133:0/81348926 learned_addr learned my addr 172.21.15.133:0/81348926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff975a99700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9700c9080 0x7ff9701641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff976a9b700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9701646d0 0x7ff970167fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9701646d0 msgr2=0x7ff970167fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9701646d0 0x7ff970167fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9700c9080 msgr2=0x7ff9701641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9700c9080 0x7ff9701641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 -- 172.21.15.133:0/81348926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700af650 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.149+0000 7ff97629a700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7ff96c004a10 tx=0x7ff96c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.150+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011590 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.150+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96c0116f0 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.150+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9700af930 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.150+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96c011a70 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.150+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700af040 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9700c5f80 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff96c01d3b0 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff966ffd700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 0x7ff9540617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff975a99700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 msgr2=0x7ff9540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7ff96c079fa0 con 0x7ff95c004690 2024-01-21T20:14:36.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.151+0000 7ff975a99700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 0x7ff9540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:36.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.155+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff96c04add0 con 0x7ff95c004690 2024-01-21T20:14:36.152 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:36.163+0000 7fa0df803680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:36.216 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:36.226+0000 7f9aa0835680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:14:36.224 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:36.234+0000 7fa0df803680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:36.290 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:36.299+0000 7f9aa0835680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:14:36.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.352+0000 7ff975a99700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 msgr2=0x7ff9540617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:36.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.352+0000 7ff975a99700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 0x7ff9540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:36.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.360+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff9700afdd0 con 0x7ff95c004690 2024-01-21T20:14:36.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.361+0000 7ff966ffd700 1 -- 172.21.15.133:0/81348926 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff96c019030 con 0x7ff95c004690 2024-01-21T20:14:36.351 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 msgr2=0x7ff9540617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 0x7ff9540617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 msgr2=0x7ff9700b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7ff96c004a10 tx=0x7ff96c001e10).stop 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 shutdown_connections 2024-01-21T20:14:36.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff95405f300 0x7ff9540617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9701646d0 0x7ff970167fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff95c004690 0x7ff9700b0410 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 --2- 172.21.15.133:0/81348926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9700c9080 0x7ff9701641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 >> 172.21.15.133:0/81348926 conn(0x7ff97005e1e0 msgr2=0x7ff9700c3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 shutdown_connections 2024-01-21T20:14:36.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.363+0000 7ff9784fe700 1 -- 172.21.15.133:0/81348926 wait complete. 2024-01-21T20:14:36.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:14:36.410 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:36.421+0000 7fa0df803680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:36.486 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:36.496+0000 7f9aa0835680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:14:36.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.497+0000 7f87354b8700 1 Processor -- start 2024-01-21T20:14:36.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.497+0000 7f87354b8700 1 -- start start 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.498+0000 7f87354b8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8730154140 0x7f8730158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.498+0000 7f87354b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 0x7f87300ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.498+0000 7f87354b8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87300ab620 con 0x7f8730154520 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.498+0000 7f87354b8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300c6ae0 con 0x7f8730154140 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.498+0000 7f87354b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87300c05e0 con 0x7f87300c8120 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8730154140 0x7f8730158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 0x7f87300ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8730154140 0x7f8730158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57674/0 (socket says 172.21.15.133:57674) 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 -- 172.21.15.133:0/2710293817 learned_addr learned my addr 172.21.15.133:0/2710293817 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872e7fc700 1 --1- 172.21.15.133:0/2710293817 >> v1:172.21.15.178:6789/0 conn(0x7f8730154520 0x7f87300c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:46236/0 (socket says 172.21.15.133:46236) 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 -- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 msgr2=0x7f87300ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:36.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 0x7f87300ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 -- 172.21.15.133:0/2710293817 >> v1:172.21.15.178:6789/0 conn(0x7f8730154520 legacy=0x7f87300c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 -- 172.21.15.133:0/2710293817 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87300c0e40 con 0x7f8730154140 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872f7fe700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 0x7f87300ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872effd700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f8730158bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8720006fd0 tx=0x7f87200090f0).ready entity=mon.1 client_cookie=8ccc8ae15e33e5a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872dffb700 1 -- 172.21.15.133:0/2710293817 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000b580 con 0x7f8730154140 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872dffb700 1 -- 172.21.15.133:0/2710293817 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000b6e0 con 0x7f8730154140 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.499+0000 7f872dffb700 1 -- 172.21.15.133:0/2710293817 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000ba60 con 0x7f8730154140 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 -- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 msgr2=0x7f8730158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f8730158bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f8720006fd0 tx=0x7f87200090f0).stop 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 -- 172.21.15.133:0/2710293817 shutdown_connections 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f8730158bb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 --2- 172.21.15.133:0/2710293817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87300c8120 0x7f87300ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 -- 172.21.15.133:0/2710293817 >> 172.21.15.133:0/2710293817 conn(0x7f873005e1e0 msgr2=0x7f873005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 -- 172.21.15.133:0/2710293817 shutdown_connections 2024-01-21T20:14:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.500+0000 7f87354b8700 1 -- 172.21.15.133:0/2710293817 wait complete. 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.502+0000 7f87354b8700 1 Processor -- start 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.502+0000 7f87354b8700 1 -- start start 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f87300af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8730154520 0x7f87300ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873013f300 con 0x7f87300c8120 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730165570 con 0x7f8730154140 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87354b8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8730164960 con 0x7f8730154520 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32962/0 (socket says 172.21.15.133:32962) 2024-01-21T20:14:36.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 -- 172.21.15.133:0/562146574 learned_addr learned my addr 172.21.15.133:0/562146574 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872e7fc700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f87300af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872f7fe700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8730154520 0x7f87300ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 -- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8730154520 msgr2=0x7f87300ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8730154520 0x7f87300ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 -- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 msgr2=0x7f87300af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f87300af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 -- 172.21.15.133:0/562146574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728009a20 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f872effd700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f8720009fd0 tx=0x7f8720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.503+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720000bc0 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.504+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000b850 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.504+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8720009370 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.504+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8720000d20 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.504+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8730164f20 con 0x7f87300c8120 2024-01-21T20:14:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8730158e60 con 0x7f87300c8120 2024-01-21T20:14:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f872001c8c0 con 0x7f87300c8120 2024-01-21T20:14:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f87177fe700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 0x7f871c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f872e7fc700 1 -- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 msgr2=0x7f871c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f872007c520 con 0x7f87300c8120 2024-01-21T20:14:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.505+0000 7f872e7fc700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 0x7f871c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:36.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.509+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f872004d200 con 0x7f87300c8120 2024-01-21T20:14:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.678+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87300aa980 con 0x7f87300c8120 2024-01-21T20:14:36.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.678+0000 7f87177fe700 1 -- 172.21.15.133:0/562146574 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f872002a030 con 0x7f87300c8120 2024-01-21T20:14:36.669 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:14:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 msgr2=0x7f871c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 0x7f871c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 msgr2=0x7f873013ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f8720009fd0 tx=0x7f8720017000).stop 2024-01-21T20:14:36.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 shutdown_connections 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f871c05f300 0x7f871c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8730154520 0x7f87300ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87300c8120 0x7f873013ee10 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 --2- 172.21.15.133:0/562146574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8730154140 0x7f87300af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 >> 172.21.15.133:0/562146574 conn(0x7f873005e1e0 msgr2=0x7f87300c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 shutdown_connections 2024-01-21T20:14:36.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.680+0000 7f87354b8700 1 -- 172.21.15.133:0/562146574 wait complete. 2024-01-21T20:14:36.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:14:36.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.815+0000 7facce6e9700 1 Processor -- start 2024-01-21T20:14:36.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.815+0000 7facce6e9700 1 -- start start 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.816+0000 7facce6e9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 0x7facc8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facce6e9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 0x7facc80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facce6e9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80ab620 con 0x7facc80c6090 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facce6e9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80c6ae0 con 0x7facc8154520 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facce6e9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80c05e0 con 0x7facc8154140 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facccc86700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7facc80c6090 0x7facc80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52124/0 (socket says 172.21.15.133:52124) 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facccc86700 1 -- 172.21.15.133:0/3854794044 learned_addr learned my addr 172.21.15.133:0/3854794044 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facbffff700 1 --2- 172.21.15.133:0/3854794044 >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 0x7facc80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 --2- 172.21.15.133:0/3854794044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 0x7facc8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc77fe700 1 -- 172.21.15.133:0/3854794044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725328063 0 0) 0x7facc80ab620 con 0x7facc80c6090 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc77fe700 1 -- 172.21.15.133:0/3854794044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb40033f0 con 0x7facc80c6090 2024-01-21T20:14:36.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 -- 172.21.15.133:0/3854794044 >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 msgr2=0x7facc80ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 --2- 172.21.15.133:0/3854794044 >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 0x7facc80ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 -- 172.21.15.133:0/3854794044 >> v1:172.21.15.133:6789/0 conn(0x7facc80c6090 legacy=0x7facc80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 -- 172.21.15.133:0/3854794044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80c0e40 con 0x7facc8154140 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facbffff700 1 --2- 172.21.15.133:0/3854794044 >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 0x7facc80ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc7fff700 1 --2- 172.21.15.133:0/3854794044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 0x7facc8158bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7facb8009760 tx=0x7facb8009060).ready entity=mon.2 client_cookie=7064fe392b4a6302 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc77fe700 1 -- 172.21.15.133:0/3854794044 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800d4a0 con 0x7facc8154140 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.817+0000 7facc77fe700 1 -- 172.21.15.133:0/3854794044 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb800d600 con 0x7facc8154140 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facc77fe700 1 -- 172.21.15.133:0/3854794044 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800d980 con 0x7facc8154140 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 -- 172.21.15.133:0/3854794044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 msgr2=0x7facc8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 --2- 172.21.15.133:0/3854794044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 0x7facc8158bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7facb8009760 tx=0x7facb8009060).stop 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 -- 172.21.15.133:0/3854794044 shutdown_connections 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 --2- 172.21.15.133:0/3854794044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154140 0x7facc8158bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 --2- 172.21.15.133:0/3854794044 >> v2:172.21.15.178:3300/0 conn(0x7facc8154520 0x7facc80ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 -- 172.21.15.133:0/3854794044 >> 172.21.15.133:0/3854794044 conn(0x7facc805e1e0 msgr2=0x7facc805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 -- 172.21.15.133:0/3854794044 shutdown_connections 2024-01-21T20:14:36.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.818+0000 7facce6e9700 1 -- 172.21.15.133:0/3854794044 wait complete. 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.819+0000 7facce6e9700 1 Processor -- start 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.819+0000 7facce6e9700 1 -- start start 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc80c6090 0x7facc814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154520 0x7facc815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc815a7a0 con 0x7facc8154140 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80caa70 con 0x7facc80c6090 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facce6e9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80af480 con 0x7facc8154520 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32974/0 (socket says 172.21.15.133:32974) 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facbffff700 1 -- 172.21.15.133:0/3381222904 learned_addr learned my addr 172.21.15.133:0/3381222904 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:36.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facccc86700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154520 0x7facc815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.820+0000 7facc7fff700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc80c6090 0x7facc814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 -- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154520 msgr2=0x7facc815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154520 0x7facc815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 -- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc80c6090 msgr2=0x7facc814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc80c6090 0x7facc814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 -- 172.21.15.133:0/3381222904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00092a0 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facbffff700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7facb000e930 tx=0x7facb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0012600 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0012760 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb80092a0 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0012ae0 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.821+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc80afa40 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.822+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc805fdf0 con 0x7facc8154140 2024-01-21T20:14:36.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.823+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7facb001b400 con 0x7facc8154140 2024-01-21T20:14:36.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.823+0000 7facc57fa700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 0x7faca80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:36.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.823+0000 7facc7fff700 1 -- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 msgr2=0x7faca80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:36.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.823+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7facb007abb0 con 0x7facc8154140 2024-01-21T20:14:36.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.823+0000 7facc7fff700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 0x7faca80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:36.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.827+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7facb0081080 con 0x7facc8154140 2024-01-21T20:14:36.843 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:36.854+0000 7fa0df803680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:36.925 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:36.935+0000 7f9aa0835680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:14:36.945 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:36.956+0000 7fa0df803680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:36.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.996+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facc80c00f0 con 0x7facc8154140 2024-01-21T20:14:36.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.996+0000 7facc57fa700 1 -- 172.21.15.133:0/3381222904 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7facb00160a0 con 0x7facc8154140 2024-01-21T20:14:36.987 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:14:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 msgr2=0x7faca80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 0x7faca80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 msgr2=0x7facc8159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7facb000e930 tx=0x7facb0009060).stop 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 shutdown_connections 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faca805f300 0x7faca80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facc8154520 0x7facc815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facc80c6090 0x7facc814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 --2- 172.21.15.133:0/3381222904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facc8154140 0x7facc8159dc0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.998+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 >> 172.21.15.133:0/3381222904 conn(0x7facc805e1e0 msgr2=0x7facc80c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.999+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 shutdown_connections 2024-01-21T20:14:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:36.999+0000 7facce6e9700 1 -- 172.21.15.133:0/3381222904 wait complete. 2024-01-21T20:14:37.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:14:37.033 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.043+0000 7f9aa0835680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:37.100 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:37.110+0000 7fa0df803680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:37.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.136+0000 7f6057712700 1 Processor -- start 2024-01-21T20:14:37.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.136+0000 7f6057712700 1 -- start start 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.137+0000 7f6057712700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500c2b00 0x7f6050065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.137+0000 7f6057712700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60500bd360 0x7f6050154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6057712700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60501511f0 con 0x7f60500a9e30 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6057712700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6050065b20 con 0x7f60500bd360 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6057712700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60500c2240 con 0x7f60500c2b00 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60500bd360 0x7f6050154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f60554ae700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60500a9e30 0x7f60500bcc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52126/0 (socket says 172.21.15.133:52126) 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f60554ae700 1 -- 172.21.15.133:0/719511478 learned_addr learned my addr 172.21.15.133:0/719511478 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6054cad700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500c2b00 0x7f6050065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 -- 172.21.15.133:0/719511478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500c2b00 msgr2=0x7f6050065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500c2b00 0x7f6050065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 -- 172.21.15.133:0/719511478 >> v1:172.21.15.133:6789/0 conn(0x7f60500a9e30 legacy=0x7f60500bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6047fff700 1 -- 172.21.15.133:0/719511478 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899142249 0 0) 0x7f604c001110 con 0x7f60500a9e30 2024-01-21T20:14:37.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 -- 172.21.15.133:0/719511478 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500c2f60 con 0x7f60500bd360 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6055caf700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f6050154870 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f6048009e60 tx=0x7f6048009780).ready entity=mon.0 client_cookie=de68807343f3b083 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6047fff700 1 -- 172.21.15.133:0/719511478 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800e070 con 0x7f60500bd360 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6047fff700 1 -- 172.21.15.133:0/719511478 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800bb60 con 0x7f60500bd360 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.138+0000 7f6047fff700 1 -- 172.21.15.133:0/719511478 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048012410 con 0x7f60500bd360 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 -- 172.21.15.133:0/719511478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 msgr2=0x7f6050154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f6050154870 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f6048009e60 tx=0x7f6048009780).stop 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 -- 172.21.15.133:0/719511478 shutdown_connections 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f6050154870 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 --2- 172.21.15.133:0/719511478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500c2b00 0x7f6050065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 -- 172.21.15.133:0/719511478 >> 172.21.15.133:0/719511478 conn(0x7f60500c8200 msgr2=0x7f60500c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 -- 172.21.15.133:0/719511478 shutdown_connections 2024-01-21T20:14:37.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.139+0000 7f6057712700 1 -- 172.21.15.133:0/719511478 wait complete. 2024-01-21T20:14:37.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.141+0000 7f6057712700 1 Processor -- start 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.141+0000 7f6057712700 1 -- start start 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500a9e30 0x7f6050142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500c2b00 0x7f6050142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050144100 con 0x7f60500bd360 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050143200 con 0x7f60500c2b00 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6057712700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60501434e0 con 0x7f60500a9e30 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32988/0 (socket says 172.21.15.133:32988) 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 -- 172.21.15.133:0/1863967086 learned_addr learned my addr 172.21.15.133:0/1863967086 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6055caf700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500c2b00 0x7f6050142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f60554ae700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500a9e30 0x7f6050142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 -- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500a9e30 msgr2=0x7f6050142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500a9e30 0x7f6050142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 -- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500c2b00 msgr2=0x7f6050142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500c2b00 0x7f6050142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 -- 172.21.15.133:0/1863967086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048009a20 con 0x7f60500bd360 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6054cad700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f604000e900 tx=0x7f6040009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.142+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040012600 con 0x7f60500bd360 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.143+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040012760 con 0x7f60500bd360 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.143+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60501437c0 con 0x7f60500bd360 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.143+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040012ae0 con 0x7f60500bd360 2024-01-21T20:14:37.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.143+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500c0100 con 0x7f60500bd360 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f604001b400 con 0x7f60500bd360 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605005fdf0 con 0x7f60500bd360 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f6045ffb700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 0x7f60340617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f60554ae700 1 -- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 msgr2=0x7f60340617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f604007aaa0 con 0x7f60500bd360 2024-01-21T20:14:37.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.144+0000 7f60554ae700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 0x7f60340617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:37.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.149+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f604004b820 con 0x7f60500bd360 2024-01-21T20:14:37.176 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:37.186+0000 7fa0df803680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:37.202 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.211+0000 7f9aa0835680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:37.242 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:37.253+0000 7fa0df803680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:37.277 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.287+0000 7f9aa0835680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:14:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.324+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6050145810 con 0x7f60500bd360 2024-01-21T20:14:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.324+0000 7f6045ffb700 1 -- 172.21.15.133:0/1863967086 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6040016020 con 0x7f60500bd360 2024-01-21T20:14:37.315 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:14:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 msgr2=0x7f60340617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 0x7f60340617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 msgr2=0x7f60500bfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f604000e900 tx=0x7f6040009060).stop 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 shutdown_connections 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f603405f300 0x7f60340617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60500c2b00 0x7f6050142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.326+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60500a9e30 0x7f6050142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.327+0000 7f6057712700 1 --2- 172.21.15.133:0/1863967086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60500bd360 0x7f60500bfc10 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.327+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 >> 172.21.15.133:0/1863967086 conn(0x7f60500c8200 msgr2=0x7f60500c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.327+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 shutdown_connections 2024-01-21T20:14:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.327+0000 7f6057712700 1 -- 172.21.15.133:0/1863967086 wait complete. 2024-01-21T20:14:37.329 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:37.348 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.358+0000 7f9aa0835680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:14:37.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.476+0000 7f4a4072e700 1 Processor -- start 2024-01-21T20:14:37.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.476+0000 7f4a4072e700 1 -- start start 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a4072e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a380c8120 0x7f4a38158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a4072e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a38154520 0x7f4a380ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a4072e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a380ab620 con 0x7f4a38154140 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a4072e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a380c6ae0 con 0x7f4a38154520 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a4072e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a380c05e0 con 0x7f4a380c8120 2024-01-21T20:14:37.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a38154520 0x7f4a380ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a38154520 0x7f4a380ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32996/0 (socket says 172.21.15.133:32996) 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 -- 172.21.15.133:0/1987928573 learned_addr learned my addr 172.21.15.133:0/1987928573 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3dcc9700 1 --2- 172.21.15.133:0/1987928573 >> v2:172.21.15.178:3300/0 conn(0x7f4a380c8120 0x7f4a38158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 -- 172.21.15.133:0/1987928573 >> v2:172.21.15.178:3300/0 conn(0x7f4a380c8120 msgr2=0x7f4a38158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 --2- 172.21.15.133:0/1987928573 >> v2:172.21.15.178:3300/0 conn(0x7f4a380c8120 0x7f4a38158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 -- 172.21.15.133:0/1987928573 >> v1:172.21.15.178:6789/0 conn(0x7f4a38154140 legacy=0x7f4a380c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.477+0000 7f4a3eccb700 1 -- 172.21.15.133:0/1987928573 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380c0e40 con 0x7f4a38154520 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a3eccb700 1 --2- 172.21.15.133:0/1987928573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154520 0x7f4a380ab130 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f4a38062cc0 tx=0x7f4a30009840).ready entity=mon.0 client_cookie=5f162f13d683469 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a3d4c8700 1 -- 172.21.15.133:0/1987928573 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000e070 con 0x7f4a38154520 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a3d4c8700 1 -- 172.21.15.133:0/1987928573 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000ba20 con 0x7f4a38154520 2024-01-21T20:14:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a3d4c8700 1 -- 172.21.15.133:0/1987928573 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3000bda0 con 0x7f4a38154520 2024-01-21T20:14:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 -- 172.21.15.133:0/1987928573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154520 msgr2=0x7f4a380ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1987928573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154520 0x7f4a380ab130 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f4a38062cc0 tx=0x7f4a30009840).stop 2024-01-21T20:14:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 -- 172.21.15.133:0/1987928573 shutdown_connections 2024-01-21T20:14:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1987928573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154520 0x7f4a380ab130 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1987928573 >> v2:172.21.15.178:3300/0 conn(0x7f4a380c8120 0x7f4a38158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 -- 172.21.15.133:0/1987928573 >> 172.21.15.133:0/1987928573 conn(0x7f4a3805e1e0 msgr2=0x7f4a3805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 -- 172.21.15.133:0/1987928573 shutdown_connections 2024-01-21T20:14:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.478+0000 7f4a4072e700 1 -- 172.21.15.133:0/1987928573 wait complete. 2024-01-21T20:14:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 Processor -- start 2024-01-21T20:14:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 -- start start 2024-01-21T20:14:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a380c8120 0x7f4a380cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a38154520 0x7f4a380c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380ae880 con 0x7f4a38154140 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380aeb60 con 0x7f4a380c8120 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a4072e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380aee40 con 0x7f4a38154520 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a3dcc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a3dcc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33006/0 (socket says 172.21.15.133:33006) 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.480+0000 7f4a3dcc9700 1 -- 172.21.15.133:0/1364858282 learned_addr learned my addr 172.21.15.133:0/1364858282 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3e4ca700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a380c8120 0x7f4a380cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3eccb700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a38154520 0x7f4a380c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a38154520 msgr2=0x7f4a380c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a38154520 0x7f4a380c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a380c8120 msgr2=0x7f4a380cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a380c8120 0x7f4a380cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 -- 172.21.15.133:0/1364858282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30009ae0 con 0x7f4a38154140 2024-01-21T20:14:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a3dcc9700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f4a2800e950 tx=0x7f4a28009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28012600 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28012760 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28012ae0 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a380af120 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.481+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a380c2810 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.482+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3805fdf0 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.483+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f4a2801b400 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.483+0000 7f4a2effd700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 0x7f4a1c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.483+0000 7f4a3e4ca700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 msgr2=0x7f4a1c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.483+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f4a2807ac50 con 0x7f4a38154140 2024-01-21T20:14:37.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.483+0000 7f4a3e4ca700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 0x7f4a1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:37.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.487+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4a2804ba30 con 0x7f4a38154140 2024-01-21T20:14:37.501 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:37.512+0000 7fa0df803680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:37.618 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.628+0000 7f9aa0835680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:14:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.684+0000 7f4a3e4ca700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 msgr2=0x7f4a1c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.684+0000 7f4a3e4ca700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 0x7f4a1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:37.683 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:37.694+0000 7fa0df803680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:37.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.700+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a380c8690 con 0x7f4a38154140 2024-01-21T20:14:37.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.701+0000 7f4a2effd700 1 -- 172.21.15.133:0/1364858282 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f4a28016090 con 0x7f4a38154140 2024-01-21T20:14:37.691 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:37.691 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 msgr2=0x7f4a1c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 0x7f4a1c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 msgr2=0x7f4a380ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f4a2800e950 tx=0x7f4a28009060).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 shutdown_connections 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4a1c05f300 0x7f4a1c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a38154520 0x7f4a380c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a380c8120 0x7f4a380cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 --2- 172.21.15.133:0/1364858282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a38154140 0x7f4a380ae070 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 >> 172.21.15.133:0/1364858282 conn(0x7f4a3805e1e0 msgr2=0x7f4a380aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 shutdown_connections 2024-01-21T20:14:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.703+0000 7f4a4072e700 1 -- 172.21.15.133:0/1364858282 wait complete. 2024-01-21T20:14:37.695 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:37.706 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:37.807 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:37.817+0000 7f9aa0835680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:14:37.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.834+0000 7fdf1bc92700 1 Processor -- start 2024-01-21T20:14:37.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.835+0000 7fdf1bc92700 1 -- start start 2024-01-21T20:14:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1bc92700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf14154140 0x7fdf14158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1bc92700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140c8120 0x7fdf140ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1bc92700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf140ab620 con 0x7fdf14154520 2024-01-21T20:14:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1bc92700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf140c6ae0 con 0x7fdf14154140 2024-01-21T20:14:37.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1bc92700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c05e0 con 0x7fdf140c8120 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1922d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf14154520 0x7fdf140c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52132/0 (socket says 172.21.15.133:52132) 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1922d700 1 -- 172.21.15.133:0/238051099 learned_addr learned my addr 172.21.15.133:0/238051099 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf19a2e700 1 --2- 172.21.15.133:0/238051099 >> v2:172.21.15.178:3300/0 conn(0x7fdf14154140 0x7fdf14158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140c8120 0x7fdf140ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660608477 0 0) 0x7fdf140ab620 con 0x7fdf14154520 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf000033f0 con 0x7fdf14154520 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406975584 0 0) 0x7fdf000033f0 con 0x7fdf14154520 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140c8120 msgr2=0x7fdf140ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140c8120 0x7fdf140ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 >> v2:172.21.15.178:3300/0 conn(0x7fdf14154140 msgr2=0x7fdf14158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 --2- 172.21.15.133:0/238051099 >> v2:172.21.15.178:3300/0 conn(0x7fdf14154140 0x7fdf14158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140c0e40 con 0x7fdf14154520 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdf04001470 con 0x7fdf14154520 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 >> v1:172.21.15.133:6789/0 conn(0x7fdf14154520 legacy=0x7fdf140c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf000038e0 0x7fdf00003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf00004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf00005000 0x7fdf0000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c6ae0 con 0x7fdf00005000 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c05e0 con 0x7fdf00004690 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0000bdd0 con 0x7fdf000038e0 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140c8120 0x7fdf140ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.836+0000 7fdf19a2e700 1 --2- 172.21.15.133:0/238051099 >> v2:172.21.15.178:3300/0 conn(0x7fdf14154140 0x7fdf14158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf00004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf00005000 0x7fdf0000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf19a2e700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf000038e0 0x7fdf00003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 -- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf000038e0 msgr2=0x7fdf00003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf000038e0 0x7fdf00003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 -- 172.21.15.133:0/238051099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf00005000 msgr2=0x7fdf0000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf00005000 0x7fdf0000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 -- 172.21.15.133:0/238051099 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000033f0 con 0x7fdf00004690 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf00005000 0x7fdf0000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf1922d700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf00004b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdf0400c240 tx=0x7fdf1405ed40).ready entity=mon.1 client_cookie=dd17fcd6af548e6d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04007a60 con 0x7fdf00004690 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0400cad0 con 0x7fdf00004690 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.837+0000 7fdf18a2c700 1 -- 172.21.15.133:0/238051099 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400ce50 con 0x7fdf00004690 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 -- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 msgr2=0x7fdf00004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/238051099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf00004b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fdf0400c240 tx=0x7fdf1405ed40).stop 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1a22f700 1 -- 172.21.15.133:0/238051099 reap_dead start 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 -- 172.21.15.133:0/238051099 shutdown_connections 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 -- 172.21.15.133:0/238051099 >> 172.21.15.133:0/238051099 conn(0x7fdf1405e1e0 msgr2=0x7fdf1405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 -- 172.21.15.133:0/238051099 shutdown_connections 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.838+0000 7fdf1bc92700 1 -- 172.21.15.133:0/238051099 wait complete. 2024-01-21T20:14:37.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.839+0000 7fdf1bc92700 1 Processor -- start 2024-01-21T20:14:37.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.839+0000 7fdf1bc92700 1 -- start start 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf140c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140b0e10 0x7fdf14148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140ae970 con 0x7fdf14168460 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf14168dd0 con 0x7fdf00004690 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140c37d0 con 0x7fdf140b0e10 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33020/0 (socket says 172.21.15.133:33020) 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 -- 172.21.15.133:0/1723835665 learned_addr learned my addr 172.21.15.133:0/1723835665 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:37.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf19a2e700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf140c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1922d700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140b0e10 0x7fdf14148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 -- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140b0e10 msgr2=0x7fdf14148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140b0e10 0x7fdf14148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 -- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 msgr2=0x7fdf140c31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf140c31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 -- 172.21.15.133:0/1723835665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140c3ab0 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1a22f700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdf140c8500 tx=0x7fdf0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00e040 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c00f040 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf140c3d90 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00fe90 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.840+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf14164c20 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.841+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1405fdf0 con 0x7fdf14168460 2024-01-21T20:14:37.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.842+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fdf0c015660 con 0x7fdf14168460 2024-01-21T20:14:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.842+0000 7fdf0a7fc700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 0x7fdef80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.842+0000 7fdf19a2e700 1 -- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 msgr2=0x7fdef80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.842+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fdf0c07b490 con 0x7fdf14168460 2024-01-21T20:14:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.842+0000 7fdf19a2e700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 0x7fdef80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:37.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:37.846+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf0c04fb90 con 0x7fdf14168460 2024-01-21T20:14:38.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.016+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf140c6540 con 0x7fdf14168460 2024-01-21T20:14:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.017+0000 7fdf0a7fc700 1 -- 172.21.15.133:0/1723835665 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18108 (secure 0 0 0) 0x7fdf0c04f780 con 0x7fdf14168460 2024-01-21T20:14:38.007 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:38.007 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":80,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:32.728583+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/766800863":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6833/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6832/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:0/1458407255":"2024-01-22T20:14:32.728543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:38.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.018+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 msgr2=0x7fdef80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:38.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 0x7fdef80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 msgr2=0x7fdf141688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdf140c8500 tx=0x7fdf0c00b040).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 shutdown_connections 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdef805f300 0x7fdef80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf14168460 0x7fdf141688e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf00004690 0x7fdf140c31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 --2- 172.21.15.133:0/1723835665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf140b0e10 0x7fdf14148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 >> 172.21.15.133:0/1723835665 conn(0x7fdf1405e1e0 msgr2=0x7fdf140aafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 shutdown_connections 2024-01-21T20:14:38.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.019+0000 7fdf1bc92700 1 -- 172.21.15.133:0/1723835665 wait complete. 2024-01-21T20:14:38.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:14:38.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.150+0000 7f882d6d0700 1 Processor -- start 2024-01-21T20:14:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.150+0000 7f882d6d0700 1 -- start start 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f882d6d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f882d6d0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f882d6d0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88280ab620 con 0x7f8828154140 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f882d6d0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88280c6ae0 con 0x7f8828154520 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f882d6d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280c05e0 con 0x7f88280c8120 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88277fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54382/0 (socket says 172.21.15.133:54382) 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88277fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57766/0 (socket says 172.21.15.133:57766) 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f8826ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8828154140 0x7f88280c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:46264/0 (socket says 172.21.15.133:46264) 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 -- 172.21.15.133:0/2543946095 learned_addr learned my addr 172.21.15.133:0/2543946095 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 -- 172.21.15.133:0/2543946095 >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 msgr2=0x7f88280ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 --2- 172.21.15.133:0/2543946095 >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 -- 172.21.15.133:0/2543946095 >> v1:172.21.15.178:6789/0 conn(0x7f8828154140 legacy=0x7f88280c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f8825ffb700 1 -- 172.21.15.133:0/2543946095 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062451856 0 0) 0x7f88280ab620 con 0x7f8828154140 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88267fc700 1 -- 172.21.15.133:0/2543946095 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280c0e40 con 0x7f88280c8120 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.151+0000 7f88277fe700 1 --2- 172.21.15.133:0/2543946095 >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f88267fc700 1 --2- 172.21.15.133:0/2543946095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f881c006fd0 tx=0x7f881c0090f0).ready entity=mon.2 client_cookie=cda3bb673a3d4432 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f8825ffb700 1 -- 172.21.15.133:0/2543946095 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00b580 con 0x7f88280c8120 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f8825ffb700 1 -- 172.21.15.133:0/2543946095 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00b6e0 con 0x7f88280c8120 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f8825ffb700 1 -- 172.21.15.133:0/2543946095 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00ba60 con 0x7f88280c8120 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 -- 172.21.15.133:0/2543946095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 msgr2=0x7f8828158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2543946095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f881c006fd0 tx=0x7f881c0090f0).stop 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 -- 172.21.15.133:0/2543946095 shutdown_connections 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2543946095 >> v2:172.21.15.178:3300/0 conn(0x7f8828154520 0x7f88280ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2543946095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88280c8120 0x7f8828158bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 -- 172.21.15.133:0/2543946095 >> 172.21.15.133:0/2543946095 conn(0x7f882805e1e0 msgr2=0x7f882805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 -- 172.21.15.133:0/2543946095 shutdown_connections 2024-01-21T20:14:38.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.152+0000 7f882d6d0700 1 -- 172.21.15.133:0/2543946095 wait complete. 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.154+0000 7f882d6d0700 1 Processor -- start 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.154+0000 7f882d6d0700 1 -- start start 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 0x7f8828145680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8828154520 0x7f88280aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280caf30 con 0x7f88280c8120 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88280af9d0 con 0x7f8828154140 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f882d6d0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88280aedc0 con 0x7f8828154520 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f8826ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f8826ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33024/0 (socket says 172.21.15.133:33024) 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f8826ffd700 1 -- 172.21.15.133:0/2535742470 learned_addr learned my addr 172.21.15.133:0/2535742470 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f88267fc700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 0x7f8828145680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.155+0000 7f88277fe700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8828154520 0x7f88280aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8828154520 msgr2=0x7f88280aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8828154520 0x7f88280aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 msgr2=0x7f8828144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 -- 172.21.15.133:0/2535742470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820009a20 con 0x7f8828154140 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f8826ffd700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f88267fc700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 0x7f8828145680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8828083d70 tx=0x7f881c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c000bc0 con 0x7f8828154140 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00b850 con 0x7f8828154140 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c009370 con 0x7f8828154140 2024-01-21T20:14:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c000d20 con 0x7f8828154140 2024-01-21T20:14:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.156+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88280af380 con 0x7f8828154140 2024-01-21T20:14:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.157+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f881c01b870 con 0x7f8828154140 2024-01-21T20:14:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.157+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88280afb10 con 0x7f8828154140 2024-01-21T20:14:38.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.158+0000 7f880f7fe700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 0x7f88140617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.158+0000 7f8826ffd700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 msgr2=0x7f88140617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:38.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.158+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f881c07c2c0 con 0x7f8828154140 2024-01-21T20:14:38.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.158+0000 7f8826ffd700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 0x7f88140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:38.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.162+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f881c04d0a0 con 0x7f8828154140 2024-01-21T20:14:38.334 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.345+0000 7fa0df803680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:38.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.359+0000 7f8826ffd700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 msgr2=0x7f88140617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:38.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.359+0000 7f8826ffd700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 0x7f88140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:38.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.375+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88280aa980 con 0x7f8828154140 2024-01-21T20:14:38.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.375+0000 7f880f7fe700 1 -- 172.21.15.133:0/2535742470 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f881c029090 con 0x7f8828154140 2024-01-21T20:14:38.366 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:38.366 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 msgr2=0x7f88140617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 0x7f88140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 msgr2=0x7f8828145680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 0x7f8828145680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f8828083d70 tx=0x7f881c017000).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 shutdown_connections 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881405f300 0x7f88140617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8828154520 0x7f88280aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88280c8120 0x7f8828144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 --2- 172.21.15.133:0/2535742470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8828154140 0x7f8828145680 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 >> 172.21.15.133:0/2535742470 conn(0x7f882805e1e0 msgr2=0x7f88280ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 shutdown_connections 2024-01-21T20:14:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.378+0000 7f882d6d0700 1 -- 172.21.15.133:0/2535742470 wait complete. 2024-01-21T20:14:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:38.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:38.402 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.413+0000 7fa0df803680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:38.478 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.488+0000 7fa0df803680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:38.494 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:38.503+0000 7f9aa0835680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:14:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.511+0000 7f7c93f26700 1 Processor -- start 2024-01-21T20:14:38.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.511+0000 7f7c93f26700 1 -- start start 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c93f26700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c93f26700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c152d60 con 0x7f7c8c1521e0 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c93f26700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8c065fd0 con 0x7f7c8c066460 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c93f26700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8c063be0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c91cc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c924c3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c8c1521e0 0x7f7c8c152650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52146/0 (socket says 172.21.15.133:52146) 2024-01-21T20:14:38.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c924c3700 1 -- 172.21.15.133:0/1798518482 learned_addr learned my addr 172.21.15.133:0/1798518482 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.512+0000 7f7c91cc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33036/0 (socket says 172.21.15.133:33036) 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c91cc2700 1 -- 172.21.15.133:0/1798518482 >> v1:172.21.15.178:6789/0 conn(0x7f7c8c066460 legacy=0x7f7c8c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c91cc2700 1 -- 172.21.15.133:0/1798518482 >> v1:172.21.15.133:6789/0 conn(0x7f7c8c1521e0 legacy=0x7f7c8c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c91cc2700 1 -- 172.21.15.133:0/1798518482 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c0653c0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c91cc2700 1 --2- 172.21.15.133:0/1798518482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f7c7c009760 tx=0x7f7c7c009060).ready entity=mon.0 client_cookie=64e2b4e12c191bc4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c90cc0700 1 -- 172.21.15.133:0/1798518482 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00b580 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c90cc0700 1 -- 172.21.15.133:0/1798518482 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c00b6e0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c90cc0700 1 -- 172.21.15.133:0/1798518482 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00ba60 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c93f26700 1 -- 172.21.15.133:0/1798518482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 msgr2=0x7f7c8c0acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.513+0000 7f7c93f26700 1 --2- 172.21.15.133:0/1798518482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f7c7c009760 tx=0x7f7c7c009060).stop 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.514+0000 7f7c93f26700 1 -- 172.21.15.133:0/1798518482 shutdown_connections 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.514+0000 7f7c93f26700 1 --2- 172.21.15.133:0/1798518482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c0acfa0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.514+0000 7f7c93f26700 1 -- 172.21.15.133:0/1798518482 >> 172.21.15.133:0/1798518482 conn(0x7f7c8c0c8200 msgr2=0x7f7c8c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.514+0000 7f7c93f26700 1 -- 172.21.15.133:0/1798518482 shutdown_connections 2024-01-21T20:14:38.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.514+0000 7f7c93f26700 1 -- 172.21.15.133:0/1798518482 wait complete. 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.515+0000 7f7c93f26700 1 Processor -- start 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.515+0000 7f7c93f26700 1 -- start start 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c8c066460 0x7f7c8c0be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c8c1521e0 0x7f7c8c0a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c163ae0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c0a0c40 con 0x7f7c8c1521e0 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c163800 con 0x7f7c8c066460 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33040/0 (socket says 172.21.15.133:33040) 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 -- 172.21.15.133:0/665133134 learned_addr learned my addr 172.21.15.133:0/665133134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c91cc2700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c8c066460 0x7f7c8c0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c924c3700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c8c1521e0 0x7f7c8c0a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c8c066460 msgr2=0x7f7c8c0be810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c8c066460 0x7f7c8c0be810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c8c1521e0 msgr2=0x7f7c8c0a2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c8c1521e0 0x7f7c8c0a2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 -- 172.21.15.133:0/665133134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0092a0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c914c1700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7c8800c470 tx=0x7f7c88007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88007020 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88001e90 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c0a05f0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880073d0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.516+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c0bed00 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8c05fdf0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7c880068b0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c827fc700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 0x7f7c700617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c91cc2700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 msgr2=0x7f7c700617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f7c88079eb0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.518+0000 7f7c91cc2700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 0x7f7c700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:38.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.522+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7c8804ac90 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.568 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:38.578+0000 7f9aa0835680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:14:38.624 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.634+0000 7fa0df803680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:38.646 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:38.655+0000 7f9aa0835680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:14:38.694 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.704+0000 7fa0df803680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:38.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.719+0000 7f7c91cc2700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 msgr2=0x7f7c700617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:38.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.719+0000 7f7c91cc2700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 0x7f7c700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:14:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.737+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c8c0a0d80 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.737+0000 7f7c827fc700 1 -- 172.21.15.133:0/665133134 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4496 (secure 0 0 0) 0x7f7c8804e2b0 con 0x7f7c8c0acbc0 2024-01-21T20:14:38.728 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:38.728 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:21.443345+0000","modified":"2024-01-21T20:14:23.451757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6312":{"gid":6312,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6834/206816937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":206816937},{"type":"v1","addr":"172.21.15.178:6834","nonce":206816937}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 msgr2=0x7f7c700617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 0x7f7c700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 msgr2=0x7f7c8c14f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7c8800c470 tx=0x7f7c88007d70).stop 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 shutdown_connections 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7c7005f300 0x7f7c700617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c8c1521e0 0x7f7c8c0a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c8c066460 0x7f7c8c0be810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 --2- 172.21.15.133:0/665133134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8c0acbc0 0x7f7c8c14f8c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 >> 172.21.15.133:0/665133134 conn(0x7f7c8c0c8200 msgr2=0x7f7c8c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 shutdown_connections 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.739+0000 7f7c93f26700 1 -- 172.21.15.133:0/665133134 wait complete. 2024-01-21T20:14:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2024-01-21T20:14:38.742 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:38.802 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:38.812+0000 7f9aa0835680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:14:38.809 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.819+0000 7fa0df803680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.869+0000 7fee0f8c1700 1 Processor -- start 2024-01-21T20:14:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.869+0000 7fee0f8c1700 1 -- start start 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0f8c1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee08137030 0x7fee08067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0f8c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee08137410 0x7fee08155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0f8c1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee081557f0 con 0x7fee080c5930 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0f8c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee08068370 con 0x7fee08137410 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0f8c1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee08068650 con 0x7fee08137030 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee08137410 0x7fee08155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee08137410 0x7fee08155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33042/0 (socket says 172.21.15.133:33042) 2024-01-21T20:14:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 -- 172.21.15.133:0/3454506834 learned_addr learned my addr 172.21.15.133:0/3454506834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0d65d700 1 --2- 172.21.15.133:0/3454506834 >> v2:172.21.15.178:3300/0 conn(0x7fee08137030 0x7fee08067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 -- 172.21.15.133:0/3454506834 >> v2:172.21.15.178:3300/0 conn(0x7fee08137030 msgr2=0x7fee08067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 --2- 172.21.15.133:0/3454506834 >> v2:172.21.15.178:3300/0 conn(0x7fee08137030 0x7fee08067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 -- 172.21.15.133:0/3454506834 >> v1:172.21.15.178:6789/0 conn(0x7fee080c5930 legacy=0x7fee080c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.870+0000 7fee0ce5c700 1 -- 172.21.15.133:0/3454506834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08068930 con 0x7fee08137410 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0ce5c700 1 --2- 172.21.15.133:0/3454506834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee08137410 0x7fee08155300 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fee080c8e10 tx=0x7fedf80090f0).ready entity=mon.0 client_cookie=73634997a95d8ae5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fedfffff700 1 -- 172.21.15.133:0/3454506834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800b520 con 0x7fee08137410 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fedfffff700 1 -- 172.21.15.133:0/3454506834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf800b680 con 0x7fee08137410 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fedfffff700 1 -- 172.21.15.133:0/3454506834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf800ba20 con 0x7fee08137410 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3454506834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee08137410 msgr2=0x7fee08155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3454506834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee08137410 0x7fee08155300 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fee080c8e10 tx=0x7fedf80090f0).stop 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3454506834 shutdown_connections 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3454506834 >> v2:172.21.15.178:3300/0 conn(0x7fee08137030 0x7fee08067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3454506834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee08137410 0x7fee08155300 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3454506834 >> 172.21.15.133:0/3454506834 conn(0x7fee08066a90 msgr2=0x7fee08066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3454506834 shutdown_connections 2024-01-21T20:14:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.871+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3454506834 wait complete. 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 Processor -- start 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 -- start start 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee08137030 0x7fee080ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08137410 0x7fee081392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0813ac40 con 0x7fee080c5930 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0813a030 con 0x7fee08137030 2024-01-21T20:14:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0f8c1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0813a310 con 0x7fee08137410 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0d65d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.873+0000 7fee0d65d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33054/0 (socket says 172.21.15.133:33054) 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 -- 172.21.15.133:0/3856627726 learned_addr learned my addr 172.21.15.133:0/3856627726 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0ce5c700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee08137030 0x7fee080ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0de5e700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08137410 0x7fee081392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 -- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08137410 msgr2=0x7fee081392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08137410 0x7fee081392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 -- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee08137030 msgr2=0x7fee080ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee08137030 0x7fee080ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 -- 172.21.15.133:0/3856627726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8009370 con 0x7fee080c5930 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0d65d700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fee00009e50 tx=0x7fee0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000caa0 con 0x7fee080c5930 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0000f040 con 0x7fee080c5930 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0813a5f0 con 0x7fee080c5930 2024-01-21T20:14:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0000ce10 con 0x7fee080c5930 2024-01-21T20:14:38.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.874+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee080aedd0 con 0x7fee080c5930 2024-01-21T20:14:38.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.875+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee080ac170 con 0x7fee080c5930 2024-01-21T20:14:38.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.876+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fee00013610 con 0x7fee080c5930 2024-01-21T20:14:38.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.876+0000 7fedfdffb700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 0x7fedec0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:38.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.876+0000 7fee0ce5c700 1 -- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 msgr2=0x7fedec0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:38.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.876+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fee0007b050 con 0x7fee080c5930 2024-01-21T20:14:38.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.876+0000 7fee0ce5c700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 0x7fedec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:38.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:38.880+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee0004bd20 con 0x7fee080c5930 2024-01-21T20:14:38.877 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:38.886+0000 7f9aa0835680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:14:38.917 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:38.927+0000 7fa0df803680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:39.253 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.006+0000 7f9aa0835680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:14:39.254 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:39.218+0000 7fa0df803680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.051+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee0805fdf0 con 0x7fee080c5930 2024-01-21T20:14:39.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.052+0000 7fedfdffb700 1 -- 172.21.15.133:0/3856627726 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18108 (secure 0 0 0) 0x7fee0004f340 con 0x7fee080c5930 2024-01-21T20:14:39.254 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:39.255 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":80,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:32.728583+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:19.214897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:20.411417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/766800863":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6833/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:6832/43404":"2024-01-22T20:14:32.728543+0000","172.21.15.133:0/1458407255":"2024-01-22T20:14:32.728543+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:39.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 msgr2=0x7fedec0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:39.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 0x7fedec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:39.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 msgr2=0x7fee081363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:39.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fee00009e50 tx=0x7fee0000b040).stop 2024-01-21T20:14:39.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 shutdown_connections 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fedec05f300 0x7fedec0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08137410 0x7fee081392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee080c5930 0x7fee081363b0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 --2- 172.21.15.133:0/3856627726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee08137030 0x7fee080ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.054+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 >> 172.21.15.133:0/3856627726 conn(0x7fee08066a90 msgr2=0x7fee080c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.055+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 shutdown_connections 2024-01-21T20:14:39.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.055+0000 7fee0f8c1700 1 -- 172.21.15.133:0/3856627726 wait complete. 2024-01-21T20:14:39.258 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:14:39.258 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.121+0000 7f9aa0835680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:14:39.279 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:39.289+0000 7fa0df803680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:39.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 Processor -- start 2024-01-21T20:14:39.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 -- start start 2024-01-21T20:14:39.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc88154140 0x7fcc88158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc88154520 0x7fcc880ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc880ab620 con 0x7fcc880c6090 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880c6ae0 con 0x7fcc88154520 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.388+0000 7fcc8ecb7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc880c05e0 con 0x7fcc88154140 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc88154520 0x7fcc880ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc88154520 0x7fcc880ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33066/0 (socket says 172.21.15.133:33066) 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 -- 172.21.15.133:0/3704774356 learned_addr learned my addr 172.21.15.133:0/3704774356 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc8ca53700 1 --2- 172.21.15.133:0/3704774356 >> v2:172.21.15.178:3300/0 conn(0x7fcc88154140 0x7fcc88158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 -- 172.21.15.133:0/3704774356 >> v2:172.21.15.178:3300/0 conn(0x7fcc88154140 msgr2=0x7fcc88158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 --2- 172.21.15.133:0/3704774356 >> v2:172.21.15.178:3300/0 conn(0x7fcc88154140 0x7fcc88158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 -- 172.21.15.133:0/3704774356 >> v1:172.21.15.178:6789/0 conn(0x7fcc880c6090 legacy=0x7fcc880c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 -- 172.21.15.133:0/3704774356 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc880c0e40 con 0x7fcc88154520 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc87fff700 1 --2- 172.21.15.133:0/3704774356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154520 0x7fcc880ab130 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fcc88083d70 tx=0x7fcc740090f0).ready entity=mon.0 client_cookie=292734f2f56e54c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:39.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc877fe700 1 -- 172.21.15.133:0/3704774356 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400b520 con 0x7fcc88154520 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc877fe700 1 -- 172.21.15.133:0/3704774356 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7400b680 con 0x7fcc88154520 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.389+0000 7fcc877fe700 1 -- 172.21.15.133:0/3704774356 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400ba00 con 0x7fcc88154520 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/3704774356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154520 msgr2=0x7fcc880ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/3704774356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154520 0x7fcc880ab130 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fcc88083d70 tx=0x7fcc740090f0).stop 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/3704774356 shutdown_connections 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/3704774356 >> v2:172.21.15.178:3300/0 conn(0x7fcc88154140 0x7fcc88158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/3704774356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154520 0x7fcc880ab130 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/3704774356 >> 172.21.15.133:0/3704774356 conn(0x7fcc8805e1e0 msgr2=0x7fcc8805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/3704774356 shutdown_connections 2024-01-21T20:14:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.390+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/3704774356 wait complete. 2024-01-21T20:14:39.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.391+0000 7fcc8ecb7700 1 Processor -- start 2024-01-21T20:14:39.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.391+0000 7fcc8ecb7700 1 -- start start 2024-01-21T20:14:39.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc880c6090 0x7fcc88152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc88154520 0x7fcc880c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88150d20 con 0x7fcc88154140 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88150a40 con 0x7fcc88154520 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ecb7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc880ae210 con 0x7fcc880c6090 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33078/0 (socket says 172.21.15.133:33078) 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 -- 172.21.15.133:0/2988534461 learned_addr learned my addr 172.21.15.133:0/2988534461 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8ca53700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc880c6090 0x7fcc88152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc8d254700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc88154520 0x7fcc880c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc880c6090 msgr2=0x7fcc88152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc880c6090 0x7fcc88152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc88154520 msgr2=0x7fcc880c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc88154520 0x7fcc880c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:39.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.392+0000 7fcc87fff700 1 -- 172.21.15.133:0/2988534461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009370 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc87fff700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fcc8806afd0 tx=0x7fcc74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7400be90 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7400b7f0 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc880ae4f0 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7401c670 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.393+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc881532b0 con 0x7fcc88154140 2024-01-21T20:14:39.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.394+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc880ae070 con 0x7fcc88154140 2024-01-21T20:14:39.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.394+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 28) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fcc7401c9e0 con 0x7fcc88154140 2024-01-21T20:14:39.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.395+0000 7fcc857fa700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:39.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.395+0000 7fcc8ca53700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 msgr2=0x7fcc6c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:39.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.395+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fcc7407be90 con 0x7fcc88154140 2024-01-21T20:14:39.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.395+0000 7fcc8ca53700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:39.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.399+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc880ae070 con 0x7fcc88154140 2024-01-21T20:14:39.414 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.423+0000 7f9aa0835680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:14:39.489 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.498+0000 7f9aa0835680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:14:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.520+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 29) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fcc74079770 con 0x7fcc88154140 2024-01-21T20:14:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.521+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 msgr2=0x7fcc6c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:39.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.521+0000 7fcc857fa700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:39.570 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.580+0000 7f9a195df700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.570 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.580+0000 7f9a195df700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.570 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.580+0000 7f9a195df700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.570 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.580+0000 7f9a195df700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.570 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.580+0000 7f9a195df700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.581+0000 7f9a1cde6700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.581+0000 7f9a1cde6700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.581+0000 7f9a1cde6700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.581+0000 7f9a1cde6700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:39.581+0000 7f9a1cde6700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:14:39.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:39.629+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcc8805fdf0 con 0x7fcc88154140 2024-01-21T20:14:40.505 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:14:40.515+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:14:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.521+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fcc7407d090 con 0x7fcc88154140 2024-01-21T20:14:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.521+0000 7fcc857fa700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.522+0000 7fcc8ca53700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.523+0000 7fcc8ca53700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c061740 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fcc7c009690 tx=0x7fcc7c009060).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.528+0000 7fcc857fa700 1 -- 172.21.15.133:0/2988534461 <== mon.0 v2:172.21.15.133:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcc7404dc80 con 0x7fcc88154140 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 msgr2=0x7fcc6c061740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c061740 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fcc7c009690 tx=0x7fcc7c009060).stop 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 msgr2=0x7fcc88141c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fcc8806afd0 tx=0x7fcc74017000).stop 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 shutdown_connections 2024-01-21T20:14:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc6c05f300 0x7fcc6c061740 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc88154520 0x7fcc880c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc880c6090 0x7fcc88152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 --2- 172.21.15.133:0/2988534461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc88154140 0x7fcc88141c60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.530+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 >> 172.21.15.133:0/2988534461 conn(0x7fcc8805e1e0 msgr2=0x7fcc880c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.531+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 shutdown_connections 2024-01-21T20:14:40.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.531+0000 7fcc8ecb7700 1 -- 172.21.15.133:0/2988534461 wait complete. 2024-01-21T20:14:40.522 INFO:tasks.ceph.mds.b.smithi178.stderr: -2523> 2024-01-21T20:14:26.545+0000 7f9637b07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:14:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:14:40.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:14:40.545 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:14:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.665+0000 7f55dc346700 1 Processor -- start 2024-01-21T20:14:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.666+0000 7f55dc346700 1 -- start start 2024-01-21T20:14:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.666+0000 7f55dc346700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55d40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.666+0000 7f55dc346700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40bfa40 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55dc346700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d40c3e70 con 0x7f55d40be810 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55dc346700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40bee30 con 0x7f55d413b970 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d98e1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f55d40c39f0 0x7f55d40be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46290/0 (socket says 172.21.15.133:46290) 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d98e1700 1 -- 172.21.15.133:0/223086623 learned_addr learned my addr 172.21.15.133:0/223086623 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438921362 0 0) 0x7f55d40bfa40 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c00033f0 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55da0e2700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55d40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1315133350 0 0) 0x7f55c00033f0 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 msgr2=0x7f55d40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55d40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 >> v1:172.21.15.178:6789/0 conn(0x7f55d40be810 legacy=0x7f55d40a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d40bf110 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f55c4001470 con 0x7f55d40c39f0 2024-01-21T20:14:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 >> v1:172.21.15.133:6789/0 conn(0x7f55d40c39f0 legacy=0x7f55d40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0003910 0x7f55c0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55c0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c0004b80 0x7f55c0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40bee30 con 0x7f55c0004b80 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000b9c0 con 0x7f55c0003910 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c000bb80 con 0x7f55d413b970 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55da0e2700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0003910 0x7f55c0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55da8e3700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c0004b80 0x7f55c0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.667+0000 7f55d98e1700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55c0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 -- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 msgr2=0x7f55c0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d413b970 0x7f55c0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 -- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0003910 msgr2=0x7f55c0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0003910 0x7f55c0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 -- 172.21.15.133:0/223086623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00033f0 con 0x7f55c0004b80 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da0e2700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0003910 0x7f55c0003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c0004b80 0x7f55c0005000 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f55d0001700 tx=0x7f55d0007bb0).ready entity=mon.0 client_cookie=929f286ed3b4df07 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0007020 con 0x7f55c0004b80 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0007180 con 0x7f55c0004b80 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55d90e0700 1 -- 172.21.15.133:0/223086623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d0007520 con 0x7f55c0004b80 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55dc346700 1 -- 172.21.15.133:0/223086623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c0004b80 msgr2=0x7f55c0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55dc346700 1 --2- 172.21.15.133:0/223086623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c0004b80 0x7f55c0005000 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f55d0001700 tx=0x7f55d0007bb0).stop 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.668+0000 7f55da8e3700 1 -- 172.21.15.133:0/223086623 reap_dead start 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.669+0000 7f55dc346700 1 -- 172.21.15.133:0/223086623 shutdown_connections 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.669+0000 7f55dc346700 1 -- 172.21.15.133:0/223086623 >> 172.21.15.133:0/223086623 conn(0x7f55d4066a70 msgr2=0x7f55d4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.669+0000 7f55dc346700 1 -- 172.21.15.133:0/223086623 shutdown_connections 2024-01-21T20:14:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.669+0000 7f55dc346700 1 -- 172.21.15.133:0/223086623 wait complete. 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 Processor -- start 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 -- start start 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0004b80 0x7f55d40a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d40654d0 0x7f55d413a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d4157de0 con 0x7f55d40c2600 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40c2f50 con 0x7f55c0004b80 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.670+0000 7f55dc346700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d40a28a0 con 0x7f55d40654d0 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46976/0 (socket says 172.21.15.133:46976) 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 -- 172.21.15.133:0/200282250 learned_addr learned my addr 172.21.15.133:0/200282250 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55d98e1700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d40654d0 0x7f55d413a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da0e2700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0004b80 0x7f55d40a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 -- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d40654d0 msgr2=0x7f55d413a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d40654d0 0x7f55d413a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 -- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0004b80 msgr2=0x7f55d40a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0004b80 0x7f55d40a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 -- 172.21.15.133:0/200282250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4157820 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55da8e3700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f55c000b990 tx=0x7f55d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d001e440 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d001e5a0 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d4157b00 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d001e940 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.671+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d4157520 con 0x7f55d40c2600 2024-01-21T20:14:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.672+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d40a2d80 con 0x7f55d40c2600 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.673+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f55d0012400 con 0x7f55d40c2600 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.673+0000 7f55caffd700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 0x7f55b80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.673+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f55d007b390 con 0x7f55d40c2600 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.673+0000 7f55da0e2700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 0x7f55b80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.673+0000 7f55da0e2700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 0x7f55b80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f55cc0094a0 tx=0x7f55cc00b040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.677+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f55d40a2d80 con 0x7f55d40c2600 2024-01-21T20:14:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:40.880+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55d405fdf0 con 0x7f55d40c2600 2024-01-21T20:14:41.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.532+0000 7f55caffd700 1 -- 172.21.15.133:0/200282250 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55d0023030 con 0x7f55d40c2600 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 msgr2=0x7f55b80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 0x7f55b80614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f55cc0094a0 tx=0x7f55cc00b040).stop 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 msgr2=0x7f55d40c2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f55c000b990 tx=0x7f55d0016000).stop 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 shutdown_connections 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f55b805f030 0x7f55b80614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d40c2600 0x7f55d40c2a60 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c0004b80 0x7f55d40a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 --2- 172.21.15.133:0/200282250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55d40654d0 0x7f55d413a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 >> 172.21.15.133:0/200282250 conn(0x7f55d4066a70 msgr2=0x7f55d4067d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 shutdown_connections 2024-01-21T20:14:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.535+0000 7f55dc346700 1 -- 172.21.15.133:0/200282250 wait complete. 2024-01-21T20:14:41.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:14:41.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.675+0000 7f8aa48df700 1 Processor -- start 2024-01-21T20:14:41.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.675+0000 7f8aa48df700 1 -- start start 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8aa48df700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8aa0066f20 0x7f8aa013a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8aa48df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa00bd220 con 0x7f8aa013a580 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8aa48df700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0065430 con 0x7f8aa00bcc80 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8aa48df700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa0065710 con 0x7f8aa0066f20 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8a9e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8aa013a580 0x7f8aa01587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46296/0 (socket says 172.21.15.133:46296) 2024-01-21T20:14:41.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.676+0000 7f8a9e59c700 1 -- 172.21.15.133:0/3195480005 learned_addr learned my addr 172.21.15.133:0/3195480005 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234980816 0 0) 0x7f8aa00bd220 con 0x7f8aa013a580 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9ed9d700 1 --2- 172.21.15.133:0/3195480005 >> v2:172.21.15.178:3300/0 conn(0x7f8aa0066f20 0x7f8aa013a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a880033f0 con 0x7f8aa013a580 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703214949 0 0) 0x7f8a880033f0 con 0x7f8aa013a580 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 >> v2:172.21.15.178:3300/0 conn(0x7f8aa0066f20 msgr2=0x7f8aa013a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 --2- 172.21.15.133:0/3195480005 >> v2:172.21.15.178:3300/0 conn(0x7f8aa0066f20 0x7f8aa013a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 >> v1:172.21.15.178:6789/0 conn(0x7f8aa00bcc80 legacy=0x7f8aa00626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00659f0 con 0x7f8aa013a580 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8a94001470 con 0x7f8aa013a580 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 >> v1:172.21.15.133:6789/0 conn(0x7f8aa013a580 legacy=0x7f8aa01587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a880038e0 0x7f8a88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8a88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a88005000 0x7f8a8800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa0065710 con 0x7f8a88004690 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8800bf60 con 0x7f8a88005000 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8800c0f0 con 0x7f8a880038e0 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8a88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9e59c700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a880038e0 0x7f8a88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9ed9d700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a88005000 0x7f8a8800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 -- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a880038e0 msgr2=0x7f8a88003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a880038e0 0x7f8a88003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 -- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a88005000 msgr2=0x7f8a8800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a88005000 0x7f8a8800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9ed9d700 1 -- 172.21.15.133:0/3195480005 reap_dead start 2024-01-21T20:14:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.677+0000 7f8a9dd9b700 1 -- 172.21.15.133:0/3195480005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a880033f0 con 0x7f8a88004690 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8a88004b10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f8a90001730 tx=0x7f8a90007bb0).ready entity=mon.0 client_cookie=e32c10b3b74c698b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007020 con 0x7f8a88004690 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90007180 con 0x7f8a88004690 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8a9d59a700 1 -- 172.21.15.133:0/3195480005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90007520 con 0x7f8a88004690 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 -- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 msgr2=0x7f8a88004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8a88004b10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f8a90001730 tx=0x7f8a90007bb0).stop 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 -- 172.21.15.133:0/3195480005 shutdown_connections 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 --2- 172.21.15.133:0/3195480005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8a88004b10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 -- 172.21.15.133:0/3195480005 >> 172.21.15.133:0/3195480005 conn(0x7f8aa00c7d20 msgr2=0x7f8aa00c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 -- 172.21.15.133:0/3195480005 shutdown_connections 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.678+0000 7f8aa48df700 1 -- 172.21.15.133:0/3195480005 wait complete. 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 Processor -- start 2024-01-21T20:14:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 -- start start 2024-01-21T20:14:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa012e7e0 0x7f8aa01396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa00a80c0 0x7f8aa00a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00acf60 con 0x7f8a88004690 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00aa780 con 0x7f8aa012e7e0 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.680+0000 7f8aa48df700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa00ac630 con 0x7f8aa00a80c0 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46986/0 (socket says 172.21.15.133:46986) 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 -- 172.21.15.133:0/407502568 learned_addr learned my addr 172.21.15.133:0/407502568 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa012e7e0 0x7f8aa01396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9ed9d700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa00a80c0 0x7f8aa00a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 -- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa00a80c0 msgr2=0x7f8aa00a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa00a80c0 0x7f8aa00a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 -- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa012e7e0 msgr2=0x7f8aa01396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa012e7e0 0x7f8aa01396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 -- 172.21.15.133:0/407502568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00ac910 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a9e59c700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f8a940047b0 tx=0x7f8aa01548c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940114c0 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a94011620 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a940119a0 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa00acbf0 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.681+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa0139bc0 con 0x7f8a88004690 2024-01-21T20:14:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.682+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa005fdf0 con 0x7f8a88004690 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.682+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 30) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f8a94011d50 con 0x7f8a88004690 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.683+0000 7f8a8effd700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 0x7f8a80061520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.683+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7178+0+0 (secure 0 0 0) 0x7f8a94079b10 con 0x7f8a88004690 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.683+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 0x7f8a80061520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.683+0000 7f8a9dd9b700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 0x7f8a80061520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8a90001010 tx=0x7f8a90015000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:41.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.687+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8a9404ac40 con 0x7f8a88004690 2024-01-21T20:14:41.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:41.852+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8aa013a960 con 0x7f8a88004690 2024-01-21T20:14:42.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.080+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8a94077690 con 0x7f8a88004690 2024-01-21T20:14:42.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.533+0000 7f8a8effd700 1 -- 172.21.15.133:0/407502568 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8a94071ea0 con 0x7f8a88004690 2024-01-21T20:14:42.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.537+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 msgr2=0x7f8a80061520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.537+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 0x7f8a80061520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f8a90001010 tx=0x7f8a90015000).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.537+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 msgr2=0x7f8aa00aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.537+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f8a940047b0 tx=0x7f8aa01548c0).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 shutdown_connections 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a8005f060 0x7f8a80061520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa00a80c0 0x7f8aa00a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a88004690 0x7f8aa00aa120 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 --2- 172.21.15.133:0/407502568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa012e7e0 0x7f8aa01396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 >> 172.21.15.133:0/407502568 conn(0x7f8aa00c7d20 msgr2=0x7f8aa0151ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 shutdown_connections 2024-01-21T20:14:42.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.538+0000 7f8aa48df700 1 -- 172.21.15.133:0/407502568 wait complete. 2024-01-21T20:14:42.530 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:14:42.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:14:42.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.682+0000 7f9eed75e700 1 Processor -- start 2024-01-21T20:14:42.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 -- start start 2024-01-21T20:14:42.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ee8067d70 0x7f9ee8068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee80c3c60 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee8068cf0 con 0x7f9ee8067d70 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.683+0000 7f9eed75e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee8064150 con 0x7f9ee8063800 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ee8067d70 0x7f9ee8068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee67fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ee8067d70 0x7f9ee8068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:38112/0 (socket says 172.21.15.133:38112) 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 -- 172.21.15.133:0/295490578 learned_addr learned my addr 172.21.15.133:0/295490578 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee6ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9ee80bf4f0 0x7f9ee80c40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:50138/0 (socket says 172.21.15.133:50138) 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee67fc700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:38210/0 (socket says 172.21.15.133:38210) 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 -- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 msgr2=0x7f9ee8063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 -- 172.21.15.133:0/295490578 >> v1:172.21.15.178:6789/0 conn(0x7f9ee80bf4f0 legacy=0x7f9ee80c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 -- 172.21.15.133:0/295490578 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee80bf8d0 con 0x7f9ee8067d70 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee67fc700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee77fe700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8067d70 0x7f9ee8068200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9ee0009f20 tx=0x7f9ee0009840).ready entity=mon.1 client_cookie=68946b47adce4caf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.684+0000 7f9ee5ffb700 1 -- 172.21.15.133:0/295490578 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000e070 con 0x7f9ee8067d70 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9ee5ffb700 1 -- 172.21.15.133:0/295490578 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000b9d0 con 0x7f9ee8067d70 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9ee5ffb700 1 -- 172.21.15.133:0/295490578 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000bd50 con 0x7f9ee8067d70 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 -- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8067d70 msgr2=0x7f9ee8068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8067d70 0x7f9ee8068200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f9ee0009f20 tx=0x7f9ee0009840).stop 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 -- 172.21.15.133:0/295490578 shutdown_connections 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8067d70 0x7f9ee8068200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 --2- 172.21.15.133:0/295490578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8063800 0x7f9ee8063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 -- 172.21.15.133:0/295490578 >> 172.21.15.133:0/295490578 conn(0x7f9ee8066a70 msgr2=0x7f9ee8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 -- 172.21.15.133:0/295490578 shutdown_connections 2024-01-21T20:14:42.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.685+0000 7f9eed75e700 1 -- 172.21.15.133:0/295490578 wait complete. 2024-01-21T20:14:42.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.686+0000 7f9eed75e700 1 Processor -- start 2024-01-21T20:14:42.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.686+0000 7f9eed75e700 1 -- start start 2024-01-21T20:14:42.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 0x7f9ee8152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8067d70 0x7f9ee8147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee814f3f0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81535e0 con 0x7f9ee8063800 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9eed75e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81538c0 con 0x7f9ee8067d70 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9ee77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9ee77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47000/0 (socket says 172.21.15.133:47000) 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9ee77fe700 1 -- 172.21.15.133:0/1277406389 learned_addr learned my addr 172.21.15.133:0/1277406389 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9ee6ffd700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 0x7f9ee8152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.687+0000 7f9ee67fc700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8067d70 0x7f9ee8147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 -- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8067d70 msgr2=0x7f9ee8147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8067d70 0x7f9ee8147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 -- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 msgr2=0x7f9ee8152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:42.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 0x7f9ee8152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 -- 172.21.15.133:0/1277406389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80092a0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee6ffd700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 0x7f9ee8152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9ee77fe700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f9ee000b610 tx=0x7f9ee0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0009500 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00092e0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee0009ae0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee001d660 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.688+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee814f080 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.689+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee805fdf0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.689+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9ee001da50 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.690+0000 7f9edf7fe700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 0x7f9ec8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.690+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f9ee007c0a0 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.690+0000 7f9ee6ffd700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 0x7f9ec8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:42.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.690+0000 7f9ee6ffd700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 0x7f9ec8061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ee8159ee0 tx=0x7f9ed0007d30).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:42.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.694+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9ee004cf80 con 0x7f9ee80bf4f0 2024-01-21T20:14:42.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:42.859+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ee8068a10 con 0x7f9ee80bf4f0 2024-01-21T20:14:43.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.536+0000 7f9edf7fe700 1 -- 172.21.15.133:0/1277406389 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9ee00505a0 con 0x7f9ee80bf4f0 2024-01-21T20:14:43.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 msgr2=0x7f9ec8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 0x7f9ec8061730 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9ee8159ee0 tx=0x7f9ed0007d30).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 msgr2=0x7f9ee8148800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f9ee000b610 tx=0x7f9ee0009840).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 shutdown_connections 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9ec805f270 0x7f9ec8061730 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ee80bf4f0 0x7f9ee8148800 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ee8063800 0x7f9ee8152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 --2- 172.21.15.133:0/1277406389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ee8067d70 0x7f9ee8147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 >> 172.21.15.133:0/1277406389 conn(0x7f9ee8066a70 msgr2=0x7f9ee80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 shutdown_connections 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.539+0000 7f9eed75e700 1 -- 172.21.15.133:0/1277406389 wait complete. 2024-01-21T20:14:43.530 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:14:43.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:14:43.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.671+0000 7fb8a2c89700 1 Processor -- start 2024-01-21T20:14:43.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.671+0000 7fb8a2c89700 1 -- start start 2024-01-21T20:14:43.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a2c89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a2c89700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 0x7fb89c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a2c89700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c065660 con 0x7fb89c069cd0 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a2c89700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0bef10 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a2c89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c156070 con 0x7fb89c0beb30 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a0a25700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb89bfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 0x7fb89c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a0a25700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:38236/0 (socket says 172.21.15.133:38236) 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a1226700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb89c069cd0 0x7fb89c151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:50150/0 (socket says 172.21.15.133:50150) 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.672+0000 7fb8a0a25700 1 -- 172.21.15.133:0/3121338227 learned_addr learned my addr 172.21.15.133:0/3121338227 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a0a25700 1 -- 172.21.15.133:0/3121338227 >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 msgr2=0x7fb89c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a0a25700 1 --2- 172.21.15.133:0/3121338227 >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 0x7fb89c0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a0a25700 1 -- 172.21.15.133:0/3121338227 >> v1:172.21.15.178:6789/0 conn(0x7fb89c069cd0 legacy=0x7fb89c151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a0a25700 1 -- 172.21.15.133:0/3121338227 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c065f00 con 0x7fb89c0beb30 2024-01-21T20:14:43.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb89bfff700 1 --2- 172.21.15.133:0/3121338227 >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 0x7fb89c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:43.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a0a25700 1 --2- 172.21.15.133:0/3121338227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb890006fd0 tx=0x7fb8900090f0).ready entity=mon.2 client_cookie=408ecc0abbb1a35a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb89b7fe700 1 -- 172.21.15.133:0/3121338227 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89000b580 con 0x7fb89c0beb30 2024-01-21T20:14:43.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb89b7fe700 1 -- 172.21.15.133:0/3121338227 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89000b6e0 con 0x7fb89c0beb30 2024-01-21T20:14:43.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb89b7fe700 1 -- 172.21.15.133:0/3121338227 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89000ba80 con 0x7fb89c0beb30 2024-01-21T20:14:43.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a2c89700 1 -- 172.21.15.133:0/3121338227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 msgr2=0x7fb89c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.673+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/3121338227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb890006fd0 tx=0x7fb8900090f0).stop 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 -- 172.21.15.133:0/3121338227 shutdown_connections 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/3121338227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c155b80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/3121338227 >> v2:172.21.15.178:3300/0 conn(0x7fb89c0c3fb0 0x7fb89c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 -- 172.21.15.133:0/3121338227 >> 172.21.15.133:0/3121338227 conn(0x7fb89c0c8010 msgr2=0x7fb89c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 -- 172.21.15.133:0/3121338227 shutdown_connections 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.674+0000 7fb8a2c89700 1 -- 172.21.15.133:0/3121338227 wait complete. 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.675+0000 7fb8a2c89700 1 Processor -- start 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.675+0000 7fb8a2c89700 1 -- start start 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb89c069cd0 0x7fb89c13a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c0bcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c169490 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c0bd9a0 con 0x7fb89c069cd0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c164ef0 con 0x7fb89c0beb30 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47014/0 (socket says 172.21.15.133:47014) 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 -- 172.21.15.133:0/816795886 learned_addr learned my addr 172.21.15.133:0/816795886 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a0a25700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb89c069cd0 0x7fb89c13a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb89bfff700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c0bcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 -- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 msgr2=0x7fb89c0bcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c0bcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 -- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb89c069cd0 msgr2=0x7fb89c13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb89c069cd0 0x7fb89c13a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 -- 172.21.15.133:0/816795886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88800b540 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb89bfff700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c0bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a1226700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fb89400c7c0 tx=0x7fb894001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894005c70 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894005dd0 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb890009370 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb894007320 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.676+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c165750 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.678+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c1658e0 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.678+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb894007710 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.678+0000 7fb8997fa700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 0x7fb880061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.678+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fb89407a430 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.678+0000 7fb8a0a25700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 0x7fb880061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.679+0000 7fb8a0a25700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 0x7fb880061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb890009fd0 tx=0x7fb890017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.682+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb89404b4b0 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.846+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb89c165f00 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.849+0000 7fb8997fa700 1 -- 172.21.15.133:0/816795886 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb89c165f00 con 0x7fb89c0c3fb0 2024-01-21T20:14:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.851+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 msgr2=0x7fb880061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.851+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 0x7fb880061730 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb890009fd0 tx=0x7fb890017000).stop 2024-01-21T20:14:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.851+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 msgr2=0x7fb89c0bd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.851+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fb89400c7c0 tx=0x7fb894001510).stop 2024-01-21T20:14:43.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 shutdown_connections 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb88005f270 0x7fb880061730 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb89c0c3fb0 0x7fb89c0bd4b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb89c069cd0 0x7fb89c13a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 --2- 172.21.15.133:0/816795886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb89c0beb30 0x7fb89c0bcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 >> 172.21.15.133:0/816795886 conn(0x7fb89c0c8010 msgr2=0x7fb89c137ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 shutdown_connections 2024-01-21T20:14:43.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.852+0000 7fb8a2c89700 1 -- 172.21.15.133:0/816795886 wait complete. 2024-01-21T20:14:43.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:14:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.980+0000 7f6973d62700 1 Processor -- start 2024-01-21T20:14:43.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.981+0000 7f6973d62700 1 -- start start 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.981+0000 7f6973d62700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f696c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.981+0000 7f6973d62700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c069ef0 con 0x7f696c062ff0 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.981+0000 7f6973d62700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c06a130 con 0x7f696c062c10 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.981+0000 7f6973d62700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c06a410 con 0x7f696c065d70 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f69712fd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f696c062ff0 0x7f696c065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46310/0 (socket says 172.21.15.133:46310) 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f69712fd700 1 -- 172.21.15.133:0/3410049681 learned_addr learned my addr 172.21.15.133:0/3410049681 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f69722ff700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f696c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228322833 0 0) 0x7f6968001110 con 0x7f696c062ff0 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69580033f0 con 0x7f696c062ff0 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471609138 0 0) 0x7f696c06a130 con 0x7f696c062c10 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6968001110 con 0x7f696c062c10 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1144130242 0 0) 0x7f69580033f0 con 0x7f696c062ff0 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 msgr2=0x7f696c15f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f696c15f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 >> v1:172.21.15.178:6789/0 conn(0x7f696c062c10 legacy=0x7f696c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c06a6f0 con 0x7f696c062ff0 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f6968001600 con 0x7f696c062ff0 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 >> v1:172.21.15.133:6789/0 conn(0x7f696c062ff0 legacy=0x7f696c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6958003aa0 0x7f6958003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f6958004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958004b80 0x7f6958005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c06a410 con 0x7f6958003aa0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695800ba70 con 0x7f6958004b80 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695800bbe0 con 0x7f696c065d70 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6971afe700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6958003aa0 0x7f6958003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f69712fd700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f6958004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f69722ff700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958004b80 0x7f6958005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6971afe700 1 -- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 msgr2=0x7f6958004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.982+0000 7f6971afe700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c065d70 0x7f6958004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6971afe700 1 -- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958004b80 msgr2=0x7f6958005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6971afe700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958004b80 0x7f6958005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6971afe700 1 -- 172.21.15.133:0/3410049681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580033f0 con 0x7f6958003aa0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6971afe700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6958003aa0 0x7f6958003ea0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f695c0018d0 tx=0x7f695c007bb0).ready entity=mon.0 client_cookie=58b5e0e5b6aa1614 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c007020 con 0x7f6958003aa0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c007180 con 0x7f6958003aa0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6970afc700 1 -- 172.21.15.133:0/3410049681 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c007500 con 0x7f6958003aa0 2024-01-21T20:14:43.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 -- 172.21.15.133:0/3410049681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6958003aa0 msgr2=0x7f6958003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 --2- 172.21.15.133:0/3410049681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6958003aa0 0x7f6958003ea0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f695c0018d0 tx=0x7f695c007bb0).stop 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f69722ff700 1 -- 172.21.15.133:0/3410049681 reap_dead start 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 -- 172.21.15.133:0/3410049681 shutdown_connections 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 -- 172.21.15.133:0/3410049681 >> 172.21.15.133:0/3410049681 conn(0x7f696c0c8010 msgr2=0x7f696c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 -- 172.21.15.133:0/3410049681 shutdown_connections 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.983+0000 7f6973d62700 1 -- 172.21.15.133:0/3410049681 wait complete. 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 Processor -- start 2024-01-21T20:14:43.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 -- start start 2024-01-21T20:14:43.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958003aa0 0x7f696c138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 0x7f696c0a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0a70b0 con 0x7f696c1395f0 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0adb30 con 0x7f6958003aa0 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f6973d62700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0ad820 con 0x7f696c139b20 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f69712fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f69712fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47024/0 (socket says 172.21.15.133:47024) 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.985+0000 7f69712fd700 1 -- 172.21.15.133:0/862997739 learned_addr learned my addr 172.21.15.133:0/862997739 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f6971afe700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958003aa0 0x7f696c138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69722ff700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 0x7f696c0a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 -- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 msgr2=0x7f696c0a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 0x7f696c0a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 -- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958003aa0 msgr2=0x7f696c138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958003aa0 0x7f696c138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:43.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 -- 172.21.15.133:0/862997739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0adfc0 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69722ff700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 0x7f696c0a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69712fd700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f696800e8b0 tx=0x7f6968001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968010520 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968010680 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c0aaa90 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968010a00 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.986+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c13ad60 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.987+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c0adce0 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.987+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f6968014430 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.988+0000 7f69627fc700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 0x7f6950061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.988+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f6968079eb0 con 0x7f696c1395f0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.988+0000 7f6971afe700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 0x7f6950061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:43.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.988+0000 7f6971afe700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 0x7f6950061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f695c000c00 tx=0x7f695c016000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:43.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:43.992+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6968049b00 con 0x7f696c1395f0 2024-01-21T20:14:44.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.161+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f696c069ef0 con 0x7f696c1395f0 2024-01-21T20:14:44.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.166+0000 7f69627fc700 1 -- 172.21.15.133:0/862997739 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7f696c069ef0 con 0x7f696c1395f0 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 msgr2=0x7f6950061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 0x7f6950061730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f695c000c00 tx=0x7f695c016000).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 msgr2=0x7f696c0a66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f696800e8b0 tx=0x7f6968001e10).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 shutdown_connections 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f695005f270 0x7f6950061730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696c139b20 0x7f696c0a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6958003aa0 0x7f696c138eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 --2- 172.21.15.133:0/862997739 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696c1395f0 0x7f696c0a66d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 >> 172.21.15.133:0/862997739 conn(0x7f696c0c8010 msgr2=0x7f696c13bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:44.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 shutdown_connections 2024-01-21T20:14:44.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.168+0000 7f6973d62700 1 -- 172.21.15.133:0/862997739 wait complete. 2024-01-21T20:14:44.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2024-01-21T20:14:44.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.301+0000 7f3c01843700 1 Processor -- start 2024-01-21T20:14:44.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.301+0000 7f3c01843700 1 -- start start 2024-01-21T20:14:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3c01843700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3bfc0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3c01843700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0c89d0 con 0x7f3bfc1545a0 2024-01-21T20:14:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3c01843700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0c6a20 con 0x7f3bfc0c6590 2024-01-21T20:14:44.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3c01843700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0c7dc0 con 0x7f3bfc0c77b0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bfaffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3bfc1545a0 0x7f3bfc0aa360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46320/0 (socket says 172.21.15.133:46320) 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bfaffd700 1 -- 172.21.15.133:0/210086462 learned_addr learned my addr 172.21.15.133:0/210086462 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3bfc0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150283150 0 0) 0x7f3bfc0c89d0 con 0x7f3bfc1545a0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be40033f0 con 0x7f3bfc1545a0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271873311 0 0) 0x7f3bfc0c6a20 con 0x7f3bfc0c6590 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.302+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bfc0c89d0 con 0x7f3bfc0c6590 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3082810633 0 0) 0x7f3be40033f0 con 0x7f3bfc1545a0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 msgr2=0x7f3bfc0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3bfc0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 >> v1:172.21.15.178:6789/0 conn(0x7f3bfc0c6590 legacy=0x7f3bfc0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0c80a0 con 0x7f3bfc1545a0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3bf0001470 con 0x7f3bfc1545a0 2024-01-21T20:14:44.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3bfc0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 >> v1:172.21.15.133:6789/0 conn(0x7f3bfc1545a0 legacy=0x7f3bfc0aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3be4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3be4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3be4004b80 0x7f3be4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0c7dc0 con 0x7f3be4003f90 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4014200 con 0x7f3be4004b80 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40143c0 con 0x7f3bfc0c77b0 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3be4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfb7fe700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3be4004b80 0x7f3be4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfaffd700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3be4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 -- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 msgr2=0x7f3be4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc0c77b0 0x7f3be4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 -- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3be4004b80 msgr2=0x7f3be4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3be4004b80 0x7f3be4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 -- 172.21.15.133:0/210086462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0092a0 con 0x7f3be4003f90 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3be4004690 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f3bec006d80 tx=0x7f3bec009060).ready entity=mon.0 client_cookie=aa06979a857e9dc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00e640 con 0x7f3be4003f90 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00e7a0 con 0x7f3be4003f90 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.303+0000 7f3bf9ffb700 1 -- 172.21.15.133:0/210086462 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00eb40 con 0x7f3be4003f90 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 -- 172.21.15.133:0/210086462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 msgr2=0x7f3be4004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 --2- 172.21.15.133:0/210086462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3be4004690 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f3bec006d80 tx=0x7f3bec009060).stop 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3bfb7fe700 1 -- 172.21.15.133:0/210086462 reap_dead start 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 -- 172.21.15.133:0/210086462 shutdown_connections 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 -- 172.21.15.133:0/210086462 >> 172.21.15.133:0/210086462 conn(0x7f3bfc0649d0 msgr2=0x7f3bfc064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 -- 172.21.15.133:0/210086462 shutdown_connections 2024-01-21T20:14:44.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.304+0000 7f3c01843700 1 -- 172.21.15.133:0/210086462 wait complete. 2024-01-21T20:14:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.306+0000 7f3c01843700 1 Processor -- start 2024-01-21T20:14:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.306+0000 7f3c01843700 1 -- start start 2024-01-21T20:14:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bfc14ad50 0x7f3bfc0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 0x7f3bfc0c0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1558f0 con 0x7f3be4003f90 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b08b0 con 0x7f3bfc14ad50 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0c4030 con 0x7f3bfc14a490 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47040/0 (socket says 172.21.15.133:47040) 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 -- 172.21.15.133:0/2737381673 learned_addr learned my addr 172.21.15.133:0/2737381673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bfc14ad50 0x7f3bfc0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfb7fe700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 0x7f3bfc0c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 -- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 msgr2=0x7f3bfc0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 0x7f3bfc0c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 -- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bfc14ad50 msgr2=0x7f3bfc0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bfc14ad50 0x7f3bfc0c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 -- 172.21.15.133:0/2737381673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0afca0 con 0x7f3be4003f90 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfb7fe700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 0x7f3bfc0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:44.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3bfaffd700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f3bf00047e0 tx=0x7f3bf0001df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0011590 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf00116f0 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0011a70 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc0aff80 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.307+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc0b0540 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.308+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc05fdf0 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.309+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f3bf0015410 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.309+0000 7f3be37fe700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 0x7f3be8061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.309+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f3bf007a5e0 con 0x7f3be4003f90 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.309+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 0x7f3be8061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:44.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.309+0000 7f3bfa7fc700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 0x7f3be8061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3bec006d80 tx=0x7f3bec01a000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:44.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.313+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3bf004b600 con 0x7f3be4003f90 2024-01-21T20:14:44.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:44.542+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f3bfc0ae080 con 0x7f3be4003f90 2024-01-21T20:14:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.541+0000 7f3be37fe700 1 -- 172.21.15.133:0/2737381673 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v560) v1 ==== 156+0+0 (secure 0 0 0) 0x7f3bf004ec20 con 0x7f3be4003f90 2024-01-21T20:14:45.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 msgr2=0x7f3be8061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:45.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 0x7f3be8061760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3bec006d80 tx=0x7f3bec01a000).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 msgr2=0x7f3bfc155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f3bf00047e0 tx=0x7f3bf0001df0).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 shutdown_connections 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3be805f2a0 0x7f3be8061760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bfc14a490 0x7f3bfc0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3be4003f90 0x7f3bfc155400 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 --2- 172.21.15.133:0/2737381673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bfc14ad50 0x7f3bfc0c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 >> 172.21.15.133:0/2737381673 conn(0x7f3bfc0649d0 msgr2=0x7f3bfc0ab090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 shutdown_connections 2024-01-21T20:14:45.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.544+0000 7f3c01843700 1 -- 172.21.15.133:0/2737381673 wait complete. 2024-01-21T20:14:45.549 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2024-01-21T20:14:45.549 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2024-01-21T20:14:45.549 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:14:45.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2024-01-21T20:14:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.681+0000 7fe4f4621700 1 Processor -- start 2024-01-21T20:14:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.681+0000 7fe4f4621700 1 -- start start 2024-01-21T20:14:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 0x7fe4ec0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec1521e0 0x7fe4ec152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec065fd0 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0653c0 con 0x7fe4ec066460 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f4621700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0656a0 con 0x7fe4ec1521e0 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47052/0 (socket says 172.21.15.133:47052) 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 -- 172.21.15.133:0/1744773971 learned_addr learned my addr 172.21.15.133:0/1744773971 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 -- 172.21.15.133:0/1744773971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec1521e0 msgr2=0x7fe4ec152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/1744773971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec1521e0 0x7fe4ec152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 -- 172.21.15.133:0/1744773971 >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 msgr2=0x7fe4ec0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f1bbc700 1 --2- 172.21.15.133:0/1744773971 >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 0x7fe4ec0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/1744773971 >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 0x7fe4ec0634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 -- 172.21.15.133:0/1744773971 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec065980 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f1bbc700 1 --2- 172.21.15.133:0/1744773971 >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 0x7fe4ec0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.682+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/1744773971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe4ec0600a0 tx=0x7fe4e40090f0).ready entity=mon.0 client_cookie=da0b05df2b348141 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f13bb700 1 -- 172.21.15.133:0/1744773971 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400b600 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f13bb700 1 -- 172.21.15.133:0/1744773971 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400b760 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f13bb700 1 -- 172.21.15.133:0/1744773971 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400bb00 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 -- 172.21.15.133:0/1744773971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0acbc0 msgr2=0x7fe4ec0acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 --2- 172.21.15.133:0/1744773971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fe4ec0600a0 tx=0x7fe4e40090f0).stop 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 -- 172.21.15.133:0/1744773971 shutdown_connections 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 --2- 172.21.15.133:0/1744773971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec1521e0 0x7fe4ec152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 --2- 172.21.15.133:0/1744773971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec0acbc0 0x7fe4ec0acfa0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 --2- 172.21.15.133:0/1744773971 >> v2:172.21.15.178:3300/0 conn(0x7fe4ec066460 0x7fe4ec0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 -- 172.21.15.133:0/1744773971 >> 172.21.15.133:0/1744773971 conn(0x7fe4ec0c8200 msgr2=0x7fe4ec0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 -- 172.21.15.133:0/1744773971 shutdown_connections 2024-01-21T20:14:45.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.683+0000 7fe4f4621700 1 -- 172.21.15.133:0/1744773971 wait complete. 2024-01-21T20:14:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.684+0000 7fe4f4621700 1 Processor -- start 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 -- start start 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec0acbc0 0x7fe4ec0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 0x7fe4ec0c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c7370 con 0x7fe4ec066460 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0bf700 con 0x7fe4ec1521e0 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f4621700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0be810 con 0x7fe4ec0acbc0 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f23bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f23bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47064/0 (socket says 172.21.15.133:47064) 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.685+0000 7fe4f23bd700 1 -- 172.21.15.133:0/2059242134 learned_addr learned my addr 172.21.15.133:0/2059242134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 -- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec0acbc0 msgr2=0x7fe4ec0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec0acbc0 0x7fe4ec0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f2bbe700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 0x7fe4ec0c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 -- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 msgr2=0x7fe4ec0c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 0x7fe4ec0c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 -- 172.21.15.133:0/2059242134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009370 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f2bbe700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 0x7fe4ec0c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f23bd700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe4e4006fd0 tx=0x7fe4e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e4002f70 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e4000bc0 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f4621700 1 -- 172.21.15.133:0/2059242134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0beaf0 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400bb00 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.686+0000 7fe4f4621700 1 -- 172.21.15.133:0/2059242134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0bf0b0 con 0x7fe4ec066460 2024-01-21T20:14:45.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.687+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c8005120 con 0x7fe4ec066460 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.687+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fe4e4021070 con 0x7fe4ec066460 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.688+0000 7fe4e2ffd700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 0x7fe4d0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.688+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fe4e407bf60 con 0x7fe4ec066460 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.688+0000 7fe4f1bbc700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 0x7fe4d0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.688+0000 7fe4f1bbc700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 0x7fe4d0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe4ec0aba80 tx=0x7fe4dc008040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:45.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.692+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe4e40aab00 con 0x7fe4ec066460 2024-01-21T20:14:45.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:45.921+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fe4c8005ac0 con 0x7fe4ec066460 2024-01-21T20:14:46.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.543+0000 7fe4e2ffd700 1 -- 172.21.15.133:0/2059242134 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v561) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4e404cfe0 con 0x7fe4ec066460 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 msgr2=0x7fe4d0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 0x7fe4d0061730 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe4ec0aba80 tx=0x7fe4dc008040).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 msgr2=0x7fe4ec1477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7fe4e4006fd0 tx=0x7fe4e4017000).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 shutdown_connections 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4d005f270 0x7fe4d0061730 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4ec1521e0 0x7fe4ec0c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4ec066460 0x7fe4ec1477d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 --2- 172.21.15.133:0/2059242134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4ec0acbc0 0x7fe4ec0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 >> 172.21.15.133:0/2059242134 conn(0x7fe4ec0c8200 msgr2=0x7fe4ec1500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 shutdown_connections 2024-01-21T20:14:46.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.547+0000 7fe4e0ff9700 1 -- 172.21.15.133:0/2059242134 wait complete. 2024-01-21T20:14:46.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:14:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.685+0000 7f75830fb700 1 Processor -- start 2024-01-21T20:14:46.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.685+0000 7f75830fb700 1 -- start start 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f75830fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f757c137030 0x7f757c067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f75830fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c0c5930 0x7f757c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f75830fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0c6290 con 0x7f757c137410 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f75830fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c068370 con 0x7f757c137030 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f75830fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c068650 con 0x7f757c0c5930 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f757c137030 0x7f757c067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f757bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f757c137410 0x7f757c155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46330/0 (socket says 172.21.15.133:46330) 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f757bfff700 1 -- 172.21.15.133:0/3088475473 learned_addr learned my addr 172.21.15.133:0/3088475473 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f757c137030 0x7f757c067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47080/0 (socket says 172.21.15.133:47080) 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7581698700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c0c5930 0x7f757c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 -- 172.21.15.133:0/3088475473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c0c5930 msgr2=0x7f757c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:46.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c0c5930 0x7f757c0c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 -- 172.21.15.133:0/3088475473 >> v1:172.21.15.133:6789/0 conn(0x7f757c137410 legacy=0x7f757c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 -- 172.21.15.133:0/3088475473 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c068930 con 0x7f757c137030 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f757b7fe700 1 -- 172.21.15.133:0/3088475473 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900597298 0 0) 0x7f757c0c6290 con 0x7f757c137410 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f7580e97700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c137030 0x7f757c067d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f7570009760 tx=0x7f7570009060).ready entity=mon.0 client_cookie=a20600a7e816e93 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.686+0000 7f757b7fe700 1 -- 172.21.15.133:0/3088475473 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75700090d0 con 0x7f757c137030 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f757b7fe700 1 -- 172.21.15.133:0/3088475473 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000b580 con 0x7f757c137030 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f757b7fe700 1 -- 172.21.15.133:0/3088475473 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000b900 con 0x7f757c137030 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 -- 172.21.15.133:0/3088475473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c137030 msgr2=0x7f757c067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c137030 0x7f757c067d90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f7570009760 tx=0x7f7570009060).stop 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 -- 172.21.15.133:0/3088475473 shutdown_connections 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c0c5930 0x7f757c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 --2- 172.21.15.133:0/3088475473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c137030 0x7f757c067d90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 -- 172.21.15.133:0/3088475473 >> 172.21.15.133:0/3088475473 conn(0x7f757c066a90 msgr2=0x7f757c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:46.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 -- 172.21.15.133:0/3088475473 shutdown_connections 2024-01-21T20:14:46.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.687+0000 7f75830fb700 1 -- 172.21.15.133:0/3088475473 wait complete. 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.689+0000 7f75830fb700 1 Processor -- start 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.689+0000 7f75830fb700 1 -- start start 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757c137030 0x7f757c0c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 0x7f757c0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0c4e90 con 0x7f757c0c5930 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c167cc0 con 0x7f757c137030 2024-01-21T20:14:46.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75830fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c167f60 con 0x7f757c137410 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47082/0 (socket says 172.21.15.133:47082) 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 -- 172.21.15.133:0/3942956012 learned_addr learned my addr 172.21.15.133:0/3942956012 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7581698700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 0x7f757c0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f757bfff700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757c137030 0x7f757c0c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 -- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 msgr2=0x7f757c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 0x7f757c0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 -- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757c137030 msgr2=0x7f757c0c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757c137030 0x7f757c0c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 -- 172.21.15.133:0/3942956012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700092a0 con 0x7f757c0c5930 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7581698700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 0x7f757c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f7580e97700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f7570009eb0 tx=0x7f7570017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.690+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757000b6f0 con 0x7f757c0c5930 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.691+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757000b850 con 0x7f757c0c5930 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.691+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c168240 con 0x7f757c0c5930 2024-01-21T20:14:46.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.691+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757001b410 con 0x7f757c0c5930 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.691+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c168800 con 0x7f757c0c5930 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.692+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c1689f0 con 0x7f757c0c5930 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.692+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f757001ba50 con 0x7f757c0c5930 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.692+0000 7f75797fa700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 0x7f7560061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.692+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f757007c4b0 con 0x7f757c0c5930 2024-01-21T20:14:46.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.692+0000 7f757bfff700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 0x7f7560061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:46.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.693+0000 7f757bfff700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 0x7f7560061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f757c0c2250 tx=0x7f7568009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:46.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.696+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f757004d4d0 con 0x7f757c0c5930 2024-01-21T20:14:46.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.860+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f757c05fdf0 con 0x7f757c0c5930 2024-01-21T20:14:46.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.863+0000 7f75797fa700 1 -- 172.21.15.133:0/3942956012 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f75700290c0 con 0x7f757c0c5930 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 msgr2=0x7f7560061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 0x7f7560061730 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f757c0c2250 tx=0x7f7568009040).stop 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 msgr2=0x7f757c135860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f7570009eb0 tx=0x7f7570017000).stop 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 shutdown_connections 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f756005f270 0x7f7560061730 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f757c137410 0x7f757c0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f757c0c5930 0x7f757c135860 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 --2- 172.21.15.133:0/3942956012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f757c137030 0x7f757c0c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:46.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 >> 172.21.15.133:0/3942956012 conn(0x7f757c066a90 msgr2=0x7f757c066e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:46.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 shutdown_connections 2024-01-21T20:14:46.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:46.865+0000 7f75830fb700 1 -- 172.21.15.133:0/3942956012 wait complete. 2024-01-21T20:14:46.867 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:14:46.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:46.903 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:14:46.952 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:14:46.952 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:14:46.953 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.079+0000 7f5b62d21700 1 Processor -- start 2024-01-21T20:14:47.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.079+0000 7f5b62d21700 1 -- start start 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b62d21700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c062c10 0x7f5b5c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b62d21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b5c0697e0 0x7f5b5c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b62d21700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b5c0634e0 con 0x7f5b5c069c40 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b62d21700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b5c06a130 con 0x7f5b5c0697e0 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b62d21700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c06a410 con 0x7f5b5c062c10 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b5c0697e0 0x7f5b5c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b5c0697e0 0x7f5b5c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47092/0 (socket says 172.21.15.133:47092) 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 -- 172.21.15.133:0/2452860673 learned_addr learned my addr 172.21.15.133:0/2452860673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b60abd700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c062c10 0x7f5b5c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 -- 172.21.15.133:0/2452860673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c062c10 msgr2=0x7f5b5c062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c062c10 0x7f5b5c062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 -- 172.21.15.133:0/2452860673 >> v1:172.21.15.178:6789/0 conn(0x7f5b5c069c40 legacy=0x7f5b5c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 -- 172.21.15.133:0/2452860673 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c06a6f0 con 0x7f5b5c0697e0 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5bfff700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c0697e0 0x7f5b5c065660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f5b48006fd0 tx=0x7f5b480090f0).ready entity=mon.0 client_cookie=b0e5d0683c1638b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5b7fe700 1 -- 172.21.15.133:0/2452860673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800b600 con 0x7f5b5c0697e0 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5b7fe700 1 -- 172.21.15.133:0/2452860673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4800b760 con 0x7f5b5c0697e0 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.080+0000 7f5b5b7fe700 1 -- 172.21.15.133:0/2452860673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800bb00 con 0x7f5b5c0697e0 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 -- 172.21.15.133:0/2452860673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c0697e0 msgr2=0x7f5b5c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c0697e0 0x7f5b5c065660 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f5b48006fd0 tx=0x7f5b480090f0).stop 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 -- 172.21.15.133:0/2452860673 shutdown_connections 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c062c10 0x7f5b5c062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 --2- 172.21.15.133:0/2452860673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c0697e0 0x7f5b5c065660 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 -- 172.21.15.133:0/2452860673 >> 172.21.15.133:0/2452860673 conn(0x7f5b5c0c8010 msgr2=0x7f5b5c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:47.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 -- 172.21.15.133:0/2452860673 shutdown_connections 2024-01-21T20:14:47.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.081+0000 7f5b62d21700 1 -- 172.21.15.133:0/2452860673 wait complete. 2024-01-21T20:14:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.082+0000 7f5b62d21700 1 Processor -- start 2024-01-21T20:14:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.082+0000 7f5b62d21700 1 -- start start 2024-01-21T20:14:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b5c062c10 0x7f5b5c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c0697e0 0x7f5b5c0ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a5260 con 0x7f5b5c069c40 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a5500 con 0x7f5b5c062c10 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b62d21700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c0a57e0 con 0x7f5b5c0697e0 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47100/0 (socket says 172.21.15.133:47100) 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 -- 172.21.15.133:0/3362181619 learned_addr learned my addr 172.21.15.133:0/3362181619 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b60abd700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b5c062c10 0x7f5b5c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b5bfff700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c0697e0 0x7f5b5c0ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 -- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c0697e0 msgr2=0x7f5b5c0ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c0697e0 0x7f5b5c0ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 -- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b5c062c10 msgr2=0x7f5b5c158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b5c062c10 0x7f5b5c158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.083+0000 7f5b612be700 1 -- 172.21.15.133:0/3362181619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009370 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b612be700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f5b5400c810 tx=0x7f5b54002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54010510 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b540106b0 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c0a7b90 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54010a70 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.084+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c158840 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.085+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c05fdf0 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.085+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5b54012440 con 0x7f5b5c069c40 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.085+0000 7f5b597fa700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 0x7f5b40061700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.085+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6326+0+0 (secure 0 0 0) 0x7f5b54079d50 con 0x7f5b5c069c40 2024-01-21T20:14:47.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.086+0000 7f5b60abd700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 0x7f5b40061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.086+0000 7f5b60abd700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 0x7f5b40061700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5b5000bb10 tx=0x7f5b50008040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.090+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5b54048b00 con 0x7f5b5c069c40 2024-01-21T20:14:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.296+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b5c0bcf70 con 0x7f5b5c069c40 2024-01-21T20:14:47.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.297+0000 7f5b597fa700 1 -- 172.21.15.133:0/3362181619 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f5b5404ae20 con 0x7f5b5c069c40 2024-01-21T20:14:47.286 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:47.286 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5764,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/209344654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":209344654},{"type":"v1","addr":"172.21.15.133:6837","nonce":209344654}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5773,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2867862870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2867862870},{"type":"v1","addr":"172.21.15.178:6835","nonce":2867862870}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":6058,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/4035122689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":4035122689},{"type":"v1","addr":"172.21.15.178:6834","nonce":4035122689}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26},{"gid":6300,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2686586787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2686586787},{"type":"v1","addr":"172.21.15.133:6836","nonce":2686586787}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2024-01-21T20:14:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.298+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 msgr2=0x7f5b40061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.298+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 0x7f5b40061700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5b5000bb10 tx=0x7f5b50008040).stop 2024-01-21T20:14:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.298+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 msgr2=0x7f5b5c0a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.298+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f5b5400c810 tx=0x7f5b54002560).stop 2024-01-21T20:14:47.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 shutdown_connections 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4005f240 0x7f5b40061700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b5c069c40 0x7f5b5c0a64b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b5c062c10 0x7f5b5c158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 --2- 172.21.15.133:0/3362181619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b5c0697e0 0x7f5b5c0ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 >> 172.21.15.133:0/3362181619 conn(0x7f5b5c0c8010 msgr2=0x7f5b5c0c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 shutdown_connections 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.299+0000 7f5b62d21700 1 -- 172.21.15.133:0/3362181619 wait complete. 2024-01-21T20:14:47.289 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 26 2024-01-21T20:14:47.300 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:14:47.300 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:14:47.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:14:47.301 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:47.301 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:14:47.301 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:14:47.301 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:14:47.301 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:47.301 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:14:47.301 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:14:47.302 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:14:47.302 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:47.302 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:14:47.302 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:14:47.302 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:14:47.302 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:14:47.309 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:14:47.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:14:47.310 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:14:47.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:14:47.313 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:14:47.313 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:14:47.314 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:14:47.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:14:47.352 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:14:47.352 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:47.352 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:14:47.353 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:47.356 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:14:47.356 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:47.356 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:14:47.357 DEBUG:teuthology.parallel:result is None 2024-01-21T20:14:47.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:14:47.427 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:14:47.427 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:14:47.441 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:14:47.441 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:14:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.494+0000 7fcd0ae3a700 1 Processor -- start 2024-01-21T20:14:47.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.494+0000 7fcd0ae3a700 1 -- start start 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.494+0000 7fcd0ae3a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd04069ef0 0x7fcd04155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.494+0000 7fcd0ae3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040c3fb0 0x7fcd04066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd0ae3a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd04065660 con 0x7fcd040beb30 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd0ae3a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040bef10 con 0x7fcd04069ef0 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd0ae3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd04156070 con 0x7fcd040c3fb0 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd04069ef0 0x7fcd04155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd04069ef0 0x7fcd04155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47146/0 (socket says 172.21.15.133:47146) 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 -- 172.21.15.133:0/183773294 learned_addr learned my addr 172.21.15.133:0/183773294 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 -- 172.21.15.133:0/183773294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040c3fb0 msgr2=0x7fcd04066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd093d7700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040c3fb0 0x7fcd04066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040c3fb0 0x7fcd04066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 -- 172.21.15.133:0/183773294 >> v1:172.21.15.178:6789/0 conn(0x7fcd040beb30 legacy=0x7fcd040697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 -- 172.21.15.133:0/183773294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd04065f00 con 0x7fcd04069ef0 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd03fff700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd04069ef0 0x7fcd04155b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fccf0006fd0 tx=0x7fccf000b3b0).ready entity=mon.0 client_cookie=f5790965e4cfb76a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd037fe700 1 -- 172.21.15.133:0/183773294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000db00 con 0x7fcd04069ef0 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd037fe700 1 -- 172.21.15.133:0/183773294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000dc60 con 0x7fcd04069ef0 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.495+0000 7fcd037fe700 1 -- 172.21.15.133:0/183773294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0010470 con 0x7fcd04069ef0 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/183773294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd04069ef0 msgr2=0x7fcd04155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd04069ef0 0x7fcd04155b80 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fccf0006fd0 tx=0x7fccf000b3b0).stop 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/183773294 shutdown_connections 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040c3fb0 0x7fcd04066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/183773294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd04069ef0 0x7fcd04155b80 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/183773294 >> 172.21.15.133:0/183773294 conn(0x7fcd040c8010 msgr2=0x7fcd040c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/183773294 shutdown_connections 2024-01-21T20:14:47.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.496+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/183773294 wait complete. 2024-01-21T20:14:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.497+0000 7fcd0ae3a700 1 Processor -- start 2024-01-21T20:14:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.497+0000 7fcd0ae3a700 1 -- start start 2024-01-21T20:14:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 0x7fcd040c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040beb30 0x7fcd040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040c1d50 con 0x7fcd040c3fb0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040a6e80 con 0x7fcd04069ef0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd0ae3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040bf950 con 0x7fcd040beb30 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47156/0 (socket says 172.21.15.133:47156) 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 -- 172.21.15.133:0/3199923805 learned_addr learned my addr 172.21.15.133:0/3199923805 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd08bd6700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 0x7fcd040c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd03fff700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040beb30 0x7fcd040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 -- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040beb30 msgr2=0x7fcd040a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040beb30 0x7fcd040a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 -- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 msgr2=0x7fcd040c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 0x7fcd040c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd093d7700 1 -- 172.21.15.133:0/3199923805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf000b610 con 0x7fcd040c3fb0 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.498+0000 7fcd08bd6700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 0x7fcd040c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:47.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd093d7700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fccfc00cdb0 tx=0x7fccfc0077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00aa80 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccfc00abe0 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f400 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040a6270 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.499+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd040a6830 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.500+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd040a7030 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.500+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fccfc00d040 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.500+0000 7fcd017fa700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 0x7fcce8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.501+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6326+0+0 (secure 0 0 0) 0x7fccfc07a640 con 0x7fcd040c3fb0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.501+0000 7fcd08bd6700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 0x7fcce8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.501+0000 7fcd08bd6700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 0x7fcce8061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcd040bda90 tx=0x7fccf8009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.505+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd040a7030 con 0x7fcd040c3fb0 2024-01-21T20:14:47.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:14:47.581 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:14:47.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:47.692+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcd0405fdf0 con 0x7fcd040c3fb0 2024-01-21T20:14:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.552+0000 7fcd017fa700 1 -- 172.21.15.133:0/3199923805 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v90) v1 ==== 97+0+0 (secure 0 0 0) 0x7fccfc04b6c0 con 0x7fcd040c3fb0 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 msgr2=0x7fcce8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 0x7fcce8061730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcd040bda90 tx=0x7fccf8009040).stop 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 msgr2=0x7fcd040a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fccfc00cdb0 tx=0x7fccfc0077d0).stop 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 shutdown_connections 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcce805f270 0x7fcce8061730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd040c3fb0 0x7fcd040a5bf0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd04069ef0 0x7fcd040c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 --2- 172.21.15.133:0/3199923805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd040beb30 0x7fcd040a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 >> 172.21.15.133:0/3199923805 conn(0x7fcd040c8010 msgr2=0x7fcd040697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.554+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 shutdown_connections 2024-01-21T20:14:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.555+0000 7fcd0ae3a700 1 -- 172.21.15.133:0/3199923805 wait complete. 2024-01-21T20:14:48.545 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:14:48.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:14:48.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.729+0000 7fd51399b700 1 Processor -- start 2024-01-21T20:14:48.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.730+0000 7fd51399b700 1 -- start start 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd51399b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd51399b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 0x7fd50c066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd51399b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c065660 con 0x7fd50c0beb30 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd51399b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c0bef10 con 0x7fd50c0c3fb0 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd51399b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c156070 con 0x7fd50c069ef0 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd511f38700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 0x7fd50c066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd511737700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd50c0beb30 0x7fd50c0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:50198/0 (socket says 172.21.15.133:50198) 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd511737700 1 -- 172.21.15.133:0/883039356 learned_addr learned my addr 172.21.15.133:0/883039356 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 --2- 172.21.15.133:0/883039356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:38380/0 (socket says 172.21.15.133:38380) 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 -- 172.21.15.133:0/883039356 >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 msgr2=0x7fd50c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 --2- 172.21.15.133:0/883039356 >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 0x7fd50c066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 -- 172.21.15.133:0/883039356 >> v1:172.21.15.178:6789/0 conn(0x7fd50c0beb30 legacy=0x7fd50c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 -- 172.21.15.133:0/883039356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c065f00 con 0x7fd50c069ef0 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd511f38700 1 --2- 172.21.15.133:0/883039356 >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 0x7fd50c066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.731+0000 7fd510f36700 1 --2- 172.21.15.133:0/883039356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd508009760 tx=0x7fd508009060).ready entity=mon.2 client_cookie=f8d75ddfa34e9423 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd503fff700 1 -- 172.21.15.133:0/883039356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080090d0 con 0x7fd50c069ef0 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd503fff700 1 -- 172.21.15.133:0/883039356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800f510 con 0x7fd50c069ef0 2024-01-21T20:14:48.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd503fff700 1 -- 172.21.15.133:0/883039356 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800f890 con 0x7fd50c069ef0 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 -- 172.21.15.133:0/883039356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 msgr2=0x7fd50c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 --2- 172.21.15.133:0/883039356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd508009760 tx=0x7fd508009060).stop 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 -- 172.21.15.133:0/883039356 shutdown_connections 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 --2- 172.21.15.133:0/883039356 >> v2:172.21.15.178:3300/0 conn(0x7fd50c0c3fb0 0x7fd50c066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 --2- 172.21.15.133:0/883039356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c069ef0 0x7fd50c155b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 -- 172.21.15.133:0/883039356 >> 172.21.15.133:0/883039356 conn(0x7fd50c0c8010 msgr2=0x7fd50c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 -- 172.21.15.133:0/883039356 shutdown_connections 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.732+0000 7fd51399b700 1 -- 172.21.15.133:0/883039356 wait complete. 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.733+0000 7fd51399b700 1 Processor -- start 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.733+0000 7fd51399b700 1 -- start start 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c069ef0 0x7fd50c1381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c0c3fb0 0x7fd50c066e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c067330 con 0x7fd50c0beb30 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0a7250 con 0x7fd50c069ef0 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd51399b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0a7be0 con 0x7fd50c0c3fb0 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd510f36700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd510f36700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47166/0 (socket says 172.21.15.133:47166) 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd510f36700 1 -- 172.21.15.133:0/1170854100 learned_addr learned my addr 172.21.15.133:0/1170854100 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd511f38700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c0c3fb0 0x7fd50c066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.734+0000 7fd511737700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c069ef0 0x7fd50c1381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 -- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c0c3fb0 msgr2=0x7fd50c066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c0c3fb0 0x7fd50c066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 -- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c069ef0 msgr2=0x7fd50c1381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c069ef0 0x7fd50c1381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 -- 172.21.15.133:0/1170854100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50400bc30 con 0x7fd50c0beb30 2024-01-21T20:14:48.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd510f36700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fd508009e00 tx=0x7fd508017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800fc50 con 0x7fd50c0beb30 2024-01-21T20:14:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800fdb0 con 0x7fd50c0beb30 2024-01-21T20:14:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080092a0 con 0x7fd50c0beb30 2024-01-21T20:14:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50801b690 con 0x7fd50c0beb30 2024-01-21T20:14:48.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.735+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c0a6c90 con 0x7fd50c0beb30 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.736+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0a79c0 con 0x7fd50c0beb30 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.737+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fd50801ba80 con 0x7fd50c0beb30 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.737+0000 7fd501ffb700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 0x7fd4f0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.737+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd50807b9c0 con 0x7fd50c0beb30 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.737+0000 7fd511737700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 0x7fd4f0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:48.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.737+0000 7fd511737700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 0x7fd4f0061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd4fc0016a0 tx=0x7fd4fc009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:48.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.741+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd50804cbc0 con 0x7fd50c0beb30 2024-01-21T20:14:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.968+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd50c0676d0 con 0x7fd50c0beb30 2024-01-21T20:14:48.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.968+0000 7fd501ffb700 1 -- 172.21.15.133:0/1170854100 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd508028020 con 0x7fd50c0beb30 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.958 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:14:48.959 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:48.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:14:48.961 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.963 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:14:48.964 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:48.966 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.968 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:14:48.970 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 msgr2=0x7fd4f0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 0x7fd4f0061730 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd4fc0016a0 tx=0x7fd4fc009040).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 msgr2=0x7fd50c066950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7fd508009e00 tx=0x7fd508017000).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 shutdown_connections 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd4f005f270 0x7fd4f0061730 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd50c0c3fb0 0x7fd50c066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd50c069ef0 0x7fd50c1381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 --2- 172.21.15.133:0/1170854100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd50c0beb30 0x7fd50c066950 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 >> 172.21.15.133:0/1170854100 conn(0x7fd50c0c8010 msgr2=0x7fd50c0bd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 shutdown_connections 2024-01-21T20:14:48.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:48.970+0000 7fd51399b700 1 -- 172.21.15.133:0/1170854100 wait complete. 2024-01-21T20:14:48.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 Processor -- start 2024-01-21T20:14:49.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 -- start start 2024-01-21T20:14:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f32fc0c3c10 0x7f32fc0be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32fc0be5f0 0x7f32fc0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc0bfa40 con 0x7f32fc13b970 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0bee30 con 0x7f32fc0be5f0 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.101+0000 7f3302369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc0bf110 con 0x7f32fc0c3c10 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f32fc0be5f0 0x7f32fc0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32fbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f32fc13b970 0x7f32fc0c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46350/0 (socket says 172.21.15.133:46350) 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32fbfff700 1 -- 172.21.15.133:0/1394581241 learned_addr learned my addr 172.21.15.133:0/1394581241 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32fb7fe700 1 --2- 172.21.15.133:0/1394581241 >> v2:172.21.15.178:3300/0 conn(0x7f32fc0c3c10 0x7f32fc0be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 -- 172.21.15.133:0/1394581241 >> v2:172.21.15.178:3300/0 conn(0x7f32fc0c3c10 msgr2=0x7f32fc0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 --2- 172.21.15.133:0/1394581241 >> v2:172.21.15.178:3300/0 conn(0x7f32fc0c3c10 0x7f32fc0be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 -- 172.21.15.133:0/1394581241 >> v1:172.21.15.133:6789/0 conn(0x7f32fc13b970 legacy=0x7f32fc0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32faffd700 1 -- 172.21.15.133:0/1394581241 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205202393 0 0) 0x7f32fc0bfa40 con 0x7f32fc13b970 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 -- 172.21.15.133:0/1394581241 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0bf3f0 con 0x7f32fc0be5f0 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f3300906700 1 --2- 172.21.15.133:0/1394581241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0be5f0 0x7f32fc0a8ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f32fc0c8ed0 tx=0x7f32f4009780).ready entity=mon.0 client_cookie=aa140429e7ed6dca server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32faffd700 1 -- 172.21.15.133:0/1394581241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f400e070 con 0x7f32fc0be5f0 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32faffd700 1 -- 172.21.15.133:0/1394581241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f400bc30 con 0x7f32fc0be5f0 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.102+0000 7f32faffd700 1 -- 172.21.15.133:0/1394581241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f4012410 con 0x7f32fc0be5f0 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 -- 172.21.15.133:0/1394581241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0be5f0 msgr2=0x7f32fc0a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 --2- 172.21.15.133:0/1394581241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0be5f0 0x7f32fc0a8ab0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f32fc0c8ed0 tx=0x7f32f4009780).stop 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 -- 172.21.15.133:0/1394581241 shutdown_connections 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 --2- 172.21.15.133:0/1394581241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0be5f0 0x7f32fc0a8ab0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 --2- 172.21.15.133:0/1394581241 >> v2:172.21.15.178:3300/0 conn(0x7f32fc0c3c10 0x7f32fc0be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 -- 172.21.15.133:0/1394581241 >> 172.21.15.133:0/1394581241 conn(0x7f32fc066a70 msgr2=0x7f32fc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 -- 172.21.15.133:0/1394581241 shutdown_connections 2024-01-21T20:14:49.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.103+0000 7f3302369700 1 -- 172.21.15.133:0/1394581241 wait complete. 2024-01-21T20:14:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.104+0000 7f3302369700 1 Processor -- start 2024-01-21T20:14:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 -- start start 2024-01-21T20:14:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 0x7f32fc154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32fc13b970 0x7f32fc153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0a0c30 con 0x7f32fc0c3c10 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc1552d0 con 0x7f32fc0be5f0 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.105+0000 7f3302369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc157780 con 0x7f32fc13b970 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47170/0 (socket says 172.21.15.133:47170) 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 -- 172.21.15.133:0/1430521149 learned_addr learned my addr 172.21.15.133:0/1430521149 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fbfff700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 0x7f32fc154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f3300906700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32fc13b970 0x7f32fc153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 -- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32fc13b970 msgr2=0x7f32fc153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32fc13b970 0x7f32fc153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 -- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 msgr2=0x7f32fc154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 0x7f32fc154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 -- 172.21.15.133:0/1430521149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009a20 con 0x7f32fc0c3c10 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fbfff700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 0x7f32fc154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32fb7fe700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f32f000c670 tx=0x7f32f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0010580 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f00106e0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc155b30 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0010a60 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.106+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc1554e0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.107+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc155cc0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.107+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f32f001b460 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.108+0000 7f32f8ff9700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 0x7f32e8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.108+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f32f007a2a0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.108+0000 7f32fbfff700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 0x7f32e8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.108+0000 7f32fbfff700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 0x7f32e8061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f32ec0016f0 tx=0x7f32ec009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.112+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f32f004b4a0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.277+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32fc05fdf0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.278+0000 7f32f8ff9700 1 -- 172.21.15.133:0/1430521149 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+14645 (secure 0 0 0) 0x7f32f004eac0 con 0x7f32fc0c3c10 2024-01-21T20:14:49.267 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:49.268 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:48.544606+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 msgr2=0x7f32e8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 0x7f32e8061730 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f32ec0016f0 tx=0x7f32ec009040).stop 2024-01-21T20:14:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 msgr2=0x7f32fc165b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f32f000c670 tx=0x7f32f0008040).stop 2024-01-21T20:14:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 shutdown_connections 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f32e805f270 0x7f32e8061730 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32fc13b970 0x7f32fc153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32fc0be5f0 0x7f32fc154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 --2- 172.21.15.133:0/1430521149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32fc0c3c10 0x7f32fc165b10 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.279+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 >> 172.21.15.133:0/1430521149 conn(0x7f32fc066a70 msgr2=0x7f32fc0c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.280+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 shutdown_connections 2024-01-21T20:14:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.280+0000 7f3302369700 1 -- 172.21.15.133:0/1430521149 wait complete. 2024-01-21T20:14:49.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:14:49.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:14:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.409+0000 7fde66dfa700 1 Processor -- start 2024-01-21T20:14:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 -- start start 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde60067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fde600c5930 0x7fde600c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600c62d0 con 0x7fde60137410 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde60068370 con 0x7fde600c5930 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.410+0000 7fde66dfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde60068650 con 0x7fde60137030 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde60137410 0x7fde60155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46358/0 (socket says 172.21.15.133:46358) 2024-01-21T20:14:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5ffff700 1 -- 172.21.15.133:0/3220714634 learned_addr learned my addr 172.21.15.133:0/3220714634 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde60067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde65397700 1 --2- 172.21.15.133:0/3220714634 >> v2:172.21.15.178:3300/0 conn(0x7fde600c5930 0x7fde600c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377568860 0 0) 0x7fde4c001110 con 0x7fde60137410 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde500033f0 con 0x7fde60137410 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659803460 0 0) 0x7fde500033f0 con 0x7fde60137410 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 msgr2=0x7fde60067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde60067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 >> v2:172.21.15.178:3300/0 conn(0x7fde600c5930 msgr2=0x7fde600c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 --2- 172.21.15.133:0/3220714634 >> v2:172.21.15.178:3300/0 conn(0x7fde600c5930 0x7fde600c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60068930 con 0x7fde60137410 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fde4c001600 con 0x7fde60137410 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde60067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde65397700 1 --2- 172.21.15.133:0/3220714634 >> v2:172.21.15.178:3300/0 conn(0x7fde600c5930 0x7fde600c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 >> v1:172.21.15.133:6789/0 conn(0x7fde60137410 legacy=0x7fde60155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde50003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde50004690 0x7fde50004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60068370 con 0x7fde500038e0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60068650 con 0x7fde50004690 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5000b8e0 con 0x7fde60137030 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde50003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde5ffff700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde50004690 0x7fde50004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.411+0000 7fde65397700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 -- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 msgr2=0x7fde50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60137030 0x7fde50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 -- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde50004690 msgr2=0x7fde50004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde50004690 0x7fde50004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 -- 172.21.15.133:0/3220714634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540092a0 con 0x7fde500038e0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde64b96700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde50003d00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fde54009c70 tx=0x7fde54009060).ready entity=mon.0 client_cookie=e661d1eaa6b56bbc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540095c0 con 0x7fde500038e0 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400e690 con 0x7fde500038e0 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde5f7fe700 1 -- 172.21.15.133:0/3220714634 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400ea10 con 0x7fde500038e0 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 -- 172.21.15.133:0/3220714634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 msgr2=0x7fde50003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 --2- 172.21.15.133:0/3220714634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde50003d00 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fde54009c70 tx=0x7fde54009060).stop 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde65397700 1 -- 172.21.15.133:0/3220714634 reap_dead start 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 -- 172.21.15.133:0/3220714634 shutdown_connections 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 -- 172.21.15.133:0/3220714634 >> 172.21.15.133:0/3220714634 conn(0x7fde60066a90 msgr2=0x7fde60066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 -- 172.21.15.133:0/3220714634 shutdown_connections 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.412+0000 7fde66dfa700 1 -- 172.21.15.133:0/3220714634 wait complete. 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 Processor -- start 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 -- start start 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde6013cfa0 0x7fde6013d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60138d20 0x7fde601391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600acda0 con 0x7fde500038e0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600abeb0 con 0x7fde6013cfa0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.414+0000 7fde66dfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600ac190 con 0x7fde60138d20 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47194/0 (socket says 172.21.15.133:47194) 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 -- 172.21.15.133:0/2980167613 learned_addr learned my addr 172.21.15.133:0/2980167613 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 -- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60138d20 msgr2=0x7fde601391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60138d20 0x7fde601391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 -- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde6013cfa0 msgr2=0x7fde6013d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde5ffff700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde6013cfa0 0x7fde6013d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde6013cfa0 0x7fde6013d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 -- 172.21.15.133:0/2980167613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600ac470 con 0x7fde500038e0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde64b96700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fde5400e4b0 tx=0x7fde5401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400e800 con 0x7fde500038e0 2024-01-21T20:14:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400e960 con 0x7fde500038e0 2024-01-21T20:14:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600ac750 con 0x7fde500038e0 2024-01-21T20:14:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54026690 con 0x7fde500038e0 2024-01-21T20:14:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.415+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6013a2e0 con 0x7fde500038e0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.416+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600acbf0 con 0x7fde500038e0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.417+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fde5402f440 con 0x7fde500038e0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.417+0000 7fde5d7fa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 0x7fde44061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.417+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fde5407c230 con 0x7fde500038e0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.417+0000 7fde5ffff700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 0x7fde44061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.417+0000 7fde5ffff700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 0x7fde44061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde6013dff0 tx=0x7fde4c009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.421+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fde5404d430 con 0x7fde500038e0 2024-01-21T20:14:49.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.585+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fde6005fdf0 con 0x7fde500038e0 2024-01-21T20:14:49.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.585+0000 7fde5d7fa700 1 -- 172.21.15.133:0/2980167613 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7fde540160b0 con 0x7fde500038e0 2024-01-21T20:14:49.575 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 msgr2=0x7fde44061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 0x7fde44061730 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fde6013dff0 tx=0x7fde4c009040).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 msgr2=0x7fde60139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fde5400e4b0 tx=0x7fde5401a000).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 shutdown_connections 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fde4405f270 0x7fde44061730 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde60138d20 0x7fde601391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde500038e0 0x7fde60139df0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 --2- 172.21.15.133:0/2980167613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde6013cfa0 0x7fde6013d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 >> 172.21.15.133:0/2980167613 conn(0x7fde60066a90 msgr2=0x7fde600c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 shutdown_connections 2024-01-21T20:14:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.587+0000 7fde66dfa700 1 -- 172.21.15.133:0/2980167613 wait complete. 2024-01-21T20:14:49.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:14:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.717+0000 7f9aa5bd9700 1 Processor -- start 2024-01-21T20:14:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.717+0000 7f9aa5bd9700 1 -- start start 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9aa5bd9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9aa00a9e30 0x7f9aa00bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9aa5bd9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00654f0 con 0x7f9aa0154a90 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9aa5bd9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa0063700 con 0x7f9aa01546b0 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9aa5bd9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa0063950 con 0x7f9aa00a9e30 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9aa00a9e30 0x7f9aa00bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9aa0154a90 0x7f9aa0066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46364/0 (socket says 172.21.15.133:46364) 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9effd700 1 -- 172.21.15.133:0/943594009 learned_addr learned my addr 172.21.15.133:0/943594009 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9ffff700 1 -- 172.21.15.133:0/943594009 >> v1:172.21.15.178:6789/0 conn(0x7f9aa01546b0 legacy=0x7f9aa0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9ffff700 1 -- 172.21.15.133:0/943594009 >> v1:172.21.15.133:6789/0 conn(0x7f9aa0154a90 legacy=0x7f9aa0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9ffff700 1 -- 172.21.15.133:0/943594009 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa0065180 con 0x7f9aa00a9e30 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9e7fc700 1 -- 172.21.15.133:0/943594009 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236826485 0 0) 0x7f9aa00654f0 con 0x7f9aa0154a90 2024-01-21T20:14:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.718+0000 7f9a9ffff700 1 --2- 172.21.15.133:0/943594009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa00bc6d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f9a98009e60 tx=0x7f9a98009780).ready entity=mon.0 client_cookie=6d3a65ebf50af281 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9a9e7fc700 1 -- 172.21.15.133:0/943594009 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800e070 con 0x7f9aa00a9e30 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9a9e7fc700 1 -- 172.21.15.133:0/943594009 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800bbf0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9a9e7fc700 1 -- 172.21.15.133:0/943594009 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98012410 con 0x7f9aa00a9e30 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/943594009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 msgr2=0x7f9aa00bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/943594009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa00bc6d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f9a98009e60 tx=0x7f9a98009780).stop 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/943594009 shutdown_connections 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/943594009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa00bc6d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/943594009 >> 172.21.15.133:0/943594009 conn(0x7f9aa00c8200 msgr2=0x7f9aa00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/943594009 shutdown_connections 2024-01-21T20:14:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.719+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/943594009 wait complete. 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.720+0000 7f9aa5bd9700 1 Processor -- start 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 -- start start 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9aa01546b0 0x7f9aa01558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa0154a90 0x7f9aa0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00bf420 con 0x7f9aa00a9e30 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa01563a0 con 0x7f9aa0154a90 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9aa5bd9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa0156680 con 0x7f9aa01546b0 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9a9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9a9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47202/0 (socket says 172.21.15.133:47202) 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.721+0000 7f9a9f7fe700 1 -- 172.21.15.133:0/792161407 learned_addr learned my addr 172.21.15.133:0/792161407 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 -- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9aa01546b0 msgr2=0x7f9aa01558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9aa01546b0 0x7f9aa01558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 -- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa0154a90 msgr2=0x7f9aa0155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa0154a90 0x7f9aa0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 -- 172.21.15.133:0/792161407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009a20 con 0x7f9aa00a9e30 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a9f7fe700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f9a8800b460 tx=0x7f9a88006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88012410 con 0x7f9aa00a9e30 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a88012590 con 0x7f9aa00a9e30 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa0156960 con 0x7f9aa00a9e30 2024-01-21T20:14:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88012950 con 0x7f9aa00a9e30 2024-01-21T20:14:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.722+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa01572f0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.723+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa00bf1f0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.723+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f9a88012d00 con 0x7f9aa00a9e30 2024-01-21T20:14:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.724+0000 7f9a97fff700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 0x7f9a80061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.724+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9a8807a0a0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.724+0000 7f9a9effd700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 0x7f9a80061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.724+0000 7f9a9effd700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 0x7f9a80061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9a900011e0 tx=0x7f9a90007850).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.728+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9aa00bf1f0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.889+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9aa00bf1f0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.889+0000 7f9a97fff700 1 -- 172.21.15.133:0/792161407 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9aa00bf1f0 con 0x7f9aa00a9e30 2024-01-21T20:14:49.879 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 msgr2=0x7f9a80061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 0x7f9a80061730 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9a900011e0 tx=0x7f9a90007850).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 msgr2=0x7f9aa0150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f9a8800b460 tx=0x7f9a88006f20).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 shutdown_connections 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9a8005f270 0x7f9a80061730 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9aa0154a90 0x7f9aa0155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9aa00a9e30 0x7f9aa0150940 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 --2- 172.21.15.133:0/792161407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9aa01546b0 0x7f9aa01558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 >> 172.21.15.133:0/792161407 conn(0x7f9aa00c8200 msgr2=0x7f9aa01512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 shutdown_connections 2024-01-21T20:14:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:49.891+0000 7f9aa5bd9700 1 -- 172.21.15.133:0/792161407 wait complete. 2024-01-21T20:14:49.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:14:50.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.018+0000 7fc0b47d6700 1 Processor -- start 2024-01-21T20:14:50.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.018+0000 7fc0b47d6700 1 -- start start 2024-01-21T20:14:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.019+0000 7fc0b47d6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0ac1545a0 0x7fc0ac0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.019+0000 7fc0b47d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.019+0000 7fc0b47d6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0ac0c89d0 con 0x7fc0ac0aa360 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.019+0000 7fc0b47d6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c7dc0 con 0x7fc0ac1545a0 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.019+0000 7fc0b47d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0c80a0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2d73700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0ac1545a0 0x7fc0ac0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2d73700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:38424/0 (socket says 172.21.15.133:38424) 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2d73700 1 -- 172.21.15.133:0/2038035996 learned_addr learned my addr 172.21.15.133:0/2038035996 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 -- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 msgr2=0x7fc0ac0c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 -- 172.21.15.133:0/2038035996 >> v1:172.21.15.178:6789/0 conn(0x7fc0ac0aa360 legacy=0x7fc0ac0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 -- 172.21.15.133:0/2038035996 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac0c8380 con 0x7fc0ac1545a0 2024-01-21T20:14:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2d73700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b2572700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac0c77b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc0a4009760 tx=0x7fc0a4009060).ready entity=mon.1 client_cookie=4d7cf15dd5a23541 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b1570700 1 -- 172.21.15.133:0/2038035996 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40090d0 con 0x7fc0ac1545a0 2024-01-21T20:14:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b1570700 1 -- 172.21.15.133:0/2038035996 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400f510 con 0x7fc0ac1545a0 2024-01-21T20:14:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.020+0000 7fc0b1570700 1 -- 172.21.15.133:0/2038035996 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400f890 con 0x7fc0ac1545a0 2024-01-21T20:14:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 -- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 msgr2=0x7fc0ac0c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac0c77b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fc0a4009760 tx=0x7fc0a4009060).stop 2024-01-21T20:14:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 -- 172.21.15.133:0/2038035996 shutdown_connections 2024-01-21T20:14:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac0c77b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/2038035996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0c67b0 0x7fc0ac0c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 -- 172.21.15.133:0/2038035996 >> 172.21.15.133:0/2038035996 conn(0x7fc0ac0649d0 msgr2=0x7fc0ac064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 -- 172.21.15.133:0/2038035996 shutdown_connections 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.021+0000 7fc0b47d6700 1 -- 172.21.15.133:0/2038035996 wait complete. 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.022+0000 7fc0b47d6700 1 Processor -- start 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.022+0000 7fc0b47d6700 1 -- start start 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0aa360 0x7fc0ac0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac164d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac155a80 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0aedb0 con 0x7fc0ac1545a0 2024-01-21T20:14:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b47d6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0af090 con 0x7fc0ac0aa360 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47218/0 (socket says 172.21.15.133:47218) 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b2572700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0aa360 0x7fc0ac0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 -- 172.21.15.133:0/738670387 learned_addr learned my addr 172.21.15.133:0/738670387 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b2d73700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac164d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 -- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0aa360 msgr2=0x7fc0ac0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0aa360 0x7fc0ac0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 -- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 msgr2=0x7fc0ac164d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac164d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 -- 172.21.15.133:0/738670387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009ae0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.023+0000 7fc0b1d71700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc0a000c440 tx=0x7fc0a0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.024+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007020 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.024+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0007180 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.024+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a40092a0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.024+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0007520 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.024+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac14f4e0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.025+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac155bf0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.025+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc0a00068b0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.025+0000 7fc0aaffd700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 0x7fc098061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.025+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc0a00794b0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.025+0000 7fc0b2572700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 0x7fc098061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.026+0000 7fc0b2572700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 0x7fc098061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc0a4009fd0 tx=0x7fc0a4017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.029+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc0a0047b00 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.197+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc0ac0aa1a0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.197+0000 7fc0aaffd700 1 -- 172.21.15.133:0/738670387 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v90) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc0ac155bf0 con 0x7fc0ac0c67b0 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:14:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:14:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:50.188 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 msgr2=0x7fc098061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 0x7fc098061730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fc0a4009fd0 tx=0x7fc0a4017000).stop 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 msgr2=0x7fc0ac0ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc0a000c440 tx=0x7fc0a0007e00).stop 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 shutdown_connections 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc09805f270 0x7fc098061730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac1545a0 0x7fc0ac164d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0ac0aa360 0x7fc0ac0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 --2- 172.21.15.133:0/738670387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0ac0c67b0 0x7fc0ac0ae570 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.199+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 >> 172.21.15.133:0/738670387 conn(0x7fc0ac0649d0 msgr2=0x7fc0ac0ab370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.200+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 shutdown_connections 2024-01-21T20:14:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.200+0000 7fc0b47d6700 1 -- 172.21.15.133:0/738670387 wait complete. 2024-01-21T20:14:50.201 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:14:50.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:14:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.332+0000 7f2bfb823700 1 Processor -- start 2024-01-21T20:14:50.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.333+0000 7f2bfb823700 1 -- start start 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.333+0000 7f2bfb823700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bf40bdf20 0x7f2bf40bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.333+0000 7f2bfb823700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40652b0 0x7f2bf4151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.333+0000 7f2bfb823700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bf40be300 0x7f2bf40695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bfb823700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf4152500 con 0x7f2bf40be300 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bfb823700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf40c32e0 con 0x7f2bf40bdf20 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bfb823700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40c2ff0 con 0x7f2bf40652b0 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bf40be300 0x7f2bf40695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bf40be300 0x7f2bf40695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50614/0 (socket says 172.21.15.133:50614) 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/78060233 learned_addr learned my addr 172.21.15.133:0/78060233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf95bf700 1 --2- 172.21.15.133:0/78060233 >> v2:172.21.15.178:3300/0 conn(0x7f2bf40bdf20 0x7f2bf40bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf8dbe700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40652b0 0x7f2bf4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/78060233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40652b0 msgr2=0x7f2bf4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:50.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40652b0 0x7f2bf4151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/78060233 >> v2:172.21.15.178:3300/0 conn(0x7f2bf40bdf20 msgr2=0x7f2bf40bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/78060233 >> v2:172.21.15.178:3300/0 conn(0x7f2bf40bdf20 0x7f2bf40bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/78060233 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4151a00 con 0x7f2bf40be300 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf40695c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f2bf40689b0 tx=0x7f2bec00ba50).ready entity=mon.0 client_cookie=84a7a49ba1b37b10 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bebfff700 1 -- 172.21.15.133:0/78060233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec010070 con 0x7f2bf40be300 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bebfff700 1 -- 172.21.15.133:0/78060233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00dd30 con 0x7f2bf40be300 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.334+0000 7f2bebfff700 1 -- 172.21.15.133:0/78060233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00dea0 con 0x7f2bf40be300 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 -- 172.21.15.133:0/78060233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 msgr2=0x7f2bf40695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf40695c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f2bf40689b0 tx=0x7f2bec00ba50).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 -- 172.21.15.133:0/78060233 shutdown_connections 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf40695c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 --2- 172.21.15.133:0/78060233 >> v2:172.21.15.178:3300/0 conn(0x7f2bf40bdf20 0x7f2bf40bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 --2- 172.21.15.133:0/78060233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40652b0 0x7f2bf4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 -- 172.21.15.133:0/78060233 >> 172.21.15.133:0/78060233 conn(0x7f2bf40c7d20 msgr2=0x7f2bf40c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 -- 172.21.15.133:0/78060233 shutdown_connections 2024-01-21T20:14:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.335+0000 7f2bfb823700 1 -- 172.21.15.133:0/78060233 wait complete. 2024-01-21T20:14:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.336+0000 7f2bfb823700 1 Processor -- start 2024-01-21T20:14:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.336+0000 7f2bfb823700 1 -- start start 2024-01-21T20:14:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bf40652b0 0x7f2bf4147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40bdf20 0x7f2bf40a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf41480c0 con 0x7f2bf40be300 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40a8760 con 0x7f2bf40652b0 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bfb823700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40a98c0 con 0x7f2bf40bdf20 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50620/0 (socket says 172.21.15.133:50620) 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/1516416526 learned_addr learned my addr 172.21.15.133:0/1516416526 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf8dbe700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40bdf20 0x7f2bf40a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf95bf700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bf40652b0 0x7f2bf4147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40bdf20 msgr2=0x7f2bf40a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40bdf20 0x7f2bf40a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bf40652b0 msgr2=0x7f2bf4147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bf40652b0 0x7f2bf4147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 -- 172.21.15.133:0/1516416526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec00bcf0 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.337+0000 7f2bf9dc0700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f2bec009f60 tx=0x7f2bec00ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.338+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00b580 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.338+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00dea0 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.338+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec015650 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.338+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf40a7b50 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.338+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf40a8110 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.339+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf405fdf0 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.339+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f2bec0159c0 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.339+0000 7f2be9ffb700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 0x7f2bd8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.339+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2bec07db20 con 0x7f2bf40be300 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.339+0000 7f2bf95bf700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 0x7f2bd8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.340+0000 7f2bf95bf700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 0x7f2bd8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2bf40c22c0 tx=0x7f2be4009060).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.343+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2bec04ed80 con 0x7f2bf40be300 2024-01-21T20:14:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:50.508+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f2bf4151c60 con 0x7f2bf40be300 2024-01-21T20:14:51.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.067+0000 7f2be9ffb700 1 -- 172.21.15.133:0/1516416526 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v91) v1 ==== 152+0+0 (secure 0 0 0) 0x7f2bec0523a0 con 0x7f2bf40be300 2024-01-21T20:14:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.071+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 msgr2=0x7f2bd8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.071+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 0x7f2bd8061730 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2bf40c22c0 tx=0x7f2be4009060).stop 2024-01-21T20:14:51.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.071+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 msgr2=0x7f2bf414db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.071+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f2bec009f60 tx=0x7f2bec00ba50).stop 2024-01-21T20:14:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 shutdown_connections 2024-01-21T20:14:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bd805f270 0x7f2bd8061730 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bf40be300 0x7f2bf414db60 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bf40652b0 0x7f2bf4147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 --2- 172.21.15.133:0/1516416526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bf40bdf20 0x7f2bf40a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 >> 172.21.15.133:0/1516416526 conn(0x7f2bf40c7d20 msgr2=0x7f2bf4150460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 shutdown_connections 2024-01-21T20:14:51.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.072+0000 7f2bfb823700 1 -- 172.21.15.133:0/1516416526 wait complete. 2024-01-21T20:14:51.065 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:14:51.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:14:51.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.212+0000 7fec3fedc700 1 Processor -- start 2024-01-21T20:14:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.212+0000 7fec3fedc700 1 -- start start 2024-01-21T20:14:51.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3fedc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3fedc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fec380c3fb0 0x7fec380697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3fedc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec38065660 con 0x7fec38069cd0 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3fedc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380bef10 con 0x7fec380c3fb0 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3fedc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec38156070 con 0x7fec380beb30 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3dc78700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3d477700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fec380c3fb0 0x7fec380697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3dc78700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:57078/0 (socket says 172.21.15.133:57078) 2024-01-21T20:14:51.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.213+0000 7fec3dc78700 1 -- 172.21.15.133:0/3536289946 learned_addr learned my addr 172.21.15.133:0/3536289946 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3d477700 1 -- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 msgr2=0x7fec38155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3d477700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3d477700 1 -- 172.21.15.133:0/3536289946 >> v1:172.21.15.178:6789/0 conn(0x7fec38069cd0 legacy=0x7fec38151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3d477700 1 -- 172.21.15.133:0/3536289946 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38065f00 con 0x7fec380c3fb0 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3dc78700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3d477700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380697e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fec28009760 tx=0x7fec28009060).ready entity=mon.1 client_cookie=7c5147f40752704b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3cc76700 1 -- 172.21.15.133:0/3536289946 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec280090d0 con 0x7fec380c3fb0 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3cc76700 1 -- 172.21.15.133:0/3536289946 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2800f510 con 0x7fec380c3fb0 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3cc76700 1 -- 172.21.15.133:0/3536289946 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2800f890 con 0x7fec380c3fb0 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3fedc700 1 -- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 msgr2=0x7fec380697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.214+0000 7fec3fedc700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380697e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fec28009760 tx=0x7fec28009060).stop 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 -- 172.21.15.133:0/3536289946 shutdown_connections 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec38155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 --2- 172.21.15.133:0/3536289946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380697e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 -- 172.21.15.133:0/3536289946 >> 172.21.15.133:0/3536289946 conn(0x7fec380c8010 msgr2=0x7fec380c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 -- 172.21.15.133:0/3536289946 shutdown_connections 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.215+0000 7fec3fedc700 1 -- 172.21.15.133:0/3536289946 wait complete. 2024-01-21T20:14:51.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.216+0000 7fec3fedc700 1 Processor -- start 2024-01-21T20:14:51.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.216+0000 7fec3fedc700 1 -- start start 2024-01-21T20:14:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec381384a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec380c1090 con 0x7fec38069cd0 2024-01-21T20:14:51.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec38138990 con 0x7fec380c3fb0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec380bfb00 con 0x7fec380beb30 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50622/0 (socket says 172.21.15.133:50622) 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 -- 172.21.15.133:0/310391716 learned_addr learned my addr 172.21.15.133:0/310391716 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3e479700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3d477700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec381384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 -- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 msgr2=0x7fec381384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec381384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 -- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 msgr2=0x7fec380bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 -- 172.21.15.133:0/310391716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34009370 con 0x7fec38069cd0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3dc78700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fec34006d00 tx=0x7fec340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34012600 con 0x7fec38069cd0 2024-01-21T20:14:51.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34012760 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec280092a0 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.217+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34012ae0 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.218+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec380c00c0 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.218+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380c09f0 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.219+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fec3401b400 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.219+0000 7fec2e7fc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.219+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fec3407aa10 con 0x7fec38069cd0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.219+0000 7fec3d477700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:51.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.220+0000 7fec3d477700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 0x7fec1c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fec28009760 tx=0x7fec28017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:51.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.224+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fec3404ba40 con 0x7fec38069cd0 2024-01-21T20:14:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:51.388+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fec3805fdf0 con 0x7fec38069cd0 2024-01-21T20:14:52.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.073+0000 7fec2e7fc700 1 -- 172.21.15.133:0/310391716 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v92) v1 ==== 170+0+0 (secure 0 0 0) 0x7fec34016020 con 0x7fec38069cd0 2024-01-21T20:14:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.078+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 msgr2=0x7fec1c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.078+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 0x7fec1c061730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fec28009760 tx=0x7fec28017000).stop 2024-01-21T20:14:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.078+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 msgr2=0x7fec380c0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.078+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fec34006d00 tx=0x7fec340090f0).stop 2024-01-21T20:14:52.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 shutdown_connections 2024-01-21T20:14:52.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fec1c05f270 0x7fec1c061730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec380c3fb0 0x7fec380bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec38069cd0 0x7fec380c0ba0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 --2- 172.21.15.133:0/310391716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec380beb30 0x7fec381384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.083+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 >> 172.21.15.133:0/310391716 conn(0x7fec380c8010 msgr2=0x7fec380c5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.086+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 shutdown_connections 2024-01-21T20:14:52.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.086+0000 7fec3fedc700 1 -- 172.21.15.133:0/310391716 wait complete. 2024-01-21T20:14:52.085 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:14:52.099 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:14:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.233+0000 7f5c2b58d700 1 Processor -- start 2024-01-21T20:14:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.233+0000 7f5c2b58d700 1 -- start start 2024-01-21T20:14:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c2b58d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c24154a90 0x7f5c240a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c2b58d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 0x7f5c24066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c2b58d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240654f0 con 0x7f5c241546b0 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c2b58d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c24063700 con 0x7f5c24154a90 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c2b58d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c24063950 con 0x7f5c240bc6d0 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c24154a90 0x7f5c240a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c24154a90 0x7f5c240a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50634/0 (socket says 172.21.15.133:50634) 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 -- 172.21.15.133:0/2481895035 learned_addr learned my addr 172.21.15.133:0/2481895035 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c29b2a700 1 --2- 172.21.15.133:0/2481895035 >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 0x7f5c24066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 -- 172.21.15.133:0/2481895035 >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 msgr2=0x7f5c24066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 --2- 172.21.15.133:0/2481895035 >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 0x7f5c24066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 -- 172.21.15.133:0/2481895035 >> v1:172.21.15.178:6789/0 conn(0x7f5c241546b0 legacy=0x7f5c24065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 -- 172.21.15.133:0/2481895035 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24065180 con 0x7f5c24154a90 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c29b2a700 1 --2- 172.21.15.133:0/2481895035 >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 0x7f5c24066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c28b28700 1 --2- 172.21.15.133:0/2481895035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c24154a90 0x7f5c240a9e30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f5c24067b20 tx=0x7f5c200090f0).ready entity=mon.0 client_cookie=2b57744747c8a147 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c1bfff700 1 -- 172.21.15.133:0/2481895035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000b600 con 0x7f5c24154a90 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c1bfff700 1 -- 172.21.15.133:0/2481895035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000b760 con 0x7f5c24154a90 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.234+0000 7f5c1bfff700 1 -- 172.21.15.133:0/2481895035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000bb00 con 0x7f5c24154a90 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2481895035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c24154a90 msgr2=0x7f5c240a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2481895035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c24154a90 0x7f5c240a9e30 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f5c24067b20 tx=0x7f5c200090f0).stop 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2481895035 shutdown_connections 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2481895035 >> v2:172.21.15.178:3300/0 conn(0x7f5c240bc6d0 0x7f5c24066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2481895035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c24154a90 0x7f5c240a9e30 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2481895035 >> 172.21.15.133:0/2481895035 conn(0x7f5c240c8200 msgr2=0x7f5c240c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2481895035 shutdown_connections 2024-01-21T20:14:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.235+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2481895035 wait complete. 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.236+0000 7f5c2b58d700 1 Processor -- start 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.236+0000 7f5c2b58d700 1 -- start start 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c241546b0 0x7f5c2414e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c24154a90 0x7f5c24150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2414ec20 con 0x7f5c240bc6d0 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2414ef00 con 0x7f5c24154a90 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c2b58d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2414f1e0 con 0x7f5c241546b0 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50636/0 (socket says 172.21.15.133:50636) 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 -- 172.21.15.133:0/2810223532 learned_addr learned my addr 172.21.15.133:0/2810223532 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29b2a700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c24154a90 0x7f5c24150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c28b28700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c241546b0 0x7f5c2414e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 -- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c241546b0 msgr2=0x7f5c2414e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c241546b0 0x7f5c2414e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 -- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c24154a90 msgr2=0x7f5c24150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c24154a90 0x7f5c24150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 -- 172.21.15.133:0/2810223532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20009370 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.237+0000 7f5c29329700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f5c1400c440 tx=0x7f5c14007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.238+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140123f0 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.238+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c14001e90 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.238+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14012780 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.238+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2414f4c0 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.238+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c240ac790 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.239+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2405fdf0 con 0x7f5c240bc6d0 2024-01-21T20:14:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.239+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f5c14012b30 con 0x7f5c240bc6d0 2024-01-21T20:14:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.239+0000 7f5c19ffb700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 0x7f5c08061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.239+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f5c14079820 con 0x7f5c240bc6d0 2024-01-21T20:14:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.239+0000 7f5c28b28700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 0x7f5c08061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.240+0000 7f5c28b28700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 0x7f5c08061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5c24067b20 tx=0x7f5c20017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.244+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5c14047b00 con 0x7f5c240bc6d0 2024-01-21T20:14:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.449+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c240c4c80 con 0x7f5c240bc6d0 2024-01-21T20:14:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.454+0000 7f5c19ffb700 1 -- 172.21.15.133:0/2810223532 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v28) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5c240c4c80 con 0x7f5c240bc6d0 2024-01-21T20:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.477+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 msgr2=0x7f5c08061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.477+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 0x7f5c08061730 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5c24067b20 tx=0x7f5c20017000).stop 2024-01-21T20:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.477+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 msgr2=0x7f5c240ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.477+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f5c1400c440 tx=0x7f5c14007db0).stop 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 shutdown_connections 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5c0805f270 0x7f5c08061730 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c24154a90 0x7f5c24150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c240bc6d0 0x7f5c240ac2a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 --2- 172.21.15.133:0/2810223532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c241546b0 0x7f5c2414e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 >> 172.21.15.133:0/2810223532 conn(0x7f5c240c8200 msgr2=0x7f5c24152cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 shutdown_connections 2024-01-21T20:14:52.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.479+0000 7f5c2b58d700 1 -- 172.21.15.133:0/2810223532 wait complete. 2024-01-21T20:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 11 and data pool 12 2024-01-21T20:14:52.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.607+0000 7f8437bd4700 1 Processor -- start 2024-01-21T20:14:52.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.607+0000 7f8437bd4700 1 -- start start 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f8437bd4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f8430153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f8437bd4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8430062b70 0x7f8430156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f8437bd4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8430153750 con 0x7f84300626f0 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f8437bd4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84300671e0 con 0x7f8430062b70 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f8437bd4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84300662e0 con 0x7f8430066e00 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f843516f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f84300626f0 0x7f8430155d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59894/0 (socket says 172.21.15.133:59894) 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.608+0000 7f843516f700 1 -- 172.21.15.133:0/1403239445 learned_addr learned my addr 172.21.15.133:0/1403239445 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8436171700 1 --2- 172.21.15.133:0/1403239445 >> v2:172.21.15.178:3300/0 conn(0x7f8430062b70 0x7f8430156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f8430153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061031666 0 0) 0x7f8430153750 con 0x7f84300626f0 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f841c0033f0 con 0x7f84300626f0 2024-01-21T20:14:52.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3520683113 0 0) 0x7f841c0033f0 con 0x7f84300626f0 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 msgr2=0x7f8430153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f8430153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 >> v2:172.21.15.178:3300/0 conn(0x7f8430062b70 msgr2=0x7f8430156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 --2- 172.21.15.133:0/1403239445 >> v2:172.21.15.178:3300/0 conn(0x7f8430062b70 0x7f8430156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430063020 con 0x7f84300626f0 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8420001470 con 0x7f84300626f0 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 >> v1:172.21.15.133:6789/0 conn(0x7f84300626f0 legacy=0x7f8430155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0038e0 0x7f841c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f841c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f841c004b80 0x7f841c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84300671e0 con 0x7f841c0038e0 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84300662e0 con 0x7f841c004b80 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c00b8e0 con 0x7f8430066e00 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0038e0 0x7f841c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f843516f700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f841c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8436171700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f841c004b80 0x7f841c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 -- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 msgr2=0x7f841c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8430066e00 0x7f841c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 -- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f841c004b80 msgr2=0x7f841c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f841c004b80 0x7f841c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 -- 172.21.15.133:0/1403239445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c0033f0 con 0x7f841c0038e0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.609+0000 7f8435970700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0038e0 0x7f841c003d00 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f842c009a80 tx=0x7f842c009060).ready entity=mon.0 client_cookie=8d54b7d2b49036dc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c009430 con 0x7f841c0038e0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00e640 con 0x7f841c0038e0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f843496e700 1 -- 172.21.15.133:0/1403239445 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00e9c0 con 0x7f841c0038e0 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 -- 172.21.15.133:0/1403239445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0038e0 msgr2=0x7f841c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1403239445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f841c0038e0 0x7f841c003d00 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f842c009a80 tx=0x7f842c009060).stop 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8436171700 1 -- 172.21.15.133:0/1403239445 reap_dead start 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 -- 172.21.15.133:0/1403239445 shutdown_connections 2024-01-21T20:14:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 -- 172.21.15.133:0/1403239445 >> 172.21.15.133:0/1403239445 conn(0x7f84300c7dc0 msgr2=0x7f84300c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 -- 172.21.15.133:0/1403239445 shutdown_connections 2024-01-21T20:14:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.610+0000 7f8437bd4700 1 -- 172.21.15.133:0/1403239445 wait complete. 2024-01-21T20:14:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.611+0000 7f8437bd4700 1 Processor -- start 2024-01-21T20:14:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.611+0000 7f8437bd4700 1 -- start start 2024-01-21T20:14:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 0x7f8430166340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 0x7f8430156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430166830 con 0x7f84300ad870 2024-01-21T20:14:52.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8430155eb0 con 0x7f84300aae90 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8437bd4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8430155580 con 0x7f841c0038e0 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8436171700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8436171700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50658/0 (socket says 172.21.15.133:50658) 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8436171700 1 -- 172.21.15.133:0/1319546010 learned_addr learned my addr 172.21.15.133:0/1319546010 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f8435970700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 0x7f8430166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.612+0000 7f843516f700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 0x7f8430156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 -- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 msgr2=0x7f8430166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 0x7f8430166340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 -- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 msgr2=0x7f8430156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 0x7f8430156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 -- 172.21.15.133:0/1319546010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430155860 con 0x7f84300ad870 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f843516f700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 0x7f8430156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8435970700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 0x7f8430166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:52.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8436171700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f84300aaaf0 tx=0x7f842800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842800e070 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8428011c30 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8430155b40 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428016450 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.613+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8430156830 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.614+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8430156040 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.614+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f8428016840 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.614+0000 7f84267fc700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 0x7f8414061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.615+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f842807aa70 con 0x7f84300ad870 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.615+0000 7f8435970700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 0x7f8414061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.615+0000 7f8435970700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 0x7f8414061760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f842c003080 tx=0x7f842c01a000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.619+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f842804ba20 con 0x7f84300ad870 2024-01-21T20:14:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.781+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8430069990 con 0x7f84300ad870 2024-01-21T20:14:52.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.782+0000 7f84267fc700 1 -- 172.21.15.133:0/1319546010 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17876 (secure 0 0 0) 0x7f842804f040 con 0x7f84300ad870 2024-01-21T20:14:52.772 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:52.772 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:52.450220+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 msgr2=0x7f8414061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 0x7f8414061760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f842c003080 tx=0x7f842c01a000).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 msgr2=0x7f84300a9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f84300aaaf0 tx=0x7f842800b040).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 shutdown_connections 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f841405f2a0 0x7f8414061760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84300ad870 0x7f84300a9450 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f841c0038e0 0x7f8430166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 --2- 172.21.15.133:0/1319546010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84300aae90 0x7f8430156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 >> 172.21.15.133:0/1319546010 conn(0x7f84300c7dc0 msgr2=0x7f84300a78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 shutdown_connections 2024-01-21T20:14:52.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.784+0000 7f8437bd4700 1 -- 172.21.15.133:0/1319546010 wait complete. 2024-01-21T20:14:52.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:52.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.912+0000 7f7a66300700 1 Processor -- start 2024-01-21T20:14:52.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.912+0000 7f7a66300700 1 -- start start 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a66300700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a600c3c10 0x7f7a600be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a66300700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600bfa40 con 0x7f7a6013b970 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a66300700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a600bee30 con 0x7f7a600be5f0 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a66300700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a600bf110 con 0x7f7a600c3c10 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a5ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7a6013b970 0x7f7a600c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59910/0 (socket says 172.21.15.133:59910) 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a5ffff700 1 -- 172.21.15.133:0/2703953802 learned_addr learned my addr 172.21.15.133:0/2703953802 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a5f7fe700 1 --2- 172.21.15.133:0/2703953802 >> v2:172.21.15.178:3300/0 conn(0x7f7a600c3c10 0x7f7a600be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90461933 0 0) 0x7f7a600bfa40 con 0x7f7a6013b970 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.913+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a4c0033f0 con 0x7f7a6013b970 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4055366076 0 0) 0x7f7a4c0033f0 con 0x7f7a6013b970 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5f7fe700 1 -- 172.21.15.133:0/2703953802 >> v1:172.21.15.178:6789/0 conn(0x7f7a600be5f0 legacy=0x7f7a600a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5f7fe700 1 -- 172.21.15.133:0/2703953802 >> v1:172.21.15.133:6789/0 conn(0x7f7a6013b970 legacy=0x7f7a600c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5f7fe700 1 -- 172.21.15.133:0/2703953802 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600bf3f0 con 0x7f7a600c3c10 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5f7fe700 1 --2- 172.21.15.133:0/2703953802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a600be100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f7a48009760 tx=0x7f7a48009060).ready entity=mon.1 client_cookie=e6dcb4b92c4aa76b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50001470 con 0x7f7a600c3c10 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a48009130 con 0x7f7a600c3c10 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a5effd700 1 -- 172.21.15.133:0/2703953802 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a48011610 con 0x7f7a600c3c10 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a66300700 1 -- 172.21.15.133:0/2703953802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 msgr2=0x7f7a600be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a66300700 1 --2- 172.21.15.133:0/2703953802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a600be100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f7a48009760 tx=0x7f7a48009060).stop 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a66300700 1 -- 172.21.15.133:0/2703953802 shutdown_connections 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.914+0000 7f7a66300700 1 --2- 172.21.15.133:0/2703953802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a600be100 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.915+0000 7f7a66300700 1 -- 172.21.15.133:0/2703953802 >> 172.21.15.133:0/2703953802 conn(0x7f7a60066a70 msgr2=0x7f7a60066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:52.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.915+0000 7f7a66300700 1 -- 172.21.15.133:0/2703953802 shutdown_connections 2024-01-21T20:14:52.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.915+0000 7f7a66300700 1 -- 172.21.15.133:0/2703953802 wait complete. 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.916+0000 7f7a66300700 1 Processor -- start 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.916+0000 7f7a66300700 1 -- start start 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a60063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6013b970 0x7f7a60063cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a600c2590 con 0x7f7a600be5f0 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a60064f80 con 0x7f7a600c3c10 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a60152160 con 0x7f7a6013b970 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50672/0 (socket says 172.21.15.133:50672) 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 -- 172.21.15.133:0/3159931627 learned_addr learned my addr 172.21.15.133:0/3159931627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 -- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6013b970 msgr2=0x7f7a60063cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6013b970 0x7f7a60063cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 -- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 msgr2=0x7f7a60063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a60063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 -- 172.21.15.133:0/3159931627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a480092a0 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5ffff700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f7a5000c840 tx=0x7f7a50001a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a50007170 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a500072f0 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500048c0 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a60064370 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.917+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a60064930 con 0x7f7a600be5f0 2024-01-21T20:14:52.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.918+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6005fdf0 con 0x7f7a600be5f0 2024-01-21T20:14:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.919+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f7a50004c30 con 0x7f7a600be5f0 2024-01-21T20:14:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.919+0000 7f7a5cff9700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 0x7f7a40061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.920+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f7a5007a650 con 0x7f7a600be5f0 2024-01-21T20:14:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.920+0000 7f7a5f7fe700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 0x7f7a40061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:52.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.920+0000 7f7a5f7fe700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 0x7f7a40061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7a600c4010 tx=0x7f7a48014000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:52.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:52.923+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a5004b510 con 0x7f7a600be5f0 2024-01-21T20:14:53.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.088+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a601522a0 con 0x7f7a600be5f0 2024-01-21T20:14:53.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.089+0000 7f7a5cff9700 1 -- 172.21.15.133:0/3159931627 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+17876 (secure 0 0 0) 0x7f7a50019020 con 0x7f7a600be5f0 2024-01-21T20:14:53.078 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:53.078 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":93,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:52.450220+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:53.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 msgr2=0x7f7a40061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 0x7f7a40061730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7a600c4010 tx=0x7f7a48014000).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 msgr2=0x7f7a60151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f7a5000c840 tx=0x7f7a50001a30).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 shutdown_connections 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a4005f270 0x7f7a40061730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a6013b970 0x7f7a60063cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a600be5f0 0x7f7a60151c70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 --2- 172.21.15.133:0/3159931627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a600c3c10 0x7f7a60063800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 >> 172.21.15.133:0/3159931627 conn(0x7f7a60066a70 msgr2=0x7f7a600c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 shutdown_connections 2024-01-21T20:14:53.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.091+0000 7f7a66300700 1 -- 172.21.15.133:0/3159931627 wait complete. 2024-01-21T20:14:53.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:14:53.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 Processor -- start 2024-01-21T20:14:53.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 -- start start 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ac4062ff0 0x7f4ac4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4ac40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac4069ef0 con 0x7f4ac4062c10 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac4065fe0 con 0x7f4ac4062ff0 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.222+0000 7f4aca9b0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac406a130 con 0x7f4ac4065b50 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4ac4062c10 0x7f4ac40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59920/0 (socket says 172.21.15.133:59920) 2024-01-21T20:14:53.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac3fff700 1 -- 172.21.15.133:0/528167088 learned_addr learned my addr 172.21.15.133:0/528167088 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/528167088 >> v2:172.21.15.178:3300/0 conn(0x7f4ac4062ff0 0x7f4ac4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4ac40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554536336 0 0) 0x7f4ab8001110 con 0x7f4ac4062c10 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac0033f0 con 0x7f4ac4062c10 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886660834 0 0) 0x7f4aac0033f0 con 0x7f4ac4062c10 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 msgr2=0x7f4ac40bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4ac40bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 >> v2:172.21.15.178:3300/0 conn(0x7f4ac4062ff0 msgr2=0x7f4ac4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 --2- 172.21.15.133:0/528167088 >> v2:172.21.15.178:3300/0 conn(0x7f4ac4062ff0 0x7f4ac4065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac406a410 con 0x7f4ac4062c10 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f4ab8001600 con 0x7f4ac4062c10 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 >> v1:172.21.15.133:6789/0 conn(0x7f4ac4062c10 legacy=0x7f4ac40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4aac0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aac003e10 0x7f4aac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac004b80 0x7f4aac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4065fe0 con 0x7f4aac003e10 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac406a130 con 0x7f4aac004b80 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac00b8e0 con 0x7f4ac4065b50 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.223+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aac003e10 0x7f4aac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac3fff700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4aac0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac004b80 0x7f4aac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 -- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 msgr2=0x7f4aac0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4065b50 0x7f4aac0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 -- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac004b80 msgr2=0x7f4aac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac004b80 0x7f4aac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 -- 172.21.15.133:0/528167088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0033f0 con 0x7f4aac003e10 2024-01-21T20:14:53.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac004b80 0x7f4aac005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aac003e10 0x7f4aac004690 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f4ab4009ab0 tx=0x7f4ab4009060).ready entity=mon.0 client_cookie=ab0ce08608a03561 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4009430 con 0x7f4aac003e10 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab400e640 con 0x7f4aac003e10 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac2ffd700 1 -- 172.21.15.133:0/528167088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400e9c0 con 0x7f4aac003e10 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4aca9b0700 1 -- 172.21.15.133:0/528167088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aac003e10 msgr2=0x7f4aac004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/528167088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aac003e10 0x7f4aac004690 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f4ab4009ab0 tx=0x7f4ab4009060).stop 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4ac8f4d700 1 -- 172.21.15.133:0/528167088 reap_dead start 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4aca9b0700 1 -- 172.21.15.133:0/528167088 shutdown_connections 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.224+0000 7f4aca9b0700 1 -- 172.21.15.133:0/528167088 >> 172.21.15.133:0/528167088 conn(0x7f4ac40c8010 msgr2=0x7f4ac40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.225+0000 7f4aca9b0700 1 -- 172.21.15.133:0/528167088 shutdown_connections 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.225+0000 7f4aca9b0700 1 -- 172.21.15.133:0/528167088 wait complete. 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.226+0000 7f4aca9b0700 1 Processor -- start 2024-01-21T20:14:53.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.226+0000 7f4aca9b0700 1 -- start start 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac003e10 0x7f4ac40699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 0x7f4ac4154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40ac8d0 con 0x7f4ac4155320 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40a8790 con 0x7f4aac003e10 2024-01-21T20:14:53.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40a7b80 con 0x7f4ac4137d90 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50686/0 (socket says 172.21.15.133:50686) 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 -- 172.21.15.133:0/4177815947 learned_addr learned my addr 172.21.15.133:0/4177815947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac3fff700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac003e10 0x7f4ac40699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 0x7f4ac4154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 -- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 msgr2=0x7f4ac4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 0x7f4ac4154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 -- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac003e10 msgr2=0x7f4ac40699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac003e10 0x7f4ac40699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 -- 172.21.15.133:0/4177815947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40a7e60 con 0x7f4ac4155320 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac37fe700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 0x7f4ac4154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac8f4d700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f4ac406a270 tx=0x7f4abc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc00e030 con 0x7f4ac4155320 2024-01-21T20:14:53.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc00f040 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40a8140 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc010db0 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.227+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac4138210 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.228+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac405fdf0 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.229+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f4abc015690 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.229+0000 7f4ac0ff9700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 0x7f4ab0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.229+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f4abc07ad80 con 0x7f4ac4155320 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.229+0000 7f4ac3fff700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 0x7f4ab0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.229+0000 7f4ac3fff700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 0x7f4ab0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4ab80017b0 tx=0x7f4ab8007900).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.233+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4abc04bc80 con 0x7f4ac4155320 2024-01-21T20:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.441+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4ac40a9530 con 0x7f4ac4155320 2024-01-21T20:14:53.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.454+0000 7f4ac0ff9700 1 -- 172.21.15.133:0/4177815947 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4abc04f2a0 con 0x7f4ac4155320 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 msgr2=0x7f4ab0061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 0x7f4ab0061730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4ab80017b0 tx=0x7f4ab8007900).stop 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 msgr2=0x7f4ac40a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f4ac406a270 tx=0x7f4abc00b040).stop 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 shutdown_connections 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4ab005f270 0x7f4ab0061730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ac4155320 0x7f4ac40a8c20 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aac003e10 0x7f4ac40699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 --2- 172.21.15.133:0/4177815947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac4137d90 0x7f4ac4154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.456+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 >> 172.21.15.133:0/4177815947 conn(0x7f4ac40c8010 msgr2=0x7f4ac40bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.457+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 shutdown_connections 2024-01-21T20:14:53.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.457+0000 7f4aca9b0700 1 -- 172.21.15.133:0/4177815947 wait complete. 2024-01-21T20:14:53.459 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:14:53.459 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:14:53.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.588+0000 7f96227cf700 1 Processor -- start 2024-01-21T20:14:53.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.588+0000 7f96227cf700 1 -- start start 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f96227cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f961c0beb30 0x7f961c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f96227cf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c065660 con 0x7f961c0c3fb0 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f96227cf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c065f00 con 0x7f961c069ef0 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f96227cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0bef10 con 0x7f961c0beb30 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f961bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f961c0beb30 0x7f961c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f961b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f961c0c3fb0 0x7f961c0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59924/0 (socket says 172.21.15.133:59924) 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f961b7fe700 1 -- 172.21.15.133:0/522904708 learned_addr learned my addr 172.21.15.133:0/522904708 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:53.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.589+0000 7f961bfff700 1 -- 172.21.15.133:0/522904708 >> v1:172.21.15.178:6789/0 conn(0x7f961c069ef0 legacy=0x7f961c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961bfff700 1 -- 172.21.15.133:0/522904708 >> v1:172.21.15.133:6789/0 conn(0x7f961c0c3fb0 legacy=0x7f961c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961affd700 1 -- 172.21.15.133:0/522904708 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729244679 0 0) 0x7f961c065660 con 0x7f961c0c3fb0 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961bfff700 1 -- 172.21.15.133:0/522904708 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c0c4740 con 0x7f961c0beb30 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961bfff700 1 --2- 172.21.15.133:0/522904708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c155b80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f9610009760 tx=0x7f9610009060).ready entity=mon.0 client_cookie=42428c5f35127b06 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961affd700 1 -- 172.21.15.133:0/522904708 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100090d0 con 0x7f961c0beb30 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961affd700 1 -- 172.21.15.133:0/522904708 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961000b520 con 0x7f961c0beb30 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f961affd700 1 -- 172.21.15.133:0/522904708 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961000b8a0 con 0x7f961c0beb30 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 -- 172.21.15.133:0/522904708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 msgr2=0x7f961c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 --2- 172.21.15.133:0/522904708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c155b80 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f9610009760 tx=0x7f9610009060).stop 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 -- 172.21.15.133:0/522904708 shutdown_connections 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 --2- 172.21.15.133:0/522904708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c155b80 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 -- 172.21.15.133:0/522904708 >> 172.21.15.133:0/522904708 conn(0x7f961c0c8010 msgr2=0x7f961c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 -- 172.21.15.133:0/522904708 shutdown_connections 2024-01-21T20:14:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.590+0000 7f96227cf700 1 -- 172.21.15.133:0/522904708 wait complete. 2024-01-21T20:14:53.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.591+0000 7f96227cf700 1 Processor -- start 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 -- start start 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f961c069ef0 0x7f961c0628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961c0c3fb0 0x7f961c13a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c168f70 con 0x7f961c0beb30 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c168680 con 0x7f961c0c3fb0 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.592+0000 7f96227cf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c13a550 con 0x7f961c069ef0 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50696/0 (socket says 172.21.15.133:50696) 2024-01-21T20:14:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 -- 172.21.15.133:0/3982356230 learned_addr learned my addr 172.21.15.133:0/3982356230 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f9620d6c700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961c0c3fb0 0x7f961c13a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961bfff700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f961c069ef0 0x7f961c0628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 -- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f961c069ef0 msgr2=0x7f961c0628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f961c069ef0 0x7f961c0628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 -- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961c0c3fb0 msgr2=0x7f961c13a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961c0c3fb0 0x7f961c13a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 -- 172.21.15.133:0/3982356230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100092a0 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f961b7fe700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f960c001eb0 tx=0x7f960c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0072e0 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c007440 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c168920 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c0057a0 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.593+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c169480 con 0x7f961c0beb30 2024-01-21T20:14:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.594+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c169120 con 0x7f961c0beb30 2024-01-21T20:14:53.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.595+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f960c005b90 con 0x7f961c0beb30 2024-01-21T20:14:53.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.595+0000 7f9618ff9700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 0x7f9608061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:53.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.595+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f960c079e00 con 0x7f961c0beb30 2024-01-21T20:14:53.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.595+0000 7f961bfff700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 0x7f9608061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:53.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.595+0000 7f961bfff700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 0x7f9608061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f961000b2e0 tx=0x7f9610017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:53.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.599+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f961c169120 con 0x7f961c0beb30 2024-01-21T20:14:53.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:53.805+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f961c05fdf0 con 0x7f961c0beb30 2024-01-21T20:14:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.458+0000 7f9618ff9700 1 -- 172.21.15.133:0/3982356230 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f960c04ad00 con 0x7f961c0beb30 2024-01-21T20:14:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 msgr2=0x7f9608061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 0x7f9608061730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f961000b2e0 tx=0x7f9610017000).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 msgr2=0x7f961c139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f960c001eb0 tx=0x7f960c007e90).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 shutdown_connections 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f960805f270 0x7f9608061730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961c0c3fb0 0x7f961c13a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f961c069ef0 0x7f961c0628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 --2- 172.21.15.133:0/3982356230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f961c0beb30 0x7f961c139b70 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 >> 172.21.15.133:0/3982356230 conn(0x7f961c0c8010 msgr2=0x7f961c0c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 shutdown_connections 2024-01-21T20:14:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.461+0000 7f96227cf700 1 -- 172.21.15.133:0/3982356230 wait complete. 2024-01-21T20:14:54.465 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:14:54.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.599+0000 7fc4db8b7700 1 Processor -- start 2024-01-21T20:14:54.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.599+0000 7fc4db8b7700 1 -- start start 2024-01-21T20:14:54.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4db8b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 0x7fc4d40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4db8b7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4d40695b0 0x7fc4d4069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4db8b7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d4069ef0 con 0x7fc4d413ac10 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4db8b7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d40c3890 con 0x7fc4d40695b0 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4db8b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d40c3b70 con 0x7fc4d413a830 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4d9e54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4d40695b0 0x7fc4d4069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4d9e54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4d40695b0 0x7fc4d4069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50700/0 (socket says 172.21.15.133:50700) 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.600+0000 7fc4d9e54700 1 -- 172.21.15.133:0/1374707324 learned_addr learned my addr 172.21.15.133:0/1374707324 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9653700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 0x7fc4d40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9e54700 1 -- 172.21.15.133:0/1374707324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 msgr2=0x7fc4d40c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9e54700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 0x7fc4d40c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9e54700 1 -- 172.21.15.133:0/1374707324 >> v1:172.21.15.178:6789/0 conn(0x7fc4d413ac10 legacy=0x7fc4d40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9e54700 1 -- 172.21.15.133:0/1374707324 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40c3e50 con 0x7fc4d40695b0 2024-01-21T20:14:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9653700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 0x7fc4d40c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4d9e54700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4069a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fc4cc00d1a0 tx=0x7fc4cc00ba50).ready entity=mon.0 client_cookie=20b7d3d6068a62b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4cbfff700 1 -- 172.21.15.133:0/1374707324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc010070 con 0x7fc4d40695b0 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4cbfff700 1 -- 172.21.15.133:0/1374707324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00de80 con 0x7fc4d40695b0 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4cbfff700 1 -- 172.21.15.133:0/1374707324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00b2e0 con 0x7fc4d40695b0 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4db8b7700 1 -- 172.21.15.133:0/1374707324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 msgr2=0x7fc4d4069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4069a00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7fc4cc00d1a0 tx=0x7fc4cc00ba50).stop 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4db8b7700 1 -- 172.21.15.133:0/1374707324 shutdown_connections 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4069a00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.601+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/1374707324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413a830 0x7fc4d40c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.602+0000 7fc4db8b7700 1 -- 172.21.15.133:0/1374707324 >> 172.21.15.133:0/1374707324 conn(0x7fc4d40c7dc0 msgr2=0x7fc4d40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.602+0000 7fc4db8b7700 1 -- 172.21.15.133:0/1374707324 shutdown_connections 2024-01-21T20:14:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.602+0000 7fc4db8b7700 1 -- 172.21.15.133:0/1374707324 wait complete. 2024-01-21T20:14:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.603+0000 7fc4db8b7700 1 Processor -- start 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.603+0000 7fc4db8b7700 1 -- start start 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 0x7fc4d40ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 0x7fc4d40ab9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4150fd0 con 0x7fc4d40695b0 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4154610 con 0x7fc4d413a830 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4db8b7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4153a00 con 0x7fc4d413ac10 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4d9653700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4d9653700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50702/0 (socket says 172.21.15.133:50702) 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4d9653700 1 -- 172.21.15.133:0/4168824118 learned_addr learned my addr 172.21.15.133:0/4168824118 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.604+0000 7fc4d8e52700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 0x7fc4d40ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9e54700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 0x7fc4d40ab9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 -- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 msgr2=0x7fc4d40ab9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 0x7fc4d40ab9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 -- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 msgr2=0x7fc4d40ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 0x7fc4d40ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 -- 172.21.15.133:0/4168824118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc00bcf0 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9e54700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 0x7fc4d40ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d8e52700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 0x7fc4d40ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4d9653700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fc4c400c880 tx=0x7fc4c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4010580 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c40106e0 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4010a60 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d4153ce0 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.605+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41542a0 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.606+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d405fdf0 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.606+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc4c401b460 con 0x7fc4d40695b0 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.607+0000 7fc4c9ffb700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 0x7fc4b8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.607+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc4c407a640 con 0x7fc4d40695b0 2024-01-21T20:14:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.607+0000 7fc4d8e52700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 0x7fc4b8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.607+0000 7fc4d8e52700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 0x7fc4b8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc4d4152c60 tx=0x7fc4d0009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.611+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc4c404b4e0 con 0x7fc4d40695b0 2024-01-21T20:14:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.813+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4d40c4130 con 0x7fc4d40695b0 2024-01-21T20:14:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.814+0000 7fc4c9ffb700 1 -- 172.21.15.133:0/4168824118 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fc4c404eb00 con 0x7fc4d40695b0 2024-01-21T20:14:54.804 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:54.804 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:14:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 msgr2=0x7fc4b8061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 0x7fc4b8061730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc4d4152c60 tx=0x7fc4d0009040).stop 2024-01-21T20:14:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 msgr2=0x7fc4d4150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7fc4c400c880 tx=0x7fc4c4008040).stop 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 shutdown_connections 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc4b805f270 0x7fc4b8061730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4d413ac10 0x7fc4d40ab9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4d40695b0 0x7fc4d4150ae0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 --2- 172.21.15.133:0/4168824118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4d413a830 0x7fc4d40ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 >> 172.21.15.133:0/4168824118 conn(0x7fc4d40c7dc0 msgr2=0x7fc4d40667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 shutdown_connections 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.816+0000 7fc4db8b7700 1 -- 172.21.15.133:0/4168824118 wait complete. 2024-01-21T20:14:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:14:54.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:14:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.944+0000 7fca079f2700 1 Processor -- start 2024-01-21T20:14:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.944+0000 7fca079f2700 1 -- start start 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.945+0000 7fca079f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.945+0000 7fca079f2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca0013aa00 0x7fca00158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.945+0000 7fca079f2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca001584f0 con 0x7fca0013a620 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.945+0000 7fca079f2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca000bd6f0 con 0x7fca0013aa00 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.945+0000 7fca079f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca000654e0 con 0x7fca00062e00 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca0013aa00 0x7fca00158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca04f8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca04f8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:57208/0 (socket says 172.21.15.133:57208) 2024-01-21T20:14:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca04f8d700 1 -- 172.21.15.133:0/3866271347 learned_addr learned my addr 172.21.15.133:0/3866271347 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 -- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 msgr2=0x7fca000a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 -- 172.21.15.133:0/3866271347 >> v1:172.21.15.178:6789/0 conn(0x7fca0013a620 legacy=0x7fca000626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 -- 172.21.15.133:0/3866271347 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00158730 con 0x7fca0013aa00 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca04f8d700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fca05f8f700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013aa00 0x7fca00158000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc9f8009e60 tx=0x7fc9f8009780).ready entity=mon.1 client_cookie=97ef3879550ee703 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fc9f7fff700 1 -- 172.21.15.133:0/3866271347 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f800e070 con 0x7fca0013aa00 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fc9f7fff700 1 -- 172.21.15.133:0/3866271347 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f800bb60 con 0x7fca0013aa00 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.946+0000 7fc9f7fff700 1 -- 172.21.15.133:0/3866271347 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8012410 con 0x7fca0013aa00 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 -- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013aa00 msgr2=0x7fca00158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013aa00 0x7fca00158000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc9f8009e60 tx=0x7fc9f8009780).stop 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 -- 172.21.15.133:0/3866271347 shutdown_connections 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013aa00 0x7fca00158000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 --2- 172.21.15.133:0/3866271347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca00062e00 0x7fca000a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 -- 172.21.15.133:0/3866271347 >> 172.21.15.133:0/3866271347 conn(0x7fca000c7dc0 msgr2=0x7fca000c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 -- 172.21.15.133:0/3866271347 shutdown_connections 2024-01-21T20:14:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.947+0000 7fca079f2700 1 -- 172.21.15.133:0/3866271347 wait complete. 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.948+0000 7fca079f2700 1 Processor -- start 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.948+0000 7fca079f2700 1 -- start start 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013a620 0x7fca00139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca0013aa00 0x7fca000a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00154810 con 0x7fca00062e00 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca000aba70 con 0x7fca0013a620 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca079f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca000aaea0 con 0x7fca0013aa00 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50718/0 (socket says 172.21.15.133:50718) 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 -- 172.21.15.133:0/1927679306 learned_addr learned my addr 172.21.15.133:0/1927679306 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca04f8d700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013a620 0x7fca00139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca05f8f700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca0013aa00 0x7fca000a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 -- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca0013aa00 msgr2=0x7fca000a6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca0013aa00 0x7fca000a6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 -- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013a620 msgr2=0x7fca00139840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013a620 0x7fca00139840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.949+0000 7fca0578e700 1 -- 172.21.15.133:0/1927679306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9fc009370 con 0x7fca00062e00 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fca0578e700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fc9f000c4c0 tx=0x7fc9f0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000ce70 con 0x7fca00062e00 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0001e90 con 0x7fca00062e00 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f8009a20 con 0x7fca00062e00 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0007250 con 0x7fca00062e00 2024-01-21T20:14:54.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.950+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca000ab420 con 0x7fca00062e00 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.951+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca000abc20 con 0x7fca00062e00 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.951+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc9f00066a0 con 0x7fca00062e00 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.952+0000 7fc9f5ffb700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 0x7fc9e4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.952+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc9f0079dc0 con 0x7fca00062e00 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.952+0000 7fca04f8d700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 0x7fc9e4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:54.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.952+0000 7fca04f8d700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 0x7fc9e4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fca00156810 tx=0x7fc9fc0090f0).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:54.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:54.956+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9f004acc0 con 0x7fca00062e00 2024-01-21T20:14:55.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.119+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca001584f0 con 0x7fca00062e00 2024-01-21T20:14:55.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.120+0000 7fc9f5ffb700 1 -- 172.21.15.133:0/1927679306 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+17863 (secure 0 0 0) 0x7fca001584f0 con 0x7fca00062e00 2024-01-21T20:14:55.110 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:55.110 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":94,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:14:53.452347+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 msgr2=0x7fc9e4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 0x7fc9e4061730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fca00156810 tx=0x7fc9fc0090f0).stop 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 msgr2=0x7fca000aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7fc9f000c4c0 tx=0x7fc9f0007e00).stop 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 shutdown_connections 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc9e405f270 0x7fc9e4061730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca0013aa00 0x7fca000a6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca00062e00 0x7fca000aa2e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 --2- 172.21.15.133:0/1927679306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca0013a620 0x7fca00139840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 >> 172.21.15.133:0/1927679306 conn(0x7fca000c7dc0 msgr2=0x7fca00157580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 shutdown_connections 2024-01-21T20:14:55.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.122+0000 7fca079f2700 1 -- 172.21.15.133:0/1927679306 wait complete. 2024-01-21T20:14:55.124 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:14:55.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:14:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.249+0000 7fb78fe84700 1 Processor -- start 2024-01-21T20:14:55.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.250+0000 7fb78fe84700 1 -- start start 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78fe84700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb78813a830 0x7fb7880c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78fe84700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880c3890 con 0x7fb7880695b0 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78fe84700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7880c3b70 con 0x7fb78813ac10 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78fe84700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7880c3e50 con 0x7fb78813a830 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb78813a830 0x7fb7880c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb78813a830 0x7fb7880c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50734/0 (socket says 172.21.15.133:50734) 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 -- 172.21.15.133:0/4254499808 learned_addr learned my addr 172.21.15.133:0/4254499808 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78e421700 1 --1- 172.21.15.133:0/4254499808 >> v1:172.21.15.133:6789/0 conn(0x7fb7880695b0 0x7fb7880699c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59926/0 (socket says 172.21.15.133:59926) 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 -- 172.21.15.133:0/4254499808 >> v1:172.21.15.178:6789/0 conn(0x7fb78813ac10 legacy=0x7fb7880bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 -- 172.21.15.133:0/4254499808 >> v1:172.21.15.133:6789/0 conn(0x7fb7880695b0 legacy=0x7fb7880699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 -- 172.21.15.133:0/4254499808 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7880c4130 con 0x7fb78813a830 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.251+0000 7fb78dc20700 1 --2- 172.21.15.133:0/4254499808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb78813a830 0x7fb7880c3220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fb778006fd0 tx=0x7fb7780090f0).ready entity=mon.0 client_cookie=f40e1b2143f9c8a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78cc1e700 1 -- 172.21.15.133:0/4254499808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800b600 con 0x7fb78813a830 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78cc1e700 1 -- 172.21.15.133:0/4254499808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800b760 con 0x7fb78813a830 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78cc1e700 1 -- 172.21.15.133:0/4254499808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800bb00 con 0x7fb78813a830 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 -- 172.21.15.133:0/4254499808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb78813a830 msgr2=0x7fb7880c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4254499808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb78813a830 0x7fb7880c3220 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fb778006fd0 tx=0x7fb7780090f0).stop 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 -- 172.21.15.133:0/4254499808 shutdown_connections 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4254499808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb78813a830 0x7fb7880c3220 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 -- 172.21.15.133:0/4254499808 >> 172.21.15.133:0/4254499808 conn(0x7fb7880c7dc0 msgr2=0x7fb7880c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 -- 172.21.15.133:0/4254499808 shutdown_connections 2024-01-21T20:14:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.252+0000 7fb78fe84700 1 -- 172.21.15.133:0/4254499808 wait complete. 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.254+0000 7fb78fe84700 1 Processor -- start 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.254+0000 7fb78fe84700 1 -- start start 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 0x7fb7880bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 0x7fb7880bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7880c02d0 con 0x7fb7880695b0 2024-01-21T20:14:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb788163330 con 0x7fb78813ac10 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb788162740 con 0x7fb78813a830 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50744/0 (socket says 172.21.15.133:50744) 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 -- 172.21.15.133:0/4060652057 learned_addr learned my addr 172.21.15.133:0/4060652057 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78d41f700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 0x7fb7880bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78e421700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 0x7fb7880bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 -- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 msgr2=0x7fb7880bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 0x7fb7880bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 -- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 msgr2=0x7fb7880bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 0x7fb7880bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 -- 172.21.15.133:0/4060652057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb778009370 con 0x7fb7880695b0 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78d41f700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 0x7fb7880bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78e421700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 0x7fb7880bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78dc20700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fb778009f50 tx=0x7fb778017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77800b8d0 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77800ba30 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7880bf0c0 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778024680 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.255+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb788162ce0 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.256+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78805fdf0 con 0x7fb7880695b0 2024-01-21T20:14:55.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.257+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fb778021070 con 0x7fb7880695b0 2024-01-21T20:14:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.257+0000 7fb77e7fc700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 0x7fb76c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.257+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fb77807c120 con 0x7fb7880695b0 2024-01-21T20:14:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.257+0000 7fb78d41f700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 0x7fb76c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.258+0000 7fb78d41f700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 0x7fb76c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb7880bf510 tx=0x7fb784008040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.261+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb77804d0d0 con 0x7fb7880695b0 2024-01-21T20:14:55.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.422+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7880671a0 con 0x7fb76c05f270 2024-01-21T20:14:55.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.432+0000 7fb77e7fc700 1 -- 172.21.15.133:0/4060652057 <== mgr.6561 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350311 (secure 0 0 0) 0x7fb7880671a0 con 0x7fb76c05f270 2024-01-21T20:14:55.426 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 msgr2=0x7fb76c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 0x7fb76c061730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb7880bf510 tx=0x7fb784008040).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 msgr2=0x7fb788153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fb778009f50 tx=0x7fb778017000).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 shutdown_connections 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb76c05f270 0x7fb76c061730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb78813ac10 0x7fb7880bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7880695b0 0x7fb788153d40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 --2- 172.21.15.133:0/4060652057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb78813a830 0x7fb7880bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 >> 172.21.15.133:0/4060652057 conn(0x7fb7880c7dc0 msgr2=0x7fb7880aad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 shutdown_connections 2024-01-21T20:14:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.436+0000 7fb78fe84700 1 -- 172.21.15.133:0/4060652057 wait complete. 2024-01-21T20:14:55.430 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:14:55.437 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T20:14:53.533539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2418104,"kb_used_data":8568,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556616,"statfs":{"total":773094113280,"available":770617974784,"internally_reserved":0,"allocated":8773632,"data_stored":4485870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11235,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003971"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.482735+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:14:47.482735+0000","last_peered":"2024-01-21T20:14:47.482735+0000","last_clean":"2024-01-21T20:14:47.482735+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:14:47.482735+0000","last_undegraded":"2024-01-21T20:14:47.482735+0000","last_fullsized":"2024-01-21T20:14:47.482735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":77,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.479561+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:14:47.479561+0000","last_peered":"2024-01-21T20:14:47.479561+0000","last_clean":"2024-01-21T20:14:47.479561+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:14:47.479561+0000","last_undegraded":"2024-01-21T20:14:47.479561+0000","last_fullsized":"2024-01-21T20:14:47.479561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.551498+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:14:47.551498+0000","last_peered":"2024-01-21T20:14:47.551498+0000","last_clean":"2024-01-21T20:14:47.551498+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:14:47.551498+0000","last_undegraded":"2024-01-21T20:14:47.551498+0000","last_fullsized":"2024-01-21T20:14:47.551498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":77,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.479561+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:14:47.479561+0000","last_peered":"2024-01-21T20:14:47.479561+0000","last_clean":"2024-01-21T20:14:47.479561+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:14:47.479561+0000","last_undegraded":"2024-01-21T20:14:47.479561+0000","last_fullsized":"2024-01-21T20:14:47.479561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":71,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.552151+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:14:47.552151+0000","last_peered":"2024-01-21T20:14:47.552151+0000","last_clean":"2024-01-21T20:14:47.552151+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:14:47.552151+0000","last_undegraded":"2024-01-21T20:14:47.552151+0000","last_fullsized":"2024-01-21T20:14:47.552151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.552149+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:14:47.552149+0000","last_peered":"2024-01-21T20:14:47.552149+0000","last_clean":"2024-01-21T20:14:47.552149+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:14:47.552149+0000","last_undegraded":"2024-01-21T20:14:47.552149+0000","last_fullsized":"2024-01-21T20:14:47.552149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.552121+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:14:47.552121+0000","last_peered":"2024-01-21T20:14:47.552121+0000","last_clean":"2024-01-21T20:14:47.552121+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:14:47.552121+0000","last_undegraded":"2024-01-21T20:14:47.552121+0000","last_fullsized":"2024-01-21T20:14:47.552121+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.482850+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:14:47.482850+0000","last_peered":"2024-01-21T20:14:47.482850+0000","last_clean":"2024-01-21T20:14:47.482850+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:14:47.482850+0000","last_undegraded":"2024-01-21T20:14:47.482850+0000","last_fullsized":"2024-01-21T20:14:47.482850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:52.065943+0000","last_change":"2024-01-21T20:14:52.065943+0000","last_active":"2024-01-21T20:14:52.065943+0000","last_peered":"2024-01-21T20:14:52.065943+0000","last_clean":"2024-01-21T20:14:52.065943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:52.065943+0000","last_undegraded":"2024-01-21T20:14:52.065943+0000","last_fullsized":"2024-01-21T20:14:52.065943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:14:51.063620+0000","last_change":"2024-01-21T20:14:51.063620+0000","last_active":"2024-01-21T20:14:51.063620+0000","last_peered":"2024-01-21T20:14:51.063620+0000","last_clean":"2024-01-21T20:14:51.063620+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:14:51.063620+0000","last_undegraded":"2024-01-21T20:14:51.063620+0000","last_fullsized":"2024-01-21T20:14:51.063620+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":67,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-01-21T20:14:47.552255+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:14:47.552255+0000","last_peered":"2024-01-21T20:14:47.552255+0000","last_clean":"2024-01-21T20:14:47.552255+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:14:47.552255+0000","last_undegraded":"2024-01-21T20:14:47.552255+0000","last_fullsized":"2024-01-21T20:14:47.552255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302260,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069580,"statfs":{"total":96636764160,"available":96327249920,"internally_reserved":0,"allocated":1093632,"data_stored":560013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.54300000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.504},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.41999999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.621}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.67500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.61899999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.497},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.64500000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.70999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.32800000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.309},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.28100000000000003}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.318},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.38600000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.55700000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298164,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073676,"statfs":{"total":96636764160,"available":96331444224,"internally_reserved":0,"allocated":1093632,"data_stored":560013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.313}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.629},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.38300000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.46200000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.435},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.40000000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.79600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.33500000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.35099999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.58499999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302264,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.746}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.76600000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.61799999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.85299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065480,"statfs":{"total":96636764160,"available":96323051520,"internally_reserved":0,"allocated":1097728,"data_stored":560974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.63},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.498}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:14:55.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:14:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.604+0000 7fefbf2f6700 1 Processor -- start 2024-01-21T20:14:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.604+0000 7fefbf2f6700 1 -- start start 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbf2f6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefb80695b0 0x7fefb8069a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbf2f6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fefb80bd020 0x7fefb80bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbf2f6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80c46d0 con 0x7fefb814b6c0 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbf2f6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb814baa0 con 0x7fefb80695b0 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbf2f6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb8069f20 con 0x7fefb80bd020 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbc891700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefb80695b0 0x7fefb8069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbd092700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefb814b6c0 0x7fefb80c2f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59940/0 (socket says 172.21.15.133:59940) 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbd092700 1 -- 172.21.15.133:0/4048180728 learned_addr learned my addr 172.21.15.133:0/4048180728 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbd893700 1 --2- 172.21.15.133:0/4048180728 >> v2:172.21.15.178:3300/0 conn(0x7fefb80bd020 0x7fefb80bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbc891700 1 -- 172.21.15.133:0/4048180728 >> v2:172.21.15.178:3300/0 conn(0x7fefb80bd020 msgr2=0x7fefb80bd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbc891700 1 --2- 172.21.15.133:0/4048180728 >> v2:172.21.15.178:3300/0 conn(0x7fefb80bd020 0x7fefb80bd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbc891700 1 -- 172.21.15.133:0/4048180728 >> v1:172.21.15.133:6789/0 conn(0x7fefb814b6c0 legacy=0x7fefb80c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefaffff700 1 -- 172.21.15.133:0/4048180728 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160491737 0 0) 0x7fefb80c46d0 con 0x7fefb814b6c0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.605+0000 7fefbc891700 1 -- 172.21.15.133:0/4048180728 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80c3ac0 con 0x7fefb80695b0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbc891700 1 --2- 172.21.15.133:0/4048180728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb8069a30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fefb8155c80 tx=0x7fefb4009060).ready entity=mon.0 client_cookie=a6546f53c962a070 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefaffff700 1 -- 172.21.15.133:0/4048180728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40090d0 con 0x7fefb80695b0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefaffff700 1 -- 172.21.15.133:0/4048180728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400b580 con 0x7fefb80695b0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefaffff700 1 -- 172.21.15.133:0/4048180728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400b900 con 0x7fefb80695b0 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 -- 172.21.15.133:0/4048180728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 msgr2=0x7fefb8069a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/4048180728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb8069a30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7fefb8155c80 tx=0x7fefb4009060).stop 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 -- 172.21.15.133:0/4048180728 shutdown_connections 2024-01-21T20:14:55.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/4048180728 >> v2:172.21.15.178:3300/0 conn(0x7fefb80bd020 0x7fefb80bd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/4048180728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb8069a30 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 -- 172.21.15.133:0/4048180728 >> 172.21.15.133:0/4048180728 conn(0x7fefb80c7de0 msgr2=0x7fefb80c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 -- 172.21.15.133:0/4048180728 shutdown_connections 2024-01-21T20:14:55.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.606+0000 7fefbf2f6700 1 -- 172.21.15.133:0/4048180728 wait complete. 2024-01-21T20:14:55.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.607+0000 7fefbf2f6700 1 Processor -- start 2024-01-21T20:14:55.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 -- start start 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb80bd020 0x7fefb81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb814b6c0 0x7fefb8168310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80bf370 con 0x7fefb80695b0 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81543e0 con 0x7fefb814b6c0 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbf2f6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8169240 con 0x7fefb80bd020 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbd092700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbd092700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50764/0 (socket says 172.21.15.133:50764) 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.608+0000 7fefbd092700 1 -- 172.21.15.133:0/2709572214 learned_addr learned my addr 172.21.15.133:0/2709572214 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 -- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb80bd020 msgr2=0x7fefb81456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb80bd020 0x7fefb81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 -- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb814b6c0 msgr2=0x7fefb8168310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb814b6c0 0x7fefb8168310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:55.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 -- 172.21.15.133:0/2709572214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40092a0 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbd092700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fefa800c510 tx=0x7fefa8007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80072e0 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa8007440 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb81540b0 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80057a0 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.609+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8168f60 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.610+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb8067200 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.611+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fefa8005bd0 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.611+0000 7fefadffb700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 0x7fef9c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.611+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fefa8079e60 con 0x7fefb80695b0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.611+0000 7fefbc891700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 0x7fef9c061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.611+0000 7fefbc891700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 0x7fef9c061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fefb80ae010 tx=0x7fefb4017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.615+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fefa804ad60 con 0x7fefb80695b0 2024-01-21T20:14:55.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.776+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefb80c3da0 con 0x7fef9c05f270 2024-01-21T20:14:55.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.786+0000 7fefadffb700 1 -- 172.21.15.133:0/2709572214 <== mgr.6561 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361605 (secure 0 0 0) 0x7fefb80c3da0 con 0x7fef9c05f270 2024-01-21T20:14:55.780 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 msgr2=0x7fef9c061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 0x7fef9c061730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fefb80ae010 tx=0x7fefb4017000).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 msgr2=0x7fefb80bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7fefa800c510 tx=0x7fefa8007c70).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 shutdown_connections 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef9c05f270 0x7fef9c061730 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb814b6c0 0x7fefb8168310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb80695b0 0x7fefb80bee80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 --2- 172.21.15.133:0/2709572214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb80bd020 0x7fefb81456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 >> 172.21.15.133:0/2709572214 conn(0x7fefb80c7de0 msgr2=0x7fefb80c2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 shutdown_connections 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.789+0000 7fefbf2f6700 1 -- 172.21.15.133:0/2709572214 wait complete. 2024-01-21T20:14:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:14:55.791 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T20:14:55.533834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418552,"kb_used_data":9016,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752556168,"statfs":{"total":773094113280,"available":770617516032,"internally_reserved":0,"allocated":9232384,"data_stored":4723434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11235,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003971"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479404+0000","last_change":"2024-01-21T20:14:52.472153+0000","last_active":"2024-01-21T20:14:52.479404+0000","last_peered":"2024-01-21T20:14:52.479404+0000","last_clean":"2024-01-21T20:14:52.479404+0000","last_became_active":"2024-01-21T20:14:52.471851+0000","last_became_peered":"2024-01-21T20:14:52.471851+0000","last_unstale":"2024-01-21T20:14:52.479404+0000","last_undegraded":"2024-01-21T20:14:52.479404+0000","last_fullsized":"2024-01-21T20:14:52.479404+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479632+0000","last_change":"2024-01-21T20:14:52.090032+0000","last_active":"2024-01-21T20:14:52.479632+0000","last_peered":"2024-01-21T20:14:52.479632+0000","last_clean":"2024-01-21T20:14:52.479632+0000","last_became_active":"2024-01-21T20:14:52.089699+0000","last_became_peered":"2024-01-21T20:14:52.089699+0000","last_unstale":"2024-01-21T20:14:52.479632+0000","last_undegraded":"2024-01-21T20:14:52.479632+0000","last_fullsized":"2024-01-21T20:14:52.479632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.474482+0000","last_change":"2024-01-21T20:14:52.471402+0000","last_active":"2024-01-21T20:14:52.474482+0000","last_peered":"2024-01-21T20:14:52.474482+0000","last_clean":"2024-01-21T20:14:52.474482+0000","last_became_active":"2024-01-21T20:14:52.470777+0000","last_became_peered":"2024-01-21T20:14:52.470777+0000","last_unstale":"2024-01-21T20:14:52.474482+0000","last_undegraded":"2024-01-21T20:14:52.474482+0000","last_fullsized":"2024-01-21T20:14:52.474482+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.468993+0000","last_change":"2024-01-21T20:14:52.098741+0000","last_active":"2024-01-21T20:14:52.468993+0000","last_peered":"2024-01-21T20:14:52.468993+0000","last_clean":"2024-01-21T20:14:52.468993+0000","last_became_active":"2024-01-21T20:14:52.098435+0000","last_became_peered":"2024-01-21T20:14:52.098435+0000","last_unstale":"2024-01-21T20:14:52.468993+0000","last_undegraded":"2024-01-21T20:14:52.468993+0000","last_fullsized":"2024-01-21T20:14:52.468993+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.470920+0000","last_change":"2024-01-21T20:14:52.468477+0000","last_active":"2024-01-21T20:14:52.470920+0000","last_peered":"2024-01-21T20:14:52.470920+0000","last_clean":"2024-01-21T20:14:52.470920+0000","last_became_active":"2024-01-21T20:14:52.468202+0000","last_became_peered":"2024-01-21T20:14:52.468202+0000","last_unstale":"2024-01-21T20:14:52.470920+0000","last_undegraded":"2024-01-21T20:14:52.470920+0000","last_fullsized":"2024-01-21T20:14:52.470920+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461448+0000","last_change":"2024-01-21T20:14:52.093008+0000","last_active":"2024-01-21T20:14:52.461448+0000","last_peered":"2024-01-21T20:14:52.461448+0000","last_clean":"2024-01-21T20:14:52.461448+0000","last_became_active":"2024-01-21T20:14:52.092680+0000","last_became_peered":"2024-01-21T20:14:52.092680+0000","last_unstale":"2024-01-21T20:14:52.461448+0000","last_undegraded":"2024-01-21T20:14:52.461448+0000","last_fullsized":"2024-01-21T20:14:52.461448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479456+0000","last_change":"2024-01-21T20:14:52.472562+0000","last_active":"2024-01-21T20:14:52.479456+0000","last_peered":"2024-01-21T20:14:52.479456+0000","last_clean":"2024-01-21T20:14:52.479456+0000","last_became_active":"2024-01-21T20:14:52.472033+0000","last_became_peered":"2024-01-21T20:14:52.472033+0000","last_unstale":"2024-01-21T20:14:52.479456+0000","last_undegraded":"2024-01-21T20:14:52.479456+0000","last_fullsized":"2024-01-21T20:14:52.479456+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.474779+0000","last_change":"2024-01-21T20:14:52.087560+0000","last_active":"2024-01-21T20:14:52.474779+0000","last_peered":"2024-01-21T20:14:52.474779+0000","last_clean":"2024-01-21T20:14:52.474779+0000","last_became_active":"2024-01-21T20:14:52.087349+0000","last_became_peered":"2024-01-21T20:14:52.087349+0000","last_unstale":"2024-01-21T20:14:52.474779+0000","last_undegraded":"2024-01-21T20:14:52.474779+0000","last_fullsized":"2024-01-21T20:14:52.474779+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.466060+0000","last_change":"2024-01-21T20:14:52.463516+0000","last_active":"2024-01-21T20:14:52.466060+0000","last_peered":"2024-01-21T20:14:52.466060+0000","last_clean":"2024-01-21T20:14:52.466060+0000","last_became_active":"2024-01-21T20:14:52.462799+0000","last_became_peered":"2024-01-21T20:14:52.462799+0000","last_unstale":"2024-01-21T20:14:52.466060+0000","last_undegraded":"2024-01-21T20:14:52.466060+0000","last_fullsized":"2024-01-21T20:14:52.466060+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.472674+0000","last_change":"2024-01-21T20:14:52.087198+0000","last_active":"2024-01-21T20:14:52.472674+0000","last_peered":"2024-01-21T20:14:52.472674+0000","last_clean":"2024-01-21T20:14:52.472674+0000","last_became_active":"2024-01-21T20:14:52.086917+0000","last_became_peered":"2024-01-21T20:14:52.086917+0000","last_unstale":"2024-01-21T20:14:52.472674+0000","last_undegraded":"2024-01-21T20:14:52.472674+0000","last_fullsized":"2024-01-21T20:14:52.472674+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.480696+0000","last_change":"2024-01-21T20:14:52.478280+0000","last_active":"2024-01-21T20:14:52.480696+0000","last_peered":"2024-01-21T20:14:52.480696+0000","last_clean":"2024-01-21T20:14:52.480696+0000","last_became_active":"2024-01-21T20:14:52.477926+0000","last_became_peered":"2024-01-21T20:14:52.477926+0000","last_unstale":"2024-01-21T20:14:52.480696+0000","last_undegraded":"2024-01-21T20:14:52.480696+0000","last_fullsized":"2024-01-21T20:14:52.480696+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3a","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.473233+0000","last_change":"2024-01-21T20:14:52.098618+0000","last_active":"2024-01-21T20:14:52.473233+0000","last_peered":"2024-01-21T20:14:52.473233+0000","last_clean":"2024-01-21T20:14:52.473233+0000","last_became_active":"2024-01-21T20:14:52.098334+0000","last_became_peered":"2024-01-21T20:14:52.098334+0000","last_unstale":"2024-01-21T20:14:52.473233+0000","last_undegraded":"2024-01-21T20:14:52.473233+0000","last_fullsized":"2024-01-21T20:14:52.473233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477403+0000","last_change":"2024-01-21T20:14:52.470444+0000","last_active":"2024-01-21T20:14:52.477403+0000","last_peered":"2024-01-21T20:14:52.477403+0000","last_clean":"2024-01-21T20:14:52.477403+0000","last_became_active":"2024-01-21T20:14:52.470220+0000","last_became_peered":"2024-01-21T20:14:52.470220+0000","last_unstale":"2024-01-21T20:14:52.477403+0000","last_undegraded":"2024-01-21T20:14:52.477403+0000","last_fullsized":"2024-01-21T20:14:52.477403+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.458325+0000","last_change":"2024-01-21T20:14:52.089103+0000","last_active":"2024-01-21T20:14:52.458325+0000","last_peered":"2024-01-21T20:14:52.458325+0000","last_clean":"2024-01-21T20:14:52.458325+0000","last_became_active":"2024-01-21T20:14:52.088814+0000","last_became_peered":"2024-01-21T20:14:52.088814+0000","last_unstale":"2024-01-21T20:14:52.458325+0000","last_undegraded":"2024-01-21T20:14:52.458325+0000","last_fullsized":"2024-01-21T20:14:52.458325+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477588+0000","last_change":"2024-01-21T20:14:52.475108+0000","last_active":"2024-01-21T20:14:52.477588+0000","last_peered":"2024-01-21T20:14:52.477588+0000","last_clean":"2024-01-21T20:14:52.477588+0000","last_became_active":"2024-01-21T20:14:52.474812+0000","last_became_peered":"2024-01-21T20:14:52.474812+0000","last_unstale":"2024-01-21T20:14:52.477588+0000","last_undegraded":"2024-01-21T20:14:52.477588+0000","last_fullsized":"2024-01-21T20:14:52.477588+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.464179+0000","last_change":"2024-01-21T20:14:52.103706+0000","last_active":"2024-01-21T20:14:52.464179+0000","last_peered":"2024-01-21T20:14:52.464179+0000","last_clean":"2024-01-21T20:14:52.464179+0000","last_became_active":"2024-01-21T20:14:52.103409+0000","last_became_peered":"2024-01-21T20:14:52.103409+0000","last_unstale":"2024-01-21T20:14:52.464179+0000","last_undegraded":"2024-01-21T20:14:52.464179+0000","last_fullsized":"2024-01-21T20:14:52.464179+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476689+0000","last_change":"2024-01-21T20:14:52.469486+0000","last_active":"2024-01-21T20:14:52.476689+0000","last_peered":"2024-01-21T20:14:52.476689+0000","last_clean":"2024-01-21T20:14:52.476689+0000","last_became_active":"2024-01-21T20:14:52.469128+0000","last_became_peered":"2024-01-21T20:14:52.469128+0000","last_unstale":"2024-01-21T20:14:52.476689+0000","last_undegraded":"2024-01-21T20:14:52.476689+0000","last_fullsized":"2024-01-21T20:14:52.476689+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461536+0000","last_change":"2024-01-21T20:14:52.096904+0000","last_active":"2024-01-21T20:14:52.461536+0000","last_peered":"2024-01-21T20:14:52.461536+0000","last_clean":"2024-01-21T20:14:52.461536+0000","last_became_active":"2024-01-21T20:14:52.095999+0000","last_became_peered":"2024-01-21T20:14:52.095999+0000","last_unstale":"2024-01-21T20:14:52.461536+0000","last_undegraded":"2024-01-21T20:14:52.461536+0000","last_fullsized":"2024-01-21T20:14:52.461536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479510+0000","last_change":"2024-01-21T20:14:52.476703+0000","last_active":"2024-01-21T20:14:52.479510+0000","last_peered":"2024-01-21T20:14:52.479510+0000","last_clean":"2024-01-21T20:14:52.479510+0000","last_became_active":"2024-01-21T20:14:52.476447+0000","last_became_peered":"2024-01-21T20:14:52.476447+0000","last_unstale":"2024-01-21T20:14:52.479510+0000","last_undegraded":"2024-01-21T20:14:52.479510+0000","last_fullsized":"2024-01-21T20:14:52.479510+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.457984+0000","last_change":"2024-01-21T20:14:52.094246+0000","last_active":"2024-01-21T20:14:52.457984+0000","last_peered":"2024-01-21T20:14:52.457984+0000","last_clean":"2024-01-21T20:14:52.457984+0000","last_became_active":"2024-01-21T20:14:52.093448+0000","last_became_peered":"2024-01-21T20:14:52.093448+0000","last_unstale":"2024-01-21T20:14:52.457984+0000","last_undegraded":"2024-01-21T20:14:52.457984+0000","last_fullsized":"2024-01-21T20:14:52.457984+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479800+0000","last_change":"2024-01-21T20:14:52.477314+0000","last_active":"2024-01-21T20:14:52.479800+0000","last_peered":"2024-01-21T20:14:52.479800+0000","last_clean":"2024-01-21T20:14:52.479800+0000","last_became_active":"2024-01-21T20:14:52.477029+0000","last_became_peered":"2024-01-21T20:14:52.477029+0000","last_unstale":"2024-01-21T20:14:52.479800+0000","last_undegraded":"2024-01-21T20:14:52.479800+0000","last_fullsized":"2024-01-21T20:14:52.479800+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.464528+0000","last_change":"2024-01-21T20:14:52.091964+0000","last_active":"2024-01-21T20:14:52.464528+0000","last_peered":"2024-01-21T20:14:52.464528+0000","last_clean":"2024-01-21T20:14:52.464528+0000","last_became_active":"2024-01-21T20:14:52.091645+0000","last_became_peered":"2024-01-21T20:14:52.091645+0000","last_unstale":"2024-01-21T20:14:52.464528+0000","last_undegraded":"2024-01-21T20:14:52.464528+0000","last_fullsized":"2024-01-21T20:14:52.464528+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479438+0000","last_change":"2024-01-21T20:14:52.468918+0000","last_active":"2024-01-21T20:14:52.479438+0000","last_peered":"2024-01-21T20:14:52.479438+0000","last_clean":"2024-01-21T20:14:52.479438+0000","last_became_active":"2024-01-21T20:14:52.468678+0000","last_became_peered":"2024-01-21T20:14:52.468678+0000","last_unstale":"2024-01-21T20:14:52.479438+0000","last_undegraded":"2024-01-21T20:14:52.479438+0000","last_fullsized":"2024-01-21T20:14:52.479438+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.490425+0000","last_change":"2024-01-21T20:14:52.099135+0000","last_active":"2024-01-21T20:14:52.490425+0000","last_peered":"2024-01-21T20:14:52.490425+0000","last_clean":"2024-01-21T20:14:52.490425+0000","last_became_active":"2024-01-21T20:14:52.098532+0000","last_became_peered":"2024-01-21T20:14:52.098532+0000","last_unstale":"2024-01-21T20:14:52.490425+0000","last_undegraded":"2024-01-21T20:14:52.490425+0000","last_fullsized":"2024-01-21T20:14:52.490425+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.471375+0000","last_change":"2024-01-21T20:14:52.470402+0000","last_active":"2024-01-21T20:14:52.471375+0000","last_peered":"2024-01-21T20:14:52.471375+0000","last_clean":"2024-01-21T20:14:52.471375+0000","last_became_active":"2024-01-21T20:14:52.470012+0000","last_became_peered":"2024-01-21T20:14:52.470012+0000","last_unstale":"2024-01-21T20:14:52.471375+0000","last_undegraded":"2024-01-21T20:14:52.471375+0000","last_fullsized":"2024-01-21T20:14:52.471375+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.33","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.474674+0000","last_change":"2024-01-21T20:14:52.098870+0000","last_active":"2024-01-21T20:14:52.474674+0000","last_peered":"2024-01-21T20:14:52.474674+0000","last_clean":"2024-01-21T20:14:52.474674+0000","last_became_active":"2024-01-21T20:14:52.098579+0000","last_became_peered":"2024-01-21T20:14:52.098579+0000","last_unstale":"2024-01-21T20:14:52.474674+0000","last_undegraded":"2024-01-21T20:14:52.474674+0000","last_fullsized":"2024-01-21T20:14:52.474674+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478226+0000","last_change":"2024-01-21T20:14:52.475349+0000","last_active":"2024-01-21T20:14:52.478226+0000","last_peered":"2024-01-21T20:14:52.478226+0000","last_clean":"2024-01-21T20:14:52.478226+0000","last_became_active":"2024-01-21T20:14:52.474793+0000","last_became_peered":"2024-01-21T20:14:52.474793+0000","last_unstale":"2024-01-21T20:14:52.478226+0000","last_undegraded":"2024-01-21T20:14:52.478226+0000","last_fullsized":"2024-01-21T20:14:52.478226+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461137+0000","last_change":"2024-01-21T20:14:52.086621+0000","last_active":"2024-01-21T20:14:52.461137+0000","last_peered":"2024-01-21T20:14:52.461137+0000","last_clean":"2024-01-21T20:14:52.461137+0000","last_became_active":"2024-01-21T20:14:52.086355+0000","last_became_peered":"2024-01-21T20:14:52.086355+0000","last_unstale":"2024-01-21T20:14:52.461137+0000","last_undegraded":"2024-01-21T20:14:52.461137+0000","last_fullsized":"2024-01-21T20:14:52.461137+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477497+0000","last_change":"2024-01-21T20:14:52.475580+0000","last_active":"2024-01-21T20:14:52.477497+0000","last_peered":"2024-01-21T20:14:52.477497+0000","last_clean":"2024-01-21T20:14:52.477497+0000","last_became_active":"2024-01-21T20:14:52.475343+0000","last_became_peered":"2024-01-21T20:14:52.475343+0000","last_unstale":"2024-01-21T20:14:52.477497+0000","last_undegraded":"2024-01-21T20:14:52.477497+0000","last_fullsized":"2024-01-21T20:14:52.477497+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455047+0000","last_change":"2024-01-21T20:14:52.093609+0000","last_active":"2024-01-21T20:14:52.455047+0000","last_peered":"2024-01-21T20:14:52.455047+0000","last_clean":"2024-01-21T20:14:52.455047+0000","last_became_active":"2024-01-21T20:14:52.093336+0000","last_became_peered":"2024-01-21T20:14:52.093336+0000","last_unstale":"2024-01-21T20:14:52.455047+0000","last_undegraded":"2024-01-21T20:14:52.455047+0000","last_fullsized":"2024-01-21T20:14:52.455047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.469355+0000","last_change":"2024-01-21T20:14:52.468087+0000","last_active":"2024-01-21T20:14:52.469355+0000","last_peered":"2024-01-21T20:14:52.469355+0000","last_clean":"2024-01-21T20:14:52.469355+0000","last_became_active":"2024-01-21T20:14:52.467735+0000","last_became_peered":"2024-01-21T20:14:52.467735+0000","last_unstale":"2024-01-21T20:14:52.469355+0000","last_undegraded":"2024-01-21T20:14:52.469355+0000","last_fullsized":"2024-01-21T20:14:52.469355+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.480576+0000","last_change":"2024-01-21T20:14:52.101898+0000","last_active":"2024-01-21T20:14:52.480576+0000","last_peered":"2024-01-21T20:14:52.480576+0000","last_clean":"2024-01-21T20:14:52.480576+0000","last_became_active":"2024-01-21T20:14:52.101577+0000","last_became_peered":"2024-01-21T20:14:52.101577+0000","last_unstale":"2024-01-21T20:14:52.480576+0000","last_undegraded":"2024-01-21T20:14:52.480576+0000","last_fullsized":"2024-01-21T20:14:52.480576+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477357+0000","last_change":"2024-01-21T20:14:52.469905+0000","last_active":"2024-01-21T20:14:52.477357+0000","last_peered":"2024-01-21T20:14:52.477357+0000","last_clean":"2024-01-21T20:14:52.477357+0000","last_became_active":"2024-01-21T20:14:52.469602+0000","last_became_peered":"2024-01-21T20:14:52.469602+0000","last_unstale":"2024-01-21T20:14:52.477357+0000","last_undegraded":"2024-01-21T20:14:52.477357+0000","last_fullsized":"2024-01-21T20:14:52.477357+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461628+0000","last_change":"2024-01-21T20:14:52.097119+0000","last_active":"2024-01-21T20:14:52.461628+0000","last_peered":"2024-01-21T20:14:52.461628+0000","last_clean":"2024-01-21T20:14:52.461628+0000","last_became_active":"2024-01-21T20:14:52.096249+0000","last_became_peered":"2024-01-21T20:14:52.096249+0000","last_unstale":"2024-01-21T20:14:52.461628+0000","last_undegraded":"2024-01-21T20:14:52.461628+0000","last_fullsized":"2024-01-21T20:14:52.461628+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.470001+0000","last_change":"2024-01-21T20:14:52.464170+0000","last_active":"2024-01-21T20:14:52.470001+0000","last_peered":"2024-01-21T20:14:52.470001+0000","last_clean":"2024-01-21T20:14:52.470001+0000","last_became_active":"2024-01-21T20:14:52.463814+0000","last_became_peered":"2024-01-21T20:14:52.463814+0000","last_unstale":"2024-01-21T20:14:52.470001+0000","last_undegraded":"2024-01-21T20:14:52.470001+0000","last_fullsized":"2024-01-21T20:14:52.470001+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.466982+0000","last_change":"2024-01-21T20:14:52.099461+0000","last_active":"2024-01-21T20:14:52.466982+0000","last_peered":"2024-01-21T20:14:52.466982+0000","last_clean":"2024-01-21T20:14:52.466982+0000","last_became_active":"2024-01-21T20:14:52.099155+0000","last_became_peered":"2024-01-21T20:14:52.099155+0000","last_unstale":"2024-01-21T20:14:52.466982+0000","last_undegraded":"2024-01-21T20:14:52.466982+0000","last_fullsized":"2024-01-21T20:14:52.466982+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478992+0000","last_change":"2024-01-21T20:14:52.468076+0000","last_active":"2024-01-21T20:14:52.478992+0000","last_peered":"2024-01-21T20:14:52.478992+0000","last_clean":"2024-01-21T20:14:52.478992+0000","last_became_active":"2024-01-21T20:14:52.467884+0000","last_became_peered":"2024-01-21T20:14:52.467884+0000","last_unstale":"2024-01-21T20:14:52.478992+0000","last_undegraded":"2024-01-21T20:14:52.478992+0000","last_fullsized":"2024-01-21T20:14:52.478992+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479844+0000","last_change":"2024-01-21T20:14:52.098799+0000","last_active":"2024-01-21T20:14:52.479844+0000","last_peered":"2024-01-21T20:14:52.479844+0000","last_clean":"2024-01-21T20:14:52.479844+0000","last_became_active":"2024-01-21T20:14:52.098447+0000","last_became_peered":"2024-01-21T20:14:52.098447+0000","last_unstale":"2024-01-21T20:14:52.479844+0000","last_undegraded":"2024-01-21T20:14:52.479844+0000","last_fullsized":"2024-01-21T20:14:52.479844+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477683+0000","last_change":"2024-01-21T20:14:52.476301+0000","last_active":"2024-01-21T20:14:52.477683+0000","last_peered":"2024-01-21T20:14:52.477683+0000","last_clean":"2024-01-21T20:14:52.477683+0000","last_became_active":"2024-01-21T20:14:52.475860+0000","last_became_peered":"2024-01-21T20:14:52.475860+0000","last_unstale":"2024-01-21T20:14:52.477683+0000","last_undegraded":"2024-01-21T20:14:52.477683+0000","last_fullsized":"2024-01-21T20:14:52.477683+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455211+0000","last_change":"2024-01-21T20:14:52.095740+0000","last_active":"2024-01-21T20:14:52.455211+0000","last_peered":"2024-01-21T20:14:52.455211+0000","last_clean":"2024-01-21T20:14:52.455211+0000","last_became_active":"2024-01-21T20:14:52.095422+0000","last_became_peered":"2024-01-21T20:14:52.095422+0000","last_unstale":"2024-01-21T20:14:52.455211+0000","last_undegraded":"2024-01-21T20:14:52.455211+0000","last_fullsized":"2024-01-21T20:14:52.455211+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481036+0000","last_change":"2024-01-21T20:14:52.474410+0000","last_active":"2024-01-21T20:14:52.481036+0000","last_peered":"2024-01-21T20:14:52.481036+0000","last_clean":"2024-01-21T20:14:52.481036+0000","last_became_active":"2024-01-21T20:14:52.474155+0000","last_became_peered":"2024-01-21T20:14:52.474155+0000","last_unstale":"2024-01-21T20:14:52.481036+0000","last_undegraded":"2024-01-21T20:14:52.481036+0000","last_fullsized":"2024-01-21T20:14:52.481036+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478098+0000","last_change":"2024-01-21T20:14:52.095310+0000","last_active":"2024-01-21T20:14:52.478098+0000","last_peered":"2024-01-21T20:14:52.478098+0000","last_clean":"2024-01-21T20:14:52.478098+0000","last_became_active":"2024-01-21T20:14:52.095001+0000","last_became_peered":"2024-01-21T20:14:52.095001+0000","last_unstale":"2024-01-21T20:14:52.478098+0000","last_undegraded":"2024-01-21T20:14:52.478098+0000","last_fullsized":"2024-01-21T20:14:52.478098+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476174+0000","last_change":"2024-01-21T20:14:52.473142+0000","last_active":"2024-01-21T20:14:52.476174+0000","last_peered":"2024-01-21T20:14:52.476174+0000","last_clean":"2024-01-21T20:14:52.476174+0000","last_became_active":"2024-01-21T20:14:52.472843+0000","last_became_peered":"2024-01-21T20:14:52.472843+0000","last_unstale":"2024-01-21T20:14:52.476174+0000","last_undegraded":"2024-01-21T20:14:52.476174+0000","last_fullsized":"2024-01-21T20:14:52.476174+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.456631+0000","last_change":"2024-01-21T20:14:52.093982+0000","last_active":"2024-01-21T20:14:52.456631+0000","last_peered":"2024-01-21T20:14:52.456631+0000","last_clean":"2024-01-21T20:14:52.456631+0000","last_became_active":"2024-01-21T20:14:52.093192+0000","last_became_peered":"2024-01-21T20:14:52.093192+0000","last_unstale":"2024-01-21T20:14:52.456631+0000","last_undegraded":"2024-01-21T20:14:52.456631+0000","last_fullsized":"2024-01-21T20:14:52.456631+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479614+0000","last_change":"2024-01-21T20:14:52.473897+0000","last_active":"2024-01-21T20:14:52.479614+0000","last_peered":"2024-01-21T20:14:52.479614+0000","last_clean":"2024-01-21T20:14:52.479614+0000","last_became_active":"2024-01-21T20:14:52.473630+0000","last_became_peered":"2024-01-21T20:14:52.473630+0000","last_unstale":"2024-01-21T20:14:52.479614+0000","last_undegraded":"2024-01-21T20:14:52.479614+0000","last_fullsized":"2024-01-21T20:14:52.479614+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461330+0000","last_change":"2024-01-21T20:14:52.095826+0000","last_active":"2024-01-21T20:14:52.461330+0000","last_peered":"2024-01-21T20:14:52.461330+0000","last_clean":"2024-01-21T20:14:52.461330+0000","last_became_active":"2024-01-21T20:14:52.095537+0000","last_became_peered":"2024-01-21T20:14:52.095537+0000","last_unstale":"2024-01-21T20:14:52.461330+0000","last_undegraded":"2024-01-21T20:14:52.461330+0000","last_fullsized":"2024-01-21T20:14:52.461330+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481202+0000","last_change":"2024-01-21T20:14:52.476732+0000","last_active":"2024-01-21T20:14:52.481202+0000","last_peered":"2024-01-21T20:14:52.481202+0000","last_clean":"2024-01-21T20:14:52.481202+0000","last_became_active":"2024-01-21T20:14:52.476471+0000","last_became_peered":"2024-01-21T20:14:52.476471+0000","last_unstale":"2024-01-21T20:14:52.481202+0000","last_undegraded":"2024-01-21T20:14:52.481202+0000","last_fullsized":"2024-01-21T20:14:52.481202+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461498+0000","last_change":"2024-01-21T20:14:52.101799+0000","last_active":"2024-01-21T20:14:52.461498+0000","last_peered":"2024-01-21T20:14:52.461498+0000","last_clean":"2024-01-21T20:14:52.461498+0000","last_became_active":"2024-01-21T20:14:52.101478+0000","last_became_peered":"2024-01-21T20:14:52.101478+0000","last_unstale":"2024-01-21T20:14:52.461498+0000","last_undegraded":"2024-01-21T20:14:52.461498+0000","last_fullsized":"2024-01-21T20:14:52.461498+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477671+0000","last_change":"2024-01-21T20:14:52.475164+0000","last_active":"2024-01-21T20:14:52.477671+0000","last_peered":"2024-01-21T20:14:52.477671+0000","last_clean":"2024-01-21T20:14:52.477671+0000","last_became_active":"2024-01-21T20:14:52.474883+0000","last_became_peered":"2024-01-21T20:14:52.474883+0000","last_unstale":"2024-01-21T20:14:52.477671+0000","last_undegraded":"2024-01-21T20:14:52.477671+0000","last_fullsized":"2024-01-21T20:14:52.477671+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455608+0000","last_change":"2024-01-21T20:14:52.086975+0000","last_active":"2024-01-21T20:14:52.455608+0000","last_peered":"2024-01-21T20:14:52.455608+0000","last_clean":"2024-01-21T20:14:52.455608+0000","last_became_active":"2024-01-21T20:14:52.086686+0000","last_became_peered":"2024-01-21T20:14:52.086686+0000","last_unstale":"2024-01-21T20:14:52.455608+0000","last_undegraded":"2024-01-21T20:14:52.455608+0000","last_fullsized":"2024-01-21T20:14:52.455608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.480823+0000","last_change":"2024-01-21T20:14:52.478407+0000","last_active":"2024-01-21T20:14:52.480823+0000","last_peered":"2024-01-21T20:14:52.480823+0000","last_clean":"2024-01-21T20:14:52.480823+0000","last_became_active":"2024-01-21T20:14:52.475846+0000","last_became_peered":"2024-01-21T20:14:52.475846+0000","last_unstale":"2024-01-21T20:14:52.480823+0000","last_undegraded":"2024-01-21T20:14:52.480823+0000","last_fullsized":"2024-01-21T20:14:52.480823+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455932+0000","last_change":"2024-01-21T20:14:52.097419+0000","last_active":"2024-01-21T20:14:52.455932+0000","last_peered":"2024-01-21T20:14:52.455932+0000","last_clean":"2024-01-21T20:14:52.455932+0000","last_became_active":"2024-01-21T20:14:52.097082+0000","last_became_peered":"2024-01-21T20:14:52.097082+0000","last_unstale":"2024-01-21T20:14:52.455932+0000","last_undegraded":"2024-01-21T20:14:52.455932+0000","last_fullsized":"2024-01-21T20:14:52.455932+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476779+0000","last_change":"2024-01-21T20:14:52.472319+0000","last_active":"2024-01-21T20:14:52.476779+0000","last_peered":"2024-01-21T20:14:52.476779+0000","last_clean":"2024-01-21T20:14:52.476779+0000","last_became_active":"2024-01-21T20:14:52.470229+0000","last_became_peered":"2024-01-21T20:14:52.470229+0000","last_unstale":"2024-01-21T20:14:52.476779+0000","last_undegraded":"2024-01-21T20:14:52.476779+0000","last_fullsized":"2024-01-21T20:14:52.476779+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461540+0000","last_change":"2024-01-21T20:14:52.086121+0000","last_active":"2024-01-21T20:14:52.461540+0000","last_peered":"2024-01-21T20:14:52.461540+0000","last_clean":"2024-01-21T20:14:52.461540+0000","last_became_active":"2024-01-21T20:14:52.085842+0000","last_became_peered":"2024-01-21T20:14:52.085842+0000","last_unstale":"2024-01-21T20:14:52.461540+0000","last_undegraded":"2024-01-21T20:14:52.461540+0000","last_fullsized":"2024-01-21T20:14:52.461540+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478201+0000","last_change":"2024-01-21T20:14:52.474135+0000","last_active":"2024-01-21T20:14:52.478201+0000","last_peered":"2024-01-21T20:14:52.478201+0000","last_clean":"2024-01-21T20:14:52.478201+0000","last_became_active":"2024-01-21T20:14:52.473827+0000","last_became_peered":"2024-01-21T20:14:52.473827+0000","last_unstale":"2024-01-21T20:14:52.478201+0000","last_undegraded":"2024-01-21T20:14:52.478201+0000","last_fullsized":"2024-01-21T20:14:52.478201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455632+0000","last_change":"2024-01-21T20:14:52.098163+0000","last_active":"2024-01-21T20:14:52.455632+0000","last_peered":"2024-01-21T20:14:52.455632+0000","last_clean":"2024-01-21T20:14:52.455632+0000","last_became_active":"2024-01-21T20:14:52.097871+0000","last_became_peered":"2024-01-21T20:14:52.097871+0000","last_unstale":"2024-01-21T20:14:52.455632+0000","last_undegraded":"2024-01-21T20:14:52.455632+0000","last_fullsized":"2024-01-21T20:14:52.455632+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479081+0000","last_change":"2024-01-21T20:14:52.471847+0000","last_active":"2024-01-21T20:14:52.479081+0000","last_peered":"2024-01-21T20:14:52.479081+0000","last_clean":"2024-01-21T20:14:52.479081+0000","last_became_active":"2024-01-21T20:14:52.471532+0000","last_became_peered":"2024-01-21T20:14:52.471532+0000","last_unstale":"2024-01-21T20:14:52.479081+0000","last_undegraded":"2024-01-21T20:14:52.479081+0000","last_fullsized":"2024-01-21T20:14:52.479081+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.459101+0000","last_change":"2024-01-21T20:14:52.088254+0000","last_active":"2024-01-21T20:14:52.459101+0000","last_peered":"2024-01-21T20:14:52.459101+0000","last_clean":"2024-01-21T20:14:52.459101+0000","last_became_active":"2024-01-21T20:14:52.087963+0000","last_became_peered":"2024-01-21T20:14:52.087963+0000","last_unstale":"2024-01-21T20:14:52.459101+0000","last_undegraded":"2024-01-21T20:14:52.459101+0000","last_fullsized":"2024-01-21T20:14:52.459101+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476740+0000","last_change":"2024-01-21T20:14:52.473191+0000","last_active":"2024-01-21T20:14:52.476740+0000","last_peered":"2024-01-21T20:14:52.476740+0000","last_clean":"2024-01-21T20:14:52.476740+0000","last_became_active":"2024-01-21T20:14:52.470179+0000","last_became_peered":"2024-01-21T20:14:52.470179+0000","last_unstale":"2024-01-21T20:14:52.476740+0000","last_undegraded":"2024-01-21T20:14:52.476740+0000","last_fullsized":"2024-01-21T20:14:52.476740+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455883+0000","last_change":"2024-01-21T20:14:52.092966+0000","last_active":"2024-01-21T20:14:52.455883+0000","last_peered":"2024-01-21T20:14:52.455883+0000","last_clean":"2024-01-21T20:14:52.455883+0000","last_became_active":"2024-01-21T20:14:52.092684+0000","last_became_peered":"2024-01-21T20:14:52.092684+0000","last_unstale":"2024-01-21T20:14:52.455883+0000","last_undegraded":"2024-01-21T20:14:52.455883+0000","last_fullsized":"2024-01-21T20:14:52.455883+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.470980+0000","last_change":"2024-01-21T20:14:52.466298+0000","last_active":"2024-01-21T20:14:52.470980+0000","last_peered":"2024-01-21T20:14:52.470980+0000","last_clean":"2024-01-21T20:14:52.470980+0000","last_became_active":"2024-01-21T20:14:52.465956+0000","last_became_peered":"2024-01-21T20:14:52.465956+0000","last_unstale":"2024-01-21T20:14:52.470980+0000","last_undegraded":"2024-01-21T20:14:52.470980+0000","last_fullsized":"2024-01-21T20:14:52.470980+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.458456+0000","last_change":"2024-01-21T20:14:52.091082+0000","last_active":"2024-01-21T20:14:52.458456+0000","last_peered":"2024-01-21T20:14:52.458456+0000","last_clean":"2024-01-21T20:14:52.458456+0000","last_became_active":"2024-01-21T20:14:52.090810+0000","last_became_peered":"2024-01-21T20:14:52.090810+0000","last_unstale":"2024-01-21T20:14:52.458456+0000","last_undegraded":"2024-01-21T20:14:52.458456+0000","last_fullsized":"2024-01-21T20:14:52.458456+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477749+0000","last_change":"2024-01-21T20:14:52.469934+0000","last_active":"2024-01-21T20:14:52.477749+0000","last_peered":"2024-01-21T20:14:52.477749+0000","last_clean":"2024-01-21T20:14:52.477749+0000","last_became_active":"2024-01-21T20:14:52.469647+0000","last_became_peered":"2024-01-21T20:14:52.469647+0000","last_unstale":"2024-01-21T20:14:52.477749+0000","last_undegraded":"2024-01-21T20:14:52.477749+0000","last_fullsized":"2024-01-21T20:14:52.477749+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.464042+0000","last_change":"2024-01-21T20:14:52.098731+0000","last_active":"2024-01-21T20:14:52.464042+0000","last_peered":"2024-01-21T20:14:52.464042+0000","last_clean":"2024-01-21T20:14:52.464042+0000","last_became_active":"2024-01-21T20:14:52.096448+0000","last_became_peered":"2024-01-21T20:14:52.096448+0000","last_unstale":"2024-01-21T20:14:52.464042+0000","last_undegraded":"2024-01-21T20:14:52.464042+0000","last_fullsized":"2024-01-21T20:14:52.464042+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479580+0000","last_change":"2024-01-21T20:14:52.474604+0000","last_active":"2024-01-21T20:14:52.479580+0000","last_peered":"2024-01-21T20:14:52.479580+0000","last_clean":"2024-01-21T20:14:52.479580+0000","last_became_active":"2024-01-21T20:14:52.473825+0000","last_became_peered":"2024-01-21T20:14:52.473825+0000","last_unstale":"2024-01-21T20:14:52.479580+0000","last_undegraded":"2024-01-21T20:14:52.479580+0000","last_fullsized":"2024-01-21T20:14:52.479580+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.468694+0000","last_change":"2024-01-21T20:14:52.097304+0000","last_active":"2024-01-21T20:14:52.468694+0000","last_peered":"2024-01-21T20:14:52.468694+0000","last_clean":"2024-01-21T20:14:52.468694+0000","last_became_active":"2024-01-21T20:14:52.096622+0000","last_became_peered":"2024-01-21T20:14:52.096622+0000","last_unstale":"2024-01-21T20:14:52.468694+0000","last_undegraded":"2024-01-21T20:14:52.468694+0000","last_fullsized":"2024-01-21T20:14:52.468694+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.466264+0000","last_change":"2024-01-21T20:14:52.462778+0000","last_active":"2024-01-21T20:14:52.466264+0000","last_peered":"2024-01-21T20:14:52.466264+0000","last_clean":"2024-01-21T20:14:52.466264+0000","last_became_active":"2024-01-21T20:14:52.462428+0000","last_became_peered":"2024-01-21T20:14:52.462428+0000","last_unstale":"2024-01-21T20:14:52.466264+0000","last_undegraded":"2024-01-21T20:14:52.466264+0000","last_fullsized":"2024-01-21T20:14:52.466264+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.468765+0000","last_change":"2024-01-21T20:14:52.092883+0000","last_active":"2024-01-21T20:14:52.468765+0000","last_peered":"2024-01-21T20:14:52.468765+0000","last_clean":"2024-01-21T20:14:52.468765+0000","last_became_active":"2024-01-21T20:14:52.092583+0000","last_became_peered":"2024-01-21T20:14:52.092583+0000","last_unstale":"2024-01-21T20:14:52.468765+0000","last_undegraded":"2024-01-21T20:14:52.468765+0000","last_fullsized":"2024-01-21T20:14:52.468765+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476923+0000","last_change":"2024-01-21T20:14:52.472918+0000","last_active":"2024-01-21T20:14:52.476923+0000","last_peered":"2024-01-21T20:14:52.476923+0000","last_clean":"2024-01-21T20:14:52.476923+0000","last_became_active":"2024-01-21T20:14:52.472616+0000","last_became_peered":"2024-01-21T20:14:52.472616+0000","last_unstale":"2024-01-21T20:14:52.476923+0000","last_undegraded":"2024-01-21T20:14:52.476923+0000","last_fullsized":"2024-01-21T20:14:52.476923+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478356+0000","last_change":"2024-01-21T20:14:52.093230+0000","last_active":"2024-01-21T20:14:52.478356+0000","last_peered":"2024-01-21T20:14:52.478356+0000","last_clean":"2024-01-21T20:14:52.478356+0000","last_became_active":"2024-01-21T20:14:52.092966+0000","last_became_peered":"2024-01-21T20:14:52.092966+0000","last_unstale":"2024-01-21T20:14:52.478356+0000","last_undegraded":"2024-01-21T20:14:52.478356+0000","last_fullsized":"2024-01-21T20:14:52.478356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477668+0000","last_change":"2024-01-21T20:14:52.476110+0000","last_active":"2024-01-21T20:14:52.477668+0000","last_peered":"2024-01-21T20:14:52.477668+0000","last_clean":"2024-01-21T20:14:52.477668+0000","last_became_active":"2024-01-21T20:14:52.475532+0000","last_became_peered":"2024-01-21T20:14:52.475532+0000","last_unstale":"2024-01-21T20:14:52.477668+0000","last_undegraded":"2024-01-21T20:14:52.477668+0000","last_fullsized":"2024-01-21T20:14:52.477668+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.469420+0000","last_change":"2024-01-21T20:14:52.095674+0000","last_active":"2024-01-21T20:14:52.469420+0000","last_peered":"2024-01-21T20:14:52.469420+0000","last_clean":"2024-01-21T20:14:52.469420+0000","last_became_active":"2024-01-21T20:14:52.092031+0000","last_became_peered":"2024-01-21T20:14:52.092031+0000","last_unstale":"2024-01-21T20:14:52.469420+0000","last_undegraded":"2024-01-21T20:14:52.469420+0000","last_fullsized":"2024-01-21T20:14:52.469420+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477231+0000","last_change":"2024-01-21T20:14:52.468006+0000","last_active":"2024-01-21T20:14:52.477231+0000","last_peered":"2024-01-21T20:14:52.477231+0000","last_clean":"2024-01-21T20:14:52.477231+0000","last_became_active":"2024-01-21T20:14:52.467677+0000","last_became_peered":"2024-01-21T20:14:52.467677+0000","last_unstale":"2024-01-21T20:14:52.477231+0000","last_undegraded":"2024-01-21T20:14:52.477231+0000","last_fullsized":"2024-01-21T20:14:52.477231+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.460151+0000","last_change":"2024-01-21T20:14:52.084407+0000","last_active":"2024-01-21T20:14:52.460151+0000","last_peered":"2024-01-21T20:14:52.460151+0000","last_clean":"2024-01-21T20:14:52.460151+0000","last_became_active":"2024-01-21T20:14:52.084000+0000","last_became_peered":"2024-01-21T20:14:52.084000+0000","last_unstale":"2024-01-21T20:14:52.460151+0000","last_undegraded":"2024-01-21T20:14:52.460151+0000","last_fullsized":"2024-01-21T20:14:52.460151+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478263+0000","last_change":"2024-01-21T20:14:52.475505+0000","last_active":"2024-01-21T20:14:52.478263+0000","last_peered":"2024-01-21T20:14:52.478263+0000","last_clean":"2024-01-21T20:14:52.478263+0000","last_became_active":"2024-01-21T20:14:52.475094+0000","last_became_peered":"2024-01-21T20:14:52.475094+0000","last_unstale":"2024-01-21T20:14:52.478263+0000","last_undegraded":"2024-01-21T20:14:52.478263+0000","last_fullsized":"2024-01-21T20:14:52.478263+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.456003+0000","last_change":"2024-01-21T20:14:52.089626+0000","last_active":"2024-01-21T20:14:52.456003+0000","last_peered":"2024-01-21T20:14:52.456003+0000","last_clean":"2024-01-21T20:14:52.456003+0000","last_became_active":"2024-01-21T20:14:52.089349+0000","last_became_peered":"2024-01-21T20:14:52.089349+0000","last_unstale":"2024-01-21T20:14:52.456003+0000","last_undegraded":"2024-01-21T20:14:52.456003+0000","last_fullsized":"2024-01-21T20:14:52.456003+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.470954+0000","last_change":"2024-01-21T20:14:52.468635+0000","last_active":"2024-01-21T20:14:52.470954+0000","last_peered":"2024-01-21T20:14:52.470954+0000","last_clean":"2024-01-21T20:14:52.470954+0000","last_became_active":"2024-01-21T20:14:52.468120+0000","last_became_peered":"2024-01-21T20:14:52.468120+0000","last_unstale":"2024-01-21T20:14:52.470954+0000","last_undegraded":"2024-01-21T20:14:52.470954+0000","last_fullsized":"2024-01-21T20:14:52.470954+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.455035+0000","last_change":"2024-01-21T20:14:52.090365+0000","last_active":"2024-01-21T20:14:52.455035+0000","last_peered":"2024-01-21T20:14:52.455035+0000","last_clean":"2024-01-21T20:14:52.455035+0000","last_became_active":"2024-01-21T20:14:52.090096+0000","last_became_peered":"2024-01-21T20:14:52.090096+0000","last_unstale":"2024-01-21T20:14:52.455035+0000","last_undegraded":"2024-01-21T20:14:52.455035+0000","last_fullsized":"2024-01-21T20:14:52.455035+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481225+0000","last_change":"2024-01-21T20:14:52.479770+0000","last_active":"2024-01-21T20:14:52.481225+0000","last_peered":"2024-01-21T20:14:52.481225+0000","last_clean":"2024-01-21T20:14:52.481225+0000","last_became_active":"2024-01-21T20:14:52.479458+0000","last_became_peered":"2024-01-21T20:14:52.479458+0000","last_unstale":"2024-01-21T20:14:52.481225+0000","last_undegraded":"2024-01-21T20:14:52.481225+0000","last_fullsized":"2024-01-21T20:14:52.481225+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.460728+0000","last_change":"2024-01-21T20:14:52.097405+0000","last_active":"2024-01-21T20:14:52.460728+0000","last_peered":"2024-01-21T20:14:52.460728+0000","last_clean":"2024-01-21T20:14:52.460728+0000","last_became_active":"2024-01-21T20:14:52.096914+0000","last_became_peered":"2024-01-21T20:14:52.096914+0000","last_unstale":"2024-01-21T20:14:52.460728+0000","last_undegraded":"2024-01-21T20:14:52.460728+0000","last_fullsized":"2024-01-21T20:14:52.460728+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478140+0000","last_change":"2024-01-21T20:14:52.472639+0000","last_active":"2024-01-21T20:14:52.478140+0000","last_peered":"2024-01-21T20:14:52.478140+0000","last_clean":"2024-01-21T20:14:52.478140+0000","last_became_active":"2024-01-21T20:14:52.472321+0000","last_became_peered":"2024-01-21T20:14:52.472321+0000","last_unstale":"2024-01-21T20:14:52.478140+0000","last_undegraded":"2024-01-21T20:14:52.478140+0000","last_fullsized":"2024-01-21T20:14:52.478140+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461571+0000","last_change":"2024-01-21T20:14:52.093389+0000","last_active":"2024-01-21T20:14:52.461571+0000","last_peered":"2024-01-21T20:14:52.461571+0000","last_clean":"2024-01-21T20:14:52.461571+0000","last_became_active":"2024-01-21T20:14:52.093222+0000","last_became_peered":"2024-01-21T20:14:52.093222+0000","last_unstale":"2024-01-21T20:14:52.461571+0000","last_undegraded":"2024-01-21T20:14:52.461571+0000","last_fullsized":"2024-01-21T20:14:52.461571+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.465088+0000","last_change":"2024-01-21T20:14:52.461399+0000","last_active":"2024-01-21T20:14:52.465088+0000","last_peered":"2024-01-21T20:14:52.465088+0000","last_clean":"2024-01-21T20:14:52.465088+0000","last_became_active":"2024-01-21T20:14:52.461117+0000","last_became_peered":"2024-01-21T20:14:52.461117+0000","last_unstale":"2024-01-21T20:14:52.465088+0000","last_undegraded":"2024-01-21T20:14:52.465088+0000","last_fullsized":"2024-01-21T20:14:52.465088+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.456047+0000","last_change":"2024-01-21T20:14:52.090953+0000","last_active":"2024-01-21T20:14:52.456047+0000","last_peered":"2024-01-21T20:14:52.456047+0000","last_clean":"2024-01-21T20:14:52.456047+0000","last_became_active":"2024-01-21T20:14:52.090677+0000","last_became_peered":"2024-01-21T20:14:52.090677+0000","last_unstale":"2024-01-21T20:14:52.456047+0000","last_undegraded":"2024-01-21T20:14:52.456047+0000","last_fullsized":"2024-01-21T20:14:52.456047+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476680+0000","last_change":"2024-01-21T20:14:52.475169+0000","last_active":"2024-01-21T20:14:52.476680+0000","last_peered":"2024-01-21T20:14:52.476680+0000","last_clean":"2024-01-21T20:14:52.476680+0000","last_became_active":"2024-01-21T20:14:52.474902+0000","last_became_peered":"2024-01-21T20:14:52.474902+0000","last_unstale":"2024-01-21T20:14:52.476680+0000","last_undegraded":"2024-01-21T20:14:52.476680+0000","last_fullsized":"2024-01-21T20:14:52.476680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"93'3","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.479865+0000","last_change":"2024-01-21T20:14:52.096874+0000","last_active":"2024-01-21T20:14:52.479865+0000","last_peered":"2024-01-21T20:14:52.479865+0000","last_clean":"2024-01-21T20:14:52.479865+0000","last_became_active":"2024-01-21T20:14:52.091625+0000","last_became_peered":"2024-01-21T20:14:52.091625+0000","last_unstale":"2024-01-21T20:14:52.479865+0000","last_undegraded":"2024-01-21T20:14:52.479865+0000","last_fullsized":"2024-01-21T20:14:52.479865+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.480879+0000","last_change":"2024-01-21T20:14:52.478791+0000","last_active":"2024-01-21T20:14:52.480879+0000","last_peered":"2024-01-21T20:14:52.480879+0000","last_clean":"2024-01-21T20:14:52.480879+0000","last_became_active":"2024-01-21T20:14:52.476003+0000","last_became_peered":"2024-01-21T20:14:52.476003+0000","last_unstale":"2024-01-21T20:14:52.480879+0000","last_undegraded":"2024-01-21T20:14:52.480879+0000","last_fullsized":"2024-01-21T20:14:52.480879+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478136+0000","last_change":"2024-01-21T20:14:52.100882+0000","last_active":"2024-01-21T20:14:52.478136+0000","last_peered":"2024-01-21T20:14:52.478136+0000","last_clean":"2024-01-21T20:14:52.478136+0000","last_became_active":"2024-01-21T20:14:52.098733+0000","last_became_peered":"2024-01-21T20:14:52.098733+0000","last_unstale":"2024-01-21T20:14:52.478136+0000","last_undegraded":"2024-01-21T20:14:52.478136+0000","last_fullsized":"2024-01-21T20:14:52.478136+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.471352+0000","last_change":"2024-01-21T20:14:52.467903+0000","last_active":"2024-01-21T20:14:52.471352+0000","last_peered":"2024-01-21T20:14:52.471352+0000","last_clean":"2024-01-21T20:14:52.471352+0000","last_became_active":"2024-01-21T20:14:52.467627+0000","last_became_peered":"2024-01-21T20:14:52.467627+0000","last_unstale":"2024-01-21T20:14:52.471352+0000","last_undegraded":"2024-01-21T20:14:52.471352+0000","last_fullsized":"2024-01-21T20:14:52.471352+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.467333+0000","last_change":"2024-01-21T20:14:52.092617+0000","last_active":"2024-01-21T20:14:52.467333+0000","last_peered":"2024-01-21T20:14:52.467333+0000","last_clean":"2024-01-21T20:14:52.467333+0000","last_became_active":"2024-01-21T20:14:52.092326+0000","last_became_peered":"2024-01-21T20:14:52.092326+0000","last_unstale":"2024-01-21T20:14:52.467333+0000","last_undegraded":"2024-01-21T20:14:52.467333+0000","last_fullsized":"2024-01-21T20:14:52.467333+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481252+0000","last_change":"2024-01-21T20:14:52.480451+0000","last_active":"2024-01-21T20:14:52.481252+0000","last_peered":"2024-01-21T20:14:52.481252+0000","last_clean":"2024-01-21T20:14:52.481252+0000","last_became_active":"2024-01-21T20:14:52.480116+0000","last_became_peered":"2024-01-21T20:14:52.480116+0000","last_unstale":"2024-01-21T20:14:52.481252+0000","last_undegraded":"2024-01-21T20:14:52.481252+0000","last_fullsized":"2024-01-21T20:14:52.481252+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.460693+0000","last_change":"2024-01-21T20:14:52.089897+0000","last_active":"2024-01-21T20:14:52.460693+0000","last_peered":"2024-01-21T20:14:52.460693+0000","last_clean":"2024-01-21T20:14:52.460693+0000","last_became_active":"2024-01-21T20:14:52.089523+0000","last_became_peered":"2024-01-21T20:14:52.089523+0000","last_unstale":"2024-01-21T20:14:52.460693+0000","last_undegraded":"2024-01-21T20:14:52.460693+0000","last_fullsized":"2024-01-21T20:14:52.460693+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.475383+0000","last_change":"2024-01-21T20:14:52.473136+0000","last_active":"2024-01-21T20:14:52.475383+0000","last_peered":"2024-01-21T20:14:52.475383+0000","last_clean":"2024-01-21T20:14:52.475383+0000","last_became_active":"2024-01-21T20:14:52.472793+0000","last_became_peered":"2024-01-21T20:14:52.472793+0000","last_unstale":"2024-01-21T20:14:52.475383+0000","last_undegraded":"2024-01-21T20:14:52.475383+0000","last_fullsized":"2024-01-21T20:14:52.475383+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.463368+0000","last_change":"2024-01-21T20:14:52.097477+0000","last_active":"2024-01-21T20:14:52.463368+0000","last_peered":"2024-01-21T20:14:52.463368+0000","last_clean":"2024-01-21T20:14:52.463368+0000","last_became_active":"2024-01-21T20:14:52.097068+0000","last_became_peered":"2024-01-21T20:14:52.097068+0000","last_unstale":"2024-01-21T20:14:52.463368+0000","last_undegraded":"2024-01-21T20:14:52.463368+0000","last_fullsized":"2024-01-21T20:14:52.463368+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477709+0000","last_change":"2024-01-21T20:14:52.474563+0000","last_active":"2024-01-21T20:14:52.477709+0000","last_peered":"2024-01-21T20:14:52.477709+0000","last_clean":"2024-01-21T20:14:52.477709+0000","last_became_active":"2024-01-21T20:14:52.474297+0000","last_became_peered":"2024-01-21T20:14:52.474297+0000","last_unstale":"2024-01-21T20:14:52.477709+0000","last_undegraded":"2024-01-21T20:14:52.477709+0000","last_fullsized":"2024-01-21T20:14:52.477709+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"93'4","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478695+0000","last_change":"2024-01-21T20:14:52.109368+0000","last_active":"2024-01-21T20:14:52.478695+0000","last_peered":"2024-01-21T20:14:52.478695+0000","last_clean":"2024-01-21T20:14:52.478695+0000","last_became_active":"2024-01-21T20:14:52.109038+0000","last_became_peered":"2024-01-21T20:14:52.109038+0000","last_unstale":"2024-01-21T20:14:52.478695+0000","last_undegraded":"2024-01-21T20:14:52.478695+0000","last_fullsized":"2024-01-21T20:14:52.478695+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477577+0000","last_change":"2024-01-21T20:14:52.473516+0000","last_active":"2024-01-21T20:14:52.477577+0000","last_peered":"2024-01-21T20:14:52.477577+0000","last_clean":"2024-01-21T20:14:52.477577+0000","last_became_active":"2024-01-21T20:14:52.471760+0000","last_became_peered":"2024-01-21T20:14:52.471760+0000","last_unstale":"2024-01-21T20:14:52.477577+0000","last_undegraded":"2024-01-21T20:14:52.477577+0000","last_fullsized":"2024-01-21T20:14:52.477577+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.474768+0000","last_change":"2024-01-21T20:14:52.089324+0000","last_active":"2024-01-21T20:14:52.474768+0000","last_peered":"2024-01-21T20:14:52.474768+0000","last_clean":"2024-01-21T20:14:52.474768+0000","last_became_active":"2024-01-21T20:14:52.089033+0000","last_became_peered":"2024-01-21T20:14:52.089033+0000","last_unstale":"2024-01-21T20:14:52.474768+0000","last_undegraded":"2024-01-21T20:14:52.474768+0000","last_fullsized":"2024-01-21T20:14:52.474768+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.474513+0000","last_change":"2024-01-21T20:14:52.472067+0000","last_active":"2024-01-21T20:14:52.474513+0000","last_peered":"2024-01-21T20:14:52.474513+0000","last_clean":"2024-01-21T20:14:52.474513+0000","last_became_active":"2024-01-21T20:14:52.471788+0000","last_became_peered":"2024-01-21T20:14:52.471788+0000","last_unstale":"2024-01-21T20:14:52.474513+0000","last_undegraded":"2024-01-21T20:14:52.474513+0000","last_fullsized":"2024-01-21T20:14:52.474513+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.456868+0000","last_change":"2024-01-21T20:14:52.103606+0000","last_active":"2024-01-21T20:14:52.456868+0000","last_peered":"2024-01-21T20:14:52.456868+0000","last_clean":"2024-01-21T20:14:52.456868+0000","last_became_active":"2024-01-21T20:14:52.103299+0000","last_became_peered":"2024-01-21T20:14:52.103299+0000","last_unstale":"2024-01-21T20:14:52.456868+0000","last_undegraded":"2024-01-21T20:14:52.456868+0000","last_fullsized":"2024-01-21T20:14:52.456868+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476899+0000","last_change":"2024-01-21T20:14:52.472071+0000","last_active":"2024-01-21T20:14:52.476899+0000","last_peered":"2024-01-21T20:14:52.476899+0000","last_clean":"2024-01-21T20:14:52.476899+0000","last_became_active":"2024-01-21T20:14:52.471744+0000","last_became_peered":"2024-01-21T20:14:52.471744+0000","last_unstale":"2024-01-21T20:14:52.476899+0000","last_undegraded":"2024-01-21T20:14:52.476899+0000","last_fullsized":"2024-01-21T20:14:52.476899+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.463975+0000","last_change":"2024-01-21T20:14:52.086425+0000","last_active":"2024-01-21T20:14:52.463975+0000","last_peered":"2024-01-21T20:14:52.463975+0000","last_clean":"2024-01-21T20:14:52.463975+0000","last_became_active":"2024-01-21T20:14:52.086118+0000","last_became_peered":"2024-01-21T20:14:52.086118+0000","last_unstale":"2024-01-21T20:14:52.463975+0000","last_undegraded":"2024-01-21T20:14:52.463975+0000","last_fullsized":"2024-01-21T20:14:52.463975+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478363+0000","last_change":"2024-01-21T20:14:52.475727+0000","last_active":"2024-01-21T20:14:52.478363+0000","last_peered":"2024-01-21T20:14:52.478363+0000","last_clean":"2024-01-21T20:14:52.478363+0000","last_became_active":"2024-01-21T20:14:52.474158+0000","last_became_peered":"2024-01-21T20:14:52.474158+0000","last_unstale":"2024-01-21T20:14:52.478363+0000","last_undegraded":"2024-01-21T20:14:52.478363+0000","last_fullsized":"2024-01-21T20:14:52.478363+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.460492+0000","last_change":"2024-01-21T20:14:52.087936+0000","last_active":"2024-01-21T20:14:52.460492+0000","last_peered":"2024-01-21T20:14:52.460492+0000","last_clean":"2024-01-21T20:14:52.460492+0000","last_became_active":"2024-01-21T20:14:52.087633+0000","last_became_peered":"2024-01-21T20:14:52.087633+0000","last_unstale":"2024-01-21T20:14:52.460492+0000","last_undegraded":"2024-01-21T20:14:52.460492+0000","last_fullsized":"2024-01-21T20:14:52.460492+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476877+0000","last_change":"2024-01-21T20:14:52.474085+0000","last_active":"2024-01-21T20:14:52.476877+0000","last_peered":"2024-01-21T20:14:52.476877+0000","last_clean":"2024-01-21T20:14:52.476877+0000","last_became_active":"2024-01-21T20:14:52.473542+0000","last_became_peered":"2024-01-21T20:14:52.473542+0000","last_unstale":"2024-01-21T20:14:52.476877+0000","last_undegraded":"2024-01-21T20:14:52.476877+0000","last_fullsized":"2024-01-21T20:14:52.476877+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.468444+0000","last_change":"2024-01-21T20:14:52.091608+0000","last_active":"2024-01-21T20:14:52.468444+0000","last_peered":"2024-01-21T20:14:52.468444+0000","last_clean":"2024-01-21T20:14:52.468444+0000","last_became_active":"2024-01-21T20:14:52.091059+0000","last_became_peered":"2024-01-21T20:14:52.091059+0000","last_unstale":"2024-01-21T20:14:52.468444+0000","last_undegraded":"2024-01-21T20:14:52.468444+0000","last_fullsized":"2024-01-21T20:14:52.468444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.475292+0000","last_change":"2024-01-21T20:14:52.474000+0000","last_active":"2024-01-21T20:14:52.475292+0000","last_peered":"2024-01-21T20:14:52.475292+0000","last_clean":"2024-01-21T20:14:52.475292+0000","last_became_active":"2024-01-21T20:14:52.473698+0000","last_became_peered":"2024-01-21T20:14:52.473698+0000","last_unstale":"2024-01-21T20:14:52.475292+0000","last_undegraded":"2024-01-21T20:14:52.475292+0000","last_fullsized":"2024-01-21T20:14:52.475292+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461235+0000","last_change":"2024-01-21T20:14:52.093969+0000","last_active":"2024-01-21T20:14:52.461235+0000","last_peered":"2024-01-21T20:14:52.461235+0000","last_clean":"2024-01-21T20:14:52.461235+0000","last_became_active":"2024-01-21T20:14:52.093675+0000","last_became_peered":"2024-01-21T20:14:52.093675+0000","last_unstale":"2024-01-21T20:14:52.461235+0000","last_undegraded":"2024-01-21T20:14:52.461235+0000","last_fullsized":"2024-01-21T20:14:52.461235+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481621+0000","last_change":"2024-01-21T20:14:52.479997+0000","last_active":"2024-01-21T20:14:52.481621+0000","last_peered":"2024-01-21T20:14:52.481621+0000","last_clean":"2024-01-21T20:14:52.481621+0000","last_became_active":"2024-01-21T20:14:52.479728+0000","last_became_peered":"2024-01-21T20:14:52.479728+0000","last_unstale":"2024-01-21T20:14:52.481621+0000","last_undegraded":"2024-01-21T20:14:52.481621+0000","last_fullsized":"2024-01-21T20:14:52.481621+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.468564+0000","last_change":"2024-01-21T20:14:52.098478+0000","last_active":"2024-01-21T20:14:52.468564+0000","last_peered":"2024-01-21T20:14:52.468564+0000","last_clean":"2024-01-21T20:14:52.468564+0000","last_became_active":"2024-01-21T20:14:52.096559+0000","last_became_peered":"2024-01-21T20:14:52.096559+0000","last_unstale":"2024-01-21T20:14:52.468564+0000","last_undegraded":"2024-01-21T20:14:52.468564+0000","last_fullsized":"2024-01-21T20:14:52.468564+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.480850+0000","last_change":"2024-01-21T20:14:52.478197+0000","last_active":"2024-01-21T20:14:52.480850+0000","last_peered":"2024-01-21T20:14:52.480850+0000","last_clean":"2024-01-21T20:14:52.480850+0000","last_became_active":"2024-01-21T20:14:52.475817+0000","last_became_peered":"2024-01-21T20:14:52.475817+0000","last_unstale":"2024-01-21T20:14:52.480850+0000","last_undegraded":"2024-01-21T20:14:52.480850+0000","last_fullsized":"2024-01-21T20:14:52.480850+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461262+0000","last_change":"2024-01-21T20:14:52.089398+0000","last_active":"2024-01-21T20:14:52.461262+0000","last_peered":"2024-01-21T20:14:52.461262+0000","last_clean":"2024-01-21T20:14:52.461262+0000","last_became_active":"2024-01-21T20:14:52.088903+0000","last_became_peered":"2024-01-21T20:14:52.088903+0000","last_unstale":"2024-01-21T20:14:52.461262+0000","last_undegraded":"2024-01-21T20:14:52.461262+0000","last_fullsized":"2024-01-21T20:14:52.461262+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481064+0000","last_change":"2024-01-21T20:14:52.474960+0000","last_active":"2024-01-21T20:14:52.481064+0000","last_peered":"2024-01-21T20:14:52.481064+0000","last_clean":"2024-01-21T20:14:52.481064+0000","last_became_active":"2024-01-21T20:14:52.474683+0000","last_became_peered":"2024-01-21T20:14:52.474683+0000","last_unstale":"2024-01-21T20:14:52.481064+0000","last_undegraded":"2024-01-21T20:14:52.481064+0000","last_fullsized":"2024-01-21T20:14:52.481064+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.462218+0000","last_change":"2024-01-21T20:14:52.095561+0000","last_active":"2024-01-21T20:14:52.462218+0000","last_peered":"2024-01-21T20:14:52.462218+0000","last_clean":"2024-01-21T20:14:52.462218+0000","last_became_active":"2024-01-21T20:14:52.091767+0000","last_became_peered":"2024-01-21T20:14:52.091767+0000","last_unstale":"2024-01-21T20:14:52.462218+0000","last_undegraded":"2024-01-21T20:14:52.462218+0000","last_fullsized":"2024-01-21T20:14:52.462218+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461071+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:14:52.461071+0000","last_peered":"2024-01-21T20:14:52.461071+0000","last_clean":"2024-01-21T20:14:52.461071+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:14:52.461071+0000","last_undegraded":"2024-01-21T20:14:52.461071+0000","last_fullsized":"2024-01-21T20:14:52.461071+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477253+0000","last_change":"2024-01-21T20:14:52.468078+0000","last_active":"2024-01-21T20:14:52.477253+0000","last_peered":"2024-01-21T20:14:52.477253+0000","last_clean":"2024-01-21T20:14:52.477253+0000","last_became_active":"2024-01-21T20:14:52.467792+0000","last_became_peered":"2024-01-21T20:14:52.467792+0000","last_unstale":"2024-01-21T20:14:52.477253+0000","last_undegraded":"2024-01-21T20:14:52.477253+0000","last_fullsized":"2024-01-21T20:14:52.477253+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476387+0000","last_change":"2024-01-21T20:14:52.089098+0000","last_active":"2024-01-21T20:14:52.476387+0000","last_peered":"2024-01-21T20:14:52.476387+0000","last_clean":"2024-01-21T20:14:52.476387+0000","last_became_active":"2024-01-21T20:14:52.088818+0000","last_became_peered":"2024-01-21T20:14:52.088818+0000","last_unstale":"2024-01-21T20:14:52.476387+0000","last_undegraded":"2024-01-21T20:14:52.476387+0000","last_fullsized":"2024-01-21T20:14:52.476387+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":81,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.456094+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:14:52.456094+0000","last_peered":"2024-01-21T20:14:52.456094+0000","last_clean":"2024-01-21T20:14:52.456094+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:14:52.456094+0000","last_undegraded":"2024-01-21T20:14:52.456094+0000","last_fullsized":"2024-01-21T20:14:52.456094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.476642+0000","last_change":"2024-01-21T20:14:52.473922+0000","last_active":"2024-01-21T20:14:52.476642+0000","last_peered":"2024-01-21T20:14:52.476642+0000","last_clean":"2024-01-21T20:14:52.476642+0000","last_became_active":"2024-01-21T20:14:52.473639+0000","last_became_peered":"2024-01-21T20:14:52.473639+0000","last_unstale":"2024-01-21T20:14:52.476642+0000","last_undegraded":"2024-01-21T20:14:52.476642+0000","last_fullsized":"2024-01-21T20:14:52.476642+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.463081+0000","last_change":"2024-01-21T20:14:52.101813+0000","last_active":"2024-01-21T20:14:52.463081+0000","last_peered":"2024-01-21T20:14:52.463081+0000","last_clean":"2024-01-21T20:14:52.463081+0000","last_became_active":"2024-01-21T20:14:52.101506+0000","last_became_peered":"2024-01-21T20:14:52.101506+0000","last_unstale":"2024-01-21T20:14:52.463081+0000","last_undegraded":"2024-01-21T20:14:52.463081+0000","last_fullsized":"2024-01-21T20:14:52.463081+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.463440+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:14:52.463440+0000","last_peered":"2024-01-21T20:14:52.463440+0000","last_clean":"2024-01-21T20:14:52.463440+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:14:52.463440+0000","last_undegraded":"2024-01-21T20:14:52.463440+0000","last_fullsized":"2024-01-21T20:14:52.463440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477673+0000","last_change":"2024-01-21T20:14:52.475939+0000","last_active":"2024-01-21T20:14:52.477673+0000","last_peered":"2024-01-21T20:14:52.477673+0000","last_clean":"2024-01-21T20:14:52.477673+0000","last_became_active":"2024-01-21T20:14:52.475594+0000","last_became_peered":"2024-01-21T20:14:52.475594+0000","last_unstale":"2024-01-21T20:14:52.477673+0000","last_undegraded":"2024-01-21T20:14:52.477673+0000","last_fullsized":"2024-01-21T20:14:52.477673+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.462025+0000","last_change":"2024-01-21T20:14:52.097086+0000","last_active":"2024-01-21T20:14:52.462025+0000","last_peered":"2024-01-21T20:14:52.462025+0000","last_clean":"2024-01-21T20:14:52.462025+0000","last_became_active":"2024-01-21T20:14:52.096795+0000","last_became_peered":"2024-01-21T20:14:52.096795+0000","last_unstale":"2024-01-21T20:14:52.462025+0000","last_undegraded":"2024-01-21T20:14:52.462025+0000","last_fullsized":"2024-01-21T20:14:52.462025+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.457355+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:14:52.457355+0000","last_peered":"2024-01-21T20:14:52.457355+0000","last_clean":"2024-01-21T20:14:52.457355+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:14:52.457355+0000","last_undegraded":"2024-01-21T20:14:52.457355+0000","last_fullsized":"2024-01-21T20:14:52.457355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":75,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461640+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:14:52.461640+0000","last_peered":"2024-01-21T20:14:52.461640+0000","last_clean":"2024-01-21T20:14:52.461640+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:14:52.461640+0000","last_undegraded":"2024-01-21T20:14:52.461640+0000","last_fullsized":"2024-01-21T20:14:52.461640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.478282+0000","last_change":"2024-01-21T20:14:52.472855+0000","last_active":"2024-01-21T20:14:52.478282+0000","last_peered":"2024-01-21T20:14:52.478282+0000","last_clean":"2024-01-21T20:14:52.478282+0000","last_became_active":"2024-01-21T20:14:52.471040+0000","last_became_peered":"2024-01-21T20:14:52.471040+0000","last_unstale":"2024-01-21T20:14:52.478282+0000","last_undegraded":"2024-01-21T20:14:52.478282+0000","last_fullsized":"2024-01-21T20:14:52.478282+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.459109+0000","last_change":"2024-01-21T20:14:52.097065+0000","last_active":"2024-01-21T20:14:52.459109+0000","last_peered":"2024-01-21T20:14:52.459109+0000","last_clean":"2024-01-21T20:14:52.459109+0000","last_became_active":"2024-01-21T20:14:52.096651+0000","last_became_peered":"2024-01-21T20:14:52.096651+0000","last_unstale":"2024-01-21T20:14:52.459109+0000","last_undegraded":"2024-01-21T20:14:52.459109+0000","last_fullsized":"2024-01-21T20:14:52.459109+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.461717+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:14:52.461717+0000","last_peered":"2024-01-21T20:14:52.461717+0000","last_clean":"2024-01-21T20:14:52.461717+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:14:52.461717+0000","last_undegraded":"2024-01-21T20:14:52.461717+0000","last_fullsized":"2024-01-21T20:14:52.461717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.471198+0000","last_change":"2024-01-21T20:14:52.468867+0000","last_active":"2024-01-21T20:14:52.471198+0000","last_peered":"2024-01-21T20:14:52.471198+0000","last_clean":"2024-01-21T20:14:52.471198+0000","last_became_active":"2024-01-21T20:14:52.468668+0000","last_became_peered":"2024-01-21T20:14:52.468668+0000","last_unstale":"2024-01-21T20:14:52.471198+0000","last_undegraded":"2024-01-21T20:14:52.471198+0000","last_fullsized":"2024-01-21T20:14:52.471198+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.460987+0000","last_change":"2024-01-21T20:14:52.099464+0000","last_active":"2024-01-21T20:14:52.460987+0000","last_peered":"2024-01-21T20:14:52.460987+0000","last_clean":"2024-01-21T20:14:52.460987+0000","last_became_active":"2024-01-21T20:14:52.098885+0000","last_became_peered":"2024-01-21T20:14:52.098885+0000","last_unstale":"2024-01-21T20:14:52.460987+0000","last_undegraded":"2024-01-21T20:14:52.460987+0000","last_fullsized":"2024-01-21T20:14:52.460987+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.463872+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:14:52.463872+0000","last_peered":"2024-01-21T20:14:52.463872+0000","last_clean":"2024-01-21T20:14:52.463872+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:14:52.463872+0000","last_undegraded":"2024-01-21T20:14:52.463872+0000","last_fullsized":"2024-01-21T20:14:52.463872+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.470893+0000","last_change":"2024-01-21T20:14:52.469008+0000","last_active":"2024-01-21T20:14:52.470893+0000","last_peered":"2024-01-21T20:14:52.470893+0000","last_clean":"2024-01-21T20:14:52.470893+0000","last_became_active":"2024-01-21T20:14:52.468741+0000","last_became_peered":"2024-01-21T20:14:52.468741+0000","last_unstale":"2024-01-21T20:14:52.470893+0000","last_undegraded":"2024-01-21T20:14:52.470893+0000","last_fullsized":"2024-01-21T20:14:52.470893+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"93'1","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.475568+0000","last_change":"2024-01-21T20:14:52.091527+0000","last_active":"2024-01-21T20:14:52.475568+0000","last_peered":"2024-01-21T20:14:52.475568+0000","last_clean":"2024-01-21T20:14:52.475568+0000","last_became_active":"2024-01-21T20:14:52.090435+0000","last_became_peered":"2024-01-21T20:14:52.090435+0000","last_unstale":"2024-01-21T20:14:52.475568+0000","last_undegraded":"2024-01-21T20:14:52.475568+0000","last_fullsized":"2024-01-21T20:14:52.475568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.465035+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:14:52.465035+0000","last_peered":"2024-01-21T20:14:52.465035+0000","last_clean":"2024-01-21T20:14:52.465035+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:14:52.465035+0000","last_undegraded":"2024-01-21T20:14:52.465035+0000","last_fullsized":"2024-01-21T20:14:52.465035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.481182+0000","last_change":"2024-01-21T20:14:52.476681+0000","last_active":"2024-01-21T20:14:52.481182+0000","last_peered":"2024-01-21T20:14:52.481182+0000","last_clean":"2024-01-21T20:14:52.481182+0000","last_became_active":"2024-01-21T20:14:52.476448+0000","last_became_peered":"2024-01-21T20:14:52.476448+0000","last_unstale":"2024-01-21T20:14:52.481182+0000","last_undegraded":"2024-01-21T20:14:52.481182+0000","last_fullsized":"2024-01-21T20:14:52.481182+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:52.065943+0000","last_clean_scrub_stamp":"2024-01-21T20:14:52.065943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"93'2","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.477166+0000","last_change":"2024-01-21T20:14:52.090032+0000","last_active":"2024-01-21T20:14:52.477166+0000","last_peered":"2024-01-21T20:14:52.477166+0000","last_clean":"2024-01-21T20:14:52.477166+0000","last_became_active":"2024-01-21T20:14:52.089695+0000","last_became_peered":"2024-01-21T20:14:52.089695+0000","last_unstale":"2024-01-21T20:14:52.477166+0000","last_undegraded":"2024-01-21T20:14:52.477166+0000","last_fullsized":"2024-01-21T20:14:52.477166+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:14:51.063620+0000","last_clean_scrub_stamp":"2024-01-21T20:14:51.063620+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":71,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-01-21T20:14:52.469553+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:14:52.469553+0000","last_peered":"2024-01-21T20:14:52.469553+0000","last_clean":"2024-01-21T20:14:52.469553+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:14:52.469553+0000","last_undegraded":"2024-01-21T20:14:52.469553+0000","last_fullsized":"2024-01-21T20:14:52.469553+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":1150976,"data_stored":589708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":590807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.59999999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.68600000000000005}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.622},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.372},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.41399999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.39100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":1163264,"data_stored":591167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.313},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.32100000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.33300000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575039,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":1116,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":1142784,"data_stored":589132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.313}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.629},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66900000000000004}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":591629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.32100000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.31}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.34499999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.62}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.57699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302312,"kb_used_data":1120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069528,"statfs":{"total":96636764160,"available":96327196672,"internally_reserved":0,"allocated":1146880,"data_stored":590093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.40400000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.49399999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.59799999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.504},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302324,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069516,"statfs":{"total":96636764160,"available":96327184384,"internally_reserved":0,"allocated":1159168,"data_stored":590771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.505}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.44}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.42999999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.375},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.45200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306412,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065428,"statfs":{"total":96636764160,"available":96322998272,"internally_reserved":0,"allocated":1150976,"data_stored":590127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.54900000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.72899999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:14:55.797 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:14:55.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:14:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.964+0000 7fc94a7a6700 1 Processor -- start 2024-01-21T20:14:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.964+0000 7fc94a7a6700 1 -- start start 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc94a7a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc944155b80 0x7fc9440c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc94a7a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc944065660 con 0x7fc9440beb30 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc94a7a6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc944065f00 con 0x7fc944069ef0 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc94a7a6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9440bef10 con 0x7fc944155b80 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc948d43700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc944155b80 0x7fc9440c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc943fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc9440beb30 0x7fc9440697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59942/0 (socket says 172.21.15.133:59942) 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc943fff700 1 -- 172.21.15.133:0/3174793792 learned_addr learned my addr 172.21.15.133:0/3174793792 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc948d43700 1 -- 172.21.15.133:0/3174793792 >> v1:172.21.15.178:6789/0 conn(0x7fc944069ef0 legacy=0x7fc944066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc948d43700 1 -- 172.21.15.133:0/3174793792 >> v1:172.21.15.133:6789/0 conn(0x7fc9440beb30 legacy=0x7fc9440697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc948d43700 1 -- 172.21.15.133:0/3174793792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9440c44a0 con 0x7fc944155b80 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.965+0000 7fc942ffd700 1 -- 172.21.15.133:0/3174793792 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256589805 0 0) 0x7fc944065660 con 0x7fc9440beb30 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc948d43700 1 --2- 172.21.15.133:0/3174793792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc944155b80 0x7fc9440c3fb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fc93c009e60 tx=0x7fc93c009780).ready entity=mon.0 client_cookie=fe888b2372af39fc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc942ffd700 1 -- 172.21.15.133:0/3174793792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00e070 con 0x7fc944155b80 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc942ffd700 1 -- 172.21.15.133:0/3174793792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c00bc30 con 0x7fc944155b80 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc942ffd700 1 -- 172.21.15.133:0/3174793792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c012410 con 0x7fc944155b80 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 -- 172.21.15.133:0/3174793792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc944155b80 msgr2=0x7fc9440c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/3174793792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc944155b80 0x7fc9440c3fb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fc93c009e60 tx=0x7fc93c009780).stop 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 -- 172.21.15.133:0/3174793792 shutdown_connections 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/3174793792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc944155b80 0x7fc9440c3fb0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 -- 172.21.15.133:0/3174793792 >> 172.21.15.133:0/3174793792 conn(0x7fc9440c8010 msgr2=0x7fc9440c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 -- 172.21.15.133:0/3174793792 shutdown_connections 2024-01-21T20:14:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.966+0000 7fc94a7a6700 1 -- 172.21.15.133:0/3174793792 wait complete. 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.967+0000 7fc94a7a6700 1 Processor -- start 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 -- start start 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc944069ef0 0x7fc944162240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 0x7fc9440a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944138d90 con 0x7fc9440beb30 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440bf8e0 con 0x7fc944069ef0 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc94a7a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9441385c0 con 0x7fc944155b80 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc9437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc9437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50792/0 (socket says 172.21.15.133:50792) 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.968+0000 7fc9437fe700 1 -- 172.21.15.133:0/1804176898 learned_addr learned my addr 172.21.15.133:0/1804176898 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc948d43700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 0x7fc9440a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc943fff700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc944069ef0 0x7fc944162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 -- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 msgr2=0x7fc9440a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 0x7fc9440a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 -- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc944069ef0 msgr2=0x7fc944162240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc944069ef0 0x7fc944162240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 -- 172.21.15.133:0/1804176898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009a20 con 0x7fc9440beb30 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc948d43700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 0x7fc9440a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc9437fe700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fc93400c4c0 tx=0x7fc934007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934007020 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc934007180 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9440c0fe0 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934007540 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.969+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441387d0 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.970+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9440c1170 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.970+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc9340068b0 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.971+0000 7fc940ff9700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 0x7fc930061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.971+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc9340799f0 con 0x7fc9440beb30 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.971+0000 7fc943fff700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 0x7fc930061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.971+0000 7fc943fff700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 0x7fc930061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc938007fd0 tx=0x7fc938009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:55.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:55.975+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc934047b00 con 0x7fc9440beb30 2024-01-21T20:14:56.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.207+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc94405fdf0 con 0x7fc9440beb30 2024-01-21T20:14:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.212+0000 7fc940ff9700 1 -- 172.21.15.133:0/1804176898 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc93404e320 con 0x7fc9440beb30 2024-01-21T20:14:56.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 msgr2=0x7fc930061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 0x7fc930061730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc938007fd0 tx=0x7fc938009040).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 msgr2=0x7fc9440bf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fc93400c4c0 tx=0x7fc934007dd0).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 shutdown_connections 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc93005f270 0x7fc930061730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc944155b80 0x7fc9440a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc944069ef0 0x7fc944162240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 --2- 172.21.15.133:0/1804176898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9440beb30 0x7fc9440bf0b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 >> 172.21.15.133:0/1804176898 conn(0x7fc9440c8010 msgr2=0x7fc9440c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 shutdown_connections 2024-01-21T20:14:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.214+0000 7fc94a7a6700 1 -- 172.21.15.133:0/1804176898 wait complete. 2024-01-21T20:14:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:14:56.216 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:14:56.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.343+0000 7fdfee309700 1 Processor -- start 2024-01-21T20:14:56.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.343+0000 7fdfee309700 1 -- start start 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.344+0000 7fdfee309700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.344+0000 7fdfee309700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 0x7fdfe80634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.344+0000 7fdfee309700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe8065fd0 con 0x7fdfe81521e0 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.344+0000 7fdfee309700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe8152d00 con 0x7fdfe8066460 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.344+0000 7fdfee309700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80653c0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 0x7fdfe80634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfec8a6700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdfe81521e0 0x7fdfe81525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37106/0 (socket says 172.21.15.133:37106) 2024-01-21T20:14:56.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfec8a6700 1 -- 172.21.15.133:0/2920438544 learned_addr learned my addr 172.21.15.133:0/2920438544 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:57250/0 (socket says 172.21.15.133:57250) 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe6ffd700 1 -- 172.21.15.133:0/2920438544 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047984022 0 0) 0x7fdfe8065fd0 con 0x7fdfe81521e0 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe6ffd700 1 -- 172.21.15.133:0/2920438544 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd00033f0 con 0x7fdfe81521e0 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 -- 172.21.15.133:0/2920438544 >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 msgr2=0x7fdfe80634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 --2- 172.21.15.133:0/2920438544 >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 0x7fdfe80634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 -- 172.21.15.133:0/2920438544 >> v1:172.21.15.178:6789/0 conn(0x7fdfe81521e0 legacy=0x7fdfe81525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 -- 172.21.15.133:0/2920438544 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80656a0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe77fe700 1 --2- 172.21.15.133:0/2920438544 >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 0x7fdfe80634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe7fff700 1 --2- 172.21.15.133:0/2920438544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdfdc009760 tx=0x7fdfdc009060).ready entity=mon.2 client_cookie=7c6877b4eb76012d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe6ffd700 1 -- 172.21.15.133:0/2920438544 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0090d0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe6ffd700 1 -- 172.21.15.133:0/2920438544 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc00d4a0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.345+0000 7fdfe6ffd700 1 -- 172.21.15.133:0/2920438544 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc00d820 con 0x7fdfe80acbc0 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 -- 172.21.15.133:0/2920438544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 msgr2=0x7fdfe80acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 --2- 172.21.15.133:0/2920438544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fdfdc009760 tx=0x7fdfdc009060).stop 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 -- 172.21.15.133:0/2920438544 shutdown_connections 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 --2- 172.21.15.133:0/2920438544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe80acfa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 --2- 172.21.15.133:0/2920438544 >> v2:172.21.15.178:3300/0 conn(0x7fdfe8066460 0x7fdfe80634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 -- 172.21.15.133:0/2920438544 >> 172.21.15.133:0/2920438544 conn(0x7fdfe80c8200 msgr2=0x7fdfe80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 -- 172.21.15.133:0/2920438544 shutdown_connections 2024-01-21T20:14:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.346+0000 7fdfee309700 1 -- 172.21.15.133:0/2920438544 wait complete. 2024-01-21T20:14:56.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.347+0000 7fdfee309700 1 Processor -- start 2024-01-21T20:14:56.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.347+0000 7fdfee309700 1 -- start start 2024-01-21T20:14:56.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfe81521e0 0x7fdfe81554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80bfb90 con 0x7fdfe8066460 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe80bf6d0 con 0x7fdfe81521e0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfee309700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe814f890 con 0x7fdfe80acbc0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50806/0 (socket says 172.21.15.133:50806) 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe7fff700 1 -- 172.21.15.133:0/3424424693 learned_addr learned my addr 172.21.15.133:0/3424424693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe77fe700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe814f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfec8a6700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfe81521e0 0x7fdfe81554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe77fe700 1 -- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfe81521e0 msgr2=0x7fdfe81554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe77fe700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfe81521e0 0x7fdfe81554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe77fe700 1 -- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 msgr2=0x7fdfe80bf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.348+0000 7fdfe77fe700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe77fe700 1 -- 172.21.15.133:0/3424424693 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80092a0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe7fff700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe77fe700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe814f3a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdfd800e980 tx=0x7fdfd8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8012600 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd8012760 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8012ae0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc0092a0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.349+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe81536d0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.350+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe81559e0 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.350+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fdfd801b400 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.350+0000 7fdfe4ff9700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 0x7fdfd4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.351+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fdfd807aa60 con 0x7fdfe80acbc0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.351+0000 7fdfe7fff700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 0x7fdfd4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:56.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.351+0000 7fdfe7fff700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 0x7fdfd4061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdfdc009270 tx=0x7fdfdc016000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:56.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.355+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfd804b900 con 0x7fdfe80acbc0 2024-01-21T20:14:56.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.560+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfe8153860 con 0x7fdfe80acbc0 2024-01-21T20:14:56.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.561+0000 7fdfe4ff9700 1 -- 172.21.15.133:0/3424424693 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fdfd8016070 con 0x7fdfe80acbc0 2024-01-21T20:14:56.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:14:56.550 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 msgr2=0x7fdfd4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 0x7fdfd4061730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdfdc009270 tx=0x7fdfdc016000).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 msgr2=0x7fdfe814f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe814f3a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fdfd800e980 tx=0x7fdfd8009060).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 shutdown_connections 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdfd405f270 0x7fdfd4061730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfe81521e0 0x7fdfe81554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe8066460 0x7fdfe80bf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 --2- 172.21.15.133:0/3424424693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfe80acbc0 0x7fdfe814f3a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 >> 172.21.15.133:0/3424424693 conn(0x7fdfe80c8200 msgr2=0x7fdfe80c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 shutdown_connections 2024-01-21T20:14:56.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:56.563+0000 7fdfee309700 1 -- 172.21.15.133:0/3424424693 wait complete. 2024-01-21T20:14:56.554 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:14:56.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:14:52.450559+0000', 'modified': '2024-01-21T20:14:54.456480+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6726}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6726': {'gid': 6726, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6836/3995790824', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 3995790824}, {'type': 'v1', 'addr': '172.21.15.133:6836', 'nonce': 3995790824}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:14:56.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:14:56.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-21T20:14:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.101+0000 7f27d5a3d700 1 Processor -- start 2024-01-21T20:14:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.101+0000 7f27d5a3d700 1 -- start start 2024-01-21T20:14:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27d5a3d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27d00a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27d5a3d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00654f0 con 0x7f27d01546b0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27d5a3d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d0063700 con 0x7f27d00bc6d0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27d5a3d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0063950 con 0x7f27d0154a90 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27ceffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f27d01546b0 0x7f27d0065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59946/0 (socket says 172.21.15.133:59946) 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.102+0000 7f27ceffd700 1 -- 172.21.15.133:0/2477588956 learned_addr learned my addr 172.21.15.133:0/2477588956 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27d00a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114087730 0 0) 0x7f27d00654f0 con 0x7f27d01546b0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b80033f0 con 0x7f27d01546b0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952479235 0 0) 0x7f27b80033f0 con 0x7f27d01546b0 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 msgr2=0x7f27d00a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27d00a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 >> v1:172.21.15.178:6789/0 conn(0x7f27d00bc6d0 legacy=0x7f27d0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d0065180 con 0x7f27d01546b0 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f27c4001470 con 0x7f27d01546b0 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 >> v1:172.21.15.133:6789/0 conn(0x7f27d01546b0 legacy=0x7f27d0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27b8003910 0x7f27b8003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27b8004690 0x7f27b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27b8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0063950 con 0x7f27b8004690 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b800b930 con 0x7f27b8003910 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b800baf0 con 0x7f27d0154a90 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27b8004690 0x7f27b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ceffd700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27b8003910 0x7f27b8003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27b8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 -- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 msgr2=0x7f27b8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27d0154a90 0x7f27b8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 -- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27b8003910 msgr2=0x7f27b8003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27b8003910 0x7f27b8003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.103+0000 7f27ce7fc700 1 -- 172.21.15.133:0/2477588956 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b80033f0 con 0x7f27b8004690 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27b8004690 0x7f27b8004b10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f27d00aa320 tx=0x7f27c0009060).ready entity=mon.0 client_cookie=42b77b0a2d00f9ec server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0009e90 con 0x7f27b8004690 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c0009430 con 0x7f27b8004690 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27cdffb700 1 -- 172.21.15.133:0/2477588956 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000e850 con 0x7f27b8004690 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 -- 172.21.15.133:0/2477588956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27b8004690 msgr2=0x7f27b8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/2477588956 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27b8004690 0x7f27b8004b10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f27d00aa320 tx=0x7f27c0009060).stop 2024-01-21T20:14:57.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27cf7fe700 1 -- 172.21.15.133:0/2477588956 reap_dead start 2024-01-21T20:14:57.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 -- 172.21.15.133:0/2477588956 shutdown_connections 2024-01-21T20:14:57.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 -- 172.21.15.133:0/2477588956 >> 172.21.15.133:0/2477588956 conn(0x7f27d00c8200 msgr2=0x7f27d00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 -- 172.21.15.133:0/2477588956 shutdown_connections 2024-01-21T20:14:57.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.104+0000 7f27d5a3d700 1 -- 172.21.15.133:0/2477588956 wait complete. 2024-01-21T20:14:57.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 Processor -- start 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 -- start start 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27b8004690 0x7f27d0164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d0143760 0x7f27d00abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0165c90 con 0x7f27d00be810 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0165120 con 0x7f27d0143760 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27d5a3d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d01653f0 con 0x7f27b8004690 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27ce7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27ce7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50814/0 (socket says 172.21.15.133:50814) 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.106+0000 7f27ce7fc700 1 -- 172.21.15.133:0/3837041086 learned_addr learned my addr 172.21.15.133:0/3837041086 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d0143760 0x7f27d00abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27b8004690 0x7f27d0164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 -- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27b8004690 msgr2=0x7f27d0164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27b8004690 0x7f27d0164c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 -- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d0143760 msgr2=0x7f27d00abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d0143760 0x7f27d00abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 -- 172.21.15.133:0/3837041086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d01656d0 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f27c000e4b0 tx=0x7f27c001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27b77fe700 1 -- 172.21.15.133:0/3837041086 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c001d980 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27b77fe700 1 -- 172.21.15.133:0/3837041086 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c001dae0 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d01659b0 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27b77fe700 1 -- 172.21.15.133:0/3837041086 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c001dea0 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.107+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d00ac080 con 0x7f27d00be810 2024-01-21T20:14:57.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.109+0000 7f27b77fe700 1 -- 172.21.15.133:0/3837041086 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f27c002f440 con 0x7f27d00be810 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.109+0000 7f27b77fe700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 0x7f27bc061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.109+0000 7f27b77fe700 1 -- 172.21.15.133:0/3837041086 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f27c007c460 con 0x7f27d00be810 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.109+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 0x7f27bc061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.109+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 0x7f27bc061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f27c4001120 tx=0x7f27c4009040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.111+0000 7f27e73e0b80 1 Processor -- start 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.111+0000 7f27e73e0b80 1 -- start start 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3d63a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d5e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3cda3d0 con 0x5566f3d5edf0 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3c9fbe0 con 0x5566f3d63620 2024-01-21T20:14:57.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566f3cb5260 con 0x5566f3dac2c0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50816/0 (socket says 172.21.15.133:50816) 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 -- 172.21.15.133:0/2468830685 learned_addr learned my addr 172.21.15.133:0/2468830685 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27ceffd700 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3d63a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d5e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 -- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 msgr2=0x5566f3d5e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d5e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 -- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 msgr2=0x5566f3d63a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3d63a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 -- 172.21.15.133:0/2468830685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566f3cae2f0 con 0x5566f3d5edf0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.112+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f27d0065460 tx=0x7f27c8007f10).ready entity=mon.0 client_cookie=c6282f4d57d56f01 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27b4ff9700 1 -- 172.21.15.133:0/2468830685 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8001820 con 0x5566f3d5edf0 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27b4ff9700 1 -- 172.21.15.133:0/2468830685 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8001980 con 0x5566f3d5edf0 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27b4ff9700 1 -- 172.21.15.133:0/2468830685 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8001d00 con 0x5566f3d5edf0 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 -- 172.21.15.133:0/2468830685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 msgr2=0x5566f3d5f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f27d0065460 tx=0x7f27c8007f10).stop 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 -- 172.21.15.133:0/2468830685 shutdown_connections 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d5f270 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3d63a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/2468830685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d5e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 -- 172.21.15.133:0/2468830685 >> 172.21.15.133:0/2468830685 conn(0x5566f3bcc2e0 msgr2=0x5566f3dac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 -- 172.21.15.133:0/2468830685 shutdown_connections 2024-01-21T20:14:57.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.113+0000 7f27e73e0b80 1 -- 172.21.15.133:0/2468830685 wait complete. 2024-01-21T20:14:57.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.114+0000 7f27e73e0b80 1 -- start start 2024-01-21T20:14:57.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.114+0000 7f27e73e0b80 1 Processor -- start 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 0x5566f3d90a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3dac2c0 0x5566f3da5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3cb53a0 con 0x5566f3d5edf0 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3cb5620 con 0x5566f3dac2c0 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566f3c80990 con 0x5566f3d63620 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 10 client.0 ll_register_callbacks cb 0x5566f3d23610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50818/0 (socket says 172.21.15.133:50818) 2024-01-21T20:14:57.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 -- 172.21.15.133:0/3545018026 learned_addr learned my addr 172.21.15.133:0/3545018026 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 0x5566f3d90a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3dac2c0 0x5566f3da5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 -- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 msgr2=0x5566f3d90a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 0x5566f3d90a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 -- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3dac2c0 msgr2=0x5566f3da5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3dac2c0 0x5566f3da5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 -- 172.21.15.133:0/3545018026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c8002890 con 0x5566f3d5edf0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 0x5566f3d90a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27ceffd700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f27c4015490 tx=0x7f27c4014000).ready entity=mon.0 client_cookie=bad6da1373b5d0fa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27adffb700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4015e60 con 0x5566f3d5edf0 2024-01-21T20:14:57.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f27c4013570 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5566f3d5ddf0 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c4013990 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 10 client.6867 fetch_fsmap learned FSMap version 30 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.115+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5566f3ca9520 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5566f3d5ddf0 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27c4021070 con 0x5566f3d5edf0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 10 client.6867 fetch_fsmap finished waiting for FSMap version 30 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 10 client.6867 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 20 client.6867 populate_metadata read hostname 'smithi133' 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3d8d3b0 0x5566f3d8d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 4 client.6867 mds_command: new command op to 6726 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 --> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566f3caad60 con 0x5566f3d8d3b0 2024-01-21T20:14:57.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3d8d3b0 0x5566f3d8d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27adffb700 10 client.6867 ms_handle_connect on v2:172.21.15.133:6834/3995790824 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.116+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3d8d3b0 0x5566f3d8d790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e7526fbf0d06c9a0 server_cookie=d048c35df104f94f in_seq=0 out_seq=0 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27adffb700 1 -- 172.21.15.133:0/3545018026 <== mds.0 v2:172.21.15.133:6834/3995790824 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5566f3caad60 con 0x5566f3d8d3b0 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27adffb700 10 client.6867 handle_command_reply: tid=0 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 client.6867 shutdown 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 msgr2=0x5566f3d8ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f27c4015490 tx=0x7f27c4014000).stop 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 shutdown_connections 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3d8d3b0 0x5566f3d8d790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3dac2c0 0x5566f3da5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3d8ea40 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27adffb700 0 client.6867 ms_handle_reset on v2:172.21.15.133:6834/3995790824 2024-01-21T20:14:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/3545018026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d63620 0x5566f3d90a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 >> 172.21.15.133:0/3545018026 conn(0x5566f3bcc2e0 msgr2=0x5566f3da8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 shutdown_connections 2024-01-21T20:14:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 1 -- 172.21.15.133:0/3545018026 wait complete. 2024-01-21T20:14:57.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.117+0000 7f27e73e0b80 20 client.6867 trim_cache size 0 max 16384 2024-01-21T20:14:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.133+0000 7f27e73e0b80 1 Processor -- start 2024-01-21T20:14:57.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.133+0000 7f27e73e0b80 1 -- start start 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d5edf0 0x5566f3d5a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3db77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3d58180 con 0x5566f3dac2c0 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3d61620 con 0x5566f3d63620 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566f3db81a0 con 0x5566f3d5edf0 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50832/0 (socket says 172.21.15.133:50832) 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 -- 172.21.15.133:0/4069813578 learned_addr learned my addr 172.21.15.133:0/4069813578 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3db77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27ceffd700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d5edf0 0x5566f3d5a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 -- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d5edf0 msgr2=0x5566f3d5a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d5edf0 0x5566f3d5a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 -- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 msgr2=0x5566f3db77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.134+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3db77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27cf7fe700 1 -- 172.21.15.133:0/4069813578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566f3ca9270 con 0x5566f3dac2c0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3db77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f27c8004060 tx=0x7f27c8018000).ready entity=mon.0 client_cookie=870032fa20270049 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27b57fa700 1 -- 172.21.15.133:0/4069813578 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80017e0 con 0x5566f3dac2c0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27b57fa700 1 -- 172.21.15.133:0/4069813578 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8001af0 con 0x5566f3dac2c0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27b57fa700 1 -- 172.21.15.133:0/4069813578 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8001e70 con 0x5566f3dac2c0 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 -- 172.21.15.133:0/4069813578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 msgr2=0x5566f3db7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f27c8004060 tx=0x7f27c8018000).stop 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 -- 172.21.15.133:0/4069813578 shutdown_connections 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3dac2c0 0x5566f3db7cb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3d5edf0 0x5566f3d5a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/4069813578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3db77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 -- 172.21.15.133:0/4069813578 >> 172.21.15.133:0/4069813578 conn(0x5566f3bcc2e0 msgr2=0x5566f3d909f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 -- 172.21.15.133:0/4069813578 shutdown_connections 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.135+0000 7f27e73e0b80 1 -- 172.21.15.133:0/4069813578 wait complete. 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.136+0000 7f27e73e0b80 1 -- start start 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.136+0000 7f27e73e0b80 1 Processor -- start 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3e0cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3e0d790 con 0x5566f3d5edf0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566f3d62770 con 0x5566f3d63620 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5566f3d8b2d0 con 0x5566f3dac2c0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 10 client.0 ll_register_callbacks cb 0x5566f3d23610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50838/0 (socket says 172.21.15.133:50838) 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 -- 172.21.15.133:0/788556755 learned_addr learned my addr 172.21.15.133:0/788556755 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3e0cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27cf7fe700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 -- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 msgr2=0x5566f3d8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d8a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 -- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 msgr2=0x5566f3e0cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3e0cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 -- 172.21.15.133:0/788556755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566f3cae2f0 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3e0cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27ceffd700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f27c4000f30 tx=0x7f27c401b000).ready entity=mon.0 client_cookie=4508667b40dfddf6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27adffb700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4013990 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f27c402d470 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27c8001980 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c402d880 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 10 client.6873 fetch_fsmap learned FSMap version 30 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.137+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x5566f3b22f80 con 0x5566f3d5edf0 2024-01-21T20:14:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8001980 con 0x5566f3d5edf0 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27c402d9e0 con 0x5566f3d5edf0 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 10 client.6873 fetch_fsmap finished waiting for FSMap version 30 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 10 client.6873 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 20 client.6873 populate_metadata read hostname 'smithi133' 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3e10b30 0x5566f3e10f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 4 client.6873 mds_command: new command op to 6726 tid=0[{"prefix": "status"}] 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 --> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5566f3ca17d0 con 0x5566f3e10b30 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3e10b30 0x5566f3e10f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 10 client.6873 ms_handle_connect on v2:172.21.15.133:6834/3995790824 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27ce7fc700 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3e10b30 0x5566f3e10f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3c3a079e1aad1065 server_cookie=da1a96b9a6d42ffa in_seq=0 out_seq=0 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 1 -- 172.21.15.133:0/788556755 <== mds.0 v2:172.21.15.133:6834/3995790824 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5566f3ca17d0 con 0x5566f3e10b30 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 10 client.6873 handle_command_reply: tid=0 2024-01-21T20:14:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 client.6873 shutdown 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 msgr2=0x5566f3e0ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f27c4000f30 tx=0x7f27c401b000).stop 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 shutdown_connections 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:6834/3995790824,v1:172.21.15.133:6836/3995790824] conn(0x5566f3e10b30 0x5566f3e10f10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5566f3dac2c0 0x5566f3d8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27adffb700 0 client.6873 ms_handle_reset on v2:172.21.15.133:6834/3995790824 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5566f3d5edf0 0x5566f3e0ca80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 --2- 172.21.15.133:0/788556755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5566f3d63620 0x5566f3e0cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.138+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 >> 172.21.15.133:0/788556755 conn(0x5566f3bcc2e0 msgr2=0x5566f3db77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 shutdown_connections 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27e73e0b80 1 -- 172.21.15.133:0/788556755 wait complete. 2024-01-21T20:14:57.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27e73e0b80 20 client.6873 trim_cache size 0 max 16384 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6726, 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 4.6871995169999998, 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 30, 2024-01-21T20:14:57.137 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 94, 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 94, 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 9.6994013020000001 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 msgr2=0x7f27bc061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 0x7f27bc061730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f27c4001120 tx=0x7f27c4009040).stop 2024-01-21T20:14:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 msgr2=0x7f27d0143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f27c000e4b0 tx=0x7f27c001a000).stop 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 shutdown_connections 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f27bc05f270 0x7f27bc061730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27d0143760 0x7f27d00abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27b8004690 0x7f27d0164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 --2- 172.21.15.133:0/3837041086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27d00be810 0x7f27d0143270 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 >> 172.21.15.133:0/3837041086 conn(0x7f27d00c8200 msgr2=0x7f27d00c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 shutdown_connections 2024-01-21T20:14:57.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.139+0000 7f27d5a3d700 1 -- 172.21.15.133:0/3837041086 wait complete. 2024-01-21T20:14:57.140 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:14:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.253+0000 7f1305845700 1 Processor -- start 2024-01-21T20:14:57.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.253+0000 7f1305845700 1 -- start start 2024-01-21T20:14:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f1305845700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1300158500 0x7f13000648f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f1305845700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f13000a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f1305845700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1300158c80 con 0x7f13000989a0 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f1305845700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13001546f0 con 0x7f1300158500 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f1305845700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300064460 con 0x7f13000c1380 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f12feffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13000989a0 0x7f1300157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59954/0 (socket says 172.21.15.133:59954) 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.254+0000 7f12feffd700 1 -- 172.21.15.133:0/569863198 learned_addr learned my addr 172.21.15.133:0/569863198 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 --2- 172.21.15.133:0/569863198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f13000a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fe7fc700 1 --2- 172.21.15.133:0/569863198 >> v2:172.21.15.178:3300/0 conn(0x7f1300158500 0x7f13000648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fdffb700 1 -- 172.21.15.133:0/569863198 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983517645 0 0) 0x7f1300158c80 con 0x7f13000989a0 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fdffb700 1 -- 172.21.15.133:0/569863198 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e80033f0 con 0x7f13000989a0 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 -- 172.21.15.133:0/569863198 >> v2:172.21.15.178:3300/0 conn(0x7f1300158500 msgr2=0x7f13000648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 --2- 172.21.15.133:0/569863198 >> v2:172.21.15.178:3300/0 conn(0x7f1300158500 0x7f13000648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 -- 172.21.15.133:0/569863198 >> v1:172.21.15.133:6789/0 conn(0x7f13000989a0 legacy=0x7f1300157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 -- 172.21.15.133:0/569863198 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000c6330 con 0x7f13000c1380 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12ff7fe700 1 --2- 172.21.15.133:0/569863198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f13000a7f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f12f8009e60 tx=0x7f12f8009780).ready entity=mon.2 client_cookie=b91e168f6840bf0e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fdffb700 1 -- 172.21.15.133:0/569863198 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800e070 con 0x7f13000c1380 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fdffb700 1 -- 172.21.15.133:0/569863198 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800bab0 con 0x7f13000c1380 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.255+0000 7f12fdffb700 1 -- 172.21.15.133:0/569863198 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800be30 con 0x7f13000c1380 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 -- 172.21.15.133:0/569863198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 msgr2=0x7f13000a7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 --2- 172.21.15.133:0/569863198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f13000a7f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f12f8009e60 tx=0x7f12f8009780).stop 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 -- 172.21.15.133:0/569863198 shutdown_connections 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 --2- 172.21.15.133:0/569863198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f13000a7f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 --2- 172.21.15.133:0/569863198 >> v2:172.21.15.178:3300/0 conn(0x7f1300158500 0x7f13000648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 -- 172.21.15.133:0/569863198 >> 172.21.15.133:0/569863198 conn(0x7f13000cb050 msgr2=0x7f13000cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 -- 172.21.15.133:0/569863198 shutdown_connections 2024-01-21T20:14:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.256+0000 7f1305845700 1 -- 172.21.15.133:0/569863198 wait complete. 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.257+0000 7f1305845700 1 Processor -- start 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 -- start start 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f1300153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1300158500 0x7f13000c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001650a0 con 0x7f13000989a0 2024-01-21T20:14:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000aeea0 con 0x7f1300158500 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.258+0000 7f1305845700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1300164490 con 0x7f13000c1380 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50844/0 (socket says 172.21.15.133:50844) 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 -- 172.21.15.133:0/3288729729 learned_addr learned my addr 172.21.15.133:0/3288729729 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12fe7fc700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f1300153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12ff7fe700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1300158500 0x7f13000c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 -- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 msgr2=0x7f1300153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f1300153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 -- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1300158500 msgr2=0x7f13000c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1300158500 0x7f13000c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 -- 172.21.15.133:0/3288729729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f8009a20 con 0x7f13000989a0 2024-01-21T20:14:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12feffd700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f12f400c590 tx=0x7f12f4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4007e40 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300164770 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f40072e0 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f40057a0 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.259+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300164d30 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.260+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13000475e0 con 0x7f13000989a0 2024-01-21T20:14:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.261+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f12f4005bd0 con 0x7f13000989a0 2024-01-21T20:14:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.261+0000 7f12e77fe700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 0x7f12ec061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.261+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f12f407a450 con 0x7f13000989a0 2024-01-21T20:14:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.261+0000 7f12fe7fc700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 0x7f12ec061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.262+0000 7f12fe7fc700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 0x7f12ec061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1300158900 tx=0x7f12f0008040).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.265+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f12f404b350 con 0x7f13000989a0 2024-01-21T20:14:57.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.469+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1300065270 con 0x7f13000989a0 2024-01-21T20:14:57.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.469+0000 7f12e77fe700 1 -- 172.21.15.133:0/3288729729 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12f404e970 con 0x7f13000989a0 2024-01-21T20:14:57.460 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 msgr2=0x7f12ec061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 0x7f12ec061730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1300158900 tx=0x7f12f0008040).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 msgr2=0x7f13000ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f12f400c590 tx=0x7f12f4007c80).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 shutdown_connections 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f12ec05f270 0x7f12ec061730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1300158500 0x7f13000c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13000989a0 0x7f13000ae9b0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 --2- 172.21.15.133:0/3288729729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000c1380 0x7f1300153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 >> 172.21.15.133:0/3288729729 conn(0x7f13000cb050 msgr2=0x7f1300063310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 shutdown_connections 2024-01-21T20:14:57.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:57.471+0000 7f1305845700 1 -- 172.21.15.133:0/3288729729 wait complete. 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:14:57.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:14:57.472 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:14:57.472 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:14:57.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.472 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:14:57.489 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:14:57.489 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:14:57.489 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:14:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41434sec preferred_lft 41434sec 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:14:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:14:57.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.492 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:14:57.556 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:14:57.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.557 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:14:57.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.616 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:14:57.616 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:14:57.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:14:57.617 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:14:57.617 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:14:57.617 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:14:57.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.721 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:14:57.738 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:14:57.738 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:14:57.738 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:14:57.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:14:57.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.805 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:57.858 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:14:57.868+0000 7f4b3db4b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:14:57.861 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:14:57.862 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:57.943 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:57.943 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:14:57.964 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:14:57.964 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:14:57.966 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:14:57.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:14:57.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:14:58.034 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:14:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.202+0000 7f70ddcb7700 1 Processor -- start 2024-01-21T20:14:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.202+0000 7f70ddcb7700 1 -- start start 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70ddcb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70ddcb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f70d8065d70 0x7f70d80bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70ddcb7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80634e0 con 0x7f70d80697e0 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70ddcb7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d806a130 con 0x7f70d8065d70 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70ddcb7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d806a410 con 0x7f70d8062c10 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f70d8065d70 0x7f70d80bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d6ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f70d80697e0 0x7f70d8065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37126/0 (socket says 172.21.15.133:37126) 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d6ffd700 1 -- 172.21.15.133:0/880848502 learned_addr learned my addr 172.21.15.133:0/880848502 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d7fff700 1 -- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 msgr2=0x7f70d8062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d7fff700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d8062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d7fff700 1 -- 172.21.15.133:0/880848502 >> v1:172.21.15.178:6789/0 conn(0x7f70d80697e0 legacy=0x7f70d8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d7fff700 1 -- 172.21.15.133:0/880848502 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d806a6f0 con 0x7f70d8065d70 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d77fe700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.203+0000 7f70d67fc700 1 -- 172.21.15.133:0/880848502 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152576938 0 0) 0x7f70d80634e0 con 0x7f70d80697e0 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70d7fff700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d8065d70 0x7f70d80bd770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f70d0009e60 tx=0x7f70d0009780).ready entity=mon.1 client_cookie=9acefa46a9e917dd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70d67fc700 1 -- 172.21.15.133:0/880848502 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000e070 con 0x7f70d8065d70 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70d67fc700 1 -- 172.21.15.133:0/880848502 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d000bb60 con 0x7f70d8065d70 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70d67fc700 1 -- 172.21.15.133:0/880848502 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0012410 con 0x7f70d8065d70 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 -- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d8065d70 msgr2=0x7f70d80bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d8065d70 0x7f70d80bd770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f70d0009e60 tx=0x7f70d0009780).stop 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 -- 172.21.15.133:0/880848502 shutdown_connections 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d8065d70 0x7f70d80bd770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/880848502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 -- 172.21.15.133:0/880848502 >> 172.21.15.133:0/880848502 conn(0x7f70d80c8010 msgr2=0x7f70d80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 -- 172.21.15.133:0/880848502 shutdown_connections 2024-01-21T20:14:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.204+0000 7f70ddcb7700 1 -- 172.21.15.133:0/880848502 wait complete. 2024-01-21T20:14:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.206+0000 7f70ddcb7700 1 Processor -- start 2024-01-21T20:14:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.206+0000 7f70ddcb7700 1 -- start start 2024-01-21T20:14:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.206+0000 7f70ddcb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.206+0000 7f70ddcb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.206+0000 7f70ddcb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d80697e0 0x7f70d80ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70ddcb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d813c740 con 0x7f70d8065d70 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70ddcb7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d813bb30 con 0x7f70d80697e0 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70ddcb7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d813be10 con 0x7f70d8062c10 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50848/0 (socket says 172.21.15.133:50848) 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 -- 172.21.15.133:0/817537926 learned_addr learned my addr 172.21.15.133:0/817537926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d77fe700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d7fff700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d80697e0 0x7f70d80ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 -- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 msgr2=0x7f70d813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d813b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 -- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d80697e0 msgr2=0x7f70d80ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d80697e0 0x7f70d80ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 -- 172.21.15.133:0/817537926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c80092a0 con 0x7f70d8065d70 2024-01-21T20:14:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70d6ffd700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f70cc00c4a0 tx=0x7f70cc007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc00ce50 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc0072e0 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d0009a20 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc007660 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.207+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d813c3d0 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.208+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d80bd490 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.209+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7f70cc0059b0 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.209+0000 7f70bffff700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 0x7f70c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.209+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f70cc079da0 con 0x7f70d8065d70 2024-01-21T20:14:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.209+0000 7f70d77fe700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 0x7f70c4061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.209+0000 7f70d77fe700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 0x7f70c4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f70d80c7580 tx=0x7f70c8009060).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.213+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f70cc04aca0 con 0x7f70d8065d70 2024-01-21T20:14:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.401+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f70d80bcf70 con 0x7f70c405f270 2024-01-21T20:14:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.402+0000 7f70bffff700 1 -- 172.21.15.133:0/817537926 <== mgr.6561 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f70d80bcf70 con 0x7f70c405f270 2024-01-21T20:14:58.392 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:14:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:14:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:14:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:14:58.392 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:14:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 msgr2=0x7f70c4061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 0x7f70c4061730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f70d80c7580 tx=0x7f70c8009060).stop 2024-01-21T20:14:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 msgr2=0x7f70d80a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f70cc00c4a0 tx=0x7f70cc007c30).stop 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 shutdown_connections 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f70c405f270 0x7f70c4061730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70d80697e0 0x7f70d80ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70d8062c10 0x7f70d813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 --2- 172.21.15.133:0/817537926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70d8065d70 0x7f70d80a95f0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.404+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 >> 172.21.15.133:0/817537926 conn(0x7f70d80c8010 msgr2=0x7f70d80be720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.405+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 shutdown_connections 2024-01-21T20:14:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.405+0000 7f70ddcb7700 1 -- 172.21.15.133:0/817537926 wait complete. 2024-01-21T20:14:58.406 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:14:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.534+0000 7fc69cfc0700 1 Processor -- start 2024-01-21T20:14:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.534+0000 7fc69cfc0700 1 -- start start 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69cfc0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 0x7fc698067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69cfc0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc698137410 0x7fc698155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69cfc0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6981557f0 con 0x7fc6980c5930 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69cfc0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc698068370 con 0x7fc698137410 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69cfc0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc698068650 con 0x7fc698137030 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc695d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc698137410 0x7fc698155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc696d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6980c5930 0x7fc6980c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59958/0 (socket says 172.21.15.133:59958) 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc696d9d700 1 -- 172.21.15.133:0/140729855 learned_addr learned my addr 172.21.15.133:0/140729855 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc695d9b700 1 --2- 172.21.15.133:0/140729855 >> v2:172.21.15.133:3300/0 conn(0x7fc698137410 0x7fc698155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50850/0 (socket says 172.21.15.133:50850) 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69659c700 1 --2- 172.21.15.133:0/140729855 >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 0x7fc698067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc695d9b700 1 -- 172.21.15.133:0/140729855 >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 msgr2=0x7fc698067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc695d9b700 1 --2- 172.21.15.133:0/140729855 >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 0x7fc698067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc695d9b700 1 -- 172.21.15.133:0/140729855 >> v1:172.21.15.133:6789/0 conn(0x7fc6980c5930 legacy=0x7fc6980c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.535+0000 7fc69559a700 1 -- 172.21.15.133:0/140729855 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127683282 0 0) 0x7fc6981557f0 con 0x7fc6980c5930 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc695d9b700 1 -- 172.21.15.133:0/140729855 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698068930 con 0x7fc698137410 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69659c700 1 --2- 172.21.15.133:0/140729855 >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 0x7fc698067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc695d9b700 1 --2- 172.21.15.133:0/140729855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc698137410 0x7fc698155300 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fc6980c8e10 tx=0x7fc688009060).ready entity=mon.0 client_cookie=cee3a71ccc558a17 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69559a700 1 -- 172.21.15.133:0/140729855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6880090d0 con 0x7fc698137410 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69559a700 1 -- 172.21.15.133:0/140729855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800b580 con 0x7fc698137410 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69559a700 1 -- 172.21.15.133:0/140729855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800b900 con 0x7fc698137410 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 -- 172.21.15.133:0/140729855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc698137410 msgr2=0x7fc698155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/140729855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc698137410 0x7fc698155300 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fc6980c8e10 tx=0x7fc688009060).stop 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 -- 172.21.15.133:0/140729855 shutdown_connections 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/140729855 >> v2:172.21.15.178:3300/0 conn(0x7fc698137030 0x7fc698067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/140729855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc698137410 0x7fc698155300 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 -- 172.21.15.133:0/140729855 >> 172.21.15.133:0/140729855 conn(0x7fc698066a90 msgr2=0x7fc698066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 -- 172.21.15.133:0/140729855 shutdown_connections 2024-01-21T20:14:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.536+0000 7fc69cfc0700 1 -- 172.21.15.133:0/140729855 wait complete. 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.538+0000 7fc69cfc0700 1 Processor -- start 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.538+0000 7fc69cfc0700 1 -- start start 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 0x7fc69813b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc698137410 0x7fc69813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980c2e40 con 0x7fc6980c5930 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69813c370 con 0x7fc698137030 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc698137b80 con 0x7fc698137410 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50854/0 (socket says 172.21.15.133:50854) 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 -- 172.21.15.133:0/4022584188 learned_addr learned my addr 172.21.15.133:0/4022584188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc695d9b700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 0x7fc69813b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 -- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc698137410 msgr2=0x7fc69813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc698137410 0x7fc69813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 -- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 msgr2=0x7fc69813b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 0x7fc69813b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 -- 172.21.15.133:0/4022584188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880092a0 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc695d9b700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 0x7fc69813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69659c700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fc68c00c8b0 tx=0x7fc68c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c010580 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c0106e0 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc698156710 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c010a60 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.539+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6980c2880 con 0x7fc6980c5930 2024-01-21T20:14:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.540+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc698137e60 con 0x7fc6980c5930 2024-01-21T20:14:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.541+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 31) v1 ==== 75548+0+0 (secure 0 0 0) 0x7fc68c01b460 con 0x7fc6980c5930 2024-01-21T20:14:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.541+0000 7fc686ffd700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 0x7fc678061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.541+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc68c07a550 con 0x7fc6980c5930 2024-01-21T20:14:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.541+0000 7fc695d9b700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 0x7fc678061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.541+0000 7fc695d9b700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 0x7fc678061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc6981542d0 tx=0x7fc688017000).ready entity=mgr.6561 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:58.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.545+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc68c04b3f0 con 0x7fc6980c5930 2024-01-21T20:14:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:58.751+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc69813ac20 con 0x7fc6980c5930 2024-01-21T20:14:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.097+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fc68c077f50 con 0x7fc6980c5930 2024-01-21T20:14:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.098+0000 7fc686ffd700 1 -- 172.21.15.133:0/4022584188 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v32) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc68c0726b0 con 0x7fc6980c5930 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 msgr2=0x7fc678061730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 0x7fc678061730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc6981542d0 tx=0x7fc688017000).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 msgr2=0x7fc698135d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fc68c00c8b0 tx=0x7fc68c008040).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 shutdown_connections 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc67805f270 0x7fc678061730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc698137410 0x7fc69813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6980c5930 0x7fc698135d00 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 --2- 172.21.15.133:0/4022584188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc698137030 0x7fc69813b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 >> 172.21.15.133:0/4022584188 conn(0x7fc698066a90 msgr2=0x7fc698136710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 shutdown_connections 2024-01-21T20:14:59.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.100+0000 7fc69cfc0700 1 -- 172.21.15.133:0/4022584188 wait complete. 2024-01-21T20:14:59.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:14:59.222 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:59.232+0000 7fb5bb34e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:59.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.236+0000 7fd47a04a700 1 Processor -- start 2024-01-21T20:14:59.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.236+0000 7fd47a04a700 1 -- start start 2024-01-21T20:14:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd47a04a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd474158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd47a04a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd474154520 0x7fd4740ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd47a04a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4740ab620 con 0x7fd474154140 2024-01-21T20:14:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd47a04a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740c6ae0 con 0x7fd474154520 2024-01-21T20:14:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd47a04a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740c05e0 con 0x7fd4740c8120 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd474158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd4737fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd474154140 0x7fd4740c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37132/0 (socket says 172.21.15.133:37132) 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd4737fe700 1 -- 172.21.15.133:0/3929857202 learned_addr learned my addr 172.21.15.133:0/3929857202 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.237+0000 7fd473fff700 1 --2- 172.21.15.133:0/3929857202 >> v2:172.21.15.178:3300/0 conn(0x7fd474154520 0x7fd4740ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd472ffd700 1 -- 172.21.15.133:0/3929857202 >> v2:172.21.15.178:3300/0 conn(0x7fd474154520 msgr2=0x7fd4740ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd472ffd700 1 --2- 172.21.15.133:0/3929857202 >> v2:172.21.15.178:3300/0 conn(0x7fd474154520 0x7fd4740ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd4727fc700 1 -- 172.21.15.133:0/3929857202 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2428165458 0 0) 0x7fd4740ab620 con 0x7fd474154140 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd472ffd700 1 -- 172.21.15.133:0/3929857202 >> v1:172.21.15.178:6789/0 conn(0x7fd474154140 legacy=0x7fd4740c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd472ffd700 1 -- 172.21.15.133:0/3929857202 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740c0e40 con 0x7fd4740c8120 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd472ffd700 1 --2- 172.21.15.133:0/3929857202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd474158bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd468009760 tx=0x7fd468009060).ready entity=mon.2 client_cookie=339da13e15140e2a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd4727fc700 1 -- 172.21.15.133:0/3929857202 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800f510 con 0x7fd4740c8120 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd4727fc700 1 -- 172.21.15.133:0/3929857202 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800f670 con 0x7fd4740c8120 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.238+0000 7fd4727fc700 1 -- 172.21.15.133:0/3929857202 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800f9f0 con 0x7fd4740c8120 2024-01-21T20:14:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 -- 172.21.15.133:0/3929857202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 msgr2=0x7fd474158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 --2- 172.21.15.133:0/3929857202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd474158bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd468009760 tx=0x7fd468009060).stop 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 -- 172.21.15.133:0/3929857202 shutdown_connections 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 --2- 172.21.15.133:0/3929857202 >> v2:172.21.15.178:3300/0 conn(0x7fd474154520 0x7fd4740ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 --2- 172.21.15.133:0/3929857202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd474158bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 -- 172.21.15.133:0/3929857202 >> 172.21.15.133:0/3929857202 conn(0x7fd47405e1e0 msgr2=0x7fd47405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 -- 172.21.15.133:0/3929857202 shutdown_connections 2024-01-21T20:14:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.239+0000 7fd47a04a700 1 -- 172.21.15.133:0/3929857202 wait complete. 2024-01-21T20:14:59.230 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:59.240+0000 7fe501d59680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.240+0000 7fd47a04a700 1 Processor -- start 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.240+0000 7fd47a04a700 1 -- start start 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd47414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd474154520 0x7fd4740ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd474150970 con 0x7fd474154140 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414d5c0 con 0x7fd474154520 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd47a04a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47414fd60 con 0x7fd4740c8120 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50866/0 (socket says 172.21.15.133:50866) 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 -- 172.21.15.133:0/2213767480 learned_addr learned my addr 172.21.15.133:0/2213767480 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd4737fe700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd47414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd473fff700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd474154520 0x7fd4740ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 -- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 msgr2=0x7fd47414d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd47414d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 -- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd474154520 msgr2=0x7fd4740ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd474154520 0x7fd4740ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 -- 172.21.15.133:0/2213767480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680092a0 con 0x7fd474154140 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd4737fe700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd47414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.241+0000 7fd472ffd700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fd4740c6c20 tx=0x7fd468017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.242+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800f7e0 con 0x7fd474154140 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.242+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800f940 con 0x7fd474154140 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.242+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd474150040 con 0x7fd474154140 2024-01-21T20:14:59.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.242+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46801b690 con 0x7fd474154140 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.242+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd474150600 con 0x7fd474154140 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.243+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47405fdf0 con 0x7fd474154140 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.244+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fd46801ba80 con 0x7fd474154140 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.244+0000 7fd45bfff700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 0x7fd460061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.244+0000 7fd4737fe700 1 -- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 msgr2=0x7fd460061780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.244+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fd46807c0a0 con 0x7fd474154140 2024-01-21T20:14:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.244+0000 7fd4737fe700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 0x7fd460061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.247+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd46804cfe0 con 0x7fd474154140 2024-01-21T20:14:59.287 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:59.297+0000 7fb5bb34e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:59.295 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:59.306+0000 7fe501d59680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:14:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.421+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd4740aa980 con 0x7fd474154140 2024-01-21T20:14:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.425+0000 7fd45bfff700 1 -- 172.21.15.133:0/2213767480 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v15)=0 v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd468028020 con 0x7fd474154140 2024-01-21T20:14:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.426+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 msgr2=0x7fd460061780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:14:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.426+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 0x7fd460061780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.426+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 msgr2=0x7fd474150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.426+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fd4740c6c20 tx=0x7fd468017000).stop 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 shutdown_connections 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd46005f2c0 0x7fd460061780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd474154520 0x7fd4740ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4740c8120 0x7fd47414d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 --2- 172.21.15.133:0/2213767480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd474154140 0x7fd474150e00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 >> 172.21.15.133:0/2213767480 conn(0x7fd47405e1e0 msgr2=0x7fd4740c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 shutdown_connections 2024-01-21T20:14:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.427+0000 7fd47a04a700 1 -- 172.21.15.133:0/2213767480 wait complete. 2024-01-21T20:14:59.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2024-01-21T20:14:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.562+0000 7fdad387e700 1 Processor -- start 2024-01-21T20:14:59.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.562+0000 7fdad387e700 1 -- start start 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad387e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdacc154560 0x7fdacc157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad387e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc0c37c0 con 0x7fdacc066f30 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad387e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc158630 con 0x7fdacc066b50 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad387e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc158ed0 con 0x7fdacc154560 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad0e19700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdacc066f30 0x7fdacc153e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59966/0 (socket says 172.21.15.133:59966) 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad0e19700 1 -- 172.21.15.133:0/1899924176 learned_addr learned my addr 172.21.15.133:0/1899924176 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdad1e1b700 1 --2- 172.21.15.133:0/1899924176 >> v2:172.21.15.178:3300/0 conn(0x7fdacc154560 0x7fdacc157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068052296 0 0) 0x7fdacc0c37c0 con 0x7fdacc066f30 2024-01-21T20:14:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab80033f0 con 0x7fdacc066f30 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462933609 0 0) 0x7fdacc158630 con 0x7fdacc066b50 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdacc0c37c0 con 0x7fdacc066b50 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1570614742 0 0) 0x7fdab80033f0 con 0x7fdacc066f30 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 >> v2:172.21.15.178:3300/0 conn(0x7fdacc154560 msgr2=0x7fdacc157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 --2- 172.21.15.133:0/1899924176 >> v2:172.21.15.178:3300/0 conn(0x7fdacc154560 0x7fdacc157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 >> v1:172.21.15.178:6789/0 conn(0x7fdacc066b50 legacy=0x7fdacc0bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc158910 con 0x7fdacc066f30 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdabc001470 con 0x7fdacc066f30 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.563+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 >> v1:172.21.15.133:6789/0 conn(0x7fdacc066f30 legacy=0x7fdacc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8003a70 0x7fdab8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 0x7fdab8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8005050 0x7fdab800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc158ed0 con 0x7fdab8004690 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800bfc0 con 0x7fdab8003a70 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab800c180 con 0x7fdab8005050 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 0x7fdab8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad161a700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8003a70 0x7fdab8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad1e1b700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8005050 0x7fdab800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 -- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8005050 msgr2=0x7fdab800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab8005050 0x7fdab800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 -- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8003a70 msgr2=0x7fdab8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8003a70 0x7fdab8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 -- 172.21.15.133:0/1899924176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80033f0 con 0x7fdab8004690 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad1e1b700 1 -- 172.21.15.133:0/1899924176 reap_dead start 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdad0e19700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 0x7fdab8004b10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdabc00c110 tx=0x7fdabc001e10).ready entity=mon.0 client_cookie=be12be4d88cfbcb5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc00ca40 con 0x7fdab8004690 2024-01-21T20:14:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc00cba0 con 0x7fdab8004690 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.564+0000 7fdac3fff700 1 -- 172.21.15.133:0/1899924176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0070d0 con 0x7fdab8004690 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 -- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 msgr2=0x7fdab8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 0x7fdab8004b10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7fdabc00c110 tx=0x7fdabc001e10).stop 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 -- 172.21.15.133:0/1899924176 shutdown_connections 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 --2- 172.21.15.133:0/1899924176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdab8004690 0x7fdab8004b10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 -- 172.21.15.133:0/1899924176 >> 172.21.15.133:0/1899924176 conn(0x7fdacc0c8f60 msgr2=0x7fdacc0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 -- 172.21.15.133:0/1899924176 shutdown_connections 2024-01-21T20:14:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.565+0000 7fdad387e700 1 -- 172.21.15.133:0/1899924176 wait complete. 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.566+0000 7fdad387e700 1 Processor -- start 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.566+0000 7fdad387e700 1 -- start start 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004690 0x7fdacc0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 0x7fdacc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdacc0ae880 0x7fdacc14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c01a0 con 0x7fdacc0c1650 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0c1ad0 con 0x7fdab8004690 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad387e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1517b0 con 0x7fdacc0ae880 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad0e19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 0x7fdacc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdacc0ae880 0x7fdacc14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad0e19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 0x7fdacc1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50890/0 (socket says 172.21.15.133:50890) 2024-01-21T20:14:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad161a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004690 0x7fdacc0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad0e19700 1 -- 172.21.15.133:0/3524884766 learned_addr learned my addr 172.21.15.133:0/3524884766 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004690 msgr2=0x7fdacc0abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004690 0x7fdacc0abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 msgr2=0x7fdacc1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 0x7fdacc1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad1e1b700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0c1d30 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad0e19700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0c1650 0x7fdacc1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.567+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab8004690 0x7fdacc0abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdad1e1b700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdacc0ae880 0x7fdacc14f620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fdacc154940 tx=0x7fdac400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400e040 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac400f040 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdad387e700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc0c2010 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac400fe20 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.568+0000 7fdad387e700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0c25d0 con 0x7fdacc0ae880 2024-01-21T20:14:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.569+0000 7fdad387e700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc05fdf0 con 0x7fdacc0ae880 2024-01-21T20:14:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.570+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 32) v1 ==== 75565+0+0 (secure 0 0 0) 0x7fdac4015660 con 0x7fdacc0ae880 2024-01-21T20:14:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.570+0000 7fdac1ffb700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:14:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.570+0000 7fdad161a700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.570+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fdac407a9f0 con 0x7fdacc0ae880 2024-01-21T20:14:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.570+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:14:59.563 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:14:59.570+0000 7fb5bb34e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.575+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdac404b8f0 con 0x7fdacc0ae880 2024-01-21T20:14:59.582 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:14:59.593+0000 7fe501d59680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:14:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.770+0000 7fdad387e700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdacc06bd20 con 0x7fdab005f2f0 2024-01-21T20:14:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.771+0000 7fdad161a700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:14:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:14:59.771+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:00.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:00.172+0000 7fdad161a700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:00.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:00.172+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:15:00.173 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:00.183+0000 7fb5bb34e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:00.204 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:00.214+0000 7fe501d59680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:00.244 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:00.255+0000 7fb5bb34e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:00.275 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:00.286+0000 7fe501d59680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:00.430 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:00.440+0000 7fb5bb34e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:00.462 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:00.473+0000 7fe501d59680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:00.850 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:00.861+0000 7fb5bb34e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:00.883 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:00.894+0000 7fe501d59680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:00.954 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:00.964+0000 7fb5bb34e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:00.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:00.973+0000 7fdad161a700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:00.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:00.973+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:15:00.987 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:00.998+0000 7fe501d59680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:01.106 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:01.117+0000 7fb5bb34e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:01.140 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:01.151+0000 7fe501d59680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:01.182 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:01.193+0000 7fb5bb34e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:01.214 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:01.225+0000 7fe501d59680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:01.249 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:01.259+0000 7fb5bb34e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:01.281 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:01.292+0000 7fe501d59680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:01.503 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:01.513+0000 7fb5bb34e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:01.539 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:01.550+0000 7fe501d59680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:01.689 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:01.700+0000 7fb5bb34e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:01.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:01.733+0000 7fe501d59680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:02.336 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.346+0000 7fb5bb34e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:02.373 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.384+0000 7fe501d59680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:02.403 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.414+0000 7fb5bb34e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:02.442 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.453+0000 7fe501d59680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:02.478 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.489+0000 7fb5bb34e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:02.517 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.528+0000 7fe501d59680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:02.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:02.574+0000 7fdad161a700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:02.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:02.574+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:15:02.624 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.634+0000 7fb5bb34e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:02.665 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.676+0000 7fe501d59680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:02.694 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.705+0000 7fb5bb34e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:02.736 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.747+0000 7fe501d59680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:02.808 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.819+0000 7fb5bb34e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:02.852 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.863+0000 7fe501d59680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:02.916 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:02.927+0000 7fb5bb34e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:02.958 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:02.969+0000 7fe501d59680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:03.206 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:03.217+0000 7fb5bb34e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:03.249 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.260+0000 7fe501d59680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:03.276 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:03.286+0000 7fb5bb34e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:03.321 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.332+0000 7fe501d59680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:03.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:03.351+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mgrmap(e 33) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fdac40783f0 con 0x7fdacc0ae880 2024-01-21T20:15:03.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:03.351+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 msgr2=0x7fdab00617b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:03.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:03.351+0000 7fdac1ffb700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab00617b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:03.396 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.407+0000 7fe475af9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.396 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.407+0000 7fe475af9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.407+0000 7fe475af9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.407+0000 7fe475af9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.407+0000 7fe475af9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.408+0000 7fe477afd700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.408+0000 7fe477afd700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.408+0000 7fe477afd700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.408+0000 7fe477afd700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:03.397 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:03.408+0000 7fe477afd700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.365+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mon.2 v2:172.21.15.178:3301/0 8 ==== mgrmap(e 34) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fdac4078770 con 0x7fdacc0ae880 2024-01-21T20:15:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.366+0000 7fdac1ffb700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.366+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdacc06bd20 con 0x7fdab005f2f0 2024-01-21T20:15:04.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.368+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab0061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.379+0000 7fdad161a700 1 --2- 172.21.15.133:0/3524884766 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdab005f2f0 0x7fdab0061730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdac8007fd0 tx=0x7fdac8007bb0).ready entity=mgr.6909 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:04.370 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:04.381+0000 7fe47fb0d700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2024-01-21T20:15:04.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.381+0000 7fdac1ffb700 1 -- 172.21.15.133:0/3524884766 <== mgr.6909 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fdacc06bd20 con 0x7fdab005f2f0 2024-01-21T20:15:04.373 INFO:teuthology.orchestra.run.smithi133.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2024-01-21T20:15:04.376 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-21T20:15:04.377 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:15:04.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.513+0000 7fb842f87700 1 Processor -- start 2024-01-21T20:15:04.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.513+0000 7fb842f87700 1 -- start start 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb842f87700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb83c156160 0x7fb83c0be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb842f87700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0c61a0 con 0x7fb83c1351d0 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb842f87700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0c5350 con 0x7fb83c155cb0 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb842f87700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c0c55d0 con 0x7fb83c156160 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb840d23700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb83c1351d0 0x7fb83c0c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35098/0 (socket says 172.21.15.133:35098) 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb840d23700 1 -- 172.21.15.133:0/3875327005 learned_addr learned my addr 172.21.15.133:0/3875327005 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616134596 0 0) 0x7fb83c0c61a0 con 0x7fb83c1351d0 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb841524700 1 --2- 172.21.15.133:0/3875327005 >> v2:172.21.15.178:3300/0 conn(0x7fb83c156160 0x7fb83c0be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c0033f0 con 0x7fb83c1351d0 2024-01-21T20:15:04.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3169623345 0 0) 0x7fb82c0033f0 con 0x7fb83c1351d0 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 >> v2:172.21.15.178:3300/0 conn(0x7fb83c156160 msgr2=0x7fb83c0be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 --2- 172.21.15.133:0/3875327005 >> v2:172.21.15.178:3300/0 conn(0x7fb83c156160 0x7fb83c0be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 >> v1:172.21.15.178:6789/0 conn(0x7fb83c155cb0 legacy=0x7fb83c0bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0c5870 con 0x7fb83c1351d0 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.514+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb830001470 con 0x7fb83c1351d0 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 >> v1:172.21.15.133:6789/0 conn(0x7fb83c1351d0 legacy=0x7fb83c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c0038e0 0x7fb82c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb82c005050 0x7fb82c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0c55d0 con 0x7fb82c004690 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00bfe0 con 0x7fb82c0038e0 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c00c1a0 con 0x7fb82c005050 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb840d23700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c0038e0 0x7fb82c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb841524700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb82c005050 0x7fb82c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 -- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb82c005050 msgr2=0x7fb82c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb82c005050 0x7fb82c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 -- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c0038e0 msgr2=0x7fb82c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c0038e0 0x7fb82c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 -- 172.21.15.133:0/3875327005 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0033f0 con 0x7fb82c004690 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb840d23700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c0038e0 0x7fb82c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb841524700 1 -- 172.21.15.133:0/3875327005 reap_dead start 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83bfff700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fb828001700 tx=0x7fb828007bb0).ready entity=mon.0 client_cookie=508051bd6eecf273 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007020 con 0x7fb82c004690 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828007180 con 0x7fb82c004690 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.515+0000 7fb83b7fe700 1 -- 172.21.15.133:0/3875327005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007540 con 0x7fb82c004690 2024-01-21T20:15:04.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 -- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 msgr2=0x7fb82c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7fb828001700 tx=0x7fb828007bb0).stop 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 -- 172.21.15.133:0/3875327005 shutdown_connections 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 --2- 172.21.15.133:0/3875327005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb82c004690 0x7fb82c004b10 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 -- 172.21.15.133:0/3875327005 >> 172.21.15.133:0/3875327005 conn(0x7fb83c066a90 msgr2=0x7fb83c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 -- 172.21.15.133:0/3875327005 shutdown_connections 2024-01-21T20:15:04.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.516+0000 7fb842f87700 1 -- 172.21.15.133:0/3875327005 wait complete. 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.517+0000 7fb842f87700 1 Processor -- start 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.517+0000 7fb842f87700 1 -- start start 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.518+0000 7fb842f87700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 0x7fb83c0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.518+0000 7fb842f87700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83c0ae940 0x7fb83c1625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.518+0000 7fb842f87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.518+0000 7fb842f87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c14f850 con 0x7fb83c162ab0 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.518+0000 7fb842f87700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c14f3c0 con 0x7fb82c004690 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb842f87700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0aeda0 con 0x7fb83c0ae940 2024-01-21T20:15:04.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41532/0 (socket says 172.21.15.133:41532) 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 -- 172.21.15.133:0/2484368591 learned_addr learned my addr 172.21.15.133:0/2484368591 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb840d23700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 0x7fb83c0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb83bfff700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83c0ae940 0x7fb83c1625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 -- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83c0ae940 msgr2=0x7fb83c1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83c0ae940 0x7fb83c1625c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 -- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 msgr2=0x7fb83c0ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 0x7fb83c0ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 -- 172.21.15.133:0/2484368591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c14e7b0 con 0x7fb83c162ab0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb840d23700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 0x7fb83c0ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb841524700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fb83c065f50 tx=0x7fb83400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400e070 con 0x7fb83c162ab0 2024-01-21T20:15:04.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834011bd0 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c14ea90 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834016450 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.519+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c14f050 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.520+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83c0c87c0 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.521+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 34) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fb834016840 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.521+0000 7fb8397fa700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 0x7fb820061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.521+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7fb83407a850 con 0x7fb83c162ab0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.521+0000 7fb840d23700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 0x7fb820061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.522+0000 7fb840d23700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 0x7fb820061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb830001ed0 tx=0x7fb830009040).ready entity=mgr.6909 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:04.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.525+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb83404ba50 con 0x7fb83c162ab0 2024-01-21T20:15:04.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:04.732+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fb83c05fdf0 con 0x7fb83c162ab0 2024-01-21T20:15:05.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.372+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb8340784a0 con 0x7fb83c162ab0 2024-01-21T20:15:05.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.373+0000 7fb8397fa700 1 -- 172.21.15.133:0/2484368591 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb8340727f0 con 0x7fb83c162ab0 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 msgr2=0x7fb820061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 0x7fb820061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb830001ed0 tx=0x7fb830009040).stop 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 msgr2=0x7fb83c0c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fb83c065f50 tx=0x7fb83400b040).stop 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 shutdown_connections 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f080 0x7fb820061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83c162ab0 0x7fb83c0c6d10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb82c004690 0x7fb83c0ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 --2- 172.21.15.133:0/2484368591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83c0ae940 0x7fb83c1625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 >> 172.21.15.133:0/2484368591 conn(0x7fb83c066a90 msgr2=0x7fb83c14c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 shutdown_connections 2024-01-21T20:15:05.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.376+0000 7fb842f87700 1 -- 172.21.15.133:0/2484368591 wait complete. 2024-01-21T20:15:05.380 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:15:05.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:15:05.432 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:15:05.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:15:05.478 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:15:05.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:15:05.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:15:05.506 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:05.516+0000 7f3a5ec16680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:15:05.508 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:05.518+0000 7fedc3446680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:15:05.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:15:05.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:05.525 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:15:05.569 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:05.579+0000 7f3a5ec16680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:15:05.573 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:05.584+0000 7fedc3446680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:15:05.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.757+0000 7fa11bc80700 1 Processor -- start 2024-01-21T20:15:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.757+0000 7fa11bc80700 1 -- start start 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11bc80700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa1140a9d10 0x7fa1140ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11bc80700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1141558d0 0x7fa114063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11bc80700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa114063750 con 0x7fa1140aa0f0 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11bc80700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140640d0 con 0x7fa1141558d0 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11bc80700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11405e380 con 0x7fa1140a9d10 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.758+0000 7fa11a21d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1141558d0 0x7fa114063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1141558d0 0x7fa114063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41540/0 (socket says 172.21.15.133:41540) 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 -- 172.21.15.133:0/3139660658 learned_addr learned my addr 172.21.15.133:0/3139660658 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa119a1c700 1 --2- 172.21.15.133:0/3139660658 >> v2:172.21.15.178:3300/0 conn(0x7fa1140a9d10 0x7fa1140ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa118a1a700 1 -- 172.21.15.133:0/3139660658 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006472078 0 0) 0x7fa114063750 con 0x7fa1140aa0f0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa118a1a700 1 -- 172.21.15.133:0/3139660658 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1000033f0 con 0x7fa1140aa0f0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 -- 172.21.15.133:0/3139660658 >> v2:172.21.15.178:3300/0 conn(0x7fa1140a9d10 msgr2=0x7fa1140ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 --2- 172.21.15.133:0/3139660658 >> v2:172.21.15.178:3300/0 conn(0x7fa1140a9d10 0x7fa1140ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 -- 172.21.15.133:0/3139660658 >> v1:172.21.15.178:6789/0 conn(0x7fa1140aa0f0 legacy=0x7fa1141551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 -- 172.21.15.133:0/3139660658 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11405e660 con 0x7fa1141558d0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa11a21d700 1 --2- 172.21.15.133:0/3139660658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa114063be0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fa11405f0d0 tx=0x7fa10c00ba50).ready entity=mon.0 client_cookie=40092c0934309de2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa118a1a700 1 -- 172.21.15.133:0/3139660658 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c010070 con 0x7fa1141558d0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa118a1a700 1 -- 172.21.15.133:0/3139660658 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00dd30 con 0x7fa1141558d0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.759+0000 7fa118a1a700 1 -- 172.21.15.133:0/3139660658 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00dea0 con 0x7fa1141558d0 2024-01-21T20:15:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 -- 172.21.15.133:0/3139660658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 msgr2=0x7fa114063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 --2- 172.21.15.133:0/3139660658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa114063be0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fa11405f0d0 tx=0x7fa10c00ba50).stop 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 -- 172.21.15.133:0/3139660658 shutdown_connections 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 --2- 172.21.15.133:0/3139660658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa114063be0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 --2- 172.21.15.133:0/3139660658 >> v2:172.21.15.178:3300/0 conn(0x7fa1140a9d10 0x7fa1140ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 -- 172.21.15.133:0/3139660658 >> 172.21.15.133:0/3139660658 conn(0x7fa1140c8200 msgr2=0x7fa1140c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 -- 172.21.15.133:0/3139660658 shutdown_connections 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.760+0000 7fa11bc80700 1 -- 172.21.15.133:0/3139660658 wait complete. 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.761+0000 7fa11bc80700 1 Processor -- start 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.761+0000 7fa11bc80700 1 -- start start 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1140aa0f0 0x7fa11414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114150cd0 con 0x7fa1141558d0 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11414c5a0 con 0x7fa1140a9d10 2024-01-21T20:15:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11bc80700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1141527e0 con 0x7fa1140aa0f0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa119a1c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41554/0 (socket says 172.21.15.133:41554) 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa119a1c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:50934/0 (socket says 172.21.15.133:50934) 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 -- 172.21.15.133:0/674081853 learned_addr learned my addr 172.21.15.133:0/674081853 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11921b700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1140aa0f0 0x7fa11414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1140aa0f0 msgr2=0x7fa11414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1140aa0f0 0x7fa11414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 msgr2=0x7fa1141507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa11a21d700 1 -- 172.21.15.133:0/674081853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c00bcf0 con 0x7fa1141558d0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.762+0000 7fa119a1c700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa11a21d700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fa10c00d760 tx=0x7fa114151c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c00dea0 con 0x7fa1141558d0 2024-01-21T20:15:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c0070c0 con 0x7fa1141558d0 2024-01-21T20:15:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa114152ac0 con 0x7fa1141558d0 2024-01-21T20:15:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10c015650 con 0x7fa1141558d0 2024-01-21T20:15:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.763+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa114153080 con 0x7fa1141558d0 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.764+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11405fdf0 con 0x7fa1141558d0 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.764+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fa10c003040 con 0x7fa1141558d0 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.765+0000 7fa10a7fc700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 0x7fa0f80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.765+0000 7fa119a1c700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 msgr2=0x7fa0f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.765+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7fa10c07e0f0 con 0x7fa1141558d0 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.765+0000 7fa119a1c700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 0x7fa0f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:05.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.769+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa10c04ed60 con 0x7fa1141558d0 2024-01-21T20:15:05.841 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:05.851+0000 7f3a5ec16680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:15:05.861 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:05.872+0000 7fedc3446680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:15:05.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.966+0000 7fa119a1c700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 msgr2=0x7fa0f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:05.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.966+0000 7fa119a1c700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 0x7fa0f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.984+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1140662a0 con 0x7fa1141558d0 2024-01-21T20:15:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.985+0000 7fa10a7fc700 1 -- 172.21.15.133:0/674081853 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fa10c052380 con 0x7fa1141558d0 2024-01-21T20:15:05.975 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:05.975 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 msgr2=0x7fa0f80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 0x7fa0f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 msgr2=0x7fa1140aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7fa10c00d760 tx=0x7fa114151c70).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 shutdown_connections 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0f805f300 0x7fa0f80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1141558d0 0x7fa1140aaab0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1140a9d10 0x7fa1141507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 --2- 172.21.15.133:0/674081853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1140aa0f0 0x7fa11414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 >> 172.21.15.133:0/674081853 conn(0x7fa1140c8200 msgr2=0x7fa11414de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 shutdown_connections 2024-01-21T20:15:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:05.987+0000 7fa11bc80700 1 -- 172.21.15.133:0/674081853 wait complete. 2024-01-21T20:15:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:15:05.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:06.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.120+0000 7f2a4552b700 1 Processor -- start 2024-01-21T20:15:06.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.120+0000 7f2a4552b700 1 -- start start 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a4552b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 0x7f2a40158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a4552b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a400c0e40 con 0x7f2a400c8120 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a4552b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a40154980 con 0x7f2a40154520 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a4552b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400c6ae0 con 0x7f2a40154140 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a3f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a400c8120 0x7f2a400c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35110/0 (socket says 172.21.15.133:35110) 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a3f7fe700 1 -- 172.21.15.133:0/3051116769 learned_addr learned my addr 172.21.15.133:0/3051116769 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:06.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a3effd700 1 --2- 172.21.15.133:0/3051116769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 0x7f2a40158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298546460 0 0) 0x7f2a400c0e40 con 0x7f2a400c8120 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.121+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a280033f0 con 0x7f2a400c8120 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391133742 0 0) 0x7f2a40154980 con 0x7f2a40154520 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a400c0e40 con 0x7f2a40154520 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3effd700 1 -- 172.21.15.133:0/3051116769 >> v1:172.21.15.178:6789/0 conn(0x7f2a40154520 legacy=0x7f2a400c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3effd700 1 -- 172.21.15.133:0/3051116769 >> v1:172.21.15.133:6789/0 conn(0x7f2a400c8120 legacy=0x7f2a400c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3effd700 1 -- 172.21.15.133:0/3051116769 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400c6800 con 0x7f2a40154140 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3effd700 1 --2- 172.21.15.133:0/3051116769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 0x7f2a40158bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2a34009790 tx=0x7f2a34009060).ready entity=mon.2 client_cookie=2fbaf7fc78f298bf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400f510 con 0x7f2a40154140 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400f670 con 0x7f2a40154140 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a3dffb700 1 -- 172.21.15.133:0/3051116769 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400f9f0 con 0x7f2a40154140 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a4552b700 1 -- 172.21.15.133:0/3051116769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 msgr2=0x7f2a40158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.122+0000 7f2a4552b700 1 --2- 172.21.15.133:0/3051116769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 0x7f2a40158bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f2a34009790 tx=0x7f2a34009060).stop 2024-01-21T20:15:06.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.123+0000 7f2a4552b700 1 -- 172.21.15.133:0/3051116769 shutdown_connections 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.123+0000 7f2a4552b700 1 --2- 172.21.15.133:0/3051116769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154140 0x7f2a40158bb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.123+0000 7f2a4552b700 1 -- 172.21.15.133:0/3051116769 >> 172.21.15.133:0/3051116769 conn(0x7f2a4005e1e0 msgr2=0x7f2a4005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.123+0000 7f2a4552b700 1 -- 172.21.15.133:0/3051116769 shutdown_connections 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.123+0000 7f2a4552b700 1 -- 172.21.15.133:0/3051116769 wait complete. 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.124+0000 7f2a4552b700 1 Processor -- start 2024-01-21T20:15:06.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.124+0000 7f2a4552b700 1 -- start start 2024-01-21T20:15:06.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a40154140 0x7f2a4014d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154520 0x7f2a400b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400b00d0 con 0x7f2a400c8120 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40164bf0 con 0x7f2a40154140 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a4552b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4014d5d0 con 0x7f2a40154520 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41558/0 (socket says 172.21.15.133:41558) 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 -- 172.21.15.133:0/488874446 learned_addr learned my addr 172.21.15.133:0/488874446 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3e7fc700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a40154140 0x7f2a4014d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3f7fe700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154520 0x7f2a400b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 -- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154520 msgr2=0x7f2a400b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154520 0x7f2a400b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 -- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a40154140 msgr2=0x7f2a4014d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a40154140 0x7f2a4014d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 -- 172.21.15.133:0/488874446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340092a0 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a3effd700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f2a4006afd0 tx=0x7f2a34017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400fe80 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400f7e0 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.125+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3401c650 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.126+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a400b0320 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.126+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40164e60 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.127+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a400b0820 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.127+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2a3401c9c0 con 0x7f2a400c8120 2024-01-21T20:15:06.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.127+0000 7f2a277fe700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 0x7f2a2c061790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.127+0000 7f2a3e7fc700 1 -- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 msgr2=0x7f2a2c061790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:06.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.128+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f2a3407c3e0 con 0x7f2a400c8120 2024-01-21T20:15:06.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.128+0000 7f2a3e7fc700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 0x7f2a2c061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:06.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.131+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a3404d160 con 0x7f2a400c8120 2024-01-21T20:15:06.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.303+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a400c6540 con 0x7f2a400c8120 2024-01-21T20:15:06.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.305+0000 7f2a277fe700 1 -- 172.21.15.133:0/488874446 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18235 (secure 0 0 0) 0x7f2a34050780 con 0x7f2a400c8120 2024-01-21T20:15:06.294 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:06.294 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:03.345697+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3899584255":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3432389072":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/960875153":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3359683327":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:03.345649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 msgr2=0x7f2a2c061790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 0x7f2a2c061790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 msgr2=0x7f2a400aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f2a4006afd0 tx=0x7f2a34017000).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 shutdown_connections 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a2c05f2d0 0x7f2a2c061790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a40154520 0x7f2a400b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a400c8120 0x7f2a400aa470 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 --2- 172.21.15.133:0/488874446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a40154140 0x7f2a4014d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 >> 172.21.15.133:0/488874446 conn(0x7f2a4005e1e0 msgr2=0x7f2a400ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 shutdown_connections 2024-01-21T20:15:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.307+0000 7f2a4552b700 1 -- 172.21.15.133:0/488874446 wait complete. 2024-01-21T20:15:06.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:14:50.532628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:14:51.412459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:15:06.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:15:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.443+0000 7f5d4cbad700 1 Processor -- start 2024-01-21T20:15:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.443+0000 7f5d4cbad700 1 -- start start 2024-01-21T20:15:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d4cbad700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d480beb30 0x7f5d48155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d4cbad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d480c3fb0 0x7f5d480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d4cbad700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d48065660 con 0x7f5d48069cd0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d4cbad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d480bef10 con 0x7f5d480c3fb0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d4cbad700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d48156070 con 0x7f5d480beb30 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.444+0000 7f5d45d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d480c3fb0 0x7f5d480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d480c3fb0 0x7f5d480697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41562/0 (socket says 172.21.15.133:41562) 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 -- 172.21.15.133:0/3535488922 learned_addr learned my addr 172.21.15.133:0/3535488922 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d4659c700 1 --2- 172.21.15.133:0/3535488922 >> v2:172.21.15.178:3300/0 conn(0x7f5d480beb30 0x7f5d48155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 -- 172.21.15.133:0/3535488922 >> v2:172.21.15.178:3300/0 conn(0x7f5d480beb30 msgr2=0x7f5d48155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 --2- 172.21.15.133:0/3535488922 >> v2:172.21.15.178:3300/0 conn(0x7f5d480beb30 0x7f5d48155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 -- 172.21.15.133:0/3535488922 >> v1:172.21.15.178:6789/0 conn(0x7f5d48069cd0 legacy=0x7f5d48151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 -- 172.21.15.133:0/3535488922 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d48065f00 con 0x7f5d480c3fb0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d45d9b700 1 --2- 172.21.15.133:0/3535488922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d480c3fb0 0x7f5d480697e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5d480650a0 tx=0x7f5d380090f0).ready entity=mon.0 client_cookie=50877e8b1ced0e61 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d4559a700 1 -- 172.21.15.133:0/3535488922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800b520 con 0x7f5d480c3fb0 2024-01-21T20:15:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d4559a700 1 -- 172.21.15.133:0/3535488922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800b680 con 0x7f5d480c3fb0 2024-01-21T20:15:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.445+0000 7f5d4559a700 1 -- 172.21.15.133:0/3535488922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ba20 con 0x7f5d480c3fb0 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 -- 172.21.15.133:0/3535488922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d480c3fb0 msgr2=0x7f5d480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/3535488922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d480c3fb0 0x7f5d480697e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7f5d480650a0 tx=0x7f5d380090f0).stop 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 -- 172.21.15.133:0/3535488922 shutdown_connections 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/3535488922 >> v2:172.21.15.178:3300/0 conn(0x7f5d480beb30 0x7f5d48155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/3535488922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d480c3fb0 0x7f5d480697e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 -- 172.21.15.133:0/3535488922 >> 172.21.15.133:0/3535488922 conn(0x7f5d480c8010 msgr2=0x7f5d480c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 -- 172.21.15.133:0/3535488922 shutdown_connections 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.446+0000 7f5d4cbad700 1 -- 172.21.15.133:0/3535488922 wait complete. 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.447+0000 7f5d4cbad700 1 Processor -- start 2024-01-21T20:15:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.447+0000 7f5d4cbad700 1 -- start start 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d480beb30 0x7f5d48150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d480c3fb0 0x7f5d480626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4812b590 con 0x7f5d48069cd0 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480c0900 con 0x7f5d480c3fb0 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4cbad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d480bfa10 con 0x7f5d480beb30 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41578/0 (socket says 172.21.15.133:41578) 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 -- 172.21.15.133:0/4203735388 learned_addr learned my addr 172.21.15.133:0/4203735388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d45d9b700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d480beb30 0x7f5d48150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d46d9d700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d480c3fb0 0x7f5d480626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d480beb30 msgr2=0x7f5d48150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d480beb30 0x7f5d48150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.448+0000 7f5d4659c700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d480c3fb0 msgr2=0x7f5d480626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d4659c700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d480c3fb0 0x7f5d480626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d4659c700 1 -- 172.21.15.133:0/4203735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009370 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d4659c700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f5d3c00e950 tx=0x7f5d3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c009530 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c012600 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d480bfcf0 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c012980 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.449+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d480c02b0 con 0x7f5d48069cd0 2024-01-21T20:15:06.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.450+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5d3c012cf0 con 0x7f5d48069cd0 2024-01-21T20:15:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.450+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4805fdf0 con 0x7f5d48069cd0 2024-01-21T20:15:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.450+0000 7f5d36ffd700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 0x7f5d280617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.451+0000 7f5d45d9b700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 msgr2=0x7f5d280617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.451+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f5d3c07ac20 con 0x7f5d48069cd0 2024-01-21T20:15:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.451+0000 7f5d45d9b700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 0x7f5d280617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:06.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.455+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5d3c04b9a0 con 0x7f5d48069cd0 2024-01-21T20:15:06.455 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:06.465+0000 7f3a5ec16680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:06.510 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:06.521+0000 7fedc3446680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:06.526 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:06.537+0000 7f3a5ec16680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:06.585 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:06.595+0000 7fedc3446680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:06.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.652+0000 7f5d45d9b700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 msgr2=0x7f5d280617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:06.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.652+0000 7f5d45d9b700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 0x7f5d280617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:06.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.657+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5d4806ac20 con 0x7f5d48069cd0 2024-01-21T20:15:06.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.658+0000 7f5d36ffd700 1 -- 172.21.15.133:0/4203735388 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v95) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5d3c04efc0 con 0x7f5d48069cd0 2024-01-21T20:15:06.647 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 msgr2=0x7f5d280617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 0x7f5d280617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 msgr2=0x7f5d480aa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f5d3c00e950 tx=0x7f5d3c009060).stop 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 shutdown_connections 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5d2805f300 0x7f5d280617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d480c3fb0 0x7f5d480626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d48069cd0 0x7f5d480aa210 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 --2- 172.21.15.133:0/4203735388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d480beb30 0x7f5d48150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 >> 172.21.15.133:0/4203735388 conn(0x7f5d480c8010 msgr2=0x7f5d480c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 shutdown_connections 2024-01-21T20:15:06.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.660+0000 7f5d4cbad700 1 -- 172.21.15.133:0/4203735388 wait complete. 2024-01-21T20:15:06.664 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:15:06.712 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:06.723+0000 7f3a5ec16680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:06.785 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:06.795+0000 7fedc3446680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:06.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.797+0000 7f1874542700 1 Processor -- start 2024-01-21T20:15:06.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.797+0000 7f1874542700 1 -- start start 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1874542700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 0x7f186c0bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1874542700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c0654f0 con 0x7f186c154a90 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1874542700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c063700 con 0x7f186c1546b0 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1874542700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c063950 con 0x7f186c0a9e30 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1871add700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f186c154a90 0x7f186c066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35120/0 (socket says 172.21.15.133:35120) 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1871add700 1 -- 172.21.15.133:0/4286727488 learned_addr learned my addr 172.21.15.133:0/4286727488 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1872adf700 1 --2- 172.21.15.133:0/4286727488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 0x7f186c0bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589327327 0 0) 0x7f186c0654f0 con 0x7f186c154a90 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18580033f0 con 0x7f186c154a90 2024-01-21T20:15:06.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572416789 0 0) 0x7f186c063700 con 0x7f186c1546b0 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f186c0654f0 con 0x7f186c1546b0 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1872adf700 1 -- 172.21.15.133:0/4286727488 >> v1:172.21.15.178:6789/0 conn(0x7f186c1546b0 legacy=0x7f186c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1872adf700 1 -- 172.21.15.133:0/4286727488 >> v1:172.21.15.133:6789/0 conn(0x7f186c154a90 legacy=0x7f186c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798428538 0 0) 0x7f18580033f0 con 0x7f186c154a90 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1872adf700 1 -- 172.21.15.133:0/4286727488 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c065180 con 0x7f186c0a9e30 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.798+0000 7f1872adf700 1 --2- 172.21.15.133:0/4286727488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 0x7f186c0bc6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1864009e90 tx=0x7f1864009780).ready entity=mon.2 client_cookie=9c16e054d36ac339 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400e070 con 0x7f186c0a9e30 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400b7a0 con 0x7f186c0a9e30 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f18712dc700 1 -- 172.21.15.133:0/4286727488 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c001470 con 0x7f186c0a9e30 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 -- 172.21.15.133:0/4286727488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 msgr2=0x7f186c0bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 --2- 172.21.15.133:0/4286727488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 0x7f186c0bc6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f1864009e90 tx=0x7f1864009780).stop 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 -- 172.21.15.133:0/4286727488 shutdown_connections 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 --2- 172.21.15.133:0/4286727488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c0a9e30 0x7f186c0bc6d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 -- 172.21.15.133:0/4286727488 >> 172.21.15.133:0/4286727488 conn(0x7f186c0c8200 msgr2=0x7f186c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 -- 172.21.15.133:0/4286727488 shutdown_connections 2024-01-21T20:15:06.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.799+0000 7f1874542700 1 -- 172.21.15.133:0/4286727488 wait complete. 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.800+0000 7f1874542700 1 Processor -- start 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 -- start start 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f186c0a9e30 0x7f186c0c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 0x7f186c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0aac10 con 0x7f186c1546b0 2024-01-21T20:15:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0c1760 con 0x7f186c0a9e30 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1874542700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c14c720 con 0x7f186c154a90 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1871add700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1871add700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41594/0 (socket says 172.21.15.133:41594) 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1871add700 1 -- 172.21.15.133:0/903847722 learned_addr learned my addr 172.21.15.133:0/903847722 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f1872adf700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 0x7f186c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.801+0000 7f18722de700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f186c0a9e30 0x7f186c0c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 -- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f186c0a9e30 msgr2=0x7f186c0c08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f186c0a9e30 0x7f186c0c08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 -- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 msgr2=0x7f186c0aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 -- 172.21.15.133:0/903847722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009a20 con 0x7f186c154a90 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1871add700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1872adf700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 0x7f186c148780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f186c1583d0 tx=0x7f1864009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400bd80 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186401e440 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0c0ec0 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400bee0 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.802+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0c1480 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.803+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c14c580 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.803+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f1864003040 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.804+0000 7f1862ffd700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 0x7f18500617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.804+0000 7f18722de700 1 -- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 msgr2=0x7f18500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.804+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f186407bd60 con 0x7f186c154a90 2024-01-21T20:15:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.804+0000 7f18722de700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 0x7f18500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.808+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f186c14c580 con 0x7f186c154a90 2024-01-21T20:15:06.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.979+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f186c14c580 con 0x7f186c154a90 2024-01-21T20:15:06.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.979+0000 7f1862ffd700 1 -- 172.21.15.133:0/903847722 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f186c14c580 con 0x7f186c154a90 2024-01-21T20:15:06.969 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:15:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 msgr2=0x7f18500617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 0x7f18500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 msgr2=0x7f186c148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 0x7f186c148780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f186c1583d0 tx=0x7f1864009780).stop 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 shutdown_connections 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f185005f300 0x7f18500617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f186c154a90 0x7f186c148780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f186c0a9e30 0x7f186c0c08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 --2- 172.21.15.133:0/903847722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f186c1546b0 0x7f186c0aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 >> 172.21.15.133:0/903847722 conn(0x7f186c0c8200 msgr2=0x7f186c0626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 shutdown_connections 2024-01-21T20:15:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:06.981+0000 7f1874542700 1 -- 172.21.15.133:0/903847722 wait complete. 2024-01-21T20:15:06.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:15:07.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.118+0000 7f01cf7f4700 1 Processor -- start 2024-01-21T20:15:07.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.118+0000 7f01cf7f4700 1 -- start start 2024-01-21T20:15:07.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cf7f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01c80beb30 0x7f01c8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cf7f4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01c80c3fb0 0x7f01c80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cf7f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c8065660 con 0x7f01c8069cd0 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cf7f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c80bef10 con 0x7f01c80beb30 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cf7f4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c8156070 con 0x7f01c80c3fb0 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cd590700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01c80beb30 0x7f01c8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cd590700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01c80beb30 0x7f01c8155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41602/0 (socket says 172.21.15.133:41602) 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cd590700 1 -- 172.21.15.133:0/172907289 learned_addr learned my addr 172.21.15.133:0/172907289 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.119+0000 7f01cdd91700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01c8069cd0 0x7f01c8151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35126/0 (socket says 172.21.15.133:35126) 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01ccd8f700 1 --2- 172.21.15.133:0/172907289 >> v2:172.21.15.178:3300/0 conn(0x7f01c80c3fb0 0x7f01c80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01cd590700 1 -- 172.21.15.133:0/172907289 >> v2:172.21.15.178:3300/0 conn(0x7f01c80c3fb0 msgr2=0x7f01c80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01cd590700 1 --2- 172.21.15.133:0/172907289 >> v2:172.21.15.178:3300/0 conn(0x7f01c80c3fb0 0x7f01c80697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01cd590700 1 -- 172.21.15.133:0/172907289 >> v1:172.21.15.133:6789/0 conn(0x7f01c8069cd0 legacy=0x7f01c8151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01cd590700 1 -- 172.21.15.133:0/172907289 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8065f00 con 0x7f01c80beb30 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01cd590700 1 --2- 172.21.15.133:0/172907289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80beb30 0x7f01c8155b80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f01c805ecd0 tx=0x7f01b80090f0).ready entity=mon.0 client_cookie=41ec61f004736998 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01bffff700 1 -- 172.21.15.133:0/172907289 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800b520 con 0x7f01c80beb30 2024-01-21T20:15:07.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01bffff700 1 -- 172.21.15.133:0/172907289 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800b680 con 0x7f01c80beb30 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.120+0000 7f01bffff700 1 -- 172.21.15.133:0/172907289 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b800ba20 con 0x7f01c80beb30 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 -- 172.21.15.133:0/172907289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80beb30 msgr2=0x7f01c8155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/172907289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80beb30 0x7f01c8155b80 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f01c805ecd0 tx=0x7f01b80090f0).stop 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 -- 172.21.15.133:0/172907289 shutdown_connections 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/172907289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80beb30 0x7f01c8155b80 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/172907289 >> v2:172.21.15.178:3300/0 conn(0x7f01c80c3fb0 0x7f01c80697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 -- 172.21.15.133:0/172907289 >> 172.21.15.133:0/172907289 conn(0x7f01c80c8010 msgr2=0x7f01c80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 -- 172.21.15.133:0/172907289 shutdown_connections 2024-01-21T20:15:07.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.121+0000 7f01cf7f4700 1 -- 172.21.15.133:0/172907289 wait complete. 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.122+0000 7f01cf7f4700 1 Processor -- start 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.122+0000 7f01cf7f4700 1 -- start start 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c8069cd0 0x7f01c8139250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c80beb30 0x7f01c80c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80a8ad0 con 0x7f01c80c3fb0 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80a7ec0 con 0x7f01c80beb30 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c80a81a0 con 0x7f01c8069cd0 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41606/0 (socket says 172.21.15.133:41606) 2024-01-21T20:15:07.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 -- 172.21.15.133:0/3204806100 learned_addr learned my addr 172.21.15.133:0/3204806100 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01ccd8f700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c80beb30 0x7f01c80c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cd590700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c8069cd0 0x7f01c8139250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 -- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c8069cd0 msgr2=0x7f01c8139250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c8069cd0 0x7f01c8139250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 -- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c80beb30 msgr2=0x7f01c80c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c80beb30 0x7f01c80c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 -- 172.21.15.133:0/3204806100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009370 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cdd91700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f01c000c7c0 tx=0x7f01c0001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0005c70 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0005dd0 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00072e0 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.123+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c80a8480 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.124+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8139740 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c80a8c40 con 0x7f01c80c3fb0 2024-01-21T20:15:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f01c00076d0 con 0x7f01c80c3fb0 2024-01-21T20:15:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01bdffb700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 0x7f01ac0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01cd590700 1 -- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 msgr2=0x7f01ac0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f01c007a060 con 0x7f01c80c3fb0 2024-01-21T20:15:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.125+0000 7f01cd590700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 0x7f01ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:07.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.133+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f01c004ade0 con 0x7f01c80c3fb0 2024-01-21T20:15:07.133 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.143+0000 7f3a5ec16680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:07.234 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.245+0000 7fedc3446680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:07.235 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.246+0000 7f3a5ec16680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:07.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.305+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f01c80c3d90 con 0x7f01c80c3fb0 2024-01-21T20:15:07.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.306+0000 7f01bdffb700 1 -- 172.21.15.133:0/3204806100 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f01c0001630 con 0x7f01c80c3fb0 2024-01-21T20:15:07.296 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 msgr2=0x7f01ac0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 0x7f01ac0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 msgr2=0x7f01c80ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f01c000c7c0 tx=0x7f01c0001510).stop 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 shutdown_connections 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f01ac05f300 0x7f01ac0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01c80c3fb0 0x7f01c80ab480 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01c8069cd0 0x7f01c8139250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 --2- 172.21.15.133:0/3204806100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01c80beb30 0x7f01c80c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 >> 172.21.15.133:0/3204806100 conn(0x7f01c80c8010 msgr2=0x7f01c80669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:07.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 shutdown_connections 2024-01-21T20:15:07.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.308+0000 7f01cf7f4700 1 -- 172.21.15.133:0/3204806100 wait complete. 2024-01-21T20:15:07.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:15:07.348 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.359+0000 7fedc3446680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:07.389 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.399+0000 7f3a5ec16680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:07.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.446+0000 7f0a5afd3700 1 Processor -- start 2024-01-21T20:15:07.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.446+0000 7f0a5afd3700 1 -- start start 2024-01-21T20:15:07.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.446+0000 7f0a5afd3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a54066e00 0x7f0a54153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a5afd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a54062b70 0x7f0a54156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a5afd3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a54153750 con 0x7f0a540626f0 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a5afd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540671e0 con 0x7f0a54062b70 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a5afd3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540662e0 con 0x7f0a54066e00 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a54062b70 0x7f0a54156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a54062b70 0x7f0a54156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41614/0 (socket says 172.21.15.133:41614) 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 -- 172.21.15.133:0/987162914 learned_addr learned my addr 172.21.15.133:0/987162914 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a58d6f700 1 --2- 172.21.15.133:0/987162914 >> v2:172.21.15.178:3300/0 conn(0x7f0a54066e00 0x7f0a54153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 -- 172.21.15.133:0/987162914 >> v2:172.21.15.178:3300/0 conn(0x7f0a54066e00 msgr2=0x7f0a54153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 --2- 172.21.15.133:0/987162914 >> v2:172.21.15.178:3300/0 conn(0x7f0a54066e00 0x7f0a54153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 -- 172.21.15.133:0/987162914 >> v1:172.21.15.178:6789/0 conn(0x7f0a540626f0 legacy=0x7f0a54155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 -- 172.21.15.133:0/987162914 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54069990 con 0x7f0a54062b70 2024-01-21T20:15:07.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a59570700 1 --2- 172.21.15.133:0/987162914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54156440 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f0a540c4660 tx=0x7f0a4c009840).ready entity=mon.0 client_cookie=94b2fee914314e6c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a537fe700 1 -- 172.21.15.133:0/987162914 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00e070 con 0x7f0a54062b70 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a537fe700 1 -- 172.21.15.133:0/987162914 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00ba10 con 0x7f0a54062b70 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.447+0000 7f0a537fe700 1 -- 172.21.15.133:0/987162914 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00bd90 con 0x7f0a54062b70 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 -- 172.21.15.133:0/987162914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 msgr2=0x7f0a54156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/987162914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54156440 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f0a540c4660 tx=0x7f0a4c009840).stop 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 -- 172.21.15.133:0/987162914 shutdown_connections 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/987162914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54156440 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/987162914 >> v2:172.21.15.178:3300/0 conn(0x7f0a54066e00 0x7f0a54153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 -- 172.21.15.133:0/987162914 >> 172.21.15.133:0/987162914 conn(0x7f0a540c7dc0 msgr2=0x7f0a540c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 -- 172.21.15.133:0/987162914 shutdown_connections 2024-01-21T20:15:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.448+0000 7f0a5afd3700 1 -- 172.21.15.133:0/987162914 wait complete. 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.449+0000 7f0a5afd3700 1 Processor -- start 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.449+0000 7f0a5afd3700 1 -- start start 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540626f0 0x7f0a54154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54066e00 0x7f0a5414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54158bd0 con 0x7f0a54062b70 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54157fc0 con 0x7f0a540626f0 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a5afd3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a541582a0 con 0x7f0a54066e00 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.450+0000 7f0a53fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a58d6f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540626f0 0x7f0a54154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41620/0 (socket says 172.21.15.133:41620) 2024-01-21T20:15:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a59570700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54066e00 0x7f0a5414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 -- 172.21.15.133:0/2487486029 learned_addr learned my addr 172.21.15.133:0/2487486029 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 -- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54066e00 msgr2=0x7f0a5414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54066e00 0x7f0a5414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 -- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540626f0 msgr2=0x7f0a54154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540626f0 0x7f0a54154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 -- 172.21.15.133:0/2487486029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c009ae0 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a53fff700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f0a4000c440 tx=0x7f0a40007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40012400 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40012580 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a54158580 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40012940 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.451+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54156350 con 0x7f0a54062b70 2024-01-21T20:15:07.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.452+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5405fdf0 con 0x7f0a54062b70 2024-01-21T20:15:07.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.453+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0a40012d30 con 0x7f0a54062b70 2024-01-21T20:15:07.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.453+0000 7f0a517fa700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 0x7f0a380617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.453+0000 7f0a58d6f700 1 -- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 msgr2=0x7f0a380617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:07.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.453+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f0a40079ba0 con 0x7f0a54062b70 2024-01-21T20:15:07.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.453+0000 7f0a58d6f700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 0x7f0a380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:07.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.460+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a40048b00 con 0x7f0a54062b70 2024-01-21T20:15:07.463 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.474+0000 7f3a5ec16680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:07.511 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.522+0000 7fedc3446680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:07.530 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.540+0000 7f3a5ec16680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:07.586 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.597+0000 7fedc3446680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:07.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.628+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a54069c70 con 0x7f0a54062b70 2024-01-21T20:15:07.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.629+0000 7f0a517fa700 1 -- 172.21.15.133:0/2487486029 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a4004a9d0 con 0x7f0a54062b70 2024-01-21T20:15:07.618 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 msgr2=0x7f0a380617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 0x7f0a380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 msgr2=0x7f0a54155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f0a4000c440 tx=0x7f0a40007de0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 shutdown_connections 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3805f300 0x7f0a380617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54066e00 0x7f0a5414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a540626f0 0x7f0a54154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 --2- 172.21.15.133:0/2487486029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a54062b70 0x7f0a54155e60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 >> 172.21.15.133:0/2487486029 conn(0x7f0a540c7dc0 msgr2=0x7f0a540c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 shutdown_connections 2024-01-21T20:15:07.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.631+0000 7f0a5afd3700 1 -- 172.21.15.133:0/2487486029 wait complete. 2024-01-21T20:15:07.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:07.655 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.666+0000 7fedc3446680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:07.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.784+0000 7fbfa0acd700 1 Processor -- start 2024-01-21T20:15:07.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.784+0000 7fbfa0acd700 1 -- start start 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbfa0acd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf9c155cb0 0x7fbf9c156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbfa0acd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c156650 con 0x7fbf9c1351d0 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbfa0acd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0c61a0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbfa0acd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c5350 con 0x7fbf9c155cb0 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf9c155cb0 0x7fbf9c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf9a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbf9c1351d0 0x7fbf9c0c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35136/0 (socket says 172.21.15.133:35136) 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf9c155cb0 0x7fbf9c156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41636/0 (socket says 172.21.15.133:41636) 2024-01-21T20:15:07.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf9a59c700 1 -- 172.21.15.133:0/3396410300 learned_addr learned my addr 172.21.15.133:0/3396410300 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 -- 172.21.15.133:0/3396410300 >> v1:172.21.15.178:6789/0 conn(0x7fbf9c0bde60 legacy=0x7fbf9c0be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 -- 172.21.15.133:0/3396410300 >> v1:172.21.15.133:6789/0 conn(0x7fbf9c1351d0 legacy=0x7fbf9c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf9959a700 1 -- 172.21.15.133:0/3396410300 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282774661 0 0) 0x7fbf8c001110 con 0x7fbf9c1351d0 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 -- 172.21.15.133:0/3396410300 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0c55d0 con 0x7fbf9c155cb0 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.785+0000 7fbf99d9b700 1 --2- 172.21.15.133:0/3396410300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c155cb0 0x7fbf9c156160 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fbf90009760 tx=0x7fbf90009060).ready entity=mon.0 client_cookie=9f2463609f61cbd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbf9959a700 1 -- 172.21.15.133:0/3396410300 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf90009120 con 0x7fbf9c155cb0 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbf9959a700 1 -- 172.21.15.133:0/3396410300 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9000b580 con 0x7fbf9c155cb0 2024-01-21T20:15:07.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbf9959a700 1 -- 172.21.15.133:0/3396410300 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9000b900 con 0x7fbf9c155cb0 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 -- 172.21.15.133:0/3396410300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c155cb0 msgr2=0x7fbf9c156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/3396410300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c155cb0 0x7fbf9c156160 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fbf90009760 tx=0x7fbf90009060).stop 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 -- 172.21.15.133:0/3396410300 shutdown_connections 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/3396410300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c155cb0 0x7fbf9c156160 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 -- 172.21.15.133:0/3396410300 >> 172.21.15.133:0/3396410300 conn(0x7fbf9c066a90 msgr2=0x7fbf9c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 -- 172.21.15.133:0/3396410300 shutdown_connections 2024-01-21T20:15:07.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.786+0000 7fbfa0acd700 1 -- 172.21.15.133:0/3396410300 wait complete. 2024-01-21T20:15:07.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 Processor -- start 2024-01-21T20:15:07.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 -- start start 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf9c1351d0 0x7fbf9c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9c155cb0 0x7fbf9c1621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0aee70 con 0x7fbf9c0bde60 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0aa880 con 0x7fbf9c1351d0 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.788+0000 7fbfa0acd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0c7200 con 0x7fbf9c155cb0 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41650/0 (socket says 172.21.15.133:41650) 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 -- 172.21.15.133:0/1975397688 learned_addr learned my addr 172.21.15.133:0/1975397688 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:07.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf99d9b700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf9c1351d0 0x7fbf9c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9ad9d700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9c155cb0 0x7fbf9c1621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9c155cb0 msgr2=0x7fbf9c1621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9c155cb0 0x7fbf9c1621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf9c1351d0 msgr2=0x7fbf9c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf9c1351d0 0x7fbf9c14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 -- 172.21.15.133:0/1975397688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900092a0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf9a59c700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fbf8c00c490 tx=0x7fbf8c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0070d0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c007230 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0075f0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c162d20 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.789+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c0aa230 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.790+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c05fdf0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.791+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fbf8c005bc0 con 0x7fbf9c0bde60 2024-01-21T20:15:07.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.791+0000 7fbf8affd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 0x7fbf7c0617f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:07.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.791+0000 7fbf99d9b700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 msgr2=0x7fbf7c0617f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:07.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.791+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7fbf8c079e10 con 0x7fbf9c0bde60 2024-01-21T20:15:07.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.791+0000 7fbf99d9b700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 0x7fbf7c0617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:07.783 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.794+0000 7f3a5ec16680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:07.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.795+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbf8c04ab90 con 0x7fbf9c0bde60 2024-01-21T20:15:07.925 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:07.936+0000 7fedc3446680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:07.966 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:07.977+0000 7f3a5ec16680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:07.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.992+0000 7fbf99d9b700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 msgr2=0x7fbf7c0617f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:07.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:07.992+0000 7fbf99d9b700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 0x7fbf7c0617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.007+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9c156650 con 0x7fbf9c0bde60 2024-01-21T20:15:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.008+0000 7fbf8affd700 1 -- 172.21.15.133:0/1975397688 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fbf9c156650 con 0x7fbf9c0bde60 2024-01-21T20:15:07.997 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:07.997 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 msgr2=0x7fbf7c0617f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 0x7fbf7c0617f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 msgr2=0x7fbf9c0c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fbf8c00c490 tx=0x7fbf8c007e40).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 shutdown_connections 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbf7c05f330 0x7fbf7c0617f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf9c155cb0 0x7fbf9c1621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf9c0bde60 0x7fbf9c0c6d10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 --2- 172.21.15.133:0/1975397688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf9c1351d0 0x7fbf9c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 >> 172.21.15.133:0/1975397688 conn(0x7fbf9c066a90 msgr2=0x7fbf9c138dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 shutdown_connections 2024-01-21T20:15:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.010+0000 7fbfa0acd700 1 -- 172.21.15.133:0/1975397688 wait complete. 2024-01-21T20:15:08.001 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:15:08.012 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:08.123 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:08.133+0000 7fedc3446680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:08.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.148+0000 7f048d375700 1 Processor -- start 2024-01-21T20:15:08.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.148+0000 7f048d375700 1 -- start start 2024-01-21T20:15:08.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f048d375700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0488154140 0x7f0488158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f048d375700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04880c8120 0x7f04880ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f048d375700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04880ab620 con 0x7f0488154520 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f048d375700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04880c6ae0 con 0x7f04880c8120 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f048d375700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04880c05e0 con 0x7f0488154140 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f04877fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04880c8120 0x7f04880ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f04867fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0488154520 0x7f04880c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35148/0 (socket says 172.21.15.133:35148) 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f04867fc700 1 -- 172.21.15.133:0/827235624 learned_addr learned my addr 172.21.15.133:0/827235624 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.149+0000 7f0486ffd700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0488154140 0x7f0488158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f04877fe700 1 -- 172.21.15.133:0/827235624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0488154140 msgr2=0x7f0488158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:08.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f04877fe700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0488154140 0x7f0488158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f04877fe700 1 -- 172.21.15.133:0/827235624 >> v1:172.21.15.133:6789/0 conn(0x7f0488154520 legacy=0x7f04880c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f04877fe700 1 -- 172.21.15.133:0/827235624 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04880c0e40 con 0x7f04880c8120 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f0485ffb700 1 -- 172.21.15.133:0/827235624 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731077919 0 0) 0x7f04880ab620 con 0x7f0488154520 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f04877fe700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04880c8120 0x7f04880ab130 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f0480009e60 tx=0x7f0480009780).ready entity=mon.0 client_cookie=cd4e16c74e3e0f40 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f0485ffb700 1 -- 172.21.15.133:0/827235624 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000e070 con 0x7f04880c8120 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f0485ffb700 1 -- 172.21.15.133:0/827235624 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048000bb60 con 0x7f04880c8120 2024-01-21T20:15:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.150+0000 7f0485ffb700 1 -- 172.21.15.133:0/827235624 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480012410 con 0x7f04880c8120 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 -- 172.21.15.133:0/827235624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04880c8120 msgr2=0x7f04880ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04880c8120 0x7f04880ab130 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f0480009e60 tx=0x7f0480009780).stop 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 -- 172.21.15.133:0/827235624 shutdown_connections 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04880c8120 0x7f04880ab130 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 --2- 172.21.15.133:0/827235624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0488154140 0x7f0488158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 -- 172.21.15.133:0/827235624 >> 172.21.15.133:0/827235624 conn(0x7f048805e1e0 msgr2=0x7f048805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 -- 172.21.15.133:0/827235624 shutdown_connections 2024-01-21T20:15:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.151+0000 7f048d375700 1 -- 172.21.15.133:0/827235624 wait complete. 2024-01-21T20:15:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.152+0000 7f048d375700 1 Processor -- start 2024-01-21T20:15:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.153+0000 7f048d375700 1 -- start start 2024-01-21T20:15:08.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.153+0000 7f048d375700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.153+0000 7f048d375700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.153+0000 7f048d375700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0488154520 0x7f04881646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f048d375700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488154ef0 con 0x7f0488154140 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f048d375700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04880b0ff0 con 0x7f0488154520 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f048d375700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0488154bc0 con 0x7f04880c8120 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f04867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f04867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41664/0 (socket says 172.21.15.133:41664) 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43166/0 (socket says 172.21.15.133:43166) 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f04867fc700 1 -- 172.21.15.133:0/2012006208 learned_addr learned my addr 172.21.15.133:0/2012006208 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f04877fe700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0488154520 0x7f04881646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 -- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0488154520 msgr2=0x7f04881646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0488154520 0x7f04881646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 -- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 msgr2=0x7f0488141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 -- 172.21.15.133:0/2012006208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480009a20 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f04867fc700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f0486ffd700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f047c00e900 tx=0x7f047c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c009450 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c012600 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04880b02a0 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047c012980 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.154+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04880b0860 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048805fdf0 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f047c012d30 con 0x7f04880c8120 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f046f7fe700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 0x7f04740617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f04867fc700 1 -- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 msgr2=0x7f04740617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f047c07ab20 con 0x7f04880c8120 2024-01-21T20:15:08.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.156+0000 7f04867fc700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 0x7f04740617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:08.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.160+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f047c04f2d0 con 0x7f04880c8120 2024-01-21T20:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.332+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04880aa980 con 0x7f04880c8120 2024-01-21T20:15:08.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.333+0000 7f046f7fe700 1 -- 172.21.15.133:0/2012006208 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18235 (secure 0 0 0) 0x7f047c04eec0 con 0x7f04880c8120 2024-01-21T20:15:08.323 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:08.323 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:03.345697+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3899584255":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3432389072":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/960875153":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3359683327":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:03.345649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 msgr2=0x7f04740617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 0x7f04740617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 msgr2=0x7f04880b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f047c00e900 tx=0x7f047c009060).stop 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 shutdown_connections 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f047405f300 0x7f04740617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0488154520 0x7f04881646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04880c8120 0x7f04880b0b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 --2- 172.21.15.133:0/2012006208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0488154140 0x7f0488141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 >> 172.21.15.133:0/2012006208 conn(0x7f048805e1e0 msgr2=0x7f04880ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 shutdown_connections 2024-01-21T20:15:08.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.335+0000 7f048d375700 1 -- 172.21.15.133:0/2012006208 wait complete. 2024-01-21T20:15:08.337 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:15:08.337 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:08.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.468+0000 7f7921a84700 1 Processor -- start 2024-01-21T20:15:08.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.468+0000 7f7921a84700 1 -- start start 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f7921a84700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f791c154140 0x7f791c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f7921a84700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c154520 0x7f791c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f7921a84700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791c0ab620 con 0x7f791c0c6090 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f7921a84700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f791c0c6ae0 con 0x7f791c154140 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f7921a84700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c0c05e0 con 0x7f791c154520 2024-01-21T20:15:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f791c0c6090 0x7f791c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35162/0 (socket says 172.21.15.133:35162) 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791bfff700 1 -- 172.21.15.133:0/2574982197 learned_addr learned my addr 172.21.15.133:0/2574982197 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791b7fe700 1 --2- 172.21.15.133:0/2574982197 >> v2:172.21.15.178:3300/0 conn(0x7f791c154140 0x7f791c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791affd700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c154520 0x7f791c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791a7fc700 1 -- 172.21.15.133:0/2574982197 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248187967 0 0) 0x7f791c0ab620 con 0x7f791c0c6090 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791a7fc700 1 -- 172.21.15.133:0/2574982197 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79040033f0 con 0x7f791c0c6090 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791b7fe700 1 -- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c154520 msgr2=0x7f791c0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791b7fe700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c154520 0x7f791c0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791b7fe700 1 -- 172.21.15.133:0/2574982197 >> v1:172.21.15.133:6789/0 conn(0x7f791c0c6090 legacy=0x7f791c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.469+0000 7f791b7fe700 1 -- 172.21.15.133:0/2574982197 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791c0c0e40 con 0x7f791c154140 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f791b7fe700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154140 0x7f791c158bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f790c009760 tx=0x7f790c009060).ready entity=mon.1 client_cookie=833176103bb8a2bd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f791a7fc700 1 -- 172.21.15.133:0/2574982197 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00d4a0 con 0x7f791c154140 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f791a7fc700 1 -- 172.21.15.133:0/2574982197 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c00d600 con 0x7f791c154140 2024-01-21T20:15:08.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f791a7fc700 1 -- 172.21.15.133:0/2574982197 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c00d980 con 0x7f791c154140 2024-01-21T20:15:08.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 -- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154140 msgr2=0x7f791c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154140 0x7f791c158bb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f790c009760 tx=0x7f790c009060).stop 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 -- 172.21.15.133:0/2574982197 shutdown_connections 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154140 0x7f791c158bb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 --2- 172.21.15.133:0/2574982197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c154520 0x7f791c0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.470+0000 7f7921a84700 1 -- 172.21.15.133:0/2574982197 >> 172.21.15.133:0/2574982197 conn(0x7f791c05e1e0 msgr2=0x7f791c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.471+0000 7f7921a84700 1 -- 172.21.15.133:0/2574982197 shutdown_connections 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.471+0000 7f7921a84700 1 -- 172.21.15.133:0/2574982197 wait complete. 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.472+0000 7f7921a84700 1 Processor -- start 2024-01-21T20:15:08.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.472+0000 7f7921a84700 1 -- start start 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 0x7f791c14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 0x7f791c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 0x7f791c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c158880 con 0x7f791c154140 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791c154b20 con 0x7f791c154520 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f7921a84700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791c154e00 con 0x7f791c0c6090 2024-01-21T20:15:08.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f791b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 0x7f791c14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f791bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 0x7f791c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f791b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 0x7f791c14cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43192/0 (socket says 172.21.15.133:43192) 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f791b7fe700 1 -- 172.21.15.133:0/2216600434 learned_addr learned my addr 172.21.15.133:0/2216600434 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.473+0000 7f791affd700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 0x7f791c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 msgr2=0x7f791c14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 0x7f791c14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 msgr2=0x7f791c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 0x7f791c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 -- 172.21.15.133:0/2216600434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0092a0 con 0x7f791c154520 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791affd700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 0x7f791c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f791bfff700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 0x7f791c1582b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f791400c790 tx=0x7f7914007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7914005d30 con 0x7f791c154520 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7914005e90 con 0x7f791c154520 2024-01-21T20:15:08.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c1550e0 con 0x7f791c154520 2024-01-21T20:15:08.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79140072e0 con 0x7f791c154520 2024-01-21T20:15:08.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.474+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791c14f480 con 0x7f791c154520 2024-01-21T20:15:08.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.475+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791c05fdf0 con 0x7f791c154520 2024-01-21T20:15:08.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.476+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7914007710 con 0x7f791c154520 2024-01-21T20:15:08.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.476+0000 7f7903fff700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 0x7f79080617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.476+0000 7f791b7fe700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 msgr2=0x7f79080617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:08.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.476+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f791407a000 con 0x7f791c154520 2024-01-21T20:15:08.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.476+0000 7f791b7fe700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 0x7f79080617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:08.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.481+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f791404ad80 con 0x7f791c154520 2024-01-21T20:15:08.623 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:08.633+0000 7f3a5ec16680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.677+0000 7f791b7fe700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 msgr2=0x7f79080617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.677+0000 7f791b7fe700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 0x7f79080617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.691+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f791c0aa980 con 0x7f791c154520 2024-01-21T20:15:08.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.692+0000 7f7903fff700 1 -- 172.21.15.133:0/2216600434 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f7914018070 con 0x7f791c154520 2024-01-21T20:15:08.681 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:08.681 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:15:08.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 msgr2=0x7f79080617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:08.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 0x7f79080617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 msgr2=0x7f791c1582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 0x7f791c1582b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f791400c790 tx=0x7f7914007f10).stop 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 shutdown_connections 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f790805f300 0x7f79080617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f791c154520 0x7f791c1582b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f791c0c6090 0x7f791c14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 --2- 172.21.15.133:0/2216600434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f791c154140 0x7f791c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 >> 172.21.15.133:0/2216600434 conn(0x7f791c05e1e0 msgr2=0x7f791c0ac550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 shutdown_connections 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.694+0000 7f7921a84700 1 -- 172.21.15.133:0/2216600434 wait complete. 2024-01-21T20:15:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:15:08.690 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:08.701+0000 7f3a5ec16680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:08.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:08.764 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:08.775+0000 7f3a5ec16680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:08.812 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:08.823+0000 7fedc3446680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:08.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.829+0000 7f7a3a708700 1 Processor -- start 2024-01-21T20:15:08.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.829+0000 7f7a3a708700 1 -- start start 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a3a708700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a3413a830 0x7f7a340c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a3a708700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a340695b0 0x7f7a340699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a3a708700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340c3890 con 0x7f7a3413ac10 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a3a708700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340c3b70 con 0x7f7a3413a830 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a3a708700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340c3e50 con 0x7f7a340695b0 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a33fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a3413a830 0x7f7a340c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a33fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7a3413a830 0x7f7a340c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41688/0 (socket says 172.21.15.133:41688) 2024-01-21T20:15:08.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a33fff700 1 -- 172.21.15.133:0/1364867738 learned_addr learned my addr 172.21.15.133:0/1364867738 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.830+0000 7f7a38ca5700 1 --2- 172.21.15.133:0/1364867738 >> v2:172.21.15.178:3300/0 conn(0x7f7a340695b0 0x7f7a340699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a33fff700 1 -- 172.21.15.133:0/1364867738 >> v2:172.21.15.178:3300/0 conn(0x7f7a340695b0 msgr2=0x7f7a340699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a33fff700 1 --2- 172.21.15.133:0/1364867738 >> v2:172.21.15.178:3300/0 conn(0x7f7a340695b0 0x7f7a340699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a33fff700 1 -- 172.21.15.133:0/1364867738 >> v1:172.21.15.178:6789/0 conn(0x7f7a3413ac10 legacy=0x7f7a340bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a33fff700 1 -- 172.21.15.133:0/1364867738 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340c4130 con 0x7f7a3413a830 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a33fff700 1 --2- 172.21.15.133:0/1364867738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413a830 0x7f7a340c3220 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f7a340c2450 tx=0x7f7a2400b3b0).ready entity=mon.0 client_cookie=ac760be7c239a582 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a32ffd700 1 -- 172.21.15.133:0/1364867738 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2400da40 con 0x7f7a3413a830 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a32ffd700 1 -- 172.21.15.133:0/1364867738 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2400dba0 con 0x7f7a3413a830 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a32ffd700 1 -- 172.21.15.133:0/1364867738 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a24010470 con 0x7f7a3413a830 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 -- 172.21.15.133:0/1364867738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413a830 msgr2=0x7f7a340c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 --2- 172.21.15.133:0/1364867738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413a830 0x7f7a340c3220 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f7a340c2450 tx=0x7f7a2400b3b0).stop 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 -- 172.21.15.133:0/1364867738 shutdown_connections 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 --2- 172.21.15.133:0/1364867738 >> v2:172.21.15.178:3300/0 conn(0x7f7a340695b0 0x7f7a340699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 --2- 172.21.15.133:0/1364867738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413a830 0x7f7a340c3220 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.831+0000 7f7a3a708700 1 -- 172.21.15.133:0/1364867738 >> 172.21.15.133:0/1364867738 conn(0x7f7a340c7dc0 msgr2=0x7f7a340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:08.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.832+0000 7f7a3a708700 1 -- 172.21.15.133:0/1364867738 shutdown_connections 2024-01-21T20:15:08.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.832+0000 7f7a3a708700 1 -- 172.21.15.133:0/1364867738 wait complete. 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.833+0000 7f7a3a708700 1 Processor -- start 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.833+0000 7f7a3a708700 1 -- start start 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a340695b0 0x7f7a341530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a3413a830 0x7f7a34164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a34160060 con 0x7f7a3413ac10 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a341608d0 con 0x7f7a3413a830 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a340a92b0 con 0x7f7a340695b0 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41692/0 (socket says 172.21.15.133:41692) 2024-01-21T20:15:08.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 -- 172.21.15.133:0/744364410 learned_addr learned my addr 172.21.15.133:0/744364410 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a33fff700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a340695b0 0x7f7a341530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a337fe700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a3413a830 0x7f7a34164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a340695b0 msgr2=0x7f7a341530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a340695b0 0x7f7a341530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a3413a830 msgr2=0x7f7a34164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a3413a830 0x7f7a34164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 -- 172.21.15.133:0/744364410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2400b610 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a38ca5700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f7a2c009e20 tx=0x7f7a2c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00caa0 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c00f040 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00ce10 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a34160280 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.834+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a34164520 con 0x7f7a3413ac10 2024-01-21T20:15:08.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.836+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34160a60 con 0x7f7a3413ac10 2024-01-21T20:15:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.836+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f7a2c013610 con 0x7f7a3413ac10 2024-01-21T20:15:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.836+0000 7f7a30ff9700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 0x7f7a200617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.836+0000 7f7a33fff700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 msgr2=0x7f7a200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.837+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f7a2c07af90 con 0x7f7a3413ac10 2024-01-21T20:15:08.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.837+0000 7f7a33fff700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 0x7f7a200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:08.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:08.841+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a2c04bc00 con 0x7f7a3413ac10 2024-01-21T20:15:08.887 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:08.897+0000 7fedc3446680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:08.910 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:08.921+0000 7f3a5ec16680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:08.965 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:08.976+0000 7fedc3446680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:08.980 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:08.991+0000 7f3a5ec16680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:09.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.038+0000 7f7a33fff700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 msgr2=0x7f7a200617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:09.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.038+0000 7f7a33fff700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 0x7f7a200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:09.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.053+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a3405fdf0 con 0x7f7a3413ac10 2024-01-21T20:15:09.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.054+0000 7f7a30ff9700 1 -- 172.21.15.133:0/744364410 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f7a2c04f220 con 0x7f7a3413ac10 2024-01-21T20:15:09.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:09.043 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:14:52.450559+0000","modified":"2024-01-21T20:14:54.456480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6726},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6726":{"gid":6726,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6836/3995790824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3995790824},{"type":"v1","addr":"172.21.15.133:6836","nonce":3995790824}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2024-01-21T20:15:09.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 msgr2=0x7f7a200617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:09.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 0x7f7a200617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 msgr2=0x7f7a34066380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f7a2c009e20 tx=0x7f7a2c00b040).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 shutdown_connections 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a2005f300 0x7f7a200617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a3413ac10 0x7f7a34066380 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a340695b0 0x7f7a341530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 --2- 172.21.15.133:0/744364410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a3413a830 0x7f7a34164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 >> 172.21.15.133:0/744364410 conn(0x7f7a340c7dc0 msgr2=0x7f7a34139c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 shutdown_connections 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.056+0000 7f7a3a708700 1 -- 172.21.15.133:0/744364410 wait complete. 2024-01-21T20:15:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 30 2024-01-21T20:15:09.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:09.097 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:09.107+0000 7f3a5ec16680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:09.126 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.136+0000 7fedc3446680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.190+0000 7f115c670700 1 Processor -- start 2024-01-21T20:15:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.190+0000 7f115c670700 1 -- start start 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115c670700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11541542e0 0x7f11540a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115c670700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11540c4720 0x7f11540c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115c670700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11540c50a0 con 0x7f1154066310 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115c670700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11540a77f0 con 0x7f11541542e0 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115c670700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154066810 con 0x7f11540c4720 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11541542e0 0x7f11540a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11541542e0 0x7f11540a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41696/0 (socket says 172.21.15.133:41696) 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 -- 172.21.15.133:0/3853387440 learned_addr learned my addr 172.21.15.133:0/3853387440 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115ac0d700 1 --2- 172.21.15.133:0/3853387440 >> v2:172.21.15.178:3300/0 conn(0x7f11540c4720 0x7f11540c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 -- 172.21.15.133:0/3853387440 >> v2:172.21.15.178:3300/0 conn(0x7f11540c4720 msgr2=0x7f11540c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 --2- 172.21.15.133:0/3853387440 >> v2:172.21.15.178:3300/0 conn(0x7f11540c4720 0x7f11540c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 -- 172.21.15.133:0/3853387440 >> v1:172.21.15.133:6789/0 conn(0x7f1154066310 legacy=0x7f11540a69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115940a700 1 -- 172.21.15.133:0/3853387440 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111335677 0 0) 0x7f11540c50a0 con 0x7f1154066310 2024-01-21T20:15:09.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 -- 172.21.15.133:0/3853387440 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154066af0 con 0x7f11541542e0 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.191+0000 7f115a40c700 1 --2- 172.21.15.133:0/3853387440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541542e0 0x7f11540a7300 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f115405ea20 tx=0x7f11500090f0).ready entity=mon.0 client_cookie=6e41b7a37ff9791a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115940a700 1 -- 172.21.15.133:0/3853387440 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000b520 con 0x7f11541542e0 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115940a700 1 -- 172.21.15.133:0/3853387440 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000b680 con 0x7f11541542e0 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115940a700 1 -- 172.21.15.133:0/3853387440 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000ba20 con 0x7f11541542e0 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 -- 172.21.15.133:0/3853387440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541542e0 msgr2=0x7f11540a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 --2- 172.21.15.133:0/3853387440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541542e0 0x7f11540a7300 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f115405ea20 tx=0x7f11500090f0).stop 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 -- 172.21.15.133:0/3853387440 shutdown_connections 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 --2- 172.21.15.133:0/3853387440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541542e0 0x7f11540a7300 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 --2- 172.21.15.133:0/3853387440 >> v2:172.21.15.178:3300/0 conn(0x7f11540c4720 0x7f11540c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 -- 172.21.15.133:0/3853387440 >> 172.21.15.133:0/3853387440 conn(0x7f1154065920 msgr2=0x7f11540c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 -- 172.21.15.133:0/3853387440 shutdown_connections 2024-01-21T20:15:09.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.192+0000 7f115c670700 1 -- 172.21.15.133:0/3853387440 wait complete. 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 Processor -- start 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 -- start start 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11540c4720 0x7f1154155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 0x7f1154152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154156fd0 con 0x7f1154066310 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154150fe0 con 0x7f11541542e0 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115c670700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1154157460 con 0x7f11540c4720 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115a40c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115a40c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41698/0 (socket says 172.21.15.133:41698) 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.194+0000 7f115a40c700 1 -- 172.21.15.133:0/3920044737 learned_addr learned my addr 172.21.15.133:0/3920044737 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f1159c0b700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11540c4720 0x7f1154155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115ac0d700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 0x7f1154152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 -- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11540c4720 msgr2=0x7f1154155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11540c4720 0x7f1154155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 -- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 msgr2=0x7f1154152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 0x7f1154152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 -- 172.21.15.133:0/3920044737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009370 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115ac0d700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 0x7f1154152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115a40c700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f1154068540 tx=0x7f1150017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150006d90 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150000bc0 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11541563c0 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000ba20 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.195+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154156980 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.196+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11541572b0 con 0x7f1154066310 2024-01-21T20:15:09.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.197+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f115001c630 con 0x7f1154066310 2024-01-21T20:15:09.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.197+0000 7f114affd700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 0x7f11380617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.197+0000 7f1159c0b700 1 -- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 msgr2=0x7f11380617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:09.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.197+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f115007c240 con 0x7f1154066310 2024-01-21T20:15:09.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.197+0000 7f1159c0b700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 0x7f11380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:09.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.201+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f115004cfc0 con 0x7f1154066310 2024-01-21T20:15:09.201 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.212+0000 7fedc3446680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:09.203 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:09.213+0000 7f3a5ec16680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:09.322 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.333+0000 7fedc3446680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:09.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.375+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f115405fdf0 con 0x7f1154066310 2024-01-21T20:15:09.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.376+0000 7f114affd700 1 -- 172.21.15.133:0/3920044737 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+18235 (secure 0 0 0) 0x7f115002a020 con 0x7f1154066310 2024-01-21T20:15:09.366 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:09.366 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":95,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:03.345697+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:14:50.532628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-01-21T20:14:51.412459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3899584255":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3432389072":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/960875153":"2024-01-22T20:15:03.345649+0000","172.21.15.133:0/3359683327":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:03.345649+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:03.345649+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 msgr2=0x7f11380617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 0x7f11380617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 msgr2=0x7f1154150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f1154068540 tx=0x7f1150017000).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 shutdown_connections 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f113805f300 0x7f11380617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11541542e0 0x7f1154152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154066310 0x7f1154150af0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 --2- 172.21.15.133:0/3920044737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11540c4720 0x7f1154155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 >> 172.21.15.133:0/3920044737 conn(0x7f1154065920 msgr2=0x7f11540c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:09.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 shutdown_connections 2024-01-21T20:15:09.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.378+0000 7f115c670700 1 -- 172.21.15.133:0/3920044737 wait complete. 2024-01-21T20:15:09.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:15:09.439 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.449+0000 7fedc3446680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:09.493 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:09.504+0000 7f3a5ec16680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:09.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.511+0000 7f21eb61f700 1 Processor -- start 2024-01-21T20:15:09.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.511+0000 7f21eb61f700 1 -- start start 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21eb61f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21e4137030 0x7f21e4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21eb61f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e4068370 con 0x7f21e4137410 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21eb61f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e4068650 con 0x7f21e40c5930 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21eb61f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e4068930 con 0x7f21e4137030 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e8bba700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21e4137410 0x7f21e4155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:35172/0 (socket says 172.21.15.133:35172) 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e8bba700 1 -- 172.21.15.133:0/1331002724 learned_addr learned my addr 172.21.15.133:0/1331002724 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e93bb700 1 --2- 172.21.15.133:0/1331002724 >> v2:172.21.15.178:3300/0 conn(0x7f21e4137030 0x7f21e4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21dbfff700 1 -- 172.21.15.133:0/1331002724 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130588500 0 0) 0x7f21e4068370 con 0x7f21e4137410 2024-01-21T20:15:09.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21dbfff700 1 -- 172.21.15.133:0/1331002724 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d00033f0 con 0x7f21e4137410 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e93bb700 1 -- 172.21.15.133:0/1331002724 >> v1:172.21.15.178:6789/0 conn(0x7f21e40c5930 legacy=0x7f21e40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e93bb700 1 -- 172.21.15.133:0/1331002724 >> v1:172.21.15.133:6789/0 conn(0x7f21e4137410 legacy=0x7f21e4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e93bb700 1 -- 172.21.15.133:0/1331002724 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e4068c10 con 0x7f21e4137030 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.512+0000 7f21e93bb700 1 --2- 172.21.15.133:0/1331002724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137030 0x7f21e4067d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f21e0009760 tx=0x7f21e0009060).ready entity=mon.1 client_cookie=7fab884bae56152c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21dbfff700 1 -- 172.21.15.133:0/1331002724 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00090d0 con 0x7f21e4137030 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21dbfff700 1 -- 172.21.15.133:0/1331002724 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e000f510 con 0x7f21e4137030 2024-01-21T20:15:09.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21dbfff700 1 -- 172.21.15.133:0/1331002724 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000f890 con 0x7f21e4137030 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 -- 172.21.15.133:0/1331002724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137030 msgr2=0x7f21e4067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1331002724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137030 0x7f21e4067d90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f21e0009760 tx=0x7f21e0009060).stop 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 -- 172.21.15.133:0/1331002724 shutdown_connections 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1331002724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137030 0x7f21e4067d90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 -- 172.21.15.133:0/1331002724 >> 172.21.15.133:0/1331002724 conn(0x7f21e4066a90 msgr2=0x7f21e4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 -- 172.21.15.133:0/1331002724 shutdown_connections 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.513+0000 7f21eb61f700 1 -- 172.21.15.133:0/1331002724 wait complete. 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 Processor -- start 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 -- start start 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 0x7f21e41367f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 0x7f21e40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e413c7d0 con 0x7f21e40c5930 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e413bbc0 con 0x7f21e4137410 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.515+0000 7f21eb61f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e413bea0 con 0x7f21e4137030 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41710/0 (socket says 172.21.15.133:41710) 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 -- 172.21.15.133:0/1142487888 learned_addr learned my addr 172.21.15.133:0/1142487888 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e8bba700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 0x7f21e41367f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e9bbc700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 0x7f21e40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 msgr2=0x7f21e41367f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 0x7f21e41367f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 msgr2=0x7f21e40ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 0x7f21e40ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:09.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 -- 172.21.15.133:0/1142487888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00092a0 con 0x7f21e40c5930 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e8bba700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 0x7f21e41367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e9bbc700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 0x7f21e40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21e93bb700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f21e0009e00 tx=0x7f21e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000f890 con 0x7f21e40c5930 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0009e30 con 0x7f21e40c5930 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e413c180 con 0x7f21e40c5930 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e000fe60 con 0x7f21e40c5930 2024-01-21T20:15:09.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.516+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e413b810 con 0x7f21e40c5930 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e405fdf0 con 0x7f21e40c5930 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 35) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f21e001b620 con 0x7f21e40c5930 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21d9ffb700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 0x7f21c80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21e8bba700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 msgr2=0x7f21c80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6963+0+0 (secure 0 0 0) 0x7f21e007c010 con 0x7f21e40c5930 2024-01-21T20:15:09.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.518+0000 7f21e8bba700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 0x7f21c80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:09.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.522+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21e004cd90 con 0x7f21e40c5930 2024-01-21T20:15:09.565 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:09.576+0000 7f3a5ec16680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:09.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.719+0000 7f21e8bba700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 msgr2=0x7f21c80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:09.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.719+0000 7f21e8bba700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 0x7f21c80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:09.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.746+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f21e406bd20 con 0x7f21e40c5930 2024-01-21T20:15:09.755 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.765+0000 7fedc3446680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:09.827 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.837+0000 7fedc3446680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.857+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 36) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f21e0079890 con 0x7f21e40c5930 2024-01-21T20:15:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.857+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 msgr2=0x7f21c80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:09.857+0000 7f21d9ffb700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 0x7f21c80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:09.851 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:15:09.851 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:15:09.851 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:15:09.855 INFO:tasks.ceph.mds.c.smithi133.stderr: -987> 2024-01-21T20:14:57.868+0000 7f4b3db4b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:15:09.857 INFO:tasks.ceph.mds.c.smithi133.stderr: -6> 2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:15:09.857 INFO:tasks.ceph.mds.c.smithi133.stderr: -5> 2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:15:09.857 INFO:tasks.ceph.mds.c.smithi133.stderr: -2> 2024-01-21T20:15:09.862+0000 7f4b3a344700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:15:09.875 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3f9f7700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3f9f7700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3f9f7700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3f9f7700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3f9f7700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3c1f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.908 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3c1f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.909 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3c1f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.909 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3c1f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:09.909 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:09.919+0000 7fed3c1f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:10.362 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:15:10.372+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:15:10.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.377+0000 7f21d9ffb700 1 -- 172.21.15.133:0/1142487888 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7f21e0054800 con 0x7f21e40c5930 2024-01-21T20:15:10.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 msgr2=0x7f21e413dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:10.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f21e0009e00 tx=0x7f21e0017000).stop 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 shutdown_connections 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f21c805f300 0x7f21c80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21e4137410 0x7f21e40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21e40c5930 0x7f21e413dae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 --2- 172.21.15.133:0/1142487888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21e4137030 0x7f21e41367f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 >> 172.21.15.133:0/1142487888 conn(0x7f21e4066a90 msgr2=0x7f21e40bf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 shutdown_connections 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.380+0000 7f21eb61f700 1 -- 172.21.15.133:0/1142487888 wait complete. 2024-01-21T20:15:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:15:10.381 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.509+0000 7f0a56718700 1 Processor -- start 2024-01-21T20:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.509+0000 7f0a56718700 1 -- start start 2024-01-21T20:15:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a56718700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a5013ac10 0x7f0a500c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a56718700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a50069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a56718700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a50069ef0 con 0x7f0a5013a830 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a56718700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500c3890 con 0x7f0a5013ac10 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a56718700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c3b70 con 0x7f0a500695b0 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a5013a830 0x7f0a500bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46362/0 (socket says 172.21.15.133:46362) 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4ffff700 1 -- 172.21.15.133:0/2560528656 learned_addr learned my addr 172.21.15.133:0/2560528656 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a54cb5700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a50069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4f7fe700 1 --2- 172.21.15.133:0/2560528656 >> v2:172.21.15.178:3300/0 conn(0x7f0a5013ac10 0x7f0a500c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370181053 0 0) 0x7f0a50069ef0 con 0x7f0a5013a830 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a380033f0 con 0x7f0a5013a830 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926909635 0 0) 0x7f0a380033f0 con 0x7f0a5013a830 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 msgr2=0x7f0a50069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a50069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 >> v2:172.21.15.178:3300/0 conn(0x7f0a5013ac10 msgr2=0x7f0a500c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 --2- 172.21.15.133:0/2560528656 >> v2:172.21.15.178:3300/0 conn(0x7f0a5013ac10 0x7f0a500c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500c3e50 con 0x7f0a5013a830 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0a40001470 con 0x7f0a5013a830 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 >> v1:172.21.15.133:6789/0 conn(0x7f0a5013a830 legacy=0x7f0a500bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a38003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.510+0000 7f0a4effd700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a38004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a38004b80 0x7f0a38005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c3890 con 0x7f0a380038e0 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500c3b70 con 0x7f0a38004b80 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3800b8e0 con 0x7f0a500695b0 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a38003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4f7fe700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a38004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a54cb5700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a38004b80 0x7f0a38005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 -- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 msgr2=0x7f0a38004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500695b0 0x7f0a38004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 -- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a38004b80 msgr2=0x7f0a38005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a38004b80 0x7f0a38005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 -- 172.21.15.133:0/2560528656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380033f0 con 0x7f0a380038e0 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a38003d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f0a4000c210 tx=0x7f0a40001e90).ready entity=mon.0 client_cookie=a8705f65b14f3dce server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40007a60 con 0x7f0a380038e0 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4000cae0 con 0x7f0a380038e0 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.511+0000 7f0a4effd700 1 -- 172.21.15.133:0/2560528656 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000ce60 con 0x7f0a380038e0 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 -- 172.21.15.133:0/2560528656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 msgr2=0x7f0a38003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 --2- 172.21.15.133:0/2560528656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a38003d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f0a4000c210 tx=0x7f0a40001e90).stop 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a54cb5700 1 -- 172.21.15.133:0/2560528656 reap_dead start 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 -- 172.21.15.133:0/2560528656 shutdown_connections 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 -- 172.21.15.133:0/2560528656 >> 172.21.15.133:0/2560528656 conn(0x7f0a500c7dc0 msgr2=0x7f0a500c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 -- 172.21.15.133:0/2560528656 shutdown_connections 2024-01-21T20:15:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.512+0000 7f0a56718700 1 -- 172.21.15.133:0/2560528656 wait complete. 2024-01-21T20:15:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.513+0000 7f0a56718700 1 Processor -- start 2024-01-21T20:15:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.513+0000 7f0a56718700 1 -- start start 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a50150e00 0x7f0a500ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500ab510 0x7f0a500a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500ada60 con 0x7f0a380038e0 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500ace50 con 0x7f0a50150e00 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a56718700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500ad130 con 0x7f0a500ab510 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39060/0 (socket says 172.21.15.133:39060) 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 -- 172.21.15.133:0/3281399878 learned_addr learned my addr 172.21.15.133:0/3281399878 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a54cb5700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500ab510 0x7f0a500a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4f7fe700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a50150e00 0x7f0a500ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 -- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500ab510 msgr2=0x7f0a500a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500ab510 0x7f0a500a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 -- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a50150e00 msgr2=0x7f0a500ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a50150e00 0x7f0a500ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 -- 172.21.15.133:0/3281399878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500ad410 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.514+0000 7f0a4ffff700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f0a4000cab0 tx=0x7f0a40015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.515+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400074f0 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.515+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40007650 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.515+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500ad6f0 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.515+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40004900 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.515+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500a9d80 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.516+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a500add40 con 0x7f0a380038e0 2024-01-21T20:15:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.516+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 36) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f0a40004c70 con 0x7f0a380038e0 2024-01-21T20:15:10.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.516+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f0a4007b180 con 0x7f0a380038e0 2024-01-21T20:15:10.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.520+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a4004c1b0 con 0x7f0a380038e0 2024-01-21T20:15:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.729+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a5005fdf0 con 0x7f0a380038e0 2024-01-21T20:15:10.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.859+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 37) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f0a40078cb0 con 0x7f0a380038e0 2024-01-21T20:15:10.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.860+0000 7f0a4cff9700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 0x7f0a3c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:10.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.861+0000 7f0a4f7fe700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 0x7f0a3c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:10.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:10.862+0000 7f0a4f7fe700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 0x7f0a3c0680e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0a50063790 tx=0x7f0a44009060).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:11.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.379+0000 7f0a4cff9700 1 -- 172.21.15.133:0/3281399878 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a4003d260 con 0x7f0a380038e0 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 msgr2=0x7f0a3c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 0x7f0a3c0680e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0a50063790 tx=0x7f0a44009060).stop 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 msgr2=0x7f0a50150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f0a4000cab0 tx=0x7f0a40015000).stop 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 shutdown_connections 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0a3c0302f0 0x7f0a3c0680e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a500ab510 0x7f0a500a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a380038e0 0x7f0a50150910 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 --2- 172.21.15.133:0/3281399878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a50150e00 0x7f0a500ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.381+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 >> 172.21.15.133:0/3281399878 conn(0x7f0a500c7dc0 msgr2=0x7f0a500c72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:11.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.382+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 shutdown_connections 2024-01-21T20:15:11.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.382+0000 7f0a56718700 1 -- 172.21.15.133:0/3281399878 wait complete. 2024-01-21T20:15:11.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:15:11.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.517+0000 7fee8e2f9700 1 Processor -- start 2024-01-21T20:15:11.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.517+0000 7fee8e2f9700 1 -- start start 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8e2f9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee88069be0 0x7fee8815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8e2f9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee880c23b0 con 0x7fee880bda90 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8e2f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee88067600 con 0x7fee8813a7b0 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8e2f9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee880663c0 con 0x7fee88069be0 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8c896700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee88069be0 0x7fee8815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8c896700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee88069be0 0x7fee8815bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39074/0 (socket says 172.21.15.133:39074) 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee877fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fee880bda90 0x7fee880694d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46368/0 (socket says 172.21.15.133:46368) 2024-01-21T20:15:11.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.518+0000 7fee8c896700 1 -- 172.21.15.133:0/3847995519 learned_addr learned my addr 172.21.15.133:0/3847995519 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8c896700 1 -- 172.21.15.133:0/3847995519 >> v1:172.21.15.178:6789/0 conn(0x7fee8813a7b0 legacy=0x7fee88066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8c896700 1 -- 172.21.15.133:0/3847995519 >> v1:172.21.15.133:6789/0 conn(0x7fee880bda90 legacy=0x7fee880694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8c896700 1 -- 172.21.15.133:0/3847995519 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee880678e0 con 0x7fee88069be0 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8c896700 1 --2- 172.21.15.133:0/3847995519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee8815bba0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fee80009f20 tx=0x7fee80009840).ready entity=mon.0 client_cookie=e4788b2f3a150513 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee86ffd700 1 -- 172.21.15.133:0/3847995519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000e070 con 0x7fee88069be0 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee86ffd700 1 -- 172.21.15.133:0/3847995519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000ba80 con 0x7fee88069be0 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee86ffd700 1 -- 172.21.15.133:0/3847995519 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000be00 con 0x7fee88069be0 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3847995519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 msgr2=0x7fee8815bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.519+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3847995519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee8815bba0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fee80009f20 tx=0x7fee80009840).stop 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.520+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3847995519 shutdown_connections 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.520+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3847995519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee8815bba0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.520+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3847995519 >> 172.21.15.133:0/3847995519 conn(0x7fee880c7d20 msgr2=0x7fee880c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.520+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3847995519 shutdown_connections 2024-01-21T20:15:11.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.520+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3847995519 wait complete. 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.521+0000 7fee8e2f9700 1 Processor -- start 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.521+0000 7fee8e2f9700 1 -- start start 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 0x7fee880aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 0x7fee880c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee88153db0 con 0x7fee88069be0 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee880a84c0 con 0x7fee880a8950 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee880a7b90 con 0x7fee8813a7b0 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39084/0 (socket says 172.21.15.133:39084) 2024-01-21T20:15:11.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 -- 172.21.15.133:0/3494773151 learned_addr learned my addr 172.21.15.133:0/3494773151 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee877fe700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 0x7fee880aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8c896700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 0x7fee880c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 -- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 msgr2=0x7fee880aa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 0x7fee880aa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 -- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 msgr2=0x7fee880c07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 0x7fee880c07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 -- 172.21.15.133:0/3494773151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009ae0 con 0x7fee88069be0 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8c896700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 0x7fee880c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee877fe700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 0x7fee880aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee87fff700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fee7c00b460 tx=0x7fee7c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c012410 con 0x7fee88069be0 2024-01-21T20:15:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c012590 con 0x7fee88069be0 2024-01-21T20:15:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee880a7e70 con 0x7fee88069be0 2024-01-21T20:15:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c012950 con 0x7fee88069be0 2024-01-21T20:15:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.522+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee880aa510 con 0x7fee88069be0 2024-01-21T20:15:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.523+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8805fdf0 con 0x7fee88069be0 2024-01-21T20:15:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.524+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 37) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fee7c012d00 con 0x7fee88069be0 2024-01-21T20:15:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.524+0000 7fee84ff9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 0x7fee740614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.524+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fee7c07a7d0 con 0x7fee88069be0 2024-01-21T20:15:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.525+0000 7fee877fe700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 0x7fee740614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:11.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.525+0000 7fee877fe700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 0x7fee740614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fee881398c0 tx=0x7fee78009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.528+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fee7c04b8a0 con 0x7fee88069be0 2024-01-21T20:15:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:11.691+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee880a87a0 con 0x7fee88069be0 2024-01-21T20:15:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.381+0000 7fee84ff9700 1 -- 172.21.15.133:0/3494773151 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7fee7c04eec0 con 0x7fee88069be0 2024-01-21T20:15:12.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 msgr2=0x7fee740614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 0x7fee740614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fee881398c0 tx=0x7fee78009040).stop 2024-01-21T20:15:12.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 msgr2=0x7fee881538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fee7c00b460 tx=0x7fee7c006f20).stop 2024-01-21T20:15:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 shutdown_connections 2024-01-21T20:15:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fee7405f030 0x7fee740614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee880a8950 0x7fee880c07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee88069be0 0x7fee881538c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 --2- 172.21.15.133:0/3494773151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee8813a7b0 0x7fee880aa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.386+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 >> 172.21.15.133:0/3494773151 conn(0x7fee880c7d20 msgr2=0x7fee880c3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.387+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 shutdown_connections 2024-01-21T20:15:12.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.387+0000 7fee8e2f9700 1 -- 172.21.15.133:0/3494773151 wait complete. 2024-01-21T20:15:12.378 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:15:12.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:15:12.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.522+0000 7f74a6531700 1 Processor -- start 2024-01-21T20:15:12.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.522+0000 7f74a6531700 1 -- start start 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a6531700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f74a0134ee0 0x7f74a00683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a6531700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f74a00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a6531700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a0064760 con 0x7f74a00c35e0 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a6531700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a0068da0 con 0x7f74a0134ee0 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a6531700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00652e0 con 0x7f74a01352c0 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a4ace700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74a00c35e0 0x7f74a00c3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46384/0 (socket says 172.21.15.133:46384) 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.523+0000 7f74a4ace700 1 -- 172.21.15.133:0/3999404233 learned_addr learned my addr 172.21.15.133:0/3999404233 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:12.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018096190 0 0) 0x7f74a0064760 con 0x7f74a00c35e0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749ffff700 1 --2- 172.21.15.133:0/3999404233 >> v2:172.21.15.178:3300/0 conn(0x7f74a0134ee0 0x7f74a00683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c0033f0 con 0x7f74a00c35e0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749f7fe700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f74a00688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245122016 0 0) 0x7f748c0033f0 con 0x7f74a00c35e0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 msgr2=0x7f74a00688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f74a00688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 >> v2:172.21.15.178:3300/0 conn(0x7f74a0134ee0 msgr2=0x7f74a00683c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 --2- 172.21.15.133:0/3999404233 >> v2:172.21.15.178:3300/0 conn(0x7f74a0134ee0 0x7f74a00683c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00649b0 con 0x7f74a00c35e0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f74980017f0 con 0x7f74a00c35e0 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749ffff700 1 --2- 172.21.15.133:0/3999404233 >> v2:172.21.15.178:3300/0 conn(0x7f74a0134ee0 0x7f74a00683c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 >> v1:172.21.15.133:6789/0 conn(0x7f74a00c35e0 legacy=0x7f74a00c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f748c0038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f748c003ec0 0x7f748c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c004b80 0x7f748c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0068da0 con 0x7f748c004b80 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00652e0 con 0x7f748c003ec0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748c00b990 con 0x7f74a01352c0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c004b80 0x7f748c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749ffff700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f748c0038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f749f7fe700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f748c003ec0 0x7f748c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 -- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 msgr2=0x7f748c0038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a01352c0 0x7f748c0038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 -- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f748c003ec0 msgr2=0x7f748c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f748c003ec0 0x7f748c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.524+0000 7f74a4ace700 1 -- 172.21.15.133:0/3999404233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0033f0 con 0x7f748c004b80 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a4ace700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c004b80 0x7f748c005000 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f749800c530 tx=0x7f74a0065250).ready entity=mon.0 client_cookie=807f52164bd4a13 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:12.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498007de0 con 0x7f748c004b80 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800ce60 con 0x7f748c004b80 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f749effd700 1 -- 172.21.15.133:0/3999404233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498005d30 con 0x7f748c004b80 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 -- 172.21.15.133:0/3999404233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c004b80 msgr2=0x7f748c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 --2- 172.21.15.133:0/3999404233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f748c004b80 0x7f748c005000 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f749800c530 tx=0x7f74a0065250).stop 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a4ace700 1 -- 172.21.15.133:0/3999404233 reap_dead start 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 -- 172.21.15.133:0/3999404233 shutdown_connections 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 -- 172.21.15.133:0/3999404233 >> 172.21.15.133:0/3999404233 conn(0x7f74a00626f0 msgr2=0x7f74a0062b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 -- 172.21.15.133:0/3999404233 shutdown_connections 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.525+0000 7f74a6531700 1 -- 172.21.15.133:0/3999404233 wait complete. 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.526+0000 7f74a6531700 1 Processor -- start 2024-01-21T20:15:12.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 -- start start 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74a014b790 0x7f74a014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a00bdc90 0x7f74a00c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a014fb50 con 0x7f74a00ab5d0 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00bf3d0 con 0x7f74a014b790 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a6531700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00abf40 con 0x7f74a00bdc90 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.527+0000 7f74a4ace700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39102/0 (socket says 172.21.15.133:39102) 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 -- 172.21.15.133:0/1139267592 learned_addr learned my addr 172.21.15.133:0/1139267592 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f749f7fe700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a00bdc90 0x7f74a00c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f749ffff700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74a014b790 0x7f74a014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 -- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a00bdc90 msgr2=0x7f74a00c0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a00bdc90 0x7f74a00c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 -- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74a014b790 msgr2=0x7f74a014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74a014b790 0x7f74a014f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 -- 172.21.15.133:0/1139267592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00be190 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a4ace700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f749800d010 tx=0x7f7498015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980072e0 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498007440 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a00be470 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498007800 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.528+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a00bea30 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.529+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a005fdf0 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.530+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 37) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f74980062e0 con 0x7f74a00ab5d0 2024-01-21T20:15:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.530+0000 7f749cff9700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 0x7f74800614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.530+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6826+0+0 (secure 0 0 0) 0x7f749807b350 con 0x7f74a00ab5d0 2024-01-21T20:15:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.530+0000 7f749ffff700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 0x7f74800614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.531+0000 7f749ffff700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 0x7f74800614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f749000b210 tx=0x7f749000b040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.534+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f749804c480 con 0x7f74a00ab5d0 2024-01-21T20:15:12.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.699+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f74a0064c90 con 0x7f74a00ab5d0 2024-01-21T20:15:12.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:12.871+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7498078f80 con 0x7f74a00ab5d0 2024-01-21T20:15:13.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.385+0000 7f749cff9700 1 -- 172.21.15.133:0/1139267592 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7498046f40 con 0x7f74a00ab5d0 2024-01-21T20:15:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.387+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 msgr2=0x7f74800614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.387+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 0x7f74800614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f749000b210 tx=0x7f749000b040).stop 2024-01-21T20:15:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.387+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 msgr2=0x7f74a00aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.387+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f749800d010 tx=0x7f7498015000).stop 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 shutdown_connections 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f030 0x7f74800614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74a00ab5d0 0x7f74a00aba50 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74a014b790 0x7f74a014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 --2- 172.21.15.133:0/1139267592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74a00bdc90 0x7f74a00c0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 >> 172.21.15.133:0/1139267592 conn(0x7f74a00626f0 msgr2=0x7f74a00bc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 shutdown_connections 2024-01-21T20:15:13.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.389+0000 7f74a6531700 1 -- 172.21.15.133:0/1139267592 wait complete. 2024-01-21T20:15:13.383 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:15:13.393 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:15:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.522+0000 7fce5160e700 1 Processor -- start 2024-01-21T20:15:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.522+0000 7fce5160e700 1 -- start start 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce5160e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce4c1351d0 0x7fce4c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce5160e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c0c3c60 0x7fce4c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce5160e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c156650 con 0x7fce4c1561a0 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce5160e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0c61a0 con 0x7fce4c1351d0 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce5160e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0c5350 con 0x7fce4c0c3c60 2024-01-21T20:15:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce4affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce4c1351d0 0x7fce4c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce4affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce4c1351d0 0x7fce4c0c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39116/0 (socket says 172.21.15.133:39116) 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce4affd700 1 -- 172.21.15.133:0/2428501028 learned_addr learned my addr 172.21.15.133:0/2428501028 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.523+0000 7fce4a7fc700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c0c3c60 0x7fce4c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce4affd700 1 -- 172.21.15.133:0/2428501028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c0c3c60 msgr2=0x7fce4c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce4affd700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c0c3c60 0x7fce4c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce4affd700 1 -- 172.21.15.133:0/2428501028 >> v1:172.21.15.178:6789/0 conn(0x7fce4c1561a0 legacy=0x7fce4c1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce4affd700 1 -- 172.21.15.133:0/2428501028 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c0c55d0 con 0x7fce4c1351d0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce4affd700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1351d0 0x7fce4c0c3770 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fce40006fd0 tx=0x7fce400090f0).ready entity=mon.0 client_cookie=2b28d3465dead573 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce49ffb700 1 -- 172.21.15.133:0/2428501028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000b600 con 0x7fce4c1351d0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce49ffb700 1 -- 172.21.15.133:0/2428501028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000b760 con 0x7fce4c1351d0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce49ffb700 1 -- 172.21.15.133:0/2428501028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000bb00 con 0x7fce4c1351d0 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 -- 172.21.15.133:0/2428501028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1351d0 msgr2=0x7fce4c0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1351d0 0x7fce4c0c3770 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fce40006fd0 tx=0x7fce400090f0).stop 2024-01-21T20:15:13.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 -- 172.21.15.133:0/2428501028 shutdown_connections 2024-01-21T20:15:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1351d0 0x7fce4c0c3770 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 --2- 172.21.15.133:0/2428501028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c0c3c60 0x7fce4c155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 -- 172.21.15.133:0/2428501028 >> 172.21.15.133:0/2428501028 conn(0x7fce4c066a90 msgr2=0x7fce4c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.524+0000 7fce5160e700 1 -- 172.21.15.133:0/2428501028 shutdown_connections 2024-01-21T20:15:13.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.525+0000 7fce5160e700 1 -- 172.21.15.133:0/2428501028 wait complete. 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.526+0000 7fce5160e700 1 Processor -- start 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.526+0000 7fce5160e700 1 -- start start 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce4c0c3c60 0x7fce4c133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c1351d0 0x7fce4c14f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c14e600 con 0x7fce4c1561a0 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c14fb30 con 0x7fce4c0c3c60 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce5160e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c14d980 con 0x7fce4c1351d0 2024-01-21T20:15:13.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce4b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce4b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39122/0 (socket says 172.21.15.133:39122) 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce4affd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce4c0c3c60 0x7fce4c133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce4b7fe700 1 -- 172.21.15.133:0/2484329751 learned_addr learned my addr 172.21.15.133:0/2484329751 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.527+0000 7fce4a7fc700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c1351d0 0x7fce4c14f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 -- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c1351d0 msgr2=0x7fce4c14f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c1351d0 0x7fce4c14f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 -- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce4c0c3c60 msgr2=0x7fce4c133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce4c0c3c60 0x7fce4c133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 -- 172.21.15.133:0/2484329751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009370 con 0x7fce4c1561a0 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce4b7fe700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fce44002230 tx=0x7fce440015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4400e4a0 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4400e600 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c14dc60 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4400e980 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.528+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c14e220 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.529+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4c14e740 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.529+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fce4401b3b0 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.530+0000 7fce337fe700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.530+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7fce44079800 con 0x7fce4c1561a0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.530+0000 7fce4affd700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.530+0000 7fce4affd700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fce4000b3c0 tx=0x7fce40017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.534+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fce44048b00 con 0x7fce4c1561a0 2024-01-21T20:15:13.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.697+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fce4c156650 con 0x7fce4c1561a0 2024-01-21T20:15:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.701+0000 7fce337fe700 1 -- 172.21.15.133:0/2484329751 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce4c156650 con 0x7fce4c1561a0 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 msgr2=0x7fce38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 0x7fce38061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fce4000b3c0 tx=0x7fce40017000).stop 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 msgr2=0x7fce4c14f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fce44002230 tx=0x7fce440015e0).stop 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 shutdown_connections 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fce3805f150 0x7fce38061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce4c1561a0 0x7fce4c14f640 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce4c0c3c60 0x7fce4c133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 --2- 172.21.15.133:0/2484329751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce4c1351d0 0x7fce4c14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 >> 172.21.15.133:0/2484329751 conn(0x7fce4c066a90 msgr2=0x7fce4c134830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 shutdown_connections 2024-01-21T20:15:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.703+0000 7fce5160e700 1 -- 172.21.15.133:0/2484329751 wait complete. 2024-01-21T20:15:13.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:15:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.832+0000 7fd005a02700 1 Processor -- start 2024-01-21T20:15:13.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.832+0000 7fd005a02700 1 -- start start 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fd005a02700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd000158450 0x7fd000158830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fd005a02700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd000062e00 0x7fd0000bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fd005a02700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd000069560 con 0x7fd0000bcc50 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fd005a02700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd000158d20 con 0x7fd000158450 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fd005a02700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000069840 con 0x7fd000062e00 2024-01-21T20:15:13.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fcffeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd000158450 0x7fd000158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fcffe7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd0000bcc50 0x7fd0000626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46388/0 (socket says 172.21.15.133:46388) 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fcffeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd000158450 0x7fd000158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39134/0 (socket says 172.21.15.133:39134) 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.833+0000 7fcffe7fc700 1 -- 172.21.15.133:0/44507527 learned_addr learned my addr 172.21.15.133:0/44507527 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcfff7fe700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd000062e00 0x7fd0000bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffeffd700 1 -- 172.21.15.133:0/44507527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd000062e00 msgr2=0x7fd0000bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffeffd700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd000062e00 0x7fd0000bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffeffd700 1 -- 172.21.15.133:0/44507527 >> v1:172.21.15.133:6789/0 conn(0x7fd0000bcc50 legacy=0x7fd0000626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffeffd700 1 -- 172.21.15.133:0/44507527 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd000069b20 con 0x7fd000158450 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffdffb700 1 -- 172.21.15.133:0/44507527 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296442030 0 0) 0x7fd000069560 con 0x7fd0000bcc50 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffeffd700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000158450 0x7fd000158830 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fcfe8009760 tx=0x7fcfe8009060).ready entity=mon.0 client_cookie=9828626a260b59e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffdffb700 1 -- 172.21.15.133:0/44507527 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80090d0 con 0x7fd000158450 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffdffb700 1 -- 172.21.15.133:0/44507527 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800b580 con 0x7fd000158450 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fcffdffb700 1 -- 172.21.15.133:0/44507527 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800b900 con 0x7fd000158450 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 -- 172.21.15.133:0/44507527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000158450 msgr2=0x7fd000158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000158450 0x7fd000158830 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fcfe8009760 tx=0x7fcfe8009060).stop 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 -- 172.21.15.133:0/44507527 shutdown_connections 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd000062e00 0x7fd0000bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 --2- 172.21.15.133:0/44507527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000158450 0x7fd000158830 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.834+0000 7fd005a02700 1 -- 172.21.15.133:0/44507527 >> 172.21.15.133:0/44507527 conn(0x7fd000064290 msgr2=0x7fd0000c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.835+0000 7fd005a02700 1 -- 172.21.15.133:0/44507527 shutdown_connections 2024-01-21T20:15:13.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.835+0000 7fd005a02700 1 -- 172.21.15.133:0/44507527 wait complete. 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.836+0000 7fd005a02700 1 Processor -- start 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.836+0000 7fd005a02700 1 -- start start 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 0x7fd000152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 0x7fd000145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000c3120 con 0x7fd000062e00 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000a5700 con 0x7fd000158450 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000153000 con 0x7fd0000bcc50 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39146/0 (socket says 172.21.15.133:39146) 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 -- 172.21.15.133:0/1600535046 learned_addr learned my addr 172.21.15.133:0/1600535046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:13.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffe7fc700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 0x7fd000152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcfff7fe700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 0x7fd000145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 -- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 msgr2=0x7fd000152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 0x7fd000152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 -- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 msgr2=0x7fd000145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 0x7fd000145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 -- 172.21.15.133:0/1600535046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80092a0 con 0x7fd000062e00 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcfff7fe700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 0x7fd000145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffe7fc700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 0x7fd000152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcffeffd700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fcfe8009eb0 tx=0x7fcfe8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8006990 con 0x7fd000062e00 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800bcc0 con 0x7fd000062e00 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0000c2d80 con 0x7fd000062e00 2024-01-21T20:15:13.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800b900 con 0x7fd000062e00 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.837+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0000a7060 con 0x7fd000062e00 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.838+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00006c850 con 0x7fd000062e00 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.839+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcfe801c630 con 0x7fd000062e00 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.839+0000 7fcff77fe700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 0x7fcfe0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.839+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7fcfe807bce0 con 0x7fd000062e00 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.839+0000 7fcffe7fc700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 0x7fcfe0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:13.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.839+0000 7fcffe7fc700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 0x7fcfe0061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcff0007fd0 tx=0x7fcff0009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:13.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:13.843+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcfe804ce30 con 0x7fd000062e00 2024-01-21T20:15:13.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.008+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fd000157b00 con 0x7fd000062e00 2024-01-21T20:15:14.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.012+0000 7fcff77fe700 1 -- 172.21.15.133:0/1600535046 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v17) v1 ==== 120+0+0 (secure 0 0 0) 0x7fcfe80200b0 con 0x7fd000062e00 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 msgr2=0x7fcfe0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 0x7fcfe0061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcff0007fd0 tx=0x7fcff0009040).stop 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 msgr2=0x7fd0000a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fcfe8009eb0 tx=0x7fcfe8017000).stop 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 shutdown_connections 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcfe005f150 0x7fcfe0061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd000158450 0x7fd000145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd000062e00 0x7fd0000a5210 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 --2- 172.21.15.133:0/1600535046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0000bcc50 0x7fd000152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 >> 172.21.15.133:0/1600535046 conn(0x7fd000064290 msgr2=0x7fd0000626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:14.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 shutdown_connections 2024-01-21T20:15:14.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.014+0000 7fd005a02700 1 -- 172.21.15.133:0/1600535046 wait complete. 2024-01-21T20:15:14.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2024-01-21T20:15:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.149+0000 7f0f0c800700 1 Processor -- start 2024-01-21T20:15:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.149+0000 7f0f0c800700 1 -- start start 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.150+0000 7f0f0c800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 0x7f0f040a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.150+0000 7f0f0c800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0f0413aa00 0x7f0f04158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.150+0000 7f0f0c800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f041584f0 con 0x7f0f040626f0 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.150+0000 7f0f0c800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040bd6f0 con 0x7f0f0413aa00 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.150+0000 7f0f0c800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040654e0 con 0x7f0f0413a620 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0a59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 0x7f0f040a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0f0413aa00 0x7f0f04158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0ad9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0f040626f0 0x7f0f040695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:58068/0 (socket says 172.21.15.133:58068) 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0ad9d700 1 -- 172.21.15.133:0/3376234617 learned_addr learned my addr 172.21.15.133:0/3376234617 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 msgr2=0x7f0f040a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 0x7f0f040a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3376234617 >> v1:172.21.15.178:6789/0 conn(0x7f0f040626f0 legacy=0x7f0f040695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3376234617 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04158730 con 0x7f0f0413aa00 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0959a700 1 -- 172.21.15.133:0/3376234617 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090235046 0 0) 0x7f0f00001490 con 0x7f0f040626f0 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0a59c700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 0x7f0f040a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f09d9b700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f04158000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0efc009760 tx=0x7f0efc009060).ready entity=mon.1 client_cookie=705a9c83d84a85a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0959a700 1 -- 172.21.15.133:0/3376234617 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0090d0 con 0x7f0f0413aa00 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0959a700 1 -- 172.21.15.133:0/3376234617 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc00f510 con 0x7f0f0413aa00 2024-01-21T20:15:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.151+0000 7f0f0959a700 1 -- 172.21.15.133:0/3376234617 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00f890 con 0x7f0f0413aa00 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 -- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 msgr2=0x7f0f04158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f04158000 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f0efc009760 tx=0x7f0efc009060).stop 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 -- 172.21.15.133:0/3376234617 shutdown_connections 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f0413a620 0x7f0f040a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3376234617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f04158000 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 -- 172.21.15.133:0/3376234617 >> 172.21.15.133:0/3376234617 conn(0x7f0f040c7dc0 msgr2=0x7f0f040c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 -- 172.21.15.133:0/3376234617 shutdown_connections 2024-01-21T20:15:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.152+0000 7f0f0c800700 1 -- 172.21.15.133:0/3376234617 wait complete. 2024-01-21T20:15:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.153+0000 7f0f0c800700 1 Processor -- start 2024-01-21T20:15:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.153+0000 7f0f0c800700 1 -- start start 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f040626f0 0x7f0f041398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f040a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040ad100 con 0x7f0f0413a620 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040acc70 con 0x7f0f0413aa00 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0c800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04139dd0 con 0x7f0f040626f0 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f09d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f09d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39148/0 (socket says 172.21.15.133:39148) 2024-01-21T20:15:14.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3785830402 learned_addr learned my addr 172.21.15.133:0/3785830402 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0a59c700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f040626f0 0x7f0f041398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.154+0000 7f0f0ad9d700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f040a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f040626f0 msgr2=0x7f0f041398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f040626f0 0x7f0f041398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 msgr2=0x7f0f040a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f040a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 -- 172.21.15.133:0/3785830402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef80092a0 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f09d9b700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f0efc009e00 tx=0x7f0efc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00f890 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc000d10 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc0092a0 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc00fea0 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.155+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f040ac340 con 0x7f0f0413a620 2024-01-21T20:15:14.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.156+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f040ace00 con 0x7f0f0413a620 2024-01-21T20:15:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.156+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0efc01b650 con 0x7f0f0413a620 2024-01-21T20:15:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.157+0000 7f0ef6ffd700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 0x7f0ee8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.157+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7f0efc07b750 con 0x7f0f0413a620 2024-01-21T20:15:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.157+0000 7f0f0a59c700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 0x7f0ee8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.157+0000 7f0f0a59c700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 0x7f0ee8061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0ef8009dc0 tx=0x7f0ef8009060).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:14.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.161+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0efc04c8a0 con 0x7f0f0413a620 2024-01-21T20:15:14.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:14.389+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f0f0405ead0 con 0x7f0f0413a620 2024-01-21T20:15:15.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.391+0000 7f0ef6ffd700 1 -- 172.21.15.133:0/3785830402 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v587) v1 ==== 166+0+0 (secure 0 0 0) 0x7f0efc0280e0 con 0x7f0f0413a620 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 msgr2=0x7f0ee8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 0x7f0ee8061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0ef8009dc0 tx=0x7f0ef8009060).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 msgr2=0x7f0f040a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f0efc009e00 tx=0x7f0efc017000).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 shutdown_connections 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ee805f150 0x7f0ee8061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f0413aa00 0x7f0f040a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f040626f0 0x7f0f041398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 --2- 172.21.15.133:0/3785830402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0413a620 0x7f0f040a99a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 >> 172.21.15.133:0/3785830402 conn(0x7f0f040c7dc0 msgr2=0x7f0f04065dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:15.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 shutdown_connections 2024-01-21T20:15:15.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.394+0000 7f0f0c800700 1 -- 172.21.15.133:0/3785830402 wait complete. 2024-01-21T20:15:15.398 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2024-01-21T20:15:15.398 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2024-01-21T20:15:15.398 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:15:15.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2024-01-21T20:15:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.530+0000 7ff21b2c8700 1 Processor -- start 2024-01-21T20:15:15.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.530+0000 7ff21b2c8700 1 -- start start 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff21b2c8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21413b970 0x7ff2140c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff21b2c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2140c39f0 0x7ff2140be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff21b2c8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2140bfa40 con 0x7ff2140be5f0 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff21b2c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2140c3e70 con 0x7ff2140c39f0 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff21b2c8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140bee30 con 0x7ff21413b970 2024-01-21T20:15:15.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff218863700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2140c39f0 0x7ff2140be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff218863700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2140c39f0 0x7ff2140be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39164/0 (socket says 172.21.15.133:39164) 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.531+0000 7ff218863700 1 -- 172.21.15.133:0/3444026611 learned_addr learned my addr 172.21.15.133:0/3444026611 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff219064700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21413b970 0x7ff2140c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff218863700 1 -- 172.21.15.133:0/3444026611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21413b970 msgr2=0x7ff2140c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff218863700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21413b970 0x7ff2140c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff218863700 1 -- 172.21.15.133:0/3444026611 >> v1:172.21.15.178:6789/0 conn(0x7ff2140be5f0 legacy=0x7ff2140c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff218863700 1 -- 172.21.15.133:0/3444026611 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140bf110 con 0x7ff2140c39f0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff218863700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2140c39f0 0x7ff2140be100 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7ff210006fd0 tx=0x7ff2100090f0).ready entity=mon.0 client_cookie=be75e348e164dea8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff20bfff700 1 -- 172.21.15.133:0/3444026611 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000b600 con 0x7ff2140c39f0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff20bfff700 1 -- 172.21.15.133:0/3444026611 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000b760 con 0x7ff2140c39f0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.532+0000 7ff20bfff700 1 -- 172.21.15.133:0/3444026611 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21000bb00 con 0x7ff2140c39f0 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 -- 172.21.15.133:0/3444026611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2140c39f0 msgr2=0x7ff2140be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2140c39f0 0x7ff2140be100 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7ff210006fd0 tx=0x7ff2100090f0).stop 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 -- 172.21.15.133:0/3444026611 shutdown_connections 2024-01-21T20:15:15.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21413b970 0x7ff2140c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/3444026611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2140c39f0 0x7ff2140be100 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 -- 172.21.15.133:0/3444026611 >> 172.21.15.133:0/3444026611 conn(0x7ff214066a70 msgr2=0x7ff214066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:15.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 -- 172.21.15.133:0/3444026611 shutdown_connections 2024-01-21T20:15:15.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.533+0000 7ff21b2c8700 1 -- 172.21.15.133:0/3444026611 wait complete. 2024-01-21T20:15:15.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.534+0000 7ff21b2c8700 1 Processor -- start 2024-01-21T20:15:15.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.534+0000 7ff21b2c8700 1 -- start start 2024-01-21T20:15:15.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2140be5f0 0x7ff214151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2140c39f0 0x7ff2140bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c2c40 con 0x7ff21413b970 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141353e0 con 0x7ff2140c39f0 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140c12e0 con 0x7ff2140be5f0 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39180/0 (socket says 172.21.15.133:39180) 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 -- 172.21.15.133:0/4264171313 learned_addr learned my addr 172.21.15.133:0/4264171313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219064700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2140be5f0 0x7ff214151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff218863700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2140c39f0 0x7ff2140bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 -- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2140be5f0 msgr2=0x7ff214151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2140be5f0 0x7ff214151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 -- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2140c39f0 msgr2=0x7ff2140bffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2140c39f0 0x7ff2140bffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 -- 172.21.15.133:0/4264171313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210009370 con 0x7ff21413b970 2024-01-21T20:15:15.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff219865700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7ff20c00c7c0 tx=0x7ff20c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00e4a0 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00e600 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2140c0a40 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.535+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00e980 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.536+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2140c1000 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.537+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff214135810 con 0x7ff21413b970 2024-01-21T20:15:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.537+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff20c012400 con 0x7ff21413b970 2024-01-21T20:15:15.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.537+0000 7ff209f76700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 0x7ff1f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:15.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.537+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7ff20c079910 con 0x7ff21413b970 2024-01-21T20:15:15.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.538+0000 7ff219064700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 0x7ff1f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:15.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.538+0000 7ff219064700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 0x7ff1f8061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff20400bbc0 tx=0x7ff204008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:15.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.541+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff20c048b00 con 0x7ff21413b970 2024-01-21T20:15:15.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:15.772+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7ff2140bf3f0 con 0x7ff21413b970 2024-01-21T20:15:16.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.396+0000 7ff209f76700 1 -- 172.21.15.133:0/4264171313 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v588) v1 ==== 186+0+0 (secure 0 0 0) 0x7ff20c017070 con 0x7ff21413b970 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 msgr2=0x7ff1f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 0x7ff1f8061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff20400bbc0 tx=0x7ff204008040).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 msgr2=0x7ff2140c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7ff20c00c7c0 tx=0x7ff20c001510).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 shutdown_connections 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff1f805f150 0x7ff1f8061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff21413b970 0x7ff2140c0490 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2140be5f0 0x7ff214151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 --2- 172.21.15.133:0/4264171313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2140c39f0 0x7ff2140bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 >> 172.21.15.133:0/4264171313 conn(0x7ff214066a70 msgr2=0x7ff214154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:16.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 shutdown_connections 2024-01-21T20:15:16.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.398+0000 7ff21b2c8700 1 -- 172.21.15.133:0/4264171313 wait complete. 2024-01-21T20:15:16.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:15:16.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.530+0000 7f65894b3700 1 Processor -- start 2024-01-21T20:15:16.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 -- start start 2024-01-21T20:15:16.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 0x7f6584158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6584154520 0x7f65840ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65840ab620 con 0x7f65840c6090 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65840c6ae0 con 0x7f6584154520 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.531+0000 7f65894b3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65840c05e0 con 0x7f6584154140 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6584154520 0x7f65840ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65837fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f65840c6090 0x7f65840c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46396/0 (socket says 172.21.15.133:46396) 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6584154520 0x7f65840ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39184/0 (socket says 172.21.15.133:39184) 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65837fe700 1 -- 172.21.15.133:0/3709162327 learned_addr learned my addr 172.21.15.133:0/3709162327 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6582ffd700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 0x7f6584158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 -- 172.21.15.133:0/3709162327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 msgr2=0x7f6584158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 0x7f6584158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 -- 172.21.15.133:0/3709162327 >> v1:172.21.15.133:6789/0 conn(0x7f65840c6090 legacy=0x7f65840c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6581ffb700 1 -- 172.21.15.133:0/3709162327 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257576736 0 0) 0x7f65840ab620 con 0x7f65840c6090 2024-01-21T20:15:16.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 -- 172.21.15.133:0/3709162327 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840c0e40 con 0x7f6584154520 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6582ffd700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 0x7f6584158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f65827fc700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65840ab130 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6574009760 tx=0x7f6574009060).ready entity=mon.0 client_cookie=dec5811a762b5628 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6581ffb700 1 -- 172.21.15.133:0/3709162327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400b580 con 0x7f6584154520 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6581ffb700 1 -- 172.21.15.133:0/3709162327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400b6e0 con 0x7f6584154520 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.532+0000 7f6581ffb700 1 -- 172.21.15.133:0/3709162327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400ba60 con 0x7f6584154520 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 -- 172.21.15.133:0/3709162327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 msgr2=0x7f65840ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65840ab130 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f6574009760 tx=0x7f6574009060).stop 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 -- 172.21.15.133:0/3709162327 shutdown_connections 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6584154140 0x7f6584158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 --2- 172.21.15.133:0/3709162327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65840ab130 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 -- 172.21.15.133:0/3709162327 >> 172.21.15.133:0/3709162327 conn(0x7f658405e1e0 msgr2=0x7f658405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 -- 172.21.15.133:0/3709162327 shutdown_connections 2024-01-21T20:15:16.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.533+0000 7f65894b3700 1 -- 172.21.15.133:0/3709162327 wait complete. 2024-01-21T20:15:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.534+0000 7f65894b3700 1 Processor -- start 2024-01-21T20:15:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.534+0000 7f65894b3700 1 -- start start 2024-01-21T20:15:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 0x7f6584155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6584154140 0x7f6584156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6584158420 con 0x7f6584154520 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65841575e0 con 0x7f6584154140 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65894b3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6584154c50 con 0x7f65840c6090 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39192/0 (socket says 172.21.15.133:39192) 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 -- 172.21.15.133:0/4079570890 learned_addr learned my addr 172.21.15.133:0/4079570890 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65827fc700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6584154140 0x7f6584156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f6582ffd700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 0x7f6584155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 -- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 msgr2=0x7f6584155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 0x7f6584155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 -- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6584154140 msgr2=0x7f6584156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6584154140 0x7f6584156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 -- 172.21.15.133:0/4079570890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740092a0 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f6582ffd700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 0x7f6584155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.535+0000 7f65837fe700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f657c00c7e0 tx=0x7f657c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.536+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c005d30 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.536+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c005e90 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.536+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c007340 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.536+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6584154f30 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.536+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65841557d0 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.537+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6584155330 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.537+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f657c007730 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.537+0000 7f656b7fe700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 0x7f6570061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.537+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7f657c07a2e0 con 0x7f6584154520 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.537+0000 7f6582ffd700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 0x7f6570061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.538+0000 7f6582ffd700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 0x7f6570061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6578008990 tx=0x7f6578008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.541+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f657c04b490 con 0x7f6584154520 2024-01-21T20:15:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.706+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f65841559f0 con 0x7f6584154520 2024-01-21T20:15:16.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.710+0000 7f656b7fe700 1 -- 172.21.15.133:0/4079570890 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f657c001650 con 0x7f6584154520 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 msgr2=0x7f6570061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 0x7f6570061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6578008990 tx=0x7f6578008040).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 msgr2=0x7f65841570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f657c00c7e0 tx=0x7f657c007f90).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 shutdown_connections 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f657005f150 0x7f6570061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6584154520 0x7f65841570f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65840c6090 0x7f6584155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 --2- 172.21.15.133:0/4079570890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6584154140 0x7f6584156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 >> 172.21.15.133:0/4079570890 conn(0x7f658405e1e0 msgr2=0x7f65840c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:16.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 shutdown_connections 2024-01-21T20:15:16.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.712+0000 7f65894b3700 1 -- 172.21.15.133:0/4079570890 wait complete. 2024-01-21T20:15:16.713 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:15:16.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:15:16.757 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:15:16.799 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:15:16.799 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:15:16.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:16.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.925+0000 7fcae4291700 1 Processor -- start 2024-01-21T20:15:16.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.925+0000 7fcae4291700 1 -- start start 2024-01-21T20:15:16.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.926+0000 7fcae4291700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcadc0bcf10 0x7fcadc0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.926+0000 7fcae4291700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc0c5ce0 0x7fcadc0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.926+0000 7fcae4291700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc14ee20 con 0x7fcadc14ea40 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.926+0000 7fcae4291700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0bed10 con 0x7fcadc0bcf10 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.926+0000 7fcae4291700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c6620 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcadc0bcf10 0x7fcadc0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcadc0bcf10 0x7fcadc0c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39208/0 (socket says 172.21.15.133:39208) 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 -- 172.21.15.133:0/3383134185 learned_addr learned my addr 172.21.15.133:0/3383134185 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae282e700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc0c5ce0 0x7fcadc0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 -- 172.21.15.133:0/3383134185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc0c5ce0 msgr2=0x7fcadc0c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc0c5ce0 0x7fcadc0c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 -- 172.21.15.133:0/3383134185 >> v1:172.21.15.178:6789/0 conn(0x7fcadc14ea40 legacy=0x7fcadc0630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 -- 172.21.15.133:0/3383134185 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0bea30 con 0x7fcadc0bcf10 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae182c700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0bcf10 0x7fcadc0c77e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fcad8006fd0 tx=0x7fcad80090f0).ready entity=mon.0 client_cookie=43bb04784759fec2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae102b700 1 -- 172.21.15.133:0/3383134185 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800b600 con 0x7fcadc0bcf10 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae102b700 1 -- 172.21.15.133:0/3383134185 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800b760 con 0x7fcadc0bcf10 2024-01-21T20:15:16.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.927+0000 7fcae102b700 1 -- 172.21.15.133:0/3383134185 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800bb00 con 0x7fcadc0bcf10 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 -- 172.21.15.133:0/3383134185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0bcf10 msgr2=0x7fcadc0c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0bcf10 0x7fcadc0c77e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fcad8006fd0 tx=0x7fcad80090f0).stop 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 -- 172.21.15.133:0/3383134185 shutdown_connections 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc0c5ce0 0x7fcadc0c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 --2- 172.21.15.133:0/3383134185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0bcf10 0x7fcadc0c77e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 -- 172.21.15.133:0/3383134185 >> 172.21.15.133:0/3383134185 conn(0x7fcadc0c7de0 msgr2=0x7fcadc0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 -- 172.21.15.133:0/3383134185 shutdown_connections 2024-01-21T20:15:16.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.928+0000 7fcae4291700 1 -- 172.21.15.133:0/3383134185 wait complete. 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.929+0000 7fcae4291700 1 Processor -- start 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.929+0000 7fcae4291700 1 -- start start 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 0x7fcadc14ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc14ea40 0x7fcadc0bfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c00b0 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0ac980 con 0x7fcadc0bcf10 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c2110 con 0x7fcadc14ea40 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39220/0 (socket says 172.21.15.133:39220) 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 -- 172.21.15.133:0/3477077078 learned_addr learned my addr 172.21.15.133:0/3477077078 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae282e700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc14ea40 0x7fcadc0bfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae202d700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 0x7fcadc14ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 -- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc14ea40 msgr2=0x7fcadc0bfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc14ea40 0x7fcadc0bfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 -- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 msgr2=0x7fcadc14ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 0x7fcadc14ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 -- 172.21.15.133:0/3477077078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8009370 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae202d700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 0x7fcadc14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae182c700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fcadc0be3b0 tx=0x7fcad8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad800b8d0 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad800ba30 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcadc0c02b0 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad801c670 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.930+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0ac610 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.931+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcadc0c07d0 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.932+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcad801caa0 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.932+0000 7fcacef78700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 0x7fcac0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.932+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6412+0+0 (secure 0 0 0) 0x7fcad807c520 con 0x7fcadc0c5ce0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.932+0000 7fcae202d700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 0x7fcac0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:16.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.933+0000 7fcae202d700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 0x7fcac0061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fcad0000c00 tx=0x7fcad0009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:16.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:16.936+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcadc0c07d0 con 0x7fcadc0c5ce0 2024-01-21T20:15:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.139+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcadc0c07d0 con 0x7fcadc0c5ce0 2024-01-21T20:15:17.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.139+0000 7fcacef78700 1 -- 172.21.15.133:0/3477077078 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fcadc0c07d0 con 0x7fcadc0c5ce0 2024-01-21T20:15:17.129 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:17.129 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1594519306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1594519306},{"type":"v1","addr":"172.21.15.178:6834","nonce":1594519306}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6133,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2787240961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2787240961},{"type":"v1","addr":"172.21.15.178:6835","nonce":2787240961}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2546331544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2546331544},{"type":"v1","addr":"172.21.15.133:6837","nonce":2546331544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7056,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/3548761228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3548761228},{"type":"v1","addr":"172.21.15.133:6836","nonce":3548761228}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[]} 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 msgr2=0x7fcac0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 0x7fcac0061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fcad0000c00 tx=0x7fcad0009040).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 msgr2=0x7fcadc0bf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fcadc0be3b0 tx=0x7fcad8017000).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 shutdown_connections 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcac005f150 0x7fcac0061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcadc14ea40 0x7fcadc0bfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcadc0bcf10 0x7fcadc14ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 --2- 172.21.15.133:0/3477077078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcadc0c5ce0 0x7fcadc0bf6d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 >> 172.21.15.133:0/3477077078 conn(0x7fcadc0c7de0 msgr2=0x7fcadc154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 shutdown_connections 2024-01-21T20:15:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.141+0000 7fcae4291700 1 -- 172.21.15.133:0/3477077078 wait complete. 2024-01-21T20:15:17.132 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 32 2024-01-21T20:15:17.143 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:15:17.143 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:15:17.143 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:15:17.143 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:15:17.143 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:15:17.143 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:15:17.144 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:15:17.144 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:15:17.144 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:15:17.144 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:15:17.144 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:15:17.144 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:15:17.144 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:15:17.145 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:15:17.145 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:15:17.145 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:15:17.152 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:15:17.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:15:17.153 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:15:17.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:15:17.155 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:15:17.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:15:17.156 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:15:17.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:15:17.194 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:15:17.194 DEBUG:teuthology.parallel:result is None 2024-01-21T20:15:17.195 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:15:17.195 DEBUG:teuthology.parallel:result is None 2024-01-21T20:15:17.199 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:15:17.199 DEBUG:teuthology.parallel:result is None 2024-01-21T20:15:17.199 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:15:17.200 DEBUG:teuthology.parallel:result is None 2024-01-21T20:15:17.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:15:17.269 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:15:17.270 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:15:17.281 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:15:17.281 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:15:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.338+0000 7f3d3404e700 1 Processor -- start 2024-01-21T20:15:17.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 -- start start 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0ab620 con 0x7f3d2c154140 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c6ae0 con 0x7f3d2c0c8120 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.339+0000 7f3d3404e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0c05e0 con 0x7f3d2c154520 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d315e9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:42176/0 (socket says 172.21.15.133:42176) 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d31dea700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3d2c154140 0x7f3d2c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:58104/0 (socket says 172.21.15.133:58104) 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d315e9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:48438/0 (socket says 172.21.15.133:48438) 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d31dea700 1 -- 172.21.15.133:0/3058507104 learned_addr learned my addr 172.21.15.133:0/3058507104 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:17.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 -- 172.21.15.133:0/3058507104 >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 msgr2=0x7f3d2c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 --2- 172.21.15.133:0/3058507104 >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 -- 172.21.15.133:0/3058507104 >> v1:172.21.15.178:6789/0 conn(0x7f3d2c154140 legacy=0x7f3d2c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 -- 172.21.15.133:0/3058507104 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0c0e40 con 0x7f3d2c154520 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d315e9700 1 --2- 172.21.15.133:0/3058507104 >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d325eb700 1 --2- 172.21.15.133:0/3058507104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3d24009e60 tx=0x7f3d24009780).ready entity=mon.2 client_cookie=2fef0de1af351c26 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d30de8700 1 -- 172.21.15.133:0/3058507104 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400e070 con 0x7f3d2c154520 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d30de8700 1 -- 172.21.15.133:0/3058507104 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2400bb60 con 0x7f3d2c154520 2024-01-21T20:15:17.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.340+0000 7f3d30de8700 1 -- 172.21.15.133:0/3058507104 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24012410 con 0x7f3d2c154520 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 -- 172.21.15.133:0/3058507104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 msgr2=0x7f3d2c0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3058507104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f3d24009e60 tx=0x7f3d24009780).stop 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 -- 172.21.15.133:0/3058507104 shutdown_connections 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3058507104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c154520 0x7f3d2c0ab130 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3058507104 >> v2:172.21.15.178:3300/0 conn(0x7f3d2c0c8120 0x7f3d2c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 -- 172.21.15.133:0/3058507104 >> 172.21.15.133:0/3058507104 conn(0x7f3d2c05e1e0 msgr2=0x7f3d2c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 -- 172.21.15.133:0/3058507104 shutdown_connections 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.341+0000 7f3d3404e700 1 -- 172.21.15.133:0/3058507104 wait complete. 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.342+0000 7f3d3404e700 1 Processor -- start 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.342+0000 7f3d3404e700 1 -- start start 2024-01-21T20:15:17.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 0x7f3d2c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 0x7f3d2c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0aea10 con 0x7f3d2c154520 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c14ff60 con 0x7f3d2c154140 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d3404e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0ca6f0 con 0x7f3d2c0c8120 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d31dea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 0x7f3d2c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d315e9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 0x7f3d2c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d31dea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:42192/0 (socket says 172.21.15.133:42192) 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d31dea700 1 -- 172.21.15.133:0/3876793017 learned_addr learned my addr 172.21.15.133:0/3876793017 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 -- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 msgr2=0x7f3d2c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 -- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 msgr2=0x7f3d2c0c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:17.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 0x7f3d2c0c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d325eb700 1 -- 172.21.15.133:0/3876793017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d280092a0 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d31dea700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.343+0000 7f3d315e9700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 0x7f3d2c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d325eb700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 0x7f3d2c0cb300 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f3d24014000 tx=0x7f3d2c0c0db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24012410 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2401d630 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d24009a20 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2401d9f0 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.344+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0ae350 con 0x7f3d2c154520 2024-01-21T20:15:17.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.345+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c05fdf0 con 0x7f3d2c154520 2024-01-21T20:15:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.345+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3d24003040 con 0x7f3d2c154520 2024-01-21T20:15:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.345+0000 7f3d227fc700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 0x7f3d10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.345+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6412+0+0 (secure 0 0 0) 0x7f3d2407c080 con 0x7f3d2c154520 2024-01-21T20:15:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.345+0000 7f3d31dea700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 0x7f3d10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:17.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.346+0000 7f3d31dea700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 0x7f3d10061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3d2c0adad0 tx=0x7f3d1c009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:17.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.350+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3d2404d230 con 0x7f3d2c154520 2024-01-21T20:15:17.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:17.530+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3d2c0c00f0 con 0x7f3d2c154520 2024-01-21T20:15:17.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:15:17.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:15:18.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.410+0000 7f3d227fc700 1 -- 172.21.15.133:0/3876793017 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v104) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3d24050850 con 0x7f3d2c154520 2024-01-21T20:15:18.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.412+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 msgr2=0x7f3d10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.412+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 0x7f3d10061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f3d2c0adad0 tx=0x7f3d1c009040).stop 2024-01-21T20:15:18.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.412+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 msgr2=0x7f3d2c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.412+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 0x7f3d2c0cb300 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f3d24014000 tx=0x7f3d2c0c0db0).stop 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 shutdown_connections 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3d1005f150 0x7f3d10061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d2c154520 0x7f3d2c0cb300 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d2c0c8120 0x7f3d2c1449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 --2- 172.21.15.133:0/3876793017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d2c154140 0x7f3d2c0c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 >> 172.21.15.133:0/3876793017 conn(0x7f3d2c05e1e0 msgr2=0x7f3d2c0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 shutdown_connections 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.413+0000 7f3d3404e700 1 -- 172.21.15.133:0/3876793017 wait complete. 2024-01-21T20:15:18.403 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:15:18.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:15:18.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.549+0000 7f96dc196700 1 Processor -- start 2024-01-21T20:15:18.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.549+0000 7f96dc196700 1 -- start start 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96dc196700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96d40be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96dc196700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d40c61a0 con 0x7f96d4155cb0 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96dc196700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d40c5350 con 0x7f96d41351d0 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96dc196700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40c55d0 con 0x7f96d4156160 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d9731700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f96d4155cb0 0x7f96d40bde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46412/0 (socket says 172.21.15.133:46412) 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d9731700 1 -- 172.21.15.133:0/3806729722 learned_addr learned my addr 172.21.15.133:0/3806729722 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:18.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273413614 0 0) 0x7f96d40c61a0 con 0x7f96d4155cb0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c00033f0 con 0x7f96d4155cb0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96da733700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96d40be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697208493 0 0) 0x7f96c00033f0 con 0x7f96d4155cb0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 msgr2=0x7f96d40be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96d40be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 >> v1:172.21.15.178:6789/0 conn(0x7f96d41351d0 legacy=0x7f96d40c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d41565f0 con 0x7f96d4155cb0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f96c4001470 con 0x7f96d4155cb0 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 >> v1:172.21.15.133:6789/0 conn(0x7f96d4155cb0 legacy=0x7f96d40bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.550+0000 7f96d8f30700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c0003910 0x7f96c0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96c00050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40c55d0 con 0x7f96c0004690 2024-01-21T20:15:18.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c000b9c0 con 0x7f96c0003910 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c000bb80 con 0x7f96d4156160 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96da733700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96c00050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9f32700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c0003910 0x7f96c0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 -- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 msgr2=0x7f96c00050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d4156160 0x7f96c00050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 -- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c0003910 msgr2=0x7f96c0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c0003910 0x7f96c0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 -- 172.21.15.133:0/3806729722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c00033f0 con 0x7f96c0004690 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9f32700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c0003910 0x7f96c0003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d9731700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96c0004b10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f96c400c190 tx=0x7f96c4001e50).ready entity=mon.0 client_cookie=db3ad241f89bfe71 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4007a20 con 0x7f96c0004690 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c400cac0 con 0x7f96c0004690 2024-01-21T20:15:18.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.551+0000 7f96d8f30700 1 -- 172.21.15.133:0/3806729722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c400ce40 con 0x7f96c0004690 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 -- 172.21.15.133:0/3806729722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 msgr2=0x7f96c0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 --2- 172.21.15.133:0/3806729722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96c0004b10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f96c400c190 tx=0x7f96c4001e50).stop 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96da733700 1 -- 172.21.15.133:0/3806729722 reap_dead start 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 -- 172.21.15.133:0/3806729722 shutdown_connections 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 -- 172.21.15.133:0/3806729722 >> 172.21.15.133:0/3806729722 conn(0x7f96d4066a90 msgr2=0x7f96d4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 -- 172.21.15.133:0/3806729722 shutdown_connections 2024-01-21T20:15:18.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.552+0000 7f96dc196700 1 -- 172.21.15.133:0/3806729722 wait complete. 2024-01-21T20:15:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.553+0000 7f96dc196700 1 Processor -- start 2024-01-21T20:15:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.553+0000 7f96dc196700 1 -- start start 2024-01-21T20:15:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d40bffa0 0x7f96d4165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96d4165d70 0x7f96d40c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4162240 con 0x7f96c0004690 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40c74f0 con 0x7f96d4165d70 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96dc196700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40c9730 con 0x7f96d40bffa0 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96d9f32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96d9f32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39294/0 (socket says 172.21.15.133:39294) 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.554+0000 7f96d9f32700 1 -- 172.21.15.133:0/2268551676 learned_addr learned my addr 172.21.15.133:0/2268551676 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9731700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d40bffa0 0x7f96d4165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96da733700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96d4165d70 0x7f96d40c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 -- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d40bffa0 msgr2=0x7f96d4165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d40bffa0 0x7f96d4165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 -- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96d4165d70 msgr2=0x7f96d40c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96d4165d70 0x7f96d40c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 -- 172.21.15.133:0/2268551676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d41661d0 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96d9f32700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f96d000e610 tx=0x7f96d0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d000eec0 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0010450 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d40c0420 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00107d0 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.555+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d414dec0 con 0x7f96c0004690 2024-01-21T20:15:18.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.556+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d414e8b0 con 0x7f96c0004690 2024-01-21T20:15:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.557+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f96d0010b80 con 0x7f96c0004690 2024-01-21T20:15:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.557+0000 7f96ca7fc700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 0x7f96b8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.557+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f96d007a000 con 0x7f96c0004690 2024-01-21T20:15:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.557+0000 7f96d9731700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 0x7f96b8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.557+0000 7f96d9731700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 0x7f96b8061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f96c4001e90 tx=0x7f96c4015000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.561+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96d004b380 con 0x7f96c0004690 2024-01-21T20:15:18.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.788+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f96d40c5870 con 0x7f96c0004690 2024-01-21T20:15:18.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.788+0000 7f96ca7fc700 1 -- 172.21.15.133:0/2268551676 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f96d004e9a0 con 0x7f96c0004690 2024-01-21T20:15:18.778 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:18.778 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:15:18.778 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:15:18.778 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.779 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.780 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:15:18.781 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.782 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.783 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.784 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.785 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.786 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.787 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:15:18.788 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:15:18.789 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:15:18.790 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:15:18.791 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 msgr2=0x7f96b8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 0x7f96b8061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f96c4001e90 tx=0x7f96c4015000).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 msgr2=0x7f96d40c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f96d000e610 tx=0x7f96d0009040).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 shutdown_connections 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96b805f150 0x7f96b8061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96d4165d70 0x7f96d40c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c0004690 0x7f96d40c7000 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 --2- 172.21.15.133:0/2268551676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96d40bffa0 0x7f96d4165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 >> 172.21.15.133:0/2268551676 conn(0x7f96d4066a90 msgr2=0x7f96d4139fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 shutdown_connections 2024-01-21T20:15:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.790+0000 7f96dc196700 1 -- 172.21.15.133:0/2268551676 wait complete. 2024-01-21T20:15:18.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:18.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.920+0000 7f8e8895a700 1 Processor -- start 2024-01-21T20:15:18.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.920+0000 7f8e8895a700 1 -- start start 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8895a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e84067d90 0x7f8e84137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8895a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e840c5930 0x7f8e840c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8895a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e840c62b0 con 0x7f8e84137030 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8895a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e84068370 con 0x7f8e840c5930 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8895a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84068650 con 0x7f8e84067d90 2024-01-21T20:15:18.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e82d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e840c5930 0x7f8e840c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e84137030 0x7f8e84155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46416/0 (socket says 172.21.15.133:46416) 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e82d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e840c5930 0x7f8e840c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39300/0 (socket says 172.21.15.133:39300) 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e8259c700 1 -- 172.21.15.133:0/2330166318 learned_addr learned my addr 172.21.15.133:0/2330166318 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.921+0000 7f8e81d9b700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e84067d90 0x7f8e84137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e82d9d700 1 -- 172.21.15.133:0/2330166318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e84067d90 msgr2=0x7f8e84137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e82d9d700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e84067d90 0x7f8e84137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e82d9d700 1 -- 172.21.15.133:0/2330166318 >> v1:172.21.15.133:6789/0 conn(0x7f8e84137030 legacy=0x7f8e84155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8159a700 1 -- 172.21.15.133:0/2330166318 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477444848 0 0) 0x7f8e840c62b0 con 0x7f8e84137030 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e82d9d700 1 -- 172.21.15.133:0/2330166318 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84068930 con 0x7f8e840c5930 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e82d9d700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e840c5930 0x7f8e840c5dc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f8e7c009e60 tx=0x7f8e7c009780).ready entity=mon.0 client_cookie=7388dd496ece5280 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8159a700 1 -- 172.21.15.133:0/2330166318 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00e070 con 0x7f8e840c5930 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8159a700 1 -- 172.21.15.133:0/2330166318 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00bb60 con 0x7f8e840c5930 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8159a700 1 -- 172.21.15.133:0/2330166318 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c012410 con 0x7f8e840c5930 2024-01-21T20:15:18.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8895a700 1 -- 172.21.15.133:0/2330166318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e840c5930 msgr2=0x7f8e840c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.922+0000 7f8e8895a700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e840c5930 0x7f8e840c5dc0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f8e7c009e60 tx=0x7f8e7c009780).stop 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 -- 172.21.15.133:0/2330166318 shutdown_connections 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e840c5930 0x7f8e840c5dc0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 --2- 172.21.15.133:0/2330166318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e84067d90 0x7f8e84137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 -- 172.21.15.133:0/2330166318 >> 172.21.15.133:0/2330166318 conn(0x7f8e84066a90 msgr2=0x7f8e84066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 -- 172.21.15.133:0/2330166318 shutdown_connections 2024-01-21T20:15:18.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.923+0000 7f8e8895a700 1 -- 172.21.15.133:0/2330166318 wait complete. 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.924+0000 7f8e8895a700 1 Processor -- start 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.924+0000 7f8e8895a700 1 -- start start 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 0x7f8e840c0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e840c5930 0x7f8e84155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840c0810 con 0x7f8e84137030 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84155600 con 0x7f8e84067d90 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840c1800 con 0x7f8e840c5930 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39312/0 (socket says 172.21.15.133:39312) 2024-01-21T20:15:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 -- 172.21.15.133:0/362378664 learned_addr learned my addr 172.21.15.133:0/362378664 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e81d9b700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e840c5930 0x7f8e84155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8259c700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 0x7f8e840c0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 -- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e840c5930 msgr2=0x7f8e84155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e840c5930 0x7f8e84155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 -- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 msgr2=0x7f8e840c0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 0x7f8e840c0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 -- 172.21.15.133:0/362378664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c009a20 con 0x7f8e84137030 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8259c700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 0x7f8e840c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e82d9d700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f8e7c00b6c0 tx=0x7f8e7c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c01d630 con 0x7f8e84137030 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c01d790 con 0x7f8e84137030 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e840c1ae0 con 0x7f8e84137030 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c01db50 con 0x7f8e84137030 2024-01-21T20:15:18.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.925+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e840c20a0 con 0x7f8e84137030 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.927+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e840c32d0 con 0x7f8e84137030 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.927+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8e7c003040 con 0x7f8e84137030 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.927+0000 7f8e72ffd700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 0x7f8e64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.927+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8e7c07bfa0 con 0x7f8e84137030 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.927+0000 7f8e8259c700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 0x7f8e64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:18.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.928+0000 7f8e8259c700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 0x7f8e64061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8e740016f0 tx=0x7f8e74009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:18.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:18.931+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e7c04d420 con 0x7f8e84137030 2024-01-21T20:15:19.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.096+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e840c67b0 con 0x7f8e84137030 2024-01-21T20:15:19.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.097+0000 7f8e72ffd700 1 -- 172.21.15.133:0/362378664 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+14646 (secure 0 0 0) 0x7f8e7c050a40 con 0x7f8e84137030 2024-01-21T20:15:19.086 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:19.086 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":104,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:18.397364+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 msgr2=0x7f8e64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 0x7f8e64061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f8e740016f0 tx=0x7f8e74009040).stop 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 msgr2=0x7f8e840ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f8e7c00b6c0 tx=0x7f8e7c009780).stop 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 shutdown_connections 2024-01-21T20:15:19.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e6405f150 0x7f8e64061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e84137030 0x7f8e840ae7d0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e84067d90 0x7f8e840c0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 --2- 172.21.15.133:0/362378664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e840c5930 0x7f8e84155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.098+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 >> 172.21.15.133:0/362378664 conn(0x7f8e84066a90 msgr2=0x7f8e840c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.099+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 shutdown_connections 2024-01-21T20:15:19.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.099+0000 7f8e8895a700 1 -- 172.21.15.133:0/362378664 wait complete. 2024-01-21T20:15:19.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:15:19.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:15:19.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.229+0000 7f5090ff2700 1 Processor -- start 2024-01-21T20:15:19.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.229+0000 7f5090ff2700 1 -- start start 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.229+0000 7f5090ff2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f508c1542e0 0x7f508c0a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.229+0000 7f5090ff2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f508c066310 0x7f508c0a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.229+0000 7f5090ff2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c0c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5090ff2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c0a77f0 con 0x7f508c066310 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5090ff2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c0c50c0 con 0x7f508c1542e0 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5090ff2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c066810 con 0x7f508c0c4720 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f508c066310 0x7f508c0a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f508c066310 0x7f508c0a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39328/0 (socket says 172.21.15.133:39328) 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 -- 172.21.15.133:0/696252713 learned_addr learned my addr 172.21.15.133:0/696252713 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f508ad9d700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c0c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 -- 172.21.15.133:0/696252713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 msgr2=0x7f508c0c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c0c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f508a59c700 1 --2- 172.21.15.133:0/696252713 >> v2:172.21.15.178:3300/0 conn(0x7f508c1542e0 0x7f508c0a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 -- 172.21.15.133:0/696252713 >> v2:172.21.15.178:3300/0 conn(0x7f508c1542e0 msgr2=0x7f508c0a7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 --2- 172.21.15.133:0/696252713 >> v2:172.21.15.178:3300/0 conn(0x7f508c1542e0 0x7f508c0a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 -- 172.21.15.133:0/696252713 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c066af0 con 0x7f508c066310 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f5089d9b700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c066310 0x7f508c0a69f0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f508c0679c0 tx=0x7f507c0090f0).ready entity=mon.0 client_cookie=8d3b6c873bb8d06f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f508959a700 1 -- 172.21.15.133:0/696252713 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00b600 con 0x7f508c066310 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f508959a700 1 -- 172.21.15.133:0/696252713 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c00b760 con 0x7f508c066310 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.230+0000 7f508959a700 1 -- 172.21.15.133:0/696252713 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00bb00 con 0x7f508c066310 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 -- 172.21.15.133:0/696252713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c066310 msgr2=0x7f508c0a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c066310 0x7f508c0a69f0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f508c0679c0 tx=0x7f507c0090f0).stop 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 -- 172.21.15.133:0/696252713 shutdown_connections 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c0c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 --2- 172.21.15.133:0/696252713 >> v2:172.21.15.178:3300/0 conn(0x7f508c1542e0 0x7f508c0a7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 --2- 172.21.15.133:0/696252713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c066310 0x7f508c0a69f0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 -- 172.21.15.133:0/696252713 >> 172.21.15.133:0/696252713 conn(0x7f508c065920 msgr2=0x7f508c0c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 -- 172.21.15.133:0/696252713 shutdown_connections 2024-01-21T20:15:19.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.231+0000 7f5090ff2700 1 -- 172.21.15.133:0/696252713 wait complete. 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.232+0000 7f5090ff2700 1 Processor -- start 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.232+0000 7f5090ff2700 1 -- start start 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f508c066310 0x7f508c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0abdc0 con 0x7f508c1542e0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0ac940 con 0x7f508c066310 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5090ff2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c154bb0 con 0x7f508c0c4720 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f508ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f508ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39338/0 (socket says 172.21.15.133:39338) 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f508ad9d700 1 -- 172.21.15.133:0/3545136415 learned_addr learned my addr 172.21.15.133:0/3545136415 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f5089d9b700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.233+0000 7f508a59c700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f508c066310 0x7f508c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 -- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 msgr2=0x7f508c1546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c1546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 -- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f508c066310 msgr2=0x7f508c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f508c066310 0x7f508c157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 -- 172.21.15.133:0/3545136415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c009370 con 0x7f508c1542e0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f508ad9d700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f508400ceb0 tx=0x7f5084007870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400ad90 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084016400 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084016780 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c0ac010 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.234+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c0ac5d0 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.235+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c05fdf0 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.236+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5084009030 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.236+0000 7f5082ffd700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 0x7f506c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.236+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f508407a790 con 0x7f508c1542e0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.236+0000 7f508a59c700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 0x7f506c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.236+0000 7f508a59c700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 0x7f506c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f507400ab00 tx=0x7f5074006f90).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.240+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f508404bb70 con 0x7f508c1542e0 2024-01-21T20:15:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.401+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f508c0c3da0 con 0x7f508c1542e0 2024-01-21T20:15:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.402+0000 7f5082ffd700 1 -- 172.21.15.133:0/3545136415 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v104) v1 ==== 110+0+10 (secure 0 0 0) 0x7f508404f190 con 0x7f508c1542e0 2024-01-21T20:15:19.391 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 msgr2=0x7f506c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 0x7f506c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f507400ab00 tx=0x7f5074006f90).stop 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 msgr2=0x7f508c143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7f508400ceb0 tx=0x7f5084007870).stop 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 shutdown_connections 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f506c05f150 0x7f506c061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f508c1542e0 0x7f508c143fd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f508c066310 0x7f508c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 --2- 172.21.15.133:0/3545136415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f508c0c4720 0x7f508c1546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 >> 172.21.15.133:0/3545136415 conn(0x7f508c065920 msgr2=0x7f508c0a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 shutdown_connections 2024-01-21T20:15:19.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.403+0000 7f5090ff2700 1 -- 172.21.15.133:0/3545136415 wait complete. 2024-01-21T20:15:19.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:15:19.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.534+0000 7f5b729a2700 1 Processor -- start 2024-01-21T20:15:19.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.534+0000 7f5b729a2700 1 -- start start 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.534+0000 7f5b729a2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 0x7f5b6c067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b729a2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b729a2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c0c62d0 con 0x7f5b6c137410 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b729a2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c068370 con 0x7f5b6c0c5930 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b729a2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c068650 con 0x7f5b6c137030 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39342/0 (socket says 172.21.15.133:39342) 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 -- 172.21.15.133:0/1940799186 learned_addr learned my addr 172.21.15.133:0/1940799186 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b6bfff700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 0x7f5b6c067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 -- 172.21.15.133:0/1940799186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 msgr2=0x7f5b6c067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 0x7f5b6c067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 -- 172.21.15.133:0/1940799186 >> v1:172.21.15.178:6789/0 conn(0x7f5b6c137410 legacy=0x7f5b6c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 -- 172.21.15.133:0/1940799186 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c068930 con 0x7f5b6c0c5930 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b6bfff700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 0x7f5b6c067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b70f3f700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f5b64009f20 tx=0x7f5b64009840).ready entity=mon.0 client_cookie=4c82b5b000c2e9f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b6b7fe700 1 -- 172.21.15.133:0/1940799186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400e070 con 0x7f5b6c0c5930 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b6b7fe700 1 -- 172.21.15.133:0/1940799186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6400ba80 con 0x7f5b6c0c5930 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.535+0000 7f5b6b7fe700 1 -- 172.21.15.133:0/1940799186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400be00 con 0x7f5b6c0c5930 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 -- 172.21.15.133:0/1940799186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c0c5930 msgr2=0x7f5b6c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f5b64009f20 tx=0x7f5b64009840).stop 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 -- 172.21.15.133:0/1940799186 shutdown_connections 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c0c5de0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1940799186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137030 0x7f5b6c067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 -- 172.21.15.133:0/1940799186 >> 172.21.15.133:0/1940799186 conn(0x7f5b6c066a90 msgr2=0x7f5b6c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 -- 172.21.15.133:0/1940799186 shutdown_connections 2024-01-21T20:15:19.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.536+0000 7f5b729a2700 1 -- 172.21.15.133:0/1940799186 wait complete. 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.537+0000 7f5b729a2700 1 Processor -- start 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.537+0000 7f5b729a2700 1 -- start start 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137410 0x7f5b6c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c0adf50 con 0x7f5b6c137030 2024-01-21T20:15:19.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c0ad340 con 0x7f5b6c0c5930 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c0ad620 con 0x7f5b6c137410 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39348/0 (socket says 172.21.15.133:39348) 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 -- 172.21.15.133:0/1974199743 learned_addr learned my addr 172.21.15.133:0/1974199743 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b6bfff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b70f3f700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137410 0x7f5b6c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 -- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137410 msgr2=0x7f5b6c0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137410 0x7f5b6c0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 -- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b6c0c5930 msgr2=0x7f5b6c136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c136710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 -- 172.21.15.133:0/1974199743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b64009ae0 con 0x7f5b6c137030 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b63fff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f5b5400c440 tx=0x7f5b54007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54007020 con 0x7f5b6c137030 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b54007180 con 0x7f5b6c137030 2024-01-21T20:15:19.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c0ad900 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.538+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54007520 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.539+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c0bf1d0 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.539+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c05fdf0 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.540+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5b540068b0 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.540+0000 7f5b697fa700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 0x7f5b4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.540+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5b54079820 con 0x7f5b6c137030 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.540+0000 7f5b6bfff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 0x7f5b4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.541+0000 7f5b6bfff700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 0x7f5b4c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5b5c006d80 tx=0x7f5b5c008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.544+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5b5404ac00 con 0x7f5b6c137030 2024-01-21T20:15:19.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.707+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b6c0c62d0 con 0x7f5b6c137030 2024-01-21T20:15:19.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.707+0000 7f5b697fa700 1 -- 172.21.15.133:0/1974199743 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v104) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b6c0c62d0 con 0x7f5b6c137030 2024-01-21T20:15:19.697 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 msgr2=0x7f5b4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 0x7f5b4c061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5b5c006d80 tx=0x7f5b5c008040).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 msgr2=0x7f5b6c0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f5b5400c440 tx=0x7f5b54007dd0).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 shutdown_connections 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5b4c05f150 0x7f5b4c061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b6c137410 0x7f5b6c0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b6c0c5930 0x7f5b6c136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 --2- 172.21.15.133:0/1974199743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b6c137030 0x7f5b6c0ac8c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 >> 172.21.15.133:0/1974199743 conn(0x7f5b6c066a90 msgr2=0x7f5b6c0c86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 shutdown_connections 2024-01-21T20:15:19.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.709+0000 7f5b729a2700 1 -- 172.21.15.133:0/1974199743 wait complete. 2024-01-21T20:15:19.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:15:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.837+0000 7fb6ad6e6700 1 Processor -- start 2024-01-21T20:15:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.837+0000 7fb6ad6e6700 1 -- start start 2024-01-21T20:15:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6ad6e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a8066360 0x7fb6a80a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6ad6e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a80689c0 0x7fb6a8068e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6ad6e6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80bc990 con 0x7fb6a81527e0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6ad6e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a80bbe50 con 0x7fb6a80689c0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6ad6e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8069320 con 0x7fb6a8066360 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a80689c0 0x7fb6a8068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a80689c0 0x7fb6a8068e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39352/0 (socket says 172.21.15.133:39352) 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 -- 172.21.15.133:0/1638188957 learned_addr learned my addr 172.21.15.133:0/1638188957 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a67fc700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a8066360 0x7fb6a80a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 -- 172.21.15.133:0/1638188957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a8066360 msgr2=0x7fb6a80a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a8066360 0x7fb6a80a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 -- 172.21.15.133:0/1638188957 >> v1:172.21.15.178:6789/0 conn(0x7fb6a81527e0 legacy=0x7fb6a80651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 -- 172.21.15.133:0/1638188957 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80bc060 con 0x7fb6a80689c0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a77fe700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a80689c0 0x7fb6a8068e30 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fb6a0009f20 tx=0x7fb6a0009840).ready entity=mon.0 client_cookie=f2973318fede5b33 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a5ffb700 1 -- 172.21.15.133:0/1638188957 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a000e070 con 0x7fb6a80689c0 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a5ffb700 1 -- 172.21.15.133:0/1638188957 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a000b9d0 con 0x7fb6a80689c0 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.838+0000 7fb6a5ffb700 1 -- 172.21.15.133:0/1638188957 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a000bd50 con 0x7fb6a80689c0 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/1638188957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a80689c0 msgr2=0x7fb6a8068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a80689c0 0x7fb6a8068e30 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fb6a0009f20 tx=0x7fb6a0009840).stop 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/1638188957 shutdown_connections 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a80689c0 0x7fb6a8068e30 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/1638188957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a8066360 0x7fb6a80a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/1638188957 >> 172.21.15.133:0/1638188957 conn(0x7fb6a80c6ef0 msgr2=0x7fb6a80c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/1638188957 shutdown_connections 2024-01-21T20:15:19.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.839+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/1638188957 wait complete. 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.840+0000 7fb6ad6e6700 1 Processor -- start 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.840+0000 7fb6ad6e6700 1 -- start start 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a80689c0 0x7fb6a80a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6a81527e0 0x7fb6a80c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80a8d70 con 0x7fb6a8066360 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80a7e90 con 0x7fb6a81527e0 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6ad6e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80a8160 con 0x7fb6a80689c0 2024-01-21T20:15:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39358/0 (socket says 172.21.15.133:39358) 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 -- 172.21.15.133:0/2917725674 learned_addr learned my addr 172.21.15.133:0/2917725674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a67fc700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a80689c0 0x7fb6a80a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a77fe700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6a81527e0 0x7fb6a80c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 -- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a80689c0 msgr2=0x7fb6a80a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a80689c0 0x7fb6a80a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 -- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6a81527e0 msgr2=0x7fb6a80c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6a81527e0 0x7fb6a80c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.841+0000 7fb6a6ffd700 1 -- 172.21.15.133:0/2917725674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009ae0 con 0x7fb6a8066360 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb6a6ffd700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fb69800c4c0 tx=0x7fb698007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800ce70 con 0x7fb6a8066360 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698001e90 con 0x7fb6a8066360 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a80a8440 con 0x7fb6a8066360 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698007250 con 0x7fb6a8066360 2024-01-21T20:15:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.842+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a80a8a00 con 0x7fb6a8066360 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.843+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a805fdf0 con 0x7fb6a8066360 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.843+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb6980066a0 con 0x7fb6a8066360 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.843+0000 7fb68f7fe700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 0x7fb694061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.843+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb698079980 con 0x7fb6a8066360 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.844+0000 7fb6a67fc700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 0x7fb694061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.844+0000 7fb6a67fc700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 0x7fb694061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb6a81513c0 tx=0x7fb69c009060).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:19.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:19.847+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb69804ad60 con 0x7fb6a8066360 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.013+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6a80bc340 con 0x7fb6a8066360 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.013+0000 7fb68f7fe700 1 -- 172.21.15.133:0/2917725674 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb69804e380 con 0x7fb6a8066360 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:15:20.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:15:20.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:20.004 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:15:20.004 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:15:20.004 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:20.004 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 msgr2=0x7fb694061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 0x7fb694061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb6a81513c0 tx=0x7fb69c009060).stop 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 msgr2=0x7fb6a8165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fb69800c4c0 tx=0x7fb698007e00).stop 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 shutdown_connections 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb69405f150 0x7fb694061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6a81527e0 0x7fb6a80c2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a8066360 0x7fb6a8165010 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 --2- 172.21.15.133:0/2917725674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6a80689c0 0x7fb6a80a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 >> 172.21.15.133:0/2917725674 conn(0x7fb6a80c6ef0 msgr2=0x7fb6a80c4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:20.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 shutdown_connections 2024-01-21T20:15:20.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.015+0000 7fb6ad6e6700 1 -- 172.21.15.133:0/2917725674 wait complete. 2024-01-21T20:15:20.017 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:15:20.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:15:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.147+0000 7f742091c700 1 Processor -- start 2024-01-21T20:15:20.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.148+0000 7f742091c700 1 -- start start 2024-01-21T20:15:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f742091c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f741c150c90 0x7f741c151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f742091c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c069750 con 0x7f741c069940 2024-01-21T20:15:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f742091c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c067720 con 0x7f741c063e10 2024-01-21T20:15:20.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f742091c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c066680 con 0x7f741c150c90 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f7419d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f741c069940 0x7f741c063700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46422/0 (socket says 172.21.15.133:46422) 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f7419d9b700 1 -- 172.21.15.133:0/630070452 learned_addr learned my addr 172.21.15.133:0/630070452 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f741a59c700 1 --2- 172.21.15.133:0/630070452 >> v2:172.21.15.178:3300/0 conn(0x7f741c150c90 0x7f741c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843214229 0 0) 0x7f741c069750 con 0x7f741c069940 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.149+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74080033f0 con 0x7f741c069940 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375698251 0 0) 0x7f741c067720 con 0x7f741c063e10 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c069750 con 0x7f741c063e10 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430296617 0 0) 0x7f74080033f0 con 0x7f741c069940 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 >> v2:172.21.15.178:3300/0 conn(0x7f741c150c90 msgr2=0x7f741c151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 --2- 172.21.15.133:0/630070452 >> v2:172.21.15.178:3300/0 conn(0x7f741c150c90 0x7f741c151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 >> v1:172.21.15.178:6789/0 conn(0x7f741c063e10 legacy=0x7f741c0c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c066960 con 0x7f741c069940 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f7404001470 con 0x7f741c069940 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 >> v1:172.21.15.133:6789/0 conn(0x7f741c069940 legacy=0x7f741c063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7408003a70 0x7f7408003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7408004690 0x7f7408004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f740800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c066680 con 0x7f7408005000 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740800bf60 con 0x7f7408003a70 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740800c0d0 con 0x7f7408004690 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f740800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741a59c700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7408003a70 0x7f7408003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f7419d9b700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7408004690 0x7f7408004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 -- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7408004690 msgr2=0x7f7408004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7408004690 0x7f7408004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 -- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7408003a70 msgr2=0x7f7408003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7408003a70 0x7f7408003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 -- 172.21.15.133:0/630070452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74080033f0 con 0x7f7408005000 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 -- 172.21.15.133:0/630070452 reap_dead start 2024-01-21T20:15:20.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741ad9d700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f740800b8e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7414001f60 tx=0x7f7414007f30).ready entity=mon.0 client_cookie=39ad76f77005c881 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414003120 con 0x7f7408005000 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414006a20 con 0x7f7408005000 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.150+0000 7f741959a700 1 -- 172.21.15.133:0/630070452 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414006dc0 con 0x7f7408005000 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 -- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 msgr2=0x7f740800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f740800b8e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f7414001f60 tx=0x7f7414007f30).stop 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 -- 172.21.15.133:0/630070452 shutdown_connections 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 --2- 172.21.15.133:0/630070452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f740800b8e0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 -- 172.21.15.133:0/630070452 >> 172.21.15.133:0/630070452 conn(0x7f741c0c4a10 msgr2=0x7f741c068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 -- 172.21.15.133:0/630070452 shutdown_connections 2024-01-21T20:15:20.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.151+0000 7f742091c700 1 -- 172.21.15.133:0/630070452 wait complete. 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.153+0000 7f742091c700 1 Processor -- start 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.153+0000 7f742091c700 1 -- start start 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 0x7f741c14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 0x7f741c0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0bf400 con 0x7f7408005000 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0abc80 con 0x7f741c0c5070 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f742091c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c1570 con 0x7f741c0c10f0 2024-01-21T20:15:20.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39378/0 (socket says 172.21.15.133:39378) 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 -- 172.21.15.133:0/715062662 learned_addr learned my addr 172.21.15.133:0/715062662 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f7419d9b700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 0x7f741c14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741ad9d700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 0x7f741c0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 -- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 msgr2=0x7f741c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 0x7f741c14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 -- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 msgr2=0x7f741c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 0x7f741c0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 -- 172.21.15.133:0/715062662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0c59e0 con 0x7f7408005000 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f7419d9b700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 0x7f741c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741ad9d700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 0x7f741c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f741a59c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f740c0119f0 tx=0x7f740c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.154+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c00f940 con 0x7f7408005000 2024-01-21T20:15:20.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.155+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c00faa0 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.155+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0ab970 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.155+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c00fe20 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.155+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0bf8c0 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.156+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c05fdf0 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.156+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f740c014650 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.156+0000 7f7412ffd700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 0x7f73fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.156+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f740c07ac20 con 0x7f7408005000 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.156+0000 7f7419d9b700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 0x7f73fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.157+0000 7f7419d9b700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 0x7f73fc061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7404001200 tx=0x7f7404009040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.161+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f740c04c000 con 0x7f7408005000 2024-01-21T20:15:20.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.322+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f741c066c40 con 0x7f7408005000 2024-01-21T20:15:20.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.416+0000 7f7412ffd700 1 -- 172.21.15.133:0/715062662 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v105) v1 ==== 152+0+0 (secure 0 0 0) 0x7f740c04f620 con 0x7f7408005000 2024-01-21T20:15:20.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 msgr2=0x7f73fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 0x7f73fc061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7404001200 tx=0x7f7404009040).stop 2024-01-21T20:15:20.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 msgr2=0x7f741c0bef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f740c0119f0 tx=0x7f740c009060).stop 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 shutdown_connections 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f73fc05f150 0x7f73fc061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f741c0c5070 0x7f741c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7408005000 0x7f741c0bef10 secure :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0x7f740c0119f0 tx=0x7f740c009060).stop 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.419+0000 7f742091c700 1 --2- 172.21.15.133:0/715062662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f741c0c10f0 0x7f741c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.420+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 >> 172.21.15.133:0/715062662 conn(0x7f741c0c4a10 msgr2=0x7f741c14d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.421+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 shutdown_connections 2024-01-21T20:15:20.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.421+0000 7f742091c700 1 -- 172.21.15.133:0/715062662 wait complete. 2024-01-21T20:15:20.412 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:15:20.425 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:15:20.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.558+0000 7fb839f15700 1 Processor -- start 2024-01-21T20:15:20.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.558+0000 7fb839f15700 1 -- start start 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb839f15700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb83413a830 0x7fb8340c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb839f15700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb83413ac10 0x7fb8340bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb839f15700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340c3890 con 0x7fb8340695b0 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb839f15700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340c3b70 con 0x7fb83413a830 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb839f15700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8340c3e50 con 0x7fb83413ac10 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb83413a830 0x7fb8340c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb83413a830 0x7fb8340c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54760/0 (socket says 172.21.15.133:54760) 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 -- 172.21.15.133:0/896722237 learned_addr learned my addr 172.21.15.133:0/896722237 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb833fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb8340695b0 0x7fb8340699c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39752/0 (socket says 172.21.15.133:39752) 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb832ffd700 1 --2- 172.21.15.133:0/896722237 >> v2:172.21.15.178:3300/0 conn(0x7fb83413ac10 0x7fb8340bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 -- 172.21.15.133:0/896722237 >> v2:172.21.15.178:3300/0 conn(0x7fb83413ac10 msgr2=0x7fb8340bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 --2- 172.21.15.133:0/896722237 >> v2:172.21.15.178:3300/0 conn(0x7fb83413ac10 0x7fb8340bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.559+0000 7fb8337fe700 1 -- 172.21.15.133:0/896722237 >> v1:172.21.15.133:6789/0 conn(0x7fb8340695b0 legacy=0x7fb8340699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb8337fe700 1 -- 172.21.15.133:0/896722237 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340c4130 con 0x7fb83413a830 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb8337fe700 1 --2- 172.21.15.133:0/896722237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413a830 0x7fb8340c3220 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fb8340694b0 tx=0x7fb8280090f0).ready entity=mon.0 client_cookie=5bd02d409156bc91 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb8327fc700 1 -- 172.21.15.133:0/896722237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800b600 con 0x7fb83413a830 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb8327fc700 1 -- 172.21.15.133:0/896722237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82800b760 con 0x7fb83413a830 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb8327fc700 1 -- 172.21.15.133:0/896722237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82800bb00 con 0x7fb83413a830 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 -- 172.21.15.133:0/896722237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413a830 msgr2=0x7fb8340c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 --2- 172.21.15.133:0/896722237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413a830 0x7fb8340c3220 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fb8340694b0 tx=0x7fb8280090f0).stop 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 -- 172.21.15.133:0/896722237 shutdown_connections 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 --2- 172.21.15.133:0/896722237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413a830 0x7fb8340c3220 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 --2- 172.21.15.133:0/896722237 >> v2:172.21.15.178:3300/0 conn(0x7fb83413ac10 0x7fb8340bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 -- 172.21.15.133:0/896722237 >> 172.21.15.133:0/896722237 conn(0x7fb8340c7dc0 msgr2=0x7fb8340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 -- 172.21.15.133:0/896722237 shutdown_connections 2024-01-21T20:15:20.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.560+0000 7fb839f15700 1 -- 172.21.15.133:0/896722237 wait complete. 2024-01-21T20:15:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.562+0000 7fb839f15700 1 Processor -- start 2024-01-21T20:15:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.562+0000 7fb839f15700 1 -- start start 2024-01-21T20:15:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.562+0000 7fb839f15700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8340695b0 0x7fb834131990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.562+0000 7fb839f15700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 0x7fb8341333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.562+0000 7fb839f15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb839f15700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341326b0 con 0x7fb83413ac10 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb839f15700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834132f50 con 0x7fb8340695b0 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb839f15700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb834131e80 con 0x7fb83413a830 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54764/0 (socket says 172.21.15.133:54764) 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 -- 172.21.15.133:0/64015064 learned_addr learned my addr 172.21.15.133:0/64015064 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb8337fe700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8340695b0 0x7fb834131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb832ffd700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 0x7fb8341333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 -- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 msgr2=0x7fb8341333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 0x7fb8341333e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 -- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8340695b0 msgr2=0x7fb834131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8340695b0 0x7fb834131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 -- 172.21.15.133:0/64015064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009370 con 0x7fb83413ac10 2024-01-21T20:15:20.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb832ffd700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 0x7fb8341333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb833fff700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb82c00c7f0 tx=0x7fb82c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c005c70 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c005dd0 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0072e0 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb834132100 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.563+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834132be0 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.564+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb83405fdf0 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.565+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb82c007710 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.565+0000 7fb81bfff700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.565+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb82c079b00 con 0x7fb83413ac10 2024-01-21T20:15:20.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.565+0000 7fb8337fe700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:20.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.565+0000 7fb8337fe700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb828009fd0 tx=0x7fb828017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:20.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.569+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb82c04ad70 con 0x7fb83413ac10 2024-01-21T20:15:20.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:20.732+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb8340c4410 con 0x7fb83413ac10 2024-01-21T20:15:21.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.424+0000 7fb81bfff700 1 -- 172.21.15.133:0/64015064 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v106) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb82c04e390 con 0x7fb83413ac10 2024-01-21T20:15:21.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.429+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 msgr2=0x7fb820061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.429+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb828009fd0 tx=0x7fb828017000).stop 2024-01-21T20:15:21.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.429+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 msgr2=0x7fb834153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.429+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb82c00c7f0 tx=0x7fb82c001510).stop 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 shutdown_connections 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82005f150 0x7fb820061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb83413ac10 0x7fb834153920 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8340695b0 0x7fb834131990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 --2- 172.21.15.133:0/64015064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83413a830 0x7fb8341333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.436+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 >> 172.21.15.133:0/64015064 conn(0x7fb8340c7dc0 msgr2=0x7fb8340c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:21.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.441+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 shutdown_connections 2024-01-21T20:15:21.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.446+0000 7fb839f15700 1 -- 172.21.15.133:0/64015064 wait complete. 2024-01-21T20:15:21.439 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:15:21.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:15:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.584+0000 7fdb603d4700 1 Processor -- start 2024-01-21T20:15:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.584+0000 7fdb603d4700 1 -- start start 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.585+0000 7fdb603d4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb580c6040 0x7fdb58137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb603d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb58068370 con 0x7fdb58067d90 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb603d4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb58068650 con 0x7fdb58137030 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb603d4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb58068930 con 0x7fdb580c6040 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d96f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb58067d90 0x7fdb580c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39762/0 (socket says 172.21.15.133:39762) 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d96f700 1 -- 172.21.15.133:0/67319154 learned_addr learned my addr 172.21.15.133:0/67319154 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5e971700 1 --2- 172.21.15.133:0/67319154 >> v2:172.21.15.178:3300/0 conn(0x7fdb580c6040 0x7fdb58137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324359628 0 0) 0x7fdb58068370 con 0x7fdb58067d90 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb440033f0 con 0x7fdb58067d90 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077479860 0 0) 0x7fdb440033f0 con 0x7fdb58067d90 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 >> v2:172.21.15.178:3300/0 conn(0x7fdb580c6040 msgr2=0x7fdb58137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 --2- 172.21.15.133:0/67319154 >> v2:172.21.15.178:3300/0 conn(0x7fdb580c6040 0x7fdb58137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 >> v1:172.21.15.178:6789/0 conn(0x7fdb58137030 legacy=0x7fdb58155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb58068c10 con 0x7fdb58067d90 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdb54001470 con 0x7fdb58067d90 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 >> v1:172.21.15.133:6789/0 conn(0x7fdb58067d90 legacy=0x7fdb580c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb44005050 0x7fdb4400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58068930 con 0x7fdb440038e0 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400bfe0 con 0x7fdb44004690 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400c1a0 con 0x7fdb44005050 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5e170700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.586+0000 7fdb5d96f700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e971700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb44005050 0x7fdb4400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 -- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb44005050 msgr2=0x7fdb4400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb44005050 0x7fdb4400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 -- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44004690 msgr2=0x7fdb44004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44004690 0x7fdb44004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 -- 172.21.15.133:0/67319154 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb440033f0 con 0x7fdb440038e0 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e971700 1 -- 172.21.15.133:0/67319154 reap_dead start 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5e170700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 0x7fdb44003d00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fdb4c001700 tx=0x7fdb4c007bb0).ready entity=mon.0 client_cookie=6166f32ed634c318 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c007020 con 0x7fdb440038e0 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c007180 con 0x7fdb440038e0 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb5d16e700 1 -- 172.21.15.133:0/67319154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c007500 con 0x7fdb440038e0 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb603d4700 1 -- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 msgr2=0x7fdb44003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.587+0000 7fdb603d4700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 0x7fdb44003d00 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fdb4c001700 tx=0x7fdb4c007bb0).stop 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.588+0000 7fdb603d4700 1 -- 172.21.15.133:0/67319154 shutdown_connections 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.588+0000 7fdb603d4700 1 --2- 172.21.15.133:0/67319154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb440038e0 0x7fdb44003d00 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.588+0000 7fdb603d4700 1 -- 172.21.15.133:0/67319154 >> 172.21.15.133:0/67319154 conn(0x7fdb58066a90 msgr2=0x7fdb58066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:21.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.588+0000 7fdb603d4700 1 -- 172.21.15.133:0/67319154 shutdown_connections 2024-01-21T20:15:21.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.588+0000 7fdb603d4700 1 -- 172.21.15.133:0/67319154 wait complete. 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 Processor -- start 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 -- start start 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440038e0 0x7fdb581351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 0x7fdb580abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5813c6e0 con 0x7fdb58135700 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58136070 con 0x7fdb580ae7c0 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.589+0000 7fdb603d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580ac7b0 con 0x7fdb440038e0 2024-01-21T20:15:21.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54796/0 (socket says 172.21.15.133:54796) 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 -- 172.21.15.133:0/2727391099 learned_addr learned my addr 172.21.15.133:0/2727391099 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e170700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440038e0 0x7fdb581351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5d96f700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 0x7fdb580abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 -- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440038e0 msgr2=0x7fdb581351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440038e0 0x7fdb581351d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 -- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 msgr2=0x7fdb580abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 0x7fdb580abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 -- 172.21.15.133:0/2727391099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580aca90 con 0x7fdb58135700 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5d96f700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 0x7fdb580abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb5e971700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fdb58063390 tx=0x7fdb5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000e040 con 0x7fdb58135700 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5000f040 con 0x7fdb58135700 2024-01-21T20:15:21.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000fdc0 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb580acd70 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.590+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5813c8f0 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.591+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb580c32e0 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.592+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb50015660 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.592+0000 7fdb4affd700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 0x7fdb3c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.592+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fdb5007af20 con 0x7fdb58135700 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.592+0000 7fdb5e170700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 0x7fdb3c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.592+0000 7fdb5e170700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 0x7fdb3c061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdb4c001010 tx=0x7fdb4c016000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.596+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb5004c010 con 0x7fdb58135700 2024-01-21T20:15:21.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.802+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdb5813cb10 con 0x7fdb58135700 2024-01-21T20:15:21.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.809+0000 7fdb4affd700 1 -- 172.21.15.133:0/2727391099 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v34) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdb5004f630 con 0x7fdb58135700 2024-01-21T20:15:21.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.813+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 msgr2=0x7fdb3c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.813+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 0x7fdb3c061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fdb4c001010 tx=0x7fdb4c016000).stop 2024-01-21T20:15:21.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.813+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 msgr2=0x7fdb58135b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.813+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fdb58063390 tx=0x7fdb5000b040).stop 2024-01-21T20:15:21.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 shutdown_connections 2024-01-21T20:15:21.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdb3c05f180 0x7fdb3c061640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb58135700 0x7fdb58135b80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440038e0 0x7fdb581351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 --2- 172.21.15.133:0/2727391099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb580ae7c0 0x7fdb580abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.814+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 >> 172.21.15.133:0/2727391099 conn(0x7fdb58066a90 msgr2=0x7fdb581364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:21.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.817+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 shutdown_connections 2024-01-21T20:15:21.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.817+0000 7fdb603d4700 1 -- 172.21.15.133:0/2727391099 wait complete. 2024-01-21T20:15:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 13 and data pool 14 2024-01-21T20:15:21.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.955+0000 7f925a445700 1 Processor -- start 2024-01-21T20:15:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.955+0000 7f925a445700 1 -- start start 2024-01-21T20:15:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f925a445700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f9254067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f925a445700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9254137410 0x7f9254155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f925a445700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92541557f0 con 0x7f92540c5930 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f925a445700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9254068370 con 0x7f9254137410 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f925a445700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9254068650 con 0x7f9254137030 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f92589e2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92540c5930 0x7f9254157e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39768/0 (socket says 172.21.15.133:39768) 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f92589e2700 1 -- 172.21.15.133:0/1281807113 learned_addr learned my addr 172.21.15.133:0/1281807113 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f9253fff700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f9254067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f92537fe700 1 --2- 172.21.15.133:0/1281807113 >> v2:172.21.15.178:3300/0 conn(0x7f9254137410 0x7f9254155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717931456 0 0) 0x7f92541557f0 con 0x7f92540c5930 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.956+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c0033f0 con 0x7f92540c5930 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934900222 0 0) 0x7f923c0033f0 con 0x7f92540c5930 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 msgr2=0x7f9254067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f9254067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 >> v2:172.21.15.178:3300/0 conn(0x7f9254137410 msgr2=0x7f9254155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 --2- 172.21.15.133:0/1281807113 >> v2:172.21.15.178:3300/0 conn(0x7f9254137410 0x7f9254155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254068930 con 0x7f92540c5930 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f924c0017f0 con 0x7f92540c5930 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92537fe700 1 --2- 172.21.15.133:0/1281807113 >> v2:172.21.15.178:3300/0 conn(0x7f9254137410 0x7f9254155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 >> v1:172.21.15.133:6789/0 conn(0x7f92540c5930 legacy=0x7f9254157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0038e0 0x7f923c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f923c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004b80 0x7f923c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254068370 con 0x7f923c004b80 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9254068650 con 0x7f923c0038e0 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00b8e0 con 0x7f9254137030 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004b80 0x7f923c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9253fff700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0038e0 0x7f923c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92537fe700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f923c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 -- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 msgr2=0x7f923c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9254137030 0x7f923c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 -- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0038e0 msgr2=0x7f923c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f923c0038e0 0x7f923c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 -- 172.21.15.133:0/1281807113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c0033f0 con 0x7f923c004b80 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f92589e2700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004b80 0x7f923c005000 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f924c00c530 tx=0x7f924c001d90).ready entity=mon.0 client_cookie=eaeb6fcce247fb5d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00ce60 con 0x7f923c004b80 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c005b20 con 0x7f923c004b80 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.957+0000 7f9252ffd700 1 -- 172.21.15.133:0/1281807113 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0070d0 con 0x7f923c004b80 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 -- 172.21.15.133:0/1281807113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004b80 msgr2=0x7f923c005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 --2- 172.21.15.133:0/1281807113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f923c004b80 0x7f923c005000 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f924c00c530 tx=0x7f924c001d90).stop 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f92589e2700 1 -- 172.21.15.133:0/1281807113 reap_dead start 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 -- 172.21.15.133:0/1281807113 shutdown_connections 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 -- 172.21.15.133:0/1281807113 >> 172.21.15.133:0/1281807113 conn(0x7f9254066a90 msgr2=0x7f9254066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 -- 172.21.15.133:0/1281807113 shutdown_connections 2024-01-21T20:15:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.958+0000 7f925a445700 1 -- 172.21.15.133:0/1281807113 wait complete. 2024-01-21T20:15:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.959+0000 7f925a445700 1 Processor -- start 2024-01-21T20:15:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.959+0000 7f925a445700 1 -- start start 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 0x7f92540aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 0x7f92540c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540aef20 con 0x7f92540ac540 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c13f0 con 0x7f92540ac160 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f925a445700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92540c1670 con 0x7f92540c0f70 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f92589e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f92589e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54824/0 (socket says 172.21.15.133:54824) 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.960+0000 7f92589e2700 1 -- 172.21.15.133:0/3027556284 learned_addr learned my addr 172.21.15.133:0/3027556284 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92537fe700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 0x7f92540c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f9253fff700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 0x7f92540aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 -- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 msgr2=0x7f92540c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 0x7f92540c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 -- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 msgr2=0x7f92540aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 0x7f92540aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 -- 172.21.15.133:0/3027556284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92540c1950 con 0x7f92540ac540 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92537fe700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 0x7f92540c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f9253fff700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 0x7f92540aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f92589e2700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f924c001220 tx=0x7f924c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0070d0 con 0x7f92540ac540 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c0017b0 con 0x7f92540ac540 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92540c1c30 con 0x7f92540ac540 2024-01-21T20:15:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c0138b0 con 0x7f92540ac540 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.961+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92540c21f0 con 0x7f92540ac540 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.962+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92540c2560 con 0x7f92540ac540 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.962+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f924c013c20 con 0x7f92540ac540 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.962+0000 7f9250ff9700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 0x7f9240061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.963+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f924c07b9e0 con 0x7f92540ac540 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.963+0000 7f9253fff700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 0x7f9240061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.963+0000 7f9253fff700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 0x7f9240061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9248009270 tx=0x7f9248008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:21.967+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f924c04cb00 con 0x7f92540ac540 2024-01-21T20:15:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.130+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f925405fdf0 con 0x7f92540ac540 2024-01-21T20:15:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.131+0000 7f9250ff9700 1 -- 172.21.15.133:0/3027556284 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17887 (secure 0 0 0) 0x7f924c01a020 con 0x7f92540ac540 2024-01-21T20:15:22.120 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:22.121 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:21.803271+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 msgr2=0x7f9240061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 0x7f9240061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9248009270 tx=0x7f9248008040).stop 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 msgr2=0x7f92540ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f924c001220 tx=0x7f924c015000).stop 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 shutdown_connections 2024-01-21T20:15:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f924005f150 0x7f9240061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92540ac540 0x7f92540ac9c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92540ac160 0x7f92540aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 --2- 172.21.15.133:0/3027556284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92540c0f70 0x7f92540c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 >> 172.21.15.133:0/3027556284 conn(0x7f9254066a90 msgr2=0x7f92540c7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 shutdown_connections 2024-01-21T20:15:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.133+0000 7f925a445700 1 -- 172.21.15.133:0/3027556284 wait complete. 2024-01-21T20:15:22.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:22.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.260+0000 7f2a5e8f5700 1 Processor -- start 2024-01-21T20:15:22.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.260+0000 7f2a5e8f5700 1 -- start start 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a5e8f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 0x7f2a580626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a5e8f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580a50f0 con 0x7f2a58155ca0 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a5e8f5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580a4da0 con 0x7f2a580bd890 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a5e8f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580bde00 con 0x7f2a581558c0 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a577fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a58155ca0 0x7f2a580bd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39780/0 (socket says 172.21.15.133:39780) 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a577fe700 1 -- 172.21.15.133:0/3470239520 learned_addr learned my addr 172.21.15.133:0/3470239520 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a57fff700 1 --2- 172.21.15.133:0/3470239520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 0x7f2a580626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994907555 0 0) 0x7f2a580a50f0 con 0x7f2a58155ca0 2024-01-21T20:15:22.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a400033f0 con 0x7f2a58155ca0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4037912318 0 0) 0x7f2a400033f0 con 0x7f2a58155ca0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a57fff700 1 -- 172.21.15.133:0/3470239520 >> v1:172.21.15.178:6789/0 conn(0x7f2a580bd890 legacy=0x7f2a580a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a57fff700 1 -- 172.21.15.133:0/3470239520 >> v1:172.21.15.133:6789/0 conn(0x7f2a58155ca0 legacy=0x7f2a580bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a57fff700 1 -- 172.21.15.133:0/3470239520 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580be0e0 con 0x7f2a581558c0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.261+0000 7f2a57fff700 1 --2- 172.21.15.133:0/3470239520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 0x7f2a580626f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2a48009790 tx=0x7f2a48009060).ready entity=mon.2 client_cookie=3bf65a62657748c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c001470 con 0x7f2a581558c0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480090d0 con 0x7f2a581558c0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a56ffd700 1 -- 172.21.15.133:0/3470239520 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48011610 con 0x7f2a581558c0 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/3470239520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 msgr2=0x7f2a580626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/3470239520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 0x7f2a580626f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f2a48009790 tx=0x7f2a48009060).stop 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/3470239520 shutdown_connections 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/3470239520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a581558c0 0x7f2a580626f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/3470239520 >> 172.21.15.133:0/3470239520 conn(0x7f2a580c8010 msgr2=0x7f2a580c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/3470239520 shutdown_connections 2024-01-21T20:15:22.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.262+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/3470239520 wait complete. 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.263+0000 7f2a5e8f5700 1 Processor -- start 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 -- start start 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a580bd890 0x7f2a58067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58155ca0 0x7f2a58150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58066140 con 0x7f2a581558c0 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58066ec0 con 0x7f2a58155ca0 2024-01-21T20:15:22.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a5e8f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580665d0 con 0x7f2a580bd890 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a577fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54832/0 (socket says 172.21.15.133:54832) 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.264+0000 7f2a577fe700 1 -- 172.21.15.133:0/509863293 learned_addr learned my addr 172.21.15.133:0/509863293 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a57fff700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a580bd890 0x7f2a58067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a5ce92700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58155ca0 0x7f2a58150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 -- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a580bd890 msgr2=0x7f2a58067350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a580bd890 0x7f2a58067350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 -- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58155ca0 msgr2=0x7f2a58150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58155ca0 0x7f2a58150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 -- 172.21.15.133:0/509863293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480092a0 con 0x7f2a581558c0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a577fe700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f2a4c00c590 tx=0x7f2a4c001640).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0072e0 con 0x7f2a581558c0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c007480 con 0x7f2a581558c0 2024-01-21T20:15:22.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a58143210 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c005990 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.265+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58066870 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.266+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a58067050 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.266+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2a4c005d40 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.267+0000 7f2a54ff9700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.267+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f2a4c079c90 con 0x7f2a581558c0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.267+0000 7f2a57fff700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.267+0000 7f2a57fff700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 0x7f2a44061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2a48006d30 tx=0x7f2a48016000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.271+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2a4c04ad10 con 0x7f2a581558c0 2024-01-21T20:15:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.436+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a58065210 con 0x7f2a581558c0 2024-01-21T20:15:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.437+0000 7f2a54ff9700 1 -- 172.21.15.133:0/509863293 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+17887 (secure 0 0 0) 0x7f2a4c018030 con 0x7f2a581558c0 2024-01-21T20:15:22.427 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:22.427 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:21.803271+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 msgr2=0x7f2a44061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 0x7f2a44061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2a48006d30 tx=0x7f2a48016000).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 msgr2=0x7f2a58142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f2a4c00c590 tx=0x7f2a4c001640).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 shutdown_connections 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2a4405f150 0x7f2a44061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a58155ca0 0x7f2a58150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a580bd890 0x7f2a58067350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 --2- 172.21.15.133:0/509863293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a581558c0 0x7f2a58142d20 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 >> 172.21.15.133:0/509863293 conn(0x7f2a580c8010 msgr2=0x7f2a58152680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 shutdown_connections 2024-01-21T20:15:22.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.439+0000 7f2a5e8f5700 1 -- 172.21.15.133:0/509863293 wait complete. 2024-01-21T20:15:22.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:15:22.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.570+0000 7ff0d97ee700 1 Processor -- start 2024-01-21T20:15:22.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.570+0000 7ff0d97ee700 1 -- start start 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d97ee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 0x7ff0d41546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d97ee700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0d40aa7a0 0x7ff0d40c0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d97ee700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d4158c00 con 0x7ff0d40c60b0 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d97ee700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d4159090 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d97ee700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41582d0 con 0x7ff0d41542f0 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d2ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 0x7ff0d41546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0d40aa7a0 0x7ff0d40c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d27fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff0d40c60b0 0x7ff0d40aa090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:60680/0 (socket says 172.21.15.133:60680) 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.571+0000 7ff0d27fc700 1 -- 172.21.15.133:0/3380754262 learned_addr learned my addr 172.21.15.133:0/3380754262 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d1ffb700 1 -- 172.21.15.133:0/3380754262 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730975567 0 0) 0x7ff0d4158c00 con 0x7ff0d40c60b0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d1ffb700 1 -- 172.21.15.133:0/3380754262 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0bc0033f0 con 0x7ff0d40c60b0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d37fe700 1 -- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 msgr2=0x7ff0d41546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d37fe700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 0x7ff0d41546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d37fe700 1 -- 172.21.15.133:0/3380754262 >> v1:172.21.15.178:6789/0 conn(0x7ff0d40c60b0 legacy=0x7ff0d40aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d37fe700 1 -- 172.21.15.133:0/3380754262 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d41585b0 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d2ffd700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 0x7ff0d41546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d37fe700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d40c0740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff0cc009e60 tx=0x7ff0cc009780).ready entity=mon.1 client_cookie=332af2004440ed6e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d1ffb700 1 -- 172.21.15.133:0/3380754262 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d1ffb700 1 -- 172.21.15.133:0/3380754262 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00bab0 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d1ffb700 1 -- 172.21.15.133:0/3380754262 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00be30 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 -- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 msgr2=0x7ff0d40c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d40c0740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff0cc009e60 tx=0x7ff0cc009780).stop 2024-01-21T20:15:22.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 -- 172.21.15.133:0/3380754262 shutdown_connections 2024-01-21T20:15:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d40c0740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/3380754262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d41542f0 0x7ff0d41546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.572+0000 7ff0d97ee700 1 -- 172.21.15.133:0/3380754262 >> 172.21.15.133:0/3380754262 conn(0x7ff0d405e1e0 msgr2=0x7ff0d405e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.573+0000 7ff0d97ee700 1 -- 172.21.15.133:0/3380754262 shutdown_connections 2024-01-21T20:15:22.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.573+0000 7ff0d97ee700 1 -- 172.21.15.133:0/3380754262 wait complete. 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.574+0000 7ff0d97ee700 1 Processor -- start 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.574+0000 7ff0d97ee700 1 -- start start 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d414cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d40c60b0 0x7ff0d40ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4154ce0 con 0x7ff0d41542f0 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41552a0 con 0x7ff0d40aa7a0 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d97ee700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40afec0 con 0x7ff0d40c60b0 2024-01-21T20:15:22.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54840/0 (socket says 172.21.15.133:54840) 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.575+0000 7ff0d37fe700 1 -- 172.21.15.133:0/667989021 learned_addr learned my addr 172.21.15.133:0/667989021 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d27fc700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d40c60b0 0x7ff0d40ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d2ffd700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d414cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 -- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d40c60b0 msgr2=0x7ff0d40ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d40c60b0 0x7ff0d40ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 -- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 msgr2=0x7ff0d414cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d414cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 -- 172.21.15.133:0/667989021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80092a0 con 0x7ff0d41542f0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d37fe700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7ff0d406aaa0 tx=0x7ff0cc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc01d630 con 0x7ff0d41542f0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc01d790 con 0x7ff0d41542f0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc009a20 con 0x7ff0d41542f0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc01db50 con 0x7ff0d41542f0 2024-01-21T20:15:22.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.576+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40aef00 con 0x7ff0d41542f0 2024-01-21T20:15:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.577+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d405fdf0 con 0x7ff0d41542f0 2024-01-21T20:15:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.577+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff0cc003040 con 0x7ff0d41542f0 2024-01-21T20:15:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.578+0000 7ff0bb7fe700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 0x7ff0c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.578+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6705+0+0 (secure 0 0 0) 0x7ff0cc07c1f0 con 0x7ff0d41542f0 2024-01-21T20:15:22.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.578+0000 7ff0d2ffd700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 0x7ff0c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.578+0000 7ff0d2ffd700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 0x7ff0c0061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff0c8009270 tx=0x7ff0c8008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.582+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0cc04d270 con 0x7ff0d41542f0 2024-01-21T20:15:22.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.790+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0d40c0210 con 0x7ff0d41542f0 2024-01-21T20:15:22.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.811+0000 7ff0bb7fe700 1 -- 172.21.15.133:0/667989021 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff0cc050890 con 0x7ff0d41542f0 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 msgr2=0x7ff0c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 0x7ff0c0061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff0c8009270 tx=0x7ff0c8008040).stop 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 msgr2=0x7ff0d40ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7ff0d406aaa0 tx=0x7ff0cc009780).stop 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 shutdown_connections 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff0c005f150 0x7ff0c0061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0d41542f0 0x7ff0d40ae5a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0d40aa7a0 0x7ff0d414cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 --2- 172.21.15.133:0/667989021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0d40c60b0 0x7ff0d40ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 >> 172.21.15.133:0/667989021 conn(0x7ff0d405e1e0 msgr2=0x7ff0d414de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 shutdown_connections 2024-01-21T20:15:22.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.813+0000 7ff0d97ee700 1 -- 172.21.15.133:0/667989021 wait complete. 2024-01-21T20:15:22.815 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:15:22.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:15:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.944+0000 7fc836c03700 1 Processor -- start 2024-01-21T20:15:22.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.944+0000 7fc836c03700 1 -- start start 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc836c03700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8300bfb60 0x7fc830152860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc836c03700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830068760 con 0x7fc8300c3c10 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc836c03700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8301535d0 con 0x7fc8300bf780 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc836c03700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8300bee70 con 0x7fc8300bfb60 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc8351a0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc8300c3c10 0x7fc830152d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39794/0 (socket says 172.21.15.133:39794) 2024-01-21T20:15:22.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.945+0000 7fc8351a0700 1 -- 172.21.15.133:0/1088481827 learned_addr learned my addr 172.21.15.133:0/1088481827 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252284331 0 0) 0x7fc830068760 con 0x7fc8300c3c10 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82ffff700 1 --2- 172.21.15.133:0/1088481827 >> v2:172.21.15.178:3300/0 conn(0x7fc8300bfb60 0x7fc830152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8200033f0 con 0x7fc8300c3c10 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936798741 0 0) 0x7fc8200033f0 con 0x7fc8300c3c10 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 >> v2:172.21.15.178:3300/0 conn(0x7fc8300bfb60 msgr2=0x7fc830152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/1088481827 >> v2:172.21.15.178:3300/0 conn(0x7fc8300bfb60 0x7fc830152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 >> v1:172.21.15.178:6789/0 conn(0x7fc8300bf780 legacy=0x7fc8300c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830067e30 con 0x7fc8300c3c10 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc8280017f0 con 0x7fc8300c3c10 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 >> v1:172.21.15.133:6789/0 conn(0x7fc8300c3c10 legacy=0x7fc830152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8200038e0 0x7fc820003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 0x7fc82000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300bee70 con 0x7fc820005050 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000bfe0 con 0x7fc8200038e0 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c1a0 con 0x7fc820004690 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc8351a0700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 0x7fc82000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc83499f700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8200038e0 0x7fc820003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc82ffff700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc8351a0700 1 -- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820004690 msgr2=0x7fc820004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc8351a0700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820004690 0x7fc820004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc8351a0700 1 -- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8200038e0 msgr2=0x7fc820003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.946+0000 7fc8351a0700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8200038e0 0x7fc820003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc8351a0700 1 -- 172.21.15.133:0/1088481827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200033f0 con 0x7fc820005050 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc8351a0700 1 -- 172.21.15.133:0/1088481827 reap_dead start 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc8351a0700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 0x7fc82000b8e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fc8300c4010 tx=0x7fc82800c730).ready entity=mon.0 client_cookie=e5890a68f9f47aef server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828002030 con 0x7fc820005050 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800cd90 con 0x7fc820005050 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc82f7fe700 1 -- 172.21.15.133:0/1088481827 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828005d30 con 0x7fc820005050 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 -- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 msgr2=0x7fc82000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 0x7fc82000b8e0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fc8300c4010 tx=0x7fc82800c730).stop 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 -- 172.21.15.133:0/1088481827 shutdown_connections 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 --2- 172.21.15.133:0/1088481827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc820005050 0x7fc82000b8e0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 -- 172.21.15.133:0/1088481827 >> 172.21.15.133:0/1088481827 conn(0x7fc830066a90 msgr2=0x7fc830066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 -- 172.21.15.133:0/1088481827 shutdown_connections 2024-01-21T20:15:22.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.947+0000 7fc836c03700 1 -- 172.21.15.133:0/1088481827 wait complete. 2024-01-21T20:15:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.949+0000 7fc836c03700 1 Processor -- start 2024-01-21T20:15:22.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.949+0000 7fc836c03700 1 -- start start 2024-01-21T20:15:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.949+0000 7fc836c03700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820005050 0x7fc830157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.949+0000 7fc836c03700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300bffa0 0x7fc83014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014be20 con 0x7fc830157620 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830165360 con 0x7fc8300bffa0 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830165640 con 0x7fc820005050 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54858/0 (socket says 172.21.15.133:54858) 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 -- 172.21.15.133:0/81003517 learned_addr learned my addr 172.21.15.133:0/81003517 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc83499f700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820005050 0x7fc830157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc82ffff700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300bffa0 0x7fc83014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 -- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820005050 msgr2=0x7fc830157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820005050 0x7fc830157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 -- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300bffa0 msgr2=0x7fc83014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300bffa0 0x7fc83014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 -- 172.21.15.133:0/81003517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830165920 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc8351a0700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fc828000f80 tx=0x7fc828015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828002030 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828013660 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc830165c00 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280017f0 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.950+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8300c1720 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.951+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83005fdf0 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.952+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc828013c50 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.952+0000 7fc82d7fa700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 0x7fc814061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.952+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc82807b480 con 0x7fc830157620 2024-01-21T20:15:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.952+0000 7fc83499f700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 0x7fc814061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.952+0000 7fc83499f700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 0x7fc814061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc824007fd0 tx=0x7fc824007bb0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:22.956+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc82804c500 con 0x7fc830157620 2024-01-21T20:15:23.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.162+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc8300c39f0 con 0x7fc830157620 2024-01-21T20:15:23.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.811+0000 7fc82d7fa700 1 -- 172.21.15.133:0/81003517 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc82801a020 con 0x7fc830157620 2024-01-21T20:15:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 msgr2=0x7fc814061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 0x7fc814061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc824007fd0 tx=0x7fc824007bb0).stop 2024-01-21T20:15:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 msgr2=0x7fc83014b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fc828000f80 tx=0x7fc828015000).stop 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 shutdown_connections 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81405f150 0x7fc814061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc830157620 0x7fc83014b930 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc820005050 0x7fc830157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 --2- 172.21.15.133:0/81003517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300bffa0 0x7fc83014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 >> 172.21.15.133:0/81003517 conn(0x7fc830066a90 msgr2=0x7fc8300abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 shutdown_connections 2024-01-21T20:15:23.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.814+0000 7fc836c03700 1 -- 172.21.15.133:0/81003517 wait complete. 2024-01-21T20:15:23.817 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:15:23.817 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.948+0000 7f9b9c92f700 1 Processor -- start 2024-01-21T20:15:23.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 -- start start 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b980bc6d0 0x7f9b98066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b980654f0 con 0x7f9b981546b0 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b98063700 con 0x7f9b980bc6d0 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.949+0000 7f9b9c92f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b98063950 con 0x7f9b98154a90 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b980bc6d0 0x7f9b98066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54586/0 (socket says 172.21.15.133:54586) 2024-01-21T20:15:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b980bc6d0 0x7f9b98066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:54000/0 (socket says 172.21.15.133:54000) 2024-01-21T20:15:23.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b95d9b700 1 -- 172.21.15.133:0/3224278919 learned_addr learned my addr 172.21.15.133:0/3224278919 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 -- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 msgr2=0x7f9b980a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 -- 172.21.15.133:0/3224278919 >> v1:172.21.15.178:6789/0 conn(0x7f9b981546b0 legacy=0x7f9b98065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 -- 172.21.15.133:0/3224278919 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98065180 con 0x7f9b980bc6d0 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b95d9b700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b96d9d700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98066090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9b90009e60 tx=0x7f9b90009780).ready entity=mon.1 client_cookie=e753ad182fc7105b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.950+0000 7f9b9559a700 1 -- 172.21.15.133:0/3224278919 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9000e070 con 0x7f9b980bc6d0 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9559a700 1 -- 172.21.15.133:0/3224278919 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9000bb60 con 0x7f9b980bc6d0 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9559a700 1 -- 172.21.15.133:0/3224278919 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90012410 con 0x7f9b980bc6d0 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 -- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 msgr2=0x7f9b98066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98066090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f9b90009e60 tx=0x7f9b90009780).stop 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 -- 172.21.15.133:0/3224278919 shutdown_connections 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98066090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/3224278919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 -- 172.21.15.133:0/3224278919 >> 172.21.15.133:0/3224278919 conn(0x7f9b980c8200 msgr2=0x7f9b980c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 -- 172.21.15.133:0/3224278919 shutdown_connections 2024-01-21T20:15:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.951+0000 7f9b9c92f700 1 -- 172.21.15.133:0/3224278919 wait complete. 2024-01-21T20:15:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.952+0000 7f9b9c92f700 1 Processor -- start 2024-01-21T20:15:23.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.952+0000 7f9b9c92f700 1 -- start start 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ab730 con 0x7f9b981546b0 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980aa720 con 0x7f9b980bc6d0 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9c92f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b980ab2a0 con 0x7f9b98154a90 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b95d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54866/0 (socket says 172.21.15.133:54866) 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b95d9b700 1 -- 172.21.15.133:0/2369895549 learned_addr learned my addr 172.21.15.133:0/2369895549 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b96d9d700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.953+0000 7f9b9659c700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 -- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 msgr2=0x7f9b980626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 -- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 msgr2=0x7f9b98157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 -- 172.21.15.133:0/2369895549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009370 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b95d9b700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f9b8c00ea50 tx=0x7f9b8c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00ee90 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00c7f0 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c00cb70 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b90009a20 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.954+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b980aac50 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.955+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9805fdf0 con 0x7f9b981546b0 2024-01-21T20:15:23.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.955+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9b8c01b400 con 0x7f9b981546b0 2024-01-21T20:15:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.956+0000 7f9b86ffd700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 0x7f9b78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.956+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f9b8c07a930 con 0x7f9b981546b0 2024-01-21T20:15:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.956+0000 7f9b9659c700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 0x7f9b78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:23.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.956+0000 7f9b9659c700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 0x7f9b78061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9b88003860 tx=0x7f9b88007d40).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:23.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:23.960+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9b8c04b950 con 0x7f9b981546b0 2024-01-21T20:15:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.165+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b980c4c80 con 0x7f9b981546b0 2024-01-21T20:15:24.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.165+0000 7f9b86ffd700 1 -- 172.21.15.133:0/2369895549 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f9b8c04ef70 con 0x7f9b981546b0 2024-01-21T20:15:24.155 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:24.155 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 msgr2=0x7f9b78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 0x7f9b78061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f9b88003860 tx=0x7f9b88007d40).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 msgr2=0x7f9b98146390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f9b8c00ea50 tx=0x7f9b8c0090f0).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 shutdown_connections 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9b7805f150 0x7f9b78061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b98154a90 0x7f9b980626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b980bc6d0 0x7f9b98157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 --2- 172.21.15.133:0/2369895549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b981546b0 0x7f9b98146390 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 >> 172.21.15.133:0/2369895549 conn(0x7f9b980c8200 msgr2=0x7f9b98151800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 shutdown_connections 2024-01-21T20:15:24.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.167+0000 7f9b9c92f700 1 -- 172.21.15.133:0/2369895549 wait complete. 2024-01-21T20:15:24.158 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:15:24.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:15:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.297+0000 7f489f126700 1 Processor -- start 2024-01-21T20:15:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.297+0000 7f489f126700 1 -- start start 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489f126700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4898067d90 0x7f4898137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489f126700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 0x7f48980c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489f126700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48980c6250 con 0x7f4898137030 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489f126700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4898068370 con 0x7f4898067d90 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489f126700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4898068650 con 0x7f48980c5930 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4898067d90 0x7f4898137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4898067d90 0x7f4898137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54878/0 (socket says 172.21.15.133:54878) 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 -- 172.21.15.133:0/966777517 learned_addr learned my addr 172.21.15.133:0/966777517 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489d6c3700 1 --2- 172.21.15.133:0/966777517 >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 0x7f48980c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 -- 172.21.15.133:0/966777517 >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 msgr2=0x7f48980c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 --2- 172.21.15.133:0/966777517 >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 0x7f48980c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 -- 172.21.15.133:0/966777517 >> v1:172.21.15.178:6789/0 conn(0x7f4898137030 legacy=0x7f4898155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 -- 172.21.15.133:0/966777517 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898068930 con 0x7f4898067d90 2024-01-21T20:15:24.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f489d6c3700 1 --2- 172.21.15.133:0/966777517 >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 0x7f48980c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.298+0000 7f4897fff700 1 --2- 172.21.15.133:0/966777517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898067d90 0x7f4898137410 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f4898066070 tx=0x7f48840090f0).ready entity=mon.0 client_cookie=3a647fd94e7a0091 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f48977fe700 1 -- 172.21.15.133:0/966777517 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400b5a0 con 0x7f4898067d90 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f48977fe700 1 -- 172.21.15.133:0/966777517 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488400b700 con 0x7f4898067d90 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f48977fe700 1 -- 172.21.15.133:0/966777517 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488400baa0 con 0x7f4898067d90 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 -- 172.21.15.133:0/966777517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898067d90 msgr2=0x7f4898137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 --2- 172.21.15.133:0/966777517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898067d90 0x7f4898137410 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7f4898066070 tx=0x7f48840090f0).stop 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 -- 172.21.15.133:0/966777517 shutdown_connections 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 --2- 172.21.15.133:0/966777517 >> v2:172.21.15.178:3300/0 conn(0x7f48980c5930 0x7f48980c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 --2- 172.21.15.133:0/966777517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898067d90 0x7f4898137410 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 -- 172.21.15.133:0/966777517 >> 172.21.15.133:0/966777517 conn(0x7f4898066a90 msgr2=0x7f4898066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 -- 172.21.15.133:0/966777517 shutdown_connections 2024-01-21T20:15:24.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.299+0000 7f489f126700 1 -- 172.21.15.133:0/966777517 wait complete. 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.300+0000 7f489f126700 1 Processor -- start 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.300+0000 7f489f126700 1 -- start start 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898067d90 0x7f48980abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c5930 0x7f4898136850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4898138b80 con 0x7f4898137030 2024-01-21T20:15:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4898165d80 con 0x7f4898067d90 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489f126700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4898166060 con 0x7f48980c5930 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489d6c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489d6c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54886/0 (socket says 172.21.15.133:54886) 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489d6c3700 1 -- 172.21.15.133:0/2006741776 learned_addr learned my addr 172.21.15.133:0/2006741776 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f489cec2700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898067d90 0x7f48980abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.301+0000 7f4897fff700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c5930 0x7f4898136850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 -- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c5930 msgr2=0x7f4898136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c5930 0x7f4898136850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 -- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898067d90 msgr2=0x7f48980abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898067d90 0x7f48980abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 -- 172.21.15.133:0/2006741776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884009370 con 0x7f4898137030 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489d6c3700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f489000a380 tx=0x7f4890007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890016470 con 0x7f4898137030 2024-01-21T20:15:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48900165d0 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890016950 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4898166340 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.302+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4898138730 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.303+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898138cf0 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.304+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4890013070 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.304+0000 7f48957fa700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 0x7f487c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.304+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f489007b0b0 con 0x7f4898137030 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.304+0000 7f489cec2700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 0x7f487c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.304+0000 7f489cec2700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 0x7f487c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f488c00b9b0 tx=0x7f488c008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.308+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f489004c130 con 0x7f4898137030 2024-01-21T20:15:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.473+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489805fdf0 con 0x7f4898137030 2024-01-21T20:15:24.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.474+0000 7f48957fa700 1 -- 172.21.15.133:0/2006741776 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+17874 (secure 0 0 0) 0x7f489004f750 con 0x7f4898137030 2024-01-21T20:15:24.463 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:24.463 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":108,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:15:22.805796+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.475+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 msgr2=0x7f487c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.475+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 0x7f487c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f488c00b9b0 tx=0x7f488c008040).stop 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.475+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 msgr2=0x7f4898165330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.475+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f489000a380 tx=0x7f4890007900).stop 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 shutdown_connections 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f487c05f150 0x7f487c061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4898137030 0x7f4898165330 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4898067d90 0x7f48980abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 --2- 172.21.15.133:0/2006741776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48980c5930 0x7f4898136850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 >> 172.21.15.133:0/2006741776 conn(0x7f4898066a90 msgr2=0x7f48980c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 shutdown_connections 2024-01-21T20:15:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.476+0000 7f489f126700 1 -- 172.21.15.133:0/2006741776 wait complete. 2024-01-21T20:15:24.477 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:15:24.479 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:15:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.605+0000 7fc36e257700 1 Processor -- start 2024-01-21T20:15:24.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.605+0000 7fc36e257700 1 -- start start 2024-01-21T20:15:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc36e257700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc368158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc36e257700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc368154520 0x7fc3680ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc36e257700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680ab620 con 0x7fc3680c6090 2024-01-21T20:15:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc36e257700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680c6ae0 con 0x7fc368154520 2024-01-21T20:15:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc36e257700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c05e0 con 0x7fc368154140 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc366ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc368154520 0x7fc3680ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc366ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc368154520 0x7fc3680ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:54032/0 (socket says 172.21.15.133:54032) 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc3677fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc368158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc367fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc3680c6090 0x7fc3680c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:60720/0 (socket says 172.21.15.133:60720) 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.606+0000 7fc366ffd700 1 -- 172.21.15.133:0/425795696 learned_addr learned my addr 172.21.15.133:0/425795696 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc366ffd700 1 -- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 msgr2=0x7fc368158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc366ffd700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc368158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc366ffd700 1 -- 172.21.15.133:0/425795696 >> v1:172.21.15.178:6789/0 conn(0x7fc3680c6090 legacy=0x7fc3680c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc366ffd700 1 -- 172.21.15.133:0/425795696 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680c0e40 con 0x7fc368154520 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc3667fc700 1 -- 172.21.15.133:0/425795696 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853716246 0 0) 0x7fc3680ab620 con 0x7fc3680c6090 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc3677fe700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc368158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc366ffd700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680ab130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fc358006fd0 tx=0x7fc3580090f0).ready entity=mon.1 client_cookie=304cc356be266f58 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc3667fc700 1 -- 172.21.15.133:0/425795696 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800b580 con 0x7fc368154520 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc3667fc700 1 -- 172.21.15.133:0/425795696 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35800b6e0 con 0x7fc368154520 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.607+0000 7fc3667fc700 1 -- 172.21.15.133:0/425795696 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35800ba60 con 0x7fc368154520 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 -- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 msgr2=0x7fc3680ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680ab130 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fc358006fd0 tx=0x7fc3580090f0).stop 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 -- 172.21.15.133:0/425795696 shutdown_connections 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc368158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 --2- 172.21.15.133:0/425795696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680ab130 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 -- 172.21.15.133:0/425795696 >> 172.21.15.133:0/425795696 conn(0x7fc36805e1e0 msgr2=0x7fc36805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 -- 172.21.15.133:0/425795696 shutdown_connections 2024-01-21T20:15:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.608+0000 7fc36e257700 1 -- 172.21.15.133:0/425795696 wait complete. 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.609+0000 7fc36e257700 1 Processor -- start 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.609+0000 7fc36e257700 1 -- start start 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc3680ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680aef00 con 0x7fc3680c6090 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680afcd0 con 0x7fc368154520 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc36e257700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680aff20 con 0x7fc368154140 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54888/0 (socket says 172.21.15.133:54888) 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 -- 172.21.15.133:0/3193015947 learned_addr learned my addr 172.21.15.133:0/3193015947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc366ffd700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc3680ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc367fff700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 -- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 msgr2=0x7fc3680ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc3680ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 -- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 msgr2=0x7fc3680aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc3677fe700 1 -- 172.21.15.133:0/3193015947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3500092a0 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.610+0000 7fc366ffd700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc3680ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc3677fe700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc35000ea20 tx=0x7fc350009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000ee60 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350009600 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc358009370 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35000ca60 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.611+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680b04e0 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.612+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36805fdf0 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.612+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc35001b400 con 0x7fc3680c6090 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.612+0000 7fc35ffff700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.613+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fc35007a980 con 0x7fc3680c6090 2024-01-21T20:15:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.613+0000 7fc366ffd700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.613+0000 7fc366ffd700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 0x7fc348061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc358006fd0 tx=0x7fc358017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.617+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc35004ba40 con 0x7fc3680c6090 2024-01-21T20:15:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.775+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3680c00f0 con 0x7fc34805f150 2024-01-21T20:15:24.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.785+0000 7fc35ffff700 1 -- 172.21.15.133:0/3193015947 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353259 (secure 0 0 0) 0x7fc3680c00f0 con 0x7fc34805f150 2024-01-21T20:15:24.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:24.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 msgr2=0x7fc348061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 0x7fc348061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc358006fd0 tx=0x7fc358017000).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 msgr2=0x7fc3680c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fc35000ea20 tx=0x7fc350009060).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 shutdown_connections 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc34805f150 0x7fc348061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc368154520 0x7fc3680aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3680c6090 0x7fc3680c47f0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 --2- 172.21.15.133:0/3193015947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc368154140 0x7fc3680ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 >> 172.21.15.133:0/3193015947 conn(0x7fc36805e1e0 msgr2=0x7fc3681481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 shutdown_connections 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.789+0000 7fc36e257700 1 -- 172.21.15.133:0/3193015947 wait complete. 2024-01-21T20:15:24.782 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:15:24.790 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:15:23.866979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419548,"kb_used_data":10012,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555172,"statfs":{"total":773094113280,"available":770616496128,"internally_reserved":0,"allocated":10252288,"data_stored":5301830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.514523"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421673+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417615+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423555+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426641+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419543+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423028+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418528+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419302+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419943+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418140+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421325+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423304+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421665+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424253+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422825+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420562+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422916+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423268+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419274+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420240+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423637+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418647+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424288+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426250+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420854+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418534+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418989+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425517+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419540+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421069+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426986+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422971+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420480+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425823+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418645+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421221+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424852+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418688+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421242+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425732+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420515+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418341+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417559+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417599+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423283+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426000+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424759+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420032+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418300+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419040+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419693+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423044+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419202+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442667+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:15:18.442667+0000","last_peered":"2024-01-21T20:15:18.442667+0000","last_clean":"2024-01-21T20:15:18.442667+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:15:18.442667+0000","last_undegraded":"2024-01-21T20:15:18.442667+0000","last_fullsized":"2024-01-21T20:15:18.442667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425318+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407883+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:15:18.407883+0000","last_peered":"2024-01-21T20:15:18.407883+0000","last_clean":"2024-01-21T20:15:18.407883+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:15:18.407883+0000","last_undegraded":"2024-01-21T20:15:18.407883+0000","last_fullsized":"2024-01-21T20:15:18.407883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422878+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:20.142766+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:15:20.142766+0000","last_peered":"2024-01-21T20:15:20.142766+0000","last_clean":"2024-01-21T20:15:20.142766+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:15:20.142766+0000","last_undegraded":"2024-01-21T20:15:20.142766+0000","last_fullsized":"2024-01-21T20:15:20.142766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407840+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:15:18.407840+0000","last_peered":"2024-01-21T20:15:18.407840+0000","last_clean":"2024-01-21T20:15:18.407840+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:15:18.407840+0000","last_undegraded":"2024-01-21T20:15:18.407840+0000","last_fullsized":"2024-01-21T20:15:18.407840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634209+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:15:19.634209+0000","last_peered":"2024-01-21T20:15:19.634209+0000","last_clean":"2024-01-21T20:15:19.634209+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:15:19.634209+0000","last_undegraded":"2024-01-21T20:15:19.634209+0000","last_fullsized":"2024-01-21T20:15:19.634209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420597+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634191+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:15:19.634191+0000","last_peered":"2024-01-21T20:15:19.634191+0000","last_clean":"2024-01-21T20:15:19.634191+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:15:19.634191+0000","last_undegraded":"2024-01-21T20:15:19.634191+0000","last_fullsized":"2024-01-21T20:15:19.634191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634194+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:15:19.634194+0000","last_peered":"2024-01-21T20:15:19.634194+0000","last_clean":"2024-01-21T20:15:19.634194+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:15:19.634194+0000","last_undegraded":"2024-01-21T20:15:19.634194+0000","last_fullsized":"2024-01-21T20:15:19.634194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418623+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442695+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:15:18.442695+0000","last_peered":"2024-01-21T20:15:18.442695+0000","last_clean":"2024-01-21T20:15:18.442695+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:15:18.442695+0000","last_undegraded":"2024-01-21T20:15:18.442695+0000","last_fullsized":"2024-01-21T20:15:18.442695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422882+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407845+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:15:18.407845+0000","last_peered":"2024-01-21T20:15:18.407845+0000","last_clean":"2024-01-21T20:15:18.407845+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:15:18.407845+0000","last_undegraded":"2024-01-21T20:15:18.407845+0000","last_fullsized":"2024-01-21T20:15:18.407845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1286144,"data_stored":666223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.62}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.48199999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.53200000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.436},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.497}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1273856,"data_stored":659418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.193},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.28799999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.25900000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.40999999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.499}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.26300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.36199999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.38900000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.37},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.35699999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.626}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":653879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.505}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.311}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.33300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:15:24.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:15:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.957+0000 7f8cddd08700 1 Processor -- start 2024-01-21T20:15:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.957+0000 7f8cddd08700 1 -- start start 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cddd08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8cd8062e00 0x7f8cd80a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cddd08700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80654e0 con 0x7f8cd813aa00 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cddd08700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8158730 con 0x7f8cd813a620 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cddd08700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80bd6f0 con 0x7f8cd8062e00 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8cd8062e00 0x7f8cd80a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8cd8062e00 0x7f8cd80a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54896/0 (socket says 172.21.15.133:54896) 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 -- 172.21.15.133:0/590668687 learned_addr learned my addr 172.21.15.133:0/590668687 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8cd813aa00 0x7f8cd8065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39810/0 (socket says 172.21.15.133:39810) 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 -- 172.21.15.133:0/590668687 >> v1:172.21.15.178:6789/0 conn(0x7f8cd813a620 legacy=0x7f8cd80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 -- 172.21.15.133:0/590668687 >> v1:172.21.15.133:6789/0 conn(0x7f8cd813aa00 legacy=0x7f8cd8065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd67fc700 1 -- 172.21.15.133:0/590668687 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786347250 0 0) 0x7f8cd80654e0 con 0x7f8cd813aa00 2024-01-21T20:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 -- 172.21.15.133:0/590668687 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8158a10 con 0x7f8cd8062e00 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.958+0000 7f8cd6ffd700 1 --2- 172.21.15.133:0/590668687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd80a6e30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f8cc8006fd0 tx=0x7f8cc80090f0).ready entity=mon.0 client_cookie=53d38bf27bc4e82e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cd67fc700 1 -- 172.21.15.133:0/590668687 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800b600 con 0x7f8cd8062e00 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cd67fc700 1 -- 172.21.15.133:0/590668687 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc800b760 con 0x7f8cd8062e00 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cd67fc700 1 -- 172.21.15.133:0/590668687 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc800bb00 con 0x7f8cd8062e00 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 -- 172.21.15.133:0/590668687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 msgr2=0x7f8cd80a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 --2- 172.21.15.133:0/590668687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd80a6e30 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f8cc8006fd0 tx=0x7f8cc80090f0).stop 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 -- 172.21.15.133:0/590668687 shutdown_connections 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 --2- 172.21.15.133:0/590668687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd80a6e30 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 -- 172.21.15.133:0/590668687 >> 172.21.15.133:0/590668687 conn(0x7f8cd80c7dc0 msgr2=0x7f8cd80c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 -- 172.21.15.133:0/590668687 shutdown_connections 2024-01-21T20:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.959+0000 7f8cddd08700 1 -- 172.21.15.133:0/590668687 wait complete. 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.961+0000 7f8cddd08700 1 Processor -- start 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.961+0000 7f8cddd08700 1 -- start start 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8cd813a620 0x7f8cd80bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cd813aa00 0x7f8cd80bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8165b20 con 0x7f8cd8062e00 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80bf840 con 0x7f8cd813aa00 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cddd08700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8166960 con 0x7f8cd813a620 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54900/0 (socket says 172.21.15.133:54900) 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 -- 172.21.15.133:0/1563975945 learned_addr learned my addr 172.21.15.133:0/1563975945 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd7fff700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cd813aa00 0x7f8cd80bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd6ffd700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8cd813a620 0x7f8cd80bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 -- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8cd813a620 msgr2=0x7f8cd80bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8cd813a620 0x7f8cd80bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 -- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cd813aa00 msgr2=0x7f8cd80bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cd813aa00 0x7f8cd80bf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 -- 172.21.15.133:0/1563975945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8009370 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cd77fe700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f8ccc00c470 tx=0x7f8ccc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.962+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00f470 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.963+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00f5f0 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.963+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00f9b0 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.963+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd8165d90 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.963+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8166310 con 0x7f8cd8062e00 2024-01-21T20:15:24.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.964+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd805fdf0 con 0x7f8cd8062e00 2024-01-21T20:15:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.964+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8ccc012400 con 0x7f8cd8062e00 2024-01-21T20:15:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.964+0000 7f8cbffff700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 0x7f8cc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.964+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f8ccc079950 con 0x7f8cd8062e00 2024-01-21T20:15:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.964+0000 7f8cd6ffd700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 0x7f8cc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:24.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.965+0000 7f8cd6ffd700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 0x7f8cc4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8cd8063200 tx=0x7f8cc8017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:24.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:24.968+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8ccc048b00 con 0x7f8cd8062e00 2024-01-21T20:15:25.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.128+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cd81666b0 con 0x7f8cc405f150 2024-01-21T20:15:25.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.137+0000 7f8cbffff700 1 -- 172.21.15.133:0/1563975945 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353259 (secure 0 0 0) 0x7f8cd81666b0 con 0x7f8cc405f150 2024-01-21T20:15:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 msgr2=0x7f8cc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 0x7f8cc4061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8cd8063200 tx=0x7f8cc8017000).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 msgr2=0x7f8cd8139840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f8ccc00c470 tx=0x7f8ccc007de0).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 shutdown_connections 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cc405f150 0x7f8cc4061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8cd813aa00 0x7f8cd80bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cd8062e00 0x7f8cd8139840 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 --2- 172.21.15.133:0/1563975945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8cd813a620 0x7f8cd80bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 >> 172.21.15.133:0/1563975945 conn(0x7f8cd80c7dc0 msgr2=0x7f8cd8155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 shutdown_connections 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.141+0000 7f8cddd08700 1 -- 172.21.15.133:0/1563975945 wait complete. 2024-01-21T20:15:25.134 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:15:25.142 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:15:23.866979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419548,"kb_used_data":10012,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555172,"statfs":{"total":773094113280,"available":770616496128,"internally_reserved":0,"allocated":10252288,"data_stored":5301830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.514523"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421673+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417615+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423555+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426641+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419543+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423028+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418528+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419302+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419943+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418140+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421325+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423304+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421665+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424253+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422825+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420562+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422916+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423268+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419274+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420240+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423637+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418647+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424288+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426250+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420854+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418534+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418989+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425517+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419540+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421069+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426986+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422971+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420480+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425823+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418645+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421221+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424852+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418688+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421242+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425732+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420515+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418341+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417559+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417599+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423283+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426000+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424759+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420032+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418300+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419040+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419693+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423044+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419202+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442667+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:15:18.442667+0000","last_peered":"2024-01-21T20:15:18.442667+0000","last_clean":"2024-01-21T20:15:18.442667+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:15:18.442667+0000","last_undegraded":"2024-01-21T20:15:18.442667+0000","last_fullsized":"2024-01-21T20:15:18.442667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425318+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407883+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:15:18.407883+0000","last_peered":"2024-01-21T20:15:18.407883+0000","last_clean":"2024-01-21T20:15:18.407883+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:15:18.407883+0000","last_undegraded":"2024-01-21T20:15:18.407883+0000","last_fullsized":"2024-01-21T20:15:18.407883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422878+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:20.142766+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:15:20.142766+0000","last_peered":"2024-01-21T20:15:20.142766+0000","last_clean":"2024-01-21T20:15:20.142766+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:15:20.142766+0000","last_undegraded":"2024-01-21T20:15:20.142766+0000","last_fullsized":"2024-01-21T20:15:20.142766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407840+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:15:18.407840+0000","last_peered":"2024-01-21T20:15:18.407840+0000","last_clean":"2024-01-21T20:15:18.407840+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:15:18.407840+0000","last_undegraded":"2024-01-21T20:15:18.407840+0000","last_fullsized":"2024-01-21T20:15:18.407840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634209+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:15:19.634209+0000","last_peered":"2024-01-21T20:15:19.634209+0000","last_clean":"2024-01-21T20:15:19.634209+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:15:19.634209+0000","last_undegraded":"2024-01-21T20:15:19.634209+0000","last_fullsized":"2024-01-21T20:15:19.634209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420597+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634191+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:15:19.634191+0000","last_peered":"2024-01-21T20:15:19.634191+0000","last_clean":"2024-01-21T20:15:19.634191+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:15:19.634191+0000","last_undegraded":"2024-01-21T20:15:19.634191+0000","last_fullsized":"2024-01-21T20:15:19.634191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634194+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:15:19.634194+0000","last_peered":"2024-01-21T20:15:19.634194+0000","last_clean":"2024-01-21T20:15:19.634194+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:15:19.634194+0000","last_undegraded":"2024-01-21T20:15:19.634194+0000","last_fullsized":"2024-01-21T20:15:19.634194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418623+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442695+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:15:18.442695+0000","last_peered":"2024-01-21T20:15:18.442695+0000","last_clean":"2024-01-21T20:15:18.442695+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:15:18.442695+0000","last_undegraded":"2024-01-21T20:15:18.442695+0000","last_fullsized":"2024-01-21T20:15:18.442695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422882+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407845+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:15:18.407845+0000","last_peered":"2024-01-21T20:15:18.407845+0000","last_clean":"2024-01-21T20:15:18.407845+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:15:18.407845+0000","last_undegraded":"2024-01-21T20:15:18.407845+0000","last_fullsized":"2024-01-21T20:15:18.407845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1286144,"data_stored":666223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.62}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.48199999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.53200000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.436},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.497}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1273856,"data_stored":659418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.193},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.28799999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.25900000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.40999999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.499}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.26300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.36199999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.38900000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.37},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.35699999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.626}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":653879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.505}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.311}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.33300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:15:25.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:15:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.308+0000 7f1144a20700 1 Processor -- start 2024-01-21T20:15:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.308+0000 7f1144a20700 1 -- start start 2024-01-21T20:15:25.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f1144a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11400bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f1144a20700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1140152380 0x7f11400a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f1144a20700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1140069ca0 con 0x7f11400626f0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f1144a20700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400c6a40 con 0x7f1140152380 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f1144a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140069650 con 0x7f1140151fa0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f113ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f11400626f0 0x7f1140062ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39812/0 (socket says 172.21.15.133:39812) 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f113ed9d700 1 -- 172.21.15.133:0/1024650964 learned_addr learned my addr 172.21.15.133:0/1024650964 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f113dd9b700 1 --2- 172.21.15.133:0/1024650964 >> v2:172.21.15.178:3300/0 conn(0x7f1140152380 0x7f11400a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f113e59c700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11400bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.309+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640774995 0 0) 0x7f1140069ca0 con 0x7f11400626f0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11280033f0 con 0x7f11400626f0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934838020 0 0) 0x7f11280033f0 con 0x7f11400626f0 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 msgr2=0x7f11400bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11400bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 >> v2:172.21.15.178:3300/0 conn(0x7f1140152380 msgr2=0x7f11400a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 --2- 172.21.15.133:0/1024650964 >> v2:172.21.15.178:3300/0 conn(0x7f1140152380 0x7f11400a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140069930 con 0x7f11400626f0 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f11380017f0 con 0x7f11400626f0 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 >> v1:172.21.15.133:6789/0 conn(0x7f11400626f0 legacy=0x7f1140062ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11280038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1128003e10 0x7f1128004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004b80 0x7f1128005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400c6a40 con 0x7f1128003e10 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140069650 con 0x7f1128004b80 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112800b8e0 con 0x7f1140151fa0 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1128003e10 0x7f1128004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113e59c700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11280038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113ed9d700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004b80 0x7f1128005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 -- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 msgr2=0x7f11280038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140151fa0 0x7f11280038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 -- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004b80 msgr2=0x7f1128005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004b80 0x7f1128005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 -- 172.21.15.133:0/1024650964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280033f0 con 0x7f1128003e10 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113dd9b700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1128003e10 0x7f1128004690 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f11400c7520 tx=0x7f1134009060).ready entity=mon.0 client_cookie=dd8b4e0e533bbe5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.310+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134009e90 con 0x7f1128003e10 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1134009430 con 0x7f1128003e10 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f113d59a700 1 -- 172.21.15.133:0/1024650964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113400e820 con 0x7f1128003e10 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 -- 172.21.15.133:0/1024650964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1128003e10 msgr2=0x7f1128004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 --2- 172.21.15.133:0/1024650964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1128003e10 0x7f1128004690 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f11400c7520 tx=0x7f1134009060).stop 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f113ed9d700 1 -- 172.21.15.133:0/1024650964 reap_dead start 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 -- 172.21.15.133:0/1024650964 shutdown_connections 2024-01-21T20:15:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 -- 172.21.15.133:0/1024650964 >> 172.21.15.133:0/1024650964 conn(0x7f11400c7de0 msgr2=0x7f11400c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 -- 172.21.15.133:0/1024650964 shutdown_connections 2024-01-21T20:15:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.311+0000 7f1144a20700 1 -- 172.21.15.133:0/1024650964 wait complete. 2024-01-21T20:15:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.313+0000 7f1144a20700 1 Processor -- start 2024-01-21T20:15:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.313+0000 7f1144a20700 1 -- start start 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128003e10 0x7f11400aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140146000 0x7f11400a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400adef0 con 0x7f11400a7d90 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400a88e0 con 0x7f1128003e10 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f1144a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400a9050 con 0x7f1140146000 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54930/0 (socket says 172.21.15.133:54930) 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 -- 172.21.15.133:0/2651322343 learned_addr learned my addr 172.21.15.133:0/2651322343 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113dd9b700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140146000 0x7f11400a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113e59c700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128003e10 0x7f11400aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 -- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140146000 msgr2=0x7f11400a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140146000 0x7f11400a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 -- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128003e10 msgr2=0x7f11400aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128003e10 0x7f11400aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 -- 172.21.15.133:0/2651322343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400a8320 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.314+0000 7f113ed9d700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f1138001350 tx=0x7f1138007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.315+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380079e0 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.315+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800e830 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.315+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11400a8600 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.315+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800ebd0 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.315+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400bf880 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.316+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114005fdf0 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.316+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f11380133e0 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.317+0000 7f112effd700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 0x7f1120061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.317+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f113807a480 con 0x7f11400a7d90 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.317+0000 7f113e59c700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 0x7f1120061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.317+0000 7f113e59c700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 0x7f1120061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1130006d80 tx=0x7f1130009060).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.321+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f113804b540 con 0x7f11400a7d90 2024-01-21T20:15:25.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.482+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1140063230 con 0x7f112005f150 2024-01-21T20:15:25.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.492+0000 7f112effd700 1 -- 172.21.15.133:0/2651322343 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353259 (secure 0 0 0) 0x7f1140063230 con 0x7f112005f150 2024-01-21T20:15:25.485 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 msgr2=0x7f1120061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 0x7f1120061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1130006d80 tx=0x7f1130009060).stop 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 msgr2=0x7f114014e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f1138001350 tx=0x7f1138007f40).stop 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 shutdown_connections 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f112005f150 0x7f1120061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11400a7d90 0x7f114014e400 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128003e10 0x7f11400aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 --2- 172.21.15.133:0/2651322343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1140146000 0x7f11400a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 >> 172.21.15.133:0/2651322343 conn(0x7f11400c7de0 msgr2=0x7f11400a4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:25.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 shutdown_connections 2024-01-21T20:15:25.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.495+0000 7f1144a20700 1 -- 172.21.15.133:0/2651322343 wait complete. 2024-01-21T20:15:25.489 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:15:25.496 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:15:23.866979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2419548,"kb_used_data":10012,"kb_used_omap":0,"kb_used_meta":2409472,"kb_avail":752555172,"statfs":{"total":773094113280,"available":770616496128,"internally_reserved":0,"allocated":10252288,"data_stored":5301830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2467299328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.514523"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421673+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417615+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423555+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426641+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419543+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423028+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418528+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419302+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419943+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418140+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421325+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423304+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421665+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424253+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422825+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420562+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422916+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423268+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419274+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420240+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423637+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418647+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424288+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426250+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420854+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418534+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418989+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425517+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419540+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421069+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426986+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422971+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420480+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425823+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418645+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421221+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424852+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418688+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.421242+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425732+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420515+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422887+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418341+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417559+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417599+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423283+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.426000+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.424759+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420032+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418300+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419040+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419693+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.423044+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.419202+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442667+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:15:18.442667+0000","last_peered":"2024-01-21T20:15:18.442667+0000","last_clean":"2024-01-21T20:15:18.442667+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:15:18.442667+0000","last_undegraded":"2024-01-21T20:15:18.442667+0000","last_fullsized":"2024-01-21T20:15:18.442667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.425318+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407883+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:15:18.407883+0000","last_peered":"2024-01-21T20:15:18.407883+0000","last_clean":"2024-01-21T20:15:18.407883+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:15:18.407883+0000","last_undegraded":"2024-01-21T20:15:18.407883+0000","last_fullsized":"2024-01-21T20:15:18.407883+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422878+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":87,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:20.142766+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:15:20.142766+0000","last_peered":"2024-01-21T20:15:20.142766+0000","last_clean":"2024-01-21T20:15:20.142766+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:15:20.142766+0000","last_undegraded":"2024-01-21T20:15:20.142766+0000","last_fullsized":"2024-01-21T20:15:20.142766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.417748+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":91,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407840+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:15:18.407840+0000","last_peered":"2024-01-21T20:15:18.407840+0000","last_clean":"2024-01-21T20:15:18.407840+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:15:18.407840+0000","last_undegraded":"2024-01-21T20:15:18.407840+0000","last_fullsized":"2024-01-21T20:15:18.407840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":84,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634209+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:15:19.634209+0000","last_peered":"2024-01-21T20:15:19.634209+0000","last_clean":"2024-01-21T20:15:19.634209+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:15:19.634209+0000","last_undegraded":"2024-01-21T20:15:19.634209+0000","last_fullsized":"2024-01-21T20:15:19.634209+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.420597+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634191+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:15:19.634191+0000","last_peered":"2024-01-21T20:15:19.634191+0000","last_clean":"2024-01-21T20:15:19.634191+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:15:19.634191+0000","last_undegraded":"2024-01-21T20:15:19.634191+0000","last_fullsized":"2024-01-21T20:15:19.634191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422777+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":82,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:19.634194+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:15:19.634194+0000","last_peered":"2024-01-21T20:15:19.634194+0000","last_clean":"2024-01-21T20:15:19.634194+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:15:19.634194+0000","last_undegraded":"2024-01-21T20:15:19.634194+0000","last_fullsized":"2024-01-21T20:15:19.634194+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.418623+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.442695+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:15:18.442695+0000","last_peered":"2024-01-21T20:15:18.442695+0000","last_clean":"2024-01-21T20:15:18.442695+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:15:18.442695+0000","last_undegraded":"2024-01-21T20:15:18.442695+0000","last_fullsized":"2024-01-21T20:15:18.442695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:15:21.415632+0000","last_change":"2024-01-21T20:15:21.415632+0000","last_active":"2024-01-21T20:15:21.415632+0000","last_peered":"2024-01-21T20:15:21.415632+0000","last_clean":"2024-01-21T20:15:21.415632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:21.415632+0000","last_undegraded":"2024-01-21T20:15:21.415632+0000","last_fullsized":"2024-01-21T20:15:21.415632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:15:20.409024+0000","last_change":"2024-01-21T20:15:20.422882+0000","last_active":"2024-01-21T20:15:20.409024+0000","last_peered":"2024-01-21T20:15:20.409024+0000","last_clean":"2024-01-21T20:15:20.409024+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:15:20.409024+0000","last_undegraded":"2024-01-21T20:15:20.409024+0000","last_fullsized":"2024-01-21T20:15:20.409024+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-01-21T20:15:18.407845+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:15:18.407845+0000","last_peered":"2024-01-21T20:15:18.407845+0000","last_clean":"2024-01-21T20:15:18.407845+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:15:18.407845+0000","last_undegraded":"2024-01-21T20:15:18.407845+0000","last_fullsized":"2024-01-21T20:15:18.407845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1256,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1286144,"data_stored":666223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.439},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.40899999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.62}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.48199999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.46400000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.84199999999999997,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.80400000000000005,"5min":1.083,"15min":1.083},"last":0.53200000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.41799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.78700000000000003,"5min":1.107,"15min":1.107},"last":0.436},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.34799999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":1.016,"15min":1.016},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.40500000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95799999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68799999999999994,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.57799999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":0.497}]},{"osd":4,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45300000000000001,"15min":0.45500000000000002},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.314,"15min":0.27500000000000002},"max":{"1min":0.59999999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.497},"min":{"1min":0.35299999999999998,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.82299999999999995,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.60799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53200000000000003,"15min":0.53400000000000003},"min":{"1min":0.39300000000000002,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.82799999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54100000000000004,"15min":0.54000000000000004},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80900000000000005,"5min":0.85499999999999998,"15min":0.86899999999999999},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1273856,"data_stored":659418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.193},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.28799999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.25900000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.40999999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.499}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302452,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069388,"statfs":{"total":96636764160,"available":96327053312,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.34499999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.26300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.36199999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.82299999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.72299999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302440,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069400,"statfs":{"total":96636764160,"available":96327065600,"internally_reserved":0,"allocated":1277952,"data_stored":660379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.38900000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.37},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.35699999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.626}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.46200000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302428,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069412,"statfs":{"total":96636764160,"available":96327077888,"internally_reserved":0,"allocated":1265664,"data_stored":653879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.45400000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.52400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.505}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.60599999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306548,"kb_used_data":1260,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065292,"statfs":{"total":96636764160,"available":96322859008,"internally_reserved":0,"allocated":1290240,"data_stored":667184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.311}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.33300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:15:25.504 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2024-01-21T20:15:25.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-01-21T20:15:25.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421673+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.417615+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.425748+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2024-01-21T20:15:25.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423555+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.426641+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419543+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423028+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.726 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418528+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419302+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419943+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2024-01-21T20:15:25.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418140+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421325+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-01-21T20:15:25.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423887+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423304+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421665+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:15:25.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.424253+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.424777+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-01-21T20:15:25.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422825+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420562+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422916+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-01-21T20:15:25.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423268+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419274+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420240+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423637+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418647+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-01-21T20:15:25.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.424288+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.426250+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420854+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-01-21T20:15:25.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418534+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418989+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.425517+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.735 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419540+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421069+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.426986+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2024-01-21T20:15:25.736 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422971+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420480+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-01-21T20:15:25.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.425823+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418645+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421221+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-01-21T20:15:25.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.424852+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418688+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.421242+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2024-01-21T20:15:25.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-01-21T20:15:25.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.425732+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-01-21T20:15:25.740 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420515+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422887+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-01-21T20:15:25.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418341+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.417559+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.417599+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423283+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.426000+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2024-01-21T20:15:25.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.424759+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420032+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-01-21T20:15:25.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418300+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419040+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419693+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.423044+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.419202+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2024-01-21T20:15:25.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.425318+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422878+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-01-21T20:15:25.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.417748+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.420597+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-01-21T20:15:25.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422777+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.418623+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:15:21.415632+0000', 'last_change': '2024-01-21T20:15:21.415632+0000', 'last_active': '2024-01-21T20:15:21.415632+0000', 'last_peered': '2024-01-21T20:15:21.415632+0000', 'last_clean': '2024-01-21T20:15:21.415632+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:21.415632+0000', 'last_undegraded': '2024-01-21T20:15:21.415632+0000', 'last_fullsized': '2024-01-21T20:15:21.415632+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:21.415632+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-01-21T20:15:25.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:15:20.409024+0000', 'last_change': '2024-01-21T20:15:20.422882+0000', 'last_active': '2024-01-21T20:15:20.409024+0000', 'last_peered': '2024-01-21T20:15:20.409024+0000', 'last_clean': '2024-01-21T20:15:20.409024+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:15:20.409024+0000', 'last_undegraded': '2024-01-21T20:15:20.409024+0000', 'last_fullsized': '2024-01-21T20:15:20.409024+0000', 'mapping_epoch': 105, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 105, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'last_clean_scrub_stamp': '2024-01-21T20:15:20.409024+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:15:25.750 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T20:15:25.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.879+0000 7fa5f6f04700 1 Processor -- start 2024-01-21T20:15:25.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.879+0000 7fa5f6f04700 1 -- start start 2024-01-21T20:15:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f6f04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa5f014b6c0 0x7fa5f00c2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f6f04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5f00bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f6f04700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00c46d0 con 0x7fa5f00c3450 2024-01-21T20:15:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f6f04700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f00c38d0 con 0x7fa5f014b6c0 2024-01-21T20:15:25.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f6f04700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f014baa0 con 0x7fa5f0069cc0 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5effff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa5f00c3450 0x7fa5f00695b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39820/0 (socket says 172.21.15.133:39820) 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5effff700 1 -- 172.21.15.133:0/1608258248 learned_addr learned my addr 172.21.15.133:0/1608258248 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f4ca0700 1 --2- 172.21.15.133:0/1608258248 >> v2:172.21.15.178:3300/0 conn(0x7fa5f014b6c0 0x7fa5f00c2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5f54a1700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5f00bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404128697 0 0) 0x7fa5f00c46d0 con 0x7fa5f00c3450 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e00033f0 con 0x7fa5f00c3450 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024299870 0 0) 0x7fa5e00033f0 con 0x7fa5f00c3450 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 msgr2=0x7fa5f00bd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5f00bd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 >> v2:172.21.15.178:3300/0 conn(0x7fa5f014b6c0 msgr2=0x7fa5f00c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.880+0000 7fa5ef7fe700 1 --2- 172.21.15.133:0/1608258248 >> v2:172.21.15.178:3300/0 conn(0x7fa5f014b6c0 0x7fa5f00c2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00c3ac0 con 0x7fa5f00c3450 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fa5dc001470 con 0x7fa5f00c3450 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 >> v1:172.21.15.133:6789/0 conn(0x7fa5f00c3450 legacy=0x7fa5f00695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5e00038e0 0x7fa5e0003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5e0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f014baa0 con 0x7fa5e0004690 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e000b8e0 con 0x7fa5e00038e0 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e000ba20 con 0x7fa5f0069cc0 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5e0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5f4ca0700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5e00038e0 0x7fa5e0003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5f54a1700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 -- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 msgr2=0x7fa5e0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5e0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 -- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5e00038e0 msgr2=0x7fa5e0003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5e00038e0 0x7fa5e0003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 -- 172.21.15.133:0/1608258248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00033f0 con 0x7fa5e0004690 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5f54a1700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0069cc0 0x7fa5e0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5effff700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5e0004b10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa5dc00c210 tx=0x7fa5dc001e90).ready entity=mon.0 client_cookie=b4206aeaa817ad3d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc007a60 con 0x7fa5e0004690 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00cae0 con 0x7fa5e0004690 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.881+0000 7fa5ef7fe700 1 -- 172.21.15.133:0/1608258248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00ce60 con 0x7fa5e0004690 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 -- 172.21.15.133:0/1608258248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 msgr2=0x7fa5e0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/1608258248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5e0004b10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7fa5dc00c210 tx=0x7fa5dc001e90).stop 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f54a1700 1 -- 172.21.15.133:0/1608258248 reap_dead start 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 -- 172.21.15.133:0/1608258248 shutdown_connections 2024-01-21T20:15:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 -- 172.21.15.133:0/1608258248 >> 172.21.15.133:0/1608258248 conn(0x7fa5f00c7de0 msgr2=0x7fa5f00c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 -- 172.21.15.133:0/1608258248 shutdown_connections 2024-01-21T20:15:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.882+0000 7fa5f6f04700 1 -- 172.21.15.133:0/1608258248 wait complete. 2024-01-21T20:15:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.883+0000 7fa5f6f04700 1 Processor -- start 2024-01-21T20:15:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.883+0000 7fa5f6f04700 1 -- start start 2024-01-21T20:15:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.884+0000 7fa5f6f04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.884+0000 7fa5f6f04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f00c6df0 0x7fa5f00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f00c4c50 0x7fa5f01637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c0080 con 0x7fa5e0004690 2024-01-21T20:15:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0155930 con 0x7fa5f00c4c50 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c7330 con 0x7fa5f00c6df0 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54948/0 (socket says 172.21.15.133:54948) 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 -- 172.21.15.133:0/2928356805 learned_addr learned my addr 172.21.15.133:0/2928356805 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5effff700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f00c6df0 0x7fa5f00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f54a1700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f00c4c50 0x7fa5f01637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 -- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f00c6df0 msgr2=0x7fa5f00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f00c6df0 0x7fa5f00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 -- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f00c4c50 msgr2=0x7fa5f01637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f00c4c50 0x7fa5f01637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 -- 172.21.15.133:0/2928356805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f00c7610 con 0x7fa5e0004690 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f4ca0700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fa5e40119f0 tx=0x7fa5e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400f940 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400faa0 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00c78f0 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400fe20 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.885+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f0163ea0 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.886+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f005fdf0 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.886+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa5e4014650 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.887+0000 7fa5ed7fa700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 0x7fa5d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.887+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa5e407b070 con 0x7fa5e0004690 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.887+0000 7fa5effff700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 0x7fa5d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.887+0000 7fa5effff700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 0x7fa5d4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa5dc001ed0 tx=0x7fa5dc015000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:25.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:25.891+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa5e404c0f0 con 0x7fa5e0004690 2024-01-21T20:15:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.120+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa5f00bfe50 con 0x7fa5e0004690 2024-01-21T20:15:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.121+0000 7fa5ed7fa700 1 -- 172.21.15.133:0/2928356805 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3175 (secure 0 0 0) 0x7fa5e4018020 con 0x7fa5e0004690 2024-01-21T20:15:26.111 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:26.111 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":997,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":108,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2477617152,"bytes_avail":770616496128,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":36,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7161}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-01-21T20:14:40.530330+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-21T20:15:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 msgr2=0x7fa5d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 0x7fa5d4061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa5dc001ed0 tx=0x7fa5dc015000).stop 2024-01-21T20:15:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 msgr2=0x7fa5f0155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7fa5e40119f0 tx=0x7fa5e4009060).stop 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 shutdown_connections 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa5d405f150 0x7fa5d4061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f00c4c50 0x7fa5f01637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5e0004690 0x7fa5f0155440 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 --2- 172.21.15.133:0/2928356805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f00c6df0 0x7fa5f00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 >> 172.21.15.133:0/2928356805 conn(0x7fa5f00c7de0 msgr2=0x7fa5f014a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 shutdown_connections 2024-01-21T20:15:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.123+0000 7fa5f6f04700 1 -- 172.21.15.133:0/2928356805 wait complete. 2024-01-21T20:15:26.124 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T20:15:26.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:15:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.291+0000 7f665f309700 1 Processor -- start 2024-01-21T20:15:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.291+0000 7f665f309700 1 -- start start 2024-01-21T20:15:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665f309700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f6658065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665f309700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6658065b50 0x7f66580bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665f309700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6658069ef0 con 0x7f6658062c10 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665f309700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6658065fe0 con 0x7f6658065b50 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665f309700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665806a130 con 0x7f6658062ff0 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6658065b50 0x7f66580bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6658065b50 0x7f66580bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54956/0 (socket says 172.21.15.133:54956) 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 -- 172.21.15.133:0/3922075863 learned_addr learned my addr 172.21.15.133:0/3922075863 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665c8a4700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f6658065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 -- 172.21.15.133:0/3922075863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 msgr2=0x7f6658065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f6658065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 -- 172.21.15.133:0/3922075863 >> v1:172.21.15.178:6789/0 conn(0x7f6658062c10 legacy=0x7f66580697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 -- 172.21.15.133:0/3922075863 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665806a410 con 0x7f6658065b50 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f665d8a6700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658065b50 0x7f66580bd770 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f6650009f20 tx=0x7f6650009840).ready entity=mon.0 client_cookie=a50a2bf669724d96 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f664ffff700 1 -- 172.21.15.133:0/3922075863 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000e070 con 0x7f6658065b50 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f664ffff700 1 -- 172.21.15.133:0/3922075863 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665000ba80 con 0x7f6658065b50 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.292+0000 7f664ffff700 1 -- 172.21.15.133:0/3922075863 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665000be00 con 0x7f6658065b50 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 -- 172.21.15.133:0/3922075863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658065b50 msgr2=0x7f66580bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658065b50 0x7f66580bd770 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f6650009f20 tx=0x7f6650009840).stop 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 -- 172.21.15.133:0/3922075863 shutdown_connections 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658065b50 0x7f66580bd770 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 --2- 172.21.15.133:0/3922075863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f6658065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 -- 172.21.15.133:0/3922075863 >> 172.21.15.133:0/3922075863 conn(0x7f66580c8010 msgr2=0x7f66580c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 -- 172.21.15.133:0/3922075863 shutdown_connections 2024-01-21T20:15:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.293+0000 7f665f309700 1 -- 172.21.15.133:0/3922075863 wait complete. 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.295+0000 7f665f309700 1 Processor -- start 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.295+0000 7f665f309700 1 -- start start 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f66580aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6658065b50 0x7f665813a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580ab990 con 0x7f6658062c10 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580aa870 con 0x7f6658065b50 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580aaad0 con 0x7f6658062ff0 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54966/0 (socket says 172.21.15.133:54966) 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 -- 172.21.15.133:0/1769138818 learned_addr learned my addr 172.21.15.133:0/1769138818 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d8a6700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6658065b50 0x7f665813a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665c8a4700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f66580aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 -- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 msgr2=0x7f66580aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f66580aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 -- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6658065b50 msgr2=0x7f665813a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6658065b50 0x7f665813a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 -- 172.21.15.133:0/1769138818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009ae0 con 0x7f6658062c10 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665d0a5700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f665400c440 tx=0x7f6654007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654007020 con 0x7f6658062c10 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6654007180 con 0x7f6658062c10 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66580ab060 con 0x7f6658062c10 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.296+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6654007520 con 0x7f6658062c10 2024-01-21T20:15:26.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.297+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66580ab620 con 0x7f6658062c10 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.297+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665805fdf0 con 0x7f6658062c10 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.298+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f66540068b0 con 0x7f6658062c10 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.298+0000 7f664dffb700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 0x7f663c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.298+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f6654079650 con 0x7f6658062c10 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.298+0000 7f665c8a4700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 0x7f663c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:26.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.298+0000 7f665c8a4700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 0x7f663c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6648006fd0 tx=0x7f6648008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:26.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.302+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6654047b00 con 0x7f6658062c10 2024-01-21T20:15:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.461+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66580abad0 con 0x7f663c05f150 2024-01-21T20:15:26.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.471+0000 7f664dffb700 1 -- 172.21.15.133:0/1769138818 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362184 (secure 0 0 0) 0x7f664800f630 con 0x7f663c05f150 2024-01-21T20:15:26.464 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.474+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 msgr2=0x7f663c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.474+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 0x7f663c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6648006fd0 tx=0x7f6648008040).stop 2024-01-21T20:15:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.474+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 msgr2=0x7f6658165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:26.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.474+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f665400c440 tx=0x7f6654007e00).stop 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 shutdown_connections 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f663c05f150 0x7f663c061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6658065b50 0x7f665813a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6658062c10 0x7f6658165380 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 --2- 172.21.15.133:0/1769138818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6658062ff0 0x7f66580aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 >> 172.21.15.133:0/1769138818 conn(0x7f66580c8010 msgr2=0x7f665813cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 shutdown_connections 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:26.475+0000 7f665f309700 1 -- 172.21.15.133:0/1769138818 wait complete. 2024-01-21T20:15:26.468 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:15:26.476 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T20:15:25.867300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":228,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2424056,"kb_used_data":10424,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752550664,"statfs":{"total":773094113280,"available":770611879936,"internally_reserved":0,"allocated":10674176,"data_stored":5518674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.514523"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832903+0000","last_change":"2024-01-21T20:15:21.828599+0000","last_active":"2024-01-21T20:15:21.832903+0000","last_peered":"2024-01-21T20:15:21.832903+0000","last_clean":"2024-01-21T20:15:21.832903+0000","last_became_active":"2024-01-21T20:15:21.824691+0000","last_became_peered":"2024-01-21T20:15:21.824691+0000","last_unstale":"2024-01-21T20:15:21.832903+0000","last_undegraded":"2024-01-21T20:15:21.832903+0000","last_fullsized":"2024-01-21T20:15:21.832903+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835953+0000","last_change":"2024-01-21T20:15:21.440624+0000","last_active":"2024-01-21T20:15:21.835953+0000","last_peered":"2024-01-21T20:15:21.835953+0000","last_clean":"2024-01-21T20:15:21.835953+0000","last_became_active":"2024-01-21T20:15:21.440174+0000","last_became_peered":"2024-01-21T20:15:21.440174+0000","last_unstale":"2024-01-21T20:15:21.835953+0000","last_undegraded":"2024-01-21T20:15:21.835953+0000","last_fullsized":"2024-01-21T20:15:21.835953+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837619+0000","last_change":"2024-01-21T20:15:21.828091+0000","last_active":"2024-01-21T20:15:21.837619+0000","last_peered":"2024-01-21T20:15:21.837619+0000","last_clean":"2024-01-21T20:15:21.837619+0000","last_became_active":"2024-01-21T20:15:21.827767+0000","last_became_peered":"2024-01-21T20:15:21.827767+0000","last_unstale":"2024-01-21T20:15:21.837619+0000","last_undegraded":"2024-01-21T20:15:21.837619+0000","last_fullsized":"2024-01-21T20:15:21.837619+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809954+0000","last_change":"2024-01-21T20:15:21.438189+0000","last_active":"2024-01-21T20:15:21.809954+0000","last_peered":"2024-01-21T20:15:21.809954+0000","last_clean":"2024-01-21T20:15:21.809954+0000","last_became_active":"2024-01-21T20:15:21.437846+0000","last_became_peered":"2024-01-21T20:15:21.437846+0000","last_unstale":"2024-01-21T20:15:21.809954+0000","last_undegraded":"2024-01-21T20:15:21.809954+0000","last_fullsized":"2024-01-21T20:15:21.809954+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834921+0000","last_change":"2024-01-21T20:15:21.824449+0000","last_active":"2024-01-21T20:15:21.834921+0000","last_peered":"2024-01-21T20:15:21.834921+0000","last_clean":"2024-01-21T20:15:21.834921+0000","last_became_active":"2024-01-21T20:15:21.824193+0000","last_became_peered":"2024-01-21T20:15:21.824193+0000","last_unstale":"2024-01-21T20:15:21.834921+0000","last_undegraded":"2024-01-21T20:15:21.834921+0000","last_fullsized":"2024-01-21T20:15:21.834921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814227+0000","last_change":"2024-01-21T20:15:21.443127+0000","last_active":"2024-01-21T20:15:21.814227+0000","last_peered":"2024-01-21T20:15:21.814227+0000","last_clean":"2024-01-21T20:15:21.814227+0000","last_became_active":"2024-01-21T20:15:21.442816+0000","last_became_peered":"2024-01-21T20:15:21.442816+0000","last_unstale":"2024-01-21T20:15:21.814227+0000","last_undegraded":"2024-01-21T20:15:21.814227+0000","last_fullsized":"2024-01-21T20:15:21.814227+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835239+0000","last_change":"2024-01-21T20:15:21.825071+0000","last_active":"2024-01-21T20:15:21.835239+0000","last_peered":"2024-01-21T20:15:21.835239+0000","last_clean":"2024-01-21T20:15:21.835239+0000","last_became_active":"2024-01-21T20:15:21.824816+0000","last_became_peered":"2024-01-21T20:15:21.824816+0000","last_unstale":"2024-01-21T20:15:21.835239+0000","last_undegraded":"2024-01-21T20:15:21.835239+0000","last_fullsized":"2024-01-21T20:15:21.835239+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832695+0000","last_change":"2024-01-21T20:15:21.444097+0000","last_active":"2024-01-21T20:15:21.832695+0000","last_peered":"2024-01-21T20:15:21.832695+0000","last_clean":"2024-01-21T20:15:21.832695+0000","last_became_active":"2024-01-21T20:15:21.443815+0000","last_became_peered":"2024-01-21T20:15:21.443815+0000","last_unstale":"2024-01-21T20:15:21.832695+0000","last_undegraded":"2024-01-21T20:15:21.832695+0000","last_fullsized":"2024-01-21T20:15:21.832695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827950+0000","last_change":"2024-01-21T20:15:21.822020+0000","last_active":"2024-01-21T20:15:21.827950+0000","last_peered":"2024-01-21T20:15:21.827950+0000","last_clean":"2024-01-21T20:15:21.827950+0000","last_became_active":"2024-01-21T20:15:21.821743+0000","last_became_peered":"2024-01-21T20:15:21.821743+0000","last_unstale":"2024-01-21T20:15:21.827950+0000","last_undegraded":"2024-01-21T20:15:21.827950+0000","last_fullsized":"2024-01-21T20:15:21.827950+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833176+0000","last_change":"2024-01-21T20:15:21.445321+0000","last_active":"2024-01-21T20:15:21.833176+0000","last_peered":"2024-01-21T20:15:21.833176+0000","last_clean":"2024-01-21T20:15:21.833176+0000","last_became_active":"2024-01-21T20:15:21.444855+0000","last_became_peered":"2024-01-21T20:15:21.444855+0000","last_unstale":"2024-01-21T20:15:21.833176+0000","last_undegraded":"2024-01-21T20:15:21.833176+0000","last_fullsized":"2024-01-21T20:15:21.833176+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827646+0000","last_change":"2024-01-21T20:15:21.826715+0000","last_active":"2024-01-21T20:15:21.827646+0000","last_peered":"2024-01-21T20:15:21.827646+0000","last_clean":"2024-01-21T20:15:21.827646+0000","last_became_active":"2024-01-21T20:15:21.826378+0000","last_became_peered":"2024-01-21T20:15:21.826378+0000","last_unstale":"2024-01-21T20:15:21.827646+0000","last_undegraded":"2024-01-21T20:15:21.827646+0000","last_fullsized":"2024-01-21T20:15:21.827646+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823963+0000","last_change":"2024-01-21T20:15:21.446524+0000","last_active":"2024-01-21T20:15:21.823963+0000","last_peered":"2024-01-21T20:15:21.823963+0000","last_clean":"2024-01-21T20:15:21.823963+0000","last_became_active":"2024-01-21T20:15:21.445683+0000","last_became_peered":"2024-01-21T20:15:21.445683+0000","last_unstale":"2024-01-21T20:15:21.823963+0000","last_undegraded":"2024-01-21T20:15:21.823963+0000","last_fullsized":"2024-01-21T20:15:21.823963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825182+0000","last_change":"2024-01-21T20:15:21.821701+0000","last_active":"2024-01-21T20:15:21.825182+0000","last_peered":"2024-01-21T20:15:21.825182+0000","last_clean":"2024-01-21T20:15:21.825182+0000","last_became_active":"2024-01-21T20:15:21.821413+0000","last_became_peered":"2024-01-21T20:15:21.821413+0000","last_unstale":"2024-01-21T20:15:21.825182+0000","last_undegraded":"2024-01-21T20:15:21.825182+0000","last_fullsized":"2024-01-21T20:15:21.825182+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812365+0000","last_change":"2024-01-21T20:15:21.439385+0000","last_active":"2024-01-21T20:15:21.812365+0000","last_peered":"2024-01-21T20:15:21.812365+0000","last_clean":"2024-01-21T20:15:21.812365+0000","last_became_active":"2024-01-21T20:15:21.439104+0000","last_became_peered":"2024-01-21T20:15:21.439104+0000","last_unstale":"2024-01-21T20:15:21.812365+0000","last_undegraded":"2024-01-21T20:15:21.812365+0000","last_fullsized":"2024-01-21T20:15:21.812365+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834857+0000","last_change":"2024-01-21T20:15:21.832980+0000","last_active":"2024-01-21T20:15:21.834857+0000","last_peered":"2024-01-21T20:15:21.834857+0000","last_clean":"2024-01-21T20:15:21.834857+0000","last_became_active":"2024-01-21T20:15:21.831413+0000","last_became_peered":"2024-01-21T20:15:21.831413+0000","last_unstale":"2024-01-21T20:15:21.834857+0000","last_undegraded":"2024-01-21T20:15:21.834857+0000","last_fullsized":"2024-01-21T20:15:21.834857+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809572+0000","last_change":"2024-01-21T20:15:21.443577+0000","last_active":"2024-01-21T20:15:21.809572+0000","last_peered":"2024-01-21T20:15:21.809572+0000","last_clean":"2024-01-21T20:15:21.809572+0000","last_became_active":"2024-01-21T20:15:21.443248+0000","last_became_peered":"2024-01-21T20:15:21.443248+0000","last_unstale":"2024-01-21T20:15:21.809572+0000","last_undegraded":"2024-01-21T20:15:21.809572+0000","last_fullsized":"2024-01-21T20:15:21.809572+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.831947+0000","last_change":"2024-01-21T20:15:21.822998+0000","last_active":"2024-01-21T20:15:21.831947+0000","last_peered":"2024-01-21T20:15:21.831947+0000","last_clean":"2024-01-21T20:15:21.831947+0000","last_became_active":"2024-01-21T20:15:21.822748+0000","last_became_peered":"2024-01-21T20:15:21.822748+0000","last_unstale":"2024-01-21T20:15:21.831947+0000","last_undegraded":"2024-01-21T20:15:21.831947+0000","last_fullsized":"2024-01-21T20:15:21.831947+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811662+0000","last_change":"2024-01-21T20:15:21.445853+0000","last_active":"2024-01-21T20:15:21.811662+0000","last_peered":"2024-01-21T20:15:21.811662+0000","last_clean":"2024-01-21T20:15:21.811662+0000","last_became_active":"2024-01-21T20:15:21.445192+0000","last_became_peered":"2024-01-21T20:15:21.445192+0000","last_unstale":"2024-01-21T20:15:21.811662+0000","last_undegraded":"2024-01-21T20:15:21.811662+0000","last_fullsized":"2024-01-21T20:15:21.811662+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837355+0000","last_change":"2024-01-21T20:15:21.836674+0000","last_active":"2024-01-21T20:15:21.837355+0000","last_peered":"2024-01-21T20:15:21.837355+0000","last_clean":"2024-01-21T20:15:21.837355+0000","last_became_active":"2024-01-21T20:15:21.836217+0000","last_became_peered":"2024-01-21T20:15:21.836217+0000","last_unstale":"2024-01-21T20:15:21.837355+0000","last_undegraded":"2024-01-21T20:15:21.837355+0000","last_fullsized":"2024-01-21T20:15:21.837355+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813279+0000","last_change":"2024-01-21T20:15:21.444909+0000","last_active":"2024-01-21T20:15:21.813279+0000","last_peered":"2024-01-21T20:15:21.813279+0000","last_clean":"2024-01-21T20:15:21.813279+0000","last_became_active":"2024-01-21T20:15:21.444583+0000","last_became_peered":"2024-01-21T20:15:21.444583+0000","last_unstale":"2024-01-21T20:15:21.813279+0000","last_undegraded":"2024-01-21T20:15:21.813279+0000","last_fullsized":"2024-01-21T20:15:21.813279+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835528+0000","last_change":"2024-01-21T20:15:21.832802+0000","last_active":"2024-01-21T20:15:21.835528+0000","last_peered":"2024-01-21T20:15:21.835528+0000","last_clean":"2024-01-21T20:15:21.835528+0000","last_became_active":"2024-01-21T20:15:21.832501+0000","last_became_peered":"2024-01-21T20:15:21.832501+0000","last_unstale":"2024-01-21T20:15:21.835528+0000","last_undegraded":"2024-01-21T20:15:21.835528+0000","last_fullsized":"2024-01-21T20:15:21.835528+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809838+0000","last_change":"2024-01-21T20:15:21.439495+0000","last_active":"2024-01-21T20:15:21.809838+0000","last_peered":"2024-01-21T20:15:21.809838+0000","last_clean":"2024-01-21T20:15:21.809838+0000","last_became_active":"2024-01-21T20:15:21.439233+0000","last_became_peered":"2024-01-21T20:15:21.439233+0000","last_unstale":"2024-01-21T20:15:21.809838+0000","last_undegraded":"2024-01-21T20:15:21.809838+0000","last_fullsized":"2024-01-21T20:15:21.809838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828830+0000","last_change":"2024-01-21T20:15:21.825795+0000","last_active":"2024-01-21T20:15:21.828830+0000","last_peered":"2024-01-21T20:15:21.828830+0000","last_clean":"2024-01-21T20:15:21.828830+0000","last_became_active":"2024-01-21T20:15:21.825529+0000","last_became_peered":"2024-01-21T20:15:21.825529+0000","last_unstale":"2024-01-21T20:15:21.828830+0000","last_undegraded":"2024-01-21T20:15:21.828830+0000","last_fullsized":"2024-01-21T20:15:21.828830+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837990+0000","last_change":"2024-01-21T20:15:21.445434+0000","last_active":"2024-01-21T20:15:21.837990+0000","last_peered":"2024-01-21T20:15:21.837990+0000","last_clean":"2024-01-21T20:15:21.837990+0000","last_became_active":"2024-01-21T20:15:21.444452+0000","last_became_peered":"2024-01-21T20:15:21.444452+0000","last_unstale":"2024-01-21T20:15:21.837990+0000","last_undegraded":"2024-01-21T20:15:21.837990+0000","last_fullsized":"2024-01-21T20:15:21.837990+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830831+0000","last_change":"2024-01-21T20:15:21.826930+0000","last_active":"2024-01-21T20:15:21.830831+0000","last_peered":"2024-01-21T20:15:21.830831+0000","last_clean":"2024-01-21T20:15:21.830831+0000","last_became_active":"2024-01-21T20:15:21.826665+0000","last_became_peered":"2024-01-21T20:15:21.826665+0000","last_unstale":"2024-01-21T20:15:21.830831+0000","last_undegraded":"2024-01-21T20:15:21.830831+0000","last_fullsized":"2024-01-21T20:15:21.830831+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827330+0000","last_change":"2024-01-21T20:15:21.440133+0000","last_active":"2024-01-21T20:15:21.827330+0000","last_peered":"2024-01-21T20:15:21.827330+0000","last_clean":"2024-01-21T20:15:21.827330+0000","last_became_active":"2024-01-21T20:15:21.439315+0000","last_became_peered":"2024-01-21T20:15:21.439315+0000","last_unstale":"2024-01-21T20:15:21.827330+0000","last_undegraded":"2024-01-21T20:15:21.827330+0000","last_fullsized":"2024-01-21T20:15:21.827330+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828928+0000","last_change":"2024-01-21T20:15:21.823537+0000","last_active":"2024-01-21T20:15:21.828928+0000","last_peered":"2024-01-21T20:15:21.828928+0000","last_clean":"2024-01-21T20:15:21.828928+0000","last_became_active":"2024-01-21T20:15:21.823253+0000","last_became_peered":"2024-01-21T20:15:21.823253+0000","last_unstale":"2024-01-21T20:15:21.828928+0000","last_undegraded":"2024-01-21T20:15:21.828928+0000","last_fullsized":"2024-01-21T20:15:21.828928+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812151+0000","last_change":"2024-01-21T20:15:21.444530+0000","last_active":"2024-01-21T20:15:21.812151+0000","last_peered":"2024-01-21T20:15:21.812151+0000","last_clean":"2024-01-21T20:15:21.812151+0000","last_became_active":"2024-01-21T20:15:21.444063+0000","last_became_peered":"2024-01-21T20:15:21.444063+0000","last_unstale":"2024-01-21T20:15:21.812151+0000","last_undegraded":"2024-01-21T20:15:21.812151+0000","last_fullsized":"2024-01-21T20:15:21.812151+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835191+0000","last_change":"2024-01-21T20:15:21.833423+0000","last_active":"2024-01-21T20:15:21.835191+0000","last_peered":"2024-01-21T20:15:21.835191+0000","last_clean":"2024-01-21T20:15:21.835191+0000","last_became_active":"2024-01-21T20:15:21.833011+0000","last_became_peered":"2024-01-21T20:15:21.833011+0000","last_unstale":"2024-01-21T20:15:21.835191+0000","last_undegraded":"2024-01-21T20:15:21.835191+0000","last_fullsized":"2024-01-21T20:15:21.835191+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.818032+0000","last_change":"2024-01-21T20:15:21.440694+0000","last_active":"2024-01-21T20:15:21.818032+0000","last_peered":"2024-01-21T20:15:21.818032+0000","last_clean":"2024-01-21T20:15:21.818032+0000","last_became_active":"2024-01-21T20:15:21.440405+0000","last_became_peered":"2024-01-21T20:15:21.440405+0000","last_unstale":"2024-01-21T20:15:21.818032+0000","last_undegraded":"2024-01-21T20:15:21.818032+0000","last_fullsized":"2024-01-21T20:15:21.818032+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830660+0000","last_change":"2024-01-21T20:15:21.825552+0000","last_active":"2024-01-21T20:15:21.830660+0000","last_peered":"2024-01-21T20:15:21.830660+0000","last_clean":"2024-01-21T20:15:21.830660+0000","last_became_active":"2024-01-21T20:15:21.825128+0000","last_became_peered":"2024-01-21T20:15:21.825128+0000","last_unstale":"2024-01-21T20:15:21.830660+0000","last_undegraded":"2024-01-21T20:15:21.830660+0000","last_fullsized":"2024-01-21T20:15:21.830660+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834030+0000","last_change":"2024-01-21T20:15:21.438814+0000","last_active":"2024-01-21T20:15:21.834030+0000","last_peered":"2024-01-21T20:15:21.834030+0000","last_clean":"2024-01-21T20:15:21.834030+0000","last_became_active":"2024-01-21T20:15:21.438520+0000","last_became_peered":"2024-01-21T20:15:21.438520+0000","last_unstale":"2024-01-21T20:15:21.834030+0000","last_undegraded":"2024-01-21T20:15:21.834030+0000","last_fullsized":"2024-01-21T20:15:21.834030+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828735+0000","last_change":"2024-01-21T20:15:21.823625+0000","last_active":"2024-01-21T20:15:21.828735+0000","last_peered":"2024-01-21T20:15:21.828735+0000","last_clean":"2024-01-21T20:15:21.828735+0000","last_became_active":"2024-01-21T20:15:21.823351+0000","last_became_peered":"2024-01-21T20:15:21.823351+0000","last_unstale":"2024-01-21T20:15:21.828735+0000","last_undegraded":"2024-01-21T20:15:21.828735+0000","last_fullsized":"2024-01-21T20:15:21.828735+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825142+0000","last_change":"2024-01-21T20:15:21.444226+0000","last_active":"2024-01-21T20:15:21.825142+0000","last_peered":"2024-01-21T20:15:21.825142+0000","last_clean":"2024-01-21T20:15:21.825142+0000","last_became_active":"2024-01-21T20:15:21.443917+0000","last_became_peered":"2024-01-21T20:15:21.443917+0000","last_unstale":"2024-01-21T20:15:21.825142+0000","last_undegraded":"2024-01-21T20:15:21.825142+0000","last_fullsized":"2024-01-21T20:15:21.825142+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834964+0000","last_change":"2024-01-21T20:15:21.833302+0000","last_active":"2024-01-21T20:15:21.834964+0000","last_peered":"2024-01-21T20:15:21.834964+0000","last_clean":"2024-01-21T20:15:21.834964+0000","last_became_active":"2024-01-21T20:15:21.832997+0000","last_became_peered":"2024-01-21T20:15:21.832997+0000","last_unstale":"2024-01-21T20:15:21.834964+0000","last_undegraded":"2024-01-21T20:15:21.834964+0000","last_fullsized":"2024-01-21T20:15:21.834964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813089+0000","last_change":"2024-01-21T20:15:21.439091+0000","last_active":"2024-01-21T20:15:21.813089+0000","last_peered":"2024-01-21T20:15:21.813089+0000","last_clean":"2024-01-21T20:15:21.813089+0000","last_became_active":"2024-01-21T20:15:21.438828+0000","last_became_peered":"2024-01-21T20:15:21.438828+0000","last_unstale":"2024-01-21T20:15:21.813089+0000","last_undegraded":"2024-01-21T20:15:21.813089+0000","last_fullsized":"2024-01-21T20:15:21.813089+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.840441+0000","last_change":"2024-01-21T20:15:21.835308+0000","last_active":"2024-01-21T20:15:21.840441+0000","last_peered":"2024-01-21T20:15:21.840441+0000","last_clean":"2024-01-21T20:15:21.840441+0000","last_became_active":"2024-01-21T20:15:21.834942+0000","last_became_peered":"2024-01-21T20:15:21.834942+0000","last_unstale":"2024-01-21T20:15:21.840441+0000","last_undegraded":"2024-01-21T20:15:21.840441+0000","last_fullsized":"2024-01-21T20:15:21.840441+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.816970+0000","last_change":"2024-01-21T20:15:21.444232+0000","last_active":"2024-01-21T20:15:21.816970+0000","last_peered":"2024-01-21T20:15:21.816970+0000","last_clean":"2024-01-21T20:15:21.816970+0000","last_became_active":"2024-01-21T20:15:21.443958+0000","last_became_peered":"2024-01-21T20:15:21.443958+0000","last_unstale":"2024-01-21T20:15:21.816970+0000","last_undegraded":"2024-01-21T20:15:21.816970+0000","last_fullsized":"2024-01-21T20:15:21.816970+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826049+0000","last_change":"2024-01-21T20:15:21.822130+0000","last_active":"2024-01-21T20:15:21.826049+0000","last_peered":"2024-01-21T20:15:21.826049+0000","last_clean":"2024-01-21T20:15:21.826049+0000","last_became_active":"2024-01-21T20:15:21.821868+0000","last_became_peered":"2024-01-21T20:15:21.821868+0000","last_unstale":"2024-01-21T20:15:21.826049+0000","last_undegraded":"2024-01-21T20:15:21.826049+0000","last_fullsized":"2024-01-21T20:15:21.826049+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814036+0000","last_change":"2024-01-21T20:15:21.442556+0000","last_active":"2024-01-21T20:15:21.814036+0000","last_peered":"2024-01-21T20:15:21.814036+0000","last_clean":"2024-01-21T20:15:21.814036+0000","last_became_active":"2024-01-21T20:15:21.442248+0000","last_became_peered":"2024-01-21T20:15:21.442248+0000","last_unstale":"2024-01-21T20:15:21.814036+0000","last_undegraded":"2024-01-21T20:15:21.814036+0000","last_fullsized":"2024-01-21T20:15:21.814036+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837660+0000","last_change":"2024-01-21T20:15:21.828466+0000","last_active":"2024-01-21T20:15:21.837660+0000","last_peered":"2024-01-21T20:15:21.837660+0000","last_clean":"2024-01-21T20:15:21.837660+0000","last_became_active":"2024-01-21T20:15:21.828229+0000","last_became_peered":"2024-01-21T20:15:21.828229+0000","last_unstale":"2024-01-21T20:15:21.837660+0000","last_undegraded":"2024-01-21T20:15:21.837660+0000","last_fullsized":"2024-01-21T20:15:21.837660+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823582+0000","last_change":"2024-01-21T20:15:21.445249+0000","last_active":"2024-01-21T20:15:21.823582+0000","last_peered":"2024-01-21T20:15:21.823582+0000","last_clean":"2024-01-21T20:15:21.823582+0000","last_became_active":"2024-01-21T20:15:21.444367+0000","last_became_peered":"2024-01-21T20:15:21.444367+0000","last_unstale":"2024-01-21T20:15:21.823582+0000","last_undegraded":"2024-01-21T20:15:21.823582+0000","last_fullsized":"2024-01-21T20:15:21.823582+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832741+0000","last_change":"2024-01-21T20:15:21.830905+0000","last_active":"2024-01-21T20:15:21.832741+0000","last_peered":"2024-01-21T20:15:21.832741+0000","last_clean":"2024-01-21T20:15:21.832741+0000","last_became_active":"2024-01-21T20:15:21.830570+0000","last_became_peered":"2024-01-21T20:15:21.830570+0000","last_unstale":"2024-01-21T20:15:21.832741+0000","last_undegraded":"2024-01-21T20:15:21.832741+0000","last_fullsized":"2024-01-21T20:15:21.832741+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811695+0000","last_change":"2024-01-21T20:15:21.444792+0000","last_active":"2024-01-21T20:15:21.811695+0000","last_peered":"2024-01-21T20:15:21.811695+0000","last_clean":"2024-01-21T20:15:21.811695+0000","last_became_active":"2024-01-21T20:15:21.443889+0000","last_became_peered":"2024-01-21T20:15:21.443889+0000","last_unstale":"2024-01-21T20:15:21.811695+0000","last_undegraded":"2024-01-21T20:15:21.811695+0000","last_fullsized":"2024-01-21T20:15:21.811695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834902+0000","last_change":"2024-01-21T20:15:21.833300+0000","last_active":"2024-01-21T20:15:21.834902+0000","last_peered":"2024-01-21T20:15:21.834902+0000","last_clean":"2024-01-21T20:15:21.834902+0000","last_became_active":"2024-01-21T20:15:21.831553+0000","last_became_peered":"2024-01-21T20:15:21.831553+0000","last_unstale":"2024-01-21T20:15:21.834902+0000","last_undegraded":"2024-01-21T20:15:21.834902+0000","last_fullsized":"2024-01-21T20:15:21.834902+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814084+0000","last_change":"2024-01-21T20:15:21.447749+0000","last_active":"2024-01-21T20:15:21.814084+0000","last_peered":"2024-01-21T20:15:21.814084+0000","last_clean":"2024-01-21T20:15:21.814084+0000","last_became_active":"2024-01-21T20:15:21.447459+0000","last_became_peered":"2024-01-21T20:15:21.447459+0000","last_unstale":"2024-01-21T20:15:21.814084+0000","last_undegraded":"2024-01-21T20:15:21.814084+0000","last_fullsized":"2024-01-21T20:15:21.814084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833950+0000","last_change":"2024-01-21T20:15:21.828294+0000","last_active":"2024-01-21T20:15:21.833950+0000","last_peered":"2024-01-21T20:15:21.833950+0000","last_clean":"2024-01-21T20:15:21.833950+0000","last_became_active":"2024-01-21T20:15:21.827964+0000","last_became_peered":"2024-01-21T20:15:21.827964+0000","last_unstale":"2024-01-21T20:15:21.833950+0000","last_undegraded":"2024-01-21T20:15:21.833950+0000","last_fullsized":"2024-01-21T20:15:21.833950+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811956+0000","last_change":"2024-01-21T20:15:21.450432+0000","last_active":"2024-01-21T20:15:21.811956+0000","last_peered":"2024-01-21T20:15:21.811956+0000","last_clean":"2024-01-21T20:15:21.811956+0000","last_became_active":"2024-01-21T20:15:21.450182+0000","last_became_peered":"2024-01-21T20:15:21.450182+0000","last_unstale":"2024-01-21T20:15:21.811956+0000","last_undegraded":"2024-01-21T20:15:21.811956+0000","last_fullsized":"2024-01-21T20:15:21.811956+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832923+0000","last_change":"2024-01-21T20:15:21.829191+0000","last_active":"2024-01-21T20:15:21.832923+0000","last_peered":"2024-01-21T20:15:21.832923+0000","last_clean":"2024-01-21T20:15:21.832923+0000","last_became_active":"2024-01-21T20:15:21.828910+0000","last_became_peered":"2024-01-21T20:15:21.828910+0000","last_unstale":"2024-01-21T20:15:21.832923+0000","last_undegraded":"2024-01-21T20:15:21.832923+0000","last_fullsized":"2024-01-21T20:15:21.832923+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810576+0000","last_change":"2024-01-21T20:15:21.438887+0000","last_active":"2024-01-21T20:15:21.810576+0000","last_peered":"2024-01-21T20:15:21.810576+0000","last_clean":"2024-01-21T20:15:21.810576+0000","last_became_active":"2024-01-21T20:15:21.438440+0000","last_became_peered":"2024-01-21T20:15:21.438440+0000","last_unstale":"2024-01-21T20:15:21.810576+0000","last_undegraded":"2024-01-21T20:15:21.810576+0000","last_fullsized":"2024-01-21T20:15:21.810576+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827505+0000","last_change":"2024-01-21T20:15:21.820868+0000","last_active":"2024-01-21T20:15:21.827505+0000","last_peered":"2024-01-21T20:15:21.827505+0000","last_clean":"2024-01-21T20:15:21.827505+0000","last_became_active":"2024-01-21T20:15:21.820578+0000","last_became_peered":"2024-01-21T20:15:21.820578+0000","last_unstale":"2024-01-21T20:15:21.827505+0000","last_undegraded":"2024-01-21T20:15:21.827505+0000","last_fullsized":"2024-01-21T20:15:21.827505+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813004+0000","last_change":"2024-01-21T20:15:21.445130+0000","last_active":"2024-01-21T20:15:21.813004+0000","last_peered":"2024-01-21T20:15:21.813004+0000","last_clean":"2024-01-21T20:15:21.813004+0000","last_became_active":"2024-01-21T20:15:21.444577+0000","last_became_peered":"2024-01-21T20:15:21.444577+0000","last_unstale":"2024-01-21T20:15:21.813004+0000","last_undegraded":"2024-01-21T20:15:21.813004+0000","last_fullsized":"2024-01-21T20:15:21.813004+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834805+0000","last_change":"2024-01-21T20:15:21.831778+0000","last_active":"2024-01-21T20:15:21.834805+0000","last_peered":"2024-01-21T20:15:21.834805+0000","last_clean":"2024-01-21T20:15:21.834805+0000","last_became_active":"2024-01-21T20:15:21.831488+0000","last_became_peered":"2024-01-21T20:15:21.831488+0000","last_unstale":"2024-01-21T20:15:21.834805+0000","last_undegraded":"2024-01-21T20:15:21.834805+0000","last_fullsized":"2024-01-21T20:15:21.834805+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822389+0000","last_change":"2024-01-21T20:15:21.445425+0000","last_active":"2024-01-21T20:15:21.822389+0000","last_peered":"2024-01-21T20:15:21.822389+0000","last_clean":"2024-01-21T20:15:21.822389+0000","last_became_active":"2024-01-21T20:15:21.444652+0000","last_became_peered":"2024-01-21T20:15:21.444652+0000","last_unstale":"2024-01-21T20:15:21.822389+0000","last_undegraded":"2024-01-21T20:15:21.822389+0000","last_fullsized":"2024-01-21T20:15:21.822389+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821056+0000","last_change":"2024-01-21T20:15:21.817463+0000","last_active":"2024-01-21T20:15:21.821056+0000","last_peered":"2024-01-21T20:15:21.821056+0000","last_clean":"2024-01-21T20:15:21.821056+0000","last_became_active":"2024-01-21T20:15:21.817103+0000","last_became_peered":"2024-01-21T20:15:21.817103+0000","last_unstale":"2024-01-21T20:15:21.821056+0000","last_undegraded":"2024-01-21T20:15:21.821056+0000","last_fullsized":"2024-01-21T20:15:21.821056+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815028+0000","last_change":"2024-01-21T20:15:21.440441+0000","last_active":"2024-01-21T20:15:21.815028+0000","last_peered":"2024-01-21T20:15:21.815028+0000","last_clean":"2024-01-21T20:15:21.815028+0000","last_became_active":"2024-01-21T20:15:21.440089+0000","last_became_peered":"2024-01-21T20:15:21.440089+0000","last_unstale":"2024-01-21T20:15:21.815028+0000","last_undegraded":"2024-01-21T20:15:21.815028+0000","last_fullsized":"2024-01-21T20:15:21.815028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830812+0000","last_change":"2024-01-21T20:15:21.826738+0000","last_active":"2024-01-21T20:15:21.830812+0000","last_peered":"2024-01-21T20:15:21.830812+0000","last_clean":"2024-01-21T20:15:21.830812+0000","last_became_active":"2024-01-21T20:15:21.826453+0000","last_became_peered":"2024-01-21T20:15:21.826453+0000","last_unstale":"2024-01-21T20:15:21.830812+0000","last_undegraded":"2024-01-21T20:15:21.830812+0000","last_fullsized":"2024-01-21T20:15:21.830812+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815798+0000","last_change":"2024-01-21T20:15:21.437125+0000","last_active":"2024-01-21T20:15:21.815798+0000","last_peered":"2024-01-21T20:15:21.815798+0000","last_clean":"2024-01-21T20:15:21.815798+0000","last_became_active":"2024-01-21T20:15:21.436817+0000","last_became_peered":"2024-01-21T20:15:21.436817+0000","last_unstale":"2024-01-21T20:15:21.815798+0000","last_undegraded":"2024-01-21T20:15:21.815798+0000","last_fullsized":"2024-01-21T20:15:21.815798+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836735+0000","last_change":"2024-01-21T20:15:21.835367+0000","last_active":"2024-01-21T20:15:21.836735+0000","last_peered":"2024-01-21T20:15:21.836735+0000","last_clean":"2024-01-21T20:15:21.836735+0000","last_became_active":"2024-01-21T20:15:21.835091+0000","last_became_peered":"2024-01-21T20:15:21.835091+0000","last_unstale":"2024-01-21T20:15:21.836735+0000","last_undegraded":"2024-01-21T20:15:21.836735+0000","last_fullsized":"2024-01-21T20:15:21.836735+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811792+0000","last_change":"2024-01-21T20:15:21.444345+0000","last_active":"2024-01-21T20:15:21.811792+0000","last_peered":"2024-01-21T20:15:21.811792+0000","last_clean":"2024-01-21T20:15:21.811792+0000","last_became_active":"2024-01-21T20:15:21.443524+0000","last_became_peered":"2024-01-21T20:15:21.443524+0000","last_unstale":"2024-01-21T20:15:21.811792+0000","last_undegraded":"2024-01-21T20:15:21.811792+0000","last_fullsized":"2024-01-21T20:15:21.811792+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834011+0000","last_change":"2024-01-21T20:15:21.828632+0000","last_active":"2024-01-21T20:15:21.834011+0000","last_peered":"2024-01-21T20:15:21.834011+0000","last_clean":"2024-01-21T20:15:21.834011+0000","last_became_active":"2024-01-21T20:15:21.828361+0000","last_became_peered":"2024-01-21T20:15:21.828361+0000","last_unstale":"2024-01-21T20:15:21.834011+0000","last_undegraded":"2024-01-21T20:15:21.834011+0000","last_fullsized":"2024-01-21T20:15:21.834011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825280+0000","last_change":"2024-01-21T20:15:21.450674+0000","last_active":"2024-01-21T20:15:21.825280+0000","last_peered":"2024-01-21T20:15:21.825280+0000","last_clean":"2024-01-21T20:15:21.825280+0000","last_became_active":"2024-01-21T20:15:21.450077+0000","last_became_peered":"2024-01-21T20:15:21.450077+0000","last_unstale":"2024-01-21T20:15:21.825280+0000","last_undegraded":"2024-01-21T20:15:21.825280+0000","last_fullsized":"2024-01-21T20:15:21.825280+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826417+0000","last_change":"2024-01-21T20:15:21.824570+0000","last_active":"2024-01-21T20:15:21.826417+0000","last_peered":"2024-01-21T20:15:21.826417+0000","last_clean":"2024-01-21T20:15:21.826417+0000","last_became_active":"2024-01-21T20:15:21.824288+0000","last_became_peered":"2024-01-21T20:15:21.824288+0000","last_unstale":"2024-01-21T20:15:21.826417+0000","last_undegraded":"2024-01-21T20:15:21.826417+0000","last_fullsized":"2024-01-21T20:15:21.826417+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813503+0000","last_change":"2024-01-21T20:15:21.447799+0000","last_active":"2024-01-21T20:15:21.813503+0000","last_peered":"2024-01-21T20:15:21.813503+0000","last_clean":"2024-01-21T20:15:21.813503+0000","last_became_active":"2024-01-21T20:15:21.447478+0000","last_became_peered":"2024-01-21T20:15:21.447478+0000","last_unstale":"2024-01-21T20:15:21.813503+0000","last_undegraded":"2024-01-21T20:15:21.813503+0000","last_fullsized":"2024-01-21T20:15:21.813503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833174+0000","last_change":"2024-01-21T20:15:21.829720+0000","last_active":"2024-01-21T20:15:21.833174+0000","last_peered":"2024-01-21T20:15:21.833174+0000","last_clean":"2024-01-21T20:15:21.833174+0000","last_became_active":"2024-01-21T20:15:21.829476+0000","last_became_peered":"2024-01-21T20:15:21.829476+0000","last_unstale":"2024-01-21T20:15:21.833174+0000","last_undegraded":"2024-01-21T20:15:21.833174+0000","last_fullsized":"2024-01-21T20:15:21.833174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825004+0000","last_change":"2024-01-21T20:15:21.449570+0000","last_active":"2024-01-21T20:15:21.825004+0000","last_peered":"2024-01-21T20:15:21.825004+0000","last_clean":"2024-01-21T20:15:21.825004+0000","last_became_active":"2024-01-21T20:15:21.449279+0000","last_became_peered":"2024-01-21T20:15:21.449279+0000","last_unstale":"2024-01-21T20:15:21.825004+0000","last_undegraded":"2024-01-21T20:15:21.825004+0000","last_fullsized":"2024-01-21T20:15:21.825004+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824511+0000","last_change":"2024-01-21T20:15:21.821574+0000","last_active":"2024-01-21T20:15:21.824511+0000","last_peered":"2024-01-21T20:15:21.824511+0000","last_clean":"2024-01-21T20:15:21.824511+0000","last_became_active":"2024-01-21T20:15:21.821292+0000","last_became_peered":"2024-01-21T20:15:21.821292+0000","last_unstale":"2024-01-21T20:15:21.824511+0000","last_undegraded":"2024-01-21T20:15:21.824511+0000","last_fullsized":"2024-01-21T20:15:21.824511+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833145+0000","last_change":"2024-01-21T20:15:21.437978+0000","last_active":"2024-01-21T20:15:21.833145+0000","last_peered":"2024-01-21T20:15:21.833145+0000","last_clean":"2024-01-21T20:15:21.833145+0000","last_became_active":"2024-01-21T20:15:21.437685+0000","last_became_peered":"2024-01-21T20:15:21.437685+0000","last_unstale":"2024-01-21T20:15:21.833145+0000","last_undegraded":"2024-01-21T20:15:21.833145+0000","last_fullsized":"2024-01-21T20:15:21.833145+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827580+0000","last_change":"2024-01-21T20:15:21.826090+0000","last_active":"2024-01-21T20:15:21.827580+0000","last_peered":"2024-01-21T20:15:21.827580+0000","last_clean":"2024-01-21T20:15:21.827580+0000","last_became_active":"2024-01-21T20:15:21.825737+0000","last_became_peered":"2024-01-21T20:15:21.825737+0000","last_unstale":"2024-01-21T20:15:21.827580+0000","last_undegraded":"2024-01-21T20:15:21.827580+0000","last_fullsized":"2024-01-21T20:15:21.827580+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824191+0000","last_change":"2024-01-21T20:15:21.450372+0000","last_active":"2024-01-21T20:15:21.824191+0000","last_peered":"2024-01-21T20:15:21.824191+0000","last_clean":"2024-01-21T20:15:21.824191+0000","last_became_active":"2024-01-21T20:15:21.449972+0000","last_became_peered":"2024-01-21T20:15:21.449972+0000","last_unstale":"2024-01-21T20:15:21.824191+0000","last_undegraded":"2024-01-21T20:15:21.824191+0000","last_fullsized":"2024-01-21T20:15:21.824191+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823691+0000","last_change":"2024-01-21T20:15:21.819320+0000","last_active":"2024-01-21T20:15:21.823691+0000","last_peered":"2024-01-21T20:15:21.823691+0000","last_clean":"2024-01-21T20:15:21.823691+0000","last_became_active":"2024-01-21T20:15:21.819030+0000","last_became_peered":"2024-01-21T20:15:21.819030+0000","last_unstale":"2024-01-21T20:15:21.823691+0000","last_undegraded":"2024-01-21T20:15:21.823691+0000","last_fullsized":"2024-01-21T20:15:21.823691+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814908+0000","last_change":"2024-01-21T20:15:21.448302+0000","last_active":"2024-01-21T20:15:21.814908+0000","last_peered":"2024-01-21T20:15:21.814908+0000","last_clean":"2024-01-21T20:15:21.814908+0000","last_became_active":"2024-01-21T20:15:21.447713+0000","last_became_peered":"2024-01-21T20:15:21.447713+0000","last_unstale":"2024-01-21T20:15:21.814908+0000","last_undegraded":"2024-01-21T20:15:21.814908+0000","last_fullsized":"2024-01-21T20:15:21.814908+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828135+0000","last_change":"2024-01-21T20:15:21.823566+0000","last_active":"2024-01-21T20:15:21.828135+0000","last_peered":"2024-01-21T20:15:21.828135+0000","last_clean":"2024-01-21T20:15:21.828135+0000","last_became_active":"2024-01-21T20:15:21.823324+0000","last_became_peered":"2024-01-21T20:15:21.823324+0000","last_unstale":"2024-01-21T20:15:21.828135+0000","last_undegraded":"2024-01-21T20:15:21.828135+0000","last_fullsized":"2024-01-21T20:15:21.828135+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826010+0000","last_change":"2024-01-21T20:15:21.445130+0000","last_active":"2024-01-21T20:15:21.826010+0000","last_peered":"2024-01-21T20:15:21.826010+0000","last_clean":"2024-01-21T20:15:21.826010+0000","last_became_active":"2024-01-21T20:15:21.444495+0000","last_became_peered":"2024-01-21T20:15:21.444495+0000","last_unstale":"2024-01-21T20:15:21.826010+0000","last_undegraded":"2024-01-21T20:15:21.826010+0000","last_fullsized":"2024-01-21T20:15:21.826010+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833641+0000","last_change":"2024-01-21T20:15:21.832615+0000","last_active":"2024-01-21T20:15:21.833641+0000","last_peered":"2024-01-21T20:15:21.833641+0000","last_clean":"2024-01-21T20:15:21.833641+0000","last_became_active":"2024-01-21T20:15:21.832243+0000","last_became_peered":"2024-01-21T20:15:21.832243+0000","last_unstale":"2024-01-21T20:15:21.833641+0000","last_undegraded":"2024-01-21T20:15:21.833641+0000","last_fullsized":"2024-01-21T20:15:21.833641+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811875+0000","last_change":"2024-01-21T20:15:21.444163+0000","last_active":"2024-01-21T20:15:21.811875+0000","last_peered":"2024-01-21T20:15:21.811875+0000","last_clean":"2024-01-21T20:15:21.811875+0000","last_became_active":"2024-01-21T20:15:21.443187+0000","last_became_peered":"2024-01-21T20:15:21.443187+0000","last_unstale":"2024-01-21T20:15:21.811875+0000","last_undegraded":"2024-01-21T20:15:21.811875+0000","last_fullsized":"2024-01-21T20:15:21.811875+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824123+0000","last_change":"2024-01-21T20:15:21.820767+0000","last_active":"2024-01-21T20:15:21.824123+0000","last_peered":"2024-01-21T20:15:21.824123+0000","last_clean":"2024-01-21T20:15:21.824123+0000","last_became_active":"2024-01-21T20:15:21.820500+0000","last_became_peered":"2024-01-21T20:15:21.820500+0000","last_unstale":"2024-01-21T20:15:21.824123+0000","last_undegraded":"2024-01-21T20:15:21.824123+0000","last_fullsized":"2024-01-21T20:15:21.824123+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.818122+0000","last_change":"2024-01-21T20:15:21.437462+0000","last_active":"2024-01-21T20:15:21.818122+0000","last_peered":"2024-01-21T20:15:21.818122+0000","last_clean":"2024-01-21T20:15:21.818122+0000","last_became_active":"2024-01-21T20:15:21.437200+0000","last_became_peered":"2024-01-21T20:15:21.437200+0000","last_unstale":"2024-01-21T20:15:21.818122+0000","last_undegraded":"2024-01-21T20:15:21.818122+0000","last_fullsized":"2024-01-21T20:15:21.818122+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830870+0000","last_change":"2024-01-21T20:15:21.827311+0000","last_active":"2024-01-21T20:15:21.830870+0000","last_peered":"2024-01-21T20:15:21.830870+0000","last_clean":"2024-01-21T20:15:21.830870+0000","last_became_active":"2024-01-21T20:15:21.826954+0000","last_became_peered":"2024-01-21T20:15:21.826954+0000","last_unstale":"2024-01-21T20:15:21.830870+0000","last_undegraded":"2024-01-21T20:15:21.830870+0000","last_fullsized":"2024-01-21T20:15:21.830870+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812703+0000","last_change":"2024-01-21T20:15:21.447743+0000","last_active":"2024-01-21T20:15:21.812703+0000","last_peered":"2024-01-21T20:15:21.812703+0000","last_clean":"2024-01-21T20:15:21.812703+0000","last_became_active":"2024-01-21T20:15:21.447482+0000","last_became_peered":"2024-01-21T20:15:21.447482+0000","last_unstale":"2024-01-21T20:15:21.812703+0000","last_undegraded":"2024-01-21T20:15:21.812703+0000","last_fullsized":"2024-01-21T20:15:21.812703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834100+0000","last_change":"2024-01-21T20:15:21.829064+0000","last_active":"2024-01-21T20:15:21.834100+0000","last_peered":"2024-01-21T20:15:21.834100+0000","last_clean":"2024-01-21T20:15:21.834100+0000","last_became_active":"2024-01-21T20:15:21.828824+0000","last_became_peered":"2024-01-21T20:15:21.828824+0000","last_unstale":"2024-01-21T20:15:21.834100+0000","last_undegraded":"2024-01-21T20:15:21.834100+0000","last_fullsized":"2024-01-21T20:15:21.834100+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811730+0000","last_change":"2024-01-21T20:15:21.446076+0000","last_active":"2024-01-21T20:15:21.811730+0000","last_peered":"2024-01-21T20:15:21.811730+0000","last_clean":"2024-01-21T20:15:21.811730+0000","last_became_active":"2024-01-21T20:15:21.445649+0000","last_became_peered":"2024-01-21T20:15:21.445649+0000","last_unstale":"2024-01-21T20:15:21.811730+0000","last_undegraded":"2024-01-21T20:15:21.811730+0000","last_fullsized":"2024-01-21T20:15:21.811730+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830318+0000","last_change":"2024-01-21T20:15:21.829240+0000","last_active":"2024-01-21T20:15:21.830318+0000","last_peered":"2024-01-21T20:15:21.830318+0000","last_clean":"2024-01-21T20:15:21.830318+0000","last_became_active":"2024-01-21T20:15:21.828632+0000","last_became_peered":"2024-01-21T20:15:21.828632+0000","last_unstale":"2024-01-21T20:15:21.830318+0000","last_undegraded":"2024-01-21T20:15:21.830318+0000","last_fullsized":"2024-01-21T20:15:21.830318+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.819494+0000","last_change":"2024-01-21T20:15:21.439644+0000","last_active":"2024-01-21T20:15:21.819494+0000","last_peered":"2024-01-21T20:15:21.819494+0000","last_clean":"2024-01-21T20:15:21.819494+0000","last_became_active":"2024-01-21T20:15:21.439365+0000","last_became_peered":"2024-01-21T20:15:21.439365+0000","last_unstale":"2024-01-21T20:15:21.819494+0000","last_undegraded":"2024-01-21T20:15:21.819494+0000","last_fullsized":"2024-01-21T20:15:21.819494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835628+0000","last_change":"2024-01-21T20:15:21.826397+0000","last_active":"2024-01-21T20:15:21.835628+0000","last_peered":"2024-01-21T20:15:21.835628+0000","last_clean":"2024-01-21T20:15:21.835628+0000","last_became_active":"2024-01-21T20:15:21.826112+0000","last_became_peered":"2024-01-21T20:15:21.826112+0000","last_unstale":"2024-01-21T20:15:21.835628+0000","last_undegraded":"2024-01-21T20:15:21.835628+0000","last_fullsized":"2024-01-21T20:15:21.835628+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836915+0000","last_change":"2024-01-21T20:15:21.450547+0000","last_active":"2024-01-21T20:15:21.836915+0000","last_peered":"2024-01-21T20:15:21.836915+0000","last_clean":"2024-01-21T20:15:21.836915+0000","last_became_active":"2024-01-21T20:15:21.450268+0000","last_became_peered":"2024-01-21T20:15:21.450268+0000","last_unstale":"2024-01-21T20:15:21.836915+0000","last_undegraded":"2024-01-21T20:15:21.836915+0000","last_fullsized":"2024-01-21T20:15:21.836915+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827128+0000","last_change":"2024-01-21T20:15:21.819496+0000","last_active":"2024-01-21T20:15:21.827128+0000","last_peered":"2024-01-21T20:15:21.827128+0000","last_clean":"2024-01-21T20:15:21.827128+0000","last_became_active":"2024-01-21T20:15:21.819115+0000","last_became_peered":"2024-01-21T20:15:21.819115+0000","last_unstale":"2024-01-21T20:15:21.827128+0000","last_undegraded":"2024-01-21T20:15:21.827128+0000","last_fullsized":"2024-01-21T20:15:21.827128+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826075+0000","last_change":"2024-01-21T20:15:21.441689+0000","last_active":"2024-01-21T20:15:21.826075+0000","last_peered":"2024-01-21T20:15:21.826075+0000","last_clean":"2024-01-21T20:15:21.826075+0000","last_became_active":"2024-01-21T20:15:21.441399+0000","last_became_peered":"2024-01-21T20:15:21.441399+0000","last_unstale":"2024-01-21T20:15:21.826075+0000","last_undegraded":"2024-01-21T20:15:21.826075+0000","last_fullsized":"2024-01-21T20:15:21.826075+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827969+0000","last_change":"2024-01-21T20:15:21.822121+0000","last_active":"2024-01-21T20:15:21.827969+0000","last_peered":"2024-01-21T20:15:21.827969+0000","last_clean":"2024-01-21T20:15:21.827969+0000","last_became_active":"2024-01-21T20:15:21.821860+0000","last_became_peered":"2024-01-21T20:15:21.821860+0000","last_unstale":"2024-01-21T20:15:21.827969+0000","last_undegraded":"2024-01-21T20:15:21.827969+0000","last_fullsized":"2024-01-21T20:15:21.827969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826358+0000","last_change":"2024-01-21T20:15:21.451159+0000","last_active":"2024-01-21T20:15:21.826358+0000","last_peered":"2024-01-21T20:15:21.826358+0000","last_clean":"2024-01-21T20:15:21.826358+0000","last_became_active":"2024-01-21T20:15:21.450871+0000","last_became_peered":"2024-01-21T20:15:21.450871+0000","last_unstale":"2024-01-21T20:15:21.826358+0000","last_undegraded":"2024-01-21T20:15:21.826358+0000","last_fullsized":"2024-01-21T20:15:21.826358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834843+0000","last_change":"2024-01-21T20:15:21.833195+0000","last_active":"2024-01-21T20:15:21.834843+0000","last_peered":"2024-01-21T20:15:21.834843+0000","last_clean":"2024-01-21T20:15:21.834843+0000","last_became_active":"2024-01-21T20:15:21.831763+0000","last_became_peered":"2024-01-21T20:15:21.831763+0000","last_unstale":"2024-01-21T20:15:21.834843+0000","last_undegraded":"2024-01-21T20:15:21.834843+0000","last_fullsized":"2024-01-21T20:15:21.834843+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.808038+0000","last_change":"2024-01-21T20:15:21.443731+0000","last_active":"2024-01-21T20:15:21.808038+0000","last_peered":"2024-01-21T20:15:21.808038+0000","last_clean":"2024-01-21T20:15:21.808038+0000","last_became_active":"2024-01-21T20:15:21.443460+0000","last_became_peered":"2024-01-21T20:15:21.443460+0000","last_unstale":"2024-01-21T20:15:21.808038+0000","last_undegraded":"2024-01-21T20:15:21.808038+0000","last_fullsized":"2024-01-21T20:15:21.808038+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835469+0000","last_change":"2024-01-21T20:15:21.834253+0000","last_active":"2024-01-21T20:15:21.835469+0000","last_peered":"2024-01-21T20:15:21.835469+0000","last_clean":"2024-01-21T20:15:21.835469+0000","last_became_active":"2024-01-21T20:15:21.834005+0000","last_became_peered":"2024-01-21T20:15:21.834005+0000","last_unstale":"2024-01-21T20:15:21.835469+0000","last_undegraded":"2024-01-21T20:15:21.835469+0000","last_fullsized":"2024-01-21T20:15:21.835469+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809705+0000","last_change":"2024-01-21T20:15:21.439012+0000","last_active":"2024-01-21T20:15:21.809705+0000","last_peered":"2024-01-21T20:15:21.809705+0000","last_clean":"2024-01-21T20:15:21.809705+0000","last_became_active":"2024-01-21T20:15:21.438757+0000","last_became_peered":"2024-01-21T20:15:21.438757+0000","last_unstale":"2024-01-21T20:15:21.809705+0000","last_undegraded":"2024-01-21T20:15:21.809705+0000","last_fullsized":"2024-01-21T20:15:21.809705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835430+0000","last_change":"2024-01-21T20:15:21.832395+0000","last_active":"2024-01-21T20:15:21.835430+0000","last_peered":"2024-01-21T20:15:21.835430+0000","last_clean":"2024-01-21T20:15:21.835430+0000","last_became_active":"2024-01-21T20:15:21.832139+0000","last_became_peered":"2024-01-21T20:15:21.832139+0000","last_unstale":"2024-01-21T20:15:21.835430+0000","last_undegraded":"2024-01-21T20:15:21.835430+0000","last_fullsized":"2024-01-21T20:15:21.835430+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830295+0000","last_change":"2024-01-21T20:15:21.443453+0000","last_active":"2024-01-21T20:15:21.830295+0000","last_peered":"2024-01-21T20:15:21.830295+0000","last_clean":"2024-01-21T20:15:21.830295+0000","last_became_active":"2024-01-21T20:15:21.443107+0000","last_became_peered":"2024-01-21T20:15:21.443107+0000","last_unstale":"2024-01-21T20:15:21.830295+0000","last_undegraded":"2024-01-21T20:15:21.830295+0000","last_fullsized":"2024-01-21T20:15:21.830295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826445+0000","last_change":"2024-01-21T20:15:21.822606+0000","last_active":"2024-01-21T20:15:21.826445+0000","last_peered":"2024-01-21T20:15:21.826445+0000","last_clean":"2024-01-21T20:15:21.826445+0000","last_became_active":"2024-01-21T20:15:21.822255+0000","last_became_peered":"2024-01-21T20:15:21.822255+0000","last_unstale":"2024-01-21T20:15:21.826445+0000","last_undegraded":"2024-01-21T20:15:21.826445+0000","last_fullsized":"2024-01-21T20:15:21.826445+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827289+0000","last_change":"2024-01-21T20:15:21.443075+0000","last_active":"2024-01-21T20:15:21.827289+0000","last_peered":"2024-01-21T20:15:21.827289+0000","last_clean":"2024-01-21T20:15:21.827289+0000","last_became_active":"2024-01-21T20:15:21.442793+0000","last_became_peered":"2024-01-21T20:15:21.442793+0000","last_unstale":"2024-01-21T20:15:21.827289+0000","last_undegraded":"2024-01-21T20:15:21.827289+0000","last_fullsized":"2024-01-21T20:15:21.827289+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833217+0000","last_change":"2024-01-21T20:15:21.830033+0000","last_active":"2024-01-21T20:15:21.833217+0000","last_peered":"2024-01-21T20:15:21.833217+0000","last_clean":"2024-01-21T20:15:21.833217+0000","last_became_active":"2024-01-21T20:15:21.829748+0000","last_became_peered":"2024-01-21T20:15:21.829748+0000","last_unstale":"2024-01-21T20:15:21.833217+0000","last_undegraded":"2024-01-21T20:15:21.833217+0000","last_fullsized":"2024-01-21T20:15:21.833217+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824950+0000","last_change":"2024-01-21T20:15:21.437931+0000","last_active":"2024-01-21T20:15:21.824950+0000","last_peered":"2024-01-21T20:15:21.824950+0000","last_clean":"2024-01-21T20:15:21.824950+0000","last_became_active":"2024-01-21T20:15:21.437290+0000","last_became_peered":"2024-01-21T20:15:21.437290+0000","last_unstale":"2024-01-21T20:15:21.824950+0000","last_undegraded":"2024-01-21T20:15:21.824950+0000","last_fullsized":"2024-01-21T20:15:21.824950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824117+0000","last_change":"2024-01-21T20:15:21.821526+0000","last_active":"2024-01-21T20:15:21.824117+0000","last_peered":"2024-01-21T20:15:21.824117+0000","last_clean":"2024-01-21T20:15:21.824117+0000","last_became_active":"2024-01-21T20:15:21.821255+0000","last_became_peered":"2024-01-21T20:15:21.821255+0000","last_unstale":"2024-01-21T20:15:21.824117+0000","last_undegraded":"2024-01-21T20:15:21.824117+0000","last_fullsized":"2024-01-21T20:15:21.824117+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822276+0000","last_change":"2024-01-21T20:15:21.451200+0000","last_active":"2024-01-21T20:15:21.822276+0000","last_peered":"2024-01-21T20:15:21.822276+0000","last_clean":"2024-01-21T20:15:21.822276+0000","last_became_active":"2024-01-21T20:15:21.450861+0000","last_became_peered":"2024-01-21T20:15:21.450861+0000","last_unstale":"2024-01-21T20:15:21.822276+0000","last_undegraded":"2024-01-21T20:15:21.822276+0000","last_fullsized":"2024-01-21T20:15:21.822276+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836370+0000","last_change":"2024-01-21T20:15:21.833958+0000","last_active":"2024-01-21T20:15:21.836370+0000","last_peered":"2024-01-21T20:15:21.836370+0000","last_clean":"2024-01-21T20:15:21.836370+0000","last_became_active":"2024-01-21T20:15:21.833681+0000","last_became_peered":"2024-01-21T20:15:21.833681+0000","last_unstale":"2024-01-21T20:15:21.836370+0000","last_undegraded":"2024-01-21T20:15:21.836370+0000","last_fullsized":"2024-01-21T20:15:21.836370+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814809+0000","last_change":"2024-01-21T20:15:21.443237+0000","last_active":"2024-01-21T20:15:21.814809+0000","last_peered":"2024-01-21T20:15:21.814809+0000","last_clean":"2024-01-21T20:15:21.814809+0000","last_became_active":"2024-01-21T20:15:21.442896+0000","last_became_peered":"2024-01-21T20:15:21.442896+0000","last_unstale":"2024-01-21T20:15:21.814809+0000","last_undegraded":"2024-01-21T20:15:21.814809+0000","last_fullsized":"2024-01-21T20:15:21.814809+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823817+0000","last_change":"2024-01-21T20:15:21.817654+0000","last_active":"2024-01-21T20:15:21.823817+0000","last_peered":"2024-01-21T20:15:21.823817+0000","last_clean":"2024-01-21T20:15:21.823817+0000","last_became_active":"2024-01-21T20:15:21.817386+0000","last_became_peered":"2024-01-21T20:15:21.817386+0000","last_unstale":"2024-01-21T20:15:21.823817+0000","last_undegraded":"2024-01-21T20:15:21.823817+0000","last_fullsized":"2024-01-21T20:15:21.823817+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809311+0000","last_change":"2024-01-21T20:15:21.446155+0000","last_active":"2024-01-21T20:15:21.809311+0000","last_peered":"2024-01-21T20:15:21.809311+0000","last_clean":"2024-01-21T20:15:21.809311+0000","last_became_active":"2024-01-21T20:15:21.445264+0000","last_became_peered":"2024-01-21T20:15:21.445264+0000","last_unstale":"2024-01-21T20:15:21.809311+0000","last_undegraded":"2024-01-21T20:15:21.809311+0000","last_fullsized":"2024-01-21T20:15:21.809311+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837711+0000","last_change":"2024-01-21T20:15:21.829179+0000","last_active":"2024-01-21T20:15:21.837711+0000","last_peered":"2024-01-21T20:15:21.837711+0000","last_clean":"2024-01-21T20:15:21.837711+0000","last_became_active":"2024-01-21T20:15:21.828870+0000","last_became_peered":"2024-01-21T20:15:21.828870+0000","last_unstale":"2024-01-21T20:15:21.837711+0000","last_undegraded":"2024-01-21T20:15:21.837711+0000","last_fullsized":"2024-01-21T20:15:21.837711+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810731+0000","last_change":"2024-01-21T20:15:21.436654+0000","last_active":"2024-01-21T20:15:21.810731+0000","last_peered":"2024-01-21T20:15:21.810731+0000","last_clean":"2024-01-21T20:15:21.810731+0000","last_became_active":"2024-01-21T20:15:21.436335+0000","last_became_peered":"2024-01-21T20:15:21.436335+0000","last_unstale":"2024-01-21T20:15:21.810731+0000","last_undegraded":"2024-01-21T20:15:21.810731+0000","last_fullsized":"2024-01-21T20:15:21.810731+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832462+0000","last_change":"2024-01-21T20:15:21.830868+0000","last_active":"2024-01-21T20:15:21.832462+0000","last_peered":"2024-01-21T20:15:21.832462+0000","last_clean":"2024-01-21T20:15:21.832462+0000","last_became_active":"2024-01-21T20:15:21.830625+0000","last_became_peered":"2024-01-21T20:15:21.830625+0000","last_unstale":"2024-01-21T20:15:21.832462+0000","last_undegraded":"2024-01-21T20:15:21.832462+0000","last_fullsized":"2024-01-21T20:15:21.832462+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814204+0000","last_change":"2024-01-21T20:15:21.443198+0000","last_active":"2024-01-21T20:15:21.814204+0000","last_peered":"2024-01-21T20:15:21.814204+0000","last_clean":"2024-01-21T20:15:21.814204+0000","last_became_active":"2024-01-21T20:15:21.442881+0000","last_became_peered":"2024-01-21T20:15:21.442881+0000","last_unstale":"2024-01-21T20:15:21.814204+0000","last_undegraded":"2024-01-21T20:15:21.814204+0000","last_fullsized":"2024-01-21T20:15:21.814204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828531+0000","last_change":"2024-01-21T20:15:21.824225+0000","last_active":"2024-01-21T20:15:21.828531+0000","last_peered":"2024-01-21T20:15:21.828531+0000","last_clean":"2024-01-21T20:15:21.828531+0000","last_became_active":"2024-01-21T20:15:21.823948+0000","last_became_peered":"2024-01-21T20:15:21.823948+0000","last_unstale":"2024-01-21T20:15:21.828531+0000","last_undegraded":"2024-01-21T20:15:21.828531+0000","last_fullsized":"2024-01-21T20:15:21.828531+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812737+0000","last_change":"2024-01-21T20:15:21.444601+0000","last_active":"2024-01-21T20:15:21.812737+0000","last_peered":"2024-01-21T20:15:21.812737+0000","last_clean":"2024-01-21T20:15:21.812737+0000","last_became_active":"2024-01-21T20:15:21.444080+0000","last_became_peered":"2024-01-21T20:15:21.444080+0000","last_unstale":"2024-01-21T20:15:21.812737+0000","last_undegraded":"2024-01-21T20:15:21.812737+0000","last_fullsized":"2024-01-21T20:15:21.812737+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833214+0000","last_change":"2024-01-21T20:15:21.830361+0000","last_active":"2024-01-21T20:15:21.833214+0000","last_peered":"2024-01-21T20:15:21.833214+0000","last_clean":"2024-01-21T20:15:21.833214+0000","last_became_active":"2024-01-21T20:15:21.830102+0000","last_became_peered":"2024-01-21T20:15:21.830102+0000","last_unstale":"2024-01-21T20:15:21.833214+0000","last_undegraded":"2024-01-21T20:15:21.833214+0000","last_fullsized":"2024-01-21T20:15:21.833214+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822447+0000","last_change":"2024-01-21T20:15:21.442810+0000","last_active":"2024-01-21T20:15:21.822447+0000","last_peered":"2024-01-21T20:15:21.822447+0000","last_clean":"2024-01-21T20:15:21.822447+0000","last_became_active":"2024-01-21T20:15:21.442506+0000","last_became_peered":"2024-01-21T20:15:21.442506+0000","last_unstale":"2024-01-21T20:15:21.822447+0000","last_undegraded":"2024-01-21T20:15:21.822447+0000","last_fullsized":"2024-01-21T20:15:21.822447+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812035+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:15:21.812035+0000","last_peered":"2024-01-21T20:15:21.812035+0000","last_clean":"2024-01-21T20:15:21.812035+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:15:21.812035+0000","last_undegraded":"2024-01-21T20:15:21.812035+0000","last_fullsized":"2024-01-21T20:15:21.812035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837323+0000","last_change":"2024-01-21T20:15:21.836397+0000","last_active":"2024-01-21T20:15:21.837323+0000","last_peered":"2024-01-21T20:15:21.837323+0000","last_clean":"2024-01-21T20:15:21.837323+0000","last_became_active":"2024-01-21T20:15:21.836100+0000","last_became_peered":"2024-01-21T20:15:21.836100+0000","last_unstale":"2024-01-21T20:15:21.837323+0000","last_undegraded":"2024-01-21T20:15:21.837323+0000","last_fullsized":"2024-01-21T20:15:21.837323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822035+0000","last_change":"2024-01-21T20:15:21.445789+0000","last_active":"2024-01-21T20:15:21.822035+0000","last_peered":"2024-01-21T20:15:21.822035+0000","last_clean":"2024-01-21T20:15:21.822035+0000","last_became_active":"2024-01-21T20:15:21.445057+0000","last_became_peered":"2024-01-21T20:15:21.445057+0000","last_unstale":"2024-01-21T20:15:21.822035+0000","last_undegraded":"2024-01-21T20:15:21.822035+0000","last_fullsized":"2024-01-21T20:15:21.822035+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810820+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:15:21.810820+0000","last_peered":"2024-01-21T20:15:21.810820+0000","last_clean":"2024-01-21T20:15:21.810820+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:15:21.810820+0000","last_undegraded":"2024-01-21T20:15:21.810820+0000","last_fullsized":"2024-01-21T20:15:21.810820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826380+0000","last_change":"2024-01-21T20:15:21.821489+0000","last_active":"2024-01-21T20:15:21.826380+0000","last_peered":"2024-01-21T20:15:21.826380+0000","last_clean":"2024-01-21T20:15:21.826380+0000","last_became_active":"2024-01-21T20:15:21.821201+0000","last_became_peered":"2024-01-21T20:15:21.821201+0000","last_unstale":"2024-01-21T20:15:21.826380+0000","last_undegraded":"2024-01-21T20:15:21.826380+0000","last_fullsized":"2024-01-21T20:15:21.826380+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821753+0000","last_change":"2024-01-21T20:15:21.444892+0000","last_active":"2024-01-21T20:15:21.821753+0000","last_peered":"2024-01-21T20:15:21.821753+0000","last_clean":"2024-01-21T20:15:21.821753+0000","last_became_active":"2024-01-21T20:15:21.444279+0000","last_became_peered":"2024-01-21T20:15:21.444279+0000","last_unstale":"2024-01-21T20:15:21.821753+0000","last_undegraded":"2024-01-21T20:15:21.821753+0000","last_fullsized":"2024-01-21T20:15:21.821753+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812452+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:15:21.812452+0000","last_peered":"2024-01-21T20:15:21.812452+0000","last_clean":"2024-01-21T20:15:21.812452+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:15:21.812452+0000","last_undegraded":"2024-01-21T20:15:21.812452+0000","last_fullsized":"2024-01-21T20:15:21.812452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827664+0000","last_change":"2024-01-21T20:15:21.826793+0000","last_active":"2024-01-21T20:15:21.827664+0000","last_peered":"2024-01-21T20:15:21.827664+0000","last_clean":"2024-01-21T20:15:21.827664+0000","last_became_active":"2024-01-21T20:15:21.826391+0000","last_became_peered":"2024-01-21T20:15:21.826391+0000","last_unstale":"2024-01-21T20:15:21.827664+0000","last_undegraded":"2024-01-21T20:15:21.827664+0000","last_fullsized":"2024-01-21T20:15:21.827664+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811964+0000","last_change":"2024-01-21T20:15:21.430707+0000","last_active":"2024-01-21T20:15:21.811964+0000","last_peered":"2024-01-21T20:15:21.811964+0000","last_clean":"2024-01-21T20:15:21.811964+0000","last_became_active":"2024-01-21T20:15:21.430416+0000","last_became_peered":"2024-01-21T20:15:21.430416+0000","last_unstale":"2024-01-21T20:15:21.811964+0000","last_undegraded":"2024-01-21T20:15:21.811964+0000","last_fullsized":"2024-01-21T20:15:21.811964+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810678+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:15:21.810678+0000","last_peered":"2024-01-21T20:15:21.810678+0000","last_clean":"2024-01-21T20:15:21.810678+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:15:21.810678+0000","last_undegraded":"2024-01-21T20:15:21.810678+0000","last_fullsized":"2024-01-21T20:15:21.810678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813620+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:15:21.813620+0000","last_peered":"2024-01-21T20:15:21.813620+0000","last_clean":"2024-01-21T20:15:21.813620+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:15:21.813620+0000","last_undegraded":"2024-01-21T20:15:21.813620+0000","last_fullsized":"2024-01-21T20:15:21.813620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833189+0000","last_change":"2024-01-21T20:15:21.829803+0000","last_active":"2024-01-21T20:15:21.833189+0000","last_peered":"2024-01-21T20:15:21.833189+0000","last_clean":"2024-01-21T20:15:21.833189+0000","last_became_active":"2024-01-21T20:15:21.829434+0000","last_became_peered":"2024-01-21T20:15:21.829434+0000","last_unstale":"2024-01-21T20:15:21.833189+0000","last_undegraded":"2024-01-21T20:15:21.833189+0000","last_fullsized":"2024-01-21T20:15:21.833189+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821719+0000","last_change":"2024-01-21T20:15:21.439867+0000","last_active":"2024-01-21T20:15:21.821719+0000","last_peered":"2024-01-21T20:15:21.821719+0000","last_clean":"2024-01-21T20:15:21.821719+0000","last_became_active":"2024-01-21T20:15:21.439585+0000","last_became_peered":"2024-01-21T20:15:21.439585+0000","last_unstale":"2024-01-21T20:15:21.821719+0000","last_undegraded":"2024-01-21T20:15:21.821719+0000","last_fullsized":"2024-01-21T20:15:21.821719+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812835+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:15:21.812835+0000","last_peered":"2024-01-21T20:15:21.812835+0000","last_clean":"2024-01-21T20:15:21.812835+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:15:21.812835+0000","last_undegraded":"2024-01-21T20:15:21.812835+0000","last_fullsized":"2024-01-21T20:15:21.812835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836584+0000","last_change":"2024-01-21T20:15:21.834560+0000","last_active":"2024-01-21T20:15:21.836584+0000","last_peered":"2024-01-21T20:15:21.836584+0000","last_clean":"2024-01-21T20:15:21.836584+0000","last_became_active":"2024-01-21T20:15:21.824614+0000","last_became_peered":"2024-01-21T20:15:21.824614+0000","last_unstale":"2024-01-21T20:15:21.836584+0000","last_undegraded":"2024-01-21T20:15:21.836584+0000","last_fullsized":"2024-01-21T20:15:21.836584+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812242+0000","last_change":"2024-01-21T20:15:21.444341+0000","last_active":"2024-01-21T20:15:21.812242+0000","last_peered":"2024-01-21T20:15:21.812242+0000","last_clean":"2024-01-21T20:15:21.812242+0000","last_became_active":"2024-01-21T20:15:21.443657+0000","last_became_peered":"2024-01-21T20:15:21.443657+0000","last_unstale":"2024-01-21T20:15:21.812242+0000","last_undegraded":"2024-01-21T20:15:21.812242+0000","last_fullsized":"2024-01-21T20:15:21.812242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814431+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:15:21.814431+0000","last_peered":"2024-01-21T20:15:21.814431+0000","last_clean":"2024-01-21T20:15:21.814431+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:15:21.814431+0000","last_undegraded":"2024-01-21T20:15:21.814431+0000","last_fullsized":"2024-01-21T20:15:21.814431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836761+0000","last_change":"2024-01-21T20:15:21.835253+0000","last_active":"2024-01-21T20:15:21.836761+0000","last_peered":"2024-01-21T20:15:21.836761+0000","last_clean":"2024-01-21T20:15:21.836761+0000","last_became_active":"2024-01-21T20:15:21.834968+0000","last_became_peered":"2024-01-21T20:15:21.834968+0000","last_unstale":"2024-01-21T20:15:21.836761+0000","last_undegraded":"2024-01-21T20:15:21.836761+0000","last_fullsized":"2024-01-21T20:15:21.836761+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810360+0000","last_change":"2024-01-21T20:15:21.445267+0000","last_active":"2024-01-21T20:15:21.810360+0000","last_peered":"2024-01-21T20:15:21.810360+0000","last_clean":"2024-01-21T20:15:21.810360+0000","last_became_active":"2024-01-21T20:15:21.444948+0000","last_became_peered":"2024-01-21T20:15:21.444948+0000","last_unstale":"2024-01-21T20:15:21.810360+0000","last_undegraded":"2024-01-21T20:15:21.810360+0000","last_fullsized":"2024-01-21T20:15:21.810360+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809858+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:15:21.809858+0000","last_peered":"2024-01-21T20:15:21.809858+0000","last_clean":"2024-01-21T20:15:21.809858+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:15:21.809858+0000","last_undegraded":"2024-01-21T20:15:21.809858+0000","last_fullsized":"2024-01-21T20:15:21.809858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825646+0000","last_change":"2024-01-21T20:15:21.821011+0000","last_active":"2024-01-21T20:15:21.825646+0000","last_peered":"2024-01-21T20:15:21.825646+0000","last_clean":"2024-01-21T20:15:21.825646+0000","last_became_active":"2024-01-21T20:15:21.820721+0000","last_became_peered":"2024-01-21T20:15:21.820721+0000","last_unstale":"2024-01-21T20:15:21.825646+0000","last_undegraded":"2024-01-21T20:15:21.825646+0000","last_fullsized":"2024-01-21T20:15:21.825646+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812044+0000","last_change":"2024-01-21T20:15:21.446054+0000","last_active":"2024-01-21T20:15:21.812044+0000","last_peered":"2024-01-21T20:15:21.812044+0000","last_clean":"2024-01-21T20:15:21.812044+0000","last_became_active":"2024-01-21T20:15:21.445770+0000","last_became_peered":"2024-01-21T20:15:21.445770+0000","last_unstale":"2024-01-21T20:15:21.812044+0000","last_undegraded":"2024-01-21T20:15:21.812044+0000","last_fullsized":"2024-01-21T20:15:21.812044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815036+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:15:21.815036+0000","last_peered":"2024-01-21T20:15:21.815036+0000","last_clean":"2024-01-21T20:15:21.815036+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:15:21.815036+0000","last_undegraded":"2024-01-21T20:15:21.815036+0000","last_fullsized":"2024-01-21T20:15:21.815036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069348,"statfs":{"total":96636764160,"available":96327012352,"internally_reserved":0,"allocated":1331200,"data_stored":688593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.44}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.47299999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.48299999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":691610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":1.083},"last":0.47099999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.379,"5min":0.252,"15min":0.252},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":1.107},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.81200000000000006,"15min":1.016},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":1.0609999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":1.621,"15min":1.621},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.375},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48199999999999998},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.75,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302488,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069352,"statfs":{"total":96636764160,"available":96327016448,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1343488,"data_stored":689375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34200000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.28399999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302488,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069352,"statfs":{"total":96636764160,"available":96327016448,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.32300000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.308}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.438}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1335296,"data_stored":690460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.28299999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.372},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.224}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.26200000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1335296,"data_stored":690142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.75}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.46400000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065256,"statfs":{"total":96636764160,"available":96322822144,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.622}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.40100000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:15:27.705 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T20:15:27.715+0000 7fbe6e532700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:15:29.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:15:29.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.620+0000 7f2e67833700 1 Processor -- start 2024-01-21T20:15:29.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 -- start start 2024-01-21T20:15:29.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 0x7f2e600c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e600695b0 0x7f2e60069a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e60069f10 con 0x7f2e6013a830 2024-01-21T20:15:29.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e600c3890 con 0x7f2e600695b0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.621+0000 7f2e67833700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600c3b70 con 0x7f2e6013ac10 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e600695b0 0x7f2e60069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e655cf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e6013a830 0x7f2e600bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39830/0 (socket says 172.21.15.133:39830) 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e655cf700 1 -- 172.21.15.133:0/3802285776 learned_addr learned my addr 172.21.15.133:0/3802285776 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e64dce700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 0x7f2e600c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 -- 172.21.15.133:0/3802285776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 msgr2=0x7f2e600c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 0x7f2e600c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 -- 172.21.15.133:0/3802285776 >> v1:172.21.15.133:6789/0 conn(0x7f2e6013a830 legacy=0x7f2e600bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e53fff700 1 -- 172.21.15.133:0/3802285776 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681342708 0 0) 0x7f2e60069f10 con 0x7f2e6013a830 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 -- 172.21.15.133:0/3802285776 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e600c3e50 con 0x7f2e600695b0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e64dce700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 0x7f2e600c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e65dd0700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e600695b0 0x7f2e60069a20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f2e58009e60 tx=0x7f2e58009780).ready entity=mon.0 client_cookie=71cbca0f2d4fd24e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e53fff700 1 -- 172.21.15.133:0/3802285776 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5800e070 con 0x7f2e600695b0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e53fff700 1 -- 172.21.15.133:0/3802285776 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5800bc30 con 0x7f2e600695b0 2024-01-21T20:15:29.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.622+0000 7f2e53fff700 1 -- 172.21.15.133:0/3802285776 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58012410 con 0x7f2e600695b0 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 -- 172.21.15.133:0/3802285776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e600695b0 msgr2=0x7f2e60069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e600695b0 0x7f2e60069a20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f2e58009e60 tx=0x7f2e58009780).stop 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 -- 172.21.15.133:0/3802285776 shutdown_connections 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e600695b0 0x7f2e60069a20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 --2- 172.21.15.133:0/3802285776 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e6013ac10 0x7f2e600c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 -- 172.21.15.133:0/3802285776 >> 172.21.15.133:0/3802285776 conn(0x7f2e600c7dc0 msgr2=0x7f2e600c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 -- 172.21.15.133:0/3802285776 shutdown_connections 2024-01-21T20:15:29.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.623+0000 7f2e67833700 1 -- 172.21.15.133:0/3802285776 wait complete. 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.624+0000 7f2e67833700 1 Processor -- start 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.624+0000 7f2e67833700 1 -- start start 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e600695b0 0x7f2e600631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 0x7f2e60138140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e600627a0 con 0x7f2e6013a830 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60062d60 con 0x7f2e6013ac10 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e67833700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e60151050 con 0x7f2e600695b0 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54996/0 (socket says 172.21.15.133:54996) 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 -- 172.21.15.133:0/3832846162 learned_addr learned my addr 172.21.15.133:0/3832846162 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e655cf700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e600695b0 0x7f2e600631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e65dd0700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 0x7f2e60138140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 -- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e600695b0 msgr2=0x7f2e600631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e600695b0 0x7f2e600631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 -- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 msgr2=0x7f2e60138140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 0x7f2e60138140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 -- 172.21.15.133:0/3832846162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58009a20 con 0x7f2e6013a830 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e65dd0700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 0x7f2e60138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.625+0000 7f2e64dce700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f2e5400d890 tx=0x7f2e54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.626+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54011590 con 0x7f2e6013a830 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.626+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e540116f0 con 0x7f2e6013a830 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.626+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e60138b00 con 0x7f2e6013a830 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.626+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54011a70 con 0x7f2e6013a830 2024-01-21T20:15:29.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.626+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e600629f0 con 0x7f2e6013a830 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.627+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e60062ef0 con 0x7f2e6013a830 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.627+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2e54012420 con 0x7f2e6013a830 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.627+0000 7f2e51ffb700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 0x7f2e44061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.627+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f2e54079ec0 con 0x7f2e6013a830 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.628+0000 7f2e655cf700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 0x7f2e44061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.628+0000 7f2e655cf700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 0x7f2e44061640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e5c007fd0 tx=0x7f2e5c007dd0).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.632+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e5404aee0 con 0x7f2e6013a830 2024-01-21T20:15:29.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.791+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e600c4130 con 0x7f2e4405f180 2024-01-21T20:15:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.800+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3832846162 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362184 (secure 0 0 0) 0x7f2e600c4130 con 0x7f2e4405f180 2024-01-21T20:15:29.795 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:29.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 msgr2=0x7f2e44061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 0x7f2e44061640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e5c007fd0 tx=0x7f2e5c007dd0).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 msgr2=0x7f2e60150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f2e5400d890 tx=0x7f2e54008040).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 shutdown_connections 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2e4405f180 0x7f2e44061640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e6013ac10 0x7f2e60138140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e600695b0 0x7f2e600631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 --2- 172.21.15.133:0/3832846162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e6013a830 0x7f2e60150b60 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 >> 172.21.15.133:0/3832846162 conn(0x7f2e600c7dc0 msgr2=0x7f2e60065200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 shutdown_connections 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.804+0000 7f2e67833700 1 -- 172.21.15.133:0/3832846162 wait complete. 2024-01-21T20:15:29.798 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:15:29.806 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T20:15:27.867830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":228,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2424056,"kb_used_data":10424,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752550664,"statfs":{"total":773094113280,"available":770611879936,"internally_reserved":0,"allocated":10674176,"data_stored":5518674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4468,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.515052"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832903+0000","last_change":"2024-01-21T20:15:21.828599+0000","last_active":"2024-01-21T20:15:21.832903+0000","last_peered":"2024-01-21T20:15:21.832903+0000","last_clean":"2024-01-21T20:15:21.832903+0000","last_became_active":"2024-01-21T20:15:21.824691+0000","last_became_peered":"2024-01-21T20:15:21.824691+0000","last_unstale":"2024-01-21T20:15:21.832903+0000","last_undegraded":"2024-01-21T20:15:21.832903+0000","last_fullsized":"2024-01-21T20:15:21.832903+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835953+0000","last_change":"2024-01-21T20:15:21.440624+0000","last_active":"2024-01-21T20:15:21.835953+0000","last_peered":"2024-01-21T20:15:21.835953+0000","last_clean":"2024-01-21T20:15:21.835953+0000","last_became_active":"2024-01-21T20:15:21.440174+0000","last_became_peered":"2024-01-21T20:15:21.440174+0000","last_unstale":"2024-01-21T20:15:21.835953+0000","last_undegraded":"2024-01-21T20:15:21.835953+0000","last_fullsized":"2024-01-21T20:15:21.835953+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837619+0000","last_change":"2024-01-21T20:15:21.828091+0000","last_active":"2024-01-21T20:15:21.837619+0000","last_peered":"2024-01-21T20:15:21.837619+0000","last_clean":"2024-01-21T20:15:21.837619+0000","last_became_active":"2024-01-21T20:15:21.827767+0000","last_became_peered":"2024-01-21T20:15:21.827767+0000","last_unstale":"2024-01-21T20:15:21.837619+0000","last_undegraded":"2024-01-21T20:15:21.837619+0000","last_fullsized":"2024-01-21T20:15:21.837619+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809954+0000","last_change":"2024-01-21T20:15:21.438189+0000","last_active":"2024-01-21T20:15:21.809954+0000","last_peered":"2024-01-21T20:15:21.809954+0000","last_clean":"2024-01-21T20:15:21.809954+0000","last_became_active":"2024-01-21T20:15:21.437846+0000","last_became_peered":"2024-01-21T20:15:21.437846+0000","last_unstale":"2024-01-21T20:15:21.809954+0000","last_undegraded":"2024-01-21T20:15:21.809954+0000","last_fullsized":"2024-01-21T20:15:21.809954+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834921+0000","last_change":"2024-01-21T20:15:21.824449+0000","last_active":"2024-01-21T20:15:21.834921+0000","last_peered":"2024-01-21T20:15:21.834921+0000","last_clean":"2024-01-21T20:15:21.834921+0000","last_became_active":"2024-01-21T20:15:21.824193+0000","last_became_peered":"2024-01-21T20:15:21.824193+0000","last_unstale":"2024-01-21T20:15:21.834921+0000","last_undegraded":"2024-01-21T20:15:21.834921+0000","last_fullsized":"2024-01-21T20:15:21.834921+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814227+0000","last_change":"2024-01-21T20:15:21.443127+0000","last_active":"2024-01-21T20:15:21.814227+0000","last_peered":"2024-01-21T20:15:21.814227+0000","last_clean":"2024-01-21T20:15:21.814227+0000","last_became_active":"2024-01-21T20:15:21.442816+0000","last_became_peered":"2024-01-21T20:15:21.442816+0000","last_unstale":"2024-01-21T20:15:21.814227+0000","last_undegraded":"2024-01-21T20:15:21.814227+0000","last_fullsized":"2024-01-21T20:15:21.814227+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835239+0000","last_change":"2024-01-21T20:15:21.825071+0000","last_active":"2024-01-21T20:15:21.835239+0000","last_peered":"2024-01-21T20:15:21.835239+0000","last_clean":"2024-01-21T20:15:21.835239+0000","last_became_active":"2024-01-21T20:15:21.824816+0000","last_became_peered":"2024-01-21T20:15:21.824816+0000","last_unstale":"2024-01-21T20:15:21.835239+0000","last_undegraded":"2024-01-21T20:15:21.835239+0000","last_fullsized":"2024-01-21T20:15:21.835239+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3c","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832695+0000","last_change":"2024-01-21T20:15:21.444097+0000","last_active":"2024-01-21T20:15:21.832695+0000","last_peered":"2024-01-21T20:15:21.832695+0000","last_clean":"2024-01-21T20:15:21.832695+0000","last_became_active":"2024-01-21T20:15:21.443815+0000","last_became_peered":"2024-01-21T20:15:21.443815+0000","last_unstale":"2024-01-21T20:15:21.832695+0000","last_undegraded":"2024-01-21T20:15:21.832695+0000","last_fullsized":"2024-01-21T20:15:21.832695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827950+0000","last_change":"2024-01-21T20:15:21.822020+0000","last_active":"2024-01-21T20:15:21.827950+0000","last_peered":"2024-01-21T20:15:21.827950+0000","last_clean":"2024-01-21T20:15:21.827950+0000","last_became_active":"2024-01-21T20:15:21.821743+0000","last_became_peered":"2024-01-21T20:15:21.821743+0000","last_unstale":"2024-01-21T20:15:21.827950+0000","last_undegraded":"2024-01-21T20:15:21.827950+0000","last_fullsized":"2024-01-21T20:15:21.827950+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833176+0000","last_change":"2024-01-21T20:15:21.445321+0000","last_active":"2024-01-21T20:15:21.833176+0000","last_peered":"2024-01-21T20:15:21.833176+0000","last_clean":"2024-01-21T20:15:21.833176+0000","last_became_active":"2024-01-21T20:15:21.444855+0000","last_became_peered":"2024-01-21T20:15:21.444855+0000","last_unstale":"2024-01-21T20:15:21.833176+0000","last_undegraded":"2024-01-21T20:15:21.833176+0000","last_fullsized":"2024-01-21T20:15:21.833176+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827646+0000","last_change":"2024-01-21T20:15:21.826715+0000","last_active":"2024-01-21T20:15:21.827646+0000","last_peered":"2024-01-21T20:15:21.827646+0000","last_clean":"2024-01-21T20:15:21.827646+0000","last_became_active":"2024-01-21T20:15:21.826378+0000","last_became_peered":"2024-01-21T20:15:21.826378+0000","last_unstale":"2024-01-21T20:15:21.827646+0000","last_undegraded":"2024-01-21T20:15:21.827646+0000","last_fullsized":"2024-01-21T20:15:21.827646+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3a","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823963+0000","last_change":"2024-01-21T20:15:21.446524+0000","last_active":"2024-01-21T20:15:21.823963+0000","last_peered":"2024-01-21T20:15:21.823963+0000","last_clean":"2024-01-21T20:15:21.823963+0000","last_became_active":"2024-01-21T20:15:21.445683+0000","last_became_peered":"2024-01-21T20:15:21.445683+0000","last_unstale":"2024-01-21T20:15:21.823963+0000","last_undegraded":"2024-01-21T20:15:21.823963+0000","last_fullsized":"2024-01-21T20:15:21.823963+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825182+0000","last_change":"2024-01-21T20:15:21.821701+0000","last_active":"2024-01-21T20:15:21.825182+0000","last_peered":"2024-01-21T20:15:21.825182+0000","last_clean":"2024-01-21T20:15:21.825182+0000","last_became_active":"2024-01-21T20:15:21.821413+0000","last_became_peered":"2024-01-21T20:15:21.821413+0000","last_unstale":"2024-01-21T20:15:21.825182+0000","last_undegraded":"2024-01-21T20:15:21.825182+0000","last_fullsized":"2024-01-21T20:15:21.825182+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812365+0000","last_change":"2024-01-21T20:15:21.439385+0000","last_active":"2024-01-21T20:15:21.812365+0000","last_peered":"2024-01-21T20:15:21.812365+0000","last_clean":"2024-01-21T20:15:21.812365+0000","last_became_active":"2024-01-21T20:15:21.439104+0000","last_became_peered":"2024-01-21T20:15:21.439104+0000","last_unstale":"2024-01-21T20:15:21.812365+0000","last_undegraded":"2024-01-21T20:15:21.812365+0000","last_fullsized":"2024-01-21T20:15:21.812365+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834857+0000","last_change":"2024-01-21T20:15:21.832980+0000","last_active":"2024-01-21T20:15:21.834857+0000","last_peered":"2024-01-21T20:15:21.834857+0000","last_clean":"2024-01-21T20:15:21.834857+0000","last_became_active":"2024-01-21T20:15:21.831413+0000","last_became_peered":"2024-01-21T20:15:21.831413+0000","last_unstale":"2024-01-21T20:15:21.834857+0000","last_undegraded":"2024-01-21T20:15:21.834857+0000","last_fullsized":"2024-01-21T20:15:21.834857+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809572+0000","last_change":"2024-01-21T20:15:21.443577+0000","last_active":"2024-01-21T20:15:21.809572+0000","last_peered":"2024-01-21T20:15:21.809572+0000","last_clean":"2024-01-21T20:15:21.809572+0000","last_became_active":"2024-01-21T20:15:21.443248+0000","last_became_peered":"2024-01-21T20:15:21.443248+0000","last_unstale":"2024-01-21T20:15:21.809572+0000","last_undegraded":"2024-01-21T20:15:21.809572+0000","last_fullsized":"2024-01-21T20:15:21.809572+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.831947+0000","last_change":"2024-01-21T20:15:21.822998+0000","last_active":"2024-01-21T20:15:21.831947+0000","last_peered":"2024-01-21T20:15:21.831947+0000","last_clean":"2024-01-21T20:15:21.831947+0000","last_became_active":"2024-01-21T20:15:21.822748+0000","last_became_peered":"2024-01-21T20:15:21.822748+0000","last_unstale":"2024-01-21T20:15:21.831947+0000","last_undegraded":"2024-01-21T20:15:21.831947+0000","last_fullsized":"2024-01-21T20:15:21.831947+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811662+0000","last_change":"2024-01-21T20:15:21.445853+0000","last_active":"2024-01-21T20:15:21.811662+0000","last_peered":"2024-01-21T20:15:21.811662+0000","last_clean":"2024-01-21T20:15:21.811662+0000","last_became_active":"2024-01-21T20:15:21.445192+0000","last_became_peered":"2024-01-21T20:15:21.445192+0000","last_unstale":"2024-01-21T20:15:21.811662+0000","last_undegraded":"2024-01-21T20:15:21.811662+0000","last_fullsized":"2024-01-21T20:15:21.811662+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837355+0000","last_change":"2024-01-21T20:15:21.836674+0000","last_active":"2024-01-21T20:15:21.837355+0000","last_peered":"2024-01-21T20:15:21.837355+0000","last_clean":"2024-01-21T20:15:21.837355+0000","last_became_active":"2024-01-21T20:15:21.836217+0000","last_became_peered":"2024-01-21T20:15:21.836217+0000","last_unstale":"2024-01-21T20:15:21.837355+0000","last_undegraded":"2024-01-21T20:15:21.837355+0000","last_fullsized":"2024-01-21T20:15:21.837355+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813279+0000","last_change":"2024-01-21T20:15:21.444909+0000","last_active":"2024-01-21T20:15:21.813279+0000","last_peered":"2024-01-21T20:15:21.813279+0000","last_clean":"2024-01-21T20:15:21.813279+0000","last_became_active":"2024-01-21T20:15:21.444583+0000","last_became_peered":"2024-01-21T20:15:21.444583+0000","last_unstale":"2024-01-21T20:15:21.813279+0000","last_undegraded":"2024-01-21T20:15:21.813279+0000","last_fullsized":"2024-01-21T20:15:21.813279+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835528+0000","last_change":"2024-01-21T20:15:21.832802+0000","last_active":"2024-01-21T20:15:21.835528+0000","last_peered":"2024-01-21T20:15:21.835528+0000","last_clean":"2024-01-21T20:15:21.835528+0000","last_became_active":"2024-01-21T20:15:21.832501+0000","last_became_peered":"2024-01-21T20:15:21.832501+0000","last_unstale":"2024-01-21T20:15:21.835528+0000","last_undegraded":"2024-01-21T20:15:21.835528+0000","last_fullsized":"2024-01-21T20:15:21.835528+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809838+0000","last_change":"2024-01-21T20:15:21.439495+0000","last_active":"2024-01-21T20:15:21.809838+0000","last_peered":"2024-01-21T20:15:21.809838+0000","last_clean":"2024-01-21T20:15:21.809838+0000","last_became_active":"2024-01-21T20:15:21.439233+0000","last_became_peered":"2024-01-21T20:15:21.439233+0000","last_unstale":"2024-01-21T20:15:21.809838+0000","last_undegraded":"2024-01-21T20:15:21.809838+0000","last_fullsized":"2024-01-21T20:15:21.809838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828830+0000","last_change":"2024-01-21T20:15:21.825795+0000","last_active":"2024-01-21T20:15:21.828830+0000","last_peered":"2024-01-21T20:15:21.828830+0000","last_clean":"2024-01-21T20:15:21.828830+0000","last_became_active":"2024-01-21T20:15:21.825529+0000","last_became_peered":"2024-01-21T20:15:21.825529+0000","last_unstale":"2024-01-21T20:15:21.828830+0000","last_undegraded":"2024-01-21T20:15:21.828830+0000","last_fullsized":"2024-01-21T20:15:21.828830+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.34","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837990+0000","last_change":"2024-01-21T20:15:21.445434+0000","last_active":"2024-01-21T20:15:21.837990+0000","last_peered":"2024-01-21T20:15:21.837990+0000","last_clean":"2024-01-21T20:15:21.837990+0000","last_became_active":"2024-01-21T20:15:21.444452+0000","last_became_peered":"2024-01-21T20:15:21.444452+0000","last_unstale":"2024-01-21T20:15:21.837990+0000","last_undegraded":"2024-01-21T20:15:21.837990+0000","last_fullsized":"2024-01-21T20:15:21.837990+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830831+0000","last_change":"2024-01-21T20:15:21.826930+0000","last_active":"2024-01-21T20:15:21.830831+0000","last_peered":"2024-01-21T20:15:21.830831+0000","last_clean":"2024-01-21T20:15:21.830831+0000","last_became_active":"2024-01-21T20:15:21.826665+0000","last_became_peered":"2024-01-21T20:15:21.826665+0000","last_unstale":"2024-01-21T20:15:21.830831+0000","last_undegraded":"2024-01-21T20:15:21.830831+0000","last_fullsized":"2024-01-21T20:15:21.830831+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827330+0000","last_change":"2024-01-21T20:15:21.440133+0000","last_active":"2024-01-21T20:15:21.827330+0000","last_peered":"2024-01-21T20:15:21.827330+0000","last_clean":"2024-01-21T20:15:21.827330+0000","last_became_active":"2024-01-21T20:15:21.439315+0000","last_became_peered":"2024-01-21T20:15:21.439315+0000","last_unstale":"2024-01-21T20:15:21.827330+0000","last_undegraded":"2024-01-21T20:15:21.827330+0000","last_fullsized":"2024-01-21T20:15:21.827330+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828928+0000","last_change":"2024-01-21T20:15:21.823537+0000","last_active":"2024-01-21T20:15:21.828928+0000","last_peered":"2024-01-21T20:15:21.828928+0000","last_clean":"2024-01-21T20:15:21.828928+0000","last_became_active":"2024-01-21T20:15:21.823253+0000","last_became_peered":"2024-01-21T20:15:21.823253+0000","last_unstale":"2024-01-21T20:15:21.828928+0000","last_undegraded":"2024-01-21T20:15:21.828928+0000","last_fullsized":"2024-01-21T20:15:21.828928+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812151+0000","last_change":"2024-01-21T20:15:21.444530+0000","last_active":"2024-01-21T20:15:21.812151+0000","last_peered":"2024-01-21T20:15:21.812151+0000","last_clean":"2024-01-21T20:15:21.812151+0000","last_became_active":"2024-01-21T20:15:21.444063+0000","last_became_peered":"2024-01-21T20:15:21.444063+0000","last_unstale":"2024-01-21T20:15:21.812151+0000","last_undegraded":"2024-01-21T20:15:21.812151+0000","last_fullsized":"2024-01-21T20:15:21.812151+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835191+0000","last_change":"2024-01-21T20:15:21.833423+0000","last_active":"2024-01-21T20:15:21.835191+0000","last_peered":"2024-01-21T20:15:21.835191+0000","last_clean":"2024-01-21T20:15:21.835191+0000","last_became_active":"2024-01-21T20:15:21.833011+0000","last_became_peered":"2024-01-21T20:15:21.833011+0000","last_unstale":"2024-01-21T20:15:21.835191+0000","last_undegraded":"2024-01-21T20:15:21.835191+0000","last_fullsized":"2024-01-21T20:15:21.835191+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.818032+0000","last_change":"2024-01-21T20:15:21.440694+0000","last_active":"2024-01-21T20:15:21.818032+0000","last_peered":"2024-01-21T20:15:21.818032+0000","last_clean":"2024-01-21T20:15:21.818032+0000","last_became_active":"2024-01-21T20:15:21.440405+0000","last_became_peered":"2024-01-21T20:15:21.440405+0000","last_unstale":"2024-01-21T20:15:21.818032+0000","last_undegraded":"2024-01-21T20:15:21.818032+0000","last_fullsized":"2024-01-21T20:15:21.818032+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830660+0000","last_change":"2024-01-21T20:15:21.825552+0000","last_active":"2024-01-21T20:15:21.830660+0000","last_peered":"2024-01-21T20:15:21.830660+0000","last_clean":"2024-01-21T20:15:21.830660+0000","last_became_active":"2024-01-21T20:15:21.825128+0000","last_became_peered":"2024-01-21T20:15:21.825128+0000","last_unstale":"2024-01-21T20:15:21.830660+0000","last_undegraded":"2024-01-21T20:15:21.830660+0000","last_fullsized":"2024-01-21T20:15:21.830660+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.30","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834030+0000","last_change":"2024-01-21T20:15:21.438814+0000","last_active":"2024-01-21T20:15:21.834030+0000","last_peered":"2024-01-21T20:15:21.834030+0000","last_clean":"2024-01-21T20:15:21.834030+0000","last_became_active":"2024-01-21T20:15:21.438520+0000","last_became_peered":"2024-01-21T20:15:21.438520+0000","last_unstale":"2024-01-21T20:15:21.834030+0000","last_undegraded":"2024-01-21T20:15:21.834030+0000","last_fullsized":"2024-01-21T20:15:21.834030+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828735+0000","last_change":"2024-01-21T20:15:21.823625+0000","last_active":"2024-01-21T20:15:21.828735+0000","last_peered":"2024-01-21T20:15:21.828735+0000","last_clean":"2024-01-21T20:15:21.828735+0000","last_became_active":"2024-01-21T20:15:21.823351+0000","last_became_peered":"2024-01-21T20:15:21.823351+0000","last_unstale":"2024-01-21T20:15:21.828735+0000","last_undegraded":"2024-01-21T20:15:21.828735+0000","last_fullsized":"2024-01-21T20:15:21.828735+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825142+0000","last_change":"2024-01-21T20:15:21.444226+0000","last_active":"2024-01-21T20:15:21.825142+0000","last_peered":"2024-01-21T20:15:21.825142+0000","last_clean":"2024-01-21T20:15:21.825142+0000","last_became_active":"2024-01-21T20:15:21.443917+0000","last_became_peered":"2024-01-21T20:15:21.443917+0000","last_unstale":"2024-01-21T20:15:21.825142+0000","last_undegraded":"2024-01-21T20:15:21.825142+0000","last_fullsized":"2024-01-21T20:15:21.825142+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834964+0000","last_change":"2024-01-21T20:15:21.833302+0000","last_active":"2024-01-21T20:15:21.834964+0000","last_peered":"2024-01-21T20:15:21.834964+0000","last_clean":"2024-01-21T20:15:21.834964+0000","last_became_active":"2024-01-21T20:15:21.832997+0000","last_became_peered":"2024-01-21T20:15:21.832997+0000","last_unstale":"2024-01-21T20:15:21.834964+0000","last_undegraded":"2024-01-21T20:15:21.834964+0000","last_fullsized":"2024-01-21T20:15:21.834964+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813089+0000","last_change":"2024-01-21T20:15:21.439091+0000","last_active":"2024-01-21T20:15:21.813089+0000","last_peered":"2024-01-21T20:15:21.813089+0000","last_clean":"2024-01-21T20:15:21.813089+0000","last_became_active":"2024-01-21T20:15:21.438828+0000","last_became_peered":"2024-01-21T20:15:21.438828+0000","last_unstale":"2024-01-21T20:15:21.813089+0000","last_undegraded":"2024-01-21T20:15:21.813089+0000","last_fullsized":"2024-01-21T20:15:21.813089+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.840441+0000","last_change":"2024-01-21T20:15:21.835308+0000","last_active":"2024-01-21T20:15:21.840441+0000","last_peered":"2024-01-21T20:15:21.840441+0000","last_clean":"2024-01-21T20:15:21.840441+0000","last_became_active":"2024-01-21T20:15:21.834942+0000","last_became_peered":"2024-01-21T20:15:21.834942+0000","last_unstale":"2024-01-21T20:15:21.840441+0000","last_undegraded":"2024-01-21T20:15:21.840441+0000","last_fullsized":"2024-01-21T20:15:21.840441+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2d","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.816970+0000","last_change":"2024-01-21T20:15:21.444232+0000","last_active":"2024-01-21T20:15:21.816970+0000","last_peered":"2024-01-21T20:15:21.816970+0000","last_clean":"2024-01-21T20:15:21.816970+0000","last_became_active":"2024-01-21T20:15:21.443958+0000","last_became_peered":"2024-01-21T20:15:21.443958+0000","last_unstale":"2024-01-21T20:15:21.816970+0000","last_undegraded":"2024-01-21T20:15:21.816970+0000","last_fullsized":"2024-01-21T20:15:21.816970+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826049+0000","last_change":"2024-01-21T20:15:21.822130+0000","last_active":"2024-01-21T20:15:21.826049+0000","last_peered":"2024-01-21T20:15:21.826049+0000","last_clean":"2024-01-21T20:15:21.826049+0000","last_became_active":"2024-01-21T20:15:21.821868+0000","last_became_peered":"2024-01-21T20:15:21.821868+0000","last_unstale":"2024-01-21T20:15:21.826049+0000","last_undegraded":"2024-01-21T20:15:21.826049+0000","last_fullsized":"2024-01-21T20:15:21.826049+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814036+0000","last_change":"2024-01-21T20:15:21.442556+0000","last_active":"2024-01-21T20:15:21.814036+0000","last_peered":"2024-01-21T20:15:21.814036+0000","last_clean":"2024-01-21T20:15:21.814036+0000","last_became_active":"2024-01-21T20:15:21.442248+0000","last_became_peered":"2024-01-21T20:15:21.442248+0000","last_unstale":"2024-01-21T20:15:21.814036+0000","last_undegraded":"2024-01-21T20:15:21.814036+0000","last_fullsized":"2024-01-21T20:15:21.814036+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837660+0000","last_change":"2024-01-21T20:15:21.828466+0000","last_active":"2024-01-21T20:15:21.837660+0000","last_peered":"2024-01-21T20:15:21.837660+0000","last_clean":"2024-01-21T20:15:21.837660+0000","last_became_active":"2024-01-21T20:15:21.828229+0000","last_became_peered":"2024-01-21T20:15:21.828229+0000","last_unstale":"2024-01-21T20:15:21.837660+0000","last_undegraded":"2024-01-21T20:15:21.837660+0000","last_fullsized":"2024-01-21T20:15:21.837660+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823582+0000","last_change":"2024-01-21T20:15:21.445249+0000","last_active":"2024-01-21T20:15:21.823582+0000","last_peered":"2024-01-21T20:15:21.823582+0000","last_clean":"2024-01-21T20:15:21.823582+0000","last_became_active":"2024-01-21T20:15:21.444367+0000","last_became_peered":"2024-01-21T20:15:21.444367+0000","last_unstale":"2024-01-21T20:15:21.823582+0000","last_undegraded":"2024-01-21T20:15:21.823582+0000","last_fullsized":"2024-01-21T20:15:21.823582+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832741+0000","last_change":"2024-01-21T20:15:21.830905+0000","last_active":"2024-01-21T20:15:21.832741+0000","last_peered":"2024-01-21T20:15:21.832741+0000","last_clean":"2024-01-21T20:15:21.832741+0000","last_became_active":"2024-01-21T20:15:21.830570+0000","last_became_peered":"2024-01-21T20:15:21.830570+0000","last_unstale":"2024-01-21T20:15:21.832741+0000","last_undegraded":"2024-01-21T20:15:21.832741+0000","last_fullsized":"2024-01-21T20:15:21.832741+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811695+0000","last_change":"2024-01-21T20:15:21.444792+0000","last_active":"2024-01-21T20:15:21.811695+0000","last_peered":"2024-01-21T20:15:21.811695+0000","last_clean":"2024-01-21T20:15:21.811695+0000","last_became_active":"2024-01-21T20:15:21.443889+0000","last_became_peered":"2024-01-21T20:15:21.443889+0000","last_unstale":"2024-01-21T20:15:21.811695+0000","last_undegraded":"2024-01-21T20:15:21.811695+0000","last_fullsized":"2024-01-21T20:15:21.811695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834902+0000","last_change":"2024-01-21T20:15:21.833300+0000","last_active":"2024-01-21T20:15:21.834902+0000","last_peered":"2024-01-21T20:15:21.834902+0000","last_clean":"2024-01-21T20:15:21.834902+0000","last_became_active":"2024-01-21T20:15:21.831553+0000","last_became_peered":"2024-01-21T20:15:21.831553+0000","last_unstale":"2024-01-21T20:15:21.834902+0000","last_undegraded":"2024-01-21T20:15:21.834902+0000","last_fullsized":"2024-01-21T20:15:21.834902+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814084+0000","last_change":"2024-01-21T20:15:21.447749+0000","last_active":"2024-01-21T20:15:21.814084+0000","last_peered":"2024-01-21T20:15:21.814084+0000","last_clean":"2024-01-21T20:15:21.814084+0000","last_became_active":"2024-01-21T20:15:21.447459+0000","last_became_peered":"2024-01-21T20:15:21.447459+0000","last_unstale":"2024-01-21T20:15:21.814084+0000","last_undegraded":"2024-01-21T20:15:21.814084+0000","last_fullsized":"2024-01-21T20:15:21.814084+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833950+0000","last_change":"2024-01-21T20:15:21.828294+0000","last_active":"2024-01-21T20:15:21.833950+0000","last_peered":"2024-01-21T20:15:21.833950+0000","last_clean":"2024-01-21T20:15:21.833950+0000","last_became_active":"2024-01-21T20:15:21.827964+0000","last_became_peered":"2024-01-21T20:15:21.827964+0000","last_unstale":"2024-01-21T20:15:21.833950+0000","last_undegraded":"2024-01-21T20:15:21.833950+0000","last_fullsized":"2024-01-21T20:15:21.833950+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811956+0000","last_change":"2024-01-21T20:15:21.450432+0000","last_active":"2024-01-21T20:15:21.811956+0000","last_peered":"2024-01-21T20:15:21.811956+0000","last_clean":"2024-01-21T20:15:21.811956+0000","last_became_active":"2024-01-21T20:15:21.450182+0000","last_became_peered":"2024-01-21T20:15:21.450182+0000","last_unstale":"2024-01-21T20:15:21.811956+0000","last_undegraded":"2024-01-21T20:15:21.811956+0000","last_fullsized":"2024-01-21T20:15:21.811956+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832923+0000","last_change":"2024-01-21T20:15:21.829191+0000","last_active":"2024-01-21T20:15:21.832923+0000","last_peered":"2024-01-21T20:15:21.832923+0000","last_clean":"2024-01-21T20:15:21.832923+0000","last_became_active":"2024-01-21T20:15:21.828910+0000","last_became_peered":"2024-01-21T20:15:21.828910+0000","last_unstale":"2024-01-21T20:15:21.832923+0000","last_undegraded":"2024-01-21T20:15:21.832923+0000","last_fullsized":"2024-01-21T20:15:21.832923+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810576+0000","last_change":"2024-01-21T20:15:21.438887+0000","last_active":"2024-01-21T20:15:21.810576+0000","last_peered":"2024-01-21T20:15:21.810576+0000","last_clean":"2024-01-21T20:15:21.810576+0000","last_became_active":"2024-01-21T20:15:21.438440+0000","last_became_peered":"2024-01-21T20:15:21.438440+0000","last_unstale":"2024-01-21T20:15:21.810576+0000","last_undegraded":"2024-01-21T20:15:21.810576+0000","last_fullsized":"2024-01-21T20:15:21.810576+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827505+0000","last_change":"2024-01-21T20:15:21.820868+0000","last_active":"2024-01-21T20:15:21.827505+0000","last_peered":"2024-01-21T20:15:21.827505+0000","last_clean":"2024-01-21T20:15:21.827505+0000","last_became_active":"2024-01-21T20:15:21.820578+0000","last_became_peered":"2024-01-21T20:15:21.820578+0000","last_unstale":"2024-01-21T20:15:21.827505+0000","last_undegraded":"2024-01-21T20:15:21.827505+0000","last_fullsized":"2024-01-21T20:15:21.827505+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813004+0000","last_change":"2024-01-21T20:15:21.445130+0000","last_active":"2024-01-21T20:15:21.813004+0000","last_peered":"2024-01-21T20:15:21.813004+0000","last_clean":"2024-01-21T20:15:21.813004+0000","last_became_active":"2024-01-21T20:15:21.444577+0000","last_became_peered":"2024-01-21T20:15:21.444577+0000","last_unstale":"2024-01-21T20:15:21.813004+0000","last_undegraded":"2024-01-21T20:15:21.813004+0000","last_fullsized":"2024-01-21T20:15:21.813004+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834805+0000","last_change":"2024-01-21T20:15:21.831778+0000","last_active":"2024-01-21T20:15:21.834805+0000","last_peered":"2024-01-21T20:15:21.834805+0000","last_clean":"2024-01-21T20:15:21.834805+0000","last_became_active":"2024-01-21T20:15:21.831488+0000","last_became_peered":"2024-01-21T20:15:21.831488+0000","last_unstale":"2024-01-21T20:15:21.834805+0000","last_undegraded":"2024-01-21T20:15:21.834805+0000","last_fullsized":"2024-01-21T20:15:21.834805+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822389+0000","last_change":"2024-01-21T20:15:21.445425+0000","last_active":"2024-01-21T20:15:21.822389+0000","last_peered":"2024-01-21T20:15:21.822389+0000","last_clean":"2024-01-21T20:15:21.822389+0000","last_became_active":"2024-01-21T20:15:21.444652+0000","last_became_peered":"2024-01-21T20:15:21.444652+0000","last_unstale":"2024-01-21T20:15:21.822389+0000","last_undegraded":"2024-01-21T20:15:21.822389+0000","last_fullsized":"2024-01-21T20:15:21.822389+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821056+0000","last_change":"2024-01-21T20:15:21.817463+0000","last_active":"2024-01-21T20:15:21.821056+0000","last_peered":"2024-01-21T20:15:21.821056+0000","last_clean":"2024-01-21T20:15:21.821056+0000","last_became_active":"2024-01-21T20:15:21.817103+0000","last_became_peered":"2024-01-21T20:15:21.817103+0000","last_unstale":"2024-01-21T20:15:21.821056+0000","last_undegraded":"2024-01-21T20:15:21.821056+0000","last_fullsized":"2024-01-21T20:15:21.821056+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815028+0000","last_change":"2024-01-21T20:15:21.440441+0000","last_active":"2024-01-21T20:15:21.815028+0000","last_peered":"2024-01-21T20:15:21.815028+0000","last_clean":"2024-01-21T20:15:21.815028+0000","last_became_active":"2024-01-21T20:15:21.440089+0000","last_became_peered":"2024-01-21T20:15:21.440089+0000","last_unstale":"2024-01-21T20:15:21.815028+0000","last_undegraded":"2024-01-21T20:15:21.815028+0000","last_fullsized":"2024-01-21T20:15:21.815028+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830812+0000","last_change":"2024-01-21T20:15:21.826738+0000","last_active":"2024-01-21T20:15:21.830812+0000","last_peered":"2024-01-21T20:15:21.830812+0000","last_clean":"2024-01-21T20:15:21.830812+0000","last_became_active":"2024-01-21T20:15:21.826453+0000","last_became_peered":"2024-01-21T20:15:21.826453+0000","last_unstale":"2024-01-21T20:15:21.830812+0000","last_undegraded":"2024-01-21T20:15:21.830812+0000","last_fullsized":"2024-01-21T20:15:21.830812+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815798+0000","last_change":"2024-01-21T20:15:21.437125+0000","last_active":"2024-01-21T20:15:21.815798+0000","last_peered":"2024-01-21T20:15:21.815798+0000","last_clean":"2024-01-21T20:15:21.815798+0000","last_became_active":"2024-01-21T20:15:21.436817+0000","last_became_peered":"2024-01-21T20:15:21.436817+0000","last_unstale":"2024-01-21T20:15:21.815798+0000","last_undegraded":"2024-01-21T20:15:21.815798+0000","last_fullsized":"2024-01-21T20:15:21.815798+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836735+0000","last_change":"2024-01-21T20:15:21.835367+0000","last_active":"2024-01-21T20:15:21.836735+0000","last_peered":"2024-01-21T20:15:21.836735+0000","last_clean":"2024-01-21T20:15:21.836735+0000","last_became_active":"2024-01-21T20:15:21.835091+0000","last_became_peered":"2024-01-21T20:15:21.835091+0000","last_unstale":"2024-01-21T20:15:21.836735+0000","last_undegraded":"2024-01-21T20:15:21.836735+0000","last_fullsized":"2024-01-21T20:15:21.836735+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811792+0000","last_change":"2024-01-21T20:15:21.444345+0000","last_active":"2024-01-21T20:15:21.811792+0000","last_peered":"2024-01-21T20:15:21.811792+0000","last_clean":"2024-01-21T20:15:21.811792+0000","last_became_active":"2024-01-21T20:15:21.443524+0000","last_became_peered":"2024-01-21T20:15:21.443524+0000","last_unstale":"2024-01-21T20:15:21.811792+0000","last_undegraded":"2024-01-21T20:15:21.811792+0000","last_fullsized":"2024-01-21T20:15:21.811792+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834011+0000","last_change":"2024-01-21T20:15:21.828632+0000","last_active":"2024-01-21T20:15:21.834011+0000","last_peered":"2024-01-21T20:15:21.834011+0000","last_clean":"2024-01-21T20:15:21.834011+0000","last_became_active":"2024-01-21T20:15:21.828361+0000","last_became_peered":"2024-01-21T20:15:21.828361+0000","last_unstale":"2024-01-21T20:15:21.834011+0000","last_undegraded":"2024-01-21T20:15:21.834011+0000","last_fullsized":"2024-01-21T20:15:21.834011+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825280+0000","last_change":"2024-01-21T20:15:21.450674+0000","last_active":"2024-01-21T20:15:21.825280+0000","last_peered":"2024-01-21T20:15:21.825280+0000","last_clean":"2024-01-21T20:15:21.825280+0000","last_became_active":"2024-01-21T20:15:21.450077+0000","last_became_peered":"2024-01-21T20:15:21.450077+0000","last_unstale":"2024-01-21T20:15:21.825280+0000","last_undegraded":"2024-01-21T20:15:21.825280+0000","last_fullsized":"2024-01-21T20:15:21.825280+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826417+0000","last_change":"2024-01-21T20:15:21.824570+0000","last_active":"2024-01-21T20:15:21.826417+0000","last_peered":"2024-01-21T20:15:21.826417+0000","last_clean":"2024-01-21T20:15:21.826417+0000","last_became_active":"2024-01-21T20:15:21.824288+0000","last_became_peered":"2024-01-21T20:15:21.824288+0000","last_unstale":"2024-01-21T20:15:21.826417+0000","last_undegraded":"2024-01-21T20:15:21.826417+0000","last_fullsized":"2024-01-21T20:15:21.826417+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813503+0000","last_change":"2024-01-21T20:15:21.447799+0000","last_active":"2024-01-21T20:15:21.813503+0000","last_peered":"2024-01-21T20:15:21.813503+0000","last_clean":"2024-01-21T20:15:21.813503+0000","last_became_active":"2024-01-21T20:15:21.447478+0000","last_became_peered":"2024-01-21T20:15:21.447478+0000","last_unstale":"2024-01-21T20:15:21.813503+0000","last_undegraded":"2024-01-21T20:15:21.813503+0000","last_fullsized":"2024-01-21T20:15:21.813503+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833174+0000","last_change":"2024-01-21T20:15:21.829720+0000","last_active":"2024-01-21T20:15:21.833174+0000","last_peered":"2024-01-21T20:15:21.833174+0000","last_clean":"2024-01-21T20:15:21.833174+0000","last_became_active":"2024-01-21T20:15:21.829476+0000","last_became_peered":"2024-01-21T20:15:21.829476+0000","last_unstale":"2024-01-21T20:15:21.833174+0000","last_undegraded":"2024-01-21T20:15:21.833174+0000","last_fullsized":"2024-01-21T20:15:21.833174+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825004+0000","last_change":"2024-01-21T20:15:21.449570+0000","last_active":"2024-01-21T20:15:21.825004+0000","last_peered":"2024-01-21T20:15:21.825004+0000","last_clean":"2024-01-21T20:15:21.825004+0000","last_became_active":"2024-01-21T20:15:21.449279+0000","last_became_peered":"2024-01-21T20:15:21.449279+0000","last_unstale":"2024-01-21T20:15:21.825004+0000","last_undegraded":"2024-01-21T20:15:21.825004+0000","last_fullsized":"2024-01-21T20:15:21.825004+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824511+0000","last_change":"2024-01-21T20:15:21.821574+0000","last_active":"2024-01-21T20:15:21.824511+0000","last_peered":"2024-01-21T20:15:21.824511+0000","last_clean":"2024-01-21T20:15:21.824511+0000","last_became_active":"2024-01-21T20:15:21.821292+0000","last_became_peered":"2024-01-21T20:15:21.821292+0000","last_unstale":"2024-01-21T20:15:21.824511+0000","last_undegraded":"2024-01-21T20:15:21.824511+0000","last_fullsized":"2024-01-21T20:15:21.824511+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833145+0000","last_change":"2024-01-21T20:15:21.437978+0000","last_active":"2024-01-21T20:15:21.833145+0000","last_peered":"2024-01-21T20:15:21.833145+0000","last_clean":"2024-01-21T20:15:21.833145+0000","last_became_active":"2024-01-21T20:15:21.437685+0000","last_became_peered":"2024-01-21T20:15:21.437685+0000","last_unstale":"2024-01-21T20:15:21.833145+0000","last_undegraded":"2024-01-21T20:15:21.833145+0000","last_fullsized":"2024-01-21T20:15:21.833145+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827580+0000","last_change":"2024-01-21T20:15:21.826090+0000","last_active":"2024-01-21T20:15:21.827580+0000","last_peered":"2024-01-21T20:15:21.827580+0000","last_clean":"2024-01-21T20:15:21.827580+0000","last_became_active":"2024-01-21T20:15:21.825737+0000","last_became_peered":"2024-01-21T20:15:21.825737+0000","last_unstale":"2024-01-21T20:15:21.827580+0000","last_undegraded":"2024-01-21T20:15:21.827580+0000","last_fullsized":"2024-01-21T20:15:21.827580+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824191+0000","last_change":"2024-01-21T20:15:21.450372+0000","last_active":"2024-01-21T20:15:21.824191+0000","last_peered":"2024-01-21T20:15:21.824191+0000","last_clean":"2024-01-21T20:15:21.824191+0000","last_became_active":"2024-01-21T20:15:21.449972+0000","last_became_peered":"2024-01-21T20:15:21.449972+0000","last_unstale":"2024-01-21T20:15:21.824191+0000","last_undegraded":"2024-01-21T20:15:21.824191+0000","last_fullsized":"2024-01-21T20:15:21.824191+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823691+0000","last_change":"2024-01-21T20:15:21.819320+0000","last_active":"2024-01-21T20:15:21.823691+0000","last_peered":"2024-01-21T20:15:21.823691+0000","last_clean":"2024-01-21T20:15:21.823691+0000","last_became_active":"2024-01-21T20:15:21.819030+0000","last_became_peered":"2024-01-21T20:15:21.819030+0000","last_unstale":"2024-01-21T20:15:21.823691+0000","last_undegraded":"2024-01-21T20:15:21.823691+0000","last_fullsized":"2024-01-21T20:15:21.823691+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814908+0000","last_change":"2024-01-21T20:15:21.448302+0000","last_active":"2024-01-21T20:15:21.814908+0000","last_peered":"2024-01-21T20:15:21.814908+0000","last_clean":"2024-01-21T20:15:21.814908+0000","last_became_active":"2024-01-21T20:15:21.447713+0000","last_became_peered":"2024-01-21T20:15:21.447713+0000","last_unstale":"2024-01-21T20:15:21.814908+0000","last_undegraded":"2024-01-21T20:15:21.814908+0000","last_fullsized":"2024-01-21T20:15:21.814908+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828135+0000","last_change":"2024-01-21T20:15:21.823566+0000","last_active":"2024-01-21T20:15:21.828135+0000","last_peered":"2024-01-21T20:15:21.828135+0000","last_clean":"2024-01-21T20:15:21.828135+0000","last_became_active":"2024-01-21T20:15:21.823324+0000","last_became_peered":"2024-01-21T20:15:21.823324+0000","last_unstale":"2024-01-21T20:15:21.828135+0000","last_undegraded":"2024-01-21T20:15:21.828135+0000","last_fullsized":"2024-01-21T20:15:21.828135+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826010+0000","last_change":"2024-01-21T20:15:21.445130+0000","last_active":"2024-01-21T20:15:21.826010+0000","last_peered":"2024-01-21T20:15:21.826010+0000","last_clean":"2024-01-21T20:15:21.826010+0000","last_became_active":"2024-01-21T20:15:21.444495+0000","last_became_peered":"2024-01-21T20:15:21.444495+0000","last_unstale":"2024-01-21T20:15:21.826010+0000","last_undegraded":"2024-01-21T20:15:21.826010+0000","last_fullsized":"2024-01-21T20:15:21.826010+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833641+0000","last_change":"2024-01-21T20:15:21.832615+0000","last_active":"2024-01-21T20:15:21.833641+0000","last_peered":"2024-01-21T20:15:21.833641+0000","last_clean":"2024-01-21T20:15:21.833641+0000","last_became_active":"2024-01-21T20:15:21.832243+0000","last_became_peered":"2024-01-21T20:15:21.832243+0000","last_unstale":"2024-01-21T20:15:21.833641+0000","last_undegraded":"2024-01-21T20:15:21.833641+0000","last_fullsized":"2024-01-21T20:15:21.833641+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811875+0000","last_change":"2024-01-21T20:15:21.444163+0000","last_active":"2024-01-21T20:15:21.811875+0000","last_peered":"2024-01-21T20:15:21.811875+0000","last_clean":"2024-01-21T20:15:21.811875+0000","last_became_active":"2024-01-21T20:15:21.443187+0000","last_became_peered":"2024-01-21T20:15:21.443187+0000","last_unstale":"2024-01-21T20:15:21.811875+0000","last_undegraded":"2024-01-21T20:15:21.811875+0000","last_fullsized":"2024-01-21T20:15:21.811875+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824123+0000","last_change":"2024-01-21T20:15:21.820767+0000","last_active":"2024-01-21T20:15:21.824123+0000","last_peered":"2024-01-21T20:15:21.824123+0000","last_clean":"2024-01-21T20:15:21.824123+0000","last_became_active":"2024-01-21T20:15:21.820500+0000","last_became_peered":"2024-01-21T20:15:21.820500+0000","last_unstale":"2024-01-21T20:15:21.824123+0000","last_undegraded":"2024-01-21T20:15:21.824123+0000","last_fullsized":"2024-01-21T20:15:21.824123+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.818122+0000","last_change":"2024-01-21T20:15:21.437462+0000","last_active":"2024-01-21T20:15:21.818122+0000","last_peered":"2024-01-21T20:15:21.818122+0000","last_clean":"2024-01-21T20:15:21.818122+0000","last_became_active":"2024-01-21T20:15:21.437200+0000","last_became_peered":"2024-01-21T20:15:21.437200+0000","last_unstale":"2024-01-21T20:15:21.818122+0000","last_undegraded":"2024-01-21T20:15:21.818122+0000","last_fullsized":"2024-01-21T20:15:21.818122+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830870+0000","last_change":"2024-01-21T20:15:21.827311+0000","last_active":"2024-01-21T20:15:21.830870+0000","last_peered":"2024-01-21T20:15:21.830870+0000","last_clean":"2024-01-21T20:15:21.830870+0000","last_became_active":"2024-01-21T20:15:21.826954+0000","last_became_peered":"2024-01-21T20:15:21.826954+0000","last_unstale":"2024-01-21T20:15:21.830870+0000","last_undegraded":"2024-01-21T20:15:21.830870+0000","last_fullsized":"2024-01-21T20:15:21.830870+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812703+0000","last_change":"2024-01-21T20:15:21.447743+0000","last_active":"2024-01-21T20:15:21.812703+0000","last_peered":"2024-01-21T20:15:21.812703+0000","last_clean":"2024-01-21T20:15:21.812703+0000","last_became_active":"2024-01-21T20:15:21.447482+0000","last_became_peered":"2024-01-21T20:15:21.447482+0000","last_unstale":"2024-01-21T20:15:21.812703+0000","last_undegraded":"2024-01-21T20:15:21.812703+0000","last_fullsized":"2024-01-21T20:15:21.812703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834100+0000","last_change":"2024-01-21T20:15:21.829064+0000","last_active":"2024-01-21T20:15:21.834100+0000","last_peered":"2024-01-21T20:15:21.834100+0000","last_clean":"2024-01-21T20:15:21.834100+0000","last_became_active":"2024-01-21T20:15:21.828824+0000","last_became_peered":"2024-01-21T20:15:21.828824+0000","last_unstale":"2024-01-21T20:15:21.834100+0000","last_undegraded":"2024-01-21T20:15:21.834100+0000","last_fullsized":"2024-01-21T20:15:21.834100+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811730+0000","last_change":"2024-01-21T20:15:21.446076+0000","last_active":"2024-01-21T20:15:21.811730+0000","last_peered":"2024-01-21T20:15:21.811730+0000","last_clean":"2024-01-21T20:15:21.811730+0000","last_became_active":"2024-01-21T20:15:21.445649+0000","last_became_peered":"2024-01-21T20:15:21.445649+0000","last_unstale":"2024-01-21T20:15:21.811730+0000","last_undegraded":"2024-01-21T20:15:21.811730+0000","last_fullsized":"2024-01-21T20:15:21.811730+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830318+0000","last_change":"2024-01-21T20:15:21.829240+0000","last_active":"2024-01-21T20:15:21.830318+0000","last_peered":"2024-01-21T20:15:21.830318+0000","last_clean":"2024-01-21T20:15:21.830318+0000","last_became_active":"2024-01-21T20:15:21.828632+0000","last_became_peered":"2024-01-21T20:15:21.828632+0000","last_unstale":"2024-01-21T20:15:21.830318+0000","last_undegraded":"2024-01-21T20:15:21.830318+0000","last_fullsized":"2024-01-21T20:15:21.830318+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.819494+0000","last_change":"2024-01-21T20:15:21.439644+0000","last_active":"2024-01-21T20:15:21.819494+0000","last_peered":"2024-01-21T20:15:21.819494+0000","last_clean":"2024-01-21T20:15:21.819494+0000","last_became_active":"2024-01-21T20:15:21.439365+0000","last_became_peered":"2024-01-21T20:15:21.439365+0000","last_unstale":"2024-01-21T20:15:21.819494+0000","last_undegraded":"2024-01-21T20:15:21.819494+0000","last_fullsized":"2024-01-21T20:15:21.819494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835628+0000","last_change":"2024-01-21T20:15:21.826397+0000","last_active":"2024-01-21T20:15:21.835628+0000","last_peered":"2024-01-21T20:15:21.835628+0000","last_clean":"2024-01-21T20:15:21.835628+0000","last_became_active":"2024-01-21T20:15:21.826112+0000","last_became_peered":"2024-01-21T20:15:21.826112+0000","last_unstale":"2024-01-21T20:15:21.835628+0000","last_undegraded":"2024-01-21T20:15:21.835628+0000","last_fullsized":"2024-01-21T20:15:21.835628+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"107'3","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836915+0000","last_change":"2024-01-21T20:15:21.450547+0000","last_active":"2024-01-21T20:15:21.836915+0000","last_peered":"2024-01-21T20:15:21.836915+0000","last_clean":"2024-01-21T20:15:21.836915+0000","last_became_active":"2024-01-21T20:15:21.450268+0000","last_became_peered":"2024-01-21T20:15:21.450268+0000","last_unstale":"2024-01-21T20:15:21.836915+0000","last_undegraded":"2024-01-21T20:15:21.836915+0000","last_fullsized":"2024-01-21T20:15:21.836915+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827128+0000","last_change":"2024-01-21T20:15:21.819496+0000","last_active":"2024-01-21T20:15:21.827128+0000","last_peered":"2024-01-21T20:15:21.827128+0000","last_clean":"2024-01-21T20:15:21.827128+0000","last_became_active":"2024-01-21T20:15:21.819115+0000","last_became_peered":"2024-01-21T20:15:21.819115+0000","last_unstale":"2024-01-21T20:15:21.827128+0000","last_undegraded":"2024-01-21T20:15:21.827128+0000","last_fullsized":"2024-01-21T20:15:21.827128+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826075+0000","last_change":"2024-01-21T20:15:21.441689+0000","last_active":"2024-01-21T20:15:21.826075+0000","last_peered":"2024-01-21T20:15:21.826075+0000","last_clean":"2024-01-21T20:15:21.826075+0000","last_became_active":"2024-01-21T20:15:21.441399+0000","last_became_peered":"2024-01-21T20:15:21.441399+0000","last_unstale":"2024-01-21T20:15:21.826075+0000","last_undegraded":"2024-01-21T20:15:21.826075+0000","last_fullsized":"2024-01-21T20:15:21.826075+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827969+0000","last_change":"2024-01-21T20:15:21.822121+0000","last_active":"2024-01-21T20:15:21.827969+0000","last_peered":"2024-01-21T20:15:21.827969+0000","last_clean":"2024-01-21T20:15:21.827969+0000","last_became_active":"2024-01-21T20:15:21.821860+0000","last_became_peered":"2024-01-21T20:15:21.821860+0000","last_unstale":"2024-01-21T20:15:21.827969+0000","last_undegraded":"2024-01-21T20:15:21.827969+0000","last_fullsized":"2024-01-21T20:15:21.827969+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826358+0000","last_change":"2024-01-21T20:15:21.451159+0000","last_active":"2024-01-21T20:15:21.826358+0000","last_peered":"2024-01-21T20:15:21.826358+0000","last_clean":"2024-01-21T20:15:21.826358+0000","last_became_active":"2024-01-21T20:15:21.450871+0000","last_became_peered":"2024-01-21T20:15:21.450871+0000","last_unstale":"2024-01-21T20:15:21.826358+0000","last_undegraded":"2024-01-21T20:15:21.826358+0000","last_fullsized":"2024-01-21T20:15:21.826358+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.834843+0000","last_change":"2024-01-21T20:15:21.833195+0000","last_active":"2024-01-21T20:15:21.834843+0000","last_peered":"2024-01-21T20:15:21.834843+0000","last_clean":"2024-01-21T20:15:21.834843+0000","last_became_active":"2024-01-21T20:15:21.831763+0000","last_became_peered":"2024-01-21T20:15:21.831763+0000","last_unstale":"2024-01-21T20:15:21.834843+0000","last_undegraded":"2024-01-21T20:15:21.834843+0000","last_fullsized":"2024-01-21T20:15:21.834843+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.808038+0000","last_change":"2024-01-21T20:15:21.443731+0000","last_active":"2024-01-21T20:15:21.808038+0000","last_peered":"2024-01-21T20:15:21.808038+0000","last_clean":"2024-01-21T20:15:21.808038+0000","last_became_active":"2024-01-21T20:15:21.443460+0000","last_became_peered":"2024-01-21T20:15:21.443460+0000","last_unstale":"2024-01-21T20:15:21.808038+0000","last_undegraded":"2024-01-21T20:15:21.808038+0000","last_fullsized":"2024-01-21T20:15:21.808038+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835469+0000","last_change":"2024-01-21T20:15:21.834253+0000","last_active":"2024-01-21T20:15:21.835469+0000","last_peered":"2024-01-21T20:15:21.835469+0000","last_clean":"2024-01-21T20:15:21.835469+0000","last_became_active":"2024-01-21T20:15:21.834005+0000","last_became_peered":"2024-01-21T20:15:21.834005+0000","last_unstale":"2024-01-21T20:15:21.835469+0000","last_undegraded":"2024-01-21T20:15:21.835469+0000","last_fullsized":"2024-01-21T20:15:21.835469+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809705+0000","last_change":"2024-01-21T20:15:21.439012+0000","last_active":"2024-01-21T20:15:21.809705+0000","last_peered":"2024-01-21T20:15:21.809705+0000","last_clean":"2024-01-21T20:15:21.809705+0000","last_became_active":"2024-01-21T20:15:21.438757+0000","last_became_peered":"2024-01-21T20:15:21.438757+0000","last_unstale":"2024-01-21T20:15:21.809705+0000","last_undegraded":"2024-01-21T20:15:21.809705+0000","last_fullsized":"2024-01-21T20:15:21.809705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.835430+0000","last_change":"2024-01-21T20:15:21.832395+0000","last_active":"2024-01-21T20:15:21.835430+0000","last_peered":"2024-01-21T20:15:21.835430+0000","last_clean":"2024-01-21T20:15:21.835430+0000","last_became_active":"2024-01-21T20:15:21.832139+0000","last_became_peered":"2024-01-21T20:15:21.832139+0000","last_unstale":"2024-01-21T20:15:21.835430+0000","last_undegraded":"2024-01-21T20:15:21.835430+0000","last_fullsized":"2024-01-21T20:15:21.835430+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"107'4","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.830295+0000","last_change":"2024-01-21T20:15:21.443453+0000","last_active":"2024-01-21T20:15:21.830295+0000","last_peered":"2024-01-21T20:15:21.830295+0000","last_clean":"2024-01-21T20:15:21.830295+0000","last_became_active":"2024-01-21T20:15:21.443107+0000","last_became_peered":"2024-01-21T20:15:21.443107+0000","last_unstale":"2024-01-21T20:15:21.830295+0000","last_undegraded":"2024-01-21T20:15:21.830295+0000","last_fullsized":"2024-01-21T20:15:21.830295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826445+0000","last_change":"2024-01-21T20:15:21.822606+0000","last_active":"2024-01-21T20:15:21.826445+0000","last_peered":"2024-01-21T20:15:21.826445+0000","last_clean":"2024-01-21T20:15:21.826445+0000","last_became_active":"2024-01-21T20:15:21.822255+0000","last_became_peered":"2024-01-21T20:15:21.822255+0000","last_unstale":"2024-01-21T20:15:21.826445+0000","last_undegraded":"2024-01-21T20:15:21.826445+0000","last_fullsized":"2024-01-21T20:15:21.826445+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827289+0000","last_change":"2024-01-21T20:15:21.443075+0000","last_active":"2024-01-21T20:15:21.827289+0000","last_peered":"2024-01-21T20:15:21.827289+0000","last_clean":"2024-01-21T20:15:21.827289+0000","last_became_active":"2024-01-21T20:15:21.442793+0000","last_became_peered":"2024-01-21T20:15:21.442793+0000","last_unstale":"2024-01-21T20:15:21.827289+0000","last_undegraded":"2024-01-21T20:15:21.827289+0000","last_fullsized":"2024-01-21T20:15:21.827289+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833217+0000","last_change":"2024-01-21T20:15:21.830033+0000","last_active":"2024-01-21T20:15:21.833217+0000","last_peered":"2024-01-21T20:15:21.833217+0000","last_clean":"2024-01-21T20:15:21.833217+0000","last_became_active":"2024-01-21T20:15:21.829748+0000","last_became_peered":"2024-01-21T20:15:21.829748+0000","last_unstale":"2024-01-21T20:15:21.833217+0000","last_undegraded":"2024-01-21T20:15:21.833217+0000","last_fullsized":"2024-01-21T20:15:21.833217+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824950+0000","last_change":"2024-01-21T20:15:21.437931+0000","last_active":"2024-01-21T20:15:21.824950+0000","last_peered":"2024-01-21T20:15:21.824950+0000","last_clean":"2024-01-21T20:15:21.824950+0000","last_became_active":"2024-01-21T20:15:21.437290+0000","last_became_peered":"2024-01-21T20:15:21.437290+0000","last_unstale":"2024-01-21T20:15:21.824950+0000","last_undegraded":"2024-01-21T20:15:21.824950+0000","last_fullsized":"2024-01-21T20:15:21.824950+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.824117+0000","last_change":"2024-01-21T20:15:21.821526+0000","last_active":"2024-01-21T20:15:21.824117+0000","last_peered":"2024-01-21T20:15:21.824117+0000","last_clean":"2024-01-21T20:15:21.824117+0000","last_became_active":"2024-01-21T20:15:21.821255+0000","last_became_peered":"2024-01-21T20:15:21.821255+0000","last_unstale":"2024-01-21T20:15:21.824117+0000","last_undegraded":"2024-01-21T20:15:21.824117+0000","last_fullsized":"2024-01-21T20:15:21.824117+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822276+0000","last_change":"2024-01-21T20:15:21.451200+0000","last_active":"2024-01-21T20:15:21.822276+0000","last_peered":"2024-01-21T20:15:21.822276+0000","last_clean":"2024-01-21T20:15:21.822276+0000","last_became_active":"2024-01-21T20:15:21.450861+0000","last_became_peered":"2024-01-21T20:15:21.450861+0000","last_unstale":"2024-01-21T20:15:21.822276+0000","last_undegraded":"2024-01-21T20:15:21.822276+0000","last_fullsized":"2024-01-21T20:15:21.822276+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836370+0000","last_change":"2024-01-21T20:15:21.833958+0000","last_active":"2024-01-21T20:15:21.836370+0000","last_peered":"2024-01-21T20:15:21.836370+0000","last_clean":"2024-01-21T20:15:21.836370+0000","last_became_active":"2024-01-21T20:15:21.833681+0000","last_became_peered":"2024-01-21T20:15:21.833681+0000","last_unstale":"2024-01-21T20:15:21.836370+0000","last_undegraded":"2024-01-21T20:15:21.836370+0000","last_fullsized":"2024-01-21T20:15:21.836370+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814809+0000","last_change":"2024-01-21T20:15:21.443237+0000","last_active":"2024-01-21T20:15:21.814809+0000","last_peered":"2024-01-21T20:15:21.814809+0000","last_clean":"2024-01-21T20:15:21.814809+0000","last_became_active":"2024-01-21T20:15:21.442896+0000","last_became_peered":"2024-01-21T20:15:21.442896+0000","last_unstale":"2024-01-21T20:15:21.814809+0000","last_undegraded":"2024-01-21T20:15:21.814809+0000","last_fullsized":"2024-01-21T20:15:21.814809+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.823817+0000","last_change":"2024-01-21T20:15:21.817654+0000","last_active":"2024-01-21T20:15:21.823817+0000","last_peered":"2024-01-21T20:15:21.823817+0000","last_clean":"2024-01-21T20:15:21.823817+0000","last_became_active":"2024-01-21T20:15:21.817386+0000","last_became_peered":"2024-01-21T20:15:21.817386+0000","last_unstale":"2024-01-21T20:15:21.823817+0000","last_undegraded":"2024-01-21T20:15:21.823817+0000","last_fullsized":"2024-01-21T20:15:21.823817+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809311+0000","last_change":"2024-01-21T20:15:21.446155+0000","last_active":"2024-01-21T20:15:21.809311+0000","last_peered":"2024-01-21T20:15:21.809311+0000","last_clean":"2024-01-21T20:15:21.809311+0000","last_became_active":"2024-01-21T20:15:21.445264+0000","last_became_peered":"2024-01-21T20:15:21.445264+0000","last_unstale":"2024-01-21T20:15:21.809311+0000","last_undegraded":"2024-01-21T20:15:21.809311+0000","last_fullsized":"2024-01-21T20:15:21.809311+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837711+0000","last_change":"2024-01-21T20:15:21.829179+0000","last_active":"2024-01-21T20:15:21.837711+0000","last_peered":"2024-01-21T20:15:21.837711+0000","last_clean":"2024-01-21T20:15:21.837711+0000","last_became_active":"2024-01-21T20:15:21.828870+0000","last_became_peered":"2024-01-21T20:15:21.828870+0000","last_unstale":"2024-01-21T20:15:21.837711+0000","last_undegraded":"2024-01-21T20:15:21.837711+0000","last_fullsized":"2024-01-21T20:15:21.837711+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810731+0000","last_change":"2024-01-21T20:15:21.436654+0000","last_active":"2024-01-21T20:15:21.810731+0000","last_peered":"2024-01-21T20:15:21.810731+0000","last_clean":"2024-01-21T20:15:21.810731+0000","last_became_active":"2024-01-21T20:15:21.436335+0000","last_became_peered":"2024-01-21T20:15:21.436335+0000","last_unstale":"2024-01-21T20:15:21.810731+0000","last_undegraded":"2024-01-21T20:15:21.810731+0000","last_fullsized":"2024-01-21T20:15:21.810731+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.832462+0000","last_change":"2024-01-21T20:15:21.830868+0000","last_active":"2024-01-21T20:15:21.832462+0000","last_peered":"2024-01-21T20:15:21.832462+0000","last_clean":"2024-01-21T20:15:21.832462+0000","last_became_active":"2024-01-21T20:15:21.830625+0000","last_became_peered":"2024-01-21T20:15:21.830625+0000","last_unstale":"2024-01-21T20:15:21.832462+0000","last_undegraded":"2024-01-21T20:15:21.832462+0000","last_fullsized":"2024-01-21T20:15:21.832462+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814204+0000","last_change":"2024-01-21T20:15:21.443198+0000","last_active":"2024-01-21T20:15:21.814204+0000","last_peered":"2024-01-21T20:15:21.814204+0000","last_clean":"2024-01-21T20:15:21.814204+0000","last_became_active":"2024-01-21T20:15:21.442881+0000","last_became_peered":"2024-01-21T20:15:21.442881+0000","last_unstale":"2024-01-21T20:15:21.814204+0000","last_undegraded":"2024-01-21T20:15:21.814204+0000","last_fullsized":"2024-01-21T20:15:21.814204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.828531+0000","last_change":"2024-01-21T20:15:21.824225+0000","last_active":"2024-01-21T20:15:21.828531+0000","last_peered":"2024-01-21T20:15:21.828531+0000","last_clean":"2024-01-21T20:15:21.828531+0000","last_became_active":"2024-01-21T20:15:21.823948+0000","last_became_peered":"2024-01-21T20:15:21.823948+0000","last_unstale":"2024-01-21T20:15:21.828531+0000","last_undegraded":"2024-01-21T20:15:21.828531+0000","last_fullsized":"2024-01-21T20:15:21.828531+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812737+0000","last_change":"2024-01-21T20:15:21.444601+0000","last_active":"2024-01-21T20:15:21.812737+0000","last_peered":"2024-01-21T20:15:21.812737+0000","last_clean":"2024-01-21T20:15:21.812737+0000","last_became_active":"2024-01-21T20:15:21.444080+0000","last_became_peered":"2024-01-21T20:15:21.444080+0000","last_unstale":"2024-01-21T20:15:21.812737+0000","last_undegraded":"2024-01-21T20:15:21.812737+0000","last_fullsized":"2024-01-21T20:15:21.812737+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833214+0000","last_change":"2024-01-21T20:15:21.830361+0000","last_active":"2024-01-21T20:15:21.833214+0000","last_peered":"2024-01-21T20:15:21.833214+0000","last_clean":"2024-01-21T20:15:21.833214+0000","last_became_active":"2024-01-21T20:15:21.830102+0000","last_became_peered":"2024-01-21T20:15:21.830102+0000","last_unstale":"2024-01-21T20:15:21.833214+0000","last_undegraded":"2024-01-21T20:15:21.833214+0000","last_fullsized":"2024-01-21T20:15:21.833214+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822447+0000","last_change":"2024-01-21T20:15:21.442810+0000","last_active":"2024-01-21T20:15:21.822447+0000","last_peered":"2024-01-21T20:15:21.822447+0000","last_clean":"2024-01-21T20:15:21.822447+0000","last_became_active":"2024-01-21T20:15:21.442506+0000","last_became_peered":"2024-01-21T20:15:21.442506+0000","last_unstale":"2024-01-21T20:15:21.822447+0000","last_undegraded":"2024-01-21T20:15:21.822447+0000","last_fullsized":"2024-01-21T20:15:21.822447+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812035+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:15:21.812035+0000","last_peered":"2024-01-21T20:15:21.812035+0000","last_clean":"2024-01-21T20:15:21.812035+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:15:21.812035+0000","last_undegraded":"2024-01-21T20:15:21.812035+0000","last_fullsized":"2024-01-21T20:15:21.812035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.837323+0000","last_change":"2024-01-21T20:15:21.836397+0000","last_active":"2024-01-21T20:15:21.837323+0000","last_peered":"2024-01-21T20:15:21.837323+0000","last_clean":"2024-01-21T20:15:21.837323+0000","last_became_active":"2024-01-21T20:15:21.836100+0000","last_became_peered":"2024-01-21T20:15:21.836100+0000","last_unstale":"2024-01-21T20:15:21.837323+0000","last_undegraded":"2024-01-21T20:15:21.837323+0000","last_fullsized":"2024-01-21T20:15:21.837323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.822035+0000","last_change":"2024-01-21T20:15:21.445789+0000","last_active":"2024-01-21T20:15:21.822035+0000","last_peered":"2024-01-21T20:15:21.822035+0000","last_clean":"2024-01-21T20:15:21.822035+0000","last_became_active":"2024-01-21T20:15:21.445057+0000","last_became_peered":"2024-01-21T20:15:21.445057+0000","last_unstale":"2024-01-21T20:15:21.822035+0000","last_undegraded":"2024-01-21T20:15:21.822035+0000","last_fullsized":"2024-01-21T20:15:21.822035+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810820+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:15:21.810820+0000","last_peered":"2024-01-21T20:15:21.810820+0000","last_clean":"2024-01-21T20:15:21.810820+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:15:21.810820+0000","last_undegraded":"2024-01-21T20:15:21.810820+0000","last_fullsized":"2024-01-21T20:15:21.810820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.826380+0000","last_change":"2024-01-21T20:15:21.821489+0000","last_active":"2024-01-21T20:15:21.826380+0000","last_peered":"2024-01-21T20:15:21.826380+0000","last_clean":"2024-01-21T20:15:21.826380+0000","last_became_active":"2024-01-21T20:15:21.821201+0000","last_became_peered":"2024-01-21T20:15:21.821201+0000","last_unstale":"2024-01-21T20:15:21.826380+0000","last_undegraded":"2024-01-21T20:15:21.826380+0000","last_fullsized":"2024-01-21T20:15:21.826380+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"107'2","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821753+0000","last_change":"2024-01-21T20:15:21.444892+0000","last_active":"2024-01-21T20:15:21.821753+0000","last_peered":"2024-01-21T20:15:21.821753+0000","last_clean":"2024-01-21T20:15:21.821753+0000","last_became_active":"2024-01-21T20:15:21.444279+0000","last_became_peered":"2024-01-21T20:15:21.444279+0000","last_unstale":"2024-01-21T20:15:21.821753+0000","last_undegraded":"2024-01-21T20:15:21.821753+0000","last_fullsized":"2024-01-21T20:15:21.821753+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":90,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812452+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:15:21.812452+0000","last_peered":"2024-01-21T20:15:21.812452+0000","last_clean":"2024-01-21T20:15:21.812452+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:15:21.812452+0000","last_undegraded":"2024-01-21T20:15:21.812452+0000","last_fullsized":"2024-01-21T20:15:21.812452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.827664+0000","last_change":"2024-01-21T20:15:21.826793+0000","last_active":"2024-01-21T20:15:21.827664+0000","last_peered":"2024-01-21T20:15:21.827664+0000","last_clean":"2024-01-21T20:15:21.827664+0000","last_became_active":"2024-01-21T20:15:21.826391+0000","last_became_peered":"2024-01-21T20:15:21.826391+0000","last_unstale":"2024-01-21T20:15:21.827664+0000","last_undegraded":"2024-01-21T20:15:21.827664+0000","last_fullsized":"2024-01-21T20:15:21.827664+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.811964+0000","last_change":"2024-01-21T20:15:21.430707+0000","last_active":"2024-01-21T20:15:21.811964+0000","last_peered":"2024-01-21T20:15:21.811964+0000","last_clean":"2024-01-21T20:15:21.811964+0000","last_became_active":"2024-01-21T20:15:21.430416+0000","last_became_peered":"2024-01-21T20:15:21.430416+0000","last_unstale":"2024-01-21T20:15:21.811964+0000","last_undegraded":"2024-01-21T20:15:21.811964+0000","last_fullsized":"2024-01-21T20:15:21.811964+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":94,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810678+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:15:21.810678+0000","last_peered":"2024-01-21T20:15:21.810678+0000","last_clean":"2024-01-21T20:15:21.810678+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:15:21.810678+0000","last_undegraded":"2024-01-21T20:15:21.810678+0000","last_fullsized":"2024-01-21T20:15:21.810678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.813620+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:15:21.813620+0000","last_peered":"2024-01-21T20:15:21.813620+0000","last_clean":"2024-01-21T20:15:21.813620+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:15:21.813620+0000","last_undegraded":"2024-01-21T20:15:21.813620+0000","last_fullsized":"2024-01-21T20:15:21.813620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.833189+0000","last_change":"2024-01-21T20:15:21.829803+0000","last_active":"2024-01-21T20:15:21.833189+0000","last_peered":"2024-01-21T20:15:21.833189+0000","last_clean":"2024-01-21T20:15:21.833189+0000","last_became_active":"2024-01-21T20:15:21.829434+0000","last_became_peered":"2024-01-21T20:15:21.829434+0000","last_unstale":"2024-01-21T20:15:21.833189+0000","last_undegraded":"2024-01-21T20:15:21.833189+0000","last_fullsized":"2024-01-21T20:15:21.833189+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"107'1","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.821719+0000","last_change":"2024-01-21T20:15:21.439867+0000","last_active":"2024-01-21T20:15:21.821719+0000","last_peered":"2024-01-21T20:15:21.821719+0000","last_clean":"2024-01-21T20:15:21.821719+0000","last_became_active":"2024-01-21T20:15:21.439585+0000","last_became_peered":"2024-01-21T20:15:21.439585+0000","last_unstale":"2024-01-21T20:15:21.821719+0000","last_undegraded":"2024-01-21T20:15:21.821719+0000","last_fullsized":"2024-01-21T20:15:21.821719+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812835+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:15:21.812835+0000","last_peered":"2024-01-21T20:15:21.812835+0000","last_clean":"2024-01-21T20:15:21.812835+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:15:21.812835+0000","last_undegraded":"2024-01-21T20:15:21.812835+0000","last_fullsized":"2024-01-21T20:15:21.812835+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836584+0000","last_change":"2024-01-21T20:15:21.834560+0000","last_active":"2024-01-21T20:15:21.836584+0000","last_peered":"2024-01-21T20:15:21.836584+0000","last_clean":"2024-01-21T20:15:21.836584+0000","last_became_active":"2024-01-21T20:15:21.824614+0000","last_became_peered":"2024-01-21T20:15:21.824614+0000","last_unstale":"2024-01-21T20:15:21.836584+0000","last_undegraded":"2024-01-21T20:15:21.836584+0000","last_fullsized":"2024-01-21T20:15:21.836584+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812242+0000","last_change":"2024-01-21T20:15:21.444341+0000","last_active":"2024-01-21T20:15:21.812242+0000","last_peered":"2024-01-21T20:15:21.812242+0000","last_clean":"2024-01-21T20:15:21.812242+0000","last_became_active":"2024-01-21T20:15:21.443657+0000","last_became_peered":"2024-01-21T20:15:21.443657+0000","last_unstale":"2024-01-21T20:15:21.812242+0000","last_undegraded":"2024-01-21T20:15:21.812242+0000","last_fullsized":"2024-01-21T20:15:21.812242+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.814431+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:15:21.814431+0000","last_peered":"2024-01-21T20:15:21.814431+0000","last_clean":"2024-01-21T20:15:21.814431+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:15:21.814431+0000","last_undegraded":"2024-01-21T20:15:21.814431+0000","last_fullsized":"2024-01-21T20:15:21.814431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.836761+0000","last_change":"2024-01-21T20:15:21.835253+0000","last_active":"2024-01-21T20:15:21.836761+0000","last_peered":"2024-01-21T20:15:21.836761+0000","last_clean":"2024-01-21T20:15:21.836761+0000","last_became_active":"2024-01-21T20:15:21.834968+0000","last_became_peered":"2024-01-21T20:15:21.834968+0000","last_unstale":"2024-01-21T20:15:21.836761+0000","last_undegraded":"2024-01-21T20:15:21.836761+0000","last_fullsized":"2024-01-21T20:15:21.836761+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.810360+0000","last_change":"2024-01-21T20:15:21.445267+0000","last_active":"2024-01-21T20:15:21.810360+0000","last_peered":"2024-01-21T20:15:21.810360+0000","last_clean":"2024-01-21T20:15:21.810360+0000","last_became_active":"2024-01-21T20:15:21.444948+0000","last_became_peered":"2024-01-21T20:15:21.444948+0000","last_unstale":"2024-01-21T20:15:21.810360+0000","last_undegraded":"2024-01-21T20:15:21.810360+0000","last_fullsized":"2024-01-21T20:15:21.810360+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.809858+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:15:21.809858+0000","last_peered":"2024-01-21T20:15:21.809858+0000","last_clean":"2024-01-21T20:15:21.809858+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:15:21.809858+0000","last_undegraded":"2024-01-21T20:15:21.809858+0000","last_fullsized":"2024-01-21T20:15:21.809858+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.825646+0000","last_change":"2024-01-21T20:15:21.821011+0000","last_active":"2024-01-21T20:15:21.825646+0000","last_peered":"2024-01-21T20:15:21.825646+0000","last_clean":"2024-01-21T20:15:21.825646+0000","last_became_active":"2024-01-21T20:15:21.820721+0000","last_became_peered":"2024-01-21T20:15:21.820721+0000","last_unstale":"2024-01-21T20:15:21.825646+0000","last_undegraded":"2024-01-21T20:15:21.825646+0000","last_fullsized":"2024-01-21T20:15:21.825646+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:21.415632+0000","last_clean_scrub_stamp":"2024-01-21T20:15:21.415632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.812044+0000","last_change":"2024-01-21T20:15:21.446054+0000","last_active":"2024-01-21T20:15:21.812044+0000","last_peered":"2024-01-21T20:15:21.812044+0000","last_clean":"2024-01-21T20:15:21.812044+0000","last_became_active":"2024-01-21T20:15:21.445770+0000","last_became_peered":"2024-01-21T20:15:21.445770+0000","last_unstale":"2024-01-21T20:15:21.812044+0000","last_undegraded":"2024-01-21T20:15:21.812044+0000","last_fullsized":"2024-01-21T20:15:21.812044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:15:20.409024+0000","last_clean_scrub_stamp":"2024-01-21T20:15:20.409024+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":82,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-01-21T20:15:21.815036+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:15:21.815036+0000","last_peered":"2024-01-21T20:15:21.815036+0000","last_clean":"2024-01-21T20:15:21.815036+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:15:21.815036+0000","last_undegraded":"2024-01-21T20:15:21.815036+0000","last_fullsized":"2024-01-21T20:15:21.815036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069348,"statfs":{"total":96636764160,"available":96327012352,"internally_reserved":0,"allocated":1331200,"data_stored":688593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.58599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39500000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.745,"5min":0.76600000000000001,"15min":0.81000000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.435,"5min":0.40999999999999998,"15min":0.36799999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":1.47},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54700000000000004,"15min":0.56000000000000005},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.871,"15min":0.91100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.55800000000000005},"min":{"1min":0.34499999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70299999999999996,"5min":0.75700000000000001,"15min":0.79700000000000004},"last":0.44}]},{"osd":2,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54300000000000004,"15min":0.55600000000000005},"min":{"1min":0.35999999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71799999999999997,"5min":0.79000000000000004,"15min":0.82799999999999996},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":1.4930000000000001},"last":0.55400000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71699999999999997,"5min":0.79500000000000004,"15min":1.5229999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71999999999999997,"5min":0.80000000000000004,"15min":1.514},"last":0.47299999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.28399999999999997},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.84799999999999998},"last":0.60399999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.502},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.309},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.70099999999999996,"5min":0.78700000000000003,"15min":0.83299999999999996},"last":0.48299999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:14:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42299999999999999,"5min":0.33400000000000002,"15min":0.32900000000000001},"max":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.752,"5min":0.80300000000000005,"15min":0.88400000000000001},"last":0.42399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1347584,"data_stored":691610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57799999999999996,"15min":0.59899999999999998},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.47599999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":1.083},"last":0.47099999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55000000000000004,"15min":0.56299999999999994},"min":{"1min":0.379,"5min":0.252,"15min":0.252},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":1.107},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72099999999999997,"5min":0.81200000000000006,"15min":1.016},"last":0.45000000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.55500000000000005,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80100000000000005,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.57699999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56299999999999994,"15min":0.58099999999999996},"min":{"1min":0.39200000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":1.0609999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78700000000000003,"5min":1.621,"15min":1.621},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.32700000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.375},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48699999999999999,"15min":0.48199999999999998},"min":{"1min":0.36599999999999999,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.75,"5min":0.75,"15min":0.86099999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.32800000000000001,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:15:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.81999999999999995,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.53900000000000003},"min":{"1min":0.38400000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.57399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302488,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069352,"statfs":{"total":96636764160,"available":96327016448,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38200000000000001,"15min":0.39200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.61399999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42599999999999999,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.247},"max":{"1min":0.57699999999999996,"5min":0.61499999999999999,"15min":0.627},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.66600000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.19400000000000001},"max":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.68799999999999994},"last":0.36699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.433,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.66900000000000004,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.40200000000000002,"15min":0.41299999999999998},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40500000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.72199999999999998,"5min":0.85199999999999998,"15min":0.90700000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.42399999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72599999999999998,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81799999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.66700000000000004,"15min":0.67100000000000004},"min":{"1min":0.499,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.754,"5min":0.94399999999999995,"15min":0.98599999999999999},"last":0.60999999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64300000000000002,"15min":0.65000000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.879,"15min":0.99299999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.66300000000000003,"15min":0.67900000000000005},"min":{"1min":0.48699999999999999,"5min":0.45600000000000002,"15min":0.44},"max":{"1min":0.79300000000000004,"5min":0.97699999999999998,"15min":1.0209999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:14:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.747,"5min":0.89700000000000002,"15min":0.96499999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302504,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069336,"statfs":{"total":96636764160,"available":96327000064,"internally_reserved":0,"allocated":1343488,"data_stored":689375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.51200000000000001,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52100000000000002,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.34200000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.23499999999999999},"max":{"1min":0.55700000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.32300000000000001,"5min":0.26700000000000002,"15min":0.26600000000000001},"max":{"1min":0.59999999999999998,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.41799999999999998,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.22},"max":{"1min":0.53600000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.248},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42199999999999999,"15min":0.42699999999999999},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59899999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.28399999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60799999999999998,"15min":0.61299999999999999},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.87,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77000000000000002,"5min":0.86699999999999999,"15min":0.88500000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.60899999999999999},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.71699999999999997,"5min":0.90600000000000003,"15min":0.92400000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.627,"15min":0.63600000000000001},"min":{"1min":0.41099999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83299999999999996,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.82599999999999996,"5min":0.90200000000000002,"15min":0.92200000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64800000000000002,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.84699999999999998,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66700000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65600000000000003,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.379,"15min":0.379},"max":{"1min":0.77100000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302488,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069352,"statfs":{"total":96636764160,"available":96327016448,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.39000000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.91500000000000004},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40899999999999997,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.23899999999999999},"max":{"1min":0.57799999999999996,"5min":0.61899999999999999,"15min":0.93799999999999994},"last":0.32300000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.55800000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.41699999999999998,"15min":0.42199999999999999},"min":{"1min":0.245,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.54400000000000004,"5min":0.59099999999999997,"15min":0.68500000000000005},"last":0.308}]},{"osd":3,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.59599999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.45700000000000002},"min":{"1min":0.27200000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60399999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.35899999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63700000000000001,"15min":0.64900000000000002},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.47299999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.95999999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.53300000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.623,"15min":0.63},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.38600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.36599999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.98699999999999999},"last":0.45000000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64000000000000001,"15min":0.63600000000000001},"min":{"1min":0.41199999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.026,"5min":1.2,"15min":1.2},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.438}]},{"osd":7,"last update":"Sun Jan 21 20:14:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.41299999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.93300000000000005,"5min":1.216,"15min":1.216},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1335296,"data_stored":690460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.45500000000000002,"15min":0.41399999999999998},"min":{"1min":0.27100000000000002,"5min":0.185,"15min":0.185},"max":{"1min":0.50800000000000001,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.48699999999999999,"15min":0.44400000000000001},"min":{"1min":0.26800000000000002,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.54600000000000004,"5min":7.532,"15min":7.532},"last":0.28299999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.44700000000000001,"15min":0.40799999999999997},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.372},{"interface":"front","average":{"1min":0.374,"5min":0.47099999999999997,"15min":0.433},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.224}]},{"osd":2,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.59599999999999997,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.52900000000000003,"15min":0.48899999999999999},"min":{"1min":0.31,"5min":0.27200000000000002,"15min":0.255},"max":{"1min":0.55500000000000005,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.26200000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68400000000000005,"15min":0.65700000000000003},"min":{"1min":0.39800000000000002,"5min":0.379,"15min":0.377},"max":{"1min":0.80600000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.67200000000000004,"15min":0.65300000000000002},"min":{"1min":0.41999999999999998,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80600000000000005,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67800000000000005,"15min":0.64500000000000002},"min":{"1min":0.41799999999999998,"5min":0.38200000000000001,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.68300000000000005,"15min":0.66400000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.52800000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.69599999999999995,"15min":0.66700000000000004},"min":{"1min":0.48299999999999998,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.79900000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.38800000000000001},"max":{"1min":0.85199999999999998,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:14:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.69399999999999995,"15min":0.67700000000000005},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71899999999999997,"15min":0.68999999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83399999999999996,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.46800000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1304,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1335296,"data_stored":690142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33100000000000002},"max":{"1min":0.73399999999999999,"5min":0.749,"15min":1.379},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.59699999999999998},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.76600000000000001,"15min":1.139},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.748,"5min":0.78400000000000003,"15min":1.8220000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.44500000000000001,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.77500000000000002,"5min":0.83499999999999996,"15min":2.3140000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.57599999999999996},"min":{"1min":0.40600000000000003,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72199999999999998,"5min":0.74099999999999999,"15min":1.7130000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55700000000000005,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.79800000000000004,"15min":2.262},"last":0.75}]},{"osd":3,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.66100000000000003,"5min":1.1120000000000001,"15min":1.2470000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58399999999999996,"15min":0.59899999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.34899999999999998},"max":{"1min":0.76700000000000002,"5min":1.161,"15min":1.7410000000000001},"last":0.46400000000000002}]},{"osd":5,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46600000000000003,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":2.3530000000000002},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.35899999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.748,"5min":0.77600000000000002,"15min":1.296},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48099999999999998,"15min":0.502},"min":{"1min":0.33700000000000002,"5min":0.32400000000000001,"15min":0.316},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.7629999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":2.3839999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:14:39 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.53900000000000003},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.3280000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56200000000000006,"15min":0.57999999999999996},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":1.8839999999999999},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306584,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065256,"statfs":{"total":96636764160,"available":96322822144,"internally_reserved":0,"allocated":1327104,"data_stored":689498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57899999999999996,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":1.4690000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.41899999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":1.252,"15min":1.252},"last":0.622}]},{"osd":1,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56200000000000006,"15min":0.56499999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57799999999999996,"15min":0.56599999999999995},"min":{"1min":0.36099999999999999,"5min":0.34399999999999997,"15min":0.307},"max":{"1min":0.76100000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55100000000000005,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71499999999999997,"5min":0.73199999999999998,"15min":1.4970000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":1.425},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76600000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.56299999999999994}]},{"osd":4,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48799999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68899999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55000000000000004,"15min":0.56200000000000006},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":1.008,"15min":1.492},"last":0.36499999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.505,"15min":0.5},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71199999999999997,"5min":1.891,"15min":1.891},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.51400000000000001,"15min":0.51300000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70299999999999996,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.40100000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:14:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.96099999999999997,"15min":0.98199999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56499999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78500000000000003,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.59699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:15:29.812 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:15:29.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:15:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.980+0000 7f09aea5a700 1 Processor -- start 2024-01-21T20:15:29.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.980+0000 7f09aea5a700 1 -- start start 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09a8154140 0x7f09a8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a8154520 0x7f09a80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a80c6090 0x7f09a80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80c6ae0 con 0x7f09a8154520 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80c05e0 con 0x7f09a8154140 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09aea5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80ab620 con 0x7f09a80c6090 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a8154520 0x7f09a80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a8154520 0x7f09a80ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55008/0 (socket says 172.21.15.133:55008) 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 -- 172.21.15.133:0/1991970134 learned_addr learned my addr 172.21.15.133:0/1991970134 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09acff7700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a80c6090 0x7f09a80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 -- 172.21.15.133:0/1991970134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a80c6090 msgr2=0x7f09a80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a7fff700 1 --2- 172.21.15.133:0/1991970134 >> v2:172.21.15.178:3300/0 conn(0x7f09a8154140 0x7f09a8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a80c6090 0x7f09a80c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 -- 172.21.15.133:0/1991970134 >> v2:172.21.15.178:3300/0 conn(0x7f09a8154140 msgr2=0x7f09a8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1991970134 >> v2:172.21.15.178:3300/0 conn(0x7f09a8154140 0x7f09a8158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 -- 172.21.15.133:0/1991970134 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80c0e40 con 0x7f09a8154520 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a8154520 0x7f09a80ab130 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f09a8083d70 tx=0x7f09980090f0).ready entity=mon.0 client_cookie=43970c2f54e6de83 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a6ffd700 1 -- 172.21.15.133:0/1991970134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800b600 con 0x7f09a8154520 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a6ffd700 1 -- 172.21.15.133:0/1991970134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099800b760 con 0x7f09a8154520 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.981+0000 7f09a6ffd700 1 -- 172.21.15.133:0/1991970134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800bae0 con 0x7f09a8154520 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 -- 172.21.15.133:0/1991970134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a8154520 msgr2=0x7f09a80ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a8154520 0x7f09a80ab130 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f09a8083d70 tx=0x7f09980090f0).stop 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 -- 172.21.15.133:0/1991970134 shutdown_connections 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a80c6090 0x7f09a80c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1991970134 >> v2:172.21.15.178:3300/0 conn(0x7f09a8154140 0x7f09a8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1991970134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a8154520 0x7f09a80ab130 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 -- 172.21.15.133:0/1991970134 >> 172.21.15.133:0/1991970134 conn(0x7f09a805e1e0 msgr2=0x7f09a805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 -- 172.21.15.133:0/1991970134 shutdown_connections 2024-01-21T20:15:29.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.982+0000 7f09aea5a700 1 -- 172.21.15.133:0/1991970134 wait complete. 2024-01-21T20:15:29.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.983+0000 7f09aea5a700 1 Processor -- start 2024-01-21T20:15:29.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.983+0000 7f09aea5a700 1 -- start start 2024-01-21T20:15:29.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 0x7f09a8139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 0x7f09a814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8158250 con 0x7f09a80c6090 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8157640 con 0x7f09a8154140 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09aea5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a8157920 con 0x7f09a8154520 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09a7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09a7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55016/0 (socket says 172.21.15.133:55016) 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.984+0000 7f09a7fff700 1 -- 172.21.15.133:0/1320093118 learned_addr learned my addr 172.21.15.133:0/1320093118 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09acff7700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 0x7f09a814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 0x7f09a8139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 -- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 msgr2=0x7f09a814e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 0x7f09a814e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 -- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 msgr2=0x7f09a8139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 0x7f09a8139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 -- 172.21.15.133:0/1320093118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0998009370 con 0x7f09a80c6090 2024-01-21T20:15:29.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09acff7700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 0x7f09a814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 0x7f09a8139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a7fff700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f099c00c850 tx=0x7f099c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c010580 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c0106e0 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a8157c00 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c010a60 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.985+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a8157200 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.986+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a805fdf0 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.986+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f099c01b460 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.987+0000 7f09a4ff9700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 0x7f0994061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.987+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f099c07a3a0 con 0x7f09a80c6090 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.987+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 0x7f0994061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:29.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.987+0000 7f09a77fe700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 0x7f0994061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f09a814de40 tx=0x7f0998017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:29.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:29.991+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f099c04b3c0 con 0x7f09a80c6090 2024-01-21T20:15:30.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.220+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f09a80aa980 con 0x7f09a80c6090 2024-01-21T20:15:30.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.223+0000 7f09a4ff9700 1 -- 172.21.15.133:0/1320093118 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f099c04e9e0 con 0x7f09a80c6090 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 msgr2=0x7f0994061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 0x7f0994061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f09a814de40 tx=0x7f0998017000).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 msgr2=0x7f09a8156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f099c00c850 tx=0x7f099c008040).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 shutdown_connections 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f099405f150 0x7f0994061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a8154520 0x7f09a814e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a80c6090 0x7f09a8156d10 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 --2- 172.21.15.133:0/1320093118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a8154140 0x7f09a8139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 >> 172.21.15.133:0/1320093118 conn(0x7f09a805e1e0 msgr2=0x7f09a8145fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:30.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.225+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 shutdown_connections 2024-01-21T20:15:30.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.226+0000 7f09aea5a700 1 -- 172.21.15.133:0/1320093118 wait complete. 2024-01-21T20:15:30.217 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:15:30.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:15:30.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.353+0000 7f8a16545700 1 Processor -- start 2024-01-21T20:15:30.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.353+0000 7f8a16545700 1 -- start start 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a10155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a100c3fb0 0x7f8a100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a10069cd0 0x7f8a10151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100bef10 con 0x7f8a100c3fb0 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a10156070 con 0x7f8a10069cd0 2024-01-21T20:15:30.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a16545700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10065660 con 0x7f8a100beb30 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a0f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a100c3fb0 0x7f8a100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a0f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8a100c3fb0 0x7f8a100697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33390/0 (socket says 172.21.15.133:33390) 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a0f7fe700 1 -- 172.21.15.133:0/694535159 learned_addr learned my addr 172.21.15.133:0/694535159 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a0ffff700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a10155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.354+0000 7f8a14ae2700 1 --2- 172.21.15.133:0/694535159 >> v2:172.21.15.178:3300/0 conn(0x7f8a10069cd0 0x7f8a10151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 -- 172.21.15.133:0/694535159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 msgr2=0x7f8a10155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a10155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 -- 172.21.15.133:0/694535159 >> v2:172.21.15.178:3300/0 conn(0x7f8a10069cd0 msgr2=0x7f8a10151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 --2- 172.21.15.133:0/694535159 >> v2:172.21.15.178:3300/0 conn(0x7f8a10069cd0 0x7f8a10151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 -- 172.21.15.133:0/694535159 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10065f00 con 0x7f8a100c3fb0 2024-01-21T20:15:30.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0f7fe700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100697e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f8a100a76d0 tx=0x7f8a0000b3b0).ready entity=mon.0 client_cookie=cb80456a769cf184 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0effd700 1 -- 172.21.15.133:0/694535159 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0000da40 con 0x7f8a100c3fb0 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0effd700 1 -- 172.21.15.133:0/694535159 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0000dba0 con 0x7f8a100c3fb0 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a0effd700 1 -- 172.21.15.133:0/694535159 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00010470 con 0x7f8a100c3fb0 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 -- 172.21.15.133:0/694535159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 msgr2=0x7f8a100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100697e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7f8a100a76d0 tx=0x7f8a0000b3b0).stop 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 -- 172.21.15.133:0/694535159 shutdown_connections 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 --2- 172.21.15.133:0/694535159 >> v2:172.21.15.178:3300/0 conn(0x7f8a10069cd0 0x7f8a10151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a10155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 --2- 172.21.15.133:0/694535159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100697e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 -- 172.21.15.133:0/694535159 >> 172.21.15.133:0/694535159 conn(0x7f8a100c8010 msgr2=0x7f8a100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:30.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 -- 172.21.15.133:0/694535159 shutdown_connections 2024-01-21T20:15:30.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.355+0000 7f8a16545700 1 -- 172.21.15.133:0/694535159 wait complete. 2024-01-21T20:15:30.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.357+0000 7f8a16545700 1 Processor -- start 2024-01-21T20:15:30.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.357+0000 7f8a16545700 1 -- start start 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a10069cd0 0x7f8a10135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a100c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a10152ea0 con 0x7f8a100c3fb0 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100c1800 con 0x7f8a10069cd0 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101364b0 con 0x7f8a100beb30 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33406/0 (socket says 172.21.15.133:33406) 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 -- 172.21.15.133:0/1699788575 learned_addr learned my addr 172.21.15.133:0/1699788575 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a0f7fe700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a100c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a0ffff700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a10069cd0 0x7f8a10135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 -- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 msgr2=0x7f8a100c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a100c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 -- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a10069cd0 msgr2=0x7f8a10135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a10069cd0 0x7f8a10135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 -- 172.21.15.133:0/1699788575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0000b610 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a14ae2700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f8a08009df0 tx=0x7f8a0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800caa0 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0800f040 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a100c0f60 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0800ce10 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.358+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a100c1520 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.359+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10152c70 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.360+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8a08013610 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.360+0000 7f8a0cff9700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 0x7f89f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.360+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f8a0807aaf0 con 0x7f8a100c3fb0 2024-01-21T20:15:30.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.360+0000 7f8a0ffff700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 0x7f89f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:30.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.360+0000 7f8a0ffff700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 0x7f89f0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f89f8009b90 tx=0x7f89f8009060).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:30.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.364+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8a10152c70 con 0x7f8a100c3fb0 2024-01-21T20:15:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.566+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a10152c70 con 0x7f8a100c3fb0 2024-01-21T20:15:30.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.567+0000 7f8a0cff9700 1 -- 172.21.15.133:0/1699788575 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f8a10152c70 con 0x7f8a100c3fb0 2024-01-21T20:15:30.557 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:30.557 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:15:30.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 msgr2=0x7f89f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 0x7f89f0061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f89f8009b90 tx=0x7f89f8009060).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 msgr2=0x7f8a100661e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7f8a08009df0 tx=0x7f8a0800b040).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 shutdown_connections 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f89f005f150 0x7f89f0061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a100c3fb0 0x7f8a100661e0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a10069cd0 0x7f8a10135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 --2- 172.21.15.133:0/1699788575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a100beb30 0x7f8a100c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 >> 172.21.15.133:0/1699788575 conn(0x7f8a100c8010 msgr2=0x7f8a10155020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 shutdown_connections 2024-01-21T20:15:30.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:30.569+0000 7f8a16545700 1 -- 172.21.15.133:0/1699788575 wait complete. 2024-01-21T20:15:30.561 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:15:30.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:15:21.803617+0000', 'modified': '2024-01-21T20:15:23.809473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7161}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7161': {'gid': 7161, 'name': 'b', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/3646142750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6833', 'nonce': 3646142750}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3646142750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:15:30.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:15:30.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-21T20:15:31.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.105+0000 7f442473f700 1 Processor -- start 2024-01-21T20:15:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.105+0000 7f442473f700 1 -- start start 2024-01-21T20:15:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f442473f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f441c062c10 0x7f441c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f442473f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c0634e0 con 0x7f441c065d70 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f442473f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f441c06a130 con 0x7f441c0697e0 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f442473f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441c06a410 con 0x7f441c062c10 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44224db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f441c062c10 0x7f441c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f4422cdc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f441c065d70 0x7f441c0bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58062/0 (socket says 172.21.15.133:58062) 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f4422cdc700 1 -- 172.21.15.133:0/3588258869 learned_addr learned my addr 172.21.15.133:0/3588258869 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44224db700 1 -- 172.21.15.133:0/3588258869 >> v1:172.21.15.178:6789/0 conn(0x7f441c0697e0 legacy=0x7f441c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44224db700 1 -- 172.21.15.133:0/3588258869 >> v1:172.21.15.133:6789/0 conn(0x7f441c065d70 legacy=0x7f441c0bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44224db700 1 -- 172.21.15.133:0/3588258869 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c06a6f0 con 0x7f441c062c10 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44214d9700 1 -- 172.21.15.133:0/3588258869 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332296549 0 0) 0x7f441c0634e0 con 0x7f441c065d70 2024-01-21T20:15:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.106+0000 7f44224db700 1 --2- 172.21.15.133:0/3588258869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c062c10 0x7f441c062ff0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c009060).ready entity=mon.0 client_cookie=e83a31b4e845bdaa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f44214d9700 1 -- 172.21.15.133:0/3588258869 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c0090d0 con 0x7f441c062c10 2024-01-21T20:15:31.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f44214d9700 1 -- 172.21.15.133:0/3588258869 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440c00b520 con 0x7f441c062c10 2024-01-21T20:15:31.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f44214d9700 1 -- 172.21.15.133:0/3588258869 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c00b8a0 con 0x7f441c062c10 2024-01-21T20:15:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 -- 172.21.15.133:0/3588258869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c062c10 msgr2=0x7f441c062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 --2- 172.21.15.133:0/3588258869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c062c10 0x7f441c062ff0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f440c009760 tx=0x7f440c009060).stop 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 -- 172.21.15.133:0/3588258869 shutdown_connections 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 --2- 172.21.15.133:0/3588258869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c062c10 0x7f441c062ff0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 -- 172.21.15.133:0/3588258869 >> 172.21.15.133:0/3588258869 conn(0x7f441c0c8010 msgr2=0x7f441c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 -- 172.21.15.133:0/3588258869 shutdown_connections 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.107+0000 7f442473f700 1 -- 172.21.15.133:0/3588258869 wait complete. 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.108+0000 7f442473f700 1 Processor -- start 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.108+0000 7f442473f700 1 -- start start 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 0x7f441c0a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 0x7f441c0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0ad200 con 0x7f441c0697e0 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0ac910 con 0x7f441c062c10 2024-01-21T20:15:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f442473f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441c0a88e0 con 0x7f441c065d70 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33420/0 (socket says 172.21.15.133:33420) 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.109+0000 7f4422cdc700 1 -- 172.21.15.133:0/3737148476 learned_addr learned my addr 172.21.15.133:0/3737148476 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 -- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 msgr2=0x7f441c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4421cda700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 0x7f441c0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f44224db700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 0x7f441c0a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 0x7f441c0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 -- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 msgr2=0x7f441c0a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 0x7f441c0a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 -- 172.21.15.133:0/3737148476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c0092a0 con 0x7f441c0697e0 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4421cda700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 0x7f441c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f44224db700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 0x7f441c0a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4422cdc700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f441400c810 tx=0x7f4414007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4412ffd700 1 -- 172.21.15.133:0/3737148476 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414005d30 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4412ffd700 1 -- 172.21.15.133:0/3737148476 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414005e90 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f4412ffd700 1 -- 172.21.15.133:0/3737148476 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414007320 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441c0acbb0 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.110+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0a9690 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.111+0000 7f4412ffd700 1 -- 172.21.15.133:0/3737148476 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4414007710 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.112+0000 7f4412ffd700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 0x7f4400061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.112+0000 7f4412ffd700 1 -- 172.21.15.133:0/3737148476 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f441407a590 con 0x7f441c0697e0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.112+0000 7f44224db700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 0x7f4400061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.112+0000 7f44224db700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 0x7f4400061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f440c009270 tx=0x7f440c017000).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.114+0000 7f44360e2b80 1 Processor -- start 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.114+0000 7f44360e2b80 1 -- start start 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.114+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cbbba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.114+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.114+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbb6df0 0x55da3cbb7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f44360e2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cb323d0 con 0x55da3cc042c0 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3caf7be0 con 0x55da3cbbb620 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da3cb0d260 con 0x55da3cbb6df0 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33426/0 (socket says 172.21.15.133:33426) 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 -- 172.21.15.133:0/277994133 learned_addr learned my addr 172.21.15.133:0/277994133 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4422cdc700 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbb6df0 0x55da3cbb7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 -- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbb6df0 msgr2=0x55da3cbb7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbb6df0 0x55da3cbb7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 -- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 msgr2=0x55da3cbbba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f44224db700 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cbbba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cbbba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 -- 172.21.15.133:0/277994133 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da3cb062f0 con 0x55da3cc042c0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f4421cda700 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f441800a850 tx=0x7f4418008040).ready entity=mon.0 client_cookie=2da1b6ec715a97f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f43fffff700 1 -- 172.21.15.133:0/277994133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800c670 con 0x55da3cc042c0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f43fffff700 1 -- 172.21.15.133:0/277994133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800c7d0 con 0x55da3cc042c0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.115+0000 7f43fffff700 1 -- 172.21.15.133:0/277994133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441800cb90 con 0x55da3cc042c0 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 -- 172.21.15.133:0/277994133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 msgr2=0x55da3cbb6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f441800a850 tx=0x7f4418008040).stop 2024-01-21T20:15:31.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 -- 172.21.15.133:0/277994133 shutdown_connections 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbb6df0 0x55da3cbb7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cbbba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 --2- 172.21.15.133:0/277994133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbb6900 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 -- 172.21.15.133:0/277994133 >> 172.21.15.133:0/277994133 conn(0x55da3ca242e0 msgr2=0x55da3cc04750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 -- 172.21.15.133:0/277994133 shutdown_connections 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.116+0000 7f44360e2b80 1 -- 172.21.15.133:0/277994133 wait complete. 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.117+0000 7f44360e2b80 1 -- start start 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.117+0000 7f44360e2b80 1 Processor -- start 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.117+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cc103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cc042c0 0x55da3cc142e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cb0d3a0 con 0x55da3cbb6df0 2024-01-21T20:15:31.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cb0d620 con 0x55da3cbbb620 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da3cad8990 con 0x55da3cc042c0 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 10 client.0 ll_register_callbacks cb 0x55da3cb7b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33432/0 (socket says 172.21.15.133:33432) 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 -- 172.21.15.133:0/3984268100 learned_addr learned my addr 172.21.15.133:0/3984268100 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f4422cdc700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cc042c0 0x55da3cc142e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f4421cda700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cc103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 -- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cc042c0 msgr2=0x55da3cc142e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cc042c0 0x55da3cc142e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 -- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 msgr2=0x55da3cc103d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cc103d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 -- 172.21.15.133:0/3984268100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441800a3d0 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44224db700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f440c009eb0 tx=0x7f440c01c000).ready entity=mon.0 client_cookie=7f07d539ba621b50 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f43fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440c026440 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f440c0265a0 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da3cbb5df0 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f440c026970 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 10 client.7317 fetch_fsmap learned FSMap version 36 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55da3cb01520 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.118+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da3cbb5df0 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f440c023030 con 0x55da3cbb6df0 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 10 client.7317 fetch_fsmap finished waiting for FSMap version 36 2024-01-21T20:15:31.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 10 client.7317 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 20 client.7317 populate_metadata read hostname 'smithi133' 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe8ef0 0x55da3cbe6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 4 client.7317 mds_command: new command op to 7161 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 --> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da3cb02d60 con 0x55da3cbe8ef0 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f4421cda700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe8ef0 0x55da3cbe6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f43fd7fa700 10 client.7317 ms_handle_connect on v2:172.21.15.178:6833/3646142750 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.119+0000 7f4421cda700 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe8ef0 0x55da3cbe6210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8b3ce55168f5586d server_cookie=b3481e83ba79233f in_seq=0 out_seq=0 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f43fd7fa700 1 -- 172.21.15.133:0/3984268100 <== mds.0 v2:172.21.15.178:6833/3646142750 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55da3cb02d60 con 0x55da3cbe8ef0 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f43fd7fa700 10 client.7317 handle_command_reply: tid=0 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 client.7317 shutdown 2024-01-21T20:15:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 msgr2=0x55da3cbe9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f440c009eb0 tx=0x7f440c01c000).stop 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 shutdown_connections 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe8ef0 0x55da3cbe6210 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cc042c0 0x55da3cc142e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f43fd7fa700 0 client.7317 ms_handle_reset on v2:172.21.15.178:6833/3646142750 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cbb6df0 0x55da3cbe9bb0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 --2- 172.21.15.133:0/3984268100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbbb620 0x55da3cc103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 >> 172.21.15.133:0/3984268100 conn(0x55da3ca242e0 msgr2=0x55da3cbb9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 shutdown_connections 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 1 -- 172.21.15.133:0/3984268100 wait complete. 2024-01-21T20:15:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.120+0000 7f44360e2b80 20 client.7317 trim_cache size 0 max 16384 2024-01-21T20:15:31.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 Processor -- start 2024-01-21T20:15:31.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 -- start start 2024-01-21T20:15:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cbb2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbb2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cc00ca0 con 0x55da3cc042c0 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cbb7900 con 0x55da3cbb6df0 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.137+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da3cbb2a00 con 0x55da3cbbb620 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33440/0 (socket says 172.21.15.133:33440) 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 -- 172.21.15.133:0/215251571 learned_addr learned my addr 172.21.15.133:0/215251571 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 -- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 msgr2=0x55da3cbb2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbb2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 -- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 msgr2=0x55da3cbb2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cbb2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 -- 172.21.15.133:0/215251571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da3cb01270 con 0x55da3cc042c0 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4422cdc700 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f441400cfd0 tx=0x7f4414053040).ready entity=mon.0 client_cookie=a97f33899626fd4c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4410bcf700 1 -- 172.21.15.133:0/215251571 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441404d5d0 con 0x55da3cc042c0 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4410bcf700 1 -- 172.21.15.133:0/215251571 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414078450 con 0x55da3cc042c0 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.138+0000 7f4410bcf700 1 -- 172.21.15.133:0/215251571 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44140785c0 con 0x55da3cc042c0 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- 172.21.15.133:0/215251571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 msgr2=0x55da3cbe61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f441400cfd0 tx=0x7f4414053040).stop 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- 172.21.15.133:0/215251571 shutdown_connections 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe61d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cbb2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 --2- 172.21.15.133:0/215251571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbb2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- 172.21.15.133:0/215251571 >> 172.21.15.133:0/215251571 conn(0x55da3ca242e0 msgr2=0x55da3cc04750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- 172.21.15.133:0/215251571 shutdown_connections 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- 172.21.15.133:0/215251571 wait complete. 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 -- start start 2024-01-21T20:15:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.139+0000 7f44360e2b80 1 Processor -- start 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cc65510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbe61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cbfd6e0 con 0x55da3cc042c0 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da3cbe6bb0 con 0x55da3cbb6df0 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da3cbfd850 con 0x55da3cbbb620 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f44360e2b80 10 client.0 ll_register_callbacks cb 0x55da3cb7b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f4422cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33456/0 (socket says 172.21.15.133:33456) 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.140+0000 7f4422cdc700 1 -- 172.21.15.133:0/1890677816 learned_addr learned my addr 172.21.15.133:0/1890677816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44224db700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cc65510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4421cda700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbe61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 -- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 msgr2=0x55da3cbe61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbe61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 -- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 msgr2=0x55da3cc65510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cc65510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 -- 172.21.15.133:0/1890677816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441c0a9690 con 0x55da3cc042c0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4421cda700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbe61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44224db700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cc65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f4422cdc700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f441400cf60 tx=0x7f4414056000).ready entity=mon.0 client_cookie=51b4ac7c927eebe5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414054bc0 con 0x55da3cc042c0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f4414054d20 con 0x55da3cc042c0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f441800c7d0 con 0x55da3cc042c0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f441407a280 con 0x55da3cc042c0 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 10 client.7323 fetch_fsmap learned FSMap version 36 2024-01-21T20:15:31.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55da3c97af80 con 0x55da3cc042c0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441800c7d0 con 0x55da3cc042c0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4414068050 con 0x55da3cc042c0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 10 client.7323 fetch_fsmap finished waiting for FSMap version 36 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 10 client.7323 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 20 client.7323 populate_metadata read hostname 'smithi133' 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe7b60 0x55da3cbe7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 4 client.7323 mds_command: new command op to 7161 tid=0[{"prefix": "status"}] 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.141+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 --> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55da3caf97d0 con 0x55da3cbe7b60 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f44224db700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe7b60 0x55da3cbe7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f44224db700 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe7b60 0x55da3cbe7f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c1aa88993f351e5e server_cookie=2ffeabeab19765d0 in_seq=0 out_seq=0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f43fd7fa700 10 client.7323 ms_handle_connect on v2:172.21.15.178:6833/3646142750 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f43fd7fa700 1 -- 172.21.15.133:0/1890677816 <== mds.0 v2:172.21.15.178:6833/3646142750 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55da3caf97d0 con 0x55da3cbe7b60 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f43fd7fa700 10 client.7323 handle_command_reply: tid=0 2024-01-21T20:15:31.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f44360e2b80 1 client.7323 shutdown 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 msgr2=0x55da3cbe66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.142+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7f441400cf60 tx=0x7f4414056000).stop 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 shutdown_connections 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:6833/3646142750,v1:172.21.15.178:6835/3646142750] conn(0x55da3cbe7b60 0x55da3cbe7f40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55da3cc042c0 0x55da3cbe66c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da3cbb6df0 0x55da3cc65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 --2- 172.21.15.133:0/1890677816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55da3cbbb620 0x55da3cbe61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f43fd7fa700 0 client.7323 ms_handle_reset on v2:172.21.15.178:6833/3646142750 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 >> 172.21.15.133:0/1890677816 conn(0x55da3ca242e0 msgr2=0x55da3cbb2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 shutdown_connections 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 1 -- 172.21.15.133:0/1890677816 wait complete. 2024-01-21T20:15:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f44360e2b80 20 client.7323 trim_cache size 0 max 16384 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7161, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.3384450559999994, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 36, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 108, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 108, 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.849717018 2024-01-21T20:15:31.140 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:15:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 msgr2=0x7f4400061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 0x7f4400061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f440c009270 tx=0x7f440c017000).stop 2024-01-21T20:15:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 msgr2=0x7f441c0c6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f441400c810 tx=0x7f4414007ed0).stop 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 shutdown_connections 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f440005f150 0x7f4400061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f441c0697e0 0x7f441c0c6e10 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f441c062c10 0x7f441c0a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 --2- 172.21.15.133:0/3737148476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f441c065d70 0x7f441c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 >> 172.21.15.133:0/3737148476 conn(0x7f441c0c8010 msgr2=0x7f441c138dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 shutdown_connections 2024-01-21T20:15:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.143+0000 7f442473f700 1 -- 172.21.15.133:0/3737148476 wait complete. 2024-01-21T20:15:31.145 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:15:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.299+0000 7f886d3cb700 1 Processor -- start 2024-01-21T20:15:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.299+0000 7f886d3cb700 1 -- start start 2024-01-21T20:15:31.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f886d3cb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 0x7f8868154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f886d3cb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 0x7f88680be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f886d3cb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88680be7d0 con 0x7f8868063430 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f886d3cb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8868155530 con 0x7f8868153e90 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f886d3cb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88680c5f20 con 0x7f88680bde30 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.300+0000 7f88667fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8868063430 0x7f88680c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58074/0 (socket says 172.21.15.133:58074) 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88667fc700 1 -- 172.21.15.133:0/4262397271 learned_addr learned my addr 172.21.15.133:0/4262397271 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 --2- 172.21.15.133:0/4262397271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 0x7f88680be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8866ffd700 1 --2- 172.21.15.133:0/4262397271 >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 0x7f8868154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8865ffb700 1 -- 172.21.15.133:0/4262397271 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687136862 0 0) 0x7f8850001110 con 0x7f8868063430 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8865ffb700 1 -- 172.21.15.133:0/4262397271 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88540033f0 con 0x7f8868063430 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 -- 172.21.15.133:0/4262397271 >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 msgr2=0x7f8868154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 --2- 172.21.15.133:0/4262397271 >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 0x7f8868154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 -- 172.21.15.133:0/4262397271 >> v1:172.21.15.133:6789/0 conn(0x7f8868063430 legacy=0x7f88680c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 -- 172.21.15.133:0/4262397271 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868154920 con 0x7f88680bde30 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8866ffd700 1 --2- 172.21.15.133:0/4262397271 >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 0x7f8868154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f88677fe700 1 --2- 172.21.15.133:0/4262397271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 0x7f88680be2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8860009760 tx=0x7f8860009060).ready entity=mon.2 client_cookie=1f1b4303f12e985 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8865ffb700 1 -- 172.21.15.133:0/4262397271 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000d4a0 con 0x7f88680bde30 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8865ffb700 1 -- 172.21.15.133:0/4262397271 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000d600 con 0x7f88680bde30 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.301+0000 7f8865ffb700 1 -- 172.21.15.133:0/4262397271 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000d980 con 0x7f88680bde30 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 -- 172.21.15.133:0/4262397271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 msgr2=0x7f88680be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4262397271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 0x7f88680be2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8860009760 tx=0x7f8860009060).stop 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 -- 172.21.15.133:0/4262397271 shutdown_connections 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4262397271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88680bde30 0x7f88680be2e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4262397271 >> v2:172.21.15.178:3300/0 conn(0x7f8868153e90 0x7f8868154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 -- 172.21.15.133:0/4262397271 >> 172.21.15.133:0/4262397271 conn(0x7f88680c7cb0 msgr2=0x7f88680c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 -- 172.21.15.133:0/4262397271 shutdown_connections 2024-01-21T20:15:31.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.302+0000 7f886d3cb700 1 -- 172.21.15.133:0/4262397271 wait complete. 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.303+0000 7f886d3cb700 1 Processor -- start 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.303+0000 7f886d3cb700 1 -- start start 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8868153e90 0x7f8868065ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 0x7f88680663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868151040 con 0x7f88680bde30 2024-01-21T20:15:31.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8868151320 con 0x7f8868150b70 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f886d3cb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8868151600 con 0x7f8868153e90 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33470/0 (socket says 172.21.15.133:33470) 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 -- 172.21.15.133:0/4172787341 learned_addr learned my addr 172.21.15.133:0/4172787341 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f88667fc700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8868153e90 0x7f8868065ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f88677fe700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 0x7f88680663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 -- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8868153e90 msgr2=0x7f8868065ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8868153e90 0x7f8868065ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 -- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 msgr2=0x7f88680663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 0x7f88680663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f8866ffd700 1 -- 172.21.15.133:0/4172787341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858009a20 con 0x7f88680bde30 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.304+0000 7f88677fe700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 0x7f88680663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f8866ffd700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f885800c0c0 tx=0x7f885800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800ccb0 con 0x7f88680bde30 2024-01-21T20:15:31.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800f040 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858013400 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600092a0 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.305+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88680668a0 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.306+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88680475e0 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.306+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f88580137b0 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.306+0000 7f885f7fe700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 0x7f8848061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.307+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f885807ad30 con 0x7f88680bde30 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.307+0000 7f88667fc700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 0x7f8848061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:31.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.307+0000 7f88667fc700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 0x7f8848061640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88680c6d00 tx=0x7f8850007a70).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:31.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.311+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f885804bdb0 con 0x7f88680bde30 2024-01-21T20:15:31.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.516+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f88680655f0 con 0x7f88680bde30 2024-01-21T20:15:31.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.516+0000 7f885f7fe700 1 -- 172.21.15.133:0/4172787341 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f885804f3d0 con 0x7f88680bde30 2024-01-21T20:15:31.507 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:15:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 msgr2=0x7f8848061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 0x7f8848061640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f88680c6d00 tx=0x7f8850007a70).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 msgr2=0x7f88680659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f885800c0c0 tx=0x7f885800b040).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 shutdown_connections 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f884805f180 0x7f8848061640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8868150b70 0x7f88680663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88680bde30 0x7f88680659d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 --2- 172.21.15.133:0/4172787341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8868153e90 0x7f8868065ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 >> 172.21.15.133:0/4172787341 conn(0x7f88680c7cb0 msgr2=0x7f88680c57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 shutdown_connections 2024-01-21T20:15:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:31.518+0000 7f886d3cb700 1 -- 172.21.15.133:0/4172787341 wait complete. 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:15:31.519 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:15:31.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.520 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:15:31.537 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:15:31.537 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:15:31.537 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:15:31.537 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41400sec preferred_lft 41400sec 2024-01-21T20:15:31.538 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:15:31.539 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:15:31.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.540 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:15:31.602 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:15:31.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.604 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:15:31.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.663 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:15:31.664 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:15:31.664 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:15:31.664 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:15:31.664 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:15:31.664 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:15:31.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.768 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:15:31.785 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:15:31.785 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:15:31.785 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:15:31.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:15:31.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:31.852 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:15:31.909 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:15:31.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:15:31.990 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:15:31.990 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:15:32.011 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:15:32.011 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:15:32.014 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:15:32.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:15:32.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:15:32.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:15:32.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.248+0000 7f26f3cf6700 1 Processor -- start 2024-01-21T20:15:32.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.248+0000 7f26f3cf6700 1 -- start start 2024-01-21T20:15:32.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f3cf6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26ec13a830 0x7f26ec0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f3cf6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26ec0695b0 0x7f26ec0699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f3cf6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec0c3890 con 0x7f26ec13ac10 2024-01-21T20:15:32.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f3cf6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0c3b70 con 0x7f26ec0695b0 2024-01-21T20:15:32.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f3cf6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0c3e50 con 0x7f26ec13a830 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f2293700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26ec0695b0 0x7f26ec0699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f2293700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26ec0695b0 0x7f26ec0699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33474/0 (socket says 172.21.15.133:33474) 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f2293700 1 -- 172.21.15.133:0/3927065588 learned_addr learned my addr 172.21.15.133:0/3927065588 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.249+0000 7f26f1a92700 1 --2- 172.21.15.133:0/3927065588 >> v2:172.21.15.178:3300/0 conn(0x7f26ec13a830 0x7f26ec0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f2293700 1 -- 172.21.15.133:0/3927065588 >> v2:172.21.15.178:3300/0 conn(0x7f26ec13a830 msgr2=0x7f26ec0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f2293700 1 --2- 172.21.15.133:0/3927065588 >> v2:172.21.15.178:3300/0 conn(0x7f26ec13a830 0x7f26ec0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f2293700 1 -- 172.21.15.133:0/3927065588 >> v1:172.21.15.178:6789/0 conn(0x7f26ec13ac10 legacy=0x7f26ec0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f2293700 1 -- 172.21.15.133:0/3927065588 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0c4130 con 0x7f26ec0695b0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f2293700 1 --2- 172.21.15.133:0/3927065588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec0695b0 0x7f26ec0699c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f26ec068230 tx=0x7f26e400ba50).ready entity=mon.0 client_cookie=43a5849340b0d77a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f0a90700 1 -- 172.21.15.133:0/3927065588 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4010070 con 0x7f26ec0695b0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f0a90700 1 -- 172.21.15.133:0/3927065588 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e400de50 con 0x7f26ec0695b0 2024-01-21T20:15:32.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f0a90700 1 -- 172.21.15.133:0/3927065588 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e400b2e0 con 0x7f26ec0695b0 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3927065588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec0695b0 msgr2=0x7f26ec0699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3927065588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec0695b0 0x7f26ec0699c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f26ec068230 tx=0x7f26e400ba50).stop 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3927065588 shutdown_connections 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3927065588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec0695b0 0x7f26ec0699c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3927065588 >> v2:172.21.15.178:3300/0 conn(0x7f26ec13a830 0x7f26ec0c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.250+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3927065588 >> 172.21.15.133:0/3927065588 conn(0x7f26ec0c7dc0 msgr2=0x7f26ec0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.251+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3927065588 shutdown_connections 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.251+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3927065588 wait complete. 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 Processor -- start 2024-01-21T20:15:32.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 -- start start 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26ec0695b0 0x7f26ec151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26ec13a830 0x7f26ec153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec152940 con 0x7f26ec13ac10 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec151010 con 0x7f26ec0695b0 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.252+0000 7f26f3cf6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec151d30 con 0x7f26ec13a830 2024-01-21T20:15:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33488/0 (socket says 172.21.15.133:33488) 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 -- 172.21.15.133:0/3891417457 learned_addr learned my addr 172.21.15.133:0/3891417457 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f1a92700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26ec0695b0 0x7f26ec151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f1291700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26ec13a830 0x7f26ec153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 -- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26ec13a830 msgr2=0x7f26ec153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26ec13a830 0x7f26ec153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 -- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26ec0695b0 msgr2=0x7f26ec151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26ec0695b0 0x7f26ec151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 -- 172.21.15.133:0/3891417457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e400bcf0 con 0x7f26ec13ac10 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f2293700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f26ec068c60 tx=0x7f26e400ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4007000 con 0x7f26ec13ac10 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e401e480 con 0x7f26ec13ac10 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e401e820 con 0x7f26ec13ac10 2024-01-21T20:15:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec152010 con 0x7f26ec13ac10 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.253+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec1525d0 con 0x7f26ec13ac10 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.254+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec05fdf0 con 0x7f26ec13ac10 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.255+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f26e4015420 con 0x7f26ec13ac10 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.255+0000 7f26e27fc700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 0x7f26d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.255+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f26e407bdb0 con 0x7f26ec13ac10 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.255+0000 7f26f1a92700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 0x7f26d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.255+0000 7f26f1a92700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 0x7f26d0061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f26dc00bbc0 tx=0x7f26dc008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.259+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f26e404ce80 con 0x7f26ec13ac10 2024-01-21T20:15:32.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.446+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f26ec152a80 con 0x7f26d005f150 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.447+0000 7f26e27fc700 1 -- 172.21.15.133:0/3891417457 <== mgr.6963 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f26ec152a80 con 0x7f26d005f150 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:15:32.438 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:15:32.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 msgr2=0x7f26d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 0x7f26d0061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f26dc00bbc0 tx=0x7f26dc008040).stop 2024-01-21T20:15:32.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 msgr2=0x7f26ec164670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f26ec068c60 tx=0x7f26e400ba50).stop 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 shutdown_connections 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f26d005f150 0x7f26d0061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26ec13ac10 0x7f26ec164670 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26ec0695b0 0x7f26ec151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 --2- 172.21.15.133:0/3891417457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26ec13a830 0x7f26ec153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 >> 172.21.15.133:0/3891417457 conn(0x7f26ec0c7dc0 msgr2=0x7f26ec139900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 shutdown_connections 2024-01-21T20:15:32.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.449+0000 7f26f3cf6700 1 -- 172.21.15.133:0/3891417457 wait complete. 2024-01-21T20:15:32.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:15:32.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.578+0000 7fcc05610700 1 Processor -- start 2024-01-21T20:15:32.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.578+0000 7fcc05610700 1 -- start start 2024-01-21T20:15:32.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcc05610700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc000c3840 0x7fcc000c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcc05610700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc000c6250 0x7fcc000bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcc05610700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc00067f10 con 0x7fcc000c5dc0 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcc05610700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000681f0 con 0x7fcc000c6250 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcc05610700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000684d0 con 0x7fcc000c3840 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcbff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc000c6250 0x7fcc000bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcbff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc000c6250 0x7fcc000bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33500/0 (socket says 172.21.15.133:33500) 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcbff7fe700 1 -- 172.21.15.133:0/4254943530 learned_addr learned my addr 172.21.15.133:0/4254943530 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.579+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/4254943530 >> v2:172.21.15.178:3300/0 conn(0x7fcc000c3840 0x7fcc000c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbff7fe700 1 -- 172.21.15.133:0/4254943530 >> v2:172.21.15.178:3300/0 conn(0x7fcc000c3840 msgr2=0x7fcc000c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/4254943530 >> v2:172.21.15.178:3300/0 conn(0x7fcc000c3840 0x7fcc000c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbff7fe700 1 -- 172.21.15.133:0/4254943530 >> v1:172.21.15.178:6789/0 conn(0x7fcc000c5dc0 legacy=0x7fcc0013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbff7fe700 1 -- 172.21.15.133:0/4254943530 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000687b0 con 0x7fcc000c6250 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/4254943530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc000bdf60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fcc00065f10 tx=0x7fcbf8009840).ready entity=mon.0 client_cookie=5252809503a6c51c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbfdffb700 1 -- 172.21.15.133:0/4254943530 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800e070 con 0x7fcc000c6250 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbfdffb700 1 -- 172.21.15.133:0/4254943530 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800ba20 con 0x7fcc000c6250 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcbfdffb700 1 -- 172.21.15.133:0/4254943530 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800bda0 con 0x7fcc000c6250 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 -- 172.21.15.133:0/4254943530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 msgr2=0x7fcc000bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 --2- 172.21.15.133:0/4254943530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc000bdf60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fcc00065f10 tx=0x7fcbf8009840).stop 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 -- 172.21.15.133:0/4254943530 shutdown_connections 2024-01-21T20:15:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 --2- 172.21.15.133:0/4254943530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc000bdf60 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 --2- 172.21.15.133:0/4254943530 >> v2:172.21.15.178:3300/0 conn(0x7fcc000c3840 0x7fcc000c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.580+0000 7fcc05610700 1 -- 172.21.15.133:0/4254943530 >> 172.21.15.133:0/4254943530 conn(0x7fcc00066a70 msgr2=0x7fcc00066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.581+0000 7fcc05610700 1 -- 172.21.15.133:0/4254943530 shutdown_connections 2024-01-21T20:15:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.581+0000 7fcc05610700 1 -- 172.21.15.133:0/4254943530 wait complete. 2024-01-21T20:15:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.582+0000 7fcc05610700 1 Processor -- start 2024-01-21T20:15:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.582+0000 7fcc05610700 1 -- start start 2024-01-21T20:15:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc000c3840 0x7fcc0013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000c5dc0 0x7fcc000ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0013b210 con 0x7fcc000c6250 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0013b4f0 con 0x7fcc000c5dc0 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0013b7d0 con 0x7fcc000c3840 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33508/0 (socket says 172.21.15.133:33508) 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1327326947 learned_addr learned my addr 172.21.15.133:0/1327326947 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc000c3840 0x7fcc0013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc000c3840 msgr2=0x7fcc0013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc000c3840 0x7fcc0013d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000c5dc0 msgr2=0x7fcc000ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000c5dc0 0x7fcc000ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1327326947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009ae0 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fcbf800b6c0 tx=0x7fcbf8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8007080 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf80092e0 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0013bab0 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf801d670 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.583+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc001685a0 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.584+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0005fdf0 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.585+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 38) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcbf8003040 con 0x7fcc000c6250 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.585+0000 7fcbf77fe700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 0x7fcbe0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.585+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fcbf807bd60 con 0x7fcc000c6250 2024-01-21T20:15:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.585+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 0x7fcbe0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.586+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 0x7fcbe0061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcbf0009270 tx=0x7fcbf0008040).ready entity=mgr.6963 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.589+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbf804ce90 con 0x7fcc000c6250 2024-01-21T20:15:32.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:32.797+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fcc00068a90 con 0x7fcc000c6250 2024-01-21T20:15:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.084+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 39) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fcbf80798e0 con 0x7fcc000c6250 2024-01-21T20:15:33.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.086+0000 7fcbf77fe700 1 -- 172.21.15.133:0/1327326947 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fcbf8048410 con 0x7fcc000c6250 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 msgr2=0x7fcbe0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 0x7fcbe0061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcbf0009270 tx=0x7fcbf0008040).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 msgr2=0x7fcc00136f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fcbf800b6c0 tx=0x7fcbf8009840).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 shutdown_connections 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbe005f150 0x7fcbe0061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc000c6250 0x7fcc00136f50 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc000c3840 0x7fcc0013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 --2- 172.21.15.133:0/1327326947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000c5dc0 0x7fcc000ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 >> 172.21.15.133:0/1327326947 conn(0x7fcc00066a70 msgr2=0x7fcc001540c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:33.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 shutdown_connections 2024-01-21T20:15:33.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.088+0000 7fcc05610700 1 -- 172.21.15.133:0/1327326947 wait complete. 2024-01-21T20:15:33.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:15:33.215 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:33.226+0000 7f5e695e7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:15:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.228+0000 7f7435924700 1 Processor -- start 2024-01-21T20:15:33.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.228+0000 7f7435924700 1 -- start start 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.229+0000 7f7435924700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74300c8120 0x7f7430158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f7435924700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7430154520 0x7f74300ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f7435924700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300ab620 con 0x7f7430154140 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f7435924700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300c6ae0 con 0x7f7430154520 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f7435924700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c05e0 con 0x7f74300c8120 2024-01-21T20:15:33.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7430154520 0x7f74300ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7430154520 0x7f74300ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33550/0 (socket says 172.21.15.133:33550) 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 -- 172.21.15.133:0/3227851775 learned_addr learned my addr 172.21.15.133:0/3227851775 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742e7fc700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74300c8120 0x7f7430158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 -- 172.21.15.133:0/3227851775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74300c8120 msgr2=0x7f7430158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74300c8120 0x7f7430158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 -- 172.21.15.133:0/3227851775 >> v1:172.21.15.178:6789/0 conn(0x7f7430154140 legacy=0x7f74300c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 -- 172.21.15.133:0/3227851775 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300c0e40 con 0x7f7430154520 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742f7fe700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300ab130 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7428009f20 tx=0x7f7428009840).ready entity=mon.0 client_cookie=d4f753d51f67a582 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742dffb700 1 -- 172.21.15.133:0/3227851775 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800e070 con 0x7f7430154520 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742dffb700 1 -- 172.21.15.133:0/3227851775 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742800b9d0 con 0x7f7430154520 2024-01-21T20:15:33.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.230+0000 7f742dffb700 1 -- 172.21.15.133:0/3227851775 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800bd50 con 0x7f7430154520 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 -- 172.21.15.133:0/3227851775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 msgr2=0x7f74300ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300ab130 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7428009f20 tx=0x7f7428009840).stop 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 -- 172.21.15.133:0/3227851775 shutdown_connections 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300ab130 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 --2- 172.21.15.133:0/3227851775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74300c8120 0x7f7430158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 -- 172.21.15.133:0/3227851775 >> 172.21.15.133:0/3227851775 conn(0x7f743005e1e0 msgr2=0x7f743005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 -- 172.21.15.133:0/3227851775 shutdown_connections 2024-01-21T20:15:33.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.231+0000 7f7435924700 1 -- 172.21.15.133:0/3227851775 wait complete. 2024-01-21T20:15:33.224 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:33.232+0000 7fdc9840b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.233+0000 7f7435924700 1 Processor -- start 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.233+0000 7f7435924700 1 -- start start 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74300c8120 0x7f743014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7430154140 0x7f743014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300b01d0 con 0x7f7430154520 2024-01-21T20:15:33.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300af8e0 con 0x7f74300c8120 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743014d1f0 con 0x7f7430154140 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33554/0 (socket says 172.21.15.133:33554) 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 -- 172.21.15.133:0/2485599901 learned_addr learned my addr 172.21.15.133:0/2485599901 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742effd700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74300c8120 0x7f743014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742e7fc700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7430154140 0x7f743014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7430154140 msgr2=0x7f743014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7430154140 0x7f743014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74300c8120 msgr2=0x7f743014cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74300c8120 0x7f743014cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 -- 172.21.15.133:0/2485599901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009ae0 con 0x7f7430154520 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f742f7fe700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f743006afd0 tx=0x7f74300c8580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74280092e0 con 0x7f7430154520 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7428013e30 con 0x7f7430154520 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f7435924700 1 -- 172.21.15.133:0/2485599901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74301654f0 con 0x7f7430154520 2024-01-21T20:15:33.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.235+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428007860 con 0x7f7430154520 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.236+0000 7f7435924700 1 -- 172.21.15.133:0/2485599901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74300afe60 con 0x7f7430154520 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 39) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f7428003040 con 0x7f7430154520 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7408005120 con 0x7f7430154520 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f74177fe700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 0x7f741c061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f742effd700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 msgr2=0x7f741c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f742807bf30 con 0x7f7430154520 2024-01-21T20:15:33.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.237+0000 7f742effd700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 0x7f741c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:33.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.242+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f742804d060 con 0x7f7430154520 2024-01-21T20:15:33.280 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:33.291+0000 7f5e695e7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:15:33.308 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:33.317+0000 7fdc9840b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:15:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.438+0000 7f742effd700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 msgr2=0x7f741c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:33.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.438+0000 7f742effd700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 0x7f741c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:33.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.439+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f74080057f0 con 0x7f7430154520 2024-01-21T20:15:33.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.442+0000 7f74177fe700 1 -- 172.21.15.133:0/2485599901 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v19)=0 v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7428024030 con 0x7f7430154520 2024-01-21T20:15:33.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 msgr2=0x7f741c061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:33.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 0x7f741c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:33.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 msgr2=0x7f74300acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f743006afd0 tx=0x7f74300c8580).stop 2024-01-21T20:15:33.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 shutdown_connections 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f741c05f1a0 0x7f741c061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7430154520 0x7f74300acb20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74300c8120 0x7f743014cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 --2- 172.21.15.133:0/2485599901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7430154140 0x7f743014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.444+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 >> 172.21.15.133:0/2485599901 conn(0x7f743005e1e0 msgr2=0x7f743014da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.445+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 shutdown_connections 2024-01-21T20:15:33.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.445+0000 7f74157fa700 1 -- 172.21.15.133:0/2485599901 wait complete. 2024-01-21T20:15:33.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2024-01-21T20:15:33.553 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:33.564+0000 7f5e695e7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:15:33.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.580+0000 7efea0f78700 1 Processor -- start 2024-01-21T20:15:33.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.581+0000 7efea0f78700 1 -- start start 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efea0f78700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c13b7c0 0x7efe9c13bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efea0f78700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe9c067080 0x7efe9c0bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efea0f78700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c156780 con 0x7efe9c0c35a0 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efea0f78700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c155e50 con 0x7efe9c067080 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efea0f78700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c156130 con 0x7efe9c13b7c0 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe9c067080 0x7efe9c0bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe9c067080 0x7efe9c0bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33560/0 (socket says 172.21.15.133:33560) 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 -- 172.21.15.133:0/641073863 learned_addr learned my addr 172.21.15.133:0/641073863 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe99d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efe9c0c35a0 0x7efe9c066970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58090/0 (socket says 172.21.15.133:58090) 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9a59c700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c13b7c0 0x7efe9c13bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 -- 172.21.15.133:0/641073863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c13b7c0 msgr2=0x7efe9c13bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:33.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c13b7c0 0x7efe9c13bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 -- 172.21.15.133:0/641073863 >> v1:172.21.15.133:6789/0 conn(0x7efe9c0c35a0 legacy=0x7efe9c066970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 -- 172.21.15.133:0/641073863 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c156410 con 0x7efe9c067080 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9ad9d700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c0bde60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7efe94009f20 tx=0x7efe94009840).ready entity=mon.0 client_cookie=be40c120a18e86e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9959a700 1 -- 172.21.15.133:0/641073863 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400e070 con 0x7efe9c067080 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9959a700 1 -- 172.21.15.133:0/641073863 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9400b9d0 con 0x7efe9c067080 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.582+0000 7efe9959a700 1 -- 172.21.15.133:0/641073863 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9400bd50 con 0x7efe9c067080 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 -- 172.21.15.133:0/641073863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 msgr2=0x7efe9c0bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c0bde60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7efe94009f20 tx=0x7efe94009840).stop 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 -- 172.21.15.133:0/641073863 shutdown_connections 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c0bde60 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 --2- 172.21.15.133:0/641073863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c13b7c0 0x7efe9c13bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 -- 172.21.15.133:0/641073863 >> 172.21.15.133:0/641073863 conn(0x7efe9c0c8f00 msgr2=0x7efe9c0c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 -- 172.21.15.133:0/641073863 shutdown_connections 2024-01-21T20:15:33.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.583+0000 7efea0f78700 1 -- 172.21.15.133:0/641073863 wait complete. 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.584+0000 7efea0f78700 1 Processor -- start 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 -- start start 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c0c35a0 0x7efe9c0a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 0x7efe9c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0c2460 con 0x7efe9c067080 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0a1990 con 0x7efe9c13b7c0 2024-01-21T20:15:33.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efea0f78700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0a1c70 con 0x7efe9c0c35a0 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efe9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efe9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33568/0 (socket says 172.21.15.133:33568) 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.585+0000 7efe9a59c700 1 -- 172.21.15.133:0/578312321 learned_addr learned my addr 172.21.15.133:0/578312321 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c0c35a0 0x7efe9c0a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9ad9d700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 0x7efe9c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c0c35a0 msgr2=0x7efe9c0a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c0c35a0 0x7efe9c0a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 msgr2=0x7efe9c0a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 0x7efe9c0a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94009ae0 con 0x7efe9c067080 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9ad9d700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 0x7efe9c0a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe9a59c700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7efe8c00e900 tx=0x7efe8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c012600 con 0x7efe9c067080 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c012760 con 0x7efe9c067080 2024-01-21T20:15:33.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c0a1f50 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c012ae0 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.586+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c0a2510 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.587+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c0a26d0 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.587+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 39) v1 ==== 75463+0+0 (secure 0 0 0) 0x7efe8c01b400 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.588+0000 7efe8affd700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.588+0000 7efe99d9b700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.588+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6705+0+0 (secure 0 0 0) 0x7efe8c07a830 con 0x7efe9c067080 2024-01-21T20:15:33.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.588+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:15:33.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.596+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe8c04b850 con 0x7efe9c067080 2024-01-21T20:15:33.599 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:33.608+0000 7fdc9840b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:15:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.789+0000 7efe99d9b700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:33.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.789+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:15:33.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:33.794+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efe9c0c3380 con 0x7efe7c05f1a0 2024-01-21T20:15:34.169 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:34.179+0000 7f5e695e7680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:34.190+0000 7efe99d9b700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:34.190+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:15:34.221 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:34.231+0000 7fdc9840b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:15:34.240 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:34.251+0000 7f5e695e7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:34.293 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:34.302+0000 7fdc9840b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:15:34.426 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:34.437+0000 7f5e695e7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:34.479 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:34.489+0000 7fdc9840b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:15:34.846 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:34.856+0000 7f5e695e7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:34.901 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:34.911+0000 7fdc9840b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:15:34.948 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:34.959+0000 7f5e695e7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:34.991+0000 7efe99d9b700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:34.991+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:15:35.004 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.014+0000 7fdc9840b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:35.100 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:35.110+0000 7f5e695e7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:35.157 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.167+0000 7fdc9840b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:35.174 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:35.185+0000 7f5e695e7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:35.231 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.241+0000 7fdc9840b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:15:35.241 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:35.252+0000 7f5e695e7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:35.299 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.309+0000 7fdc9840b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:15:35.498 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:35.508+0000 7f5e695e7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:35.554 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.564+0000 7fdc9840b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:15:35.679 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:35.690+0000 7f5e695e7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:35.741 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:35.750+0000 7fdc9840b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:15:36.327 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.337+0000 7f5e695e7680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:36.391 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.400+0000 7fdc9840b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:15:36.395 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.405+0000 7f5e695e7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:36.460 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.469+0000 7fdc9840b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:15:36.469 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.480+0000 7f5e695e7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:36.535 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.545+0000 7fdc9840b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:15:36.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:36.592+0000 7efe99d9b700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:15:36.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:36.592+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:15:36.615 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.626+0000 7f5e695e7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:36.683 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.693+0000 7fdc9840b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:15:36.685 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.695+0000 7f5e695e7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:36.754 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.764+0000 7fdc9840b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:15:36.799 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.809+0000 7f5e695e7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:36.870 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.880+0000 7fdc9840b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:15:36.905 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:36.916+0000 7f5e695e7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:36.978 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:36.988+0000 7fdc9840b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:15:37.194 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:37.205+0000 7f5e695e7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:37.265 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:15:37.275+0000 7f5e695e7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:37.289 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.298+0000 7fdc9840b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:15:37.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:37.344+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 40) v1 ==== 75463+0+0 (secure 0 0 0) 0x7efe8c0783b0 con 0x7efe9c067080 2024-01-21T20:15:37.362 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.371+0000 7fdc9840b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:15:37.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:37.391+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 41) v1 ==== 75287+0+0 (secure 0 0 0) 0x7efe8c078730 con 0x7efe9c067080 2024-01-21T20:15:37.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:37.392+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:15:37.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:37.392+0000 7efe8affd700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:15:37.447 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0c1ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.447 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0c1ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.447 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0c1ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.447 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0c1ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.447 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0c1ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.448 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0f1b1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.448 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0f1b1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.448 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0f1b1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.448 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0f1b1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:37.448 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:15:37.457+0000 7fdc0f1b1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:15:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.396+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mon.0 v2:172.21.15.133:3300/0 9 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7efe8c047c70 con 0x7efe9c067080 2024-01-21T20:15:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.396+0000 7efe8affd700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.396+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efe9c0c3380 con 0x7efe7c05f1a0 2024-01-21T20:15:38.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.398+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.412+0000 7efe99d9b700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c0615e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7efe9c13c060 tx=0x7efe90007cf0).ready entity=mgr.6649 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:38.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.417+0000 7efe8affd700 1 -- 172.21.15.133:0/578312321 <== mgr.6649 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7efe9c0c3380 con 0x7efe7c05f1a0 2024-01-21T20:15:38.407 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /bad-path 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 msgr2=0x7efe7c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c0615e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7efe9c13c060 tx=0x7efe90007cf0).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 msgr2=0x7efe9c165400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7efe8c00e900 tx=0x7efe8c009060).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 shutdown_connections 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe7c05f1a0 0x7efe7c0615e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe9c13b7c0 0x7efe9c0a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe9c067080 0x7efe9c165400 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 --2- 172.21.15.133:0/578312321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe9c0c35a0 0x7efe9c0a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 >> 172.21.15.133:0/578312321 conn(0x7efe9c0c8f00 msgr2=0x7efe9c0c94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 shutdown_connections 2024-01-21T20:15:38.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.419+0000 7efea0f78700 1 -- 172.21.15.133:0/578312321 wait complete. 2024-01-21T20:15:38.423 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2024-01-21T20:15:38.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2024-01-21T20:15:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.553+0000 7f1407a05700 1 Processor -- start 2024-01-21T20:15:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.553+0000 7f1407a05700 1 -- start start 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.554+0000 7f1407a05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.554+0000 7f1407a05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14000652b0 0x7f1400151510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.554+0000 7f1407a05700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14000c32e0 con 0x7f14000bdf20 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.554+0000 7f1407a05700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1400152500 con 0x7f14000652b0 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.554+0000 7f1407a05700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000c2ff0 con 0x7f1400069cd0 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14000652b0 0x7f1400151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1404fa0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f14057a1700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f14000bdf20 0x7f14000695c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:58340/0 (socket says 172.21.15.133:58340) 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1404fa0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:40086/0 (socket says 172.21.15.133:40086) 2024-01-21T20:15:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14000652b0 0x7f1400151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57970/0 (socket says 172.21.15.133:57970) 2024-01-21T20:15:38.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f14057a1700 1 -- 172.21.15.133:0/1691689181 learned_addr learned my addr 172.21.15.133:0/1691689181 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 -- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 msgr2=0x7f14000bcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 -- 172.21.15.133:0/1691689181 >> v1:172.21.15.178:6789/0 conn(0x7f14000bdf20 legacy=0x7f14000695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f13f7fff700 1 -- 172.21.15.133:0/1691689181 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107660673 0 0) 0x7f14000c32e0 con 0x7f14000bdf20 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 -- 172.21.15.133:0/1691689181 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400151a00 con 0x7f14000652b0 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1404fa0700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f1405fa2700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f1400151510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f13f8009e60 tx=0x7f13f8009780).ready entity=mon.1 client_cookie=dd1d8f568ae825cd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f13f7fff700 1 -- 172.21.15.133:0/1691689181 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800e070 con 0x7f14000652b0 2024-01-21T20:15:38.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f13f7fff700 1 -- 172.21.15.133:0/1691689181 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f800bb60 con 0x7f14000652b0 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.555+0000 7f13f7fff700 1 -- 172.21.15.133:0/1691689181 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8012410 con 0x7f14000652b0 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 -- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 msgr2=0x7f1400151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f1400151510 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f13f8009e60 tx=0x7f13f8009780).stop 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 -- 172.21.15.133:0/1691689181 shutdown_connections 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f1400151510 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 --2- 172.21.15.133:0/1691689181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1400069cd0 0x7f14000bcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 -- 172.21.15.133:0/1691689181 >> 172.21.15.133:0/1691689181 conn(0x7f14000c7d20 msgr2=0x7f14000c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 -- 172.21.15.133:0/1691689181 shutdown_connections 2024-01-21T20:15:38.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.556+0000 7f1407a05700 1 -- 172.21.15.133:0/1691689181 wait complete. 2024-01-21T20:15:38.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.557+0000 7f1407a05700 1 Processor -- start 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.557+0000 7f1407a05700 1 -- start start 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f14001611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14000bdf20 0x7f1400161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a87a0 con 0x7f1400069cd0 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a89f0 con 0x7f14000652b0 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1407a05700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000a8cd0 con 0x7f14000bdf20 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33662/0 (socket says 172.21.15.133:33662) 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 -- 172.21.15.133:0/803415790 learned_addr learned my addr 172.21.15.133:0/803415790 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1405fa2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14000bdf20 0x7f1400161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f14057a1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f14001611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 -- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14000bdf20 msgr2=0x7f1400161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14000bdf20 0x7f1400161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 -- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 msgr2=0x7f14001611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f14001611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 -- 172.21.15.133:0/803415790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0092a0 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.558+0000 7f1404fa0700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f13fc00ea50 tx=0x7f13fc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.559+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0095a0 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.559+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00c640 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.559+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f8009a20 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.559+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00c9c0 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.559+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14000a9290 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.560+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 42) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f13fc01b400 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.560+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14000a9600 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.560+0000 7f13f5ffb700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 0x7f13e4061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.560+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f13fc07a7f0 con 0x7f1400069cd0 2024-01-21T20:15:38.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.560+0000 7f14057a1700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 0x7f13e4061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:15:38.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.561+0000 7f14057a1700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 0x7f13e4061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f13f0007fd0 tx=0x7f13f0007dd0).ready entity=mgr.6649 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:15:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.565+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13fc04f310 con 0x7f1400069cd0 2024-01-21T20:15:38.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.753+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1400151c60 con 0x7f13e405f080 2024-01-21T20:15:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.755+0000 7f13f5ffb700 1 -- 172.21.15.133:0/803415790 <== mgr.6649 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f1400151c60 con 0x7f13e405f080 2024-01-21T20:15:38.746 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:15:38.746 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:15:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 msgr2=0x7f13e4061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 0x7f13e4061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f13f0007fd0 tx=0x7f13f0007dd0).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 msgr2=0x7f1400139040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f13fc00ea50 tx=0x7f13fc009060).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 shutdown_connections 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f13e405f080 0x7f13e4061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14000bdf20 0x7f1400161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14000652b0 0x7f14001611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 --2- 172.21.15.133:0/803415790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1400069cd0 0x7f1400139040 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 >> 172.21.15.133:0/803415790 conn(0x7f14000c7d20 msgr2=0x7f1400066620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:15:38.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 shutdown_connections 2024-01-21T20:15:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:15:38.757+0000 7f1407a05700 1 -- 172.21.15.133:0/803415790 wait complete. 2024-01-21T20:15:38.760 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:15:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2024-01-21T20:15:47.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:15:47.751 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:16:00.413 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:00.423+0000 7fdbfe990700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:00.413 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:00.423+0000 7fdbfe990700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:00.413 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:00.423+0000 7fdbfe990700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:00.413 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:00.423+0000 7fdbfe990700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:00.413 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:00.423+0000 7fdbfe990700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:17.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:16:17.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:16:38.761 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2024-01-21T20:16:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.905+0000 7fcb9d5d3700 1 Processor -- start 2024-01-21T20:16:38.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.905+0000 7fcb9d5d3700 1 -- start start 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb9d5d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb980c6040 0x7fcb980ab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb9d5d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb980bf090 0x7fcb980ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb9d5d3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb98068b90 con 0x7fcb98151f50 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb9d5d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb98067d70 con 0x7fcb980bf090 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb9d5d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980abae0 con 0x7fcb980c6040 2024-01-21T20:16:38.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb980bf090 0x7fcb980ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb980bf090 0x7fcb980ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52688/0 (socket says 172.21.15.133:52688) 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.906+0000 7fcb977fe700 1 -- 172.21.15.133:0/2659625361 learned_addr learned my addr 172.21.15.133:0/2659625361 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb967fc700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb980c6040 0x7fcb980ab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb977fe700 1 -- 172.21.15.133:0/2659625361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb980c6040 msgr2=0x7fcb980ab100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb977fe700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb980c6040 0x7fcb980ab100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb977fe700 1 -- 172.21.15.133:0/2659625361 >> v1:172.21.15.178:6789/0 conn(0x7fcb98151f50 legacy=0x7fcb980c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb977fe700 1 -- 172.21.15.133:0/2659625361 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb98067f80 con 0x7fcb980bf090 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb977fe700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980bf090 0x7fcb980ab5f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7fcb90009f20 tx=0x7fcb90009840).ready entity=mon.0 client_cookie=7338dd20e7998cf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb95ffb700 1 -- 172.21.15.133:0/2659625361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000e070 con 0x7fcb980bf090 2024-01-21T20:16:38.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb95ffb700 1 -- 172.21.15.133:0/2659625361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9000ba40 con 0x7fcb980bf090 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb95ffb700 1 -- 172.21.15.133:0/2659625361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9000bdc0 con 0x7fcb980bf090 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.907+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2659625361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980bf090 msgr2=0x7fcb980ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980bf090 0x7fcb980ab5f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7fcb90009f20 tx=0x7fcb90009840).stop 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2659625361 shutdown_connections 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980bf090 0x7fcb980ab5f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2659625361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb980c6040 0x7fcb980ab100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2659625361 >> 172.21.15.133:0/2659625361 conn(0x7fcb98066a70 msgr2=0x7fcb98066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2659625361 shutdown_connections 2024-01-21T20:16:38.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.908+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2659625361 wait complete. 2024-01-21T20:16:38.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.909+0000 7fcb9d5d3700 1 Processor -- start 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.909+0000 7fcb9d5d3700 1 -- start start 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 0x7fcb98161ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 0x7fcb980c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980a1440 con 0x7fcb980c6040 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980a0830 con 0x7fcb980bf090 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb9d5d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb980a0b10 con 0x7fcb98151f50 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52694/0 (socket says 172.21.15.133:52694) 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 -- 172.21.15.133:0/2706759994 learned_addr learned my addr 172.21.15.133:0/2706759994 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb977fe700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 0x7fcb980c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb96ffd700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 0x7fcb98161ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 -- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 msgr2=0x7fcb980c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 0x7fcb980c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 -- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 msgr2=0x7fcb98161ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 0x7fcb98161ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 -- 172.21.15.133:0/2706759994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009ae0 con 0x7fcb980c6040 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb96ffd700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 0x7fcb98161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb977fe700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 0x7fcb980c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:38.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb967fc700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fcb8800d890 tx=0x7fcb88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.910+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880125f0 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.911+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88012750 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.911+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb980a0df0 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.911+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88012ad0 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.911+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980a04c0 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.912+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb980a15b0 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.912+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7fcb88013480 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.912+0000 7fcb7f7fe700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 0x7fcb840618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.912+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fcb8807a790 con 0x7fcb980c6040 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.912+0000 7fcb96ffd700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 0x7fcb840618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:38.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.913+0000 7fcb96ffd700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 0x7fcb840618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcb8c00b8b0 tx=0x7fcb8c008040).ready entity=mgr.6649 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:38.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:38.917+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb8804b360 con 0x7fcb980c6040 2024-01-21T20:16:39.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.102+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb9805fdf0 con 0x7fcb8405f3e0 2024-01-21T20:16:39.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.103+0000 7fcb7f7fe700 1 -- 172.21.15.133:0/2706759994 <== mgr.6649 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fcb9805fdf0 con 0x7fcb8405f3e0 2024-01-21T20:16:39.093 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:39.093 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:15:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2024-01-21T20:16:39.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 msgr2=0x7fcb840618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 0x7fcb840618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fcb8c00b8b0 tx=0x7fcb8c008040).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 msgr2=0x7fcb981647b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fcb8800d890 tx=0x7fcb88008040).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 shutdown_connections 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcb8405f3e0 0x7fcb840618a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb98151f50 0x7fcb980c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb980bf090 0x7fcb98161ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 --2- 172.21.15.133:0/2706759994 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb980c6040 0x7fcb981647b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 >> 172.21.15.133:0/2706759994 conn(0x7fcb98066a70 msgr2=0x7fcb980c9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.105+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 shutdown_connections 2024-01-21T20:16:39.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.106+0000 7fcb9d5d3700 1 -- 172.21.15.133:0/2706759994 wait complete. 2024-01-21T20:16:39.107 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:15:38", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2024-01-21T20:16:39.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2024-01-21T20:16:39.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.242+0000 7f1afb87d700 1 Processor -- start 2024-01-21T20:16:39.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.242+0000 7f1afb87d700 1 -- start start 2024-01-21T20:16:39.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1afb87d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1af414edc0 0x7f1af40694f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1afb87d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1afb87d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af40c4210 con 0x7f1af414e9e0 2024-01-21T20:16:39.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1afb87d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af4069ed0 con 0x7f1af414edc0 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1afb87d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40c3600 con 0x7f1af40c3140 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af9e1a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af8e18700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1af414edc0 0x7f1af40694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af9e1a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:39954/0 (socket says 172.21.15.133:39954) 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af9e1a700 1 -- 172.21.15.133:0/1947982915 learned_addr learned my addr 172.21.15.133:0/1947982915 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af9619700 1 --1- 172.21.15.133:0/1947982915 >> v1:172.21.15.178:6789/0 conn(0x7f1af414e9e0 0x7f1af4151f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:56684/0 (socket says 172.21.15.133:56684) 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af8e18700 1 -- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 msgr2=0x7f1af40699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af8e18700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af8e18700 1 -- 172.21.15.133:0/1947982915 >> v1:172.21.15.178:6789/0 conn(0x7f1af414e9e0 legacy=0x7f1af4151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af8e18700 1 -- 172.21.15.133:0/1947982915 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40c38e0 con 0x7f1af414edc0 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.243+0000 7f1af9e1a700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1af8e18700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af414edc0 0x7f1af40694f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f1ae400ba00 tx=0x7f1ae400b300).ready entity=mon.1 client_cookie=5407b000b94ac015 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1aebfff700 1 -- 172.21.15.133:0/1947982915 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400da70 con 0x7f1af414edc0 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1aebfff700 1 -- 172.21.15.133:0/1947982915 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400dbd0 con 0x7f1af414edc0 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1aebfff700 1 -- 172.21.15.133:0/1947982915 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4010470 con 0x7f1af414edc0 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 -- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af414edc0 msgr2=0x7f1af40694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af414edc0 0x7f1af40694f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f1ae400ba00 tx=0x7f1ae400b300).stop 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 -- 172.21.15.133:0/1947982915 shutdown_connections 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af40c3140 0x7f1af40699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 --2- 172.21.15.133:0/1947982915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af414edc0 0x7f1af40694f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 -- 172.21.15.133:0/1947982915 >> 172.21.15.133:0/1947982915 conn(0x7f1af40642d0 msgr2=0x7f1af40c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 -- 172.21.15.133:0/1947982915 shutdown_connections 2024-01-21T20:16:39.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.244+0000 7f1afb87d700 1 -- 172.21.15.133:0/1947982915 wait complete. 2024-01-21T20:16:39.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.245+0000 7f1afb87d700 1 Processor -- start 2024-01-21T20:16:39.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.245+0000 7f1afb87d700 1 -- start start 2024-01-21T20:16:39.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 0x7f1af40626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af414e9e0 0x7f1af4062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40630d0 con 0x7f1af414edc0 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40adbf0 con 0x7f1af40c3140 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1afb87d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af40acfe0 con 0x7f1af414e9e0 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1af9e1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1af9e1a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52698/0 (socket says 172.21.15.133:52698) 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.246+0000 7f1af9e1a700 1 -- 172.21.15.133:0/3452690675 learned_addr learned my addr 172.21.15.133:0/3452690675 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af8e18700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af414e9e0 0x7f1af4062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9619700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 0x7f1af40626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 -- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af414e9e0 msgr2=0x7f1af4062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af414e9e0 0x7f1af4062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 -- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 msgr2=0x7f1af40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 0x7f1af40626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 -- 172.21.15.133:0/3452690675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec009ae0 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9619700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 0x7f1af40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1af9e1a700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f1aec009fb0 tx=0x7f1aec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00cb20 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aec00f040 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aec00ce90 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae400b540 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.247+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af40ad5a0 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.248+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af405fdf0 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.248+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f1aec014670 con 0x7f1af414edc0 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.249+0000 7f1ae9ffb700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 0x7f1ad80618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.249+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f1aec07ab80 con 0x7f1af414edc0 2024-01-21T20:16:39.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.249+0000 7f1af9619700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 0x7f1ad80618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.249+0000 7f1af9619700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 0x7f1ad80618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1af40aa7c0 tx=0x7f1af0009040).ready entity=mgr.6649 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.253+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1aec04ab00 con 0x7f1af414edc0 2024-01-21T20:16:39.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.439+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f1af406ade0 con 0x7f1ad805f3e0 2024-01-21T20:16:39.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.443+0000 7f1ae9ffb700 1 -- 172.21.15.133:0/3452690675 <== mgr.6649 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f1af406ade0 con 0x7f1ad805f3e0 2024-01-21T20:16:39.433 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /bad-path 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.445+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 msgr2=0x7f1ad80618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 0x7f1ad80618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1af40aa7c0 tx=0x7f1af0009040).stop 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 msgr2=0x7f1af40a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f1aec009fb0 tx=0x7f1aec00b040).stop 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 shutdown_connections 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1ad805f3e0 0x7f1ad80618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1af414edc0 0x7f1af40a9820 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1af40c3140 0x7f1af40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 --2- 172.21.15.133:0/3452690675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1af414e9e0 0x7f1af4062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 >> 172.21.15.133:0/3452690675 conn(0x7f1af40642d0 msgr2=0x7f1af41542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 shutdown_connections 2024-01-21T20:16:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.446+0000 7f1afb87d700 1 -- 172.21.15.133:0/3452690675 wait complete. 2024-01-21T20:16:39.447 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2024-01-21T20:16:39.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:16:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.575+0000 7f0357d89700 1 Processor -- start 2024-01-21T20:16:39.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 -- start start 2024-01-21T20:16:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f035013ac10 0x7f03500c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03500695b0 0x7f0350069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0350069ef0 con 0x7f035013a830 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500c3890 con 0x7f035013ac10 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.576+0000 7f0357d89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500c3b70 con 0x7f03500695b0 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f035013ac10 0x7f03500c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f035013ac10 0x7f03500c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52710/0 (socket says 172.21.15.133:52710) 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 -- 172.21.15.133:0/827671240 learned_addr learned my addr 172.21.15.133:0/827671240 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0356326700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03500695b0 0x7f0350069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 -- 172.21.15.133:0/827671240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03500695b0 msgr2=0x7f0350069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03500695b0 0x7f0350069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 -- 172.21.15.133:0/827671240 >> v1:172.21.15.178:6789/0 conn(0x7f035013a830 legacy=0x7f03500bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 -- 172.21.15.133:0/827671240 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500c3e50 con 0x7f035013ac10 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0355324700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013ac10 0x7f03500c3220 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f0340006fd0 tx=0x7f034000b3b0).ready entity=mon.0 client_cookie=750670af1f87dfde server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0354b23700 1 -- 172.21.15.133:0/827671240 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000db40 con 0x7f035013ac10 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0354b23700 1 -- 172.21.15.133:0/827671240 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000dca0 con 0x7f035013ac10 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.577+0000 7f0354b23700 1 -- 172.21.15.133:0/827671240 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340010680 con 0x7f035013ac10 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 -- 172.21.15.133:0/827671240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013ac10 msgr2=0x7f03500c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013ac10 0x7f03500c3220 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f0340006fd0 tx=0x7f034000b3b0).stop 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 -- 172.21.15.133:0/827671240 shutdown_connections 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03500695b0 0x7f0350069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 --2- 172.21.15.133:0/827671240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013ac10 0x7f03500c3220 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 -- 172.21.15.133:0/827671240 >> 172.21.15.133:0/827671240 conn(0x7f03500c7dc0 msgr2=0x7f03500c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:39.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 -- 172.21.15.133:0/827671240 shutdown_connections 2024-01-21T20:16:39.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.578+0000 7f0357d89700 1 -- 172.21.15.133:0/827671240 wait complete. 2024-01-21T20:16:39.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.579+0000 7f0357d89700 1 Processor -- start 2024-01-21T20:16:39.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.579+0000 7f0357d89700 1 -- start start 2024-01-21T20:16:39.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03500695b0 0x7f0350165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f035013ac10 0x7f0350165b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500bff70 con 0x7f035013a830 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500a7300 con 0x7f03500695b0 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0357d89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03500bf2f0 con 0x7f035013ac10 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52712/0 (socket says 172.21.15.133:52712) 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 -- 172.21.15.133:0/319746330 learned_addr learned my addr 172.21.15.133:0/319746330 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355b25700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03500695b0 0x7f0350165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0356326700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f035013ac10 0x7f0350165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 -- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f035013ac10 msgr2=0x7f0350165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f035013ac10 0x7f0350165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 -- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03500695b0 msgr2=0x7f0350165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03500695b0 0x7f0350165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 -- 172.21.15.133:0/319746330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034000b610 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.580+0000 7f0355324700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f034000b4a0 tx=0x7f034000b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.581+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034001e070 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.581+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0340006950 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.581+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03500bf5d0 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.581+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03400196a0 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.581+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03500bfb90 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03500c00b0 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 44) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f0340021070 con 0x7f035013a830 2024-01-21T20:16:39.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f03467fc700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 0x7f0334061870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:39.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f034007bed0 con 0x7f035013a830 2024-01-21T20:16:39.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f0355b25700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 0x7f0334061870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:39.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.582+0000 7f0355b25700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 0x7f0334061870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f034c000c00 tx=0x7f034c007d20).ready entity=mgr.6649 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:39.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.586+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f03500c00b0 con 0x7f035013a830 2024-01-21T20:16:39.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:39.792+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f03500c00b0 con 0x7f035013a830 2024-01-21T20:16:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.138+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f03400795b0 con 0x7f035013a830 2024-01-21T20:16:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.139+0000 7f03467fc700 1 -- 172.21.15.133:0/319746330 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v45) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0340042ab0 con 0x7f035013a830 2024-01-21T20:16:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 msgr2=0x7f0334061870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 0x7f0334061870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f034c000c00 tx=0x7f034c007d20).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 msgr2=0x7f03500aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f034000b4a0 tx=0x7f034000b3b0).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 shutdown_connections 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f033405f3b0 0x7f0334061870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f035013ac10 0x7f0350165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03500695b0 0x7f0350165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 --2- 172.21.15.133:0/319746330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035013a830 0x7f03500aaf30 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 >> 172.21.15.133:0/319746330 conn(0x7f03500c7dc0 msgr2=0x7f03500c4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 shutdown_connections 2024-01-21T20:16:40.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.142+0000 7f0357d89700 1 -- 172.21.15.133:0/319746330 wait complete. 2024-01-21T20:16:40.144 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:16:40.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:16:40.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:16:40.245 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:16:40.245 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:16:40.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:16:40.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:16:40.273 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:40.284+0000 7ff582601680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:16:40.276 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:40.287+0000 7f90fd729680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:16:40.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:16:40.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:16:40.287 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:16:40.340 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:40.351+0000 7ff582601680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:16:40.341 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:40.351+0000 7f90fd729680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:16:40.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:16:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.516+0000 7f1bea611700 1 Processor -- start 2024-01-21T20:16:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.516+0000 7f1bea611700 1 -- start start 2024-01-21T20:16:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1bea611700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1be4154140 0x7f1be4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1bea611700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1be4154520 0x7f1be40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1bea611700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be40ab620 con 0x7f1be40c6090 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1bea611700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be40c6ae0 con 0x7f1be4154520 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1bea611700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be40c05e0 con 0x7f1be4154140 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1be37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1be4154520 0x7f1be40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1be8bae700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1be40c6090 0x7f1be40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55414/0 (socket says 172.21.15.133:55414) 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1be37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1be4154520 0x7f1be40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60604/0 (socket says 172.21.15.133:60604) 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1be8bae700 1 -- 172.21.15.133:0/2466969333 learned_addr learned my addr 172.21.15.133:0/2466969333 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.517+0000 7f1be3fff700 1 --2- 172.21.15.133:0/2466969333 >> v2:172.21.15.178:3300/0 conn(0x7f1be4154140 0x7f1be4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be37fe700 1 -- 172.21.15.133:0/2466969333 >> v2:172.21.15.178:3300/0 conn(0x7f1be4154140 msgr2=0x7f1be4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be37fe700 1 --2- 172.21.15.133:0/2466969333 >> v2:172.21.15.178:3300/0 conn(0x7f1be4154140 0x7f1be4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be37fe700 1 -- 172.21.15.133:0/2466969333 >> v1:172.21.15.133:6789/0 conn(0x7f1be40c6090 legacy=0x7f1be40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be37fe700 1 -- 172.21.15.133:0/2466969333 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be40c0e40 con 0x7f1be4154520 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be2ffd700 1 -- 172.21.15.133:0/2466969333 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076444681 0 0) 0x7f1be40ab620 con 0x7f1be40c6090 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be37fe700 1 --2- 172.21.15.133:0/2466969333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be4154520 0x7f1be40ab130 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f1be4083d70 tx=0x7f1bd8009060).ready entity=mon.0 client_cookie=5a42c1bfc072a4af server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be2ffd700 1 -- 172.21.15.133:0/2466969333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800f510 con 0x7f1be4154520 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be2ffd700 1 -- 172.21.15.133:0/2466969333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800f670 con 0x7f1be4154520 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1be2ffd700 1 -- 172.21.15.133:0/2466969333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800f9f0 con 0x7f1be4154520 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1bea611700 1 -- 172.21.15.133:0/2466969333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be4154520 msgr2=0x7f1be40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1bea611700 1 --2- 172.21.15.133:0/2466969333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be4154520 0x7f1be40ab130 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f1be4083d70 tx=0x7f1bd8009060).stop 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1bea611700 1 -- 172.21.15.133:0/2466969333 shutdown_connections 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.518+0000 7f1bea611700 1 --2- 172.21.15.133:0/2466969333 >> v2:172.21.15.178:3300/0 conn(0x7f1be4154140 0x7f1be4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.519+0000 7f1bea611700 1 --2- 172.21.15.133:0/2466969333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be4154520 0x7f1be40ab130 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.519+0000 7f1bea611700 1 -- 172.21.15.133:0/2466969333 >> 172.21.15.133:0/2466969333 conn(0x7f1be405e1e0 msgr2=0x7f1be405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.519+0000 7f1bea611700 1 -- 172.21.15.133:0/2466969333 shutdown_connections 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.519+0000 7f1bea611700 1 -- 172.21.15.133:0/2466969333 wait complete. 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.520+0000 7f1bea611700 1 Processor -- start 2024-01-21T20:16:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.520+0000 7f1bea611700 1 -- start start 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be4154140 0x7f1be40ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 0x7f1be40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40acd60 con 0x7f1be40c6090 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be4148a20 con 0x7f1be4154520 2024-01-21T20:16:40.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1bea611700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be40ae070 con 0x7f1be4154140 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1be3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60610/0 (socket says 172.21.15.133:60610) 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1be3fff700 1 -- 172.21.15.133:0/2471062179 learned_addr learned my addr 172.21.15.133:0/2471062179 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1be8bae700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 0x7f1be40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.521+0000 7f1be37fe700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be4154140 0x7f1be40ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be4154140 msgr2=0x7f1be40ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be4154140 0x7f1be40ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 msgr2=0x7f1be4138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 -- 172.21.15.133:0/2471062179 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80092a0 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be3fff700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be8bae700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 0x7f1be40ac870 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1bdc002230 tx=0x7f1bdc007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc005d30 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc005e90 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be40ae350 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc007360 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.522+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be40cba20 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.523+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f1bdc007750 con 0x7f1be4154520 2024-01-21T20:16:40.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.524+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be40ae4e0 con 0x7f1be4154520 2024-01-21T20:16:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.524+0000 7f1be0ff9700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 0x7f1bd0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.524+0000 7f1be3fff700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 msgr2=0x7f1bd0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.524+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f1bdc07a970 con 0x7f1be4154520 2024-01-21T20:16:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.524+0000 7f1be3fff700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 0x7f1bd0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.528+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1bdc04b480 con 0x7f1be4154520 2024-01-21T20:16:40.614 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:40.624+0000 7f90fd729680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:16:40.630 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:40.641+0000 7ff582601680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:16:40.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.725+0000 7f1be3fff700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 msgr2=0x7f1bd0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:40.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.725+0000 7f1be3fff700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 0x7f1bd0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:40.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.742+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1be405fdf0 con 0x7f1be4154520 2024-01-21T20:16:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.742+0000 7f1be0ff9700 1 -- 172.21.15.133:0/2471062179 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f1bdc04eaa0 con 0x7f1be4154520 2024-01-21T20:16:40.732 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:40.732 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:16:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 msgr2=0x7f1bd0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 0x7f1bd0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 msgr2=0x7f1be40ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 0x7f1be40ac870 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1bdc002230 tx=0x7f1bdc007eb0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 shutdown_connections 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1bd005f390 0x7f1bd0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be4154520 0x7f1be40ac870 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be40c6090 0x7f1be4138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 --2- 172.21.15.133:0/2471062179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be4154140 0x7f1be40ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.744+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 >> 172.21.15.133:0/2471062179 conn(0x7f1be405e1e0 msgr2=0x7f1be41481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.745+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 shutdown_connections 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.745+0000 7f1bea611700 1 -- 172.21.15.133:0/2471062179 wait complete. 2024-01-21T20:16:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:16:40.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:16:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.876+0000 7f2146ab0700 1 Processor -- start 2024-01-21T20:16:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.876+0000 7f2146ab0700 1 -- start start 2024-01-21T20:16:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f2146ab0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21401558c0 0x7f21400626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f2146ab0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 0x7f2140062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f2146ab0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400a50f0 con 0x7f2140155ca0 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f2146ab0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400630d0 con 0x7f21401558c0 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f2146ab0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400a4da0 con 0x7f21400bd890 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f214484c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21401558c0 0x7f21400626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f214484c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21401558c0 0x7f21400626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60620/0 (socket says 172.21.15.133:60620) 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.877+0000 7f214484c700 1 -- 172.21.15.133:0/3916130001 learned_addr learned my addr 172.21.15.133:0/3916130001 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214504d700 1 --2- 172.21.15.133:0/3916130001 >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 0x7f2140062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214484c700 1 -- 172.21.15.133:0/3916130001 >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 msgr2=0x7f2140062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214484c700 1 --2- 172.21.15.133:0/3916130001 >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 0x7f2140062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214484c700 1 -- 172.21.15.133:0/3916130001 >> v1:172.21.15.178:6789/0 conn(0x7f2140155ca0 legacy=0x7f21400bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214484c700 1 -- 172.21.15.133:0/3916130001 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400bde00 con 0x7f21401558c0 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214504d700 1 --2- 172.21.15.133:0/3916130001 >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 0x7f2140062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f214484c700 1 --2- 172.21.15.133:0/3916130001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21401558c0 0x7f21400626f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f21400c4410 tx=0x7f21340090f0).ready entity=mon.0 client_cookie=abc111af71dea899 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f213f7fe700 1 -- 172.21.15.133:0/3916130001 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400b600 con 0x7f21401558c0 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f213f7fe700 1 -- 172.21.15.133:0/3916130001 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400b760 con 0x7f21401558c0 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.878+0000 7f213f7fe700 1 -- 172.21.15.133:0/3916130001 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400bae0 con 0x7f21401558c0 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 -- 172.21.15.133:0/3916130001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21401558c0 msgr2=0x7f21400626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 --2- 172.21.15.133:0/3916130001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21401558c0 0x7f21400626f0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f21400c4410 tx=0x7f21340090f0).stop 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 -- 172.21.15.133:0/3916130001 shutdown_connections 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 --2- 172.21.15.133:0/3916130001 >> v2:172.21.15.178:3300/0 conn(0x7f21400bd890 0x7f2140062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 --2- 172.21.15.133:0/3916130001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21401558c0 0x7f21400626f0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 -- 172.21.15.133:0/3916130001 >> 172.21.15.133:0/3916130001 conn(0x7f21400c8010 msgr2=0x7f21400c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 -- 172.21.15.133:0/3916130001 shutdown_connections 2024-01-21T20:16:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.879+0000 7f2146ab0700 1 -- 172.21.15.133:0/3916130001 wait complete. 2024-01-21T20:16:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.880+0000 7f2146ab0700 1 Processor -- start 2024-01-21T20:16:40.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.880+0000 7f2146ab0700 1 -- start start 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 0x7f214013db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 0x7f21400ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140156b50 con 0x7f2140155ca0 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140157560 con 0x7f21401558c0 2024-01-21T20:16:40.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f2146ab0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2140156fe0 con 0x7f21400bd890 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60624/0 (socket says 172.21.15.133:60624) 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214484c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 0x7f214013db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 -- 172.21.15.133:0/819015429 learned_addr learned my addr 172.21.15.133:0/819015429 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f213ffff700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 0x7f21400ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 -- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 msgr2=0x7f214013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 0x7f214013db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 -- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 msgr2=0x7f21400ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 0x7f21400ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:40.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214504d700 1 -- 172.21.15.133:0/819015429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134009370 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f214484c700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 0x7f214013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.881+0000 7f213ffff700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 0x7f21400ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f214504d700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f213800d180 tx=0x7f2138009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800dcc0 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213800f040 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21400ad3f0 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138013600 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.882+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2140156500 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.883+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2140156cc0 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.883+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f21380139f0 con 0x7f2140155ca0 2024-01-21T20:16:40.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.884+0000 7f213d775700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 0x7f2124061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:40.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.884+0000 7f214484c700 1 -- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 msgr2=0x7f2124061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:40.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.884+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f213807b0f0 con 0x7f2140155ca0 2024-01-21T20:16:40.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.884+0000 7f214484c700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 0x7f2124061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:40.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:40.888+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f213804bbb0 con 0x7f2140155ca0 2024-01-21T20:16:41.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.057+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21400ae030 con 0x7f2140155ca0 2024-01-21T20:16:41.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.058+0000 7f213d775700 1 -- 172.21.15.133:0/819015429 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18411 (secure 0 0 0) 0x7f213804f1d0 con 0x7f2140155ca0 2024-01-21T20:16:41.048 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:41.049 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":111,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:16:39.122586+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":1,"to":5}]},{"pgid":"13.20","mappings":[{"from":6,"to":3}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3913532409":"2024-01-22T20:15:37.387255+0000","172.21.15.133:0/385807244":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:37.387255+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:16:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.060+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 msgr2=0x7f2124061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.060+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 0x7f2124061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.060+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 msgr2=0x7f21400acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.060+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f213800d180 tx=0x7f2138009a50).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 shutdown_connections 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212405f390 0x7f2124061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2140155ca0 0x7f21400acd40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21400bd890 0x7f214013db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 --2- 172.21.15.133:0/819015429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21401558c0 0x7f21400ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 >> 172.21.15.133:0/819015429 conn(0x7f21400c8010 msgr2=0x7f21401534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:41.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 shutdown_connections 2024-01-21T20:16:41.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.061+0000 7f2146ab0700 1 -- 172.21.15.133:0/819015429 wait complete. 2024-01-21T20:16:41.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:15:20.346500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:15:20.756907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:16:41.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:16:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.197+0000 7fe1ec39e700 1 Processor -- start 2024-01-21T20:16:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.197+0000 7fe1ec39e700 1 -- start start 2024-01-21T20:16:41.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ec39e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1e41351d0 0x7fe1e40c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ec39e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 0x7fe1e40bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ec39e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e40c61a0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ec39e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c5350 con 0x7fe1e41351d0 2024-01-21T20:16:41.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ec39e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40c55d0 con 0x7fe1e41563c0 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1e41351d0 0x7fe1e40c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1e41351d0 0x7fe1e40c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60634/0 (socket says 172.21.15.133:60634) 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 -- 172.21.15.133:0/2906962780 learned_addr learned my addr 172.21.15.133:0/2906962780 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea93b700 1 --2- 172.21.15.133:0/2906962780 >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 0x7fe1e40bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 -- 172.21.15.133:0/2906962780 >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 msgr2=0x7fe1e40bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 --2- 172.21.15.133:0/2906962780 >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 0x7fe1e40bde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1ea13a700 1 -- 172.21.15.133:0/2906962780 >> v1:172.21.15.133:6789/0 conn(0x7fe1e40c3c60 legacy=0x7fe1e4155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1ea13a700 1 -- 172.21.15.133:0/2906962780 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40c5870 con 0x7fe1e41351d0 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.199+0000 7fe1e9138700 1 -- 172.21.15.133:0/2906962780 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946387077 0 0) 0x7fe1e40c61a0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1ea93b700 1 --2- 172.21.15.133:0/2906962780 >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 0x7fe1e40bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1ea13a700 1 --2- 172.21.15.133:0/2906962780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e41351d0 0x7fe1e40c3770 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe1e414cd00 tx=0x7fe1e00090f0).ready entity=mon.0 client_cookie=be0aa6f062842325 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1e9138700 1 -- 172.21.15.133:0/2906962780 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000b600 con 0x7fe1e41351d0 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1e9138700 1 -- 172.21.15.133:0/2906962780 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000b760 con 0x7fe1e41351d0 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.200+0000 7fe1e9138700 1 -- 172.21.15.133:0/2906962780 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000bb00 con 0x7fe1e41351d0 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 -- 172.21.15.133:0/2906962780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e41351d0 msgr2=0x7fe1e40c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/2906962780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e41351d0 0x7fe1e40c3770 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fe1e414cd00 tx=0x7fe1e00090f0).stop 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 -- 172.21.15.133:0/2906962780 shutdown_connections 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/2906962780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e41351d0 0x7fe1e40c3770 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/2906962780 >> v2:172.21.15.178:3300/0 conn(0x7fe1e41563c0 0x7fe1e40bde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 -- 172.21.15.133:0/2906962780 >> 172.21.15.133:0/2906962780 conn(0x7fe1e4066a90 msgr2=0x7fe1e4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:41.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 -- 172.21.15.133:0/2906962780 shutdown_connections 2024-01-21T20:16:41.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.201+0000 7fe1ec39e700 1 -- 172.21.15.133:0/2906962780 wait complete. 2024-01-21T20:16:41.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.202+0000 7fe1ec39e700 1 Processor -- start 2024-01-21T20:16:41.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.202+0000 7fe1ec39e700 1 -- start start 2024-01-21T20:16:41.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1e41351d0 0x7fe1e414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1e41563c0 0x7fe1e414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e414f9f0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e414ec50 con 0x7fe1e41563c0 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ec39e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4166620 con 0x7fe1e41351d0 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60638/0 (socket says 172.21.15.133:60638) 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 -- 172.21.15.133:0/1554893120 learned_addr learned my addr 172.21.15.133:0/1554893120 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea93b700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1e41563c0 0x7fe1e414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1e9939700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1e41351d0 0x7fe1e414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1e41351d0 msgr2=0x7fe1e414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1e41351d0 0x7fe1e414e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1e41563c0 msgr2=0x7fe1e414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1e41563c0 0x7fe1e414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 -- 172.21.15.133:0/1554893120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009370 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1ea13a700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe1e0011fc0 tx=0x7fe1e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000bec0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.203+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000b8d0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.204+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40abeb0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.204+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e001c420 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.204+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e4165b40 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e405fdf0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe1e001c810 con 0x7fe1e40c3c60 2024-01-21T20:16:41.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1daffd700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 0x7fe1c8061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1e9939700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 msgr2=0x7fe1c8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:41.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fe1e007bef0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.205+0000 7fe1e9939700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 0x7fe1c8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:41.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.209+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe1e004cb20 con 0x7fe1e40c3c60 2024-01-21T20:16:41.226 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:41.236+0000 7f90fd729680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:16:41.273 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:41.283+0000 7ff582601680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:16:41.299 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:41.309+0000 7f90fd729680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:16:41.346 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:41.357+0000 7ff582601680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:16:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.406+0000 7fe1e9939700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 msgr2=0x7fe1c8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.406+0000 7fe1e9939700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 0x7fe1c8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.416+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe1e406ade0 con 0x7fe1e40c3c60 2024-01-21T20:16:41.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.417+0000 7fe1daffd700 1 -- 172.21.15.133:0/1554893120 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v111) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe1e0050140 con 0x7fe1e40c3c60 2024-01-21T20:16:41.406 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 msgr2=0x7fe1c8061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 0x7fe1c8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 msgr2=0x7fe1e4134850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fe1e0011fc0 tx=0x7fe1e0017000).stop 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 shutdown_connections 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe1c805f390 0x7fe1c8061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1e41563c0 0x7fe1e414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1e40c3c60 0x7fe1e4134850 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 --2- 172.21.15.133:0/1554893120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1e41351d0 0x7fe1e414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 >> 172.21.15.133:0/1554893120 conn(0x7fe1e4066a90 msgr2=0x7fe1e40bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 shutdown_connections 2024-01-21T20:16:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.419+0000 7fe1ec39e700 1 -- 172.21.15.133:0/1554893120 wait complete. 2024-01-21T20:16:41.422 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:16:41.488 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:41.498+0000 7f90fd729680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:16:41.543 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:41.554+0000 7ff582601680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:16:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.555+0000 7ff15359e700 1 Processor -- start 2024-01-21T20:16:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.555+0000 7ff15359e700 1 -- start start 2024-01-21T20:16:41.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.556+0000 7ff15359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.556+0000 7ff15359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff14c152020 0x7ff14c0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.556+0000 7ff15359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0c5c20 con 0x7ff14c13a790 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.556+0000 7ff15359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c152440 con 0x7ff14c069a60 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.556+0000 7ff15359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c066860 con 0x7ff14c152020 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff151d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff151d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60650/0 (socket says 172.21.15.133:60650) 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff151d9b700 1 -- 172.21.15.133:0/1213576816 learned_addr learned my addr 172.21.15.133:0/1213576816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 --2- 172.21.15.133:0/1213576816 >> v2:172.21.15.178:3300/0 conn(0x7ff14c152020 0x7ff14c0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 -- 172.21.15.133:0/1213576816 >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 msgr2=0x7ff14c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 --2- 172.21.15.133:0/1213576816 >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 -- 172.21.15.133:0/1213576816 >> v1:172.21.15.178:6789/0 conn(0x7ff14c13a790 legacy=0x7ff14c069350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 -- 172.21.15.133:0/1213576816 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0c5e80 con 0x7ff14c152020 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff15159a700 1 -- 172.21.15.133:0/1213576816 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622827667 0 0) 0x7ff14c0c5c20 con 0x7ff14c13a790 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff151d9b700 1 --2- 172.21.15.133:0/1213576816 >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff152d9d700 1 --2- 172.21.15.133:0/1213576816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c152020 0x7ff14c0c5730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff14c061510 tx=0x7ff148009780).ready entity=mon.1 client_cookie=3e3ebc241869d333 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff15159a700 1 -- 172.21.15.133:0/1213576816 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14800e070 con 0x7ff14c152020 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff15159a700 1 -- 172.21.15.133:0/1213576816 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14800bb60 con 0x7ff14c152020 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.557+0000 7ff15159a700 1 -- 172.21.15.133:0/1213576816 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148012410 con 0x7ff14c152020 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 -- 172.21.15.133:0/1213576816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c152020 msgr2=0x7ff14c0c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 --2- 172.21.15.133:0/1213576816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c152020 0x7ff14c0c5730 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff14c061510 tx=0x7ff148009780).stop 2024-01-21T20:16:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 -- 172.21.15.133:0/1213576816 shutdown_connections 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 --2- 172.21.15.133:0/1213576816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c152020 0x7ff14c0c5730 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 --2- 172.21.15.133:0/1213576816 >> v2:172.21.15.133:3300/0 conn(0x7ff14c069a60 0x7ff14c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 -- 172.21.15.133:0/1213576816 >> 172.21.15.133:0/1213576816 conn(0x7ff14c0c7bd0 msgr2=0x7ff14c0c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 -- 172.21.15.133:0/1213576816 shutdown_connections 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.558+0000 7ff15359e700 1 -- 172.21.15.133:0/1213576816 wait complete. 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.559+0000 7ff15359e700 1 Processor -- start 2024-01-21T20:16:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.559+0000 7ff15359e700 1 -- start start 2024-01-21T20:16:41.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c069a60 0x7ff14c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff14c13a790 0x7ff14c136ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c137e50 con 0x7ff14c152020 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c164710 con 0x7ff14c069a60 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c1649f0 con 0x7ff14c13a790 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff152d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff15259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c069a60 0x7ff14c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff152d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60664/0 (socket says 172.21.15.133:60664) 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.560+0000 7ff152d9d700 1 -- 172.21.15.133:0/658197796 learned_addr learned my addr 172.21.15.133:0/658197796 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff14c13a790 msgr2=0x7ff14c136ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff14c13a790 0x7ff14c136ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c069a60 msgr2=0x7ff14c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c069a60 0x7ff14c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 -- 172.21.15.133:0/658197796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144009370 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff152d9d700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7ff14800b6c0 tx=0x7ff148009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148012410 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff148007080 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff148009a20 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14801d860 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.561+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c164fb0 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.562+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c137fc0 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.562+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff148003040 con 0x7ff14c152020 2024-01-21T20:16:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.563+0000 7ff13effd700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 0x7ff130061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:41.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.563+0000 7ff15259c700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 msgr2=0x7ff130061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:41.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.563+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7ff14807c6b0 con 0x7ff14c152020 2024-01-21T20:16:41.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.563+0000 7ff15259c700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 0x7ff130061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:41.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.567+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff14804d1d0 con 0x7ff14c152020 2024-01-21T20:16:41.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.764+0000 7ff15259c700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 msgr2=0x7ff130061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:41.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.764+0000 7ff15259c700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 0x7ff130061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:41.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.874+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff14c06c7b0 con 0x7ff14c152020 2024-01-21T20:16:41.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.875+0000 7ff13effd700 1 -- 172.21.15.133:0/658197796 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v111) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1480507f0 con 0x7ff14c152020 2024-01-21T20:16:41.865 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 msgr2=0x7ff130061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 0x7ff130061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 msgr2=0x7ff14c165390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7ff14800b6c0 tx=0x7ff148009780).stop 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 shutdown_connections 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff13005f390 0x7ff130061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff14c152020 0x7ff14c165390 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff14c069a60 0x7ff14c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:41.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 --2- 172.21.15.133:0/658197796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff14c13a790 0x7ff14c136ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:41.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 >> 172.21.15.133:0/658197796 conn(0x7ff14c0c7bd0 msgr2=0x7ff14c0c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:41.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 shutdown_connections 2024-01-21T20:16:41.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:41.877+0000 7ff15359e700 1 -- 172.21.15.133:0/658197796 wait complete. 2024-01-21T20:16:41.881 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:16:41.909 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:41.919+0000 7f90fd729680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:16:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.012+0000 7fc76393a700 1 Processor -- start 2024-01-21T20:16:42.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.013+0000 7fc76393a700 1 -- start start 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc76393a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc76393a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc76393a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0ab620 con 0x7fc75c0c6090 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc76393a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c0c6ae0 con 0x7fc75c154140 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc76393a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0c05e0 con 0x7fc75c154520 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc760ed5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc7616d6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc760ed5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:56110/0 (socket says 172.21.15.133:56110) 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc7616d6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:44708/0 (socket says 172.21.15.133:44708) 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc760ed5700 1 -- 172.21.15.133:0/1656268306 learned_addr learned my addr 172.21.15.133:0/1656268306 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.014+0000 7fc761ed7700 1 --1- 172.21.15.133:0/1656268306 >> v1:172.21.15.178:6789/0 conn(0x7fc75c0c6090 0x7fc75c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43774/0 (socket says 172.21.15.133:43774) 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc760ed5700 1 -- 172.21.15.133:0/1656268306 >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 msgr2=0x7fc75c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc760ed5700 1 --2- 172.21.15.133:0/1656268306 >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc760ed5700 1 -- 172.21.15.133:0/1656268306 >> v1:172.21.15.178:6789/0 conn(0x7fc75c0c6090 legacy=0x7fc75c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc760ed5700 1 -- 172.21.15.133:0/1656268306 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0c0e40 con 0x7fc75c154520 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc7616d6700 1 --2- 172.21.15.133:0/1656268306 >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc760ed5700 1 --2- 172.21.15.133:0/1656268306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c0090f0).ready entity=mon.2 client_cookie=4d46b3a884607e12 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc753fff700 1 -- 172.21.15.133:0/1656268306 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00b580 con 0x7fc75c154520 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc753fff700 1 -- 172.21.15.133:0/1656268306 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00b6e0 con 0x7fc75c154520 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.015+0000 7fc753fff700 1 -- 172.21.15.133:0/1656268306 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c00ba60 con 0x7fc75c154520 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 -- 172.21.15.133:0/1656268306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 msgr2=0x7fc75c0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 --2- 172.21.15.133:0/1656268306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fc74c006fd0 tx=0x7fc74c0090f0).stop 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 -- 172.21.15.133:0/1656268306 shutdown_connections 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 --2- 172.21.15.133:0/1656268306 >> v2:172.21.15.178:3300/0 conn(0x7fc75c154140 0x7fc75c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 --2- 172.21.15.133:0/1656268306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c154520 0x7fc75c0ab130 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 -- 172.21.15.133:0/1656268306 >> 172.21.15.133:0/1656268306 conn(0x7fc75c05e1e0 msgr2=0x7fc75c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 -- 172.21.15.133:0/1656268306 shutdown_connections 2024-01-21T20:16:42.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.016+0000 7fc76393a700 1 -- 172.21.15.133:0/1656268306 wait complete. 2024-01-21T20:16:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.018+0000 7fc76393a700 1 Processor -- start 2024-01-21T20:16:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.018+0000 7fc76393a700 1 -- start start 2024-01-21T20:16:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 0x7fc75c0b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c153960 con 0x7fc75c154140 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0afac0 con 0x7fc75c154520 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc76393a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0afda0 con 0x7fc75c0c6090 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc760ed5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc7616d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc761ed7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 0x7fc75c0b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc7616d6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:56116/0 (socket says 172.21.15.133:56116) 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 -- 172.21.15.133:0/2882378357 learned_addr learned my addr 172.21.15.133:0/2882378357 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.019+0000 7fc760ed5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60666/0 (socket says 172.21.15.133:60666) 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 -- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 msgr2=0x7fc75c0b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 0x7fc75c0b0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 -- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 msgr2=0x7fc75c0b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 -- 172.21.15.133:0/2882378357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580092a0 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc760ed5700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc761ed7700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 0x7fc75c0b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc7616d6700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc75800ea20 tx=0x7fc758009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800ee60 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800c850 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c009370 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800cbd0 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.020+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c0b0360 con 0x7fc75c0c6090 2024-01-21T20:16:42.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0b06d0 con 0x7fc75c0c6090 2024-01-21T20:16:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fc75801b400 con 0x7fc75c0c6090 2024-01-21T20:16:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc751ffb700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 0x7fc740061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc760ed5700 1 -- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 msgr2=0x7fc740061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fc75807ae40 con 0x7fc75c0c6090 2024-01-21T20:16:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.022+0000 7fc760ed5700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 0x7fc740061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:42.015 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.022+0000 7f90fd729680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:16:42.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.026+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc75804bac0 con 0x7fc75c0c6090 2024-01-21T20:16:42.095 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.106+0000 7ff582601680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:16:42.166 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.176+0000 7f90fd729680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:16:42.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.195+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc75c05fdf0 con 0x7fc75c0c6090 2024-01-21T20:16:42.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.196+0000 7fc751ffb700 1 -- 172.21.15.133:0/2882378357 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc75804f0e0 con 0x7fc75c0c6090 2024-01-21T20:16:42.185 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 msgr2=0x7fc740061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 0x7fc740061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 msgr2=0x7fc75c152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc75800ea20 tx=0x7fc758009060).stop 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 shutdown_connections 2024-01-21T20:16:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc74005f390 0x7fc740061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc75c154520 0x7fc75c0b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc75c0c6090 0x7fc75c152ff0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 --2- 172.21.15.133:0/2882378357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc75c154140 0x7fc75c0b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 >> 172.21.15.133:0/2882378357 conn(0x7fc75c05e1e0 msgr2=0x7fc75c0c3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 shutdown_connections 2024-01-21T20:16:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.198+0000 7fc76393a700 1 -- 172.21.15.133:0/2882378357 wait complete. 2024-01-21T20:16:42.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:16:42.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.213+0000 7ff582601680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:16:42.240 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.250+0000 7f90fd729680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:16:42.307 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.317+0000 7f90fd729680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:16:42.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.336+0000 7ff4ba0f4700 1 Processor -- start 2024-01-21T20:16:42.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.336+0000 7ff4ba0f4700 1 -- start start 2024-01-21T20:16:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4ba0f4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4ba0f4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff4b4154520 0x7ff4b40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4ba0f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b40ab620 con 0x7ff4b40c6090 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4ba0f4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40c6ae0 con 0x7ff4b4154520 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4ba0f4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c05e0 con 0x7ff4b4154140 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4b3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4b40c6090 0x7ff4b40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55446/0 (socket says 172.21.15.133:55446) 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.337+0000 7ff4b3fff700 1 -- 172.21.15.133:0/2923271075 learned_addr learned my addr 172.21.15.133:0/2923271075 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 --2- 172.21.15.133:0/2923271075 >> v2:172.21.15.178:3300/0 conn(0x7ff4b4154520 0x7ff4b40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b37fe700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b2ffd700 1 -- 172.21.15.133:0/2923271075 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54547912 0 0) 0x7ff4b40ab620 con 0x7ff4b40c6090 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b2ffd700 1 -- 172.21.15.133:0/2923271075 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00033f0 con 0x7ff4b40c6090 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 -- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 msgr2=0x7ff4b4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 -- 172.21.15.133:0/2923271075 >> v1:172.21.15.133:6789/0 conn(0x7ff4b40c6090 legacy=0x7ff4b40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 -- 172.21.15.133:0/2923271075 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40c0e40 con 0x7ff4b4154520 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b37fe700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4abfff700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b40ab130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff49c009760 tx=0x7ff49c009060).ready entity=mon.1 client_cookie=bd30a09e92429a37 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b2ffd700 1 -- 172.21.15.133:0/2923271075 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00d4a0 con 0x7ff4b4154520 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b2ffd700 1 -- 172.21.15.133:0/2923271075 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00d600 con 0x7ff4b4154520 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.338+0000 7ff4b2ffd700 1 -- 172.21.15.133:0/2923271075 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c00d980 con 0x7ff4b4154520 2024-01-21T20:16:42.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 msgr2=0x7ff4b40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b40ab130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff49c009760 tx=0x7ff49c009060).stop 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/2923271075 shutdown_connections 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/2923271075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b40ab130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/2923271075 >> 172.21.15.133:0/2923271075 conn(0x7ff4b405e1e0 msgr2=0x7ff4b405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/2923271075 shutdown_connections 2024-01-21T20:16:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.339+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/2923271075 wait complete. 2024-01-21T20:16:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.341+0000 7ff4ba0f4700 1 Processor -- start 2024-01-21T20:16:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.341+0000 7ff4ba0f4700 1 -- start start 2024-01-21T20:16:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b4139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40af360 con 0x7ff4b40c6090 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b4146690 con 0x7ff4b4154520 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40c9070 con 0x7ff4b4154140 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60676/0 (socket says 172.21.15.133:60676) 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 -- 172.21.15.133:0/332250744 learned_addr learned my addr 172.21.15.133:0/332250744 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4abfff700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b3fff700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b4139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 -- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 msgr2=0x7ff4b40aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b40aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 -- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 msgr2=0x7ff4b4139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b4139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 -- 172.21.15.133:0/332250744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40092a0 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b37fe700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7ff4a400ea20 tx=0x7ff4a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400ee60 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400c850 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0092a0 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.343+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400cbd0 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.344+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b40c9910 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff4a401b400 con 0x7ff4b40c6090 2024-01-21T20:16:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b40c9b30 con 0x7ff4b40c6090 2024-01-21T20:16:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4b0ff9700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 0x7ff494061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4abfff700 1 -- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 msgr2=0x7ff494061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7ff4a407ae80 con 0x7ff4b40c6090 2024-01-21T20:16:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.345+0000 7ff4abfff700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 0x7ff494061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.349+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff4a404ba50 con 0x7ff4b40c6090 2024-01-21T20:16:42.378 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.389+0000 7ff582601680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:16:42.454 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.465+0000 7ff582601680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:16:42.523 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.533+0000 7ff582601680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:16:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.533+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4b40c9230 con 0x7ff4b40c6090 2024-01-21T20:16:42.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.534+0000 7ff4b0ff9700 1 -- 172.21.15.133:0/332250744 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4b40c9230 con 0x7ff4b40c6090 2024-01-21T20:16:42.524 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:16:42.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 msgr2=0x7ff494061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 0x7ff494061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 msgr2=0x7ff4b41461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7ff4a400ea20 tx=0x7ff4a4009060).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 shutdown_connections 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff49405f390 0x7ff494061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4b4154520 0x7ff4b4139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4b40c6090 0x7ff4b41461a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 --2- 172.21.15.133:0/332250744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4b4154140 0x7ff4b40aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 >> 172.21.15.133:0/332250744 conn(0x7ff4b405e1e0 msgr2=0x7ff4b40c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 shutdown_connections 2024-01-21T20:16:42.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.536+0000 7ff4ba0f4700 1 -- 172.21.15.133:0/332250744 wait complete. 2024-01-21T20:16:42.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:16:42.562 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.573+0000 7f90fd729680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:16:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.667+0000 7f558bf8d700 1 Processor -- start 2024-01-21T20:16:42.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.667+0000 7f558bf8d700 1 -- start start 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558bf8d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5584154140 0x7f5584158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558bf8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f55840ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558bf8d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840ab620 con 0x7f5584154520 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558bf8d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840c6ae0 con 0x7f5584154140 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558bf8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c05e0 con 0x7f55840c8120 2024-01-21T20:16:42.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f5589d29700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5584154140 0x7f5584158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f5589d29700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5584154140 0x7f5584158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60690/0 (socket says 172.21.15.133:60690) 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f5589d29700 1 -- 172.21.15.133:0/2318663905 learned_addr learned my addr 172.21.15.133:0/2318663905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.668+0000 7f558a52a700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f55840ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5589d29700 1 -- 172.21.15.133:0/2318663905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 msgr2=0x7f55840ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5589d29700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f55840ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5589d29700 1 -- 172.21.15.133:0/2318663905 >> v1:172.21.15.178:6789/0 conn(0x7f5584154520 legacy=0x7f55840c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5589d29700 1 -- 172.21.15.133:0/2318663905 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840c0e40 con 0x7f5584154140 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5588d27700 1 -- 172.21.15.133:0/2318663905 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959586319 0 0) 0x7f55840ab620 con 0x7f5584154520 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5589d29700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154140 0x7f5584158bb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f5580006fd0 tx=0x7f55800090f0).ready entity=mon.0 client_cookie=314ab06077d91341 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5588d27700 1 -- 172.21.15.133:0/2318663905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000b580 con 0x7f5584154140 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5588d27700 1 -- 172.21.15.133:0/2318663905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558000b6e0 con 0x7f5584154140 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.669+0000 7f5588d27700 1 -- 172.21.15.133:0/2318663905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000ba60 con 0x7f5584154140 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 -- 172.21.15.133:0/2318663905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154140 msgr2=0x7f5584158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154140 0x7f5584158bb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f5580006fd0 tx=0x7f55800090f0).stop 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 -- 172.21.15.133:0/2318663905 shutdown_connections 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154140 0x7f5584158bb0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 --2- 172.21.15.133:0/2318663905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f55840ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 -- 172.21.15.133:0/2318663905 >> 172.21.15.133:0/2318663905 conn(0x7f558405e1e0 msgr2=0x7f558405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 -- 172.21.15.133:0/2318663905 shutdown_connections 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.670+0000 7f558bf8d700 1 -- 172.21.15.133:0/2318663905 wait complete. 2024-01-21T20:16:42.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.671+0000 7f558bf8d700 1 Processor -- start 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.671+0000 7f558bf8d700 1 -- start start 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f558414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5584154140 0x7f55840b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b1140 con 0x7f5584154520 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558414d640 con 0x7f5584154140 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55841551d0 con 0x7f55840c8120 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60698/0 (socket says 172.21.15.133:60698) 2024-01-21T20:16:42.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 -- 172.21.15.133:0/3624652551 learned_addr learned my addr 172.21.15.133:0/3624652551 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f5589528700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5584154140 0x7f55840b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f5589d29700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f558414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 msgr2=0x7f558414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f558414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5584154140 msgr2=0x7f55840b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5584154140 0x7f55840b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 -- 172.21.15.133:0/3624652551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009370 con 0x7f5584154520 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558a52a700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f557c009e90 tx=0x7f557c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:42.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00caa0 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c00f040 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5584154ea0 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c00ce10 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.672+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55840b0e60 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584154d00 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f557c013610 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f557a7fc700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 0x7f5568061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f5589d29700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 msgr2=0x7f5568061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f557c07b1e0 con 0x7f5584154520 2024-01-21T20:16:42.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.674+0000 7f5589d29700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 0x7f5568061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:42.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.678+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5584154d00 con 0x7f5584154520 2024-01-21T20:16:42.744 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:42.755+0000 7f90fd729680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:16:42.794 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:42.805+0000 7ff582601680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:16:42.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.875+0000 7f5589d29700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 msgr2=0x7f5568061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:42.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.875+0000 7f5589d29700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 0x7f5568061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:42.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.891+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f558405fdf0 con 0x7f5584154520 2024-01-21T20:16:42.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.892+0000 7f557a7fc700 1 -- 172.21.15.133:0/3624652551 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f557c04bd00 con 0x7f5584154520 2024-01-21T20:16:42.881 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:42.881 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:16:42.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 msgr2=0x7f5568061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 0x7f5568061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 msgr2=0x7f55840c2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f557c009e90 tx=0x7f557c00b040).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 shutdown_connections 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f556805f390 0x7f5568061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5584154520 0x7f55840c2600 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55840c8120 0x7f558414d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 --2- 172.21.15.133:0/3624652551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5584154140 0x7f55840b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 >> 172.21.15.133:0/3624652551 conn(0x7f558405e1e0 msgr2=0x7f558414d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 shutdown_connections 2024-01-21T20:16:42.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:42.895+0000 7f558bf8d700 1 -- 172.21.15.133:0/3624652551 wait complete. 2024-01-21T20:16:42.886 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:16:42.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:16:42.993 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:43.004+0000 7ff582601680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:16:43.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.032+0000 7ff416bf3700 1 Processor -- start 2024-01-21T20:16:43.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.032+0000 7ff416bf3700 1 -- start start 2024-01-21T20:16:43.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff416bf3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff41013a830 0x7ff4100c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff416bf3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff41013ac10 0x7ff4100bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff416bf3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4100c3890 con 0x7ff4100695b0 2024-01-21T20:16:43.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff416bf3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100c3b70 con 0x7ff41013ac10 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff416bf3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100c3e50 con 0x7ff41013a830 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff40ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff41013ac10 0x7ff4100bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.033+0000 7ff415190700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4100695b0 0x7ff4100699c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55452/0 (socket says 172.21.15.133:55452) 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff41013ac10 0x7ff4100bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60708/0 (socket says 172.21.15.133:60708) 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff415190700 1 -- 172.21.15.133:0/1953039576 learned_addr learned my addr 172.21.15.133:0/1953039576 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff41498f700 1 --2- 172.21.15.133:0/1953039576 >> v2:172.21.15.178:3300/0 conn(0x7ff41013a830 0x7ff4100c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40f7fe700 1 -- 172.21.15.133:0/1953039576 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028240336 0 0) 0x7ff4100c3890 con 0x7ff4100695b0 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40f7fe700 1 -- 172.21.15.133:0/1953039576 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4000033f0 con 0x7ff4100695b0 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 -- 172.21.15.133:0/1953039576 >> v2:172.21.15.178:3300/0 conn(0x7ff41013a830 msgr2=0x7ff4100c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 --2- 172.21.15.133:0/1953039576 >> v2:172.21.15.178:3300/0 conn(0x7ff41013a830 0x7ff4100c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 -- 172.21.15.133:0/1953039576 >> v1:172.21.15.133:6789/0 conn(0x7ff4100695b0 legacy=0x7ff4100699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 -- 172.21.15.133:0/1953039576 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100c4130 con 0x7ff41013ac10 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40ffff700 1 --2- 172.21.15.133:0/1953039576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff41013ac10 0x7ff4100bce60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7ff410068230 tx=0x7ff3fc00b300).ready entity=mon.0 client_cookie=7855c7a1adf55e82 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40f7fe700 1 -- 172.21.15.133:0/1953039576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00b370 con 0x7ff41013ac10 2024-01-21T20:16:43.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40f7fe700 1 -- 172.21.15.133:0/1953039576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00d8c0 con 0x7ff41013ac10 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.034+0000 7ff40f7fe700 1 -- 172.21.15.133:0/1953039576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00dc40 con 0x7ff41013ac10 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 -- 172.21.15.133:0/1953039576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff41013ac10 msgr2=0x7ff4100bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1953039576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff41013ac10 0x7ff4100bce60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7ff410068230 tx=0x7ff3fc00b300).stop 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 -- 172.21.15.133:0/1953039576 shutdown_connections 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1953039576 >> v2:172.21.15.178:3300/0 conn(0x7ff41013a830 0x7ff4100c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1953039576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff41013ac10 0x7ff4100bce60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 -- 172.21.15.133:0/1953039576 >> 172.21.15.133:0/1953039576 conn(0x7ff4100c7dc0 msgr2=0x7ff4100c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 -- 172.21.15.133:0/1953039576 shutdown_connections 2024-01-21T20:16:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.035+0000 7ff416bf3700 1 -- 172.21.15.133:0/1953039576 wait complete. 2024-01-21T20:16:43.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.036+0000 7ff416bf3700 1 Processor -- start 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.036+0000 7ff416bf3700 1 -- start start 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.037+0000 7ff416bf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 0x7ff410137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41013ac10 0x7ff410065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100aa560 con 0x7ff4100695b0 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100a9ae0 con 0x7ff41013ac10 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100ab1c0 con 0x7ff41013a830 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60722/0 (socket says 172.21.15.133:60722) 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 -- 172.21.15.133:0/1010704062 learned_addr learned my addr 172.21.15.133:0/1010704062 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff415190700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41013ac10 0x7ff410065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff40ffff700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 0x7ff410137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 -- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 msgr2=0x7ff410137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 0x7ff410137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 -- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41013ac10 msgr2=0x7ff410065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41013ac10 0x7ff410065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 -- 172.21.15.133:0/1010704062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc00b540 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff40ffff700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 0x7ff410137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff41498f700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff40400e950 tx=0x7ff404009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400c6a0 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40400c800 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4100ab4a0 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40400cb80 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.038+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100aba60 con 0x7ff4100695b0 2024-01-21T20:16:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.039+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41005fdf0 con 0x7ff4100695b0 2024-01-21T20:16:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.040+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff40401b400 con 0x7ff4100695b0 2024-01-21T20:16:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.040+0000 7ff40d7fa700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 0x7ff3f4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.040+0000 7ff40ffff700 1 -- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 msgr2=0x7ff3f4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.040+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7ff40407af10 con 0x7ff4100695b0 2024-01-21T20:16:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.040+0000 7ff40ffff700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 0x7ff3f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.048+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff40404ba50 con 0x7ff4100695b0 2024-01-21T20:16:43.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.223+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4100671a0 con 0x7ff4100695b0 2024-01-21T20:16:43.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.224+0000 7ff40d7fa700 1 -- 172.21.15.133:0/1010704062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18411 (secure 0 0 0) 0x7ff404016070 con 0x7ff4100695b0 2024-01-21T20:16:43.213 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:43.213 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":111,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:16:39.122586+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":1,"to":5}]},{"pgid":"13.20","mappings":[{"from":6,"to":3}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3913532409":"2024-01-22T20:15:37.387255+0000","172.21.15.133:0/385807244":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:37.387255+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.225+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 msgr2=0x7ff3f4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.225+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 0x7ff3f4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.225+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 msgr2=0x7ff4100aa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.225+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7ff40400e950 tx=0x7ff404009060).stop 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 shutdown_connections 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff3f405f390 0x7ff3f4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41013ac10 0x7ff410065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4100695b0 0x7ff4100aa070 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 --2- 172.21.15.133:0/1010704062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff41013a830 0x7ff410137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 >> 172.21.15.133:0/1010704062 conn(0x7ff4100c7dc0 msgr2=0x7ff410066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 shutdown_connections 2024-01-21T20:16:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.226+0000 7ff416bf3700 1 -- 172.21.15.133:0/1010704062 wait complete. 2024-01-21T20:16:43.227 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:16:43.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:16:43.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.357+0000 7f345a9c6700 1 Processor -- start 2024-01-21T20:16:43.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.357+0000 7f345a9c6700 1 -- start start 2024-01-21T20:16:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f345a9c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 0x7f3454158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f345a9c6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3454154520 0x7f34540ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f345a9c6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34540ab620 con 0x7f34540c6090 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f345a9c6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34540c6ae0 con 0x7f3454154520 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f345a9c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540c05e0 con 0x7f3454154140 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3458f63700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34540c6090 0x7f34540c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55456/0 (socket says 172.21.15.133:55456) 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3458f63700 1 -- 172.21.15.133:0/574406555 learned_addr learned my addr 172.21.15.133:0/574406555 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 --2- 172.21.15.133:0/574406555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 0x7f3454158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f34537fe700 1 --2- 172.21.15.133:0/574406555 >> v2:172.21.15.178:3300/0 conn(0x7f3454154520 0x7f34540ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3452ffd700 1 -- 172.21.15.133:0/574406555 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738890826 0 0) 0x7f34540ab620 con 0x7f34540c6090 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3452ffd700 1 -- 172.21.15.133:0/574406555 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c0033f0 con 0x7f34540c6090 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 -- 172.21.15.133:0/574406555 >> v2:172.21.15.178:3300/0 conn(0x7f3454154520 msgr2=0x7f34540ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 --2- 172.21.15.133:0/574406555 >> v2:172.21.15.178:3300/0 conn(0x7f3454154520 0x7f34540ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 -- 172.21.15.133:0/574406555 >> v1:172.21.15.133:6789/0 conn(0x7f34540c6090 legacy=0x7f34540c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 -- 172.21.15.133:0/574406555 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540c0e40 con 0x7f3454154140 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.358+0000 7f3453fff700 1 --2- 172.21.15.133:0/574406555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 0x7f3454158bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3444009760 tx=0x7f3444009060).ready entity=mon.2 client_cookie=beb241a45720b64 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f3452ffd700 1 -- 172.21.15.133:0/574406555 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400d4a0 con 0x7f3454154140 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f3452ffd700 1 -- 172.21.15.133:0/574406555 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344400d600 con 0x7f3454154140 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f3452ffd700 1 -- 172.21.15.133:0/574406555 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400d980 con 0x7f3454154140 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 -- 172.21.15.133:0/574406555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 msgr2=0x7f3454158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 --2- 172.21.15.133:0/574406555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 0x7f3454158bb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3444009760 tx=0x7f3444009060).stop 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 -- 172.21.15.133:0/574406555 shutdown_connections 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 --2- 172.21.15.133:0/574406555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154140 0x7f3454158bb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 --2- 172.21.15.133:0/574406555 >> v2:172.21.15.178:3300/0 conn(0x7f3454154520 0x7f34540ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 -- 172.21.15.133:0/574406555 >> 172.21.15.133:0/574406555 conn(0x7f345405e1e0 msgr2=0x7f345405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 -- 172.21.15.133:0/574406555 shutdown_connections 2024-01-21T20:16:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.359+0000 7f345a9c6700 1 -- 172.21.15.133:0/574406555 wait complete. 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.360+0000 7f345a9c6700 1 Processor -- start 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 -- start start 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 0x7f345414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154520 0x7f345415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345415a7a0 con 0x7f3454154140 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540caa70 con 0x7f34540c6090 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f345a9c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540af480 con 0x7f3454154520 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.361+0000 7f34537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60734/0 (socket says 172.21.15.133:60734) 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 -- 172.21.15.133:0/3854636625 learned_addr learned my addr 172.21.15.133:0/3854636625 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3453fff700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 0x7f345414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3458f63700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154520 0x7f345415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154520 msgr2=0x7f345415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154520 0x7f345415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 msgr2=0x7f345414c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 0x7f345414c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 -- 172.21.15.133:0/3854636625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34440092a0 con 0x7f3454154140 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3453fff700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 0x7f345414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f34537fe700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f344800e8d0 tx=0x7f3448009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448009390 con 0x7f3454154140 2024-01-21T20:16:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448012600 con 0x7f3454154140 2024-01-21T20:16:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34540af760 con 0x7f3454154140 2024-01-21T20:16:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448012980 con 0x7f3454154140 2024-01-21T20:16:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.362+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34540ca700 con 0x7f3454154140 2024-01-21T20:16:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.363+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345405fdf0 con 0x7f3454154140 2024-01-21T20:16:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.364+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f344801b400 con 0x7f3454154140 2024-01-21T20:16:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.364+0000 7f3450ff9700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 0x7f3440061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.364+0000 7f3453fff700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 msgr2=0x7f3440061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.364+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f344807ad30 con 0x7f3454154140 2024-01-21T20:16:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.364+0000 7f3453fff700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 0x7f3440061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.368+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f344804b8a0 con 0x7f3454154140 2024-01-21T20:16:43.395 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.406+0000 7f90fd729680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:16:43.463 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.474+0000 7f90fd729680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:16:43.538 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.549+0000 7f90fd729680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:16:43.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.565+0000 7f3453fff700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 msgr2=0x7f3440061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:43.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.565+0000 7f3453fff700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 0x7f3440061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:43.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.579+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34540c00f0 con 0x7f3454154140 2024-01-21T20:16:43.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.579+0000 7f3450ff9700 1 -- 172.21.15.133:0/3854636625 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f3448016070 con 0x7f3454154140 2024-01-21T20:16:43.569 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:43.569 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 msgr2=0x7f3440061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 0x7f3440061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 msgr2=0x7f3454159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f344800e8d0 tx=0x7f3448009060).stop 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 shutdown_connections 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f344005f390 0x7f3440061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3454154520 0x7f345415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34540c6090 0x7f345414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 --2- 172.21.15.133:0/3854636625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3454154140 0x7f3454159dc0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.581+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 >> 172.21.15.133:0/3854636625 conn(0x7f345405e1e0 msgr2=0x7f34540c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.582+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 shutdown_connections 2024-01-21T20:16:43.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.582+0000 7f345a9c6700 1 -- 172.21.15.133:0/3854636625 wait complete. 2024-01-21T20:16:43.572 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:16:43.584 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:16:43.684 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.694+0000 7f90fd729680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:16:43.686 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:43.697+0000 7ff582601680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:16:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.714+0000 7f2b5c58c700 1 Processor -- start 2024-01-21T20:16:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.714+0000 7f2b5c58c700 1 -- start start 2024-01-21T20:16:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5c58c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b541351d0 0x7f2b540c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5c58c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b540c3c60 0x7f2b54155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5c58c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b540c61a0 con 0x7f2b541561a0 2024-01-21T20:16:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5c58c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b54156630 con 0x7f2b540c3c60 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5c58c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540c5350 con 0x7f2b541351d0 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b540c3c60 0x7f2b54155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b540c3c60 0x7f2b54155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60748/0 (socket says 172.21.15.133:60748) 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 -- 172.21.15.133:0/386535701 learned_addr learned my addr 172.21.15.133:0/386535701 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5ab29700 1 --1- 172.21.15.133:0/386535701 >> v1:172.21.15.133:6789/0 conn(0x7f2b541561a0 0x7f2b541526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55472/0 (socket says 172.21.15.133:55472) 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b5a328700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b541351d0 0x7f2b540c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 -- 172.21.15.133:0/386535701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b541351d0 msgr2=0x7f2b540c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b541351d0 0x7f2b540c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 -- 172.21.15.133:0/386535701 >> v1:172.21.15.133:6789/0 conn(0x7f2b541561a0 legacy=0x7f2b541526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 -- 172.21.15.133:0/386535701 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b540c55d0 con 0x7f2b540c3c60 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59b27700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b540c3c60 0x7f2b54155cb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f2b44006fd0 tx=0x7f2b440090f0).ready entity=mon.0 client_cookie=58f3a3f66355a90 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59326700 1 -- 172.21.15.133:0/386535701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400b580 con 0x7f2b540c3c60 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59326700 1 -- 172.21.15.133:0/386535701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4400b6e0 con 0x7f2b540c3c60 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.715+0000 7f2b59326700 1 -- 172.21.15.133:0/386535701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400ba80 con 0x7f2b540c3c60 2024-01-21T20:16:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 -- 172.21.15.133:0/386535701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b540c3c60 msgr2=0x7f2b54155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b540c3c60 0x7f2b54155cb0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f2b44006fd0 tx=0x7f2b440090f0).stop 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 -- 172.21.15.133:0/386535701 shutdown_connections 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b541351d0 0x7f2b540c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/386535701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b540c3c60 0x7f2b54155cb0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 -- 172.21.15.133:0/386535701 >> 172.21.15.133:0/386535701 conn(0x7f2b54066a90 msgr2=0x7f2b54066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 -- 172.21.15.133:0/386535701 shutdown_connections 2024-01-21T20:16:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.716+0000 7f2b5c58c700 1 -- 172.21.15.133:0/386535701 wait complete. 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.717+0000 7f2b5c58c700 1 Processor -- start 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.717+0000 7f2b5c58c700 1 -- start start 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 0x7f2b541653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b541561a0 0x7f2b54164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54064220 con 0x7f2b541351d0 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540c9be0 con 0x7f2b541561a0 2024-01-21T20:16:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5c58c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54063930 con 0x7f2b540c3c60 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b59b27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b59b27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60758/0 (socket says 172.21.15.133:60758) 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b59b27700 1 -- 172.21.15.133:0/677560119 learned_addr learned my addr 172.21.15.133:0/677560119 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5a328700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 0x7f2b541653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.718+0000 7f2b5ab29700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b541561a0 0x7f2b54164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b541561a0 msgr2=0x7f2b54164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b541561a0 0x7f2b54164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 msgr2=0x7f2b541649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 -- 172.21.15.133:0/677560119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009370 con 0x7f2b540c3c60 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b59b27700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5a328700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 0x7f2b541653c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2b5000e6d0 tx=0x7f2b50009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b500092b0 con 0x7f2b540c3c60 2024-01-21T20:16:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50012600 con 0x7f2b540c3c60 2024-01-21T20:16:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b54063bd0 con 0x7f2b540c3c60 2024-01-21T20:16:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50012980 con 0x7f2b540c3c60 2024-01-21T20:16:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.719+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b540c6d10 con 0x7f2b540c3c60 2024-01-21T20:16:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.720+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5405fdf0 con 0x7f2b540c3c60 2024-01-21T20:16:43.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.720+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f2b50012cf0 con 0x7f2b540c3c60 2024-01-21T20:16:43.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.721+0000 7f2b4affd700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 0x7f2b38061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:43.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.721+0000 7f2b59b27700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 msgr2=0x7f2b38061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:43.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.721+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f2b5007ab40 con 0x7f2b540c3c60 2024-01-21T20:16:43.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.721+0000 7f2b59b27700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 0x7f2b38061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:43.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.725+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2b5004f260 con 0x7f2b540c3c60 2024-01-21T20:16:43.755 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.766+0000 7f90fd729680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:16:43.760 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:43.771+0000 7ff582601680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:16:43.838 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:43.849+0000 7ff582601680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:16:43.870 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.881+0000 7f90fd729680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:16:43.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.922+0000 7f2b59b27700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 msgr2=0x7f2b38061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:43.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.922+0000 7f2b59b27700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 0x7f2b38061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:43.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.938+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b540c5870 con 0x7f2b540c3c60 2024-01-21T20:16:43.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.938+0000 7f2b4affd700 1 -- 172.21.15.133:0/677560119 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f2b5004ee50 con 0x7f2b540c3c60 2024-01-21T20:16:43.928 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:43.928 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:15:21.803617+0000","modified":"2024-01-21T20:15:23.809473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7161},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7161":{"gid":7161,"name":"b","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3646142750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3646142750},{"type":"v1","addr":"172.21.15.178:6835","nonce":3646142750}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 msgr2=0x7f2b38061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 0x7f2b38061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 msgr2=0x7f2b541653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 0x7f2b541653c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2b5000e6d0 tx=0x7f2b50009060).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 shutdown_connections 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2b3805f390 0x7f2b38061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b541561a0 0x7f2b54164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b540c3c60 0x7f2b541653c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 --2- 172.21.15.133:0/677560119 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b541351d0 0x7f2b541649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:43.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 >> 172.21.15.133:0/677560119 conn(0x7f2b54066a90 msgr2=0x7f2b54139820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:43.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 shutdown_connections 2024-01-21T20:16:43.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:43.940+0000 7f2b5c58c700 1 -- 172.21.15.133:0/677560119 wait complete. 2024-01-21T20:16:43.931 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 36 2024-01-21T20:16:43.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:16:43.978 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:43.989+0000 7f90fd729680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:16:43.994 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.005+0000 7ff582601680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:16:44.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.071+0000 7fcc7c8d3700 1 Processor -- start 2024-01-21T20:16:44.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.071+0000 7fcc7c8d3700 1 -- start start 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7c8d3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc780c8120 0x7fcc78158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7c8d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 0x7fcc780ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7c8d3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc780ab620 con 0x7fcc78154140 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7c8d3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc780c6ae0 con 0x7fcc780c8120 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7c8d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780c05e0 con 0x7fcc78154520 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc78154140 0x7fcc780c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55478/0 (socket says 172.21.15.133:55478) 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7659c700 1 -- 172.21.15.133:0/3825283512 learned_addr learned my addr 172.21.15.133:0/3825283512 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/3825283512 >> v2:172.21.15.178:3300/0 conn(0x7fcc780c8120 0x7fcc78158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc76d9d700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 0x7fcc780ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7559a700 1 -- 172.21.15.133:0/3825283512 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192907281 0 0) 0x7fcc780ab620 con 0x7fcc78154140 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc7559a700 1 -- 172.21.15.133:0/3825283512 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc600033f0 con 0x7fcc78154140 2024-01-21T20:16:44.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc75d9b700 1 -- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 msgr2=0x7fcc780ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 0x7fcc780ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc75d9b700 1 -- 172.21.15.133:0/3825283512 >> v1:172.21.15.133:6789/0 conn(0x7fcc78154140 legacy=0x7fcc780c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc75d9b700 1 -- 172.21.15.133:0/3825283512 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc780c0e40 con 0x7fcc780c8120 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.072+0000 7fcc76d9d700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 0x7fcc780ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc780c8120 0x7fcc78158bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fcc6c009760 tx=0x7fcc6c009060).ready entity=mon.1 client_cookie=8c537c7b48d74809 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7559a700 1 -- 172.21.15.133:0/3825283512 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00d4a0 con 0x7fcc780c8120 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7559a700 1 -- 172.21.15.133:0/3825283512 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00d600 con 0x7fcc780c8120 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7559a700 1 -- 172.21.15.133:0/3825283512 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00d980 con 0x7fcc780c8120 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc780c8120 msgr2=0x7fcc78158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc780c8120 0x7fcc78158bb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fcc6c009760 tx=0x7fcc6c009060).stop 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/3825283512 shutdown_connections 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc78154520 0x7fcc780ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/3825283512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc780c8120 0x7fcc78158bb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/3825283512 >> 172.21.15.133:0/3825283512 conn(0x7fcc7805e1e0 msgr2=0x7fcc7805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:44.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.073+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/3825283512 shutdown_connections 2024-01-21T20:16:44.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.074+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/3825283512 wait complete. 2024-01-21T20:16:44.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.075+0000 7fcc7c8d3700 1 Processor -- start 2024-01-21T20:16:44.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.075+0000 7fcc7c8d3700 1 -- start start 2024-01-21T20:16:44.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 0x7fcc7814ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc78154520 0x7fcc7815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780af0f0 con 0x7fcc78154140 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc781648b0 con 0x7fcc78154520 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc7c8d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780ae850 con 0x7fcc780c8120 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc75d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc75d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60760/0 (socket says 172.21.15.133:60760) 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.076+0000 7fcc75d9b700 1 -- 172.21.15.133:0/313792151 learned_addr learned my addr 172.21.15.133:0/313792151 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc76d9d700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc78154520 0x7fcc7815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc7659c700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 0x7fcc7814ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 -- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 msgr2=0x7fcc7814ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 0x7fcc7814ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 -- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc78154520 msgr2=0x7fcc7815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc78154520 0x7fcc7815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 -- 172.21.15.133:0/313792151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc70009a20 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc7659c700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 0x7fcc7814ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc75d9b700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fcc6c009d50 tx=0x7fcc6c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c000c90 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00d770 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01d640 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c0092a0 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.077+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc780aee10 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.078+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7805fdf0 con 0x7fcc78154140 2024-01-21T20:16:44.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.078+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fcc6c01da70 con 0x7fcc78154140 2024-01-21T20:16:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.079+0000 7fcc66ffd700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 0x7fcc58061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.079+0000 7fcc7659c700 1 -- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 msgr2=0x7fcc58061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.079+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fcc6c07c130 con 0x7fcc78154140 2024-01-21T20:16:44.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.079+0000 7fcc7659c700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 0x7fcc58061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:44.070 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.081+0000 7ff582601680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:16:44.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.083+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc6c04cd60 con 0x7fcc78154140 2024-01-21T20:16:44.191 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.202+0000 7ff582601680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:16:44.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.252+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc780aa980 con 0x7fcc78154140 2024-01-21T20:16:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.253+0000 7fcc66ffd700 1 -- 172.21.15.133:0/313792151 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18411 (secure 0 0 0) 0x7fcc6c050380 con 0x7fcc78154140 2024-01-21T20:16:44.243 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:44.243 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":111,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:16:39.122586+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:15:20.346500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-01-21T20:15:20.756907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":1,"to":5}]},{"pgid":"13.20","mappings":[{"from":6,"to":3}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/3913532409":"2024-01-22T20:15:37.387255+0000","172.21.15.133:0/385807244":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6833/43404":"2024-01-22T20:15:37.387255+0000","172.21.15.133:6832/43404":"2024-01-22T20:15:37.387255+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 msgr2=0x7fcc58061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 0x7fcc58061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 msgr2=0x7fcc780ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fcc6c009d50 tx=0x7fcc6c016000).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 shutdown_connections 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5805f390 0x7fcc58061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc78154520 0x7fcc7815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc780c8120 0x7fcc7814ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 --2- 172.21.15.133:0/313792151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc78154140 0x7fcc780ae070 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 >> 172.21.15.133:0/313792151 conn(0x7fcc7805e1e0 msgr2=0x7fcc780c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:44.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 shutdown_connections 2024-01-21T20:16:44.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.255+0000 7fcc7c8d3700 1 -- 172.21.15.133:0/313792151 wait complete. 2024-01-21T20:16:44.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:16:44.270 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:44.280+0000 7f90fd729680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:16:44.305 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.316+0000 7ff582601680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:16:44.342 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:16:44.352+0000 7f90fd729680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:16:44.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.389+0000 7f8e22b3a700 1 Processor -- start 2024-01-21T20:16:44.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.389+0000 7f8e22b3a700 1 -- start start 2024-01-21T20:16:44.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.389+0000 7f8e22b3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 0x7f8e1c067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e22b3a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c068370 con 0x7f8e1c0c5930 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e22b3a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1c068650 con 0x7f8e1c137410 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e22b3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c068930 con 0x7f8e1c137030 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e210d7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e1c0c5930 0x7f8e1c15df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55482/0 (socket says 172.21.15.133:55482) 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e210d7700 1 -- 172.21.15.133:0/2958195020 learned_addr learned my addr 172.21.15.133:0/2958195020 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e208d6700 1 --2- 172.21.15.133:0/2958195020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 0x7f8e1c067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109895743 0 0) 0x7f8e1c068370 con 0x7f8e1c0c5930 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c0033f0 con 0x7f8e1c0c5930 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721389137 0 0) 0x7f8e1c068650 con 0x7f8e1c137410 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e1c068370 con 0x7f8e1c137410 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e208d6700 1 -- 172.21.15.133:0/2958195020 >> v1:172.21.15.178:6789/0 conn(0x7f8e1c137410 legacy=0x7f8e1c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e208d6700 1 -- 172.21.15.133:0/2958195020 >> v1:172.21.15.133:6789/0 conn(0x7f8e1c0c5930 legacy=0x7f8e1c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e208d6700 1 -- 172.21.15.133:0/2958195020 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c068c10 con 0x7f8e1c137030 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e208d6700 1 --2- 172.21.15.133:0/2958195020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 0x7f8e1c067d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8e10009790 tx=0x7f8e10009060).ready entity=mon.2 client_cookie=9548955f4b70015 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100090d0 con 0x7f8e1c137030 2024-01-21T20:16:44.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1000f510 con 0x7f8e1c137030 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.390+0000 7f8e1b7fe700 1 -- 172.21.15.133:0/2958195020 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1000f890 con 0x7f8e1c137030 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 -- 172.21.15.133:0/2958195020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 msgr2=0x7f8e1c067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/2958195020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 0x7f8e1c067d90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8e10009790 tx=0x7f8e10009060).stop 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 -- 172.21.15.133:0/2958195020 shutdown_connections 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/2958195020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c137030 0x7f8e1c067d90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 -- 172.21.15.133:0/2958195020 >> 172.21.15.133:0/2958195020 conn(0x7f8e1c066a90 msgr2=0x7f8e1c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 -- 172.21.15.133:0/2958195020 shutdown_connections 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.391+0000 7f8e22b3a700 1 -- 172.21.15.133:0/2958195020 wait complete. 2024-01-21T20:16:44.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.393+0000 7f8e22b3a700 1 Processor -- start 2024-01-21T20:16:44.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.393+0000 7f8e22b3a700 1 -- start start 2024-01-21T20:16:44.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c0c5930 0x7f8e1c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e1c137030 0x7f8e1c0c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c8830 con 0x7f8e1c137410 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c19a0 con 0x7f8e1c137030 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e22b3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1c0c2520 con 0x7f8e1c0c5930 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e210d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e210d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60772/0 (socket says 172.21.15.133:60772) 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e210d7700 1 -- 172.21.15.133:0/4061287196 learned_addr learned my addr 172.21.15.133:0/4061287196 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e208d6700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c0c5930 0x7f8e1c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.394+0000 7f8e1bfff700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e1c137030 0x7f8e1c0c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c0c5930 msgr2=0x7f8e1c14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c0c5930 0x7f8e1c14db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e1c137030 msgr2=0x7f8e1c0c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e1c137030 0x7f8e1c0c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 -- 172.21.15.133:0/4061287196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100092a0 con 0x7f8e1c137410 2024-01-21T20:16:44.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e210d7700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f8e14001560 tx=0x7f8e140015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14005d30 con 0x7f8e1c137410 2024-01-21T20:16:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e14005e90 con 0x7f8e1c137410 2024-01-21T20:16:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1c0c1bf0 con 0x7f8e1c137410 2024-01-21T20:16:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e14007300 con 0x7f8e1c137410 2024-01-21T20:16:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.395+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1c0c21b0 con 0x7f8e1c137410 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.396+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1c05fdf0 con 0x7f8e1c137410 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.396+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 45) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f8e140076b0 con 0x7f8e1c137410 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.397+0000 7f8e197fa700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 0x7f8e00061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.397+0000 7f8e208d6700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 msgr2=0x7f8e00061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.397+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f8e14079ef0 con 0x7f8e1c137410 2024-01-21T20:16:44.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.397+0000 7f8e208d6700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 0x7f8e00061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:16:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.401+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8e1404ab20 con 0x7f8e1c137410 2024-01-21T20:16:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.598+0000 7f8e208d6700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 msgr2=0x7f8e00061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:16:44.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.598+0000 7f8e208d6700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 0x7f8e00061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:16:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.616+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8e1c06bd20 con 0x7f8e1c137410 2024-01-21T20:16:44.610 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.621+0000 7ff582601680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:16:44.681 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.692+0000 7ff582601680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:16:44.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.712+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 46) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f8e14077620 con 0x7f8e1c137410 2024-01-21T20:16:44.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.713+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 msgr2=0x7f8e00061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:16:44.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:44.713+0000 7f8e197fa700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 0x7f8e00061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:44.704 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:16:44.704 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:16:44.704 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:16:44.708 INFO:tasks.ceph.mds.b.smithi178.stderr: -5668> 2024-01-21T20:15:27.715+0000 7fbe6e532700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:16:44.715 INFO:tasks.ceph.mds.b.smithi178.stderr: -5> 2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:16:44.715 INFO:tasks.ceph.mds.b.smithi178.stderr: -4> 2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:16:44.715 INFO:tasks.ceph.mds.b.smithi178.stderr: -1> 2024-01-21T20:16:44.714+0000 7fbe6ad2b700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:16:44.734 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.767+0000 7ff4fdbb0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.767+0000 7ff4fdbb0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.767+0000 7ff4fdbb0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.767+0000 7ff4fdbb0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.767+0000 7ff4fdbb0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.768+0000 7ff4fb3ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.768+0000 7ff4fb3ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.768+0000 7ff4fb3ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.768+0000 7ff4fb3ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:44.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:16:44.768+0000 7ff4fb3ab700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:16:45.131 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:16:45.142+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:16:45.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.151+0000 7f8e197fa700 1 -- 172.21.15.133:0/4061287196 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8e14073f80 con 0x7f8e1c137410 2024-01-21T20:16:45.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 msgr2=0x7f8e1c0c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f8e14001560 tx=0x7f8e140015b0).stop 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 shutdown_connections 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8e0005f390 0x7f8e00061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e1c137410 0x7f8e1c0c8340 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1c0c5930 0x7f8e1c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 --2- 172.21.15.133:0/4061287196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e1c137030 0x7f8e1c0c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 >> 172.21.15.133:0/4061287196 conn(0x7f8e1c066a90 msgr2=0x7f8e1c0c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 shutdown_connections 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.153+0000 7f8e22b3a700 1 -- 172.21.15.133:0/4061287196 wait complete. 2024-01-21T20:16:45.143 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:16:45.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:16:45.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.285+0000 7f7a23606700 1 Processor -- start 2024-01-21T20:16:45.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.285+0000 7f7a23606700 1 -- start start 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a23606700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a1c156160 0x7f7a1c0be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a23606700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0c61a0 con 0x7f7a1c1351d0 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a23606700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0c5350 con 0x7f7a1c155cb0 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a23606700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c55d0 con 0x7f7a1c156160 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a213a2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7a1c1351d0 0x7f7a1c0c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55484/0 (socket says 172.21.15.133:55484) 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a213a2700 1 -- 172.21.15.133:0/2603796790 learned_addr learned my addr 172.21.15.133:0/2603796790 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a21ba3700 1 --2- 172.21.15.133:0/2603796790 >> v2:172.21.15.178:3300/0 conn(0x7f7a1c156160 0x7f7a1c0be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.286+0000 7f7a13fff700 1 -- 172.21.15.133:0/2603796790 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512103189 0 0) 0x7f7a1c0c61a0 con 0x7f7a1c1351d0 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a13fff700 1 -- 172.21.15.133:0/2603796790 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a080033f0 con 0x7f7a1c1351d0 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a21ba3700 1 -- 172.21.15.133:0/2603796790 >> v1:172.21.15.178:6789/0 conn(0x7f7a1c155cb0 legacy=0x7f7a1c0bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a21ba3700 1 -- 172.21.15.133:0/2603796790 >> v1:172.21.15.133:6789/0 conn(0x7f7a1c1351d0 legacy=0x7f7a1c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a21ba3700 1 -- 172.21.15.133:0/2603796790 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0c5870 con 0x7f7a1c156160 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a21ba3700 1 --2- 172.21.15.133:0/2603796790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0be570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7a14009e60 tx=0x7f7a14009780).ready entity=mon.1 client_cookie=559bdf3b824b581c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a13fff700 1 -- 172.21.15.133:0/2603796790 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400e070 con 0x7f7a1c156160 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a13fff700 1 -- 172.21.15.133:0/2603796790 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400bb60 con 0x7f7a1c156160 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a13fff700 1 -- 172.21.15.133:0/2603796790 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14012410 con 0x7f7a1c156160 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a23606700 1 -- 172.21.15.133:0/2603796790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 msgr2=0x7f7a1c0be570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.287+0000 7f7a23606700 1 --2- 172.21.15.133:0/2603796790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0be570 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7a14009e60 tx=0x7f7a14009780).stop 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.288+0000 7f7a23606700 1 -- 172.21.15.133:0/2603796790 shutdown_connections 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.288+0000 7f7a23606700 1 --2- 172.21.15.133:0/2603796790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0be570 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.288+0000 7f7a23606700 1 -- 172.21.15.133:0/2603796790 >> 172.21.15.133:0/2603796790 conn(0x7f7a1c066a90 msgr2=0x7f7a1c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.288+0000 7f7a23606700 1 -- 172.21.15.133:0/2603796790 shutdown_connections 2024-01-21T20:16:45.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.288+0000 7f7a23606700 1 -- 172.21.15.133:0/2603796790 wait complete. 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.289+0000 7f7a23606700 1 Processor -- start 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.289+0000 7f7a23606700 1 -- start start 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 0x7f7a1c0c1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c162a70 con 0x7f7a1c155cb0 2024-01-21T20:16:45.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c161ec0 con 0x7f7a1c156160 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c162140 con 0x7f7a1c1351d0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60856/0 (socket says 172.21.15.133:60856) 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 -- 172.21.15.133:0/867139370 learned_addr learned my addr 172.21.15.133:0/867139370 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a21ba3700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a213a2700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 0x7f7a1c0c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 -- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 msgr2=0x7f7a1c0c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 0x7f7a1c0c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 -- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 msgr2=0x7f7a1c0aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 -- 172.21.15.133:0/867139370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a14009a20 con 0x7f7a1c155cb0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a213a2700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 0x7f7a1c0c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a20ba1700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f7a0c00c4c0 tx=0x7f7a0c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c007020 con 0x7f7a1c155cb0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c001e90 con 0x7f7a1c155cb0 2024-01-21T20:16:45.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c162420 con 0x7f7a1c155cb0 2024-01-21T20:16:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.290+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0073d0 con 0x7f7a1c155cb0 2024-01-21T20:16:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.291+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0c1c40 con 0x7f7a1c155cb0 2024-01-21T20:16:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.292+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c162c20 con 0x7f7a1c155cb0 2024-01-21T20:16:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.292+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 46) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f7a0c0068b0 con 0x7f7a1c155cb0 2024-01-21T20:16:45.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.292+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7395+0+0 (secure 0 0 0) 0x7f7a0c079d00 con 0x7f7a1c155cb0 2024-01-21T20:16:45.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.296+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7a1c162c20 con 0x7f7a1c155cb0 2024-01-21T20:16:45.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.502+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7a1c05fdf0 con 0x7f7a1c155cb0 2024-01-21T20:16:45.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.714+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7a0c0777a0 con 0x7f7a1c155cb0 2024-01-21T20:16:45.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.714+0000 7f7a11ffb700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 0x7f7a00068370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:45.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.715+0000 7f7a213a2700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 0x7f7a00068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:45.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:45.716+0000 7f7a213a2700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 0x7f7a00068370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7a1c0ab440 tx=0x7f7a18009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:46.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.152+0000 7f7a11ffb700 1 -- 172.21.15.133:0/867139370 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7a0c06e540 con 0x7f7a1c155cb0 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 msgr2=0x7f7a00068370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 0x7f7a00068370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f7a1c0ab440 tx=0x7f7a18009040).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 msgr2=0x7f7a1c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f7a0c00c4c0 tx=0x7f7a0c007e00).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 shutdown_connections 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7a000302f0 0x7f7a00068370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a1c156160 0x7f7a1c0aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a1c1351d0 0x7f7a1c0c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 --2- 172.21.15.133:0/867139370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c155cb0 0x7f7a1c0ae630 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 >> 172.21.15.133:0/867139370 conn(0x7f7a1c066a90 msgr2=0x7f7a1c139bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:46.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 shutdown_connections 2024-01-21T20:16:46.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.154+0000 7f7a23606700 1 -- 172.21.15.133:0/867139370 wait complete. 2024-01-21T20:16:46.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:16:46.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.291+0000 7fe5a5843700 1 Processor -- start 2024-01-21T20:16:46.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.291+0000 7fe5a5843700 1 -- start start 2024-01-21T20:16:46.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe5a5843700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5a00c0a70 0x7fe5a00c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe5a5843700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00c1410 con 0x7fe5a014ecb0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe5a5843700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a00c9040 con 0x7fe5a014e8d0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe5a5843700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a00c9290 con 0x7fe5a00c0a70 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe59e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5a014ecb0 0x7fe5a0155570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55488/0 (socket says 172.21.15.133:55488) 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe59e7fc700 1 -- 172.21.15.133:0/1752216773 learned_addr learned my addr 172.21.15.133:0/1752216773 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097714802 0 0) 0x7fe590001110 con 0x7fe5a014ecb0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5880033f0 con 0x7fe5a014ecb0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.292+0000 7fe59f7fe700 1 --2- 172.21.15.133:0/1752216773 >> v2:172.21.15.178:3300/0 conn(0x7fe5a00c0a70 0x7fe5a00c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 776933368 0 0) 0x7fe5880033f0 con 0x7fe5a014ecb0 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 >> v2:172.21.15.178:3300/0 conn(0x7fe5a00c0a70 msgr2=0x7fe5a00c0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 --2- 172.21.15.133:0/1752216773 >> v2:172.21.15.178:3300/0 conn(0x7fe5a00c0a70 0x7fe5a00c0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 >> v1:172.21.15.178:6789/0 conn(0x7fe5a014e8d0 legacy=0x7fe5a005e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00c9570 con 0x7fe5a014ecb0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe590001600 con 0x7fe5a014ecb0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 >> v1:172.21.15.133:6789/0 conn(0x7fe5a014ecb0 legacy=0x7fe5a0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5880038e0 0x7fe588003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588004690 0x7fe588004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe58800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00c9290 con 0x7fe588005000 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe588014770 con 0x7fe588004690 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe588014900 con 0x7fe5880038e0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe58800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588004690 0x7fe588004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59effd700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5880038e0 0x7fe588003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 -- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5880038e0 msgr2=0x7fe588003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5880038e0 0x7fe588003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 -- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588004690 msgr2=0x7fe588004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588004690 0x7fe588004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 -- 172.21.15.133:0/1752216773 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880033f0 con 0x7fe588005000 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588004690 0x7fe588004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 -- 172.21.15.133:0/1752216773 reap_dead start 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59f7fe700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe58800b8e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe59800e1c0 tx=0x7fe59800b040).ready entity=mon.0 client_cookie=3164cee45d037184 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598017070 con 0x7fe588005000 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59800f040 con 0x7fe588005000 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.293+0000 7fe59dffb700 1 -- 172.21.15.133:0/1752216773 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59800eca0 con 0x7fe588005000 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 -- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 msgr2=0x7fe58800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe58800b8e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fe59800e1c0 tx=0x7fe59800b040).stop 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 -- 172.21.15.133:0/1752216773 shutdown_connections 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 --2- 172.21.15.133:0/1752216773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe58800b8e0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 -- 172.21.15.133:0/1752216773 >> 172.21.15.133:0/1752216773 conn(0x7fe5a0084eb0 msgr2=0x7fe5a00947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 -- 172.21.15.133:0/1752216773 shutdown_connections 2024-01-21T20:16:46.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.294+0000 7fe5a5843700 1 -- 172.21.15.133:0/1752216773 wait complete. 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.295+0000 7fe5a5843700 1 Processor -- start 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.295+0000 7fe5a5843700 1 -- start start 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 0x7fe5a00ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a00ae5e0 0x7fe5a00a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00aea60 con 0x7fe588005000 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00ab680 con 0x7fe5a00b0dc0 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe5a5843700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a00aad50 con 0x7fe5a00ae5e0 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe59effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe59effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60878/0 (socket says 172.21.15.133:60878) 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.296+0000 7fe59effd700 1 -- 172.21.15.133:0/62210770 learned_addr learned my addr 172.21.15.133:0/62210770 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 0x7fe5a00ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 -- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a00ae5e0 msgr2=0x7fe5a00a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a00ae5e0 0x7fe5a00a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:46.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 -- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 msgr2=0x7fe5a00ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 0x7fe5a00ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 -- 172.21.15.133:0/62210770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a00ab030 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 0x7fe5a00ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe59effd700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fe59400e460 tx=0x7fe594009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594001410 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594010040 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594001780 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a00ab310 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.297+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a00a9bb0 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.298+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a00ab960 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.298+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fe594001b70 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.298+0000 7fe5877fe700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 0x7fe58c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.299+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 7395+0+0 (secure 0 0 0) 0x7fe59407a170 con 0x7fe588005000 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.299+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 0x7fe58c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:46.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.299+0000 7fe59e7fc700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 0x7fe58c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe590001730 tx=0x7fe590000cc0).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:46.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.303+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe59404b110 con 0x7fe588005000 2024-01-21T20:16:46.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:46.469+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5a005fdf0 con 0x7fe588005000 2024-01-21T20:16:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.155+0000 7fe5877fe700 1 -- 172.21.15.133:0/62210770 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe59404e730 con 0x7fe588005000 2024-01-21T20:16:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.159+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 msgr2=0x7fe58c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.159+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 0x7fe58c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe590001730 tx=0x7fe590000cc0).stop 2024-01-21T20:16:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.159+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 msgr2=0x7fe5a0149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:47.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.159+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fe59400e460 tx=0x7fe594009040).stop 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 shutdown_connections 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe58c05f030 0x7fe58c0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5a00ae5e0 0x7fe5a00a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe588005000 0x7fe5a0149b20 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 --2- 172.21.15.133:0/62210770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a00b0dc0 0x7fe5a00ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 >> 172.21.15.133:0/62210770 conn(0x7fe5a0084eb0 msgr2=0x7fe5a00c5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:47.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 shutdown_connections 2024-01-21T20:16:47.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.160+0000 7fe5a5843700 1 -- 172.21.15.133:0/62210770 wait complete. 2024-01-21T20:16:47.151 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:16:47.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:16:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.301+0000 7fca4f4f5700 1 Processor -- start 2024-01-21T20:16:47.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.301+0000 7fca4f4f5700 1 -- start start 2024-01-21T20:16:47.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4f4f5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca481520d0 0x7fca480668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4f4f5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca480c3cc0 0x7fca480bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4f4f5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca480c4150 con 0x7fca48066dd0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4f4f5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca48156a10 con 0x7fca480c3cc0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4f4f5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca48155e70 con 0x7fca481520d0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca480c3cc0 0x7fca480bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca480c3cc0 0x7fca480bdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60880/0 (socket says 172.21.15.133:60880) 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 -- 172.21.15.133:0/253675256 learned_addr learned my addr 172.21.15.133:0/253675256 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 -- 172.21.15.133:0/253675256 >> v2:172.21.15.178:3300/0 conn(0x7fca481520d0 msgr2=0x7fca480668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 --2- 172.21.15.133:0/253675256 >> v2:172.21.15.178:3300/0 conn(0x7fca481520d0 0x7fca480668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 -- 172.21.15.133:0/253675256 >> v1:172.21.15.178:6789/0 conn(0x7fca48066dd0 legacy=0x7fca480c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 -- 172.21.15.133:0/253675256 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48067250 con 0x7fca480c3cc0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.302+0000 7fca4da92700 1 --2- 172.21.15.133:0/253675256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca480bdf00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7fca4806c490 tx=0x7fca40009840).ready entity=mon.0 client_cookie=bf35be1bc5d4196b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca3ffff700 1 -- 172.21.15.133:0/253675256 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000e070 con 0x7fca480c3cc0 2024-01-21T20:16:47.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca3ffff700 1 -- 172.21.15.133:0/253675256 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000ba10 con 0x7fca480c3cc0 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca3ffff700 1 -- 172.21.15.133:0/253675256 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000bd90 con 0x7fca480c3cc0 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 -- 172.21.15.133:0/253675256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 msgr2=0x7fca480bdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/253675256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca480bdf00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7fca4806c490 tx=0x7fca40009840).stop 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 -- 172.21.15.133:0/253675256 shutdown_connections 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/253675256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca480bdf00 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/253675256 >> v2:172.21.15.178:3300/0 conn(0x7fca481520d0 0x7fca480668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 -- 172.21.15.133:0/253675256 >> 172.21.15.133:0/253675256 conn(0x7fca480c8f10 msgr2=0x7fca480c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 -- 172.21.15.133:0/253675256 shutdown_connections 2024-01-21T20:16:47.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.303+0000 7fca4f4f5700 1 -- 172.21.15.133:0/253675256 wait complete. 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.304+0000 7fca4f4f5700 1 Processor -- start 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.304+0000 7fca4f4f5700 1 -- start start 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 0x7fca4814bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca481520d0 0x7fca480c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca48162480 con 0x7fca480c3cc0 2024-01-21T20:16:47.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c3280 con 0x7fca481520d0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4f4f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480c3560 con 0x7fca48066dd0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4ca90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4ca90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60888/0 (socket says 172.21.15.133:60888) 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4ca90700 1 -- 172.21.15.133:0/3789795234 learned_addr learned my addr 172.21.15.133:0/3789795234 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4da92700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca481520d0 0x7fca480c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.305+0000 7fca4d291700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 0x7fca4814bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 -- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 msgr2=0x7fca4814bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 0x7fca4814bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 -- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca481520d0 msgr2=0x7fca480c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca481520d0 0x7fca480c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 -- 172.21.15.133:0/3789795234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40009ae0 con 0x7fca480c3cc0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4d291700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 0x7fca4814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4ca90700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7fca4400b490 tx=0x7fca44006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400be90 con 0x7fca480c3cc0 2024-01-21T20:16:47.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca44002320 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca480c3840 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440026e0 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.306+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca48162e00 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.307+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4805fdf0 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.307+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 47) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fca44002a90 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.308+0000 7fca3dffb700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 0x7fca2c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.308+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6899+0+0 (secure 0 0 0) 0x7fca4407a070 con 0x7fca480c3cc0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.308+0000 7fca4d291700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 0x7fca2c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:47.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.308+0000 7fca4d291700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 0x7fca2c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca48151a20 tx=0x7fca38008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:47.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.312+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca4404b200 con 0x7fca480c3cc0 2024-01-21T20:16:47.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.474+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca481560e0 con 0x7fca480c3cc0 2024-01-21T20:16:47.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:47.721+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fca4407c170 con 0x7fca480c3cc0 2024-01-21T20:16:47.887 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:16:47.889 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:16:48.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.160+0000 7fca3dffb700 1 -- 172.21.15.133:0/3789795234 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca440723a0 con 0x7fca480c3cc0 2024-01-21T20:16:48.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.165+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 msgr2=0x7fca2c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.165+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 0x7fca2c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca48151a20 tx=0x7fca38008040).stop 2024-01-21T20:16:48.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.165+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 msgr2=0x7fca48162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.165+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7fca4400b490 tx=0x7fca44006f00).stop 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 shutdown_connections 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca2c05f030 0x7fca2c0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca481520d0 0x7fca480c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca48066dd0 0x7fca4814bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 --2- 172.21.15.133:0/3789795234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480c3cc0 0x7fca48162910 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.167+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 >> 172.21.15.133:0/3789795234 conn(0x7fca480c8f10 msgr2=0x7fca4814c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.171+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 shutdown_connections 2024-01-21T20:16:48.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.171+0000 7fca4f4f5700 1 -- 172.21.15.133:0/3789795234 wait complete. 2024-01-21T20:16:48.161 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:16:48.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:16:48.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.303+0000 7f87ea3e3700 1 Processor -- start 2024-01-21T20:16:48.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.303+0000 7f87ea3e3700 1 -- start start 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87ea3e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87e40a9d10 0x7f87e40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87ea3e3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e41558d0 0x7f87e4063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87ea3e3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4063750 con 0x7f87e40aa0f0 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87ea3e3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40640d0 con 0x7f87e40a9d10 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87ea3e3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e405e380 con 0x7f87e41558d0 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87e3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87e40a9d10 0x7f87e40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87e3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87e40a9d10 0x7f87e40ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60896/0 (socket says 172.21.15.133:60896) 2024-01-21T20:16:48.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87e3fff700 1 -- 172.21.15.133:0/3250988234 learned_addr learned my addr 172.21.15.133:0/3250988234 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.304+0000 7f87e8980700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e41558d0 0x7f87e4063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e3fff700 1 -- 172.21.15.133:0/3250988234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e41558d0 msgr2=0x7f87e4063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e3fff700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e41558d0 0x7f87e4063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e3fff700 1 -- 172.21.15.133:0/3250988234 >> v1:172.21.15.178:6789/0 conn(0x7f87e40aa0f0 legacy=0x7f87e41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e3fff700 1 -- 172.21.15.133:0/3250988234 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e405e660 con 0x7f87e40a9d10 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e3fff700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e40ad410 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f87d4006fd0 tx=0x7f87d40090f0).ready entity=mon.0 client_cookie=a4f5df47005695ec server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e2ffd700 1 -- 172.21.15.133:0/3250988234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400b600 con 0x7f87e40a9d10 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e2ffd700 1 -- 172.21.15.133:0/3250988234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d400b760 con 0x7f87e40a9d10 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87e2ffd700 1 -- 172.21.15.133:0/3250988234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bb00 con 0x7f87e40a9d10 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3250988234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 msgr2=0x7f87e40ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e40ad410 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f87d4006fd0 tx=0x7f87d40090f0).stop 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3250988234 shutdown_connections 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e40ad410 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3250988234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e41558d0 0x7f87e4063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3250988234 >> 172.21.15.133:0/3250988234 conn(0x7f87e40c8200 msgr2=0x7f87e40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.305+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3250988234 shutdown_connections 2024-01-21T20:16:48.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.306+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3250988234 wait complete. 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.307+0000 7f87ea3e3700 1 Processor -- start 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.307+0000 7f87ea3e3700 1 -- start start 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e40aa0f0 0x7f87e414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 0x7f87e414c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e414ca80 con 0x7f87e40a9d10 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e414cd60 con 0x7f87e41558d0 2024-01-21T20:16:48.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e414d040 con 0x7f87e40aa0f0 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60912/0 (socket says 172.21.15.133:60912) 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 -- 172.21.15.133:0/3585765638 learned_addr learned my addr 172.21.15.133:0/3585765638 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 -- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e40aa0f0 msgr2=0x7f87e414bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e8980700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 0x7f87e414c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e37fe700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e40aa0f0 0x7f87e414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e40aa0f0 0x7f87e414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 -- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 msgr2=0x7f87e414c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 0x7f87e414c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 -- 172.21.15.133:0/3585765638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d4009370 con 0x7f87e40a9d10 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e8980700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 0x7f87e414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e3fff700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f87e405f8e0 tx=0x7f87d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bec0 con 0x7f87e40a9d10 2024-01-21T20:16:48.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4006930 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d400bb00 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e414d320 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.308+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4149dc0 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e414d7c0 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f87d4021070 con 0x7f87e40a9d10 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87e0ff9700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 0x7f87c40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f87d407bd60 con 0x7f87e40a9d10 2024-01-21T20:16:48.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87e37fe700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 0x7f87c40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.310+0000 7f87e37fe700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 0x7f87c40615e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f87cc001680 tx=0x7f87cc009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.314+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f87d404cfe0 con 0x7f87e40a9d10 2024-01-21T20:16:48.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.478+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f87e414d970 con 0x7f87e40a9d10 2024-01-21T20:16:48.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.482+0000 7f87e0ff9700 1 -- 172.21.15.133:0/3585765638 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f87d4029070 con 0x7f87e40a9d10 2024-01-21T20:16:48.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 msgr2=0x7f87c40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 0x7f87c40615e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f87cc001680 tx=0x7f87cc009040).stop 2024-01-21T20:16:48.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 msgr2=0x7f87e41498d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f87e405f8e0 tx=0x7f87d4017000).stop 2024-01-21T20:16:48.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 shutdown_connections 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f87c405f120 0x7f87c40615e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87e41558d0 0x7f87e414c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87e40a9d10 0x7f87e41498d0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 --2- 172.21.15.133:0/3585765638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87e40aa0f0 0x7f87e414bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 >> 172.21.15.133:0/3585765638 conn(0x7f87e40c8200 msgr2=0x7f87e40c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 shutdown_connections 2024-01-21T20:16:48.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.484+0000 7f87ea3e3700 1 -- 172.21.15.133:0/3585765638 wait complete. 2024-01-21T20:16:48.485 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:16:48.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.613+0000 7f7983f33700 1 Processor -- start 2024-01-21T20:16:48.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.613+0000 7f7983f33700 1 -- start start 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f7983f33700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f797c062e00 0x7f797c15d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f7983f33700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0a50f0 con 0x7f797c155ca0 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f7983f33700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0a4da0 con 0x7f797c1558c0 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f7983f33700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0bde00 con 0x7f797c062e00 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f79814ce700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f797c155ca0 0x7f797c0bd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55498/0 (socket says 172.21.15.133:55498) 2024-01-21T20:16:48.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.614+0000 7f79814ce700 1 -- 172.21.15.133:0/1702604075 learned_addr learned my addr 172.21.15.133:0/1702604075 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79824d0700 1 --2- 172.21.15.133:0/1702604075 >> v2:172.21.15.178:3300/0 conn(0x7f797c062e00 0x7f797c15d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568368203 0 0) 0x7f797c0a50f0 con 0x7f797c155ca0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79680033f0 con 0x7f797c155ca0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195019250 0 0) 0x7f797c0a4da0 con 0x7f797c1558c0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c0a50f0 con 0x7f797c1558c0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 777050180 0 0) 0x7f79680033f0 con 0x7f797c155ca0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 >> v2:172.21.15.178:3300/0 conn(0x7f797c062e00 msgr2=0x7f797c15d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 --2- 172.21.15.133:0/1702604075 >> v2:172.21.15.178:3300/0 conn(0x7f797c062e00 0x7f797c15d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 >> v1:172.21.15.178:6789/0 conn(0x7f797c1558c0 legacy=0x7f797c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0be0e0 con 0x7f797c155ca0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f7978001470 con 0x7f797c155ca0 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 >> v1:172.21.15.133:6789/0 conn(0x7f797c155ca0 legacy=0x7f797c0bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968003ac0 0x7f7968003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 0x7f7968004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7968005070 0x7f796800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0bde00 con 0x7f7968004690 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796800c010 con 0x7f7968005070 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796800c1d0 con 0x7f7968003ac0 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 0x7f7968004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f7981ccf700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968003ac0 0x7f7968003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79824d0700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7968005070 0x7f796800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 -- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968003ac0 msgr2=0x7f7968003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968003ac0 0x7f7968003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 -- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7968005070 msgr2=0x7f796800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7968005070 0x7f796800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79814ce700 1 -- 172.21.15.133:0/1702604075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680033f0 con 0x7f7968004690 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.615+0000 7f79824d0700 1 -- 172.21.15.133:0/1702604075 reap_dead start 2024-01-21T20:16:48.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f79814ce700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 0x7f7968004b10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f7978007f80 tx=0x7f797c0c3d70).ready entity=mon.0 client_cookie=70670a34b8038c37 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800c980 con 0x7f7968004690 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797800cae0 con 0x7f7968004690 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7980ccd700 1 -- 172.21.15.133:0/1702604075 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797800ce80 con 0x7f7968004690 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 -- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 msgr2=0x7f7968004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 0x7f7968004b10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f7978007f80 tx=0x7f797c0c3d70).stop 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 -- 172.21.15.133:0/1702604075 shutdown_connections 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 --2- 172.21.15.133:0/1702604075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7968004690 0x7f7968004b10 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 -- 172.21.15.133:0/1702604075 >> 172.21.15.133:0/1702604075 conn(0x7f797c0c8010 msgr2=0x7f797c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 -- 172.21.15.133:0/1702604075 shutdown_connections 2024-01-21T20:16:48.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.616+0000 7f7983f33700 1 -- 172.21.15.133:0/1702604075 wait complete. 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 Processor -- start 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 -- start start 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968004690 0x7f797c1667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f797c14f300 0x7f797c13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0ac700 con 0x7f797c0bfdc0 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c0730 con 0x7f797c14f300 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f7983f33700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c166cd0 con 0x7f7968004690 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f79824d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f79824d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60942/0 (socket says 172.21.15.133:60942) 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.618+0000 7f79824d0700 1 -- 172.21.15.133:0/3569150352 learned_addr learned my addr 172.21.15.133:0/3569150352 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f7981ccf700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968004690 0x7f797c1667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79814ce700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f797c14f300 0x7f797c13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 -- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968004690 msgr2=0x7f797c1667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968004690 0x7f797c1667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 -- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f797c14f300 msgr2=0x7f797c13fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f797c14f300 0x7f797c13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 -- 172.21.15.133:0/3569150352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c14f870 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79824d0700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f797c0c45b0 tx=0x7f797400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400e070 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011c60 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c14fb50 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974016450 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.619+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c150110 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.620+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0ac870 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.620+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f797401f3b0 con 0x7f797c0bfdc0 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.621+0000 7f79727fc700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 0x7f7960061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.621+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f797407a7a0 con 0x7f797c0bfdc0 2024-01-21T20:16:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.621+0000 7f7981ccf700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 0x7f7960061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.621+0000 7f7981ccf700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 0x7f7960061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f796c000c00 tx=0x7f796c009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.625+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f797404b9c0 con 0x7f797c0bfdc0 2024-01-21T20:16:48.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.790+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f797c0aaad0 con 0x7f797c0bfdc0 2024-01-21T20:16:48.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.793+0000 7f79727fc700 1 -- 172.21.15.133:0/3569150352 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f797404efe0 con 0x7f797c0bfdc0 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 msgr2=0x7f7960061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 0x7f7960061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f796c000c00 tx=0x7f796c009040).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 msgr2=0x7f797c0c0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f797c0c45b0 tx=0x7f797400b040).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 shutdown_connections 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f796005f150 0x7f7960061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f797c0bfdc0 0x7f797c0c0240 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7968004690 0x7f797c1667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 --2- 172.21.15.133:0/3569150352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f797c14f300 0x7f797c13fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 >> 172.21.15.133:0/3569150352 conn(0x7f797c0c8010 msgr2=0x7f797c150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 shutdown_connections 2024-01-21T20:16:48.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.795+0000 7f7983f33700 1 -- 172.21.15.133:0/3569150352 wait complete. 2024-01-21T20:16:48.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2024-01-21T20:16:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.924+0000 7f93493bf700 1 Processor -- start 2024-01-21T20:16:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.924+0000 7f93493bf700 1 -- start start 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93493bf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 0x7f9344158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93493bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9344154520 0x7f93440ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93493bf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440ab620 con 0x7f93440c6090 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93493bf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440c6ae0 con 0x7f9344154520 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93493bf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440c05e0 con 0x7f9344154140 2024-01-21T20:16:48.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93427fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9344154520 0x7f93440ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93427fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9344154520 0x7f93440ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60944/0 (socket says 172.21.15.133:60944) 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f93427fc700 1 -- 172.21.15.133:0/861151811 learned_addr learned my addr 172.21.15.133:0/861151811 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.925+0000 7f9342ffd700 1 --2- 172.21.15.133:0/861151811 >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 0x7f9344158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93427fc700 1 -- 172.21.15.133:0/861151811 >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 msgr2=0x7f9344158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93427fc700 1 --2- 172.21.15.133:0/861151811 >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 0x7f9344158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93427fc700 1 -- 172.21.15.133:0/861151811 >> v1:172.21.15.133:6789/0 conn(0x7f93440c6090 legacy=0x7f93440c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93427fc700 1 -- 172.21.15.133:0/861151811 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440c0e40 con 0x7f9344154520 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f9342ffd700 1 --2- 172.21.15.133:0/861151811 >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 0x7f9344158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93427fc700 1 --2- 172.21.15.133:0/861151811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f93440ab130 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f9344083d70 tx=0x7f93340090f0).ready entity=mon.0 client_cookie=ac395f40a45647fe server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f9341ffb700 1 -- 172.21.15.133:0/861151811 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400b600 con 0x7f9344154520 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f9341ffb700 1 -- 172.21.15.133:0/861151811 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933400b760 con 0x7f9344154520 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f9341ffb700 1 -- 172.21.15.133:0/861151811 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400bae0 con 0x7f9344154520 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 -- 172.21.15.133:0/861151811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 msgr2=0x7f93440ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 --2- 172.21.15.133:0/861151811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f93440ab130 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f9344083d70 tx=0x7f93340090f0).stop 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 -- 172.21.15.133:0/861151811 shutdown_connections 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 --2- 172.21.15.133:0/861151811 >> v2:172.21.15.178:3300/0 conn(0x7f9344154140 0x7f9344158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 --2- 172.21.15.133:0/861151811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f93440ab130 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 -- 172.21.15.133:0/861151811 >> 172.21.15.133:0/861151811 conn(0x7f934405e1e0 msgr2=0x7f934405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 -- 172.21.15.133:0/861151811 shutdown_connections 2024-01-21T20:16:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.926+0000 7f93493bf700 1 -- 172.21.15.133:0/861151811 wait complete. 2024-01-21T20:16:48.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 Processor -- start 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 -- start start 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93440c6090 0x7f93440af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9344154140 0x7f934413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934413f300 con 0x7f9344154520 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.928+0000 7f93493bf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93440b03a0 con 0x7f9344154140 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93493bf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9344153350 con 0x7f93440c6090 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60960/0 (socket says 172.21.15.133:60960) 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 -- 172.21.15.133:0/587169285 learned_addr learned my addr 172.21.15.133:0/587169285 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 -- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93440c6090 msgr2=0x7f93440af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93440c6090 0x7f93440af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:48.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93427fc700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9344154140 0x7f934413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 -- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9344154140 msgr2=0x7f934413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9344154140 0x7f934413ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 -- 172.21.15.133:0/587169285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334009370 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93437fe700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f933c002230 tx=0x7f933c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c010510 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c010670 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0109f0 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93440afa70 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.929+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93440b0030 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.930+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93440af810 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.930+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f933c01b400 con 0x7f9344154520 2024-01-21T20:16:48.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.931+0000 7f932b7fe700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 0x7f9330061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:48.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.931+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f933c07a160 con 0x7f9344154520 2024-01-21T20:16:48.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.931+0000 7f9342ffd700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 0x7f9330061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:48.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.931+0000 7f9342ffd700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 0x7f9330061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9338006fd0 tx=0x7f9338008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:48.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:48.935+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f933c04b2d0 con 0x7f9344154520 2024-01-21T20:16:49.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:49.173+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f93440b0510 con 0x7f9344154520 2024-01-21T20:16:50.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.168+0000 7f932b7fe700 1 -- 172.21.15.133:0/587169285 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v650) v1 ==== 183+0+0 (secure 0 0 0) 0x7f933c04e8f0 con 0x7f9344154520 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 msgr2=0x7f9330061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 0x7f9330061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9338006fd0 tx=0x7f9338008040).stop 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 msgr2=0x7f9344152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f933c002230 tx=0x7f933c0015e0).stop 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 shutdown_connections 2024-01-21T20:16:50.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f933005f150 0x7f9330061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9344154520 0x7f9344152e60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93440c6090 0x7f93440af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 --2- 172.21.15.133:0/587169285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9344154140 0x7f934413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 >> 172.21.15.133:0/587169285 conn(0x7f934405e1e0 msgr2=0x7f934414dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 shutdown_connections 2024-01-21T20:16:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.171+0000 7f93493bf700 1 -- 172.21.15.133:0/587169285 wait complete. 2024-01-21T20:16:50.175 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2024-01-21T20:16:50.175 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2024-01-21T20:16:50.175 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:16:50.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2024-01-21T20:16:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.308+0000 7efe32c91700 1 Processor -- start 2024-01-21T20:16:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.309+0000 7efe32c91700 1 -- start start 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.309+0000 7efe32c91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe2c067d90 0x7efe2c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.309+0000 7efe32c91700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c068370 con 0x7efe2c0c5930 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.309+0000 7efe32c91700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c068650 con 0x7efe2c137030 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.309+0000 7efe32c91700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c068930 con 0x7efe2c067d90 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe2c067d90 0x7efe2c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe2c067d90 0x7efe2c137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34168/0 (socket says 172.21.15.133:34168) 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 -- 172.21.15.133:0/1158008485 learned_addr learned my addr 172.21.15.133:0/1158008485 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 -- 172.21.15.133:0/1158008485 >> v1:172.21.15.178:6789/0 conn(0x7efe2c137030 legacy=0x7efe2c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 -- 172.21.15.133:0/1158008485 >> v1:172.21.15.133:6789/0 conn(0x7efe2c0c5930 legacy=0x7efe2c0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 -- 172.21.15.133:0/1158008485 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c068c10 con 0x7efe2c067d90 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2b7fe700 1 -- 172.21.15.133:0/1158008485 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260277354 0 0) 0x7efe2c068370 con 0x7efe2c0c5930 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2bfff700 1 --2- 172.21.15.133:0/1158008485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c137410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7efe18006fd0 tx=0x7efe180090f0).ready entity=mon.0 client_cookie=f2a639f6b3b9afc9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2b7fe700 1 -- 172.21.15.133:0/1158008485 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800b600 con 0x7efe2c067d90 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2b7fe700 1 -- 172.21.15.133:0/1158008485 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800b760 con 0x7efe2c067d90 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.310+0000 7efe2b7fe700 1 -- 172.21.15.133:0/1158008485 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1800bb00 con 0x7efe2c067d90 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 -- 172.21.15.133:0/1158008485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 msgr2=0x7efe2c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 --2- 172.21.15.133:0/1158008485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c137410 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7efe18006fd0 tx=0x7efe180090f0).stop 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 -- 172.21.15.133:0/1158008485 shutdown_connections 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 --2- 172.21.15.133:0/1158008485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c137410 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 -- 172.21.15.133:0/1158008485 >> 172.21.15.133:0/1158008485 conn(0x7efe2c066a90 msgr2=0x7efe2c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 -- 172.21.15.133:0/1158008485 shutdown_connections 2024-01-21T20:16:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.311+0000 7efe32c91700 1 -- 172.21.15.133:0/1158008485 wait complete. 2024-01-21T20:16:50.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.312+0000 7efe32c91700 1 Processor -- start 2024-01-21T20:16:50.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.312+0000 7efe32c91700 1 -- start start 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2c0c5930 0x7efe2c0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2c137030 0x7efe2c0bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0bffa0 con 0x7efe2c067d90 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0c0e00 con 0x7efe2c0c5930 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe32c91700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c136e30 con 0x7efe2c137030 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34178/0 (socket says 172.21.15.133:34178) 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 -- 172.21.15.133:0/1792145528 learned_addr learned my addr 172.21.15.133:0/1792145528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe2bfff700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2c0c5930 0x7efe2c0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe3122e700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2c137030 0x7efe2c0bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 -- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2c137030 msgr2=0x7efe2c0bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2c137030 0x7efe2c0bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 -- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2c0c5930 msgr2=0x7efe2c0c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2c0c5930 0x7efe2c0c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 -- 172.21.15.133:0/1792145528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18009370 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.313+0000 7efe30a2d700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7efe2000c4c0 tx=0x7efe20007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.314+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20007020 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.314+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20001e90 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.314+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200073b0 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.314+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c0c01f0 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.314+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0c07b0 con 0x7efe2c067d90 2024-01-21T20:16:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.315+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c05fdf0 con 0x7efe2c067d90 2024-01-21T20:16:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.315+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe200068b0 con 0x7efe2c067d90 2024-01-21T20:16:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.316+0000 7efe297fa700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 0x7efe10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.316+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7efe2007a430 con 0x7efe2c067d90 2024-01-21T20:16:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.316+0000 7efe2bfff700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 0x7efe10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.316+0000 7efe2bfff700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 0x7efe10061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efe18009130 tx=0x7efe18017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:50.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.320+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe2004b5c0 con 0x7efe2c067d90 2024-01-21T20:16:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:50.546+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7efe2c0bf740 con 0x7efe2c067d90 2024-01-21T20:16:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.172+0000 7efe297fa700 1 -- 172.21.15.133:0/1792145528 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v651) v1 ==== 151+0+0 (secure 0 0 0) 0x7efe2004ebe0 con 0x7efe2c067d90 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 msgr2=0x7efe10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 0x7efe10061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efe18009130 tx=0x7efe18017000).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 msgr2=0x7efe2c136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7efe2000c4c0 tx=0x7efe20007e00).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 shutdown_connections 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1005f150 0x7efe10061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2c137030 0x7efe2c0bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe2c067d90 0x7efe2c136940 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 --2- 172.21.15.133:0/1792145528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe2c0c5930 0x7efe2c0c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 >> 172.21.15.133:0/1792145528 conn(0x7efe2c066a90 msgr2=0x7efe2c157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.174+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 shutdown_connections 2024-01-21T20:16:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.175+0000 7efe32c91700 1 -- 172.21.15.133:0/1792145528 wait complete. 2024-01-21T20:16:51.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:16:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.305+0000 7f47a965c700 1 Processor -- start 2024-01-21T20:16:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.305+0000 7f47a965c700 1 -- start start 2024-01-21T20:16:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a965c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41545a0 0x7f47a40c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a965c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a40c67b0 0x7f47a40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a965c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40c89d0 con 0x7f47a40aa360 2024-01-21T20:16:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a965c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40c7dc0 con 0x7f47a41545a0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a965c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40c80a0 con 0x7f47a40c67b0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41545a0 0x7f47a40c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41545a0 0x7f47a40c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34182/0 (socket says 172.21.15.133:34182) 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 -- 172.21.15.133:0/4276101137 learned_addr learned my addr 172.21.15.133:0/4276101137 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 -- 172.21.15.133:0/4276101137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a40c67b0 msgr2=0x7f47a40c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 --2- 172.21.15.133:0/4276101137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a40c67b0 0x7f47a40c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 -- 172.21.15.133:0/4276101137 >> v1:172.21.15.178:6789/0 conn(0x7f47a40aa360 legacy=0x7f47a40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 -- 172.21.15.133:0/4276101137 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40c8380 con 0x7f47a41545a0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.306+0000 7f47a2ffd700 1 --2- 172.21.15.133:0/4276101137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41545a0 0x7f47a40c77b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f4798006fd0 tx=0x7f47980090f0).ready entity=mon.0 client_cookie=21d8840f942ac0ff server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a1ffb700 1 -- 172.21.15.133:0/4276101137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800b600 con 0x7f47a41545a0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a1ffb700 1 -- 172.21.15.133:0/4276101137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800b760 con 0x7f47a41545a0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a1ffb700 1 -- 172.21.15.133:0/4276101137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800bb00 con 0x7f47a41545a0 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 -- 172.21.15.133:0/4276101137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41545a0 msgr2=0x7f47a40c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 --2- 172.21.15.133:0/4276101137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41545a0 0x7f47a40c77b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f4798006fd0 tx=0x7f47980090f0).stop 2024-01-21T20:16:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 -- 172.21.15.133:0/4276101137 shutdown_connections 2024-01-21T20:16:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 --2- 172.21.15.133:0/4276101137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41545a0 0x7f47a40c77b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 --2- 172.21.15.133:0/4276101137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a40c67b0 0x7f47a40c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 -- 172.21.15.133:0/4276101137 >> 172.21.15.133:0/4276101137 conn(0x7f47a40649d0 msgr2=0x7f47a4064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 -- 172.21.15.133:0/4276101137 shutdown_connections 2024-01-21T20:16:51.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.307+0000 7f47a965c700 1 -- 172.21.15.133:0/4276101137 wait complete. 2024-01-21T20:16:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.308+0000 7f47a965c700 1 Processor -- start 2024-01-21T20:16:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 -- start start 2024-01-21T20:16:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 0x7f47a414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a41545a0 0x7f47a40ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4151f20 con 0x7f47a40aa360 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41520b0 con 0x7f47a40c67b0 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a965c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40af510 con 0x7f47a41545a0 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34198/0 (socket says 172.21.15.133:34198) 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.309+0000 7f47a2ffd700 1 -- 172.21.15.133:0/203188358 learned_addr learned my addr 172.21.15.133:0/203188358 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 -- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a41545a0 msgr2=0x7f47a40ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a41545a0 0x7f47a40ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 -- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 msgr2=0x7f47a414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a27fc700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 0x7f47a414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 0x7f47a414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 -- 172.21.15.133:0/203188358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4798009370 con 0x7f47a40aa360 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a27fc700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 0x7f47a414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a2ffd700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f47a4084670 tx=0x7f4798017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798002f70 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980069b0 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40af7f0 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800b8d0 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.310+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a41508f0 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.311+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4150b10 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.311+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4798022030 con 0x7f47a40aa360 2024-01-21T20:16:51.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.312+0000 7f478b7fe700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 0x7f4790061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.312+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7f479807c170 con 0x7f47a40aa360 2024-01-21T20:16:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.312+0000 7f47a27fc700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 0x7f4790061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.312+0000 7f47a27fc700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 0x7f4790061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f47a4065950 tx=0x7f4794008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.316+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f479804d340 con 0x7f47a40aa360 2024-01-21T20:16:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.479+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f47a40af9e0 con 0x7f47a40aa360 2024-01-21T20:16:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.483+0000 7f478b7fe700 1 -- 172.21.15.133:0/203188358 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f479802a070 con 0x7f47a40aa360 2024-01-21T20:16:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 msgr2=0x7f4790061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 0x7f4790061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f47a4065950 tx=0x7f4794008040).stop 2024-01-21T20:16:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 msgr2=0x7f47a4150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7f47a4084670 tx=0x7f4798017000).stop 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 shutdown_connections 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f479005f150 0x7f4790061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47a41545a0 0x7f47a40ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a40aa360 0x7f47a4150400 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 --2- 172.21.15.133:0/203188358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47a40c67b0 0x7f47a414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 >> 172.21.15.133:0/203188358 conn(0x7f47a40649d0 msgr2=0x7f47a40c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 shutdown_connections 2024-01-21T20:16:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.485+0000 7f47a965c700 1 -- 172.21.15.133:0/203188358 wait complete. 2024-01-21T20:16:51.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:16:51.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:16:51.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:16:51.577 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:16:51.577 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:16:51.577 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:16:51.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.703+0000 7fa110a9c700 1 Processor -- start 2024-01-21T20:16:51.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.703+0000 7fa110a9c700 1 -- start start 2024-01-21T20:16:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa110a9c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa10c0acbc0 0x7fa10c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa110a9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c066460 0x7fa10c0634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa110a9c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa10c065fd0 con 0x7fa10c1521e0 2024-01-21T20:16:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa110a9c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10c152d20 con 0x7fa10c0acbc0 2024-01-21T20:16:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa110a9c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0653c0 con 0x7fa10c066460 2024-01-21T20:16:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.704+0000 7fa10a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa10c0acbc0 0x7fa10c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa10c0acbc0 0x7fa10c0acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34204/0 (socket says 172.21.15.133:34204) 2024-01-21T20:16:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 -- 172.21.15.133:0/1115515586 learned_addr learned my addr 172.21.15.133:0/1115515586 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa109d9b700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c066460 0x7fa10c0634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 -- 172.21.15.133:0/1115515586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c066460 msgr2=0x7fa10c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c066460 0x7fa10c0634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 -- 172.21.15.133:0/1115515586 >> v1:172.21.15.178:6789/0 conn(0x7fa10c1521e0 legacy=0x7fa10c152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 -- 172.21.15.133:0/1115515586 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10c0656a0 con 0x7fa10c0acbc0 2024-01-21T20:16:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10a59c700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c0acbc0 0x7fa10c0acfa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fa0fc006fd0 tx=0x7fa0fc0090f0).ready entity=mon.0 client_cookie=3b5b60456aae24c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10959a700 1 -- 172.21.15.133:0/1115515586 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00b600 con 0x7fa10c0acbc0 2024-01-21T20:16:51.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10959a700 1 -- 172.21.15.133:0/1115515586 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00b760 con 0x7fa10c0acbc0 2024-01-21T20:16:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.705+0000 7fa10959a700 1 -- 172.21.15.133:0/1115515586 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00bb00 con 0x7fa10c0acbc0 2024-01-21T20:16:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 -- 172.21.15.133:0/1115515586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c0acbc0 msgr2=0x7fa10c0acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c0acbc0 0x7fa10c0acfa0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7fa0fc006fd0 tx=0x7fa0fc0090f0).stop 2024-01-21T20:16:51.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 -- 172.21.15.133:0/1115515586 shutdown_connections 2024-01-21T20:16:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c0acbc0 0x7fa10c0acfa0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 --2- 172.21.15.133:0/1115515586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c066460 0x7fa10c0634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 -- 172.21.15.133:0/1115515586 >> 172.21.15.133:0/1115515586 conn(0x7fa10c0c8200 msgr2=0x7fa10c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:51.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 -- 172.21.15.133:0/1115515586 shutdown_connections 2024-01-21T20:16:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.706+0000 7fa110a9c700 1 -- 172.21.15.133:0/1115515586 wait complete. 2024-01-21T20:16:51.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.707+0000 7fa110a9c700 1 Processor -- start 2024-01-21T20:16:51.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.707+0000 7fa110a9c700 1 -- start start 2024-01-21T20:16:51.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa10c066460 0x7fa10c142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c0acbc0 0x7fa10c165d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c154470 con 0x7fa10c1521e0 2024-01-21T20:16:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c166620 con 0x7fa10c066460 2024-01-21T20:16:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa110a9c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c166900 con 0x7fa10c0acbc0 2024-01-21T20:16:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34216/0 (socket says 172.21.15.133:34216) 2024-01-21T20:16:51.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 -- 172.21.15.133:0/2709911026 learned_addr learned my addr 172.21.15.133:0/2709911026 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:51.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10a59c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa10c066460 0x7fa10c142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa109d9b700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c0acbc0 0x7fa10c165d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 -- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c0acbc0 msgr2=0x7fa10c165d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c0acbc0 0x7fa10c165d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 -- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa10c066460 msgr2=0x7fa10c142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa10c066460 0x7fa10c142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.708+0000 7fa10ad9d700 1 -- 172.21.15.133:0/2709911026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc009370 con 0x7fa10c1521e0 2024-01-21T20:16:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa10ad9d700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fa104002230 tx=0x7fa1040015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400e4a0 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10400e600 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c166be0 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10400e980 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.709+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c166250 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.710+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c154620 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.710+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa10401b3b0 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.710+0000 7fa102ffd700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 0x7fa0ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.710+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6369+0+0 (secure 0 0 0) 0x7fa104079910 con 0x7fa10c1521e0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.710+0000 7fa10a59c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 0x7fa0ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.711+0000 7fa10a59c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 0x7fa0ec061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa0fc00b3c0 tx=0x7fa0fc017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:51.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.714+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa104048b00 con 0x7fa10c1521e0 2024-01-21T20:16:51.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.922+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa10c065980 con 0x7fa10c1521e0 2024-01-21T20:16:51.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.923+0000 7fa102ffd700 1 -- 172.21.15.133:0/2709911026 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fa10c154620 con 0x7fa10c1521e0 2024-01-21T20:16:51.912 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:51.912 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5948,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/914865226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":914865226},{"type":"v1","addr":"172.21.15.178:6834","nonce":914865226}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3336508281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3336508281},{"type":"v1","addr":"172.21.15.178:6835","nonce":3336508281}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":7146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/353943041","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":353943041},{"type":"v1","addr":"172.21.15.133:6836","nonce":353943041}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":7149,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/4124402354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":4124402354},{"type":"v1","addr":"172.21.15.133:6837","nonce":4124402354}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[]} 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.924+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 msgr2=0x7fa0ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.924+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 0x7fa0ec061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa0fc00b3c0 tx=0x7fa0fc017000).stop 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.924+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 msgr2=0x7fa10c14f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.924+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fa104002230 tx=0x7fa1040015e0).stop 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 shutdown_connections 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa0ec05f150 0x7fa0ec061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa10c1521e0 0x7fa10c14f830 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa10c066460 0x7fa10c142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 --2- 172.21.15.133:0/2709911026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa10c0acbc0 0x7fa10c165d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 >> 172.21.15.133:0/2709911026 conn(0x7fa10c0c8200 msgr2=0x7fa10c062810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 shutdown_connections 2024-01-21T20:16:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:51.925+0000 7fa110a9c700 1 -- 172.21.15.133:0/2709911026 wait complete. 2024-01-21T20:16:51.915 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2024-01-21T20:16:51.927 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:16:51.927 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:16:51.927 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:16:51.927 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:16:51.928 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:16:51.928 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:16:51.928 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:16:51.928 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:16:51.928 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:16:51.928 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:16:51.929 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:16:51.929 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:16:51.929 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:16:51.929 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:16:51.929 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:16:51.929 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:16:51.937 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:16:51.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:16:51.938 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:16:51.938 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:16:51.941 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:16:51.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:16:51.980 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:16:51.980 DEBUG:teuthology.parallel:result is None 2024-01-21T20:16:51.981 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:16:51.981 DEBUG:teuthology.parallel:result is None 2024-01-21T20:16:51.984 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:16:51.984 DEBUG:teuthology.parallel:result is None 2024-01-21T20:16:52.055 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:16:52.055 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:16:52.068 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:16:56.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-01-21T20:16:57.941 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:16:57.941 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:16:57.944 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:16:57.944 DEBUG:teuthology.parallel:result is None 2024-01-21T20:16:57.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:16:58.029 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 Processor -- start 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 -- start start 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c0067f10 con 0x7fd0c00c5dc0 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00681f0 con 0x7fd0c00c3840 2024-01-21T20:16:58.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.087+0000 7fd0c55db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00684d0 con 0x7fd0c00c6250 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0beffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0be7fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd0c00c5dc0 0x7fd0c013a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0be7fc700 1 -- 172.21.15.133:0/3404732103 learned_addr learned my addr 172.21.15.133:0/3404732103 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0beffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:53458/0 (socket says 172.21.15.133:53458) 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:43666/0 (socket says 172.21.15.133:43666) 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bdffb700 1 -- 172.21.15.133:0/3404732103 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899380573 0 0) 0x7fd0c0067f10 con 0x7fd0c00c5dc0 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bdffb700 1 -- 172.21.15.133:0/3404732103 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0ac0033f0 con 0x7fd0c00c5dc0 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 -- 172.21.15.133:0/3404732103 >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 msgr2=0x7fd0c00c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 --2- 172.21.15.133:0/3404732103 >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 -- 172.21.15.133:0/3404732103 >> v1:172.21.15.178:6789/0 conn(0x7fd0c00c5dc0 legacy=0x7fd0c013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:58.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 -- 172.21.15.133:0/3404732103 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00687b0 con 0x7fd0c00c6250 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0beffd700 1 --2- 172.21.15.133:0/3404732103 >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.088+0000 7fd0bf7fe700 1 --2- 172.21.15.133:0/3404732103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd0b8009e60 tx=0x7fd0b8009780).ready entity=mon.2 client_cookie=b1f1ca53aa6ffa5a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0bdffb700 1 -- 172.21.15.133:0/3404732103 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800e070 con 0x7fd0c00c6250 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0bdffb700 1 -- 172.21.15.133:0/3404732103 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800bab0 con 0x7fd0c00c6250 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0bdffb700 1 -- 172.21.15.133:0/3404732103 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800be30 con 0x7fd0c00c6250 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 -- 172.21.15.133:0/3404732103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 msgr2=0x7fd0c00bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 --2- 172.21.15.133:0/3404732103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd0b8009e60 tx=0x7fd0b8009780).stop 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 -- 172.21.15.133:0/3404732103 shutdown_connections 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 --2- 172.21.15.133:0/3404732103 >> v2:172.21.15.178:3300/0 conn(0x7fd0c00c3840 0x7fd0c00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 --2- 172.21.15.133:0/3404732103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c00bdf60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 -- 172.21.15.133:0/3404732103 >> 172.21.15.133:0/3404732103 conn(0x7fd0c0066a70 msgr2=0x7fd0c0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 -- 172.21.15.133:0/3404732103 shutdown_connections 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.089+0000 7fd0c55db700 1 -- 172.21.15.133:0/3404732103 wait complete. 2024-01-21T20:16:58.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.090+0000 7fd0c55db700 1 Processor -- start 2024-01-21T20:16:58.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 -- start start 2024-01-21T20:16:58.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 0x7fd0c0164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c01312b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01336a0 con 0x7fd0c00c3840 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0132a90 con 0x7fd0c00c5dc0 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0c55db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0132d70 con 0x7fd0c00c6250 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34246/0 (socket says 172.21.15.133:34246) 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.091+0000 7fd0beffd700 1 -- 172.21.15.133:0/960422906 learned_addr learned my addr 172.21.15.133:0/960422906 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0be7fc700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 0x7fd0c0164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0bf7fe700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c01312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 -- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 msgr2=0x7fd0c01312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c01312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 -- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 msgr2=0x7fd0c0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 0x7fd0c0164eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:58.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 -- 172.21.15.133:0/960422906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00092a0 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0be7fc700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 0x7fd0c0164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0beffd700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fd0b000ea20 tx=0x7fd0b0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b000c850 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b000c9b0 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b8009a20 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b000cd30 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.092+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c0133330 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.093+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0133980 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.093+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd0b0012600 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.094+0000 7fd0b77fe700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 0x7fd0a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.094+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6369+0+0 (secure 0 0 0) 0x7fd0b007a9b0 con 0x7fd0c00c3840 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.094+0000 7fd0be7fc700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 0x7fd0a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:58.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.094+0000 7fd0be7fc700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 0x7fd0a0061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd0a8007fd0 tx=0x7fd0a8009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:58.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.098+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0b004bc20 con 0x7fd0c00c3840 2024-01-21T20:16:58.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:58.276+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd0c005fdf0 con 0x7fd0c00c3840 2024-01-21T20:16:59.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.118+0000 7fd0b77fe700 1 -- 172.21.15.133:0/960422906 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v120) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd0b004f240 con 0x7fd0c00c3840 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 msgr2=0x7fd0a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 0x7fd0a0061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd0a8007fd0 tx=0x7fd0a8009040).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 msgr2=0x7fd0c01644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7fd0b000ea20 tx=0x7fd0b0009060).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 shutdown_connections 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd0a005f150 0x7fd0a0061610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0c00c6250 0x7fd0c01312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0c00c3840 0x7fd0c01644e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 --2- 172.21.15.133:0/960422906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0c00c5dc0 0x7fd0c0164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 >> 172.21.15.133:0/960422906 conn(0x7fd0c0066a70 msgr2=0x7fd0c00be830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 shutdown_connections 2024-01-21T20:16:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.121+0000 7fd0c55db700 1 -- 172.21.15.133:0/960422906 wait complete. 2024-01-21T20:16:59.112 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:16:59.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:16:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.261+0000 7f2d6bb27700 1 Processor -- start 2024-01-21T20:16:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.261+0000 7f2d6bb27700 1 -- start start 2024-01-21T20:16:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.262+0000 7f2d6bb27700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d6415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.262+0000 7f2d6bb27700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d64069ef0 con 0x7f2d64062ff0 2024-01-21T20:16:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.262+0000 7f2d6bb27700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6406a130 con 0x7f2d64062c10 2024-01-21T20:16:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.262+0000 7f2d6bb27700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6406a410 con 0x7f2d64065d70 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d690c2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2d64062ff0 0x7f2d64065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47532/0 (socket says 172.21.15.133:47532) 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d690c2700 1 -- 172.21.15.133:0/3707467388 learned_addr learned my addr 172.21.15.133:0/3707467388 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144902729 0 0) 0x7f2d60001110 con 0x7f2d64062ff0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d6a0c4700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d6415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500033f0 con 0x7f2d64062ff0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1278317583 0 0) 0x7f2d500033f0 con 0x7f2d64062ff0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 msgr2=0x7f2d6415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d6415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 >> v1:172.21.15.178:6789/0 conn(0x7f2d64062c10 legacy=0x7f2d640697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6406a6f0 con 0x7f2d64062ff0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f2d60001600 con 0x7f2d64062ff0 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 >> v1:172.21.15.133:6789/0 conn(0x7f2d64062ff0 legacy=0x7f2d64065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d50003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d50004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d50004b80 0x7f2d50005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6406a410 con 0x7f2d50003910 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5000b9f0 con 0x7f2d50004b80 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5000bbb0 con 0x7f2d64065d70 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d698c3700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d50003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d690c2700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d50004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.263+0000 7f2d6a0c4700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d50004b80 0x7f2d50005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 -- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 msgr2=0x7f2d50004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d64065d70 0x7f2d50004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 -- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d50004b80 msgr2=0x7f2d50005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d50004b80 0x7f2d50005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 -- 172.21.15.133:0/3707467388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500033f0 con 0x7f2d50003910 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d698c3700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d50003d30 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f2d54001730 tx=0x7f2d54007bb0).ready entity=mon.0 client_cookie=c56d307df163d96c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54007020 con 0x7f2d50003910 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54007180 con 0x7f2d50003910 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d688c1700 1 -- 172.21.15.133:0/3707467388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54007500 con 0x7f2d50003910 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 -- 172.21.15.133:0/3707467388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 msgr2=0x7f2d50003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/3707467388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d50003d30 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f2d54001730 tx=0x7f2d54007bb0).stop 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6a0c4700 1 -- 172.21.15.133:0/3707467388 reap_dead start 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 -- 172.21.15.133:0/3707467388 shutdown_connections 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 -- 172.21.15.133:0/3707467388 >> 172.21.15.133:0/3707467388 conn(0x7f2d640c8010 msgr2=0x7f2d640c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 -- 172.21.15.133:0/3707467388 shutdown_connections 2024-01-21T20:16:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.264+0000 7f2d6bb27700 1 -- 172.21.15.133:0/3707467388 wait complete. 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 Processor -- start 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 -- start start 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640aa220 0x7f2d640aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 0x7f2d640ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640aab90 con 0x7f2d50003910 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640a9d90 con 0x7f2d64153d40 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d6bb27700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640a94a0 con 0x7f2d640aa220 2024-01-21T20:16:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d698c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d698c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34266/0 (socket says 172.21.15.133:34266) 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.266+0000 7f2d698c3700 1 -- 172.21.15.133:0/413338397 learned_addr learned my addr 172.21.15.133:0/413338397 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d6a0c4700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 0x7f2d640ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d690c2700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640aa220 0x7f2d640aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 -- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640aa220 msgr2=0x7f2d640aa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640aa220 0x7f2d640aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 -- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 msgr2=0x7f2d640ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 0x7f2d640ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 -- 172.21.15.133:0/413338397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640a9740 con 0x7f2d50003910 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d6a0c4700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 0x7f2d640ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d698c3700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f2d5000b9c0 tx=0x7f2d54015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54013670 con 0x7f2d50003910 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d540137d0 con 0x7f2d50003910 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d640a9a20 con 0x7f2d50003910 2024-01-21T20:16:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54013b90 con 0x7f2d50003910 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.267+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d641541a0 con 0x7f2d50003910 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.268+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6405fdf0 con 0x7f2d50003910 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.268+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2d5401f400 con 0x7f2d50003910 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.269+0000 7f2d5a7fc700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 0x7f2d48061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.269+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2d5407ac30 con 0x7f2d50003910 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.269+0000 7f2d690c2700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 0x7f2d48061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.269+0000 7f2d690c2700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 0x7f2d48061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2d60000e10 tx=0x7f2d60009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.273+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2d5404bfb0 con 0x7f2d50003910 2024-01-21T20:16:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.499+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d640bcf70 con 0x7f2d50003910 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.500+0000 7f2d5a7fc700 1 -- 172.21.15.133:0/413338397 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2d54024030 con 0x7f2d50003910 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:16:59.489 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.491 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.493 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:16:59.494 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.495 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:16:59.496 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:16:59.497 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:16:59.498 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:16:59.499 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.500 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:16:59.501 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 msgr2=0x7f2d48061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 0x7f2d48061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2d60000e10 tx=0x7f2d60009040).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 msgr2=0x7f2d640be640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f2d5000b9c0 tx=0x7f2d54015000).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 shutdown_connections 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2d4805f150 0x7f2d48061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d64153d40 0x7f2d640ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d50003910 0x7f2d640be640 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 --2- 172.21.15.133:0/413338397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d640aa220 0x7f2d640aa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 >> 172.21.15.133:0/413338397 conn(0x7f2d640c8010 msgr2=0x7f2d6413af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 shutdown_connections 2024-01-21T20:16:59.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.502+0000 7f2d6bb27700 1 -- 172.21.15.133:0/413338397 wait complete. 2024-01-21T20:16:59.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:16:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.629+0000 7fa73f773700 1 Processor -- start 2024-01-21T20:16:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.630+0000 7fa73f773700 1 -- start start 2024-01-21T20:16:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73f773700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7380c1c60 0x7fa73815f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73f773700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7380a5de0 con 0x7fa7380c1800 2024-01-21T20:16:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73f773700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa738066070 con 0x7fa7380a5a00 2024-01-21T20:16:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73f773700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7380654a0 con 0x7fa7380c1c60 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73cd0e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa7380c1800 0x7fa73815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47546/0 (socket says 172.21.15.133:47546) 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73cd0e700 1 -- 172.21.15.133:0/2159735524 learned_addr learned my addr 172.21.15.133:0/2159735524 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73dd10700 1 --2- 172.21.15.133:0/2159735524 >> v2:172.21.15.178:3300/0 conn(0x7fa7380c1c60 0x7fa73815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598344574 0 0) 0x7fa7380a5de0 con 0x7fa7380c1800 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7240033f0 con 0x7fa7380c1800 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673574683 0 0) 0x7fa7240033f0 con 0x7fa7380c1800 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 >> v2:172.21.15.178:3300/0 conn(0x7fa7380c1c60 msgr2=0x7fa73815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 --2- 172.21.15.133:0/2159735524 >> v2:172.21.15.178:3300/0 conn(0x7fa7380c1c60 0x7fa73815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 >> v1:172.21.15.178:6789/0 conn(0x7fa7380a5a00 legacy=0x7fa738064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738065740 con 0x7fa7380c1800 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa73dd10700 1 --2- 172.21.15.133:0/2159735524 >> v2:172.21.15.178:3300/0 conn(0x7fa7380c1c60 0x7fa73815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.631+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fa72c001470 con 0x7fa7380c1800 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 >> v1:172.21.15.133:6789/0 conn(0x7fa7380c1800 legacy=0x7fa73815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7240038e0 0x7fa724003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa724004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa724005050 0x7fa72400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380654a0 con 0x7fa724004690 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72400bfe0 con 0x7fa724005050 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72400c1a0 con 0x7fa7240038e0 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa724004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73dd10700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa724005050 0x7fa72400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73d50f700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7240038e0 0x7fa724003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 -- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7240038e0 msgr2=0x7fa724003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7240038e0 0x7fa724003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 -- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa724005050 msgr2=0x7fa72400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa724005050 0x7fa72400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 -- 172.21.15.133:0/2159735524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240033f0 con 0x7fa724004690 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73dd10700 1 -- 172.21.15.133:0/2159735524 reap_dead start 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73d50f700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7240038e0 0x7fa724003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa724004b10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fa72c00c160 tx=0x7fa72c001e50).ready entity=mon.0 client_cookie=5cb5e5ace11d50b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c007a20 con 0x7fa724004690 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00ca10 con 0x7fa724004690 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.632+0000 7fa72bfff700 1 -- 172.21.15.133:0/2159735524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00cdb0 con 0x7fa724004690 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 -- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 msgr2=0x7fa724004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa724004b10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fa72c00c160 tx=0x7fa72c001e50).stop 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 -- 172.21.15.133:0/2159735524 shutdown_connections 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 --2- 172.21.15.133:0/2159735524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa724004b10 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 -- 172.21.15.133:0/2159735524 >> 172.21.15.133:0/2159735524 conn(0x7fa7380631c0 msgr2=0x7fa7380c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 -- 172.21.15.133:0/2159735524 shutdown_connections 2024-01-21T20:16:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.633+0000 7fa73f773700 1 -- 172.21.15.133:0/2159735524 wait complete. 2024-01-21T20:16:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.634+0000 7fa73f773700 1 Processor -- start 2024-01-21T20:16:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.634+0000 7fa73f773700 1 -- start start 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa738161890 0x7fa738167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 0x7fa738092900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa738167fe0 con 0x7fa724004690 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7380be9e0 con 0x7fa738161890 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa738093510 con 0x7fa7380924a0 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34278/0 (socket says 172.21.15.133:34278) 2024-01-21T20:16:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 -- 172.21.15.133:0/4106043917 learned_addr learned my addr 172.21.15.133:0/4106043917 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa738161890 0x7fa738167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73dd10700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 0x7fa738092900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 -- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 msgr2=0x7fa738092900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 0x7fa738092900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 -- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa738161890 msgr2=0x7fa738167af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa738161890 0x7fa738167af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 -- 172.21.15.133:0/4106043917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7380be3d0 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73dd10700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 0x7fa738092900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73d50f700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fa734007720 tx=0x7fa734009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400ee60 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734010450 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340107d0 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.635+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738093230 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.636+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa738092df0 con 0x7fa724004690 2024-01-21T20:16:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7380c14e0 con 0x7fa724004690 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa734010b80 con 0x7fa724004690 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa729ffb700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 0x7fa71c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa734079fe0 con 0x7fa724004690 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 0x7fa71c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.637+0000 7fa73cd0e700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 0x7fa71c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa72c001ed0 tx=0x7fa72c015000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.641+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa73404b3c0 con 0x7fa724004690 2024-01-21T20:16:59.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.805+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7380becc0 con 0x7fa724004690 2024-01-21T20:16:59.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.806+0000 7fa729ffb700 1 -- 172.21.15.133:0/4106043917 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+14655 (secure 0 0 0) 0x7fa73404e9e0 con 0x7fa724004690 2024-01-21T20:16:59.795 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:16:59.795 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":120,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:16:59.108220+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 msgr2=0x7fa71c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 0x7fa71c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa72c001ed0 tx=0x7fa72c015000).stop 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 msgr2=0x7fa738167600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fa734007720 tx=0x7fa734009040).stop 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 shutdown_connections 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa71c05f150 0x7fa71c061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7380924a0 0x7fa738092900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa724004690 0x7fa738167600 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.807+0000 7fa73f773700 1 --2- 172.21.15.133:0/4106043917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa738161890 0x7fa738167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.808+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 >> 172.21.15.133:0/4106043917 conn(0x7fa7380631c0 msgr2=0x7fa738156790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.808+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 shutdown_connections 2024-01-21T20:16:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.808+0000 7fa73f773700 1 -- 172.21.15.133:0/4106043917 wait complete. 2024-01-21T20:16:59.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:16:59.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:16:59.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.938+0000 7fc659263700 1 Processor -- start 2024-01-21T20:16:59.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.938+0000 7fc659263700 1 -- start start 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc654154140 0x7fc654158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc654154520 0x7fc6540ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6540c6090 0x7fc6540c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6540c6ae0 con 0x7fc654154140 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6540c05e0 con 0x7fc6540c6090 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc659263700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540ab620 con 0x7fc654154520 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc652ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc654154140 0x7fc654158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc652ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc654154140 0x7fc654158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34286/0 (socket says 172.21.15.133:34286) 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc652ffd700 1 -- 172.21.15.133:0/2211804562 learned_addr learned my addr 172.21.15.133:0/2211804562 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc6537fe700 1 --2- 172.21.15.133:0/2211804562 >> v2:172.21.15.178:3300/0 conn(0x7fc6540c6090 0x7fc6540c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.939+0000 7fc6527fc700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc654154520 0x7fc6540ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 -- 172.21.15.133:0/2211804562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc654154520 msgr2=0x7fc6540ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc654154520 0x7fc6540ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 -- 172.21.15.133:0/2211804562 >> v2:172.21.15.178:3300/0 conn(0x7fc6540c6090 msgr2=0x7fc6540c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 --2- 172.21.15.133:0/2211804562 >> v2:172.21.15.178:3300/0 conn(0x7fc6540c6090 0x7fc6540c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 -- 172.21.15.133:0/2211804562 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540c0e40 con 0x7fc654154140 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc652ffd700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154140 0x7fc654158bb0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc654062cc0 tx=0x7fc6480090f0).ready entity=mon.0 client_cookie=726eed23d76bb608 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc651ffb700 1 -- 172.21.15.133:0/2211804562 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800b600 con 0x7fc654154140 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc651ffb700 1 -- 172.21.15.133:0/2211804562 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800b760 con 0x7fc654154140 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc651ffb700 1 -- 172.21.15.133:0/2211804562 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800bae0 con 0x7fc654154140 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 -- 172.21.15.133:0/2211804562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154140 msgr2=0x7fc654158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154140 0x7fc654158bb0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fc654062cc0 tx=0x7fc6480090f0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 -- 172.21.15.133:0/2211804562 shutdown_connections 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 --2- 172.21.15.133:0/2211804562 >> v2:172.21.15.178:3300/0 conn(0x7fc6540c6090 0x7fc6540c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154140 0x7fc654158bb0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 --2- 172.21.15.133:0/2211804562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc654154520 0x7fc6540ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 -- 172.21.15.133:0/2211804562 >> 172.21.15.133:0/2211804562 conn(0x7fc65405e1e0 msgr2=0x7fc65405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:16:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 -- 172.21.15.133:0/2211804562 shutdown_connections 2024-01-21T20:16:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.940+0000 7fc659263700 1 -- 172.21.15.133:0/2211804562 wait complete. 2024-01-21T20:16:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.942+0000 7fc659263700 1 Processor -- start 2024-01-21T20:16:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.942+0000 7fc659263700 1 -- start start 2024-01-21T20:16:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.942+0000 7fc659263700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6540c6090 0x7fc6540cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.942+0000 7fc659263700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc654154140 0x7fc6541689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.942+0000 7fc659263700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc659263700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654165af0 con 0x7fc654154520 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc659263700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654168560 con 0x7fc654154140 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc659263700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc654168230 con 0x7fc6540c6090 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34298/0 (socket says 172.21.15.133:34298) 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 -- 172.21.15.133:0/3034860603 learned_addr learned my addr 172.21.15.133:0/3034860603 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6527fc700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc654154140 0x7fc6541689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc652ffd700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6540c6090 0x7fc6540cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 -- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6540c6090 msgr2=0x7fc6540cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6540c6090 0x7fc6540cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 -- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc654154140 msgr2=0x7fc6541689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc654154140 0x7fc6541689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 -- 172.21.15.133:0/3034860603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009370 con 0x7fc654154520 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc6537fe700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fc64c009fa0 tx=0x7fc64c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00ec70 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00edd0 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc654165530 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c014610 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.943+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6540cb6f0 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.944+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc654168090 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.945+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc64c01d3b0 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.945+0000 7fc63b7fe700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 0x7fc640061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.945+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc64c07a590 con 0x7fc654154520 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.945+0000 7fc652ffd700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 0x7fc640061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:16:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.945+0000 7fc652ffd700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 0x7fc640061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc648009130 tx=0x7fc648017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:16:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:16:59.949+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc654168090 con 0x7fc654154520 2024-01-21T20:17:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.112+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc654168090 con 0x7fc654154520 2024-01-21T20:17:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.113+0000 7fc63b7fe700 1 -- 172.21.15.133:0/3034860603 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc654168090 con 0x7fc654154520 2024-01-21T20:17:00.102 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 msgr2=0x7fc640061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 0x7fc640061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc648009130 tx=0x7fc648017000).stop 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 msgr2=0x7fc654164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fc64c009fa0 tx=0x7fc64c009900).stop 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 shutdown_connections 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc64005f150 0x7fc640061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc654154520 0x7fc654164ae0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6540c6090 0x7fc6540cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 --2- 172.21.15.133:0/3034860603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc654154140 0x7fc6541689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.114+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 >> 172.21.15.133:0/3034860603 conn(0x7fc65405e1e0 msgr2=0x7fc65414dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.115+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 shutdown_connections 2024-01-21T20:17:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.115+0000 7fc659263700 1 -- 172.21.15.133:0/3034860603 wait complete. 2024-01-21T20:17:00.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:17:00.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.245+0000 7fd3c130a700 1 Processor -- start 2024-01-21T20:17:00.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.245+0000 7fd3c130a700 1 -- start start 2024-01-21T20:17:00.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3c130a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3c130a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3bc065900 0x7fd3bc06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3c130a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc065000 con 0x7fd3bc065490 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3c130a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc065d60 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3c130a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc069540 con 0x7fd3bc065900 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53208/0 (socket says 172.21.15.133:53208) 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 -- 172.21.15.133:0/2327275438 learned_addr learned my addr 172.21.15.133:0/2327275438 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3ba7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd3bc065490 0x7fd3bc0a3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40622/0 (socket says 172.21.15.133:40622) 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3bb7fe700 1 --2- 172.21.15.133:0/2327275438 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc065900 0x7fd3bc06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 -- 172.21.15.133:0/2327275438 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc065900 msgr2=0x7fd3bc06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 --2- 172.21.15.133:0/2327275438 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc065900 0x7fd3bc06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 -- 172.21.15.133:0/2327275438 >> v1:172.21.15.133:6789/0 conn(0x7fd3bc065490 legacy=0x7fd3bc0a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 -- 172.21.15.133:0/2327275438 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc064410 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3b9ffb700 1 -- 172.21.15.133:0/2327275438 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592646483 0 0) 0x7fd3bc065000 con 0x7fd3bc065490 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.246+0000 7fd3baffd700 1 --2- 172.21.15.133:0/2327275438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fd3bc0a9bf0 tx=0x7fd3b00090f0).ready entity=mon.0 client_cookie=a720a66f849de35a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3b9ffb700 1 -- 172.21.15.133:0/2327275438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000b600 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3b9ffb700 1 -- 172.21.15.133:0/2327275438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b000b760 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3b9ffb700 1 -- 172.21.15.133:0/2327275438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b000bb00 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 -- 172.21.15.133:0/2327275438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 msgr2=0x7fd3bc0bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 --2- 172.21.15.133:0/2327275438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fd3bc0a9bf0 tx=0x7fd3b00090f0).stop 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 -- 172.21.15.133:0/2327275438 shutdown_connections 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 --2- 172.21.15.133:0/2327275438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc0bcc80 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 --2- 172.21.15.133:0/2327275438 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc065900 0x7fd3bc06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 -- 172.21.15.133:0/2327275438 >> 172.21.15.133:0/2327275438 conn(0x7fd3bc0c6ef0 msgr2=0x7fd3bc0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 -- 172.21.15.133:0/2327275438 shutdown_connections 2024-01-21T20:17:00.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.247+0000 7fd3c130a700 1 -- 172.21.15.133:0/2327275438 wait complete. 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.248+0000 7fd3c130a700 1 Processor -- start 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 -- start start 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc065490 0x7fd3bc1656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 0x7fd3bc147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0a7bc0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc165e00 con 0x7fd3bc065900 2024-01-21T20:17:00.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3c130a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0a6080 con 0x7fd3bc065490 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3bb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53224/0 (socket says 172.21.15.133:53224) 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.249+0000 7fd3bb7fe700 1 -- 172.21.15.133:0/3410424290 learned_addr learned my addr 172.21.15.133:0/3410424290 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3ba7fc700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 0x7fd3bc147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3baffd700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc065490 0x7fd3bc1656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 -- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc065490 msgr2=0x7fd3bc1656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc065490 0x7fd3bc1656b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 -- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 msgr2=0x7fd3bc147e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 0x7fd3bc147e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 -- 172.21.15.133:0/3410424290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009370 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3ba7fc700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 0x7fd3bc147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3bb7fe700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd3b4009fa0 tx=0x7fd3b4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400ecc0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400ee20 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc165ba0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4014610 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.250+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc0c2b80 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.251+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc05fdf0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.251+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd3b40149c0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.252+0000 7fd3a37fe700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 0x7fd3a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.252+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd3b407a5d0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.252+0000 7fd3baffd700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 0x7fd3a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.252+0000 7fd3baffd700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 0x7fd3a8061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd3bc168160 tx=0x7fd3b0017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.256+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3b404b950 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.418+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3bc0bd9b0 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.418+0000 7fd3a37fe700 1 -- 172.21.15.133:0/3410424290 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3b404ef70 con 0x7fd3bc0bc8a0 2024-01-21T20:17:00.407 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:17:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 msgr2=0x7fd3a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 0x7fd3a8061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd3bc168160 tx=0x7fd3b0017000).stop 2024-01-21T20:17:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 msgr2=0x7fd3bc153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd3b4009fa0 tx=0x7fd3b4009900).stop 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 shutdown_connections 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3a805f150 0x7fd3a8061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3bc0bc8a0 0x7fd3bc153e60 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc065490 0x7fd3bc1656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 --2- 172.21.15.133:0/3410424290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc065900 0x7fd3bc147e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 >> 172.21.15.133:0/3410424290 conn(0x7fd3bc0c6ef0 msgr2=0x7fd3bc0c6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 shutdown_connections 2024-01-21T20:17:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.420+0000 7fd3c130a700 1 -- 172.21.15.133:0/3410424290 wait complete. 2024-01-21T20:17:00.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:17:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.547+0000 7fb67748f700 1 Processor -- start 2024-01-21T20:17:00.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.547+0000 7fb67748f700 1 -- start start 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb67748f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6700c3c20 0x7fb67013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb67748f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6700c64d0 con 0x7fb67013a9e0 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb67748f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb670067f10 con 0x7fb6700c3840 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb67748f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6700681f0 con 0x7fb6700c3c20 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb675a2c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb67013a9e0 0x7fb6700bdf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40638/0 (socket says 172.21.15.133:40638) 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb675a2c700 1 -- 172.21.15.133:0/192368855 learned_addr learned my addr 172.21.15.133:0/192368855 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927735843 0 0) 0x7fb668001490 con 0x7fb67013a9e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb65c0033f0 con 0x7fb67013a9e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb674a2a700 1 --2- 172.21.15.133:0/192368855 >> v2:172.21.15.178:3300/0 conn(0x7fb6700c3c20 0x7fb67013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427254254 0 0) 0x7fb65c0033f0 con 0x7fb67013a9e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 >> v2:172.21.15.178:3300/0 conn(0x7fb6700c3c20 msgr2=0x7fb67013a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 --2- 172.21.15.133:0/192368855 >> v2:172.21.15.178:3300/0 conn(0x7fb6700c3c20 0x7fb67013a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 >> v1:172.21.15.178:6789/0 conn(0x7fb6700c3840 legacy=0x7fb6700c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6700684d0 con 0x7fb67013a9e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb668001980 con 0x7fb67013a9e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 >> v1:172.21.15.133:6789/0 conn(0x7fb67013a9e0 legacy=0x7fb6700bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0038e0 0x7fb65c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.548+0000 7fb667fff700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 0x7fb65c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c005050 0x7fb65c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700681f0 con 0x7fb65c004690 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c00bfe0 con 0x7fb65c005050 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c00c1a0 con 0x7fb65c0038e0 2024-01-21T20:17:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 0x7fb65c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb675a2c700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c005050 0x7fb65c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb67522b700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0038e0 0x7fb65c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 -- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0038e0 msgr2=0x7fb65c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0038e0 0x7fb65c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 -- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c005050 msgr2=0x7fb65c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c005050 0x7fb65c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 -- 172.21.15.133:0/192368855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0033f0 con 0x7fb65c004690 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb675a2c700 1 -- 172.21.15.133:0/192368855 reap_dead start 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb67522b700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0038e0 0x7fb65c003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb674a2a700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 0x7fb65c004b10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fb660006d80 tx=0x7fb660009060).ready entity=mon.0 client_cookie=4ada1f41410c9f2a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660009e90 con 0x7fb65c004690 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000e640 con 0x7fb65c004690 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.549+0000 7fb667fff700 1 -- 172.21.15.133:0/192368855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66000ea00 con 0x7fb65c004690 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 -- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 msgr2=0x7fb65c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 0x7fb65c004b10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fb660006d80 tx=0x7fb660009060).stop 2024-01-21T20:17:00.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 -- 172.21.15.133:0/192368855 shutdown_connections 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 --2- 172.21.15.133:0/192368855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb65c004690 0x7fb65c004b10 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 -- 172.21.15.133:0/192368855 >> 172.21.15.133:0/192368855 conn(0x7fb670066a70 msgr2=0x7fb670066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 -- 172.21.15.133:0/192368855 shutdown_connections 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.550+0000 7fb67748f700 1 -- 172.21.15.133:0/192368855 wait complete. 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.551+0000 7fb67748f700 1 Processor -- start 2024-01-21T20:17:00.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.551+0000 7fb67748f700 1 -- start start 2024-01-21T20:17:00.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c004690 0x7fb67014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb670153390 0x7fb670153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6700abeb0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb670153d00 con 0x7fb670153390 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb670151a80 con 0x7fb65c004690 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53234/0 (socket says 172.21.15.133:53234) 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 -- 172.21.15.133:0/2901048740 learned_addr learned my addr 172.21.15.133:0/2901048740 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67522b700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c004690 0x7fb67014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb675a2c700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb670153390 0x7fb670153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 -- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c004690 msgr2=0x7fb67014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c004690 0x7fb67014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 -- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb670153390 msgr2=0x7fb670153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb670153390 0x7fb670153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 -- 172.21.15.133:0/2901048740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670151d60 con 0x7fb6700ae9b0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb674a2a700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fb66001ce50 tx=0x7fb66001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660000bc0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66000ed70 con 0x7fb6700ae9b0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660000d20 con 0x7fb6700ae9b0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.552+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb670152040 con 0x7fb6700ae9b0 2024-01-21T20:17:00.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.553+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb670151690 con 0x7fb6700ae9b0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.554+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67005fdf0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.554+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb6600123f0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.554+0000 7fb665ffb700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 0x7fb654061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.554+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb66007b7e0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.554+0000 7fb67522b700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 0x7fb654061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.555+0000 7fb67522b700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 0x7fb654061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb66c000c00 tx=0x7fb66c009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.559+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb66004cb60 con 0x7fb6700ae9b0 2024-01-21T20:17:00.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.725+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6700abff0 con 0x7fb6700ae9b0 2024-01-21T20:17:00.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.725+0000 7fb665ffb700 1 -- 172.21.15.133:0/2901048740 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v120) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb660029030 con 0x7fb6700ae9b0 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:17:00.715 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 msgr2=0x7fb654061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 0x7fb654061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb66c000c00 tx=0x7fb66c009040).stop 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 msgr2=0x7fb6701511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fb66001ce50 tx=0x7fb66001a000).stop 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 shutdown_connections 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb65405f150 0x7fb654061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb670153390 0x7fb670153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c004690 0x7fb67014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 --2- 172.21.15.133:0/2901048740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6700ae9b0 0x7fb6701511a0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 >> 172.21.15.133:0/2901048740 conn(0x7fb670066a70 msgr2=0x7fb6700c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 shutdown_connections 2024-01-21T20:17:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.727+0000 7fb67748f700 1 -- 172.21.15.133:0/2901048740 wait complete. 2024-01-21T20:17:00.728 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:17:00.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:17:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.860+0000 7f342be4a700 1 Processor -- start 2024-01-21T20:17:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 -- start start 2024-01-21T20:17:00.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34240c3560 0x7f3424063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3424157f30 con 0x7f34240c5060 2024-01-21T20:17:00.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240674d0 con 0x7f34240c3560 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.861+0000 7f342be4a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3424154ed0 con 0x7f3424154960 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3429be6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34240c5060 0x7f3424066dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40644/0 (socket says 172.21.15.133:40644) 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3429be6700 1 -- 172.21.15.133:0/4238405951 learned_addr learned my addr 172.21.15.133:0/4238405951 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 --2- 172.21.15.133:0/4238405951 >> v2:172.21.15.178:3300/0 conn(0x7f34240c3560 0x7f3424063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f34293e5700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3428be4700 1 -- 172.21.15.133:0/4238405951 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763371733 0 0) 0x7f3424157f30 con 0x7f34240c5060 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3428be4700 1 -- 172.21.15.133:0/4238405951 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34100033f0 con 0x7f34240c5060 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 -- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 msgr2=0x7f34240c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 -- 172.21.15.133:0/4238405951 >> v1:172.21.15.133:6789/0 conn(0x7f34240c5060 legacy=0x7f3424066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 -- 172.21.15.133:0/4238405951 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34241551b0 con 0x7f34240c3560 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f342a3e7700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c3560 0x7f3424063a30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f341c009e60 tx=0x7f341c009780).ready entity=mon.1 client_cookie=cf2b9236ae6d8c3f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3428be4700 1 -- 172.21.15.133:0/4238405951 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00e070 con 0x7f34240c3560 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3428be4700 1 -- 172.21.15.133:0/4238405951 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00bab0 con 0x7f34240c3560 2024-01-21T20:17:00.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.862+0000 7f3428be4700 1 -- 172.21.15.133:0/4238405951 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00be30 con 0x7f34240c3560 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 -- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c3560 msgr2=0x7f3424063a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c3560 0x7f3424063a30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f341c009e60 tx=0x7f341c009780).stop 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 -- 172.21.15.133:0/4238405951 shutdown_connections 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c3560 0x7f3424063a30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 --2- 172.21.15.133:0/4238405951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 -- 172.21.15.133:0/4238405951 >> 172.21.15.133:0/4238405951 conn(0x7f34240c8f60 msgr2=0x7f34240c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 -- 172.21.15.133:0/4238405951 shutdown_connections 2024-01-21T20:17:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.863+0000 7f342be4a700 1 -- 172.21.15.133:0/4238405951 wait complete. 2024-01-21T20:17:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.864+0000 7f342be4a700 1 Processor -- start 2024-01-21T20:17:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.864+0000 7f342be4a700 1 -- start start 2024-01-21T20:17:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c5060 0x7f34240ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c0ff0 con 0x7f34240c3560 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c03e0 con 0x7f34240c5060 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342be4a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240c06c0 con 0x7f3424154960 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53250/0 (socket says 172.21.15.133:53250) 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 -- 172.21.15.133:0/378558269 learned_addr learned my addr 172.21.15.133:0/378558269 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f342a3e7700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f34293e5700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c5060 0x7f34240ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 -- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 msgr2=0x7f34240ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 -- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c5060 msgr2=0x7f34240ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c5060 0x7f34240ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.865+0000 7f3429be6700 1 -- 172.21.15.133:0/378558269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009a20 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f3429be6700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f3414001ed0 tx=0x7f3414007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341400ce10 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34240c09a0 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140072e0 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34140057a0 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.866+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34240c0000 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.867+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342405fdf0 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.867+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3414005b50 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.867+0000 7f341a7fc700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.867+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f34140797a0 con 0x7f34240c3560 2024-01-21T20:17:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.867+0000 7f34293e5700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.868+0000 7f34293e5700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3424151b10 tx=0x7f3420009060).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:00.871+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f341404aac0 con 0x7f34240c3560 2024-01-21T20:17:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.035+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3424155490 con 0x7f34240c3560 2024-01-21T20:17:01.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.125+0000 7f341a7fc700 1 -- 172.21.15.133:0/378558269 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v121) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3414018070 con 0x7f34240c3560 2024-01-21T20:17:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 msgr2=0x7f3408061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3424151b10 tx=0x7f3420009060).stop 2024-01-21T20:17:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 msgr2=0x7f342414fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f3414001ed0 tx=0x7f3414007c70).stop 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 shutdown_connections 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3424154960 0x7f34240ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34240c3560 0x7f342414fe10 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 --2- 172.21.15.133:0/378558269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34240c5060 0x7f34240ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 >> 172.21.15.133:0/378558269 conn(0x7f34240c8f60 msgr2=0x7f34240c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.128+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 shutdown_connections 2024-01-21T20:17:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.129+0000 7f342be4a700 1 -- 172.21.15.133:0/378558269 wait complete. 2024-01-21T20:17:01.119 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:17:01.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:17:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.264+0000 7f034f2dc700 1 Processor -- start 2024-01-21T20:17:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 -- start start 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0348067d90 0x7f0348137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 0x7f03480c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c6250 con 0x7f0348137030 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0348068370 con 0x7f0348067d90 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.265+0000 7f034f2dc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0348068650 con 0x7f03480c5930 2024-01-21T20:17:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0348067d90 0x7f0348137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0348067d90 0x7f0348137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53262/0 (socket says 172.21.15.133:53262) 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 -- 172.21.15.133:0/728056433 learned_addr learned my addr 172.21.15.133:0/728056433 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034d879700 1 --2- 172.21.15.133:0/728056433 >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 0x7f03480c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 -- 172.21.15.133:0/728056433 >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 msgr2=0x7f03480c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 --2- 172.21.15.133:0/728056433 >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 0x7f03480c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 -- 172.21.15.133:0/728056433 >> v1:172.21.15.178:6789/0 conn(0x7f0348137030 legacy=0x7f0348155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 -- 172.21.15.133:0/728056433 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348068930 con 0x7f0348067d90 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034d879700 1 --2- 172.21.15.133:0/728056433 >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 0x7f03480c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f034c877700 1 --2- 172.21.15.133:0/728056433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0348067d90 0x7f0348137410 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f0348066070 tx=0x7f03440090f0).ready entity=mon.0 client_cookie=912386d82247e2db server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f033ffff700 1 -- 172.21.15.133:0/728056433 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400b5a0 con 0x7f0348067d90 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f033ffff700 1 -- 172.21.15.133:0/728056433 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400b700 con 0x7f0348067d90 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.266+0000 7f033ffff700 1 -- 172.21.15.133:0/728056433 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400baa0 con 0x7f0348067d90 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 -- 172.21.15.133:0/728056433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0348067d90 msgr2=0x7f0348137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 --2- 172.21.15.133:0/728056433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0348067d90 0x7f0348137410 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f0348066070 tx=0x7f03440090f0).stop 2024-01-21T20:17:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 -- 172.21.15.133:0/728056433 shutdown_connections 2024-01-21T20:17:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 --2- 172.21.15.133:0/728056433 >> v2:172.21.15.178:3300/0 conn(0x7f03480c5930 0x7f03480c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 --2- 172.21.15.133:0/728056433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0348067d90 0x7f0348137410 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 -- 172.21.15.133:0/728056433 >> 172.21.15.133:0/728056433 conn(0x7f0348066a90 msgr2=0x7f0348066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 -- 172.21.15.133:0/728056433 shutdown_connections 2024-01-21T20:17:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.267+0000 7f034f2dc700 1 -- 172.21.15.133:0/728056433 wait complete. 2024-01-21T20:17:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.268+0000 7f034f2dc700 1 Processor -- start 2024-01-21T20:17:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.268+0000 7f034f2dc700 1 -- start start 2024-01-21T20:17:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 0x7f03481398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0348137030 0x7f0348136870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480abeb0 con 0x7f03480c5930 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480ac750 con 0x7f0348067d90 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034f2dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480aee40 con 0x7f0348137030 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034c877700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034c877700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53266/0 (socket says 172.21.15.133:53266) 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.269+0000 7f034c877700 1 -- 172.21.15.133:0/2361157608 learned_addr learned my addr 172.21.15.133:0/2361157608 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034d879700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0348137030 0x7f0348136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034d078700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 0x7f03481398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 -- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0348137030 msgr2=0x7f0348136870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0348137030 0x7f0348136870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 -- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 msgr2=0x7f03481398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 0x7f03481398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 -- 172.21.15.133:0/2361157608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009370 con 0x7f03480c5930 2024-01-21T20:17:01.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034d078700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 0x7f03481398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034c877700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f0344006fd0 tx=0x7f0344015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344006910 con 0x7f03480c5930 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400b870 con 0x7f03480c5930 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03480ac100 con 0x7f03480c5930 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344024470 con 0x7f03480c5930 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.270+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480aeb50 con 0x7f03480c5930 2024-01-21T20:17:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.271+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034805fdf0 con 0x7f03480c5930 2024-01-21T20:17:01.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.272+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0344021070 con 0x7f03480c5930 2024-01-21T20:17:01.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.272+0000 7f033df76700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 0x7f032c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:01.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.272+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f034407be50 con 0x7f03480c5930 2024-01-21T20:17:01.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.272+0000 7f034d078700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 0x7f032c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:01.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.272+0000 7f034d078700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 0x7f032c061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f033800a820 tx=0x7f0338008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.276+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f034404d0b0 con 0x7f03480c5930 2024-01-21T20:17:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:01.440+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f03480639e0 con 0x7f03480c5930 2024-01-21T20:17:02.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.126+0000 7f033df76700 1 -- 172.21.15.133:0/2361157608 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v122) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0344029030 con 0x7f03480c5930 2024-01-21T20:17:02.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.129+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 msgr2=0x7f032c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.129+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 0x7f032c061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f033800a820 tx=0x7f0338008040).stop 2024-01-21T20:17:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.129+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 msgr2=0x7f03480ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.129+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f0344006fd0 tx=0x7f0344015000).stop 2024-01-21T20:17:02.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 shutdown_connections 2024-01-21T20:17:02.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f032c05f150 0x7f032c061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0348137030 0x7f0348136870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0348067d90 0x7f03481398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 --2- 172.21.15.133:0/2361157608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c5930 0x7f03480ae660 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.132+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 >> 172.21.15.133:0/2361157608 conn(0x7f0348066a90 msgr2=0x7f03480c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.133+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 shutdown_connections 2024-01-21T20:17:02.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.133+0000 7f034f2dc700 1 -- 172.21.15.133:0/2361157608 wait complete. 2024-01-21T20:17:02.124 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:17:02.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:17:02.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.276+0000 7fa71a145700 1 Processor -- start 2024-01-21T20:17:02.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.276+0000 7fa71a145700 1 -- start start 2024-01-21T20:17:02.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa71a145700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa714069ef0 0x7fa714155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa71a145700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 0x7fa714066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa71a145700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa714065660 con 0x7fa7140beb30 2024-01-21T20:17:02.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa71a145700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7140bef10 con 0x7fa714069ef0 2024-01-21T20:17:02.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa71a145700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa714156070 con 0x7fa7140c3fb0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa712ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa714069ef0 0x7fa714155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa712ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa714069ef0 0x7fa714155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53270/0 (socket says 172.21.15.133:53270) 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.277+0000 7fa712ffd700 1 -- 172.21.15.133:0/109779370 learned_addr learned my addr 172.21.15.133:0/109779370 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa713fff700 1 --2- 172.21.15.133:0/109779370 >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 0x7fa714066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa712ffd700 1 -- 172.21.15.133:0/109779370 >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 msgr2=0x7fa714066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa712ffd700 1 --2- 172.21.15.133:0/109779370 >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 0x7fa714066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa712ffd700 1 -- 172.21.15.133:0/109779370 >> v1:172.21.15.178:6789/0 conn(0x7fa7140beb30 legacy=0x7fa7140697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa712ffd700 1 -- 172.21.15.133:0/109779370 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714065f00 con 0x7fa714069ef0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa713fff700 1 --2- 172.21.15.133:0/109779370 >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 0x7fa714066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa712ffd700 1 --2- 172.21.15.133:0/109779370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa714069ef0 0x7fa714155b80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fa714060070 tx=0x7fa70400b3b0).ready entity=mon.0 client_cookie=c8e5caa4a9221f9c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa7127fc700 1 -- 172.21.15.133:0/109779370 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70400dac0 con 0x7fa714069ef0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa7127fc700 1 -- 172.21.15.133:0/109779370 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70400dc20 con 0x7fa714069ef0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa7127fc700 1 -- 172.21.15.133:0/109779370 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704010470 con 0x7fa714069ef0 2024-01-21T20:17:02.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa71a145700 1 -- 172.21.15.133:0/109779370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa714069ef0 msgr2=0x7fa714155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.278+0000 7fa71a145700 1 --2- 172.21.15.133:0/109779370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa714069ef0 0x7fa714155b80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fa714060070 tx=0x7fa70400b3b0).stop 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 -- 172.21.15.133:0/109779370 shutdown_connections 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 --2- 172.21.15.133:0/109779370 >> v2:172.21.15.178:3300/0 conn(0x7fa7140c3fb0 0x7fa714066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 --2- 172.21.15.133:0/109779370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa714069ef0 0x7fa714155b80 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 -- 172.21.15.133:0/109779370 >> 172.21.15.133:0/109779370 conn(0x7fa7140c8010 msgr2=0x7fa7140c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 -- 172.21.15.133:0/109779370 shutdown_connections 2024-01-21T20:17:02.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.279+0000 7fa71a145700 1 -- 172.21.15.133:0/109779370 wait complete. 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.280+0000 7fa71a145700 1 Processor -- start 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.280+0000 7fa71a145700 1 -- start start 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa714069ef0 0x7fa714164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7140c3fb0 0x7fa714135c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa714151460 con 0x7fa7140beb30 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141684a0 con 0x7fa714069ef0 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7141653d0 con 0x7fa7140c3fb0 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53284/0 (socket says 172.21.15.133:53284) 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 -- 172.21.15.133:0/3041585420 learned_addr learned my addr 172.21.15.133:0/3041585420 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa7137fe700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa714069ef0 0x7fa714164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa713fff700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7140c3fb0 0x7fa714135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 -- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7140c3fb0 msgr2=0x7fa714135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7140c3fb0 0x7fa714135c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 -- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa714069ef0 msgr2=0x7fa714164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa714069ef0 0x7fa714164db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 -- 172.21.15.133:0/3041585420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70400b610 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa712ffd700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa704013000 tx=0x7fa70400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704006910 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704019660 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7141656b0 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.281+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704019a20 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.282+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa714165c70 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.282+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71405fdf0 con 0x7fa7140beb30 2024-01-21T20:17:02.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.283+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa70400f3d0 con 0x7fa7140beb30 2024-01-21T20:17:02.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.283+0000 7fa6fbfff700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 0x7fa700061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.283+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa70407bc40 con 0x7fa7140beb30 2024-01-21T20:17:02.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.283+0000 7fa7137fe700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 0x7fa700061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.284+0000 7fa7137fe700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 0x7fa700061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa7080038b0 tx=0x7fa708007d20).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.288+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa70404ccd0 con 0x7fa7140beb30 2024-01-21T20:17:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.494+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa71406ac20 con 0x7fa7140beb30 2024-01-21T20:17:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.501+0000 7fa6fbfff700 1 -- 172.21.15.133:0/3041585420 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v41) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa704028030 con 0x7fa7140beb30 2024-01-21T20:17:02.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 msgr2=0x7fa700061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 0x7fa700061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fa7080038b0 tx=0x7fa708007d20).stop 2024-01-21T20:17:02.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 msgr2=0x7fa714150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fa704013000 tx=0x7fa70400b3b0).stop 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 shutdown_connections 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa70005f180 0x7fa700061640 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0x7fa7080038b0 tx=0x7fa708007d20).stop 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7140c3fb0 0x7fa714135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa714069ef0 0x7fa714164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 --2- 172.21.15.133:0/3041585420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7140beb30 0x7fa714150f70 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.505+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 >> 172.21.15.133:0/3041585420 conn(0x7fa7140c8010 msgr2=0x7fa7140626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.507+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 shutdown_connections 2024-01-21T20:17:02.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.507+0000 7fa71a145700 1 -- 172.21.15.133:0/3041585420 wait complete. 2024-01-21T20:17:02.499 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 15 and data pool 16 2024-01-21T20:17:02.519 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:17:02.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.644+0000 7f69a12d8700 1 Processor -- start 2024-01-21T20:17:02.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.644+0000 7f69a12d8700 1 -- start start 2024-01-21T20:17:02.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f69a12d8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f69a12d8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f699c0bc6d0 0x7f699c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f69a12d8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c0654f0 con 0x7f699c0a9e30 2024-01-21T20:17:02.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f69a12d8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c063700 con 0x7f699c0bc6d0 2024-01-21T20:17:02.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f69a12d8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c063950 con 0x7f699c1546b0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f699affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.645+0000 7f699b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f699c0bc6d0 0x7f699c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53242/0 (socket says 172.21.15.133:53242) 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 -- 172.21.15.133:0/3910401623 learned_addr learned my addr 172.21.15.133:0/3910401623 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699a7fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f699c0a9e30 0x7f699c065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37390/0 (socket says 172.21.15.133:37390) 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 -- 172.21.15.133:0/3910401623 >> v2:172.21.15.178:3300/0 conn(0x7f699c0bc6d0 msgr2=0x7f699c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 --2- 172.21.15.133:0/3910401623 >> v2:172.21.15.178:3300/0 conn(0x7f699c0bc6d0 0x7f699c066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 -- 172.21.15.133:0/3910401623 >> v1:172.21.15.178:6789/0 conn(0x7f699c0a9e30 legacy=0x7f699c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 -- 172.21.15.133:0/3910401623 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c065180 con 0x7f699c1546b0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f699affd700 1 --2- 172.21.15.133:0/3910401623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6990006fd0 tx=0x7f69900090f0).ready entity=mon.2 client_cookie=bf091d6ee2b5203b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f6999ffb700 1 -- 172.21.15.133:0/3910401623 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000b580 con 0x7f699c1546b0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f6999ffb700 1 -- 172.21.15.133:0/3910401623 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699000b6e0 con 0x7f699c1546b0 2024-01-21T20:17:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.646+0000 7f6999ffb700 1 -- 172.21.15.133:0/3910401623 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000ba80 con 0x7f699c1546b0 2024-01-21T20:17:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 -- 172.21.15.133:0/3910401623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 msgr2=0x7f699c154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3910401623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6990006fd0 tx=0x7f69900090f0).stop 2024-01-21T20:17:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 -- 172.21.15.133:0/3910401623 shutdown_connections 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3910401623 >> v2:172.21.15.178:3300/0 conn(0x7f699c0bc6d0 0x7f699c066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3910401623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c1546b0 0x7f699c154a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 -- 172.21.15.133:0/3910401623 >> 172.21.15.133:0/3910401623 conn(0x7f699c0c8200 msgr2=0x7f699c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 -- 172.21.15.133:0/3910401623 shutdown_connections 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.647+0000 7f69a12d8700 1 -- 172.21.15.133:0/3910401623 wait complete. 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.648+0000 7f69a12d8700 1 Processor -- start 2024-01-21T20:17:02.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.648+0000 7f69a12d8700 1 -- start start 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c0a9e30 0x7f699c0ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f699c1546b0 0x7f699c165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0aba50 con 0x7f699c0bc6d0 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0c0e20 con 0x7f699c1546b0 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f69a12d8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0ac870 con 0x7f699c0a9e30 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c0a9e30 0x7f699c0ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53288/0 (socket says 172.21.15.133:53288) 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 -- 172.21.15.133:0/3567334167 learned_addr learned my addr 172.21.15.133:0/3567334167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699b7fe700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f699c1546b0 0x7f699c165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 -- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c0a9e30 msgr2=0x7f699c0ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c0a9e30 0x7f699c0ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 -- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f699c1546b0 msgr2=0x7f699c165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f699c1546b0 0x7f699c165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 -- 172.21.15.133:0/3567334167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990009370 con 0x7f699c0bc6d0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.649+0000 7f699a7fc700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f698c00c440 tx=0x7f698c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.650+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0070d0 con 0x7f699c0bc6d0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.650+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c007230 con 0x7f699c0bc6d0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.650+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c0abc60 con 0x7f699c0bc6d0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.650+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c0075b0 con 0x7f699c0bc6d0 2024-01-21T20:17:02.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.650+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c0ac220 con 0x7f699c0bc6d0 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.651+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c0aca00 con 0x7f699c0bc6d0 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.651+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f698c0058f0 con 0x7f699c0bc6d0 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.651+0000 7f69837fe700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.652+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f698c0799d0 con 0x7f699c0bc6d0 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.652+0000 7f699affd700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.652+0000 7f699affd700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 0x7f6988061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6990009fd0 tx=0x7f6990017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.656+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f698c04aa50 con 0x7f699c0bc6d0 2024-01-21T20:17:02.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.822+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f699c0c4c80 con 0x7f699c0bc6d0 2024-01-21T20:17:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.823+0000 7f69837fe700 1 -- 172.21.15.133:0/3567334167 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17888 (secure 0 0 0) 0x7f698c04e070 con 0x7f699c0bc6d0 2024-01-21T20:17:02.812 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:02.813 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":123,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:02.495174+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:17:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 msgr2=0x7f6988061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 0x7f6988061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6990009fd0 tx=0x7f6990017000).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 msgr2=0x7f699c14c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f698c00c440 tx=0x7f698c007dc0).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 shutdown_connections 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f698805f150 0x7f6988061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f699c1546b0 0x7f699c165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f699c0a9e30 0x7f699c0ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 --2- 172.21.15.133:0/3567334167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f699c0bc6d0 0x7f699c14c230 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 >> 172.21.15.133:0/3567334167 conn(0x7f699c0c8200 msgr2=0x7f699c0c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 shutdown_connections 2024-01-21T20:17:02.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.825+0000 7f69a12d8700 1 -- 172.21.15.133:0/3567334167 wait complete. 2024-01-21T20:17:02.827 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:17:02.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.953+0000 7f8832785700 1 Processor -- start 2024-01-21T20:17:02.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.953+0000 7f8832785700 1 -- start start 2024-01-21T20:17:02.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8832785700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 0x7f882c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8832785700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f882c062e00 0x7f882c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8832785700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882c1584f0 con 0x7f882c13aa00 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8832785700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0bd6f0 con 0x7f882c062e00 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8832785700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882c0654e0 con 0x7f882c13a620 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f882c062e00 0x7f882c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f882c062e00 0x7f882c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53292/0 (socket says 172.21.15.133:53292) 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 -- 172.21.15.133:0/3874239046 learned_addr learned my addr 172.21.15.133:0/3874239046 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f882bfff700 1 --2- 172.21.15.133:0/3874239046 >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 0x7f882c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 -- 172.21.15.133:0/3874239046 >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 msgr2=0x7f882c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 --2- 172.21.15.133:0/3874239046 >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 0x7f882c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 -- 172.21.15.133:0/3874239046 >> v1:172.21.15.178:6789/0 conn(0x7f882c13aa00 legacy=0x7f882c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 -- 172.21.15.133:0/3874239046 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c158730 con 0x7f882c062e00 2024-01-21T20:17:02.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f882bfff700 1 --2- 172.21.15.133:0/3874239046 >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 0x7f882c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.954+0000 7f8830d22700 1 --2- 172.21.15.133:0/3874239046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c062e00 0x7f882c158000 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f882c068f20 tx=0x7f8824009840).ready entity=mon.0 client_cookie=7cfabc016eb0e560 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f882affd700 1 -- 172.21.15.133:0/3874239046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400e070 con 0x7f882c062e00 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f882affd700 1 -- 172.21.15.133:0/3874239046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400ba10 con 0x7f882c062e00 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f882affd700 1 -- 172.21.15.133:0/3874239046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400bd90 con 0x7f882c062e00 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 -- 172.21.15.133:0/3874239046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c062e00 msgr2=0x7f882c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 --2- 172.21.15.133:0/3874239046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c062e00 0x7f882c158000 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f882c068f20 tx=0x7f8824009840).stop 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 -- 172.21.15.133:0/3874239046 shutdown_connections 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 --2- 172.21.15.133:0/3874239046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c062e00 0x7f882c158000 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 --2- 172.21.15.133:0/3874239046 >> v2:172.21.15.178:3300/0 conn(0x7f882c13a620 0x7f882c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 -- 172.21.15.133:0/3874239046 >> 172.21.15.133:0/3874239046 conn(0x7f882c0c7dc0 msgr2=0x7f882c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 -- 172.21.15.133:0/3874239046 shutdown_connections 2024-01-21T20:17:02.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.955+0000 7f8832785700 1 -- 172.21.15.133:0/3874239046 wait complete. 2024-01-21T20:17:02.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.956+0000 7f8832785700 1 Processor -- start 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 -- start start 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f882c062e00 0x7f882c13da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882c13aa00 0x7f882c0a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0ac240 con 0x7f882c13a620 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882c0abf10 con 0x7f882c13aa00 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f8832785700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882c1684d0 con 0x7f882c062e00 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f882b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f882b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53304/0 (socket says 172.21.15.133:53304) 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.957+0000 7f882b7fe700 1 -- 172.21.15.133:0/2747336665 learned_addr learned my addr 172.21.15.133:0/2747336665 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882bfff700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f882c062e00 0x7f882c13da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8830d22700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882c13aa00 0x7f882c0a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 -- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f882c062e00 msgr2=0x7f882c13da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f882c062e00 0x7f882c13da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 -- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882c13aa00 msgr2=0x7f882c0a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882c13aa00 0x7f882c0a7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 -- 172.21.15.133:0/2747336665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824009ae0 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f882b7fe700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f881c00b460 tx=0x7f881c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c012410 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c012590 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c012950 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882c1687b0 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.958+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882c13df20 con 0x7f882c13a620 2024-01-21T20:17:02.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.959+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882c05fdf0 con 0x7f882c13a620 2024-01-21T20:17:02.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.959+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f881c012cc0 con 0x7f882c13a620 2024-01-21T20:17:02.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.960+0000 7f8828ff9700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 0x7f8818061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:02.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.960+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f881c07a120 con 0x7f882c13a620 2024-01-21T20:17:02.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.960+0000 7f882bfff700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 0x7f8818061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:02.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.960+0000 7f882bfff700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 0x7f8818061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f882000abd0 tx=0x7f8820008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:02.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:02.964+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f881c04b1a0 con 0x7f882c13a620 2024-01-21T20:17:03.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.127+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f882c06bdd0 con 0x7f882c13a620 2024-01-21T20:17:03.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.128+0000 7f8828ff9700 1 -- 172.21.15.133:0/2747336665 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17888 (secure 0 0 0) 0x7f881c04e7c0 con 0x7f882c13a620 2024-01-21T20:17:03.117 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:03.117 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":123,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:02.495174+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:17:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 msgr2=0x7f8818061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 0x7f8818061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f882000abd0 tx=0x7f8820008040).stop 2024-01-21T20:17:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 msgr2=0x7f882c167bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f881c00b460 tx=0x7f881c006f20).stop 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 shutdown_connections 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f881805f150 0x7f8818061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882c13aa00 0x7f882c0a7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f882c062e00 0x7f882c13da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 --2- 172.21.15.133:0/2747336665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f882c13a620 0x7f882c167bd0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 >> 172.21.15.133:0/2747336665 conn(0x7f882c0c7dc0 msgr2=0x7f882c0a69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 shutdown_connections 2024-01-21T20:17:03.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.130+0000 7f8832785700 1 -- 172.21.15.133:0/2747336665 wait complete. 2024-01-21T20:17:03.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:17:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.260+0000 7f0c2917e700 1 Processor -- start 2024-01-21T20:17:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.260+0000 7f0c2917e700 1 -- start start 2024-01-21T20:17:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.260+0000 7f0c2917e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0c2413a830 0x7f0c240c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2917e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 0x7f0c240bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2917e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240c3890 con 0x7f0c240695b0 2024-01-21T20:17:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2917e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240c3b70 con 0x7f0c2413a830 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2917e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c3e50 con 0x7f0c2413ac10 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 0x7f0c240bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0c2413a830 0x7f0c240c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2359e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0c240695b0 0x7f0c24154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37398/0 (socket says 172.21.15.133:37398) 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2359e700 1 -- 172.21.15.133:0/145172849 learned_addr learned my addr 172.21.15.133:0/145172849 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 -- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 msgr2=0x7f0c240bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 0x7f0c240bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 -- 172.21.15.133:0/145172849 >> v1:172.21.15.178:6789/0 conn(0x7f0c240695b0 legacy=0x7f0c24154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c21d9b700 1 -- 172.21.15.133:0/145172849 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280974450 0 0) 0x7f0c240c3890 con 0x7f0c240695b0 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 -- 172.21.15.133:0/145172849 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240c4130 con 0x7f0c2413a830 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c2259c700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 0x7f0c240bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c22d9d700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413a830 0x7f0c240c3220 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0c14009760 tx=0x7f0c14009060).ready entity=mon.1 client_cookie=ff48ad92fbd83d7c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.261+0000 7f0c21d9b700 1 -- 172.21.15.133:0/145172849 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140090d0 con 0x7f0c2413a830 2024-01-21T20:17:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c21d9b700 1 -- 172.21.15.133:0/145172849 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400f510 con 0x7f0c2413a830 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c21d9b700 1 -- 172.21.15.133:0/145172849 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f890 con 0x7f0c2413a830 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 -- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413a830 msgr2=0x7f0c240c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413a830 0x7f0c240c3220 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0c14009760 tx=0x7f0c14009060).stop 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 -- 172.21.15.133:0/145172849 shutdown_connections 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413a830 0x7f0c240c3220 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 --2- 172.21.15.133:0/145172849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413ac10 0x7f0c240bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 -- 172.21.15.133:0/145172849 >> 172.21.15.133:0/145172849 conn(0x7f0c240c7dc0 msgr2=0x7f0c240c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 -- 172.21.15.133:0/145172849 shutdown_connections 2024-01-21T20:17:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.262+0000 7f0c2917e700 1 -- 172.21.15.133:0/145172849 wait complete. 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 Processor -- start 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 -- start start 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413a830 0x7f0c240a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413ac10 0x7f0c240626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240a5220 con 0x7f0c240695b0 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240a5500 con 0x7f0c2413ac10 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c2917e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240a57e0 con 0x7f0c2413a830 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c22d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53314/0 (socket says 172.21.15.133:53314) 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.264+0000 7f0c22d9d700 1 -- 172.21.15.133:0/3932912861 learned_addr learned my addr 172.21.15.133:0/3932912861 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:03.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c2359e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413ac10 0x7f0c240626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c2259c700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413a830 0x7f0c240a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 -- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413a830 msgr2=0x7f0c240a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413a830 0x7f0c240a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 -- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413ac10 msgr2=0x7f0c240626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413ac10 0x7f0c240626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 -- 172.21.15.133:0/3932912861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c180092a0 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c22d9d700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f0c14009e00 tx=0x7f0c14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1400f890 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1400fc50 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c140092a0 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1401b440 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.265+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c240c0440 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.266+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2405fdf0 con 0x7f0c240695b0 2024-01-21T20:17:03.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.266+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0c1401b7f0 con 0x7f0c240695b0 2024-01-21T20:17:03.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.267+0000 7f0c0b7fe700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 0x7f0c10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.267+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f0c1407b900 con 0x7f0c240695b0 2024-01-21T20:17:03.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.267+0000 7f0c2259c700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 0x7f0c10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.267+0000 7f0c2259c700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 0x7f0c10061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0c24153c80 tx=0x7f0c18009060).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.271+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0c1404c980 con 0x7f0c240695b0 2024-01-21T20:17:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.477+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0c240c0820 con 0x7f0c240695b0 2024-01-21T20:17:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.504+0000 7f0c0b7fe700 1 -- 172.21.15.133:0/3932912861 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c140280b0 con 0x7f0c240695b0 2024-01-21T20:17:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 msgr2=0x7f0c10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 0x7f0c10061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0c24153c80 tx=0x7f0c18009060).stop 2024-01-21T20:17:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 msgr2=0x7f0c24137f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f0c14009e00 tx=0x7f0c14017000).stop 2024-01-21T20:17:03.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 shutdown_connections 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0c1005f150 0x7f0c10061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c2413ac10 0x7f0c240626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c240695b0 0x7f0c24137f80 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 --2- 172.21.15.133:0/3932912861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c2413a830 0x7f0c240a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 >> 172.21.15.133:0/3932912861 conn(0x7f0c240c7dc0 msgr2=0x7f0c24138dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 shutdown_connections 2024-01-21T20:17:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.507+0000 7f0c2917e700 1 -- 172.21.15.133:0/3932912861 wait complete. 2024-01-21T20:17:03.508 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:17:03.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:17:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.638+0000 7f759bbf8700 1 Processor -- start 2024-01-21T20:17:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.638+0000 7f759bbf8700 1 -- start start 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f759bbf8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f759413a620 0x7f75940a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f759bbf8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75940654e0 con 0x7f7594062e00 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f759bbf8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7594158730 con 0x7f759413aa00 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f759bbf8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75940bd6f0 con 0x7f759413a620 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f7599994700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f759413a620 0x7f75940a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f7599994700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f759413a620 0x7f75940a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53326/0 (socket says 172.21.15.133:53326) 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.639+0000 7f7599994700 1 -- 172.21.15.133:0/4091061291 learned_addr learned my addr 172.21.15.133:0/4091061291 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:03.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7599994700 1 -- 172.21.15.133:0/4091061291 >> v1:172.21.15.178:6789/0 conn(0x7f759413aa00 legacy=0x7f75940626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7599994700 1 -- 172.21.15.133:0/4091061291 >> v1:172.21.15.133:6789/0 conn(0x7f7594062e00 legacy=0x7f7594065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7599994700 1 -- 172.21.15.133:0/4091061291 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7594158a10 con 0x7f759413a620 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7598992700 1 -- 172.21.15.133:0/4091061291 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159598292 0 0) 0x7f75940654e0 con 0x7f7594062e00 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7599994700 1 --2- 172.21.15.133:0/4091061291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940a6e30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f7584006fd0 tx=0x7f75840090f0).ready entity=mon.0 client_cookie=df3b7133f21f474 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7598992700 1 -- 172.21.15.133:0/4091061291 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758400b600 con 0x7f759413a620 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7598992700 1 -- 172.21.15.133:0/4091061291 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758400b760 con 0x7f759413a620 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f7598992700 1 -- 172.21.15.133:0/4091061291 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758400bb00 con 0x7f759413a620 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f759bbf8700 1 -- 172.21.15.133:0/4091061291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 msgr2=0x7f75940a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.640+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4091061291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940a6e30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f7584006fd0 tx=0x7f75840090f0).stop 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.641+0000 7f759bbf8700 1 -- 172.21.15.133:0/4091061291 shutdown_connections 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.641+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4091061291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940a6e30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.641+0000 7f759bbf8700 1 -- 172.21.15.133:0/4091061291 >> 172.21.15.133:0/4091061291 conn(0x7f75940c7dc0 msgr2=0x7f75940c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.641+0000 7f759bbf8700 1 -- 172.21.15.133:0/4091061291 shutdown_connections 2024-01-21T20:17:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.641+0000 7f759bbf8700 1 -- 172.21.15.133:0/4091061291 wait complete. 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.642+0000 7f759bbf8700 1 Processor -- start 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.642+0000 7f759bbf8700 1 -- start start 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594062e00 0x7f7594139b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 0x7f7594065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75940acf60 con 0x7f759413a620 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75940abd40 con 0x7f759413aa00 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759bbf8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75940ac5e0 con 0x7f7594062e00 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f7599193700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f7599193700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53340/0 (socket says 172.21.15.133:53340) 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f7599193700 1 -- 172.21.15.133:0/4044275006 learned_addr learned my addr 172.21.15.133:0/4044275006 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f759a195700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 0x7f7594065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.643+0000 7f7599994700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594062e00 0x7f7594139b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 -- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594062e00 msgr2=0x7f7594139b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594062e00 0x7f7594139b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 -- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 msgr2=0x7f7594065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 0x7f7594065970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 -- 172.21.15.133:0/4044275006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7584009370 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f759a195700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 0x7f7594065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f7599193700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f759000b460 tx=0x7f7590006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590012410 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590012590 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590012950 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7594165440 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.644+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75940ac270 con 0x7f759413a620 2024-01-21T20:17:03.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.645+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759405fdf0 con 0x7f759413a620 2024-01-21T20:17:03.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.645+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7590012d00 con 0x7f759413a620 2024-01-21T20:17:03.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.646+0000 7f758a7fc700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 0x7f7578061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:03.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.646+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f759007a1d0 con 0x7f759413a620 2024-01-21T20:17:03.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.646+0000 7f7599994700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 0x7f7578061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:03.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.646+0000 7f7599994700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 0x7f7578061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7594158370 tx=0x7f7584017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:03.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.650+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f759004b250 con 0x7f759413a620 2024-01-21T20:17:03.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:03.858+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f75940a97f0 con 0x7f759413a620 2024-01-21T20:17:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.503+0000 7f758a7fc700 1 -- 172.21.15.133:0/4044275006 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7f759004e870 con 0x7f759413a620 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 msgr2=0x7f7578061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 0x7f7578061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7594158370 tx=0x7f7584017000).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 msgr2=0x7f75940aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f759000b460 tx=0x7f7590006f20).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 shutdown_connections 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f757805f150 0x7f7578061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759413aa00 0x7f7594065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594062e00 0x7f7594139b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 --2- 172.21.15.133:0/4044275006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f759413a620 0x7f75940aca70 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 >> 172.21.15.133:0/4044275006 conn(0x7f75940c7dc0 msgr2=0x7f7594156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:04.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 shutdown_connections 2024-01-21T20:17:04.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.506+0000 7f759bbf8700 1 -- 172.21.15.133:0/4044275006 wait complete. 2024-01-21T20:17:04.510 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:17:04.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:17:04.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.643+0000 7f8d1b18f700 1 Processor -- start 2024-01-21T20:17:04.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.643+0000 7f8d1b18f700 1 -- start start 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d140beb30 0x7f8d14155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 0x7f8d140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d14069cd0 0x7f8d14151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d140bef10 con 0x7f8d140beb30 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d14156070 con 0x7f8d140c3fb0 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d1b18f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d14065660 con 0x7f8d14069cd0 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d18f2b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d140beb30 0x7f8d14155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d18f2b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d140beb30 0x7f8d14155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53356/0 (socket says 172.21.15.133:53356) 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.644+0000 7f8d18f2b700 1 -- 172.21.15.133:0/1156780349 learned_addr learned my addr 172.21.15.133:0/1156780349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d13fff700 1 --2- 172.21.15.133:0/1156780349 >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 0x7f8d140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1972c700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d14069cd0 0x7f8d14151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 -- 172.21.15.133:0/1156780349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d14069cd0 msgr2=0x7f8d14151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d14069cd0 0x7f8d14151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 -- 172.21.15.133:0/1156780349 >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 msgr2=0x7f8d140697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1156780349 >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 0x7f8d140697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 -- 172.21.15.133:0/1156780349 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14065f00 con 0x7f8d140beb30 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d13fff700 1 --2- 172.21.15.133:0/1156780349 >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 0x7f8d140697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d14155b80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f8d1405ecd0 tx=0x7f8d080090f0).ready entity=mon.0 client_cookie=625ae52d718df323 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d137fe700 1 -- 172.21.15.133:0/1156780349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800b600 con 0x7f8d140beb30 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d137fe700 1 -- 172.21.15.133:0/1156780349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0800b760 con 0x7f8d140beb30 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d137fe700 1 -- 172.21.15.133:0/1156780349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0800bb00 con 0x7f8d140beb30 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1156780349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 msgr2=0x7f8d14155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d14155b80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f8d1405ecd0 tx=0x7f8d080090f0).stop 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1156780349 shutdown_connections 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d14069cd0 0x7f8d14151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1156780349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d14155b80 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1156780349 >> v2:172.21.15.178:3300/0 conn(0x7f8d140c3fb0 0x7f8d140697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.645+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1156780349 >> 172.21.15.133:0/1156780349 conn(0x7f8d140c8010 msgr2=0x7f8d140c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.646+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1156780349 shutdown_connections 2024-01-21T20:17:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.646+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1156780349 wait complete. 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.647+0000 7f8d1b18f700 1 Processor -- start 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.647+0000 7f8d1b18f700 1 -- start start 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d14069cd0 0x7f8d14138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d140c3fb0 0x7f8d140c7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140c7cf0 con 0x7f8d140beb30 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140bf150 con 0x7f8d14069cd0 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140adc00 con 0x7f8d140c3fb0 2024-01-21T20:17:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 -- 172.21.15.133:0/1056902973 learned_addr learned my addr 172.21.15.133:0/1056902973 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d14069cd0 0x7f8d14138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1972c700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d140c3fb0 0x7f8d140c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 -- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d140c3fb0 msgr2=0x7f8d140c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d140c3fb0 0x7f8d140c7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 -- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d14069cd0 msgr2=0x7f8d14138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d14069cd0 0x7f8d14138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 -- 172.21.15.133:0/1056902973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009370 con 0x7f8d140beb30 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d13fff700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f8d0000d860 tx=0x7f8d00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00011590 con 0x7f8d140beb30 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d000116f0 con 0x7f8d140beb30 2024-01-21T20:17:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d140bf3f0 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00011a70 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.648+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d140adee0 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.649+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d140bfa40 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.650+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8d00012420 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.650+0000 7f8d117fa700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 0x7f8cf8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.650+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f8d00079ef0 con 0x7f8d140beb30 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.650+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 0x7f8cf8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.651+0000 7f8d18f2b700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 0x7f8cf8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8d08009fd0 tx=0x7f8d08017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.654+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8d0004af10 con 0x7f8d140beb30 2024-01-21T20:17:04.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.860+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d14095ee0 con 0x7f8d140beb30 2024-01-21T20:17:04.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.861+0000 7f8d117fa700 1 -- 172.21.15.133:0/1056902973 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f8d0004e530 con 0x7f8d140beb30 2024-01-21T20:17:04.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:04.850 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:17:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 msgr2=0x7f8cf8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 0x7f8cf8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f8d08009fd0 tx=0x7f8d08017000).stop 2024-01-21T20:17:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 msgr2=0x7f8d140c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f8d0000d860 tx=0x7f8d00008040).stop 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 shutdown_connections 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8cf805f150 0x7f8cf8061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d140c3fb0 0x7f8d140c7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d14069cd0 0x7f8d14138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 --2- 172.21.15.133:0/1056902973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d140beb30 0x7f8d140c7310 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 >> 172.21.15.133:0/1056902973 conn(0x7f8d140c8010 msgr2=0x7f8d140c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 shutdown_connections 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.863+0000 7f8d1b18f700 1 -- 172.21.15.133:0/1056902973 wait complete. 2024-01-21T20:17:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:17:04.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:17:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.990+0000 7f0612407700 1 Processor -- start 2024-01-21T20:17:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.990+0000 7f0612407700 1 -- start start 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f060c137030 0x7f060c067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 0x7f060c155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 0x7f060c0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c0c6290 con 0x7f060c137030 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060c1557f0 con 0x7f060c137410 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f0612407700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c068370 con 0x7f060c0c5930 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f060c137030 0x7f060c067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f060c137030 0x7f060c067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53360/0 (socket says 172.21.15.133:53360) 2024-01-21T20:17:04.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 -- 172.21.15.133:0/1025197231 learned_addr learned my addr 172.21.15.133:0/1025197231 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 -- 172.21.15.133:0/1025197231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 msgr2=0x7f060c0c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f06109a4700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 0x7f060c0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060b7fe700 1 --2- 172.21.15.133:0/1025197231 >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 0x7f060c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 0x7f060c0c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 -- 172.21.15.133:0/1025197231 >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 msgr2=0x7f060c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 --2- 172.21.15.133:0/1025197231 >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 0x7f060c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060bfff700 1 -- 172.21.15.133:0/1025197231 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c068650 con 0x7f060c137030 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f060b7fe700 1 --2- 172.21.15.133:0/1025197231 >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 0x7f060c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.991+0000 7f06109a4700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 0x7f060c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f060bfff700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c067d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f060c0af0d0 tx=0x7f06000090f0).ready entity=mon.0 client_cookie=f12452e0caece187 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f060affd700 1 -- 172.21.15.133:0/1025197231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000b600 con 0x7f060c137030 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f060affd700 1 -- 172.21.15.133:0/1025197231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060000b760 con 0x7f060c137030 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f060affd700 1 -- 172.21.15.133:0/1025197231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000bb00 con 0x7f060c137030 2024-01-21T20:17:04.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 -- 172.21.15.133:0/1025197231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 msgr2=0x7f060c067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c067d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f060c0af0d0 tx=0x7f06000090f0).stop 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 -- 172.21.15.133:0/1025197231 shutdown_connections 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c0c5930 0x7f060c0c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 --2- 172.21.15.133:0/1025197231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c067d90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 --2- 172.21.15.133:0/1025197231 >> v2:172.21.15.178:3300/0 conn(0x7f060c137410 0x7f060c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 -- 172.21.15.133:0/1025197231 >> 172.21.15.133:0/1025197231 conn(0x7f060c066a90 msgr2=0x7f060c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 -- 172.21.15.133:0/1025197231 shutdown_connections 2024-01-21T20:17:04.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.992+0000 7f0612407700 1 -- 172.21.15.133:0/1025197231 wait complete. 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.994+0000 7f0612407700 1 Processor -- start 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.994+0000 7f0612407700 1 -- start start 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 0x7f060c156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c137410 0x7f060c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c13d9b0 con 0x7f060c137030 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c13cda0 con 0x7f060c0c5930 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f0612407700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c13d080 con 0x7f060c137410 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53362/0 (socket says 172.21.15.133:53362) 2024-01-21T20:17:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 -- 172.21.15.133:0/3193646810 learned_addr learned my addr 172.21.15.133:0/3193646810 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060bfff700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 0x7f060c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f06109a4700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c137410 0x7f060c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 -- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c137410 msgr2=0x7f060c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c137410 0x7f060c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 -- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 msgr2=0x7f060c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 0x7f060c156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 -- 172.21.15.133:0/3193646810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009370 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060bfff700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 0x7f060c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.995+0000 7f060b7fe700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f05fc00c880 tx=0x7f05fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.996+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc010580 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.996+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc0106e0 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.996+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c13d360 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.996+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc010a60 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.996+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c158550 con 0x7f060c137030 2024-01-21T20:17:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.997+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f060c13db60 con 0x7f060c137030 2024-01-21T20:17:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.997+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f05fc01b460 con 0x7f060c137030 2024-01-21T20:17:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.998+0000 7f0608ff9700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 0x7f05f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.998+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f05fc07aea0 con 0x7f060c137030 2024-01-21T20:17:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.998+0000 7f060bfff700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 0x7f05f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:04.998+0000 7f060bfff700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 0x7f05f8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0600009fd0 tx=0x7f0600017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:04.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.001+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f05fc04be80 con 0x7f060c137030 2024-01-21T20:17:05.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.166+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f060c05fdf0 con 0x7f060c137030 2024-01-21T20:17:05.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.167+0000 7f0608ff9700 1 -- 172.21.15.133:0/3193646810 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+17875 (secure 0 0 0) 0x7f05fc04f4a0 con 0x7f060c137030 2024-01-21T20:17:05.157 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:05.157 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":124,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:03.497463+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:17:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 msgr2=0x7f05f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 0x7f05f8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0600009fd0 tx=0x7f0600017000).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 msgr2=0x7f060c157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f05fc00c880 tx=0x7f05fc008040).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 shutdown_connections 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f05f805f150 0x7f05f8061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f060c137410 0x7f060c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f060c0c5930 0x7f060c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 --2- 172.21.15.133:0/3193646810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f060c137030 0x7f060c157b70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 >> 172.21.15.133:0/3193646810 conn(0x7f060c066a90 msgr2=0x7f060c0c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 shutdown_connections 2024-01-21T20:17:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.169+0000 7f0612407700 1 -- 172.21.15.133:0/3193646810 wait complete. 2024-01-21T20:17:05.171 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:17:05.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:17:05.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.297+0000 7f1b99ae5700 1 Processor -- start 2024-01-21T20:17:05.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.297+0000 7f1b99ae5700 1 -- start start 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.298+0000 7f1b99ae5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b94062c10 0x7f1b94062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.298+0000 7f1b99ae5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 0x7f1b94065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.298+0000 7f1b99ae5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b940634e0 con 0x7f1b94069c40 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.298+0000 7f1b99ae5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9406a130 con 0x7f1b94062c10 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.298+0000 7f1b99ae5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9406a410 con 0x7f1b940697e0 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b94062c10 0x7f1b94062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 0x7f1b94065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b94062c10 0x7f1b94062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:41200/0 (socket says 172.21.15.133:41200) 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 -- 172.21.15.133:0/3888697179 learned_addr learned my addr 172.21.15.133:0/3888697179 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b93fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1b94069c40 0x7f1b941583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37416/0 (socket says 172.21.15.133:37416) 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 0x7f1b94065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53312/0 (socket says 172.21.15.133:53312) 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 -- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 msgr2=0x7f1b94065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 --2- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 0x7f1b94065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 -- 172.21.15.133:0/3888697179 >> v1:172.21.15.178:6789/0 conn(0x7f1b94069c40 legacy=0x7f1b941583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 -- 172.21.15.133:0/3888697179 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9406a6f0 con 0x7f1b94062c10 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b927fc700 1 -- 172.21.15.133:0/3888697179 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466992816 0 0) 0x7f1b940634e0 con 0x7f1b94069c40 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b937fe700 1 --2- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94062c10 0x7f1b94062ff0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f1b7c006fd0 tx=0x7f1b7c0090f0).ready entity=mon.1 client_cookie=b0079dc7c7f3b591 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b927fc700 1 -- 172.21.15.133:0/3888697179 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00b580 con 0x7f1b94062c10 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b927fc700 1 -- 172.21.15.133:0/3888697179 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00b6e0 con 0x7f1b94062c10 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.299+0000 7f1b927fc700 1 -- 172.21.15.133:0/3888697179 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00ba80 con 0x7f1b94062c10 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94062c10 msgr2=0x7f1b94062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94062c10 0x7f1b94062ff0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f1b7c006fd0 tx=0x7f1b7c0090f0).stop 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3888697179 shutdown_connections 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94062c10 0x7f1b94062ff0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3888697179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b940697e0 0x7f1b94065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3888697179 >> 172.21.15.133:0/3888697179 conn(0x7f1b940c8010 msgr2=0x7f1b940c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3888697179 shutdown_connections 2024-01-21T20:17:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.300+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3888697179 wait complete. 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.301+0000 7f1b99ae5700 1 Processor -- start 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.301+0000 7f1b99ae5700 1 -- start start 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b94062c10 0x7f1b94154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94069c40 0x7f1b9413c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940a91f0 con 0x7f1b940697e0 2024-01-21T20:17:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94154760 con 0x7f1b94069c40 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b99ae5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b940a8060 con 0x7f1b94062c10 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53372/0 (socket says 172.21.15.133:53372) 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 -- 172.21.15.133:0/3854988402 learned_addr learned my addr 172.21.15.133:0/3854988402 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b93fff700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94069c40 0x7f1b9413c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b937fe700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b94062c10 0x7f1b94154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 -- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b94062c10 msgr2=0x7f1b94154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b94062c10 0x7f1b94154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 -- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94069c40 msgr2=0x7f1b9413c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94069c40 0x7f1b9413c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 -- 172.21.15.133:0/3854988402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009370 con 0x7f1b940697e0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.302+0000 7f1b92ffd700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1b8400e960 tx=0x7f1b84009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.303+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84012600 con 0x7f1b940697e0 2024-01-21T20:17:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.303+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84012760 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.303+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b940a8340 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.303+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84012ae0 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.303+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b940a8900 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.304+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b940a93a0 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.304+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1b8401b400 con 0x7f1b940697e0 2024-01-21T20:17:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.304+0000 7f1b8bfff700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.304+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f1b8407a850 con 0x7f1b940697e0 2024-01-21T20:17:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.304+0000 7f1b937fe700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.305+0000 7f1b937fe700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 0x7f1b74061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1b7c00b340 tx=0x7f1b7c017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.308+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b940a93a0 con 0x7f1b940697e0 2024-01-21T20:17:05.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.466+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b940a93a0 con 0x7f1b7405f150 2024-01-21T20:17:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.476+0000 7f1b8bfff700 1 -- 172.21.15.133:0/3854988402 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350342 (secure 0 0 0) 0x7f1b940a93a0 con 0x7f1b7405f150 2024-01-21T20:17:05.470 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 msgr2=0x7f1b74061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 0x7f1b74061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1b7c00b340 tx=0x7f1b7c017000).stop 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 msgr2=0x7f1b940ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f1b8400e960 tx=0x7f1b84009060).stop 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 shutdown_connections 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1b7405f150 0x7f1b74061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b94069c40 0x7f1b9413c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b94062c10 0x7f1b94154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 --2- 172.21.15.133:0/3854988402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940697e0 0x7f1b940ab0e0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 >> 172.21.15.133:0/3854988402 conn(0x7f1b940c8010 msgr2=0x7f1b940a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 shutdown_connections 2024-01-21T20:17:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.479+0000 7f1b99ae5700 1 -- 172.21.15.133:0/3854988402 wait complete. 2024-01-21T20:17:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:17:05.480 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T20:17:04.722313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425208,"kb_used_data":11576,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752549512,"statfs":{"total":773094113280,"available":770610700288,"internally_reserved":0,"allocated":11853824,"data_stored":6197134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5591,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-57,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.433786"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451774+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:16:58.451774+0000","last_peered":"2024-01-21T20:16:58.451774+0000","last_clean":"2024-01-21T20:16:58.451774+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:16:58.451774+0000","last_undegraded":"2024-01-21T20:16:58.451774+0000","last_fullsized":"2024-01-21T20:16:58.451774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449032+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:16:58.449032+0000","last_peered":"2024-01-21T20:16:58.449032+0000","last_clean":"2024-01-21T20:16:58.449032+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:16:58.449032+0000","last_undegraded":"2024-01-21T20:16:58.449032+0000","last_fullsized":"2024-01-21T20:16:58.449032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.061081+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:16:58.061081+0000","last_peered":"2024-01-21T20:16:58.061081+0000","last_clean":"2024-01-21T20:16:58.061081+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:16:58.061081+0000","last_undegraded":"2024-01-21T20:16:58.061081+0000","last_fullsized":"2024-01-21T20:16:58.061081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449051+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:16:58.449051+0000","last_peered":"2024-01-21T20:16:58.449051+0000","last_clean":"2024-01-21T20:16:58.449051+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:16:58.449051+0000","last_undegraded":"2024-01-21T20:16:58.449051+0000","last_fullsized":"2024-01-21T20:16:58.449051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059069+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:16:58.059069+0000","last_peered":"2024-01-21T20:16:58.059069+0000","last_clean":"2024-01-21T20:16:58.059069+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:16:58.059069+0000","last_undegraded":"2024-01-21T20:16:58.059069+0000","last_fullsized":"2024-01-21T20:16:58.059069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059138+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:16:58.059138+0000","last_peered":"2024-01-21T20:16:58.059138+0000","last_clean":"2024-01-21T20:16:58.059138+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:16:58.059138+0000","last_undegraded":"2024-01-21T20:16:58.059138+0000","last_fullsized":"2024-01-21T20:16:58.059138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059193+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:16:58.059193+0000","last_peered":"2024-01-21T20:16:58.059193+0000","last_clean":"2024-01-21T20:16:58.059193+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:16:58.059193+0000","last_undegraded":"2024-01-21T20:16:58.059193+0000","last_fullsized":"2024-01-21T20:16:58.059193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451769+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:16:58.451769+0000","last_peered":"2024-01-21T20:16:58.451769+0000","last_clean":"2024-01-21T20:16:58.451769+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:16:58.451769+0000","last_undegraded":"2024-01-21T20:16:58.451769+0000","last_fullsized":"2024-01-21T20:16:58.451769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059076+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:16:58.059076+0000","last_peered":"2024-01-21T20:16:58.059076+0000","last_clean":"2024-01-21T20:16:58.059076+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:16:58.059076+0000","last_undegraded":"2024-01-21T20:16:58.059076+0000","last_fullsized":"2024-01-21T20:16:58.059076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.82099999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79700000000000004},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.82799999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":0.80400000000000005},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.83699999999999997},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.81499999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.46999999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":1.083},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64300000000000002,"5min":0.78700000000000003,"15min":1.107},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":1.016},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70499999999999996,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.877,"15min":1.0609999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":1.621,"15min":1.621},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.65900000000000003,"5min":0.75,"15min":0.86099999999999999},"last":0.35499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.61799999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.625},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.61399999999999999},"last":0.38},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.44},"min":{"1min":0.36299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.627},"last":0.35699999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.40200000000000002},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.68799999999999994},"last":0.435}]},{"osd":3,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.41299999999999998},"min":{"1min":0.34200000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56699999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.47299999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.98899999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64100000000000001,"15min":0.67000000000000004},"min":{"1min":0.501,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.878,"15min":0.99299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.872,"15min":0.95299999999999996},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.36499999999999999},"min":{"1min":0.27500000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.47499999999999998,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.442}]},{"osd":2,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.70799999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.621,"15min":0.81699999999999995},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.40799999999999997,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.376},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.34799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.34399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.433,"15min":0.45600000000000002},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32300000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82799999999999996,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.91900000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.2,"15min":1.2},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.874,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":1.216,"15min":1.216},"last":0.45400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.55100000000000005,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.47799999999999998,"15min":0.44600000000000001},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":7.532,"15min":7.532},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.40999999999999998},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.625,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.497}]},{"osd":5,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79800000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81399999999999995,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.749,"15min":0.82599999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.46300000000000002,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.76600000000000001,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.89600000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":1.472,"15min":1.472},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":0.82599999999999996},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":1.0920000000000001,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59599999999999997,"5min":0.748,"15min":0.77600000000000002},"last":0.747}]},{"osd":6,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.875}]},{"osd":7,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.747},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":1.252,"15min":1.252},"last":0.78600000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.73399999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60499999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.81599999999999995,"5min":1.008,"15min":1.008},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":1.891,"15min":1.891},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77300000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.745,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:17:05.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:17:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 Processor -- start 2024-01-21T20:17:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 -- start start 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7d40c77b0 0x7fa7d40c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7d40c6590 0x7fa7d40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d40c89d0 con 0x7fa7d41545a0 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.647+0000 7fa7d97e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40c69c0 con 0x7fa7d40c6590 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d97e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d40c7dc0 con 0x7fa7d40c77b0 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7d40c6590 0x7fa7d40c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa7d40c6590 0x7fa7d40c0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53386/0 (socket says 172.21.15.133:53386) 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 -- 172.21.15.133:0/2009240765 learned_addr learned my addr 172.21.15.133:0/2009240765 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d27fc700 1 --2- 172.21.15.133:0/2009240765 >> v2:172.21.15.178:3300/0 conn(0x7fa7d40c77b0 0x7fa7d40c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 -- 172.21.15.133:0/2009240765 >> v2:172.21.15.178:3300/0 conn(0x7fa7d40c77b0 msgr2=0x7fa7d40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 --2- 172.21.15.133:0/2009240765 >> v2:172.21.15.178:3300/0 conn(0x7fa7d40c77b0 0x7fa7d40c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 -- 172.21.15.133:0/2009240765 >> v1:172.21.15.178:6789/0 conn(0x7fa7d41545a0 legacy=0x7fa7d40aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 -- 172.21.15.133:0/2009240765 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40c80a0 con 0x7fa7d40c6590 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d37fe700 1 --2- 172.21.15.133:0/2009240765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d40c0750 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa7d4084730 tx=0x7fa7cc009840).ready entity=mon.0 client_cookie=6bc2ad80c5109f6c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d1ffb700 1 -- 172.21.15.133:0/2009240765 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00e070 con 0x7fa7d40c6590 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d1ffb700 1 -- 172.21.15.133:0/2009240765 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc00ba50 con 0x7fa7d40c6590 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.648+0000 7fa7d1ffb700 1 -- 172.21.15.133:0/2009240765 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc00bdd0 con 0x7fa7d40c6590 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 -- 172.21.15.133:0/2009240765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 msgr2=0x7fa7d40c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/2009240765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d40c0750 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa7d4084730 tx=0x7fa7cc009840).stop 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 -- 172.21.15.133:0/2009240765 shutdown_connections 2024-01-21T20:17:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/2009240765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d40c0750 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/2009240765 >> v2:172.21.15.178:3300/0 conn(0x7fa7d40c77b0 0x7fa7d40c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 -- 172.21.15.133:0/2009240765 >> 172.21.15.133:0/2009240765 conn(0x7fa7d40649d0 msgr2=0x7fa7d4064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 -- 172.21.15.133:0/2009240765 shutdown_connections 2024-01-21T20:17:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.649+0000 7fa7d97e4700 1 -- 172.21.15.133:0/2009240765 wait complete. 2024-01-21T20:17:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.650+0000 7fa7d97e4700 1 Processor -- start 2024-01-21T20:17:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.650+0000 7fa7d97e4700 1 -- start start 2024-01-21T20:17:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7d40c77b0 0x7fa7d40ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7d41545a0 0x7fa7d40ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40af750 con 0x7fa7d40c6590 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d414f7d0 con 0x7fa7d41545a0 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d97e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d40aeb40 con 0x7fa7d40c77b0 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53390/0 (socket says 172.21.15.133:53390) 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 -- 172.21.15.133:0/630418528 learned_addr learned my addr 172.21.15.133:0/630418528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d37fe700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7d41545a0 0x7fa7d40ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d27fc700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7d40c77b0 0x7fa7d40ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 -- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7d40c77b0 msgr2=0x7fa7d40ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7d40c77b0 0x7fa7d40ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 -- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7d41545a0 msgr2=0x7fa7d40ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7d41545a0 0x7fa7d40ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 -- 172.21.15.133:0/630418528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc009ae0 con 0x7fa7d40c6590 2024-01-21T20:17:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.651+0000 7fa7d2ffd700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fa7c400c440 tx=0x7fa7c4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.652+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40123f0 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.652+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4001e90 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.652+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d40aee20 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.652+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4012780 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.652+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d40af3e0 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.653+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d405fdf0 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.653+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa7c4012b30 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.653+0000 7fa7bb7fe700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 0x7fa7c0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.653+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa7c40796a0 con 0x7fa7d40c6590 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.653+0000 7fa7d27fc700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 0x7fa7c0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.654+0000 7fa7d27fc700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 0x7fa7c0061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7c800bbc0 tx=0x7fa7c8008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.657+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa7c4047b00 con 0x7fa7d40c6590 2024-01-21T20:17:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.818+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7d40af890 con 0x7fa7c005f150 2024-01-21T20:17:05.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.827+0000 7fa7bb7fe700 1 -- 172.21.15.133:0/630418528 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350342 (secure 0 0 0) 0x7fa7c800b800 con 0x7fa7c005f150 2024-01-21T20:17:05.821 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:05.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 msgr2=0x7fa7c0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 0x7fa7c0061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7c800bbc0 tx=0x7fa7c8008040).stop 2024-01-21T20:17:05.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 msgr2=0x7fa7d414f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7fa7c400c440 tx=0x7fa7c4007db0).stop 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 shutdown_connections 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa7c005f150 0x7fa7c0061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7d41545a0 0x7fa7d40ae570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7d40c6590 0x7fa7d414f2e0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 --2- 172.21.15.133:0/630418528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7d40c77b0 0x7fa7d40ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 >> 172.21.15.133:0/630418528 conn(0x7fa7d40649d0 msgr2=0x7fa7d40c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 shutdown_connections 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.831+0000 7fa7d97e4700 1 -- 172.21.15.133:0/630418528 wait complete. 2024-01-21T20:17:05.824 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:17:05.832 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T20:17:04.722313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425208,"kb_used_data":11576,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752549512,"statfs":{"total":773094113280,"available":770610700288,"internally_reserved":0,"allocated":11853824,"data_stored":6197134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5591,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-57,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.433786"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451774+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:16:58.451774+0000","last_peered":"2024-01-21T20:16:58.451774+0000","last_clean":"2024-01-21T20:16:58.451774+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:16:58.451774+0000","last_undegraded":"2024-01-21T20:16:58.451774+0000","last_fullsized":"2024-01-21T20:16:58.451774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449032+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:16:58.449032+0000","last_peered":"2024-01-21T20:16:58.449032+0000","last_clean":"2024-01-21T20:16:58.449032+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:16:58.449032+0000","last_undegraded":"2024-01-21T20:16:58.449032+0000","last_fullsized":"2024-01-21T20:16:58.449032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.061081+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:16:58.061081+0000","last_peered":"2024-01-21T20:16:58.061081+0000","last_clean":"2024-01-21T20:16:58.061081+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:16:58.061081+0000","last_undegraded":"2024-01-21T20:16:58.061081+0000","last_fullsized":"2024-01-21T20:16:58.061081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449051+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:16:58.449051+0000","last_peered":"2024-01-21T20:16:58.449051+0000","last_clean":"2024-01-21T20:16:58.449051+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:16:58.449051+0000","last_undegraded":"2024-01-21T20:16:58.449051+0000","last_fullsized":"2024-01-21T20:16:58.449051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059069+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:16:58.059069+0000","last_peered":"2024-01-21T20:16:58.059069+0000","last_clean":"2024-01-21T20:16:58.059069+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:16:58.059069+0000","last_undegraded":"2024-01-21T20:16:58.059069+0000","last_fullsized":"2024-01-21T20:16:58.059069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059138+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:16:58.059138+0000","last_peered":"2024-01-21T20:16:58.059138+0000","last_clean":"2024-01-21T20:16:58.059138+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:16:58.059138+0000","last_undegraded":"2024-01-21T20:16:58.059138+0000","last_fullsized":"2024-01-21T20:16:58.059138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059193+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:16:58.059193+0000","last_peered":"2024-01-21T20:16:58.059193+0000","last_clean":"2024-01-21T20:16:58.059193+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:16:58.059193+0000","last_undegraded":"2024-01-21T20:16:58.059193+0000","last_fullsized":"2024-01-21T20:16:58.059193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451769+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:16:58.451769+0000","last_peered":"2024-01-21T20:16:58.451769+0000","last_clean":"2024-01-21T20:16:58.451769+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:16:58.451769+0000","last_undegraded":"2024-01-21T20:16:58.451769+0000","last_fullsized":"2024-01-21T20:16:58.451769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059076+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:16:58.059076+0000","last_peered":"2024-01-21T20:16:58.059076+0000","last_clean":"2024-01-21T20:16:58.059076+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:16:58.059076+0000","last_undegraded":"2024-01-21T20:16:58.059076+0000","last_fullsized":"2024-01-21T20:16:58.059076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.82099999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79700000000000004},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.82799999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":0.80400000000000005},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.83699999999999997},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.81499999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.46999999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":1.083},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64300000000000002,"5min":0.78700000000000003,"15min":1.107},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":1.016},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70499999999999996,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.877,"15min":1.0609999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":1.621,"15min":1.621},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.65900000000000003,"5min":0.75,"15min":0.86099999999999999},"last":0.35499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.61799999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.625},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.61399999999999999},"last":0.38},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.44},"min":{"1min":0.36299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.627},"last":0.35699999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.40200000000000002},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.68799999999999994},"last":0.435}]},{"osd":3,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.41299999999999998},"min":{"1min":0.34200000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56699999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.47299999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.98899999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64100000000000001,"15min":0.67000000000000004},"min":{"1min":0.501,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.878,"15min":0.99299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.872,"15min":0.95299999999999996},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.36499999999999999},"min":{"1min":0.27500000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.47499999999999998,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.442}]},{"osd":2,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.70799999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.621,"15min":0.81699999999999995},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.40799999999999997,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.376},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.34799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.34399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.433,"15min":0.45600000000000002},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32300000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82799999999999996,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.91900000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.2,"15min":1.2},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.874,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":1.216,"15min":1.216},"last":0.45400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.55100000000000005,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.47799999999999998,"15min":0.44600000000000001},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":7.532,"15min":7.532},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.40999999999999998},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.625,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.497}]},{"osd":5,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79800000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81399999999999995,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.749,"15min":0.82599999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.46300000000000002,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.76600000000000001,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.89600000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":1.472,"15min":1.472},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":0.82599999999999996},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":1.0920000000000001,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59599999999999997,"5min":0.748,"15min":0.77600000000000002},"last":0.747}]},{"osd":6,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.875}]},{"osd":7,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.747},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":1.252,"15min":1.252},"last":0.78600000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.73399999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60499999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.81599999999999995,"5min":1.008,"15min":1.008},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":1.891,"15min":1.891},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77300000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.745,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:17:05.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:17:05.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.999+0000 7f2acf1ab700 1 Processor -- start 2024-01-21T20:17:05.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:05.999+0000 7f2acf1ab700 1 -- start start 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2acf1ab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ac81558c0 0x7f2ac80626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2acf1ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80a50f0 con 0x7f2ac8155ca0 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2acf1ab700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80a4da0 con 0x7f2ac80bd890 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2acf1ab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80bde00 con 0x7f2ac81558c0 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2ac8155ca0 0x7f2ac80bd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40668/0 (socket says 172.21.15.133:40668) 2024-01-21T20:17:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac7fff700 1 -- 172.21.15.133:0/1981385504 learned_addr learned my addr 172.21.15.133:0/1981385504 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2accf47700 1 --2- 172.21.15.133:0/1981385504 >> v2:172.21.15.178:3300/0 conn(0x7f2ac81558c0 0x7f2ac80626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1935916325 0 0) 0x7f2ac80a50f0 con 0x7f2ac8155ca0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab80033f0 con 0x7f2ac8155ca0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462071849 0 0) 0x7f2ab80033f0 con 0x7f2ac8155ca0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 >> v2:172.21.15.178:3300/0 conn(0x7f2ac81558c0 msgr2=0x7f2ac80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 --2- 172.21.15.133:0/1981385504 >> v2:172.21.15.178:3300/0 conn(0x7f2ac81558c0 0x7f2ac80626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 >> v1:172.21.15.178:6789/0 conn(0x7f2ac80bd890 legacy=0x7f2ac80a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80be0e0 con 0x7f2ac8155ca0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f2ab4001470 con 0x7f2ac8155ca0 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2accf47700 1 --2- 172.21.15.133:0/1981385504 >> v2:172.21.15.178:3300/0 conn(0x7f2ac81558c0 0x7f2ac80626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 >> v1:172.21.15.133:6789/0 conn(0x7f2ac8155ca0 legacy=0x7f2ac80bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab80038e0 0x7f2ab8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 0x7f2ab8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ab8005000 0x7f2ab800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80bde00 con 0x7f2ab8004690 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800bf60 con 0x7f2ab80038e0 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.000+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800c0f0 con 0x7f2ab8005000 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 0x7f2ab8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2accf47700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab80038e0 0x7f2ab8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2acd748700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ab8005000 0x7f2ab800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 -- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ab8005000 msgr2=0x7f2ab800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ab8005000 0x7f2ab800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 -- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab80038e0 msgr2=0x7f2ab8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab80038e0 0x7f2ab8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2acd748700 1 -- 172.21.15.133:0/1981385504 reap_dead start 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 -- 172.21.15.133:0/1981385504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80033f0 con 0x7f2ab8004690 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac7fff700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 0x7f2ab8004b10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2ab400c190 tx=0x7f2ab4001e50).ready entity=mon.0 client_cookie=1d241699e402884 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4007a20 con 0x7f2ab8004690 2024-01-21T20:17:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab400ca80 con 0x7f2ab8004690 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.001+0000 7f2ac77fe700 1 -- 172.21.15.133:0/1981385504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400ce00 con 0x7f2ab8004690 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 msgr2=0x7f2ab8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 0x7f2ab8004b10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2ab400c190 tx=0x7f2ab4001e50).stop 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1981385504 shutdown_connections 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1981385504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ab8004690 0x7f2ab8004b10 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1981385504 >> 172.21.15.133:0/1981385504 conn(0x7f2ac80c8010 msgr2=0x7f2ac80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1981385504 shutdown_connections 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.002+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1981385504 wait complete. 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.003+0000 7f2acf1ab700 1 Processor -- start 2024-01-21T20:17:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.003+0000 7f2acf1ab700 1 -- start start 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 0x7f2ac806a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80aafc0 0x7f2ac813db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac806a960 con 0x7f2ac80c7090 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80ac300 con 0x7f2ab8004690 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80c79e0 con 0x7f2ac80aafc0 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53410/0 (socket says 172.21.15.133:53410) 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 -- 172.21.15.133:0/1880492013 learned_addr learned my addr 172.21.15.133:0/1880492013 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2accf47700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 0x7f2ac806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2ac7fff700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80aafc0 0x7f2ac813db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 -- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80aafc0 msgr2=0x7f2ac813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80aafc0 0x7f2ac813db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 -- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 msgr2=0x7f2ac806a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 0x7f2ac806a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 -- 172.21.15.133:0/1880492013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80ab440 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2accf47700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 0x7f2ac806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acd748700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2ac8064e60 tx=0x7f2ac0007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0006c30 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac0006d90 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac80ac790 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0007260 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.004+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac80ab9d0 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.006+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac805fdf0 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.006+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2ac00075d0 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.006+0000 7f2ac57fa700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 0x7f2aac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.006+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f2ac0079fa0 con 0x7f2ac80c7090 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.006+0000 7f2accf47700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 0x7f2aac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:05.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.007+0000 7f2accf47700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 0x7f2aac061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2ac8060fa0 tx=0x7f2abc008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.010+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2ac004b020 con 0x7f2ac80c7090 2024-01-21T20:17:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.170+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ac80aa390 con 0x7f2aac05f150 2024-01-21T20:17:06.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.179+0000 7f2ac57fa700 1 -- 172.21.15.133:0/1880492013 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+350342 (secure 0 0 0) 0x7f2ac80aa390 con 0x7f2aac05f150 2024-01-21T20:17:06.172 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 msgr2=0x7f2aac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 0x7f2aac061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2ac8060fa0 tx=0x7f2abc008040).stop 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 msgr2=0x7f2ac80c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2ac8064e60 tx=0x7f2ac0007f30).stop 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 shutdown_connections 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2aac05f150 0x7f2aac061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ac80c7090 0x7f2ac80c74f0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ab8004690 0x7f2ac806a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 --2- 172.21.15.133:0/1880492013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80aafc0 0x7f2ac813db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 >> 172.21.15.133:0/1880492013 conn(0x7f2ac80c8010 msgr2=0x7f2ac80c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 shutdown_connections 2024-01-21T20:17:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.183+0000 7f2acf1ab700 1 -- 172.21.15.133:0/1880492013 wait complete. 2024-01-21T20:17:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:17:06.184 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T20:17:04.722313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2425208,"kb_used_data":11576,"kb_used_omap":0,"kb_used_meta":2413568,"kb_avail":752549512,"statfs":{"total":773094113280,"available":770610700288,"internally_reserved":0,"allocated":11853824,"data_stored":6197134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2471493632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5591,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-57,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.433786"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451774+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:16:58.451774+0000","last_peered":"2024-01-21T20:16:58.451774+0000","last_clean":"2024-01-21T20:16:58.451774+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:16:58.451774+0000","last_undegraded":"2024-01-21T20:16:58.451774+0000","last_fullsized":"2024-01-21T20:16:58.451774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449032+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:16:58.449032+0000","last_peered":"2024-01-21T20:16:58.449032+0000","last_clean":"2024-01-21T20:16:58.449032+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:16:58.449032+0000","last_undegraded":"2024-01-21T20:16:58.449032+0000","last_fullsized":"2024-01-21T20:16:58.449032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":100,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.061081+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:16:58.061081+0000","last_peered":"2024-01-21T20:16:58.061081+0000","last_clean":"2024-01-21T20:16:58.061081+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:16:58.061081+0000","last_undegraded":"2024-01-21T20:16:58.061081+0000","last_fullsized":"2024-01-21T20:16:58.061081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":106,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.449051+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:16:58.449051+0000","last_peered":"2024-01-21T20:16:58.449051+0000","last_clean":"2024-01-21T20:16:58.449051+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:16:58.449051+0000","last_undegraded":"2024-01-21T20:16:58.449051+0000","last_fullsized":"2024-01-21T20:16:58.449051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":97,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059069+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:16:58.059069+0000","last_peered":"2024-01-21T20:16:58.059069+0000","last_clean":"2024-01-21T20:16:58.059069+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:16:58.059069+0000","last_undegraded":"2024-01-21T20:16:58.059069+0000","last_fullsized":"2024-01-21T20:16:58.059069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059138+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:16:58.059138+0000","last_peered":"2024-01-21T20:16:58.059138+0000","last_clean":"2024-01-21T20:16:58.059138+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:16:58.059138+0000","last_undegraded":"2024-01-21T20:16:58.059138+0000","last_fullsized":"2024-01-21T20:16:58.059138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":95,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059193+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:16:58.059193+0000","last_peered":"2024-01-21T20:16:58.059193+0000","last_clean":"2024-01-21T20:16:58.059193+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:16:58.059193+0000","last_undegraded":"2024-01-21T20:16:58.059193+0000","last_fullsized":"2024-01-21T20:16:58.059193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.451769+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:16:58.451769+0000","last_peered":"2024-01-21T20:16:58.451769+0000","last_clean":"2024-01-21T20:16:58.451769+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:16:58.451769+0000","last_undegraded":"2024-01-21T20:16:58.451769+0000","last_fullsized":"2024-01-21T20:16:58.451769+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:02.121217+0000","last_change":"2024-01-21T20:17:02.121217+0000","last_active":"2024-01-21T20:17:02.121217+0000","last_peered":"2024-01-21T20:17:02.121217+0000","last_clean":"2024-01-21T20:17:02.121217+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:02.121217+0000","last_undegraded":"2024-01-21T20:17:02.121217+0000","last_fullsized":"2024-01-21T20:17:02.121217+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:17:01.117321+0000","last_change":"2024-01-21T20:17:01.117321+0000","last_active":"2024-01-21T20:17:01.117321+0000","last_peered":"2024-01-21T20:17:01.117321+0000","last_clean":"2024-01-21T20:17:01.117321+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:17:01.117321+0000","last_undegraded":"2024-01-21T20:17:01.117321+0000","last_fullsized":"2024-01-21T20:17:01.117321+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":92,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-01-21T20:16:58.059076+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:16:58.059076+0000","last_peered":"2024-01-21T20:16:58.059076+0000","last_clean":"2024-01-21T20:16:58.059076+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:16:58.059076+0000","last_undegraded":"2024-01-21T20:16:58.059076+0000","last_fullsized":"2024-01-21T20:16:58.059076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575061,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.82099999999999995},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79700000000000004},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.82799999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":0.80400000000000005},"last":0.63300000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.83699999999999997},"last":0.68300000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.82499999999999996},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.81499999999999995},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.46999999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":1.083},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64300000000000002,"5min":0.78700000000000003,"15min":1.107},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":1.016},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70499999999999996,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.51200000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.877,"15min":1.0609999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":1.621,"15min":1.621},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.65900000000000003,"5min":0.75,"15min":0.86099999999999999},"last":0.35499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.61799999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.625},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575063,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.61399999999999999},"last":0.38},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.44},"min":{"1min":0.36299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.627},"last":0.35699999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.40200000000000002},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.68799999999999994},"last":0.435}]},{"osd":3,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.41299999999999998},"min":{"1min":0.34200000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56699999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.47299999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.98899999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64100000000000001,"15min":0.67000000000000004},"min":{"1min":0.501,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.878,"15min":0.99299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.497},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.872,"15min":0.95299999999999996},"last":0.53300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302636,"kb_used_data":1444,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069204,"statfs":{"total":96636764160,"available":96326864896,"internally_reserved":0,"allocated":1478656,"data_stored":773921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.36499999999999999},"min":{"1min":0.27500000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.47499999999999998,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.442}]},{"osd":2,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.70799999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.621,"15min":0.81699999999999995},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.40799999999999997,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.55500000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.61899999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.376},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.34799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.34399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.433,"15min":0.45600000000000002},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32300000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82799999999999996,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.91900000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55600000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.2,"15min":1.2},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.48799999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.874,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":1.216,"15min":1.216},"last":0.45400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.55100000000000005,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.47799999999999998,"15min":0.44600000000000001},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":7.532,"15min":7.532},"last":0.34899999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.40999999999999998},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.32200000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.625,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41099999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.497}]},{"osd":5,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79800000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.50700000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81399999999999995,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575062,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302640,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069200,"statfs":{"total":96636764160,"available":96326860800,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.749,"15min":0.82599999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.46300000000000002,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.76600000000000001,"15min":0.82699999999999996},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.89600000000000002},"last":0.443},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":1.472,"15min":1.472},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":0.82599999999999996},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":1.0920000000000001,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59599999999999997,"5min":0.748,"15min":0.77600000000000002},"last":0.747}]},{"osd":6,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.875}]},{"osd":7,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.80400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575061,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065104,"statfs":{"total":96636764160,"available":96322666496,"internally_reserved":0,"allocated":1482752,"data_stored":774882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.747},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":1.252,"15min":1.252},"last":0.78600000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56399999999999995}]},{"osd":2,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.73399999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60499999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.81599999999999995,"5min":1.008,"15min":1.008},"last":0.70199999999999996}]},{"osd":6,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":1.891,"15min":1.891},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77300000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.745,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:17:06.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2024-01-21T20:17:06.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-01-21T20:17:06.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2024-01-21T20:17:06.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2024-01-21T20:17:06.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2024-01-21T20:17:06.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2024-01-21T20:17:06.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2024-01-21T20:17:06.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2024-01-21T20:17:06.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2024-01-21T20:17:06.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-01-21T20:17:06.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-01-21T20:17:06.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-01-21T20:17:06.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2024-01-21T20:17:06.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-01-21T20:17:06.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:02.121217+0000', 'last_change': '2024-01-21T20:17:02.121217+0000', 'last_active': '2024-01-21T20:17:02.121217+0000', 'last_peered': '2024-01-21T20:17:02.121217+0000', 'last_clean': '2024-01-21T20:17:02.121217+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:02.121217+0000', 'last_undegraded': '2024-01-21T20:17:02.121217+0000', 'last_fullsized': '2024-01-21T20:17:02.121217+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:02.121217+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-01-21T20:17:06.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:17:01.117321+0000', 'last_change': '2024-01-21T20:17:01.117321+0000', 'last_active': '2024-01-21T20:17:01.117321+0000', 'last_peered': '2024-01-21T20:17:01.117321+0000', 'last_clean': '2024-01-21T20:17:01.117321+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:17:01.117321+0000', 'last_undegraded': '2024-01-21T20:17:01.117321+0000', 'last_fullsized': '2024-01-21T20:17:01.117321+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'last_clean_scrub_stamp': '2024-01-21T20:17:01.117321+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:17:06.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T20:17:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.350+0000 7f551b6e4700 1 Processor -- start 2024-01-21T20:17:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.350+0000 7f551b6e4700 1 -- start start 2024-01-21T20:17:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f551b6e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 0x7f55140c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f551b6e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55140695b0 0x7f5514069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f551b6e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5514069ef0 con 0x7f551413ac10 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f551b6e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140c3890 con 0x7f55140695b0 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f551b6e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c3b70 con 0x7f551413a830 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519480700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 0x7f55140c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55140695b0 0x7f5514069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5518c7f700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f551413ac10 0x7f55140bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37442/0 (socket says 172.21.15.133:37442) 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519480700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 0x7f55140c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53352/0 (socket says 172.21.15.133:53352) 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5518c7f700 1 -- 172.21.15.133:0/1188835586 learned_addr learned my addr 172.21.15.133:0/1188835586 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55140695b0 0x7f5514069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:41264/0 (socket says 172.21.15.133:41264) 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 -- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 msgr2=0x7f55140c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 --2- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 0x7f55140c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 -- 172.21.15.133:0/1188835586 >> v1:172.21.15.178:6789/0 conn(0x7f551413ac10 legacy=0x7f55140bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.351+0000 7f5519c81700 1 -- 172.21.15.133:0/1188835586 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140c3e50 con 0x7f55140695b0 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f5519c81700 1 --2- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55140695b0 0x7f5514069a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f550c009e60 tx=0x7f550c009780).ready entity=mon.1 client_cookie=e44e95993548458c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f550bfff700 1 -- 172.21.15.133:0/1188835586 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c00e070 con 0x7f55140695b0 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f550bfff700 1 -- 172.21.15.133:0/1188835586 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00bb60 con 0x7f55140695b0 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f550bfff700 1 -- 172.21.15.133:0/1188835586 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c012410 con 0x7f55140695b0 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 -- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55140695b0 msgr2=0x7f5514069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 --2- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55140695b0 0x7f5514069a00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f550c009e60 tx=0x7f550c009780).stop 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 -- 172.21.15.133:0/1188835586 shutdown_connections 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 --2- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55140695b0 0x7f5514069a00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 --2- 172.21.15.133:0/1188835586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413a830 0x7f55140c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 -- 172.21.15.133:0/1188835586 >> 172.21.15.133:0/1188835586 conn(0x7f55140c7dc0 msgr2=0x7f55140c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 -- 172.21.15.133:0/1188835586 shutdown_connections 2024-01-21T20:17:06.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.352+0000 7f551b6e4700 1 -- 172.21.15.133:0/1188835586 wait complete. 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.354+0000 7f551b6e4700 1 Processor -- start 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.354+0000 7f551b6e4700 1 -- start start 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551413a830 0x7f5514161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413ac10 0x7f55140a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c1050 con 0x7f55140695b0 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140c0e90 con 0x7f551413a830 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f551b6e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55141624d0 con 0x7f551413ac10 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53420/0 (socket says 172.21.15.133:53420) 2024-01-21T20:17:06.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 -- 172.21.15.133:0/2568397388 learned_addr learned my addr 172.21.15.133:0/2568397388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519c81700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413ac10 0x7f55140a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5518c7f700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551413a830 0x7f5514161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 -- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413ac10 msgr2=0x7f55140a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413ac10 0x7f55140a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 -- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551413a830 msgr2=0x7f5514161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551413a830 0x7f5514161fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 -- 172.21.15.133:0/2568397388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009a20 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.355+0000 7f5519480700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f551000e930 tx=0x7f5510009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.356+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000eed0 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.356+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551000c850 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.356+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5514137f20 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.356+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000cbd0 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.356+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5514161a20 con 0x7f55140695b0 2024-01-21T20:17:06.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.357+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55140c12c0 con 0x7f55140695b0 2024-01-21T20:17:06.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.357+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f551001b400 con 0x7f55140695b0 2024-01-21T20:17:06.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.357+0000 7f5509ffb700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 0x7f54f80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.357+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f551007aa40 con 0x7f55140695b0 2024-01-21T20:17:06.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.358+0000 7f5518c7f700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 0x7f54f80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.358+0000 7f5518c7f700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 0x7f54f80615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5514138620 tx=0x7f5504009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.362+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f551007ce60 con 0x7f55140695b0 2024-01-21T20:17:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.591+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55140c4130 con 0x7f55140695b0 2024-01-21T20:17:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.591+0000 7f5509ffb700 1 -- 172.21.15.133:0/2568397388 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1024 (secure 0 0 0) 0x7f551004ba60 con 0x7f55140695b0 2024-01-21T20:17:06.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:06.581 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1097,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":124,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2483412992,"bytes_avail":770610700288,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":43,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7632}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-01-21T20:16:39.416321+0000","services":{}},"progress_events":{}} 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 msgr2=0x7f54f80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 0x7f54f80615e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5514138620 tx=0x7f5504009040).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 msgr2=0x7f5514153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f551000e930 tx=0x7f5510009060).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 shutdown_connections 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f54f805f120 0x7f54f80615e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f551413ac10 0x7f55140a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55140695b0 0x7f5514153f60 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 --2- 172.21.15.133:0/2568397388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f551413a830 0x7f5514161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 >> 172.21.15.133:0/2568397388 conn(0x7f55140c7dc0 msgr2=0x7f5514139980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 shutdown_connections 2024-01-21T20:17:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.593+0000 7f551b6e4700 1 -- 172.21.15.133:0/2568397388 wait complete. 2024-01-21T20:17:06.594 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T20:17:06.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:17:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.720+0000 7f28a9035700 1 Processor -- start 2024-01-21T20:17:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.720+0000 7f28a9035700 1 -- start start 2024-01-21T20:17:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a9035700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28a40bc8a0 0x7f28a40bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a9035700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 0x7f28a406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a9035700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a4065000 con 0x7f28a4065490 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a9035700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a4065d60 con 0x7f28a40bc8a0 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a9035700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a4069540 con 0x7f28a4065900 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28a40bc8a0 0x7f28a40bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28a4065490 0x7f28a40a3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40670/0 (socket says 172.21.15.133:40670) 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.721+0000 7f28a259c700 1 -- 172.21.15.133:0/3050306286 learned_addr learned my addr 172.21.15.133:0/3050306286 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a2d9d700 1 -- 172.21.15.133:0/3050306286 >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 msgr2=0x7f28a406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a359e700 1 --2- 172.21.15.133:0/3050306286 >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 0x7f28a406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a2d9d700 1 --2- 172.21.15.133:0/3050306286 >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 0x7f28a406a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a2d9d700 1 -- 172.21.15.133:0/3050306286 >> v1:172.21.15.133:6789/0 conn(0x7f28a4065490 legacy=0x7f28a40a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a1d9b700 1 -- 172.21.15.133:0/3050306286 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180831065 0 0) 0x7f28a4065000 con 0x7f28a4065490 2024-01-21T20:17:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a2d9d700 1 -- 172.21.15.133:0/3050306286 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4064410 con 0x7f28a40bc8a0 2024-01-21T20:17:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a359e700 1 --2- 172.21.15.133:0/3050306286 >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 0x7f28a406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a2d9d700 1 --2- 172.21.15.133:0/3050306286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a40bcc80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f28a40a9bf0 tx=0x7f288c009060).ready entity=mon.0 client_cookie=8fe78e1396a56b4a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a1d9b700 1 -- 172.21.15.133:0/3050306286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0090d0 con 0x7f28a40bc8a0 2024-01-21T20:17:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a1d9b700 1 -- 172.21.15.133:0/3050306286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00b580 con 0x7f28a40bc8a0 2024-01-21T20:17:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.722+0000 7f28a1d9b700 1 -- 172.21.15.133:0/3050306286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00b900 con 0x7f28a40bc8a0 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 -- 172.21.15.133:0/3050306286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 msgr2=0x7f28a40bcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 --2- 172.21.15.133:0/3050306286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a40bcc80 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f28a40a9bf0 tx=0x7f288c009060).stop 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 -- 172.21.15.133:0/3050306286 shutdown_connections 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 --2- 172.21.15.133:0/3050306286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a40bcc80 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 --2- 172.21.15.133:0/3050306286 >> v2:172.21.15.178:3300/0 conn(0x7f28a4065900 0x7f28a406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 -- 172.21.15.133:0/3050306286 >> 172.21.15.133:0/3050306286 conn(0x7f28a40c6ef0 msgr2=0x7f28a40c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 -- 172.21.15.133:0/3050306286 shutdown_connections 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.723+0000 7f28a9035700 1 -- 172.21.15.133:0/3050306286 wait complete. 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.725+0000 7f28a9035700 1 Processor -- start 2024-01-21T20:17:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.725+0000 7f28a9035700 1 -- start start 2024-01-21T20:17:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a4065490 0x7f28a41669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a4065900 0x7f28a41629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4166ec0 con 0x7f28a40bc8a0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4151200 con 0x7f28a4065490 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a9035700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a41505f0 con 0x7f28a4065900 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53430/0 (socket says 172.21.15.133:53430) 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 -- 172.21.15.133:0/3634584589 learned_addr learned my addr 172.21.15.133:0/3634584589 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a2d9d700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a4065490 0x7f28a41669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a259c700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a4065900 0x7f28a41629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 -- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a4065900 msgr2=0x7f28a41629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a4065900 0x7f28a41629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 -- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a4065490 msgr2=0x7f28a41669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a4065490 0x7f28a41669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 -- 172.21.15.133:0/3634584589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0092a0 con 0x7f28a40bc8a0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.726+0000 7f28a359e700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f289c00a380 tx=0x7f289c007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.727+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c016470 con 0x7f28a40bc8a0 2024-01-21T20:17:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.727+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c0165d0 con 0x7f28a40bc8a0 2024-01-21T20:17:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.727+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a41508d0 con 0x7f28a40bc8a0 2024-01-21T20:17:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.727+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c016950 con 0x7f28a40bc8a0 2024-01-21T20:17:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.727+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a4150e90 con 0x7f28a40bc8a0 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.728+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a4151390 con 0x7f28a40bc8a0 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.728+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f289c013070 con 0x7f28a40bc8a0 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.728+0000 7f289b7fe700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 0x7f2884061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.728+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f289c07ad00 con 0x7f28a40bc8a0 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.728+0000 7f28a2d9d700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 0x7f2884061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.729+0000 7f28a2d9d700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 0x7f2884061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f288c00b340 tx=0x7f288c017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:06.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.732+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f289c04bd80 con 0x7f28a40bc8a0 2024-01-21T20:17:06.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.892+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28a40649a0 con 0x7f288405f150 2024-01-21T20:17:06.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.902+0000 7f289b7fe700 1 -- 172.21.15.133:0/3634584589 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362163 (secure 0 0 0) 0x7f28a40649a0 con 0x7f288405f150 2024-01-21T20:17:06.895 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:06.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 msgr2=0x7f2884061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 0x7f2884061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f288c00b340 tx=0x7f288c017000).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 msgr2=0x7f28a414fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f289c00a380 tx=0x7f289c007900).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 shutdown_connections 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f288405f150 0x7f2884061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28a40bc8a0 0x7f28a414fba0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a4065490 0x7f28a41669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 --2- 172.21.15.133:0/3634584589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a4065900 0x7f28a41629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 >> 172.21.15.133:0/3634584589 conn(0x7f28a40c6ef0 msgr2=0x7f28a40a3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 shutdown_connections 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:06.905+0000 7f28a9035700 1 -- 172.21.15.133:0/3634584589 wait complete. 2024-01-21T20:17:06.899 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:17:06.907 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-21T20:17:06.722617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429752,"kb_used_data":12024,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544968,"statfs":{"total":773094113280,"available":770606047232,"internally_reserved":0,"allocated":12312576,"data_stored":6434698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5591,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-57,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.433786"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519456+0000","last_change":"2024-01-21T20:17:02.512752+0000","last_active":"2024-01-21T20:17:02.519456+0000","last_peered":"2024-01-21T20:17:02.519456+0000","last_clean":"2024-01-21T20:17:02.519456+0000","last_became_active":"2024-01-21T20:17:02.512347+0000","last_became_peered":"2024-01-21T20:17:02.512347+0000","last_unstale":"2024-01-21T20:17:02.519456+0000","last_undegraded":"2024-01-21T20:17:02.519456+0000","last_fullsized":"2024-01-21T20:17:02.519456+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525612+0000","last_change":"2024-01-21T20:17:02.147092+0000","last_active":"2024-01-21T20:17:02.525612+0000","last_peered":"2024-01-21T20:17:02.525612+0000","last_clean":"2024-01-21T20:17:02.525612+0000","last_became_active":"2024-01-21T20:17:02.146269+0000","last_became_peered":"2024-01-21T20:17:02.146269+0000","last_unstale":"2024-01-21T20:17:02.525612+0000","last_undegraded":"2024-01-21T20:17:02.525612+0000","last_fullsized":"2024-01-21T20:17:02.525612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525428+0000","last_change":"2024-01-21T20:17:02.523938+0000","last_active":"2024-01-21T20:17:02.525428+0000","last_peered":"2024-01-21T20:17:02.525428+0000","last_clean":"2024-01-21T20:17:02.525428+0000","last_became_active":"2024-01-21T20:17:02.523518+0000","last_became_peered":"2024-01-21T20:17:02.523518+0000","last_unstale":"2024-01-21T20:17:02.525428+0000","last_undegraded":"2024-01-21T20:17:02.525428+0000","last_fullsized":"2024-01-21T20:17:02.525428+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499382+0000","last_change":"2024-01-21T20:17:02.132725+0000","last_active":"2024-01-21T20:17:02.499382+0000","last_peered":"2024-01-21T20:17:02.499382+0000","last_clean":"2024-01-21T20:17:02.499382+0000","last_became_active":"2024-01-21T20:17:02.132477+0000","last_became_peered":"2024-01-21T20:17:02.132477+0000","last_unstale":"2024-01-21T20:17:02.499382+0000","last_undegraded":"2024-01-21T20:17:02.499382+0000","last_fullsized":"2024-01-21T20:17:02.499382+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518400+0000","last_change":"2024-01-21T20:17:02.515533+0000","last_active":"2024-01-21T20:17:02.518400+0000","last_peered":"2024-01-21T20:17:02.518400+0000","last_clean":"2024-01-21T20:17:02.518400+0000","last_became_active":"2024-01-21T20:17:02.514907+0000","last_became_peered":"2024-01-21T20:17:02.514907+0000","last_unstale":"2024-01-21T20:17:02.518400+0000","last_undegraded":"2024-01-21T20:17:02.518400+0000","last_fullsized":"2024-01-21T20:17:02.518400+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.503672+0000","last_change":"2024-01-21T20:17:02.146783+0000","last_active":"2024-01-21T20:17:02.503672+0000","last_peered":"2024-01-21T20:17:02.503672+0000","last_clean":"2024-01-21T20:17:02.503672+0000","last_became_active":"2024-01-21T20:17:02.146469+0000","last_became_peered":"2024-01-21T20:17:02.146469+0000","last_unstale":"2024-01-21T20:17:02.503672+0000","last_undegraded":"2024-01-21T20:17:02.503672+0000","last_fullsized":"2024-01-21T20:17:02.503672+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522244+0000","last_change":"2024-01-21T20:17:02.513843+0000","last_active":"2024-01-21T20:17:02.522244+0000","last_peered":"2024-01-21T20:17:02.522244+0000","last_clean":"2024-01-21T20:17:02.522244+0000","last_became_active":"2024-01-21T20:17:02.513565+0000","last_became_peered":"2024-01-21T20:17:02.513565+0000","last_unstale":"2024-01-21T20:17:02.522244+0000","last_undegraded":"2024-01-21T20:17:02.522244+0000","last_fullsized":"2024-01-21T20:17:02.522244+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521318+0000","last_change":"2024-01-21T20:17:02.143556+0000","last_active":"2024-01-21T20:17:02.521318+0000","last_peered":"2024-01-21T20:17:02.521318+0000","last_clean":"2024-01-21T20:17:02.521318+0000","last_became_active":"2024-01-21T20:17:02.142967+0000","last_became_peered":"2024-01-21T20:17:02.142967+0000","last_unstale":"2024-01-21T20:17:02.521318+0000","last_undegraded":"2024-01-21T20:17:02.521318+0000","last_fullsized":"2024-01-21T20:17:02.521318+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519825+0000","last_change":"2024-01-21T20:17:02.515434+0000","last_active":"2024-01-21T20:17:02.519825+0000","last_peered":"2024-01-21T20:17:02.519825+0000","last_clean":"2024-01-21T20:17:02.519825+0000","last_became_active":"2024-01-21T20:17:02.515159+0000","last_became_peered":"2024-01-21T20:17:02.515159+0000","last_unstale":"2024-01-21T20:17:02.519825+0000","last_undegraded":"2024-01-21T20:17:02.519825+0000","last_fullsized":"2024-01-21T20:17:02.519825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.533101+0000","last_change":"2024-01-21T20:17:02.140557+0000","last_active":"2024-01-21T20:17:02.533101+0000","last_peered":"2024-01-21T20:17:02.533101+0000","last_clean":"2024-01-21T20:17:02.533101+0000","last_became_active":"2024-01-21T20:17:02.140259+0000","last_became_peered":"2024-01-21T20:17:02.140259+0000","last_unstale":"2024-01-21T20:17:02.533101+0000","last_undegraded":"2024-01-21T20:17:02.533101+0000","last_fullsized":"2024-01-21T20:17:02.533101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513949+0000","last_change":"2024-01-21T20:17:02.512083+0000","last_active":"2024-01-21T20:17:02.513949+0000","last_peered":"2024-01-21T20:17:02.513949+0000","last_clean":"2024-01-21T20:17:02.513949+0000","last_became_active":"2024-01-21T20:17:02.511647+0000","last_became_peered":"2024-01-21T20:17:02.511647+0000","last_unstale":"2024-01-21T20:17:02.513949+0000","last_undegraded":"2024-01-21T20:17:02.513949+0000","last_fullsized":"2024-01-21T20:17:02.513949+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523427+0000","last_change":"2024-01-21T20:17:02.146578+0000","last_active":"2024-01-21T20:17:02.523427+0000","last_peered":"2024-01-21T20:17:02.523427+0000","last_clean":"2024-01-21T20:17:02.523427+0000","last_became_active":"2024-01-21T20:17:02.146290+0000","last_became_peered":"2024-01-21T20:17:02.146290+0000","last_unstale":"2024-01-21T20:17:02.523427+0000","last_undegraded":"2024-01-21T20:17:02.523427+0000","last_fullsized":"2024-01-21T20:17:02.523427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523240+0000","last_change":"2024-01-21T20:17:02.519344+0000","last_active":"2024-01-21T20:17:02.523240+0000","last_peered":"2024-01-21T20:17:02.523240+0000","last_clean":"2024-01-21T20:17:02.523240+0000","last_became_active":"2024-01-21T20:17:02.519030+0000","last_became_peered":"2024-01-21T20:17:02.519030+0000","last_unstale":"2024-01-21T20:17:02.523240+0000","last_undegraded":"2024-01-21T20:17:02.523240+0000","last_fullsized":"2024-01-21T20:17:02.523240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507203+0000","last_change":"2024-01-21T20:17:02.145950+0000","last_active":"2024-01-21T20:17:02.507203+0000","last_peered":"2024-01-21T20:17:02.507203+0000","last_clean":"2024-01-21T20:17:02.507203+0000","last_became_active":"2024-01-21T20:17:02.145642+0000","last_became_peered":"2024-01-21T20:17:02.145642+0000","last_unstale":"2024-01-21T20:17:02.507203+0000","last_undegraded":"2024-01-21T20:17:02.507203+0000","last_fullsized":"2024-01-21T20:17:02.507203+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518054+0000","last_change":"2024-01-21T20:17:02.515356+0000","last_active":"2024-01-21T20:17:02.518054+0000","last_peered":"2024-01-21T20:17:02.518054+0000","last_clean":"2024-01-21T20:17:02.518054+0000","last_became_active":"2024-01-21T20:17:02.515043+0000","last_became_peered":"2024-01-21T20:17:02.515043+0000","last_unstale":"2024-01-21T20:17:02.518054+0000","last_undegraded":"2024-01-21T20:17:02.518054+0000","last_fullsized":"2024-01-21T20:17:02.518054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499844+0000","last_change":"2024-01-21T20:17:02.148889+0000","last_active":"2024-01-21T20:17:02.499844+0000","last_peered":"2024-01-21T20:17:02.499844+0000","last_clean":"2024-01-21T20:17:02.499844+0000","last_became_active":"2024-01-21T20:17:02.148576+0000","last_became_peered":"2024-01-21T20:17:02.148576+0000","last_unstale":"2024-01-21T20:17:02.499844+0000","last_undegraded":"2024-01-21T20:17:02.499844+0000","last_fullsized":"2024-01-21T20:17:02.499844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528613+0000","last_change":"2024-01-21T20:17:02.518455+0000","last_active":"2024-01-21T20:17:02.528613+0000","last_peered":"2024-01-21T20:17:02.528613+0000","last_clean":"2024-01-21T20:17:02.528613+0000","last_became_active":"2024-01-21T20:17:02.517102+0000","last_became_peered":"2024-01-21T20:17:02.517102+0000","last_unstale":"2024-01-21T20:17:02.528613+0000","last_undegraded":"2024-01-21T20:17:02.528613+0000","last_fullsized":"2024-01-21T20:17:02.528613+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506798+0000","last_change":"2024-01-21T20:17:02.143589+0000","last_active":"2024-01-21T20:17:02.506798+0000","last_peered":"2024-01-21T20:17:02.506798+0000","last_clean":"2024-01-21T20:17:02.506798+0000","last_became_active":"2024-01-21T20:17:02.143262+0000","last_became_peered":"2024-01-21T20:17:02.143262+0000","last_unstale":"2024-01-21T20:17:02.506798+0000","last_undegraded":"2024-01-21T20:17:02.506798+0000","last_fullsized":"2024-01-21T20:17:02.506798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507442+0000","last_change":"2024-01-21T20:17:02.504590+0000","last_active":"2024-01-21T20:17:02.507442+0000","last_peered":"2024-01-21T20:17:02.507442+0000","last_clean":"2024-01-21T20:17:02.507442+0000","last_became_active":"2024-01-21T20:17:02.504342+0000","last_became_peered":"2024-01-21T20:17:02.504342+0000","last_unstale":"2024-01-21T20:17:02.507442+0000","last_undegraded":"2024-01-21T20:17:02.507442+0000","last_fullsized":"2024-01-21T20:17:02.507442+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513814+0000","last_change":"2024-01-21T20:17:02.152353+0000","last_active":"2024-01-21T20:17:02.513814+0000","last_peered":"2024-01-21T20:17:02.513814+0000","last_clean":"2024-01-21T20:17:02.513814+0000","last_became_active":"2024-01-21T20:17:02.152046+0000","last_became_peered":"2024-01-21T20:17:02.152046+0000","last_unstale":"2024-01-21T20:17:02.513814+0000","last_undegraded":"2024-01-21T20:17:02.513814+0000","last_fullsized":"2024-01-21T20:17:02.513814+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524940+0000","last_change":"2024-01-21T20:17:02.515566+0000","last_active":"2024-01-21T20:17:02.524940+0000","last_peered":"2024-01-21T20:17:02.524940+0000","last_clean":"2024-01-21T20:17:02.524940+0000","last_became_active":"2024-01-21T20:17:02.515292+0000","last_became_peered":"2024-01-21T20:17:02.515292+0000","last_unstale":"2024-01-21T20:17:02.524940+0000","last_undegraded":"2024-01-21T20:17:02.524940+0000","last_fullsized":"2024-01-21T20:17:02.524940+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507952+0000","last_change":"2024-01-21T20:17:02.149379+0000","last_active":"2024-01-21T20:17:02.507952+0000","last_peered":"2024-01-21T20:17:02.507952+0000","last_clean":"2024-01-21T20:17:02.507952+0000","last_became_active":"2024-01-21T20:17:02.149071+0000","last_became_peered":"2024-01-21T20:17:02.149071+0000","last_unstale":"2024-01-21T20:17:02.507952+0000","last_undegraded":"2024-01-21T20:17:02.507952+0000","last_fullsized":"2024-01-21T20:17:02.507952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522574+0000","last_change":"2024-01-21T20:17:02.515874+0000","last_active":"2024-01-21T20:17:02.522574+0000","last_peered":"2024-01-21T20:17:02.522574+0000","last_clean":"2024-01-21T20:17:02.522574+0000","last_became_active":"2024-01-21T20:17:02.515583+0000","last_became_peered":"2024-01-21T20:17:02.515583+0000","last_unstale":"2024-01-21T20:17:02.522574+0000","last_undegraded":"2024-01-21T20:17:02.522574+0000","last_fullsized":"2024-01-21T20:17:02.522574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.534721+0000","last_change":"2024-01-21T20:17:02.151061+0000","last_active":"2024-01-21T20:17:02.534721+0000","last_peered":"2024-01-21T20:17:02.534721+0000","last_clean":"2024-01-21T20:17:02.534721+0000","last_became_active":"2024-01-21T20:17:02.150596+0000","last_became_peered":"2024-01-21T20:17:02.150596+0000","last_unstale":"2024-01-21T20:17:02.534721+0000","last_undegraded":"2024-01-21T20:17:02.534721+0000","last_fullsized":"2024-01-21T20:17:02.534721+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.517642+0000","last_change":"2024-01-21T20:17:02.515031+0000","last_active":"2024-01-21T20:17:02.517642+0000","last_peered":"2024-01-21T20:17:02.517642+0000","last_clean":"2024-01-21T20:17:02.517642+0000","last_became_active":"2024-01-21T20:17:02.514690+0000","last_became_peered":"2024-01-21T20:17:02.514690+0000","last_unstale":"2024-01-21T20:17:02.517642+0000","last_undegraded":"2024-01-21T20:17:02.517642+0000","last_fullsized":"2024-01-21T20:17:02.517642+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.517538+0000","last_change":"2024-01-21T20:17:02.144843+0000","last_active":"2024-01-21T20:17:02.517538+0000","last_peered":"2024-01-21T20:17:02.517538+0000","last_clean":"2024-01-21T20:17:02.517538+0000","last_became_active":"2024-01-21T20:17:02.144490+0000","last_became_peered":"2024-01-21T20:17:02.144490+0000","last_unstale":"2024-01-21T20:17:02.517538+0000","last_undegraded":"2024-01-21T20:17:02.517538+0000","last_fullsized":"2024-01-21T20:17:02.517538+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520679+0000","last_change":"2024-01-21T20:17:02.516387+0000","last_active":"2024-01-21T20:17:02.520679+0000","last_peered":"2024-01-21T20:17:02.520679+0000","last_clean":"2024-01-21T20:17:02.520679+0000","last_became_active":"2024-01-21T20:17:02.515980+0000","last_became_peered":"2024-01-21T20:17:02.515980+0000","last_unstale":"2024-01-21T20:17:02.520679+0000","last_undegraded":"2024-01-21T20:17:02.520679+0000","last_fullsized":"2024-01-21T20:17:02.520679+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512333+0000","last_change":"2024-01-21T20:17:02.145255+0000","last_active":"2024-01-21T20:17:02.512333+0000","last_peered":"2024-01-21T20:17:02.512333+0000","last_clean":"2024-01-21T20:17:02.512333+0000","last_became_active":"2024-01-21T20:17:02.144668+0000","last_became_peered":"2024-01-21T20:17:02.144668+0000","last_unstale":"2024-01-21T20:17:02.512333+0000","last_undegraded":"2024-01-21T20:17:02.512333+0000","last_fullsized":"2024-01-21T20:17:02.512333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529674+0000","last_change":"2024-01-21T20:17:02.529012+0000","last_active":"2024-01-21T20:17:02.529674+0000","last_peered":"2024-01-21T20:17:02.529674+0000","last_clean":"2024-01-21T20:17:02.529674+0000","last_became_active":"2024-01-21T20:17:02.528753+0000","last_became_peered":"2024-01-21T20:17:02.528753+0000","last_unstale":"2024-01-21T20:17:02.529674+0000","last_undegraded":"2024-01-21T20:17:02.529674+0000","last_fullsized":"2024-01-21T20:17:02.529674+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509493+0000","last_change":"2024-01-21T20:17:02.147338+0000","last_active":"2024-01-21T20:17:02.509493+0000","last_peered":"2024-01-21T20:17:02.509493+0000","last_clean":"2024-01-21T20:17:02.509493+0000","last_became_active":"2024-01-21T20:17:02.146798+0000","last_became_peered":"2024-01-21T20:17:02.146798+0000","last_unstale":"2024-01-21T20:17:02.509493+0000","last_undegraded":"2024-01-21T20:17:02.509493+0000","last_fullsized":"2024-01-21T20:17:02.509493+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521681+0000","last_change":"2024-01-21T20:17:02.518593+0000","last_active":"2024-01-21T20:17:02.521681+0000","last_peered":"2024-01-21T20:17:02.521681+0000","last_clean":"2024-01-21T20:17:02.521681+0000","last_became_active":"2024-01-21T20:17:02.517970+0000","last_became_peered":"2024-01-21T20:17:02.517970+0000","last_unstale":"2024-01-21T20:17:02.521681+0000","last_undegraded":"2024-01-21T20:17:02.521681+0000","last_fullsized":"2024-01-21T20:17:02.521681+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528191+0000","last_change":"2024-01-21T20:17:02.149149+0000","last_active":"2024-01-21T20:17:02.528191+0000","last_peered":"2024-01-21T20:17:02.528191+0000","last_clean":"2024-01-21T20:17:02.528191+0000","last_became_active":"2024-01-21T20:17:02.148804+0000","last_became_peered":"2024-01-21T20:17:02.148804+0000","last_unstale":"2024-01-21T20:17:02.528191+0000","last_undegraded":"2024-01-21T20:17:02.528191+0000","last_fullsized":"2024-01-21T20:17:02.528191+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514418+0000","last_change":"2024-01-21T20:17:02.511422+0000","last_active":"2024-01-21T20:17:02.514418+0000","last_peered":"2024-01-21T20:17:02.514418+0000","last_clean":"2024-01-21T20:17:02.514418+0000","last_became_active":"2024-01-21T20:17:02.511123+0000","last_became_peered":"2024-01-21T20:17:02.511123+0000","last_unstale":"2024-01-21T20:17:02.514418+0000","last_undegraded":"2024-01-21T20:17:02.514418+0000","last_fullsized":"2024-01-21T20:17:02.514418+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.502374+0000","last_change":"2024-01-21T20:17:02.140869+0000","last_active":"2024-01-21T20:17:02.502374+0000","last_peered":"2024-01-21T20:17:02.502374+0000","last_clean":"2024-01-21T20:17:02.502374+0000","last_became_active":"2024-01-21T20:17:02.140582+0000","last_became_peered":"2024-01-21T20:17:02.140582+0000","last_unstale":"2024-01-21T20:17:02.502374+0000","last_undegraded":"2024-01-21T20:17:02.502374+0000","last_fullsized":"2024-01-21T20:17:02.502374+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523777+0000","last_change":"2024-01-21T20:17:02.517182+0000","last_active":"2024-01-21T20:17:02.523777+0000","last_peered":"2024-01-21T20:17:02.523777+0000","last_clean":"2024-01-21T20:17:02.523777+0000","last_became_active":"2024-01-21T20:17:02.516706+0000","last_became_peered":"2024-01-21T20:17:02.516706+0000","last_unstale":"2024-01-21T20:17:02.523777+0000","last_undegraded":"2024-01-21T20:17:02.523777+0000","last_fullsized":"2024-01-21T20:17:02.523777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510799+0000","last_change":"2024-01-21T20:17:02.143846+0000","last_active":"2024-01-21T20:17:02.510799+0000","last_peered":"2024-01-21T20:17:02.510799+0000","last_clean":"2024-01-21T20:17:02.510799+0000","last_became_active":"2024-01-21T20:17:02.143410+0000","last_became_peered":"2024-01-21T20:17:02.143410+0000","last_unstale":"2024-01-21T20:17:02.510799+0000","last_undegraded":"2024-01-21T20:17:02.510799+0000","last_fullsized":"2024-01-21T20:17:02.510799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524170+0000","last_change":"2024-01-21T20:17:02.522292+0000","last_active":"2024-01-21T20:17:02.524170+0000","last_peered":"2024-01-21T20:17:02.524170+0000","last_clean":"2024-01-21T20:17:02.524170+0000","last_became_active":"2024-01-21T20:17:02.521985+0000","last_became_peered":"2024-01-21T20:17:02.521985+0000","last_unstale":"2024-01-21T20:17:02.524170+0000","last_undegraded":"2024-01-21T20:17:02.524170+0000","last_fullsized":"2024-01-21T20:17:02.524170+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.526855+0000","last_change":"2024-01-21T20:17:02.152125+0000","last_active":"2024-01-21T20:17:02.526855+0000","last_peered":"2024-01-21T20:17:02.526855+0000","last_clean":"2024-01-21T20:17:02.526855+0000","last_became_active":"2024-01-21T20:17:02.151831+0000","last_became_peered":"2024-01-21T20:17:02.151831+0000","last_unstale":"2024-01-21T20:17:02.526855+0000","last_undegraded":"2024-01-21T20:17:02.526855+0000","last_fullsized":"2024-01-21T20:17:02.526855+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520644+0000","last_change":"2024-01-21T20:17:02.517020+0000","last_active":"2024-01-21T20:17:02.520644+0000","last_peered":"2024-01-21T20:17:02.520644+0000","last_clean":"2024-01-21T20:17:02.520644+0000","last_became_active":"2024-01-21T20:17:02.516743+0000","last_became_peered":"2024-01-21T20:17:02.516743+0000","last_unstale":"2024-01-21T20:17:02.520644+0000","last_undegraded":"2024-01-21T20:17:02.520644+0000","last_fullsized":"2024-01-21T20:17:02.520644+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507357+0000","last_change":"2024-01-21T20:17:02.144388+0000","last_active":"2024-01-21T20:17:02.507357+0000","last_peered":"2024-01-21T20:17:02.507357+0000","last_clean":"2024-01-21T20:17:02.507357+0000","last_became_active":"2024-01-21T20:17:02.143604+0000","last_became_peered":"2024-01-21T20:17:02.143604+0000","last_unstale":"2024-01-21T20:17:02.507357+0000","last_undegraded":"2024-01-21T20:17:02.507357+0000","last_fullsized":"2024-01-21T20:17:02.507357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.515890+0000","last_change":"2024-01-21T20:17:02.514315+0000","last_active":"2024-01-21T20:17:02.515890+0000","last_peered":"2024-01-21T20:17:02.515890+0000","last_clean":"2024-01-21T20:17:02.515890+0000","last_became_active":"2024-01-21T20:17:02.514001+0000","last_became_peered":"2024-01-21T20:17:02.514001+0000","last_unstale":"2024-01-21T20:17:02.515890+0000","last_undegraded":"2024-01-21T20:17:02.515890+0000","last_fullsized":"2024-01-21T20:17:02.515890+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522271+0000","last_change":"2024-01-21T20:17:02.148492+0000","last_active":"2024-01-21T20:17:02.522271+0000","last_peered":"2024-01-21T20:17:02.522271+0000","last_clean":"2024-01-21T20:17:02.522271+0000","last_became_active":"2024-01-21T20:17:02.148236+0000","last_became_peered":"2024-01-21T20:17:02.148236+0000","last_unstale":"2024-01-21T20:17:02.522271+0000","last_undegraded":"2024-01-21T20:17:02.522271+0000","last_fullsized":"2024-01-21T20:17:02.522271+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521003+0000","last_change":"2024-01-21T20:17:02.516103+0000","last_active":"2024-01-21T20:17:02.521003+0000","last_peered":"2024-01-21T20:17:02.521003+0000","last_clean":"2024-01-21T20:17:02.521003+0000","last_became_active":"2024-01-21T20:17:02.515808+0000","last_became_peered":"2024-01-21T20:17:02.515808+0000","last_unstale":"2024-01-21T20:17:02.521003+0000","last_undegraded":"2024-01-21T20:17:02.521003+0000","last_fullsized":"2024-01-21T20:17:02.521003+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499243+0000","last_change":"2024-01-21T20:17:02.130861+0000","last_active":"2024-01-21T20:17:02.499243+0000","last_peered":"2024-01-21T20:17:02.499243+0000","last_clean":"2024-01-21T20:17:02.499243+0000","last_became_active":"2024-01-21T20:17:02.130515+0000","last_became_peered":"2024-01-21T20:17:02.130515+0000","last_unstale":"2024-01-21T20:17:02.499243+0000","last_undegraded":"2024-01-21T20:17:02.499243+0000","last_fullsized":"2024-01-21T20:17:02.499243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529100+0000","last_change":"2024-01-21T20:17:02.523382+0000","last_active":"2024-01-21T20:17:02.529100+0000","last_peered":"2024-01-21T20:17:02.529100+0000","last_clean":"2024-01-21T20:17:02.529100+0000","last_became_active":"2024-01-21T20:17:02.523149+0000","last_became_peered":"2024-01-21T20:17:02.523149+0000","last_unstale":"2024-01-21T20:17:02.529100+0000","last_undegraded":"2024-01-21T20:17:02.529100+0000","last_fullsized":"2024-01-21T20:17:02.529100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499598+0000","last_change":"2024-01-21T20:17:02.130778+0000","last_active":"2024-01-21T20:17:02.499598+0000","last_peered":"2024-01-21T20:17:02.499598+0000","last_clean":"2024-01-21T20:17:02.499598+0000","last_became_active":"2024-01-21T20:17:02.130445+0000","last_became_peered":"2024-01-21T20:17:02.130445+0000","last_unstale":"2024-01-21T20:17:02.499598+0000","last_undegraded":"2024-01-21T20:17:02.499598+0000","last_fullsized":"2024-01-21T20:17:02.499598+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524879+0000","last_change":"2024-01-21T20:17:02.521834+0000","last_active":"2024-01-21T20:17:02.524879+0000","last_peered":"2024-01-21T20:17:02.524879+0000","last_clean":"2024-01-21T20:17:02.524879+0000","last_became_active":"2024-01-21T20:17:02.521564+0000","last_became_peered":"2024-01-21T20:17:02.521564+0000","last_unstale":"2024-01-21T20:17:02.524879+0000","last_undegraded":"2024-01-21T20:17:02.524879+0000","last_fullsized":"2024-01-21T20:17:02.524879+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.504969+0000","last_change":"2024-01-21T20:17:02.151802+0000","last_active":"2024-01-21T20:17:02.504969+0000","last_peered":"2024-01-21T20:17:02.504969+0000","last_clean":"2024-01-21T20:17:02.504969+0000","last_became_active":"2024-01-21T20:17:02.151528+0000","last_became_peered":"2024-01-21T20:17:02.151528+0000","last_unstale":"2024-01-21T20:17:02.504969+0000","last_undegraded":"2024-01-21T20:17:02.504969+0000","last_fullsized":"2024-01-21T20:17:02.504969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528363+0000","last_change":"2024-01-21T20:17:02.525683+0000","last_active":"2024-01-21T20:17:02.528363+0000","last_peered":"2024-01-21T20:17:02.528363+0000","last_clean":"2024-01-21T20:17:02.528363+0000","last_became_active":"2024-01-21T20:17:02.525425+0000","last_became_peered":"2024-01-21T20:17:02.525425+0000","last_unstale":"2024-01-21T20:17:02.528363+0000","last_undegraded":"2024-01-21T20:17:02.528363+0000","last_fullsized":"2024-01-21T20:17:02.528363+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513093+0000","last_change":"2024-01-21T20:17:02.154449+0000","last_active":"2024-01-21T20:17:02.513093+0000","last_peered":"2024-01-21T20:17:02.513093+0000","last_clean":"2024-01-21T20:17:02.513093+0000","last_became_active":"2024-01-21T20:17:02.154205+0000","last_became_peered":"2024-01-21T20:17:02.154205+0000","last_unstale":"2024-01-21T20:17:02.513093+0000","last_undegraded":"2024-01-21T20:17:02.513093+0000","last_fullsized":"2024-01-21T20:17:02.513093+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529678+0000","last_change":"2024-01-21T20:17:02.529088+0000","last_active":"2024-01-21T20:17:02.529678+0000","last_peered":"2024-01-21T20:17:02.529678+0000","last_clean":"2024-01-21T20:17:02.529678+0000","last_became_active":"2024-01-21T20:17:02.528804+0000","last_became_peered":"2024-01-21T20:17:02.528804+0000","last_unstale":"2024-01-21T20:17:02.529678+0000","last_undegraded":"2024-01-21T20:17:02.529678+0000","last_fullsized":"2024-01-21T20:17:02.529678+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499474+0000","last_change":"2024-01-21T20:17:02.150032+0000","last_active":"2024-01-21T20:17:02.499474+0000","last_peered":"2024-01-21T20:17:02.499474+0000","last_clean":"2024-01-21T20:17:02.499474+0000","last_became_active":"2024-01-21T20:17:02.149763+0000","last_became_peered":"2024-01-21T20:17:02.149763+0000","last_unstale":"2024-01-21T20:17:02.499474+0000","last_undegraded":"2024-01-21T20:17:02.499474+0000","last_fullsized":"2024-01-21T20:17:02.499474+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.527059+0000","last_change":"2024-01-21T20:17:02.526635+0000","last_active":"2024-01-21T20:17:02.527059+0000","last_peered":"2024-01-21T20:17:02.527059+0000","last_clean":"2024-01-21T20:17:02.527059+0000","last_became_active":"2024-01-21T20:17:02.526356+0000","last_became_peered":"2024-01-21T20:17:02.526356+0000","last_unstale":"2024-01-21T20:17:02.527059+0000","last_undegraded":"2024-01-21T20:17:02.527059+0000","last_fullsized":"2024-01-21T20:17:02.527059+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507033+0000","last_change":"2024-01-21T20:17:02.145696+0000","last_active":"2024-01-21T20:17:02.507033+0000","last_peered":"2024-01-21T20:17:02.507033+0000","last_clean":"2024-01-21T20:17:02.507033+0000","last_became_active":"2024-01-21T20:17:02.145398+0000","last_became_peered":"2024-01-21T20:17:02.145398+0000","last_unstale":"2024-01-21T20:17:02.507033+0000","last_undegraded":"2024-01-21T20:17:02.507033+0000","last_fullsized":"2024-01-21T20:17:02.507033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528676+0000","last_change":"2024-01-21T20:17:02.519563+0000","last_active":"2024-01-21T20:17:02.528676+0000","last_peered":"2024-01-21T20:17:02.528676+0000","last_clean":"2024-01-21T20:17:02.528676+0000","last_became_active":"2024-01-21T20:17:02.519246+0000","last_became_peered":"2024-01-21T20:17:02.519246+0000","last_unstale":"2024-01-21T20:17:02.528676+0000","last_undegraded":"2024-01-21T20:17:02.528676+0000","last_fullsized":"2024-01-21T20:17:02.528676+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513044+0000","last_change":"2024-01-21T20:17:02.142835+0000","last_active":"2024-01-21T20:17:02.513044+0000","last_peered":"2024-01-21T20:17:02.513044+0000","last_clean":"2024-01-21T20:17:02.513044+0000","last_became_active":"2024-01-21T20:17:02.142531+0000","last_became_peered":"2024-01-21T20:17:02.142531+0000","last_unstale":"2024-01-21T20:17:02.513044+0000","last_undegraded":"2024-01-21T20:17:02.513044+0000","last_fullsized":"2024-01-21T20:17:02.513044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520503+0000","last_change":"2024-01-21T20:17:02.515560+0000","last_active":"2024-01-21T20:17:02.520503+0000","last_peered":"2024-01-21T20:17:02.520503+0000","last_clean":"2024-01-21T20:17:02.520503+0000","last_became_active":"2024-01-21T20:17:02.515297+0000","last_became_peered":"2024-01-21T20:17:02.515297+0000","last_unstale":"2024-01-21T20:17:02.520503+0000","last_undegraded":"2024-01-21T20:17:02.520503+0000","last_fullsized":"2024-01-21T20:17:02.520503+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501361+0000","last_change":"2024-01-21T20:17:02.150145+0000","last_active":"2024-01-21T20:17:02.501361+0000","last_peered":"2024-01-21T20:17:02.501361+0000","last_clean":"2024-01-21T20:17:02.501361+0000","last_became_active":"2024-01-21T20:17:02.149854+0000","last_became_peered":"2024-01-21T20:17:02.149854+0000","last_unstale":"2024-01-21T20:17:02.501361+0000","last_undegraded":"2024-01-21T20:17:02.501361+0000","last_fullsized":"2024-01-21T20:17:02.501361+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520718+0000","last_change":"2024-01-21T20:17:02.518070+0000","last_active":"2024-01-21T20:17:02.520718+0000","last_peered":"2024-01-21T20:17:02.520718+0000","last_clean":"2024-01-21T20:17:02.520718+0000","last_became_active":"2024-01-21T20:17:02.517886+0000","last_became_peered":"2024-01-21T20:17:02.517886+0000","last_unstale":"2024-01-21T20:17:02.520718+0000","last_undegraded":"2024-01-21T20:17:02.520718+0000","last_fullsized":"2024-01-21T20:17:02.520718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512535+0000","last_change":"2024-01-21T20:17:02.152349+0000","last_active":"2024-01-21T20:17:02.512535+0000","last_peered":"2024-01-21T20:17:02.512535+0000","last_clean":"2024-01-21T20:17:02.512535+0000","last_became_active":"2024-01-21T20:17:02.152072+0000","last_became_peered":"2024-01-21T20:17:02.152072+0000","last_unstale":"2024-01-21T20:17:02.512535+0000","last_undegraded":"2024-01-21T20:17:02.512535+0000","last_fullsized":"2024-01-21T20:17:02.512535+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524010+0000","last_change":"2024-01-21T20:17:02.517365+0000","last_active":"2024-01-21T20:17:02.524010+0000","last_peered":"2024-01-21T20:17:02.524010+0000","last_clean":"2024-01-21T20:17:02.524010+0000","last_became_active":"2024-01-21T20:17:02.516794+0000","last_became_peered":"2024-01-21T20:17:02.516794+0000","last_unstale":"2024-01-21T20:17:02.524010+0000","last_undegraded":"2024-01-21T20:17:02.524010+0000","last_fullsized":"2024-01-21T20:17:02.524010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509584+0000","last_change":"2024-01-21T20:17:02.139070+0000","last_active":"2024-01-21T20:17:02.509584+0000","last_peered":"2024-01-21T20:17:02.509584+0000","last_clean":"2024-01-21T20:17:02.509584+0000","last_became_active":"2024-01-21T20:17:02.138794+0000","last_became_peered":"2024-01-21T20:17:02.138794+0000","last_unstale":"2024-01-21T20:17:02.509584+0000","last_undegraded":"2024-01-21T20:17:02.509584+0000","last_fullsized":"2024-01-21T20:17:02.509584+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521661+0000","last_change":"2024-01-21T20:17:02.517724+0000","last_active":"2024-01-21T20:17:02.521661+0000","last_peered":"2024-01-21T20:17:02.521661+0000","last_clean":"2024-01-21T20:17:02.521661+0000","last_became_active":"2024-01-21T20:17:02.517523+0000","last_became_peered":"2024-01-21T20:17:02.517523+0000","last_unstale":"2024-01-21T20:17:02.521661+0000","last_undegraded":"2024-01-21T20:17:02.521661+0000","last_fullsized":"2024-01-21T20:17:02.521661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.503346+0000","last_change":"2024-01-21T20:17:02.150824+0000","last_active":"2024-01-21T20:17:02.503346+0000","last_peered":"2024-01-21T20:17:02.503346+0000","last_clean":"2024-01-21T20:17:02.503346+0000","last_became_active":"2024-01-21T20:17:02.150533+0000","last_became_peered":"2024-01-21T20:17:02.150533+0000","last_unstale":"2024-01-21T20:17:02.503346+0000","last_undegraded":"2024-01-21T20:17:02.503346+0000","last_fullsized":"2024-01-21T20:17:02.503346+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521085+0000","last_change":"2024-01-21T20:17:02.517060+0000","last_active":"2024-01-21T20:17:02.521085+0000","last_peered":"2024-01-21T20:17:02.521085+0000","last_clean":"2024-01-21T20:17:02.521085+0000","last_became_active":"2024-01-21T20:17:02.516597+0000","last_became_peered":"2024-01-21T20:17:02.516597+0000","last_unstale":"2024-01-21T20:17:02.521085+0000","last_undegraded":"2024-01-21T20:17:02.521085+0000","last_fullsized":"2024-01-21T20:17:02.521085+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520485+0000","last_change":"2024-01-21T20:17:02.139306+0000","last_active":"2024-01-21T20:17:02.520485+0000","last_peered":"2024-01-21T20:17:02.520485+0000","last_clean":"2024-01-21T20:17:02.520485+0000","last_became_active":"2024-01-21T20:17:02.139017+0000","last_became_peered":"2024-01-21T20:17:02.139017+0000","last_unstale":"2024-01-21T20:17:02.520485+0000","last_undegraded":"2024-01-21T20:17:02.520485+0000","last_fullsized":"2024-01-21T20:17:02.520485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528343+0000","last_change":"2024-01-21T20:17:02.523319+0000","last_active":"2024-01-21T20:17:02.528343+0000","last_peered":"2024-01-21T20:17:02.528343+0000","last_clean":"2024-01-21T20:17:02.528343+0000","last_became_active":"2024-01-21T20:17:02.523103+0000","last_became_peered":"2024-01-21T20:17:02.523103+0000","last_unstale":"2024-01-21T20:17:02.528343+0000","last_undegraded":"2024-01-21T20:17:02.528343+0000","last_fullsized":"2024-01-21T20:17:02.528343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523641+0000","last_change":"2024-01-21T20:17:02.140761+0000","last_active":"2024-01-21T20:17:02.523641+0000","last_peered":"2024-01-21T20:17:02.523641+0000","last_clean":"2024-01-21T20:17:02.523641+0000","last_became_active":"2024-01-21T20:17:02.140434+0000","last_became_peered":"2024-01-21T20:17:02.140434+0000","last_unstale":"2024-01-21T20:17:02.523641+0000","last_undegraded":"2024-01-21T20:17:02.523641+0000","last_fullsized":"2024-01-21T20:17:02.523641+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525757+0000","last_change":"2024-01-21T20:17:02.525209+0000","last_active":"2024-01-21T20:17:02.525757+0000","last_peered":"2024-01-21T20:17:02.525757+0000","last_clean":"2024-01-21T20:17:02.525757+0000","last_became_active":"2024-01-21T20:17:02.524915+0000","last_became_peered":"2024-01-21T20:17:02.524915+0000","last_unstale":"2024-01-21T20:17:02.525757+0000","last_undegraded":"2024-01-21T20:17:02.525757+0000","last_fullsized":"2024-01-21T20:17:02.525757+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521592+0000","last_change":"2024-01-21T20:17:02.148485+0000","last_active":"2024-01-21T20:17:02.521592+0000","last_peered":"2024-01-21T20:17:02.521592+0000","last_clean":"2024-01-21T20:17:02.521592+0000","last_became_active":"2024-01-21T20:17:02.148168+0000","last_became_peered":"2024-01-21T20:17:02.148168+0000","last_unstale":"2024-01-21T20:17:02.521592+0000","last_undegraded":"2024-01-21T20:17:02.521592+0000","last_fullsized":"2024-01-21T20:17:02.521592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514791+0000","last_change":"2024-01-21T20:17:02.508455+0000","last_active":"2024-01-21T20:17:02.514791+0000","last_peered":"2024-01-21T20:17:02.514791+0000","last_clean":"2024-01-21T20:17:02.514791+0000","last_became_active":"2024-01-21T20:17:02.508069+0000","last_became_peered":"2024-01-21T20:17:02.508069+0000","last_unstale":"2024-01-21T20:17:02.514791+0000","last_undegraded":"2024-01-21T20:17:02.514791+0000","last_fullsized":"2024-01-21T20:17:02.514791+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501677+0000","last_change":"2024-01-21T20:17:02.148386+0000","last_active":"2024-01-21T20:17:02.501677+0000","last_peered":"2024-01-21T20:17:02.501677+0000","last_clean":"2024-01-21T20:17:02.501677+0000","last_became_active":"2024-01-21T20:17:02.148073+0000","last_became_peered":"2024-01-21T20:17:02.148073+0000","last_unstale":"2024-01-21T20:17:02.501677+0000","last_undegraded":"2024-01-21T20:17:02.501677+0000","last_fullsized":"2024-01-21T20:17:02.501677+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.532774+0000","last_change":"2024-01-21T20:17:02.525256+0000","last_active":"2024-01-21T20:17:02.532774+0000","last_peered":"2024-01-21T20:17:02.532774+0000","last_clean":"2024-01-21T20:17:02.532774+0000","last_became_active":"2024-01-21T20:17:02.524982+0000","last_became_peered":"2024-01-21T20:17:02.524982+0000","last_unstale":"2024-01-21T20:17:02.532774+0000","last_undegraded":"2024-01-21T20:17:02.532774+0000","last_fullsized":"2024-01-21T20:17:02.532774+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505279+0000","last_change":"2024-01-21T20:17:02.142916+0000","last_active":"2024-01-21T20:17:02.505279+0000","last_peered":"2024-01-21T20:17:02.505279+0000","last_clean":"2024-01-21T20:17:02.505279+0000","last_became_active":"2024-01-21T20:17:02.142639+0000","last_became_peered":"2024-01-21T20:17:02.142639+0000","last_unstale":"2024-01-21T20:17:02.505279+0000","last_undegraded":"2024-01-21T20:17:02.505279+0000","last_fullsized":"2024-01-21T20:17:02.505279+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520699+0000","last_change":"2024-01-21T20:17:02.516564+0000","last_active":"2024-01-21T20:17:02.520699+0000","last_peered":"2024-01-21T20:17:02.520699+0000","last_clean":"2024-01-21T20:17:02.520699+0000","last_became_active":"2024-01-21T20:17:02.516278+0000","last_became_peered":"2024-01-21T20:17:02.516278+0000","last_unstale":"2024-01-21T20:17:02.520699+0000","last_undegraded":"2024-01-21T20:17:02.520699+0000","last_fullsized":"2024-01-21T20:17:02.520699+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501398+0000","last_change":"2024-01-21T20:17:02.144180+0000","last_active":"2024-01-21T20:17:02.501398+0000","last_peered":"2024-01-21T20:17:02.501398+0000","last_clean":"2024-01-21T20:17:02.501398+0000","last_became_active":"2024-01-21T20:17:02.143904+0000","last_became_peered":"2024-01-21T20:17:02.143904+0000","last_unstale":"2024-01-21T20:17:02.501398+0000","last_undegraded":"2024-01-21T20:17:02.501398+0000","last_fullsized":"2024-01-21T20:17:02.501398+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523761+0000","last_change":"2024-01-21T20:17:02.517187+0000","last_active":"2024-01-21T20:17:02.523761+0000","last_peered":"2024-01-21T20:17:02.523761+0000","last_clean":"2024-01-21T20:17:02.523761+0000","last_became_active":"2024-01-21T20:17:02.516484+0000","last_became_peered":"2024-01-21T20:17:02.516484+0000","last_unstale":"2024-01-21T20:17:02.523761+0000","last_undegraded":"2024-01-21T20:17:02.523761+0000","last_fullsized":"2024-01-21T20:17:02.523761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506469+0000","last_change":"2024-01-21T20:17:02.148493+0000","last_active":"2024-01-21T20:17:02.506469+0000","last_peered":"2024-01-21T20:17:02.506469+0000","last_clean":"2024-01-21T20:17:02.506469+0000","last_became_active":"2024-01-21T20:17:02.148177+0000","last_became_peered":"2024-01-21T20:17:02.148177+0000","last_unstale":"2024-01-21T20:17:02.506469+0000","last_undegraded":"2024-01-21T20:17:02.506469+0000","last_fullsized":"2024-01-21T20:17:02.506469+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528229+0000","last_change":"2024-01-21T20:17:02.521522+0000","last_active":"2024-01-21T20:17:02.528229+0000","last_peered":"2024-01-21T20:17:02.528229+0000","last_clean":"2024-01-21T20:17:02.528229+0000","last_became_active":"2024-01-21T20:17:02.520827+0000","last_became_peered":"2024-01-21T20:17:02.520827+0000","last_unstale":"2024-01-21T20:17:02.528229+0000","last_undegraded":"2024-01-21T20:17:02.528229+0000","last_fullsized":"2024-01-21T20:17:02.528229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.508729+0000","last_change":"2024-01-21T20:17:02.146917+0000","last_active":"2024-01-21T20:17:02.508729+0000","last_peered":"2024-01-21T20:17:02.508729+0000","last_clean":"2024-01-21T20:17:02.508729+0000","last_became_active":"2024-01-21T20:17:02.146629+0000","last_became_peered":"2024-01-21T20:17:02.146629+0000","last_unstale":"2024-01-21T20:17:02.508729+0000","last_undegraded":"2024-01-21T20:17:02.508729+0000","last_fullsized":"2024-01-21T20:17:02.508729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521067+0000","last_change":"2024-01-21T20:17:02.516882+0000","last_active":"2024-01-21T20:17:02.521067+0000","last_peered":"2024-01-21T20:17:02.521067+0000","last_clean":"2024-01-21T20:17:02.521067+0000","last_became_active":"2024-01-21T20:17:02.516229+0000","last_became_peered":"2024-01-21T20:17:02.516229+0000","last_unstale":"2024-01-21T20:17:02.521067+0000","last_undegraded":"2024-01-21T20:17:02.521067+0000","last_fullsized":"2024-01-21T20:17:02.521067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506895+0000","last_change":"2024-01-21T20:17:02.146034+0000","last_active":"2024-01-21T20:17:02.506895+0000","last_peered":"2024-01-21T20:17:02.506895+0000","last_clean":"2024-01-21T20:17:02.506895+0000","last_became_active":"2024-01-21T20:17:02.145622+0000","last_became_peered":"2024-01-21T20:17:02.145622+0000","last_unstale":"2024-01-21T20:17:02.506895+0000","last_undegraded":"2024-01-21T20:17:02.506895+0000","last_fullsized":"2024-01-21T20:17:02.506895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528622+0000","last_change":"2024-01-21T20:17:02.518554+0000","last_active":"2024-01-21T20:17:02.528622+0000","last_peered":"2024-01-21T20:17:02.528622+0000","last_clean":"2024-01-21T20:17:02.528622+0000","last_became_active":"2024-01-21T20:17:02.518104+0000","last_became_peered":"2024-01-21T20:17:02.518104+0000","last_unstale":"2024-01-21T20:17:02.528622+0000","last_undegraded":"2024-01-21T20:17:02.528622+0000","last_fullsized":"2024-01-21T20:17:02.528622+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499587+0000","last_change":"2024-01-21T20:17:02.148899+0000","last_active":"2024-01-21T20:17:02.499587+0000","last_peered":"2024-01-21T20:17:02.499587+0000","last_clean":"2024-01-21T20:17:02.499587+0000","last_became_active":"2024-01-21T20:17:02.148646+0000","last_became_peered":"2024-01-21T20:17:02.148646+0000","last_unstale":"2024-01-21T20:17:02.499587+0000","last_undegraded":"2024-01-21T20:17:02.499587+0000","last_fullsized":"2024-01-21T20:17:02.499587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528438+0000","last_change":"2024-01-21T20:17:02.526833+0000","last_active":"2024-01-21T20:17:02.528438+0000","last_peered":"2024-01-21T20:17:02.528438+0000","last_clean":"2024-01-21T20:17:02.528438+0000","last_became_active":"2024-01-21T20:17:02.526567+0000","last_became_peered":"2024-01-21T20:17:02.526567+0000","last_unstale":"2024-01-21T20:17:02.528438+0000","last_undegraded":"2024-01-21T20:17:02.528438+0000","last_fullsized":"2024-01-21T20:17:02.528438+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.527633+0000","last_change":"2024-01-21T20:17:02.149884+0000","last_active":"2024-01-21T20:17:02.527633+0000","last_peered":"2024-01-21T20:17:02.527633+0000","last_clean":"2024-01-21T20:17:02.527633+0000","last_became_active":"2024-01-21T20:17:02.149625+0000","last_became_peered":"2024-01-21T20:17:02.149625+0000","last_unstale":"2024-01-21T20:17:02.527633+0000","last_undegraded":"2024-01-21T20:17:02.527633+0000","last_fullsized":"2024-01-21T20:17:02.527633+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524543+0000","last_change":"2024-01-21T20:17:02.509290+0000","last_active":"2024-01-21T20:17:02.524543+0000","last_peered":"2024-01-21T20:17:02.524543+0000","last_clean":"2024-01-21T20:17:02.524543+0000","last_became_active":"2024-01-21T20:17:02.509011+0000","last_became_peered":"2024-01-21T20:17:02.509011+0000","last_unstale":"2024-01-21T20:17:02.524543+0000","last_undegraded":"2024-01-21T20:17:02.524543+0000","last_fullsized":"2024-01-21T20:17:02.524543+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.533402+0000","last_change":"2024-01-21T20:17:02.142281+0000","last_active":"2024-01-21T20:17:02.533402+0000","last_peered":"2024-01-21T20:17:02.533402+0000","last_clean":"2024-01-21T20:17:02.533402+0000","last_became_active":"2024-01-21T20:17:02.141981+0000","last_became_peered":"2024-01-21T20:17:02.141981+0000","last_unstale":"2024-01-21T20:17:02.533402+0000","last_undegraded":"2024-01-21T20:17:02.533402+0000","last_fullsized":"2024-01-21T20:17:02.533402+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513464+0000","last_change":"2024-01-21T20:17:02.507899+0000","last_active":"2024-01-21T20:17:02.513464+0000","last_peered":"2024-01-21T20:17:02.513464+0000","last_clean":"2024-01-21T20:17:02.513464+0000","last_became_active":"2024-01-21T20:17:02.507568+0000","last_became_peered":"2024-01-21T20:17:02.507568+0000","last_unstale":"2024-01-21T20:17:02.513464+0000","last_undegraded":"2024-01-21T20:17:02.513464+0000","last_fullsized":"2024-01-21T20:17:02.513464+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524804+0000","last_change":"2024-01-21T20:17:02.155950+0000","last_active":"2024-01-21T20:17:02.524804+0000","last_peered":"2024-01-21T20:17:02.524804+0000","last_clean":"2024-01-21T20:17:02.524804+0000","last_became_active":"2024-01-21T20:17:02.155519+0000","last_became_peered":"2024-01-21T20:17:02.155519+0000","last_unstale":"2024-01-21T20:17:02.524804+0000","last_undegraded":"2024-01-21T20:17:02.524804+0000","last_fullsized":"2024-01-21T20:17:02.524804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523750+0000","last_change":"2024-01-21T20:17:02.520454+0000","last_active":"2024-01-21T20:17:02.523750+0000","last_peered":"2024-01-21T20:17:02.523750+0000","last_clean":"2024-01-21T20:17:02.523750+0000","last_became_active":"2024-01-21T20:17:02.517778+0000","last_became_peered":"2024-01-21T20:17:02.517778+0000","last_unstale":"2024-01-21T20:17:02.523750+0000","last_undegraded":"2024-01-21T20:17:02.523750+0000","last_fullsized":"2024-01-21T20:17:02.523750+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510120+0000","last_change":"2024-01-21T20:17:02.137501+0000","last_active":"2024-01-21T20:17:02.510120+0000","last_peered":"2024-01-21T20:17:02.510120+0000","last_clean":"2024-01-21T20:17:02.510120+0000","last_became_active":"2024-01-21T20:17:02.137207+0000","last_became_peered":"2024-01-21T20:17:02.137207+0000","last_unstale":"2024-01-21T20:17:02.510120+0000","last_undegraded":"2024-01-21T20:17:02.510120+0000","last_fullsized":"2024-01-21T20:17:02.510120+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522516+0000","last_change":"2024-01-21T20:17:02.518905+0000","last_active":"2024-01-21T20:17:02.522516+0000","last_peered":"2024-01-21T20:17:02.522516+0000","last_clean":"2024-01-21T20:17:02.522516+0000","last_became_active":"2024-01-21T20:17:02.518635+0000","last_became_peered":"2024-01-21T20:17:02.518635+0000","last_unstale":"2024-01-21T20:17:02.522516+0000","last_undegraded":"2024-01-21T20:17:02.522516+0000","last_fullsized":"2024-01-21T20:17:02.522516+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512351+0000","last_change":"2024-01-21T20:17:02.146182+0000","last_active":"2024-01-21T20:17:02.512351+0000","last_peered":"2024-01-21T20:17:02.512351+0000","last_clean":"2024-01-21T20:17:02.512351+0000","last_became_active":"2024-01-21T20:17:02.145905+0000","last_became_peered":"2024-01-21T20:17:02.145905+0000","last_unstale":"2024-01-21T20:17:02.512351+0000","last_undegraded":"2024-01-21T20:17:02.512351+0000","last_fullsized":"2024-01-21T20:17:02.512351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525509+0000","last_change":"2024-01-21T20:17:02.519376+0000","last_active":"2024-01-21T20:17:02.525509+0000","last_peered":"2024-01-21T20:17:02.525509+0000","last_clean":"2024-01-21T20:17:02.525509+0000","last_became_active":"2024-01-21T20:17:02.518309+0000","last_became_peered":"2024-01-21T20:17:02.518309+0000","last_unstale":"2024-01-21T20:17:02.525509+0000","last_undegraded":"2024-01-21T20:17:02.525509+0000","last_fullsized":"2024-01-21T20:17:02.525509+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521703+0000","last_change":"2024-01-21T20:17:02.145874+0000","last_active":"2024-01-21T20:17:02.521703+0000","last_peered":"2024-01-21T20:17:02.521703+0000","last_clean":"2024-01-21T20:17:02.521703+0000","last_became_active":"2024-01-21T20:17:02.145580+0000","last_became_peered":"2024-01-21T20:17:02.145580+0000","last_unstale":"2024-01-21T20:17:02.521703+0000","last_undegraded":"2024-01-21T20:17:02.521703+0000","last_fullsized":"2024-01-21T20:17:02.521703+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521048+0000","last_change":"2024-01-21T20:17:02.514489+0000","last_active":"2024-01-21T20:17:02.521048+0000","last_peered":"2024-01-21T20:17:02.521048+0000","last_clean":"2024-01-21T20:17:02.521048+0000","last_became_active":"2024-01-21T20:17:02.514021+0000","last_became_peered":"2024-01-21T20:17:02.514021+0000","last_unstale":"2024-01-21T20:17:02.521048+0000","last_undegraded":"2024-01-21T20:17:02.521048+0000","last_fullsized":"2024-01-21T20:17:02.521048+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525444+0000","last_change":"2024-01-21T20:17:02.147068+0000","last_active":"2024-01-21T20:17:02.525444+0000","last_peered":"2024-01-21T20:17:02.525444+0000","last_clean":"2024-01-21T20:17:02.525444+0000","last_became_active":"2024-01-21T20:17:02.146780+0000","last_became_peered":"2024-01-21T20:17:02.146780+0000","last_unstale":"2024-01-21T20:17:02.525444+0000","last_undegraded":"2024-01-21T20:17:02.525444+0000","last_fullsized":"2024-01-21T20:17:02.525444+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518298+0000","last_change":"2024-01-21T20:17:02.516964+0000","last_active":"2024-01-21T20:17:02.518298+0000","last_peered":"2024-01-21T20:17:02.518298+0000","last_clean":"2024-01-21T20:17:02.518298+0000","last_became_active":"2024-01-21T20:17:02.516504+0000","last_became_peered":"2024-01-21T20:17:02.516504+0000","last_unstale":"2024-01-21T20:17:02.518298+0000","last_undegraded":"2024-01-21T20:17:02.518298+0000","last_fullsized":"2024-01-21T20:17:02.518298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499687+0000","last_change":"2024-01-21T20:17:02.132654+0000","last_active":"2024-01-21T20:17:02.499687+0000","last_peered":"2024-01-21T20:17:02.499687+0000","last_clean":"2024-01-21T20:17:02.499687+0000","last_became_active":"2024-01-21T20:17:02.130584+0000","last_became_peered":"2024-01-21T20:17:02.130584+0000","last_unstale":"2024-01-21T20:17:02.499687+0000","last_undegraded":"2024-01-21T20:17:02.499687+0000","last_fullsized":"2024-01-21T20:17:02.499687+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520872+0000","last_change":"2024-01-21T20:17:02.518145+0000","last_active":"2024-01-21T20:17:02.520872+0000","last_peered":"2024-01-21T20:17:02.520872+0000","last_clean":"2024-01-21T20:17:02.520872+0000","last_became_active":"2024-01-21T20:17:02.517884+0000","last_became_peered":"2024-01-21T20:17:02.517884+0000","last_unstale":"2024-01-21T20:17:02.520872+0000","last_undegraded":"2024-01-21T20:17:02.520872+0000","last_fullsized":"2024-01-21T20:17:02.520872+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513332+0000","last_change":"2024-01-21T20:17:02.142031+0000","last_active":"2024-01-21T20:17:02.513332+0000","last_peered":"2024-01-21T20:17:02.513332+0000","last_clean":"2024-01-21T20:17:02.513332+0000","last_became_active":"2024-01-21T20:17:02.141392+0000","last_became_peered":"2024-01-21T20:17:02.141392+0000","last_unstale":"2024-01-21T20:17:02.513332+0000","last_undegraded":"2024-01-21T20:17:02.513332+0000","last_fullsized":"2024-01-21T20:17:02.513332+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523287+0000","last_change":"2024-01-21T20:17:02.522119+0000","last_active":"2024-01-21T20:17:02.523287+0000","last_peered":"2024-01-21T20:17:02.523287+0000","last_clean":"2024-01-21T20:17:02.523287+0000","last_became_active":"2024-01-21T20:17:02.520335+0000","last_became_peered":"2024-01-21T20:17:02.520335+0000","last_unstale":"2024-01-21T20:17:02.523287+0000","last_undegraded":"2024-01-21T20:17:02.523287+0000","last_fullsized":"2024-01-21T20:17:02.523287+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501773+0000","last_change":"2024-01-21T20:17:02.148782+0000","last_active":"2024-01-21T20:17:02.501773+0000","last_peered":"2024-01-21T20:17:02.501773+0000","last_clean":"2024-01-21T20:17:02.501773+0000","last_became_active":"2024-01-21T20:17:02.147335+0000","last_became_peered":"2024-01-21T20:17:02.147335+0000","last_unstale":"2024-01-21T20:17:02.501773+0000","last_undegraded":"2024-01-21T20:17:02.501773+0000","last_fullsized":"2024-01-21T20:17:02.501773+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528385+0000","last_change":"2024-01-21T20:17:02.525795+0000","last_active":"2024-01-21T20:17:02.528385+0000","last_peered":"2024-01-21T20:17:02.528385+0000","last_clean":"2024-01-21T20:17:02.528385+0000","last_became_active":"2024-01-21T20:17:02.525519+0000","last_became_peered":"2024-01-21T20:17:02.525519+0000","last_unstale":"2024-01-21T20:17:02.528385+0000","last_undegraded":"2024-01-21T20:17:02.528385+0000","last_fullsized":"2024-01-21T20:17:02.528385+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506861+0000","last_change":"2024-01-21T20:17:02.135694+0000","last_active":"2024-01-21T20:17:02.506861+0000","last_peered":"2024-01-21T20:17:02.506861+0000","last_clean":"2024-01-21T20:17:02.506861+0000","last_became_active":"2024-01-21T20:17:02.135240+0000","last_became_peered":"2024-01-21T20:17:02.135240+0000","last_unstale":"2024-01-21T20:17:02.506861+0000","last_undegraded":"2024-01-21T20:17:02.506861+0000","last_fullsized":"2024-01-21T20:17:02.506861+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528403+0000","last_change":"2024-01-21T20:17:02.525944+0000","last_active":"2024-01-21T20:17:02.528403+0000","last_peered":"2024-01-21T20:17:02.528403+0000","last_clean":"2024-01-21T20:17:02.528403+0000","last_became_active":"2024-01-21T20:17:02.525669+0000","last_became_peered":"2024-01-21T20:17:02.525669+0000","last_unstale":"2024-01-21T20:17:02.528403+0000","last_undegraded":"2024-01-21T20:17:02.528403+0000","last_fullsized":"2024-01-21T20:17:02.528403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512866+0000","last_change":"2024-01-21T20:17:02.147830+0000","last_active":"2024-01-21T20:17:02.512866+0000","last_peered":"2024-01-21T20:17:02.512866+0000","last_clean":"2024-01-21T20:17:02.512866+0000","last_became_active":"2024-01-21T20:17:02.145641+0000","last_became_peered":"2024-01-21T20:17:02.145641+0000","last_unstale":"2024-01-21T20:17:02.512866+0000","last_undegraded":"2024-01-21T20:17:02.512866+0000","last_fullsized":"2024-01-21T20:17:02.512866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523458+0000","last_change":"2024-01-21T20:17:02.516344+0000","last_active":"2024-01-21T20:17:02.523458+0000","last_peered":"2024-01-21T20:17:02.523458+0000","last_clean":"2024-01-21T20:17:02.523458+0000","last_became_active":"2024-01-21T20:17:02.516042+0000","last_became_peered":"2024-01-21T20:17:02.516042+0000","last_unstale":"2024-01-21T20:17:02.523458+0000","last_undegraded":"2024-01-21T20:17:02.523458+0000","last_fullsized":"2024-01-21T20:17:02.523458+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510068+0000","last_change":"2024-01-21T20:17:02.141847+0000","last_active":"2024-01-21T20:17:02.510068+0000","last_peered":"2024-01-21T20:17:02.510068+0000","last_clean":"2024-01-21T20:17:02.510068+0000","last_became_active":"2024-01-21T20:17:02.141543+0000","last_became_peered":"2024-01-21T20:17:02.141543+0000","last_unstale":"2024-01-21T20:17:02.510068+0000","last_undegraded":"2024-01-21T20:17:02.510068+0000","last_fullsized":"2024-01-21T20:17:02.510068+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522481+0000","last_change":"2024-01-21T20:17:02.517984+0000","last_active":"2024-01-21T20:17:02.522481+0000","last_peered":"2024-01-21T20:17:02.522481+0000","last_clean":"2024-01-21T20:17:02.522481+0000","last_became_active":"2024-01-21T20:17:02.517652+0000","last_became_peered":"2024-01-21T20:17:02.517652+0000","last_unstale":"2024-01-21T20:17:02.522481+0000","last_undegraded":"2024-01-21T20:17:02.522481+0000","last_fullsized":"2024-01-21T20:17:02.522481+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512636+0000","last_change":"2024-01-21T20:17:02.146063+0000","last_active":"2024-01-21T20:17:02.512636+0000","last_peered":"2024-01-21T20:17:02.512636+0000","last_clean":"2024-01-21T20:17:02.512636+0000","last_became_active":"2024-01-21T20:17:02.145574+0000","last_became_peered":"2024-01-21T20:17:02.145574+0000","last_unstale":"2024-01-21T20:17:02.512636+0000","last_undegraded":"2024-01-21T20:17:02.512636+0000","last_fullsized":"2024-01-21T20:17:02.512636+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528322+0000","last_change":"2024-01-21T20:17:02.521053+0000","last_active":"2024-01-21T20:17:02.528322+0000","last_peered":"2024-01-21T20:17:02.528322+0000","last_clean":"2024-01-21T20:17:02.528322+0000","last_became_active":"2024-01-21T20:17:02.520775+0000","last_became_peered":"2024-01-21T20:17:02.520775+0000","last_unstale":"2024-01-21T20:17:02.528322+0000","last_undegraded":"2024-01-21T20:17:02.528322+0000","last_fullsized":"2024-01-21T20:17:02.528322+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509949+0000","last_change":"2024-01-21T20:17:02.147518+0000","last_active":"2024-01-21T20:17:02.509949+0000","last_peered":"2024-01-21T20:17:02.509949+0000","last_clean":"2024-01-21T20:17:02.509949+0000","last_became_active":"2024-01-21T20:17:02.147239+0000","last_became_peered":"2024-01-21T20:17:02.147239+0000","last_unstale":"2024-01-21T20:17:02.509949+0000","last_undegraded":"2024-01-21T20:17:02.509949+0000","last_fullsized":"2024-01-21T20:17:02.509949+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501860+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:17:02.501860+0000","last_peered":"2024-01-21T20:17:02.501860+0000","last_clean":"2024-01-21T20:17:02.501860+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:17:02.501860+0000","last_undegraded":"2024-01-21T20:17:02.501860+0000","last_fullsized":"2024-01-21T20:17:02.501860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519475+0000","last_change":"2024-01-21T20:17:02.513849+0000","last_active":"2024-01-21T20:17:02.519475+0000","last_peered":"2024-01-21T20:17:02.519475+0000","last_clean":"2024-01-21T20:17:02.519475+0000","last_became_active":"2024-01-21T20:17:02.513534+0000","last_became_peered":"2024-01-21T20:17:02.513534+0000","last_unstale":"2024-01-21T20:17:02.519475+0000","last_undegraded":"2024-01-21T20:17:02.519475+0000","last_fullsized":"2024-01-21T20:17:02.519475+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524817+0000","last_change":"2024-01-21T20:17:02.145418+0000","last_active":"2024-01-21T20:17:02.524817+0000","last_peered":"2024-01-21T20:17:02.524817+0000","last_clean":"2024-01-21T20:17:02.524817+0000","last_became_active":"2024-01-21T20:17:02.144798+0000","last_became_peered":"2024-01-21T20:17:02.144798+0000","last_unstale":"2024-01-21T20:17:02.524817+0000","last_undegraded":"2024-01-21T20:17:02.524817+0000","last_fullsized":"2024-01-21T20:17:02.524817+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501490+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:17:02.501490+0000","last_peered":"2024-01-21T20:17:02.501490+0000","last_clean":"2024-01-21T20:17:02.501490+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:17:02.501490+0000","last_undegraded":"2024-01-21T20:17:02.501490+0000","last_fullsized":"2024-01-21T20:17:02.501490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528654+0000","last_change":"2024-01-21T20:17:02.518743+0000","last_active":"2024-01-21T20:17:02.528654+0000","last_peered":"2024-01-21T20:17:02.528654+0000","last_clean":"2024-01-21T20:17:02.528654+0000","last_became_active":"2024-01-21T20:17:02.518472+0000","last_became_peered":"2024-01-21T20:17:02.518472+0000","last_unstale":"2024-01-21T20:17:02.528654+0000","last_undegraded":"2024-01-21T20:17:02.528654+0000","last_fullsized":"2024-01-21T20:17:02.528654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501364+0000","last_change":"2024-01-21T20:17:02.138631+0000","last_active":"2024-01-21T20:17:02.501364+0000","last_peered":"2024-01-21T20:17:02.501364+0000","last_clean":"2024-01-21T20:17:02.501364+0000","last_became_active":"2024-01-21T20:17:02.138360+0000","last_became_peered":"2024-01-21T20:17:02.138360+0000","last_unstale":"2024-01-21T20:17:02.501364+0000","last_undegraded":"2024-01-21T20:17:02.501364+0000","last_fullsized":"2024-01-21T20:17:02.501364+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512440+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:17:02.512440+0000","last_peered":"2024-01-21T20:17:02.512440+0000","last_clean":"2024-01-21T20:17:02.512440+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:17:02.512440+0000","last_undegraded":"2024-01-21T20:17:02.512440+0000","last_fullsized":"2024-01-21T20:17:02.512440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514563+0000","last_change":"2024-01-21T20:17:02.510463+0000","last_active":"2024-01-21T20:17:02.514563+0000","last_peered":"2024-01-21T20:17:02.514563+0000","last_clean":"2024-01-21T20:17:02.514563+0000","last_became_active":"2024-01-21T20:17:02.508203+0000","last_became_peered":"2024-01-21T20:17:02.508203+0000","last_unstale":"2024-01-21T20:17:02.514563+0000","last_undegraded":"2024-01-21T20:17:02.514563+0000","last_fullsized":"2024-01-21T20:17:02.514563+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522467+0000","last_change":"2024-01-21T20:17:02.142326+0000","last_active":"2024-01-21T20:17:02.522467+0000","last_peered":"2024-01-21T20:17:02.522467+0000","last_clean":"2024-01-21T20:17:02.522467+0000","last_became_active":"2024-01-21T20:17:02.142043+0000","last_became_peered":"2024-01-21T20:17:02.142043+0000","last_unstale":"2024-01-21T20:17:02.522467+0000","last_undegraded":"2024-01-21T20:17:02.522467+0000","last_fullsized":"2024-01-21T20:17:02.522467+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501813+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:17:02.501813+0000","last_peered":"2024-01-21T20:17:02.501813+0000","last_clean":"2024-01-21T20:17:02.501813+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:17:02.501813+0000","last_undegraded":"2024-01-21T20:17:02.501813+0000","last_fullsized":"2024-01-21T20:17:02.501813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":101,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505066+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:17:02.505066+0000","last_peered":"2024-01-21T20:17:02.505066+0000","last_clean":"2024-01-21T20:17:02.505066+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:17:02.505066+0000","last_undegraded":"2024-01-21T20:17:02.505066+0000","last_fullsized":"2024-01-21T20:17:02.505066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525453+0000","last_change":"2024-01-21T20:17:02.524302+0000","last_active":"2024-01-21T20:17:02.525453+0000","last_peered":"2024-01-21T20:17:02.525453+0000","last_clean":"2024-01-21T20:17:02.525453+0000","last_became_active":"2024-01-21T20:17:02.524007+0000","last_became_peered":"2024-01-21T20:17:02.524007+0000","last_unstale":"2024-01-21T20:17:02.525453+0000","last_undegraded":"2024-01-21T20:17:02.525453+0000","last_fullsized":"2024-01-21T20:17:02.525453+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507847+0000","last_change":"2024-01-21T20:17:02.148876+0000","last_active":"2024-01-21T20:17:02.507847+0000","last_peered":"2024-01-21T20:17:02.507847+0000","last_clean":"2024-01-21T20:17:02.507847+0000","last_became_active":"2024-01-21T20:17:02.148548+0000","last_became_peered":"2024-01-21T20:17:02.148548+0000","last_unstale":"2024-01-21T20:17:02.507847+0000","last_undegraded":"2024-01-21T20:17:02.507847+0000","last_fullsized":"2024-01-21T20:17:02.507847+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505175+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:17:02.505175+0000","last_peered":"2024-01-21T20:17:02.505175+0000","last_clean":"2024-01-21T20:17:02.505175+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:17:02.505175+0000","last_undegraded":"2024-01-21T20:17:02.505175+0000","last_fullsized":"2024-01-21T20:17:02.505175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.532726+0000","last_change":"2024-01-21T20:17:02.526895+0000","last_active":"2024-01-21T20:17:02.532726+0000","last_peered":"2024-01-21T20:17:02.532726+0000","last_clean":"2024-01-21T20:17:02.532726+0000","last_became_active":"2024-01-21T20:17:02.526626+0000","last_became_peered":"2024-01-21T20:17:02.526626+0000","last_unstale":"2024-01-21T20:17:02.532726+0000","last_undegraded":"2024-01-21T20:17:02.532726+0000","last_fullsized":"2024-01-21T20:17:02.532726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513973+0000","last_change":"2024-01-21T20:17:02.141351+0000","last_active":"2024-01-21T20:17:02.513973+0000","last_peered":"2024-01-21T20:17:02.513973+0000","last_clean":"2024-01-21T20:17:02.513973+0000","last_became_active":"2024-01-21T20:17:02.141075+0000","last_became_peered":"2024-01-21T20:17:02.141075+0000","last_unstale":"2024-01-21T20:17:02.513973+0000","last_undegraded":"2024-01-21T20:17:02.513973+0000","last_fullsized":"2024-01-21T20:17:02.513973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.508040+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:17:02.508040+0000","last_peered":"2024-01-21T20:17:02.508040+0000","last_clean":"2024-01-21T20:17:02.508040+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:17:02.508040+0000","last_undegraded":"2024-01-21T20:17:02.508040+0000","last_fullsized":"2024-01-21T20:17:02.508040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528033+0000","last_change":"2024-01-21T20:17:02.521898+0000","last_active":"2024-01-21T20:17:02.528033+0000","last_peered":"2024-01-21T20:17:02.528033+0000","last_clean":"2024-01-21T20:17:02.528033+0000","last_became_active":"2024-01-21T20:17:02.521591+0000","last_became_peered":"2024-01-21T20:17:02.521591+0000","last_unstale":"2024-01-21T20:17:02.528033+0000","last_undegraded":"2024-01-21T20:17:02.528033+0000","last_fullsized":"2024-01-21T20:17:02.528033+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521819+0000","last_change":"2024-01-21T20:17:02.150515+0000","last_active":"2024-01-21T20:17:02.521819+0000","last_peered":"2024-01-21T20:17:02.521819+0000","last_clean":"2024-01-21T20:17:02.521819+0000","last_became_active":"2024-01-21T20:17:02.150241+0000","last_became_peered":"2024-01-21T20:17:02.150241+0000","last_unstale":"2024-01-21T20:17:02.521819+0000","last_undegraded":"2024-01-21T20:17:02.521819+0000","last_fullsized":"2024-01-21T20:17:02.521819+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.502963+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:17:02.502963+0000","last_peered":"2024-01-21T20:17:02.502963+0000","last_clean":"2024-01-21T20:17:02.502963+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:17:02.502963+0000","last_undegraded":"2024-01-21T20:17:02.502963+0000","last_fullsized":"2024-01-21T20:17:02.502963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.530019+0000","last_change":"2024-01-21T20:17:02.526539+0000","last_active":"2024-01-21T20:17:02.530019+0000","last_peered":"2024-01-21T20:17:02.530019+0000","last_clean":"2024-01-21T20:17:02.530019+0000","last_became_active":"2024-01-21T20:17:02.524181+0000","last_became_peered":"2024-01-21T20:17:02.524181+0000","last_unstale":"2024-01-21T20:17:02.530019+0000","last_undegraded":"2024-01-21T20:17:02.530019+0000","last_fullsized":"2024-01-21T20:17:02.530019+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512608+0000","last_change":"2024-01-21T20:17:02.141448+0000","last_active":"2024-01-21T20:17:02.512608+0000","last_peered":"2024-01-21T20:17:02.512608+0000","last_clean":"2024-01-21T20:17:02.512608+0000","last_became_active":"2024-01-21T20:17:02.141161+0000","last_became_peered":"2024-01-21T20:17:02.141161+0000","last_unstale":"2024-01-21T20:17:02.512608+0000","last_undegraded":"2024-01-21T20:17:02.512608+0000","last_fullsized":"2024-01-21T20:17:02.512608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513310+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:17:02.513310+0000","last_peered":"2024-01-21T20:17:02.513310+0000","last_clean":"2024-01-21T20:17:02.513310+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:17:02.513310+0000","last_undegraded":"2024-01-21T20:17:02.513310+0000","last_fullsized":"2024-01-21T20:17:02.513310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1531904,"data_stored":803130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.82099999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79700000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.82799999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":0.80400000000000005},"last":0.504}]},{"osd":3,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.376},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.83699999999999997},"last":0.45200000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.82499999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.81499999999999995},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1544192,"data_stored":804667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.46999999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":1.083},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64300000000000002,"5min":0.78700000000000003,"15min":1.107},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":1.016},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70499999999999996,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.877,"15min":1.0609999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":1.621,"15min":1.621},"last":0.376}]},{"osd":4,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.65900000000000003,"5min":0.75,"15min":0.86099999999999999},"last":0.35399999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.503}]},{"osd":7,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.61799999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.41599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1548288,"data_stored":805551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.61399999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.44},"min":{"1min":0.36299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.627},"last":0.439}]},{"osd":2,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.40200000000000002},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.68799999999999994},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.432},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.41299999999999998},"min":{"1min":0.34200000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56699999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.98899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64100000000000001,"15min":0.67000000000000004},"min":{"1min":0.501,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.878,"15min":0.99299999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.872,"15min":0.95299999999999996},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834575063,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":803774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.36499999999999999},"min":{"1min":0.27500000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.47499999999999998,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.70799999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.621,"15min":0.81699999999999995},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40799999999999997,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.32700000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.498}]},{"osd":6,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":804105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.253}]},{"osd":3,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.34399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.433,"15min":0.45600000000000002},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28000000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82799999999999996,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.91900000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.2,"15min":1.2},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.874,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":1.216,"15min":1.216},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1531904,"data_stored":804001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.55100000000000005,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.316},{"interface":"front","average":{"1min":0.433,"5min":0.47799999999999998,"15min":0.44600000000000001},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":7.532,"15min":7.532},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.40999999999999998},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.374}]},{"osd":2,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.625,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.56499999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79800000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81399999999999995,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":804915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.749,"15min":0.82599999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.46300000000000002,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.76600000000000001,"15min":0.82699999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.89600000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":1.472,"15min":1.472},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":0.82599999999999996},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":1.0920000000000001,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59599999999999997,"5min":0.748,"15min":0.77600000000000002},"last":0.29399999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.375},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.435}]}]},{"osd":5,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1536000,"data_stored":804555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":1.252,"15min":1.252},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60499999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.81599999999999995,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":1.891,"15min":1.891},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77300000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.50800000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.745,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:17:07.477 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:17:07.489+0000 7f14a2d4c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:17:09.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:17:10.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.052+0000 7f55657e3700 1 Processor -- start 2024-01-21T20:17:10.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.052+0000 7f55657e3700 1 -- start start 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f5560158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5560154520 0x7f55600ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 0x7f55600c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600c6ae0 con 0x7f5560154520 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600c05e0 con 0x7f55600c6090 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f55657e3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600ab620 con 0x7f5560154140 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5560154520 0x7f55600ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5560154520 0x7f55600ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53442/0 (socket says 172.21.15.133:53442) 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 -- 172.21.15.133:0/3034779090 learned_addr learned my addr 172.21.15.133:0/3034779090 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555f7fe700 1 --2- 172.21.15.133:0/3034779090 >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 0x7f55600c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555effd700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f5560158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 -- 172.21.15.133:0/3034779090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 msgr2=0x7f5560158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f5560158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 -- 172.21.15.133:0/3034779090 >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 msgr2=0x7f55600c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 --2- 172.21.15.133:0/3034779090 >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 0x7f55600c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555e7fc700 1 -- 172.21.15.133:0/3034779090 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600c0e40 con 0x7f5560154520 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.053+0000 7f555f7fe700 1 --2- 172.21.15.133:0/3034779090 >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 0x7f55600c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f555e7fc700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f55600ab130 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f5560062cc0 tx=0x7f55500090f0).ready entity=mon.0 client_cookie=94b0c0866d9ede71 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f555dffb700 1 -- 172.21.15.133:0/3034779090 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000b600 con 0x7f5560154520 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f555dffb700 1 -- 172.21.15.133:0/3034779090 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555000b760 con 0x7f5560154520 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f555dffb700 1 -- 172.21.15.133:0/3034779090 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000bae0 con 0x7f5560154520 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 -- 172.21.15.133:0/3034779090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 msgr2=0x7f55600ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f55600ab130 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f5560062cc0 tx=0x7f55500090f0).stop 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 -- 172.21.15.133:0/3034779090 shutdown_connections 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 --2- 172.21.15.133:0/3034779090 >> v2:172.21.15.178:3300/0 conn(0x7f55600c6090 0x7f55600c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f5560158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 --2- 172.21.15.133:0/3034779090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f55600ab130 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 -- 172.21.15.133:0/3034779090 >> 172.21.15.133:0/3034779090 conn(0x7f556005e1e0 msgr2=0x7f556005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 -- 172.21.15.133:0/3034779090 shutdown_connections 2024-01-21T20:17:10.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.054+0000 7f55657e3700 1 -- 172.21.15.133:0/3034779090 wait complete. 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 Processor -- start 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 -- start start 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c6090 0x7f5560165530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f55600cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55601647d0 con 0x7f5560154520 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5560164ab0 con 0x7f55600c6090 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.056+0000 7f55657e3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5560164d90 con 0x7f5560154140 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53446/0 (socket says 172.21.15.133:53446) 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 -- 172.21.15.133:0/3771238797 learned_addr learned my addr 172.21.15.133:0/3771238797 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555effd700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c6090 0x7f5560165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555e7fc700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f55600cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 -- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 msgr2=0x7f55600cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f55600cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 -- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c6090 msgr2=0x7f5560165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c6090 0x7f5560165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 -- 172.21.15.133:0/3771238797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550009370 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f555f7fe700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f555800a380 tx=0x7f5558007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800ae10 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800d650 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800d9d0 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5560165070 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.057+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5560164520 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.058+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600c8f60 con 0x7f5560154520 2024-01-21T20:17:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.059+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5558013070 con 0x7f5560154520 2024-01-21T20:17:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.059+0000 7f55477fe700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 0x7f554c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.059+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f555807ae80 con 0x7f5560154520 2024-01-21T20:17:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.059+0000 7f555effd700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 0x7f554c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.059+0000 7f555effd700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 0x7f554c061640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f555400a9d0 tx=0x7f5554008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.063+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f55600c8f60 con 0x7f5560154520 2024-01-21T20:17:10.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.230+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55600c8f60 con 0x7f554c05f180 2024-01-21T20:17:10.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.240+0000 7f55477fe700 1 -- 172.21.15.133:0/3771238797 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362163 (secure 0 0 0) 0x7f55600c8f60 con 0x7f554c05f180 2024-01-21T20:17:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 msgr2=0x7f554c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 0x7f554c061640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f555400a9d0 tx=0x7f5554008040).stop 2024-01-21T20:17:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 msgr2=0x7f556014c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f555800a380 tx=0x7f5558007900).stop 2024-01-21T20:17:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 shutdown_connections 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f554c05f180 0x7f554c061640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5560154520 0x7f556014c760 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c6090 0x7f5560165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 --2- 172.21.15.133:0/3771238797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5560154140 0x7f55600cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 >> 172.21.15.133:0/3771238797 conn(0x7f556005e1e0 msgr2=0x7f55600c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 shutdown_connections 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.243+0000 7f55657e3700 1 -- 172.21.15.133:0/3771238797 wait complete. 2024-01-21T20:17:10.237 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:17:10.244 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-21T20:17:08.723247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429752,"kb_used_data":12024,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752544968,"statfs":{"total":773094113280,"available":770606047232,"internally_reserved":0,"allocated":12312576,"data_stored":6434698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5591,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-57,"num_write_kb":-25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.434416"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519456+0000","last_change":"2024-01-21T20:17:02.512752+0000","last_active":"2024-01-21T20:17:02.519456+0000","last_peered":"2024-01-21T20:17:02.519456+0000","last_clean":"2024-01-21T20:17:02.519456+0000","last_became_active":"2024-01-21T20:17:02.512347+0000","last_became_peered":"2024-01-21T20:17:02.512347+0000","last_unstale":"2024-01-21T20:17:02.519456+0000","last_undegraded":"2024-01-21T20:17:02.519456+0000","last_fullsized":"2024-01-21T20:17:02.519456+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3f","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525612+0000","last_change":"2024-01-21T20:17:02.147092+0000","last_active":"2024-01-21T20:17:02.525612+0000","last_peered":"2024-01-21T20:17:02.525612+0000","last_clean":"2024-01-21T20:17:02.525612+0000","last_became_active":"2024-01-21T20:17:02.146269+0000","last_became_peered":"2024-01-21T20:17:02.146269+0000","last_unstale":"2024-01-21T20:17:02.525612+0000","last_undegraded":"2024-01-21T20:17:02.525612+0000","last_fullsized":"2024-01-21T20:17:02.525612+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525428+0000","last_change":"2024-01-21T20:17:02.523938+0000","last_active":"2024-01-21T20:17:02.525428+0000","last_peered":"2024-01-21T20:17:02.525428+0000","last_clean":"2024-01-21T20:17:02.525428+0000","last_became_active":"2024-01-21T20:17:02.523518+0000","last_became_peered":"2024-01-21T20:17:02.523518+0000","last_unstale":"2024-01-21T20:17:02.525428+0000","last_undegraded":"2024-01-21T20:17:02.525428+0000","last_fullsized":"2024-01-21T20:17:02.525428+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499382+0000","last_change":"2024-01-21T20:17:02.132725+0000","last_active":"2024-01-21T20:17:02.499382+0000","last_peered":"2024-01-21T20:17:02.499382+0000","last_clean":"2024-01-21T20:17:02.499382+0000","last_became_active":"2024-01-21T20:17:02.132477+0000","last_became_peered":"2024-01-21T20:17:02.132477+0000","last_unstale":"2024-01-21T20:17:02.499382+0000","last_undegraded":"2024-01-21T20:17:02.499382+0000","last_fullsized":"2024-01-21T20:17:02.499382+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518400+0000","last_change":"2024-01-21T20:17:02.515533+0000","last_active":"2024-01-21T20:17:02.518400+0000","last_peered":"2024-01-21T20:17:02.518400+0000","last_clean":"2024-01-21T20:17:02.518400+0000","last_became_active":"2024-01-21T20:17:02.514907+0000","last_became_peered":"2024-01-21T20:17:02.514907+0000","last_unstale":"2024-01-21T20:17:02.518400+0000","last_undegraded":"2024-01-21T20:17:02.518400+0000","last_fullsized":"2024-01-21T20:17:02.518400+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.503672+0000","last_change":"2024-01-21T20:17:02.146783+0000","last_active":"2024-01-21T20:17:02.503672+0000","last_peered":"2024-01-21T20:17:02.503672+0000","last_clean":"2024-01-21T20:17:02.503672+0000","last_became_active":"2024-01-21T20:17:02.146469+0000","last_became_peered":"2024-01-21T20:17:02.146469+0000","last_unstale":"2024-01-21T20:17:02.503672+0000","last_undegraded":"2024-01-21T20:17:02.503672+0000","last_fullsized":"2024-01-21T20:17:02.503672+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522244+0000","last_change":"2024-01-21T20:17:02.513843+0000","last_active":"2024-01-21T20:17:02.522244+0000","last_peered":"2024-01-21T20:17:02.522244+0000","last_clean":"2024-01-21T20:17:02.522244+0000","last_became_active":"2024-01-21T20:17:02.513565+0000","last_became_peered":"2024-01-21T20:17:02.513565+0000","last_unstale":"2024-01-21T20:17:02.522244+0000","last_undegraded":"2024-01-21T20:17:02.522244+0000","last_fullsized":"2024-01-21T20:17:02.522244+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3c","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521318+0000","last_change":"2024-01-21T20:17:02.143556+0000","last_active":"2024-01-21T20:17:02.521318+0000","last_peered":"2024-01-21T20:17:02.521318+0000","last_clean":"2024-01-21T20:17:02.521318+0000","last_became_active":"2024-01-21T20:17:02.142967+0000","last_became_peered":"2024-01-21T20:17:02.142967+0000","last_unstale":"2024-01-21T20:17:02.521318+0000","last_undegraded":"2024-01-21T20:17:02.521318+0000","last_fullsized":"2024-01-21T20:17:02.521318+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519825+0000","last_change":"2024-01-21T20:17:02.515434+0000","last_active":"2024-01-21T20:17:02.519825+0000","last_peered":"2024-01-21T20:17:02.519825+0000","last_clean":"2024-01-21T20:17:02.519825+0000","last_became_active":"2024-01-21T20:17:02.515159+0000","last_became_peered":"2024-01-21T20:17:02.515159+0000","last_unstale":"2024-01-21T20:17:02.519825+0000","last_undegraded":"2024-01-21T20:17:02.519825+0000","last_fullsized":"2024-01-21T20:17:02.519825+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.533101+0000","last_change":"2024-01-21T20:17:02.140557+0000","last_active":"2024-01-21T20:17:02.533101+0000","last_peered":"2024-01-21T20:17:02.533101+0000","last_clean":"2024-01-21T20:17:02.533101+0000","last_became_active":"2024-01-21T20:17:02.140259+0000","last_became_peered":"2024-01-21T20:17:02.140259+0000","last_unstale":"2024-01-21T20:17:02.533101+0000","last_undegraded":"2024-01-21T20:17:02.533101+0000","last_fullsized":"2024-01-21T20:17:02.533101+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513949+0000","last_change":"2024-01-21T20:17:02.512083+0000","last_active":"2024-01-21T20:17:02.513949+0000","last_peered":"2024-01-21T20:17:02.513949+0000","last_clean":"2024-01-21T20:17:02.513949+0000","last_became_active":"2024-01-21T20:17:02.511647+0000","last_became_peered":"2024-01-21T20:17:02.511647+0000","last_unstale":"2024-01-21T20:17:02.513949+0000","last_undegraded":"2024-01-21T20:17:02.513949+0000","last_fullsized":"2024-01-21T20:17:02.513949+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3a","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523427+0000","last_change":"2024-01-21T20:17:02.146578+0000","last_active":"2024-01-21T20:17:02.523427+0000","last_peered":"2024-01-21T20:17:02.523427+0000","last_clean":"2024-01-21T20:17:02.523427+0000","last_became_active":"2024-01-21T20:17:02.146290+0000","last_became_peered":"2024-01-21T20:17:02.146290+0000","last_unstale":"2024-01-21T20:17:02.523427+0000","last_undegraded":"2024-01-21T20:17:02.523427+0000","last_fullsized":"2024-01-21T20:17:02.523427+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523240+0000","last_change":"2024-01-21T20:17:02.519344+0000","last_active":"2024-01-21T20:17:02.523240+0000","last_peered":"2024-01-21T20:17:02.523240+0000","last_clean":"2024-01-21T20:17:02.523240+0000","last_became_active":"2024-01-21T20:17:02.519030+0000","last_became_peered":"2024-01-21T20:17:02.519030+0000","last_unstale":"2024-01-21T20:17:02.523240+0000","last_undegraded":"2024-01-21T20:17:02.523240+0000","last_fullsized":"2024-01-21T20:17:02.523240+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507203+0000","last_change":"2024-01-21T20:17:02.145950+0000","last_active":"2024-01-21T20:17:02.507203+0000","last_peered":"2024-01-21T20:17:02.507203+0000","last_clean":"2024-01-21T20:17:02.507203+0000","last_became_active":"2024-01-21T20:17:02.145642+0000","last_became_peered":"2024-01-21T20:17:02.145642+0000","last_unstale":"2024-01-21T20:17:02.507203+0000","last_undegraded":"2024-01-21T20:17:02.507203+0000","last_fullsized":"2024-01-21T20:17:02.507203+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518054+0000","last_change":"2024-01-21T20:17:02.515356+0000","last_active":"2024-01-21T20:17:02.518054+0000","last_peered":"2024-01-21T20:17:02.518054+0000","last_clean":"2024-01-21T20:17:02.518054+0000","last_became_active":"2024-01-21T20:17:02.515043+0000","last_became_peered":"2024-01-21T20:17:02.515043+0000","last_unstale":"2024-01-21T20:17:02.518054+0000","last_undegraded":"2024-01-21T20:17:02.518054+0000","last_fullsized":"2024-01-21T20:17:02.518054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499844+0000","last_change":"2024-01-21T20:17:02.148889+0000","last_active":"2024-01-21T20:17:02.499844+0000","last_peered":"2024-01-21T20:17:02.499844+0000","last_clean":"2024-01-21T20:17:02.499844+0000","last_became_active":"2024-01-21T20:17:02.148576+0000","last_became_peered":"2024-01-21T20:17:02.148576+0000","last_unstale":"2024-01-21T20:17:02.499844+0000","last_undegraded":"2024-01-21T20:17:02.499844+0000","last_fullsized":"2024-01-21T20:17:02.499844+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528613+0000","last_change":"2024-01-21T20:17:02.518455+0000","last_active":"2024-01-21T20:17:02.528613+0000","last_peered":"2024-01-21T20:17:02.528613+0000","last_clean":"2024-01-21T20:17:02.528613+0000","last_became_active":"2024-01-21T20:17:02.517102+0000","last_became_peered":"2024-01-21T20:17:02.517102+0000","last_unstale":"2024-01-21T20:17:02.528613+0000","last_undegraded":"2024-01-21T20:17:02.528613+0000","last_fullsized":"2024-01-21T20:17:02.528613+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506798+0000","last_change":"2024-01-21T20:17:02.143589+0000","last_active":"2024-01-21T20:17:02.506798+0000","last_peered":"2024-01-21T20:17:02.506798+0000","last_clean":"2024-01-21T20:17:02.506798+0000","last_became_active":"2024-01-21T20:17:02.143262+0000","last_became_peered":"2024-01-21T20:17:02.143262+0000","last_unstale":"2024-01-21T20:17:02.506798+0000","last_undegraded":"2024-01-21T20:17:02.506798+0000","last_fullsized":"2024-01-21T20:17:02.506798+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507442+0000","last_change":"2024-01-21T20:17:02.504590+0000","last_active":"2024-01-21T20:17:02.507442+0000","last_peered":"2024-01-21T20:17:02.507442+0000","last_clean":"2024-01-21T20:17:02.507442+0000","last_became_active":"2024-01-21T20:17:02.504342+0000","last_became_peered":"2024-01-21T20:17:02.504342+0000","last_unstale":"2024-01-21T20:17:02.507442+0000","last_undegraded":"2024-01-21T20:17:02.507442+0000","last_fullsized":"2024-01-21T20:17:02.507442+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513814+0000","last_change":"2024-01-21T20:17:02.152353+0000","last_active":"2024-01-21T20:17:02.513814+0000","last_peered":"2024-01-21T20:17:02.513814+0000","last_clean":"2024-01-21T20:17:02.513814+0000","last_became_active":"2024-01-21T20:17:02.152046+0000","last_became_peered":"2024-01-21T20:17:02.152046+0000","last_unstale":"2024-01-21T20:17:02.513814+0000","last_undegraded":"2024-01-21T20:17:02.513814+0000","last_fullsized":"2024-01-21T20:17:02.513814+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524940+0000","last_change":"2024-01-21T20:17:02.515566+0000","last_active":"2024-01-21T20:17:02.524940+0000","last_peered":"2024-01-21T20:17:02.524940+0000","last_clean":"2024-01-21T20:17:02.524940+0000","last_became_active":"2024-01-21T20:17:02.515292+0000","last_became_peered":"2024-01-21T20:17:02.515292+0000","last_unstale":"2024-01-21T20:17:02.524940+0000","last_undegraded":"2024-01-21T20:17:02.524940+0000","last_fullsized":"2024-01-21T20:17:02.524940+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507952+0000","last_change":"2024-01-21T20:17:02.149379+0000","last_active":"2024-01-21T20:17:02.507952+0000","last_peered":"2024-01-21T20:17:02.507952+0000","last_clean":"2024-01-21T20:17:02.507952+0000","last_became_active":"2024-01-21T20:17:02.149071+0000","last_became_peered":"2024-01-21T20:17:02.149071+0000","last_unstale":"2024-01-21T20:17:02.507952+0000","last_undegraded":"2024-01-21T20:17:02.507952+0000","last_fullsized":"2024-01-21T20:17:02.507952+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522574+0000","last_change":"2024-01-21T20:17:02.515874+0000","last_active":"2024-01-21T20:17:02.522574+0000","last_peered":"2024-01-21T20:17:02.522574+0000","last_clean":"2024-01-21T20:17:02.522574+0000","last_became_active":"2024-01-21T20:17:02.515583+0000","last_became_peered":"2024-01-21T20:17:02.515583+0000","last_unstale":"2024-01-21T20:17:02.522574+0000","last_undegraded":"2024-01-21T20:17:02.522574+0000","last_fullsized":"2024-01-21T20:17:02.522574+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.34","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.534721+0000","last_change":"2024-01-21T20:17:02.151061+0000","last_active":"2024-01-21T20:17:02.534721+0000","last_peered":"2024-01-21T20:17:02.534721+0000","last_clean":"2024-01-21T20:17:02.534721+0000","last_became_active":"2024-01-21T20:17:02.150596+0000","last_became_peered":"2024-01-21T20:17:02.150596+0000","last_unstale":"2024-01-21T20:17:02.534721+0000","last_undegraded":"2024-01-21T20:17:02.534721+0000","last_fullsized":"2024-01-21T20:17:02.534721+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.517642+0000","last_change":"2024-01-21T20:17:02.515031+0000","last_active":"2024-01-21T20:17:02.517642+0000","last_peered":"2024-01-21T20:17:02.517642+0000","last_clean":"2024-01-21T20:17:02.517642+0000","last_became_active":"2024-01-21T20:17:02.514690+0000","last_became_peered":"2024-01-21T20:17:02.514690+0000","last_unstale":"2024-01-21T20:17:02.517642+0000","last_undegraded":"2024-01-21T20:17:02.517642+0000","last_fullsized":"2024-01-21T20:17:02.517642+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.517538+0000","last_change":"2024-01-21T20:17:02.144843+0000","last_active":"2024-01-21T20:17:02.517538+0000","last_peered":"2024-01-21T20:17:02.517538+0000","last_clean":"2024-01-21T20:17:02.517538+0000","last_became_active":"2024-01-21T20:17:02.144490+0000","last_became_peered":"2024-01-21T20:17:02.144490+0000","last_unstale":"2024-01-21T20:17:02.517538+0000","last_undegraded":"2024-01-21T20:17:02.517538+0000","last_fullsized":"2024-01-21T20:17:02.517538+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520679+0000","last_change":"2024-01-21T20:17:02.516387+0000","last_active":"2024-01-21T20:17:02.520679+0000","last_peered":"2024-01-21T20:17:02.520679+0000","last_clean":"2024-01-21T20:17:02.520679+0000","last_became_active":"2024-01-21T20:17:02.515980+0000","last_became_peered":"2024-01-21T20:17:02.515980+0000","last_unstale":"2024-01-21T20:17:02.520679+0000","last_undegraded":"2024-01-21T20:17:02.520679+0000","last_fullsized":"2024-01-21T20:17:02.520679+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512333+0000","last_change":"2024-01-21T20:17:02.145255+0000","last_active":"2024-01-21T20:17:02.512333+0000","last_peered":"2024-01-21T20:17:02.512333+0000","last_clean":"2024-01-21T20:17:02.512333+0000","last_became_active":"2024-01-21T20:17:02.144668+0000","last_became_peered":"2024-01-21T20:17:02.144668+0000","last_unstale":"2024-01-21T20:17:02.512333+0000","last_undegraded":"2024-01-21T20:17:02.512333+0000","last_fullsized":"2024-01-21T20:17:02.512333+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529674+0000","last_change":"2024-01-21T20:17:02.529012+0000","last_active":"2024-01-21T20:17:02.529674+0000","last_peered":"2024-01-21T20:17:02.529674+0000","last_clean":"2024-01-21T20:17:02.529674+0000","last_became_active":"2024-01-21T20:17:02.528753+0000","last_became_peered":"2024-01-21T20:17:02.528753+0000","last_unstale":"2024-01-21T20:17:02.529674+0000","last_undegraded":"2024-01-21T20:17:02.529674+0000","last_fullsized":"2024-01-21T20:17:02.529674+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509493+0000","last_change":"2024-01-21T20:17:02.147338+0000","last_active":"2024-01-21T20:17:02.509493+0000","last_peered":"2024-01-21T20:17:02.509493+0000","last_clean":"2024-01-21T20:17:02.509493+0000","last_became_active":"2024-01-21T20:17:02.146798+0000","last_became_peered":"2024-01-21T20:17:02.146798+0000","last_unstale":"2024-01-21T20:17:02.509493+0000","last_undegraded":"2024-01-21T20:17:02.509493+0000","last_fullsized":"2024-01-21T20:17:02.509493+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521681+0000","last_change":"2024-01-21T20:17:02.518593+0000","last_active":"2024-01-21T20:17:02.521681+0000","last_peered":"2024-01-21T20:17:02.521681+0000","last_clean":"2024-01-21T20:17:02.521681+0000","last_became_active":"2024-01-21T20:17:02.517970+0000","last_became_peered":"2024-01-21T20:17:02.517970+0000","last_unstale":"2024-01-21T20:17:02.521681+0000","last_undegraded":"2024-01-21T20:17:02.521681+0000","last_fullsized":"2024-01-21T20:17:02.521681+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.30","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528191+0000","last_change":"2024-01-21T20:17:02.149149+0000","last_active":"2024-01-21T20:17:02.528191+0000","last_peered":"2024-01-21T20:17:02.528191+0000","last_clean":"2024-01-21T20:17:02.528191+0000","last_became_active":"2024-01-21T20:17:02.148804+0000","last_became_peered":"2024-01-21T20:17:02.148804+0000","last_unstale":"2024-01-21T20:17:02.528191+0000","last_undegraded":"2024-01-21T20:17:02.528191+0000","last_fullsized":"2024-01-21T20:17:02.528191+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514418+0000","last_change":"2024-01-21T20:17:02.511422+0000","last_active":"2024-01-21T20:17:02.514418+0000","last_peered":"2024-01-21T20:17:02.514418+0000","last_clean":"2024-01-21T20:17:02.514418+0000","last_became_active":"2024-01-21T20:17:02.511123+0000","last_became_peered":"2024-01-21T20:17:02.511123+0000","last_unstale":"2024-01-21T20:17:02.514418+0000","last_undegraded":"2024-01-21T20:17:02.514418+0000","last_fullsized":"2024-01-21T20:17:02.514418+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.502374+0000","last_change":"2024-01-21T20:17:02.140869+0000","last_active":"2024-01-21T20:17:02.502374+0000","last_peered":"2024-01-21T20:17:02.502374+0000","last_clean":"2024-01-21T20:17:02.502374+0000","last_became_active":"2024-01-21T20:17:02.140582+0000","last_became_peered":"2024-01-21T20:17:02.140582+0000","last_unstale":"2024-01-21T20:17:02.502374+0000","last_undegraded":"2024-01-21T20:17:02.502374+0000","last_fullsized":"2024-01-21T20:17:02.502374+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523777+0000","last_change":"2024-01-21T20:17:02.517182+0000","last_active":"2024-01-21T20:17:02.523777+0000","last_peered":"2024-01-21T20:17:02.523777+0000","last_clean":"2024-01-21T20:17:02.523777+0000","last_became_active":"2024-01-21T20:17:02.516706+0000","last_became_peered":"2024-01-21T20:17:02.516706+0000","last_unstale":"2024-01-21T20:17:02.523777+0000","last_undegraded":"2024-01-21T20:17:02.523777+0000","last_fullsized":"2024-01-21T20:17:02.523777+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510799+0000","last_change":"2024-01-21T20:17:02.143846+0000","last_active":"2024-01-21T20:17:02.510799+0000","last_peered":"2024-01-21T20:17:02.510799+0000","last_clean":"2024-01-21T20:17:02.510799+0000","last_became_active":"2024-01-21T20:17:02.143410+0000","last_became_peered":"2024-01-21T20:17:02.143410+0000","last_unstale":"2024-01-21T20:17:02.510799+0000","last_undegraded":"2024-01-21T20:17:02.510799+0000","last_fullsized":"2024-01-21T20:17:02.510799+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524170+0000","last_change":"2024-01-21T20:17:02.522292+0000","last_active":"2024-01-21T20:17:02.524170+0000","last_peered":"2024-01-21T20:17:02.524170+0000","last_clean":"2024-01-21T20:17:02.524170+0000","last_became_active":"2024-01-21T20:17:02.521985+0000","last_became_peered":"2024-01-21T20:17:02.521985+0000","last_unstale":"2024-01-21T20:17:02.524170+0000","last_undegraded":"2024-01-21T20:17:02.524170+0000","last_fullsized":"2024-01-21T20:17:02.524170+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2d","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.526855+0000","last_change":"2024-01-21T20:17:02.152125+0000","last_active":"2024-01-21T20:17:02.526855+0000","last_peered":"2024-01-21T20:17:02.526855+0000","last_clean":"2024-01-21T20:17:02.526855+0000","last_became_active":"2024-01-21T20:17:02.151831+0000","last_became_peered":"2024-01-21T20:17:02.151831+0000","last_unstale":"2024-01-21T20:17:02.526855+0000","last_undegraded":"2024-01-21T20:17:02.526855+0000","last_fullsized":"2024-01-21T20:17:02.526855+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520644+0000","last_change":"2024-01-21T20:17:02.517020+0000","last_active":"2024-01-21T20:17:02.520644+0000","last_peered":"2024-01-21T20:17:02.520644+0000","last_clean":"2024-01-21T20:17:02.520644+0000","last_became_active":"2024-01-21T20:17:02.516743+0000","last_became_peered":"2024-01-21T20:17:02.516743+0000","last_unstale":"2024-01-21T20:17:02.520644+0000","last_undegraded":"2024-01-21T20:17:02.520644+0000","last_fullsized":"2024-01-21T20:17:02.520644+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507357+0000","last_change":"2024-01-21T20:17:02.144388+0000","last_active":"2024-01-21T20:17:02.507357+0000","last_peered":"2024-01-21T20:17:02.507357+0000","last_clean":"2024-01-21T20:17:02.507357+0000","last_became_active":"2024-01-21T20:17:02.143604+0000","last_became_peered":"2024-01-21T20:17:02.143604+0000","last_unstale":"2024-01-21T20:17:02.507357+0000","last_undegraded":"2024-01-21T20:17:02.507357+0000","last_fullsized":"2024-01-21T20:17:02.507357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.515890+0000","last_change":"2024-01-21T20:17:02.514315+0000","last_active":"2024-01-21T20:17:02.515890+0000","last_peered":"2024-01-21T20:17:02.515890+0000","last_clean":"2024-01-21T20:17:02.515890+0000","last_became_active":"2024-01-21T20:17:02.514001+0000","last_became_peered":"2024-01-21T20:17:02.514001+0000","last_unstale":"2024-01-21T20:17:02.515890+0000","last_undegraded":"2024-01-21T20:17:02.515890+0000","last_fullsized":"2024-01-21T20:17:02.515890+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522271+0000","last_change":"2024-01-21T20:17:02.148492+0000","last_active":"2024-01-21T20:17:02.522271+0000","last_peered":"2024-01-21T20:17:02.522271+0000","last_clean":"2024-01-21T20:17:02.522271+0000","last_became_active":"2024-01-21T20:17:02.148236+0000","last_became_peered":"2024-01-21T20:17:02.148236+0000","last_unstale":"2024-01-21T20:17:02.522271+0000","last_undegraded":"2024-01-21T20:17:02.522271+0000","last_fullsized":"2024-01-21T20:17:02.522271+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521003+0000","last_change":"2024-01-21T20:17:02.516103+0000","last_active":"2024-01-21T20:17:02.521003+0000","last_peered":"2024-01-21T20:17:02.521003+0000","last_clean":"2024-01-21T20:17:02.521003+0000","last_became_active":"2024-01-21T20:17:02.515808+0000","last_became_peered":"2024-01-21T20:17:02.515808+0000","last_unstale":"2024-01-21T20:17:02.521003+0000","last_undegraded":"2024-01-21T20:17:02.521003+0000","last_fullsized":"2024-01-21T20:17:02.521003+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499243+0000","last_change":"2024-01-21T20:17:02.130861+0000","last_active":"2024-01-21T20:17:02.499243+0000","last_peered":"2024-01-21T20:17:02.499243+0000","last_clean":"2024-01-21T20:17:02.499243+0000","last_became_active":"2024-01-21T20:17:02.130515+0000","last_became_peered":"2024-01-21T20:17:02.130515+0000","last_unstale":"2024-01-21T20:17:02.499243+0000","last_undegraded":"2024-01-21T20:17:02.499243+0000","last_fullsized":"2024-01-21T20:17:02.499243+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529100+0000","last_change":"2024-01-21T20:17:02.523382+0000","last_active":"2024-01-21T20:17:02.529100+0000","last_peered":"2024-01-21T20:17:02.529100+0000","last_clean":"2024-01-21T20:17:02.529100+0000","last_became_active":"2024-01-21T20:17:02.523149+0000","last_became_peered":"2024-01-21T20:17:02.523149+0000","last_unstale":"2024-01-21T20:17:02.529100+0000","last_undegraded":"2024-01-21T20:17:02.529100+0000","last_fullsized":"2024-01-21T20:17:02.529100+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499598+0000","last_change":"2024-01-21T20:17:02.130778+0000","last_active":"2024-01-21T20:17:02.499598+0000","last_peered":"2024-01-21T20:17:02.499598+0000","last_clean":"2024-01-21T20:17:02.499598+0000","last_became_active":"2024-01-21T20:17:02.130445+0000","last_became_peered":"2024-01-21T20:17:02.130445+0000","last_unstale":"2024-01-21T20:17:02.499598+0000","last_undegraded":"2024-01-21T20:17:02.499598+0000","last_fullsized":"2024-01-21T20:17:02.499598+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524879+0000","last_change":"2024-01-21T20:17:02.521834+0000","last_active":"2024-01-21T20:17:02.524879+0000","last_peered":"2024-01-21T20:17:02.524879+0000","last_clean":"2024-01-21T20:17:02.524879+0000","last_became_active":"2024-01-21T20:17:02.521564+0000","last_became_peered":"2024-01-21T20:17:02.521564+0000","last_unstale":"2024-01-21T20:17:02.524879+0000","last_undegraded":"2024-01-21T20:17:02.524879+0000","last_fullsized":"2024-01-21T20:17:02.524879+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.504969+0000","last_change":"2024-01-21T20:17:02.151802+0000","last_active":"2024-01-21T20:17:02.504969+0000","last_peered":"2024-01-21T20:17:02.504969+0000","last_clean":"2024-01-21T20:17:02.504969+0000","last_became_active":"2024-01-21T20:17:02.151528+0000","last_became_peered":"2024-01-21T20:17:02.151528+0000","last_unstale":"2024-01-21T20:17:02.504969+0000","last_undegraded":"2024-01-21T20:17:02.504969+0000","last_fullsized":"2024-01-21T20:17:02.504969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528363+0000","last_change":"2024-01-21T20:17:02.525683+0000","last_active":"2024-01-21T20:17:02.528363+0000","last_peered":"2024-01-21T20:17:02.528363+0000","last_clean":"2024-01-21T20:17:02.528363+0000","last_became_active":"2024-01-21T20:17:02.525425+0000","last_became_peered":"2024-01-21T20:17:02.525425+0000","last_unstale":"2024-01-21T20:17:02.528363+0000","last_undegraded":"2024-01-21T20:17:02.528363+0000","last_fullsized":"2024-01-21T20:17:02.528363+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513093+0000","last_change":"2024-01-21T20:17:02.154449+0000","last_active":"2024-01-21T20:17:02.513093+0000","last_peered":"2024-01-21T20:17:02.513093+0000","last_clean":"2024-01-21T20:17:02.513093+0000","last_became_active":"2024-01-21T20:17:02.154205+0000","last_became_peered":"2024-01-21T20:17:02.154205+0000","last_unstale":"2024-01-21T20:17:02.513093+0000","last_undegraded":"2024-01-21T20:17:02.513093+0000","last_fullsized":"2024-01-21T20:17:02.513093+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.529678+0000","last_change":"2024-01-21T20:17:02.529088+0000","last_active":"2024-01-21T20:17:02.529678+0000","last_peered":"2024-01-21T20:17:02.529678+0000","last_clean":"2024-01-21T20:17:02.529678+0000","last_became_active":"2024-01-21T20:17:02.528804+0000","last_became_peered":"2024-01-21T20:17:02.528804+0000","last_unstale":"2024-01-21T20:17:02.529678+0000","last_undegraded":"2024-01-21T20:17:02.529678+0000","last_fullsized":"2024-01-21T20:17:02.529678+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499474+0000","last_change":"2024-01-21T20:17:02.150032+0000","last_active":"2024-01-21T20:17:02.499474+0000","last_peered":"2024-01-21T20:17:02.499474+0000","last_clean":"2024-01-21T20:17:02.499474+0000","last_became_active":"2024-01-21T20:17:02.149763+0000","last_became_peered":"2024-01-21T20:17:02.149763+0000","last_unstale":"2024-01-21T20:17:02.499474+0000","last_undegraded":"2024-01-21T20:17:02.499474+0000","last_fullsized":"2024-01-21T20:17:02.499474+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.527059+0000","last_change":"2024-01-21T20:17:02.526635+0000","last_active":"2024-01-21T20:17:02.527059+0000","last_peered":"2024-01-21T20:17:02.527059+0000","last_clean":"2024-01-21T20:17:02.527059+0000","last_became_active":"2024-01-21T20:17:02.526356+0000","last_became_peered":"2024-01-21T20:17:02.526356+0000","last_unstale":"2024-01-21T20:17:02.527059+0000","last_undegraded":"2024-01-21T20:17:02.527059+0000","last_fullsized":"2024-01-21T20:17:02.527059+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507033+0000","last_change":"2024-01-21T20:17:02.145696+0000","last_active":"2024-01-21T20:17:02.507033+0000","last_peered":"2024-01-21T20:17:02.507033+0000","last_clean":"2024-01-21T20:17:02.507033+0000","last_became_active":"2024-01-21T20:17:02.145398+0000","last_became_peered":"2024-01-21T20:17:02.145398+0000","last_unstale":"2024-01-21T20:17:02.507033+0000","last_undegraded":"2024-01-21T20:17:02.507033+0000","last_fullsized":"2024-01-21T20:17:02.507033+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528676+0000","last_change":"2024-01-21T20:17:02.519563+0000","last_active":"2024-01-21T20:17:02.528676+0000","last_peered":"2024-01-21T20:17:02.528676+0000","last_clean":"2024-01-21T20:17:02.528676+0000","last_became_active":"2024-01-21T20:17:02.519246+0000","last_became_peered":"2024-01-21T20:17:02.519246+0000","last_unstale":"2024-01-21T20:17:02.528676+0000","last_undegraded":"2024-01-21T20:17:02.528676+0000","last_fullsized":"2024-01-21T20:17:02.528676+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513044+0000","last_change":"2024-01-21T20:17:02.142835+0000","last_active":"2024-01-21T20:17:02.513044+0000","last_peered":"2024-01-21T20:17:02.513044+0000","last_clean":"2024-01-21T20:17:02.513044+0000","last_became_active":"2024-01-21T20:17:02.142531+0000","last_became_peered":"2024-01-21T20:17:02.142531+0000","last_unstale":"2024-01-21T20:17:02.513044+0000","last_undegraded":"2024-01-21T20:17:02.513044+0000","last_fullsized":"2024-01-21T20:17:02.513044+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520503+0000","last_change":"2024-01-21T20:17:02.515560+0000","last_active":"2024-01-21T20:17:02.520503+0000","last_peered":"2024-01-21T20:17:02.520503+0000","last_clean":"2024-01-21T20:17:02.520503+0000","last_became_active":"2024-01-21T20:17:02.515297+0000","last_became_peered":"2024-01-21T20:17:02.515297+0000","last_unstale":"2024-01-21T20:17:02.520503+0000","last_undegraded":"2024-01-21T20:17:02.520503+0000","last_fullsized":"2024-01-21T20:17:02.520503+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501361+0000","last_change":"2024-01-21T20:17:02.150145+0000","last_active":"2024-01-21T20:17:02.501361+0000","last_peered":"2024-01-21T20:17:02.501361+0000","last_clean":"2024-01-21T20:17:02.501361+0000","last_became_active":"2024-01-21T20:17:02.149854+0000","last_became_peered":"2024-01-21T20:17:02.149854+0000","last_unstale":"2024-01-21T20:17:02.501361+0000","last_undegraded":"2024-01-21T20:17:02.501361+0000","last_fullsized":"2024-01-21T20:17:02.501361+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520718+0000","last_change":"2024-01-21T20:17:02.518070+0000","last_active":"2024-01-21T20:17:02.520718+0000","last_peered":"2024-01-21T20:17:02.520718+0000","last_clean":"2024-01-21T20:17:02.520718+0000","last_became_active":"2024-01-21T20:17:02.517886+0000","last_became_peered":"2024-01-21T20:17:02.517886+0000","last_unstale":"2024-01-21T20:17:02.520718+0000","last_undegraded":"2024-01-21T20:17:02.520718+0000","last_fullsized":"2024-01-21T20:17:02.520718+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512535+0000","last_change":"2024-01-21T20:17:02.152349+0000","last_active":"2024-01-21T20:17:02.512535+0000","last_peered":"2024-01-21T20:17:02.512535+0000","last_clean":"2024-01-21T20:17:02.512535+0000","last_became_active":"2024-01-21T20:17:02.152072+0000","last_became_peered":"2024-01-21T20:17:02.152072+0000","last_unstale":"2024-01-21T20:17:02.512535+0000","last_undegraded":"2024-01-21T20:17:02.512535+0000","last_fullsized":"2024-01-21T20:17:02.512535+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524010+0000","last_change":"2024-01-21T20:17:02.517365+0000","last_active":"2024-01-21T20:17:02.524010+0000","last_peered":"2024-01-21T20:17:02.524010+0000","last_clean":"2024-01-21T20:17:02.524010+0000","last_became_active":"2024-01-21T20:17:02.516794+0000","last_became_peered":"2024-01-21T20:17:02.516794+0000","last_unstale":"2024-01-21T20:17:02.524010+0000","last_undegraded":"2024-01-21T20:17:02.524010+0000","last_fullsized":"2024-01-21T20:17:02.524010+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509584+0000","last_change":"2024-01-21T20:17:02.139070+0000","last_active":"2024-01-21T20:17:02.509584+0000","last_peered":"2024-01-21T20:17:02.509584+0000","last_clean":"2024-01-21T20:17:02.509584+0000","last_became_active":"2024-01-21T20:17:02.138794+0000","last_became_peered":"2024-01-21T20:17:02.138794+0000","last_unstale":"2024-01-21T20:17:02.509584+0000","last_undegraded":"2024-01-21T20:17:02.509584+0000","last_fullsized":"2024-01-21T20:17:02.509584+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521661+0000","last_change":"2024-01-21T20:17:02.517724+0000","last_active":"2024-01-21T20:17:02.521661+0000","last_peered":"2024-01-21T20:17:02.521661+0000","last_clean":"2024-01-21T20:17:02.521661+0000","last_became_active":"2024-01-21T20:17:02.517523+0000","last_became_peered":"2024-01-21T20:17:02.517523+0000","last_unstale":"2024-01-21T20:17:02.521661+0000","last_undegraded":"2024-01-21T20:17:02.521661+0000","last_fullsized":"2024-01-21T20:17:02.521661+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.503346+0000","last_change":"2024-01-21T20:17:02.150824+0000","last_active":"2024-01-21T20:17:02.503346+0000","last_peered":"2024-01-21T20:17:02.503346+0000","last_clean":"2024-01-21T20:17:02.503346+0000","last_became_active":"2024-01-21T20:17:02.150533+0000","last_became_peered":"2024-01-21T20:17:02.150533+0000","last_unstale":"2024-01-21T20:17:02.503346+0000","last_undegraded":"2024-01-21T20:17:02.503346+0000","last_fullsized":"2024-01-21T20:17:02.503346+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521085+0000","last_change":"2024-01-21T20:17:02.517060+0000","last_active":"2024-01-21T20:17:02.521085+0000","last_peered":"2024-01-21T20:17:02.521085+0000","last_clean":"2024-01-21T20:17:02.521085+0000","last_became_active":"2024-01-21T20:17:02.516597+0000","last_became_peered":"2024-01-21T20:17:02.516597+0000","last_unstale":"2024-01-21T20:17:02.521085+0000","last_undegraded":"2024-01-21T20:17:02.521085+0000","last_fullsized":"2024-01-21T20:17:02.521085+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520485+0000","last_change":"2024-01-21T20:17:02.139306+0000","last_active":"2024-01-21T20:17:02.520485+0000","last_peered":"2024-01-21T20:17:02.520485+0000","last_clean":"2024-01-21T20:17:02.520485+0000","last_became_active":"2024-01-21T20:17:02.139017+0000","last_became_peered":"2024-01-21T20:17:02.139017+0000","last_unstale":"2024-01-21T20:17:02.520485+0000","last_undegraded":"2024-01-21T20:17:02.520485+0000","last_fullsized":"2024-01-21T20:17:02.520485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528343+0000","last_change":"2024-01-21T20:17:02.523319+0000","last_active":"2024-01-21T20:17:02.528343+0000","last_peered":"2024-01-21T20:17:02.528343+0000","last_clean":"2024-01-21T20:17:02.528343+0000","last_became_active":"2024-01-21T20:17:02.523103+0000","last_became_peered":"2024-01-21T20:17:02.523103+0000","last_unstale":"2024-01-21T20:17:02.528343+0000","last_undegraded":"2024-01-21T20:17:02.528343+0000","last_fullsized":"2024-01-21T20:17:02.528343+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523641+0000","last_change":"2024-01-21T20:17:02.140761+0000","last_active":"2024-01-21T20:17:02.523641+0000","last_peered":"2024-01-21T20:17:02.523641+0000","last_clean":"2024-01-21T20:17:02.523641+0000","last_became_active":"2024-01-21T20:17:02.140434+0000","last_became_peered":"2024-01-21T20:17:02.140434+0000","last_unstale":"2024-01-21T20:17:02.523641+0000","last_undegraded":"2024-01-21T20:17:02.523641+0000","last_fullsized":"2024-01-21T20:17:02.523641+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525757+0000","last_change":"2024-01-21T20:17:02.525209+0000","last_active":"2024-01-21T20:17:02.525757+0000","last_peered":"2024-01-21T20:17:02.525757+0000","last_clean":"2024-01-21T20:17:02.525757+0000","last_became_active":"2024-01-21T20:17:02.524915+0000","last_became_peered":"2024-01-21T20:17:02.524915+0000","last_unstale":"2024-01-21T20:17:02.525757+0000","last_undegraded":"2024-01-21T20:17:02.525757+0000","last_fullsized":"2024-01-21T20:17:02.525757+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521592+0000","last_change":"2024-01-21T20:17:02.148485+0000","last_active":"2024-01-21T20:17:02.521592+0000","last_peered":"2024-01-21T20:17:02.521592+0000","last_clean":"2024-01-21T20:17:02.521592+0000","last_became_active":"2024-01-21T20:17:02.148168+0000","last_became_peered":"2024-01-21T20:17:02.148168+0000","last_unstale":"2024-01-21T20:17:02.521592+0000","last_undegraded":"2024-01-21T20:17:02.521592+0000","last_fullsized":"2024-01-21T20:17:02.521592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514791+0000","last_change":"2024-01-21T20:17:02.508455+0000","last_active":"2024-01-21T20:17:02.514791+0000","last_peered":"2024-01-21T20:17:02.514791+0000","last_clean":"2024-01-21T20:17:02.514791+0000","last_became_active":"2024-01-21T20:17:02.508069+0000","last_became_peered":"2024-01-21T20:17:02.508069+0000","last_unstale":"2024-01-21T20:17:02.514791+0000","last_undegraded":"2024-01-21T20:17:02.514791+0000","last_fullsized":"2024-01-21T20:17:02.514791+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501677+0000","last_change":"2024-01-21T20:17:02.148386+0000","last_active":"2024-01-21T20:17:02.501677+0000","last_peered":"2024-01-21T20:17:02.501677+0000","last_clean":"2024-01-21T20:17:02.501677+0000","last_became_active":"2024-01-21T20:17:02.148073+0000","last_became_peered":"2024-01-21T20:17:02.148073+0000","last_unstale":"2024-01-21T20:17:02.501677+0000","last_undegraded":"2024-01-21T20:17:02.501677+0000","last_fullsized":"2024-01-21T20:17:02.501677+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.532774+0000","last_change":"2024-01-21T20:17:02.525256+0000","last_active":"2024-01-21T20:17:02.532774+0000","last_peered":"2024-01-21T20:17:02.532774+0000","last_clean":"2024-01-21T20:17:02.532774+0000","last_became_active":"2024-01-21T20:17:02.524982+0000","last_became_peered":"2024-01-21T20:17:02.524982+0000","last_unstale":"2024-01-21T20:17:02.532774+0000","last_undegraded":"2024-01-21T20:17:02.532774+0000","last_fullsized":"2024-01-21T20:17:02.532774+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505279+0000","last_change":"2024-01-21T20:17:02.142916+0000","last_active":"2024-01-21T20:17:02.505279+0000","last_peered":"2024-01-21T20:17:02.505279+0000","last_clean":"2024-01-21T20:17:02.505279+0000","last_became_active":"2024-01-21T20:17:02.142639+0000","last_became_peered":"2024-01-21T20:17:02.142639+0000","last_unstale":"2024-01-21T20:17:02.505279+0000","last_undegraded":"2024-01-21T20:17:02.505279+0000","last_fullsized":"2024-01-21T20:17:02.505279+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520699+0000","last_change":"2024-01-21T20:17:02.516564+0000","last_active":"2024-01-21T20:17:02.520699+0000","last_peered":"2024-01-21T20:17:02.520699+0000","last_clean":"2024-01-21T20:17:02.520699+0000","last_became_active":"2024-01-21T20:17:02.516278+0000","last_became_peered":"2024-01-21T20:17:02.516278+0000","last_unstale":"2024-01-21T20:17:02.520699+0000","last_undegraded":"2024-01-21T20:17:02.520699+0000","last_fullsized":"2024-01-21T20:17:02.520699+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501398+0000","last_change":"2024-01-21T20:17:02.144180+0000","last_active":"2024-01-21T20:17:02.501398+0000","last_peered":"2024-01-21T20:17:02.501398+0000","last_clean":"2024-01-21T20:17:02.501398+0000","last_became_active":"2024-01-21T20:17:02.143904+0000","last_became_peered":"2024-01-21T20:17:02.143904+0000","last_unstale":"2024-01-21T20:17:02.501398+0000","last_undegraded":"2024-01-21T20:17:02.501398+0000","last_fullsized":"2024-01-21T20:17:02.501398+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523761+0000","last_change":"2024-01-21T20:17:02.517187+0000","last_active":"2024-01-21T20:17:02.523761+0000","last_peered":"2024-01-21T20:17:02.523761+0000","last_clean":"2024-01-21T20:17:02.523761+0000","last_became_active":"2024-01-21T20:17:02.516484+0000","last_became_peered":"2024-01-21T20:17:02.516484+0000","last_unstale":"2024-01-21T20:17:02.523761+0000","last_undegraded":"2024-01-21T20:17:02.523761+0000","last_fullsized":"2024-01-21T20:17:02.523761+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506469+0000","last_change":"2024-01-21T20:17:02.148493+0000","last_active":"2024-01-21T20:17:02.506469+0000","last_peered":"2024-01-21T20:17:02.506469+0000","last_clean":"2024-01-21T20:17:02.506469+0000","last_became_active":"2024-01-21T20:17:02.148177+0000","last_became_peered":"2024-01-21T20:17:02.148177+0000","last_unstale":"2024-01-21T20:17:02.506469+0000","last_undegraded":"2024-01-21T20:17:02.506469+0000","last_fullsized":"2024-01-21T20:17:02.506469+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528229+0000","last_change":"2024-01-21T20:17:02.521522+0000","last_active":"2024-01-21T20:17:02.528229+0000","last_peered":"2024-01-21T20:17:02.528229+0000","last_clean":"2024-01-21T20:17:02.528229+0000","last_became_active":"2024-01-21T20:17:02.520827+0000","last_became_peered":"2024-01-21T20:17:02.520827+0000","last_unstale":"2024-01-21T20:17:02.528229+0000","last_undegraded":"2024-01-21T20:17:02.528229+0000","last_fullsized":"2024-01-21T20:17:02.528229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.508729+0000","last_change":"2024-01-21T20:17:02.146917+0000","last_active":"2024-01-21T20:17:02.508729+0000","last_peered":"2024-01-21T20:17:02.508729+0000","last_clean":"2024-01-21T20:17:02.508729+0000","last_became_active":"2024-01-21T20:17:02.146629+0000","last_became_peered":"2024-01-21T20:17:02.146629+0000","last_unstale":"2024-01-21T20:17:02.508729+0000","last_undegraded":"2024-01-21T20:17:02.508729+0000","last_fullsized":"2024-01-21T20:17:02.508729+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521067+0000","last_change":"2024-01-21T20:17:02.516882+0000","last_active":"2024-01-21T20:17:02.521067+0000","last_peered":"2024-01-21T20:17:02.521067+0000","last_clean":"2024-01-21T20:17:02.521067+0000","last_became_active":"2024-01-21T20:17:02.516229+0000","last_became_peered":"2024-01-21T20:17:02.516229+0000","last_unstale":"2024-01-21T20:17:02.521067+0000","last_undegraded":"2024-01-21T20:17:02.521067+0000","last_fullsized":"2024-01-21T20:17:02.521067+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506895+0000","last_change":"2024-01-21T20:17:02.146034+0000","last_active":"2024-01-21T20:17:02.506895+0000","last_peered":"2024-01-21T20:17:02.506895+0000","last_clean":"2024-01-21T20:17:02.506895+0000","last_became_active":"2024-01-21T20:17:02.145622+0000","last_became_peered":"2024-01-21T20:17:02.145622+0000","last_unstale":"2024-01-21T20:17:02.506895+0000","last_undegraded":"2024-01-21T20:17:02.506895+0000","last_fullsized":"2024-01-21T20:17:02.506895+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528622+0000","last_change":"2024-01-21T20:17:02.518554+0000","last_active":"2024-01-21T20:17:02.528622+0000","last_peered":"2024-01-21T20:17:02.528622+0000","last_clean":"2024-01-21T20:17:02.528622+0000","last_became_active":"2024-01-21T20:17:02.518104+0000","last_became_peered":"2024-01-21T20:17:02.518104+0000","last_unstale":"2024-01-21T20:17:02.528622+0000","last_undegraded":"2024-01-21T20:17:02.528622+0000","last_fullsized":"2024-01-21T20:17:02.528622+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499587+0000","last_change":"2024-01-21T20:17:02.148899+0000","last_active":"2024-01-21T20:17:02.499587+0000","last_peered":"2024-01-21T20:17:02.499587+0000","last_clean":"2024-01-21T20:17:02.499587+0000","last_became_active":"2024-01-21T20:17:02.148646+0000","last_became_peered":"2024-01-21T20:17:02.148646+0000","last_unstale":"2024-01-21T20:17:02.499587+0000","last_undegraded":"2024-01-21T20:17:02.499587+0000","last_fullsized":"2024-01-21T20:17:02.499587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528438+0000","last_change":"2024-01-21T20:17:02.526833+0000","last_active":"2024-01-21T20:17:02.528438+0000","last_peered":"2024-01-21T20:17:02.528438+0000","last_clean":"2024-01-21T20:17:02.528438+0000","last_became_active":"2024-01-21T20:17:02.526567+0000","last_became_peered":"2024-01-21T20:17:02.526567+0000","last_unstale":"2024-01-21T20:17:02.528438+0000","last_undegraded":"2024-01-21T20:17:02.528438+0000","last_fullsized":"2024-01-21T20:17:02.528438+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"123'3","reported_seq":13,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.527633+0000","last_change":"2024-01-21T20:17:02.149884+0000","last_active":"2024-01-21T20:17:02.527633+0000","last_peered":"2024-01-21T20:17:02.527633+0000","last_clean":"2024-01-21T20:17:02.527633+0000","last_became_active":"2024-01-21T20:17:02.149625+0000","last_became_peered":"2024-01-21T20:17:02.149625+0000","last_unstale":"2024-01-21T20:17:02.527633+0000","last_undegraded":"2024-01-21T20:17:02.527633+0000","last_fullsized":"2024-01-21T20:17:02.527633+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524543+0000","last_change":"2024-01-21T20:17:02.509290+0000","last_active":"2024-01-21T20:17:02.524543+0000","last_peered":"2024-01-21T20:17:02.524543+0000","last_clean":"2024-01-21T20:17:02.524543+0000","last_became_active":"2024-01-21T20:17:02.509011+0000","last_became_peered":"2024-01-21T20:17:02.509011+0000","last_unstale":"2024-01-21T20:17:02.524543+0000","last_undegraded":"2024-01-21T20:17:02.524543+0000","last_fullsized":"2024-01-21T20:17:02.524543+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.533402+0000","last_change":"2024-01-21T20:17:02.142281+0000","last_active":"2024-01-21T20:17:02.533402+0000","last_peered":"2024-01-21T20:17:02.533402+0000","last_clean":"2024-01-21T20:17:02.533402+0000","last_became_active":"2024-01-21T20:17:02.141981+0000","last_became_peered":"2024-01-21T20:17:02.141981+0000","last_unstale":"2024-01-21T20:17:02.533402+0000","last_undegraded":"2024-01-21T20:17:02.533402+0000","last_fullsized":"2024-01-21T20:17:02.533402+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513464+0000","last_change":"2024-01-21T20:17:02.507899+0000","last_active":"2024-01-21T20:17:02.513464+0000","last_peered":"2024-01-21T20:17:02.513464+0000","last_clean":"2024-01-21T20:17:02.513464+0000","last_became_active":"2024-01-21T20:17:02.507568+0000","last_became_peered":"2024-01-21T20:17:02.507568+0000","last_unstale":"2024-01-21T20:17:02.513464+0000","last_undegraded":"2024-01-21T20:17:02.513464+0000","last_fullsized":"2024-01-21T20:17:02.513464+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524804+0000","last_change":"2024-01-21T20:17:02.155950+0000","last_active":"2024-01-21T20:17:02.524804+0000","last_peered":"2024-01-21T20:17:02.524804+0000","last_clean":"2024-01-21T20:17:02.524804+0000","last_became_active":"2024-01-21T20:17:02.155519+0000","last_became_peered":"2024-01-21T20:17:02.155519+0000","last_unstale":"2024-01-21T20:17:02.524804+0000","last_undegraded":"2024-01-21T20:17:02.524804+0000","last_fullsized":"2024-01-21T20:17:02.524804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523750+0000","last_change":"2024-01-21T20:17:02.520454+0000","last_active":"2024-01-21T20:17:02.523750+0000","last_peered":"2024-01-21T20:17:02.523750+0000","last_clean":"2024-01-21T20:17:02.523750+0000","last_became_active":"2024-01-21T20:17:02.517778+0000","last_became_peered":"2024-01-21T20:17:02.517778+0000","last_unstale":"2024-01-21T20:17:02.523750+0000","last_undegraded":"2024-01-21T20:17:02.523750+0000","last_fullsized":"2024-01-21T20:17:02.523750+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510120+0000","last_change":"2024-01-21T20:17:02.137501+0000","last_active":"2024-01-21T20:17:02.510120+0000","last_peered":"2024-01-21T20:17:02.510120+0000","last_clean":"2024-01-21T20:17:02.510120+0000","last_became_active":"2024-01-21T20:17:02.137207+0000","last_became_peered":"2024-01-21T20:17:02.137207+0000","last_unstale":"2024-01-21T20:17:02.510120+0000","last_undegraded":"2024-01-21T20:17:02.510120+0000","last_fullsized":"2024-01-21T20:17:02.510120+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522516+0000","last_change":"2024-01-21T20:17:02.518905+0000","last_active":"2024-01-21T20:17:02.522516+0000","last_peered":"2024-01-21T20:17:02.522516+0000","last_clean":"2024-01-21T20:17:02.522516+0000","last_became_active":"2024-01-21T20:17:02.518635+0000","last_became_peered":"2024-01-21T20:17:02.518635+0000","last_unstale":"2024-01-21T20:17:02.522516+0000","last_undegraded":"2024-01-21T20:17:02.522516+0000","last_fullsized":"2024-01-21T20:17:02.522516+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512351+0000","last_change":"2024-01-21T20:17:02.146182+0000","last_active":"2024-01-21T20:17:02.512351+0000","last_peered":"2024-01-21T20:17:02.512351+0000","last_clean":"2024-01-21T20:17:02.512351+0000","last_became_active":"2024-01-21T20:17:02.145905+0000","last_became_peered":"2024-01-21T20:17:02.145905+0000","last_unstale":"2024-01-21T20:17:02.512351+0000","last_undegraded":"2024-01-21T20:17:02.512351+0000","last_fullsized":"2024-01-21T20:17:02.512351+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525509+0000","last_change":"2024-01-21T20:17:02.519376+0000","last_active":"2024-01-21T20:17:02.525509+0000","last_peered":"2024-01-21T20:17:02.525509+0000","last_clean":"2024-01-21T20:17:02.525509+0000","last_became_active":"2024-01-21T20:17:02.518309+0000","last_became_peered":"2024-01-21T20:17:02.518309+0000","last_unstale":"2024-01-21T20:17:02.525509+0000","last_undegraded":"2024-01-21T20:17:02.525509+0000","last_fullsized":"2024-01-21T20:17:02.525509+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"123'4","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521703+0000","last_change":"2024-01-21T20:17:02.145874+0000","last_active":"2024-01-21T20:17:02.521703+0000","last_peered":"2024-01-21T20:17:02.521703+0000","last_clean":"2024-01-21T20:17:02.521703+0000","last_became_active":"2024-01-21T20:17:02.145580+0000","last_became_peered":"2024-01-21T20:17:02.145580+0000","last_unstale":"2024-01-21T20:17:02.521703+0000","last_undegraded":"2024-01-21T20:17:02.521703+0000","last_fullsized":"2024-01-21T20:17:02.521703+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521048+0000","last_change":"2024-01-21T20:17:02.514489+0000","last_active":"2024-01-21T20:17:02.521048+0000","last_peered":"2024-01-21T20:17:02.521048+0000","last_clean":"2024-01-21T20:17:02.521048+0000","last_became_active":"2024-01-21T20:17:02.514021+0000","last_became_peered":"2024-01-21T20:17:02.514021+0000","last_unstale":"2024-01-21T20:17:02.521048+0000","last_undegraded":"2024-01-21T20:17:02.521048+0000","last_fullsized":"2024-01-21T20:17:02.521048+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525444+0000","last_change":"2024-01-21T20:17:02.147068+0000","last_active":"2024-01-21T20:17:02.525444+0000","last_peered":"2024-01-21T20:17:02.525444+0000","last_clean":"2024-01-21T20:17:02.525444+0000","last_became_active":"2024-01-21T20:17:02.146780+0000","last_became_peered":"2024-01-21T20:17:02.146780+0000","last_unstale":"2024-01-21T20:17:02.525444+0000","last_undegraded":"2024-01-21T20:17:02.525444+0000","last_fullsized":"2024-01-21T20:17:02.525444+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.518298+0000","last_change":"2024-01-21T20:17:02.516964+0000","last_active":"2024-01-21T20:17:02.518298+0000","last_peered":"2024-01-21T20:17:02.518298+0000","last_clean":"2024-01-21T20:17:02.518298+0000","last_became_active":"2024-01-21T20:17:02.516504+0000","last_became_peered":"2024-01-21T20:17:02.516504+0000","last_unstale":"2024-01-21T20:17:02.518298+0000","last_undegraded":"2024-01-21T20:17:02.518298+0000","last_fullsized":"2024-01-21T20:17:02.518298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.499687+0000","last_change":"2024-01-21T20:17:02.132654+0000","last_active":"2024-01-21T20:17:02.499687+0000","last_peered":"2024-01-21T20:17:02.499687+0000","last_clean":"2024-01-21T20:17:02.499687+0000","last_became_active":"2024-01-21T20:17:02.130584+0000","last_became_peered":"2024-01-21T20:17:02.130584+0000","last_unstale":"2024-01-21T20:17:02.499687+0000","last_undegraded":"2024-01-21T20:17:02.499687+0000","last_fullsized":"2024-01-21T20:17:02.499687+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.520872+0000","last_change":"2024-01-21T20:17:02.518145+0000","last_active":"2024-01-21T20:17:02.520872+0000","last_peered":"2024-01-21T20:17:02.520872+0000","last_clean":"2024-01-21T20:17:02.520872+0000","last_became_active":"2024-01-21T20:17:02.517884+0000","last_became_peered":"2024-01-21T20:17:02.517884+0000","last_unstale":"2024-01-21T20:17:02.520872+0000","last_undegraded":"2024-01-21T20:17:02.520872+0000","last_fullsized":"2024-01-21T20:17:02.520872+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513332+0000","last_change":"2024-01-21T20:17:02.142031+0000","last_active":"2024-01-21T20:17:02.513332+0000","last_peered":"2024-01-21T20:17:02.513332+0000","last_clean":"2024-01-21T20:17:02.513332+0000","last_became_active":"2024-01-21T20:17:02.141392+0000","last_became_peered":"2024-01-21T20:17:02.141392+0000","last_unstale":"2024-01-21T20:17:02.513332+0000","last_undegraded":"2024-01-21T20:17:02.513332+0000","last_fullsized":"2024-01-21T20:17:02.513332+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523287+0000","last_change":"2024-01-21T20:17:02.522119+0000","last_active":"2024-01-21T20:17:02.523287+0000","last_peered":"2024-01-21T20:17:02.523287+0000","last_clean":"2024-01-21T20:17:02.523287+0000","last_became_active":"2024-01-21T20:17:02.520335+0000","last_became_peered":"2024-01-21T20:17:02.520335+0000","last_unstale":"2024-01-21T20:17:02.523287+0000","last_undegraded":"2024-01-21T20:17:02.523287+0000","last_fullsized":"2024-01-21T20:17:02.523287+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501773+0000","last_change":"2024-01-21T20:17:02.148782+0000","last_active":"2024-01-21T20:17:02.501773+0000","last_peered":"2024-01-21T20:17:02.501773+0000","last_clean":"2024-01-21T20:17:02.501773+0000","last_became_active":"2024-01-21T20:17:02.147335+0000","last_became_peered":"2024-01-21T20:17:02.147335+0000","last_unstale":"2024-01-21T20:17:02.501773+0000","last_undegraded":"2024-01-21T20:17:02.501773+0000","last_fullsized":"2024-01-21T20:17:02.501773+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528385+0000","last_change":"2024-01-21T20:17:02.525795+0000","last_active":"2024-01-21T20:17:02.528385+0000","last_peered":"2024-01-21T20:17:02.528385+0000","last_clean":"2024-01-21T20:17:02.528385+0000","last_became_active":"2024-01-21T20:17:02.525519+0000","last_became_peered":"2024-01-21T20:17:02.525519+0000","last_unstale":"2024-01-21T20:17:02.528385+0000","last_undegraded":"2024-01-21T20:17:02.528385+0000","last_fullsized":"2024-01-21T20:17:02.528385+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.506861+0000","last_change":"2024-01-21T20:17:02.135694+0000","last_active":"2024-01-21T20:17:02.506861+0000","last_peered":"2024-01-21T20:17:02.506861+0000","last_clean":"2024-01-21T20:17:02.506861+0000","last_became_active":"2024-01-21T20:17:02.135240+0000","last_became_peered":"2024-01-21T20:17:02.135240+0000","last_unstale":"2024-01-21T20:17:02.506861+0000","last_undegraded":"2024-01-21T20:17:02.506861+0000","last_fullsized":"2024-01-21T20:17:02.506861+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528403+0000","last_change":"2024-01-21T20:17:02.525944+0000","last_active":"2024-01-21T20:17:02.528403+0000","last_peered":"2024-01-21T20:17:02.528403+0000","last_clean":"2024-01-21T20:17:02.528403+0000","last_became_active":"2024-01-21T20:17:02.525669+0000","last_became_peered":"2024-01-21T20:17:02.525669+0000","last_unstale":"2024-01-21T20:17:02.528403+0000","last_undegraded":"2024-01-21T20:17:02.528403+0000","last_fullsized":"2024-01-21T20:17:02.528403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512866+0000","last_change":"2024-01-21T20:17:02.147830+0000","last_active":"2024-01-21T20:17:02.512866+0000","last_peered":"2024-01-21T20:17:02.512866+0000","last_clean":"2024-01-21T20:17:02.512866+0000","last_became_active":"2024-01-21T20:17:02.145641+0000","last_became_peered":"2024-01-21T20:17:02.145641+0000","last_unstale":"2024-01-21T20:17:02.512866+0000","last_undegraded":"2024-01-21T20:17:02.512866+0000","last_fullsized":"2024-01-21T20:17:02.512866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.523458+0000","last_change":"2024-01-21T20:17:02.516344+0000","last_active":"2024-01-21T20:17:02.523458+0000","last_peered":"2024-01-21T20:17:02.523458+0000","last_clean":"2024-01-21T20:17:02.523458+0000","last_became_active":"2024-01-21T20:17:02.516042+0000","last_became_peered":"2024-01-21T20:17:02.516042+0000","last_unstale":"2024-01-21T20:17:02.523458+0000","last_undegraded":"2024-01-21T20:17:02.523458+0000","last_fullsized":"2024-01-21T20:17:02.523458+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.510068+0000","last_change":"2024-01-21T20:17:02.141847+0000","last_active":"2024-01-21T20:17:02.510068+0000","last_peered":"2024-01-21T20:17:02.510068+0000","last_clean":"2024-01-21T20:17:02.510068+0000","last_became_active":"2024-01-21T20:17:02.141543+0000","last_became_peered":"2024-01-21T20:17:02.141543+0000","last_unstale":"2024-01-21T20:17:02.510068+0000","last_undegraded":"2024-01-21T20:17:02.510068+0000","last_fullsized":"2024-01-21T20:17:02.510068+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522481+0000","last_change":"2024-01-21T20:17:02.517984+0000","last_active":"2024-01-21T20:17:02.522481+0000","last_peered":"2024-01-21T20:17:02.522481+0000","last_clean":"2024-01-21T20:17:02.522481+0000","last_became_active":"2024-01-21T20:17:02.517652+0000","last_became_peered":"2024-01-21T20:17:02.517652+0000","last_unstale":"2024-01-21T20:17:02.522481+0000","last_undegraded":"2024-01-21T20:17:02.522481+0000","last_fullsized":"2024-01-21T20:17:02.522481+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512636+0000","last_change":"2024-01-21T20:17:02.146063+0000","last_active":"2024-01-21T20:17:02.512636+0000","last_peered":"2024-01-21T20:17:02.512636+0000","last_clean":"2024-01-21T20:17:02.512636+0000","last_became_active":"2024-01-21T20:17:02.145574+0000","last_became_peered":"2024-01-21T20:17:02.145574+0000","last_unstale":"2024-01-21T20:17:02.512636+0000","last_undegraded":"2024-01-21T20:17:02.512636+0000","last_fullsized":"2024-01-21T20:17:02.512636+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528322+0000","last_change":"2024-01-21T20:17:02.521053+0000","last_active":"2024-01-21T20:17:02.528322+0000","last_peered":"2024-01-21T20:17:02.528322+0000","last_clean":"2024-01-21T20:17:02.528322+0000","last_became_active":"2024-01-21T20:17:02.520775+0000","last_became_peered":"2024-01-21T20:17:02.520775+0000","last_unstale":"2024-01-21T20:17:02.528322+0000","last_undegraded":"2024-01-21T20:17:02.528322+0000","last_fullsized":"2024-01-21T20:17:02.528322+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.509949+0000","last_change":"2024-01-21T20:17:02.147518+0000","last_active":"2024-01-21T20:17:02.509949+0000","last_peered":"2024-01-21T20:17:02.509949+0000","last_clean":"2024-01-21T20:17:02.509949+0000","last_became_active":"2024-01-21T20:17:02.147239+0000","last_became_peered":"2024-01-21T20:17:02.147239+0000","last_unstale":"2024-01-21T20:17:02.509949+0000","last_undegraded":"2024-01-21T20:17:02.509949+0000","last_fullsized":"2024-01-21T20:17:02.509949+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":100,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501860+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:17:02.501860+0000","last_peered":"2024-01-21T20:17:02.501860+0000","last_clean":"2024-01-21T20:17:02.501860+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:17:02.501860+0000","last_undegraded":"2024-01-21T20:17:02.501860+0000","last_fullsized":"2024-01-21T20:17:02.501860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.519475+0000","last_change":"2024-01-21T20:17:02.513849+0000","last_active":"2024-01-21T20:17:02.519475+0000","last_peered":"2024-01-21T20:17:02.519475+0000","last_clean":"2024-01-21T20:17:02.519475+0000","last_became_active":"2024-01-21T20:17:02.513534+0000","last_became_peered":"2024-01-21T20:17:02.513534+0000","last_unstale":"2024-01-21T20:17:02.519475+0000","last_undegraded":"2024-01-21T20:17:02.519475+0000","last_fullsized":"2024-01-21T20:17:02.519475+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.524817+0000","last_change":"2024-01-21T20:17:02.145418+0000","last_active":"2024-01-21T20:17:02.524817+0000","last_peered":"2024-01-21T20:17:02.524817+0000","last_clean":"2024-01-21T20:17:02.524817+0000","last_became_active":"2024-01-21T20:17:02.144798+0000","last_became_peered":"2024-01-21T20:17:02.144798+0000","last_unstale":"2024-01-21T20:17:02.524817+0000","last_undegraded":"2024-01-21T20:17:02.524817+0000","last_fullsized":"2024-01-21T20:17:02.524817+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501490+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:17:02.501490+0000","last_peered":"2024-01-21T20:17:02.501490+0000","last_clean":"2024-01-21T20:17:02.501490+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:17:02.501490+0000","last_undegraded":"2024-01-21T20:17:02.501490+0000","last_fullsized":"2024-01-21T20:17:02.501490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528654+0000","last_change":"2024-01-21T20:17:02.518743+0000","last_active":"2024-01-21T20:17:02.528654+0000","last_peered":"2024-01-21T20:17:02.528654+0000","last_clean":"2024-01-21T20:17:02.528654+0000","last_became_active":"2024-01-21T20:17:02.518472+0000","last_became_peered":"2024-01-21T20:17:02.518472+0000","last_unstale":"2024-01-21T20:17:02.528654+0000","last_undegraded":"2024-01-21T20:17:02.528654+0000","last_fullsized":"2024-01-21T20:17:02.528654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501364+0000","last_change":"2024-01-21T20:17:02.138631+0000","last_active":"2024-01-21T20:17:02.501364+0000","last_peered":"2024-01-21T20:17:02.501364+0000","last_clean":"2024-01-21T20:17:02.501364+0000","last_became_active":"2024-01-21T20:17:02.138360+0000","last_became_peered":"2024-01-21T20:17:02.138360+0000","last_unstale":"2024-01-21T20:17:02.501364+0000","last_undegraded":"2024-01-21T20:17:02.501364+0000","last_fullsized":"2024-01-21T20:17:02.501364+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512440+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:17:02.512440+0000","last_peered":"2024-01-21T20:17:02.512440+0000","last_clean":"2024-01-21T20:17:02.512440+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:17:02.512440+0000","last_undegraded":"2024-01-21T20:17:02.512440+0000","last_fullsized":"2024-01-21T20:17:02.512440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.514563+0000","last_change":"2024-01-21T20:17:02.510463+0000","last_active":"2024-01-21T20:17:02.514563+0000","last_peered":"2024-01-21T20:17:02.514563+0000","last_clean":"2024-01-21T20:17:02.514563+0000","last_became_active":"2024-01-21T20:17:02.508203+0000","last_became_peered":"2024-01-21T20:17:02.508203+0000","last_unstale":"2024-01-21T20:17:02.514563+0000","last_undegraded":"2024-01-21T20:17:02.514563+0000","last_fullsized":"2024-01-21T20:17:02.514563+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"123'2","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.522467+0000","last_change":"2024-01-21T20:17:02.142326+0000","last_active":"2024-01-21T20:17:02.522467+0000","last_peered":"2024-01-21T20:17:02.522467+0000","last_clean":"2024-01-21T20:17:02.522467+0000","last_became_active":"2024-01-21T20:17:02.142043+0000","last_became_peered":"2024-01-21T20:17:02.142043+0000","last_unstale":"2024-01-21T20:17:02.522467+0000","last_undegraded":"2024-01-21T20:17:02.522467+0000","last_fullsized":"2024-01-21T20:17:02.522467+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.501813+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:17:02.501813+0000","last_peered":"2024-01-21T20:17:02.501813+0000","last_clean":"2024-01-21T20:17:02.501813+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:17:02.501813+0000","last_undegraded":"2024-01-21T20:17:02.501813+0000","last_fullsized":"2024-01-21T20:17:02.501813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":101,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505066+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:17:02.505066+0000","last_peered":"2024-01-21T20:17:02.505066+0000","last_clean":"2024-01-21T20:17:02.505066+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:17:02.505066+0000","last_undegraded":"2024-01-21T20:17:02.505066+0000","last_fullsized":"2024-01-21T20:17:02.505066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.525453+0000","last_change":"2024-01-21T20:17:02.524302+0000","last_active":"2024-01-21T20:17:02.525453+0000","last_peered":"2024-01-21T20:17:02.525453+0000","last_clean":"2024-01-21T20:17:02.525453+0000","last_became_active":"2024-01-21T20:17:02.524007+0000","last_became_peered":"2024-01-21T20:17:02.524007+0000","last_unstale":"2024-01-21T20:17:02.525453+0000","last_undegraded":"2024-01-21T20:17:02.525453+0000","last_fullsized":"2024-01-21T20:17:02.525453+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.507847+0000","last_change":"2024-01-21T20:17:02.148876+0000","last_active":"2024-01-21T20:17:02.507847+0000","last_peered":"2024-01-21T20:17:02.507847+0000","last_clean":"2024-01-21T20:17:02.507847+0000","last_became_active":"2024-01-21T20:17:02.148548+0000","last_became_peered":"2024-01-21T20:17:02.148548+0000","last_unstale":"2024-01-21T20:17:02.507847+0000","last_undegraded":"2024-01-21T20:17:02.507847+0000","last_fullsized":"2024-01-21T20:17:02.507847+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.505175+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:17:02.505175+0000","last_peered":"2024-01-21T20:17:02.505175+0000","last_clean":"2024-01-21T20:17:02.505175+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:17:02.505175+0000","last_undegraded":"2024-01-21T20:17:02.505175+0000","last_fullsized":"2024-01-21T20:17:02.505175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.532726+0000","last_change":"2024-01-21T20:17:02.526895+0000","last_active":"2024-01-21T20:17:02.532726+0000","last_peered":"2024-01-21T20:17:02.532726+0000","last_clean":"2024-01-21T20:17:02.532726+0000","last_became_active":"2024-01-21T20:17:02.526626+0000","last_became_peered":"2024-01-21T20:17:02.526626+0000","last_unstale":"2024-01-21T20:17:02.532726+0000","last_undegraded":"2024-01-21T20:17:02.532726+0000","last_fullsized":"2024-01-21T20:17:02.532726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513973+0000","last_change":"2024-01-21T20:17:02.141351+0000","last_active":"2024-01-21T20:17:02.513973+0000","last_peered":"2024-01-21T20:17:02.513973+0000","last_clean":"2024-01-21T20:17:02.513973+0000","last_became_active":"2024-01-21T20:17:02.141075+0000","last_became_peered":"2024-01-21T20:17:02.141075+0000","last_unstale":"2024-01-21T20:17:02.513973+0000","last_undegraded":"2024-01-21T20:17:02.513973+0000","last_fullsized":"2024-01-21T20:17:02.513973+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.508040+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:17:02.508040+0000","last_peered":"2024-01-21T20:17:02.508040+0000","last_clean":"2024-01-21T20:17:02.508040+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:17:02.508040+0000","last_undegraded":"2024-01-21T20:17:02.508040+0000","last_fullsized":"2024-01-21T20:17:02.508040+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.528033+0000","last_change":"2024-01-21T20:17:02.521898+0000","last_active":"2024-01-21T20:17:02.528033+0000","last_peered":"2024-01-21T20:17:02.528033+0000","last_clean":"2024-01-21T20:17:02.528033+0000","last_became_active":"2024-01-21T20:17:02.521591+0000","last_became_peered":"2024-01-21T20:17:02.521591+0000","last_unstale":"2024-01-21T20:17:02.528033+0000","last_undegraded":"2024-01-21T20:17:02.528033+0000","last_fullsized":"2024-01-21T20:17:02.528033+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"123'1","reported_seq":11,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.521819+0000","last_change":"2024-01-21T20:17:02.150515+0000","last_active":"2024-01-21T20:17:02.521819+0000","last_peered":"2024-01-21T20:17:02.521819+0000","last_clean":"2024-01-21T20:17:02.521819+0000","last_became_active":"2024-01-21T20:17:02.150241+0000","last_became_peered":"2024-01-21T20:17:02.150241+0000","last_unstale":"2024-01-21T20:17:02.521819+0000","last_undegraded":"2024-01-21T20:17:02.521819+0000","last_fullsized":"2024-01-21T20:17:02.521819+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.502963+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:17:02.502963+0000","last_peered":"2024-01-21T20:17:02.502963+0000","last_clean":"2024-01-21T20:17:02.502963+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:17:02.502963+0000","last_undegraded":"2024-01-21T20:17:02.502963+0000","last_fullsized":"2024-01-21T20:17:02.502963+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.530019+0000","last_change":"2024-01-21T20:17:02.526539+0000","last_active":"2024-01-21T20:17:02.530019+0000","last_peered":"2024-01-21T20:17:02.530019+0000","last_clean":"2024-01-21T20:17:02.530019+0000","last_became_active":"2024-01-21T20:17:02.524181+0000","last_became_peered":"2024-01-21T20:17:02.524181+0000","last_unstale":"2024-01-21T20:17:02.530019+0000","last_undegraded":"2024-01-21T20:17:02.530019+0000","last_fullsized":"2024-01-21T20:17:02.530019+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:02.121217+0000","last_clean_scrub_stamp":"2024-01-21T20:17:02.121217+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.512608+0000","last_change":"2024-01-21T20:17:02.141448+0000","last_active":"2024-01-21T20:17:02.512608+0000","last_peered":"2024-01-21T20:17:02.512608+0000","last_clean":"2024-01-21T20:17:02.512608+0000","last_became_active":"2024-01-21T20:17:02.141161+0000","last_became_peered":"2024-01-21T20:17:02.141161+0000","last_unstale":"2024-01-21T20:17:02.512608+0000","last_undegraded":"2024-01-21T20:17:02.512608+0000","last_fullsized":"2024-01-21T20:17:02.512608+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:17:01.117321+0000","last_clean_scrub_stamp":"2024-01-21T20:17:01.117321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-01-21T20:17:02.513310+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:17:02.513310+0000","last_peered":"2024-01-21T20:17:02.513310+0000","last_clean":"2024-01-21T20:17:02.513310+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:17:02.513310+0000","last_undegraded":"2024-01-21T20:17:02.513310+0000","last_fullsized":"2024-01-21T20:17:02.513310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1531904,"data_stored":803130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.61699999999999999},"min":{"1min":0.502,"5min":0.435,"15min":0.36799999999999999},"max":{"1min":0.78200000000000003,"5min":0.78500000000000003,"15min":0.82099999999999995},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.56000000000000005},"min":{"1min":0.373,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.79700000000000004},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.40699999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72099999999999997,"5min":0.77700000000000002,"15min":0.82799999999999996},"last":0.433},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.42399999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70699999999999996,"5min":0.77000000000000002,"15min":0.80400000000000005},"last":0.504}]},{"osd":3,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.57499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.376},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.59299999999999997},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.83699999999999997},"last":0.45200000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.68500000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.75700000000000001,"5min":0.78200000000000003,"15min":0.82499999999999996},"last":0.55700000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.49399999999999999},"min":{"1min":0.34300000000000003,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.81799999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.64500000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.40200000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:16:35 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.78400000000000003,"15min":0.82499999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.81499999999999995},"last":0.52900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306796,"kb_used_data":1508,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065044,"statfs":{"total":96636764160,"available":96322605056,"internally_reserved":0,"allocated":1544192,"data_stored":804667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57699999999999996,"15min":0.59999999999999998},"min":{"1min":0.46999999999999997,"5min":0.25,"15min":0.25},"max":{"1min":0.73199999999999998,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59899999999999998,"15min":0.61799999999999999},"min":{"1min":0.39500000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":1.083},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.38900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.64300000000000002,"5min":0.78700000000000003,"15min":1.107},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76100000000000001,"5min":0.81200000000000006,"15min":1.016},"last":0.46899999999999997}]},{"osd":2,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55300000000000005,"15min":0.56699999999999995},"min":{"1min":0.41399999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70499999999999996,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.749,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57999999999999996},"min":{"1min":0.42299999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.71999999999999997,"5min":0.877,"15min":1.0609999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.36099999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71399999999999997,"5min":1.621,"15min":1.621},"last":0.376}]},{"osd":4,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.45400000000000001},"min":{"1min":0.312,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56000000000000005,"5min":0.76100000000000001,"15min":0.84599999999999997},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48999999999999999,"15min":0.48099999999999998},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.28299999999999997},"max":{"1min":0.65900000000000003,"5min":0.75,"15min":0.86099999999999999},"last":0.35399999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57499999999999996,"15min":0.56799999999999995},"min":{"1min":0.371,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70699999999999996,"5min":0.85699999999999998,"15min":0.86899999999999999},"last":0.503}]},{"osd":7,"last update":"Sun Jan 21 20:16:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.38900000000000001,"5min":0.34399999999999997,"15min":0.33000000000000002},"max":{"1min":0.61799999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.41599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":1548288,"data_stored":805551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.39200000000000002},"min":{"1min":0.26300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.61399999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.40999999999999998,"15min":0.44},"min":{"1min":0.36299999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.627},"last":0.439}]},{"osd":2,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.40200000000000002},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.40899999999999997},"min":{"1min":0.314,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.59799999999999998,"5min":0.60099999999999998,"15min":0.68799999999999994},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.441},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.59299999999999997,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.432},{"interface":"front","average":{"1min":0.437,"5min":0.38600000000000001,"15min":0.41299999999999998},"min":{"1min":0.34200000000000003,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56699999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.36399999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.434,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58499999999999996,"15min":0.61399999999999999},"min":{"1min":0.434,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.70299999999999996}]},{"osd":5,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.622,"15min":0.64500000000000002},"min":{"1min":0.42199999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82099999999999995,"5min":0.876,"15min":0.98899999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.64100000000000001,"15min":0.67000000000000004},"min":{"1min":0.501,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83299999999999996,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.625,"15min":0.64800000000000002},"min":{"1min":0.46899999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.878,"5min":0.878,"15min":0.99299999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.86899999999999999,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:16:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.85599999999999998,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61899999999999999,"15min":0.65200000000000002},"min":{"1min":0.44800000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79500000000000004,"5min":0.872,"15min":0.95299999999999996},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834575063,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":803774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.36499999999999999},"min":{"1min":0.27500000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.47499999999999998,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.27700000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.29999999999999999,"5min":0.252,"15min":0.245},"max":{"1min":0.57299999999999995,"5min":0.57799999999999996,"15min":0.70799999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.44},"min":{"1min":0.34499999999999997,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.57599999999999996,"5min":0.621,"15min":0.81699999999999995},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.39800000000000002,"15min":0.41499999999999998},"min":{"1min":0.28000000000000003,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.40799999999999997,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.32700000000000001}]},{"osd":4,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.60799999999999998},"min":{"1min":0.40799999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.44},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58999999999999997,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.51400000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.60399999999999998},"min":{"1min":0.41499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60899999999999999,"15min":0.63100000000000001},"min":{"1min":0.42899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.498}]},{"osd":6,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89200000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.625,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.90400000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:16:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.64000000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.625,"15min":0.65000000000000002},"min":{"1min":0.46700000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.86099999999999999,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.47799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":804105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.314},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.40400000000000003,"15min":0.42099999999999999},"min":{"1min":0.32900000000000001,"5min":0.27100000000000002,"15min":0.26900000000000002},"max":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.374,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.23799999999999999,"15min":0.23300000000000001},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41199999999999998,"15min":0.42399999999999999},"min":{"1min":0.30499999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.253}]},{"osd":3,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41999999999999998,"15min":0.439},"min":{"1min":0.34399999999999997,"5min":0.255,"15min":0.255},"max":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.433,"15min":0.45600000000000002},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.26100000000000001},"max":{"1min":0.57899999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.28000000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.64300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82799999999999996,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.65400000000000003,"15min":0.67100000000000004},"min":{"1min":0.47099999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.91900000000000004,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61099999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85199999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.623},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56000000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.626,"15min":0.63300000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.2,"15min":1.2},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.61799999999999999,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.88700000000000001,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.57299999999999995}]},{"osd":7,"last update":"Sun Jan 21 20:16:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.47899999999999998,"5min":0.40500000000000003,"15min":0.376},"max":{"1min":0.874,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65000000000000002,"15min":0.66100000000000003},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88200000000000001,"5min":1.216,"15min":1.216},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302688,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069152,"statfs":{"total":96636764160,"available":96326811648,"internally_reserved":0,"allocated":1531904,"data_stored":804001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.185},"max":{"1min":0.55100000000000005,"5min":7.8940000000000001,"15min":7.8940000000000001},"last":0.316},{"interface":"front","average":{"1min":0.433,"5min":0.47799999999999998,"15min":0.44600000000000001},"min":{"1min":0.29399999999999998,"5min":0.26800000000000002,"15min":0.25900000000000001},"max":{"1min":0.60099999999999998,"5min":7.532,"15min":7.532},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.437,"15min":0.40999999999999998},"min":{"1min":0.28000000000000003,"5min":0.217,"15min":0.217},"max":{"1min":0.56499999999999995,"5min":6.9660000000000002,"15min":6.9660000000000002},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.46200000000000002,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.58899999999999997,"5min":7.8380000000000001,"15min":7.8380000000000001},"last":0.374}]},{"osd":2,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.498,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.625,"5min":7.0199999999999996,"15min":7.0199999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.51700000000000002,"15min":0.48799999999999999},"min":{"1min":0.33400000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.58999999999999997,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.44400000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":7.6020000000000003,"15min":7.6020000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.39800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":7.0940000000000003,"15min":7.0940000000000003},"last":0.54700000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66900000000000004,"15min":0.64300000000000002},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":7.1230000000000002,"15min":7.1230000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.67200000000000004,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.77000000000000002,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":0.56499999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.68400000000000005,"15min":0.66200000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79800000000000004,"5min":7.9649999999999999,"15min":7.9649999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67000000000000004,"15min":0.66100000000000003},"min":{"1min":0.47799999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.755,"5min":7.3540000000000001,"15min":7.3540000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:16:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68799999999999994,"15min":0.67000000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":7.5620000000000003,"15min":7.5620000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69599999999999995,"15min":0.68400000000000005},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81399999999999995,"5min":7.8200000000000003,"15min":7.8200000000000003},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302696,"kb_used_data":1504,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069144,"statfs":{"total":96636764160,"available":96326803456,"internally_reserved":0,"allocated":1540096,"data_stored":804915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59799999999999998},"min":{"1min":0.36799999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.749,"15min":0.82599999999999996},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.56599999999999995,"15min":0.59599999999999997},"min":{"1min":0.46300000000000002,"5min":0.38700000000000001,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.76600000000000001,"15min":0.82699999999999996},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57999999999999996,"15min":0.60999999999999999},"min":{"1min":0.443,"5min":0.318,"15min":0.318},"max":{"1min":0.75800000000000001,"5min":0.78400000000000003,"15min":0.89600000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.61699999999999999},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.39700000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56100000000000005,"15min":0.57599999999999996},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77800000000000002,"5min":1.472,"15min":1.472},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55000000000000004,"15min":0.56799999999999995},"min":{"1min":0.42899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70699999999999996,"5min":0.79800000000000004,"15min":0.82599999999999996},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55300000000000005,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0700000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59999999999999998,"15min":0.60099999999999998},"min":{"1min":0.40699999999999997,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":1.0920000000000001,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.47199999999999998},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66800000000000004,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.48599999999999999},"min":{"1min":0.32300000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59599999999999997,"5min":0.748,"15min":0.77600000000000002},"last":0.29399999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.47999999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:16:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51100000000000001,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66300000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.375},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54800000000000004,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67000000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.435}]}]},{"osd":5,"up_from":13,"seq":55834575062,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1536000,"data_stored":804555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.59799999999999998},"min":{"1min":0.311,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.82899999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79900000000000004,"5min":1.252,"15min":1.252},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.36199999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.35899999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79600000000000004,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.75700000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54500000000000004,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.81499999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78000000000000003,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.60499999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.55700000000000005},"min":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.81599999999999995,"5min":1.008,"15min":1.008},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":1.891,"15min":1.891},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53900000000000003,"15min":0.51200000000000001},"min":{"1min":0.40699999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77300000000000002,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.50800000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:16:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52700000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.78500000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.745,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:17:10.250 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:17:10.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:17:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.417+0000 7f342e3d9700 1 Processor -- start 2024-01-21T20:17:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f342e3d9700 1 -- start start 2024-01-21T20:17:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f342e3d9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3428065d70 0x7f342815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f342e3d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3428069ef0 con 0x7f3428062c10 2024-01-21T20:17:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f342e3d9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342806a130 con 0x7f3428062ff0 2024-01-21T20:17:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f342e3d9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342806a410 con 0x7f3428065d70 2024-01-21T20:17:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.418+0000 7f3427fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3428062c10 0x7f34280697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47962/0 (socket says 172.21.15.133:47962) 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3427fff700 1 -- 172.21.15.133:0/1113959408 learned_addr learned my addr 172.21.15.133:0/1113959408 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661173212 0 0) 0x7f3410001110 con 0x7f3428062c10 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34140033f0 con 0x7f3428062c10 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f342c976700 1 --2- 172.21.15.133:0/1113959408 >> v2:172.21.15.178:3300/0 conn(0x7f3428065d70 0x7f342815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4172511010 0 0) 0x7f34140033f0 con 0x7f3428062c10 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 >> v2:172.21.15.178:3300/0 conn(0x7f3428065d70 msgr2=0x7f342815f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 --2- 172.21.15.133:0/1113959408 >> v2:172.21.15.178:3300/0 conn(0x7f3428065d70 0x7f342815f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 >> v1:172.21.15.178:6789/0 conn(0x7f3428062ff0 legacy=0x7f3428065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342806a6f0 con 0x7f3428062c10 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3410001600 con 0x7f3428062c10 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 >> v1:172.21.15.133:6789/0 conn(0x7f3428062c10 legacy=0x7f34280697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34140038e0 0x7f3414003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3414004690 0x7f3414004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f341400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342806a410 con 0x7f3414005050 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341400bfe0 con 0x7f34140038e0 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341400c1a0 con 0x7f3414004690 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f342c976700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f341400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f3427fff700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34140038e0 0x7f3414003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.419+0000 7f34277fe700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3414004690 0x7f3414004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 -- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3414004690 msgr2=0x7f3414004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3414004690 0x7f3414004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 -- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34140038e0 msgr2=0x7f3414003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34140038e0 0x7f3414003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 -- 172.21.15.133:0/1113959408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140033f0 con 0x7f3414005050 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 -- 172.21.15.133:0/1113959408 reap_dead start 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342c976700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f341400b8e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f34200094d0 tx=0x7f342000b040).ready entity=mon.0 client_cookie=49486e183f476cb4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420017070 con 0x7f3414005050 2024-01-21T20:17:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342000f040 con 0x7f3414005050 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f3426ffd700 1 -- 172.21.15.133:0/1113959408 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000ec40 con 0x7f3414005050 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 -- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 msgr2=0x7f341400b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f341400b8e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f34200094d0 tx=0x7f342000b040).stop 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 -- 172.21.15.133:0/1113959408 shutdown_connections 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 --2- 172.21.15.133:0/1113959408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f341400b8e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 -- 172.21.15.133:0/1113959408 >> 172.21.15.133:0/1113959408 conn(0x7f34280c8010 msgr2=0x7f34280c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 -- 172.21.15.133:0/1113959408 shutdown_connections 2024-01-21T20:17:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.420+0000 7f342e3d9700 1 -- 172.21.15.133:0/1113959408 wait complete. 2024-01-21T20:17:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 Processor -- start 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 -- start start 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34280ac640 0x7f3428153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3428133c00 0x7f34281544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428154990 con 0x7f3414005050 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281323a0 con 0x7f3428133c00 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.422+0000 7f342e3d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428131790 con 0x7f34280ac640 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48860/0 (socket says 172.21.15.133:48860) 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 -- 172.21.15.133:0/414146634 learned_addr learned my addr 172.21.15.133:0/414146634 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f34277fe700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34280ac640 0x7f3428153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f342c976700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3428133c00 0x7f34281544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 -- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34280ac640 msgr2=0x7f3428153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34280ac640 0x7f3428153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 -- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3428133c00 msgr2=0x7f34281544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3428133c00 0x7f34281544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 -- 172.21.15.133:0/414146634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428131a70 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3427fff700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f34100079e0 tx=0x7f34100078d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011590 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34100116f0 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3428131d50 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410011a70 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.423+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3428130a20 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.424+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342805fdf0 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.424+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f341001d3b0 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.425+0000 7f3424ff9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.425+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f3410079b80 con 0x7f3414005050 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.425+0000 7f34277fe700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.425+0000 7f34277fe700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3428136d90 tx=0x7f3418009040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.429+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f341004ac50 con 0x7f3414005050 2024-01-21T20:17:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.659+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3428069ef0 con 0x7f3414005050 2024-01-21T20:17:10.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.663+0000 7f3424ff9700 1 -- 172.21.15.133:0/414146634 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3428069ef0 con 0x7f3414005050 2024-01-21T20:17:10.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 msgr2=0x7f3408061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3428136d90 tx=0x7f3418009040).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 msgr2=0x7f34280ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f34100079e0 tx=0x7f34100078d0).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 shutdown_connections 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f340805f150 0x7f3408061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3428133c00 0x7f34281544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3414005050 0x7f34280ac150 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 --2- 172.21.15.133:0/414146634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34280ac640 0x7f3428153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 >> 172.21.15.133:0/414146634 conn(0x7f34280c8010 msgr2=0x7f34280a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 shutdown_connections 2024-01-21T20:17:10.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.665+0000 7f342e3d9700 1 -- 172.21.15.133:0/414146634 wait complete. 2024-01-21T20:17:10.656 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:17:10.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:17:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.794+0000 7f187e884700 1 Processor -- start 2024-01-21T20:17:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.794+0000 7f187e884700 1 -- start start 2024-01-21T20:17:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187e884700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 0x7f18780c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187e884700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18780be810 0x7f18780a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187e884700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18780bfa40 con 0x7f18780c39f0 2024-01-21T20:17:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187e884700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18780c3e70 con 0x7f18780be810 2024-01-21T20:17:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187e884700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18780bee30 con 0x7f187813b970 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18780be810 0x7f18780a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18780be810 0x7f18780a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48864/0 (socket says 172.21.15.133:48864) 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 -- 172.21.15.133:0/1028798499 learned_addr learned my addr 172.21.15.133:0/1028798499 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f1877fff700 1 --2- 172.21.15.133:0/1028798499 >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 0x7f18780c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 -- 172.21.15.133:0/1028798499 >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 msgr2=0x7f18780c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 --2- 172.21.15.133:0/1028798499 >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 0x7f18780c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 -- 172.21.15.133:0/1028798499 >> v1:172.21.15.178:6789/0 conn(0x7f18780c39f0 legacy=0x7f18780be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 -- 172.21.15.133:0/1028798499 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780bf110 con 0x7f18780be810 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f1877fff700 1 --2- 172.21.15.133:0/1028798499 >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 0x7f18780c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f187ce21700 1 --2- 172.21.15.133:0/1028798499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780be810 0x7f18780a8ab0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f1878065f70 tx=0x7f1870009840).ready entity=mon.0 client_cookie=9b135683b8def8c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f1876ffd700 1 -- 172.21.15.133:0/1028798499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000e070 con 0x7f18780be810 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f1876ffd700 1 -- 172.21.15.133:0/1028798499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000ba10 con 0x7f18780be810 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.795+0000 7f1876ffd700 1 -- 172.21.15.133:0/1028798499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000bd90 con 0x7f18780be810 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 -- 172.21.15.133:0/1028798499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780be810 msgr2=0x7f18780a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 --2- 172.21.15.133:0/1028798499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780be810 0x7f18780a8ab0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f1878065f70 tx=0x7f1870009840).stop 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 -- 172.21.15.133:0/1028798499 shutdown_connections 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 --2- 172.21.15.133:0/1028798499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780be810 0x7f18780a8ab0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 --2- 172.21.15.133:0/1028798499 >> v2:172.21.15.178:3300/0 conn(0x7f187813b970 0x7f18780c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 -- 172.21.15.133:0/1028798499 >> 172.21.15.133:0/1028798499 conn(0x7f1878066a70 msgr2=0x7f1878066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 -- 172.21.15.133:0/1028798499 shutdown_connections 2024-01-21T20:17:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.796+0000 7f187e884700 1 -- 172.21.15.133:0/1028798499 wait complete. 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.797+0000 7f187e884700 1 Processor -- start 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.797+0000 7f187e884700 1 -- start start 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18780be810 0x7f1878138b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f187813b970 0x7f1878155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878139000 con 0x7f18780c39f0 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878152890 con 0x7f18780be810 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187e884700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878152b70 con 0x7f187813b970 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48880/0 (socket says 172.21.15.133:48880) 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 -- 172.21.15.133:0/3816142087 learned_addr learned my addr 172.21.15.133:0/3816142087 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f1877fff700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18780be810 0x7f1878138b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f187ce21700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f187813b970 0x7f1878155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 -- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f187813b970 msgr2=0x7f1878155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f187813b970 0x7f1878155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.798+0000 7f18777fe700 1 -- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18780be810 msgr2=0x7f1878138b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f18777fe700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18780be810 0x7f1878138b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f18777fe700 1 -- 172.21.15.133:0/3816142087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870009ae0 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f18777fe700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f186c00b460 tx=0x7f186c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c00be60 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c012410 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0127b0 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1878152e50 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.799+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878162a90 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.800+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878153370 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.800+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f186c012b60 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.800+0000 7f1874ff9700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 0x7f1864061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.800+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f186c07a1d0 con 0x7f18780c39f0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.801+0000 7f1877fff700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 0x7f1864061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.801+0000 7f1877fff700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 0x7f1864061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f18780c1c50 tx=0x7f1868008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:10.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:10.804+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1878153370 con 0x7f18780c39f0 2024-01-21T20:17:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.007+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1878153370 con 0x7f18780c39f0 2024-01-21T20:17:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.007+0000 7f1874ff9700 1 -- 172.21.15.133:0/3816142087 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f1878153370 con 0x7f18780c39f0 2024-01-21T20:17:10.997 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:10.997 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 msgr2=0x7f1864061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 0x7f1864061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f18780c1c50 tx=0x7f1868008040).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 msgr2=0x7f1878154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f186c00b460 tx=0x7f186c006f20).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 shutdown_connections 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f186405f150 0x7f1864061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f187813b970 0x7f1878155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18780be810 0x7f1878138b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 --2- 172.21.15.133:0/3816142087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18780c39f0 0x7f1878154e90 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 >> 172.21.15.133:0/3816142087 conn(0x7f1878066a70 msgr2=0x7f18780abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 shutdown_connections 2024-01-21T20:17:10.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.009+0000 7f187e884700 1 -- 172.21.15.133:0/3816142087 wait complete. 2024-01-21T20:17:11.000 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:17:11.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:17:02.495526+0000', 'modified': '2024-01-21T20:17:04.500837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7632}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7632': {'gid': 7632, 'name': 'c', 'rank': 0, 'incarnation': 41, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.133:6837/3997755903', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 3997755903}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3997755903}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:17:11.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:17:11.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-21T20:17:11.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.544+0000 7fa4f4910700 1 Processor -- start 2024-01-21T20:17:11.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.544+0000 7fa4f4910700 1 -- start start 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.545+0000 7fa4f4910700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4f013a830 0x7fa4f00c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.545+0000 7fa4f4910700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4f00695b0 0x7fa4f00699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.545+0000 7fa4f4910700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f00c3890 con 0x7fa4f013ac10 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.545+0000 7fa4f4910700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f00c3b70 con 0x7fa4f00695b0 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.545+0000 7fa4f4910700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f00c3e50 con 0x7fa4f013a830 2024-01-21T20:17:11.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4f00695b0 0x7fa4f00699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4f00695b0 0x7fa4f00699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48886/0 (socket says 172.21.15.133:48886) 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 -- 172.21.15.133:0/854517753 learned_addr learned my addr 172.21.15.133:0/854517753 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/854517753 >> v2:172.21.15.178:3300/0 conn(0x7fa4f013a830 0x7fa4f00c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 -- 172.21.15.133:0/854517753 >> v2:172.21.15.178:3300/0 conn(0x7fa4f013a830 msgr2=0x7fa4f00c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/854517753 >> v2:172.21.15.178:3300/0 conn(0x7fa4f013a830 0x7fa4f00c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 -- 172.21.15.133:0/854517753 >> v1:172.21.15.178:6789/0 conn(0x7fa4f013ac10 legacy=0x7fa4f00bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 -- 172.21.15.133:0/854517753 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f00c4130 con 0x7fa4f00695b0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/854517753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f00695b0 0x7fa4f00699c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fa4f0068230 tx=0x7fa4e8009840).ready entity=mon.0 client_cookie=e36e1c8c9673e189 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4ed59a700 1 -- 172.21.15.133:0/854517753 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800e070 con 0x7fa4f00695b0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4ed59a700 1 -- 172.21.15.133:0/854517753 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800ba10 con 0x7fa4f00695b0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.546+0000 7fa4ed59a700 1 -- 172.21.15.133:0/854517753 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800bd90 con 0x7fa4f00695b0 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 -- 172.21.15.133:0/854517753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f00695b0 msgr2=0x7fa4f00699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 --2- 172.21.15.133:0/854517753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f00695b0 0x7fa4f00699c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fa4f0068230 tx=0x7fa4e8009840).stop 2024-01-21T20:17:11.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 -- 172.21.15.133:0/854517753 shutdown_connections 2024-01-21T20:17:11.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 --2- 172.21.15.133:0/854517753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f00695b0 0x7fa4f00699c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 --2- 172.21.15.133:0/854517753 >> v2:172.21.15.178:3300/0 conn(0x7fa4f013a830 0x7fa4f00c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 -- 172.21.15.133:0/854517753 >> 172.21.15.133:0/854517753 conn(0x7fa4f00c7dc0 msgr2=0x7fa4f00c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 -- 172.21.15.133:0/854517753 shutdown_connections 2024-01-21T20:17:11.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.547+0000 7fa4f4910700 1 -- 172.21.15.133:0/854517753 wait complete. 2024-01-21T20:17:11.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.548+0000 7fa4f4910700 1 Processor -- start 2024-01-21T20:17:11.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.548+0000 7fa4f4910700 1 -- start start 2024-01-21T20:17:11.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4f00695b0 0x7fa4f00ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 0x7fa4f0136e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f0137360 con 0x7fa4f013ac10 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f01660f0 con 0x7fa4f00695b0 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4f4910700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f00ad9e0 con 0x7fa4f013a830 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48898/0 (socket says 172.21.15.133:48898) 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 -- 172.21.15.133:0/1214896305 learned_addr learned my addr 172.21.15.133:0/1214896305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4f00695b0 0x7fa4f00ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 0x7fa4f0136e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 -- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 msgr2=0x7fa4f0136e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 0x7fa4f0136e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 -- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4f00695b0 msgr2=0x7fa4f00ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4f00695b0 0x7fa4f00ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 -- 172.21.15.133:0/1214896305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009ae0 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 0x7fa4f0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.549+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fa4e8009930 tx=0x7fa4e8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.550+0000 7fa4e6ffd700 1 -- 172.21.15.133:0/1214896305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80092e0 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.550+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f01657c0 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.550+0000 7fa4e6ffd700 1 -- 172.21.15.133:0/1214896305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8007080 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.550+0000 7fa4e6ffd700 1 -- 172.21.15.133:0/1214896305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e801e6a0 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.550+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0165d80 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.551+0000 7fa4e6ffd700 1 -- 172.21.15.133:0/1214896305 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa4e8003040 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.551+0000 7fa4e6ffd700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 0x7fa4d00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.551+0000 7fa4e6ffd700 1 -- 172.21.15.133:0/1214896305 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa4e807b850 con 0x7fa4f013ac10 2024-01-21T20:17:11.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.551+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 0x7fa4d00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.552+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 0x7fa4d00615e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa4e000bbc0 tx=0x7fa4e0008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.553+0000 7fa5062b3b80 1 Processor -- start 2024-01-21T20:17:11.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.553+0000 7fa5062b3b80 1 -- start start 2024-01-21T20:17:11.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf41ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf3523d0 con 0x5556cf41f240 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf317be0 con 0x5556cf403550 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556cf32d260 con 0x5556cf403930 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48900/0 (socket says 172.21.15.133:48900) 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2251576697 learned_addr learned my addr 172.21.15.133:0/2251576697 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.554+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf41ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 msgr2=0x5556cf41ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf41ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 msgr2=0x5556cf3dd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2251576697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556cf3262f0 con 0x5556cf41f240 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa4e804cb30 tx=0x7fa4e800e000).ready entity=mon.0 client_cookie=a81bf3a8e5c6a37b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4cffff700 1 -- 172.21.15.133:0/2251576697 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8054070 con 0x5556cf41f240 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4cffff700 1 -- 172.21.15.133:0/2251576697 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80505d0 con 0x5556cf41f240 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa4cffff700 1 -- 172.21.15.133:0/2251576697 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e804cd40 con 0x5556cf41f240 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2251576697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 msgr2=0x5556cf41f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.555+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa4e804cb30 tx=0x7fa4e800e000).stop 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2251576697 shutdown_connections 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf41f6c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2251576697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf41ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2251576697 >> 172.21.15.133:0/2251576697 conn(0x5556cf2442e0 msgr2=0x5556cf424750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2251576697 shutdown_connections 2024-01-21T20:17:11.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2251576697 wait complete. 2024-01-21T20:17:11.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 -- start start 2024-01-21T20:17:11.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.556+0000 7fa5062b3b80 1 Processor -- start 2024-01-21T20:17:11.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf32d3a0 con 0x5556cf403930 2024-01-21T20:17:11.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf32d620 con 0x5556cf403550 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556cf2f8990 con 0x5556cf41f240 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa5062b3b80 10 client.0 ll_register_callbacks cb 0x5556cf39b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa4edd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa4edd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48902/0 (socket says 172.21.15.133:48902) 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa4edd9b700 1 -- 172.21.15.133:0/107120301 learned_addr learned my addr 172.21.15.133:0/107120301 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.557+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 -- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 msgr2=0x5556cf3db310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3db310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 -- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 msgr2=0x5556cf3fe7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3fe7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 -- 172.21.15.133:0/107120301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0165d80 con 0x5556cf403930 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa4f013b060 tx=0x7fa4d8007f90).ready entity=mon.0 client_cookie=a25b1c438dcfab7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:17:11.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8019070 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa4d8015470 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5556cf3d5df0 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d8011ed0 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 10 client.7788 fetch_fsmap learned FSMap version 43 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x5556cf321520 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556cf3d5df0 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa4d801c020 con 0x5556cf403930 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 10 client.7788 fetch_fsmap finished waiting for FSMap version 43 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 10 client.7788 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 20 client.7788 populate_metadata read hostname 'smithi133' 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf41c140 0x5556cf41c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 4 client.7788 mds_command: new command op to 7632 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 --> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5556cf322d60 con 0x5556cf41c140 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.558+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf41c140 0x5556cf41c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa4cd7fa700 10 client.7788 ms_handle_connect on v2:172.21.15.133:6835/3997755903 2024-01-21T20:17:11.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf41c140 0x5556cf41c520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d7a261556cc250e4 server_cookie=53fa495859e2d9d2 in_seq=0 out_seq=0 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/107120301 <== mds.0 v2:172.21.15.133:6835/3997755903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5556cf322d60 con 0x5556cf41c140 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa4cd7fa700 10 client.7788 handle_command_reply: tid=0 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa5062b3b80 1 client.7788 shutdown 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 msgr2=0x5556cf434ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.559+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa4f013b060 tx=0x7fa4d8007f90).stop 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 shutdown_connections 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf41c140 0x5556cf41c520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3fe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/107120301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf434ba0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa4cd7fa700 0 client.7788 ms_handle_reset on v2:172.21.15.133:6835/3997755903 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 >> 172.21.15.133:0/107120301 conn(0x5556cf2442e0 msgr2=0x5556cf3d7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 shutdown_connections 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 1 -- 172.21.15.133:0/107120301 wait complete. 2024-01-21T20:17:11.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.560+0000 7fa5062b3b80 20 client.7788 trim_cache size 0 max 16384 2024-01-21T20:17:11.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.576+0000 7fa5062b3b80 1 Processor -- start 2024-01-21T20:17:11.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.576+0000 7fa5062b3b80 1 -- start start 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf3dc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf3fed40 con 0x5556cf41f240 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf3dcd10 con 0x5556cf403550 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556cf408080 con 0x5556cf403930 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48914/0 (socket says 172.21.15.133:48914) 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2612744809 learned_addr learned my addr 172.21.15.133:0/2612744809 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf3dc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 msgr2=0x5556cf3dc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf3dc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 msgr2=0x5556cf3dc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 -- 172.21.15.133:0/2612744809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556cf321270 con 0x5556cf41f240 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.577+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fa4e8050330 tx=0x7fa4e8054000).ready entity=mon.0 client_cookie=7e76b41f4c7df992 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa4e4bcf700 1 -- 172.21.15.133:0/2612744809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800e070 con 0x5556cf41f240 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa4e4bcf700 1 -- 172.21.15.133:0/2612744809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e804fd30 con 0x5556cf41f240 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa4e4bcf700 1 -- 172.21.15.133:0/2612744809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e804cd40 con 0x5556cf41f240 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2612744809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 msgr2=0x5556cf409a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fa4e8050330 tx=0x7fa4e8054000).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2612744809 shutdown_connections 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf41f240 0x5556cf409a50 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf3dc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/2612744809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf403930 0x5556cf3dc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2612744809 >> 172.21.15.133:0/2612744809 conn(0x5556cf2442e0 msgr2=0x5556cf41c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2612744809 shutdown_connections 2024-01-21T20:17:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.578+0000 7fa5062b3b80 1 -- 172.21.15.133:0/2612744809 wait complete. 2024-01-21T20:17:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.579+0000 7fa5062b3b80 1 -- start start 2024-01-21T20:17:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.579+0000 7fa5062b3b80 1 Processor -- start 2024-01-21T20:17:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf489aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf489680 con 0x5556cf403930 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556cf424f90 con 0x5556cf403550 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556cf425100 con 0x5556cf41f240 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 10 client.0 ll_register_callbacks cb 0x5556cf39b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48926/0 (socket says 172.21.15.133:48926) 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 -- 172.21.15.133:0/3568671853 learned_addr learned my addr 172.21.15.133:0/3568671853 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf489aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4eed9d700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 -- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 msgr2=0x5556cf3dc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3dc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 -- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 msgr2=0x5556cf489aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf489aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 -- 172.21.15.133:0/3568671853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556cf3262f0 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf489aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4edd9b700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fa4d8003500 tx=0x7fa4d801f000).ready entity=mon.0 client_cookie=cf3571463e6cf544 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d802a070 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fa4d8000e40 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4e80505d0 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d8015d90 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 10 client.7794 fetch_fsmap learned FSMap version 43 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.580+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x5556cf19af80 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e80505d0 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 43) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa4d801c070 con 0x5556cf403930 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 10 client.7794 fetch_fsmap finished waiting for FSMap version 43 2024-01-21T20:17:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 10 client.7794 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 20 client.7794 populate_metadata read hostname 'smithi133' 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf3dc7d0 0x5556cf3ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 4 client.7794 mds_command: new command op to 7632 tid=0[{"prefix": "status"}] 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 --> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5556cf3197d0 con 0x5556cf3dc7d0 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.581+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf3dc7d0 0x5556cf3ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa4cd7fa700 10 client.7794 ms_handle_connect on v2:172.21.15.133:6835/3997755903 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa4ee59c700 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf3dc7d0 0x5556cf3ff600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=77e03908e401dacf server_cookie=3796b3f4afa72024 in_seq=0 out_seq=0 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa4cd7fa700 1 -- 172.21.15.133:0/3568671853 <== mds.0 v2:172.21.15.133:6835/3997755903 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5556cf3197d0 con 0x5556cf3dc7d0 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa4cd7fa700 10 client.7794 handle_command_reply: tid=0 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 client.7794 shutdown 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 msgr2=0x5556cf48c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fa4d8003500 tx=0x7fa4d801f000).stop 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 shutdown_connections 2024-01-21T20:17:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556cf41f240 0x5556cf3dc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:6835/3997755903,v1:172.21.15.133:6837/3997755903] conn(0x5556cf3dc7d0 0x5556cf3ff600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556cf403550 0x5556cf489aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa4cd7fa700 0 client.7794 ms_handle_reset on v2:172.21.15.133:6835/3997755903 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 --2- 172.21.15.133:0/3568671853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5556cf403930 0x5556cf48c6d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 >> 172.21.15.133:0/3568671853 conn(0x5556cf2442e0 msgr2=0x5556cf41c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 shutdown_connections 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 1 -- 172.21.15.133:0/3568671853 wait complete. 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.582+0000 7fa5062b3b80 20 client.7794 trim_cache size 0 max 16384 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:17:11.577 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 7632, 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.0855292559999992, 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 43, 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 124, 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 124, 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 19.514513990000001 2024-01-21T20:17:11.578 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 msgr2=0x7fa4d00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 0x7fa4d00615e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa4e000bbc0 tx=0x7fa4e0008040).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 msgr2=0x7fa4f00668b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fa4e8009930 tx=0x7fa4e8009840).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 shutdown_connections 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa4d005f120 0x7fa4d00615e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4f013ac10 0x7fa4f00668b0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4f00695b0 0x7fa4f00ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 --2- 172.21.15.133:0/1214896305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4f013a830 0x7fa4f0136e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 >> 172.21.15.133:0/1214896305 conn(0x7fa4f00c7dc0 msgr2=0x7fa4f00c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 shutdown_connections 2024-01-21T20:17:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.583+0000 7fa4f4910700 1 -- 172.21.15.133:0/1214896305 wait complete. 2024-01-21T20:17:11.584 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:17:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.698+0000 7f6fa4ae0700 1 Processor -- start 2024-01-21T20:17:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.698+0000 7f6fa4ae0700 1 -- start start 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6fa4ae0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fa0153e90 0x7f6fa0154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6fa4ae0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6fa4ae0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0155530 con 0x7f6fa00c5d00 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6fa4ae0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa0154920 con 0x7f6fa0153e90 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6fa4ae0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0154c00 con 0x7f6fa0063430 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9dd9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9e59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fa0153e90 0x7f6fa0154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9dd9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54280/0 (socket says 172.21.15.133:54280) 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9e59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fa0153e90 0x7f6fa0154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57204/0 (socket says 172.21.15.133:57204) 2024-01-21T20:17:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9dd9b700 1 -- 172.21.15.133:0/2157741464 learned_addr learned my addr 172.21.15.133:0/2157741464 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.699+0000 7f6f9ed9d700 1 --1- 172.21.15.133:0/2157741464 >> v1:172.21.15.178:6789/0 conn(0x7f6fa00c5d00 0x7f6fa00bde30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:56522/0 (socket says 172.21.15.133:56522) 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9e59c700 1 -- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 msgr2=0x7f6fa00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9e59c700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9e59c700 1 -- 172.21.15.133:0/2157741464 >> v1:172.21.15.178:6789/0 conn(0x7f6fa00c5d00 legacy=0x7f6fa00bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9e59c700 1 -- 172.21.15.133:0/2157741464 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0154ee0 con 0x7f6fa0153e90 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9dd9b700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9d59a700 1 -- 172.21.15.133:0/2157741464 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735566538 0 0) 0x7f6fa0155530 con 0x7f6fa00c5d00 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9e59c700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa0154270 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6f90009760 tx=0x7f6f90009060).ready entity=mon.1 client_cookie=385faeebc22c1158 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9d59a700 1 -- 172.21.15.133:0/2157741464 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000f510 con 0x7f6fa0153e90 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9d59a700 1 -- 172.21.15.133:0/2157741464 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000f670 con 0x7f6fa0153e90 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6f9d59a700 1 -- 172.21.15.133:0/2157741464 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000f9f0 con 0x7f6fa0153e90 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 msgr2=0x7f6fa0154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa0154270 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f6f90009760 tx=0x7f6f90009060).stop 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/2157741464 shutdown_connections 2024-01-21T20:17:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa0154270 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/2157741464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0063430 0x7f6fa00c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.700+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/2157741464 >> 172.21.15.133:0/2157741464 conn(0x7f6fa00c7cb0 msgr2=0x7f6fa00c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.701+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/2157741464 shutdown_connections 2024-01-21T20:17:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.701+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/2157741464 wait complete. 2024-01-21T20:17:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.702+0000 7f6fa4ae0700 1 Processor -- start 2024-01-21T20:17:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.702+0000 7f6fa4ae0700 1 -- start start 2024-01-21T20:17:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa00c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 0x7f6fa014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c1c10 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00be040 con 0x7f6fa0153e90 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0158320 con 0x7f6fa0157bb0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48928/0 (socket says 172.21.15.133:48928) 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 -- 172.21.15.133:0/3937327571 learned_addr learned my addr 172.21.15.133:0/3937327571 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9e59c700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa00c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9dd9b700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 0x7f6fa014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 -- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 msgr2=0x7f6fa014d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 0x7f6fa014d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 -- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 msgr2=0x7f6fa00c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa00c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 -- 172.21.15.133:0/3937327571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94009370 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9dd9b700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 0x7f6fa014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f9ed9d700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f6f9800c810 tx=0x7f6f98007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98005c70 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98005dd0 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f900092a0 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.703+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98007320 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.704+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01588e0 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.704+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa00475e0 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.705+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6f98007710 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.705+0000 7f6f8effd700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 0x7f6f80061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.705+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f6f9807a3e0 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.705+0000 7f6f9e59c700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 0x7f6f80061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:11.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.706+0000 7f6f9e59c700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 0x7f6f80061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6f90009fd0 tx=0x7f6f90017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:11.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.709+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6f9804b400 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.917+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6fa006ab50 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.917+0000 7f6f8effd700 1 -- 172.21.15.133:0/3937327571 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f9804ea20 con 0x7f6fa00bd6d0 2024-01-21T20:17:11.907 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:17:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 msgr2=0x7f6f80061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 0x7f6f80061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6f90009fd0 tx=0x7f6f90017000).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 msgr2=0x7f6fa00bdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f6f9800c810 tx=0x7f6f98007f60).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 shutdown_connections 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6f8005f150 0x7f6f80061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa00bd6d0 0x7f6fa00bdb50 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fa0153e90 0x7f6fa00c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 --2- 172.21.15.133:0/3937327571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fa0157bb0 0x7f6fa014d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 >> 172.21.15.133:0/3937327571 conn(0x7f6fa00c7cb0 msgr2=0x7f6fa00699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 shutdown_connections 2024-01-21T20:17:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:11.919+0000 7f6fa4ae0700 1 -- 172.21.15.133:0/3937327571 wait complete. 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:17:11.919 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:17:11.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:11.920 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:17:11.937 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41299sec preferred_lft 41299sec 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:17:11.938 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:17:11.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:11.940 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:17:12.002 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:17:12.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.004 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:17:12.062 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:17:12.062 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:17:12.062 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:17:12.062 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:17:12.062 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:17:12.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:17:12.063 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:17:12.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.168 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:17:12.185 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:17:12.185 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:17:12.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:17:12.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:17:12.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.252 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:17:12.309 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:17:12.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:17:12.391 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:17:12.391 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:17:12.412 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:17:12.412 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:17:12.414 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:17:12.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:17:12.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:17:12.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:17:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.648+0000 7fdf6de69700 1 Processor -- start 2024-01-21T20:17:12.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.648+0000 7fdf6de69700 1 -- start start 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf6de69700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf681546b0 0x7fdf68154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf6de69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 0x7fdf680bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf6de69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf680654f0 con 0x7fdf68065980 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf6de69700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf68063700 con 0x7fdf681546b0 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf6de69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf68063950 con 0x7fdf680a9e30 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf681546b0 0x7fdf68154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf681546b0 0x7fdf68154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48938/0 (socket says 172.21.15.133:48938) 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.649+0000 7fdf677fe700 1 -- 172.21.15.133:0/2161502225 learned_addr learned my addr 172.21.15.133:0/2161502225 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf66ffd700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 0x7fdf680bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf677fe700 1 -- 172.21.15.133:0/2161502225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 msgr2=0x7fdf680bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf677fe700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 0x7fdf680bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf677fe700 1 -- 172.21.15.133:0/2161502225 >> v1:172.21.15.178:6789/0 conn(0x7fdf68065980 legacy=0x7fdf68065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf677fe700 1 -- 172.21.15.133:0/2161502225 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf68065180 con 0x7fdf681546b0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf66ffd700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 0x7fdf680bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf677fe700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf681546b0 0x7fdf68154a90 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fdf5c006fd0 tx=0x7fdf5c0090f0).ready entity=mon.0 client_cookie=f07fbd6762dc7f3f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf667fc700 1 -- 172.21.15.133:0/2161502225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00b600 con 0x7fdf681546b0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf667fc700 1 -- 172.21.15.133:0/2161502225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00b760 con 0x7fdf681546b0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf667fc700 1 -- 172.21.15.133:0/2161502225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00bb00 con 0x7fdf681546b0 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf6de69700 1 -- 172.21.15.133:0/2161502225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf681546b0 msgr2=0x7fdf68154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf6de69700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf681546b0 0x7fdf68154a90 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fdf5c006fd0 tx=0x7fdf5c0090f0).stop 2024-01-21T20:17:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf6de69700 1 -- 172.21.15.133:0/2161502225 shutdown_connections 2024-01-21T20:17:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf6de69700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf681546b0 0x7fdf68154a90 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.650+0000 7fdf6de69700 1 --2- 172.21.15.133:0/2161502225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf680a9e30 0x7fdf680bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.651+0000 7fdf6de69700 1 -- 172.21.15.133:0/2161502225 >> 172.21.15.133:0/2161502225 conn(0x7fdf680c8200 msgr2=0x7fdf680c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.651+0000 7fdf6de69700 1 -- 172.21.15.133:0/2161502225 shutdown_connections 2024-01-21T20:17:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.651+0000 7fdf6de69700 1 -- 172.21.15.133:0/2161502225 wait complete. 2024-01-21T20:17:12.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.652+0000 7fdf6de69700 1 Processor -- start 2024-01-21T20:17:12.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.652+0000 7fdf6de69700 1 -- start start 2024-01-21T20:17:12.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf68065980 0x7fdf680c1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf681546b0 0x7fdf680bec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680aa720 con 0x7fdf680a9e30 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680aa970 con 0x7fdf68065980 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf680aac50 con 0x7fdf681546b0 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48946/0 (socket says 172.21.15.133:48946) 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 -- 172.21.15.133:0/1315922736 learned_addr learned my addr 172.21.15.133:0/1315922736 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf677fe700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf68065980 0x7fdf680c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf67fff700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf681546b0 0x7fdf680bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 -- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf681546b0 msgr2=0x7fdf680bec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf681546b0 0x7fdf680bec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 -- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf68065980 msgr2=0x7fdf680c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf68065980 0x7fdf680c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 -- 172.21.15.133:0/1315922736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009370 con 0x7fdf680a9e30 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf66ffd700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fdf5800d890 tx=0x7fdf58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011590 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf580116f0 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58011a70 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf680ac660 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.653+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf680bf150 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.654+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf680ac8a0 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.655+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdf58012420 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.655+0000 7fdf4ffff700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 0x7fdf54061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.655+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fdf58079d60 con 0x7fdf680a9e30 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.655+0000 7fdf677fe700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 0x7fdf54061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.655+0000 7fdf677fe700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 0x7fdf54061640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdf5c00b3c0 tx=0x7fdf5c017000).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.659+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdf680ac8a0 con 0x7fdf680a9e30 2024-01-21T20:17:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.848+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf680bf370 con 0x7fdf5405f180 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.850+0000 7fdf4ffff700 1 -- 172.21.15.133:0/1315922736 <== mgr.7446 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdf5c000bc0 con 0x7fdf5405f180 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:17:12.839 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 msgr2=0x7fdf54061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 0x7fdf54061640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fdf5c00b3c0 tx=0x7fdf5c017000).stop 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 msgr2=0x7fdf68168cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fdf5800d890 tx=0x7fdf58008040).stop 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 shutdown_connections 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf5405f180 0x7fdf54061640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf681546b0 0x7fdf680bec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf68065980 0x7fdf680c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 --2- 172.21.15.133:0/1315922736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf680a9e30 0x7fdf68168cc0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 >> 172.21.15.133:0/1315922736 conn(0x7fdf680c8200 msgr2=0x7fdf680bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 shutdown_connections 2024-01-21T20:17:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.852+0000 7fdf6de69700 1 -- 172.21.15.133:0/1315922736 wait complete. 2024-01-21T20:17:12.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:17:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.981+0000 7fcf7e27b700 1 Processor -- start 2024-01-21T20:17:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.981+0000 7fcf7e27b700 1 -- start start 2024-01-21T20:17:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf7e27b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf7813b970 0x7fcf780c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf7e27b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 0x7fcf780be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf7e27b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf780bfa40 con 0x7fcf780be5f0 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf7e27b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780c3e70 con 0x7fcf7813b970 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf7e27b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf780bee30 con 0x7fcf780c39f0 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf7813b970 0x7fcf780c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcf7813b970 0x7fcf780c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48960/0 (socket says 172.21.15.133:48960) 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 -- 172.21.15.133:0/79189425 learned_addr learned my addr 172.21.15.133:0/79189425 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf777fe700 1 --2- 172.21.15.133:0/79189425 >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 0x7fcf780be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 -- 172.21.15.133:0/79189425 >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 msgr2=0x7fcf780be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 --2- 172.21.15.133:0/79189425 >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 0x7fcf780be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 -- 172.21.15.133:0/79189425 >> v1:172.21.15.178:6789/0 conn(0x7fcf780be5f0 legacy=0x7fcf780c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 -- 172.21.15.133:0/79189425 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf780bf110 con 0x7fcf7813b970 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf777fe700 1 --2- 172.21.15.133:0/79189425 >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 0x7fcf780be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf77fff700 1 --2- 172.21.15.133:0/79189425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf7813b970 0x7fcf780c3500 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fcf780c8ed0 tx=0x7fcf680090f0).ready entity=mon.0 client_cookie=1d5bae75e6c72fe0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.982+0000 7fcf76ffd700 1 -- 172.21.15.133:0/79189425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800b600 con 0x7fcf7813b970 2024-01-21T20:17:12.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf76ffd700 1 -- 172.21.15.133:0/79189425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6800b760 con 0x7fcf7813b970 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf76ffd700 1 -- 172.21.15.133:0/79189425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800bb00 con 0x7fcf7813b970 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 -- 172.21.15.133:0/79189425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf7813b970 msgr2=0x7fcf780c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/79189425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf7813b970 0x7fcf780c3500 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7fcf780c8ed0 tx=0x7fcf680090f0).stop 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 -- 172.21.15.133:0/79189425 shutdown_connections 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/79189425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf7813b970 0x7fcf780c3500 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/79189425 >> v2:172.21.15.178:3300/0 conn(0x7fcf780c39f0 0x7fcf780be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 -- 172.21.15.133:0/79189425 >> 172.21.15.133:0/79189425 conn(0x7fcf78066a70 msgr2=0x7fcf78066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 -- 172.21.15.133:0/79189425 shutdown_connections 2024-01-21T20:17:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.983+0000 7fcf7e27b700 1 -- 172.21.15.133:0/79189425 wait complete. 2024-01-21T20:17:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.984+0000 7fcf7e27b700 1 Processor -- start 2024-01-21T20:17:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.984+0000 7fcf7e27b700 1 -- start start 2024-01-21T20:17:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf780c39f0 0x7fcf78151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7813b970 0x7fcf780a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780c1ef0 con 0x7fcf780be5f0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780c2980 con 0x7fcf7813b970 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf7e27b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf78162280 con 0x7fcf780c39f0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf77fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf77fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:48976/0 (socket says 172.21.15.133:48976) 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.985+0000 7fcf77fff700 1 -- 172.21.15.133:0/935253184 learned_addr learned my addr 172.21.15.133:0/935253184 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 -- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf780c39f0 msgr2=0x7fcf78151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf780c39f0 0x7fcf78151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 -- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7813b970 msgr2=0x7fcf780a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7813b970 0x7fcf780a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 -- 172.21.15.133:0/935253184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68009370 con 0x7fcf780be5f0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf77fff700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fcf68006fd0 tx=0x7fcf68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68002f70 con 0x7fcf780be5f0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf680069b0 con 0x7fcf780be5f0 2024-01-21T20:17:12.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780c20e0 con 0x7fcf780be5f0 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800bb00 con 0x7fcf780be5f0 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.986+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf780c26a0 con 0x7fcf780be5f0 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.987+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf78162050 con 0x7fcf780be5f0 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.987+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 48) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcf68021070 con 0x7fcf780be5f0 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.988+0000 7fcf74f74700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 0x7fcf58061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:12.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.988+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7fcf6807be60 con 0x7fcf780be5f0 2024-01-21T20:17:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.988+0000 7fcf777fe700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 0x7fcf58061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:12.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.988+0000 7fcf777fe700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 0x7fcf58061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcf60006d80 tx=0x7fcf60008040).ready entity=mgr.7446 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:12.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:12.992+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcf78162050 con 0x7fcf780be5f0 2024-01-21T20:17:13.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:13.200+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fcf78162050 con 0x7fcf780be5f0 2024-01-21T20:17:14.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.106+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fcf6807f030 con 0x7fcf780be5f0 2024-01-21T20:17:14.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.108+0000 7fcf74f74700 1 -- 172.21.15.133:0/935253184 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v49) v1 ==== 92+0+0 (secure 0 0 0) 0x7fcf680422e0 con 0x7fcf780be5f0 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 msgr2=0x7fcf58061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 0x7fcf58061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcf60006d80 tx=0x7fcf60008040).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 msgr2=0x7fcf780c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fcf68006fd0 tx=0x7fcf68017000).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 shutdown_connections 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcf5805f150 0x7fcf58061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7813b970 0x7fcf780a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcf780be5f0 0x7fcf780c1a00 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 --2- 172.21.15.133:0/935253184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf780c39f0 0x7fcf78151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 >> 172.21.15.133:0/935253184 conn(0x7fcf78066a70 msgr2=0x7fcf78153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 shutdown_connections 2024-01-21T20:17:14.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.110+0000 7fcf7e27b700 1 -- 172.21.15.133:0/935253184 wait complete. 2024-01-21T20:17:14.114 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:17:14.237 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:14.248+0000 7f9196db3680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:17:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.252+0000 7f29fe3b5700 1 Processor -- start 2024-01-21T20:17:14.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.252+0000 7f29fe3b5700 1 -- start start 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29fe3b5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29f8137030 0x7f29f8067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29fe3b5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29f8137410 0x7f29f8155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29fe3b5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f81557f0 con 0x7f29f80c5930 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29fe3b5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f8068370 con 0x7f29f8137410 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29fe3b5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f8068650 con 0x7f29f8137030 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29f8137410 0x7f29f8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29f8137410 0x7f29f8155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49010/0 (socket says 172.21.15.133:49010) 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29f77fe700 1 -- 172.21.15.133:0/591689348 learned_addr learned my addr 172.21.15.133:0/591689348 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.253+0000 7f29f7fff700 1 --2- 172.21.15.133:0/591689348 >> v2:172.21.15.178:3300/0 conn(0x7f29f8137030 0x7f29f8067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f77fe700 1 -- 172.21.15.133:0/591689348 >> v2:172.21.15.178:3300/0 conn(0x7f29f8137030 msgr2=0x7f29f8067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:14.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f77fe700 1 --2- 172.21.15.133:0/591689348 >> v2:172.21.15.178:3300/0 conn(0x7f29f8137030 0x7f29f8067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f77fe700 1 -- 172.21.15.133:0/591689348 >> v1:172.21.15.178:6789/0 conn(0x7f29f80c5930 legacy=0x7f29f80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f77fe700 1 -- 172.21.15.133:0/591689348 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8068930 con 0x7f29f8137410 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f6ffd700 1 -- 172.21.15.133:0/591689348 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126806561 0 0) 0x7f29f81557f0 con 0x7f29f80c5930 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f77fe700 1 --2- 172.21.15.133:0/591689348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137410 0x7f29f8155300 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f29f80c8e10 tx=0x7f29ec0090f0).ready entity=mon.0 client_cookie=2b04753c374846c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f6ffd700 1 -- 172.21.15.133:0/591689348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00b520 con 0x7f29f8137410 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f6ffd700 1 -- 172.21.15.133:0/591689348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec00b680 con 0x7f29f8137410 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29f6ffd700 1 -- 172.21.15.133:0/591689348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00ba20 con 0x7f29f8137410 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29fe3b5700 1 -- 172.21.15.133:0/591689348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137410 msgr2=0x7f29f8155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.254+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/591689348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137410 0x7f29f8155300 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f29f80c8e10 tx=0x7f29ec0090f0).stop 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 -- 172.21.15.133:0/591689348 shutdown_connections 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/591689348 >> v2:172.21.15.178:3300/0 conn(0x7f29f8137030 0x7f29f8067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/591689348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137410 0x7f29f8155300 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 -- 172.21.15.133:0/591689348 >> 172.21.15.133:0/591689348 conn(0x7f29f8066a90 msgr2=0x7f29f8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:14.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 -- 172.21.15.133:0/591689348 shutdown_connections 2024-01-21T20:17:14.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.255+0000 7f29fe3b5700 1 -- 172.21.15.133:0/591689348 wait complete. 2024-01-21T20:17:14.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.256+0000 7f29fe3b5700 1 Processor -- start 2024-01-21T20:17:14.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.256+0000 7f29fe3b5700 1 -- start start 2024-01-21T20:17:14.246 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:14.256+0000 7f90b0bd2680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f80c5930 0x7f29f81349c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f8137410 0x7f29f813b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f813be40 con 0x7f29f8137030 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c0040 con 0x7f29f8137410 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fe3b5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c02b0 con 0x7f29f80c5930 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49022/0 (socket says 172.21.15.133:49022) 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 -- 172.21.15.133:0/1839179374 learned_addr learned my addr 172.21.15.133:0/1839179374 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f7fff700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f80c5930 0x7f29f81349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29fc952700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f8137410 0x7f29f813b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 -- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f80c5930 msgr2=0x7f29f81349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f80c5930 0x7f29f81349c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 -- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f8137410 msgr2=0x7f29f813b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f8137410 0x7f29f813b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 -- 172.21.15.133:0/1839179374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009370 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f77fe700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f29ec006fd0 tx=0x7f29ec017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.257+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec006d90 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.258+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec000bc0 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.258+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec00ba20 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.258+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80c0590 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.258+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80c0b50 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80c6630 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f29ec01c630 con 0x7f29f8137030 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29f4ff9700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 0x7f29e4061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29f7fff700 1 -- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 msgr2=0x7f29e4061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:14.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f29ec07be90 con 0x7f29f8137030 2024-01-21T20:17:14.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.259+0000 7f29f7fff700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 0x7f29e4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:17:14.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.264+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f29ec04cf10 con 0x7f29f8137030 2024-01-21T20:17:14.301 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:14.312+0000 7f9196db3680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:17:14.311 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:14.322+0000 7f90b0bd2680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:17:14.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.435+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f29f80c0d70 con 0x7f29f8137030 2024-01-21T20:17:14.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.439+0000 7f29f4ff9700 1 -- 172.21.15.133:0/1839179374 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f29ec02a030 con 0x7f29f8137030 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 msgr2=0x7f29e4061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 0x7f29e4061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 msgr2=0x7f29f813b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f29ec006fd0 tx=0x7f29ec017000).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 shutdown_connections 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f29e405f1a0 0x7f29e4061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f8137410 0x7f29f813b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f80c5930 0x7f29f81349c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 --2- 172.21.15.133:0/1839179374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29f8137030 0x7f29f813b460 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 >> 172.21.15.133:0/1839179374 conn(0x7f29f8066a90 msgr2=0x7f29f80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 shutdown_connections 2024-01-21T20:17:14.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.441+0000 7f29fe3b5700 1 -- 172.21.15.133:0/1839179374 wait complete. 2024-01-21T20:17:14.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:14.443 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T20:17:14.464 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2024-01-21T20:17:14.575 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:14.586+0000 7f9196db3680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:17:14.604 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:14.615+0000 7f90b0bd2680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:17:14.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.640+0000 7f3af29e2700 1 Processor -- start 2024-01-21T20:17:14.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.640+0000 7f3af29e2700 1 -- start start 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af29e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec138030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af29e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3aec0c3250 0x7f3aec0c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af29e2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec065cc0 con 0x7f3aec137750 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af29e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec0c4620 con 0x7f3aec0c3250 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af29e2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0c4060 con 0x7f3aec0be3f0 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af0f7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3aec0c3250 0x7f3aec0c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af0f7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3aec0c3250 0x7f3aec0c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49028/0 (socket says 172.21.15.133:49028) 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3af0f7f700 1 -- 172.21.15.133:0/3768583513 learned_addr learned my addr 172.21.15.133:0/3768583513 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:14.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.641+0000 7f3ae3fff700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3af0f7f700 1 -- 172.21.15.133:0/3768583513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 msgr2=0x7f3aec138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3af0f7f700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3af0f7f700 1 -- 172.21.15.133:0/3768583513 >> v1:172.21.15.178:6789/0 conn(0x7f3aec137750 legacy=0x7f3aec0bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3af0f7f700 1 -- 172.21.15.133:0/3768583513 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0c4340 con 0x7f3aec0c3250 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3af0f7f700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec0c36e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f3ae4009f20 tx=0x7f3ae4009840).ready entity=mon.0 client_cookie=2af83e01737d604f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3aeb7fe700 1 -- 172.21.15.133:0/3768583513 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400e070 con 0x7f3aec0c3250 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3aeb7fe700 1 -- 172.21.15.133:0/3768583513 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400b9d0 con 0x7f3aec0c3250 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.642+0000 7f3aeb7fe700 1 -- 172.21.15.133:0/3768583513 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400bd50 con 0x7f3aec0c3250 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 -- 172.21.15.133:0/3768583513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 msgr2=0x7f3aec0c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec0c36e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7f3ae4009f20 tx=0x7f3ae4009840).stop 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 -- 172.21.15.133:0/3768583513 shutdown_connections 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec0c36e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 --2- 172.21.15.133:0/3768583513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 -- 172.21.15.133:0/3768583513 >> 172.21.15.133:0/3768583513 conn(0x7f3aec0c7cd0 msgr2=0x7f3aec0c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:14.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 -- 172.21.15.133:0/3768583513 shutdown_connections 2024-01-21T20:17:14.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.643+0000 7f3af29e2700 1 -- 172.21.15.133:0/3768583513 wait complete. 2024-01-21T20:17:14.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.644+0000 7f3af29e2700 1 Processor -- start 2024-01-21T20:17:14.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.644+0000 7f3af29e2700 1 -- start start 2024-01-21T20:17:14.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aec137750 0x7f3aec0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec14e0f0 con 0x7f3aec0c3250 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec164f00 con 0x7f3aec137750 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec1651e0 con 0x7f3aec0be3f0 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49032/0 (socket says 172.21.15.133:49032) 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af0f7f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aec137750 0x7f3aec0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3aebfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 -- 172.21.15.133:0/531709754 learned_addr learned my addr 172.21.15.133:0/531709754 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 msgr2=0x7f3aec167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aec137750 msgr2=0x7f3aec0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aec137750 0x7f3aec0626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:14.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009ae0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae3fff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f3ad400e8d0 tx=0x7f3ad4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4009390 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad4012600 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec1654c0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.645+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4012980 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.646+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec167bf0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec14e2a0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 49) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f3ad4012cf0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3ae97fa700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3aebfff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f3ad407a6d0 con 0x7f3aec0c3250 2024-01-21T20:17:14.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.647+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:17:14.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.651+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3aec14e2a0 con 0x7f3aec0c3250 2024-01-21T20:17:14.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.848+0000 7f3aebfff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:14.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.848+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:17:14.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:14.848+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3aec14e2a0 con 0x7f3acc05f1a0 2024-01-21T20:17:15.189 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:15.199+0000 7f9196db3680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:17:15.229 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:15.240+0000 7f90b0bd2680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:17:15.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:15.249+0000 7f3aebfff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:15.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:15.249+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:17:15.260 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:15.271+0000 7f9196db3680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:17:15.301 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:15.312+0000 7f90b0bd2680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:17:15.448 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:15.458+0000 7f9196db3680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:17:15.488 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:15.498+0000 7f90b0bd2680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:17:15.867 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:15.878+0000 7f9196db3680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:17:15.913 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:15.923+0000 7f90b0bd2680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:17:15.970 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:15.981+0000 7f9196db3680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:17:16.016 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.026+0000 7f90b0bd2680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:17:16.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:16.049+0000 7f3aebfff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:16.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:16.049+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:17:16.123 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:16.134+0000 7f9196db3680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:17:16.170 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.180+0000 7f90b0bd2680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:17:16.198 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:16.209+0000 7f9196db3680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:17:16.244 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.255+0000 7f90b0bd2680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:17:16.265 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:16.276+0000 7f9196db3680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:17:16.312 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.322+0000 7f90b0bd2680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:17:16.521 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:16.531+0000 7f9196db3680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:17:16.566 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.576+0000 7f90b0bd2680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:17:16.703 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:16.714+0000 7f9196db3680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:17:16.751 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:16.762+0000 7f90b0bd2680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:17:17.353 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.363+0000 7f9196db3680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:17:17.408 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.418+0000 7f90b0bd2680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:17:17.421 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.432+0000 7f9196db3680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:17:17.478 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.488+0000 7f90b0bd2680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:17:17.496 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.507+0000 7f9196db3680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:17:17.554 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.564+0000 7f90b0bd2680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:17:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:17.650+0000 7f3aebfff700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:17:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:17.650+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:17:17.645 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.655+0000 7f9196db3680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:17:17.701 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.711+0000 7f90b0bd2680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:17:17.715 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.726+0000 7f9196db3680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:17:17.773 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.783+0000 7f90b0bd2680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:17:17.830 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.841+0000 7f9196db3680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:17:17.888 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:17.898+0000 7f90b0bd2680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:17:17.938 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:17.949+0000 7f9196db3680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:17:17.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:17:17.982 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:17:17.997 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.007+0000 7f90b0bd2680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:17:18.236 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:18.246+0000 7f9196db3680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:17:18.296 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.306+0000 7f90b0bd2680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:17:18.307 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:17:18.318+0000 7f9196db3680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:17:18.368 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.378+0000 7f90b0bd2680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:17:18.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:18.386+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 50) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f3ad4078250 con 0x7f3aec0c3250 2024-01-21T20:17:18.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:18.397+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 51) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f3ad40785d0 con 0x7f3aec0c3250 2024-01-21T20:17:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:18.398+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:17:18.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:18.398+0000 7f3ae97fa700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:17:18.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9024972700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9024972700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9024972700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9024972700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9024972700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.453 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9027978700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.453 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9027978700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.453 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9027978700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.453 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9027978700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:18.454 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:17:18.462+0000 7f9027978700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:17:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.401+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mon.0 v2:172.21.15.133:3300/0 9 ==== mgrmap(e 52) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f3ad40472e0 con 0x7f3aec0c3250 2024-01-21T20:17:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.401+0000 7f3ae97fa700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.401+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3aec14e2a0 con 0x7f3acc05f1a0 2024-01-21T20:17:19.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.402+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.404+0000 7f3aebfff700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc0615e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3adc0014e0 tx=0x7f3adc000bc0).ready entity=mgr.7821 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:19.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.421+0000 7f3ae97fa700 1 -- 172.21.15.133:0/531709754 <== mgr.7821 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3aec14e2a0 con 0x7f3acc05f1a0 2024-01-21T20:17:19.411 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 msgr2=0x7f3acc0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc0615e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f3adc0014e0 tx=0x7f3adc000bc0).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 msgr2=0x7f3aec14fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f3ad400e8d0 tx=0x7f3ad4009060).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 shutdown_connections 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f1a0 0x7f3acc0615e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aec137750 0x7f3aec0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aec0be3f0 0x7f3aec167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 --2- 172.21.15.133:0/531709754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3aec0c3250 0x7f3aec14fc30 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 >> 172.21.15.133:0/531709754 conn(0x7f3aec0c7cd0 msgr2=0x7f3aec156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 shutdown_connections 2024-01-21T20:17:19.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.423+0000 7f3af29e2700 1 -- 172.21.15.133:0/531709754 wait complete. 2024-01-21T20:17:19.428 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T20:17:19.428 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2024-01-21-20_18_00 in ~41s... 2024-01-21T20:17:19.428 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2024-01-21T20:17:19.428 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2024-01-21T20:17:19.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.564+0000 7f09abaf6700 1 Processor -- start 2024-01-21T20:17:19.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.564+0000 7f09abaf6700 1 -- start start 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4150de0 0x7f09a41511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a40bd130 0x7f09a40c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 0x7f09a40699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a4069eb0 con 0x7f09a40bd130 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a40be2b0 con 0x7f09a4069510 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09abaf6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40be740 con 0x7f09a4150de0 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a40bd130 0x7f09a40c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a40bd130 0x7f09a40c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49112/0 (socket says 172.21.15.133:49112) 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 -- 172.21.15.133:0/2983261395 learned_addr learned my addr 172.21.15.133:0/2983261395 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9892700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4150de0 0x7f09a41511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09aa093700 1 --2- 172.21.15.133:0/2983261395 >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 0x7f09a40699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 -- 172.21.15.133:0/2983261395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4150de0 msgr2=0x7f09a41511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:19.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4150de0 0x7f09a41511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 -- 172.21.15.133:0/2983261395 >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 msgr2=0x7f09a40699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 --2- 172.21.15.133:0/2983261395 >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 0x7f09a40699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 -- 172.21.15.133:0/2983261395 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a40bd6a0 con 0x7f09a40bd130 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09aa093700 1 --2- 172.21.15.133:0/2983261395 >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 0x7f09a40699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a9091700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a40bd130 0x7f09a40c3f70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f09a4068d40 tx=0x7f09940090f0).ready entity=mon.0 client_cookie=c093971c3100581e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a8890700 1 -- 172.21.15.133:0/2983261395 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400b520 con 0x7f09a40bd130 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a8890700 1 -- 172.21.15.133:0/2983261395 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099400b680 con 0x7f09a40bd130 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.565+0000 7f09a8890700 1 -- 172.21.15.133:0/2983261395 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099400ba00 con 0x7f09a40bd130 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 -- 172.21.15.133:0/2983261395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a40bd130 msgr2=0x7f09a40c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a40bd130 0x7f09a40c3f70 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f09a4068d40 tx=0x7f09940090f0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 -- 172.21.15.133:0/2983261395 shutdown_connections 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2983261395 >> v2:172.21.15.178:3300/0 conn(0x7f09a4069510 0x7f09a40699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4150de0 0x7f09a41511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2983261395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a40bd130 0x7f09a40c3f70 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 -- 172.21.15.133:0/2983261395 >> 172.21.15.133:0/2983261395 conn(0x7f09a40c7d30 msgr2=0x7f09a40c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:19.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 -- 172.21.15.133:0/2983261395 shutdown_connections 2024-01-21T20:17:19.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.566+0000 7f09abaf6700 1 -- 172.21.15.133:0/2983261395 wait complete. 2024-01-21T20:17:19.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.568+0000 7f09abaf6700 1 Processor -- start 2024-01-21T20:17:19.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.568+0000 7f09abaf6700 1 -- start start 2024-01-21T20:17:19.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4069510 0x7f09a40c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a40bd130 0x7f09a4142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a41658f0 con 0x7f09a4150de0 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c1240 con 0x7f09a40bd130 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a40c0910 con 0x7f09a4069510 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49126/0 (socket says 172.21.15.133:49126) 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 -- 172.21.15.133:0/2682895881 learned_addr learned my addr 172.21.15.133:0/2682895881 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09a9892700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4069510 0x7f09a40c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09a9091700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a40bd130 0x7f09a4142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 -- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4069510 msgr2=0x7f09a40c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4069510 0x7f09a40c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 -- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a40bd130 msgr2=0x7f09a4142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a40bd130 0x7f09a4142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 -- 172.21.15.133:0/2682895881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994009370 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09aa093700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f099c009fc0 tx=0x7f099c0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00dbe0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099c00f040 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a40c0bf0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c0133f0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.569+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a40c1bc0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.570+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a40c13b0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.571+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 52) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f099c0137e0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.571+0000 7f099a7fc700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 0x7f0988061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.571+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f099c07a8b0 con 0x7f09a4150de0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.571+0000 7f09a9892700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 0x7f0988061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:17:19.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.571+0000 7f09a9892700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 0x7f0988061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f09a0009b90 tx=0x7f09a0009060).ready entity=mgr.7821 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:17:19.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.575+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f099c04ba60 con 0x7f09a4150de0 2024-01-21T20:17:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.760+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09a40bd980 con 0x7f098805f080 2024-01-21T20:17:19.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.762+0000 7f099a7fc700 1 -- 172.21.15.133:0/2682895881 <== mgr.7821 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f09a40bd980 con 0x7f098805f080 2024-01-21T20:17:19.752 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:17:19.752 INFO:teuthology.orchestra.run.smithi133.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2024-01-21T20:17:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 msgr2=0x7f0988061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 0x7f0988061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f09a0009b90 tx=0x7f09a0009060).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 msgr2=0x7f09a4153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f099c009fc0 tx=0x7f099c0099b0).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 shutdown_connections 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f098805f080 0x7f0988061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a4150de0 0x7f09a4153810 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09a4069510 0x7f09a40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 --2- 172.21.15.133:0/2682895881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09a40bd130 0x7f09a4142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 >> 172.21.15.133:0/2682895881 conn(0x7f09a40c7d30 msgr2=0x7f09a40c3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 shutdown_connections 2024-01-21T20:17:19.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:17:19.764+0000 7f09abaf6700 1 -- 172.21.15.133:0/2682895881 wait complete. 2024-01-21T20:17:19.766 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2024-01-21T20:17:19.766 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2024-01-21T20:17:19.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:19.767 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:20.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:20.785 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:21.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:21.808 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:22.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:22.831 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:23.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:23.854 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:24.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:24.877 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:25.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:25.901 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:26.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:26.926 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:27.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:27.949 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:28.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:28.973 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:29.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:29.996 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:31.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:31.019 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:32.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:32.043 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:33.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:33.067 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:34.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:34.091 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:35.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:35.115 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:36.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:36.138 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:37.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:37.161 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:38.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:38.184 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:39.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:39.207 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:40.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:40.230 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:41.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:41.252 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:42.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:42.275 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:43.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:43.298 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:44.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:44.321 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:45.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:45.343 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:46.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:46.366 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:47.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:47.388 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:48.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:17:48.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:17:48.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:48.410 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:49.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:49.432 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:50.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:50.455 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:51.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:51.478 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:52.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:52.501 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:53.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:53.523 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:54.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:54.546 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:55.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:55.570 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:56.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:56.592 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:57.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:57.615 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:58.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:58.638 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:17:59.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:17:59.661 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:18:00.416 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:00.426+0000 7f9017157700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:00.416 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:00.427+0000 7f9017157700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:00.416 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:00.427+0000 7f9017157700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:00.416 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:00.427+0000 7f9017157700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:00.416 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:00.427+0000 7f9017157700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:00.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:00.683 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:18:00.704 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_18_00_UTC 2024-01-21T20:18:00.705 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2024-01-21-20_18_00_UTC'] 2024-01-21T20:18:00.705 DEBUG:tasks.cephfs.test_snap_schedules:exec=1705868239.4286418, now = 1705868280.7057264, timo = 41 2024-01-21T20:18:01.706 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2024-01-21T20:18:01.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.849+0000 7f386d846700 1 Processor -- start 2024-01-21T20:18:01.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.849+0000 7f386d846700 1 -- start start 2024-01-21T20:18:01.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f386d846700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f386814e8d0 0x7f386805e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f386d846700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38680c0a70 0x7f38680c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f386d846700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38680c9040 con 0x7f386814ecb0 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f386d846700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680c13e0 con 0x7f38680c0a70 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f386d846700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680c9290 con 0x7f386814e8d0 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f38677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38680c0a70 0x7f38680c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f38677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38680c0a70 0x7f38680c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44502/0 (socket says 172.21.15.133:44502) 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f38677fe700 1 -- 172.21.15.133:0/1142127308 learned_addr learned my addr 172.21.15.133:0/1142127308 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f3866ffd700 1 --2- 172.21.15.133:0/1142127308 >> v2:172.21.15.178:3300/0 conn(0x7f386814e8d0 0x7f386805e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f38677fe700 1 -- 172.21.15.133:0/1142127308 >> v2:172.21.15.178:3300/0 conn(0x7f386814e8d0 msgr2=0x7f386805e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.850+0000 7f38677fe700 1 --2- 172.21.15.133:0/1142127308 >> v2:172.21.15.178:3300/0 conn(0x7f386814e8d0 0x7f386805e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f38677fe700 1 -- 172.21.15.133:0/1142127308 >> v1:172.21.15.178:6789/0 conn(0x7f386814ecb0 legacy=0x7f3868155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f38677fe700 1 -- 172.21.15.133:0/1142127308 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38680c9570 con 0x7f38680c0a70 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f38677fe700 1 --2- 172.21.15.133:0/1142127308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680c0ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f38680656c0 tx=0x7f3860009840).ready entity=mon.0 client_cookie=d291e66287146874 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f3865ffb700 1 -- 172.21.15.133:0/1142127308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386000e070 con 0x7f38680c0a70 2024-01-21T20:18:01.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f3865ffb700 1 -- 172.21.15.133:0/1142127308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386000ba10 con 0x7f38680c0a70 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f3865ffb700 1 -- 172.21.15.133:0/1142127308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386000bd90 con 0x7f38680c0a70 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 -- 172.21.15.133:0/1142127308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 msgr2=0x7f38680c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 --2- 172.21.15.133:0/1142127308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680c0ef0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f38680656c0 tx=0x7f3860009840).stop 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 -- 172.21.15.133:0/1142127308 shutdown_connections 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 --2- 172.21.15.133:0/1142127308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680c0ef0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 --2- 172.21.15.133:0/1142127308 >> v2:172.21.15.178:3300/0 conn(0x7f386814e8d0 0x7f386805e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 -- 172.21.15.133:0/1142127308 >> 172.21.15.133:0/1142127308 conn(0x7f3868084eb0 msgr2=0x7f38680947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 -- 172.21.15.133:0/1142127308 shutdown_connections 2024-01-21T20:18:01.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.851+0000 7f386d846700 1 -- 172.21.15.133:0/1142127308 wait complete. 2024-01-21T20:18:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.853+0000 7f386d846700 1 Processor -- start 2024-01-21T20:18:01.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.853+0000 7f386d846700 1 -- start start 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f386814e8d0 0x7f386814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386814ecb0 0x7f38680c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680adc80 con 0x7f38680c0a70 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38680aeec0 con 0x7f386814ecb0 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f386d846700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680ad6c0 con 0x7f386814e8d0 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f3866ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f3866ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44512/0 (socket says 172.21.15.133:44512) 2024-01-21T20:18:01.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f3866ffd700 1 -- 172.21.15.133:0/558020834 learned_addr learned my addr 172.21.15.133:0/558020834 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f38677fe700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386814ecb0 0x7f38680c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.854+0000 7f38667fc700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f386814e8d0 0x7f386814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 -- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f386814e8d0 msgr2=0x7f386814dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f386814e8d0 0x7f386814dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 -- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386814ecb0 msgr2=0x7f38680c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386814ecb0 0x7f38680c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 -- 172.21.15.133:0/558020834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860009ae0 con 0x7f38680c0a70 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f3866ffd700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f385c00d890 tx=0x7f385c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c011590 con 0x7f38680c0a70 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c0116f0 con 0x7f38680c0a70 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c011a70 con 0x7f38680c0a70 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38680ad9a0 con 0x7f38680c0a70 2024-01-21T20:18:01.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.855+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386814e0e0 con 0x7f38680c0a70 2024-01-21T20:18:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.856+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 54) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f385c01c460 con 0x7f38680c0a70 2024-01-21T20:18:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.856+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386805fdf0 con 0x7f38680c0a70 2024-01-21T20:18:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.857+0000 7f384f7fe700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 0x7f38540618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.857+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f385c07a5c0 con 0x7f38680c0a70 2024-01-21T20:18:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.857+0000 7f38667fc700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 0x7f38540618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.857+0000 7f38667fc700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 0x7f38540618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3868098d80 tx=0x7f3858006e80).ready entity=mgr.7821 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:01.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:01.861+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f385c04b240 con 0x7f38680c0a70 2024-01-21T20:18:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.046+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3868084c50 con 0x7f385405f3e0 2024-01-21T20:18:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.050+0000 7f384f7fe700 1 -- 172.21.15.133:0/558020834 <== mgr.7821 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3868084c50 con 0x7f385405f3e0 2024-01-21T20:18:02.039 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path snap_test_dir1 2024-01-21T20:18:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 msgr2=0x7f38540618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 0x7f38540618a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3868098d80 tx=0x7f3858006e80).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 msgr2=0x7f38680ae4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f385c00d890 tx=0x7f385c008040).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 shutdown_connections 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f385405f3e0 0x7f38540618a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f386814ecb0 0x7f38680c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38680c0a70 0x7f38680ae4a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 --2- 172.21.15.133:0/558020834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f386814e8d0 0x7f386814dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 >> 172.21.15.133:0/558020834 conn(0x7f3868084eb0 msgr2=0x7f38680c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 shutdown_connections 2024-01-21T20:18:02.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.052+0000 7f386d846700 1 -- 172.21.15.133:0/558020834 wait complete. 2024-01-21T20:18:02.053 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-01-21T20:18:02.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:02.053 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T20:18:02.070 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_18_00_UTC 2024-01-21T20:18:02.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_18_00_UTC 2024-01-21T20:18:02.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:02.070 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_18_00_UTC) 2024-01-21T20:18:02.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:02.132 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T20:18:02.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T20:18:02.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 Processor -- start 2024-01-21T20:18:02.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 -- start start 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ea8154370 0x7f5ea8065410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ea8154750 0x7f5ea8095e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea8096360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80c5340 con 0x7f5ea8154370 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea8096850 con 0x7f5ea8154750 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.361+0000 7f5ead08f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80bf070 con 0x7f5ea8064560 2024-01-21T20:18:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ea8154370 0x7f5ea8065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5ea8154370 0x7f5ea8065410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44514/0 (socket says 172.21.15.133:44514) 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 -- 172.21.15.133:0/1556313268 learned_addr learned my addr 172.21.15.133:0/1556313268 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea759e700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea8096360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea659c700 1 --2- 172.21.15.133:0/1556313268 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8154750 0x7f5ea8095e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 -- 172.21.15.133:0/1556313268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 msgr2=0x7f5ea8096360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea8096360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 -- 172.21.15.133:0/1556313268 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8154750 msgr2=0x7f5ea8095e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/1556313268 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8154750 0x7f5ea8095e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 -- 172.21.15.133:0/1556313268 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80be180 con 0x7f5ea8154370 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8065410 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f5ea80687e0 tx=0x7f5e980090f0).ready entity=mon.0 client_cookie=f1a2867703cd8d64 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea5d9b700 1 -- 172.21.15.133:0/1556313268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800b600 con 0x7f5ea8154370 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea5d9b700 1 -- 172.21.15.133:0/1556313268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9800b760 con 0x7f5ea8154370 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.362+0000 7f5ea5d9b700 1 -- 172.21.15.133:0/1556313268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9800bb00 con 0x7f5ea8154370 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 -- 172.21.15.133:0/1556313268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 msgr2=0x7f5ea8065410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8065410 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f5ea80687e0 tx=0x7f5e980090f0).stop 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 -- 172.21.15.133:0/1556313268 shutdown_connections 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea8096360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 --2- 172.21.15.133:0/1556313268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8065410 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 --2- 172.21.15.133:0/1556313268 >> v2:172.21.15.178:3300/0 conn(0x7f5ea8154750 0x7f5ea8095e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 -- 172.21.15.133:0/1556313268 >> 172.21.15.133:0/1556313268 conn(0x7f5ea805ec60 msgr2=0x7f5ea80c8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 -- 172.21.15.133:0/1556313268 shutdown_connections 2024-01-21T20:18:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.363+0000 7f5ead08f700 1 -- 172.21.15.133:0/1556313268 wait complete. 2024-01-21T20:18:02.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.364+0000 7f5ead08f700 1 Processor -- start 2024-01-21T20:18:02.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.364+0000 7f5ead08f700 1 -- start start 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea80a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 0x7f5ea81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80acfa0 con 0x7f5ea8154370 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80a8ab0 con 0x7f5ea8154750 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ead08f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80a8d90 con 0x7f5ea8064560 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44530/0 (socket says 172.21.15.133:44530) 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea659c700 1 -- 172.21.15.133:0/2896432287 learned_addr learned my addr 172.21.15.133:0/2896432287 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea80a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea759e700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 0x7f5ea81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.365+0000 7f5ea659c700 1 -- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 msgr2=0x7f5ea80a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea659c700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea80a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea659c700 1 -- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 msgr2=0x7f5ea81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea659c700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 0x7f5ea81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:02.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea659c700 1 -- 172.21.15.133:0/2896432287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98009370 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea80a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea759e700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 0x7f5ea81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ea659c700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f5e9c006980 tx=0x7f5e9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0125f0 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c012750 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c012ad0 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea80acc30 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.366+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea8151240 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.367+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea805fdf0 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.367+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 54) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f5e9c013480 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.367+0000 7f5e8f7fe700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 0x7f5e940618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.368+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f5e9c07a5f0 con 0x7f5ea8154370 2024-01-21T20:18:02.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.368+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 0x7f5e940618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:02.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.368+0000 7f5ea6d9d700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 0x7f5e940618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5e9800b3c0 tx=0x7f5e98017000).ready entity=mgr.7821 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:02.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.372+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5e9c04b270 con 0x7f5ea8154370 2024-01-21T20:18:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:02.582+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5ea8063750 con 0x7f5ea8154370 2024-01-21T20:18:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.172+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f5e9c077dd0 con 0x7f5ea8154370 2024-01-21T20:18:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.174+0000 7f5e8f7fe700 1 -- 172.21.15.133:0/2896432287 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v55) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5e9c0720b0 con 0x7f5ea8154370 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 msgr2=0x7f5e940618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 0x7f5e940618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5e9800b3c0 tx=0x7f5e98017000).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 msgr2=0x7f5ea8150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f5e9c006980 tx=0x7f5e9c008040).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 shutdown_connections 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e9405f3e0 0x7f5e940618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ea8154750 0x7f5ea81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ea8064560 0x7f5ea80a9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 --2- 172.21.15.133:0/2896432287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ea8154370 0x7f5ea8150d50 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 >> 172.21.15.133:0/2896432287 conn(0x7f5ea805ec60 msgr2=0x7f5ea80c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 shutdown_connections 2024-01-21T20:18:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.176+0000 7f5ead08f700 1 -- 172.21.15.133:0/2896432287 wait complete. 2024-01-21T20:18:03.180 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:18:03.181 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:18:03.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:18:03.274 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:18:03.275 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T20:18:03.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:03.275 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T20:18:03.310 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:03.321+0000 7f6915ec1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:18:03.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T20:18:03.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:03.316 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T20:18:03.317 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:03.327+0000 7f71a5223680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:18:03.373 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:03.384+0000 7f6915ec1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:18:03.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:03.382 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:03.393+0000 7f71a5223680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:18:03.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.512+0000 7f8a97f3e700 1 Processor -- start 2024-01-21T20:18:03.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.513+0000 7f8a97f3e700 1 -- start start 2024-01-21T20:18:03.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a97f3e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a90154140 0x7f8a90158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a97f3e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 0x7f8a900ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a97f3e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a900ab620 con 0x7f8a900c6090 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a97f3e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a900c6ae0 con 0x7f8a90154140 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a97f3e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a900c05e0 con 0x7f8a90154520 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a964db700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8a900c6090 0x7f8a900c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55274/0 (socket says 172.21.15.133:55274) 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a964db700 1 -- 172.21.15.133:0/2668819441 learned_addr learned my addr 172.21.15.133:0/2668819441 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a95cda700 1 --2- 172.21.15.133:0/2668819441 >> v2:172.21.15.178:3300/0 conn(0x7f8a90154140 0x7f8a90158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 --2- 172.21.15.133:0/2668819441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 0x7f8a900ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a94cd8700 1 -- 172.21.15.133:0/2668819441 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771536148 0 0) 0x7f8a900ab620 con 0x7f8a900c6090 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a94cd8700 1 -- 172.21.15.133:0/2668819441 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a7c0033f0 con 0x7f8a900c6090 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 -- 172.21.15.133:0/2668819441 >> v2:172.21.15.178:3300/0 conn(0x7f8a90154140 msgr2=0x7f8a90158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 --2- 172.21.15.133:0/2668819441 >> v2:172.21.15.178:3300/0 conn(0x7f8a90154140 0x7f8a90158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 -- 172.21.15.133:0/2668819441 >> v1:172.21.15.133:6789/0 conn(0x7f8a900c6090 legacy=0x7f8a900c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 -- 172.21.15.133:0/2668819441 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a900c0e40 con 0x7f8a90154520 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a954d9700 1 --2- 172.21.15.133:0/2668819441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 0x7f8a900ab130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8a80009760 tx=0x7f8a80009060).ready entity=mon.2 client_cookie=38cc3175e8566bab server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.514+0000 7f8a94cd8700 1 -- 172.21.15.133:0/2668819441 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000d4a0 con 0x7f8a90154520 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a94cd8700 1 -- 172.21.15.133:0/2668819441 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8000d600 con 0x7f8a90154520 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a94cd8700 1 -- 172.21.15.133:0/2668819441 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000d980 con 0x7f8a90154520 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 -- 172.21.15.133:0/2668819441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 msgr2=0x7f8a900ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/2668819441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 0x7f8a900ab130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8a80009760 tx=0x7f8a80009060).stop 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 -- 172.21.15.133:0/2668819441 shutdown_connections 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/2668819441 >> v2:172.21.15.178:3300/0 conn(0x7f8a90154140 0x7f8a90158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/2668819441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154520 0x7f8a900ab130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 -- 172.21.15.133:0/2668819441 >> 172.21.15.133:0/2668819441 conn(0x7f8a9005e1e0 msgr2=0x7f8a9005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 -- 172.21.15.133:0/2668819441 shutdown_connections 2024-01-21T20:18:03.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.515+0000 7f8a97f3e700 1 -- 172.21.15.133:0/2668819441 wait complete. 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.516+0000 7f8a97f3e700 1 Processor -- start 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.516+0000 7f8a97f3e700 1 -- start start 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 0x7f8a900c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a900c4680 con 0x7f8a90154520 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a900b0370 con 0x7f8a900c6090 2024-01-21T20:18:03.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a97f3e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9014cc30 con 0x7f8a90154140 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a964db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a95cda700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a954d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 0x7f8a900c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a95cda700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:48138/0 (socket says 172.21.15.133:48138) 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a95cda700 1 -- 172.21.15.133:0/136454414 learned_addr learned my addr 172.21.15.133:0/136454414 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.517+0000 7f8a964db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44560/0 (socket says 172.21.15.133:44560) 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 msgr2=0x7f8a900c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 0x7f8a900c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 msgr2=0x7f8a900c2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 -- 172.21.15.133:0/136454414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800092a0 con 0x7f8a90154520 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a954d9700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 0x7f8a900c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a95cda700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a964db700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f8a8800c790 tx=0x7f8a88007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88005d30 con 0x7f8a90154520 2024-01-21T20:18:03.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a88005e90 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a900c27d0 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a880072e0 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.518+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a900c2d90 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.519+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9005fdf0 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.519+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f8a88007710 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.520+0000 7f8a867fc700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 0x7f8a74061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.520+0000 7f8a95cda700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 msgr2=0x7f8a74061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.520+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f8a8807a170 con 0x7f8a90154520 2024-01-21T20:18:03.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.520+0000 7f8a95cda700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 0x7f8a74061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:03.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.524+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8a8804ae50 con 0x7f8a90154520 2024-01-21T20:18:03.647 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:03.658+0000 7f6915ec1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:18:03.673 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:03.684+0000 7f71a5223680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:18:03.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.721+0000 7f8a95cda700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 msgr2=0x7f8a74061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:03.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.721+0000 7f8a95cda700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 0x7f8a74061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.737+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a900aa980 con 0x7f8a90154520 2024-01-21T20:18:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.738+0000 7f8a867fc700 1 -- 172.21.15.133:0/136454414 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f8a88018020 con 0x7f8a90154520 2024-01-21T20:18:03.727 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:03.727 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:18:03.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 msgr2=0x7f8a74061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:03.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 0x7f8a74061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:03.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 msgr2=0x7f8a9014c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f8a8800c790 tx=0x7f8a88007f10).stop 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 shutdown_connections 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8a7405f390 0x7f8a74061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a90154520 0x7f8a9014c740 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a900c6090 0x7f8a900c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 --2- 172.21.15.133:0/136454414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a90154140 0x7f8a900c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 >> 172.21.15.133:0/136454414 conn(0x7f8a9005e1e0 msgr2=0x7f8a900ab660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 shutdown_connections 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.740+0000 7f8a97f3e700 1 -- 172.21.15.133:0/136454414 wait complete. 2024-01-21T20:18:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:18:03.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.872+0000 7f24cac57700 1 Processor -- start 2024-01-21T20:18:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.872+0000 7f24cac57700 1 -- start start 2024-01-21T20:18:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24cac57700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24c40c8120 0x7f24c4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24cac57700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 0x7f24c40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24cac57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40ab620 con 0x7f24c4154140 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24cac57700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c40c6ae0 con 0x7f24c40c8120 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24cac57700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c40c05e0 con 0x7f24c4154520 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24c40c8120 0x7f24c4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c89f3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f24c4154140 0x7f24c40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55278/0 (socket says 172.21.15.133:55278) 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c89f3700 1 -- 172.21.15.133:0/1185479855 learned_addr learned my addr 172.21.15.133:0/1185479855 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c91f4700 1 --2- 172.21.15.133:0/1185479855 >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 0x7f24c40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c37fe700 1 -- 172.21.15.133:0/1185479855 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177768148 0 0) 0x7f24c40ab620 con 0x7f24c4154140 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c37fe700 1 -- 172.21.15.133:0/1185479855 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b40033f0 con 0x7f24c4154140 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 -- 172.21.15.133:0/1185479855 >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 msgr2=0x7f24c40ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 --2- 172.21.15.133:0/1185479855 >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 0x7f24c40ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 -- 172.21.15.133:0/1185479855 >> v1:172.21.15.133:6789/0 conn(0x7f24c4154140 legacy=0x7f24c40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 -- 172.21.15.133:0/1185479855 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40c0e40 con 0x7f24c40c8120 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c91f4700 1 --2- 172.21.15.133:0/1185479855 >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 0x7f24c40ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.873+0000 7f24c3fff700 1 --2- 172.21.15.133:0/1185479855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c4158bb0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f24c40634e0 tx=0x7f24b0009060).ready entity=mon.0 client_cookie=9ca047a7cb021ac4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24c37fe700 1 -- 172.21.15.133:0/1185479855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000f510 con 0x7f24c40c8120 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24c37fe700 1 -- 172.21.15.133:0/1185479855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000f670 con 0x7f24c40c8120 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24c37fe700 1 -- 172.21.15.133:0/1185479855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000f9f0 con 0x7f24c40c8120 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 -- 172.21.15.133:0/1185479855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 msgr2=0x7f24c4158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 --2- 172.21.15.133:0/1185479855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c4158bb0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f24c40634e0 tx=0x7f24b0009060).stop 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 -- 172.21.15.133:0/1185479855 shutdown_connections 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 --2- 172.21.15.133:0/1185479855 >> v2:172.21.15.178:3300/0 conn(0x7f24c4154520 0x7f24c40ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 --2- 172.21.15.133:0/1185479855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c4158bb0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 -- 172.21.15.133:0/1185479855 >> 172.21.15.133:0/1185479855 conn(0x7f24c405e1e0 msgr2=0x7f24c405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 -- 172.21.15.133:0/1185479855 shutdown_connections 2024-01-21T20:18:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.874+0000 7f24cac57700 1 -- 172.21.15.133:0/1185479855 wait complete. 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 Processor -- start 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 -- start start 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24c4154140 0x7f24c40afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24c4154520 0x7f24c414cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4154af0 con 0x7f24c40c8120 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40b06c0 con 0x7f24c4154140 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.876+0000 7f24cac57700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40b09a0 con 0x7f24c4154520 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44572/0 (socket says 172.21.15.133:44572) 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 -- 172.21.15.133:0/1033664904 learned_addr learned my addr 172.21.15.133:0/1033664904 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c3fff700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24c4154140 0x7f24c40afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c91f4700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24c4154520 0x7f24c414cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 -- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24c4154520 msgr2=0x7f24c414cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24c4154520 0x7f24c414cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 -- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24c4154140 msgr2=0x7f24c40afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24c4154140 0x7f24c40afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 -- 172.21.15.133:0/1033664904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00092a0 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c89f3700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f24b800c590 tx=0x7f24b8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80072e0 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b8007440 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b80057a0 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c40b0c80 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.877+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c40b0360 con 0x7f24c40c8120 2024-01-21T20:18:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.878+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c405fdf0 con 0x7f24c40c8120 2024-01-21T20:18:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.879+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f24b8005bd0 con 0x7f24c40c8120 2024-01-21T20:18:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.880+0000 7f24c17fa700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 0x7f24a8061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.880+0000 7f24c3fff700 1 -- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 msgr2=0x7f24a8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.880+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f24b8079fd0 con 0x7f24c40c8120 2024-01-21T20:18:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.880+0000 7f24c3fff700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 0x7f24a8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:03.884+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24b804acb0 con 0x7f24c40c8120 2024-01-21T20:18:04.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.054+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24c40aa980 con 0x7f24c40c8120 2024-01-21T20:18:04.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.055+0000 7f24c17fa700 1 -- 172.21.15.133:0/1033664904 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+18121 (secure 0 0 0) 0x7f24b804e2d0 con 0x7f24c40c8120 2024-01-21T20:18:04.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:04.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":125,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:18.393520+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/310937302":"2024-01-22T20:17:18.393481+0000","172.21.15.133:0/2955466938":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6833/43404":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6832/43404":"2024-01-22T20:17:18.393481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:04.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 msgr2=0x7f24a8061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 0x7f24a8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 msgr2=0x7f24c40aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f24b800c590 tx=0x7f24b8007c80).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 shutdown_connections 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f24a805f390 0x7f24a8061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24c4154520 0x7f24c414cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24c40c8120 0x7f24c40aed90 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 --2- 172.21.15.133:0/1033664904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24c4154140 0x7f24c40afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 >> 172.21.15.133:0/1033664904 conn(0x7f24c405e1e0 msgr2=0x7f24c40c2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 shutdown_connections 2024-01-21T20:18:04.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.057+0000 7f24cac57700 1 -- 172.21.15.133:0/1033664904 wait complete. 2024-01-21T20:18:04.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:17:01.059720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:17:01.464345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T20:18:04.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:18:04.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.197+0000 7fef363c6700 1 Processor -- start 2024-01-21T20:18:04.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.197+0000 7fef363c6700 1 -- start start 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef300acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30066460 0x7fef300634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef301521e0 0x7fef301525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef30065fd0 con 0x7fef30066460 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300653c0 con 0x7fef301521e0 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef363c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300656a0 con 0x7fef300acbc0 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30066460 0x7fef300634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30066460 0x7fef300634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44574/0 (socket says 172.21.15.133:44574) 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 -- 172.21.15.133:0/3367454174 learned_addr learned my addr 172.21.15.133:0/3367454174 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef2ffff700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef300acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef34963700 1 --2- 172.21.15.133:0/3367454174 >> v2:172.21.15.178:3300/0 conn(0x7fef301521e0 0x7fef301525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 -- 172.21.15.133:0/3367454174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 msgr2=0x7fef300acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef300acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 -- 172.21.15.133:0/3367454174 >> v2:172.21.15.178:3300/0 conn(0x7fef301521e0 msgr2=0x7fef301525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 --2- 172.21.15.133:0/3367454174 >> v2:172.21.15.178:3300/0 conn(0x7fef301521e0 0x7fef301525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.198+0000 7fef27fff700 1 -- 172.21.15.133:0/3367454174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30065980 con 0x7fef30066460 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef27fff700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef300634d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fef30067b20 tx=0x7fef180090f0).ready entity=mon.0 client_cookie=b3aa306d05fc8bfd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3367454174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800f510 con 0x7fef30066460 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3367454174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800f670 con 0x7fef30066460 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3367454174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1800fa10 con 0x7fef30066460 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 -- 172.21.15.133:0/3367454174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 msgr2=0x7fef300634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef300634d0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fef30067b20 tx=0x7fef180090f0).stop 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 -- 172.21.15.133:0/3367454174 shutdown_connections 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 --2- 172.21.15.133:0/3367454174 >> v2:172.21.15.178:3300/0 conn(0x7fef301521e0 0x7fef301525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef300acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 --2- 172.21.15.133:0/3367454174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef300634d0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 -- 172.21.15.133:0/3367454174 >> 172.21.15.133:0/3367454174 conn(0x7fef300c8200 msgr2=0x7fef300c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 -- 172.21.15.133:0/3367454174 shutdown_connections 2024-01-21T20:18:04.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.199+0000 7fef363c6700 1 -- 172.21.15.133:0/3367454174 wait complete. 2024-01-21T20:18:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 Processor -- start 2024-01-21T20:18:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 -- start start 2024-01-21T20:18:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef30151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef301521e0 0x7fef30151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30154470 con 0x7fef30066460 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30151b00 con 0x7fef301521e0 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef363c6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30154890 con 0x7fef300acbc0 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef2ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.201+0000 7fef2ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44576/0 (socket says 172.21.15.133:44576) 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 -- 172.21.15.133:0/1312260352 learned_addr learned my addr 172.21.15.133:0/1312260352 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef27fff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef30151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef34963700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef301521e0 0x7fef30151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 msgr2=0x7fef30151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef30151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef301521e0 msgr2=0x7fef30151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef301521e0 0x7fef30151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 -- 172.21.15.133:0/1312260352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef18009370 con 0x7fef30066460 2024-01-21T20:18:04.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2ffff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fef2000e950 tx=0x7fef20009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20012600 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20012760 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20012ae0 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30153850 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.202+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef30154090 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.203+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fef2001b400 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.203+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef301546e0 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.204+0000 7fef2d7fa700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 0x7fef10061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.204+0000 7fef27fff700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 msgr2=0x7fef10061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.204+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fef2007ad80 con 0x7fef30066460 2024-01-21T20:18:04.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.204+0000 7fef27fff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 0x7fef10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:04.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.208+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef2004ba60 con 0x7fef30066460 2024-01-21T20:18:04.262 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:04.273+0000 7f6915ec1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:18:04.330 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:04.341+0000 7f71a5223680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:18:04.335 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:04.346+0000 7f6915ec1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.405+0000 7fef27fff700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 msgr2=0x7fef10061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.405+0000 7fef27fff700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 0x7fef10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.411+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fef30065c60 con 0x7fef30066460 2024-01-21T20:18:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.411+0000 7fef2d7fa700 1 -- 172.21.15.133:0/1312260352 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v125) v1 ==== 110+0+10 (secure 0 0 0) 0x7fef20016020 con 0x7fef30066460 2024-01-21T20:18:04.400 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 msgr2=0x7fef10061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 0x7fef10061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 msgr2=0x7fef301442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fef2000e950 tx=0x7fef20009060).stop 2024-01-21T20:18:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 shutdown_connections 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1005f390 0x7fef10061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef301521e0 0x7fef30151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30066460 0x7fef301442e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 --2- 172.21.15.133:0/1312260352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef300acbc0 0x7fef30151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 >> 172.21.15.133:0/1312260352 conn(0x7fef300c8200 msgr2=0x7fef300aa980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 shutdown_connections 2024-01-21T20:18:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.413+0000 7fef363c6700 1 -- 172.21.15.133:0/1312260352 wait complete. 2024-01-21T20:18:04.404 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:04.415+0000 7f71a5223680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:18:04.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:18:04.522 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:04.533+0000 7f6915ec1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:18:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.549+0000 7f0eeff59700 1 Processor -- start 2024-01-21T20:18:04.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.549+0000 7f0eeff59700 1 -- start start 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eeff59700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee81351d0 0x7f0ee80c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eeff59700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee81563c0 0x7f0ee80bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eeff59700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee80c61a0 con 0x7f0ee80c3c60 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eeff59700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee80c5350 con 0x7f0ee81563c0 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eeff59700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80c55d0 con 0x7f0ee81351d0 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.550+0000 7f0eee4f6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee81563c0 0x7f0ee80bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee81563c0 0x7f0ee80bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44586/0 (socket says 172.21.15.133:44586) 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 -- 172.21.15.133:0/2571529825 learned_addr learned my addr 172.21.15.133:0/2571529825 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eedcf5700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee81351d0 0x7f0ee80c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 -- 172.21.15.133:0/2571529825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee81351d0 msgr2=0x7f0ee80c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee81351d0 0x7f0ee80c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 -- 172.21.15.133:0/2571529825 >> v1:172.21.15.178:6789/0 conn(0x7f0ee80c3c60 legacy=0x7f0ee8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 -- 172.21.15.133:0/2571529825 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee80c5870 con 0x7f0ee81563c0 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eee4f6700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee80bde60 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f0ee0009f20 tx=0x7f0ee0009840).ready entity=mon.0 client_cookie=e41fa2bc216efa7a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eeccf3700 1 -- 172.21.15.133:0/2571529825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000e070 con 0x7f0ee81563c0 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eeccf3700 1 -- 172.21.15.133:0/2571529825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee000b9d0 con 0x7f0ee81563c0 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.551+0000 7f0eeccf3700 1 -- 172.21.15.133:0/2571529825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee000bd50 con 0x7f0ee81563c0 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 -- 172.21.15.133:0/2571529825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 msgr2=0x7f0ee80bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee80bde60 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f0ee0009f20 tx=0x7f0ee0009840).stop 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 -- 172.21.15.133:0/2571529825 shutdown_connections 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee80bde60 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 --2- 172.21.15.133:0/2571529825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee81351d0 0x7f0ee80c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 -- 172.21.15.133:0/2571529825 >> 172.21.15.133:0/2571529825 conn(0x7f0ee8066a90 msgr2=0x7f0ee8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 -- 172.21.15.133:0/2571529825 shutdown_connections 2024-01-21T20:18:04.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.552+0000 7f0eeff59700 1 -- 172.21.15.133:0/2571529825 wait complete. 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.553+0000 7f0eeff59700 1 Processor -- start 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.553+0000 7f0eeff59700 1 -- start start 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee80c3c60 0x7f0ee80ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ee81351d0 0x7f0ee8135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80657f0 con 0x7f0ee81563c0 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee8065510 con 0x7f0ee81351d0 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eeff59700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee80c1010 con 0x7f0ee80c3c60 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eedcf5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee80c3c60 0x7f0ee80ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44588/0 (socket says 172.21.15.133:44588) 2024-01-21T20:18:04.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 -- 172.21.15.133:0/853000248 learned_addr learned my addr 172.21.15.133:0/853000248 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eed4f4700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ee81351d0 0x7f0ee8135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 -- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee80c3c60 msgr2=0x7f0ee80ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee80c3c60 0x7f0ee80ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 -- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ee81351d0 msgr2=0x7f0ee8135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ee81351d0 0x7f0ee8135890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 -- 172.21.15.133:0/853000248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009ae0 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.554+0000 7f0eee4f6700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0ee8066530 tx=0x7f0ee0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.555+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00092e0 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.555+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee0007610 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.555+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee00079b0 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.555+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee80c12f0 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.555+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee8065220 con 0x7f0ee81563c0 2024-01-21T20:18:04.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.556+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee80c1940 con 0x7f0ee81563c0 2024-01-21T20:18:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.557+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0ee0003040 con 0x7f0ee81563c0 2024-01-21T20:18:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.557+0000 7f0ede7fc700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 0x7f0ecc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.557+0000 7f0eedcf5700 1 -- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 msgr2=0x7f0ecc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.557+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f0ee007c340 con 0x7f0ee81563c0 2024-01-21T20:18:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.557+0000 7f0eedcf5700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 0x7f0ecc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:04.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.561+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ee004cfc0 con 0x7f0ee81563c0 2024-01-21T20:18:04.604 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:04.615+0000 7f71a5223680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:18:04.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.730+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ee805fdf0 con 0x7f0ee81563c0 2024-01-21T20:18:04.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.731+0000 7f0ede7fc700 1 -- 172.21.15.133:0/853000248 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ee0024020 con 0x7f0ee81563c0 2024-01-21T20:18:04.720 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:18:04.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 msgr2=0x7f0ecc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:04.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 0x7f0ecc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 msgr2=0x7f0ee8064d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0ee8066530 tx=0x7f0ee0009840).stop 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 shutdown_connections 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0ecc05f390 0x7f0ecc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee81563c0 0x7f0ee8064d30 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ee80c3c60 0x7f0ee80ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 --2- 172.21.15.133:0/853000248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ee81351d0 0x7f0ee8135890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 >> 172.21.15.133:0/853000248 conn(0x7f0ee8066a90 msgr2=0x7f0ee8134830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 shutdown_connections 2024-01-21T20:18:04.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.733+0000 7f0eeff59700 1 -- 172.21.15.133:0/853000248 wait complete. 2024-01-21T20:18:04.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T20:18:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.868+0000 7fcddc5c5700 1 Processor -- start 2024-01-21T20:18:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.868+0000 7fcddc5c5700 1 -- start start 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddc5c5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 0x7fcdd4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddc5c5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddc5c5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd40ab620 con 0x7fcdd40c6090 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddc5c5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40c6ae0 con 0x7fcdd4154140 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddc5c5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40c05e0 con 0x7fcdd4154520 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcdd9b60700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcdda361700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 0x7fcdd4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcdd9b60700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54608/0 (socket says 172.21.15.133:54608) 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcddab62700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fcdd40c6090 0x7fcdd40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43786/0 (socket says 172.21.15.133:43786) 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.869+0000 7fcdd9b60700 1 -- 172.21.15.133:0/757985997 learned_addr learned my addr 172.21.15.133:0/757985997 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd9b60700 1 -- 172.21.15.133:0/757985997 >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 msgr2=0x7fcdd4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd9b60700 1 --2- 172.21.15.133:0/757985997 >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 0x7fcdd4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd9b60700 1 -- 172.21.15.133:0/757985997 >> v1:172.21.15.178:6789/0 conn(0x7fcdd40c6090 legacy=0x7fcdd40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd9b60700 1 -- 172.21.15.133:0/757985997 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40c0e40 con 0x7fcdd4154520 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd935f700 1 -- 172.21.15.133:0/757985997 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990274434 0 0) 0x7fcdd40ab620 con 0x7fcdd40c6090 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdda361700 1 --2- 172.21.15.133:0/757985997 >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 0x7fcdd4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd9b60700 1 --2- 172.21.15.133:0/757985997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcdc4006fd0 tx=0x7fcdc40090f0).ready entity=mon.2 client_cookie=f602039ea472f5cb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd935f700 1 -- 172.21.15.133:0/757985997 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400b580 con 0x7fcdd4154520 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd935f700 1 -- 172.21.15.133:0/757985997 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400b6e0 con 0x7fcdd4154520 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcdd935f700 1 -- 172.21.15.133:0/757985997 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400ba60 con 0x7fcdd4154520 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcddc5c5700 1 -- 172.21.15.133:0/757985997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 msgr2=0x7fcdd40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.870+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/757985997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcdc4006fd0 tx=0x7fcdc40090f0).stop 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 -- 172.21.15.133:0/757985997 shutdown_connections 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/757985997 >> v2:172.21.15.178:3300/0 conn(0x7fcdd4154140 0x7fcdd4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/757985997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40ab130 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 -- 172.21.15.133:0/757985997 >> 172.21.15.133:0/757985997 conn(0x7fcdd405e1e0 msgr2=0x7fcdd405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:04.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 -- 172.21.15.133:0/757985997 shutdown_connections 2024-01-21T20:18:04.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.871+0000 7fcddc5c5700 1 -- 172.21.15.133:0/757985997 wait complete. 2024-01-21T20:18:04.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.872+0000 7fcddc5c5700 1 Processor -- start 2024-01-21T20:18:04.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.872+0000 7fcddc5c5700 1 -- start start 2024-01-21T20:18:04.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd40c6090 0x7fcdd413eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4063ee0 con 0x7fcdd4154140 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd41687a0 con 0x7fcdd40c6090 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4152b10 con 0x7fcdd4154520 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44598/0 (socket says 172.21.15.133:44598) 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 -- 172.21.15.133:0/1512863324 learned_addr learned my addr 172.21.15.133:0/1512863324 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdda361700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd40c6090 0x7fcdd413eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddab62700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 -- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 msgr2=0x7fcdd40639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 -- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd40c6090 msgr2=0x7fcdd413eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd40c6090 0x7fcdd413eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 -- 172.21.15.133:0/1512863324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd00092a0 con 0x7fcdd4154140 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdd9b60700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcdd40c6c20 tx=0x7fcdc4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:04.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400b850 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400b9b0 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc401c670 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4009370 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.873+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd4168150 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.874+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd4168930 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.875+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fcdc401ca20 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.875+0000 7fcdcaffd700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 0x7fcdb8061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.875+0000 7fcdda361700 1 -- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 msgr2=0x7fcdb8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.875+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fcdc407c0e0 con 0x7fcdd4154140 2024-01-21T20:18:04.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.875+0000 7fcdda361700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 0x7fcdb8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:04.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:04.879+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcdc404cdc0 con 0x7fcdd4154140 2024-01-21T20:18:04.944 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:04.955+0000 7f6915ec1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:18:05.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.050+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdd40aa980 con 0x7fcdd4154140 2024-01-21T20:18:05.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.051+0000 7fcdcaffd700 1 -- 172.21.15.133:0/1512863324 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdc40503e0 con 0x7fcdd4154140 2024-01-21T20:18:05.040 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 msgr2=0x7fcdb8061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 0x7fcdb8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 msgr2=0x7fcdd4063500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcdd40c6c20 tx=0x7fcdc4017000).stop 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 shutdown_connections 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcdb805f390 0x7fcdb8061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdd4154520 0x7fcdd40639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd40c6090 0x7fcdd413eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 --2- 172.21.15.133:0/1512863324 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd4154140 0x7fcdd4063500 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.052+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 >> 172.21.15.133:0/1512863324 conn(0x7fcdd405e1e0 msgr2=0x7fcdd40c3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.053+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 shutdown_connections 2024-01-21T20:18:05.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.053+0000 7fcddc5c5700 1 -- 172.21.15.133:0/1512863324 wait complete. 2024-01-21T20:18:05.046 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.057+0000 7f71a5223680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:18:05.047 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.058+0000 7f6915ec1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:05.054 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T20:18:05.158 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.169+0000 7f71a5223680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:05.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.186+0000 7f607bab7700 1 Processor -- start 2024-01-21T20:18:05.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.186+0000 7f607bab7700 1 -- start start 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607bab7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607bab7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60740c8120 0x7f60740ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607bab7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740ab620 con 0x7f6074154520 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607bab7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740c6ae0 con 0x7f60740c8120 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607bab7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740c05e0 con 0x7f6074154140 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f607a054700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f60740c8120 0x7f60740ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54634/0 (socket says 172.21.15.133:54634) 2024-01-21T20:18:05.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 -- 172.21.15.133:0/2153852370 learned_addr learned my addr 172.21.15.133:0/2153852370 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079052700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f6074154520 0x7f60740c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43800/0 (socket says 172.21.15.133:43800) 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6078851700 1 -- 172.21.15.133:0/2153852370 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907668395 0 0) 0x7f60740ab620 con 0x7f6074154520 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6078851700 1 -- 172.21.15.133:0/2153852370 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60600033f0 con 0x7f6074154520 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 -- 172.21.15.133:0/2153852370 >> v2:172.21.15.178:3300/0 conn(0x7f60740c8120 msgr2=0x7f60740ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 --2- 172.21.15.133:0/2153852370 >> v2:172.21.15.178:3300/0 conn(0x7f60740c8120 0x7f60740ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 -- 172.21.15.133:0/2153852370 >> v1:172.21.15.178:6789/0 conn(0x7f6074154520 legacy=0x7f60740c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.187+0000 7f6079853700 1 -- 172.21.15.133:0/2153852370 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740c0e40 con 0x7f6074154140 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f6079853700 1 --2- 172.21.15.133:0/2153852370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6070006fd0 tx=0x7f60700090f0).ready entity=mon.2 client_cookie=48b329e2b23a5424 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f6078851700 1 -- 172.21.15.133:0/2153852370 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000f510 con 0x7f6074154140 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f6078851700 1 -- 172.21.15.133:0/2153852370 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f607000f670 con 0x7f6074154140 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f6078851700 1 -- 172.21.15.133:0/2153852370 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607000f9f0 con 0x7f6074154140 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 -- 172.21.15.133:0/2153852370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 msgr2=0x7f6074158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 --2- 172.21.15.133:0/2153852370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6070006fd0 tx=0x7f60700090f0).stop 2024-01-21T20:18:05.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 -- 172.21.15.133:0/2153852370 shutdown_connections 2024-01-21T20:18:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 --2- 172.21.15.133:0/2153852370 >> v2:172.21.15.178:3300/0 conn(0x7f60740c8120 0x7f60740ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 --2- 172.21.15.133:0/2153852370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f6074158bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 -- 172.21.15.133:0/2153852370 >> 172.21.15.133:0/2153852370 conn(0x7f607405e1e0 msgr2=0x7f607405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 -- 172.21.15.133:0/2153852370 shutdown_connections 2024-01-21T20:18:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.188+0000 7f607bab7700 1 -- 172.21.15.133:0/2153852370 wait complete. 2024-01-21T20:18:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 Processor -- start 2024-01-21T20:18:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 -- start start 2024-01-21T20:18:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60740c8120 0x7f607414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f60741558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074157f70 con 0x7f6074154520 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074155ee0 con 0x7f60740c8120 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.190+0000 7f607bab7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60741561c0 con 0x7f6074154140 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44610/0 (socket says 172.21.15.133:44610) 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 -- 172.21.15.133:0/3565480180 learned_addr learned my addr 172.21.15.133:0/3565480180 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f6079052700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f60741558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f6079853700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60740c8120 0x7f607414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 -- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 msgr2=0x7f60741558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f60741558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 -- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60740c8120 msgr2=0x7f607414d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60740c8120 0x7f607414d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 -- 172.21.15.133:0/3565480180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009370 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607a054700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f606c009df0 tx=0x7f606c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c009b50 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00f040 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074157c00 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00ccb0 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.191+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60741578b0 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.192+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607405fdf0 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.193+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f606c013610 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.193+0000 7f606a777700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 0x7f6058061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.193+0000 7f6079853700 1 -- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 msgr2=0x7f6058061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.193+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f606c07bac0 con 0x7f6074154520 2024-01-21T20:18:05.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.193+0000 7f6079853700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 0x7f6058061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:05.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.201+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f606c050230 con 0x7f6074154520 2024-01-21T20:18:05.201 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.212+0000 7f6915ec1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:05.276 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.287+0000 7f6915ec1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:18:05.324 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.335+0000 7f71a5223680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:05.344 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.355+0000 7f6915ec1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:18:05.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.371+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60740aa100 con 0x7f6074154520 2024-01-21T20:18:05.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.372+0000 7f606a777700 1 -- 172.21.15.133:0/3565480180 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f606c04fe20 con 0x7f6074154520 2024-01-21T20:18:05.361 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.373+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 msgr2=0x7f6058061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.373+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 0x7f6058061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 msgr2=0x7f6074158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f606c009df0 tx=0x7f606c00b040).stop 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 shutdown_connections 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f605805f390 0x7f6058061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6074154520 0x7f6074158400 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60740c8120 0x7f607414d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 --2- 172.21.15.133:0/3565480180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6074154140 0x7f60741558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 >> 172.21.15.133:0/3565480180 conn(0x7f607405e1e0 msgr2=0x7f60740ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 shutdown_connections 2024-01-21T20:18:05.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.374+0000 7f607bab7700 1 -- 172.21.15.133:0/3565480180 wait complete. 2024-01-21T20:18:05.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:05.405 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.416+0000 7f71a5223680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:18:05.477 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.488+0000 7f71a5223680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:18:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.502+0000 7f660205f700 1 Processor -- start 2024-01-21T20:18:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.502+0000 7f660205f700 1 -- start start 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f660205f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65fc154140 0x7f65fc158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f660205f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65fc154520 0x7f65fc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f660205f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0ab620 con 0x7f65fc0c6090 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f660205f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0c6ae0 con 0x7f65fc154520 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f660205f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0c05e0 con 0x7f65fc154140 2024-01-21T20:18:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f65f2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65fc154520 0x7f65fc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f65fbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f65fc0c6090 0x7f65fc0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55286/0 (socket says 172.21.15.133:55286) 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.503+0000 7f65fbfff700 1 -- 172.21.15.133:0/2628610925 learned_addr learned my addr 172.21.15.133:0/2628610925 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65fb7fe700 1 --2- 172.21.15.133:0/2628610925 >> v2:172.21.15.178:3300/0 conn(0x7f65fc154140 0x7f65fc158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65f2ffd700 1 -- 172.21.15.133:0/2628610925 >> v2:172.21.15.178:3300/0 conn(0x7f65fc154140 msgr2=0x7f65fc158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65f2ffd700 1 --2- 172.21.15.133:0/2628610925 >> v2:172.21.15.178:3300/0 conn(0x7f65fc154140 0x7f65fc158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65f2ffd700 1 -- 172.21.15.133:0/2628610925 >> v1:172.21.15.133:6789/0 conn(0x7f65fc0c6090 legacy=0x7f65fc0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65f2ffd700 1 -- 172.21.15.133:0/2628610925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0c0e40 con 0x7f65fc154520 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65f2ffd700 1 --2- 172.21.15.133:0/2628610925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0ab130 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f65fc083d70 tx=0x7f65e4009060).ready entity=mon.0 client_cookie=e4c93b369b7bbe11 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65faffd700 1 -- 172.21.15.133:0/2628610925 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400f510 con 0x7f65fc154520 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65faffd700 1 -- 172.21.15.133:0/2628610925 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e400f670 con 0x7f65fc154520 2024-01-21T20:18:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.504+0000 7f65faffd700 1 -- 172.21.15.133:0/2628610925 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e400f9f0 con 0x7f65fc154520 2024-01-21T20:18:05.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 -- 172.21.15.133:0/2628610925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 msgr2=0x7f65fc0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 --2- 172.21.15.133:0/2628610925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0ab130 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f65fc083d70 tx=0x7f65e4009060).stop 2024-01-21T20:18:05.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 -- 172.21.15.133:0/2628610925 shutdown_connections 2024-01-21T20:18:05.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 --2- 172.21.15.133:0/2628610925 >> v2:172.21.15.178:3300/0 conn(0x7f65fc154140 0x7f65fc158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 --2- 172.21.15.133:0/2628610925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0ab130 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 -- 172.21.15.133:0/2628610925 >> 172.21.15.133:0/2628610925 conn(0x7f65fc05e1e0 msgr2=0x7f65fc05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 -- 172.21.15.133:0/2628610925 shutdown_connections 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.505+0000 7f660205f700 1 -- 172.21.15.133:0/2628610925 wait complete. 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.506+0000 7f660205f700 1 Processor -- start 2024-01-21T20:18:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.506+0000 7f660205f700 1 -- start start 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65fc0c6090 0x7f65fc152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65fc154140 0x7f65fc141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc150d20 con 0x7f65fc154520 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc150a40 con 0x7f65fc0c6090 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f660205f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0ae210 con 0x7f65fc154140 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44634/0 (socket says 172.21.15.133:44634) 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 -- 172.21.15.133:0/1236799170 learned_addr learned my addr 172.21.15.133:0/1236799170 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fb7fe700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65fc0c6090 0x7f65fc152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65f2ffd700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65fc154140 0x7f65fc141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65fc154140 msgr2=0x7f65fc141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65fc154140 0x7f65fc141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65fc0c6090 msgr2=0x7f65fc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65fc0c6090 0x7f65fc152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 -- 172.21.15.133:0/1236799170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40092a0 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.507+0000 7f65fbfff700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f65f400c790 tx=0x7f65f40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.508+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4005d30 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.508+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4005e90 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.508+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4007320 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.508+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc0ae4f0 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.508+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc1532b0 con 0x7f65fc154520 2024-01-21T20:18:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.509+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc0ae070 con 0x7f65fc154520 2024-01-21T20:18:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.509+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f65f40076d0 con 0x7f65fc154520 2024-01-21T20:18:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.510+0000 7f65f8ff9700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 0x7f65dc061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.510+0000 7f65fb7fe700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 msgr2=0x7f65dc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.510+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f65f407a780 con 0x7f65fc154520 2024-01-21T20:18:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.510+0000 7f65fb7fe700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 0x7f65dc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:05.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.514+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f65fc0ae070 con 0x7f65fc154520 2024-01-21T20:18:05.599 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.610+0000 7f6915ec1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:18:05.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.711+0000 7f65fb7fe700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 msgr2=0x7f65dc061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:05.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.711+0000 7f65fb7fe700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 0x7f65dc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:05.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.724+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65fc0ae070 con 0x7f65fc154520 2024-01-21T20:18:05.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.724+0000 7f65f8ff9700 1 -- 172.21.15.133:0/1236799170 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f65fc0ae070 con 0x7f65fc154520 2024-01-21T20:18:05.713 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:05.713 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:18:05.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 msgr2=0x7f65dc061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:05.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 0x7f65dc061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 msgr2=0x7f65fc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f65f400c790 tx=0x7f65f40015e0).stop 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 shutdown_connections 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65dc05f390 0x7f65dc061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65fc154520 0x7f65fc0c7760 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65fc0c6090 0x7f65fc152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 --2- 172.21.15.133:0/1236799170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65fc154140 0x7f65fc141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 >> 172.21.15.133:0/1236799170 conn(0x7f65fc05e1e0 msgr2=0x7f65fc0c48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 shutdown_connections 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.726+0000 7f660205f700 1 -- 172.21.15.133:0/1236799170 wait complete. 2024-01-21T20:18:05.716 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:18:05.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:05.743 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.754+0000 7f71a5223680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:18:05.785 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:05.796+0000 7f6915ec1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.873+0000 7f0eb8476700 1 Processor -- start 2024-01-21T20:18:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.873+0000 7f0eb8476700 1 -- start start 2024-01-21T20:18:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb8476700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb0154140 0x7f0eb0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb8476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00c8120 0x7f0eb00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb8476700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb00ab620 con 0x7f0eb0154520 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb8476700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00c6ae0 con 0x7f0eb0154140 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb8476700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00c05e0 con 0x7f0eb00c8120 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb0154140 0x7f0eb0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0eb0154140 0x7f0eb0158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44646/0 (socket says 172.21.15.133:44646) 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 -- 172.21.15.133:0/1872600113 learned_addr learned my addr 172.21.15.133:0/1872600113 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6a13700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00c8120 0x7f0eb00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 -- 172.21.15.133:0/1872600113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00c8120 msgr2=0x7f0eb00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00c8120 0x7f0eb00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 -- 172.21.15.133:0/1872600113 >> v1:172.21.15.178:6789/0 conn(0x7f0eb0154520 legacy=0x7f0eb00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 -- 172.21.15.133:0/1872600113 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00c0e40 con 0x7f0eb0154140 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.875+0000 7f0eb6212700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb0158bb0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f0eac006fd0 tx=0x7f0eac0090f0).ready entity=mon.0 client_cookie=9cdb3071812e27 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb5210700 1 -- 172.21.15.133:0/1872600113 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00b580 con 0x7f0eb0154140 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb5210700 1 -- 172.21.15.133:0/1872600113 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac00b6e0 con 0x7f0eb0154140 2024-01-21T20:18:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb5210700 1 -- 172.21.15.133:0/1872600113 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac00ba60 con 0x7f0eb0154140 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 -- 172.21.15.133:0/1872600113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 msgr2=0x7f0eb0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb0158bb0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f0eac006fd0 tx=0x7f0eac0090f0).stop 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 -- 172.21.15.133:0/1872600113 shutdown_connections 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb0158bb0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 --2- 172.21.15.133:0/1872600113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00c8120 0x7f0eb00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 -- 172.21.15.133:0/1872600113 >> 172.21.15.133:0/1872600113 conn(0x7f0eb005e1e0 msgr2=0x7f0eb005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 -- 172.21.15.133:0/1872600113 shutdown_connections 2024-01-21T20:18:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.876+0000 7f0eb8476700 1 -- 172.21.15.133:0/1872600113 wait complete. 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 Processor -- start 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 -- start start 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00c8120 0x7f0eb00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 0x7f0eb00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00cbf40 con 0x7f0eb0154140 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00c99a0 con 0x7f0eb00c8120 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.878+0000 7f0eb8476700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00c9070 con 0x7f0eb0154520 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44654/0 (socket says 172.21.15.133:44654) 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 -- 172.21.15.133:0/2560205732 learned_addr learned my addr 172.21.15.133:0/2560205732 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb6212700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00c8120 0x7f0eb00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb6a13700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 0x7f0eb00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:05.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 -- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 msgr2=0x7f0eb00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 0x7f0eb00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 -- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00c8120 msgr2=0x7f0eb00aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00c8120 0x7f0eb00aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 -- 172.21.15.133:0/2560205732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac009370 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb6a13700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 0x7f0eb00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb5a11700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f0ea000c440 tx=0x7f0ea0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0007020 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0007180 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb00c9350 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0007520 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.879+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb0148e90 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.880+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb005fdf0 con 0x7f0eb0154140 2024-01-21T20:18:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.881+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f0ea00068b0 con 0x7f0eb0154140 2024-01-21T20:18:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.881+0000 7f0ea6ffd700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 0x7f0e94061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.881+0000 7f0eb6212700 1 -- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 msgr2=0x7f0e94061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.881+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f0ea0079a60 con 0x7f0eb0154140 2024-01-21T20:18:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.881+0000 7f0eb6212700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 0x7f0e94061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:05.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:05.885+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0ea0047b00 con 0x7f0eb0154140 2024-01-21T20:18:05.938 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:05.949+0000 7f71a5223680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:06.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.052+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb00c00f0 con 0x7f0eb0154140 2024-01-21T20:18:06.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.053+0000 7f0ea6ffd700 1 -- 172.21.15.133:0/2560205732 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+18121 (secure 0 0 0) 0x7f0ea004a740 con 0x7f0eb0154140 2024-01-21T20:18:06.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:06.043 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":125,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:18.393520+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/310937302":"2024-01-22T20:17:18.393481+0000","172.21.15.133:0/2955466938":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6833/43404":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6832/43404":"2024-01-22T20:17:18.393481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 msgr2=0x7f0e94061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 0x7f0e94061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 msgr2=0x7f0eb01489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f0ea000c440 tx=0x7f0ea0007e00).stop 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 shutdown_connections 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0e9405f390 0x7f0e94061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb0154520 0x7f0eb00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00c8120 0x7f0eb00aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 --2- 172.21.15.133:0/2560205732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0eb0154140 0x7f0eb01489a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 >> 172.21.15.133:0/2560205732 conn(0x7f0eb005e1e0 msgr2=0x7f0eb014dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 shutdown_connections 2024-01-21T20:18:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.056+0000 7f0eb8476700 1 -- 172.21.15.133:0/2560205732 wait complete. 2024-01-21T20:18:06.057 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T20:18:06.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:06.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.189+0000 7f8f49a3b700 1 Processor -- start 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.189+0000 7f8f49a3b700 1 -- start start 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f49a3b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441546d0 0x7f8f440aa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f49a3b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f440aa580 0x7f8f440c0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f49a3b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f44154b50 con 0x7f8f441542f0 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f49a3b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f44158c00 con 0x7f8f440aa580 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f49a3b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440aa9f0 con 0x7f8f441546d0 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f42ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f441542f0 0x7f8f440c60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55298/0 (socket says 172.21.15.133:55298) 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f42ffd700 1 -- 172.21.15.133:0/2179158567 learned_addr learned my addr 172.21.15.133:0/2179158567 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 --2- 172.21.15.133:0/2179158567 >> v2:172.21.15.133:3300/0 conn(0x7f8f440aa580 0x7f8f440c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f427fc700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441546d0 0x7f8f440aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 -- 172.21.15.133:0/2179158567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441546d0 msgr2=0x7f8f440aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441546d0 0x7f8f440aa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 -- 172.21.15.133:0/2179158567 >> v1:172.21.15.133:6789/0 conn(0x7f8f441542f0 legacy=0x7f8f440c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 -- 172.21.15.133:0/2179158567 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44159090 con 0x7f8f440aa580 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f41ffb700 1 -- 172.21.15.133:0/2179158567 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063570994 0 0) 0x7f8f44154b50 con 0x7f8f441542f0 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.190+0000 7f8f437fe700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f440c0740 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8f3c009e60 tx=0x7f8f3c009780).ready entity=mon.0 client_cookie=68f7195f496aa65f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f41ffb700 1 -- 172.21.15.133:0/2179158567 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00e070 con 0x7f8f440aa580 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f41ffb700 1 -- 172.21.15.133:0/2179158567 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00bb60 con 0x7f8f440aa580 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f41ffb700 1 -- 172.21.15.133:0/2179158567 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c012410 con 0x7f8f440aa580 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 -- 172.21.15.133:0/2179158567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 msgr2=0x7f8f440c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f440c0740 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8f3c009e60 tx=0x7f8f3c009780).stop 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 -- 172.21.15.133:0/2179158567 shutdown_connections 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f440c0740 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/2179158567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441546d0 0x7f8f440aa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 -- 172.21.15.133:0/2179158567 >> 172.21.15.133:0/2179158567 conn(0x7f8f4405e1e0 msgr2=0x7f8f4405e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 -- 172.21.15.133:0/2179158567 shutdown_connections 2024-01-21T20:18:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.191+0000 7f8f49a3b700 1 -- 172.21.15.133:0/2179158567 wait complete. 2024-01-21T20:18:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 Processor -- start 2024-01-21T20:18:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 -- start start 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 0x7f8f440c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f441546d0 0x7f8f4414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.193+0000 7f8f49a3b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440abab0 con 0x7f8f440aa580 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f49a3b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440abf40 con 0x7f8f441546d0 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f49a3b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f440c3df0 con 0x7f8f441542f0 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f42ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f42ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44660/0 (socket says 172.21.15.133:44660) 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f42ffd700 1 -- 172.21.15.133:0/3432688133 learned_addr learned my addr 172.21.15.133:0/3432688133 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 0x7f8f440c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f437fe700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f441546d0 0x7f8f4414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f441546d0 msgr2=0x7f8f4414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f441546d0 0x7f8f4414f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 msgr2=0x7f8f441481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 -- 172.21.15.133:0/3432688133 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009a20 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f42ffd700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f427fc700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 0x7f8f440c33c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8f3400e6f0 tx=0x7f8f34009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34012600 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34012760 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34012ae0 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f440ab180 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.194+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f440ab740 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.195+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f440abc20 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.196+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f8f3401b400 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.196+0000 7f8f2b7fe700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 0x7f8f30061880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.196+0000 7f8f42ffd700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 msgr2=0x7f8f30061880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.196+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f8f3407ab50 con 0x7f8f441542f0 2024-01-21T20:18:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.196+0000 7f8f42ffd700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 0x7f8f30061880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:06.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.201+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f3404b710 con 0x7f8f441542f0 2024-01-21T20:18:06.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.397+0000 7f8f42ffd700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 msgr2=0x7f8f30061880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:06.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.397+0000 7f8f42ffd700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 0x7f8f30061880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:06.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.412+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f44156be0 con 0x7f8f441542f0 2024-01-21T20:18:06.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.413+0000 7f8f2b7fe700 1 -- 172.21.15.133:0/3432688133 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f8f3404ed30 con 0x7f8f441542f0 2024-01-21T20:18:06.402 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:06.402 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:18:06.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 msgr2=0x7f8f30061880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:06.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 0x7f8f30061880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 msgr2=0x7f8f440c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 0x7f8f440c33c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8f3400e6f0 tx=0x7f8f34009060).stop 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 shutdown_connections 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f3005f3c0 0x7f8f30061880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f441546d0 0x7f8f4414f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f440aa580 0x7f8f441481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 --2- 172.21.15.133:0/3432688133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f441542f0 0x7f8f440c33c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 >> 172.21.15.133:0/3432688133 conn(0x7f8f4405e1e0 msgr2=0x7f8f440c7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 shutdown_connections 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.415+0000 7f8f49a3b700 1 -- 172.21.15.133:0/3432688133 wait complete. 2024-01-21T20:18:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:18:06.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:06.448 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.459+0000 7f6915ec1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:18:06.518 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.529+0000 7f6915ec1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:18:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.553+0000 7fa6543bc700 1 Processor -- start 2024-01-21T20:18:06.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.553+0000 7fa6543bc700 1 -- start start 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa64c0a9e30 0x7fa64c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c065fb0 0x7fa64c0bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa64c0bd140 0x7fa64c0bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c0c2ff0 con 0x7fa64c0bd140 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64c1511f0 con 0x7fa64c0a9e30 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa6543bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c065b20 con 0x7fa64c065fb0 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa652959700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa64c0bd140 0x7fa64c0bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.554+0000 7fa652959700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa64c0bd140 0x7fa64c0bd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44674/0 (socket says 172.21.15.133:44674) 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 -- 172.21.15.133:0/975828140 learned_addr learned my addr 172.21.15.133:0/975828140 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa651957700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c065fb0 0x7fa64c0bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652158700 1 --2- 172.21.15.133:0/975828140 >> v2:172.21.15.178:3300/0 conn(0x7fa64c0a9e30 0x7fa64c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 -- 172.21.15.133:0/975828140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c065fb0 msgr2=0x7fa64c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c065fb0 0x7fa64c0bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 -- 172.21.15.133:0/975828140 >> v2:172.21.15.178:3300/0 conn(0x7fa64c0a9e30 msgr2=0x7fa64c0c2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 --2- 172.21.15.133:0/975828140 >> v2:172.21.15.178:3300/0 conn(0x7fa64c0a9e30 0x7fa64c0c2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 -- 172.21.15.133:0/975828140 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0c2240 con 0x7fa64c0bd140 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa652959700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c0bd5d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa64c05f0d0 tx=0x7fa644009840).ready entity=mon.0 client_cookie=e9f9b9796c1c8bc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa651156700 1 -- 172.21.15.133:0/975828140 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64400e070 con 0x7fa64c0bd140 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa651156700 1 -- 172.21.15.133:0/975828140 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64400b970 con 0x7fa64c0bd140 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.555+0000 7fa651156700 1 -- 172.21.15.133:0/975828140 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64400bcf0 con 0x7fa64c0bd140 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 -- 172.21.15.133:0/975828140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 msgr2=0x7fa64c0bd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c0bd5d0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7fa64c05f0d0 tx=0x7fa644009840).stop 2024-01-21T20:18:06.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 -- 172.21.15.133:0/975828140 shutdown_connections 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c0bd5d0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 --2- 172.21.15.133:0/975828140 >> v2:172.21.15.178:3300/0 conn(0x7fa64c0a9e30 0x7fa64c0c2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 --2- 172.21.15.133:0/975828140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c065fb0 0x7fa64c0bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 -- 172.21.15.133:0/975828140 >> 172.21.15.133:0/975828140 conn(0x7fa64c0c8200 msgr2=0x7fa64c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 -- 172.21.15.133:0/975828140 shutdown_connections 2024-01-21T20:18:06.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.556+0000 7fa6543bc700 1 -- 172.21.15.133:0/975828140 wait complete. 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.557+0000 7fa6543bc700 1 Processor -- start 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.557+0000 7fa6543bc700 1 -- start start 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 0x7fa64c151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c0a9e30 0x7fa64c1641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0aa700 con 0x7fa64c0bd140 2024-01-21T20:18:06.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0aacc0 con 0x7fa64c065fb0 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa6543bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1518d0 con 0x7fa64c0a9e30 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44682/0 (socket says 172.21.15.133:44682) 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 -- 172.21.15.133:0/1857281363 learned_addr learned my addr 172.21.15.133:0/1857281363 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa651957700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c0a9e30 0x7fa64c1641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652158700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 0x7fa64c151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c0a9e30 msgr2=0x7fa64c1641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c0a9e30 0x7fa64c1641b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 msgr2=0x7fa64c151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 0x7fa64c151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652959700 1 -- 172.21.15.133:0/1857281363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644009ae0 con 0x7fa64c0bd140 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.558+0000 7fa652158700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 0x7fa64c151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa652959700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fa64400b8a0 tx=0x7fa64c065c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64400bee0 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644007080 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c151bb0 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64401d6b0 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.559+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c1646a0 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.560+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c068b40 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.560+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fa644003040 con 0x7fa64c0bd140 2024-01-21T20:18:06.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.561+0000 7fa642ffd700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 0x7fa630061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.561+0000 7fa652158700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 msgr2=0x7fa630061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:06.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.561+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7fa64407baf0 con 0x7fa64c0bd140 2024-01-21T20:18:06.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.561+0000 7fa652158700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 0x7fa630061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:06.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.565+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa64404c770 con 0x7fa64c0bd140 2024-01-21T20:18:06.594 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.605+0000 7f6915ec1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:18:06.636 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:06.648+0000 7f71a5223680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:18:06.708 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:06.720+0000 7f71a5223680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:18:06.742 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.753+0000 7f6915ec1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:18:06.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.762+0000 7fa652158700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 msgr2=0x7fa630061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:06.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.762+0000 7fa652158700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 0x7fa630061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:06.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.779+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa64c151d40 con 0x7fa64c0bd140 2024-01-21T20:18:06.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.779+0000 7fa642ffd700 1 -- 172.21.15.133:0/1857281363 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fa644022070 con 0x7fa64c0bd140 2024-01-21T20:18:06.768 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:06.768 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:17:02.495526+0000","modified":"2024-01-21T20:17:04.500837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7632},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7632":{"gid":7632,"name":"c","rank":0,"incarnation":41,"state":"up:active","state_seq":4,"addr":"172.21.15.133:6837/3997755903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3997755903},{"type":"v1","addr":"172.21.15.133:6837","nonce":3997755903}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 msgr2=0x7fa630061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 0x7fa630061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 msgr2=0x7fa64c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7fa64400b8a0 tx=0x7fa64c065c60).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 shutdown_connections 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa63005f390 0x7fa630061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa64c0bd140 0x7fa64c153fd0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64c065fb0 0x7fa64c151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 --2- 172.21.15.133:0/1857281363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa64c0a9e30 0x7fa64c1641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 >> 172.21.15.133:0/1857281363 conn(0x7fa64c0c8200 msgr2=0x7fa64c0bdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 shutdown_connections 2024-01-21T20:18:06.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.781+0000 7fa6543bc700 1 -- 172.21.15.133:0/1857281363 wait complete. 2024-01-21T20:18:06.772 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2024-01-21T20:18:06.783 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:06.788 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:06.799+0000 7f71a5223680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:18:06.813 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.824+0000 7f6915ec1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:18:06.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.912+0000 7f36bb624700 1 Processor -- start 2024-01-21T20:18:06.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 -- start start 2024-01-21T20:18:06.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36b4137030 0x7f36b4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 0x7f36b40c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40c6290 con 0x7f36b4137410 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b4068370 con 0x7f36b4137030 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.913+0000 7f36bb624700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4068650 con 0x7f36b40c5930 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36b4137030 0x7f36b4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36b4137030 0x7f36b4067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44692/0 (socket says 172.21.15.133:44692) 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 -- 172.21.15.133:0/712816784 learned_addr learned my addr 172.21.15.133:0/712816784 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b9bc1700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 0x7f36b40c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 -- 172.21.15.133:0/712816784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 msgr2=0x7f36b40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 0x7f36b40c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 -- 172.21.15.133:0/712816784 >> v1:172.21.15.178:6789/0 conn(0x7f36b4137410 legacy=0x7f36b4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 -- 172.21.15.133:0/712816784 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4068930 con 0x7f36b4137030 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b9bc1700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 0x7f36b40c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36b93c0700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b4067d90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f36b0006fd0 tx=0x7f36b00090f0).ready entity=mon.0 client_cookie=7a9a881a8452ad2a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36abfff700 1 -- 172.21.15.133:0/712816784 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b000b600 con 0x7f36b4137030 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36abfff700 1 -- 172.21.15.133:0/712816784 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b000b760 con 0x7f36b4137030 2024-01-21T20:18:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.914+0000 7f36abfff700 1 -- 172.21.15.133:0/712816784 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b000bb00 con 0x7f36b4137030 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 -- 172.21.15.133:0/712816784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 msgr2=0x7f36b4067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b4067d90 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f36b0006fd0 tx=0x7f36b00090f0).stop 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 -- 172.21.15.133:0/712816784 shutdown_connections 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b4067d90 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 --2- 172.21.15.133:0/712816784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b40c5930 0x7f36b40c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 -- 172.21.15.133:0/712816784 >> 172.21.15.133:0/712816784 conn(0x7f36b4066a90 msgr2=0x7f36b4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 -- 172.21.15.133:0/712816784 shutdown_connections 2024-01-21T20:18:06.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.915+0000 7f36bb624700 1 -- 172.21.15.133:0/712816784 wait complete. 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.916+0000 7f36bb624700 1 Processor -- start 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.916+0000 7f36bb624700 1 -- start start 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 0x7f36b4135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b4137410 0x7f36b40ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b413bd60 con 0x7f36b4137030 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40adc90 con 0x7f36b40c5930 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36bb624700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b413cb50 con 0x7f36b4137410 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b93c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 0x7f36b4135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44694/0 (socket says 172.21.15.133:44694) 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b93c0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 0x7f36b4135b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:48308/0 (socket says 172.21.15.133:48308) 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 -- 172.21.15.133:0/2906240099 learned_addr learned my addr 172.21.15.133:0/2906240099 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b9bc1700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b4137410 0x7f36b40ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 -- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b4137410 msgr2=0x7f36b40ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b4137410 0x7f36b40ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 -- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 msgr2=0x7f36b4135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 0x7f36b4135b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 -- 172.21.15.133:0/2906240099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b0009370 con 0x7f36b4137030 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.917+0000 7f36b8bbf700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f36a400c440 tx=0x7f36a4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.918+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4007020 con 0x7f36b4137030 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.918+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4007180 con 0x7f36b4137030 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.918+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b413bf40 con 0x7f36b4137030 2024-01-21T20:18:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.918+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a4007520 con 0x7f36b4137030 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.918+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b413c500 con 0x7f36b4137030 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b413cd00 con 0x7f36b4137030 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f36a40068b0 con 0x7f36b4137030 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36a9ffb700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 0x7f3698061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36b93c0700 1 -- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 msgr2=0x7f3698061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6877+0+0 (secure 0 0 0) 0x7f36a4079aa0 con 0x7f36b4137030 2024-01-21T20:18:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.919+0000 7f36b93c0700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 0x7f3698061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:06.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:06.923+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f36a4047b00 con 0x7f36b4137030 2024-01-21T20:18:06.930 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:06.941+0000 7f6915ec1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:18:06.945 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:06.956+0000 7f71a5223680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:18:07.020 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.031+0000 7f71a5223680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:18:07.037 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:07.048+0000 7f6915ec1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:07.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.097+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36b413b180 con 0x7f36b4137030 2024-01-21T20:18:07.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.098+0000 7f36a9ffb700 1 -- 172.21.15.133:0/2906240099 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+18121 (secure 0 0 0) 0x7f36b413b180 con 0x7f36b4137030 2024-01-21T20:18:07.087 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:07.087 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":125,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:17:18.393520+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:17:01.059720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-01-21T20:17:01.464345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/310937302":"2024-01-22T20:17:18.393481+0000","172.21.15.133:0/2955466938":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6833/43404":"2024-01-22T20:17:18.393481+0000","172.21.15.133:6832/43404":"2024-01-22T20:17:18.393481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:07.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 msgr2=0x7f3698061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:07.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 0x7f3698061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:07.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 msgr2=0x7f36b40ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:07.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f36a400c440 tx=0x7f36a4007e00).stop 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 shutdown_connections 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f369805f390 0x7f3698061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36b4137410 0x7f36b40ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36b40c5930 0x7f36b4135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 --2- 172.21.15.133:0/2906240099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4137030 0x7f36b40ad2b0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 >> 172.21.15.133:0/2906240099 conn(0x7f36b4066a90 msgr2=0x7f36b41367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 shutdown_connections 2024-01-21T20:18:07.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.100+0000 7f36bb624700 1 -- 172.21.15.133:0/2906240099 wait complete. 2024-01-21T20:18:07.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T20:18:07.141 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.152+0000 7f71a5223680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:18:07.260 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.271+0000 7f71a5223680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:07.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.275+0000 7f4c4312f700 1 Processor -- start 2024-01-21T20:18:07.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.275+0000 7f4c4312f700 1 -- start start 2024-01-21T20:18:07.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c4312f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c4312f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c3c0c8120 0x7f4c3c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c4312f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3c0ab620 con 0x7f4c3c154520 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c4312f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3c0c6ae0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c4312f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0c05e0 con 0x7f4c3c154140 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c416cc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c3c0c8120 0x7f4c3c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54738/0 (socket says 172.21.15.133:54738) 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 -- 172.21.15.133:0/2512972576 learned_addr learned my addr 172.21.15.133:0/2512972576 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 -- 172.21.15.133:0/2512972576 >> v2:172.21.15.178:3300/0 conn(0x7f4c3c0c8120 msgr2=0x7f4c3c0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 --2- 172.21.15.133:0/2512972576 >> v2:172.21.15.178:3300/0 conn(0x7f4c3c0c8120 0x7f4c3c0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 -- 172.21.15.133:0/2512972576 >> v1:172.21.15.178:6789/0 conn(0x7f4c3c154520 legacy=0x7f4c3c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 -- 172.21.15.133:0/2512972576 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0c0e40 con 0x7f4c3c154140 2024-01-21T20:18:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.276+0000 7f4c40ecb700 1 --2- 172.21.15.133:0/2512972576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4c30006fd0 tx=0x7f4c300090f0).ready entity=mon.2 client_cookie=228536caa58c1cbe server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c3b7fe700 1 -- 172.21.15.133:0/2512972576 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000b580 con 0x7f4c3c154140 2024-01-21T20:18:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c3b7fe700 1 -- 172.21.15.133:0/2512972576 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3000b6e0 con 0x7f4c3c154140 2024-01-21T20:18:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c3b7fe700 1 -- 172.21.15.133:0/2512972576 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000ba60 con 0x7f4c3c154140 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 -- 172.21.15.133:0/2512972576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 msgr2=0x7f4c3c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 --2- 172.21.15.133:0/2512972576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4c30006fd0 tx=0x7f4c300090f0).stop 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 -- 172.21.15.133:0/2512972576 shutdown_connections 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 --2- 172.21.15.133:0/2512972576 >> v2:172.21.15.178:3300/0 conn(0x7f4c3c0c8120 0x7f4c3c0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 --2- 172.21.15.133:0/2512972576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c158bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 -- 172.21.15.133:0/2512972576 >> 172.21.15.133:0/2512972576 conn(0x7f4c3c05e1e0 msgr2=0x7f4c3c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 -- 172.21.15.133:0/2512972576 shutdown_connections 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.277+0000 7f4c4312f700 1 -- 172.21.15.133:0/2512972576 wait complete. 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.278+0000 7f4c4312f700 1 Processor -- start 2024-01-21T20:18:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.278+0000 7f4c4312f700 1 -- start start 2024-01-21T20:18:07.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c3c154520 0x7f4c3c0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0b01f0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0ae070 con 0x7f4c3c154520 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.279+0000 7f4c4312f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c0aebf0 con 0x7f4c3c154140 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44708/0 (socket says 172.21.15.133:44708) 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 -- 172.21.15.133:0/3626985336 learned_addr learned my addr 172.21.15.133:0/3626985336 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c416cc700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c3c154520 0x7f4c3c0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c3bfff700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 msgr2=0x7f4c3c144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c3c154520 msgr2=0x7f4c3c0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c3c154520 0x7f4c3c0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 -- 172.21.15.133:0/3626985336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009370 con 0x7f4c3c0c8120 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c40ecb700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4c3c0c6c20 tx=0x7f4c30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30000bc0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3000b850 con 0x7f4c3c0c8120 2024-01-21T20:18:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3c1453f0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30000d20 con 0x7f4c3c0c8120 2024-01-21T20:18:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.280+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3c0ae5a0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.281+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 55) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f4c3001daa0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.281+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3c05fdf0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.282+0000 7f4c397fa700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 0x7f4c20061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.282+0000 7f4c3bfff700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 msgr2=0x7f4c20061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.282+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6933+0+0 (secure 0 0 0) 0x7f4c3007c980 con 0x7f4c3c0c8120 2024-01-21T20:18:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.282+0000 7f4c3bfff700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 0x7f4c20061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.290+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c3004d620 con 0x7f4c3c0c8120 2024-01-21T20:18:07.336 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:07.346+0000 7f6915ec1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:18:07.406 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:07.417+0000 7f6915ec1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:18:07.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.483+0000 7f4c3bfff700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 msgr2=0x7f4c20061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:07.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.483+0000 7f4c3bfff700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 0x7f4c20061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:07.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.509+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4c3c0c00f0 con 0x7f4c3c0c8120 2024-01-21T20:18:07.571 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.582+0000 7f71a5223680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:18:07.642 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.653+0000 7f71a5223680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:18:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.673+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 56) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f4c3007a120 con 0x7f4c3c0c8120 2024-01-21T20:18:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.673+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 msgr2=0x7f4c20061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:07.673+0000 7f4c397fa700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 0x7f4c20061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:07.666 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.666 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.667 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.667 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.667 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2024-01-21T20:18:07.667 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:07.677+0000 7f149f545700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:18:07.672 INFO:tasks.ceph.mds.c.smithi133.stderr: -7703> 2024-01-21T20:17:07.489+0000 7f14a2d4c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:18:07.680 INFO:tasks.ceph.mds.c.smithi133.stderr: -8> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.680 INFO:tasks.ceph.mds.c.smithi133.stderr: -7> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.680 INFO:tasks.ceph.mds.c.smithi133.stderr: -6> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.681 INFO:tasks.ceph.mds.c.smithi133.stderr: -5> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T20:18:07.681 INFO:tasks.ceph.mds.c.smithi133.stderr: -4> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2024-01-21T20:18:07.681 INFO:tasks.ceph.mds.c.smithi133.stderr: -2> 2024-01-21T20:18:07.677+0000 7f149f545700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T20:18:07.701 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711d7cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711d7cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711d7cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711d7cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711d7cc700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.722 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711f7d0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.723 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711f7d0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.723 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711f7d0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.723 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711f7d0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:07.723 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:07.733+0000 7f711f7d0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:08.168 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T20:18:08.179+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T20:18:08.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.185+0000 7f4c397fa700 1 -- 172.21.15.133:0/3626985336 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4c30042f20 con 0x7f4c3c0c8120 2024-01-21T20:18:08.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 msgr2=0x7f4c3c0afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:08.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4c3c0c6c20 tx=0x7f4c30017000).stop 2024-01-21T20:18:08.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 shutdown_connections 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4c2005f390 0x7f4c20061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c3c154520 0x7f4c3c0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c3c0c8120 0x7f4c3c0afd00 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 --2- 172.21.15.133:0/3626985336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3c154140 0x7f4c3c144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 >> 172.21.15.133:0/3626985336 conn(0x7f4c3c05e1e0 msgr2=0x7f4c3c153120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 shutdown_connections 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.187+0000 7f4c4312f700 1 -- 172.21.15.133:0/3626985336 wait complete. 2024-01-21T20:18:08.177 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T20:18:08.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T20:18:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.320+0000 7fe9b2e83700 1 Processor -- start 2024-01-21T20:18:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.320+0000 7fe9b2e83700 1 -- start start 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b2e83700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b2e83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b2e83700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ac063750 con 0x7fe9ac0c4920 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b2e83700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ac0640d0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b2e83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac05e380 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b0c1f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9abfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b0c1f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:48432/0 (socket says 172.21.15.133:48432) 2024-01-21T20:18:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9abfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54854/0 (socket says 172.21.15.133:54854) 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b0c1f700 1 -- 172.21.15.133:0/1156756907 learned_addr learned my addr 172.21.15.133:0/1156756907 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.321+0000 7fe9b1420700 1 --1- 172.21.15.133:0/1156756907 >> v1:172.21.15.178:6789/0 conn(0x7fe9ac0c4920 0x7fe9ac1551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43842/0 (socket says 172.21.15.133:43842) 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9ab7fe700 1 -- 172.21.15.133:0/1156756907 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914079870 0 0) 0x7fe9ac063750 con 0x7fe9ac0c4920 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9ab7fe700 1 -- 172.21.15.133:0/1156756907 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe99c0033f0 con 0x7fe9ac0c4920 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9abfff700 1 -- 172.21.15.133:0/1156756907 >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 msgr2=0x7fe9ac0ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9abfff700 1 --2- 172.21.15.133:0/1156756907 >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9abfff700 1 -- 172.21.15.133:0/1156756907 >> v1:172.21.15.178:6789/0 conn(0x7fe9ac0c4920 legacy=0x7fe9ac1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9abfff700 1 -- 172.21.15.133:0/1156756907 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac05e660 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b0c1f700 1 --2- 172.21.15.133:0/1156756907 >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9abfff700 1 --2- 172.21.15.133:0/1156756907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe998009760 tx=0x7fe998009060).ready entity=mon.2 client_cookie=4b9f624f6b626da6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9ab7fe700 1 -- 172.21.15.133:0/1156756907 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980090d0 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9ab7fe700 1 -- 172.21.15.133:0/1156756907 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800d4a0 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9ab7fe700 1 -- 172.21.15.133:0/1156756907 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800d820 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 -- 172.21.15.133:0/1156756907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 msgr2=0x7fe9ac063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/1156756907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fe998009760 tx=0x7fe998009060).stop 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 -- 172.21.15.133:0/1156756907 shutdown_connections 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/1156756907 >> v2:172.21.15.178:3300/0 conn(0x7fe9ac0a9d10 0x7fe9ac0ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/1156756907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0aa0f0 0x7fe9ac063be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 -- 172.21.15.133:0/1156756907 >> 172.21.15.133:0/1156756907 conn(0x7fe9ac0c8200 msgr2=0x7fe9ac0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 -- 172.21.15.133:0/1156756907 shutdown_connections 2024-01-21T20:18:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.322+0000 7fe9b2e83700 1 -- 172.21.15.133:0/1156756907 wait complete. 2024-01-21T20:18:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.324+0000 7fe9b2e83700 1 Processor -- start 2024-01-21T20:18:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.324+0000 7fe9b2e83700 1 -- start start 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.324+0000 7fe9b2e83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 0x7fe9ac155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9ac0c4920 0x7fe9ac0c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0be810 con 0x7fe9ac0aa0f0 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac0bf0b0 con 0x7fe9ac0c4920 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ac153d00 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 0x7fe9ac155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44826/0 (socket says 172.21.15.133:44826) 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b1420700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9ac0c4920 0x7fe9ac0c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9abfff700 1 -- 172.21.15.133:0/2321398166 learned_addr learned my addr 172.21.15.133:0/2321398166 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 -- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9ac0c4920 msgr2=0x7fe9ac0c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9ac0c4920 0x7fe9ac0c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 -- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 msgr2=0x7fe9ac14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 -- 172.21.15.133:0/2321398166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a000b610 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9abfff700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b0c1f700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 0x7fe9ac155600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe9a000ee10 tx=0x7fe9a000b3b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000ee40 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a000dd30 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980092a0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a000dea0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.325+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ac0bea60 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.326+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac0bf390 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.327+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 56) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fe9a0010920 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.327+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7249+0+0 (secure 0 0 0) 0x7fe9a007a7d0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.332+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe9a004b6f0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.540+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9ac05fdf0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.678+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fe9a00781f0 con 0x7fe9ac0a9d10 2024-01-21T20:18:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.678+0000 7fe9a97fa700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 0x7fe9900680f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.679+0000 7fe9abfff700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 0x7fe9900680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:08.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:08.679+0000 7fe9abfff700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 0x7fe9900680f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe998009270 tx=0x7fe998016000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:09.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.185+0000 7fe9a97fa700 1 -- 172.21.15.133:0/2321398166 <== mon.2 v2:172.21.15.178:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9a0070310 con 0x7fe9ac0a9d10 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 msgr2=0x7fe9900680f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 0x7fe9900680f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fe998009270 tx=0x7fe998016000).stop 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 msgr2=0x7fe9ac155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 0x7fe9ac155600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe9a000ee10 tx=0x7fe9a000b3b0).stop 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 shutdown_connections 2024-01-21T20:18:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe9900302c0 0x7fe9900680f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9ac0c4920 0x7fe9ac0c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9ac0a9d10 0x7fe9ac155600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 --2- 172.21.15.133:0/2321398166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9ac0aa0f0 0x7fe9ac14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 >> 172.21.15.133:0/2321398166 conn(0x7fe9ac0c8200 msgr2=0x7fe9ac0aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 shutdown_connections 2024-01-21T20:18:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.188+0000 7fe9b2e83700 1 -- 172.21.15.133:0/2321398166 wait complete. 2024-01-21T20:18:09.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T20:18:09.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.323+0000 7fd12f1f8700 1 Processor -- start 2024-01-21T20:18:09.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.323+0000 7fd12f1f8700 1 -- start start 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.323+0000 7fd12f1f8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd128154250 0x7fd128154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12f1f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd128065f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12f1f8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12806a4b0 con 0x7fd128069510 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12f1f8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd128069ef0 con 0x7fd128154250 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12f1f8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12806a1d0 con 0x7fd128062e00 2024-01-21T20:18:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd128154250 0x7fd128154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd127fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd128069510 0x7fd1280626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55312/0 (socket says 172.21.15.133:55312) 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd127fff700 1 -- 172.21.15.133:0/2252353749 learned_addr learned my addr 172.21.15.133:0/2252353749 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 -- 172.21.15.133:0/2252353749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 msgr2=0x7fd128065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 --2- 172.21.15.133:0/2252353749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd128065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 -- 172.21.15.133:0/2252353749 >> v1:172.21.15.133:6789/0 conn(0x7fd128069510 legacy=0x7fd1280626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 -- 172.21.15.133:0/2252353749 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128065720 con 0x7fd128154250 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd1277fe700 1 -- 172.21.15.133:0/2252353749 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274582118 0 0) 0x7fd12806a4b0 con 0x7fd128069510 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd12cf94700 1 --2- 172.21.15.133:0/2252353749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd128154630 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fd11c009760 tx=0x7fd11c009060).ready entity=mon.0 client_cookie=5851c572dfae4d6f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd1277fe700 1 -- 172.21.15.133:0/2252353749 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00b580 con 0x7fd128154250 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd1277fe700 1 -- 172.21.15.133:0/2252353749 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c00b6e0 con 0x7fd128154250 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.324+0000 7fd1277fe700 1 -- 172.21.15.133:0/2252353749 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00ba60 con 0x7fd128154250 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 -- 172.21.15.133:0/2252353749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 msgr2=0x7fd128154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/2252353749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd128154630 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fd11c009760 tx=0x7fd11c009060).stop 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 -- 172.21.15.133:0/2252353749 shutdown_connections 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/2252353749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd128065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/2252353749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd128154630 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 -- 172.21.15.133:0/2252353749 >> 172.21.15.133:0/2252353749 conn(0x7fd1280c7d30 msgr2=0x7fd1280c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 -- 172.21.15.133:0/2252353749 shutdown_connections 2024-01-21T20:18:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.325+0000 7fd12f1f8700 1 -- 172.21.15.133:0/2252353749 wait complete. 2024-01-21T20:18:09.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.326+0000 7fd12f1f8700 1 Processor -- start 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.326+0000 7fd12f1f8700 1 -- start start 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd1280a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd128069510 0x7fd128152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281537e0 con 0x7fd128154250 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd128157300 con 0x7fd128069510 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12f1f8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1281575e0 con 0x7fd128062e00 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:44844/0 (socket says 172.21.15.133:44844) 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 -- 172.21.15.133:0/3552545222 learned_addr learned my addr 172.21.15.133:0/3552545222 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd127fff700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd128069510 0x7fd128152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12cf94700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd1280a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:09.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 -- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 msgr2=0x7fd1280a5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd1280a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 -- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd128069510 msgr2=0x7fd128152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd128069510 0x7fd128152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.327+0000 7fd12d795700 1 -- 172.21.15.133:0/3552545222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0092a0 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd12d795700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fd12000b760 tx=0x7fd120009310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000d600 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000d780 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1281578c0 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000db40 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.328+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd128157e80 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.329+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1281580a0 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.329+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fd120019460 con 0x7fd128154250 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.329+0000 7fd1257fa700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 0x7fd10c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.330+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 7249+0+0 (secure 0 0 0) 0x7fd12007a550 con 0x7fd128154250 2024-01-21T20:18:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.330+0000 7fd12cf94700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 0x7fd10c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.330+0000 7fd12cf94700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 0x7fd10c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd11c00b340 tx=0x7fd11c017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.334+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd12004b520 con 0x7fd128154250 2024-01-21T20:18:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:09.498+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd12805fdf0 con 0x7fd128154250 2024-01-21T20:18:10.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.186+0000 7fd1257fa700 1 -- 172.21.15.133:0/3552545222 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd12004eb40 con 0x7fd128154250 2024-01-21T20:18:10.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.191+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 msgr2=0x7fd10c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.191+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 0x7fd10c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd11c00b340 tx=0x7fd11c017000).stop 2024-01-21T20:18:10.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.191+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 msgr2=0x7fd1281532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.191+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fd12000b760 tx=0x7fd120009310).stop 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 shutdown_connections 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd10c05f030 0x7fd10c0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd128154250 0x7fd1281532f0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd128062e00 0x7fd1280a5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 --2- 172.21.15.133:0/3552545222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd128069510 0x7fd128152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 >> 172.21.15.133:0/3552545222 conn(0x7fd1280c7d30 msgr2=0x7fd1280c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 shutdown_connections 2024-01-21T20:18:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.192+0000 7fd12f1f8700 1 -- 172.21.15.133:0/3552545222 wait complete. 2024-01-21T20:18:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T20:18:10.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T20:18:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.330+0000 7f1a1548b700 1 Processor -- start 2024-01-21T20:18:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.330+0000 7f1a1548b700 1 -- start start 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a1548b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a10067080 0x7f1a10063800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a1548b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a10154a90 con 0x7f1a101371f0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a1548b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a10154d70 con 0x7f1a101375d0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a1548b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a10155050 con 0x7f1a10067080 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1a101371f0 0x7f1a10066970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54952/0 (socket says 172.21.15.133:54952) 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0effd700 1 -- 172.21.15.133:0/3572016286 learned_addr learned my addr 172.21.15.133:0/3572016286 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3572016286 >> v2:172.21.15.178:3300/0 conn(0x7f1a10067080 0x7f1a10063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999681195 0 0) 0x7f1a10154a90 con 0x7f1a101371f0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f80033f0 con 0x7f1a101371f0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914203622 0 0) 0x7f1a10154d70 con 0x7f1a101375d0 2024-01-21T20:18:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10154a90 con 0x7f1a101375d0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3507004825 0 0) 0x7f19f80033f0 con 0x7f1a101371f0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 >> v2:172.21.15.178:3300/0 conn(0x7f1a10067080 msgr2=0x7f1a10063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 --2- 172.21.15.133:0/3572016286 >> v2:172.21.15.178:3300/0 conn(0x7f1a10067080 0x7f1a10063800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 >> v1:172.21.15.178:6789/0 conn(0x7f1a101375d0 legacy=0x7f1a10067eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10155330 con 0x7f1a101371f0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1a00001470 con 0x7f1a101371f0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 >> v1:172.21.15.133:6789/0 conn(0x7f1a101371f0 legacy=0x7f1a10066970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f8003ac0 0x7f19f8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 0x7f19f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10155050 con 0x7f19f8005000 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800bf60 con 0x7f19f8003ac0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.331+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f800c120 con 0x7f19f8004690 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 0x7f19f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0effd700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f8003ac0 0x7f19f8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 -- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8004690 msgr2=0x7f19f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 -- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f8003ac0 msgr2=0x7f19f8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f8003ac0 0x7f19f8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 -- 172.21.15.133:0/3572016286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80033f0 con 0x7f19f8005000 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8004690 0x7f19f8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 -- 172.21.15.133:0/3572016286 reap_dead start 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0f7fe700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 0x7f19f800b8e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f1a08001fd0 tx=0x7f1a08007f30).ready entity=mon.0 client_cookie=2b7bf0abfdfc459f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08006a20 con 0x7f19f8005000 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08006b80 con 0x7f19f8005000 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a0dffb700 1 -- 172.21.15.133:0/3572016286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800c8b0 con 0x7f19f8005000 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a1548b700 1 -- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 msgr2=0x7f19f800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.332+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 0x7f19f800b8e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f1a08001fd0 tx=0x7f1a08007f30).stop 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.333+0000 7f1a1548b700 1 -- 172.21.15.133:0/3572016286 shutdown_connections 2024-01-21T20:18:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.333+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3572016286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19f8005000 0x7f19f800b8e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.333+0000 7f1a1548b700 1 -- 172.21.15.133:0/3572016286 >> 172.21.15.133:0/3572016286 conn(0x7f1a100c8f00 msgr2=0x7f1a100c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.333+0000 7f1a1548b700 1 -- 172.21.15.133:0/3572016286 shutdown_connections 2024-01-21T20:18:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.333+0000 7f1a1548b700 1 -- 172.21.15.133:0/3572016286 wait complete. 2024-01-21T20:18:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.334+0000 7f1a1548b700 1 Processor -- start 2024-01-21T20:18:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.334+0000 7f1a1548b700 1 -- start start 2024-01-21T20:18:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8005000 0x7f1a101677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a100ace60 0x7f1a100ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10167cc0 con 0x7f1a10164890 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a101361e0 con 0x7f1a100ace60 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a101389d0 con 0x7f19f8005000 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45474/0 (socket says 172.21.15.133:45474) 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 -- 172.21.15.133:0/3439564635 learned_addr learned my addr 172.21.15.133:0/3439564635 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0effd700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8005000 0x7f1a101677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0f7fe700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a100ace60 0x7f1a100ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 -- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8005000 msgr2=0x7f1a101677d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8005000 0x7f1a101677d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 -- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a100ace60 msgr2=0x7f1a100ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a100ace60 0x7f1a100ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 -- 172.21.15.133:0/3439564635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100ad7b0 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a0e7fc700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f1a040115c0 tx=0x7f1a04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040145f0 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04014750 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a100ab870 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04014ad0 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.335+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a101380a0 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.337+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a1005fdf0 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.337+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 57) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f1a04015480 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.337+0000 7f19f77fe700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 0x7f19fc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.337+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6811+0+0 (secure 0 0 0) 0x7f1a0407a870 con 0x7f1a10164890 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.337+0000 7f1a0effd700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 0x7f19fc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.338+0000 7f1a0effd700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 0x7f19fc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1a00001120 tx=0x7f1a00001d20).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.341+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1a0404ba00 con 0x7f1a10164890 2024-01-21T20:18:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.505+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a100c6d30 con 0x7f1a10164890 2024-01-21T20:18:10.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:10.679+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1a04078560 con 0x7f1a10164890 2024-01-21T20:18:11.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.189+0000 7f19f77fe700 1 -- 172.21.15.133:0/3439564635 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1a04070e90 con 0x7f1a10164890 2024-01-21T20:18:11.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 msgr2=0x7f19fc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 0x7f19fc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1a00001120 tx=0x7f1a00001d20).stop 2024-01-21T20:18:11.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 msgr2=0x7f1a100a93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f1a040115c0 tx=0x7f1a04008040).stop 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 shutdown_connections 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f19fc05f030 0x7f19fc0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a100ace60 0x7f1a100ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8005000 0x7f1a101677d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 --2- 172.21.15.133:0/3439564635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a10164890 0x7f1a100a93e0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 >> 172.21.15.133:0/3439564635 conn(0x7f1a100c8f00 msgr2=0x7f1a100c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 shutdown_connections 2024-01-21T20:18:11.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.192+0000 7f1a1548b700 1 -- 172.21.15.133:0/3439564635 wait complete. 2024-01-21T20:18:11.184 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T20:18:11.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T20:18:11.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.325+0000 7f79bcde0700 1 Processor -- start 2024-01-21T20:18:11.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.325+0000 7f79bcde0700 1 -- start start 2024-01-21T20:18:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79bcde0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79b80bf780 0x7f79b80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79bcde0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79bcde0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b8068760 con 0x7f79b8152860 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79bcde0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80c3ee0 con 0x7f79b80bf780 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79bcde0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b81535d0 con 0x7f79b80bfb60 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79b80bf780 0x7f79b80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f79b8152860 0x7f79b8152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54962/0 (socket says 172.21.15.133:54962) 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b6d9d700 1 -- 172.21.15.133:0/3018805355 learned_addr learned my addr 172.21.15.133:0/3018805355 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b5d9b700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 -- 172.21.15.133:0/3018805355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 msgr2=0x7f79b80c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 -- 172.21.15.133:0/3018805355 >> v1:172.21.15.133:6789/0 conn(0x7f79b8152860 legacy=0x7f79b8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b559a700 1 -- 172.21.15.133:0/3018805355 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860236689 0 0) 0x7f79b8068760 con 0x7f79b8152860 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 -- 172.21.15.133:0/3018805355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8067e30 con 0x7f79b80bf780 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b659c700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b80bf780 0x7f79b80c3500 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f79a8009760 tx=0x7f79a8009060).ready entity=mon.0 client_cookie=3a1f3b05483b9f02 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.326+0000 7f79b559a700 1 -- 172.21.15.133:0/3018805355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a80090d0 con 0x7f79b80bf780 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79b559a700 1 -- 172.21.15.133:0/3018805355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800b580 con 0x7f79b80bf780 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79b559a700 1 -- 172.21.15.133:0/3018805355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800b900 con 0x7f79b80bf780 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 -- 172.21.15.133:0/3018805355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b80bf780 msgr2=0x7f79b80c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b80bf780 0x7f79b80c3500 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f79a8009760 tx=0x7f79a8009060).stop 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 -- 172.21.15.133:0/3018805355 shutdown_connections 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b80bf780 0x7f79b80c3500 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3018805355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 -- 172.21.15.133:0/3018805355 >> 172.21.15.133:0/3018805355 conn(0x7f79b8066a90 msgr2=0x7f79b8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 -- 172.21.15.133:0/3018805355 shutdown_connections 2024-01-21T20:18:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.327+0000 7f79bcde0700 1 -- 172.21.15.133:0/3018805355 wait complete. 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.328+0000 7f79bcde0700 1 Processor -- start 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.328+0000 7f79bcde0700 1 -- start start 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b80bf780 0x7f79b80aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80c7e60 con 0x7f79b8152860 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80c32c0 con 0x7f79b80bf780 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79bcde0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80ab000 con 0x7f79b80bfb60 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79b6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79b6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45488/0 (socket says 172.21.15.133:45488) 2024-01-21T20:18:11.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.329+0000 7f79b6d9d700 1 -- 172.21.15.133:0/3478127677 learned_addr learned my addr 172.21.15.133:0/3478127677 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b5d9b700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b659c700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b80bf780 0x7f79b80aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 -- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 msgr2=0x7f79b80c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 -- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b80bf780 msgr2=0x7f79b80aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b80bf780 0x7f79b80aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 -- 172.21.15.133:0/3478127677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80092a0 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b5d9b700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79b6d9d700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f79b000c730 tx=0x7f79b0001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0005d30 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0005e90 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b80c7530 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0007340 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.330+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b80c7af0 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.331+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b80c8010 con 0x7f79b8152860 2024-01-21T20:18:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.331+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f79b00076f0 con 0x7f79b8152860 2024-01-21T20:18:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.332+0000 7f79a6ffd700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.332+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f79b007a2a0 con 0x7f79b8152860 2024-01-21T20:18:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.332+0000 7f79b659c700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.332+0000 7f79b659c700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 0x7f7998061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f79a800b340 tx=0x7f79a8017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.336+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f79b80c8010 con 0x7f79b8152860 2024-01-21T20:18:11.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.500+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f79b80c7fa0 con 0x7f79b8152860 2024-01-21T20:18:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.504+0000 7f79a6ffd700 1 -- 172.21.15.133:0/3478127677 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79b004b460 con 0x7f79b8152860 2024-01-21T20:18:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 msgr2=0x7f7998061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 0x7f7998061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f79a800b340 tx=0x7f79a8017000).stop 2024-01-21T20:18:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 msgr2=0x7f79b80c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f79b000c730 tx=0x7f79b0001520).stop 2024-01-21T20:18:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 shutdown_connections 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f799805f150 0x7f7998061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79b8152860 0x7f79b80c2cf0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b80bf780 0x7f79b80aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 --2- 172.21.15.133:0/3478127677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b80bfb60 0x7f79b80c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 >> 172.21.15.133:0/3478127677 conn(0x7f79b8066a90 msgr2=0x7f79b80ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 shutdown_connections 2024-01-21T20:18:11.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.506+0000 7f79bcde0700 1 -- 172.21.15.133:0/3478127677 wait complete. 2024-01-21T20:18:11.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T20:18:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.635+0000 7f4940a8c700 1 Processor -- start 2024-01-21T20:18:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.635+0000 7f4940a8c700 1 -- start start 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4940a8c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 0x7f493c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4940a8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4940a8c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c065660 con 0x7f493c0beb30 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4940a8c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0bef10 con 0x7f493c069ef0 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4940a8c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c156070 con 0x7f493c0c3fb0 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f493ad9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f4939d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 0x7f493c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f493ad9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:41612/0 (socket says 172.21.15.133:41612) 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f493ad9d700 1 -- 172.21.15.133:0/3179079940 learned_addr learned my addr 172.21.15.133:0/3179079940 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.636+0000 7f493a59c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f493c0beb30 0x7f493c0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39386/0 (socket says 172.21.15.133:39386) 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493ad9d700 1 -- 172.21.15.133:0/3179079940 >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 msgr2=0x7f493c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493ad9d700 1 --2- 172.21.15.133:0/3179079940 >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 0x7f493c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493ad9d700 1 -- 172.21.15.133:0/3179079940 >> v1:172.21.15.178:6789/0 conn(0x7f493c0beb30 legacy=0x7f493c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493ad9d700 1 -- 172.21.15.133:0/3179079940 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c065f00 con 0x7f493c0c3fb0 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f4939d9b700 1 --2- 172.21.15.133:0/3179079940 >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 0x7f493c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493ad9d700 1 --2- 172.21.15.133:0/3179079940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f493400d1a0 tx=0x7f493400ba50).ready entity=mon.2 client_cookie=ecb813d09f5d30b8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493959a700 1 -- 172.21.15.133:0/3179079940 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934010070 con 0x7f493c0c3fb0 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493959a700 1 -- 172.21.15.133:0/3179079940 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400de10 con 0x7f493c0c3fb0 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.637+0000 7f493959a700 1 -- 172.21.15.133:0/3179079940 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400b2e0 con 0x7f493c0c3fb0 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 -- 172.21.15.133:0/3179079940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 msgr2=0x7f493c066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 --2- 172.21.15.133:0/3179079940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f493400d1a0 tx=0x7f493400ba50).stop 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 -- 172.21.15.133:0/3179079940 shutdown_connections 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 --2- 172.21.15.133:0/3179079940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c066390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 --2- 172.21.15.133:0/3179079940 >> v2:172.21.15.178:3300/0 conn(0x7f493c069ef0 0x7f493c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 -- 172.21.15.133:0/3179079940 >> 172.21.15.133:0/3179079940 conn(0x7f493c0c8010 msgr2=0x7f493c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 -- 172.21.15.133:0/3179079940 shutdown_connections 2024-01-21T20:18:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.638+0000 7f4940a8c700 1 -- 172.21.15.133:0/3179079940 wait complete. 2024-01-21T20:18:11.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.639+0000 7f4940a8c700 1 Processor -- start 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.639+0000 7f4940a8c700 1 -- start start 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069ef0 0x7f493c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c0a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0c0230 con 0x7f493c0beb30 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0bf620 con 0x7f493c069ef0 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4940a8c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0bf900 con 0x7f493c0c3fb0 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4939d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4939d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45492/0 (socket says 172.21.15.133:45492) 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f4939d9b700 1 -- 172.21.15.133:0/2749215092 learned_addr learned my addr 172.21.15.133:0/2749215092 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f493ad9d700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c0a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.640+0000 7f493a59c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069ef0 0x7f493c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 -- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 msgr2=0x7f493c0a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c0a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 -- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069ef0 msgr2=0x7f493c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069ef0 0x7f493c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 -- 172.21.15.133:0/2749215092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0092a0 con 0x7f493c0beb30 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4939d9b700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f492c00e9d0 tx=0x7f492c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00c6a0 con 0x7f493c0beb30 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c00c800 con 0x7f493c0beb30 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493400bcf0 con 0x7f493c0beb30 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c00cb80 con 0x7f493c0beb30 2024-01-21T20:18:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.641+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c0bfec0 con 0x7f493c0beb30 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.642+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c05fdf0 con 0x7f493c0beb30 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.642+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f492c01b400 con 0x7f493c0beb30 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.643+0000 7f492affd700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 0x7f491c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.643+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f492c07a850 con 0x7f493c0beb30 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.643+0000 7f493a59c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 0x7f491c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.643+0000 7f493a59c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 0x7f491c061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4930007fd0 tx=0x7f4930007d30).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.647+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f492c04ba60 con 0x7f493c0beb30 2024-01-21T20:18:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.823+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f493c0c7d00 con 0x7f493c0beb30 2024-01-21T20:18:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.826+0000 7f492affd700 1 -- 172.21.15.133:0/2749215092 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f492c0160b0 con 0x7f493c0beb30 2024-01-21T20:18:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 msgr2=0x7f491c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 0x7f491c061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f4930007fd0 tx=0x7f4930007d30).stop 2024-01-21T20:18:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 msgr2=0x7f493c0a6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f492c00e9d0 tx=0x7f492c009060).stop 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 shutdown_connections 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f491c05f150 0x7f491c061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c0c3fb0 0x7f493c0a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069ef0 0x7f493c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 --2- 172.21.15.133:0/2749215092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0beb30 0x7f493c0a6bf0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 >> 172.21.15.133:0/2749215092 conn(0x7f493c0c8010 msgr2=0x7f493c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 shutdown_connections 2024-01-21T20:18:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.828+0000 7f4940a8c700 1 -- 172.21.15.133:0/2749215092 wait complete. 2024-01-21T20:18:11.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2024-01-21T20:18:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.956+0000 7f52b8e88700 1 Processor -- start 2024-01-21T20:18:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.956+0000 7f52b8e88700 1 -- start start 2024-01-21T20:18:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b8e88700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52b4155ca0 0x7f52b40bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b8e88700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b40bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b8e88700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b40a50f0 con 0x7f52b41558c0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b8e88700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b40bdb60 con 0x7f52b4155ca0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b8e88700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b40a4da0 con 0x7f52b4062e00 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52b4155ca0 0x7f52b40bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f52b41558c0 0x7f52b40626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54966/0 (socket says 172.21.15.133:54966) 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b259c700 1 -- 172.21.15.133:0/893152044 learned_addr learned my addr 172.21.15.133:0/893152044 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b2d9d700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b40bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 -- 172.21.15.133:0/893152044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 msgr2=0x7f52b40bd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b40bd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 -- 172.21.15.133:0/893152044 >> v1:172.21.15.133:6789/0 conn(0x7f52b41558c0 legacy=0x7f52b40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b159a700 1 -- 172.21.15.133:0/893152044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115047240 0 0) 0x7f52b40a50f0 con 0x7f52b41558c0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 -- 172.21.15.133:0/893152044 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40bde00 con 0x7f52b4155ca0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b2d9d700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.957+0000 7f52b1d9b700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b4155ca0 0x7f52b40bd180 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f52a4009760 tx=0x7f52a4009060).ready entity=mon.0 client_cookie=d15862993e047419 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b159a700 1 -- 172.21.15.133:0/893152044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a40090d0 con 0x7f52b4155ca0 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b159a700 1 -- 172.21.15.133:0/893152044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400b580 con 0x7f52b4155ca0 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b159a700 1 -- 172.21.15.133:0/893152044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a400b900 con 0x7f52b4155ca0 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 -- 172.21.15.133:0/893152044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b4155ca0 msgr2=0x7f52b40bd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b4155ca0 0x7f52b40bd180 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f52a4009760 tx=0x7f52a4009060).stop 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 -- 172.21.15.133:0/893152044 shutdown_connections 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b40bd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 --2- 172.21.15.133:0/893152044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b4155ca0 0x7f52b40bd180 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 -- 172.21.15.133:0/893152044 >> 172.21.15.133:0/893152044 conn(0x7f52b40c8010 msgr2=0x7f52b40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 -- 172.21.15.133:0/893152044 shutdown_connections 2024-01-21T20:18:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.958+0000 7f52b8e88700 1 -- 172.21.15.133:0/893152044 wait complete. 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 Processor -- start 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 -- start start 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b4151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b4155ca0 0x7f52b40addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4165540 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4151770 con 0x7f52b4155ca0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.960+0000 7f52b8e88700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b4164930 con 0x7f52b4062e00 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45514/0 (socket says 172.21.15.133:45514) 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 -- 172.21.15.133:0/3096973273 learned_addr learned my addr 172.21.15.133:0/3096973273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 -- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 msgr2=0x7f52b4151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b4151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 -- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b4155ca0 msgr2=0x7f52b40addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b4155ca0 0x7f52b40addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 -- 172.21.15.133:0/3096973273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a40092a0 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b1d9b700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f52a4009eb0 tx=0x7f52a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a4006990 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a400bcc0 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a401b410 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b4164c10 con 0x7f52b41558c0 2024-01-21T20:18:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.961+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b41651d0 con 0x7f52b41558c0 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.962+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b40c2430 con 0x7f52b41558c0 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.962+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f52a401b7c0 con 0x7f52b41558c0 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.963+0000 7f52a2ffd700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 0x7f5294061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.963+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f52a407b9e0 con 0x7f52b41558c0 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.963+0000 7f52b259c700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 0x7f5294061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.963+0000 7f52b259c700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 0x7f5294061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f52a80011e0 tx=0x7f52a8007850).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:11.967+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f52a404cba0 con 0x7f52b41558c0 2024-01-21T20:18:12.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:12.195+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f52b414f640 con 0x7f52b41558c0 2024-01-21T20:18:13.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.198+0000 7f52a2ffd700 1 -- 172.21.15.133:0/3096973273 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v706) v1 ==== 148+0+0 (secure 0 0 0) 0x7f52b414f640 con 0x7f52b41558c0 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 msgr2=0x7f5294061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 0x7f5294061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f52a80011e0 tx=0x7f52a8007850).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 msgr2=0x7f52b40ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f52a4009eb0 tx=0x7f52a4017000).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 shutdown_connections 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f529405f150 0x7f5294061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b4155ca0 0x7f52b40addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b4062e00 0x7f52b4151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 --2- 172.21.15.133:0/3096973273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52b41558c0 0x7f52b40ad8d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 >> 172.21.15.133:0/3096973273 conn(0x7f52b40c8010 msgr2=0x7f52b40c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 shutdown_connections 2024-01-21T20:18:13.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.201+0000 7f52b8e88700 1 -- 172.21.15.133:0/3096973273 wait complete. 2024-01-21T20:18:13.206 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2024-01-21T20:18:13.206 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2024-01-21T20:18:13.206 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T20:18:13.206 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2024-01-21T20:18:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.338+0000 7f40a0018700 1 Processor -- start 2024-01-21T20:18:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.338+0000 7f40a0018700 1 -- start start 2024-01-21T20:18:13.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f40a0018700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40980c3840 0x7f40980c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f40a0018700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40980c6250 0x7f40980bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f40a0018700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4098067f10 con 0x7f40980c5dc0 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f40a0018700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980681f0 con 0x7f40980c3840 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f40a0018700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980684d0 con 0x7f40980c6250 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40980c3840 0x7f40980c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409d5b3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f40980c5dc0 0x7f409813a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54982/0 (socket says 172.21.15.133:54982) 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409d5b3700 1 -- 172.21.15.133:0/254182825 learned_addr learned my addr 172.21.15.133:0/254182825 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409e5b5700 1 --2- 172.21.15.133:0/254182825 >> v2:172.21.15.178:3300/0 conn(0x7f40980c6250 0x7f40980bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 -- 172.21.15.133:0/254182825 >> v2:172.21.15.178:3300/0 conn(0x7f40980c6250 msgr2=0x7f40980bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 --2- 172.21.15.133:0/254182825 >> v2:172.21.15.178:3300/0 conn(0x7f40980c6250 0x7f40980bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 -- 172.21.15.133:0/254182825 >> v1:172.21.15.133:6789/0 conn(0x7f40980c5dc0 legacy=0x7f409813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409cdb2700 1 -- 172.21.15.133:0/254182825 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663843924 0 0) 0x7f4098067f10 con 0x7f40980c5dc0 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 -- 172.21.15.133:0/254182825 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980687b0 con 0x7f40980c3840 2024-01-21T20:18:13.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409ddb4700 1 --2- 172.21.15.133:0/254182825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c3840 0x7f40980c3c20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f40980c8eb0 tx=0x7f4094009060).ready entity=mon.0 client_cookie=41c4e11742191fb5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409cdb2700 1 -- 172.21.15.133:0/254182825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940090d0 con 0x7f40980c3840 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409cdb2700 1 -- 172.21.15.133:0/254182825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409400b580 con 0x7f40980c3840 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.339+0000 7f409cdb2700 1 -- 172.21.15.133:0/254182825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409400b900 con 0x7f40980c3840 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 -- 172.21.15.133:0/254182825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c3840 msgr2=0x7f40980c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 --2- 172.21.15.133:0/254182825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c3840 0x7f40980c3c20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f40980c8eb0 tx=0x7f4094009060).stop 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 -- 172.21.15.133:0/254182825 shutdown_connections 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 --2- 172.21.15.133:0/254182825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c3840 0x7f40980c3c20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 --2- 172.21.15.133:0/254182825 >> v2:172.21.15.178:3300/0 conn(0x7f40980c6250 0x7f40980bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 -- 172.21.15.133:0/254182825 >> 172.21.15.133:0/254182825 conn(0x7f4098066a70 msgr2=0x7f4098066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 -- 172.21.15.133:0/254182825 shutdown_connections 2024-01-21T20:18:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.340+0000 7f40a0018700 1 -- 172.21.15.133:0/254182825 wait complete. 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.341+0000 7f40a0018700 1 Processor -- start 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.341+0000 7f40a0018700 1 -- start start 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 0x7f4098138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40980c6250 0x7f4098151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981393c0 con 0x7f40980c5dc0 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4098138530 con 0x7f40980c6250 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f40a0018700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40981387b0 con 0x7f40980c3840 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45536/0 (socket says 172.21.15.133:45536) 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 -- 172.21.15.133:0/1342098736 learned_addr learned my addr 172.21.15.133:0/1342098736 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409e5b5700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40980c6250 0x7f4098151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409ddb4700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 0x7f4098138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 -- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 msgr2=0x7f4098138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 0x7f4098138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 -- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40980c6250 msgr2=0x7f4098151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40980c6250 0x7f4098151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409d5b3700 1 -- 172.21.15.133:0/1342098736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940092a0 con 0x7f40980c5dc0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.342+0000 7f409ddb4700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 0x7f4098138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f409d5b3700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f408800c4e0 tx=0x7f4088007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880072e0 con 0x7f40980c5dc0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4088007440 con 0x7f40980c5dc0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4098138a90 con 0x7f40980c5dc0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880057a0 con 0x7f40980c5dc0 2024-01-21T20:18:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.343+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4098139050 con 0x7f40980c5dc0 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.344+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409805fdf0 con 0x7f40980c5dc0 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.344+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4088005bd0 con 0x7f40980c5dc0 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.344+0000 7f408e7fc700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 0x7f407c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.345+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f4088079b70 con 0x7f40980c5dc0 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.345+0000 7f409ddb4700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 0x7f407c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:13.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.345+0000 7f409ddb4700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 0x7f407c061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f409400b340 tx=0x7f4094017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:13.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.349+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f408804ad30 con 0x7f40980c5dc0 2024-01-21T20:18:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:13.576+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f4098068ec0 con 0x7f40980c5dc0 2024-01-21T20:18:14.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.205+0000 7f408e7fc700 1 -- 172.21.15.133:0/1342098736 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v707) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4088018030 con 0x7f40980c5dc0 2024-01-21T20:18:14.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 msgr2=0x7f407c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 0x7f407c061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f409400b340 tx=0x7f4094017000).stop 2024-01-21T20:18:14.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 msgr2=0x7f4098151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f408800c4e0 tx=0x7f4088007c70).stop 2024-01-21T20:18:14.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 shutdown_connections 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f407c05f150 0x7f407c061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40980c6250 0x7f4098151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40980c3840 0x7f4098138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 --2- 172.21.15.133:0/1342098736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40980c5dc0 0x7f4098151c50 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 >> 172.21.15.133:0/1342098736 conn(0x7f4098066a70 msgr2=0x7f4098154910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 shutdown_connections 2024-01-21T20:18:14.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.208+0000 7f40a0018700 1 -- 172.21.15.133:0/1342098736 wait complete. 2024-01-21T20:18:14.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T20:18:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.344+0000 7f0541627700 1 Processor -- start 2024-01-21T20:18:14.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.344+0000 7f0541627700 1 -- start start 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0541627700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f053c0a9e30 0x7f053c0bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0541627700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c0654f0 con 0x7f053c1546b0 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0541627700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053c063700 con 0x7f053c154a90 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0541627700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053c063950 con 0x7f053c0a9e30 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f053c0a9e30 0x7f053c0bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f053c0a9e30 0x7f053c0bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45548/0 (socket says 172.21.15.133:45548) 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f053c1546b0 0x7f053c065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54984/0 (socket says 172.21.15.133:54984) 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 -- 172.21.15.133:0/1799481050 learned_addr learned my addr 172.21.15.133:0/1799481050 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 -- 172.21.15.133:0/1799481050 >> v1:172.21.15.178:6789/0 conn(0x7f053c154a90 legacy=0x7f053c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 -- 172.21.15.133:0/1799481050 >> v1:172.21.15.133:6789/0 conn(0x7f053c1546b0 legacy=0x7f053c065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 -- 172.21.15.133:0/1799481050 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c065180 con 0x7f053c0a9e30 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0539ffb700 1 -- 172.21.15.133:0/1799481050 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278899049 0 0) 0x7f053c0654f0 con 0x7f053c1546b0 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f053b7fe700 1 --2- 172.21.15.133:0/1799481050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c0a9e30 0x7f053c0bc6d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f0534009f20 tx=0x7f0534009840).ready entity=mon.0 client_cookie=98f38b50d6b4ec7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0539ffb700 1 -- 172.21.15.133:0/1799481050 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400e070 con 0x7f053c0a9e30 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0539ffb700 1 -- 172.21.15.133:0/1799481050 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053400ba80 con 0x7f053c0a9e30 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.345+0000 7f0539ffb700 1 -- 172.21.15.133:0/1799481050 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400be00 con 0x7f053c0a9e30 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 -- 172.21.15.133:0/1799481050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c0a9e30 msgr2=0x7f053c0bc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 --2- 172.21.15.133:0/1799481050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c0a9e30 0x7f053c0bc6d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f0534009f20 tx=0x7f0534009840).stop 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 -- 172.21.15.133:0/1799481050 shutdown_connections 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 --2- 172.21.15.133:0/1799481050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c0a9e30 0x7f053c0bc6d0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 -- 172.21.15.133:0/1799481050 >> 172.21.15.133:0/1799481050 conn(0x7f053c0c8200 msgr2=0x7f053c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 -- 172.21.15.133:0/1799481050 shutdown_connections 2024-01-21T20:18:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.346+0000 7f0541627700 1 -- 172.21.15.133:0/1799481050 wait complete. 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.347+0000 7f0541627700 1 Processor -- start 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.347+0000 7f0541627700 1 -- start start 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f053c0a9e30 0x7f053c143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 0x7f053c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c143830 con 0x7f053c154a90 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0ab5d0 con 0x7f053c0a9e30 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f0541627700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0bf860 con 0x7f053c1546b0 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f053b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f053b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45558/0 (socket says 172.21.15.133:45558) 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f053b7fe700 1 -- 172.21.15.133:0/601015062 learned_addr learned my addr 172.21.15.133:0/601015062 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f053affd700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f053c0a9e30 0x7f053c143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.348+0000 7f053a7fc700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 0x7f053c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 -- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 msgr2=0x7f053c0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 0x7f053c0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 -- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f053c0a9e30 msgr2=0x7f053c143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f053c0a9e30 0x7f053c143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 -- 172.21.15.133:0/601015062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009ae0 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053a7fc700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 0x7f053c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f053b7fe700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f053400bff0 tx=0x7f0534009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400be00 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053401d460 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0bfe20 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053401d7e0 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.349+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c0ab7c0 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.350+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c0c4eb0 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.350+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0534003040 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.350+0000 7f05237fe700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 0x7f0528061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.351+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f053407b950 con 0x7f053c154a90 2024-01-21T20:18:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.351+0000 7f053affd700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 0x7f0528061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.351+0000 7f053affd700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 0x7f0528061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f052c000c00 tx=0x7f052c007c30).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.355+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f053404cbc0 con 0x7f053c154a90 2024-01-21T20:18:14.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.519+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f053c05fdf0 con 0x7f053c154a90 2024-01-21T20:18:14.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.522+0000 7f05237fe700 1 -- 172.21.15.133:0/601015062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0534022070 con 0x7f053c154a90 2024-01-21T20:18:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 msgr2=0x7f0528061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 0x7f0528061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f052c000c00 tx=0x7f052c007c30).stop 2024-01-21T20:18:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 msgr2=0x7f053c0ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f053400bff0 tx=0x7f0534009840).stop 2024-01-21T20:18:14.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 shutdown_connections 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f052805f150 0x7f0528061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f053c154a90 0x7f053c0ad160 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f053c0a9e30 0x7f053c143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 --2- 172.21.15.133:0/601015062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f053c1546b0 0x7f053c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 >> 172.21.15.133:0/601015062 conn(0x7f053c0c8200 msgr2=0x7f053c151500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 shutdown_connections 2024-01-21T20:18:14.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.524+0000 7f0541627700 1 -- 172.21.15.133:0/601015062 wait complete. 2024-01-21T20:18:14.527 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T20:18:14.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:18:14.569 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T20:18:14.615 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T20:18:14.615 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T20:18:14.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:14.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.741+0000 7f53d8484700 1 Processor -- start 2024-01-21T20:18:14.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.741+0000 7f53d8484700 1 -- start start 2024-01-21T20:18:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d8484700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d00beb30 0x7f53d0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d8484700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d00c3fb0 0x7f53d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d8484700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d0065660 con 0x7f53d0069cd0 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d8484700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d00bef10 con 0x7f53d00beb30 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d8484700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0156070 con 0x7f53d00c3fb0 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d00beb30 0x7f53d0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d00beb30 0x7f53d0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45568/0 (socket says 172.21.15.133:45568) 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 -- 172.21.15.133:0/2325172380 learned_addr learned my addr 172.21.15.133:0/2325172380 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d5a1f700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d00c3fb0 0x7f53d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 -- 172.21.15.133:0/2325172380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d00c3fb0 msgr2=0x7f53d00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d00c3fb0 0x7f53d00697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 -- 172.21.15.133:0/2325172380 >> v1:172.21.15.178:6789/0 conn(0x7f53d0069cd0 legacy=0x7f53d0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.742+0000 7f53d6220700 1 -- 172.21.15.133:0/2325172380 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d0065f00 con 0x7f53d00beb30 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d6220700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d0155b80 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f53cc006fd0 tx=0x7f53cc0090f0).ready entity=mon.0 client_cookie=39a9eac91e43b932 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d521e700 1 -- 172.21.15.133:0/2325172380 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00b600 con 0x7f53d00beb30 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d521e700 1 -- 172.21.15.133:0/2325172380 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc00b760 con 0x7f53d00beb30 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d521e700 1 -- 172.21.15.133:0/2325172380 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00bb00 con 0x7f53d00beb30 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 -- 172.21.15.133:0/2325172380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 msgr2=0x7f53d0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d0155b80 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f53cc006fd0 tx=0x7f53cc0090f0).stop 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 -- 172.21.15.133:0/2325172380 shutdown_connections 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d0155b80 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 --2- 172.21.15.133:0/2325172380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d00c3fb0 0x7f53d00697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 -- 172.21.15.133:0/2325172380 >> 172.21.15.133:0/2325172380 conn(0x7f53d00c8010 msgr2=0x7f53d00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 -- 172.21.15.133:0/2325172380 shutdown_connections 2024-01-21T20:18:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.743+0000 7f53d8484700 1 -- 172.21.15.133:0/2325172380 wait complete. 2024-01-21T20:18:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 Processor -- start 2024-01-21T20:18:14.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 -- start start 2024-01-21T20:18:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d0069cd0 0x7f53d0150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 0x7f53d00bd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00bdbd0 con 0x7f53d00beb30 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d0165ab0 con 0x7f53d00c3fb0 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d8484700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d00a8530 con 0x7f53d0069cd0 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d5a1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d5a1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45574/0 (socket says 172.21.15.133:45574) 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.745+0000 7f53d5a1f700 1 -- 172.21.15.133:0/3210735735 learned_addr learned my addr 172.21.15.133:0/3210735735 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d6220700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d0069cd0 0x7f53d0150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d6a21700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 0x7f53d00bd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 -- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d0069cd0 msgr2=0x7f53d0150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d0069cd0 0x7f53d0150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 -- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 msgr2=0x7f53d00bd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 0x7f53d00bd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 -- 172.21.15.133:0/3210735735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009370 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d6a21700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 0x7f53d00bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d5a1f700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f53c000d8c0 tx=0x7f53c0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c00095b0 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0009710 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d0164bc0 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0009a90 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.746+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d0165180 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.747+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d00bf090 con 0x7f53d00beb30 2024-01-21T20:18:14.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.747+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f53c0013480 con 0x7f53d00beb30 2024-01-21T20:18:14.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.748+0000 7f53c6ffd700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 0x7f53b4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:14.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.748+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f53c007a0d0 con 0x7f53d00beb30 2024-01-21T20:18:14.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.748+0000 7f53d6220700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 0x7f53b4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:14.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.748+0000 7f53d6220700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 0x7f53b4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53cc00b3c0 tx=0x7f53cc017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:14.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.752+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f53c004b230 con 0x7f53d00beb30 2024-01-21T20:18:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.958+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53d005fdf0 con 0x7f53d00beb30 2024-01-21T20:18:14.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.958+0000 7f53c6ffd700 1 -- 172.21.15.133:0/3210735735 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f53c004e850 con 0x7f53d00beb30 2024-01-21T20:18:14.949 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:14.949 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":45,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6257,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/950913094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":950913094},{"type":"v1","addr":"172.21.15.178:6833","nonce":950913094}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6521,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1479037828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1479037828},{"type":"v1","addr":"172.21.15.133:6837","nonce":1479037828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2433229944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2433229944},{"type":"v1","addr":"172.21.15.178:6835","nonce":2433229944}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":7629,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2856830180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2856830180},{"type":"v1","addr":"172.21.15.133:6836","nonce":2856830180}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39}],"filesystems":[]} 2024-01-21T20:18:14.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 msgr2=0x7f53b4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 0x7f53b4061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f53cc00b3c0 tx=0x7f53cc017000).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 msgr2=0x7f53d00bd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f53c000d8c0 tx=0x7f53c0008040).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 shutdown_connections 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f53b405f150 0x7f53b4061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53d00c3fb0 0x7f53d00bd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53d0069cd0 0x7f53d0150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 --2- 172.21.15.133:0/3210735735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d00beb30 0x7f53d00bd1f0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 >> 172.21.15.133:0/3210735735 conn(0x7f53d00c8010 msgr2=0x7f53d00c3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 shutdown_connections 2024-01-21T20:18:14.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:14.960+0000 7f53d8484700 1 -- 172.21.15.133:0/3210735735 wait complete. 2024-01-21T20:18:14.952 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 45 2024-01-21T20:18:14.963 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T20:18:14.963 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T20:18:14.963 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T20:18:14.963 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:18:14.963 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T20:18:14.963 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T20:18:14.964 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T20:18:14.964 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:18:14.964 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T20:18:14.964 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T20:18:14.964 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T20:18:14.964 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:18:14.964 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T20:18:14.965 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T20:18:14.965 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T20:18:14.965 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T20:18:14.973 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T20:18:14.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T20:18:14.974 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T20:18:14.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T20:18:14.976 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T20:18:14.976 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T20:18:14.977 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T20:18:14.977 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T20:18:15.014 INFO:tasks.ceph.mds.a:Started 2024-01-21T20:18:15.015 DEBUG:teuthology.parallel:result is None 2024-01-21T20:18:15.015 INFO:tasks.ceph.mds.c:Started 2024-01-21T20:18:15.015 DEBUG:teuthology.parallel:result is None 2024-01-21T20:18:15.019 INFO:tasks.ceph.mds.b:Started 2024-01-21T20:18:15.019 DEBUG:teuthology.parallel:result is None 2024-01-21T20:18:15.020 INFO:tasks.ceph.mds.d:Started 2024-01-21T20:18:15.020 DEBUG:teuthology.parallel:result is None 2024-01-21T20:18:15.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T20:18:15.090 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T20:18:15.090 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T20:18:15.090 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T20:18:15.100+0000 7fcd68a4b700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-01-21T20:18:15.105 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T20:18:15.105 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T20:18:15.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.157+0000 7f3548774700 1 Processor -- start 2024-01-21T20:18:15.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.157+0000 7f3548774700 1 -- start start 2024-01-21T20:18:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3548774700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f35401351d0 0x7f35400c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3548774700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 0x7f3540155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3548774700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3540156650 con 0x7f35401561a0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3548774700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35400c61a0 con 0x7f35401351d0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3548774700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35400c5350 con 0x7f35400c3c60 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3546d11700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f35401561a0 0x7f35401526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55032/0 (socket says 172.21.15.133:55032) 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3546d11700 1 -- 172.21.15.133:0/3406270323 learned_addr learned my addr 172.21.15.133:0/3406270323 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3546510700 1 --2- 172.21.15.133:0/3406270323 >> v2:172.21.15.178:3300/0 conn(0x7f35401351d0 0x7f35400c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f3545d0f700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 0x7f3540155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f354550e700 1 -- 172.21.15.133:0/3406270323 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357636076 0 0) 0x7f3538001490 con 0x7f35401561a0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.158+0000 7f354550e700 1 -- 172.21.15.133:0/3406270323 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c0033f0 con 0x7f35401561a0 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3546510700 1 -- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 msgr2=0x7f3540155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3546510700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 0x7f3540155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:15.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3546510700 1 -- 172.21.15.133:0/3406270323 >> v1:172.21.15.133:6789/0 conn(0x7f35401561a0 legacy=0x7f35401526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3546510700 1 -- 172.21.15.133:0/3406270323 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400c55d0 con 0x7f35401351d0 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3545d0f700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 0x7f3540155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3546510700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400c3770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f353c009760 tx=0x7f353c009060).ready entity=mon.1 client_cookie=dbe6a592176945e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f354550e700 1 -- 172.21.15.133:0/3406270323 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0090d0 con 0x7f35401351d0 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f354550e700 1 -- 172.21.15.133:0/3406270323 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c00d4a0 con 0x7f35401351d0 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f354550e700 1 -- 172.21.15.133:0/3406270323 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c00d820 con 0x7f35401351d0 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3548774700 1 -- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 msgr2=0x7f35400c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.159+0000 7f3548774700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400c3770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f353c009760 tx=0x7f353c009060).stop 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 -- 172.21.15.133:0/3406270323 shutdown_connections 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400c3770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:15.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 --2- 172.21.15.133:0/3406270323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35400c3c60 0x7f3540155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 -- 172.21.15.133:0/3406270323 >> 172.21.15.133:0/3406270323 conn(0x7f3540066a90 msgr2=0x7f3540066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 -- 172.21.15.133:0/3406270323 shutdown_connections 2024-01-21T20:18:15.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.160+0000 7f3548774700 1 -- 172.21.15.133:0/3406270323 wait complete. 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.161+0000 7f3548774700 1 Processor -- start 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.161+0000 7f3548774700 1 -- start start 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400ab240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35401561a0 0x7f3540165a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354014ec80 con 0x7f35400c3c60 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354014d710 con 0x7f35401351d0 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354014d9f0 con 0x7f35401561a0 2024-01-21T20:18:15.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45616/0 (socket says 172.21.15.133:45616) 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 -- 172.21.15.133:0/288614668 learned_addr learned my addr 172.21.15.133:0/288614668 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3545d0f700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400ab240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546d11700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35401561a0 0x7f3540165a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 -- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35401561a0 msgr2=0x7f3540165a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35401561a0 0x7f3540165a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 -- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 msgr2=0x7f35400ab240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400ab240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 -- 172.21.15.133:0/288614668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35300092a0 con 0x7f35400c3c60 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3546510700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f353c00d260 tx=0x7f353c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0126f0 con 0x7f35400c3c60 2024-01-21T20:18:15.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c012850 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.162+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c0092a0 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.163+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c012bf0 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.163+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354014e290 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.164+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f353c026460 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.164+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354014de10 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.164+0000 7f3536ffd700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 0x7f3524061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.164+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6397+0+0 (secure 0 0 0) 0x7f353c07b6d0 con 0x7f35400c3c60 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.164+0000 7f3545d0f700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 0x7f3524061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:15.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.165+0000 7f3545d0f700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 0x7f3524061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f35400c40a0 tx=0x7f3530009060).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:15.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.169+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f354014de10 con 0x7f35400c3c60 2024-01-21T20:18:15.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:15.350+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f354014de10 con 0x7f35400c3c60 2024-01-21T20:18:16.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.224+0000 7f3536ffd700 1 -- 172.21.15.133:0/288614668 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7f354014de10 con 0x7f35400c3c60 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 msgr2=0x7f3524061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 0x7f3524061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f35400c40a0 tx=0x7f3530009060).stop 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 msgr2=0x7f354014e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f353c00d260 tx=0x7f353c016000).stop 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 shutdown_connections 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f352405f150 0x7f3524061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35401561a0 0x7f3540165a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35400c3c60 0x7f354014e790 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 --2- 172.21.15.133:0/288614668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35401351d0 0x7f35400ab240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 >> 172.21.15.133:0/288614668 conn(0x7f3540066a90 msgr2=0x7f354014c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 shutdown_connections 2024-01-21T20:18:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.227+0000 7f3548774700 1 -- 172.21.15.133:0/288614668 wait complete. 2024-01-21T20:18:16.219 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T20:18:16.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T20:18:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.363+0000 7f214c636700 1 Processor -- start 2024-01-21T20:18:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.364+0000 7f214c636700 1 -- start start 2024-01-21T20:18:16.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214c636700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2144137030 0x7f2144067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214c636700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2144068370 con 0x7f2144137410 2024-01-21T20:18:16.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214c636700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2144068650 con 0x7f21440c5930 2024-01-21T20:18:16.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214c636700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2144068930 con 0x7f2144137030 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214a3d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2144137030 0x7f2144067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f2149bd1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2144137410 0x7f2144155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55038/0 (socket says 172.21.15.133:55038) 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f2149bd1700 1 -- 172.21.15.133:0/36794437 learned_addr learned my addr 172.21.15.133:0/36794437 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214a3d2700 1 -- 172.21.15.133:0/36794437 >> v1:172.21.15.178:6789/0 conn(0x7f21440c5930 legacy=0x7f21440c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214a3d2700 1 -- 172.21.15.133:0/36794437 >> v1:172.21.15.133:6789/0 conn(0x7f2144137410 legacy=0x7f2144155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f21493d0700 1 -- 172.21.15.133:0/36794437 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295146808 0 0) 0x7f2144068370 con 0x7f2144137410 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214a3d2700 1 -- 172.21.15.133:0/36794437 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144068c10 con 0x7f2144137030 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f214a3d2700 1 --2- 172.21.15.133:0/36794437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f2144067d90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f2140009760 tx=0x7f2140009060).ready entity=mon.0 client_cookie=df6ec67bc59a4985 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f21493d0700 1 -- 172.21.15.133:0/36794437 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400090d0 con 0x7f2144137030 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f21493d0700 1 -- 172.21.15.133:0/36794437 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000b520 con 0x7f2144137030 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.365+0000 7f21493d0700 1 -- 172.21.15.133:0/36794437 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000b8a0 con 0x7f2144137030 2024-01-21T20:18:16.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 -- 172.21.15.133:0/36794437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 msgr2=0x7f2144067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 --2- 172.21.15.133:0/36794437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f2144067d90 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f2140009760 tx=0x7f2140009060).stop 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 -- 172.21.15.133:0/36794437 shutdown_connections 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 --2- 172.21.15.133:0/36794437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f2144067d90 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 -- 172.21.15.133:0/36794437 >> 172.21.15.133:0/36794437 conn(0x7f2144066a90 msgr2=0x7f2144066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 -- 172.21.15.133:0/36794437 shutdown_connections 2024-01-21T20:18:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.366+0000 7f214c636700 1 -- 172.21.15.133:0/36794437 wait complete. 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.367+0000 7f214c636700 1 Processor -- start 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.367+0000 7f214c636700 1 -- start start 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 0x7f21440c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2144137410 0x7f2144163b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440ac9a0 con 0x7f2144137030 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c2280 con 0x7f2144137410 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c2560 con 0x7f21440c5930 2024-01-21T20:18:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45644/0 (socket says 172.21.15.133:45644) 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 -- 172.21.15.133:0/3964030074 learned_addr learned my addr 172.21.15.133:0/3964030074 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214abd3700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2144137410 0x7f2144163b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214a3d2700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 0x7f21440c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 -- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 msgr2=0x7f21440c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 0x7f21440c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 -- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2144137410 msgr2=0x7f2144163b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2144137410 0x7f2144163b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 -- 172.21.15.133:0/3964030074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400092a0 con 0x7f2144137030 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214a3d2700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 0x7f21440c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2149bd1700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f2138001eb0 tx=0x7f2138007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213800ce90 con 0x7f2144137030 2024-01-21T20:18:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21380072e0 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.368+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440c2840 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.369+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138007680 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.369+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440c2b20 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.369+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21440acb50 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.370+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f21380059b0 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.370+0000 7f2136ffd700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 0x7f2128061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.370+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2138079820 con 0x7f2144137030 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.370+0000 7f214a3d2700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 0x7f2128061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.370+0000 7f214a3d2700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 0x7f2128061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f214000b2e0 tx=0x7f2140017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.374+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f213804abe0 con 0x7f2144137030 2024-01-21T20:18:16.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.601+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f214406bd20 con 0x7f2144137030 2024-01-21T20:18:16.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.601+0000 7f2136ffd700 1 -- 172.21.15.133:0/3964030074 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f213804e200 con 0x7f2144137030 2024-01-21T20:18:16.591 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:18:16.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:18:16.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:18:16.594 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:18:16.595 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.596 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.599 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T20:18:16.600 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T20:18:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.605 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T20:18:16.606 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:18:16.607 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T20:18:16.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:16.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T20:18:16.609 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:18:16.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 msgr2=0x7f2128061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 0x7f2128061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f214000b2e0 tx=0x7f2140017000).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 msgr2=0x7f21441636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f2138001eb0 tx=0x7f2138007e90).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 shutdown_connections 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f212805f150 0x7f2128061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2144137410 0x7f2144163b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21440c5930 0x7f21440c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 --2- 172.21.15.133:0/3964030074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2144137030 0x7f21441636a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 >> 172.21.15.133:0/3964030074 conn(0x7f2144066a90 msgr2=0x7f21440c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 shutdown_connections 2024-01-21T20:18:16.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.603+0000 7f214c636700 1 -- 172.21.15.133:0/3964030074 wait complete. 2024-01-21T20:18:16.612 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:16.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.737+0000 7fb4d34d8700 1 Processor -- start 2024-01-21T20:18:16.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.737+0000 7fb4d34d8700 1 -- start start 2024-01-21T20:18:16.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 0x7fb4cc0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4cc13ac10 0x7fb4cc0bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 0x7fb4cc069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc069ef0 con 0x7fb4cc13ac10 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c3890 con 0x7fb4cc0695b0 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d34d8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0c3b70 con 0x7fb4cc13a830 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d0a73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4cc13ac10 0x7fb4cc0bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d0a73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4cc13ac10 0x7fb4cc0bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45646/0 (socket says 172.21.15.133:45646) 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.738+0000 7fb4d0a73700 1 -- 172.21.15.133:0/53551273 learned_addr learned my addr 172.21.15.133:0/53551273 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d1a75700 1 --2- 172.21.15.133:0/53551273 >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 0x7fb4cc069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d1274700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 0x7fb4cc0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 -- 172.21.15.133:0/53551273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 msgr2=0x7fb4cc0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 0x7fb4cc0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 -- 172.21.15.133:0/53551273 >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 msgr2=0x7fb4cc069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 --2- 172.21.15.133:0/53551273 >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 0x7fb4cc069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 -- 172.21.15.133:0/53551273 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0c3e50 con 0x7fb4cc13ac10 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d1a75700 1 --2- 172.21.15.133:0/53551273 >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 0x7fb4cc069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d1274700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 0x7fb4cc0c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d0a73700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc0bce60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7fb4cc06a2d0 tx=0x7fb4c80090f0).ready entity=mon.0 client_cookie=e5cf2546edf7d963 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4c3fff700 1 -- 172.21.15.133:0/53551273 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800b600 con 0x7fb4cc13ac10 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4c3fff700 1 -- 172.21.15.133:0/53551273 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c800b760 con 0x7fb4cc13ac10 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4c3fff700 1 -- 172.21.15.133:0/53551273 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800bb00 con 0x7fb4cc13ac10 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 -- 172.21.15.133:0/53551273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 msgr2=0x7fb4cc0bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc0bce60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7fb4cc06a2d0 tx=0x7fb4c80090f0).stop 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 -- 172.21.15.133:0/53551273 shutdown_connections 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/53551273 >> v2:172.21.15.178:3300/0 conn(0x7fb4cc0695b0 0x7fb4cc069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc13a830 0x7fb4cc0c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/53551273 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc0bce60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.739+0000 7fb4d34d8700 1 -- 172.21.15.133:0/53551273 >> 172.21.15.133:0/53551273 conn(0x7fb4cc0c7dc0 msgr2=0x7fb4cc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.740+0000 7fb4d34d8700 1 -- 172.21.15.133:0/53551273 shutdown_connections 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.740+0000 7fb4d34d8700 1 -- 172.21.15.133:0/53551273 wait complete. 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.741+0000 7fb4d34d8700 1 Processor -- start 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.741+0000 7fb4d34d8700 1 -- start start 2024-01-21T20:18:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc0695b0 0x7fb4cc152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4cc13a830 0x7fb4cc0a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0a84f0 con 0x7fb4cc13ac10 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0a87d0 con 0x7fb4cc13a830 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4cc0a8ab0 con 0x7fb4cc0695b0 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45652/0 (socket says 172.21.15.133:45652) 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 -- 172.21.15.133:0/2910886719 learned_addr learned my addr 172.21.15.133:0/2910886719 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1274700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc0695b0 0x7fb4cc152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d0a73700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4cc13a830 0x7fb4cc0a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 -- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc0695b0 msgr2=0x7fb4cc152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc0695b0 0x7fb4cc152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 -- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4cc13a830 msgr2=0x7fb4cc0a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4cc13a830 0x7fb4cc0a95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 -- 172.21.15.133:0/2910886719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8009370 con 0x7fb4cc13ac10 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d1a75700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fb4c400cef0 tx=0x7fb4c4007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400add0 con 0x7fb4cc13ac10 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4016400 con 0x7fb4cc13ac10 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4cc0a8d90 con 0x7fb4cc13ac10 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4016780 con 0x7fb4cc13ac10 2024-01-21T20:18:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.742+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4cc0a8110 con 0x7fb4cc13ac10 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.743+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4cc05fdf0 con 0x7fb4cc13ac10 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.744+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb4c401f3f0 con 0x7fb4cc13ac10 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.744+0000 7fb4c1ffb700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 0x7fb4b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.744+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fb4c407a800 con 0x7fb4cc13ac10 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.744+0000 7fb4d1274700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 0x7fb4b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.744+0000 7fb4d1274700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 0x7fb4b0061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb4bc00ab40 tx=0x7fb4bc008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:16.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.748+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb4c404bb60 con 0x7fb4cc13ac10 2024-01-21T20:18:16.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.913+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4cc0aa920 con 0x7fb4cc13ac10 2024-01-21T20:18:16.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.914+0000 7fb4c1ffb700 1 -- 172.21.15.133:0/2910886719 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+14700 (secure 0 0 0) 0x7fb4c404f180 con 0x7fb4cc13ac10 2024-01-21T20:18:16.905 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:16.905 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":135,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:18:16.215853+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 msgr2=0x7fb4b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 0x7fb4b0061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb4bc00ab40 tx=0x7fb4bc008040).stop 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 msgr2=0x7fb4cc1658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7fb4c400cef0 tx=0x7fb4c4007860).stop 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 shutdown_connections 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb4b005f150 0x7fb4b0061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4cc13ac10 0x7fb4cc1658d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4cc0695b0 0x7fb4cc152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 --2- 172.21.15.133:0/2910886719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4cc13a830 0x7fb4cc0a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 >> 172.21.15.133:0/2910886719 conn(0x7fb4cc0c7dc0 msgr2=0x7fb4cc065200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 shutdown_connections 2024-01-21T20:18:16.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:16.916+0000 7fb4d34d8700 1 -- 172.21.15.133:0/2910886719 wait complete. 2024-01-21T20:18:16.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '130', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T20:18:16.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T20:18:17.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.047+0000 7fe6b18e3700 1 Processor -- start 2024-01-21T20:18:17.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.047+0000 7fe6b18e3700 1 -- start start 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6b18e3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6ac065d70 0x7fe6ac15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6b18e3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac069ef0 con 0x7fe6ac062c10 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6b18e3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6ac06a130 con 0x7fe6ac062ff0 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6b18e3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ac06a410 con 0x7fe6ac065d70 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6aaffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe6ac062c10 0x7fe6ac0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55054/0 (socket says 172.21.15.133:55054) 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.048+0000 7fe6aaffd700 1 -- 172.21.15.133:0/1552999319 learned_addr learned my addr 172.21.15.133:0/1552999319 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6ab7fe700 1 --2- 172.21.15.133:0/1552999319 >> v2:172.21.15.178:3300/0 conn(0x7fe6ac065d70 0x7fe6ac15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6a9ffb700 1 -- 172.21.15.133:0/1552999319 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451446591 0 0) 0x7fe694001110 con 0x7fe6ac062c10 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6a9ffb700 1 -- 172.21.15.133:0/1552999319 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6980033f0 con 0x7fe6ac062c10 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6ab7fe700 1 -- 172.21.15.133:0/1552999319 >> v1:172.21.15.178:6789/0 conn(0x7fe6ac062ff0 legacy=0x7fe6ac065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6ab7fe700 1 -- 172.21.15.133:0/1552999319 >> v1:172.21.15.133:6789/0 conn(0x7fe6ac062c10 legacy=0x7fe6ac0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6ab7fe700 1 -- 172.21.15.133:0/1552999319 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ac06a6f0 con 0x7fe6ac065d70 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6ab7fe700 1 --2- 172.21.15.133:0/1552999319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac15f750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fe6a4009e60 tx=0x7fe6a4009780).ready entity=mon.1 client_cookie=86f104975706ee9b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6a9ffb700 1 -- 172.21.15.133:0/1552999319 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400e070 con 0x7fe6ac065d70 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6a9ffb700 1 -- 172.21.15.133:0/1552999319 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a400bb60 con 0x7fe6ac065d70 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.049+0000 7fe6a9ffb700 1 -- 172.21.15.133:0/1552999319 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4012410 con 0x7fe6ac065d70 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1552999319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 msgr2=0x7fe6ac15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1552999319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac15f750 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fe6a4009e60 tx=0x7fe6a4009780).stop 2024-01-21T20:18:17.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1552999319 shutdown_connections 2024-01-21T20:18:17.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1552999319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac15f750 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1552999319 >> 172.21.15.133:0/1552999319 conn(0x7fe6ac0c8010 msgr2=0x7fe6ac0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1552999319 shutdown_connections 2024-01-21T20:18:17.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.050+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1552999319 wait complete. 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.051+0000 7fe6b18e3700 1 Processor -- start 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 -- start start 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 0x7fe6ac153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac165cb0 con 0x7fe6ac062c10 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac13c500 con 0x7fe6ac065d70 2024-01-21T20:18:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.052+0000 7fe6b18e3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ac0ac960 con 0x7fe6ac062ff0 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45656/0 (socket says 172.21.15.133:45656) 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 -- 172.21.15.133:0/1200309676 learned_addr learned my addr 172.21.15.133:0/1200309676 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6ab7fe700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aa7fc700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 0x7fe6ac153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 -- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 msgr2=0x7fe6ac153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 0x7fe6ac153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 -- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 msgr2=0x7fe6ac155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 -- 172.21.15.133:0/1200309676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a4009a20 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aa7fc700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 0x7fe6ac153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6aaffd700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fe69400c4a0 tx=0x7fe694007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940072e0 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694007440 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ac164fd0 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940057a0 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.053+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ac165580 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.054+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ac05fdf0 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.054+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe694005bd0 con 0x7fe6ac062c10 2024-01-21T20:18:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.055+0000 7fe6a37fe700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 0x7fe68c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.055+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe694079460 con 0x7fe6ac062c10 2024-01-21T20:18:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.055+0000 7fe6aa7fc700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 0x7fe68c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.055+0000 7fe6aa7fc700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 0x7fe68c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe6ac15a630 tx=0x7fe69c009040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.059+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe69404a820 con 0x7fe6ac062c10 2024-01-21T20:18:17.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.224+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe6ac069ef0 con 0x7fe6ac062c10 2024-01-21T20:18:17.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.224+0000 7fe6a37fe700 1 -- 172.21.15.133:0/1200309676 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe6ac069ef0 con 0x7fe6ac062c10 2024-01-21T20:18:17.215 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T20:18:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 msgr2=0x7fe68c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 0x7fe68c061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe6ac15a630 tx=0x7fe69c009040).stop 2024-01-21T20:18:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 msgr2=0x7fe6ac164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7fe69400c4a0 tx=0x7fe694007af0).stop 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 shutdown_connections 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe68c05f150 0x7fe68c061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6ac065d70 0x7fe6ac155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6ac062c10 0x7fe6ac164ae0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 --2- 172.21.15.133:0/1200309676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6ac062ff0 0x7fe6ac153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 >> 172.21.15.133:0/1200309676 conn(0x7fe6ac0c8010 msgr2=0x7fe6ac0697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 shutdown_connections 2024-01-21T20:18:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.226+0000 7fe6b18e3700 1 -- 172.21.15.133:0/1200309676 wait complete. 2024-01-21T20:18:17.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T20:18:17.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 Processor -- start 2024-01-21T20:18:17.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 -- start start 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff35c13ac00 0x7ff35c15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0c64d0 con 0x7ff35c0c3c20 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c067f10 con 0x7ff35c0c3840 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.358+0000 7ff363099700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0681f0 con 0x7ff35c13ac00 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff35c0c3c20 0x7ff35c13a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55062/0 (socket says 172.21.15.133:55062) 2024-01-21T20:18:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35bfff700 1 -- 172.21.15.133:0/2514447984 learned_addr learned my addr 172.21.15.133:0/2514447984 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff361636700 1 --2- 172.21.15.133:0/2514447984 >> v2:172.21.15.178:3300/0 conn(0x7ff35c13ac00 0x7ff35c15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513068313 0 0) 0x7ff344001110 con 0x7ff35c0c3c20 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3480033f0 con 0x7ff35c0c3c20 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff361636700 1 -- 172.21.15.133:0/2514447984 >> v1:172.21.15.178:6789/0 conn(0x7ff35c0c3840 legacy=0x7ff35c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754497452 0 0) 0x7ff3480033f0 con 0x7ff35c0c3c20 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff361636700 1 -- 172.21.15.133:0/2514447984 >> v1:172.21.15.133:6789/0 conn(0x7ff35c0c3c20 legacy=0x7ff35c13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff361636700 1 -- 172.21.15.133:0/2514447984 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0684d0 con 0x7ff35c13ac00 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff361636700 1 --2- 172.21.15.133:0/2514447984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c15f250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff34c009760 tx=0x7ff34c009060).ready entity=mon.1 client_cookie=2f659a3fb14dc8c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344001600 con 0x7ff35c13ac00 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c009130 con 0x7ff35c13ac00 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.359+0000 7ff35b7fe700 1 -- 172.21.15.133:0/2514447984 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011610 con 0x7ff35c13ac00 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 -- 172.21.15.133:0/2514447984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 msgr2=0x7ff35c15f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 --2- 172.21.15.133:0/2514447984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c15f250 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff34c009760 tx=0x7ff34c009060).stop 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 -- 172.21.15.133:0/2514447984 shutdown_connections 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 --2- 172.21.15.133:0/2514447984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c15f250 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 -- 172.21.15.133:0/2514447984 >> 172.21.15.133:0/2514447984 conn(0x7ff35c066a70 msgr2=0x7ff35c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 -- 172.21.15.133:0/2514447984 shutdown_connections 2024-01-21T20:18:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.360+0000 7ff363099700 1 -- 172.21.15.133:0/2514447984 wait complete. 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.362+0000 7ff363099700 1 Processor -- start 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.362+0000 7ff363099700 1 -- start start 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c3c20 0x7ff35c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c063fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1514b0 con 0x7ff35c0c3840 2024-01-21T20:18:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1312b0 con 0x7ff35c13ac00 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c131590 con 0x7ff35c0c3c20 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45670/0 (socket says 172.21.15.133:45670) 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 -- 172.21.15.133:0/1629707995 learned_addr learned my addr 172.21.15.133:0/1629707995 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 -- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c3c20 msgr2=0x7ff35c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c3c20 0x7ff35c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff361636700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c063fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 -- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 msgr2=0x7ff35c063fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c063fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 -- 172.21.15.133:0/1629707995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0092a0 con 0x7ff35c0c3840 2024-01-21T20:18:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff361636700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c063fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff360e35700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7ff35400c710 tx=0x7ff354001540).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354010510 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354010670 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c0647a0 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.363+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354010a10 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.364+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c064d60 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.364+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c05fdf0 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.365+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff35401b400 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.365+0000 7ff3597fa700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 0x7ff33c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.365+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7ff354079f40 con 0x7ff35c0c3840 2024-01-21T20:18:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.365+0000 7ff35bfff700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 0x7ff33c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.365+0000 7ff35bfff700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 0x7ff33c0615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff35c138270 tx=0x7ff344001330).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.369+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff35404b2a0 con 0x7ff35c0c3840 2024-01-21T20:18:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.533+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff35c06bd20 con 0x7ff35c0c3840 2024-01-21T20:18:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.534+0000 7ff3597fa700 1 -- 172.21.15.133:0/1629707995 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff35404e8c0 con 0x7ff35c0c3840 2024-01-21T20:18:17.524 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.535+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 msgr2=0x7ff33c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.535+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 0x7ff33c0615e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff35c138270 tx=0x7ff344001330).stop 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 msgr2=0x7ff35c152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7ff35400c710 tx=0x7ff354001540).stop 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 shutdown_connections 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff33c05f120 0x7ff33c0615e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c13ac00 0x7ff35c063fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff35c0c3840 0x7ff35c152130 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 --2- 172.21.15.133:0/1629707995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c0c3c20 0x7ff35c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:17.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 >> 172.21.15.133:0/1629707995 conn(0x7ff35c066a70 msgr2=0x7ff35c0c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 shutdown_connections 2024-01-21T20:18:17.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.536+0000 7ff363099700 1 -- 172.21.15.133:0/1629707995 wait complete. 2024-01-21T20:18:17.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T20:18:17.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.663+0000 7f0a1c02c700 1 Processor -- start 2024-01-21T20:18:17.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 -- start start 2024-01-21T20:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a140beb30 0x7f0a14155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a14069ef0 0x7f0a14066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a14065660 con 0x7f0a140c3fb0 2024-01-21T20:18:17.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a140bef10 con 0x7f0a140beb30 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.664+0000 7f0a1c02c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a14156070 con 0x7f0a14069ef0 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a140beb30 0x7f0a14155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a140beb30 0x7f0a14155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45674/0 (socket says 172.21.15.133:45674) 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a195c7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a140c3fb0 0x7f0a140697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55074/0 (socket says 172.21.15.133:55074) 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 -- 172.21.15.133:0/2788813982 learned_addr learned my addr 172.21.15.133:0/2788813982 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a1a5c9700 1 --2- 172.21.15.133:0/2788813982 >> v2:172.21.15.178:3300/0 conn(0x7f0a14069ef0 0x7f0a14066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 -- 172.21.15.133:0/2788813982 >> v2:172.21.15.178:3300/0 conn(0x7f0a14069ef0 msgr2=0x7f0a14066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 --2- 172.21.15.133:0/2788813982 >> v2:172.21.15.178:3300/0 conn(0x7f0a14069ef0 0x7f0a14066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 -- 172.21.15.133:0/2788813982 >> v1:172.21.15.133:6789/0 conn(0x7f0a140c3fb0 legacy=0x7f0a140697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 -- 172.21.15.133:0/2788813982 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a14065f00 con 0x7f0a140beb30 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a18dc6700 1 -- 172.21.15.133:0/2788813982 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371766674 0 0) 0x7f0a14065660 con 0x7f0a140c3fb0 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a19dc8700 1 --2- 172.21.15.133:0/2788813982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140beb30 0x7f0a14155b80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f0a14069360 tx=0x7f0a040090f0).ready entity=mon.0 client_cookie=1e33b88b32631b75 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a18dc6700 1 -- 172.21.15.133:0/2788813982 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400b600 con 0x7f0a140beb30 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a18dc6700 1 -- 172.21.15.133:0/2788813982 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400b760 con 0x7f0a140beb30 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.665+0000 7f0a18dc6700 1 -- 172.21.15.133:0/2788813982 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400bb00 con 0x7f0a140beb30 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2788813982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140beb30 msgr2=0x7f0a14155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2788813982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140beb30 0x7f0a14155b80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f0a14069360 tx=0x7f0a040090f0).stop 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2788813982 shutdown_connections 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2788813982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140beb30 0x7f0a14155b80 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2788813982 >> v2:172.21.15.178:3300/0 conn(0x7f0a14069ef0 0x7f0a14066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2788813982 >> 172.21.15.133:0/2788813982 conn(0x7f0a140c8010 msgr2=0x7f0a140c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2788813982 shutdown_connections 2024-01-21T20:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.666+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2788813982 wait complete. 2024-01-21T20:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.667+0000 7f0a1c02c700 1 Processor -- start 2024-01-21T20:18:17.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.667+0000 7f0a1c02c700 1 -- start start 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a14069ef0 0x7f0a140bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a140beb30 0x7f0a140a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140bf690 con 0x7f0a140c3fb0 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140bf970 con 0x7f0a14069ef0 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140bfc50 con 0x7f0a140beb30 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45676/0 (socket says 172.21.15.133:45676) 2024-01-21T20:18:17.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 -- 172.21.15.133:0/2457381926 learned_addr learned my addr 172.21.15.133:0/2457381926 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a19dc8700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a14069ef0 0x7f0a140bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a195c7700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a140beb30 0x7f0a140a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 -- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a140beb30 msgr2=0x7f0a140a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a140beb30 0x7f0a140a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 -- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a14069ef0 msgr2=0x7f0a140bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a14069ef0 0x7f0a140bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 -- 172.21.15.133:0/2457381926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009370 con 0x7f0a140c3fb0 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1a5c9700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f0a0c007ef0 tx=0x7f0a0c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00ebe0 con 0x7f0a140c3fb0 2024-01-21T20:18:17.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00ed40 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a140bff30 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.668+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c014610 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.669+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a140a6260 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.669+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a140c0450 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.670+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0a0c014a40 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.670+0000 7f0a0a7fc700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 0x7f09f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.670+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0a0c07a590 con 0x7f0a140c3fb0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.670+0000 7f0a19dc8700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 0x7f09f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.671+0000 7f0a19dc8700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 0x7f09f8061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0a04008000 tx=0x7f0a04017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.674+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a140c0450 con 0x7f0a140c3fb0 2024-01-21T20:18:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.840+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a140c0450 con 0x7f0a140c3fb0 2024-01-21T20:18:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.840+0000 7f0a0a7fc700 1 -- 172.21.15.133:0/2457381926 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0a140c0450 con 0x7f0a140c3fb0 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:17.831 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T20:18:17.832 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T20:18:17.832 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:17.832 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:18:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 msgr2=0x7f09f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 0x7f09f8061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f0a04008000 tx=0x7f0a04017000).stop 2024-01-21T20:18:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 msgr2=0x7f0a140c0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f0a0c007ef0 tx=0x7f0a0c009840).stop 2024-01-21T20:18:17.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 shutdown_connections 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f09f805f150 0x7f09f8061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a140c3fb0 0x7f0a140c0730 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a14069ef0 0x7f0a140bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 --2- 172.21.15.133:0/2457381926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a140beb30 0x7f0a140a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 >> 172.21.15.133:0/2457381926 conn(0x7f0a140c8010 msgr2=0x7f0a140bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 shutdown_connections 2024-01-21T20:18:17.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.842+0000 7f0a1c02c700 1 -- 172.21.15.133:0/2457381926 wait complete. 2024-01-21T20:18:17.845 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T20:18:17.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T20:18:17.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.974+0000 7f053669d700 1 Processor -- start 2024-01-21T20:18:17.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.974+0000 7f053669d700 1 -- start start 2024-01-21T20:18:17.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f053669d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 0x7f0530063ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f053669d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0530069610 0x7f0530069a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f053669d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0530154cd0 con 0x7f05300bc3d0 2024-01-21T20:18:17.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f053669d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0530154fb0 con 0x7f0530069610 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f053669d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0530155290 con 0x7f0530063700 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f052f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0530069610 0x7f0530069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.975+0000 7f052f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0530069610 0x7f0530069a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45678/0 (socket says 172.21.15.133:45678) 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 -- 172.21.15.133:0/3796489104 learned_addr learned my addr 172.21.15.133:0/3796489104 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052ffff700 1 --2- 172.21.15.133:0/3796489104 >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 0x7f0530063ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 -- 172.21.15.133:0/3796489104 >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 msgr2=0x7f0530063ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 --2- 172.21.15.133:0/3796489104 >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 0x7f0530063ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 -- 172.21.15.133:0/3796489104 >> v1:172.21.15.178:6789/0 conn(0x7f05300bc3d0 legacy=0x7f05300bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 -- 172.21.15.133:0/3796489104 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530155570 con 0x7f0530069610 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052ffff700 1 --2- 172.21.15.133:0/3796489104 >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 0x7f0530063ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052f7fe700 1 --2- 172.21.15.133:0/3796489104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530069a90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f0530067fe0 tx=0x7f05200090f0).ready entity=mon.0 client_cookie=c5f9d42711caa3d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052effd700 1 -- 172.21.15.133:0/3796489104 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000b600 con 0x7f0530069610 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052effd700 1 -- 172.21.15.133:0/3796489104 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000b760 con 0x7f0530069610 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.976+0000 7f052effd700 1 -- 172.21.15.133:0/3796489104 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000bae0 con 0x7f0530069610 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 -- 172.21.15.133:0/3796489104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 msgr2=0x7f0530069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 --2- 172.21.15.133:0/3796489104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530069a90 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f0530067fe0 tx=0x7f05200090f0).stop 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 -- 172.21.15.133:0/3796489104 shutdown_connections 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 --2- 172.21.15.133:0/3796489104 >> v2:172.21.15.178:3300/0 conn(0x7f0530063700 0x7f0530063ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 --2- 172.21.15.133:0/3796489104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530069a90 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 -- 172.21.15.133:0/3796489104 >> 172.21.15.133:0/3796489104 conn(0x7f05300c49a0 msgr2=0x7f0530068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 -- 172.21.15.133:0/3796489104 shutdown_connections 2024-01-21T20:18:17.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.977+0000 7f053669d700 1 -- 172.21.15.133:0/3796489104 wait complete. 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.978+0000 7f053669d700 1 Processor -- start 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.978+0000 7f053669d700 1 -- start start 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0530063700 0x7f053014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05300bc3d0 0x7f05301458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530150b90 con 0x7f0530069610 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053014ff80 con 0x7f0530063700 2024-01-21T20:18:17.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0530150260 con 0x7f05300bc3d0 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45694/0 (socket says 172.21.15.133:45694) 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 -- 172.21.15.133:0/271962423 learned_addr learned my addr 172.21.15.133:0/271962423 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052ffff700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0530063700 0x7f053014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f0534c3a700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05300bc3d0 0x7f05301458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 -- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05300bc3d0 msgr2=0x7f05301458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05300bc3d0 0x7f05301458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 -- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0530063700 msgr2=0x7f053014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0530063700 0x7f053014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 -- 172.21.15.133:0/271962423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009370 con 0x7f0530069610 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052f7fe700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f0520009fd0 tx=0x7f0520017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052000b8d0 con 0x7f0530069610 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052000ba30 con 0x7f0530069610 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0530150540 con 0x7f0530069610 2024-01-21T20:18:17.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.979+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052001b660 con 0x7f0530069610 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.980+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530158940 con 0x7f0530069610 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.981+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0530150d00 con 0x7f0530069610 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.981+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f052001ba10 con 0x7f0530069610 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.981+0000 7f052cff9700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 0x7f051c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.981+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f052007ba80 con 0x7f0530069610 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.981+0000 7f052ffff700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 0x7f051c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:17.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.982+0000 7f052ffff700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 0x7f051c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0524006d80 tx=0x7f0524008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:17.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:17.985+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f052004ce40 con 0x7f0530069610 2024-01-21T20:18:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.148+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f053005fdf0 con 0x7f0530069610 2024-01-21T20:18:18.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:18:18.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:18:18.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.224+0000 7f052cff9700 1 -- 172.21.15.133:0/271962423 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) v1 ==== 152+0+0 (secure 0 0 0) 0x7f052001f020 con 0x7f0530069610 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.228+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 msgr2=0x7f051c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.228+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 0x7f051c061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0524006d80 tx=0x7f0524008040).stop 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.228+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 msgr2=0x7f0530158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.228+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f0520009fd0 tx=0x7f0520017000).stop 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 shutdown_connections 2024-01-21T20:18:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f051c05f150 0x7f051c061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05300bc3d0 0x7f05301458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0530063700 0x7f053014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 --2- 172.21.15.133:0/271962423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0530069610 0x7f0530158450 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 >> 172.21.15.133:0/271962423 conn(0x7f05300c49a0 msgr2=0x7f05300a5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 shutdown_connections 2024-01-21T20:18:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.229+0000 7f053669d700 1 -- 172.21.15.133:0/271962423 wait complete. 2024-01-21T20:18:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T20:18:18.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T20:18:18.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.436+0000 7f8f69af6700 1 Processor -- start 2024-01-21T20:18:18.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.436+0000 7f8f69af6700 1 -- start start 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f69af6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 0x7f8f640acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f69af6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f64066460 0x7f8f640634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f69af6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f64065fd0 con 0x7f8f641521e0 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f69af6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f64152d00 con 0x7f8f64066460 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f69af6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640653c0 con 0x7f8f640acbc0 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f63fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f641521e0 0x7f8f641525f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55082/0 (socket says 172.21.15.133:55082) 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f63fff700 1 -- 172.21.15.133:0/3370958446 learned_addr learned my addr 172.21.15.133:0/3370958446 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/3370958446 >> v2:172.21.15.178:3300/0 conn(0x7f8f64066460 0x7f8f640634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f637fe700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 0x7f8f640acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f627fc700 1 -- 172.21.15.133:0/3370958446 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918928230 0 0) 0x7f8f64065fd0 con 0x7f8f641521e0 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.437+0000 7f8f627fc700 1 -- 172.21.15.133:0/3370958446 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f4c0033f0 con 0x7f8f641521e0 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f62ffd700 1 -- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 msgr2=0x7f8f640acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 0x7f8f640acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f62ffd700 1 -- 172.21.15.133:0/3370958446 >> v1:172.21.15.133:6789/0 conn(0x7f8f641521e0 legacy=0x7f8f641525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f62ffd700 1 -- 172.21.15.133:0/3370958446 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640656a0 con 0x7f8f64066460 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f637fe700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 0x7f8f640acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f64066460 0x7f8f640634d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f8f54009760 tx=0x7f8f54009060).ready entity=mon.1 client_cookie=e58683adae479639 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f627fc700 1 -- 172.21.15.133:0/3370958446 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f540090d0 con 0x7f8f64066460 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f627fc700 1 -- 172.21.15.133:0/3370958446 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5400d4a0 con 0x7f8f64066460 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f627fc700 1 -- 172.21.15.133:0/3370958446 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400d820 con 0x7f8f64066460 2024-01-21T20:18:18.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 -- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f64066460 msgr2=0x7f8f640634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f64066460 0x7f8f640634d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f8f54009760 tx=0x7f8f54009060).stop 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 -- 172.21.15.133:0/3370958446 shutdown_connections 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640acbc0 0x7f8f640acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 --2- 172.21.15.133:0/3370958446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f64066460 0x7f8f640634d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.438+0000 7f8f69af6700 1 -- 172.21.15.133:0/3370958446 >> 172.21.15.133:0/3370958446 conn(0x7f8f640c8200 msgr2=0x7f8f640c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.439+0000 7f8f69af6700 1 -- 172.21.15.133:0/3370958446 shutdown_connections 2024-01-21T20:18:18.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.439+0000 7f8f69af6700 1 -- 172.21.15.133:0/3370958446 wait complete. 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.440+0000 7f8f69af6700 1 Processor -- start 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.440+0000 7f8f69af6700 1 -- start start 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f64066460 0x7f8f6414ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 0x7f8f640c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640c1340 con 0x7f8f640acbc0 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640c0730 con 0x7f8f641521e0 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640c0a10 con 0x7f8f64066460 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45696/0 (socket says 172.21.15.133:45696) 2024-01-21T20:18:18.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 -- 172.21.15.133:0/825149067 learned_addr learned my addr 172.21.15.133:0/825149067 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f63fff700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 0x7f8f640c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f637fe700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f64066460 0x7f8f6414ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 -- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f64066460 msgr2=0x7f8f6414ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f64066460 0x7f8f6414ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 -- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 msgr2=0x7f8f640c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 0x7f8f640c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 -- 172.21.15.133:0/825149067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f580092a0 con 0x7f8f640acbc0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f63fff700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 0x7f8f640c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f62ffd700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f8f54009d50 tx=0x7f8f54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54012950 con 0x7f8f640acbc0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54012ab0 con 0x7f8f640acbc0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f540092a0 con 0x7f8f640acbc0 2024-01-21T20:18:18.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54012e50 con 0x7f8f640acbc0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.441+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f640c0fd0 con 0x7f8f640acbc0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.442+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6405fdf0 con 0x7f8f640acbc0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.443+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8f5401c630 con 0x7f8f640acbc0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.443+0000 7f8f4bfff700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 0x7f8f50061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.443+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f8f5407c210 con 0x7f8f640acbc0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.443+0000 7f8f637fe700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 0x7f8f50061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:18.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.444+0000 7f8f637fe700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 0x7f8f50061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8f58009dc0 tx=0x7f8f58009060).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:18.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.447+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f5404d460 con 0x7f8f640acbc0 2024-01-21T20:18:18.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:18.610+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f64065980 con 0x7f8f640acbc0 2024-01-21T20:18:19.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.229+0000 7f8f4bfff700 1 -- 172.21.15.133:0/825149067 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8f54050a80 con 0x7f8f640acbc0 2024-01-21T20:18:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.235+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 msgr2=0x7f8f50061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.235+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 0x7f8f50061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8f58009dc0 tx=0x7f8f58009060).stop 2024-01-21T20:18:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.235+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 msgr2=0x7f8f640bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.235+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f8f54009d50 tx=0x7f8f54016000).stop 2024-01-21T20:18:19.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 shutdown_connections 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f5005f150 0x7f8f50061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f641521e0 0x7f8f640c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f64066460 0x7f8f6414ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 --2- 172.21.15.133:0/825149067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f640acbc0 0x7f8f640bfe00 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 >> 172.21.15.133:0/825149067 conn(0x7f8f640c8200 msgr2=0x7f8f640c2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 shutdown_connections 2024-01-21T20:18:19.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.249+0000 7f8f69af6700 1 -- 172.21.15.133:0/825149067 wait complete. 2024-01-21T20:18:19.244 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T20:18:19.256 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T20:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.386+0000 7fc08343e700 1 Processor -- start 2024-01-21T20:18:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.386+0000 7fc08343e700 1 -- start start 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc08343e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc07c13a830 0x7fc07c0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc08343e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0c3890 con 0x7fc07c13ac10 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc08343e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0c3b70 con 0x7fc07c0695b0 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc08343e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c0c3e50 con 0x7fc07c13a830 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc0809d9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc07c13ac10 0x7fc07c0bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55096/0 (socket says 172.21.15.133:55096) 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc0809d9700 1 -- 172.21.15.133:0/453431045 learned_addr learned my addr 172.21.15.133:0/453431045 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:19.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc0811da700 1 --2- 172.21.15.133:0/453431045 >> v2:172.21.15.178:3300/0 conn(0x7fc07c13a830 0x7fc07c0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278391250 0 0) 0x7fc07c0c3890 con 0x7fc07c13ac10 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0680033f0 con 0x7fc07c13ac10 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932417925 0 0) 0x7fc0680033f0 con 0x7fc07c13ac10 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 >> v2:172.21.15.178:3300/0 conn(0x7fc07c13a830 msgr2=0x7fc07c0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 --2- 172.21.15.133:0/453431045 >> v2:172.21.15.178:3300/0 conn(0x7fc07c13a830 0x7fc07c0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 >> v1:172.21.15.178:6789/0 conn(0x7fc07c0695b0 legacy=0x7fc07c0699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0c4130 con 0x7fc07c13ac10 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.387+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc06c001470 con 0x7fc07c13ac10 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 >> v1:172.21.15.133:6789/0 conn(0x7fc07c13ac10 legacy=0x7fc07c0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0680038e0 0x7fc068003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 0x7fc068004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc068005050 0x7fc06800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c3e50 con 0x7fc068004690 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800bfe0 con 0x7fc0680038e0 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06800c1a0 con 0x7fc068005050 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 0x7fc068004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0811da700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0680038e0 0x7fc068003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0819db700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc068005050 0x7fc06800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 -- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc068005050 msgr2=0x7fc06800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc068005050 0x7fc06800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 -- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0680038e0 msgr2=0x7fc068003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0680038e0 0x7fc068003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0819db700 1 -- 172.21.15.133:0/453431045 reap_dead start 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 -- 172.21.15.133:0/453431045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680033f0 con 0x7fc068004690 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc0809d9700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 0x7fc068004b10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fc07c13b060 tx=0x7fc06c00a060).ready entity=mon.0 client_cookie=2096c6fe936a65cb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00db80 con 0x7fc068004690 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00dce0 con 0x7fc068004690 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.388+0000 7fc073fff700 1 -- 172.21.15.133:0/453431045 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c007360 con 0x7fc068004690 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 -- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 msgr2=0x7fc068004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 0x7fc068004b10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7fc07c13b060 tx=0x7fc06c00a060).stop 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 -- 172.21.15.133:0/453431045 shutdown_connections 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 --2- 172.21.15.133:0/453431045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068004690 0x7fc068004b10 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 -- 172.21.15.133:0/453431045 >> 172.21.15.133:0/453431045 conn(0x7fc07c0c7dc0 msgr2=0x7fc07c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 -- 172.21.15.133:0/453431045 shutdown_connections 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.389+0000 7fc08343e700 1 -- 172.21.15.133:0/453431045 wait complete. 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.390+0000 7fc08343e700 1 Processor -- start 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.390+0000 7fc08343e700 1 -- start start 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc068004690 0x7fc07c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c1613a0 0x7fc07c0c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0a04c0 con 0x7fc07c162fc0 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c161820 con 0x7fc068004690 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc08343e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c154350 con 0x7fc07c1613a0 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45706/0 (socket says 172.21.15.133:45706) 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0811da700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc068004690 0x7fc07c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 -- 172.21.15.133:0/155540104 learned_addr learned my addr 172.21.15.133:0/155540104 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0809d9700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c1613a0 0x7fc07c0c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 -- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c1613a0 msgr2=0x7fc07c0c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c1613a0 0x7fc07c0c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 -- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc068004690 msgr2=0x7fc07c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc068004690 0x7fc07c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 -- 172.21.15.133:0/155540104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0a8160 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc0819db700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fc07c06a2d0 tx=0x7fc074009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.391+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400ee50 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.392+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074003030 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.392+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0740033b0 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.392+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c0c0e20 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.392+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c0a7b90 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.393+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c05fdf0 con 0x7fc07c162fc0 2024-01-21T20:18:19.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.393+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc0740019a0 con 0x7fc07c162fc0 2024-01-21T20:18:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.393+0000 7fc071ffb700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 0x7fc060061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.393+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc074079370 con 0x7fc07c162fc0 2024-01-21T20:18:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.393+0000 7fc0811da700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 0x7fc060061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.394+0000 7fc0811da700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 0x7fc060061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc078006d80 tx=0x7fc078012040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.398+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc07404a440 con 0x7fc07c162fc0 2024-01-21T20:18:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.603+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc07c0c4410 con 0x7fc07c162fc0 2024-01-21T20:18:19.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.609+0000 7fc071ffb700 1 -- 172.21.15.133:0/155540104 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v47) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc07401c070 con 0x7fc07c162fc0 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 msgr2=0x7fc060061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 0x7fc060061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc078006d80 tx=0x7fc078012040).stop 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 msgr2=0x7fc07c0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7fc07c06a2d0 tx=0x7fc074009040).stop 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 shutdown_connections 2024-01-21T20:18:19.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc06005f150 0x7fc060061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c162fc0 0x7fc07c0acd60 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc068004690 0x7fc07c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 --2- 172.21.15.133:0/155540104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c1613a0 0x7fc07c0c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 >> 172.21.15.133:0/155540104 conn(0x7fc07c0c7dc0 msgr2=0x7fc07c0699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.614+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 shutdown_connections 2024-01-21T20:18:19.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.615+0000 7fc08343e700 1 -- 172.21.15.133:0/155540104 wait complete. 2024-01-21T20:18:19.616 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 17 and data pool 18 2024-01-21T20:18:19.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:19.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.759+0000 7fdfb8fc3700 1 Processor -- start 2024-01-21T20:18:19.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.759+0000 7fdfb8fc3700 1 -- start start 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.760+0000 7fdfb8fc3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdfb40c3c10 0x7fdfb40be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.760+0000 7fdfb8fc3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40bfa40 con 0x7fdfb413b970 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.760+0000 7fdfb8fc3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb40bee30 con 0x7fdfb40be5f0 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.760+0000 7fdfb8fc3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb40bf110 con 0x7fdfb40c3c10 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdfb413b970 0x7fdfb40c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55098/0 (socket says 172.21.15.133:55098) 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb259c700 1 -- 172.21.15.133:0/323559110 learned_addr learned my addr 172.21.15.133:0/323559110 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:19.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/323559110 >> v2:172.21.15.178:3300/0 conn(0x7fdfb40c3c10 0x7fdfb40be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893841265 0 0) 0x7fdfb40bfa40 con 0x7fdfb413b970 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfa00033f0 con 0x7fdfb413b970 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969159119 0 0) 0x7fdfb40bee30 con 0x7fdfb40be5f0 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb40bfa40 con 0x7fdfb40be5f0 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382727432 0 0) 0x7fdfa00033f0 con 0x7fdfb413b970 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 >> v2:172.21.15.178:3300/0 conn(0x7fdfb40c3c10 msgr2=0x7fdfb40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 --2- 172.21.15.133:0/323559110 >> v2:172.21.15.178:3300/0 conn(0x7fdfb40c3c10 0x7fdfb40be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 >> v1:172.21.15.178:6789/0 conn(0x7fdfb40be5f0 legacy=0x7fdfb40a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40bf3f0 con 0x7fdfb413b970 2024-01-21T20:18:19.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdf9c001470 con 0x7fdfb413b970 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/323559110 >> v2:172.21.15.178:3300/0 conn(0x7fdfb40c3c10 0x7fdfb40be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 >> v1:172.21.15.133:6789/0 conn(0x7fdfb413b970 legacy=0x7fdfb40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0003a70 0x7fdfa0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfa0004690 0x7fdfa0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 0x7fdfa000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40bf110 con 0x7fdfa0005050 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa000bfc0 con 0x7fdfa0003a70 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa000c180 con 0x7fdfa0004690 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb2d9d700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 0x7fdfa000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb259c700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0003a70 0x7fdfa0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.761+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfa0004690 0x7fdfa0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 -- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfa0004690 msgr2=0x7fdfa0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfa0004690 0x7fdfa0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 -- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0003a70 msgr2=0x7fdfa0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0003a70 0x7fdfa0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 -- 172.21.15.133:0/323559110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa00033f0 con 0x7fdfa0005050 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 -- 172.21.15.133:0/323559110 reap_dead start 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb2d9d700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 0x7fdfa000b8e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fdfac001f90 tx=0x7fdfac007f30).ready entity=mon.0 client_cookie=43db40ab4f797ea1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac006a20 con 0x7fdfa0005050 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac006b80 con 0x7fdfa0005050 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb159a700 1 -- 172.21.15.133:0/323559110 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00c8b0 con 0x7fdfa0005050 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 msgr2=0x7fdfa000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.762+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 0x7fdfa000b8e0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7fdfac001f90 tx=0x7fdfac007f30).stop 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.763+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/323559110 shutdown_connections 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.763+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/323559110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfa0005050 0x7fdfa000b8e0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.763+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/323559110 >> 172.21.15.133:0/323559110 conn(0x7fdfb4066a70 msgr2=0x7fdfb4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.763+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/323559110 shutdown_connections 2024-01-21T20:18:19.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.763+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/323559110 wait complete. 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.764+0000 7fdfb8fc3700 1 Processor -- start 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.764+0000 7fdfb8fc3700 1 -- start start 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0005050 0x7fdfb4151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfb4163470 0x7fdfb40c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40c19b0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb40c13a0 con 0x7fdfa0005050 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4162900 con 0x7fdfb4163470 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45710/0 (socket says 172.21.15.133:45710) 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 -- 172.21.15.133:0/1632603610 learned_addr learned my addr 172.21.15.133:0/1632603610 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb259c700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0005050 0x7fdfb4151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb2d9d700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfb4163470 0x7fdfb40c1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 -- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfb4163470 msgr2=0x7fdfb40c1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfb4163470 0x7fdfb40c1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 -- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0005050 msgr2=0x7fdfb4151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0005050 0x7fdfb4151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 -- 172.21.15.133:0/1632603610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4162be0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb1d9b700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fdfa4011a70 tx=0x7fdfa4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4011eb0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa400f940 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.765+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb40c1640 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.766+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400fcc0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.766+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb41623a0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.766+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb4162680 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.767+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdfa4014650 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.767+0000 7fdfaaffd700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 0x7fdf94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.767+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fdfa407afc0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.767+0000 7fdfb259c700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 0x7fdf94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:19.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.768+0000 7fdfb259c700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 0x7fdf94061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdf9c001200 tx=0x7fdf9c001df0).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:19.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.772+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdfa40a9b00 con 0x7fdfb4162ff0 2024-01-21T20:18:19.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.938+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfb405fdf0 con 0x7fdfb4162ff0 2024-01-21T20:18:19.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.939+0000 7fdfaaffd700 1 -- 172.21.15.133:0/1632603610 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+17933 (secure 0 0 0) 0x7fdfa404c030 con 0x7fdfb4162ff0 2024-01-21T20:18:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:19.930 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":138,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:18:19.606111+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 msgr2=0x7fdf94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 0x7fdf94061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdf9c001200 tx=0x7fdf9c001df0).stop 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 msgr2=0x7fdfb4161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fdfa4011a70 tx=0x7fdfa4009060).stop 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 shutdown_connections 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdf9405f150 0x7fdf94061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfb4163470 0x7fdfb40c1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfa0005050 0x7fdfb4151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 --2- 172.21.15.133:0/1632603610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfb4162ff0 0x7fdfb4161eb0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 >> 172.21.15.133:0/1632603610 conn(0x7fdfb4066a70 msgr2=0x7fdfb4068280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 shutdown_connections 2024-01-21T20:18:19.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:19.941+0000 7fdfb8fc3700 1 -- 172.21.15.133:0/1632603610 wait complete. 2024-01-21T20:18:19.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.069+0000 7faa5ab8d700 1 Processor -- start 2024-01-21T20:18:20.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.069+0000 7faa5ab8d700 1 -- start start 2024-01-21T20:18:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa5ab8d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa54062c10 0x7faa54062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa5ab8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa54065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa5ab8d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540634e0 con 0x7faa54069c40 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa5ab8d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5406a130 con 0x7faa54062c10 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa5ab8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5406a410 con 0x7faa540697e0 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa54062c10 0x7faa54062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa54062c10 0x7faa54062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45722/0 (socket says 172.21.15.133:45722) 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 -- 172.21.15.133:0/1102840042 learned_addr learned my addr 172.21.15.133:0/1102840042 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa53fff700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa54065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 -- 172.21.15.133:0/1102840042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 msgr2=0x7faa54065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa54065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 -- 172.21.15.133:0/1102840042 >> v1:172.21.15.178:6789/0 conn(0x7faa54069c40 legacy=0x7faa541583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.070+0000 7faa58929700 1 -- 172.21.15.133:0/1102840042 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5406a6f0 con 0x7faa54062c10 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa58929700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa54062ff0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7faa48006fd0 tx=0x7faa480090f0).ready entity=mon.0 client_cookie=b86fdd940ebb9328 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa537fe700 1 -- 172.21.15.133:0/1102840042 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800b600 con 0x7faa54062c10 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa537fe700 1 -- 172.21.15.133:0/1102840042 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4800b760 con 0x7faa54062c10 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa537fe700 1 -- 172.21.15.133:0/1102840042 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800bb00 con 0x7faa54062c10 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 -- 172.21.15.133:0/1102840042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 msgr2=0x7faa54062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa54062ff0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7faa48006fd0 tx=0x7faa480090f0).stop 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 -- 172.21.15.133:0/1102840042 shutdown_connections 2024-01-21T20:18:20.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa54062ff0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/1102840042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa54065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 -- 172.21.15.133:0/1102840042 >> 172.21.15.133:0/1102840042 conn(0x7faa540c8010 msgr2=0x7faa540c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 -- 172.21.15.133:0/1102840042 shutdown_connections 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.071+0000 7faa5ab8d700 1 -- 172.21.15.133:0/1102840042 wait complete. 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.072+0000 7faa5ab8d700 1 Processor -- start 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 -- start start 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa540ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 0x7faa5413d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540ac320 con 0x7faa54062c10 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54155010 con 0x7faa54069c40 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.073+0000 7faa5ab8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540ab800 con 0x7faa540697e0 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45728/0 (socket says 172.21.15.133:45728) 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 -- 172.21.15.133:0/2764363896 learned_addr learned my addr 172.21.15.133:0/2764363896 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa5912a700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 0x7faa5413d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa53fff700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa540ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 -- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 msgr2=0x7faa540ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa540ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 -- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 msgr2=0x7faa5413d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 0x7faa5413d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 -- 172.21.15.133:0/2764363896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009370 con 0x7faa54062c10 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa5912a700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 0x7faa5413d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa58929700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7faa540692f0 tx=0x7faa48017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800bec0 con 0x7faa54062c10 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48006930 con 0x7faa54062c10 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540aba80 con 0x7faa54062c10 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4800bb00 con 0x7faa54062c10 2024-01-21T20:18:20.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.074+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540ac040 con 0x7faa54062c10 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.075+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5405fdf0 con 0x7faa54062c10 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.076+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faa48021070 con 0x7faa54062c10 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.076+0000 7faa517fa700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 0x7faa38061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.076+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6733+0+0 (secure 0 0 0) 0x7faa4807be70 con 0x7faa54062c10 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.076+0000 7faa53fff700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 0x7faa38061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.076+0000 7faa53fff700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 0x7faa38061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa540aabf0 tx=0x7faa40008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.081+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faa4804cee0 con 0x7faa54062c10 2024-01-21T20:18:20.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.243+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa540c8e40 con 0x7faa54062c10 2024-01-21T20:18:20.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.244+0000 7faa517fa700 1 -- 172.21.15.133:0/2764363896 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+17933 (secure 0 0 0) 0x7faa48050500 con 0x7faa54062c10 2024-01-21T20:18:20.235 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:20.235 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":138,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:18:19.606111+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.246+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 msgr2=0x7faa38061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.246+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 0x7faa38061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7faa540aabf0 tx=0x7faa40008040).stop 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.246+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 msgr2=0x7faa540ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.246+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7faa540692f0 tx=0x7faa48017000).stop 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 shutdown_connections 2024-01-21T20:18:20.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa3805f150 0x7faa38061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa54069c40 0x7faa5413d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa54062c10 0x7faa540ace50 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 --2- 172.21.15.133:0/2764363896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa540697e0 0x7faa540ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 >> 172.21.15.133:0/2764363896 conn(0x7faa540c8010 msgr2=0x7faa540a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 shutdown_connections 2024-01-21T20:18:20.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.247+0000 7faa5ab8d700 1 -- 172.21.15.133:0/2764363896 wait complete. 2024-01-21T20:18:20.249 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T20:18:20.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.378+0000 7fdd2deab700 1 Processor -- start 2024-01-21T20:18:20.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.378+0000 7fdd2deab700 1 -- start start 2024-01-21T20:18:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd2deab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 0x7fdd28155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd2deab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd280c3fb0 0x7fdd280697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd2deab700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd28065660 con 0x7fdd28069cd0 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd2deab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280bef10 con 0x7fdd280c3fb0 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd2deab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28156070 con 0x7fdd280beb30 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd26ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd280c3fb0 0x7fdd280697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd277fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 0x7fdd28155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd26ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd280c3fb0 0x7fdd280697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:53520/0 (socket says 172.21.15.133:53520) 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.379+0000 7fdd26ffd700 1 -- 172.21.15.133:0/713544393 learned_addr learned my addr 172.21.15.133:0/713544393 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd26ffd700 1 -- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 msgr2=0x7fdd28155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 0x7fdd28155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd26ffd700 1 -- 172.21.15.133:0/713544393 >> v1:172.21.15.178:6789/0 conn(0x7fdd28069cd0 legacy=0x7fdd28151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd26ffd700 1 -- 172.21.15.133:0/713544393 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28065f00 con 0x7fdd280c3fb0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd267fc700 1 -- 172.21.15.133:0/713544393 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790506680 0 0) 0x7fdd28065660 con 0x7fdd28069cd0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd277fe700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 0x7fdd28155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280c3fb0 0x7fdd280697e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fdd18006fd0 tx=0x7fdd1800b3b0).ready entity=mon.1 client_cookie=26b8914c23b48efc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd267fc700 1 -- 172.21.15.133:0/713544393 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800da70 con 0x7fdd280c3fb0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd267fc700 1 -- 172.21.15.133:0/713544393 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1800dbd0 con 0x7fdd280c3fb0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd267fc700 1 -- 172.21.15.133:0/713544393 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18010470 con 0x7fdd280c3fb0 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd2deab700 1 -- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280c3fb0 msgr2=0x7fdd280697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.380+0000 7fdd2deab700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280c3fb0 0x7fdd280697e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fdd18006fd0 tx=0x7fdd1800b3b0).stop 2024-01-21T20:18:20.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 -- 172.21.15.133:0/713544393 shutdown_connections 2024-01-21T20:18:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280beb30 0x7fdd28155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 --2- 172.21.15.133:0/713544393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280c3fb0 0x7fdd280697e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 -- 172.21.15.133:0/713544393 >> 172.21.15.133:0/713544393 conn(0x7fdd280c8010 msgr2=0x7fdd280c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 -- 172.21.15.133:0/713544393 shutdown_connections 2024-01-21T20:18:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.381+0000 7fdd2deab700 1 -- 172.21.15.133:0/713544393 wait complete. 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.382+0000 7fdd2deab700 1 Processor -- start 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.382+0000 7fdd2deab700 1 -- start start 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 0x7fdd28066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280c3fb0 0x7fdd28066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28151570 con 0x7fdd28069cd0 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280c67d0 con 0x7fdd280beb30 2024-01-21T20:18:20.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd2deab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd28067150 con 0x7fdd280c3fb0 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45050/0 (socket says 172.21.15.133:45050) 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.383+0000 7fdd277fe700 1 -- 172.21.15.133:0/3091501322 learned_addr learned my addr 172.21.15.133:0/3091501322 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 0x7fdd28066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd27fff700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280c3fb0 0x7fdd28066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 -- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280c3fb0 msgr2=0x7fdd28066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280c3fb0 0x7fdd28066c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 -- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 msgr2=0x7fdd28066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 0x7fdd28066770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 -- 172.21.15.133:0/3091501322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100092a0 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 0x7fdd28066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd277fe700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fdd1000e980 tx=0x7fdd10009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000c850 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1800b610 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000c9b0 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1000cd30 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.384+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd280c0cf0 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.385+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd2805fdf0 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.385+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdd10012600 con 0x7fdd28069cd0 2024-01-21T20:18:20.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.386+0000 7fdd1ffff700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 0x7fdd08061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.386+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fdd1007aa30 con 0x7fdd28069cd0 2024-01-21T20:18:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.386+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 0x7fdd08061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.386+0000 7fdd26ffd700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 0x7fdd08061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdd18006fd0 tx=0x7fdd1800b3b0).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.391+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd1004baa0 con 0x7fdd28069cd0 2024-01-21T20:18:20.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.594+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd2806ac20 con 0x7fdd28069cd0 2024-01-21T20:18:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.619+0000 7fdd1ffff700 1 -- 172.21.15.133:0/3091501322 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd1004f0c0 con 0x7fdd28069cd0 2024-01-21T20:18:20.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.620+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 msgr2=0x7fdd08061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.620+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 0x7fdd08061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fdd18006fd0 tx=0x7fdd1800b3b0).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.620+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 msgr2=0x7fdd28151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.620+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fdd1000e980 tx=0x7fdd10009060).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 shutdown_connections 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdd0805f150 0x7fdd08061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd280c3fb0 0x7fdd28066c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd28069cd0 0x7fdd28151080 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 --2- 172.21.15.133:0/3091501322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd280beb30 0x7fdd28066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 >> 172.21.15.133:0/3091501322 conn(0x7fdd280c8010 msgr2=0x7fdd28137b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:20.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 shutdown_connections 2024-01-21T20:18:20.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.621+0000 7fdd2deab700 1 -- 172.21.15.133:0/3091501322 wait complete. 2024-01-21T20:18:20.623 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T20:18:20.623 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T20:18:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.753+0000 7ff1bb5e6700 1 Processor -- start 2024-01-21T20:18:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.753+0000 7ff1bb5e6700 1 -- start start 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1b41546b0 0x7ff1b4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b40654f0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b4063700 con 0x7ff1b40a9e30 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b4063950 con 0x7ff1b41546b0 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1b41546b0 0x7ff1b4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9b83700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1b40bc6d0 0x7ff1b4066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40512/0 (socket says 172.21.15.133:40512) 2024-01-21T20:18:20.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1b41546b0 0x7ff1b4154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45056/0 (socket says 172.21.15.133:45056) 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9b83700 1 -- 172.21.15.133:0/1567934472 learned_addr learned my addr 172.21.15.133:0/1567934472 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 -- 172.21.15.133:0/1567934472 >> v1:172.21.15.178:6789/0 conn(0x7ff1b40a9e30 legacy=0x7ff1b4065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 -- 172.21.15.133:0/1567934472 >> v1:172.21.15.133:6789/0 conn(0x7ff1b40bc6d0 legacy=0x7ff1b4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 -- 172.21.15.133:0/1567934472 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b4065180 con 0x7ff1b41546b0 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1abfff700 1 -- 172.21.15.133:0/1567934472 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997473049 0 0) 0x7ff1b40654f0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1b9382700 1 --2- 172.21.15.133:0/1567934472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b41546b0 0x7ff1b4154a90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7ff1b0009760 tx=0x7ff1b0009060).ready entity=mon.0 client_cookie=19e66bd8e5cb93f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1abfff700 1 -- 172.21.15.133:0/1567934472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b00090d0 con 0x7ff1b41546b0 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1abfff700 1 -- 172.21.15.133:0/1567934472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b000b520 con 0x7ff1b41546b0 2024-01-21T20:18:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1abfff700 1 -- 172.21.15.133:0/1567934472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000b8a0 con 0x7ff1b41546b0 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/1567934472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b41546b0 msgr2=0x7ff1b4154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/1567934472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b41546b0 0x7ff1b4154a90 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7ff1b0009760 tx=0x7ff1b0009060).stop 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/1567934472 shutdown_connections 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/1567934472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b41546b0 0x7ff1b4154a90 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/1567934472 >> 172.21.15.133:0/1567934472 conn(0x7ff1b40c8200 msgr2=0x7ff1b40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/1567934472 shutdown_connections 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.755+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/1567934472 wait complete. 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 Processor -- start 2024-01-21T20:18:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- start start 2024-01-21T20:18:20.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1b40a9e30 0x7ff1b414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 0x7ff1b4167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40bfbc0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40aaa30 con 0x7ff1b41546b0 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b414f6a0 con 0x7ff1b40a9e30 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45058/0 (socket says 172.21.15.133:45058) 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 -- 172.21.15.133:0/2974369355 learned_addr learned my addr 172.21.15.133:0/2974369355 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b9b83700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 0x7ff1b4167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b9382700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1b40a9e30 0x7ff1b414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 -- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1b40a9e30 msgr2=0x7ff1b414cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1b40a9e30 0x7ff1b414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 -- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 msgr2=0x7ff1b4167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 0x7ff1b4167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 -- 172.21.15.133:0/2974369355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00092a0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b9b83700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 0x7ff1b4167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1b8b81700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7ff1a400b460 tx=0x7ff1a4006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4012410 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4012590 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b414f980 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4012950 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.758+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b40bf7e0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.759+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b405fdf0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.761+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff1a4012d00 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.761+0000 7ff1a9ffb700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 0x7ff198061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.761+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7ff1a407a1e0 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.761+0000 7ff1b9382700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 0x7ff198061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.761+0000 7ff1b9382700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 0x7ff198061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff1b000b2e0 tx=0x7ff1b0017000).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.765+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff1a404b250 con 0x7ff1b40bc6d0 2024-01-21T20:18:20.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:20.972+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff1b405e390 con 0x7ff1b40bc6d0 2024-01-21T20:18:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.618+0000 7ff1a9ffb700 1 -- 172.21.15.133:0/2974369355 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1a404e870 con 0x7ff1b40bc6d0 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 msgr2=0x7ff198061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 0x7ff198061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff1b000b2e0 tx=0x7ff1b0017000).stop 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 msgr2=0x7ff1b413e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7ff1a400b460 tx=0x7ff1a4006f20).stop 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 shutdown_connections 2024-01-21T20:18:21.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff19805f150 0x7ff198061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1b41546b0 0x7ff1b4167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1b40a9e30 0x7ff1b414cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 --2- 172.21.15.133:0/2974369355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1b40bc6d0 0x7ff1b413e280 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 >> 172.21.15.133:0/2974369355 conn(0x7ff1b40c8200 msgr2=0x7ff1b40c52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 shutdown_connections 2024-01-21T20:18:21.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.620+0000 7ff1bb5e6700 1 -- 172.21.15.133:0/2974369355 wait complete. 2024-01-21T20:18:21.624 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T20:18:21.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.757+0000 7fc740c3a700 1 Processor -- start 2024-01-21T20:18:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.757+0000 7fc740c3a700 1 -- start start 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc740c3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc73c0be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc740c3a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73c0bfa40 con 0x7fc73c0be5f0 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc740c3a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73c0bee30 con 0x7fc73c13b970 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc740c3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c0bf110 con 0x7fc73c0c3c10 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc73c0be5f0 0x7fc73c0a8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40526/0 (socket says 172.21.15.133:40526) 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73ad9d700 1 -- 172.21.15.133:0/2519336137 learned_addr learned my addr 172.21.15.133:0/2519336137 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc739d9b700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc73c0be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509660444 0 0) 0x7fc73c0bfa40 con 0x7fc73c0be5f0 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7240033f0 con 0x7fc73c0be5f0 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398726850 0 0) 0x7fc73c0bee30 con 0x7fc73c13b970 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc73c0bfa40 con 0x7fc73c13b970 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435679831 0 0) 0x7fc7240033f0 con 0x7fc73c0be5f0 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 msgr2=0x7fc73c0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc73c0be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 >> v1:172.21.15.178:6789/0 conn(0x7fc73c13b970 legacy=0x7fc73c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c0bf3f0 con 0x7fc73c0be5f0 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.758+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc734001770 con 0x7fc73c0be5f0 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 >> v1:172.21.15.133:6789/0 conn(0x7fc73c0be5f0 legacy=0x7fc73c0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc724003aa0 0x7fc724003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc724004690 0x7fc724004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc7240050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c0bf110 con 0x7fc724004690 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72400b9e0 con 0x7fc724003aa0 2024-01-21T20:18:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72400bba0 con 0x7fc73c0c3c10 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc724004690 0x7fc724004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73a59c700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc724003aa0 0x7fc724003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73ad9d700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc7240050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 -- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 msgr2=0x7fc7240050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc7240050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 -- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc724003aa0 msgr2=0x7fc724003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc724003aa0 0x7fc724003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 -- 172.21.15.133:0/2519336137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240033f0 con 0x7fc724004690 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73ad9d700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc73c0c3c10 0x7fc7240050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc739d9b700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc724004690 0x7fc724004b10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fc73c0c4010 tx=0x7fc730009060).ready entity=mon.0 client_cookie=3e3841f8c60953f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730009e90 con 0x7fc724004690 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730009430 con 0x7fc724004690 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.759+0000 7fc73959a700 1 -- 172.21.15.133:0/2519336137 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000e850 con 0x7fc724004690 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 -- 172.21.15.133:0/2519336137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc724004690 msgr2=0x7fc724004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 --2- 172.21.15.133:0/2519336137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc724004690 0x7fc724004b10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fc73c0c4010 tx=0x7fc730009060).stop 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc73ad9d700 1 -- 172.21.15.133:0/2519336137 reap_dead start 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 -- 172.21.15.133:0/2519336137 shutdown_connections 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 -- 172.21.15.133:0/2519336137 >> 172.21.15.133:0/2519336137 conn(0x7fc73c066a70 msgr2=0x7fc73c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 -- 172.21.15.133:0/2519336137 shutdown_connections 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.760+0000 7fc740c3a700 1 -- 172.21.15.133:0/2519336137 wait complete. 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.761+0000 7fc740c3a700 1 Processor -- start 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.761+0000 7fc740c3a700 1 -- start start 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc724004690 0x7fc73c063840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc73c156b70 0x7fc73c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c135620 con 0x7fc73c167a60 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c1574e0 con 0x7fc73c156b70 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc740c3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73c13ab70 con 0x7fc724004690 2024-01-21T20:18:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45072/0 (socket says 172.21.15.133:45072) 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 -- 172.21.15.133:0/199212652 learned_addr learned my addr 172.21.15.133:0/199212652 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc73a59c700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc724004690 0x7fc73c063840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc73ad9d700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc73c156b70 0x7fc73c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 -- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc724004690 msgr2=0x7fc73c063840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc724004690 0x7fc73c063840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 -- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc73c156b70 msgr2=0x7fc73c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc73c156b70 0x7fc73c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.762+0000 7fc739d9b700 1 -- 172.21.15.133:0/199212652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c167ec0 con 0x7fc73c167a60 2024-01-21T20:18:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc739d9b700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc73000e4b0 tx=0x7fc73001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73001d860 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73001d9e0 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73c063eb0 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73001dda0 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.763+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73c134fd0 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.764+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc73002f440 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.764+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73c05fdf0 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.764+0000 7fc72affd700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 0x7fc71c061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.765+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fc73007c090 con 0x7fc73c167a60 2024-01-21T20:18:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.765+0000 7fc73a59c700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 0x7fc71c061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.765+0000 7fc73a59c700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 0x7fc71c061640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc72c007fd0 tx=0x7fc72c007bb0).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.769+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc73004cfe0 con 0x7fc73c167a60 2024-01-21T20:18:21.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.973+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc73c0bf6d0 con 0x7fc73c167a60 2024-01-21T20:18:21.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.974+0000 7fc72affd700 1 -- 172.21.15.133:0/199212652 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fc730016020 con 0x7fc73c167a60 2024-01-21T20:18:21.964 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:21.964 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 msgr2=0x7fc71c061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 0x7fc71c061640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc72c007fd0 tx=0x7fc72c007bb0).stop 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 msgr2=0x7fc73c13a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc73000e4b0 tx=0x7fc73001a000).stop 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 shutdown_connections 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc71c05f180 0x7fc71c061640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc73c156b70 0x7fc73c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc724004690 0x7fc73c063840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 --2- 172.21.15.133:0/199212652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc73c167a60 0x7fc73c13a680 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.975+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 >> 172.21.15.133:0/199212652 conn(0x7fc73c066a70 msgr2=0x7fc73c0ac4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.976+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 shutdown_connections 2024-01-21T20:18:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:21.976+0000 7fc740c3a700 1 -- 172.21.15.133:0/199212652 wait complete. 2024-01-21T20:18:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T20:18:21.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T20:18:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.103+0000 7fefa0e4a700 1 Processor -- start 2024-01-21T20:18:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.104+0000 7fefa0e4a700 1 -- start start 2024-01-21T20:18:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fefa0e4a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef9c0bcc80 0x7fef9c0a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fefa0e4a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c065000 con 0x7fef9c0a4280 2024-01-21T20:18:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fefa0e4a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9c069540 con 0x7fef9c0bc8a0 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fefa0e4a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9c0a46e0 con 0x7fef9c0bcc80 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef99d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef9c0bcc80 0x7fef9c0a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fef9c0a4280 0x7fef9c06a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40530/0 (socket says 172.21.15.133:40530) 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9ad9d700 1 -- 172.21.15.133:0/586096176 learned_addr learned my addr 172.21.15.133:0/586096176 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9959a700 1 -- 172.21.15.133:0/586096176 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418668762 0 0) 0x7fef9c065000 con 0x7fef9c0a4280 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9959a700 1 -- 172.21.15.133:0/586096176 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef840033f0 con 0x7fef9c0a4280 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef99d9b700 1 -- 172.21.15.133:0/586096176 >> v1:172.21.15.178:6789/0 conn(0x7fef9c0bc8a0 legacy=0x7fef9c065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef99d9b700 1 -- 172.21.15.133:0/586096176 >> v1:172.21.15.133:6789/0 conn(0x7fef9c0a4280 legacy=0x7fef9c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef99d9b700 1 -- 172.21.15.133:0/586096176 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c064410 con 0x7fef9c0bcc80 2024-01-21T20:18:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef99d9b700 1 --2- 172.21.15.133:0/586096176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0bcc80 0x7fef9c0a3d90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fef9000a900 tx=0x7fef9000a200).ready entity=mon.0 client_cookie=f39f1b3b56f11dbb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9959a700 1 -- 172.21.15.133:0/586096176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000a2c0 con 0x7fef9c0bcc80 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9959a700 1 -- 172.21.15.133:0/586096176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9000c790 con 0x7fef9c0bcc80 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.105+0000 7fef9959a700 1 -- 172.21.15.133:0/586096176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9000cb10 con 0x7fef9c0bcc80 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 -- 172.21.15.133:0/586096176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0bcc80 msgr2=0x7fef9c0a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/586096176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0bcc80 0x7fef9c0a3d90 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fef9000a900 tx=0x7fef9000a200).stop 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 -- 172.21.15.133:0/586096176 shutdown_connections 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/586096176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0bcc80 0x7fef9c0a3d90 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 -- 172.21.15.133:0/586096176 >> 172.21.15.133:0/586096176 conn(0x7fef9c0c6ef0 msgr2=0x7fef9c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 -- 172.21.15.133:0/586096176 shutdown_connections 2024-01-21T20:18:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.106+0000 7fefa0e4a700 1 -- 172.21.15.133:0/586096176 wait complete. 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.107+0000 7fefa0e4a700 1 Processor -- start 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.107+0000 7fefa0e4a700 1 -- start start 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef9c0bc8a0 0x7fef9c0a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 0x7fef9c093bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1604b0 con 0x7fef9c0a4280 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1442d0 con 0x7fef9c0bc8a0 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fefa0e4a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9c1606b0 con 0x7fef9c0bcc80 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45088/0 (socket says 172.21.15.133:45088) 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9a59c700 1 -- 172.21.15.133:0/2846022271 learned_addr learned my addr 172.21.15.133:0/2846022271 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef99d9b700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef9c0bc8a0 0x7fef9c0a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9ad9d700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 0x7fef9c093bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9a59c700 1 -- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 msgr2=0x7fef9c093bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.108+0000 7fef9a59c700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 0x7fef9c093bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef9a59c700 1 -- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef9c0bc8a0 msgr2=0x7fef9c0a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef9a59c700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef9c0bc8a0 0x7fef9c0a6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef9a59c700 1 -- 172.21.15.133:0/2846022271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9000a440 con 0x7fef9c0a4280 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef9ad9d700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 0x7fef9c093bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef9a59c700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fef8c00c490 tx=0x7fef8c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00f470 con 0x7fef9c0a4280 2024-01-21T20:18:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00f5d0 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c160990 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00f950 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.109+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9c160f50 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.110+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9c05fdf0 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.110+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fef8c00fd40 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.111+0000 7fef8affd700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 0x7fef7c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.111+0000 7fef99d9b700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 0x7fef7c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.111+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fef8c079880 con 0x7fef9c0a4280 2024-01-21T20:18:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.111+0000 7fef99d9b700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 0x7fef7c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef9000afd0 tx=0x7fef9000a200).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.115+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef8c048b00 con 0x7fef9c0a4280 2024-01-21T20:18:22.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.277+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9c0bd9b0 con 0x7fef9c0a4280 2024-01-21T20:18:22.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.278+0000 7fef8affd700 1 -- 172.21.15.133:0/2846022271 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17920 (secure 0 0 0) 0x7fef8c04a940 con 0x7fef9c0a4280 2024-01-21T20:18:22.268 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:22.268 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":139,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T20:18:20.608159+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T20:18:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 msgr2=0x7fef7c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 0x7fef7c061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef9000afd0 tx=0x7fef9000a200).stop 2024-01-21T20:18:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 msgr2=0x7fef9c143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fef8c00c490 tx=0x7fef8c007de0).stop 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 shutdown_connections 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef7c05f150 0x7fef7c061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef9c0bcc80 0x7fef9c093bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef9c0a4280 0x7fef9c143de0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 --2- 172.21.15.133:0/2846022271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef9c0bc8a0 0x7fef9c0a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.280+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 >> 172.21.15.133:0/2846022271 conn(0x7fef9c0c6ef0 msgr2=0x7fef9c0c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.281+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 shutdown_connections 2024-01-21T20:18:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.281+0000 7fefa0e4a700 1 -- 172.21.15.133:0/2846022271 wait complete. 2024-01-21T20:18:22.282 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T20:18:22.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:18:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.410+0000 7fbfc9b1f700 1 Processor -- start 2024-01-21T20:18:22.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.411+0000 7fbfc9b1f700 1 -- start start 2024-01-21T20:18:22.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.411+0000 7fbfc9b1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc413ac10 0x7fbfc40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.411+0000 7fbfc9b1f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc40c3890 con 0x7fbfc413a830 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.411+0000 7fbfc9b1f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc40c3b70 con 0x7fbfc40695b0 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.411+0000 7fbfc9b1f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40c3e50 con 0x7fbfc413ac10 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc413ac10 0x7fbfc40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbfc413a830 0x7fbfc40bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40546/0 (socket says 172.21.15.133:40546) 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc37fe700 1 -- 172.21.15.133:0/3165440049 learned_addr learned my addr 172.21.15.133:0/3165440049 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/3165440049 >> v1:172.21.15.178:6789/0 conn(0x7fbfc40695b0 legacy=0x7fbfc40699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/3165440049 >> v1:172.21.15.133:6789/0 conn(0x7fbfc413a830 legacy=0x7fbfc40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/3165440049 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40c4130 con 0x7fbfc413ac10 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc27fc700 1 -- 172.21.15.133:0/3165440049 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554679659 0 0) 0x7fbfc40c3890 con 0x7fbfc413a830 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc2ffd700 1 --2- 172.21.15.133:0/3165440049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413ac10 0x7fbfc40c3220 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fbfb8009760 tx=0x7fbfb8009060).ready entity=mon.0 client_cookie=6a0bcc3fb0ef3de0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc27fc700 1 -- 172.21.15.133:0/3165440049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80090d0 con 0x7fbfc413ac10 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc27fc700 1 -- 172.21.15.133:0/3165440049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800b520 con 0x7fbfc413ac10 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.412+0000 7fbfc27fc700 1 -- 172.21.15.133:0/3165440049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800b8a0 con 0x7fbfc413ac10 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/3165440049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413ac10 msgr2=0x7fbfc40c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/3165440049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413ac10 0x7fbfc40c3220 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fbfb8009760 tx=0x7fbfb8009060).stop 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/3165440049 shutdown_connections 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/3165440049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413ac10 0x7fbfc40c3220 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/3165440049 >> 172.21.15.133:0/3165440049 conn(0x7fbfc40c7dc0 msgr2=0x7fbfc40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/3165440049 shutdown_connections 2024-01-21T20:18:22.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.413+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/3165440049 wait complete. 2024-01-21T20:18:22.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.414+0000 7fbfc9b1f700 1 Processor -- start 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.414+0000 7fbfc9b1f700 1 -- start start 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfc40695b0 0x7fbfc40aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfc413ac10 0x7fbfc40c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40c1ab0 con 0x7fbfc413a830 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40a5420 con 0x7fbfc40695b0 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc9b1f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc40a5700 con 0x7fbfc413ac10 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45096/0 (socket says 172.21.15.133:45096) 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/1674236105 learned_addr learned my addr 172.21.15.133:0/1674236105 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc37fe700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfc40695b0 0x7fbfc40aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc3fff700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfc413ac10 0x7fbfc40c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfc413ac10 msgr2=0x7fbfc40c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfc413ac10 0x7fbfc40c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfc40695b0 msgr2=0x7fbfc40aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfc40695b0 0x7fbfc40aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 -- 172.21.15.133:0/1674236105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80092a0 con 0x7fbfc413a830 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.415+0000 7fbfc2ffd700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fbfc4068c60 tx=0x7fbfb8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.416+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8011a10 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.416+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8011b70 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.416+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc40a59e0 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.416+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb801b410 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.416+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4136ec0 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.417+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc40c1d90 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.417+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbfb801b800 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.417+0000 7fbfabfff700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 0x7fbfb00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.418+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fbfb807bec0 con 0x7fbfc413a830 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.418+0000 7fbfc37fe700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 0x7fbfb00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.418+0000 7fbfc37fe700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 0x7fbfb00615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbfb4007fd0 tx=0x7fbfb4007dd0).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.422+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbfb804cf30 con 0x7fbfc413a830 2024-01-21T20:18:22.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.581+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfc40a52a0 con 0x7fbfb005f120 2024-01-21T20:18:22.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.591+0000 7fbfabfff700 1 -- 172.21.15.133:0/1674236105 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353236 (secure 0 0 0) 0x7fbfb40074f0 con 0x7fbfb005f120 2024-01-21T20:18:22.587 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 msgr2=0x7fbfb00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 0x7fbfb00615e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fbfb4007fd0 tx=0x7fbfb4007dd0).stop 2024-01-21T20:18:22.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 msgr2=0x7fbfc41369d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fbfc4068c60 tx=0x7fbfb8017000).stop 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 shutdown_connections 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbfb005f120 0x7fbfb00615e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfc413ac10 0x7fbfc40c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfc40695b0 0x7fbfc40aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 --2- 172.21.15.133:0/1674236105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc413a830 0x7fbfc41369d0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 >> 172.21.15.133:0/1674236105 conn(0x7fbfc40c7dc0 msgr2=0x7fbfc40c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 shutdown_connections 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.594+0000 7fbfc9b1f700 1 -- 172.21.15.133:0/1674236105 wait complete. 2024-01-21T20:18:22.594 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:18:22.596 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:18:21.683150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430856,"kb_used_data":13128,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543864,"statfs":{"total":773094113280,"available":770604916736,"internally_reserved":0,"allocated":13443072,"data_stored":7077666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19377,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-68,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.505886"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234823+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228046+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236561+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227267+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233413+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228792+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233242+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234482+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234495+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228137+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235496+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235316+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233990+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233381+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235273+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230085+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232534+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236183+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227815+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230669+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230234+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228375+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231867+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229649+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231594+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234162+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231807+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230251+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227779+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233880+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231480+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231890+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234763+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235768+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233761+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229786+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234343+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233394+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227069+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234400+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231419+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233634+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230327+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231620+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232138+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232250+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235161+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229254+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227834+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232412+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231174+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230702+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224514+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:18:16.224514+0000","last_peered":"2024-01-21T20:18:16.224514+0000","last_clean":"2024-01-21T20:18:16.224514+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:18:16.224514+0000","last_undegraded":"2024-01-21T20:18:16.224514+0000","last_fullsized":"2024-01-21T20:18:16.224514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.226483+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:18:16.226483+0000","last_peered":"2024-01-21T20:18:16.226483+0000","last_clean":"2024-01-21T20:18:16.226483+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:18:16.226483+0000","last_undegraded":"2024-01-21T20:18:16.226483+0000","last_fullsized":"2024-01-21T20:18:16.226483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229399+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224527+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:18:16.224527+0000","last_peered":"2024-01-21T20:18:16.224527+0000","last_clean":"2024-01-21T20:18:16.224527+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:18:16.224527+0000","last_undegraded":"2024-01-21T20:18:16.224527+0000","last_fullsized":"2024-01-21T20:18:16.224527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760100+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:18:16.760100+0000","last_peered":"2024-01-21T20:18:16.760100+0000","last_clean":"2024-01-21T20:18:16.760100+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:18:16.760100+0000","last_undegraded":"2024-01-21T20:18:16.760100+0000","last_fullsized":"2024-01-21T20:18:16.760100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229425+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760118+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:18:16.760118+0000","last_peered":"2024-01-21T20:18:16.760118+0000","last_clean":"2024-01-21T20:18:16.760118+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:18:16.760118+0000","last_undegraded":"2024-01-21T20:18:16.760118+0000","last_fullsized":"2024-01-21T20:18:16.760118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228454+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230295+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302836,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069004,"statfs":{"total":96636764160,"available":96326660096,"internally_reserved":0,"allocated":1683456,"data_stored":887404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82099999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.871},"last":0.436},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.79700000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80400000000000005},"last":0.56599999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.309},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81499999999999995},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.25},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.27800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.504}]},{"osd":1,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.107},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.016},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.877,"15min":1.0609999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":1.621,"15min":1.621},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.28599999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.84599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28299999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.86099999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86899999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.38900000000000001},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47899999999999998,"5min":0.58099999999999996,"15min":0.60599999999999998},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61499999999999999},"last":0.28100000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.245},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.68799999999999994},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.58299999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39300000000000002,"15min":0.40999999999999998},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.438}]},{"osd":5,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.876,"15min":0.98899999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.878,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.371}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.95299999999999996},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302824,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069016,"statfs":{"total":96636764160,"available":96326672384,"internally_reserved":0,"allocated":1671168,"data_stored":880571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38100000000000001,"15min":0.39800000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.245},"max":{"1min":0.503,"5min":0.57499999999999996,"15min":0.70799999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.59999999999999998,"15min":0.81699999999999995},"last":0.34599999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.42399999999999999},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80600000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.5,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.371},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26900000000000002},"max":{"1min":0.49199999999999999,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.495,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40200000000000002,"15min":0.42099999999999999},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55500000000000005,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.45500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81799999999999995,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.751},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.375},"max":{"1min":0.876,"5min":0.95999999999999996,"15min":1.1759999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.375,"15min":0.373},"max":{"1min":0.68500000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93300000000000005,"15min":1.216},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575076,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.40799999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":0.626,"15min":7.8940000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.443},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.60099999999999998,"15min":7.532},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.37,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":6.9660000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39100000000000001,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":7.8380000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":7.0199999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":8.0220000000000002},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.85099999999999998,"15min":7.6020000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.64200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":7.0940000000000003},"last":0.754}]},{"osd":5,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.1230000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":7.9939999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":7.9649999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.85199999999999998,"15min":7.3540000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61299999999999999,"15min":0.66600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.91300000000000003,"15min":7.5620000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.67900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":7.8200000000000003},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82599999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.372},"max":{"1min":0.75,"5min":0.75,"15min":0.82699999999999996},"last":0.624}]},{"osd":1,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.89600000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.83499999999999996},"last":0.63500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84499999999999997,"5min":1.472,"15min":1.472},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.38,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.79800000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78100000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.81899999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.748,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.32400000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.875,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306924,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064916,"statfs":{"total":96636764160,"available":96322473984,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82899999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.252},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.315},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":1.8520000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.83399999999999996,"15min":0.85699999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.9350000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.4079999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83299999999999996},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":1.008},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.498,"15min":0.499},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":1.891},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":1.9079999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.96099999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.78900000000000003,"15min":1.3200000000000001},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:18:22.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:18:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.764+0000 7f51a6476700 1 Processor -- start 2024-01-21T20:18:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.764+0000 7f51a6476700 1 -- start start 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a6476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f51a0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a6476700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51a0069ef0 0x7f51a0066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a6476700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a0065660 con 0x7f51a00c3fb0 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a6476700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a00bef10 con 0x7f51a0069ef0 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a6476700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0156070 con 0x7f51a00beb30 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f519f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51a00c3fb0 0x7f51a00697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40548/0 (socket says 172.21.15.133:40548) 2024-01-21T20:18:22.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f519f7fe700 1 -- 172.21.15.133:0/134474590 learned_addr learned my addr 172.21.15.133:0/134474590 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f51a4a13700 1 --2- 172.21.15.133:0/134474590 >> v2:172.21.15.178:3300/0 conn(0x7f51a0069ef0 0x7f51a0066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f519ffff700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f51a0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250866573 0 0) 0x7f51a0065660 con 0x7f51a00c3fb0 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.765+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f518c0033f0 con 0x7f51a00c3fb0 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2410462566 0 0) 0x7f518c0033f0 con 0x7f51a00c3fb0 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 msgr2=0x7f51a0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f51a0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 >> v2:172.21.15.178:3300/0 conn(0x7f51a0069ef0 msgr2=0x7f51a0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:22.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 --2- 172.21.15.133:0/134474590 >> v2:172.21.15.178:3300/0 conn(0x7f51a0069ef0 0x7f51a0066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a0065f00 con 0x7f51a00c3fb0 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f5190001470 con 0x7f51a00c3fb0 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 >> v1:172.21.15.133:6789/0 conn(0x7f51a00c3fb0 legacy=0x7f51a00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f518c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f518c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f518c004b80 0x7f518c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a00bef10 con 0x7f518c003910 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0156070 con 0x7f518c004b80 2024-01-21T20:18:22.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c00b8e0 con 0x7f51a00beb30 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f51a4a13700 1 --2- 172.21.15.133:0/134474590 >> v2:172.21.15.178:3300/0 conn(0x7f51a0069ef0 0x7f51a0066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f518c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519f7fe700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f518c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f51a4a13700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f518c004b80 0x7f518c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 -- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 msgr2=0x7f518c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a00beb30 0x7f518c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 -- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f518c004b80 msgr2=0x7f518c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f518c004b80 0x7f518c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 -- 172.21.15.133:0/134474590 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0033f0 con 0x7f518c003910 2024-01-21T20:18:22.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519ffff700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f518c003d30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f5188009ab0 tx=0x7f5188009060).ready entity=mon.0 client_cookie=bd8f81f73b02569 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188009430 con 0x7f518c003910 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518800e640 con 0x7f518c003910 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.766+0000 7f519effd700 1 -- 172.21.15.133:0/134474590 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800e9c0 con 0x7f518c003910 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 -- 172.21.15.133:0/134474590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 msgr2=0x7f518c003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 --2- 172.21.15.133:0/134474590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f518c003d30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f5188009ab0 tx=0x7f5188009060).stop 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a4a13700 1 -- 172.21.15.133:0/134474590 reap_dead start 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 -- 172.21.15.133:0/134474590 shutdown_connections 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 -- 172.21.15.133:0/134474590 >> 172.21.15.133:0/134474590 conn(0x7f51a00c8010 msgr2=0x7f51a00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 -- 172.21.15.133:0/134474590 shutdown_connections 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.767+0000 7f51a6476700 1 -- 172.21.15.133:0/134474590 wait complete. 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.768+0000 7f51a6476700 1 Processor -- start 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.769+0000 7f51a6476700 1 -- start start 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a00a6010 0x7f51a00626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0166aa0 0x7f51a00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a01398d0 con 0x7f518c003910 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0166610 con 0x7f51a00a6010 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a0062be0 con 0x7f51a0166aa0 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45122/0 (socket says 172.21.15.133:45122) 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 -- 172.21.15.133:0/843497969 learned_addr learned my addr 172.21.15.133:0/843497969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519f7fe700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a00a6010 0x7f51a00626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a4a13700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0166aa0 0x7f51a00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 -- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0166aa0 msgr2=0x7f51a00c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0166aa0 0x7f51a00c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 -- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a00a6010 msgr2=0x7f51a00626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a00a6010 0x7f51a00626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 -- 172.21.15.133:0/843497969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a00ad3c0 con 0x7f518c003910 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519ffff700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f518801dfd0 tx=0x7f518801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518800ed30 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518800ee90 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a0062e60 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188026440 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.770+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a0063420 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.771+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a01668f0 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.772+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f518802f440 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.772+0000 7f519cff9700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 0x7f5180061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.772+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f518807c150 con 0x7f518c003910 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.772+0000 7f519f7fe700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 0x7f5180061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:22.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.772+0000 7f519f7fe700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 0x7f5180061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f51a00a5fa0 tx=0x7f5190007040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:22.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.776+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f518804d160 con 0x7f518c003910 2024-01-21T20:18:22.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.938+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51a005fdf0 con 0x7f518005f150 2024-01-21T20:18:22.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.947+0000 7f519cff9700 1 -- 172.21.15.133:0/843497969 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353236 (secure 0 0 0) 0x7f51a005fdf0 con 0x7f518005f150 2024-01-21T20:18:22.941 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 msgr2=0x7f5180061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 0x7f5180061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f51a00a5fa0 tx=0x7f5190007040).stop 2024-01-21T20:18:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 msgr2=0x7f51a01393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f518801dfd0 tx=0x7f518801a000).stop 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 shutdown_connections 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f518005f150 0x7f5180061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a0166aa0 0x7f51a00c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f518c003910 0x7f51a01393e0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 --2- 172.21.15.133:0/843497969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a00a6010 0x7f51a00626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 >> 172.21.15.133:0/843497969 conn(0x7f51a00c8010 msgr2=0x7f51a013a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 shutdown_connections 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:22.950+0000 7f51a6476700 1 -- 172.21.15.133:0/843497969 wait complete. 2024-01-21T20:18:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:18:22.952 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:18:21.683150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430856,"kb_used_data":13128,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543864,"statfs":{"total":773094113280,"available":770604916736,"internally_reserved":0,"allocated":13443072,"data_stored":7077666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19377,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-68,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.505886"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234823+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228046+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236561+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227267+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233413+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228792+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233242+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234482+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234495+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228137+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235496+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235316+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233990+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233381+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235273+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230085+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232534+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236183+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227815+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230669+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230234+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228375+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231867+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229649+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231594+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234162+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231807+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230251+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227779+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233880+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231480+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231890+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234763+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235768+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233761+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229786+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234343+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233394+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227069+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234400+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231419+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233634+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230327+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231620+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232138+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232250+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235161+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229254+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227834+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232412+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231174+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230702+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224514+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:18:16.224514+0000","last_peered":"2024-01-21T20:18:16.224514+0000","last_clean":"2024-01-21T20:18:16.224514+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:18:16.224514+0000","last_undegraded":"2024-01-21T20:18:16.224514+0000","last_fullsized":"2024-01-21T20:18:16.224514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.226483+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:18:16.226483+0000","last_peered":"2024-01-21T20:18:16.226483+0000","last_clean":"2024-01-21T20:18:16.226483+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:18:16.226483+0000","last_undegraded":"2024-01-21T20:18:16.226483+0000","last_fullsized":"2024-01-21T20:18:16.226483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229399+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224527+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:18:16.224527+0000","last_peered":"2024-01-21T20:18:16.224527+0000","last_clean":"2024-01-21T20:18:16.224527+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:18:16.224527+0000","last_undegraded":"2024-01-21T20:18:16.224527+0000","last_fullsized":"2024-01-21T20:18:16.224527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760100+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:18:16.760100+0000","last_peered":"2024-01-21T20:18:16.760100+0000","last_clean":"2024-01-21T20:18:16.760100+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:18:16.760100+0000","last_undegraded":"2024-01-21T20:18:16.760100+0000","last_fullsized":"2024-01-21T20:18:16.760100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229425+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760118+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:18:16.760118+0000","last_peered":"2024-01-21T20:18:16.760118+0000","last_clean":"2024-01-21T20:18:16.760118+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:18:16.760118+0000","last_undegraded":"2024-01-21T20:18:16.760118+0000","last_fullsized":"2024-01-21T20:18:16.760118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228454+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230295+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302836,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069004,"statfs":{"total":96636764160,"available":96326660096,"internally_reserved":0,"allocated":1683456,"data_stored":887404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82099999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.871},"last":0.436},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.79700000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80400000000000005},"last":0.56599999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.309},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81499999999999995},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.25},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.27800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.504}]},{"osd":1,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.107},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.016},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.877,"15min":1.0609999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":1.621,"15min":1.621},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.28599999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.84599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28299999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.86099999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86899999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.38900000000000001},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47899999999999998,"5min":0.58099999999999996,"15min":0.60599999999999998},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61499999999999999},"last":0.28100000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.245},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.68799999999999994},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.58299999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39300000000000002,"15min":0.40999999999999998},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.438}]},{"osd":5,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.876,"15min":0.98899999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.878,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.371}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.95299999999999996},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302824,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069016,"statfs":{"total":96636764160,"available":96326672384,"internally_reserved":0,"allocated":1671168,"data_stored":880571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38100000000000001,"15min":0.39800000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.245},"max":{"1min":0.503,"5min":0.57499999999999996,"15min":0.70799999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.59999999999999998,"15min":0.81699999999999995},"last":0.34599999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.42399999999999999},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80600000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.5,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.371},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26900000000000002},"max":{"1min":0.49199999999999999,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.495,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40200000000000002,"15min":0.42099999999999999},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55500000000000005,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.45500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81799999999999995,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.751},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.375},"max":{"1min":0.876,"5min":0.95999999999999996,"15min":1.1759999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.375,"15min":0.373},"max":{"1min":0.68500000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93300000000000005,"15min":1.216},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575076,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.40799999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":0.626,"15min":7.8940000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.443},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.60099999999999998,"15min":7.532},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.37,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":6.9660000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39100000000000001,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":7.8380000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":7.0199999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":8.0220000000000002},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.85099999999999998,"15min":7.6020000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.64200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":7.0940000000000003},"last":0.754}]},{"osd":5,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.1230000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":7.9939999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":7.9649999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.85199999999999998,"15min":7.3540000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61299999999999999,"15min":0.66600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.91300000000000003,"15min":7.5620000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.67900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":7.8200000000000003},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82599999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.372},"max":{"1min":0.75,"5min":0.75,"15min":0.82699999999999996},"last":0.624}]},{"osd":1,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.89600000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.83499999999999996},"last":0.63500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84499999999999997,"5min":1.472,"15min":1.472},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.38,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.79800000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78100000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.81899999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.748,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.32400000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.875,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306924,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064916,"statfs":{"total":96636764160,"available":96322473984,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82899999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.252},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.315},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":1.8520000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.83399999999999996,"15min":0.85699999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.9350000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.4079999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83299999999999996},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":1.008},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.498,"15min":0.499},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":1.891},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":1.9079999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.96099999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.78900000000000003,"15min":1.3200000000000001},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:18:22.957 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:18:23.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.119+0000 7fdddaf9c700 1 Processor -- start 2024-01-21T20:18:23.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.119+0000 7fdddaf9c700 1 -- start start 2024-01-21T20:18:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.120+0000 7fdddaf9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddd4062ff0 0x7fddd4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.120+0000 7fdddaf9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 0x7fddd40bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.120+0000 7fdddaf9c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4069ef0 con 0x7fddd4062c10 2024-01-21T20:18:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.120+0000 7fdddaf9c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4065fe0 con 0x7fddd4062ff0 2024-01-21T20:18:23.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.120+0000 7fdddaf9c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd406a130 con 0x7fddd4065b50 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd9539700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 0x7fddd40bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddd4062ff0 0x7fddd4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddd4062ff0 0x7fddd4065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:53652/0 (socket says 172.21.15.133:53652) 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd8d38700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fddd4062c10 0x7fddd40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35978/0 (socket says 172.21.15.133:35978) 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd9539700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 0x7fddd40bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54096/0 (socket says 172.21.15.133:54096) 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 -- 172.21.15.133:0/3916415417 learned_addr learned my addr 172.21.15.133:0/3916415417 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 -- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 msgr2=0x7fddd40bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 --2- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 0x7fddd40bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 -- 172.21.15.133:0/3916415417 >> v1:172.21.15.178:6789/0 conn(0x7fddd4062c10 legacy=0x7fddd40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 -- 172.21.15.133:0/3916415417 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd406a410 con 0x7fddd4062ff0 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd3fff700 1 --2- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd4065660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fddc0006fd0 tx=0x7fddc00090f0).ready entity=mon.1 client_cookie=854c60ee1db02312 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd37fe700 1 -- 172.21.15.133:0/3916415417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000b580 con 0x7fddd4062ff0 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd37fe700 1 -- 172.21.15.133:0/3916415417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000b6e0 con 0x7fddd4062ff0 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.121+0000 7fddd37fe700 1 -- 172.21.15.133:0/3916415417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000ba80 con 0x7fddd4062ff0 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 -- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 msgr2=0x7fddd4065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd4065660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fddc0006fd0 tx=0x7fddc00090f0).stop 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 -- 172.21.15.133:0/3916415417 shutdown_connections 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4065b50 0x7fddd40bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/3916415417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd4065660 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 -- 172.21.15.133:0/3916415417 >> 172.21.15.133:0/3916415417 conn(0x7fddd40c8010 msgr2=0x7fddd40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:23.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 -- 172.21.15.133:0/3916415417 shutdown_connections 2024-01-21T20:18:23.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.122+0000 7fdddaf9c700 1 -- 172.21.15.133:0/3916415417 wait complete. 2024-01-21T20:18:23.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.123+0000 7fdddaf9c700 1 Processor -- start 2024-01-21T20:18:23.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.123+0000 7fdddaf9c700 1 -- start start 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4062c10 0x7fddd40ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd40a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a89b0 con 0x7fddd4065b50 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40bf950 con 0x7fddd4062ff0 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fdddaf9c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40bfae0 con 0x7fddd4062c10 2024-01-21T20:18:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45128/0 (socket says 172.21.15.133:45128) 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 -- 172.21.15.133:0/2076697942 learned_addr learned my addr 172.21.15.133:0/2076697942 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd3fff700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd40a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd8d38700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4062c10 0x7fddd40ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 -- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4062c10 msgr2=0x7fddd40ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4062c10 0x7fddd40ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 -- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 msgr2=0x7fddd40a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd40a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 -- 172.21.15.133:0/2076697942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0009370 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd3fff700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd40a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.124+0000 7fddd9539700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fddcc009e90 tx=0x7fddcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.125+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00caa0 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.125+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc00f040 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.125+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00ce10 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.125+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd413a870 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.125+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40acee0 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.126+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd405fdf0 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.126+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fddcc013610 con 0x7fddd4065b50 2024-01-21T20:18:23.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.126+0000 7fddd17fa700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 0x7fddb8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.126+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fddcc07ad20 con 0x7fddd4065b50 2024-01-21T20:18:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.126+0000 7fddd8d38700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 0x7fddb8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.127+0000 7fddd8d38700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 0x7fddb8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fddc8007fd0 tx=0x7fddc8007d30).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.130+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fddcc04be30 con 0x7fddd4065b50 2024-01-21T20:18:23.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.290+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddd40c8e40 con 0x7fddb805f150 2024-01-21T20:18:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.299+0000 7fddd17fa700 1 -- 172.21.15.133:0/2076697942 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353236 (secure 0 0 0) 0x7fddd40c8e40 con 0x7fddb805f150 2024-01-21T20:18:23.294 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 msgr2=0x7fddb8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 0x7fddb8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fddc8007fd0 tx=0x7fddc8007d30).stop 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 msgr2=0x7fddd413a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fddcc009e90 tx=0x7fddcc00b040).stop 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 shutdown_connections 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fddb805f150 0x7fddb8061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd4065b50 0x7fddd413a380 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddd4062c10 0x7fddd40ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 --2- 172.21.15.133:0/2076697942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddd4062ff0 0x7fddd40a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 >> 172.21.15.133:0/2076697942 conn(0x7fddd40c8010 msgr2=0x7fddd40c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 shutdown_connections 2024-01-21T20:18:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.303+0000 7fdddaf9c700 1 -- 172.21.15.133:0/2076697942 wait complete. 2024-01-21T20:18:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:18:23.304 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T20:18:21.683150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430856,"kb_used_data":13128,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543864,"statfs":{"total":773094113280,"available":770604916736,"internally_reserved":0,"allocated":13443072,"data_stored":7077666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19377,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-68,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.505886"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234823+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228046+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236561+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227267+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233413+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228792+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233242+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234482+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234495+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228137+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235496+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235316+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233990+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233381+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235273+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230085+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232534+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.236183+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227815+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230669+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230234+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228375+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231867+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229649+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231594+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234162+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231807+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230251+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227779+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233880+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231480+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231890+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234763+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235768+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233761+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229786+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234343+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233394+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227069+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.234400+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231419+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.233634+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230327+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232836+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231620+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232138+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232250+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.235161+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229254+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227834+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231372+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.232412+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.231174+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230702+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224514+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:18:16.224514+0000","last_peered":"2024-01-21T20:18:16.224514+0000","last_clean":"2024-01-21T20:18:16.224514+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:18:16.224514+0000","last_undegraded":"2024-01-21T20:18:16.224514+0000","last_fullsized":"2024-01-21T20:18:16.224514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229812+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.226483+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:18:16.226483+0000","last_peered":"2024-01-21T20:18:16.226483+0000","last_clean":"2024-01-21T20:18:16.226483+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:18:16.226483+0000","last_undegraded":"2024-01-21T20:18:16.226483+0000","last_fullsized":"2024-01-21T20:18:16.226483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229399+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":122,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.224527+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:18:16.224527+0000","last_peered":"2024-01-21T20:18:16.224527+0000","last_clean":"2024-01-21T20:18:16.224527+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:18:16.224527+0000","last_undegraded":"2024-01-21T20:18:16.224527+0000","last_fullsized":"2024-01-21T20:18:16.224527+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":110,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760100+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:18:16.760100+0000","last_peered":"2024-01-21T20:18:16.760100+0000","last_clean":"2024-01-21T20:18:16.760100+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:18:16.760100+0000","last_undegraded":"2024-01-21T20:18:16.760100+0000","last_fullsized":"2024-01-21T20:18:16.760100+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.229425+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760118+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:18:16.760118+0000","last_peered":"2024-01-21T20:18:16.760118+0000","last_clean":"2024-01-21T20:18:16.760118+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:18:16.760118+0000","last_undegraded":"2024-01-21T20:18:16.760118+0000","last_fullsized":"2024-01-21T20:18:16.760118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.227774+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":108,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.228454+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760098+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:18:16.760098+0000","last_peered":"2024-01-21T20:18:16.760098+0000","last_clean":"2024-01-21T20:18:16.760098+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:18:16.760098+0000","last_undegraded":"2024-01-21T20:18:16.760098+0000","last_fullsized":"2024-01-21T20:18:16.760098+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T20:18:19.224210+0000","last_change":"2024-01-21T20:18:19.224210+0000","last_active":"2024-01-21T20:18:19.224210+0000","last_peered":"2024-01-21T20:18:19.224210+0000","last_clean":"2024-01-21T20:18:19.224210+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:19.224210+0000","last_undegraded":"2024-01-21T20:18:19.224210+0000","last_fullsized":"2024-01-21T20:18:19.224210+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T20:18:18.218332+0000","last_change":"2024-01-21T20:18:18.230295+0000","last_active":"2024-01-21T20:18:18.218332+0000","last_peered":"2024-01-21T20:18:18.218332+0000","last_clean":"2024-01-21T20:18:18.218332+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T20:18:18.218332+0000","last_undegraded":"2024-01-21T20:18:18.218332+0000","last_fullsized":"2024-01-21T20:18:18.218332+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":106,"reported_epoch":135,"state":"active+clean","last_fresh":"2024-01-21T20:18:16.760099+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:18:16.760099+0000","last_peered":"2024-01-21T20:18:16.760099+0000","last_clean":"2024-01-21T20:18:16.760099+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:18:16.760099+0000","last_undegraded":"2024-01-21T20:18:16.760099+0000","last_fullsized":"2024-01-21T20:18:16.760099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575075,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302836,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069004,"statfs":{"total":96636764160,"available":96326660096,"internally_reserved":0,"allocated":1683456,"data_stored":887404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82099999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.871},"last":0.436},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.79700000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80400000000000005},"last":0.56599999999999995}]},{"osd":3,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.66800000000000004}]},{"osd":5,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.309},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81499999999999995},"last":0.629}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306936,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064904,"statfs":{"total":96636764160,"available":96322461696,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.25},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.27800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.504}]},{"osd":1,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.107},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.016},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.877,"15min":1.0609999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":1.621,"15min":1.621},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.28599999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.84599999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28299999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.86099999999999999},"last":0.60499999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86899999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.61899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.38900000000000001},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47899999999999998,"5min":0.58099999999999996,"15min":0.60599999999999998},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61499999999999999},"last":0.28100000000000003}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.245},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.68799999999999994},"last":0.26800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.58299999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.377},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39300000000000002,"15min":0.40999999999999998},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.438}]},{"osd":5,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.876,"15min":0.98899999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.878,"15min":0.99299999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.371}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.95299999999999996},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302824,"kb_used_data":1632,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069016,"statfs":{"total":96636764160,"available":96326672384,"internally_reserved":0,"allocated":1671168,"data_stored":880571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38100000000000001,"15min":0.39800000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.372}]},{"osd":2,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.245},"max":{"1min":0.503,"5min":0.57499999999999996,"15min":0.70799999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.59999999999999998,"15min":0.81699999999999995},"last":0.34599999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.42399999999999999},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.35399999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.68700000000000006}]},{"osd":6,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80600000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.5,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.371},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26900000000000002},"max":{"1min":0.49199999999999999,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.31}]},{"osd":1,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.495,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40200000000000002,"15min":0.42099999999999999},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55500000000000005,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.45500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81799999999999995,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.751},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.375},"max":{"1min":0.876,"5min":0.95999999999999996,"15min":1.1759999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.375,"15min":0.373},"max":{"1min":0.68500000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.73199999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93300000000000005,"15min":1.216},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575076,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302828,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069012,"statfs":{"total":96636764160,"available":96326668288,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.40799999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":0.626,"15min":7.8940000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.443},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.60099999999999998,"15min":7.532},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.37,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":6.9660000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.39100000000000001,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":7.8380000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":7.0199999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":8.0220000000000002},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.85099999999999998,"15min":7.6020000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.64200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":7.0940000000000003},"last":0.754}]},{"osd":5,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.1230000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":7.9939999999999998},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":7.9649999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.85199999999999998,"15min":7.3540000000000001},"last":0.64100000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61299999999999999,"15min":0.66600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.91300000000000003,"15min":7.5620000000000003},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.67900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":7.8200000000000003},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302840,"kb_used_data":1648,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069000,"statfs":{"total":96636764160,"available":96326656000,"internally_reserved":0,"allocated":1687552,"data_stored":888365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82599999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.372},"max":{"1min":0.75,"5min":0.75,"15min":0.82699999999999996},"last":0.624}]},{"osd":1,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.89600000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.83499999999999996},"last":0.63500000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84499999999999997,"5min":1.472,"15min":1.472},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.38,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.79800000000000004},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78100000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.81899999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.499},{"interface":"front","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.748,"15min":0.77600000000000002},"last":0.48799999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.32400000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.875,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.51400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306924,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064916,"statfs":{"total":96636764160,"available":96322473984,"internally_reserved":0,"allocated":1675264,"data_stored":881532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82899999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.252},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.315},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":1.8520000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.83399999999999996,"15min":0.85699999999999998},"last":0.54400000000000004}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.9350000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.59799999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.4079999999999999},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83299999999999996},"last":0.627},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":1.008},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.498,"15min":0.499},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":1.891},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":1.9079999999999999},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.96099999999999997},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.78900000000000003,"15min":1.3200000000000001},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:18:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2024-01-21T20:18:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2024-01-21T20:18:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234823+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.228046+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.236561+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235836+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227267+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2024-01-21T20:18:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233413+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.228792+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2024-01-21T20:18:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233242+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234482+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2024-01-21T20:18:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234495+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.228137+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235496+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235316+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233990+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233381+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235273+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2024-01-21T20:18:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230085+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.232534+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2024-01-21T20:18:23.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.236183+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227815+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230669+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2024-01-21T20:18:23.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230234+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.228375+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2024-01-21T20:18:23.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231867+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229649+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2024-01-21T20:18:23.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231594+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234162+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2024-01-21T20:18:23.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231807+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230251+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227779+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2024-01-21T20:18:23.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233880+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231480+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2024-01-21T20:18:23.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231890+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234763+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2024-01-21T20:18:23.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235768+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233761+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229786+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2024-01-21T20:18:23.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234343+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227774+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231372+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233394+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227069+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T20:18:23.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234812+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.234400+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2024-01-21T20:18:23.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231419+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.233634+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2024-01-21T20:18:23.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230327+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.232836+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231620+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2024-01-21T20:18:23.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.232138+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.232250+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2024-01-21T20:18:23.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.235161+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229254+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2024-01-21T20:18:23.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227834+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231372+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.232412+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2024-01-21T20:18:23.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.231174+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230702+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2024-01-21T20:18:23.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229812+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229399+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.229425+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2024-01-21T20:18:23.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.227774+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.228454+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T20:18:19.224210+0000', 'last_change': '2024-01-21T20:18:19.224210+0000', 'last_active': '2024-01-21T20:18:19.224210+0000', 'last_peered': '2024-01-21T20:18:19.224210+0000', 'last_clean': '2024-01-21T20:18:19.224210+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:19.224210+0000', 'last_undegraded': '2024-01-21T20:18:19.224210+0000', 'last_fullsized': '2024-01-21T20:18:19.224210+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:19.224210+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2024-01-21T20:18:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T20:18:18.218332+0000', 'last_change': '2024-01-21T20:18:18.230295+0000', 'last_active': '2024-01-21T20:18:18.218332+0000', 'last_peered': '2024-01-21T20:18:18.218332+0000', 'last_clean': '2024-01-21T20:18:18.218332+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T20:18:18.218332+0000', 'last_undegraded': '2024-01-21T20:18:18.218332+0000', 'last_fullsized': '2024-01-21T20:18:18.218332+0000', 'mapping_epoch': 136, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 136, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'last_clean_scrub_stamp': '2024-01-21T20:18:18.218332+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T20:18:23.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T20:18:23.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.471+0000 7fd20ed16700 1 Processor -- start 2024-01-21T20:18:23.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 -- start start 2024-01-21T20:18:23.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 0x7fd2080a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd208062e00 0x7fd208158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2081584f0 con 0x7fd20813aa00 2024-01-21T20:18:23.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080bd6f0 con 0x7fd208062e00 2024-01-21T20:18:23.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.472+0000 7fd20ed16700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080654e0 con 0x7fd20813a620 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd208062e00 0x7fd208158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd208062e00 0x7fd208158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45134/0 (socket says 172.21.15.133:45134) 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 -- 172.21.15.133:0/733753797 learned_addr learned my addr 172.21.15.133:0/733753797 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20cab2700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 0x7fd2080a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 -- 172.21.15.133:0/733753797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 msgr2=0x7fd2080a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 0x7fd2080a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 -- 172.21.15.133:0/733753797 >> v1:172.21.15.178:6789/0 conn(0x7fd20813aa00 legacy=0x7fd2080626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 -- 172.21.15.133:0/733753797 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208158730 con 0x7fd208062e00 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20cab2700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 0x7fd2080a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:23.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd20d2b3700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208158000 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fd200009f20 tx=0x7fd200009840).ready entity=mon.0 client_cookie=cf55ee68e7da0a84 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd2077fe700 1 -- 172.21.15.133:0/733753797 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000e070 con 0x7fd208062e00 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd2077fe700 1 -- 172.21.15.133:0/733753797 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000ba80 con 0x7fd208062e00 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.473+0000 7fd2077fe700 1 -- 172.21.15.133:0/733753797 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000be00 con 0x7fd208062e00 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 -- 172.21.15.133:0/733753797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 msgr2=0x7fd208158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208158000 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fd200009f20 tx=0x7fd200009840).stop 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 -- 172.21.15.133:0/733753797 shutdown_connections 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208158000 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 --2- 172.21.15.133:0/733753797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813a620 0x7fd2080a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 -- 172.21.15.133:0/733753797 >> 172.21.15.133:0/733753797 conn(0x7fd2080c7dc0 msgr2=0x7fd2080c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 -- 172.21.15.133:0/733753797 shutdown_connections 2024-01-21T20:18:23.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.474+0000 7fd20ed16700 1 -- 172.21.15.133:0/733753797 wait complete. 2024-01-21T20:18:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.475+0000 7fd20ed16700 1 Processor -- start 2024-01-21T20:18:23.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.475+0000 7fd20ed16700 1 -- start start 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20813a620 0x7fd2080c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813aa00 0x7fd2080c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20813bfe0 con 0x7fd208062e00 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080c44c0 con 0x7fd20813a620 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20ed16700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd208168030 con 0x7fd20813aa00 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45146/0 (socket says 172.21.15.133:45146) 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 -- 172.21.15.133:0/1418159706 learned_addr learned my addr 172.21.15.133:0/1418159706 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20d2b3700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813aa00 0x7fd2080c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd207fff700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20813a620 0x7fd2080c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 -- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813aa00 msgr2=0x7fd2080c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813aa00 0x7fd2080c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 -- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20813a620 msgr2=0x7fd2080c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20813a620 0x7fd2080c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 -- 172.21.15.133:0/1418159706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd200009ae0 con 0x7fd208062e00 2024-01-21T20:18:23.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.476+0000 7fd20cab2700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd1fc00d860 tx=0x7fd1fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.477+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00f520 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.477+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00f680 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.477+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00fa00 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.477+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081684c0 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.477+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208167700 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.478+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208168310 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.478+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd1fc0123e0 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.478+0000 7fd2057fa700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.478+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fd1fc07a0b0 con 0x7fd208062e00 2024-01-21T20:18:23.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.478+0000 7fd207fff700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.479+0000 7fd207fff700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd2080bf5b0 tx=0x7fd1f4007d40).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.482+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd1fc04b0c0 con 0x7fd208062e00 2024-01-21T20:18:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.711+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd2080c07e0 con 0x7fd208062e00 2024-01-21T20:18:23.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.711+0000 7fd2057fa700 1 -- 172.21.15.133:0/1418159706 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1110 (secure 0 0 0) 0x7fd1fc04e6e0 con 0x7fd208062e00 2024-01-21T20:18:23.700 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:23.701 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1174,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":139,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2489196544,"bytes_avail":770604916736,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":49,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8082}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-01-21T20:16:39.416321+0000","services":{}},"progress_events":{}} 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 msgr2=0x7fd1ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd2080bf5b0 tx=0x7fd1f4007d40).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 msgr2=0x7fd208139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fd1fc00d860 tx=0x7fd1fc008040).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 shutdown_connections 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd1ec05f150 0x7fd1ec061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20813aa00 0x7fd2080c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd208062e00 0x7fd208139700 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 --2- 172.21.15.133:0/1418159706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20813a620 0x7fd2080c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 >> 172.21.15.133:0/1418159706 conn(0x7fd2080c7dc0 msgr2=0x7fd2080c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:23.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 shutdown_connections 2024-01-21T20:18:23.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.713+0000 7fd20ed16700 1 -- 172.21.15.133:0/1418159706 wait complete. 2024-01-21T20:18:23.714 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T20:18:23.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:18:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.841+0000 7fd410b7a700 1 Processor -- start 2024-01-21T20:18:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.842+0000 7fd410b7a700 1 -- start start 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.842+0000 7fd410b7a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd40c1545a0 0x7fd40c0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd410b7a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c0c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd410b7a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd40c0c6590 0x7fd40c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd410b7a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0c89d0 con 0x7fd40c0c6590 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd410b7a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0c6a20 con 0x7fd40c1545a0 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd410b7a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0c7dc0 con 0x7fd40c0aa360 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd40c0c6590 0x7fd40c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd40c0c6590 0x7fd40c1582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45154/0 (socket says 172.21.15.133:45154) 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 -- 172.21.15.133:0/1085492722 learned_addr learned my addr 172.21.15.133:0/1085492722 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40a59c700 1 --2- 172.21.15.133:0/1085492722 >> v2:172.21.15.178:3300/0 conn(0x7fd40c1545a0 0x7fd40c0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd409d9b700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c0c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 -- 172.21.15.133:0/1085492722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 msgr2=0x7fd40c0c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c0c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 -- 172.21.15.133:0/1085492722 >> v2:172.21.15.178:3300/0 conn(0x7fd40c1545a0 msgr2=0x7fd40c0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/1085492722 >> v2:172.21.15.178:3300/0 conn(0x7fd40c1545a0 0x7fd40c0c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 -- 172.21.15.133:0/1085492722 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0c80a0 con 0x7fd40c0c6590 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0c6590 0x7fd40c1582a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fd40c0c58d0 tx=0x7fd404009840).ready entity=mon.0 client_cookie=e1d6b0a22475ae9e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40959a700 1 -- 172.21.15.133:0/1085492722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400e070 con 0x7fd40c0c6590 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40959a700 1 -- 172.21.15.133:0/1085492722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400b970 con 0x7fd40c0c6590 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.843+0000 7fd40959a700 1 -- 172.21.15.133:0/1085492722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400bcf0 con 0x7fd40c0c6590 2024-01-21T20:18:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 -- 172.21.15.133:0/1085492722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0c6590 msgr2=0x7fd40c1582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0c6590 0x7fd40c1582a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fd40c0c58d0 tx=0x7fd404009840).stop 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 -- 172.21.15.133:0/1085492722 shutdown_connections 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c0c6590 0x7fd40c1582a0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 --2- 172.21.15.133:0/1085492722 >> v2:172.21.15.178:3300/0 conn(0x7fd40c1545a0 0x7fd40c0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 --2- 172.21.15.133:0/1085492722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c0c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 -- 172.21.15.133:0/1085492722 >> 172.21.15.133:0/1085492722 conn(0x7fd40c0649d0 msgr2=0x7fd40c064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 -- 172.21.15.133:0/1085492722 shutdown_connections 2024-01-21T20:18:23.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.844+0000 7fd410b7a700 1 -- 172.21.15.133:0/1085492722 wait complete. 2024-01-21T20:18:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.845+0000 7fd410b7a700 1 Processor -- start 2024-01-21T20:18:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.845+0000 7fd410b7a700 1 -- start start 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd40c0c6590 0x7fd40c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c156db0 con 0x7fd40c1545a0 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1561a0 con 0x7fd40c0c6590 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd410b7a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c156480 con 0x7fd40c0aa360 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd40ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd40ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45164/0 (socket says 172.21.15.133:45164) 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd40ad9d700 1 -- 172.21.15.133:0/839924688 learned_addr learned my addr 172.21.15.133:0/839924688 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd40a59c700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.846+0000 7fd409d9b700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd40c0c6590 0x7fd40c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 -- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 msgr2=0x7fd40c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 -- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd40c0c6590 msgr2=0x7fd40c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd40c0c6590 0x7fd40c14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 -- 172.21.15.133:0/839924688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404009ae0 con 0x7fd40c1545a0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd40ad9d700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fd40400b610 tx=0x7fd404009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400bcf0 con 0x7fd40c1545a0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400b640 con 0x7fd40c1545a0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c156760 con 0x7fd40c1545a0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40401d670 con 0x7fd40c1545a0 2024-01-21T20:18:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.847+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c157240 con 0x7fd40c1545a0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.848+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c156f20 con 0x7fd40c1545a0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.848+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd404003040 con 0x7fd40c1545a0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.849+0000 7fd3faffd700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 0x7fd3ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.849+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fd40407b660 con 0x7fd40c1545a0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.849+0000 7fd40a59c700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 0x7fd3ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.849+0000 7fd40a59c700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 0x7fd3ec061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd400009c30 tx=0x7fd400009060).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:23.853+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd40404c780 con 0x7fd40c1545a0 2024-01-21T20:18:24.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.014+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd40c05fdf0 con 0x7fd3ec05f150 2024-01-21T20:18:24.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.024+0000 7fd3faffd700 1 -- 172.21.15.133:0/839924688 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362087 (secure 0 0 0) 0x7fd40c05fdf0 con 0x7fd3ec05f150 2024-01-21T20:18:24.018 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 msgr2=0x7fd3ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 0x7fd3ec061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd400009c30 tx=0x7fd400009060).stop 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 msgr2=0x7fd40c0af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7fd40400b610 tx=0x7fd404009840).stop 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 shutdown_connections 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd3ec05f150 0x7fd3ec061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd40c1545a0 0x7fd40c0af330 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd40c0aa360 0x7fd40c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 --2- 172.21.15.133:0/839924688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd40c0c6590 0x7fd40c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 >> 172.21.15.133:0/839924688 conn(0x7fd40c0649d0 msgr2=0x7fd40c0c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 shutdown_connections 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:24.027+0000 7fd410b7a700 1 -- 172.21.15.133:0/839924688 wait complete. 2024-01-21T20:18:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:18:24.029 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T20:18:23.683451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431256,"kb_used_data":13528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543464,"statfs":{"total":773094113280,"available":770604507136,"internally_reserved":0,"allocated":13852672,"data_stored":7288794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19377,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-68,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.505886"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633149+0000","last_change":"2024-01-21T20:18:19.631663+0000","last_active":"2024-01-21T20:18:19.633149+0000","last_peered":"2024-01-21T20:18:19.633149+0000","last_clean":"2024-01-21T20:18:19.633149+0000","last_became_active":"2024-01-21T20:18:19.631008+0000","last_became_peered":"2024-01-21T20:18:19.631008+0000","last_unstale":"2024-01-21T20:18:19.633149+0000","last_undegraded":"2024-01-21T20:18:19.633149+0000","last_fullsized":"2024-01-21T20:18:19.633149+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632859+0000","last_change":"2024-01-21T20:18:19.252978+0000","last_active":"2024-01-21T20:18:19.632859+0000","last_peered":"2024-01-21T20:18:19.632859+0000","last_clean":"2024-01-21T20:18:19.632859+0000","last_became_active":"2024-01-21T20:18:19.252473+0000","last_became_peered":"2024-01-21T20:18:19.252473+0000","last_unstale":"2024-01-21T20:18:19.632859+0000","last_undegraded":"2024-01-21T20:18:19.632859+0000","last_fullsized":"2024-01-21T20:18:19.632859+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635932+0000","last_change":"2024-01-21T20:18:19.629427+0000","last_active":"2024-01-21T20:18:19.635932+0000","last_peered":"2024-01-21T20:18:19.635932+0000","last_clean":"2024-01-21T20:18:19.635932+0000","last_became_active":"2024-01-21T20:18:19.629155+0000","last_became_peered":"2024-01-21T20:18:19.629155+0000","last_unstale":"2024-01-21T20:18:19.635932+0000","last_undegraded":"2024-01-21T20:18:19.635932+0000","last_fullsized":"2024-01-21T20:18:19.635932+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612067+0000","last_change":"2024-01-21T20:18:19.245767+0000","last_active":"2024-01-21T20:18:19.612067+0000","last_peered":"2024-01-21T20:18:19.612067+0000","last_clean":"2024-01-21T20:18:19.612067+0000","last_became_active":"2024-01-21T20:18:19.244925+0000","last_became_peered":"2024-01-21T20:18:19.244925+0000","last_unstale":"2024-01-21T20:18:19.612067+0000","last_undegraded":"2024-01-21T20:18:19.612067+0000","last_fullsized":"2024-01-21T20:18:19.612067+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635737+0000","last_change":"2024-01-21T20:18:19.630142+0000","last_active":"2024-01-21T20:18:19.635737+0000","last_peered":"2024-01-21T20:18:19.635737+0000","last_clean":"2024-01-21T20:18:19.635737+0000","last_became_active":"2024-01-21T20:18:19.629434+0000","last_became_peered":"2024-01-21T20:18:19.629434+0000","last_unstale":"2024-01-21T20:18:19.635737+0000","last_undegraded":"2024-01-21T20:18:19.635737+0000","last_fullsized":"2024-01-21T20:18:19.635737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616154+0000","last_change":"2024-01-21T20:18:19.249826+0000","last_active":"2024-01-21T20:18:19.616154+0000","last_peered":"2024-01-21T20:18:19.616154+0000","last_clean":"2024-01-21T20:18:19.616154+0000","last_became_active":"2024-01-21T20:18:19.249219+0000","last_became_peered":"2024-01-21T20:18:19.249219+0000","last_unstale":"2024-01-21T20:18:19.616154+0000","last_undegraded":"2024-01-21T20:18:19.616154+0000","last_fullsized":"2024-01-21T20:18:19.616154+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636748+0000","last_change":"2024-01-21T20:18:19.636174+0000","last_active":"2024-01-21T20:18:19.636748+0000","last_peered":"2024-01-21T20:18:19.636748+0000","last_clean":"2024-01-21T20:18:19.636748+0000","last_became_active":"2024-01-21T20:18:19.635868+0000","last_became_peered":"2024-01-21T20:18:19.635868+0000","last_unstale":"2024-01-21T20:18:19.636748+0000","last_undegraded":"2024-01-21T20:18:19.636748+0000","last_fullsized":"2024-01-21T20:18:19.636748+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634337+0000","last_change":"2024-01-21T20:18:19.253371+0000","last_active":"2024-01-21T20:18:19.634337+0000","last_peered":"2024-01-21T20:18:19.634337+0000","last_clean":"2024-01-21T20:18:19.634337+0000","last_became_active":"2024-01-21T20:18:19.253110+0000","last_became_peered":"2024-01-21T20:18:19.253110+0000","last_unstale":"2024-01-21T20:18:19.634337+0000","last_undegraded":"2024-01-21T20:18:19.634337+0000","last_fullsized":"2024-01-21T20:18:19.634337+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636068+0000","last_change":"2024-01-21T20:18:19.631750+0000","last_active":"2024-01-21T20:18:19.636068+0000","last_peered":"2024-01-21T20:18:19.636068+0000","last_clean":"2024-01-21T20:18:19.636068+0000","last_became_active":"2024-01-21T20:18:19.631483+0000","last_became_peered":"2024-01-21T20:18:19.631483+0000","last_unstale":"2024-01-21T20:18:19.636068+0000","last_undegraded":"2024-01-21T20:18:19.636068+0000","last_fullsized":"2024-01-21T20:18:19.636068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636850+0000","last_change":"2024-01-21T20:18:19.249653+0000","last_active":"2024-01-21T20:18:19.636850+0000","last_peered":"2024-01-21T20:18:19.636850+0000","last_clean":"2024-01-21T20:18:19.636850+0000","last_became_active":"2024-01-21T20:18:19.249362+0000","last_became_peered":"2024-01-21T20:18:19.249362+0000","last_unstale":"2024-01-21T20:18:19.636850+0000","last_undegraded":"2024-01-21T20:18:19.636850+0000","last_fullsized":"2024-01-21T20:18:19.636850+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633220+0000","last_change":"2024-01-21T20:18:19.628838+0000","last_active":"2024-01-21T20:18:19.633220+0000","last_peered":"2024-01-21T20:18:19.633220+0000","last_clean":"2024-01-21T20:18:19.633220+0000","last_became_active":"2024-01-21T20:18:19.628525+0000","last_became_peered":"2024-01-21T20:18:19.628525+0000","last_unstale":"2024-01-21T20:18:19.633220+0000","last_undegraded":"2024-01-21T20:18:19.633220+0000","last_fullsized":"2024-01-21T20:18:19.633220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634851+0000","last_change":"2024-01-21T20:18:19.248676+0000","last_active":"2024-01-21T20:18:19.634851+0000","last_peered":"2024-01-21T20:18:19.634851+0000","last_clean":"2024-01-21T20:18:19.634851+0000","last_became_active":"2024-01-21T20:18:19.248376+0000","last_became_peered":"2024-01-21T20:18:19.248376+0000","last_unstale":"2024-01-21T20:18:19.634851+0000","last_undegraded":"2024-01-21T20:18:19.634851+0000","last_fullsized":"2024-01-21T20:18:19.634851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633252+0000","last_change":"2024-01-21T20:18:19.631521+0000","last_active":"2024-01-21T20:18:19.633252+0000","last_peered":"2024-01-21T20:18:19.633252+0000","last_clean":"2024-01-21T20:18:19.633252+0000","last_became_active":"2024-01-21T20:18:19.631211+0000","last_became_peered":"2024-01-21T20:18:19.631211+0000","last_unstale":"2024-01-21T20:18:19.633252+0000","last_undegraded":"2024-01-21T20:18:19.633252+0000","last_fullsized":"2024-01-21T20:18:19.633252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612533+0000","last_change":"2024-01-21T20:18:19.248132+0000","last_active":"2024-01-21T20:18:19.612533+0000","last_peered":"2024-01-21T20:18:19.612533+0000","last_clean":"2024-01-21T20:18:19.612533+0000","last_became_active":"2024-01-21T20:18:19.247829+0000","last_became_peered":"2024-01-21T20:18:19.247829+0000","last_unstale":"2024-01-21T20:18:19.612533+0000","last_undegraded":"2024-01-21T20:18:19.612533+0000","last_fullsized":"2024-01-21T20:18:19.612533+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631181+0000","last_change":"2024-01-21T20:18:19.620410+0000","last_active":"2024-01-21T20:18:19.631181+0000","last_peered":"2024-01-21T20:18:19.631181+0000","last_clean":"2024-01-21T20:18:19.631181+0000","last_became_active":"2024-01-21T20:18:19.620138+0000","last_became_peered":"2024-01-21T20:18:19.620138+0000","last_unstale":"2024-01-21T20:18:19.631181+0000","last_undegraded":"2024-01-21T20:18:19.631181+0000","last_fullsized":"2024-01-21T20:18:19.631181+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617602+0000","last_change":"2024-01-21T20:18:19.248541+0000","last_active":"2024-01-21T20:18:19.617602+0000","last_peered":"2024-01-21T20:18:19.617602+0000","last_clean":"2024-01-21T20:18:19.617602+0000","last_became_active":"2024-01-21T20:18:19.247715+0000","last_became_peered":"2024-01-21T20:18:19.247715+0000","last_unstale":"2024-01-21T20:18:19.617602+0000","last_undegraded":"2024-01-21T20:18:19.617602+0000","last_fullsized":"2024-01-21T20:18:19.617602+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636603+0000","last_change":"2024-01-21T20:18:19.634198+0000","last_active":"2024-01-21T20:18:19.636603+0000","last_peered":"2024-01-21T20:18:19.636603+0000","last_clean":"2024-01-21T20:18:19.636603+0000","last_became_active":"2024-01-21T20:18:19.632780+0000","last_became_peered":"2024-01-21T20:18:19.632780+0000","last_unstale":"2024-01-21T20:18:19.636603+0000","last_undegraded":"2024-01-21T20:18:19.636603+0000","last_fullsized":"2024-01-21T20:18:19.636603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615960+0000","last_change":"2024-01-21T20:18:19.257168+0000","last_active":"2024-01-21T20:18:19.615960+0000","last_peered":"2024-01-21T20:18:19.615960+0000","last_clean":"2024-01-21T20:18:19.615960+0000","last_became_active":"2024-01-21T20:18:19.256823+0000","last_became_peered":"2024-01-21T20:18:19.256823+0000","last_unstale":"2024-01-21T20:18:19.615960+0000","last_undegraded":"2024-01-21T20:18:19.615960+0000","last_fullsized":"2024-01-21T20:18:19.615960+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631307+0000","last_change":"2024-01-21T20:18:19.618672+0000","last_active":"2024-01-21T20:18:19.631307+0000","last_peered":"2024-01-21T20:18:19.631307+0000","last_clean":"2024-01-21T20:18:19.631307+0000","last_became_active":"2024-01-21T20:18:19.618378+0000","last_became_peered":"2024-01-21T20:18:19.618378+0000","last_unstale":"2024-01-21T20:18:19.631307+0000","last_undegraded":"2024-01-21T20:18:19.631307+0000","last_fullsized":"2024-01-21T20:18:19.631307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616593+0000","last_change":"2024-01-21T20:18:19.253162+0000","last_active":"2024-01-21T20:18:19.616593+0000","last_peered":"2024-01-21T20:18:19.616593+0000","last_clean":"2024-01-21T20:18:19.616593+0000","last_became_active":"2024-01-21T20:18:19.252972+0000","last_became_peered":"2024-01-21T20:18:19.252972+0000","last_unstale":"2024-01-21T20:18:19.616593+0000","last_undegraded":"2024-01-21T20:18:19.616593+0000","last_fullsized":"2024-01-21T20:18:19.616593+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639996+0000","last_change":"2024-01-21T20:18:19.638791+0000","last_active":"2024-01-21T20:18:19.639996+0000","last_peered":"2024-01-21T20:18:19.639996+0000","last_clean":"2024-01-21T20:18:19.639996+0000","last_became_active":"2024-01-21T20:18:19.638553+0000","last_became_peered":"2024-01-21T20:18:19.638553+0000","last_unstale":"2024-01-21T20:18:19.639996+0000","last_undegraded":"2024-01-21T20:18:19.639996+0000","last_fullsized":"2024-01-21T20:18:19.639996+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612153+0000","last_change":"2024-01-21T20:18:19.247911+0000","last_active":"2024-01-21T20:18:19.612153+0000","last_peered":"2024-01-21T20:18:19.612153+0000","last_clean":"2024-01-21T20:18:19.612153+0000","last_became_active":"2024-01-21T20:18:19.247601+0000","last_became_peered":"2024-01-21T20:18:19.247601+0000","last_unstale":"2024-01-21T20:18:19.612153+0000","last_undegraded":"2024-01-21T20:18:19.612153+0000","last_fullsized":"2024-01-21T20:18:19.612153+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632416+0000","last_change":"2024-01-21T20:18:19.630030+0000","last_active":"2024-01-21T20:18:19.632416+0000","last_peered":"2024-01-21T20:18:19.632416+0000","last_clean":"2024-01-21T20:18:19.632416+0000","last_became_active":"2024-01-21T20:18:19.629613+0000","last_became_peered":"2024-01-21T20:18:19.629613+0000","last_unstale":"2024-01-21T20:18:19.632416+0000","last_undegraded":"2024-01-21T20:18:19.632416+0000","last_fullsized":"2024-01-21T20:18:19.632416+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638448+0000","last_change":"2024-01-21T20:18:19.253196+0000","last_active":"2024-01-21T20:18:19.638448+0000","last_peered":"2024-01-21T20:18:19.638448+0000","last_clean":"2024-01-21T20:18:19.638448+0000","last_became_active":"2024-01-21T20:18:19.252739+0000","last_became_peered":"2024-01-21T20:18:19.252739+0000","last_unstale":"2024-01-21T20:18:19.638448+0000","last_undegraded":"2024-01-21T20:18:19.638448+0000","last_fullsized":"2024-01-21T20:18:19.638448+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633399+0000","last_change":"2024-01-21T20:18:19.624276+0000","last_active":"2024-01-21T20:18:19.633399+0000","last_peered":"2024-01-21T20:18:19.633399+0000","last_clean":"2024-01-21T20:18:19.633399+0000","last_became_active":"2024-01-21T20:18:19.624031+0000","last_became_peered":"2024-01-21T20:18:19.624031+0000","last_unstale":"2024-01-21T20:18:19.633399+0000","last_undegraded":"2024-01-21T20:18:19.633399+0000","last_fullsized":"2024-01-21T20:18:19.633399+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630251+0000","last_change":"2024-01-21T20:18:19.250054+0000","last_active":"2024-01-21T20:18:19.630251+0000","last_peered":"2024-01-21T20:18:19.630251+0000","last_clean":"2024-01-21T20:18:19.630251+0000","last_became_active":"2024-01-21T20:18:19.249787+0000","last_became_peered":"2024-01-21T20:18:19.249787+0000","last_unstale":"2024-01-21T20:18:19.630251+0000","last_undegraded":"2024-01-21T20:18:19.630251+0000","last_fullsized":"2024-01-21T20:18:19.630251+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631088+0000","last_change":"2024-01-21T20:18:19.618695+0000","last_active":"2024-01-21T20:18:19.631088+0000","last_peered":"2024-01-21T20:18:19.631088+0000","last_clean":"2024-01-21T20:18:19.631088+0000","last_became_active":"2024-01-21T20:18:19.618400+0000","last_became_peered":"2024-01-21T20:18:19.618400+0000","last_unstale":"2024-01-21T20:18:19.631088+0000","last_undegraded":"2024-01-21T20:18:19.631088+0000","last_fullsized":"2024-01-21T20:18:19.631088+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615007+0000","last_change":"2024-01-21T20:18:19.247792+0000","last_active":"2024-01-21T20:18:19.615007+0000","last_peered":"2024-01-21T20:18:19.615007+0000","last_clean":"2024-01-21T20:18:19.615007+0000","last_became_active":"2024-01-21T20:18:19.247531+0000","last_became_peered":"2024-01-21T20:18:19.247531+0000","last_unstale":"2024-01-21T20:18:19.615007+0000","last_undegraded":"2024-01-21T20:18:19.615007+0000","last_fullsized":"2024-01-21T20:18:19.615007+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637115+0000","last_change":"2024-01-21T20:18:19.629469+0000","last_active":"2024-01-21T20:18:19.637115+0000","last_peered":"2024-01-21T20:18:19.637115+0000","last_clean":"2024-01-21T20:18:19.637115+0000","last_became_active":"2024-01-21T20:18:19.629268+0000","last_became_peered":"2024-01-21T20:18:19.629268+0000","last_unstale":"2024-01-21T20:18:19.637115+0000","last_undegraded":"2024-01-21T20:18:19.637115+0000","last_fullsized":"2024-01-21T20:18:19.637115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620229+0000","last_change":"2024-01-21T20:18:19.241690+0000","last_active":"2024-01-21T20:18:19.620229+0000","last_peered":"2024-01-21T20:18:19.620229+0000","last_clean":"2024-01-21T20:18:19.620229+0000","last_became_active":"2024-01-21T20:18:19.241419+0000","last_became_peered":"2024-01-21T20:18:19.241419+0000","last_unstale":"2024-01-21T20:18:19.620229+0000","last_undegraded":"2024-01-21T20:18:19.620229+0000","last_fullsized":"2024-01-21T20:18:19.620229+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640065+0000","last_change":"2024-01-21T20:18:19.636627+0000","last_active":"2024-01-21T20:18:19.640065+0000","last_peered":"2024-01-21T20:18:19.640065+0000","last_clean":"2024-01-21T20:18:19.640065+0000","last_became_active":"2024-01-21T20:18:19.636183+0000","last_became_peered":"2024-01-21T20:18:19.636183+0000","last_unstale":"2024-01-21T20:18:19.640065+0000","last_undegraded":"2024-01-21T20:18:19.640065+0000","last_fullsized":"2024-01-21T20:18:19.640065+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633346+0000","last_change":"2024-01-21T20:18:19.253302+0000","last_active":"2024-01-21T20:18:19.633346+0000","last_peered":"2024-01-21T20:18:19.633346+0000","last_clean":"2024-01-21T20:18:19.633346+0000","last_became_active":"2024-01-21T20:18:19.253025+0000","last_became_peered":"2024-01-21T20:18:19.253025+0000","last_unstale":"2024-01-21T20:18:19.633346+0000","last_undegraded":"2024-01-21T20:18:19.633346+0000","last_fullsized":"2024-01-21T20:18:19.633346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633252+0000","last_change":"2024-01-21T20:18:19.625575+0000","last_active":"2024-01-21T20:18:19.633252+0000","last_peered":"2024-01-21T20:18:19.633252+0000","last_clean":"2024-01-21T20:18:19.633252+0000","last_became_active":"2024-01-21T20:18:19.625288+0000","last_became_peered":"2024-01-21T20:18:19.625288+0000","last_unstale":"2024-01-21T20:18:19.633252+0000","last_undegraded":"2024-01-21T20:18:19.633252+0000","last_fullsized":"2024-01-21T20:18:19.633252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.613371+0000","last_change":"2024-01-21T20:18:19.251406+0000","last_active":"2024-01-21T20:18:19.613371+0000","last_peered":"2024-01-21T20:18:19.613371+0000","last_clean":"2024-01-21T20:18:19.613371+0000","last_became_active":"2024-01-21T20:18:19.251056+0000","last_became_peered":"2024-01-21T20:18:19.251056+0000","last_unstale":"2024-01-21T20:18:19.613371+0000","last_undegraded":"2024-01-21T20:18:19.613371+0000","last_fullsized":"2024-01-21T20:18:19.613371+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634880+0000","last_change":"2024-01-21T20:18:19.631987+0000","last_active":"2024-01-21T20:18:19.634880+0000","last_peered":"2024-01-21T20:18:19.634880+0000","last_clean":"2024-01-21T20:18:19.634880+0000","last_became_active":"2024-01-21T20:18:19.631698+0000","last_became_peered":"2024-01-21T20:18:19.631698+0000","last_unstale":"2024-01-21T20:18:19.634880+0000","last_undegraded":"2024-01-21T20:18:19.634880+0000","last_fullsized":"2024-01-21T20:18:19.634880+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615158+0000","last_change":"2024-01-21T20:18:19.250470+0000","last_active":"2024-01-21T20:18:19.615158+0000","last_peered":"2024-01-21T20:18:19.615158+0000","last_clean":"2024-01-21T20:18:19.615158+0000","last_became_active":"2024-01-21T20:18:19.250201+0000","last_became_peered":"2024-01-21T20:18:19.250201+0000","last_unstale":"2024-01-21T20:18:19.615158+0000","last_undegraded":"2024-01-21T20:18:19.615158+0000","last_fullsized":"2024-01-21T20:18:19.615158+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635717+0000","last_change":"2024-01-21T20:18:19.629993+0000","last_active":"2024-01-21T20:18:19.635717+0000","last_peered":"2024-01-21T20:18:19.635717+0000","last_clean":"2024-01-21T20:18:19.635717+0000","last_became_active":"2024-01-21T20:18:19.629102+0000","last_became_peered":"2024-01-21T20:18:19.629102+0000","last_unstale":"2024-01-21T20:18:19.635717+0000","last_undegraded":"2024-01-21T20:18:19.635717+0000","last_fullsized":"2024-01-21T20:18:19.635717+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628473+0000","last_change":"2024-01-21T20:18:19.249996+0000","last_active":"2024-01-21T20:18:19.628473+0000","last_peered":"2024-01-21T20:18:19.628473+0000","last_clean":"2024-01-21T20:18:19.628473+0000","last_became_active":"2024-01-21T20:18:19.249562+0000","last_became_peered":"2024-01-21T20:18:19.249562+0000","last_unstale":"2024-01-21T20:18:19.628473+0000","last_undegraded":"2024-01-21T20:18:19.628473+0000","last_fullsized":"2024-01-21T20:18:19.628473+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639440+0000","last_change":"2024-01-21T20:18:19.635623+0000","last_active":"2024-01-21T20:18:19.639440+0000","last_peered":"2024-01-21T20:18:19.639440+0000","last_clean":"2024-01-21T20:18:19.639440+0000","last_became_active":"2024-01-21T20:18:19.635231+0000","last_became_peered":"2024-01-21T20:18:19.635231+0000","last_unstale":"2024-01-21T20:18:19.639440+0000","last_undegraded":"2024-01-21T20:18:19.639440+0000","last_fullsized":"2024-01-21T20:18:19.639440+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611637+0000","last_change":"2024-01-21T20:18:19.252573+0000","last_active":"2024-01-21T20:18:19.611637+0000","last_peered":"2024-01-21T20:18:19.611637+0000","last_clean":"2024-01-21T20:18:19.611637+0000","last_became_active":"2024-01-21T20:18:19.252236+0000","last_became_peered":"2024-01-21T20:18:19.252236+0000","last_unstale":"2024-01-21T20:18:19.611637+0000","last_undegraded":"2024-01-21T20:18:19.611637+0000","last_fullsized":"2024-01-21T20:18:19.611637+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630272+0000","last_change":"2024-01-21T20:18:19.625432+0000","last_active":"2024-01-21T20:18:19.630272+0000","last_peered":"2024-01-21T20:18:19.630272+0000","last_clean":"2024-01-21T20:18:19.630272+0000","last_became_active":"2024-01-21T20:18:19.625175+0000","last_became_peered":"2024-01-21T20:18:19.625175+0000","last_unstale":"2024-01-21T20:18:19.630272+0000","last_undegraded":"2024-01-21T20:18:19.630272+0000","last_fullsized":"2024-01-21T20:18:19.630272+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633958+0000","last_change":"2024-01-21T20:18:19.252602+0000","last_active":"2024-01-21T20:18:19.633958+0000","last_peered":"2024-01-21T20:18:19.633958+0000","last_clean":"2024-01-21T20:18:19.633958+0000","last_became_active":"2024-01-21T20:18:19.251923+0000","last_became_peered":"2024-01-21T20:18:19.251923+0000","last_unstale":"2024-01-21T20:18:19.633958+0000","last_undegraded":"2024-01-21T20:18:19.633958+0000","last_fullsized":"2024-01-21T20:18:19.633958+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632401+0000","last_change":"2024-01-21T20:18:19.629843+0000","last_active":"2024-01-21T20:18:19.632401+0000","last_peered":"2024-01-21T20:18:19.632401+0000","last_clean":"2024-01-21T20:18:19.632401+0000","last_became_active":"2024-01-21T20:18:19.629587+0000","last_became_peered":"2024-01-21T20:18:19.629587+0000","last_unstale":"2024-01-21T20:18:19.632401+0000","last_undegraded":"2024-01-21T20:18:19.632401+0000","last_fullsized":"2024-01-21T20:18:19.632401+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620692+0000","last_change":"2024-01-21T20:18:19.250339+0000","last_active":"2024-01-21T20:18:19.620692+0000","last_peered":"2024-01-21T20:18:19.620692+0000","last_clean":"2024-01-21T20:18:19.620692+0000","last_became_active":"2024-01-21T20:18:19.248715+0000","last_became_peered":"2024-01-21T20:18:19.248715+0000","last_unstale":"2024-01-21T20:18:19.620692+0000","last_undegraded":"2024-01-21T20:18:19.620692+0000","last_fullsized":"2024-01-21T20:18:19.620692+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632281+0000","last_change":"2024-01-21T20:18:19.627848+0000","last_active":"2024-01-21T20:18:19.632281+0000","last_peered":"2024-01-21T20:18:19.632281+0000","last_clean":"2024-01-21T20:18:19.632281+0000","last_became_active":"2024-01-21T20:18:19.627537+0000","last_became_peered":"2024-01-21T20:18:19.627537+0000","last_unstale":"2024-01-21T20:18:19.632281+0000","last_undegraded":"2024-01-21T20:18:19.632281+0000","last_fullsized":"2024-01-21T20:18:19.632281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611320+0000","last_change":"2024-01-21T20:18:19.252159+0000","last_active":"2024-01-21T20:18:19.611320+0000","last_peered":"2024-01-21T20:18:19.611320+0000","last_clean":"2024-01-21T20:18:19.611320+0000","last_became_active":"2024-01-21T20:18:19.251826+0000","last_became_peered":"2024-01-21T20:18:19.251826+0000","last_unstale":"2024-01-21T20:18:19.611320+0000","last_undegraded":"2024-01-21T20:18:19.611320+0000","last_fullsized":"2024-01-21T20:18:19.611320+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630317+0000","last_change":"2024-01-21T20:18:19.625557+0000","last_active":"2024-01-21T20:18:19.630317+0000","last_peered":"2024-01-21T20:18:19.630317+0000","last_clean":"2024-01-21T20:18:19.630317+0000","last_became_active":"2024-01-21T20:18:19.624980+0000","last_became_peered":"2024-01-21T20:18:19.624980+0000","last_unstale":"2024-01-21T20:18:19.630317+0000","last_undegraded":"2024-01-21T20:18:19.630317+0000","last_fullsized":"2024-01-21T20:18:19.630317+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617353+0000","last_change":"2024-01-21T20:18:19.249995+0000","last_active":"2024-01-21T20:18:19.617353+0000","last_peered":"2024-01-21T20:18:19.617353+0000","last_clean":"2024-01-21T20:18:19.617353+0000","last_became_active":"2024-01-21T20:18:19.249711+0000","last_became_peered":"2024-01-21T20:18:19.249711+0000","last_unstale":"2024-01-21T20:18:19.617353+0000","last_undegraded":"2024-01-21T20:18:19.617353+0000","last_fullsized":"2024-01-21T20:18:19.617353+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636583+0000","last_change":"2024-01-21T20:18:19.633636+0000","last_active":"2024-01-21T20:18:19.636583+0000","last_peered":"2024-01-21T20:18:19.636583+0000","last_clean":"2024-01-21T20:18:19.636583+0000","last_became_active":"2024-01-21T20:18:19.632486+0000","last_became_peered":"2024-01-21T20:18:19.632486+0000","last_unstale":"2024-01-21T20:18:19.636583+0000","last_undegraded":"2024-01-21T20:18:19.636583+0000","last_fullsized":"2024-01-21T20:18:19.636583+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.613474+0000","last_change":"2024-01-21T20:18:19.248322+0000","last_active":"2024-01-21T20:18:19.613474+0000","last_peered":"2024-01-21T20:18:19.613474+0000","last_clean":"2024-01-21T20:18:19.613474+0000","last_became_active":"2024-01-21T20:18:19.247519+0000","last_became_peered":"2024-01-21T20:18:19.247519+0000","last_unstale":"2024-01-21T20:18:19.613474+0000","last_undegraded":"2024-01-21T20:18:19.613474+0000","last_fullsized":"2024-01-21T20:18:19.613474+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634867+0000","last_change":"2024-01-21T20:18:19.631894+0000","last_active":"2024-01-21T20:18:19.634867+0000","last_peered":"2024-01-21T20:18:19.634867+0000","last_clean":"2024-01-21T20:18:19.634867+0000","last_became_active":"2024-01-21T20:18:19.631552+0000","last_became_peered":"2024-01-21T20:18:19.631552+0000","last_unstale":"2024-01-21T20:18:19.634867+0000","last_undegraded":"2024-01-21T20:18:19.634867+0000","last_fullsized":"2024-01-21T20:18:19.634867+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616690+0000","last_change":"2024-01-21T20:18:19.252913+0000","last_active":"2024-01-21T20:18:19.616690+0000","last_peered":"2024-01-21T20:18:19.616690+0000","last_clean":"2024-01-21T20:18:19.616690+0000","last_became_active":"2024-01-21T20:18:19.252409+0000","last_became_peered":"2024-01-21T20:18:19.252409+0000","last_unstale":"2024-01-21T20:18:19.616690+0000","last_undegraded":"2024-01-21T20:18:19.616690+0000","last_fullsized":"2024-01-21T20:18:19.616690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640017+0000","last_change":"2024-01-21T20:18:19.638989+0000","last_active":"2024-01-21T20:18:19.640017+0000","last_peered":"2024-01-21T20:18:19.640017+0000","last_clean":"2024-01-21T20:18:19.640017+0000","last_became_active":"2024-01-21T20:18:19.638696+0000","last_became_peered":"2024-01-21T20:18:19.638696+0000","last_unstale":"2024-01-21T20:18:19.640017+0000","last_undegraded":"2024-01-21T20:18:19.640017+0000","last_fullsized":"2024-01-21T20:18:19.640017+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626240+0000","last_change":"2024-01-21T20:18:19.246150+0000","last_active":"2024-01-21T20:18:19.626240+0000","last_peered":"2024-01-21T20:18:19.626240+0000","last_clean":"2024-01-21T20:18:19.626240+0000","last_became_active":"2024-01-21T20:18:19.245882+0000","last_became_peered":"2024-01-21T20:18:19.245882+0000","last_unstale":"2024-01-21T20:18:19.626240+0000","last_undegraded":"2024-01-21T20:18:19.626240+0000","last_fullsized":"2024-01-21T20:18:19.626240+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630351+0000","last_change":"2024-01-21T20:18:19.625254+0000","last_active":"2024-01-21T20:18:19.630351+0000","last_peered":"2024-01-21T20:18:19.630351+0000","last_clean":"2024-01-21T20:18:19.630351+0000","last_became_active":"2024-01-21T20:18:19.624958+0000","last_became_peered":"2024-01-21T20:18:19.624958+0000","last_unstale":"2024-01-21T20:18:19.630351+0000","last_undegraded":"2024-01-21T20:18:19.630351+0000","last_fullsized":"2024-01-21T20:18:19.630351+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.614317+0000","last_change":"2024-01-21T20:18:19.250299+0000","last_active":"2024-01-21T20:18:19.614317+0000","last_peered":"2024-01-21T20:18:19.614317+0000","last_clean":"2024-01-21T20:18:19.614317+0000","last_became_active":"2024-01-21T20:18:19.248897+0000","last_became_peered":"2024-01-21T20:18:19.248897+0000","last_unstale":"2024-01-21T20:18:19.614317+0000","last_undegraded":"2024-01-21T20:18:19.614317+0000","last_fullsized":"2024-01-21T20:18:19.614317+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630293+0000","last_change":"2024-01-21T20:18:19.625613+0000","last_active":"2024-01-21T20:18:19.630293+0000","last_peered":"2024-01-21T20:18:19.630293+0000","last_clean":"2024-01-21T20:18:19.630293+0000","last_became_active":"2024-01-21T20:18:19.625140+0000","last_became_peered":"2024-01-21T20:18:19.625140+0000","last_unstale":"2024-01-21T20:18:19.630293+0000","last_undegraded":"2024-01-21T20:18:19.630293+0000","last_fullsized":"2024-01-21T20:18:19.630293+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611673+0000","last_change":"2024-01-21T20:18:19.252656+0000","last_active":"2024-01-21T20:18:19.611673+0000","last_peered":"2024-01-21T20:18:19.611673+0000","last_clean":"2024-01-21T20:18:19.611673+0000","last_became_active":"2024-01-21T20:18:19.252316+0000","last_became_peered":"2024-01-21T20:18:19.252316+0000","last_unstale":"2024-01-21T20:18:19.611673+0000","last_undegraded":"2024-01-21T20:18:19.611673+0000","last_fullsized":"2024-01-21T20:18:19.611673+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629890+0000","last_change":"2024-01-21T20:18:19.624286+0000","last_active":"2024-01-21T20:18:19.629890+0000","last_peered":"2024-01-21T20:18:19.629890+0000","last_clean":"2024-01-21T20:18:19.629890+0000","last_became_active":"2024-01-21T20:18:19.622414+0000","last_became_peered":"2024-01-21T20:18:19.622414+0000","last_unstale":"2024-01-21T20:18:19.629890+0000","last_undegraded":"2024-01-21T20:18:19.629890+0000","last_fullsized":"2024-01-21T20:18:19.629890+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612096+0000","last_change":"2024-01-21T20:18:19.241212+0000","last_active":"2024-01-21T20:18:19.612096+0000","last_peered":"2024-01-21T20:18:19.612096+0000","last_clean":"2024-01-21T20:18:19.612096+0000","last_became_active":"2024-01-21T20:18:19.240868+0000","last_became_peered":"2024-01-21T20:18:19.240868+0000","last_unstale":"2024-01-21T20:18:19.612096+0000","last_undegraded":"2024-01-21T20:18:19.612096+0000","last_fullsized":"2024-01-21T20:18:19.612096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.627082+0000","last_change":"2024-01-21T20:18:19.623400+0000","last_active":"2024-01-21T20:18:19.627082+0000","last_peered":"2024-01-21T20:18:19.627082+0000","last_clean":"2024-01-21T20:18:19.627082+0000","last_became_active":"2024-01-21T20:18:19.623135+0000","last_became_peered":"2024-01-21T20:18:19.623135+0000","last_unstale":"2024-01-21T20:18:19.627082+0000","last_undegraded":"2024-01-21T20:18:19.627082+0000","last_fullsized":"2024-01-21T20:18:19.627082+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616400+0000","last_change":"2024-01-21T20:18:19.245992+0000","last_active":"2024-01-21T20:18:19.616400+0000","last_peered":"2024-01-21T20:18:19.616400+0000","last_clean":"2024-01-21T20:18:19.616400+0000","last_became_active":"2024-01-21T20:18:19.245677+0000","last_became_peered":"2024-01-21T20:18:19.245677+0000","last_unstale":"2024-01-21T20:18:19.616400+0000","last_undegraded":"2024-01-21T20:18:19.616400+0000","last_fullsized":"2024-01-21T20:18:19.616400+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636962+0000","last_change":"2024-01-21T20:18:19.630059+0000","last_active":"2024-01-21T20:18:19.636962+0000","last_peered":"2024-01-21T20:18:19.636962+0000","last_clean":"2024-01-21T20:18:19.636962+0000","last_became_active":"2024-01-21T20:18:19.629774+0000","last_became_peered":"2024-01-21T20:18:19.629774+0000","last_unstale":"2024-01-21T20:18:19.636962+0000","last_undegraded":"2024-01-21T20:18:19.636962+0000","last_fullsized":"2024-01-21T20:18:19.636962+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619426+0000","last_change":"2024-01-21T20:18:19.248915+0000","last_active":"2024-01-21T20:18:19.619426+0000","last_peered":"2024-01-21T20:18:19.619426+0000","last_clean":"2024-01-21T20:18:19.619426+0000","last_became_active":"2024-01-21T20:18:19.248639+0000","last_became_peered":"2024-01-21T20:18:19.248639+0000","last_unstale":"2024-01-21T20:18:19.619426+0000","last_undegraded":"2024-01-21T20:18:19.619426+0000","last_fullsized":"2024-01-21T20:18:19.619426+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639452+0000","last_change":"2024-01-21T20:18:19.638127+0000","last_active":"2024-01-21T20:18:19.639452+0000","last_peered":"2024-01-21T20:18:19.639452+0000","last_clean":"2024-01-21T20:18:19.639452+0000","last_became_active":"2024-01-21T20:18:19.636481+0000","last_became_peered":"2024-01-21T20:18:19.636481+0000","last_unstale":"2024-01-21T20:18:19.639452+0000","last_undegraded":"2024-01-21T20:18:19.639452+0000","last_fullsized":"2024-01-21T20:18:19.639452+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631481+0000","last_change":"2024-01-21T20:18:19.248850+0000","last_active":"2024-01-21T20:18:19.631481+0000","last_peered":"2024-01-21T20:18:19.631481+0000","last_clean":"2024-01-21T20:18:19.631481+0000","last_became_active":"2024-01-21T20:18:19.248511+0000","last_became_peered":"2024-01-21T20:18:19.248511+0000","last_unstale":"2024-01-21T20:18:19.631481+0000","last_undegraded":"2024-01-21T20:18:19.631481+0000","last_fullsized":"2024-01-21T20:18:19.631481+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633187+0000","last_change":"2024-01-21T20:18:19.631628+0000","last_active":"2024-01-21T20:18:19.633187+0000","last_peered":"2024-01-21T20:18:19.633187+0000","last_clean":"2024-01-21T20:18:19.633187+0000","last_became_active":"2024-01-21T20:18:19.631336+0000","last_became_peered":"2024-01-21T20:18:19.631336+0000","last_unstale":"2024-01-21T20:18:19.633187+0000","last_undegraded":"2024-01-21T20:18:19.633187+0000","last_fullsized":"2024-01-21T20:18:19.633187+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638383+0000","last_change":"2024-01-21T20:18:19.241693+0000","last_active":"2024-01-21T20:18:19.638383+0000","last_peered":"2024-01-21T20:18:19.638383+0000","last_clean":"2024-01-21T20:18:19.638383+0000","last_became_active":"2024-01-21T20:18:19.241428+0000","last_became_peered":"2024-01-21T20:18:19.241428+0000","last_unstale":"2024-01-21T20:18:19.638383+0000","last_undegraded":"2024-01-21T20:18:19.638383+0000","last_fullsized":"2024-01-21T20:18:19.638383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630471+0000","last_change":"2024-01-21T20:18:19.626443+0000","last_active":"2024-01-21T20:18:19.630471+0000","last_peered":"2024-01-21T20:18:19.630471+0000","last_clean":"2024-01-21T20:18:19.630471+0000","last_became_active":"2024-01-21T20:18:19.626055+0000","last_became_peered":"2024-01-21T20:18:19.626055+0000","last_unstale":"2024-01-21T20:18:19.630471+0000","last_undegraded":"2024-01-21T20:18:19.630471+0000","last_fullsized":"2024-01-21T20:18:19.630471+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628272+0000","last_change":"2024-01-21T20:18:19.248631+0000","last_active":"2024-01-21T20:18:19.628272+0000","last_peered":"2024-01-21T20:18:19.628272+0000","last_clean":"2024-01-21T20:18:19.628272+0000","last_became_active":"2024-01-21T20:18:19.248311+0000","last_became_peered":"2024-01-21T20:18:19.248311+0000","last_unstale":"2024-01-21T20:18:19.628272+0000","last_undegraded":"2024-01-21T20:18:19.628272+0000","last_fullsized":"2024-01-21T20:18:19.628272+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632448+0000","last_change":"2024-01-21T20:18:19.630352+0000","last_active":"2024-01-21T20:18:19.632448+0000","last_peered":"2024-01-21T20:18:19.632448+0000","last_clean":"2024-01-21T20:18:19.632448+0000","last_became_active":"2024-01-21T20:18:19.629197+0000","last_became_peered":"2024-01-21T20:18:19.629197+0000","last_unstale":"2024-01-21T20:18:19.632448+0000","last_undegraded":"2024-01-21T20:18:19.632448+0000","last_fullsized":"2024-01-21T20:18:19.632448+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.625415+0000","last_change":"2024-01-21T20:18:19.248569+0000","last_active":"2024-01-21T20:18:19.625415+0000","last_peered":"2024-01-21T20:18:19.625415+0000","last_clean":"2024-01-21T20:18:19.625415+0000","last_became_active":"2024-01-21T20:18:19.248340+0000","last_became_peered":"2024-01-21T20:18:19.248340+0000","last_unstale":"2024-01-21T20:18:19.625415+0000","last_undegraded":"2024-01-21T20:18:19.625415+0000","last_fullsized":"2024-01-21T20:18:19.625415+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638326+0000","last_change":"2024-01-21T20:18:19.630102+0000","last_active":"2024-01-21T20:18:19.638326+0000","last_peered":"2024-01-21T20:18:19.638326+0000","last_clean":"2024-01-21T20:18:19.638326+0000","last_became_active":"2024-01-21T20:18:19.629856+0000","last_became_peered":"2024-01-21T20:18:19.629856+0000","last_unstale":"2024-01-21T20:18:19.638326+0000","last_undegraded":"2024-01-21T20:18:19.638326+0000","last_fullsized":"2024-01-21T20:18:19.638326+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611780+0000","last_change":"2024-01-21T20:18:19.251625+0000","last_active":"2024-01-21T20:18:19.611780+0000","last_peered":"2024-01-21T20:18:19.611780+0000","last_clean":"2024-01-21T20:18:19.611780+0000","last_became_active":"2024-01-21T20:18:19.247715+0000","last_became_peered":"2024-01-21T20:18:19.247715+0000","last_unstale":"2024-01-21T20:18:19.611780+0000","last_undegraded":"2024-01-21T20:18:19.611780+0000","last_fullsized":"2024-01-21T20:18:19.611780+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632225+0000","last_change":"2024-01-21T20:18:19.625374+0000","last_active":"2024-01-21T20:18:19.632225+0000","last_peered":"2024-01-21T20:18:19.632225+0000","last_clean":"2024-01-21T20:18:19.632225+0000","last_became_active":"2024-01-21T20:18:19.625072+0000","last_became_peered":"2024-01-21T20:18:19.625072+0000","last_unstale":"2024-01-21T20:18:19.632225+0000","last_undegraded":"2024-01-21T20:18:19.632225+0000","last_fullsized":"2024-01-21T20:18:19.632225+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615344+0000","last_change":"2024-01-21T20:18:19.257029+0000","last_active":"2024-01-21T20:18:19.615344+0000","last_peered":"2024-01-21T20:18:19.615344+0000","last_clean":"2024-01-21T20:18:19.615344+0000","last_became_active":"2024-01-21T20:18:19.256743+0000","last_became_peered":"2024-01-21T20:18:19.256743+0000","last_unstale":"2024-01-21T20:18:19.615344+0000","last_undegraded":"2024-01-21T20:18:19.615344+0000","last_fullsized":"2024-01-21T20:18:19.615344+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637154+0000","last_change":"2024-01-21T20:18:19.636233+0000","last_active":"2024-01-21T20:18:19.637154+0000","last_peered":"2024-01-21T20:18:19.637154+0000","last_clean":"2024-01-21T20:18:19.637154+0000","last_became_active":"2024-01-21T20:18:19.635801+0000","last_became_peered":"2024-01-21T20:18:19.635801+0000","last_unstale":"2024-01-21T20:18:19.637154+0000","last_undegraded":"2024-01-21T20:18:19.637154+0000","last_fullsized":"2024-01-21T20:18:19.637154+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612636+0000","last_change":"2024-01-21T20:18:19.248015+0000","last_active":"2024-01-21T20:18:19.612636+0000","last_peered":"2024-01-21T20:18:19.612636+0000","last_clean":"2024-01-21T20:18:19.612636+0000","last_became_active":"2024-01-21T20:18:19.247455+0000","last_became_peered":"2024-01-21T20:18:19.247455+0000","last_unstale":"2024-01-21T20:18:19.612636+0000","last_undegraded":"2024-01-21T20:18:19.612636+0000","last_fullsized":"2024-01-21T20:18:19.612636+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640047+0000","last_change":"2024-01-21T20:18:19.636468+0000","last_active":"2024-01-21T20:18:19.640047+0000","last_peered":"2024-01-21T20:18:19.640047+0000","last_clean":"2024-01-21T20:18:19.640047+0000","last_became_active":"2024-01-21T20:18:19.635870+0000","last_became_peered":"2024-01-21T20:18:19.635870+0000","last_unstale":"2024-01-21T20:18:19.640047+0000","last_undegraded":"2024-01-21T20:18:19.640047+0000","last_fullsized":"2024-01-21T20:18:19.640047+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615473+0000","last_change":"2024-01-21T20:18:19.252266+0000","last_active":"2024-01-21T20:18:19.615473+0000","last_peered":"2024-01-21T20:18:19.615473+0000","last_clean":"2024-01-21T20:18:19.615473+0000","last_became_active":"2024-01-21T20:18:19.251989+0000","last_became_peered":"2024-01-21T20:18:19.251989+0000","last_unstale":"2024-01-21T20:18:19.615473+0000","last_undegraded":"2024-01-21T20:18:19.615473+0000","last_fullsized":"2024-01-21T20:18:19.615473+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630923+0000","last_change":"2024-01-21T20:18:19.626357+0000","last_active":"2024-01-21T20:18:19.630923+0000","last_peered":"2024-01-21T20:18:19.630923+0000","last_clean":"2024-01-21T20:18:19.630923+0000","last_became_active":"2024-01-21T20:18:19.626054+0000","last_became_peered":"2024-01-21T20:18:19.626054+0000","last_unstale":"2024-01-21T20:18:19.630923+0000","last_undegraded":"2024-01-21T20:18:19.630923+0000","last_fullsized":"2024-01-21T20:18:19.630923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635751+0000","last_change":"2024-01-21T20:18:19.254683+0000","last_active":"2024-01-21T20:18:19.635751+0000","last_peered":"2024-01-21T20:18:19.635751+0000","last_clean":"2024-01-21T20:18:19.635751+0000","last_became_active":"2024-01-21T20:18:19.254388+0000","last_became_peered":"2024-01-21T20:18:19.254388+0000","last_unstale":"2024-01-21T20:18:19.635751+0000","last_undegraded":"2024-01-21T20:18:19.635751+0000","last_fullsized":"2024-01-21T20:18:19.635751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632203+0000","last_change":"2024-01-21T20:18:19.627089+0000","last_active":"2024-01-21T20:18:19.632203+0000","last_peered":"2024-01-21T20:18:19.632203+0000","last_clean":"2024-01-21T20:18:19.632203+0000","last_became_active":"2024-01-21T20:18:19.626789+0000","last_became_peered":"2024-01-21T20:18:19.626789+0000","last_unstale":"2024-01-21T20:18:19.632203+0000","last_undegraded":"2024-01-21T20:18:19.632203+0000","last_fullsized":"2024-01-21T20:18:19.632203+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634179+0000","last_change":"2024-01-21T20:18:19.253774+0000","last_active":"2024-01-21T20:18:19.634179+0000","last_peered":"2024-01-21T20:18:19.634179+0000","last_clean":"2024-01-21T20:18:19.634179+0000","last_became_active":"2024-01-21T20:18:19.253405+0000","last_became_peered":"2024-01-21T20:18:19.253405+0000","last_unstale":"2024-01-21T20:18:19.634179+0000","last_undegraded":"2024-01-21T20:18:19.634179+0000","last_fullsized":"2024-01-21T20:18:19.634179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633268+0000","last_change":"2024-01-21T20:18:19.628653+0000","last_active":"2024-01-21T20:18:19.633268+0000","last_peered":"2024-01-21T20:18:19.633268+0000","last_clean":"2024-01-21T20:18:19.633268+0000","last_became_active":"2024-01-21T20:18:19.628434+0000","last_became_peered":"2024-01-21T20:18:19.628434+0000","last_unstale":"2024-01-21T20:18:19.633268+0000","last_undegraded":"2024-01-21T20:18:19.633268+0000","last_fullsized":"2024-01-21T20:18:19.633268+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616876+0000","last_change":"2024-01-21T20:18:19.253953+0000","last_active":"2024-01-21T20:18:19.616876+0000","last_peered":"2024-01-21T20:18:19.616876+0000","last_clean":"2024-01-21T20:18:19.616876+0000","last_became_active":"2024-01-21T20:18:19.253642+0000","last_became_peered":"2024-01-21T20:18:19.253642+0000","last_unstale":"2024-01-21T20:18:19.616876+0000","last_undegraded":"2024-01-21T20:18:19.616876+0000","last_fullsized":"2024-01-21T20:18:19.616876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630550+0000","last_change":"2024-01-21T20:18:19.629404+0000","last_active":"2024-01-21T20:18:19.630550+0000","last_peered":"2024-01-21T20:18:19.630550+0000","last_clean":"2024-01-21T20:18:19.630550+0000","last_became_active":"2024-01-21T20:18:19.629096+0000","last_became_peered":"2024-01-21T20:18:19.629096+0000","last_unstale":"2024-01-21T20:18:19.630550+0000","last_undegraded":"2024-01-21T20:18:19.630550+0000","last_fullsized":"2024-01-21T20:18:19.630550+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616401+0000","last_change":"2024-01-21T20:18:19.255638+0000","last_active":"2024-01-21T20:18:19.616401+0000","last_peered":"2024-01-21T20:18:19.616401+0000","last_clean":"2024-01-21T20:18:19.616401+0000","last_became_active":"2024-01-21T20:18:19.255398+0000","last_became_peered":"2024-01-21T20:18:19.255398+0000","last_unstale":"2024-01-21T20:18:19.616401+0000","last_undegraded":"2024-01-21T20:18:19.616401+0000","last_fullsized":"2024-01-21T20:18:19.616401+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633416+0000","last_change":"2024-01-21T20:18:19.631074+0000","last_active":"2024-01-21T20:18:19.633416+0000","last_peered":"2024-01-21T20:18:19.633416+0000","last_clean":"2024-01-21T20:18:19.633416+0000","last_became_active":"2024-01-21T20:18:19.627990+0000","last_became_peered":"2024-01-21T20:18:19.627990+0000","last_unstale":"2024-01-21T20:18:19.633416+0000","last_undegraded":"2024-01-21T20:18:19.633416+0000","last_fullsized":"2024-01-21T20:18:19.633416+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628983+0000","last_change":"2024-01-21T20:18:19.253835+0000","last_active":"2024-01-21T20:18:19.628983+0000","last_peered":"2024-01-21T20:18:19.628983+0000","last_clean":"2024-01-21T20:18:19.628983+0000","last_became_active":"2024-01-21T20:18:19.253593+0000","last_became_peered":"2024-01-21T20:18:19.253593+0000","last_unstale":"2024-01-21T20:18:19.628983+0000","last_undegraded":"2024-01-21T20:18:19.628983+0000","last_fullsized":"2024-01-21T20:18:19.628983+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636087+0000","last_change":"2024-01-21T20:18:19.631175+0000","last_active":"2024-01-21T20:18:19.636087+0000","last_peered":"2024-01-21T20:18:19.636087+0000","last_clean":"2024-01-21T20:18:19.636087+0000","last_became_active":"2024-01-21T20:18:19.630658+0000","last_became_peered":"2024-01-21T20:18:19.630658+0000","last_unstale":"2024-01-21T20:18:19.636087+0000","last_undegraded":"2024-01-21T20:18:19.636087+0000","last_fullsized":"2024-01-21T20:18:19.636087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616059+0000","last_change":"2024-01-21T20:18:19.249647+0000","last_active":"2024-01-21T20:18:19.616059+0000","last_peered":"2024-01-21T20:18:19.616059+0000","last_clean":"2024-01-21T20:18:19.616059+0000","last_became_active":"2024-01-21T20:18:19.249338+0000","last_became_peered":"2024-01-21T20:18:19.249338+0000","last_unstale":"2024-01-21T20:18:19.616059+0000","last_undegraded":"2024-01-21T20:18:19.616059+0000","last_fullsized":"2024-01-21T20:18:19.616059+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637136+0000","last_change":"2024-01-21T20:18:19.632053+0000","last_active":"2024-01-21T20:18:19.637136+0000","last_peered":"2024-01-21T20:18:19.637136+0000","last_clean":"2024-01-21T20:18:19.637136+0000","last_became_active":"2024-01-21T20:18:19.631799+0000","last_became_peered":"2024-01-21T20:18:19.631799+0000","last_unstale":"2024-01-21T20:18:19.637136+0000","last_undegraded":"2024-01-21T20:18:19.637136+0000","last_fullsized":"2024-01-21T20:18:19.637136+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616792+0000","last_change":"2024-01-21T20:18:19.250267+0000","last_active":"2024-01-21T20:18:19.616792+0000","last_peered":"2024-01-21T20:18:19.616792+0000","last_clean":"2024-01-21T20:18:19.616792+0000","last_became_active":"2024-01-21T20:18:19.250016+0000","last_became_peered":"2024-01-21T20:18:19.250016+0000","last_unstale":"2024-01-21T20:18:19.616792+0000","last_undegraded":"2024-01-21T20:18:19.616792+0000","last_fullsized":"2024-01-21T20:18:19.616792+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622039+0000","last_change":"2024-01-21T20:18:19.620660+0000","last_active":"2024-01-21T20:18:19.622039+0000","last_peered":"2024-01-21T20:18:19.622039+0000","last_clean":"2024-01-21T20:18:19.622039+0000","last_became_active":"2024-01-21T20:18:19.620343+0000","last_became_peered":"2024-01-21T20:18:19.620343+0000","last_unstale":"2024-01-21T20:18:19.622039+0000","last_undegraded":"2024-01-21T20:18:19.622039+0000","last_fullsized":"2024-01-21T20:18:19.622039+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617703+0000","last_change":"2024-01-21T20:18:19.248692+0000","last_active":"2024-01-21T20:18:19.617703+0000","last_peered":"2024-01-21T20:18:19.617703+0000","last_clean":"2024-01-21T20:18:19.617703+0000","last_became_active":"2024-01-21T20:18:19.247980+0000","last_became_peered":"2024-01-21T20:18:19.247980+0000","last_unstale":"2024-01-21T20:18:19.617703+0000","last_undegraded":"2024-01-21T20:18:19.617703+0000","last_fullsized":"2024-01-21T20:18:19.617703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640447+0000","last_change":"2024-01-21T20:18:19.639139+0000","last_active":"2024-01-21T20:18:19.640447+0000","last_peered":"2024-01-21T20:18:19.640447+0000","last_clean":"2024-01-21T20:18:19.640447+0000","last_became_active":"2024-01-21T20:18:19.638685+0000","last_became_peered":"2024-01-21T20:18:19.638685+0000","last_unstale":"2024-01-21T20:18:19.640447+0000","last_undegraded":"2024-01-21T20:18:19.640447+0000","last_fullsized":"2024-01-21T20:18:19.640447+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632590+0000","last_change":"2024-01-21T20:18:19.245530+0000","last_active":"2024-01-21T20:18:19.632590+0000","last_peered":"2024-01-21T20:18:19.632590+0000","last_clean":"2024-01-21T20:18:19.632590+0000","last_became_active":"2024-01-21T20:18:19.244977+0000","last_became_peered":"2024-01-21T20:18:19.244977+0000","last_unstale":"2024-01-21T20:18:19.632590+0000","last_undegraded":"2024-01-21T20:18:19.632590+0000","last_fullsized":"2024-01-21T20:18:19.632590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639368+0000","last_change":"2024-01-21T20:18:19.636375+0000","last_active":"2024-01-21T20:18:19.639368+0000","last_peered":"2024-01-21T20:18:19.639368+0000","last_clean":"2024-01-21T20:18:19.639368+0000","last_became_active":"2024-01-21T20:18:19.636078+0000","last_became_peered":"2024-01-21T20:18:19.636078+0000","last_unstale":"2024-01-21T20:18:19.639368+0000","last_undegraded":"2024-01-21T20:18:19.639368+0000","last_fullsized":"2024-01-21T20:18:19.639368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615273+0000","last_change":"2024-01-21T20:18:19.254766+0000","last_active":"2024-01-21T20:18:19.615273+0000","last_peered":"2024-01-21T20:18:19.615273+0000","last_clean":"2024-01-21T20:18:19.615273+0000","last_became_active":"2024-01-21T20:18:19.254512+0000","last_became_peered":"2024-01-21T20:18:19.254512+0000","last_unstale":"2024-01-21T20:18:19.615273+0000","last_undegraded":"2024-01-21T20:18:19.615273+0000","last_fullsized":"2024-01-21T20:18:19.615273+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633127+0000","last_change":"2024-01-21T20:18:19.631190+0000","last_active":"2024-01-21T20:18:19.633127+0000","last_peered":"2024-01-21T20:18:19.633127+0000","last_clean":"2024-01-21T20:18:19.633127+0000","last_became_active":"2024-01-21T20:18:19.630903+0000","last_became_peered":"2024-01-21T20:18:19.630903+0000","last_unstale":"2024-01-21T20:18:19.633127+0000","last_undegraded":"2024-01-21T20:18:19.633127+0000","last_fullsized":"2024-01-21T20:18:19.633127+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616121+0000","last_change":"2024-01-21T20:18:19.252787+0000","last_active":"2024-01-21T20:18:19.616121+0000","last_peered":"2024-01-21T20:18:19.616121+0000","last_clean":"2024-01-21T20:18:19.616121+0000","last_became_active":"2024-01-21T20:18:19.252519+0000","last_became_peered":"2024-01-21T20:18:19.252519+0000","last_unstale":"2024-01-21T20:18:19.616121+0000","last_undegraded":"2024-01-21T20:18:19.616121+0000","last_fullsized":"2024-01-21T20:18:19.616121+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622840+0000","last_change":"2024-01-21T20:18:19.620400+0000","last_active":"2024-01-21T20:18:19.622840+0000","last_peered":"2024-01-21T20:18:19.622840+0000","last_clean":"2024-01-21T20:18:19.622840+0000","last_became_active":"2024-01-21T20:18:19.620146+0000","last_became_peered":"2024-01-21T20:18:19.620146+0000","last_unstale":"2024-01-21T20:18:19.622840+0000","last_undegraded":"2024-01-21T20:18:19.622840+0000","last_fullsized":"2024-01-21T20:18:19.622840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615668+0000","last_change":"2024-01-21T20:18:19.247323+0000","last_active":"2024-01-21T20:18:19.615668+0000","last_peered":"2024-01-21T20:18:19.615668+0000","last_clean":"2024-01-21T20:18:19.615668+0000","last_became_active":"2024-01-21T20:18:19.247056+0000","last_became_peered":"2024-01-21T20:18:19.247056+0000","last_unstale":"2024-01-21T20:18:19.615668+0000","last_undegraded":"2024-01-21T20:18:19.615668+0000","last_fullsized":"2024-01-21T20:18:19.615668+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636564+0000","last_change":"2024-01-21T20:18:19.633402+0000","last_active":"2024-01-21T20:18:19.636564+0000","last_peered":"2024-01-21T20:18:19.636564+0000","last_clean":"2024-01-21T20:18:19.636564+0000","last_became_active":"2024-01-21T20:18:19.632524+0000","last_became_peered":"2024-01-21T20:18:19.632524+0000","last_unstale":"2024-01-21T20:18:19.636564+0000","last_undegraded":"2024-01-21T20:18:19.636564+0000","last_fullsized":"2024-01-21T20:18:19.636564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611888+0000","last_change":"2024-01-21T20:18:19.243896+0000","last_active":"2024-01-21T20:18:19.611888+0000","last_peered":"2024-01-21T20:18:19.611888+0000","last_clean":"2024-01-21T20:18:19.611888+0000","last_became_active":"2024-01-21T20:18:19.243626+0000","last_became_peered":"2024-01-21T20:18:19.243626+0000","last_unstale":"2024-01-21T20:18:19.611888+0000","last_undegraded":"2024-01-21T20:18:19.611888+0000","last_fullsized":"2024-01-21T20:18:19.611888+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636063+0000","last_change":"2024-01-21T20:18:19.631004+0000","last_active":"2024-01-21T20:18:19.636063+0000","last_peered":"2024-01-21T20:18:19.636063+0000","last_clean":"2024-01-21T20:18:19.636063+0000","last_became_active":"2024-01-21T20:18:19.630570+0000","last_became_peered":"2024-01-21T20:18:19.630570+0000","last_unstale":"2024-01-21T20:18:19.636063+0000","last_undegraded":"2024-01-21T20:18:19.636063+0000","last_fullsized":"2024-01-21T20:18:19.636063+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612487+0000","last_change":"2024-01-21T20:18:19.240373+0000","last_active":"2024-01-21T20:18:19.612487+0000","last_peered":"2024-01-21T20:18:19.612487+0000","last_clean":"2024-01-21T20:18:19.612487+0000","last_became_active":"2024-01-21T20:18:19.239862+0000","last_became_peered":"2024-01-21T20:18:19.239862+0000","last_unstale":"2024-01-21T20:18:19.612487+0000","last_undegraded":"2024-01-21T20:18:19.612487+0000","last_fullsized":"2024-01-21T20:18:19.612487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634344+0000","last_change":"2024-01-21T20:18:19.633256+0000","last_active":"2024-01-21T20:18:19.634344+0000","last_peered":"2024-01-21T20:18:19.634344+0000","last_clean":"2024-01-21T20:18:19.634344+0000","last_became_active":"2024-01-21T20:18:19.632909+0000","last_became_peered":"2024-01-21T20:18:19.632909+0000","last_unstale":"2024-01-21T20:18:19.634344+0000","last_undegraded":"2024-01-21T20:18:19.634344+0000","last_fullsized":"2024-01-21T20:18:19.634344+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616432+0000","last_change":"2024-01-21T20:18:19.246487+0000","last_active":"2024-01-21T20:18:19.616432+0000","last_peered":"2024-01-21T20:18:19.616432+0000","last_clean":"2024-01-21T20:18:19.616432+0000","last_became_active":"2024-01-21T20:18:19.246237+0000","last_became_peered":"2024-01-21T20:18:19.246237+0000","last_unstale":"2024-01-21T20:18:19.616432+0000","last_undegraded":"2024-01-21T20:18:19.616432+0000","last_fullsized":"2024-01-21T20:18:19.616432+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640029+0000","last_change":"2024-01-21T20:18:19.635362+0000","last_active":"2024-01-21T20:18:19.640029+0000","last_peered":"2024-01-21T20:18:19.640029+0000","last_clean":"2024-01-21T20:18:19.640029+0000","last_became_active":"2024-01-21T20:18:19.635065+0000","last_became_peered":"2024-01-21T20:18:19.635065+0000","last_unstale":"2024-01-21T20:18:19.640029+0000","last_undegraded":"2024-01-21T20:18:19.640029+0000","last_fullsized":"2024-01-21T20:18:19.640029+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622911+0000","last_change":"2024-01-21T20:18:19.248733+0000","last_active":"2024-01-21T20:18:19.622911+0000","last_peered":"2024-01-21T20:18:19.622911+0000","last_clean":"2024-01-21T20:18:19.622911+0000","last_became_active":"2024-01-21T20:18:19.248273+0000","last_became_peered":"2024-01-21T20:18:19.248273+0000","last_unstale":"2024-01-21T20:18:19.622911+0000","last_undegraded":"2024-01-21T20:18:19.622911+0000","last_fullsized":"2024-01-21T20:18:19.622911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634384+0000","last_change":"2024-01-21T20:18:19.628817+0000","last_active":"2024-01-21T20:18:19.634384+0000","last_peered":"2024-01-21T20:18:19.634384+0000","last_clean":"2024-01-21T20:18:19.634384+0000","last_became_active":"2024-01-21T20:18:19.628501+0000","last_became_peered":"2024-01-21T20:18:19.628501+0000","last_unstale":"2024-01-21T20:18:19.634384+0000","last_undegraded":"2024-01-21T20:18:19.634384+0000","last_fullsized":"2024-01-21T20:18:19.634384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615961+0000","last_change":"2024-01-21T20:18:19.255054+0000","last_active":"2024-01-21T20:18:19.615961+0000","last_peered":"2024-01-21T20:18:19.615961+0000","last_clean":"2024-01-21T20:18:19.615961+0000","last_became_active":"2024-01-21T20:18:19.254700+0000","last_became_peered":"2024-01-21T20:18:19.254700+0000","last_unstale":"2024-01-21T20:18:19.615961+0000","last_undegraded":"2024-01-21T20:18:19.615961+0000","last_fullsized":"2024-01-21T20:18:19.615961+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626198+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:18:19.626198+0000","last_peered":"2024-01-21T20:18:19.626198+0000","last_clean":"2024-01-21T20:18:19.626198+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:18:19.626198+0000","last_undegraded":"2024-01-21T20:18:19.626198+0000","last_fullsized":"2024-01-21T20:18:19.626198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622737+0000","last_change":"2024-01-21T20:18:19.616016+0000","last_active":"2024-01-21T20:18:19.622737+0000","last_peered":"2024-01-21T20:18:19.622737+0000","last_clean":"2024-01-21T20:18:19.622737+0000","last_became_active":"2024-01-21T20:18:19.615759+0000","last_became_peered":"2024-01-21T20:18:19.615759+0000","last_unstale":"2024-01-21T20:18:19.622737+0000","last_undegraded":"2024-01-21T20:18:19.622737+0000","last_fullsized":"2024-01-21T20:18:19.622737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616691+0000","last_change":"2024-01-21T20:18:19.245490+0000","last_active":"2024-01-21T20:18:19.616691+0000","last_peered":"2024-01-21T20:18:19.616691+0000","last_clean":"2024-01-21T20:18:19.616691+0000","last_became_active":"2024-01-21T20:18:19.245216+0000","last_became_peered":"2024-01-21T20:18:19.245216+0000","last_unstale":"2024-01-21T20:18:19.616691+0000","last_undegraded":"2024-01-21T20:18:19.616691+0000","last_fullsized":"2024-01-21T20:18:19.616691+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612181+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:18:19.612181+0000","last_peered":"2024-01-21T20:18:19.612181+0000","last_clean":"2024-01-21T20:18:19.612181+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:18:19.612181+0000","last_undegraded":"2024-01-21T20:18:19.612181+0000","last_fullsized":"2024-01-21T20:18:19.612181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639368+0000","last_change":"2024-01-21T20:18:19.635365+0000","last_active":"2024-01-21T20:18:19.639368+0000","last_peered":"2024-01-21T20:18:19.639368+0000","last_clean":"2024-01-21T20:18:19.639368+0000","last_became_active":"2024-01-21T20:18:19.635076+0000","last_became_peered":"2024-01-21T20:18:19.635076+0000","last_unstale":"2024-01-21T20:18:19.639368+0000","last_undegraded":"2024-01-21T20:18:19.639368+0000","last_fullsized":"2024-01-21T20:18:19.639368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620795+0000","last_change":"2024-01-21T20:18:19.239622+0000","last_active":"2024-01-21T20:18:19.620795+0000","last_peered":"2024-01-21T20:18:19.620795+0000","last_clean":"2024-01-21T20:18:19.620795+0000","last_became_active":"2024-01-21T20:18:19.239344+0000","last_became_peered":"2024-01-21T20:18:19.239344+0000","last_unstale":"2024-01-21T20:18:19.620795+0000","last_undegraded":"2024-01-21T20:18:19.620795+0000","last_fullsized":"2024-01-21T20:18:19.620795+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":117,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.610636+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:18:19.610636+0000","last_peered":"2024-01-21T20:18:19.610636+0000","last_clean":"2024-01-21T20:18:19.610636+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:18:19.610636+0000","last_undegraded":"2024-01-21T20:18:19.610636+0000","last_fullsized":"2024-01-21T20:18:19.610636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630336+0000","last_change":"2024-01-21T20:18:19.625673+0000","last_active":"2024-01-21T20:18:19.630336+0000","last_peered":"2024-01-21T20:18:19.630336+0000","last_clean":"2024-01-21T20:18:19.630336+0000","last_became_active":"2024-01-21T20:18:19.625316+0000","last_became_peered":"2024-01-21T20:18:19.625316+0000","last_unstale":"2024-01-21T20:18:19.630336+0000","last_undegraded":"2024-01-21T20:18:19.630336+0000","last_fullsized":"2024-01-21T20:18:19.630336+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630626+0000","last_change":"2024-01-21T20:18:19.250478+0000","last_active":"2024-01-21T20:18:19.630626+0000","last_peered":"2024-01-21T20:18:19.630626+0000","last_clean":"2024-01-21T20:18:19.630626+0000","last_became_active":"2024-01-21T20:18:19.250207+0000","last_became_peered":"2024-01-21T20:18:19.250207+0000","last_unstale":"2024-01-21T20:18:19.630626+0000","last_undegraded":"2024-01-21T20:18:19.630626+0000","last_fullsized":"2024-01-21T20:18:19.630626+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":125,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612342+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:18:19.612342+0000","last_peered":"2024-01-21T20:18:19.612342+0000","last_clean":"2024-01-21T20:18:19.612342+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:18:19.612342+0000","last_undegraded":"2024-01-21T20:18:19.612342+0000","last_fullsized":"2024-01-21T20:18:19.612342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619850+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:18:19.619850+0000","last_peered":"2024-01-21T20:18:19.619850+0000","last_clean":"2024-01-21T20:18:19.619850+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:18:19.619850+0000","last_undegraded":"2024-01-21T20:18:19.619850+0000","last_fullsized":"2024-01-21T20:18:19.619850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634359+0000","last_change":"2024-01-21T20:18:19.629794+0000","last_active":"2024-01-21T20:18:19.634359+0000","last_peered":"2024-01-21T20:18:19.634359+0000","last_clean":"2024-01-21T20:18:19.634359+0000","last_became_active":"2024-01-21T20:18:19.629537+0000","last_became_peered":"2024-01-21T20:18:19.629537+0000","last_unstale":"2024-01-21T20:18:19.634359+0000","last_undegraded":"2024-01-21T20:18:19.634359+0000","last_fullsized":"2024-01-21T20:18:19.634359+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635384+0000","last_change":"2024-01-21T20:18:19.250082+0000","last_active":"2024-01-21T20:18:19.635384+0000","last_peered":"2024-01-21T20:18:19.635384+0000","last_clean":"2024-01-21T20:18:19.635384+0000","last_became_active":"2024-01-21T20:18:19.249692+0000","last_became_peered":"2024-01-21T20:18:19.249692+0000","last_unstale":"2024-01-21T20:18:19.635384+0000","last_undegraded":"2024-01-21T20:18:19.635384+0000","last_fullsized":"2024-01-21T20:18:19.635384+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619935+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:18:19.619935+0000","last_peered":"2024-01-21T20:18:19.619935+0000","last_clean":"2024-01-21T20:18:19.619935+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:18:19.619935+0000","last_undegraded":"2024-01-21T20:18:19.619935+0000","last_fullsized":"2024-01-21T20:18:19.619935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629700+0000","last_change":"2024-01-21T20:18:19.624186+0000","last_active":"2024-01-21T20:18:19.629700+0000","last_peered":"2024-01-21T20:18:19.629700+0000","last_clean":"2024-01-21T20:18:19.629700+0000","last_became_active":"2024-01-21T20:18:19.623889+0000","last_became_peered":"2024-01-21T20:18:19.623889+0000","last_unstale":"2024-01-21T20:18:19.629700+0000","last_undegraded":"2024-01-21T20:18:19.629700+0000","last_fullsized":"2024-01-21T20:18:19.629700+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612786+0000","last_change":"2024-01-21T20:18:19.244454+0000","last_active":"2024-01-21T20:18:19.612786+0000","last_peered":"2024-01-21T20:18:19.612786+0000","last_clean":"2024-01-21T20:18:19.612786+0000","last_became_active":"2024-01-21T20:18:19.242845+0000","last_became_peered":"2024-01-21T20:18:19.242845+0000","last_unstale":"2024-01-21T20:18:19.612786+0000","last_undegraded":"2024-01-21T20:18:19.612786+0000","last_fullsized":"2024-01-21T20:18:19.612786+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617082+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:18:19.617082+0000","last_peered":"2024-01-21T20:18:19.617082+0000","last_clean":"2024-01-21T20:18:19.617082+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:18:19.617082+0000","last_undegraded":"2024-01-21T20:18:19.617082+0000","last_fullsized":"2024-01-21T20:18:19.617082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635899+0000","last_change":"2024-01-21T20:18:19.630308+0000","last_active":"2024-01-21T20:18:19.635899+0000","last_peered":"2024-01-21T20:18:19.635899+0000","last_clean":"2024-01-21T20:18:19.635899+0000","last_became_active":"2024-01-21T20:18:19.629745+0000","last_became_peered":"2024-01-21T20:18:19.629745+0000","last_unstale":"2024-01-21T20:18:19.635899+0000","last_undegraded":"2024-01-21T20:18:19.635899+0000","last_fullsized":"2024-01-21T20:18:19.635899+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630714+0000","last_change":"2024-01-21T20:18:19.247153+0000","last_active":"2024-01-21T20:18:19.630714+0000","last_peered":"2024-01-21T20:18:19.630714+0000","last_clean":"2024-01-21T20:18:19.630714+0000","last_became_active":"2024-01-21T20:18:19.246781+0000","last_became_peered":"2024-01-21T20:18:19.246781+0000","last_unstale":"2024-01-21T20:18:19.630714+0000","last_undegraded":"2024-01-21T20:18:19.630714+0000","last_fullsized":"2024-01-21T20:18:19.630714+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626944+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:18:19.626944+0000","last_peered":"2024-01-21T20:18:19.626944+0000","last_clean":"2024-01-21T20:18:19.626944+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:18:19.626944+0000","last_undegraded":"2024-01-21T20:18:19.626944+0000","last_fullsized":"2024-01-21T20:18:19.626944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629691+0000","last_change":"2024-01-21T20:18:19.624069+0000","last_active":"2024-01-21T20:18:19.629691+0000","last_peered":"2024-01-21T20:18:19.629691+0000","last_clean":"2024-01-21T20:18:19.629691+0000","last_became_active":"2024-01-21T20:18:19.623761+0000","last_became_peered":"2024-01-21T20:18:19.623761+0000","last_unstale":"2024-01-21T20:18:19.629691+0000","last_undegraded":"2024-01-21T20:18:19.629691+0000","last_fullsized":"2024-01-21T20:18:19.629691+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631940+0000","last_change":"2024-01-21T20:18:19.247725+0000","last_active":"2024-01-21T20:18:19.631940+0000","last_peered":"2024-01-21T20:18:19.631940+0000","last_clean":"2024-01-21T20:18:19.631940+0000","last_became_active":"2024-01-21T20:18:19.245322+0000","last_became_peered":"2024-01-21T20:18:19.245322+0000","last_unstale":"2024-01-21T20:18:19.631940+0000","last_undegraded":"2024-01-21T20:18:19.631940+0000","last_fullsized":"2024-01-21T20:18:19.631940+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617745+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:18:19.617745+0000","last_peered":"2024-01-21T20:18:19.617745+0000","last_clean":"2024-01-21T20:18:19.617745+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:18:19.617745+0000","last_undegraded":"2024-01-21T20:18:19.617745+0000","last_fullsized":"2024-01-21T20:18:19.617745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575076,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":909996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82099999999999995},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.871},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.79700000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80400000000000005},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.309},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.433}]},{"osd":6,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81499999999999995},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":1728512,"data_stored":911317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.25},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.27800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.107},"last":0.378},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.016},"last":0.27300000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.31}]},{"osd":3,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.877,"15min":1.0609999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":1.621,"15min":1.621},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.28599999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.84599999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28299999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.86099999999999999},"last":0.45100000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86899999999999999},"last":0.43099999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.44500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575078,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1728512,"data_stored":910785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.38900000000000001},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47899999999999998,"5min":0.58099999999999996,"15min":0.60599999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61499999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.68799999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.58299999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.309},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39300000000000002,"15min":0.40999999999999998},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.371}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.876,"15min":0.98899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.622}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.878,"15min":0.99299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.95299999999999996},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575077,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38100000000000001,"15min":0.39800000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.245},"max":{"1min":0.503,"5min":0.57499999999999996,"15min":0.70799999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.59999999999999998,"15min":0.81699999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.42399999999999999},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80600000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.5,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26900000000000002},"max":{"1min":0.49199999999999999,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.495,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40200000000000002,"15min":0.42099999999999999},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55500000000000005,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.45500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81799999999999995,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.375},"max":{"1min":0.876,"5min":0.95999999999999996,"15min":1.1759999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.375,"15min":0.373},"max":{"1min":0.68500000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73299999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.2},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.54100000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93300000000000005,"15min":1.216},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575077,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1736704,"data_stored":911441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.40799999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":0.626,"15min":7.8940000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.443},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.60099999999999998,"15min":7.532},"last":0.35199999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.37,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":6.9660000000000002},"last":0.38},{"interface":"front","average":{"1min":0.376,"5min":0.39100000000000001,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":7.8380000000000001},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":7.0199999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":8.0220000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.85099999999999998,"15min":7.6020000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.64200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":7.0940000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.1230000000000002},"last":0.502},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":7.9939999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":7.9649999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.85199999999999998,"15min":7.3540000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61299999999999999,"15min":0.66600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.91300000000000003,"15min":7.5620000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.67900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":7.8200000000000003},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575077,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82599999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.372},"max":{"1min":0.75,"5min":0.75,"15min":0.82699999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.89600000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.83499999999999996},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84499999999999997,"5min":1.472,"15min":1.472},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.38,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.79800000000000004},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78100000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.81899999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.748,"15min":0.77600000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.32400000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.875,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.5}]},{"osd":7,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575076,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":1728512,"data_stored":910853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82899999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.252},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.315},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":1.8520000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.83399999999999996,"15min":0.85699999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.9350000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.4079999999999999},"last":0.44}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83299999999999996},"last":0.496},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":1.008},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.498,"15min":0.499},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":1.891},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":1.9079999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.96099999999999997},"last":0.503},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.78900000000000003,"15min":1.3200000000000001},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:18:25.517 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T20:18:25.528+0000 7f21462c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T20:18:27.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T20:18:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.175+0000 7fe712daf700 1 Processor -- start 2024-01-21T20:18:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.175+0000 7fe712daf700 1 -- start start 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 0x7fe70c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 0x7fe70c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe70c069cd0 0x7fe70c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0bef10 con 0x7fe70c069cd0 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c156070 con 0x7fe70c0c3fb0 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe712daf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c065660 con 0x7fe70c0beb30 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe71134c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe70c069cd0 0x7fe70c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe71134c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe70c069cd0 0x7fe70c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45180/0 (socket says 172.21.15.133:45180) 2024-01-21T20:18:27.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.176+0000 7fe71134c700 1 -- 172.21.15.133:0/3058736816 learned_addr learned my addr 172.21.15.133:0/3058736816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe710b4b700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 0x7fe70c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe70bfff700 1 --2- 172.21.15.133:0/3058736816 >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 0x7fe70c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 -- 172.21.15.133:0/3058736816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 msgr2=0x7fe70c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 0x7fe70c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 -- 172.21.15.133:0/3058736816 >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 msgr2=0x7fe70c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 --2- 172.21.15.133:0/3058736816 >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 0x7fe70c0697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 -- 172.21.15.133:0/3058736816 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c065f00 con 0x7fe70c069cd0 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe70bfff700 1 --2- 172.21.15.133:0/3058736816 >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 0x7fe70c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe710b4b700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 0x7fe70c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe71134c700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c151b00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fe70c0c5b20 tx=0x7fe704009840).ready entity=mon.0 client_cookie=9272f28f275bac19 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe70b7fe700 1 -- 172.21.15.133:0/3058736816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400e070 con 0x7fe70c069cd0 2024-01-21T20:18:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe70b7fe700 1 -- 172.21.15.133:0/3058736816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400ba50 con 0x7fe70c069cd0 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe70b7fe700 1 -- 172.21.15.133:0/3058736816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400bdd0 con 0x7fe70c069cd0 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 -- 172.21.15.133:0/3058736816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 msgr2=0x7fe70c151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c151b00 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7fe70c0c5b20 tx=0x7fe704009840).stop 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 -- 172.21.15.133:0/3058736816 shutdown_connections 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c151b00 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 --2- 172.21.15.133:0/3058736816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0beb30 0x7fe70c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 --2- 172.21.15.133:0/3058736816 >> v2:172.21.15.178:3300/0 conn(0x7fe70c0c3fb0 0x7fe70c0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.177+0000 7fe712daf700 1 -- 172.21.15.133:0/3058736816 >> 172.21.15.133:0/3058736816 conn(0x7fe70c0c8010 msgr2=0x7fe70c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.178+0000 7fe712daf700 1 -- 172.21.15.133:0/3058736816 shutdown_connections 2024-01-21T20:18:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.178+0000 7fe712daf700 1 -- 172.21.15.133:0/3058736816 wait complete. 2024-01-21T20:18:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.179+0000 7fe712daf700 1 Processor -- start 2024-01-21T20:18:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.179+0000 7fe712daf700 1 -- start start 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 0x7fe70c0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 0x7fe70c0c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0bf440 con 0x7fe70c069cd0 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1513b0 con 0x7fe70c0beb30 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe712daf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0ad7d0 con 0x7fe70c0c3fb0 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe710b4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe710b4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45192/0 (socket says 172.21.15.133:45192) 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.180+0000 7fe710b4b700 1 -- 172.21.15.133:0/2306940346 learned_addr learned my addr 172.21.15.133:0/2306940346 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe71134c700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 0x7fe70c0c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe70bfff700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 0x7fe70c0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 -- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 msgr2=0x7fe70c0c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 0x7fe70c0c7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 -- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 msgr2=0x7fe70c0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 0x7fe70c0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 -- 172.21.15.133:0/2306940346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe704009ae0 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe71134c700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 0x7fe70c0c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe70bfff700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 0x7fe70c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe710b4b700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fe70000c880 tx=0x7fe700008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700010580 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7000106e0 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0adab0 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700010a60 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.181+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0ab4b0 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.182+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0bf720 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.182+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe70001b460 con 0x7fe70c069cd0 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.183+0000 7fe7097fa700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 0x7fe6f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.183+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fe70007a460 con 0x7fe70c069cd0 2024-01-21T20:18:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.183+0000 7fe70bfff700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 0x7fe6f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.183+0000 7fe70bfff700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 0x7fe6f0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe70c0aad60 tx=0x7fe6f8008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.187+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe70004b510 con 0x7fe70c069cd0 2024-01-21T20:18:27.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.350+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe70c0bf580 con 0x7fe6f005f150 2024-01-21T20:18:27.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.359+0000 7fe7097fa700 1 -- 172.21.15.133:0/2306940346 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362087 (secure 0 0 0) 0x7fe6f800c040 con 0x7fe6f005f150 2024-01-21T20:18:27.353 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 msgr2=0x7fe6f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 0x7fe6f0061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe70c0aad60 tx=0x7fe6f8008040).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 msgr2=0x7fe70c150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fe70000c880 tx=0x7fe700008040).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 shutdown_connections 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe6f005f150 0x7fe6f0061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c3fb0 0x7fe70c0c7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe70c069cd0 0x7fe70c150ec0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 --2- 172.21.15.133:0/2306940346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c0beb30 0x7fe70c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 >> 172.21.15.133:0/2306940346 conn(0x7fe70c0c8010 msgr2=0x7fe70c0bd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:27.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 shutdown_connections 2024-01-21T20:18:27.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.363+0000 7fe712daf700 1 -- 172.21.15.133:0/2306940346 wait complete. 2024-01-21T20:18:27.357 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T20:18:27.364 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T20:18:25.683949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2431256,"kb_used_data":13528,"kb_used_omap":0,"kb_used_meta":2417664,"kb_avail":752543464,"statfs":{"total":773094113280,"available":770604507136,"internally_reserved":0,"allocated":13852672,"data_stored":7288794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2475687936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-19377,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-68,"num_write_kb":-44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.506384"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633149+0000","last_change":"2024-01-21T20:18:19.631663+0000","last_active":"2024-01-21T20:18:19.633149+0000","last_peered":"2024-01-21T20:18:19.633149+0000","last_clean":"2024-01-21T20:18:19.633149+0000","last_became_active":"2024-01-21T20:18:19.631008+0000","last_became_peered":"2024-01-21T20:18:19.631008+0000","last_unstale":"2024-01-21T20:18:19.633149+0000","last_undegraded":"2024-01-21T20:18:19.633149+0000","last_fullsized":"2024-01-21T20:18:19.633149+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3f","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632859+0000","last_change":"2024-01-21T20:18:19.252978+0000","last_active":"2024-01-21T20:18:19.632859+0000","last_peered":"2024-01-21T20:18:19.632859+0000","last_clean":"2024-01-21T20:18:19.632859+0000","last_became_active":"2024-01-21T20:18:19.252473+0000","last_became_peered":"2024-01-21T20:18:19.252473+0000","last_unstale":"2024-01-21T20:18:19.632859+0000","last_undegraded":"2024-01-21T20:18:19.632859+0000","last_fullsized":"2024-01-21T20:18:19.632859+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635932+0000","last_change":"2024-01-21T20:18:19.629427+0000","last_active":"2024-01-21T20:18:19.635932+0000","last_peered":"2024-01-21T20:18:19.635932+0000","last_clean":"2024-01-21T20:18:19.635932+0000","last_became_active":"2024-01-21T20:18:19.629155+0000","last_became_peered":"2024-01-21T20:18:19.629155+0000","last_unstale":"2024-01-21T20:18:19.635932+0000","last_undegraded":"2024-01-21T20:18:19.635932+0000","last_fullsized":"2024-01-21T20:18:19.635932+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612067+0000","last_change":"2024-01-21T20:18:19.245767+0000","last_active":"2024-01-21T20:18:19.612067+0000","last_peered":"2024-01-21T20:18:19.612067+0000","last_clean":"2024-01-21T20:18:19.612067+0000","last_became_active":"2024-01-21T20:18:19.244925+0000","last_became_peered":"2024-01-21T20:18:19.244925+0000","last_unstale":"2024-01-21T20:18:19.612067+0000","last_undegraded":"2024-01-21T20:18:19.612067+0000","last_fullsized":"2024-01-21T20:18:19.612067+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635737+0000","last_change":"2024-01-21T20:18:19.630142+0000","last_active":"2024-01-21T20:18:19.635737+0000","last_peered":"2024-01-21T20:18:19.635737+0000","last_clean":"2024-01-21T20:18:19.635737+0000","last_became_active":"2024-01-21T20:18:19.629434+0000","last_became_peered":"2024-01-21T20:18:19.629434+0000","last_unstale":"2024-01-21T20:18:19.635737+0000","last_undegraded":"2024-01-21T20:18:19.635737+0000","last_fullsized":"2024-01-21T20:18:19.635737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616154+0000","last_change":"2024-01-21T20:18:19.249826+0000","last_active":"2024-01-21T20:18:19.616154+0000","last_peered":"2024-01-21T20:18:19.616154+0000","last_clean":"2024-01-21T20:18:19.616154+0000","last_became_active":"2024-01-21T20:18:19.249219+0000","last_became_peered":"2024-01-21T20:18:19.249219+0000","last_unstale":"2024-01-21T20:18:19.616154+0000","last_undegraded":"2024-01-21T20:18:19.616154+0000","last_fullsized":"2024-01-21T20:18:19.616154+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636748+0000","last_change":"2024-01-21T20:18:19.636174+0000","last_active":"2024-01-21T20:18:19.636748+0000","last_peered":"2024-01-21T20:18:19.636748+0000","last_clean":"2024-01-21T20:18:19.636748+0000","last_became_active":"2024-01-21T20:18:19.635868+0000","last_became_peered":"2024-01-21T20:18:19.635868+0000","last_unstale":"2024-01-21T20:18:19.636748+0000","last_undegraded":"2024-01-21T20:18:19.636748+0000","last_fullsized":"2024-01-21T20:18:19.636748+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3c","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634337+0000","last_change":"2024-01-21T20:18:19.253371+0000","last_active":"2024-01-21T20:18:19.634337+0000","last_peered":"2024-01-21T20:18:19.634337+0000","last_clean":"2024-01-21T20:18:19.634337+0000","last_became_active":"2024-01-21T20:18:19.253110+0000","last_became_peered":"2024-01-21T20:18:19.253110+0000","last_unstale":"2024-01-21T20:18:19.634337+0000","last_undegraded":"2024-01-21T20:18:19.634337+0000","last_fullsized":"2024-01-21T20:18:19.634337+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636068+0000","last_change":"2024-01-21T20:18:19.631750+0000","last_active":"2024-01-21T20:18:19.636068+0000","last_peered":"2024-01-21T20:18:19.636068+0000","last_clean":"2024-01-21T20:18:19.636068+0000","last_became_active":"2024-01-21T20:18:19.631483+0000","last_became_peered":"2024-01-21T20:18:19.631483+0000","last_unstale":"2024-01-21T20:18:19.636068+0000","last_undegraded":"2024-01-21T20:18:19.636068+0000","last_fullsized":"2024-01-21T20:18:19.636068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636850+0000","last_change":"2024-01-21T20:18:19.249653+0000","last_active":"2024-01-21T20:18:19.636850+0000","last_peered":"2024-01-21T20:18:19.636850+0000","last_clean":"2024-01-21T20:18:19.636850+0000","last_became_active":"2024-01-21T20:18:19.249362+0000","last_became_peered":"2024-01-21T20:18:19.249362+0000","last_unstale":"2024-01-21T20:18:19.636850+0000","last_undegraded":"2024-01-21T20:18:19.636850+0000","last_fullsized":"2024-01-21T20:18:19.636850+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633220+0000","last_change":"2024-01-21T20:18:19.628838+0000","last_active":"2024-01-21T20:18:19.633220+0000","last_peered":"2024-01-21T20:18:19.633220+0000","last_clean":"2024-01-21T20:18:19.633220+0000","last_became_active":"2024-01-21T20:18:19.628525+0000","last_became_peered":"2024-01-21T20:18:19.628525+0000","last_unstale":"2024-01-21T20:18:19.633220+0000","last_undegraded":"2024-01-21T20:18:19.633220+0000","last_fullsized":"2024-01-21T20:18:19.633220+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3a","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634851+0000","last_change":"2024-01-21T20:18:19.248676+0000","last_active":"2024-01-21T20:18:19.634851+0000","last_peered":"2024-01-21T20:18:19.634851+0000","last_clean":"2024-01-21T20:18:19.634851+0000","last_became_active":"2024-01-21T20:18:19.248376+0000","last_became_peered":"2024-01-21T20:18:19.248376+0000","last_unstale":"2024-01-21T20:18:19.634851+0000","last_undegraded":"2024-01-21T20:18:19.634851+0000","last_fullsized":"2024-01-21T20:18:19.634851+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633252+0000","last_change":"2024-01-21T20:18:19.631521+0000","last_active":"2024-01-21T20:18:19.633252+0000","last_peered":"2024-01-21T20:18:19.633252+0000","last_clean":"2024-01-21T20:18:19.633252+0000","last_became_active":"2024-01-21T20:18:19.631211+0000","last_became_peered":"2024-01-21T20:18:19.631211+0000","last_unstale":"2024-01-21T20:18:19.633252+0000","last_undegraded":"2024-01-21T20:18:19.633252+0000","last_fullsized":"2024-01-21T20:18:19.633252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612533+0000","last_change":"2024-01-21T20:18:19.248132+0000","last_active":"2024-01-21T20:18:19.612533+0000","last_peered":"2024-01-21T20:18:19.612533+0000","last_clean":"2024-01-21T20:18:19.612533+0000","last_became_active":"2024-01-21T20:18:19.247829+0000","last_became_peered":"2024-01-21T20:18:19.247829+0000","last_unstale":"2024-01-21T20:18:19.612533+0000","last_undegraded":"2024-01-21T20:18:19.612533+0000","last_fullsized":"2024-01-21T20:18:19.612533+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631181+0000","last_change":"2024-01-21T20:18:19.620410+0000","last_active":"2024-01-21T20:18:19.631181+0000","last_peered":"2024-01-21T20:18:19.631181+0000","last_clean":"2024-01-21T20:18:19.631181+0000","last_became_active":"2024-01-21T20:18:19.620138+0000","last_became_peered":"2024-01-21T20:18:19.620138+0000","last_unstale":"2024-01-21T20:18:19.631181+0000","last_undegraded":"2024-01-21T20:18:19.631181+0000","last_fullsized":"2024-01-21T20:18:19.631181+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617602+0000","last_change":"2024-01-21T20:18:19.248541+0000","last_active":"2024-01-21T20:18:19.617602+0000","last_peered":"2024-01-21T20:18:19.617602+0000","last_clean":"2024-01-21T20:18:19.617602+0000","last_became_active":"2024-01-21T20:18:19.247715+0000","last_became_peered":"2024-01-21T20:18:19.247715+0000","last_unstale":"2024-01-21T20:18:19.617602+0000","last_undegraded":"2024-01-21T20:18:19.617602+0000","last_fullsized":"2024-01-21T20:18:19.617602+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636603+0000","last_change":"2024-01-21T20:18:19.634198+0000","last_active":"2024-01-21T20:18:19.636603+0000","last_peered":"2024-01-21T20:18:19.636603+0000","last_clean":"2024-01-21T20:18:19.636603+0000","last_became_active":"2024-01-21T20:18:19.632780+0000","last_became_peered":"2024-01-21T20:18:19.632780+0000","last_unstale":"2024-01-21T20:18:19.636603+0000","last_undegraded":"2024-01-21T20:18:19.636603+0000","last_fullsized":"2024-01-21T20:18:19.636603+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615960+0000","last_change":"2024-01-21T20:18:19.257168+0000","last_active":"2024-01-21T20:18:19.615960+0000","last_peered":"2024-01-21T20:18:19.615960+0000","last_clean":"2024-01-21T20:18:19.615960+0000","last_became_active":"2024-01-21T20:18:19.256823+0000","last_became_peered":"2024-01-21T20:18:19.256823+0000","last_unstale":"2024-01-21T20:18:19.615960+0000","last_undegraded":"2024-01-21T20:18:19.615960+0000","last_fullsized":"2024-01-21T20:18:19.615960+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631307+0000","last_change":"2024-01-21T20:18:19.618672+0000","last_active":"2024-01-21T20:18:19.631307+0000","last_peered":"2024-01-21T20:18:19.631307+0000","last_clean":"2024-01-21T20:18:19.631307+0000","last_became_active":"2024-01-21T20:18:19.618378+0000","last_became_peered":"2024-01-21T20:18:19.618378+0000","last_unstale":"2024-01-21T20:18:19.631307+0000","last_undegraded":"2024-01-21T20:18:19.631307+0000","last_fullsized":"2024-01-21T20:18:19.631307+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616593+0000","last_change":"2024-01-21T20:18:19.253162+0000","last_active":"2024-01-21T20:18:19.616593+0000","last_peered":"2024-01-21T20:18:19.616593+0000","last_clean":"2024-01-21T20:18:19.616593+0000","last_became_active":"2024-01-21T20:18:19.252972+0000","last_became_peered":"2024-01-21T20:18:19.252972+0000","last_unstale":"2024-01-21T20:18:19.616593+0000","last_undegraded":"2024-01-21T20:18:19.616593+0000","last_fullsized":"2024-01-21T20:18:19.616593+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639996+0000","last_change":"2024-01-21T20:18:19.638791+0000","last_active":"2024-01-21T20:18:19.639996+0000","last_peered":"2024-01-21T20:18:19.639996+0000","last_clean":"2024-01-21T20:18:19.639996+0000","last_became_active":"2024-01-21T20:18:19.638553+0000","last_became_peered":"2024-01-21T20:18:19.638553+0000","last_unstale":"2024-01-21T20:18:19.639996+0000","last_undegraded":"2024-01-21T20:18:19.639996+0000","last_fullsized":"2024-01-21T20:18:19.639996+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612153+0000","last_change":"2024-01-21T20:18:19.247911+0000","last_active":"2024-01-21T20:18:19.612153+0000","last_peered":"2024-01-21T20:18:19.612153+0000","last_clean":"2024-01-21T20:18:19.612153+0000","last_became_active":"2024-01-21T20:18:19.247601+0000","last_became_peered":"2024-01-21T20:18:19.247601+0000","last_unstale":"2024-01-21T20:18:19.612153+0000","last_undegraded":"2024-01-21T20:18:19.612153+0000","last_fullsized":"2024-01-21T20:18:19.612153+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632416+0000","last_change":"2024-01-21T20:18:19.630030+0000","last_active":"2024-01-21T20:18:19.632416+0000","last_peered":"2024-01-21T20:18:19.632416+0000","last_clean":"2024-01-21T20:18:19.632416+0000","last_became_active":"2024-01-21T20:18:19.629613+0000","last_became_peered":"2024-01-21T20:18:19.629613+0000","last_unstale":"2024-01-21T20:18:19.632416+0000","last_undegraded":"2024-01-21T20:18:19.632416+0000","last_fullsized":"2024-01-21T20:18:19.632416+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.34","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638448+0000","last_change":"2024-01-21T20:18:19.253196+0000","last_active":"2024-01-21T20:18:19.638448+0000","last_peered":"2024-01-21T20:18:19.638448+0000","last_clean":"2024-01-21T20:18:19.638448+0000","last_became_active":"2024-01-21T20:18:19.252739+0000","last_became_peered":"2024-01-21T20:18:19.252739+0000","last_unstale":"2024-01-21T20:18:19.638448+0000","last_undegraded":"2024-01-21T20:18:19.638448+0000","last_fullsized":"2024-01-21T20:18:19.638448+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633399+0000","last_change":"2024-01-21T20:18:19.624276+0000","last_active":"2024-01-21T20:18:19.633399+0000","last_peered":"2024-01-21T20:18:19.633399+0000","last_clean":"2024-01-21T20:18:19.633399+0000","last_became_active":"2024-01-21T20:18:19.624031+0000","last_became_peered":"2024-01-21T20:18:19.624031+0000","last_unstale":"2024-01-21T20:18:19.633399+0000","last_undegraded":"2024-01-21T20:18:19.633399+0000","last_fullsized":"2024-01-21T20:18:19.633399+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630251+0000","last_change":"2024-01-21T20:18:19.250054+0000","last_active":"2024-01-21T20:18:19.630251+0000","last_peered":"2024-01-21T20:18:19.630251+0000","last_clean":"2024-01-21T20:18:19.630251+0000","last_became_active":"2024-01-21T20:18:19.249787+0000","last_became_peered":"2024-01-21T20:18:19.249787+0000","last_unstale":"2024-01-21T20:18:19.630251+0000","last_undegraded":"2024-01-21T20:18:19.630251+0000","last_fullsized":"2024-01-21T20:18:19.630251+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631088+0000","last_change":"2024-01-21T20:18:19.618695+0000","last_active":"2024-01-21T20:18:19.631088+0000","last_peered":"2024-01-21T20:18:19.631088+0000","last_clean":"2024-01-21T20:18:19.631088+0000","last_became_active":"2024-01-21T20:18:19.618400+0000","last_became_peered":"2024-01-21T20:18:19.618400+0000","last_unstale":"2024-01-21T20:18:19.631088+0000","last_undegraded":"2024-01-21T20:18:19.631088+0000","last_fullsized":"2024-01-21T20:18:19.631088+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615007+0000","last_change":"2024-01-21T20:18:19.247792+0000","last_active":"2024-01-21T20:18:19.615007+0000","last_peered":"2024-01-21T20:18:19.615007+0000","last_clean":"2024-01-21T20:18:19.615007+0000","last_became_active":"2024-01-21T20:18:19.247531+0000","last_became_peered":"2024-01-21T20:18:19.247531+0000","last_unstale":"2024-01-21T20:18:19.615007+0000","last_undegraded":"2024-01-21T20:18:19.615007+0000","last_fullsized":"2024-01-21T20:18:19.615007+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637115+0000","last_change":"2024-01-21T20:18:19.629469+0000","last_active":"2024-01-21T20:18:19.637115+0000","last_peered":"2024-01-21T20:18:19.637115+0000","last_clean":"2024-01-21T20:18:19.637115+0000","last_became_active":"2024-01-21T20:18:19.629268+0000","last_became_peered":"2024-01-21T20:18:19.629268+0000","last_unstale":"2024-01-21T20:18:19.637115+0000","last_undegraded":"2024-01-21T20:18:19.637115+0000","last_fullsized":"2024-01-21T20:18:19.637115+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620229+0000","last_change":"2024-01-21T20:18:19.241690+0000","last_active":"2024-01-21T20:18:19.620229+0000","last_peered":"2024-01-21T20:18:19.620229+0000","last_clean":"2024-01-21T20:18:19.620229+0000","last_became_active":"2024-01-21T20:18:19.241419+0000","last_became_peered":"2024-01-21T20:18:19.241419+0000","last_unstale":"2024-01-21T20:18:19.620229+0000","last_undegraded":"2024-01-21T20:18:19.620229+0000","last_fullsized":"2024-01-21T20:18:19.620229+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640065+0000","last_change":"2024-01-21T20:18:19.636627+0000","last_active":"2024-01-21T20:18:19.640065+0000","last_peered":"2024-01-21T20:18:19.640065+0000","last_clean":"2024-01-21T20:18:19.640065+0000","last_became_active":"2024-01-21T20:18:19.636183+0000","last_became_peered":"2024-01-21T20:18:19.636183+0000","last_unstale":"2024-01-21T20:18:19.640065+0000","last_undegraded":"2024-01-21T20:18:19.640065+0000","last_fullsized":"2024-01-21T20:18:19.640065+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633346+0000","last_change":"2024-01-21T20:18:19.253302+0000","last_active":"2024-01-21T20:18:19.633346+0000","last_peered":"2024-01-21T20:18:19.633346+0000","last_clean":"2024-01-21T20:18:19.633346+0000","last_became_active":"2024-01-21T20:18:19.253025+0000","last_became_peered":"2024-01-21T20:18:19.253025+0000","last_unstale":"2024-01-21T20:18:19.633346+0000","last_undegraded":"2024-01-21T20:18:19.633346+0000","last_fullsized":"2024-01-21T20:18:19.633346+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633252+0000","last_change":"2024-01-21T20:18:19.625575+0000","last_active":"2024-01-21T20:18:19.633252+0000","last_peered":"2024-01-21T20:18:19.633252+0000","last_clean":"2024-01-21T20:18:19.633252+0000","last_became_active":"2024-01-21T20:18:19.625288+0000","last_became_peered":"2024-01-21T20:18:19.625288+0000","last_unstale":"2024-01-21T20:18:19.633252+0000","last_undegraded":"2024-01-21T20:18:19.633252+0000","last_fullsized":"2024-01-21T20:18:19.633252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.613371+0000","last_change":"2024-01-21T20:18:19.251406+0000","last_active":"2024-01-21T20:18:19.613371+0000","last_peered":"2024-01-21T20:18:19.613371+0000","last_clean":"2024-01-21T20:18:19.613371+0000","last_became_active":"2024-01-21T20:18:19.251056+0000","last_became_peered":"2024-01-21T20:18:19.251056+0000","last_unstale":"2024-01-21T20:18:19.613371+0000","last_undegraded":"2024-01-21T20:18:19.613371+0000","last_fullsized":"2024-01-21T20:18:19.613371+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634880+0000","last_change":"2024-01-21T20:18:19.631987+0000","last_active":"2024-01-21T20:18:19.634880+0000","last_peered":"2024-01-21T20:18:19.634880+0000","last_clean":"2024-01-21T20:18:19.634880+0000","last_became_active":"2024-01-21T20:18:19.631698+0000","last_became_peered":"2024-01-21T20:18:19.631698+0000","last_unstale":"2024-01-21T20:18:19.634880+0000","last_undegraded":"2024-01-21T20:18:19.634880+0000","last_fullsized":"2024-01-21T20:18:19.634880+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615158+0000","last_change":"2024-01-21T20:18:19.250470+0000","last_active":"2024-01-21T20:18:19.615158+0000","last_peered":"2024-01-21T20:18:19.615158+0000","last_clean":"2024-01-21T20:18:19.615158+0000","last_became_active":"2024-01-21T20:18:19.250201+0000","last_became_peered":"2024-01-21T20:18:19.250201+0000","last_unstale":"2024-01-21T20:18:19.615158+0000","last_undegraded":"2024-01-21T20:18:19.615158+0000","last_fullsized":"2024-01-21T20:18:19.615158+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635717+0000","last_change":"2024-01-21T20:18:19.629993+0000","last_active":"2024-01-21T20:18:19.635717+0000","last_peered":"2024-01-21T20:18:19.635717+0000","last_clean":"2024-01-21T20:18:19.635717+0000","last_became_active":"2024-01-21T20:18:19.629102+0000","last_became_peered":"2024-01-21T20:18:19.629102+0000","last_unstale":"2024-01-21T20:18:19.635717+0000","last_undegraded":"2024-01-21T20:18:19.635717+0000","last_fullsized":"2024-01-21T20:18:19.635717+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628473+0000","last_change":"2024-01-21T20:18:19.249996+0000","last_active":"2024-01-21T20:18:19.628473+0000","last_peered":"2024-01-21T20:18:19.628473+0000","last_clean":"2024-01-21T20:18:19.628473+0000","last_became_active":"2024-01-21T20:18:19.249562+0000","last_became_peered":"2024-01-21T20:18:19.249562+0000","last_unstale":"2024-01-21T20:18:19.628473+0000","last_undegraded":"2024-01-21T20:18:19.628473+0000","last_fullsized":"2024-01-21T20:18:19.628473+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639440+0000","last_change":"2024-01-21T20:18:19.635623+0000","last_active":"2024-01-21T20:18:19.639440+0000","last_peered":"2024-01-21T20:18:19.639440+0000","last_clean":"2024-01-21T20:18:19.639440+0000","last_became_active":"2024-01-21T20:18:19.635231+0000","last_became_peered":"2024-01-21T20:18:19.635231+0000","last_unstale":"2024-01-21T20:18:19.639440+0000","last_undegraded":"2024-01-21T20:18:19.639440+0000","last_fullsized":"2024-01-21T20:18:19.639440+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611637+0000","last_change":"2024-01-21T20:18:19.252573+0000","last_active":"2024-01-21T20:18:19.611637+0000","last_peered":"2024-01-21T20:18:19.611637+0000","last_clean":"2024-01-21T20:18:19.611637+0000","last_became_active":"2024-01-21T20:18:19.252236+0000","last_became_peered":"2024-01-21T20:18:19.252236+0000","last_unstale":"2024-01-21T20:18:19.611637+0000","last_undegraded":"2024-01-21T20:18:19.611637+0000","last_fullsized":"2024-01-21T20:18:19.611637+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630272+0000","last_change":"2024-01-21T20:18:19.625432+0000","last_active":"2024-01-21T20:18:19.630272+0000","last_peered":"2024-01-21T20:18:19.630272+0000","last_clean":"2024-01-21T20:18:19.630272+0000","last_became_active":"2024-01-21T20:18:19.625175+0000","last_became_peered":"2024-01-21T20:18:19.625175+0000","last_unstale":"2024-01-21T20:18:19.630272+0000","last_undegraded":"2024-01-21T20:18:19.630272+0000","last_fullsized":"2024-01-21T20:18:19.630272+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633958+0000","last_change":"2024-01-21T20:18:19.252602+0000","last_active":"2024-01-21T20:18:19.633958+0000","last_peered":"2024-01-21T20:18:19.633958+0000","last_clean":"2024-01-21T20:18:19.633958+0000","last_became_active":"2024-01-21T20:18:19.251923+0000","last_became_peered":"2024-01-21T20:18:19.251923+0000","last_unstale":"2024-01-21T20:18:19.633958+0000","last_undegraded":"2024-01-21T20:18:19.633958+0000","last_fullsized":"2024-01-21T20:18:19.633958+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632401+0000","last_change":"2024-01-21T20:18:19.629843+0000","last_active":"2024-01-21T20:18:19.632401+0000","last_peered":"2024-01-21T20:18:19.632401+0000","last_clean":"2024-01-21T20:18:19.632401+0000","last_became_active":"2024-01-21T20:18:19.629587+0000","last_became_peered":"2024-01-21T20:18:19.629587+0000","last_unstale":"2024-01-21T20:18:19.632401+0000","last_undegraded":"2024-01-21T20:18:19.632401+0000","last_fullsized":"2024-01-21T20:18:19.632401+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620692+0000","last_change":"2024-01-21T20:18:19.250339+0000","last_active":"2024-01-21T20:18:19.620692+0000","last_peered":"2024-01-21T20:18:19.620692+0000","last_clean":"2024-01-21T20:18:19.620692+0000","last_became_active":"2024-01-21T20:18:19.248715+0000","last_became_peered":"2024-01-21T20:18:19.248715+0000","last_unstale":"2024-01-21T20:18:19.620692+0000","last_undegraded":"2024-01-21T20:18:19.620692+0000","last_fullsized":"2024-01-21T20:18:19.620692+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632281+0000","last_change":"2024-01-21T20:18:19.627848+0000","last_active":"2024-01-21T20:18:19.632281+0000","last_peered":"2024-01-21T20:18:19.632281+0000","last_clean":"2024-01-21T20:18:19.632281+0000","last_became_active":"2024-01-21T20:18:19.627537+0000","last_became_peered":"2024-01-21T20:18:19.627537+0000","last_unstale":"2024-01-21T20:18:19.632281+0000","last_undegraded":"2024-01-21T20:18:19.632281+0000","last_fullsized":"2024-01-21T20:18:19.632281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611320+0000","last_change":"2024-01-21T20:18:19.252159+0000","last_active":"2024-01-21T20:18:19.611320+0000","last_peered":"2024-01-21T20:18:19.611320+0000","last_clean":"2024-01-21T20:18:19.611320+0000","last_became_active":"2024-01-21T20:18:19.251826+0000","last_became_peered":"2024-01-21T20:18:19.251826+0000","last_unstale":"2024-01-21T20:18:19.611320+0000","last_undegraded":"2024-01-21T20:18:19.611320+0000","last_fullsized":"2024-01-21T20:18:19.611320+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630317+0000","last_change":"2024-01-21T20:18:19.625557+0000","last_active":"2024-01-21T20:18:19.630317+0000","last_peered":"2024-01-21T20:18:19.630317+0000","last_clean":"2024-01-21T20:18:19.630317+0000","last_became_active":"2024-01-21T20:18:19.624980+0000","last_became_peered":"2024-01-21T20:18:19.624980+0000","last_unstale":"2024-01-21T20:18:19.630317+0000","last_undegraded":"2024-01-21T20:18:19.630317+0000","last_fullsized":"2024-01-21T20:18:19.630317+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617353+0000","last_change":"2024-01-21T20:18:19.249995+0000","last_active":"2024-01-21T20:18:19.617353+0000","last_peered":"2024-01-21T20:18:19.617353+0000","last_clean":"2024-01-21T20:18:19.617353+0000","last_became_active":"2024-01-21T20:18:19.249711+0000","last_became_peered":"2024-01-21T20:18:19.249711+0000","last_unstale":"2024-01-21T20:18:19.617353+0000","last_undegraded":"2024-01-21T20:18:19.617353+0000","last_fullsized":"2024-01-21T20:18:19.617353+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636583+0000","last_change":"2024-01-21T20:18:19.633636+0000","last_active":"2024-01-21T20:18:19.636583+0000","last_peered":"2024-01-21T20:18:19.636583+0000","last_clean":"2024-01-21T20:18:19.636583+0000","last_became_active":"2024-01-21T20:18:19.632486+0000","last_became_peered":"2024-01-21T20:18:19.632486+0000","last_unstale":"2024-01-21T20:18:19.636583+0000","last_undegraded":"2024-01-21T20:18:19.636583+0000","last_fullsized":"2024-01-21T20:18:19.636583+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.613474+0000","last_change":"2024-01-21T20:18:19.248322+0000","last_active":"2024-01-21T20:18:19.613474+0000","last_peered":"2024-01-21T20:18:19.613474+0000","last_clean":"2024-01-21T20:18:19.613474+0000","last_became_active":"2024-01-21T20:18:19.247519+0000","last_became_peered":"2024-01-21T20:18:19.247519+0000","last_unstale":"2024-01-21T20:18:19.613474+0000","last_undegraded":"2024-01-21T20:18:19.613474+0000","last_fullsized":"2024-01-21T20:18:19.613474+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634867+0000","last_change":"2024-01-21T20:18:19.631894+0000","last_active":"2024-01-21T20:18:19.634867+0000","last_peered":"2024-01-21T20:18:19.634867+0000","last_clean":"2024-01-21T20:18:19.634867+0000","last_became_active":"2024-01-21T20:18:19.631552+0000","last_became_peered":"2024-01-21T20:18:19.631552+0000","last_unstale":"2024-01-21T20:18:19.634867+0000","last_undegraded":"2024-01-21T20:18:19.634867+0000","last_fullsized":"2024-01-21T20:18:19.634867+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616690+0000","last_change":"2024-01-21T20:18:19.252913+0000","last_active":"2024-01-21T20:18:19.616690+0000","last_peered":"2024-01-21T20:18:19.616690+0000","last_clean":"2024-01-21T20:18:19.616690+0000","last_became_active":"2024-01-21T20:18:19.252409+0000","last_became_peered":"2024-01-21T20:18:19.252409+0000","last_unstale":"2024-01-21T20:18:19.616690+0000","last_undegraded":"2024-01-21T20:18:19.616690+0000","last_fullsized":"2024-01-21T20:18:19.616690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640017+0000","last_change":"2024-01-21T20:18:19.638989+0000","last_active":"2024-01-21T20:18:19.640017+0000","last_peered":"2024-01-21T20:18:19.640017+0000","last_clean":"2024-01-21T20:18:19.640017+0000","last_became_active":"2024-01-21T20:18:19.638696+0000","last_became_peered":"2024-01-21T20:18:19.638696+0000","last_unstale":"2024-01-21T20:18:19.640017+0000","last_undegraded":"2024-01-21T20:18:19.640017+0000","last_fullsized":"2024-01-21T20:18:19.640017+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626240+0000","last_change":"2024-01-21T20:18:19.246150+0000","last_active":"2024-01-21T20:18:19.626240+0000","last_peered":"2024-01-21T20:18:19.626240+0000","last_clean":"2024-01-21T20:18:19.626240+0000","last_became_active":"2024-01-21T20:18:19.245882+0000","last_became_peered":"2024-01-21T20:18:19.245882+0000","last_unstale":"2024-01-21T20:18:19.626240+0000","last_undegraded":"2024-01-21T20:18:19.626240+0000","last_fullsized":"2024-01-21T20:18:19.626240+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630351+0000","last_change":"2024-01-21T20:18:19.625254+0000","last_active":"2024-01-21T20:18:19.630351+0000","last_peered":"2024-01-21T20:18:19.630351+0000","last_clean":"2024-01-21T20:18:19.630351+0000","last_became_active":"2024-01-21T20:18:19.624958+0000","last_became_peered":"2024-01-21T20:18:19.624958+0000","last_unstale":"2024-01-21T20:18:19.630351+0000","last_undegraded":"2024-01-21T20:18:19.630351+0000","last_fullsized":"2024-01-21T20:18:19.630351+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.614317+0000","last_change":"2024-01-21T20:18:19.250299+0000","last_active":"2024-01-21T20:18:19.614317+0000","last_peered":"2024-01-21T20:18:19.614317+0000","last_clean":"2024-01-21T20:18:19.614317+0000","last_became_active":"2024-01-21T20:18:19.248897+0000","last_became_peered":"2024-01-21T20:18:19.248897+0000","last_unstale":"2024-01-21T20:18:19.614317+0000","last_undegraded":"2024-01-21T20:18:19.614317+0000","last_fullsized":"2024-01-21T20:18:19.614317+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630293+0000","last_change":"2024-01-21T20:18:19.625613+0000","last_active":"2024-01-21T20:18:19.630293+0000","last_peered":"2024-01-21T20:18:19.630293+0000","last_clean":"2024-01-21T20:18:19.630293+0000","last_became_active":"2024-01-21T20:18:19.625140+0000","last_became_peered":"2024-01-21T20:18:19.625140+0000","last_unstale":"2024-01-21T20:18:19.630293+0000","last_undegraded":"2024-01-21T20:18:19.630293+0000","last_fullsized":"2024-01-21T20:18:19.630293+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611673+0000","last_change":"2024-01-21T20:18:19.252656+0000","last_active":"2024-01-21T20:18:19.611673+0000","last_peered":"2024-01-21T20:18:19.611673+0000","last_clean":"2024-01-21T20:18:19.611673+0000","last_became_active":"2024-01-21T20:18:19.252316+0000","last_became_peered":"2024-01-21T20:18:19.252316+0000","last_unstale":"2024-01-21T20:18:19.611673+0000","last_undegraded":"2024-01-21T20:18:19.611673+0000","last_fullsized":"2024-01-21T20:18:19.611673+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629890+0000","last_change":"2024-01-21T20:18:19.624286+0000","last_active":"2024-01-21T20:18:19.629890+0000","last_peered":"2024-01-21T20:18:19.629890+0000","last_clean":"2024-01-21T20:18:19.629890+0000","last_became_active":"2024-01-21T20:18:19.622414+0000","last_became_peered":"2024-01-21T20:18:19.622414+0000","last_unstale":"2024-01-21T20:18:19.629890+0000","last_undegraded":"2024-01-21T20:18:19.629890+0000","last_fullsized":"2024-01-21T20:18:19.629890+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612096+0000","last_change":"2024-01-21T20:18:19.241212+0000","last_active":"2024-01-21T20:18:19.612096+0000","last_peered":"2024-01-21T20:18:19.612096+0000","last_clean":"2024-01-21T20:18:19.612096+0000","last_became_active":"2024-01-21T20:18:19.240868+0000","last_became_peered":"2024-01-21T20:18:19.240868+0000","last_unstale":"2024-01-21T20:18:19.612096+0000","last_undegraded":"2024-01-21T20:18:19.612096+0000","last_fullsized":"2024-01-21T20:18:19.612096+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.627082+0000","last_change":"2024-01-21T20:18:19.623400+0000","last_active":"2024-01-21T20:18:19.627082+0000","last_peered":"2024-01-21T20:18:19.627082+0000","last_clean":"2024-01-21T20:18:19.627082+0000","last_became_active":"2024-01-21T20:18:19.623135+0000","last_became_peered":"2024-01-21T20:18:19.623135+0000","last_unstale":"2024-01-21T20:18:19.627082+0000","last_undegraded":"2024-01-21T20:18:19.627082+0000","last_fullsized":"2024-01-21T20:18:19.627082+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616400+0000","last_change":"2024-01-21T20:18:19.245992+0000","last_active":"2024-01-21T20:18:19.616400+0000","last_peered":"2024-01-21T20:18:19.616400+0000","last_clean":"2024-01-21T20:18:19.616400+0000","last_became_active":"2024-01-21T20:18:19.245677+0000","last_became_peered":"2024-01-21T20:18:19.245677+0000","last_unstale":"2024-01-21T20:18:19.616400+0000","last_undegraded":"2024-01-21T20:18:19.616400+0000","last_fullsized":"2024-01-21T20:18:19.616400+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636962+0000","last_change":"2024-01-21T20:18:19.630059+0000","last_active":"2024-01-21T20:18:19.636962+0000","last_peered":"2024-01-21T20:18:19.636962+0000","last_clean":"2024-01-21T20:18:19.636962+0000","last_became_active":"2024-01-21T20:18:19.629774+0000","last_became_peered":"2024-01-21T20:18:19.629774+0000","last_unstale":"2024-01-21T20:18:19.636962+0000","last_undegraded":"2024-01-21T20:18:19.636962+0000","last_fullsized":"2024-01-21T20:18:19.636962+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619426+0000","last_change":"2024-01-21T20:18:19.248915+0000","last_active":"2024-01-21T20:18:19.619426+0000","last_peered":"2024-01-21T20:18:19.619426+0000","last_clean":"2024-01-21T20:18:19.619426+0000","last_became_active":"2024-01-21T20:18:19.248639+0000","last_became_peered":"2024-01-21T20:18:19.248639+0000","last_unstale":"2024-01-21T20:18:19.619426+0000","last_undegraded":"2024-01-21T20:18:19.619426+0000","last_fullsized":"2024-01-21T20:18:19.619426+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639452+0000","last_change":"2024-01-21T20:18:19.638127+0000","last_active":"2024-01-21T20:18:19.639452+0000","last_peered":"2024-01-21T20:18:19.639452+0000","last_clean":"2024-01-21T20:18:19.639452+0000","last_became_active":"2024-01-21T20:18:19.636481+0000","last_became_peered":"2024-01-21T20:18:19.636481+0000","last_unstale":"2024-01-21T20:18:19.639452+0000","last_undegraded":"2024-01-21T20:18:19.639452+0000","last_fullsized":"2024-01-21T20:18:19.639452+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631481+0000","last_change":"2024-01-21T20:18:19.248850+0000","last_active":"2024-01-21T20:18:19.631481+0000","last_peered":"2024-01-21T20:18:19.631481+0000","last_clean":"2024-01-21T20:18:19.631481+0000","last_became_active":"2024-01-21T20:18:19.248511+0000","last_became_peered":"2024-01-21T20:18:19.248511+0000","last_unstale":"2024-01-21T20:18:19.631481+0000","last_undegraded":"2024-01-21T20:18:19.631481+0000","last_fullsized":"2024-01-21T20:18:19.631481+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633187+0000","last_change":"2024-01-21T20:18:19.631628+0000","last_active":"2024-01-21T20:18:19.633187+0000","last_peered":"2024-01-21T20:18:19.633187+0000","last_clean":"2024-01-21T20:18:19.633187+0000","last_became_active":"2024-01-21T20:18:19.631336+0000","last_became_peered":"2024-01-21T20:18:19.631336+0000","last_unstale":"2024-01-21T20:18:19.633187+0000","last_undegraded":"2024-01-21T20:18:19.633187+0000","last_fullsized":"2024-01-21T20:18:19.633187+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638383+0000","last_change":"2024-01-21T20:18:19.241693+0000","last_active":"2024-01-21T20:18:19.638383+0000","last_peered":"2024-01-21T20:18:19.638383+0000","last_clean":"2024-01-21T20:18:19.638383+0000","last_became_active":"2024-01-21T20:18:19.241428+0000","last_became_peered":"2024-01-21T20:18:19.241428+0000","last_unstale":"2024-01-21T20:18:19.638383+0000","last_undegraded":"2024-01-21T20:18:19.638383+0000","last_fullsized":"2024-01-21T20:18:19.638383+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630471+0000","last_change":"2024-01-21T20:18:19.626443+0000","last_active":"2024-01-21T20:18:19.630471+0000","last_peered":"2024-01-21T20:18:19.630471+0000","last_clean":"2024-01-21T20:18:19.630471+0000","last_became_active":"2024-01-21T20:18:19.626055+0000","last_became_peered":"2024-01-21T20:18:19.626055+0000","last_unstale":"2024-01-21T20:18:19.630471+0000","last_undegraded":"2024-01-21T20:18:19.630471+0000","last_fullsized":"2024-01-21T20:18:19.630471+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628272+0000","last_change":"2024-01-21T20:18:19.248631+0000","last_active":"2024-01-21T20:18:19.628272+0000","last_peered":"2024-01-21T20:18:19.628272+0000","last_clean":"2024-01-21T20:18:19.628272+0000","last_became_active":"2024-01-21T20:18:19.248311+0000","last_became_peered":"2024-01-21T20:18:19.248311+0000","last_unstale":"2024-01-21T20:18:19.628272+0000","last_undegraded":"2024-01-21T20:18:19.628272+0000","last_fullsized":"2024-01-21T20:18:19.628272+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632448+0000","last_change":"2024-01-21T20:18:19.630352+0000","last_active":"2024-01-21T20:18:19.632448+0000","last_peered":"2024-01-21T20:18:19.632448+0000","last_clean":"2024-01-21T20:18:19.632448+0000","last_became_active":"2024-01-21T20:18:19.629197+0000","last_became_peered":"2024-01-21T20:18:19.629197+0000","last_unstale":"2024-01-21T20:18:19.632448+0000","last_undegraded":"2024-01-21T20:18:19.632448+0000","last_fullsized":"2024-01-21T20:18:19.632448+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.625415+0000","last_change":"2024-01-21T20:18:19.248569+0000","last_active":"2024-01-21T20:18:19.625415+0000","last_peered":"2024-01-21T20:18:19.625415+0000","last_clean":"2024-01-21T20:18:19.625415+0000","last_became_active":"2024-01-21T20:18:19.248340+0000","last_became_peered":"2024-01-21T20:18:19.248340+0000","last_unstale":"2024-01-21T20:18:19.625415+0000","last_undegraded":"2024-01-21T20:18:19.625415+0000","last_fullsized":"2024-01-21T20:18:19.625415+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.638326+0000","last_change":"2024-01-21T20:18:19.630102+0000","last_active":"2024-01-21T20:18:19.638326+0000","last_peered":"2024-01-21T20:18:19.638326+0000","last_clean":"2024-01-21T20:18:19.638326+0000","last_became_active":"2024-01-21T20:18:19.629856+0000","last_became_peered":"2024-01-21T20:18:19.629856+0000","last_unstale":"2024-01-21T20:18:19.638326+0000","last_undegraded":"2024-01-21T20:18:19.638326+0000","last_fullsized":"2024-01-21T20:18:19.638326+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611780+0000","last_change":"2024-01-21T20:18:19.251625+0000","last_active":"2024-01-21T20:18:19.611780+0000","last_peered":"2024-01-21T20:18:19.611780+0000","last_clean":"2024-01-21T20:18:19.611780+0000","last_became_active":"2024-01-21T20:18:19.247715+0000","last_became_peered":"2024-01-21T20:18:19.247715+0000","last_unstale":"2024-01-21T20:18:19.611780+0000","last_undegraded":"2024-01-21T20:18:19.611780+0000","last_fullsized":"2024-01-21T20:18:19.611780+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632225+0000","last_change":"2024-01-21T20:18:19.625374+0000","last_active":"2024-01-21T20:18:19.632225+0000","last_peered":"2024-01-21T20:18:19.632225+0000","last_clean":"2024-01-21T20:18:19.632225+0000","last_became_active":"2024-01-21T20:18:19.625072+0000","last_became_peered":"2024-01-21T20:18:19.625072+0000","last_unstale":"2024-01-21T20:18:19.632225+0000","last_undegraded":"2024-01-21T20:18:19.632225+0000","last_fullsized":"2024-01-21T20:18:19.632225+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615344+0000","last_change":"2024-01-21T20:18:19.257029+0000","last_active":"2024-01-21T20:18:19.615344+0000","last_peered":"2024-01-21T20:18:19.615344+0000","last_clean":"2024-01-21T20:18:19.615344+0000","last_became_active":"2024-01-21T20:18:19.256743+0000","last_became_peered":"2024-01-21T20:18:19.256743+0000","last_unstale":"2024-01-21T20:18:19.615344+0000","last_undegraded":"2024-01-21T20:18:19.615344+0000","last_fullsized":"2024-01-21T20:18:19.615344+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637154+0000","last_change":"2024-01-21T20:18:19.636233+0000","last_active":"2024-01-21T20:18:19.637154+0000","last_peered":"2024-01-21T20:18:19.637154+0000","last_clean":"2024-01-21T20:18:19.637154+0000","last_became_active":"2024-01-21T20:18:19.635801+0000","last_became_peered":"2024-01-21T20:18:19.635801+0000","last_unstale":"2024-01-21T20:18:19.637154+0000","last_undegraded":"2024-01-21T20:18:19.637154+0000","last_fullsized":"2024-01-21T20:18:19.637154+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612636+0000","last_change":"2024-01-21T20:18:19.248015+0000","last_active":"2024-01-21T20:18:19.612636+0000","last_peered":"2024-01-21T20:18:19.612636+0000","last_clean":"2024-01-21T20:18:19.612636+0000","last_became_active":"2024-01-21T20:18:19.247455+0000","last_became_peered":"2024-01-21T20:18:19.247455+0000","last_unstale":"2024-01-21T20:18:19.612636+0000","last_undegraded":"2024-01-21T20:18:19.612636+0000","last_fullsized":"2024-01-21T20:18:19.612636+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640047+0000","last_change":"2024-01-21T20:18:19.636468+0000","last_active":"2024-01-21T20:18:19.640047+0000","last_peered":"2024-01-21T20:18:19.640047+0000","last_clean":"2024-01-21T20:18:19.640047+0000","last_became_active":"2024-01-21T20:18:19.635870+0000","last_became_peered":"2024-01-21T20:18:19.635870+0000","last_unstale":"2024-01-21T20:18:19.640047+0000","last_undegraded":"2024-01-21T20:18:19.640047+0000","last_fullsized":"2024-01-21T20:18:19.640047+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615473+0000","last_change":"2024-01-21T20:18:19.252266+0000","last_active":"2024-01-21T20:18:19.615473+0000","last_peered":"2024-01-21T20:18:19.615473+0000","last_clean":"2024-01-21T20:18:19.615473+0000","last_became_active":"2024-01-21T20:18:19.251989+0000","last_became_peered":"2024-01-21T20:18:19.251989+0000","last_unstale":"2024-01-21T20:18:19.615473+0000","last_undegraded":"2024-01-21T20:18:19.615473+0000","last_fullsized":"2024-01-21T20:18:19.615473+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630923+0000","last_change":"2024-01-21T20:18:19.626357+0000","last_active":"2024-01-21T20:18:19.630923+0000","last_peered":"2024-01-21T20:18:19.630923+0000","last_clean":"2024-01-21T20:18:19.630923+0000","last_became_active":"2024-01-21T20:18:19.626054+0000","last_became_peered":"2024-01-21T20:18:19.626054+0000","last_unstale":"2024-01-21T20:18:19.630923+0000","last_undegraded":"2024-01-21T20:18:19.630923+0000","last_fullsized":"2024-01-21T20:18:19.630923+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635751+0000","last_change":"2024-01-21T20:18:19.254683+0000","last_active":"2024-01-21T20:18:19.635751+0000","last_peered":"2024-01-21T20:18:19.635751+0000","last_clean":"2024-01-21T20:18:19.635751+0000","last_became_active":"2024-01-21T20:18:19.254388+0000","last_became_peered":"2024-01-21T20:18:19.254388+0000","last_unstale":"2024-01-21T20:18:19.635751+0000","last_undegraded":"2024-01-21T20:18:19.635751+0000","last_fullsized":"2024-01-21T20:18:19.635751+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632203+0000","last_change":"2024-01-21T20:18:19.627089+0000","last_active":"2024-01-21T20:18:19.632203+0000","last_peered":"2024-01-21T20:18:19.632203+0000","last_clean":"2024-01-21T20:18:19.632203+0000","last_became_active":"2024-01-21T20:18:19.626789+0000","last_became_peered":"2024-01-21T20:18:19.626789+0000","last_unstale":"2024-01-21T20:18:19.632203+0000","last_undegraded":"2024-01-21T20:18:19.632203+0000","last_fullsized":"2024-01-21T20:18:19.632203+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634179+0000","last_change":"2024-01-21T20:18:19.253774+0000","last_active":"2024-01-21T20:18:19.634179+0000","last_peered":"2024-01-21T20:18:19.634179+0000","last_clean":"2024-01-21T20:18:19.634179+0000","last_became_active":"2024-01-21T20:18:19.253405+0000","last_became_peered":"2024-01-21T20:18:19.253405+0000","last_unstale":"2024-01-21T20:18:19.634179+0000","last_undegraded":"2024-01-21T20:18:19.634179+0000","last_fullsized":"2024-01-21T20:18:19.634179+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633268+0000","last_change":"2024-01-21T20:18:19.628653+0000","last_active":"2024-01-21T20:18:19.633268+0000","last_peered":"2024-01-21T20:18:19.633268+0000","last_clean":"2024-01-21T20:18:19.633268+0000","last_became_active":"2024-01-21T20:18:19.628434+0000","last_became_peered":"2024-01-21T20:18:19.628434+0000","last_unstale":"2024-01-21T20:18:19.633268+0000","last_undegraded":"2024-01-21T20:18:19.633268+0000","last_fullsized":"2024-01-21T20:18:19.633268+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616876+0000","last_change":"2024-01-21T20:18:19.253953+0000","last_active":"2024-01-21T20:18:19.616876+0000","last_peered":"2024-01-21T20:18:19.616876+0000","last_clean":"2024-01-21T20:18:19.616876+0000","last_became_active":"2024-01-21T20:18:19.253642+0000","last_became_peered":"2024-01-21T20:18:19.253642+0000","last_unstale":"2024-01-21T20:18:19.616876+0000","last_undegraded":"2024-01-21T20:18:19.616876+0000","last_fullsized":"2024-01-21T20:18:19.616876+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630550+0000","last_change":"2024-01-21T20:18:19.629404+0000","last_active":"2024-01-21T20:18:19.630550+0000","last_peered":"2024-01-21T20:18:19.630550+0000","last_clean":"2024-01-21T20:18:19.630550+0000","last_became_active":"2024-01-21T20:18:19.629096+0000","last_became_peered":"2024-01-21T20:18:19.629096+0000","last_unstale":"2024-01-21T20:18:19.630550+0000","last_undegraded":"2024-01-21T20:18:19.630550+0000","last_fullsized":"2024-01-21T20:18:19.630550+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616401+0000","last_change":"2024-01-21T20:18:19.255638+0000","last_active":"2024-01-21T20:18:19.616401+0000","last_peered":"2024-01-21T20:18:19.616401+0000","last_clean":"2024-01-21T20:18:19.616401+0000","last_became_active":"2024-01-21T20:18:19.255398+0000","last_became_peered":"2024-01-21T20:18:19.255398+0000","last_unstale":"2024-01-21T20:18:19.616401+0000","last_undegraded":"2024-01-21T20:18:19.616401+0000","last_fullsized":"2024-01-21T20:18:19.616401+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633416+0000","last_change":"2024-01-21T20:18:19.631074+0000","last_active":"2024-01-21T20:18:19.633416+0000","last_peered":"2024-01-21T20:18:19.633416+0000","last_clean":"2024-01-21T20:18:19.633416+0000","last_became_active":"2024-01-21T20:18:19.627990+0000","last_became_peered":"2024-01-21T20:18:19.627990+0000","last_unstale":"2024-01-21T20:18:19.633416+0000","last_undegraded":"2024-01-21T20:18:19.633416+0000","last_fullsized":"2024-01-21T20:18:19.633416+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.628983+0000","last_change":"2024-01-21T20:18:19.253835+0000","last_active":"2024-01-21T20:18:19.628983+0000","last_peered":"2024-01-21T20:18:19.628983+0000","last_clean":"2024-01-21T20:18:19.628983+0000","last_became_active":"2024-01-21T20:18:19.253593+0000","last_became_peered":"2024-01-21T20:18:19.253593+0000","last_unstale":"2024-01-21T20:18:19.628983+0000","last_undegraded":"2024-01-21T20:18:19.628983+0000","last_fullsized":"2024-01-21T20:18:19.628983+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636087+0000","last_change":"2024-01-21T20:18:19.631175+0000","last_active":"2024-01-21T20:18:19.636087+0000","last_peered":"2024-01-21T20:18:19.636087+0000","last_clean":"2024-01-21T20:18:19.636087+0000","last_became_active":"2024-01-21T20:18:19.630658+0000","last_became_peered":"2024-01-21T20:18:19.630658+0000","last_unstale":"2024-01-21T20:18:19.636087+0000","last_undegraded":"2024-01-21T20:18:19.636087+0000","last_fullsized":"2024-01-21T20:18:19.636087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616059+0000","last_change":"2024-01-21T20:18:19.249647+0000","last_active":"2024-01-21T20:18:19.616059+0000","last_peered":"2024-01-21T20:18:19.616059+0000","last_clean":"2024-01-21T20:18:19.616059+0000","last_became_active":"2024-01-21T20:18:19.249338+0000","last_became_peered":"2024-01-21T20:18:19.249338+0000","last_unstale":"2024-01-21T20:18:19.616059+0000","last_undegraded":"2024-01-21T20:18:19.616059+0000","last_fullsized":"2024-01-21T20:18:19.616059+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.637136+0000","last_change":"2024-01-21T20:18:19.632053+0000","last_active":"2024-01-21T20:18:19.637136+0000","last_peered":"2024-01-21T20:18:19.637136+0000","last_clean":"2024-01-21T20:18:19.637136+0000","last_became_active":"2024-01-21T20:18:19.631799+0000","last_became_peered":"2024-01-21T20:18:19.631799+0000","last_unstale":"2024-01-21T20:18:19.637136+0000","last_undegraded":"2024-01-21T20:18:19.637136+0000","last_fullsized":"2024-01-21T20:18:19.637136+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616792+0000","last_change":"2024-01-21T20:18:19.250267+0000","last_active":"2024-01-21T20:18:19.616792+0000","last_peered":"2024-01-21T20:18:19.616792+0000","last_clean":"2024-01-21T20:18:19.616792+0000","last_became_active":"2024-01-21T20:18:19.250016+0000","last_became_peered":"2024-01-21T20:18:19.250016+0000","last_unstale":"2024-01-21T20:18:19.616792+0000","last_undegraded":"2024-01-21T20:18:19.616792+0000","last_fullsized":"2024-01-21T20:18:19.616792+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622039+0000","last_change":"2024-01-21T20:18:19.620660+0000","last_active":"2024-01-21T20:18:19.622039+0000","last_peered":"2024-01-21T20:18:19.622039+0000","last_clean":"2024-01-21T20:18:19.622039+0000","last_became_active":"2024-01-21T20:18:19.620343+0000","last_became_peered":"2024-01-21T20:18:19.620343+0000","last_unstale":"2024-01-21T20:18:19.622039+0000","last_undegraded":"2024-01-21T20:18:19.622039+0000","last_fullsized":"2024-01-21T20:18:19.622039+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617703+0000","last_change":"2024-01-21T20:18:19.248692+0000","last_active":"2024-01-21T20:18:19.617703+0000","last_peered":"2024-01-21T20:18:19.617703+0000","last_clean":"2024-01-21T20:18:19.617703+0000","last_became_active":"2024-01-21T20:18:19.247980+0000","last_became_peered":"2024-01-21T20:18:19.247980+0000","last_unstale":"2024-01-21T20:18:19.617703+0000","last_undegraded":"2024-01-21T20:18:19.617703+0000","last_fullsized":"2024-01-21T20:18:19.617703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640447+0000","last_change":"2024-01-21T20:18:19.639139+0000","last_active":"2024-01-21T20:18:19.640447+0000","last_peered":"2024-01-21T20:18:19.640447+0000","last_clean":"2024-01-21T20:18:19.640447+0000","last_became_active":"2024-01-21T20:18:19.638685+0000","last_became_peered":"2024-01-21T20:18:19.638685+0000","last_unstale":"2024-01-21T20:18:19.640447+0000","last_undegraded":"2024-01-21T20:18:19.640447+0000","last_fullsized":"2024-01-21T20:18:19.640447+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.632590+0000","last_change":"2024-01-21T20:18:19.245530+0000","last_active":"2024-01-21T20:18:19.632590+0000","last_peered":"2024-01-21T20:18:19.632590+0000","last_clean":"2024-01-21T20:18:19.632590+0000","last_became_active":"2024-01-21T20:18:19.244977+0000","last_became_peered":"2024-01-21T20:18:19.244977+0000","last_unstale":"2024-01-21T20:18:19.632590+0000","last_undegraded":"2024-01-21T20:18:19.632590+0000","last_fullsized":"2024-01-21T20:18:19.632590+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639368+0000","last_change":"2024-01-21T20:18:19.636375+0000","last_active":"2024-01-21T20:18:19.639368+0000","last_peered":"2024-01-21T20:18:19.639368+0000","last_clean":"2024-01-21T20:18:19.639368+0000","last_became_active":"2024-01-21T20:18:19.636078+0000","last_became_peered":"2024-01-21T20:18:19.636078+0000","last_unstale":"2024-01-21T20:18:19.639368+0000","last_undegraded":"2024-01-21T20:18:19.639368+0000","last_fullsized":"2024-01-21T20:18:19.639368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615273+0000","last_change":"2024-01-21T20:18:19.254766+0000","last_active":"2024-01-21T20:18:19.615273+0000","last_peered":"2024-01-21T20:18:19.615273+0000","last_clean":"2024-01-21T20:18:19.615273+0000","last_became_active":"2024-01-21T20:18:19.254512+0000","last_became_peered":"2024-01-21T20:18:19.254512+0000","last_unstale":"2024-01-21T20:18:19.615273+0000","last_undegraded":"2024-01-21T20:18:19.615273+0000","last_fullsized":"2024-01-21T20:18:19.615273+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.633127+0000","last_change":"2024-01-21T20:18:19.631190+0000","last_active":"2024-01-21T20:18:19.633127+0000","last_peered":"2024-01-21T20:18:19.633127+0000","last_clean":"2024-01-21T20:18:19.633127+0000","last_became_active":"2024-01-21T20:18:19.630903+0000","last_became_peered":"2024-01-21T20:18:19.630903+0000","last_unstale":"2024-01-21T20:18:19.633127+0000","last_undegraded":"2024-01-21T20:18:19.633127+0000","last_fullsized":"2024-01-21T20:18:19.633127+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616121+0000","last_change":"2024-01-21T20:18:19.252787+0000","last_active":"2024-01-21T20:18:19.616121+0000","last_peered":"2024-01-21T20:18:19.616121+0000","last_clean":"2024-01-21T20:18:19.616121+0000","last_became_active":"2024-01-21T20:18:19.252519+0000","last_became_peered":"2024-01-21T20:18:19.252519+0000","last_unstale":"2024-01-21T20:18:19.616121+0000","last_undegraded":"2024-01-21T20:18:19.616121+0000","last_fullsized":"2024-01-21T20:18:19.616121+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622840+0000","last_change":"2024-01-21T20:18:19.620400+0000","last_active":"2024-01-21T20:18:19.622840+0000","last_peered":"2024-01-21T20:18:19.622840+0000","last_clean":"2024-01-21T20:18:19.622840+0000","last_became_active":"2024-01-21T20:18:19.620146+0000","last_became_peered":"2024-01-21T20:18:19.620146+0000","last_unstale":"2024-01-21T20:18:19.622840+0000","last_undegraded":"2024-01-21T20:18:19.622840+0000","last_fullsized":"2024-01-21T20:18:19.622840+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615668+0000","last_change":"2024-01-21T20:18:19.247323+0000","last_active":"2024-01-21T20:18:19.615668+0000","last_peered":"2024-01-21T20:18:19.615668+0000","last_clean":"2024-01-21T20:18:19.615668+0000","last_became_active":"2024-01-21T20:18:19.247056+0000","last_became_peered":"2024-01-21T20:18:19.247056+0000","last_unstale":"2024-01-21T20:18:19.615668+0000","last_undegraded":"2024-01-21T20:18:19.615668+0000","last_fullsized":"2024-01-21T20:18:19.615668+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636564+0000","last_change":"2024-01-21T20:18:19.633402+0000","last_active":"2024-01-21T20:18:19.636564+0000","last_peered":"2024-01-21T20:18:19.636564+0000","last_clean":"2024-01-21T20:18:19.636564+0000","last_became_active":"2024-01-21T20:18:19.632524+0000","last_became_peered":"2024-01-21T20:18:19.632524+0000","last_unstale":"2024-01-21T20:18:19.636564+0000","last_undegraded":"2024-01-21T20:18:19.636564+0000","last_fullsized":"2024-01-21T20:18:19.636564+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.611888+0000","last_change":"2024-01-21T20:18:19.243896+0000","last_active":"2024-01-21T20:18:19.611888+0000","last_peered":"2024-01-21T20:18:19.611888+0000","last_clean":"2024-01-21T20:18:19.611888+0000","last_became_active":"2024-01-21T20:18:19.243626+0000","last_became_peered":"2024-01-21T20:18:19.243626+0000","last_unstale":"2024-01-21T20:18:19.611888+0000","last_undegraded":"2024-01-21T20:18:19.611888+0000","last_fullsized":"2024-01-21T20:18:19.611888+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.636063+0000","last_change":"2024-01-21T20:18:19.631004+0000","last_active":"2024-01-21T20:18:19.636063+0000","last_peered":"2024-01-21T20:18:19.636063+0000","last_clean":"2024-01-21T20:18:19.636063+0000","last_became_active":"2024-01-21T20:18:19.630570+0000","last_became_peered":"2024-01-21T20:18:19.630570+0000","last_unstale":"2024-01-21T20:18:19.636063+0000","last_undegraded":"2024-01-21T20:18:19.636063+0000","last_fullsized":"2024-01-21T20:18:19.636063+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612487+0000","last_change":"2024-01-21T20:18:19.240373+0000","last_active":"2024-01-21T20:18:19.612487+0000","last_peered":"2024-01-21T20:18:19.612487+0000","last_clean":"2024-01-21T20:18:19.612487+0000","last_became_active":"2024-01-21T20:18:19.239862+0000","last_became_peered":"2024-01-21T20:18:19.239862+0000","last_unstale":"2024-01-21T20:18:19.612487+0000","last_undegraded":"2024-01-21T20:18:19.612487+0000","last_fullsized":"2024-01-21T20:18:19.612487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634344+0000","last_change":"2024-01-21T20:18:19.633256+0000","last_active":"2024-01-21T20:18:19.634344+0000","last_peered":"2024-01-21T20:18:19.634344+0000","last_clean":"2024-01-21T20:18:19.634344+0000","last_became_active":"2024-01-21T20:18:19.632909+0000","last_became_peered":"2024-01-21T20:18:19.632909+0000","last_unstale":"2024-01-21T20:18:19.634344+0000","last_undegraded":"2024-01-21T20:18:19.634344+0000","last_fullsized":"2024-01-21T20:18:19.634344+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616432+0000","last_change":"2024-01-21T20:18:19.246487+0000","last_active":"2024-01-21T20:18:19.616432+0000","last_peered":"2024-01-21T20:18:19.616432+0000","last_clean":"2024-01-21T20:18:19.616432+0000","last_became_active":"2024-01-21T20:18:19.246237+0000","last_became_peered":"2024-01-21T20:18:19.246237+0000","last_unstale":"2024-01-21T20:18:19.616432+0000","last_undegraded":"2024-01-21T20:18:19.616432+0000","last_fullsized":"2024-01-21T20:18:19.616432+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.640029+0000","last_change":"2024-01-21T20:18:19.635362+0000","last_active":"2024-01-21T20:18:19.640029+0000","last_peered":"2024-01-21T20:18:19.640029+0000","last_clean":"2024-01-21T20:18:19.640029+0000","last_became_active":"2024-01-21T20:18:19.635065+0000","last_became_peered":"2024-01-21T20:18:19.635065+0000","last_unstale":"2024-01-21T20:18:19.640029+0000","last_undegraded":"2024-01-21T20:18:19.640029+0000","last_fullsized":"2024-01-21T20:18:19.640029+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622911+0000","last_change":"2024-01-21T20:18:19.248733+0000","last_active":"2024-01-21T20:18:19.622911+0000","last_peered":"2024-01-21T20:18:19.622911+0000","last_clean":"2024-01-21T20:18:19.622911+0000","last_became_active":"2024-01-21T20:18:19.248273+0000","last_became_peered":"2024-01-21T20:18:19.248273+0000","last_unstale":"2024-01-21T20:18:19.622911+0000","last_undegraded":"2024-01-21T20:18:19.622911+0000","last_fullsized":"2024-01-21T20:18:19.622911+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634384+0000","last_change":"2024-01-21T20:18:19.628817+0000","last_active":"2024-01-21T20:18:19.634384+0000","last_peered":"2024-01-21T20:18:19.634384+0000","last_clean":"2024-01-21T20:18:19.634384+0000","last_became_active":"2024-01-21T20:18:19.628501+0000","last_became_peered":"2024-01-21T20:18:19.628501+0000","last_unstale":"2024-01-21T20:18:19.634384+0000","last_undegraded":"2024-01-21T20:18:19.634384+0000","last_fullsized":"2024-01-21T20:18:19.634384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.615961+0000","last_change":"2024-01-21T20:18:19.255054+0000","last_active":"2024-01-21T20:18:19.615961+0000","last_peered":"2024-01-21T20:18:19.615961+0000","last_clean":"2024-01-21T20:18:19.615961+0000","last_became_active":"2024-01-21T20:18:19.254700+0000","last_became_peered":"2024-01-21T20:18:19.254700+0000","last_unstale":"2024-01-21T20:18:19.615961+0000","last_undegraded":"2024-01-21T20:18:19.615961+0000","last_fullsized":"2024-01-21T20:18:19.615961+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626198+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T20:18:19.626198+0000","last_peered":"2024-01-21T20:18:19.626198+0000","last_clean":"2024-01-21T20:18:19.626198+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T20:18:19.626198+0000","last_undegraded":"2024-01-21T20:18:19.626198+0000","last_fullsized":"2024-01-21T20:18:19.626198+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.622737+0000","last_change":"2024-01-21T20:18:19.616016+0000","last_active":"2024-01-21T20:18:19.622737+0000","last_peered":"2024-01-21T20:18:19.622737+0000","last_clean":"2024-01-21T20:18:19.622737+0000","last_became_active":"2024-01-21T20:18:19.615759+0000","last_became_peered":"2024-01-21T20:18:19.615759+0000","last_unstale":"2024-01-21T20:18:19.622737+0000","last_undegraded":"2024-01-21T20:18:19.622737+0000","last_fullsized":"2024-01-21T20:18:19.622737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.616691+0000","last_change":"2024-01-21T20:18:19.245490+0000","last_active":"2024-01-21T20:18:19.616691+0000","last_peered":"2024-01-21T20:18:19.616691+0000","last_clean":"2024-01-21T20:18:19.616691+0000","last_became_active":"2024-01-21T20:18:19.245216+0000","last_became_peered":"2024-01-21T20:18:19.245216+0000","last_unstale":"2024-01-21T20:18:19.616691+0000","last_undegraded":"2024-01-21T20:18:19.616691+0000","last_fullsized":"2024-01-21T20:18:19.616691+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":125,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612181+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T20:18:19.612181+0000","last_peered":"2024-01-21T20:18:19.612181+0000","last_clean":"2024-01-21T20:18:19.612181+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T20:18:19.612181+0000","last_undegraded":"2024-01-21T20:18:19.612181+0000","last_fullsized":"2024-01-21T20:18:19.612181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.639368+0000","last_change":"2024-01-21T20:18:19.635365+0000","last_active":"2024-01-21T20:18:19.639368+0000","last_peered":"2024-01-21T20:18:19.639368+0000","last_clean":"2024-01-21T20:18:19.639368+0000","last_became_active":"2024-01-21T20:18:19.635076+0000","last_became_peered":"2024-01-21T20:18:19.635076+0000","last_unstale":"2024-01-21T20:18:19.639368+0000","last_undegraded":"2024-01-21T20:18:19.639368+0000","last_fullsized":"2024-01-21T20:18:19.639368+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.620795+0000","last_change":"2024-01-21T20:18:19.239622+0000","last_active":"2024-01-21T20:18:19.620795+0000","last_peered":"2024-01-21T20:18:19.620795+0000","last_clean":"2024-01-21T20:18:19.620795+0000","last_became_active":"2024-01-21T20:18:19.239344+0000","last_became_peered":"2024-01-21T20:18:19.239344+0000","last_unstale":"2024-01-21T20:18:19.620795+0000","last_undegraded":"2024-01-21T20:18:19.620795+0000","last_fullsized":"2024-01-21T20:18:19.620795+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":117,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.610636+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T20:18:19.610636+0000","last_peered":"2024-01-21T20:18:19.610636+0000","last_clean":"2024-01-21T20:18:19.610636+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T20:18:19.610636+0000","last_undegraded":"2024-01-21T20:18:19.610636+0000","last_fullsized":"2024-01-21T20:18:19.610636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630336+0000","last_change":"2024-01-21T20:18:19.625673+0000","last_active":"2024-01-21T20:18:19.630336+0000","last_peered":"2024-01-21T20:18:19.630336+0000","last_clean":"2024-01-21T20:18:19.630336+0000","last_became_active":"2024-01-21T20:18:19.625316+0000","last_became_peered":"2024-01-21T20:18:19.625316+0000","last_unstale":"2024-01-21T20:18:19.630336+0000","last_undegraded":"2024-01-21T20:18:19.630336+0000","last_fullsized":"2024-01-21T20:18:19.630336+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"138'4","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630626+0000","last_change":"2024-01-21T20:18:19.250478+0000","last_active":"2024-01-21T20:18:19.630626+0000","last_peered":"2024-01-21T20:18:19.630626+0000","last_clean":"2024-01-21T20:18:19.630626+0000","last_became_active":"2024-01-21T20:18:19.250207+0000","last_became_peered":"2024-01-21T20:18:19.250207+0000","last_unstale":"2024-01-21T20:18:19.630626+0000","last_undegraded":"2024-01-21T20:18:19.630626+0000","last_fullsized":"2024-01-21T20:18:19.630626+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":125,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612342+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T20:18:19.612342+0000","last_peered":"2024-01-21T20:18:19.612342+0000","last_clean":"2024-01-21T20:18:19.612342+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T20:18:19.612342+0000","last_undegraded":"2024-01-21T20:18:19.612342+0000","last_fullsized":"2024-01-21T20:18:19.612342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":113,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619850+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T20:18:19.619850+0000","last_peered":"2024-01-21T20:18:19.619850+0000","last_clean":"2024-01-21T20:18:19.619850+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T20:18:19.619850+0000","last_undegraded":"2024-01-21T20:18:19.619850+0000","last_fullsized":"2024-01-21T20:18:19.619850+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.634359+0000","last_change":"2024-01-21T20:18:19.629794+0000","last_active":"2024-01-21T20:18:19.634359+0000","last_peered":"2024-01-21T20:18:19.634359+0000","last_clean":"2024-01-21T20:18:19.634359+0000","last_became_active":"2024-01-21T20:18:19.629537+0000","last_became_peered":"2024-01-21T20:18:19.629537+0000","last_unstale":"2024-01-21T20:18:19.634359+0000","last_undegraded":"2024-01-21T20:18:19.634359+0000","last_fullsized":"2024-01-21T20:18:19.634359+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"138'1","reported_seq":11,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635384+0000","last_change":"2024-01-21T20:18:19.250082+0000","last_active":"2024-01-21T20:18:19.635384+0000","last_peered":"2024-01-21T20:18:19.635384+0000","last_clean":"2024-01-21T20:18:19.635384+0000","last_became_active":"2024-01-21T20:18:19.249692+0000","last_became_peered":"2024-01-21T20:18:19.249692+0000","last_unstale":"2024-01-21T20:18:19.635384+0000","last_undegraded":"2024-01-21T20:18:19.635384+0000","last_fullsized":"2024-01-21T20:18:19.635384+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.619935+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T20:18:19.619935+0000","last_peered":"2024-01-21T20:18:19.619935+0000","last_clean":"2024-01-21T20:18:19.619935+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T20:18:19.619935+0000","last_undegraded":"2024-01-21T20:18:19.619935+0000","last_fullsized":"2024-01-21T20:18:19.619935+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629700+0000","last_change":"2024-01-21T20:18:19.624186+0000","last_active":"2024-01-21T20:18:19.629700+0000","last_peered":"2024-01-21T20:18:19.629700+0000","last_clean":"2024-01-21T20:18:19.629700+0000","last_became_active":"2024-01-21T20:18:19.623889+0000","last_became_peered":"2024-01-21T20:18:19.623889+0000","last_unstale":"2024-01-21T20:18:19.629700+0000","last_undegraded":"2024-01-21T20:18:19.629700+0000","last_fullsized":"2024-01-21T20:18:19.629700+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.612786+0000","last_change":"2024-01-21T20:18:19.244454+0000","last_active":"2024-01-21T20:18:19.612786+0000","last_peered":"2024-01-21T20:18:19.612786+0000","last_clean":"2024-01-21T20:18:19.612786+0000","last_became_active":"2024-01-21T20:18:19.242845+0000","last_became_peered":"2024-01-21T20:18:19.242845+0000","last_unstale":"2024-01-21T20:18:19.612786+0000","last_undegraded":"2024-01-21T20:18:19.612786+0000","last_fullsized":"2024-01-21T20:18:19.612786+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":111,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617082+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T20:18:19.617082+0000","last_peered":"2024-01-21T20:18:19.617082+0000","last_clean":"2024-01-21T20:18:19.617082+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T20:18:19.617082+0000","last_undegraded":"2024-01-21T20:18:19.617082+0000","last_fullsized":"2024-01-21T20:18:19.617082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.635899+0000","last_change":"2024-01-21T20:18:19.630308+0000","last_active":"2024-01-21T20:18:19.635899+0000","last_peered":"2024-01-21T20:18:19.635899+0000","last_clean":"2024-01-21T20:18:19.635899+0000","last_became_active":"2024-01-21T20:18:19.629745+0000","last_became_peered":"2024-01-21T20:18:19.629745+0000","last_unstale":"2024-01-21T20:18:19.635899+0000","last_undegraded":"2024-01-21T20:18:19.635899+0000","last_fullsized":"2024-01-21T20:18:19.635899+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"138'3","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.630714+0000","last_change":"2024-01-21T20:18:19.247153+0000","last_active":"2024-01-21T20:18:19.630714+0000","last_peered":"2024-01-21T20:18:19.630714+0000","last_clean":"2024-01-21T20:18:19.630714+0000","last_became_active":"2024-01-21T20:18:19.246781+0000","last_became_peered":"2024-01-21T20:18:19.246781+0000","last_unstale":"2024-01-21T20:18:19.630714+0000","last_undegraded":"2024-01-21T20:18:19.630714+0000","last_fullsized":"2024-01-21T20:18:19.630714+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.626944+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T20:18:19.626944+0000","last_peered":"2024-01-21T20:18:19.626944+0000","last_clean":"2024-01-21T20:18:19.626944+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T20:18:19.626944+0000","last_undegraded":"2024-01-21T20:18:19.626944+0000","last_fullsized":"2024-01-21T20:18:19.626944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.629691+0000","last_change":"2024-01-21T20:18:19.624069+0000","last_active":"2024-01-21T20:18:19.629691+0000","last_peered":"2024-01-21T20:18:19.629691+0000","last_clean":"2024-01-21T20:18:19.629691+0000","last_became_active":"2024-01-21T20:18:19.623761+0000","last_became_peered":"2024-01-21T20:18:19.623761+0000","last_unstale":"2024-01-21T20:18:19.629691+0000","last_undegraded":"2024-01-21T20:18:19.629691+0000","last_fullsized":"2024-01-21T20:18:19.629691+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:19.224210+0000","last_clean_scrub_stamp":"2024-01-21T20:18:19.224210+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"138'2","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.631940+0000","last_change":"2024-01-21T20:18:19.247725+0000","last_active":"2024-01-21T20:18:19.631940+0000","last_peered":"2024-01-21T20:18:19.631940+0000","last_clean":"2024-01-21T20:18:19.631940+0000","last_became_active":"2024-01-21T20:18:19.245322+0000","last_became_peered":"2024-01-21T20:18:19.245322+0000","last_unstale":"2024-01-21T20:18:19.631940+0000","last_undegraded":"2024-01-21T20:18:19.631940+0000","last_fullsized":"2024-01-21T20:18:19.631940+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T20:18:18.218332+0000","last_clean_scrub_stamp":"2024-01-21T20:18:18.218332+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-01-21T20:18:19.617745+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T20:18:19.617745+0000","last_peered":"2024-01-21T20:18:19.617745+0000","last_clean":"2024-01-21T20:18:19.617745+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T20:18:19.617745+0000","last_undegraded":"2024-01-21T20:18:19.617745+0000","last_fullsized":"2024-01-21T20:18:19.617745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575076,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":909996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.59699999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40999999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82099999999999995},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35299999999999998,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.871},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52900000000000003,"15min":0.55700000000000005},"min":{"1min":0.41599999999999998,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.79700000000000004},"last":0.38700000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53900000000000003,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56299999999999994,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.80400000000000005},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.57499999999999996},"min":{"1min":0.376,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.81799999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57699999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.314,"5min":0.29999999999999999,"15min":0.26800000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.36499999999999999,"5min":0.34499999999999997,"15min":0.29599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49299999999999999,"15min":0.5},"min":{"1min":0.317,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.309},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.433}]},{"osd":6,"last update":"Sun Jan 21 20:17:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.55100000000000005,"15min":0.54800000000000004},"min":{"1min":0.374,"5min":0.309,"15min":0.309},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.81499999999999995},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":1728512,"data_stored":911317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58999999999999997,"15min":0.59599999999999997},"min":{"1min":0.39200000000000002,"5min":0.35499999999999998,"15min":0.25},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":1.0900000000000001},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.27800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":1.083},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54600000000000004,"15min":0.55600000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":1.107},"last":0.378},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.36199999999999999,"5min":0.34799999999999998,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.016},"last":0.27300000000000002}]},{"osd":2,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.32300000000000001},"max":{"1min":0.90500000000000003,"5min":0.95799999999999996,"15min":1.0449999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55100000000000005,"15min":0.56999999999999995},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78200000000000003,"5min":0.81200000000000006,"15min":1.0369999999999999},"last":0.31}]},{"osd":3,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57699999999999996},"min":{"1min":0.40200000000000002,"5min":0.39200000000000002,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.877,"15min":1.0609999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78500000000000003,"5min":1.621,"15min":1.621},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46999999999999997,"15min":0.45500000000000002},"min":{"1min":0.32300000000000001,"5min":0.312,"15min":0.28599999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.84599999999999997},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.49299999999999999,"15min":0.48099999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28299999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.86099999999999999},"last":0.45100000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.308,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71199999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.371,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86899999999999999},"last":0.43099999999999999}]},{"osd":7,"last update":"Sun Jan 21 20:17:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33000000000000002},"max":{"1min":0.73499999999999999,"5min":0.82799999999999996,"15min":0.88600000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.378,"5min":0.36399999999999999,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.82299999999999995,"15min":0.85499999999999998},"last":0.44500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575078,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302880,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068960,"statfs":{"total":96636764160,"available":96326615040,"internally_reserved":0,"allocated":1728512,"data_stored":910785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.38900000000000001},"min":{"1min":0.25700000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47899999999999998,"5min":0.58099999999999996,"15min":0.60599999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.436},"min":{"1min":0.29799999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60899999999999999,"15min":0.61499999999999999},"last":0.29299999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.378,"15min":0.39900000000000002},"min":{"1min":0.24099999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54200000000000004,"5min":0.55600000000000005,"15min":0.66600000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38700000000000001,"15min":0.40600000000000003},"min":{"1min":0.26600000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.68799999999999994},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.439},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.27600000000000002},"max":{"1min":0.58299999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"last":0.309},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39300000000000002,"15min":0.40999999999999998},"min":{"1min":0.255,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.56399999999999995,"5min":0.65800000000000003,"15min":0.67700000000000005},"last":0.371}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58499999999999996,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.34799999999999998},"max":{"1min":0.68200000000000005,"5min":0.89000000000000001,"15min":0.90700000000000003},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59499999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.751,"5min":0.83299999999999996,"15min":0.92700000000000005},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.876,"15min":0.98899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.64700000000000002,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76100000000000001,"5min":0.89000000000000001,"15min":0.98599999999999999},"last":0.622}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.47999999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.78600000000000003,"5min":0.878,"15min":0.99299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65300000000000002,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.79700000000000004,"5min":0.91400000000000003,"15min":1.0209999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.63200000000000001},"min":{"1min":0.46200000000000002,"5min":0.39200000000000002,"15min":0.38200000000000001},"max":{"1min":0.77900000000000003,"5min":0.90500000000000003,"15min":0.96499999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":0.872,"15min":0.95299999999999996},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575077,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.35199999999999998,"15min":0.36099999999999999},"min":{"1min":0.25900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.77500000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.38100000000000001,"15min":0.39800000000000002},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":0.55800000000000005,"15min":0.72699999999999998},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.26500000000000001,"5min":0.252,"15min":0.245},"max":{"1min":0.503,"5min":0.57499999999999996,"15min":0.70799999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.42199999999999999,"15min":0.438},"min":{"1min":0.26300000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52800000000000002,"5min":0.59999999999999998,"15min":0.81699999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.39900000000000002,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.73199999999999998,"15min":0.79300000000000004},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.40999999999999998,"15min":0.42399999999999999},"min":{"1min":0.219,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.54700000000000004,"5min":0.59899999999999998,"15min":0.76300000000000001},"last":0.34799999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.42699999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.73299999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59599999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83799999999999997,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53700000000000003}]},{"osd":5,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.58499999999999996,"15min":0.60099999999999998},"min":{"1min":0.36299999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73299999999999998,"5min":0.86899999999999999,"15min":0.92400000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.42299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.628,"15min":0.64700000000000002},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.39700000000000002},"max":{"1min":0.81499999999999995,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.64700000000000002},"min":{"1min":0.47799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Sun Jan 21 20:17:29 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40400000000000003,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80600000000000005,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63100000000000001,"15min":0.64600000000000002},"min":{"1min":0.47799999999999998,"5min":0.40100000000000002,"15min":0.379},"max":{"1min":0.77800000000000002,"5min":0.93799999999999994,"15min":0.96299999999999997},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.39400000000000002},"min":{"1min":0.255,"5min":0.193,"15min":0.193},"max":{"1min":0.5,"5min":0.57299999999999995,"15min":0.65700000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40400000000000003,"15min":0.41899999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.26900000000000002},"max":{"1min":0.49199999999999999,"5min":0.61899999999999999,"15min":0.63100000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.372,"15min":0.39300000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23300000000000001},"max":{"1min":0.495,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.313},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.40200000000000002,"15min":0.42099999999999999},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55500000000000005,"5min":0.60399999999999998,"15min":0.68500000000000005},"last":0.29699999999999999}]},{"osd":3,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.436},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.255},"max":{"1min":0.54000000000000004,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.438,"15min":0.45500000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.36499999999999999}]},{"osd":4,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.64300000000000002},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.81799999999999995,"5min":0.92900000000000005,"15min":0.95499999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64400000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.375},"max":{"1min":0.876,"5min":0.95999999999999996,"15min":1.1759999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60899999999999999,"15min":0.63},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60299999999999998,"15min":0.621},"min":{"1min":0.375,"5min":0.375,"15min":0.373},"max":{"1min":0.68500000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73299999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.82699999999999996,"5min":1.026,"15min":1.2},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.621,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.33700000000000002},"max":{"1min":0.79700000000000004,"5min":0.89200000000000002,"15min":0.93400000000000005},"last":0.54100000000000004}]},{"osd":7,"last update":"Sun Jan 21 20:17:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.63400000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.376},"max":{"1min":0.80200000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63900000000000001,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.39200000000000002},"max":{"1min":0.85699999999999998,"5min":0.93300000000000005,"15min":1.216},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575077,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302888,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068952,"statfs":{"total":96636764160,"available":96326606848,"internally_reserved":0,"allocated":1736704,"data_stored":911441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.40799999999999997},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.49199999999999999,"5min":0.626,"15min":7.8940000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.40500000000000003,"15min":0.443},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.56000000000000005,"5min":0.60099999999999998,"15min":7.532},"last":0.35199999999999998}]},{"osd":1,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.37,"15min":0.40699999999999997},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":6.9660000000000002},"last":0.38},{"interface":"front","average":{"1min":0.376,"5min":0.39100000000000001,"15min":0.42999999999999999},"min":{"1min":0.29199999999999998,"5min":0.224,"15min":0.223},"max":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":7.8380000000000001},"last":0.29399999999999998}]},{"osd":2,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.43099999999999999,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.26600000000000001},"max":{"1min":0.59099999999999997,"5min":0.625,"15min":7.0199999999999996},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.442,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57999999999999996,"5min":0.61599999999999999,"15min":8.0220000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.64900000000000002},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.80800000000000005,"5min":0.85099999999999998,"15min":7.6020000000000003},"last":0.437},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58599999999999997,"15min":0.64200000000000002},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77300000000000002,"5min":0.92600000000000005,"15min":7.0940000000000003},"last":0.60799999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59599999999999997,"15min":0.63900000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.38200000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.1230000000000002},"last":0.502},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60299999999999998,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.88500000000000001,"5min":0.94399999999999995,"15min":7.9939999999999998},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.65900000000000003},"min":{"1min":0.42399999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":7.9649999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.65800000000000003},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.85199999999999998,"15min":7.3540000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Sun Jan 21 20:17:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.61299999999999999,"15min":0.66600000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82699999999999996,"5min":0.91300000000000003,"15min":7.5620000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.621,"15min":0.67900000000000005},"min":{"1min":0.40999999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85499999999999998,"5min":0.86899999999999999,"15min":7.8200000000000003},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575077,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1732608,"data_stored":911407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.59599999999999997},"min":{"1min":0.36099999999999999,"5min":0.34899999999999998,"15min":0.33300000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.82599999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57499999999999996,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.372},"max":{"1min":0.75,"5min":0.75,"15min":0.82699999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.60499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.89600000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.61299999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39200000000000002},"max":{"1min":0.73099999999999998,"5min":0.79200000000000004,"15min":0.83499999999999996},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.84499999999999997,"5min":1.472,"15min":1.472},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56200000000000006,"15min":0.56699999999999995},"min":{"1min":0.434,"5min":0.38,"15min":0.33300000000000002},"max":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.79800000000000004},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78100000000000003,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46400000000000002,"15min":0.47099999999999997},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.81899999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.47899999999999998,"15min":0.48499999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.748,"15min":0.77600000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.33700000000000002,"15min":0.32400000000000001},"max":{"1min":0.84499999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.52100000000000002,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.875,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.5}]},{"osd":7,"last update":"Sun Jan 21 20:17:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.53100000000000003},"min":{"1min":0.375,"5min":0.32100000000000001,"15min":0.30599999999999999},"max":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.81499999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80400000000000005,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575076,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306976,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064864,"statfs":{"total":96636764160,"available":96322420736,"internally_reserved":0,"allocated":1728512,"data_stored":910853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40899999999999997,"5min":0.311,"15min":0.26200000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82899999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.40999999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.252},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.35299999999999998,"15min":0.315},"max":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":1.8520000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.436,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77800000000000002,"5min":0.83399999999999996,"15min":0.85699999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56799999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.36099999999999999,"15min":0.34399999999999997},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":1.9350000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.46500000000000002,"5min":0.375,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":0.74099999999999999,"15min":0.81599999999999995},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.43099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58499999999999996,"15min":0.58799999999999997},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":1.4079999999999999},"last":0.44}]},{"osd":4,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.48999999999999999},"min":{"1min":0.35299999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.83299999999999996},"last":0.496},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.42499999999999999,"5min":0.32000000000000001,"15min":0.29699999999999999},"max":{"1min":0.79500000000000004,"5min":0.81599999999999995,"15min":1.008},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.498,"15min":0.499},"min":{"1min":0.39300000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.68100000000000005,"5min":0.71199999999999997,"15min":1.891},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.51800000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.77300000000000002,"15min":1.9079999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 20:17:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.31,"15min":0.31},"max":{"1min":0.81499999999999995,"5min":0.88600000000000001,"15min":0.96099999999999997},"last":0.503},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.78900000000000003,"15min":1.3200000000000001},"last":0.52900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T20:18:27.369 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T20:18:27.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T20:18:27.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.538+0000 7f721d3e1700 1 Processor -- start 2024-01-21T20:18:27.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.538+0000 7f721d3e1700 1 -- start start 2024-01-21T20:18:27.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f721d3e1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f72180aa7a0 0x7f721815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f721d3e1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7218154b50 con 0x7f72181542f0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f721d3e1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7218158c00 con 0x7f72181546d0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f721d3e1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7218159090 con 0x7f72180aa7a0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f7216ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f72181542f0 0x7f72180c60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40554/0 (socket says 172.21.15.133:40554) 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f7216ffd700 1 -- 172.21.15.133:0/3605780129 learned_addr learned my addr 172.21.15.133:0/3605780129 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f72177fe700 1 --2- 172.21.15.133:0/3605780129 >> v2:172.21.15.178:3300/0 conn(0x7f72180aa7a0 0x7f721815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398041307 0 0) 0x7f7218154b50 con 0x7f72181542f0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.539+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72000033f0 con 0x7f72181542f0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541729354 0 0) 0x7f7218158c00 con 0x7f72181546d0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7218154b50 con 0x7f72181546d0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1080079691 0 0) 0x7f72000033f0 con 0x7f72181542f0 2024-01-21T20:18:27.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 >> v2:172.21.15.178:3300/0 conn(0x7f72180aa7a0 msgr2=0x7f721815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 --2- 172.21.15.133:0/3605780129 >> v2:172.21.15.178:3300/0 conn(0x7f72180aa7a0 0x7f721815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 >> v1:172.21.15.178:6789/0 conn(0x7f72181546d0 legacy=0x7f72180aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180c67c0 con 0x7f72181542f0 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f720c001470 con 0x7f72181542f0 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 >> v1:172.21.15.133:6789/0 conn(0x7f72181542f0 legacy=0x7f72180c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7200003a70 0x7f7200003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7200004690 0x7f7200004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f720000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218159090 con 0x7f7200005050 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720000bfc0 con 0x7f7200003a70 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720000c180 con 0x7f7200004690 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f720000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7216ffd700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7200003a70 0x7f7200003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72167fc700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7200004690 0x7f7200004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 -- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7200004690 msgr2=0x7f7200004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7200004690 0x7f7200004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 -- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7200003a70 msgr2=0x7f7200003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7200003a70 0x7f7200003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 -- 172.21.15.133:0/3605780129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000033f0 con 0x7f7200005050 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 -- 172.21.15.133:0/3605780129 reap_dead start 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f72177fe700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f720000b8e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f72180aabb0 tx=0x7f721000b040).ready entity=mon.0 client_cookie=3e5d561dca0d01f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210009ac0 con 0x7f7200005050 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721000f040 con 0x7f7200005050 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.540+0000 7f7215ffb700 1 -- 172.21.15.133:0/3605780129 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721000ece0 con 0x7f7200005050 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 -- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 msgr2=0x7f720000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f720000b8e0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f72180aabb0 tx=0x7f721000b040).stop 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 -- 172.21.15.133:0/3605780129 shutdown_connections 2024-01-21T20:18:27.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3605780129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f720000b8e0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 -- 172.21.15.133:0/3605780129 >> 172.21.15.133:0/3605780129 conn(0x7f721805e1e0 msgr2=0x7f721805e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 -- 172.21.15.133:0/3605780129 shutdown_connections 2024-01-21T20:18:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.541+0000 7f721d3e1700 1 -- 172.21.15.133:0/3605780129 wait complete. 2024-01-21T20:18:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.542+0000 7f721d3e1700 1 Processor -- start 2024-01-21T20:18:27.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.542+0000 7f721d3e1700 1 -- start start 2024-01-21T20:18:27.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72180c47a0 0x7f7218165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7218165d00 0x7f7218154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721813ba10 con 0x7f7200005050 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218166160 con 0x7f7218165d00 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f721d3e1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180ae980 con 0x7f72180c47a0 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45210/0 (socket says 172.21.15.133:45210) 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 -- 172.21.15.133:0/3347967729 learned_addr learned my addr 172.21.15.133:0/3347967729 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f72177fe700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7218165d00 0x7f7218154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f72167fc700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72180c47a0 0x7f7218165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 -- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72180c47a0 msgr2=0x7f7218165810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72180c47a0 0x7f7218165810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 -- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7218165d00 msgr2=0x7f7218154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7218165d00 0x7f7218154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.543+0000 7f7216ffd700 1 -- 172.21.15.133:0/3347967729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180c3210 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f7216ffd700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f720c004760 tx=0x7f720c001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011590 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c0116f0 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180c34f0 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011a70 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.544+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72180c3ab0 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.545+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72180c4b80 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.545+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f720c01d3b0 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.545+0000 7f71ff7fe700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 0x7f7204061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.546+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f720c079e90 con 0x7f7200005050 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.546+0000 7f72167fc700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 0x7f7204061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.546+0000 7f72167fc700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 0x7f7204061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f72080010e0 tx=0x7f7208009040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.550+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f72180c4b80 con 0x7f7200005050 2024-01-21T20:18:27.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.784+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f72180c4b80 con 0x7f7200005050 2024-01-21T20:18:27.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.788+0000 7f71ff7fe700 1 -- 172.21.15.133:0/3347967729 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f72180c4b80 con 0x7f7200005050 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.789+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 msgr2=0x7f7204061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 0x7f7204061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f72080010e0 tx=0x7f7208009040).stop 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 msgr2=0x7f72180c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f720c004760 tx=0x7f720c001e10).stop 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 shutdown_connections 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f720405f150 0x7f7204061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7218165d00 0x7f7218154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7200005050 0x7f72180c42b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 --2- 172.21.15.133:0/3347967729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72180c47a0 0x7f7218165810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 >> 172.21.15.133:0/3347967729 conn(0x7f721805e1e0 msgr2=0x7f72180c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:27.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 shutdown_connections 2024-01-21T20:18:27.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.790+0000 7f721d3e1700 1 -- 172.21.15.133:0/3347967729 wait complete. 2024-01-21T20:18:27.780 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T20:18:27.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T20:18:27.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.917+0000 7f887da75700 1 Processor -- start 2024-01-21T20:18:27.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.918+0000 7f887da75700 1 -- start start 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.918+0000 7f887da75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8878069cc0 0x7f88780c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.918+0000 7f887da75700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780c3890 con 0x7f887813a830 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.918+0000 7f887da75700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780c3b70 con 0x7f887813ac10 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.918+0000 7f887da75700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780c3e50 con 0x7f8878069cc0 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f8877fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8878069cc0 0x7f88780c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88777fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f887813a830 0x7f88780bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40556/0 (socket says 172.21.15.133:40556) 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88777fe700 1 -- 172.21.15.133:0/4076060553 learned_addr learned my addr 172.21.15.133:0/4076060553 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f8877fff700 1 -- 172.21.15.133:0/4076060553 >> v1:172.21.15.178:6789/0 conn(0x7f887813ac10 legacy=0x7f88780695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f8877fff700 1 -- 172.21.15.133:0/4076060553 >> v1:172.21.15.133:6789/0 conn(0x7f887813a830 legacy=0x7f88780bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f8877fff700 1 -- 172.21.15.133:0/4076060553 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780c4130 con 0x7f8878069cc0 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88767fc700 1 -- 172.21.15.133:0/4076060553 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493035194 0 0) 0x7f88780c3890 con 0x7f887813a830 2024-01-21T20:18:27.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f8877fff700 1 --2- 172.21.15.133:0/4076060553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780c3220 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f887000d0d0 tx=0x7f887000b990).ready entity=mon.0 client_cookie=c6254a565bd4da98 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88767fc700 1 -- 172.21.15.133:0/4076060553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870010070 con 0x7f8878069cc0 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88767fc700 1 -- 172.21.15.133:0/4076060553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000ddb0 con 0x7f8878069cc0 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.919+0000 7f88767fc700 1 -- 172.21.15.133:0/4076060553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000b2e0 con 0x7f8878069cc0 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 -- 172.21.15.133:0/4076060553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 msgr2=0x7f88780c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 --2- 172.21.15.133:0/4076060553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780c3220 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f887000d0d0 tx=0x7f887000b990).stop 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 -- 172.21.15.133:0/4076060553 shutdown_connections 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 --2- 172.21.15.133:0/4076060553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780c3220 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 -- 172.21.15.133:0/4076060553 >> 172.21.15.133:0/4076060553 conn(0x7f88780c7dc0 msgr2=0x7f88780c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 -- 172.21.15.133:0/4076060553 shutdown_connections 2024-01-21T20:18:27.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.920+0000 7f887da75700 1 -- 172.21.15.133:0/4076060553 wait complete. 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.921+0000 7f887da75700 1 Processor -- start 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.921+0000 7f887da75700 1 -- start start 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 0x7f88781609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 0x7f88780c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780a8d20 con 0x7f8878069cc0 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878160ea0 con 0x7f887813ac10 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780a8f80 con 0x7f887813a830 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45224/0 (socket says 172.21.15.133:45224) 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 -- 172.21.15.133:0/2987552915 learned_addr learned my addr 172.21.15.133:0/2987552915 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f8876ffd700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 0x7f88781609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f8877fff700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 0x7f88780c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 -- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 msgr2=0x7f88781609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 0x7f88781609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 -- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 msgr2=0x7f88780c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 0x7f88780c0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 -- 172.21.15.133:0/2987552915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887000bc30 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f8876ffd700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 0x7f88781609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f8877fff700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 0x7f88780c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f88777fe700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f886c00c4e0 tx=0x7f886c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0072e0 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c007440 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88780a9260 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.922+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c0057a0 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.923+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88780a9820 con 0x7f8878069cc0 2024-01-21T20:18:27.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.923+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887805fdf0 con 0x7f8878069cc0 2024-01-21T20:18:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.924+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f886c005bd0 con 0x7f8878069cc0 2024-01-21T20:18:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.924+0000 7f885ffff700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 0x7f8864061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.924+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f886c079e10 con 0x7f8878069cc0 2024-01-21T20:18:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.924+0000 7f8876ffd700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 0x7f8864061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:27.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.925+0000 7f8876ffd700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 0x7f8864061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f88780adf70 tx=0x7f8868008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:27.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:27.928+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f886c04ae80 con 0x7f8878069cc0 2024-01-21T20:18:28.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.131+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88780671a0 con 0x7f8878069cc0 2024-01-21T20:18:28.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.132+0000 7f885ffff700 1 -- 172.21.15.133:0/2987552915 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f886c04e4a0 con 0x7f8878069cc0 2024-01-21T20:18:28.121 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:28.121 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T20:18:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 msgr2=0x7f8864061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 0x7f8864061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f88780adf70 tx=0x7f8868008040).stop 2024-01-21T20:18:28.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 msgr2=0x7f88780aa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f886c00c4e0 tx=0x7f886c007c70).stop 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 shutdown_connections 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f886405f150 0x7f8864061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887813ac10 0x7f88780c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8878069cc0 0x7f88780aa020 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 --2- 172.21.15.133:0/2987552915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887813a830 0x7f88781609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 >> 172.21.15.133:0/2987552915 conn(0x7f88780c7dc0 msgr2=0x7f88780bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 shutdown_connections 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.134+0000 7f887da75700 1 -- 172.21.15.133:0/2987552915 wait complete. 2024-01-21T20:18:28.124 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T20:18:28.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T20:18:19.606444+0000', 'modified': '2024-01-21T20:18:21.615679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8082}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8082': {'gid': 8082, 'name': 'c', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/602888662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 602888662}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 602888662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T20:18:28.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T20:18:28.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-21T20:18:28.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.671+0000 7f217661d700 1 Processor -- start 2024-01-21T20:18:28.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 -- start start 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 0x7f21700c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700bfa40 con 0x7f21700c39f0 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700c3e70 con 0x7f217013b970 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.672+0000 7f217661d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700bee30 con 0x7f21700be810 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f216ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 0x7f21700c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54178/0 (socket says 172.21.15.133:54178) 2024-01-21T20:18:28.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 -- 172.21.15.133:0/1793342799 learned_addr learned my addr 172.21.15.133:0/1793342799 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 -- 172.21.15.133:0/1793342799 >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 msgr2=0x7f21700c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 --2- 172.21.15.133:0/1793342799 >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 0x7f21700c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 -- 172.21.15.133:0/1793342799 >> v1:172.21.15.178:6789/0 conn(0x7f21700c39f0 legacy=0x7f21700be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 -- 172.21.15.133:0/1793342799 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700bf110 con 0x7f21700be810 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f216ffff700 1 --2- 172.21.15.133:0/1793342799 >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 0x7f21700c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f2174bba700 1 --2- 172.21.15.133:0/1793342799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2168009f20 tx=0x7f2168009840).ready entity=mon.2 client_cookie=8a358dc95b0cfc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.673+0000 7f216effd700 1 -- 172.21.15.133:0/1793342799 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800e070 con 0x7f21700be810 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f216effd700 1 -- 172.21.15.133:0/1793342799 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800b9d0 con 0x7f21700be810 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f216effd700 1 -- 172.21.15.133:0/1793342799 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800bd50 con 0x7f21700be810 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 -- 172.21.15.133:0/1793342799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 msgr2=0x7f21700a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 --2- 172.21.15.133:0/1793342799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f2168009f20 tx=0x7f2168009840).stop 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 -- 172.21.15.133:0/1793342799 shutdown_connections 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 --2- 172.21.15.133:0/1793342799 >> v2:172.21.15.178:3300/0 conn(0x7f217013b970 0x7f21700c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 --2- 172.21.15.133:0/1793342799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700be810 0x7f21700a8ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 -- 172.21.15.133:0/1793342799 >> 172.21.15.133:0/1793342799 conn(0x7f2170066a70 msgr2=0x7f2170066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 -- 172.21.15.133:0/1793342799 shutdown_connections 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.674+0000 7f217661d700 1 -- 172.21.15.133:0/1793342799 wait complete. 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.675+0000 7f217661d700 1 Processor -- start 2024-01-21T20:18:28.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.675+0000 7f217661d700 1 -- start start 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700c39f0 0x7f21700c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f217013b970 0x7f2170156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c22a0 con 0x7f21700be810 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c16b0 con 0x7f217013b970 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f217661d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c1970 con 0x7f21700c39f0 2024-01-21T20:18:28.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f216ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f216ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45240/0 (socket says 172.21.15.133:45240) 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f216ffff700 1 -- 172.21.15.133:0/333505195 learned_addr learned my addr 172.21.15.133:0/333505195 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f2174bba700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f217013b970 0x7f2170156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.676+0000 7f216f7fe700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700c39f0 0x7f21700c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 -- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700c39f0 msgr2=0x7f21700c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700c39f0 0x7f21700c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 -- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f217013b970 msgr2=0x7f2170156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f217013b970 0x7f2170156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 -- 172.21.15.133:0/333505195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21580092a0 con 0x7f21700be810 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216ffff700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f215800ea20 tx=0x7f2158009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216cff9700 1 -- 172.21.15.133:0/333505195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800ee60 con 0x7f21700be810 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216cff9700 1 -- 172.21.15.133:0/333505195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800c850 con 0x7f21700be810 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f216cff9700 1 -- 172.21.15.133:0/333505195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215800cbd0 con 0x7f21700be810 2024-01-21T20:18:28.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2168009ae0 con 0x7f21700be810 2024-01-21T20:18:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.677+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700c1f30 con 0x7f21700be810 2024-01-21T20:18:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.678+0000 7f216cff9700 1 -- 172.21.15.133:0/333505195 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f215801b400 con 0x7f21700be810 2024-01-21T20:18:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.679+0000 7f216cff9700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 0x7f2150061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.679+0000 7f216cff9700 1 -- 172.21.15.133:0/333505195 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f215807a9e0 con 0x7f21700be810 2024-01-21T20:18:28.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.679+0000 7f216f7fe700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 0x7f2150061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.679+0000 7f216f7fe700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 0x7f2150061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2170065100 tx=0x7f2160000bc0).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.681+0000 7f2187fc0b80 1 Processor -- start 2024-01-21T20:18:28.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.681+0000 7f2187fc0b80 1 -- start start 2024-01-21T20:18:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b986a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b981900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8fd3d0 con 0x55e00b981df0 2024-01-21T20:18:28.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8c2be0 con 0x55e00b9cf2c0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8d8260 con 0x55e00b986620 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45246/0 (socket says 172.21.15.133:45246) 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 -- 172.21.15.133:0/2699193703 learned_addr learned my addr 172.21.15.133:0/2699193703 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f216ffff700 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b986a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f216f7fe700 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b981900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 -- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 msgr2=0x55e00b986a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b986a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 -- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 msgr2=0x55e00b981900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b981900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.682+0000 7f2174bba700 1 -- 172.21.15.133:0/2699193703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b8d12f0 con 0x55e00b981df0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2174bba700 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f216800b610 tx=0x7f2168009840).ready entity=mon.0 client_cookie=c70ab05b8159299b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2165ffb700 1 -- 172.21.15.133:0/2699193703 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168022070 con 0x55e00b981df0 2024-01-21T20:18:28.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2165ffb700 1 -- 172.21.15.133:0/2699193703 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800bb40 con 0x55e00b981df0 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2165ffb700 1 -- 172.21.15.133:0/2699193703 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800bcd0 con 0x55e00b981df0 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2699193703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 msgr2=0x55e00b982270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f216800b610 tx=0x7f2168009840).stop 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2699193703 shutdown_connections 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b982270 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b986a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2699193703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b981900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2699193703 >> 172.21.15.133:0/2699193703 conn(0x55e00b7ef2e0 msgr2=0x55e00b9cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2699193703 shutdown_connections 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.683+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2699193703 wait complete. 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.684+0000 7f2187fc0b80 1 -- start start 2024-01-21T20:18:28.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.684+0000 7f2187fc0b80 1 Processor -- start 2024-01-21T20:18:28.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b981df0 0x55e00b9b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8d83a0 con 0x55e00b9cf2c0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8d8620 con 0x55e00b981df0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b8a3990 con 0x55e00b986620 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2187fc0b80 10 client.0 ll_register_callbacks cb 0x55e00b946610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45248/0 (socket says 172.21.15.133:45248) 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f2174bba700 1 -- 172.21.15.133:0/1287842805 learned_addr learned my addr 172.21.15.133:0/1287842805 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f216ffff700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b981df0 0x55e00b9b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.685+0000 7f216f7fe700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 -- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 msgr2=0x55e00b9b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 -- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b981df0 msgr2=0x55e00b9b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b981df0 0x55e00b9b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 -- 172.21.15.133:0/1287842805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168017040 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2174bba700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x55e00b9cf720 tx=0x7f216801e000).ready entity=mon.0 client_cookie=3663f7ad60a41bbe server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168022040 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f216801e450 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e00b980df0 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2168001080 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 10 client.8256 fetch_fsmap learned FSMap version 49 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55e00b8cc520 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e00b980df0 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f216801e820 con 0x55e00b9cf2c0 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 10 client.8256 fetch_fsmap finished waiting for FSMap version 49 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 10 client.8256 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 20 client.8256 populate_metadata read hostname 'smithi133' 2024-01-21T20:18:28.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b9b4d00 0x55e00b9b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 4 client.8256 mds_command: new command op to 8082 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 --> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e00b8cdd60 con 0x55e00b9b4d00 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.686+0000 7f216ffff700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b9b4d00 0x55e00b9b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f214effd700 10 client.8256 ms_handle_connect on v2:172.21.15.133:6834/602888662 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f216ffff700 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b9b4d00 0x55e00b9b50e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b2b995dca157ebc1 server_cookie=c349cae7362c3494 in_seq=0 out_seq=0 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f214effd700 1 -- 172.21.15.133:0/1287842805 <== mds.0 v2:172.21.15.133:6834/602888662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55e00b8cdd60 con 0x55e00b9b4d00 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f214effd700 10 client.8256 handle_command_reply: tid=0 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 client.8256 shutdown 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 msgr2=0x55e00b9b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x55e00b9cf720 tx=0x7f216801e000).stop 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 shutdown_connections 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b9b4d00 0x55e00b9b50e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bf0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b981df0 0x55e00b9b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f214effd700 0 client.8256 ms_handle_reset on v2:172.21.15.133:6834/602888662 2024-01-21T20:18:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/1287842805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.687+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 >> 172.21.15.133:0/1287842805 conn(0x55e00b7ef2e0 msgr2=0x55e00b9cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.688+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 shutdown_connections 2024-01-21T20:18:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.688+0000 7f2187fc0b80 1 -- 172.21.15.133:0/1287842805 wait complete. 2024-01-21T20:18:28.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.688+0000 7f2187fc0b80 20 client.8256 trim_cache size 0 max 16384 2024-01-21T20:18:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.704+0000 7f2187fc0b80 1 Processor -- start 2024-01-21T20:18:28.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.704+0000 7f2187fc0b80 1 -- start start 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9d03d0 con 0x55e00b981df0 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9b1770 con 0x55e00b9cf2c0 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b97b0e0 con 0x55e00b986620 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45252/0 (socket says 172.21.15.133:45252) 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 -- 172.21.15.133:0/2308434158 learned_addr learned my addr 172.21.15.133:0/2308434158 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2174bba700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216f7fe700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 -- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 msgr2=0x55e00b9b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 -- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 msgr2=0x55e00b9b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 -- 172.21.15.133:0/2308434158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b8cc270 con 0x55e00b981df0 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f2174bba700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216f7fe700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f216ffff700 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f2158009fd0 tx=0x7f215801d040).ready entity=mon.0 client_cookie=2e8923a6a0e334a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f21667fc700 1 -- 172.21.15.133:0/2308434158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158054040 con 0x55e00b981df0 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f21667fc700 1 -- 172.21.15.133:0/2308434158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215804dbc0 con 0x55e00b981df0 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.705+0000 7f21667fc700 1 -- 172.21.15.133:0/2308434158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215804be60 con 0x55e00b981df0 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2308434158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 msgr2=0x55e00b97d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f2158009fd0 tx=0x7f215801d040).stop 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2308434158 shutdown_connections 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b9cf2c0 0x55e00b9b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b981df0 0x55e00b97d4c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/2308434158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b986620 0x55e00b9b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2308434158 >> 172.21.15.133:0/2308434158 conn(0x55e00b7ef2e0 msgr2=0x55e00b9cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2308434158 shutdown_connections 2024-01-21T20:18:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- 172.21.15.133:0/2308434158 wait complete. 2024-01-21T20:18:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.706+0000 7f2187fc0b80 1 -- start start 2024-01-21T20:18:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.707+0000 7f2187fc0b80 1 Processor -- start 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.707+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b981df0 0x55e00b9caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.707+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 0x55e00ba30840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.707+0000 7f2187fc0b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b99e030 con 0x55e00b9cf2c0 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9dd700 con 0x55e00b986620 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9ca580 con 0x55e00b981df0 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 10 client.0 ll_register_callbacks cb 0x55e00b946610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45260/0 (socket says 172.21.15.133:45260) 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 -- 172.21.15.133:0/832215213 learned_addr learned my addr 172.21.15.133:0/832215213 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f216ffff700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b981df0 0x55e00b9caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f216f7fe700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 0x55e00ba30840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 -- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b981df0 msgr2=0x55e00b9caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b981df0 0x55e00b9caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 -- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 msgr2=0x55e00ba30840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 0x55e00ba30840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 -- 172.21.15.133:0/832215213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21700c1f30 con 0x55e00b9cf2c0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f216f7fe700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 0x55e00ba30840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2174bba700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x55e00b984c90 tx=0x7f2168027000).ready entity=mon.0 client_cookie=de9df2432ca3c54 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216801e450 con 0x55e00b9cf2c0 2024-01-21T20:18:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f216801ed80 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f216800bb40 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2168013ca0 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 10 client.8262 fetch_fsmap learned FSMap version 49 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55e00b745f80 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800bb40 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f216801e820 con 0x55e00b9cf2c0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 10 client.8262 fetch_fsmap finished waiting for FSMap version 49 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 10 client.8262 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.708+0000 7f2187fc0b80 20 client.8262 populate_metadata read hostname 'smithi133' 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b99d770 0x55e00b9b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 4 client.8262 mds_command: new command op to 8082 tid=0[{"prefix": "status"}] 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 --> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e00b8c47d0 con 0x55e00b99d770 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f216ffff700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b99d770 0x55e00b9b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f214effd700 10 client.8262 ms_handle_connect on v2:172.21.15.133:6834/602888662 2024-01-21T20:18:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f216ffff700 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b99d770 0x55e00b9b26e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=559dfb9e176df417 server_cookie=272574137b7157 in_seq=0 out_seq=0 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f214effd700 1 -- 172.21.15.133:0/832215213 <== mds.0 v2:172.21.15.133:6834/602888662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e00b8c47d0 con 0x55e00b99d770 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f214effd700 10 client.8262 handle_command_reply: tid=0 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 client.8262 shutdown 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 msgr2=0x55e00b99d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x55e00b984c90 tx=0x7f2168027000).stop 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 shutdown_connections 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:6834/602888662,v1:172.21.15.133:6837/602888662] conn(0x55e00b99d770 0x55e00b9b26e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55e00b9cf2c0 0x55e00b99d230 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e00b981df0 0x55e00b9caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f214effd700 0 client.8262 ms_handle_reset on v2:172.21.15.133:6834/602888662 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 --2- 172.21.15.133:0/832215213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e00b986620 0x55e00ba30840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 >> 172.21.15.133:0/832215213 conn(0x55e00b7ef2e0 msgr2=0x55e00b9caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 shutdown_connections 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.709+0000 7f2187fc0b80 1 -- 172.21.15.133:0/832215213 wait complete. 2024-01-21T20:18:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f2187fc0b80 20 client.8262 trim_cache size 0 max 16384 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8082, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.1020682429999997, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 49, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 139, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 139, 2024-01-21T20:18:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.606811616 2024-01-21T20:18:28.707 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T20:18:28.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 msgr2=0x7f2150061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 0x7f2150061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2170065100 tx=0x7f2160000bc0).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 msgr2=0x7f2170139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f215800ea20 tx=0x7f2158009060).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 shutdown_connections 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f215005f150 0x7f2150061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f217013b970 0x7f2170156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21700be810 0x7f2170139b60 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 --2- 172.21.15.133:0/333505195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21700c39f0 0x7f21700c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 >> 172.21.15.133:0/333505195 conn(0x7f2170066a70 msgr2=0x7f21700c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 shutdown_connections 2024-01-21T20:18:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.710+0000 7f217661d700 1 -- 172.21.15.133:0/333505195 wait complete. 2024-01-21T20:18:28.711 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T20:18:28.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.825+0000 7fb022e3e700 1 Processor -- start 2024-01-21T20:18:28.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.825+0000 7fb022e3e700 1 -- start start 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb022e3e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb01c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb022e3e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb01c0c6690 0x7fb01c0c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb022e3e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0c31e0 con 0x7fb01c0c5a00 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb022e3e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0a6c30 con 0x7fb01c0c6690 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb022e3e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c06bdb0 con 0x7fb01c150ba0 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb01bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb01c0c5a00 0x7fb01c0c5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40568/0 (socket says 172.21.15.133:40568) 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb01bfff700 1 -- 172.21.15.133:0/3965372092 learned_addr learned my addr 172.21.15.133:0/3965372092 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318568589 0 0) 0x7fb01c0c31e0 con 0x7fb01c0c5a00 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb020bda700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb01c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb0213db700 1 --2- 172.21.15.133:0/3965372092 >> v2:172.21.15.178:3300/0 conn(0x7fb01c0c6690 0x7fb01c0c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.826+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c0033f0 con 0x7fb01c0c5a00 2024-01-21T20:18:28.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2483372178 0 0) 0x7fb00c0033f0 con 0x7fb01c0c5a00 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 msgr2=0x7fb01c150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb01c150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 >> v2:172.21.15.178:3300/0 conn(0x7fb01c0c6690 msgr2=0x7fb01c0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 --2- 172.21.15.133:0/3965372092 >> v2:172.21.15.178:3300/0 conn(0x7fb01c0c6690 0x7fb01c0c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0c2650 con 0x7fb01c0c5a00 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb008001470 con 0x7fb01c0c5a00 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 >> v1:172.21.15.133:6789/0 conn(0x7fb01c0c5a00 legacy=0x7fb01c0c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb00c003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb00c003e40 0x7fb00c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00c004b80 0x7fb00c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0a6c30 con 0x7fb00c003e40 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c06bdb0 con 0x7fb00c004b80 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c00b8e0 con 0x7fb01c150ba0 2024-01-21T20:18:28.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb00c003e40 0x7fb00c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb020bda700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb00c003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb0213db700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00c004b80 0x7fb00c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 -- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 msgr2=0x7fb00c003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb01c150ba0 0x7fb00c003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 -- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00c004b80 msgr2=0x7fb00c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb00c004b80 0x7fb00c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 -- 172.21.15.133:0/3965372092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0033f0 con 0x7fb00c003e40 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01bfff700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb00c003e40 0x7fb00c004690 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fb00800c160 tx=0x7fb01c0c27e0).ready entity=mon.0 client_cookie=d980506e88433b08 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800ca50 con 0x7fb00c003e40 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800cbb0 con 0x7fb00c003e40 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.827+0000 7fb01b7fe700 1 -- 172.21.15.133:0/3965372092 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080070d0 con 0x7fb00c003e40 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 -- 172.21.15.133:0/3965372092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb00c003e40 msgr2=0x7fb00c004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 --2- 172.21.15.133:0/3965372092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb00c003e40 0x7fb00c004690 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7fb00800c160 tx=0x7fb01c0c27e0).stop 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb0213db700 1 -- 172.21.15.133:0/3965372092 reap_dead start 2024-01-21T20:18:28.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 -- 172.21.15.133:0/3965372092 shutdown_connections 2024-01-21T20:18:28.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 -- 172.21.15.133:0/3965372092 >> 172.21.15.133:0/3965372092 conn(0x7fb01c0c3ed0 msgr2=0x7fb01c0c42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:28.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 -- 172.21.15.133:0/3965372092 shutdown_connections 2024-01-21T20:18:28.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.828+0000 7fb022e3e700 1 -- 172.21.15.133:0/3965372092 wait complete. 2024-01-21T20:18:28.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.830+0000 7fb022e3e700 1 Processor -- start 2024-01-21T20:18:28.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.830+0000 7fb022e3e700 1 -- start start 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00c003e40 0x7fb01c141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb01c065e10 0x7fb01c163260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c066270 con 0x7fb01c15fc80 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c163fe0 con 0x7fb01c065e10 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0aa3e0 con 0x7fb00c003e40 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45274/0 (socket says 172.21.15.133:45274) 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 -- 172.21.15.133:0/4100868466 learned_addr learned my addr 172.21.15.133:0/4100868466 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb020bda700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00c003e40 0x7fb01c141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 -- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00c003e40 msgr2=0x7fb01c141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00c003e40 0x7fb01c141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb0213db700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb01c065e10 0x7fb01c163260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 -- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb01c065e10 msgr2=0x7fb01c163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:28.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb01c065e10 0x7fb01c163260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 -- 172.21.15.133:0/4100868466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0aa6c0 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb01bfff700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fb00c0045d0 tx=0x7fb008015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080046b0 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008004810 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0aa9a0 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008004b90 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.831+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c1422c0 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.832+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c0661f0 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.833+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb008013450 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.833+0000 7fb0197fa700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 0x7fb000061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.833+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fb00807b240 con 0x7fb01c15fc80 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.833+0000 7fb020bda700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 0x7fb000061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:28.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.833+0000 7fb020bda700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 0x7fb000061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb010009270 tx=0x7fb010008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:28.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:28.837+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb00804c250 con 0x7fb01c15fc80 2024-01-21T20:18:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.043+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb01c0475e0 con 0x7fb01c15fc80 2024-01-21T20:18:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.043+0000 7fb0197fa700 1 -- 172.21.15.133:0/4100868466 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb008025070 con 0x7fb01c15fc80 2024-01-21T20:18:29.032 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T20:18:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 msgr2=0x7fb000061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 0x7fb000061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb010009270 tx=0x7fb010008040).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 msgr2=0x7fb01c065920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7fb00c0045d0 tx=0x7fb008015000).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 shutdown_connections 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb00005f150 0x7fb000061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb01c065e10 0x7fb01c163260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb00c003e40 0x7fb01c141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 --2- 172.21.15.133:0/4100868466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb01c15fc80 0x7fb01c065920 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 >> 172.21.15.133:0/4100868466 conn(0x7fb01c0c3ed0 msgr2=0x7fb01c064ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 shutdown_connections 2024-01-21T20:18:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.045+0000 7fb022e3e700 1 -- 172.21.15.133:0/4100868466 wait complete. 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T20:18:29.045 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:18:29.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.045 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:18:29.063 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 41223sec preferred_lft 41223sec 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T20:18:29.064 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T20:18:29.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.065 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T20:18:29.129 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T20:18:29.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.131 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T20:18:29.189 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T20:18:29.189 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T20:18:29.189 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T20:18:29.189 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T20:18:29.189 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T20:18:29.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T20:18:29.190 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T20:18:29.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.295 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T20:18:29.311 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T20:18:29.312 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T20:18:29.312 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T20:18:29.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T20:18:29.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.379 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T20:18:29.435 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T20:18:29.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:18:29.517 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:18:29.517 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:18:29.537 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T20:18:29.537 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T20:18:29.539 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T20:18:29.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T20:18:29.539 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T20:18:29.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T20:18:29.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.777+0000 7f1280b8d700 1 Processor -- start 2024-01-21T20:18:29.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.778+0000 7f1280b8d700 1 -- start start 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f1280b8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 0x7f127c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f1280b8d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f127c1563c0 0x7f127c0bde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f1280b8d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c0c61a0 con 0x7f127c0c3c60 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f1280b8d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0c5350 con 0x7f127c1563c0 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f1280b8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c55d0 con 0x7f127c1351d0 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f127c1563c0 0x7f127c0bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f127c1563c0 0x7f127c0bde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45282/0 (socket says 172.21.15.133:45282) 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 -- 172.21.15.133:0/2776442487 learned_addr learned my addr 172.21.15.133:0/2776442487 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 -- 172.21.15.133:0/2776442487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 msgr2=0x7f127c0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127a59c700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 0x7f127c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 0x7f127c0c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 -- 172.21.15.133:0/2776442487 >> v1:172.21.15.178:6789/0 conn(0x7f127c0c3c60 legacy=0x7f127c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 -- 172.21.15.133:0/2776442487 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c0c5870 con 0x7f127c1563c0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127a59c700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 0x7f127c0c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127ad9d700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0bde60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f1274009f20 tx=0x7f1274009840).ready entity=mon.0 client_cookie=1a18b812315999d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127959a700 1 -- 172.21.15.133:0/2776442487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400e070 con 0x7f127c1563c0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127959a700 1 -- 172.21.15.133:0/2776442487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400ba40 con 0x7f127c1563c0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.779+0000 7f127959a700 1 -- 172.21.15.133:0/2776442487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bdc0 con 0x7f127c1563c0 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 -- 172.21.15.133:0/2776442487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 msgr2=0x7f127c0bde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0bde60 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f1274009f20 tx=0x7f1274009840).stop 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 -- 172.21.15.133:0/2776442487 shutdown_connections 2024-01-21T20:18:29.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0bde60 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 --2- 172.21.15.133:0/2776442487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c1351d0 0x7f127c0c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 -- 172.21.15.133:0/2776442487 >> 172.21.15.133:0/2776442487 conn(0x7f127c066a90 msgr2=0x7f127c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:29.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 -- 172.21.15.133:0/2776442487 shutdown_connections 2024-01-21T20:18:29.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.780+0000 7f1280b8d700 1 -- 172.21.15.133:0/2776442487 wait complete. 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.781+0000 7f1280b8d700 1 Processor -- start 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.781+0000 7f1280b8d700 1 -- start start 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c0c3c60 0x7f127c152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f127c1351d0 0x7f127c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c7c10 con 0x7f127c1563c0 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c7e90 con 0x7f127c1351d0 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1280b8d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c0c8170 con 0x7f127c0c3c60 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f127ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f127ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45292/0 (socket says 172.21.15.133:45292) 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f127ad9d700 1 -- 172.21.15.133:0/3985577605 learned_addr learned my addr 172.21.15.133:0/3985577605 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f127a59c700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c0c3c60 0x7f127c152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.782+0000 7f1279d9b700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f127c1351d0 0x7f127c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 -- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c0c3c60 msgr2=0x7f127c152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c0c3c60 0x7f127c152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 -- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f127c1351d0 msgr2=0x7f127c0c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f127c1351d0 0x7f127c0c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 -- 172.21.15.133:0/3985577605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009ae0 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f127ad9d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f127c066530 tx=0x7f1274009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740092e0 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274007610 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c0c8450 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740079b0 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.783+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c0c8a10 con 0x7f127c1563c0 2024-01-21T20:18:29.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.784+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c0c8c00 con 0x7f127c1563c0 2024-01-21T20:18:29.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.784+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1274003040 con 0x7f127c1563c0 2024-01-21T20:18:29.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.785+0000 7f1272ffd700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 0x7f125c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:29.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.785+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f127407c230 con 0x7f127c1563c0 2024-01-21T20:18:29.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.785+0000 7f127a59c700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 0x7f125c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:29.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.785+0000 7f127a59c700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 0x7f125c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f126c00a9d0 tx=0x7f126c008040).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:29.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.789+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f127404d2a0 con 0x7f127c1563c0 2024-01-21T20:18:29.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.976+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c0c5b50 con 0x7f125c05f150 2024-01-21T20:18:29.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.977+0000 7f1272ffd700 1 -- 172.21.15.133:0/3985577605 <== mgr.7902 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f127c0c5b50 con 0x7f125c05f150 2024-01-21T20:18:29.966 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T20:18:29.967 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T20:18:29.967 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T20:18:29.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T20:18:29.967 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T20:18:29.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 msgr2=0x7f125c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 0x7f125c061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f126c00a9d0 tx=0x7f126c008040).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 msgr2=0x7f127c0c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f127c066530 tx=0x7f1274009840).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 shutdown_connections 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f125c05f150 0x7f125c061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f127c1563c0 0x7f127c0c8f30 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f127c0c3c60 0x7f127c152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 --2- 172.21.15.133:0/3985577605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f127c1351d0 0x7f127c0c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 >> 172.21.15.133:0/3985577605 conn(0x7f127c066a90 msgr2=0x7f127c139b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 shutdown_connections 2024-01-21T20:18:29.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:29.979+0000 7f1280b8d700 1 -- 172.21.15.133:0/3985577605 wait complete. 2024-01-21T20:18:29.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T20:18:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.109+0000 7fb845cfe700 1 Processor -- start 2024-01-21T20:18:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.109+0000 7fb845cfe700 1 -- start start 2024-01-21T20:18:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.110+0000 7fb845cfe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb840152380 0x7fb8400a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.110+0000 7fb845cfe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8400626f0 0x7fb840062b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb845cfe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb840069ca0 con 0x7fb840151fa0 2024-01-21T20:18:30.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb845cfe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb840063050 con 0x7fb8400626f0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb845cfe700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400c6a40 con 0x7fb840152380 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8400626f0 0x7fb840062b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8400626f0 0x7fb840062b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45308/0 (socket says 172.21.15.133:45308) 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 -- 172.21.15.133:0/1787122207 learned_addr learned my addr 172.21.15.133:0/1787122207 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83effd700 1 --2- 172.21.15.133:0/1787122207 >> v2:172.21.15.178:3300/0 conn(0x7fb840152380 0x7fb8400a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 -- 172.21.15.133:0/1787122207 >> v2:172.21.15.178:3300/0 conn(0x7fb840152380 msgr2=0x7fb8400a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 --2- 172.21.15.133:0/1787122207 >> v2:172.21.15.178:3300/0 conn(0x7fb840152380 0x7fb8400a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 -- 172.21.15.133:0/1787122207 >> v1:172.21.15.178:6789/0 conn(0x7fb840151fa0 legacy=0x7fb8400bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 -- 172.21.15.133:0/1787122207 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840069650 con 0x7fb8400626f0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83ffff700 1 --2- 172.21.15.133:0/1787122207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb840062b60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fb8400c7db0 tx=0x7fb838009840).ready entity=mon.0 client_cookie=d26551d62a2d9229 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83e7fc700 1 -- 172.21.15.133:0/1787122207 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800e070 con 0x7fb8400626f0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83e7fc700 1 -- 172.21.15.133:0/1787122207 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800ba20 con 0x7fb8400626f0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.111+0000 7fb83e7fc700 1 -- 172.21.15.133:0/1787122207 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800bda0 con 0x7fb8400626f0 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 -- 172.21.15.133:0/1787122207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 msgr2=0x7fb840062b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1787122207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb840062b60 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fb8400c7db0 tx=0x7fb838009840).stop 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 -- 172.21.15.133:0/1787122207 shutdown_connections 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1787122207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb840062b60 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1787122207 >> v2:172.21.15.178:3300/0 conn(0x7fb840152380 0x7fb8400a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 -- 172.21.15.133:0/1787122207 >> 172.21.15.133:0/1787122207 conn(0x7fb8400c7de0 msgr2=0x7fb8400c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 -- 172.21.15.133:0/1787122207 shutdown_connections 2024-01-21T20:18:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.112+0000 7fb845cfe700 1 -- 172.21.15.133:0/1787122207 wait complete. 2024-01-21T20:18:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.113+0000 7fb845cfe700 1 Processor -- start 2024-01-21T20:18:30.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.113+0000 7fb845cfe700 1 -- start start 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb840151fa0 0x7fb8400aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb840152380 0x7fb8400ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c1ce0 con 0x7fb8400626f0 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c08f0 con 0x7fb840151fa0 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb845cfe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400bfce0 con 0x7fb840152380 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:45316/0 (socket says 172.21.15.133:45316) 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 -- 172.21.15.133:0/1049049916 learned_addr learned my addr 172.21.15.133:0/1049049916 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83effd700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb840151fa0 0x7fb8400aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83ffff700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb840152380 0x7fb8400ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 -- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb840152380 msgr2=0x7fb8400ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb840152380 0x7fb8400ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 -- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb840151fa0 msgr2=0x7fb8400aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.114+0000 7fb83f7fe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb840151fa0 0x7fb8400aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb83f7fe700 1 -- 172.21.15.133:0/1049049916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009ae0 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb83f7fe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb83000c4c0 tx=0x7fb830007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000ce70 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb830001e90 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400bffc0 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830007250 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.115+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400c0600 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.116+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400c1620 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.116+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 58) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb8300066a0 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.116+0000 7fb827fff700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.117+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7fb830079cc0 con 0x7fb8400626f0 2024-01-21T20:18:30.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.117+0000 7fb83effd700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:30.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.117+0000 7fb83effd700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 0x7fb82c061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8400abd70 tx=0x7fb834009060).ready entity=mgr.7902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:30.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.121+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb83004ad30 con 0x7fb8400626f0 2024-01-21T20:18:30.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:30.328+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb8400a80f0 con 0x7fb8400626f0 2024-01-21T20:18:31.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.117+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 59) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fb830077830 con 0x7fb8400626f0 2024-01-21T20:18:31.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.119+0000 7fb827fff700 1 -- 172.21.15.133:0/1049049916 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb830071b00 con 0x7fb8400626f0 2024-01-21T20:18:31.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 msgr2=0x7fb82c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 0x7fb82c061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb8400abd70 tx=0x7fb834009060).stop 2024-01-21T20:18:31.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 msgr2=0x7fb8400c1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7fb83000c4c0 tx=0x7fb830007e00).stop 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 shutdown_connections 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb82c05f150 0x7fb82c061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb840152380 0x7fb8400ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8400626f0 0x7fb8400c1070 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 --2- 172.21.15.133:0/1049049916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb840151fa0 0x7fb8400aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 >> 172.21.15.133:0/1049049916 conn(0x7fb8400c7de0 msgr2=0x7fb8400a5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.122+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 shutdown_connections 2024-01-21T20:18:31.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.123+0000 7fb845cfe700 1 -- 172.21.15.133:0/1049049916 wait complete. 2024-01-21T20:18:31.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T20:18:31.248 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:31.259+0000 7f6bcc774680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:18:31.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.268+0000 7f0ac2980700 1 Processor -- start 2024-01-21T20:18:31.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.268+0000 7f0ac2980700 1 -- start start 2024-01-21T20:18:31.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.268+0000 7f0ac2980700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 0x7f0abc067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac2980700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc0c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac2980700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0c6290 con 0x7f0abc137410 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac2980700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc068370 con 0x7f0abc137030 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac2980700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc068650 con 0x7f0abc0c5930 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abbfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 0x7f0abc067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc0c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abb7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0abc137410 0x7f0abc155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:58372/0 (socket says 172.21.15.133:58372) 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abb7fe700 1 -- 172.21.15.133:0/434866100 learned_addr learned my addr 172.21.15.133:0/434866100 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abaffd700 1 -- 172.21.15.133:0/434866100 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524631535 0 0) 0x7f0abc0c6290 con 0x7f0abc137410 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abaffd700 1 -- 172.21.15.133:0/434866100 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa40033f0 con 0x7f0abc137410 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 -- 172.21.15.133:0/434866100 >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 msgr2=0x7f0abc067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 --2- 172.21.15.133:0/434866100 >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 0x7f0abc067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 -- 172.21.15.133:0/434866100 >> v1:172.21.15.178:6789/0 conn(0x7f0abc137410 legacy=0x7f0abc155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 -- 172.21.15.133:0/434866100 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc068930 con 0x7f0abc0c5930 2024-01-21T20:18:31.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0abbfff700 1 --2- 172.21.15.133:0/434866100 >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 0x7f0abc067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T20:18:31.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.269+0000 7f0ac0f1d700 1 --2- 172.21.15.133:0/434866100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc0c5da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ab4009e60 tx=0x7f0ab4009780).ready entity=mon.2 client_cookie=d1d1917664071777 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:31.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0abaffd700 1 -- 172.21.15.133:0/434866100 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400e070 con 0x7f0abc0c5930 2024-01-21T20:18:31.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0abaffd700 1 -- 172.21.15.133:0/434866100 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab400bab0 con 0x7f0abc0c5930 2024-01-21T20:18:31.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0abaffd700 1 -- 172.21.15.133:0/434866100 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400be30 con 0x7f0abc0c5930 2024-01-21T20:18:31.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 -- 172.21.15.133:0/434866100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 msgr2=0x7f0abc0c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 --2- 172.21.15.133:0/434866100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc0c5da0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ab4009e60 tx=0x7f0ab4009780).stop 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 -- 172.21.15.133:0/434866100 shutdown_connections 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 --2- 172.21.15.133:0/434866100 >> v2:172.21.15.178:3300/0 conn(0x7f0abc137030 0x7f0abc067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 --2- 172.21.15.133:0/434866100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc0c5da0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 -- 172.21.15.133:0/434866100 >> 172.21.15.133:0/434866100 conn(0x7f0abc066a90 msgr2=0x7f0abc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 -- 172.21.15.133:0/434866100 shutdown_connections 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.270+0000 7f0ac2980700 1 -- 172.21.15.133:0/434866100 wait complete. 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.271+0000 7f0ac2980700 1 Processor -- start 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 -- start start 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 0x7f0abc13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0abc137410 0x7f0abc13d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc13de80 con 0x7f0abc137030 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0ac400 con 0x7f0abc137410 2024-01-21T20:18:31.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0ac2980700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc164ac0 con 0x7f0abc0c5930 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.272+0000 7f0abb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 0x7f0abc13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ac0f1d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0abc137410 0x7f0abc13d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 0x7f0abc13d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43670/0 (socket says 172.21.15.133:43670) 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abb7fe700 1 -- 172.21.15.133:0/3821078543 learned_addr learned my addr 172.21.15.133:0/3821078543 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:46090/0 (socket says 172.21.15.133:46090) 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 -- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0abc137410 msgr2=0x7f0abc13d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0abc137410 0x7f0abc13d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 -- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 msgr2=0x7f0abc13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 0x7f0abc13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 -- 172.21.15.133:0/3821078543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0092a0 con 0x7f0abc0c5930 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0abbfff700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0aac00e980 tx=0x7f0aac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:31.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac012600 con 0x7f0abc0c5930 2024-01-21T20:18:31.265 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f4214465680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac012760 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab4009a20 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac012ae0 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.273+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc1644f0 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.274+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc05fdf0 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.275+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 59) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f0aac01b400 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.275+0000 7f0ab8ff9700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 0x7f0aa8061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.275+0000 7f0abb7fe700 1 -- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 msgr2=0x7f0aa8061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.275+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f0aac07a8e0 con 0x7f0abc0c5930 2024-01-21T20:18:31.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.275+0000 7f0abb7fe700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 0x7f0aa8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:31.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.279+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0aac04b8f0 con 0x7f0abc0c5930 2024-01-21T20:18:31.313 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:31.323+0000 7f6bcc774680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:18:31.328 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:31.340+0000 7f4214465680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T20:18:31.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.451+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0abc06bd20 con 0x7f0abc0c5930 2024-01-21T20:18:31.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.456+0000 7f0ab8ff9700 1 -- 172.21.15.133:0/3821078543 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v27)=0 v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0aac016020 con 0x7f0abc0c5930 2024-01-21T20:18:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 msgr2=0x7f0aa8061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 0x7f0aa8061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 msgr2=0x7f0abc136710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f0aac00e980 tx=0x7f0aac009060).stop 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 shutdown_connections 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0aa805f1a0 0x7f0aa8061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0abc137410 0x7f0abc13d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0abc0c5930 0x7f0abc136710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 --2- 172.21.15.133:0/3821078543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0abc137030 0x7f0abc13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 >> 172.21.15.133:0/3821078543 conn(0x7f0abc066a90 msgr2=0x7f0abc155290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 shutdown_connections 2024-01-21T20:18:31.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.458+0000 7f0ac2980700 1 -- 172.21.15.133:0/3821078543 wait complete. 2024-01-21T20:18:31.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T20:18:31.459 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T20:18:31.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2024-01-21T20:18:31.586 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:31.597+0000 7f6bcc774680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:18:31.621 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:31.632+0000 7f4214465680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T20:18:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.656+0000 7f1f44fbf700 1 Processor -- start 2024-01-21T20:18:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.656+0000 7f1f44fbf700 1 -- start start 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f44fbf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f400c0a70 0x7f1f400c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f44fbf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f400c1410 con 0x7f1f4014e8d0 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f44fbf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f400c9040 con 0x7f1f4014ecb0 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f44fbf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f400c9290 con 0x7f1f400c0a70 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f3ed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f400c0a70 0x7f1f400c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f3e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1f4014e8d0 0x7f1f4005e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56524/0 (socket says 172.21.15.133:56524) 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.657+0000 7f1f3e59c700 1 -- 172.21.15.133:0/293910790 learned_addr learned my addr 172.21.15.133:0/293910790 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/293910790 >> v1:172.21.15.178:6789/0 conn(0x7f1f4014ecb0 legacy=0x7f1f40155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/293910790 >> v1:172.21.15.133:6789/0 conn(0x7f1f4014e8d0 legacy=0x7f1f4005e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3d59a700 1 -- 172.21.15.133:0/293910790 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49352568 0 0) 0x7f1f30001110 con 0x7f1f4014e8d0 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/293910790 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400c9570 con 0x7f1f400c0a70 2024-01-21T20:18:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3ed9d700 1 --2- 172.21.15.133:0/293910790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400c0a70 0x7f1f400c0f20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f1f38009e60 tx=0x7f1f38009780).ready entity=mon.0 client_cookie=613fe9ca511d9e63 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3d59a700 1 -- 172.21.15.133:0/293910790 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3800e070 con 0x7f1f400c0a70 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3d59a700 1 -- 172.21.15.133:0/293910790 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3800bc30 con 0x7f1f400c0a70 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.658+0000 7f1f3d59a700 1 -- 172.21.15.133:0/293910790 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38012410 con 0x7f1f400c0a70 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 -- 172.21.15.133:0/293910790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400c0a70 msgr2=0x7f1f400c0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/293910790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400c0a70 0x7f1f400c0f20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f1f38009e60 tx=0x7f1f38009780).stop 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 -- 172.21.15.133:0/293910790 shutdown_connections 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/293910790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f400c0a70 0x7f1f400c0f20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 -- 172.21.15.133:0/293910790 >> 172.21.15.133:0/293910790 conn(0x7f1f40084eb0 msgr2=0x7f1f400947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 -- 172.21.15.133:0/293910790 shutdown_connections 2024-01-21T20:18:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.659+0000 7f1f44fbf700 1 -- 172.21.15.133:0/293910790 wait complete. 2024-01-21T20:18:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.661+0000 7f1f44fbf700 1 Processor -- start 2024-01-21T20:18:31.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.661+0000 7f1f44fbf700 1 -- start start 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.661+0000 7f1f44fbf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f400c0a70 0x7f1f400ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f44fbf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f4014e8d0 0x7f1f40167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f44fbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f44fbf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400c5090 con 0x7f1f4014ecb0 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f44fbf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400c4b60 con 0x7f1f400c0a70 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f44fbf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400afee0 con 0x7f1f4014e8d0 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43674/0 (socket says 172.21.15.133:43674) 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/2950854820 learned_addr learned my addr 172.21.15.133:0/2950854820 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f400c0a70 0x7f1f400ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3dd9b700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f4014e8d0 0x7f1f40167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f4014e8d0 msgr2=0x7f1f40167af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f4014e8d0 0x7f1f40167af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f400c0a70 msgr2=0x7f1f400ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f400c0a70 0x7f1f400ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38009a20 con 0x7f1f4014ecb0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.662+0000 7f1f3ed9d700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f1f3800b6c0 tx=0x7f1f38009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.663+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380063d0 con 0x7f1f4014ecb0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.663+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38006530 con 0x7f1f4014ecb0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.663+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380068d0 con 0x7f1f4014ecb0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.663+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f400c4db0 con 0x7f1f4014ecb0 2024-01-21T20:18:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.663+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f400b0460 con 0x7f1f4014ecb0 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f400afd20 con 0x7f1f4014ecb0 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 59) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f1f38027460 con 0x7f1f4014ecb0 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f2effd700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f3e59c700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f1f3807c810 con 0x7f1f4014ecb0 2024-01-21T20:18:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.664+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T20:18:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.668+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1f3804d820 con 0x7f1f4014ecb0 2024-01-21T20:18:31.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.865+0000 7f1f3e59c700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:31.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.865+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T20:18:31.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:31.865+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f4005fdf0 con 0x7f1f2005f1a0 2024-01-21T20:18:32.199 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:32.209+0000 7f6bcc774680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:18:32.245 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:32.256+0000 7f4214465680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T20:18:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:32.266+0000 7f1f3e59c700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:32.266+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T20:18:32.270 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:32.281+0000 7f6bcc774680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:18:32.317 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:32.328+0000 7f4214465680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T20:18:32.456 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:32.467+0000 7f6bcc774680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:18:32.504 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:32.515+0000 7f4214465680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T20:18:32.877 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:32.888+0000 7f6bcc774680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:18:32.924 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:32.935+0000 7f4214465680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T20:18:32.980 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:32.991+0000 7f6bcc774680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:33.027 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.038+0000 7f4214465680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:33.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:33.067+0000 7f1f3e59c700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:33.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:33.067+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T20:18:33.134 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:33.145+0000 7f6bcc774680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:33.182 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.194+0000 7f4214465680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:33.209 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:33.220+0000 7f6bcc774680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:18:33.257 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.268+0000 7f4214465680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T20:18:33.277 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:33.288+0000 7f6bcc774680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:18:33.325 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.336+0000 7f4214465680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T20:18:33.532 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:33.543+0000 7f6bcc774680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:18:33.579 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.590+0000 7f4214465680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T20:18:33.714 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:33.725+0000 7f6bcc774680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:33.771 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:33.782+0000 7f4214465680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T20:18:34.364 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.375+0000 7f6bcc774680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:18:34.423 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.434+0000 7f4214465680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T20:18:34.433 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.443+0000 7f6bcc774680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:18:34.491 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.503+0000 7f4214465680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T20:18:34.508 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.519+0000 7f6bcc774680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:18:34.567 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.578+0000 7f4214465680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T20:18:34.654 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.665+0000 7f6bcc774680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:18:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:34.668+0000 7f1f3e59c700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T20:18:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:34.668+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T20:18:34.715 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.726+0000 7f4214465680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T20:18:34.725 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.736+0000 7f6bcc774680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:18:34.785 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.797+0000 7f4214465680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T20:18:34.840 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.851+0000 7f6bcc774680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:18:34.900 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:34.912+0000 7f4214465680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T20:18:34.947 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:34.958+0000 7f6bcc774680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:35.009 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.020+0000 7f4214465680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T20:18:35.239 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:35.250+0000 7f6bcc774680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:18:35.304 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.315+0000 7f4214465680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T20:18:35.311 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T20:18:35.322+0000 7f6bcc774680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:18:35.376 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.387+0000 7f4214465680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T20:18:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:35.391+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 60) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f1f3807a380 con 0x7f1f4014ecb0 2024-01-21T20:18:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:35.408+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 61) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f1f3807a700 con 0x7f1f4014ecb0 2024-01-21T20:18:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:35.408+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f20061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T20:18:35.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:35.408+0000 7f1f2effd700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f20061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f4188205700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f4188205700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f4188205700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f4188205700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f4188205700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f418aa0a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f418aa0a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.462+0000 7f418aa0a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.463+0000 7f418aa0a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:35.452 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:18:35.463+0000 7f418aa0a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:18:36.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.409+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mon.0 v2:172.21.15.133:3300/0 9 ==== mgrmap(e 62) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f1f38076550 con 0x7f1f4014ecb0 2024-01-21T20:18:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.410+0000 7f1f2effd700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f200615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.410+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f4005fdf0 con 0x7f1f2005f1a0 2024-01-21T20:18:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.411+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f200615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.413+0000 7f1f3e59c700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f200615e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1f30000c00 tx=0x7f1f300079f0).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.424+0000 7f1f2effd700 1 -- 172.21.15.133:0/2950854820 <== mgr.7483 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f1f4005fdf0 con 0x7f1f2005f1a0 2024-01-21T20:18:36.413 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 msgr2=0x7f1f200615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f200615e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f1f30000c00 tx=0x7f1f300079f0).stop 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 msgr2=0x7f1f40167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f1f3800b6c0 tx=0x7f1f38009780).stop 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 shutdown_connections 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1f2005f1a0 0x7f1f200615e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f4014ecb0 0x7f1f40167fe0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f400c0a70 0x7f1f400ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 --2- 172.21.15.133:0/2950854820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f4014e8d0 0x7f1f40167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 >> 172.21.15.133:0/2950854820 conn(0x7f1f40084eb0 msgr2=0x7f1f400a9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 shutdown_connections 2024-01-21T20:18:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.427+0000 7f1f44fbf700 1 -- 172.21.15.133:0/2950854820 wait complete. 2024-01-21T20:18:36.430 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2024-01-21T20:18:36.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2024-01-21T20:18:36.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.567+0000 7f7499910700 1 Processor -- start 2024-01-21T20:18:36.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.567+0000 7f7499910700 1 -- start start 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749413a620 0x7f74940a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f749413aa00 0x7f7494158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74940626f0 0x7f7494062b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74940bd6f0 con 0x7f749413a620 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74941584f0 con 0x7f749413aa00 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7499910700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74940654e0 con 0x7f74940626f0 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7492ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749413a620 0x7f74940a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7492ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749413a620 0x7f74940a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43772/0 (socket says 172.21.15.133:43772) 2024-01-21T20:18:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.568+0000 7f7492ffd700 1 -- 172.21.15.133:0/3301027455 learned_addr learned my addr 172.21.15.133:0/3301027455 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f74937fe700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74940626f0 0x7f7494062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f74927fc700 1 --2- 172.21.15.133:0/3301027455 >> v2:172.21.15.178:3300/0 conn(0x7f749413aa00 0x7f7494158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 -- 172.21.15.133:0/3301027455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74940626f0 msgr2=0x7f7494062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74940626f0 0x7f7494062b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 -- 172.21.15.133:0/3301027455 >> v2:172.21.15.178:3300/0 conn(0x7f749413aa00 msgr2=0x7f7494158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 --2- 172.21.15.133:0/3301027455 >> v2:172.21.15.178:3300/0 conn(0x7f749413aa00 0x7f7494158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 -- 172.21.15.133:0/3301027455 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494063070 con 0x7f749413a620 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7492ffd700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74940a6e30 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f749413e3f0 tx=0x7f74880090f0).ready entity=mon.0 client_cookie=2be4fc335d3ff1b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7491ffb700 1 -- 172.21.15.133:0/3301027455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800b600 con 0x7f749413a620 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7491ffb700 1 -- 172.21.15.133:0/3301027455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748800b760 con 0x7f749413a620 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7491ffb700 1 -- 172.21.15.133:0/3301027455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800bb00 con 0x7f749413a620 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 -- 172.21.15.133:0/3301027455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 msgr2=0x7f74940a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74940a6e30 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7f749413e3f0 tx=0x7f74880090f0).stop 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 -- 172.21.15.133:0/3301027455 shutdown_connections 2024-01-21T20:18:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74940626f0 0x7f7494062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 --2- 172.21.15.133:0/3301027455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74940a6e30 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 --2- 172.21.15.133:0/3301027455 >> v2:172.21.15.178:3300/0 conn(0x7f749413aa00 0x7f7494158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.569+0000 7f7499910700 1 -- 172.21.15.133:0/3301027455 >> 172.21.15.133:0/3301027455 conn(0x7f74940c7dc0 msgr2=0x7f74940c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.570+0000 7f7499910700 1 -- 172.21.15.133:0/3301027455 shutdown_connections 2024-01-21T20:18:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.570+0000 7f7499910700 1 -- 172.21.15.133:0/3301027455 wait complete. 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.571+0000 7f7499910700 1 Processor -- start 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.571+0000 7f7499910700 1 -- start start 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74940626f0 0x7f74940ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f749413aa00 0x7f74940c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74940a7b80 con 0x7f749413a620 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74940a7e60 con 0x7f74940626f0 2024-01-21T20:18:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74940a8140 con 0x7f749413aa00 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43780/0 (socket says 172.21.15.133:43780) 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7492ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74940626f0 0x7f74940ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 -- 172.21.15.133:0/1428254811 learned_addr learned my addr 172.21.15.133:0/1428254811 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74937fe700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f749413aa00 0x7f74940c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 -- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f749413aa00 msgr2=0x7f74940c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f749413aa00 0x7f74940c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 -- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74940626f0 msgr2=0x7f74940ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74940626f0 0x7f74940ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 -- 172.21.15.133:0/1428254811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009370 con 0x7f749413a620 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f74927fc700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f748400d890 tx=0x7f7484008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011590 con 0x7f749413a620 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840116f0 con 0x7f749413a620 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484011a70 con 0x7f749413a620 2024-01-21T20:18:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74940a8420 con 0x7f749413a620 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.572+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7494139dd0 con 0x7f749413a620 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.574+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74940aae00 con 0x7f749413a620 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.574+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 62) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f7484012420 con 0x7f749413a620 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.574+0000 7f747b7fe700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 0x7f7480061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.574+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f7484079b90 con 0x7f749413a620 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.574+0000 7f7492ffd700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 0x7f7480061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.575+0000 7f7492ffd700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 0x7f7480061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f748800b3c0 tx=0x7f7488017000).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.578+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f74940aae00 con 0x7f749413a620 2024-01-21T20:18:36.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.766+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f74940aae00 con 0x7f748005f080 2024-01-21T20:18:36.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.770+0000 7f747b7fe700 1 -- 172.21.15.133:0/1428254811 <== mgr.7483 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f74940aae00 con 0x7f748005f080 2024-01-21T20:18:36.759 INFO:teuthology.orchestra.run.smithi133.stdout:Retention added to path /snap_test_dir1 2024-01-21T20:18:36.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 msgr2=0x7f7480061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 0x7f7480061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f748800b3c0 tx=0x7f7488017000).stop 2024-01-21T20:18:36.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 msgr2=0x7f74941398e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f748400d890 tx=0x7f7484008040).stop 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 shutdown_connections 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f748005f080 0x7f7480061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f749413aa00 0x7f74940c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74940626f0 0x7f74940ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 --2- 172.21.15.133:0/1428254811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749413a620 0x7f74941398e0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 >> 172.21.15.133:0/1428254811 conn(0x7f74940c7dc0 msgr2=0x7f7494156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 shutdown_connections 2024-01-21T20:18:36.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.772+0000 7f7499910700 1 -- 172.21.15.133:0/1428254811 wait complete. 2024-01-21T20:18:36.773 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2024-01-21T20:18:36.773 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2024-01-21T20:18:36.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2024-01-21T20:18:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.904+0000 7f3ae5987700 1 Processor -- start 2024-01-21T20:18:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.904+0000 7f3ae5987700 1 -- start start 2024-01-21T20:18:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ae5987700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ae01371f0 0x7f3ae0066970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ae5987700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae0154a90 con 0x7f3ae01375d0 2024-01-21T20:18:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ae5987700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae0154d70 con 0x7f3ae0063f10 2024-01-21T20:18:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ae5987700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae0155050 con 0x7f3ae01371f0 2024-01-21T20:18:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ade7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3ae01375d0 0x7f3ae0063800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56530/0 (socket says 172.21.15.133:56530) 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3ade7fc700 1 -- 172.21.15.133:0/3481305406 learned_addr learned my addr 172.21.15.133:0/3481305406 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3481305406 >> v2:172.21.15.178:3300/0 conn(0x7f3ae01371f0 0x7f3ae0066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433229783 0 0) 0x7f3ae0154a90 con 0x7f3ae01375d0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac80033f0 con 0x7f3ae01375d0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595007814 0 0) 0x7f3ac80033f0 con 0x7f3ae01375d0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 >> v2:172.21.15.178:3300/0 conn(0x7f3ae01371f0 msgr2=0x7f3ae0066970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 --2- 172.21.15.133:0/3481305406 >> v2:172.21.15.178:3300/0 conn(0x7f3ae01371f0 0x7f3ae0066970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 >> v1:172.21.15.178:6789/0 conn(0x7f3ae0063f10 legacy=0x7f3ae0067eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae0155330 con 0x7f3ae01375d0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.905+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3ad0001470 con 0x7f3ae01375d0 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 >> v1:172.21.15.133:6789/0 conn(0x7f3ae01375d0 legacy=0x7f3ae0063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 0x7f3ac8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac8004690 0x7f3ac8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ac8005000 0x7f3ac800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0155050 con 0x7f3ac80038e0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800bf60 con 0x7f3ac8005000 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800c0f0 con 0x7f3ac8004690 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 0x7f3ac8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3ade7fc700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac8004690 0x7f3ac8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adf7fe700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ac8005000 0x7f3ac800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 -- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac8004690 msgr2=0x7f3ac8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac8004690 0x7f3ac8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 -- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ac8005000 msgr2=0x7f3ac800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ac8005000 0x7f3ac800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adf7fe700 1 -- 172.21.15.133:0/3481305406 reap_dead start 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 -- 172.21.15.133:0/3481305406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80033f0 con 0x7f3ac80038e0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 0x7f3ac8003d00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f3ad4009a60 tx=0x7f3ad4009060).ready entity=mon.0 client_cookie=9ee028a2a19a5ba server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4009ea0 con 0x7f3ac80038e0 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad4009430 con 0x7f3ac80038e0 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.906+0000 7f3addffb700 1 -- 172.21.15.133:0/3481305406 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400e870 con 0x7f3ac80038e0 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 -- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 msgr2=0x7f3ac8003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 0x7f3ac8003d00 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7f3ad4009a60 tx=0x7f3ad4009060).stop 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 -- 172.21.15.133:0/3481305406 shutdown_connections 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3481305406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ac80038e0 0x7f3ac8003d00 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 -- 172.21.15.133:0/3481305406 >> 172.21.15.133:0/3481305406 conn(0x7f3ae00c8f00 msgr2=0x7f3ae00c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 -- 172.21.15.133:0/3481305406 shutdown_connections 2024-01-21T20:18:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.907+0000 7f3ae5987700 1 -- 172.21.15.133:0/3481305406 wait complete. 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.908+0000 7f3ae5987700 1 Processor -- start 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.908+0000 7f3ae5987700 1 -- start start 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac80038e0 0x7f3ae0167eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ae00ac450 0x7f3ae01683a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0134e70 con 0x7f3ae00adb70 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0168890 con 0x7f3ae00ac450 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae014f740 con 0x7f3ac80038e0 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43804/0 (socket says 172.21.15.133:43804) 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 -- 172.21.15.133:0/3014825966 learned_addr learned my addr 172.21.15.133:0/3014825966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ade7fc700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ae00ac450 0x7f3ae01683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac80038e0 0x7f3ae0167eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 -- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac80038e0 msgr2=0x7f3ae0167eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac80038e0 0x7f3ae0167eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 -- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ae00ac450 msgr2=0x7f3ae01683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ae00ac450 0x7f3ae01683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 -- 172.21.15.133:0/3014825966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae01345d0 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3adf7fe700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f3ae006a190 tx=0x7f3ad8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003030 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8003190 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae01348b0 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.909+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8001580 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.910+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae00ae4a0 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.910+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae014f510 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.911+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 62) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f3ad8001930 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.911+0000 7f3ac77fe700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 0x7f3acc061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.911+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6905+0+0 (secure 0 0 0) 0x7f3ad80796b0 con 0x7f3ae00adb70 2024-01-21T20:18:36.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.911+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 0x7f3acc061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T20:18:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.911+0000 7f3adeffd700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 0x7f3acc061570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3ad4006d50 tx=0x7f3ad401a000).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T20:18:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:36.915+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3ae014f510 con 0x7f3ae00adb70 2024-01-21T20:18:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.102+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ae014f510 con 0x7f3acc05f0b0 2024-01-21T20:18:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.104+0000 7f3ac77fe700 1 -- 172.21.15.133:0/3014825966 <== mgr.7483 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f3ae014f510 con 0x7f3acc05f0b0 2024-01-21T20:18:37.093 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T20:18:37.093 INFO:teuthology.orchestra.run.smithi133.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2024-01-21T20:18:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 msgr2=0x7f3acc061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 0x7f3acc061570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3ad4006d50 tx=0x7f3ad401a000).stop 2024-01-21T20:18:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 msgr2=0x7f3ae00adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T20:18:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f3ae006a190 tx=0x7f3ad8009040).stop 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 shutdown_connections 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3acc05f0b0 0x7f3acc061570 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ae00adb70 0x7f3ae00adfb0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ac80038e0 0x7f3ae0167eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 --2- 172.21.15.133:0/3014825966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ae00ac450 0x7f3ae01683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 >> 172.21.15.133:0/3014825966 conn(0x7f3ae00c8f00 msgr2=0x7f3ae0157180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 shutdown_connections 2024-01-21T20:18:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T20:18:37.106+0000 7f3ae5987700 1 -- 172.21.15.133:0/3014825966 wait complete. 2024-01-21T20:18:37.107 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2024-01-21T20:18:37.107 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2024-01-21T20:18:48.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:18:48.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:19:00.764 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:19:00.775+0000 7f417a1e9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:19:00.764 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:19:00.775+0000 7f417a1e9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:19:00.764 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:19:00.775+0000 7f417a1e9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:19:00.764 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:19:00.775+0000 7f417a1e9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:19:00.764 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T20:19:00.775+0000 7f417a1e9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T20:19:18.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:19:18.361 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:19:48.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:19:48.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:20:18.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:20:18.529 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:20:48.620 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:20:48.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:21:18.694 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:21:18.697 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:21:48.813 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:21:48.816 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:22:18.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:22:18.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:22:49.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:22:49.101 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:23:19.377 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:23:19.380 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:23:49.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:23:49.535 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:24:19.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:24:19.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:24:49.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:24:49.752 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:25:19.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:25:19.872 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:25:49.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:25:49.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:26:20.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:26:20.115 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:26:50.274 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:26:50.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:27:20.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:27:20.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:27:50.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:27:50.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:28:20.837 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:28:20.840 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:28:50.930 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:28:50.933 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:29:21.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:29:21.048 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:29:51.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:29:51.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:30:21.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:30:21.316 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:30:51.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:30:51.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:31:21.596 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:31:21.600 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:31:51.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:31:51.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:32:21.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:32:21.875 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:32:51.993 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:32:51.997 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:33:22.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:33:22.139 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:33:52.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:33:52.280 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:34:22.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:34:22.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:34:52.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:34:52.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:35:22.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:35:22.622 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:35:52.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:35:52.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:36:22.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:36:22.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:36:53.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:36:53.071 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:37:23.154 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:37:23.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:37:53.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:37:53.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:38:23.464 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:38:23.467 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:38:53.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:38:53.611 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:39:23.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:39:23.757 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:39:53.908 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:39:53.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:40:24.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:40:24.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:40:54.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:40:54.157 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:41:24.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:41:24.321 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:41:54.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:41:54.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:42:24.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:42:24.518 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:42:54.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:42:54.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:43:24.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:43:24.791 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:43:54.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:43:54.938 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:44:25.084 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:44:25.088 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:44:55.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:44:55.234 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:45:25.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:45:25.364 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:45:55.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:45:55.527 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:46:25.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:46:25.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:46:55.814 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:46:55.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:47:25.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:47:25.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:47:56.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:47:56.104 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:48:26.253 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:48:26.257 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:48:56.410 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:48:56.413 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:49:26.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:49:26.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:49:56.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:49:56.681 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:50:26.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:50:26.767 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:50:56.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:50:56.898 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:51:27.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:51:27.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:51:57.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:51:57.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:52:27.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:52:27.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:52:57.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:52:57.485 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:53:27.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:53:27.628 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:53:57.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:53:57.783 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:54:28.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:54:28.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:54:58.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:54:58.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:55:28.293 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:55:28.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:55:58.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:55:58.443 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:56:28.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:56:28.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:56:58.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:56:58.696 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:57:28.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:57:28.838 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:57:58.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:57:58.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:58:29.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:58:29.113 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:58:59.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:58:59.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:59:29.386 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:59:29.389 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:59:59.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T20:59:59.531 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:00:29.673 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:00:29.677 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:00:59.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:00:59.806 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:01:29.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:01:29.923 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:02:00.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:02:00.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:02:30.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:02:30.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:03:00.348 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:03:00.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:03:30.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:03:30.490 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:04:00.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:04:00.643 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:04:30.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:04:30.732 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:05:00.883 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:05:00.886 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:05:30.946 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:05:30.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:06:01.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:06:01.065 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:06:31.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:06:31.207 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:07:01.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:07:01.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:07:31.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:07:31.477 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:08:01.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:08:01.614 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:08:31.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:08:31.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:09:02.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:09:02.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:09:32.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:09:32.196 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:10:02.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:10:02.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:10:32.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:10:32.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:11:02.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:11:02.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:11:32.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:11:32.686 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:12:02.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:12:02.851 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:12:32.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:12:32.963 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:13:03.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:13:03.176 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:13:33.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:13:33.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:14:03.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:14:03.502 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:14:16.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:16.109 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:14:16.134 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_20_00_UTC 2024-01-21T21:14:16.134 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_21_00_UTC 2024-01-21T21:14:16.134 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_22_00_UTC 2024-01-21T21:14:16.134 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_23_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_24_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_25_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_26_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_27_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_28_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_29_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_30_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_31_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_32_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_33_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_34_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_35_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_36_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_37_00_UTC 2024-01-21T21:14:16.135 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_38_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_39_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_40_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_41_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_42_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_43_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_44_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_45_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_46_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_47_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_48_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_49_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_50_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_51_00_UTC 2024-01-21T21:14:16.136 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_52_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_53_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_54_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_55_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_56_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_57_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_58_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_59_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_00_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_01_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_02_00_UTC 2024-01-21T21:14:16.137 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_03_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_04_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_05_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_06_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_07_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_08_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_09_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_10_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_11_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_12_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_13_00_UTC 2024-01-21T21:14:16.138 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_14_00_UTC 2024-01-21T21:14:16.138 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-20_20_00_UTC', 'scheduled-2024-01-21-20_21_00_UTC', 'scheduled-2024-01-21-20_22_00_UTC', 'scheduled-2024-01-21-20_23_00_UTC', 'scheduled-2024-01-21-20_24_00_UTC', 'scheduled-2024-01-21-20_25_00_UTC', 'scheduled-2024-01-21-20_26_00_UTC', 'scheduled-2024-01-21-20_27_00_UTC', 'scheduled-2024-01-21-20_28_00_UTC', 'scheduled-2024-01-21-20_29_00_UTC', 'scheduled-2024-01-21-20_30_00_UTC', 'scheduled-2024-01-21-20_31_00_UTC', 'scheduled-2024-01-21-20_32_00_UTC', 'scheduled-2024-01-21-20_33_00_UTC', 'scheduled-2024-01-21-20_34_00_UTC', 'scheduled-2024-01-21-20_35_00_UTC', 'scheduled-2024-01-21-20_36_00_UTC', 'scheduled-2024-01-21-20_37_00_UTC', 'scheduled-2024-01-21-20_38_00_UTC', 'scheduled-2024-01-21-20_39_00_UTC', 'scheduled-2024-01-21-20_40_00_UTC', 'scheduled-2024-01-21-20_41_00_UTC', 'scheduled-2024-01-21-20_42_00_UTC', 'scheduled-2024-01-21-20_43_00_UTC', 'scheduled-2024-01-21-20_44_00_UTC', 'scheduled-2024-01-21-20_45_00_UTC', 'scheduled-2024-01-21-20_46_00_UTC', 'scheduled-2024-01-21-20_47_00_UTC', 'scheduled-2024-01-21-20_48_00_UTC', 'scheduled-2024-01-21-20_49_00_UTC', 'scheduled-2024-01-21-20_50_00_UTC', 'scheduled-2024-01-21-20_51_00_UTC', 'scheduled-2024-01-21-20_52_00_UTC', 'scheduled-2024-01-21-20_53_00_UTC', 'scheduled-2024-01-21-20_54_00_UTC', 'scheduled-2024-01-21-20_55_00_UTC', 'scheduled-2024-01-21-20_56_00_UTC', 'scheduled-2024-01-21-20_57_00_UTC', 'scheduled-2024-01-21-20_58_00_UTC', 'scheduled-2024-01-21-20_59_00_UTC', 'scheduled-2024-01-21-21_00_00_UTC', 'scheduled-2024-01-21-21_01_00_UTC', 'scheduled-2024-01-21-21_02_00_UTC', 'scheduled-2024-01-21-21_03_00_UTC', 'scheduled-2024-01-21-21_04_00_UTC', 'scheduled-2024-01-21-21_05_00_UTC', 'scheduled-2024-01-21-21_06_00_UTC', 'scheduled-2024-01-21-21_07_00_UTC', 'scheduled-2024-01-21-21_08_00_UTC', 'scheduled-2024-01-21-21_09_00_UTC', 'scheduled-2024-01-21-21_10_00_UTC', 'scheduled-2024-01-21-21_11_00_UTC', 'scheduled-2024-01-21-21_12_00_UTC', 'scheduled-2024-01-21-21_13_00_UTC', 'scheduled-2024-01-21-21_14_00_UTC'] 2024-01-21T21:14:16.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2024-01-21T21:14:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.301+0000 7f7571f7c700 1 Processor -- start 2024-01-21T21:14:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.301+0000 7f7571f7c700 1 -- start start 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f7571f7c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f756c151f90 0x7f756c152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f7571f7c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f7571f7c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0bd1a0 con 0x7f756c069ee0 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f7571f7c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c066c70 con 0x7f756c151f90 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f7571f7c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c066f50 con 0x7f756c065d90 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f756c151f90 0x7f756c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f756c069ee0 0x7f756c065680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46010/0 (socket says 172.21.15.133:46010) 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756affd700 1 -- 172.21.15.133:0/1870480070 learned_addr learned my addr 172.21.15.133:0/1870480070 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756bfff700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756b7fe700 1 -- 172.21.15.133:0/1870480070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 msgr2=0x7f756c0a7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756b7fe700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0a7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756b7fe700 1 -- 172.21.15.133:0/1870480070 >> v1:172.21.15.133:6789/0 conn(0x7f756c069ee0 legacy=0x7f756c065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756b7fe700 1 -- 172.21.15.133:0/1870480070 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c067230 con 0x7f756c151f90 2024-01-21T21:14:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.302+0000 7f756a7fc700 1 -- 172.21.15.133:0/1870480070 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266758333 0 0) 0x7f756c0bd1a0 con 0x7f756c069ee0 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f756b7fe700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c151f90 0x7f756c152370 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f7560009760 tx=0x7f7560009060).ready entity=mon.0 client_cookie=f80e25adf162bee0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f756a7fc700 1 -- 172.21.15.133:0/1870480070 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75600090d0 con 0x7f756c151f90 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f756a7fc700 1 -- 172.21.15.133:0/1870480070 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000b580 con 0x7f756c151f90 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f756a7fc700 1 -- 172.21.15.133:0/1870480070 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000b900 con 0x7f756c151f90 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 -- 172.21.15.133:0/1870480070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c151f90 msgr2=0x7f756c152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c151f90 0x7f756c152370 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f7560009760 tx=0x7f7560009060).stop 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 -- 172.21.15.133:0/1870480070 shutdown_connections 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0a7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 --2- 172.21.15.133:0/1870480070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c151f90 0x7f756c152370 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 -- 172.21.15.133:0/1870480070 >> 172.21.15.133:0/1870480070 conn(0x7f756c0c7d30 msgr2=0x7f756c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 -- 172.21.15.133:0/1870480070 shutdown_connections 2024-01-21T21:14:16.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.303+0000 7f7571f7c700 1 -- 172.21.15.133:0/1870480070 wait complete. 2024-01-21T21:14:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.305+0000 7f7571f7c700 1 Processor -- start 2024-01-21T21:14:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.305+0000 7f7571f7c700 1 -- start start 2024-01-21T21:14:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f756c151f90 0x7f756c0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0c3790 con 0x7f756c069ee0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0c2b80 con 0x7f756c151f90 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0c2e60 con 0x7f756c065d90 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43676/0 (socket says 172.21.15.133:43676) 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 -- 172.21.15.133:0/849727254 learned_addr learned my addr 172.21.15.133:0/849727254 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756b7fe700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 -- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 msgr2=0x7f756c0c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 -- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f756c151f90 msgr2=0x7f756c0c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756bfff700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f756c151f90 0x7f756c0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f756c151f90 0x7f756c0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 -- 172.21.15.133:0/849727254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75600092a0 con 0x7f756c069ee0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f756affd700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f755c00c4e0 tx=0x7f755c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0072e0 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c007440 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c0c3140 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c0057a0 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.306+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c0c2820 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.307+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c0c3940 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.308+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 65) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f755c005bd0 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.308+0000 7f7553fff700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 0x7f7558061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.308+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f755c07a1e0 con 0x7f756c069ee0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.308+0000 7f756b7fe700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 0x7f7558061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.309+0000 7f756b7fe700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 0x7f7558061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f756000b340 tx=0x7f7560017000).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.312+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f756c0c3940 con 0x7f756c069ee0 2024-01-21T21:14:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.505+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f756c0c38d0 con 0x7f755805f2c0 2024-01-21T21:14:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.507+0000 7f7553fff700 1 -- 172.21.15.133:0/849727254 <== mgr.7483 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f756c0c38d0 con 0x7f755805f2c0 2024-01-21T21:14:16.508 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:16.508 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:18:36", "first": "2024-01-21T20:19:00", "last": "2024-01-21T21:14:00", "last_pruned": "2024-01-21T21:14:00", "created_count": 56, "pruned_count": 1, "active": true}] 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.508+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 msgr2=0x7f7558061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.508+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 0x7f7558061780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f756000b340 tx=0x7f7560017000).stop 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.508+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 msgr2=0x7f756c14dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.508+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f755c00c4e0 tx=0x7f755c007c70).stop 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 shutdown_connections 2024-01-21T21:14:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f755805f2c0 0x7f7558061780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f756c151f90 0x7f756c0c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f756c065d90 0x7f756c0c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 --2- 172.21.15.133:0/849727254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c069ee0 0x7f756c14dce0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 >> 172.21.15.133:0/849727254 conn(0x7f756c0c7d30 msgr2=0x7f756c069510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 shutdown_connections 2024-01-21T21:14:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.509+0000 7f7571f7c700 1 -- 172.21.15.133:0/849727254 wait complete. 2024-01-21T21:14:16.522 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T20:18:36", "first": "2024-01-21T20:19:00", "last": "2024-01-21T21:14:00", "last_pruned": "2024-01-21T21:14:00", "created_count": 56, "pruned_count": 1, "active": true}] 2024-01-21T21:14:16.522 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T20:18:36', 'first': '2024-01-21T20:19:00', 'last': '2024-01-21T21:14:00', 'last_pruned': '2024-01-21T21:14:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2024-01-21T21:14:16.522 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2024-01-21T21:14:16.522 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2024-01-21T21:14:16.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2024-01-21T21:14:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.640+0000 7ffa6e0ad700 1 Processor -- start 2024-01-21T21:14:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.640+0000 7ffa6e0ad700 1 -- start start 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa6e0ad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68154250 0x7ffa68154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa6e0ad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa68062e00 0x7ffa68065f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa6e0ad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6806a4b0 con 0x7ffa68069510 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa6e0ad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa68069ef0 con 0x7ffa68062e00 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa6e0ad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6806a1d0 con 0x7ffa68154250 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa67fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa68062e00 0x7ffa68065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa66ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa68069510 0x7ffa680626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46024/0 (socket says 172.21.15.133:46024) 2024-01-21T21:14:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa66ffd700 1 -- 172.21.15.133:0/53309652 learned_addr learned my addr 172.21.15.133:0/53309652 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa677fe700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68154250 0x7ffa68154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa67fff700 1 -- 172.21.15.133:0/53309652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68154250 msgr2=0x7ffa68154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa67fff700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68154250 0x7ffa68154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa67fff700 1 -- 172.21.15.133:0/53309652 >> v1:172.21.15.133:6789/0 conn(0x7ffa68069510 legacy=0x7ffa680626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa67fff700 1 -- 172.21.15.133:0/53309652 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa68065720 con 0x7ffa68062e00 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.641+0000 7ffa667fc700 1 -- 172.21.15.133:0/53309652 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258096354 0 0) 0x7ffa6806a4b0 con 0x7ffa68069510 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa67fff700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa68065f20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7ffa60009e60 tx=0x7ffa60009780).ready entity=mon.0 client_cookie=8cd12c97be4ac647 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa667fc700 1 -- 172.21.15.133:0/53309652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000e070 con 0x7ffa68062e00 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa667fc700 1 -- 172.21.15.133:0/53309652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6000bb60 con 0x7ffa68062e00 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa667fc700 1 -- 172.21.15.133:0/53309652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60012410 con 0x7ffa68062e00 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/53309652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 msgr2=0x7ffa68065f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa68065f20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7ffa60009e60 tx=0x7ffa60009780).stop 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/53309652 shutdown_connections 2024-01-21T21:14:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa68065f20 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/53309652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68154250 0x7ffa68154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/53309652 >> 172.21.15.133:0/53309652 conn(0x7ffa680c7d30 msgr2=0x7ffa680c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/53309652 shutdown_connections 2024-01-21T21:14:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.642+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/53309652 wait complete. 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.643+0000 7ffa6e0ad700 1 Processor -- start 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 -- start start 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68069510 0x7ffa68163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa68154250 0x7ffa6814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680abf50 con 0x7ffa68062e00 2024-01-21T21:14:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa680acd50 con 0x7ffa68154250 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa6e0ad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa68164240 con 0x7ffa68069510 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.644+0000 7ffa677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43690/0 (socket says 172.21.15.133:43690) 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 -- 172.21.15.133:0/42863296 learned_addr learned my addr 172.21.15.133:0/42863296 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 -- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68069510 msgr2=0x7ffa68163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68069510 0x7ffa68163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 -- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa68154250 msgr2=0x7ffa6814e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa68154250 0x7ffa6814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 -- 172.21.15.133:0/42863296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60009a20 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa677fe700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7ffa5000e930 tx=0x7ffa50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000c640 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000c7a0 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000cb20 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa680ac140 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.645+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa680ac700 con 0x7ffa68062e00 2024-01-21T21:14:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.646+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6805fdf0 con 0x7ffa68062e00 2024-01-21T21:14:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.646+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 65) v1 ==== 75577+0+0 (secure 0 0 0) 0x7ffa5001b400 con 0x7ffa68062e00 2024-01-21T21:14:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.647+0000 7ffa5ffff700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 0x7ffa48061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.647+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 7007+0+0 (secure 0 0 0) 0x7ffa5007abb0 con 0x7ffa68062e00 2024-01-21T21:14:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.647+0000 7ffa66ffd700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 0x7ffa48061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.647+0000 7ffa66ffd700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 0x7ffa48061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffa580011e0 tx=0x7ffa58007850).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:16.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.651+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa5004b930 con 0x7ffa68062e00 2024-01-21T21:14:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.839+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa680c8ab0 con 0x7ffa4805f2c0 2024-01-21T21:14:16.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.843+0000 7ffa5ffff700 1 -- 172.21.15.133:0/42863296 <== mgr.7483 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7ffa680c8ab0 con 0x7ffa4805f2c0 2024-01-21T21:14:16.845 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 msgr2=0x7ffa48061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 0x7ffa48061780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ffa580011e0 tx=0x7ffa58007850).stop 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 msgr2=0x7ffa680aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7ffa5000e930 tx=0x7ffa50009060).stop 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 shutdown_connections 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffa4805f2c0 0x7ffa48061780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa68154250 0x7ffa6814e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa68062e00 0x7ffa680aba60 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 --2- 172.21.15.133:0/42863296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa68069510 0x7ffa68163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.845+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 >> 172.21.15.133:0/42863296 conn(0x7ffa680c7d30 msgr2=0x7ffa68065e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.846+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 shutdown_connections 2024-01-21T21:14:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:16.846+0000 7ffa6e0ad700 1 -- 172.21.15.133:0/42863296 wait complete. 2024-01-21T21:14:16.858 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2024-01-21T21:14:16.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:16.859 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_20_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_21_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_22_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_23_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_24_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_25_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_26_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_27_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_28_00_UTC 2024-01-21T21:14:16.878 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_29_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_30_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_31_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_32_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_33_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_34_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_35_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_36_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_37_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_38_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_39_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_40_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_41_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_42_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_43_00_UTC 2024-01-21T21:14:16.879 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_44_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_45_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_46_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_47_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_48_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_49_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_50_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_51_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_52_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_53_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_54_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_55_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_56_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_57_00_UTC 2024-01-21T21:14:16.880 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_58_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-20_59_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_00_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_01_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_02_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_03_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_04_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_05_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_06_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_07_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_08_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_09_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_10_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_11_00_UTC 2024-01-21T21:14:16.881 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_12_00_UTC 2024-01-21T21:14:16.882 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_13_00_UTC 2024-01-21T21:14:16.882 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_14_00_UTC 2024-01-21T21:14:16.882 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_20_00_UTC 2024-01-21T21:14:16.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:16.882 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_20_00_UTC) 2024-01-21T21:14:16.942 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_21_00_UTC 2024-01-21T21:14:16.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:16.943 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_21_00_UTC) 2024-01-21T21:14:17.007 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_22_00_UTC 2024-01-21T21:14:17.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.008 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_22_00_UTC) 2024-01-21T21:14:17.069 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_23_00_UTC 2024-01-21T21:14:17.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.070 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_23_00_UTC) 2024-01-21T21:14:17.133 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_24_00_UTC 2024-01-21T21:14:17.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.134 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_24_00_UTC) 2024-01-21T21:14:17.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_25_00_UTC 2024-01-21T21:14:17.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.197 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_25_00_UTC) 2024-01-21T21:14:17.259 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_26_00_UTC 2024-01-21T21:14:17.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.259 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_26_00_UTC) 2024-01-21T21:14:17.322 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_27_00_UTC 2024-01-21T21:14:17.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.322 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_27_00_UTC) 2024-01-21T21:14:17.385 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_28_00_UTC 2024-01-21T21:14:17.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.386 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_28_00_UTC) 2024-01-21T21:14:17.448 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_29_00_UTC 2024-01-21T21:14:17.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.448 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_29_00_UTC) 2024-01-21T21:14:17.513 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_30_00_UTC 2024-01-21T21:14:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.514 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_30_00_UTC) 2024-01-21T21:14:17.576 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_31_00_UTC 2024-01-21T21:14:17.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.577 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_31_00_UTC) 2024-01-21T21:14:17.639 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_32_00_UTC 2024-01-21T21:14:17.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.639 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_32_00_UTC) 2024-01-21T21:14:17.702 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_33_00_UTC 2024-01-21T21:14:17.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.702 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_33_00_UTC) 2024-01-21T21:14:17.765 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_34_00_UTC 2024-01-21T21:14:17.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.765 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_34_00_UTC) 2024-01-21T21:14:17.827 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_35_00_UTC 2024-01-21T21:14:17.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.827 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_35_00_UTC) 2024-01-21T21:14:17.889 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_36_00_UTC 2024-01-21T21:14:17.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.890 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_36_00_UTC) 2024-01-21T21:14:17.952 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_37_00_UTC 2024-01-21T21:14:17.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:17.952 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_37_00_UTC) 2024-01-21T21:14:18.016 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_38_00_UTC 2024-01-21T21:14:18.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.016 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_38_00_UTC) 2024-01-21T21:14:18.078 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_39_00_UTC 2024-01-21T21:14:18.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.078 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_39_00_UTC) 2024-01-21T21:14:18.142 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_40_00_UTC 2024-01-21T21:14:18.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.143 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_40_00_UTC) 2024-01-21T21:14:18.204 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_41_00_UTC 2024-01-21T21:14:18.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.205 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_41_00_UTC) 2024-01-21T21:14:18.268 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_42_00_UTC 2024-01-21T21:14:18.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.268 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_42_00_UTC) 2024-01-21T21:14:18.334 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_43_00_UTC 2024-01-21T21:14:18.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.334 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_43_00_UTC) 2024-01-21T21:14:18.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_44_00_UTC 2024-01-21T21:14:18.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.398 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_44_00_UTC) 2024-01-21T21:14:18.461 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_45_00_UTC 2024-01-21T21:14:18.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.461 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_45_00_UTC) 2024-01-21T21:14:18.523 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_46_00_UTC 2024-01-21T21:14:18.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.524 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_46_00_UTC) 2024-01-21T21:14:18.586 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_47_00_UTC 2024-01-21T21:14:18.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.586 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_47_00_UTC) 2024-01-21T21:14:18.648 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_48_00_UTC 2024-01-21T21:14:18.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.648 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_48_00_UTC) 2024-01-21T21:14:18.710 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_49_00_UTC 2024-01-21T21:14:18.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.710 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_49_00_UTC) 2024-01-21T21:14:18.772 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_50_00_UTC 2024-01-21T21:14:18.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.772 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_50_00_UTC) 2024-01-21T21:14:18.835 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_51_00_UTC 2024-01-21T21:14:18.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.835 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_51_00_UTC) 2024-01-21T21:14:18.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_52_00_UTC 2024-01-21T21:14:18.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.898 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_52_00_UTC) 2024-01-21T21:14:18.960 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_53_00_UTC 2024-01-21T21:14:18.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:18.961 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_53_00_UTC) 2024-01-21T21:14:19.022 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_54_00_UTC 2024-01-21T21:14:19.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.023 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_54_00_UTC) 2024-01-21T21:14:19.085 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_55_00_UTC 2024-01-21T21:14:19.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.086 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_55_00_UTC) 2024-01-21T21:14:19.147 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_56_00_UTC 2024-01-21T21:14:19.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.147 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_56_00_UTC) 2024-01-21T21:14:19.210 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_57_00_UTC 2024-01-21T21:14:19.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.210 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_57_00_UTC) 2024-01-21T21:14:19.272 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_58_00_UTC 2024-01-21T21:14:19.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.273 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_58_00_UTC) 2024-01-21T21:14:19.335 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-20_59_00_UTC 2024-01-21T21:14:19.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.335 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-20_59_00_UTC) 2024-01-21T21:14:19.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_00_00_UTC 2024-01-21T21:14:19.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.398 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_00_00_UTC) 2024-01-21T21:14:19.460 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_01_00_UTC 2024-01-21T21:14:19.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.461 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_01_00_UTC) 2024-01-21T21:14:19.524 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_02_00_UTC 2024-01-21T21:14:19.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.524 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_02_00_UTC) 2024-01-21T21:14:19.586 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_03_00_UTC 2024-01-21T21:14:19.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.587 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_03_00_UTC) 2024-01-21T21:14:19.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_04_00_UTC 2024-01-21T21:14:19.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.650 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_04_00_UTC) 2024-01-21T21:14:19.712 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_05_00_UTC 2024-01-21T21:14:19.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.712 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_05_00_UTC) 2024-01-21T21:14:19.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_06_00_UTC 2024-01-21T21:14:19.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.774 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_06_00_UTC) 2024-01-21T21:14:19.837 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_07_00_UTC 2024-01-21T21:14:19.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.837 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_07_00_UTC) 2024-01-21T21:14:19.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_08_00_UTC 2024-01-21T21:14:19.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.899 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_08_00_UTC) 2024-01-21T21:14:19.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_09_00_UTC 2024-01-21T21:14:19.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:19.961 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_09_00_UTC) 2024-01-21T21:14:20.023 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_10_00_UTC 2024-01-21T21:14:20.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.024 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_10_00_UTC) 2024-01-21T21:14:20.087 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_11_00_UTC 2024-01-21T21:14:20.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.088 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_11_00_UTC) 2024-01-21T21:14:20.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_12_00_UTC 2024-01-21T21:14:20.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.153 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_12_00_UTC) 2024-01-21T21:14:20.215 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_13_00_UTC 2024-01-21T21:14:20.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.215 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_13_00_UTC) 2024-01-21T21:14:20.278 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_14_00_UTC 2024-01-21T21:14:20.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.278 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_14_00_UTC) 2024-01-21T21:14:20.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:20.341 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T21:14:20.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T21:14:20.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.559+0000 7fcc7465e700 1 Processor -- start 2024-01-21T21:14:20.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.559+0000 7fcc7465e700 1 -- start start 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc7465e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc6c154140 0x7fcc6c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc7465e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 0x7fcc6c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc7465e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c0ab620 con 0x7fcc6c0c6090 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc7465e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c0c6ae0 con 0x7fcc6c154140 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc7465e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c0c05e0 con 0x7fcc6c154520 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc6c154140 0x7fcc6c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc6c154140 0x7fcc6c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32962/0 (socket says 172.21.15.133:32962) 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 -- 172.21.15.133:0/1165248258 learned_addr learned my addr 172.21.15.133:0/1165248258 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc71bf9700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 0x7fcc6c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 -- 172.21.15.133:0/1165248258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 msgr2=0x7fcc6c0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 0x7fcc6c0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 -- 172.21.15.133:0/1165248258 >> v1:172.21.15.178:6789/0 conn(0x7fcc6c0c6090 legacy=0x7fcc6c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 -- 172.21.15.133:0/1165248258 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c0c0e40 con 0x7fcc6c154140 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc71bf9700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 0x7fcc6c0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.560+0000 7fcc723fa700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c158bb0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fcc68006fd0 tx=0x7fcc680090f0).ready entity=mon.0 client_cookie=3a3c7ab4484694b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc713f8700 1 -- 172.21.15.133:0/1165248258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800b600 con 0x7fcc6c154140 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc713f8700 1 -- 172.21.15.133:0/1165248258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800b760 con 0x7fcc6c154140 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc713f8700 1 -- 172.21.15.133:0/1165248258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800bae0 con 0x7fcc6c154140 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 -- 172.21.15.133:0/1165248258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 msgr2=0x7fcc6c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c158bb0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7fcc68006fd0 tx=0x7fcc680090f0).stop 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 -- 172.21.15.133:0/1165248258 shutdown_connections 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c158bb0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 --2- 172.21.15.133:0/1165248258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c154520 0x7fcc6c0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 -- 172.21.15.133:0/1165248258 >> 172.21.15.133:0/1165248258 conn(0x7fcc6c05e1e0 msgr2=0x7fcc6c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:20.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 -- 172.21.15.133:0/1165248258 shutdown_connections 2024-01-21T21:14:20.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.561+0000 7fcc7465e700 1 -- 172.21.15.133:0/1165248258 wait complete. 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.562+0000 7fcc7465e700 1 Processor -- start 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.562+0000 7fcc7465e700 1 -- start start 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c0c6090 0x7fcc6c168770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 0x7fcc6c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c14d3c0 con 0x7fcc6c154140 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c1520f0 con 0x7fcc6c154520 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc7465e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c151830 con 0x7fcc6c0c6090 2024-01-21T21:14:20.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc71bf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc71bf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32964/0 (socket says 172.21.15.133:32964) 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.563+0000 7fcc71bf9700 1 -- 172.21.15.133:0/191579974 learned_addr learned my addr 172.21.15.133:0/191579974 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc723fa700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c0c6090 0x7fcc6c168770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc72bfb700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 0x7fcc6c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 -- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c0c6090 msgr2=0x7fcc6c168770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c0c6090 0x7fcc6c168770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 -- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 msgr2=0x7fcc6c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 0x7fcc6c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 -- 172.21.15.133:0/191579974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68009370 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc72bfb700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 0x7fcc6c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc71bf9700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fcc5c00c8e0 tx=0x7fcc5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c007530 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c007690 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c168c60 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c007a10 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.564+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c151e00 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.565+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c05fdf0 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.565+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 65) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fcc5c01b460 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.566+0000 7fcc62ffd700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 0x7fcc50061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.566+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fcc5c07a760 con 0x7fcc6c154140 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.566+0000 7fcc723fa700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 0x7fcc50061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:20.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.566+0000 7fcc723fa700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 0x7fcc50061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcc6800b3c0 tx=0x7fcc68017000).ready entity=mgr.7483 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:20.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.570+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc5c04b4e0 con 0x7fcc6c154140 2024-01-21T21:14:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.775+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcc6c0c00f0 con 0x7fcc6c154140 2024-01-21T21:14:20.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.856+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fcc5c078040 con 0x7fcc6c154140 2024-01-21T21:14:20.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.857+0000 7fcc62ffd700 1 -- 172.21.15.133:0/191579974 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v66) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcc5c073700 con 0x7fcc6c154140 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 msgr2=0x7fcc50061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 0x7fcc50061780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcc6800b3c0 tx=0x7fcc68017000).stop 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 msgr2=0x7fcc6c152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fcc5c00c8e0 tx=0x7fcc5c008040).stop 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 shutdown_connections 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcc5005f2c0 0x7fcc50061780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc6c154520 0x7fcc6c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc6c0c6090 0x7fcc6c168770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:20.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 --2- 172.21.15.133:0/191579974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc6c154140 0x7fcc6c152580 secure :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0x7fcc5c00c8e0 tx=0x7fcc5c008040).stop 2024-01-21T21:14:20.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.860+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 >> 172.21.15.133:0/191579974 conn(0x7fcc6c05e1e0 msgr2=0x7fcc6c0c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:20.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.861+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 shutdown_connections 2024-01-21T21:14:20.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:20.861+0000 7fcc7465e700 1 -- 172.21.15.133:0/191579974 wait complete. 2024-01-21T21:14:20.881 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:14:20.881 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:14:20.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:14:21.007 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:14:21.007 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T21:14:21.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:21.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T21:14:21.048 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:21.047+0000 7f99ce411680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:14:21.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:14:21.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:21.098 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T21:14:21.108 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:21.106+0000 7f700eeb4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:14:21.159 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:21.157+0000 7f99ce411680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:14:21.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:21.231 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:21.226+0000 7f700eeb4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:14:21.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.453+0000 7f523d84c700 1 Processor -- start 2024-01-21T21:14:21.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.453+0000 7f523d84c700 1 -- start start 2024-01-21T21:14:21.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f523d84c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 0x7f5238158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f523d84c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f523d84c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380ab620 con 0x7f5238154140 2024-01-21T21:14:21.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f523d84c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380c6ae0 con 0x7f52380c8120 2024-01-21T21:14:21.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f523d84c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c05e0 con 0x7f5238154520 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52367fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 0x7f5238158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:45078/0 (socket says 172.21.15.133:45078) 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 -- 172.21.15.133:0/2877288078 learned_addr learned my addr 172.21.15.133:0/2877288078 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f5236ffd700 1 --1- 172.21.15.133:0/2877288078 >> v1:172.21.15.178:6789/0 conn(0x7f5238154140 0x7f52380c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35268/0 (socket says 172.21.15.133:35268) 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 -- 172.21.15.133:0/2877288078 >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 msgr2=0x7f5238158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 --2- 172.21.15.133:0/2877288078 >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 0x7f5238158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 -- 172.21.15.133:0/2877288078 >> v1:172.21.15.178:6789/0 conn(0x7f5238154140 legacy=0x7f52380c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52377fe700 1 -- 172.21.15.133:0/2877288078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380c0e40 con 0x7f5238154520 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.454+0000 7f52367fc700 1 --2- 172.21.15.133:0/2877288078 >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 0x7f5238158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f52377fe700 1 --2- 172.21.15.133:0/2877288078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5230009f20 tx=0x7f5230009840).ready entity=mon.2 client_cookie=7a658d84d8c7bd3d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f5235ffb700 1 -- 172.21.15.133:0/2877288078 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000e070 con 0x7f5238154520 2024-01-21T21:14:21.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f5235ffb700 1 -- 172.21.15.133:0/2877288078 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000b9d0 con 0x7f5238154520 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f5235ffb700 1 -- 172.21.15.133:0/2877288078 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000bd50 con 0x7f5238154520 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 -- 172.21.15.133:0/2877288078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 msgr2=0x7f52380ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 --2- 172.21.15.133:0/2877288078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f5230009f20 tx=0x7f5230009840).stop 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 -- 172.21.15.133:0/2877288078 shutdown_connections 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 --2- 172.21.15.133:0/2877288078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f52380ab130 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 --2- 172.21.15.133:0/2877288078 >> v2:172.21.15.178:3300/0 conn(0x7f52380c8120 0x7f5238158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 -- 172.21.15.133:0/2877288078 >> 172.21.15.133:0/2877288078 conn(0x7f523805e1e0 msgr2=0x7f523805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 -- 172.21.15.133:0/2877288078 shutdown_connections 2024-01-21T21:14:21.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.455+0000 7f523d84c700 1 -- 172.21.15.133:0/2877288078 wait complete. 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 Processor -- start 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 -- start start 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f523814c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.457+0000 7f523d84c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b0800 con 0x7f52380c8120 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f523d84c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380aa830 con 0x7f5238154140 2024-01-21T21:14:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f523d84c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380aa550 con 0x7f5238154520 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:43042/0 (socket says 172.21.15.133:43042) 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f5236ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32992/0 (socket says 172.21.15.133:32992) 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 -- 172.21.15.133:0/206778518 learned_addr learned my addr 172.21.15.133:0/206778518 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52377fe700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f523814c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 msgr2=0x7f523814c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f523814c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 msgr2=0x7f5238168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 -- 172.21.15.133:0/206778518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f522c0092a0 con 0x7f5238154140 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f5236ffd700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f52367fc700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f522c00e980 tx=0x7f522c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c012600 con 0x7f5238154140 2024-01-21T21:14:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c012760 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5230009ae0 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c012ae0 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.458+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380b0490 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.459+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380aaf80 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.460+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f522c01b400 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.460+0000 7f521f7fe700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.460+0000 7f5236ffd700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 msgr2=0x7f5224061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.460+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f522c07ac30 con 0x7f5238154140 2024-01-21T21:14:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.460+0000 7f5236ffd700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.465+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f522c04b980 con 0x7f5238154140 2024-01-21T21:14:21.550 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:21.548+0000 7f99ce411680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:14:21.557 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:21.556+0000 7f700eeb4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:14:21.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.661+0000 7f5236ffd700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 msgr2=0x7f5224061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:21.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.661+0000 7f5236ffd700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:21.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.680+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52380aa980 con 0x7f5238154140 2024-01-21T21:14:21.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.681+0000 7f521f7fe700 1 -- 172.21.15.133:0/206778518 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f522c04efa0 con 0x7f5238154140 2024-01-21T21:14:21.682 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:21.682 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T21:14:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.682+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 msgr2=0x7f5224061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.682+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 msgr2=0x7f5238158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f522c00e980 tx=0x7f522c009060).stop 2024-01-21T21:14:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 shutdown_connections 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f522405f270 0x7f5224061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5238154520 0x7f523814c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52380c8120 0x7f5238168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 --2- 172.21.15.133:0/206778518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5238154140 0x7f5238158200 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 >> 172.21.15.133:0/206778518 conn(0x7f523805e1e0 msgr2=0x7f523814d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 shutdown_connections 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.683+0000 7f523d84c700 1 -- 172.21.15.133:0/206778518 wait complete. 2024-01-21T21:14:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T21:14:21.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.815+0000 7fea79901700 1 Processor -- start 2024-01-21T21:14:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.815+0000 7fea79901700 1 -- start start 2024-01-21T21:14:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea79901700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fea74137030 0x7fea74067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea79901700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea79901700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea740c6290 con 0x7fea74137410 2024-01-21T21:14:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea79901700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea74068370 con 0x7fea74137030 2024-01-21T21:14:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea79901700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea74068650 con 0x7fea740c5930 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea727fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea74137410 0x7fea74155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47680/0 (socket says 172.21.15.133:47680) 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.816+0000 7fea727fc700 1 -- 172.21.15.133:0/3849971114 learned_addr learned my addr 172.21.15.133:0/3849971114 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea72ffd700 1 --2- 172.21.15.133:0/3849971114 >> v2:172.21.15.178:3300/0 conn(0x7fea74137030 0x7fea74067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 --2- 172.21.15.133:0/3849971114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea71ffb700 1 -- 172.21.15.133:0/3849971114 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025086151 0 0) 0x7fea740c6290 con 0x7fea74137410 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea71ffb700 1 -- 172.21.15.133:0/3849971114 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea5c0033f0 con 0x7fea74137410 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 -- 172.21.15.133:0/3849971114 >> v2:172.21.15.178:3300/0 conn(0x7fea74137030 msgr2=0x7fea74067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 --2- 172.21.15.133:0/3849971114 >> v2:172.21.15.178:3300/0 conn(0x7fea74137030 0x7fea74067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 -- 172.21.15.133:0/3849971114 >> v1:172.21.15.133:6789/0 conn(0x7fea74137410 legacy=0x7fea74155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 -- 172.21.15.133:0/3849971114 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea74068930 con 0x7fea740c5930 2024-01-21T21:14:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea737fe700 1 --2- 172.21.15.133:0/3849971114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c5da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fea6c009e60 tx=0x7fea6c009780).ready entity=mon.2 client_cookie=a83a3fac6f6e671d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea71ffb700 1 -- 172.21.15.133:0/3849971114 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00e070 con 0x7fea740c5930 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea71ffb700 1 -- 172.21.15.133:0/3849971114 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c00bab0 con 0x7fea740c5930 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.817+0000 7fea71ffb700 1 -- 172.21.15.133:0/3849971114 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c00be30 con 0x7fea740c5930 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 -- 172.21.15.133:0/3849971114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 msgr2=0x7fea740c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 --2- 172.21.15.133:0/3849971114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c5da0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fea6c009e60 tx=0x7fea6c009780).stop 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 -- 172.21.15.133:0/3849971114 shutdown_connections 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 --2- 172.21.15.133:0/3849971114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c5da0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 --2- 172.21.15.133:0/3849971114 >> v2:172.21.15.178:3300/0 conn(0x7fea74137030 0x7fea74067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 -- 172.21.15.133:0/3849971114 >> 172.21.15.133:0/3849971114 conn(0x7fea74066a90 msgr2=0x7fea74066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 -- 172.21.15.133:0/3849971114 shutdown_connections 2024-01-21T21:14:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.818+0000 7fea79901700 1 -- 172.21.15.133:0/3849971114 wait complete. 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.819+0000 7fea79901700 1 Processor -- start 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.819+0000 7fea79901700 1 -- start start 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea74137030 0x7fea74167350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74167d30 con 0x7fea74137410 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea740c1ed0 con 0x7fea74137030 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea79901700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea740c12c0 con 0x7fea740c5930 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea72ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32996/0 (socket says 172.21.15.133:32996) 2024-01-21T21:14:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 -- 172.21.15.133:0/2079359322 learned_addr learned my addr 172.21.15.133:0/2079359322 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea727fc700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea74137030 0x7fea74167350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 -- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 msgr2=0x7fea740c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 -- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea74137030 msgr2=0x7fea74167350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea74137030 0x7fea74167350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 -- 172.21.15.133:0/2079359322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c009a20 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.820+0000 7fea737fe700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fea74066530 tx=0x7fea6c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.821+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c007080 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.821+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c013e60 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.821+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740c15a0 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.821+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c01d860 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.821+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea740c1b60 con 0x7fea74137410 2024-01-21T21:14:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea740c2060 con 0x7fea74137410 2024-01-21T21:14:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fea6c003040 con 0x7fea74137410 2024-01-21T21:14:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea5b7fe700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 0x7fea60061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea72ffd700 1 -- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 msgr2=0x7fea60061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fea6c07c2d0 con 0x7fea74137410 2024-01-21T21:14:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.822+0000 7fea72ffd700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 0x7fea60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:21.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:21.827+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fea6c050ab0 con 0x7fea74137410 2024-01-21T21:14:22.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.001+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea740bfa20 con 0x7fea74137410 2024-01-21T21:14:22.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.002+0000 7fea5b7fe700 1 -- 172.21.15.133:0/2079359322 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+18430 (secure 0 0 0) 0x7fea6c0506a0 con 0x7fea74137410 2024-01-21T21:14:22.004 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:22.004 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":146,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:21.851322+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":146,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3f","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/937693422":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6832/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6833/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:0/1046605086":"2024-01-22T20:18:35.401302+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":54,"length":3},{"begin":110,"length":3}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 msgr2=0x7fea60061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 0x7fea60061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 msgr2=0x7fea74167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fea74066530 tx=0x7fea6c009780).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 shutdown_connections 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fea6005f270 0x7fea60061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea74137410 0x7fea74167840 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea740c5930 0x7fea740c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 --2- 172.21.15.133:0/2079359322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea74137030 0x7fea74167350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 >> 172.21.15.133:0/2079359322 conn(0x7fea74066a90 msgr2=0x7fea740c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 shutdown_connections 2024-01-21T21:14:22.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.004+0000 7fea79901700 1 -- 172.21.15.133:0/2079359322 wait complete. 2024-01-21T21:14:22.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T20:18:18.173848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T20:18:18.635617+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 146, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T21:14:22.019 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:14:22.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.141+0000 7f04abf9c700 1 Processor -- start 2024-01-21T21:14:22.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.141+0000 7f04abf9c700 1 -- start start 2024-01-21T21:14:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04abf9c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04abf9c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a4137410 0x7f04a4155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04abf9c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a41557f0 con 0x7f04a40c5930 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04abf9c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a4068370 con 0x7f04a4137410 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04abf9c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a4068650 con 0x7f04a4137030 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a4137410 0x7f04a4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a4137410 0x7f04a4155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33008/0 (socket says 172.21.15.133:33008) 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 -- 172.21.15.133:0/2336959001 learned_addr learned my addr 172.21.15.133:0/2336959001 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 -- 172.21.15.133:0/2336959001 >> v2:172.21.15.178:3300/0 conn(0x7f04a4137030 msgr2=0x7f04a4067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 --2- 172.21.15.133:0/2336959001 >> v2:172.21.15.178:3300/0 conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 -- 172.21.15.133:0/2336959001 >> v1:172.21.15.178:6789/0 conn(0x7f04a40c5930 legacy=0x7f04a40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 -- 172.21.15.133:0/2336959001 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4068930 con 0x7f04a4137410 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a9537700 1 --2- 172.21.15.133:0/2336959001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4155300 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f04a40c8e10 tx=0x7f04940090f0).ready entity=mon.0 client_cookie=99ff7444bc595474 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a8d36700 1 -- 172.21.15.133:0/2336959001 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049400b600 con 0x7f04a4137410 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a8d36700 1 -- 172.21.15.133:0/2336959001 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049400b760 con 0x7f04a4137410 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.142+0000 7f04a8d36700 1 -- 172.21.15.133:0/2336959001 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049400bb00 con 0x7f04a4137410 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 -- 172.21.15.133:0/2336959001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 msgr2=0x7f04a4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 --2- 172.21.15.133:0/2336959001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4155300 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f04a40c8e10 tx=0x7f04940090f0).stop 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 -- 172.21.15.133:0/2336959001 shutdown_connections 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 --2- 172.21.15.133:0/2336959001 >> v2:172.21.15.178:3300/0 conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 --2- 172.21.15.133:0/2336959001 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4155300 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 -- 172.21.15.133:0/2336959001 >> 172.21.15.133:0/2336959001 conn(0x7f04a4066a90 msgr2=0x7f04a4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 -- 172.21.15.133:0/2336959001 shutdown_connections 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.143+0000 7f04abf9c700 1 -- 172.21.15.133:0/2336959001 wait complete. 2024-01-21T21:14:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.145+0000 7f04abf9c700 1 Processor -- start 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.145+0000 7f04abf9c700 1 -- start start 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 0x7f04a41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41569c0 con 0x7f04a40c5930 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40abf50 con 0x7f04a4137030 2024-01-21T21:14:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.146+0000 7f04abf9c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40ac230 con 0x7f04a4137410 2024-01-21T21:14:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04aa539700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 0x7f04a41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04aa539700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 0x7f04a41564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:45102/0 (socket says 172.21.15.133:45102) 2024-01-21T21:14:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33016/0 (socket says 172.21.15.133:33016) 2024-01-21T21:14:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04aa539700 1 -- 172.21.15.133:0/705906809 learned_addr learned my addr 172.21.15.133:0/705906809 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 msgr2=0x7f04a41564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 0x7f04a41564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 msgr2=0x7f04a4155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 -- 172.21.15.133:0/705906809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009370 con 0x7f04a40c5930 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f04a9d38700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f04a000b490 tx=0x7f04a0006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000be90 con 0x7f04a40c5930 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0002320 con 0x7f04a40c5930 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.147+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00026c0 con 0x7f04a40c5930 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.148+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a40ac510 con 0x7f04a40c5930 2024-01-21T21:14:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.148+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a40acad0 con 0x7f04a40c5930 2024-01-21T21:14:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.149+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a405fdf0 con 0x7f04a40c5930 2024-01-21T21:14:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.149+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f04a0002ab0 con 0x7f04a40c5930 2024-01-21T21:14:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.150+0000 7f049a7fc700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 0x7f0488061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.150+0000 7f04a9537700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 msgr2=0x7f0488061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.150+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f04a007a510 con 0x7f04a40c5930 2024-01-21T21:14:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.150+0000 7f04a9537700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 0x7f0488061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.157+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f04a004b2c0 con 0x7f04a40c5930 2024-01-21T21:14:22.179 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:22.177+0000 7f700eeb4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:14:22.203 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:22.201+0000 7f99ce411680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:14:22.255 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:22.253+0000 7f700eeb4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:14:22.276 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:22.275+0000 7f99ce411680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:14:22.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.351+0000 7f04a9537700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 msgr2=0x7f0488061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:22.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.351+0000 7f04a9537700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 0x7f0488061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:22.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.353+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04a406bd20 con 0x7f04a40c5930 2024-01-21T21:14:22.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.354+0000 7f049a7fc700 1 -- 172.21.15.133:0/705906809 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7f04a004e8e0 con 0x7f04a40c5930 2024-01-21T21:14:22.355 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:14:22.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 msgr2=0x7f0488061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 0x7f0488061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 msgr2=0x7f04a4135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f04a000b490 tx=0x7f04a0006f10).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 shutdown_connections 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f048805f270 0x7f0488061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a4137410 0x7f04a41564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a40c5930 0x7f04a4135540 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 --2- 172.21.15.133:0/705906809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a4155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 >> 172.21.15.133:0/705906809 conn(0x7f04a4066a90 msgr2=0x7f04a4136710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 shutdown_connections 2024-01-21T21:14:22.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.356+0000 7f04abf9c700 1 -- 172.21.15.133:0/705906809 wait complete. 2024-01-21T21:14:22.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:14:22.442 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:22.441+0000 7f700eeb4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:14:22.478 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:22.477+0000 7f99ce411680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:14:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.494+0000 7f18e7434700 1 Processor -- start 2024-01-21T21:14:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 -- start start 2024-01-21T21:14:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18e0137030 0x7f18e0067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18e0137410 0x7f18e0155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e01557f0 con 0x7f18e00c5930 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0068370 con 0x7f18e0137410 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.495+0000 7f18e7434700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e0068650 con 0x7f18e0137030 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f18e0137410 0x7f18e0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e59d1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f18e00c5930 0x7f18e00c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47690/0 (socket says 172.21.15.133:47690) 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e59d1700 1 -- 172.21.15.133:0/2609965336 learned_addr learned my addr 172.21.15.133:0/2609965336 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e51d0700 1 --2- 172.21.15.133:0/2609965336 >> v2:172.21.15.178:3300/0 conn(0x7f18e0137030 0x7f18e0067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 -- 172.21.15.133:0/2609965336 >> v2:172.21.15.178:3300/0 conn(0x7f18e0137030 msgr2=0x7f18e0067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 --2- 172.21.15.133:0/2609965336 >> v2:172.21.15.178:3300/0 conn(0x7f18e0137030 0x7f18e0067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 -- 172.21.15.133:0/2609965336 >> v1:172.21.15.133:6789/0 conn(0x7f18e00c5930 legacy=0x7f18e00c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 -- 172.21.15.133:0/2609965336 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0068930 con 0x7f18e0137410 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18d7fff700 1 -- 172.21.15.133:0/2609965336 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109551514 0 0) 0x7f18e01557f0 con 0x7f18e00c5930 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18e49cf700 1 --2- 172.21.15.133:0/2609965336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e0137410 0x7f18e0155300 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f18e00c8e10 tx=0x7f18d0009060).ready entity=mon.0 client_cookie=594b001d30be8338 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18d7fff700 1 -- 172.21.15.133:0/2609965336 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00090d0 con 0x7f18e0137410 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18d7fff700 1 -- 172.21.15.133:0/2609965336 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000f510 con 0x7f18e0137410 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.496+0000 7f18d7fff700 1 -- 172.21.15.133:0/2609965336 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000f890 con 0x7f18e0137410 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 -- 172.21.15.133:0/2609965336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e0137410 msgr2=0x7f18e0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 --2- 172.21.15.133:0/2609965336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e0137410 0x7f18e0155300 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f18e00c8e10 tx=0x7f18d0009060).stop 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 -- 172.21.15.133:0/2609965336 shutdown_connections 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 --2- 172.21.15.133:0/2609965336 >> v2:172.21.15.178:3300/0 conn(0x7f18e0137030 0x7f18e0067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 --2- 172.21.15.133:0/2609965336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e0137410 0x7f18e0155300 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 -- 172.21.15.133:0/2609965336 >> 172.21.15.133:0/2609965336 conn(0x7f18e0066a90 msgr2=0x7f18e0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 -- 172.21.15.133:0/2609965336 shutdown_connections 2024-01-21T21:14:22.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.497+0000 7f18e7434700 1 -- 172.21.15.133:0/2609965336 wait complete. 2024-01-21T21:14:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.498+0000 7f18e7434700 1 Processor -- start 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.498+0000 7f18e7434700 1 -- start start 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18e0137030 0x7f18e0167ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18e0137410 0x7f18e0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00addc0 con 0x7f18e00c5930 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00adf50 con 0x7f18e0137030 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e7434700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e01655d0 con 0x7f18e0137410 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33026/0 (socket says 172.21.15.133:33026) 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 -- 172.21.15.133:0/2303977986 learned_addr learned my addr 172.21.15.133:0/2303977986 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e49cf700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18e0137030 0x7f18e0167ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e59d1700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18e0137410 0x7f18e0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 -- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18e0137410 msgr2=0x7f18e0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18e0137410 0x7f18e0155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 -- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18e0137030 msgr2=0x7f18e0167ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18e0137030 0x7f18e0167ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.499+0000 7f18e51d0700 1 -- 172.21.15.133:0/2303977986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00092a0 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18e51d0700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f18dc00e900 tx=0x7f18dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc012600 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc012760 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01644f0 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc012ae0 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.500+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0164ab0 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f18dc01b400 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e005fdf0 con 0x7f18e00c5930 2024-01-21T21:14:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18d5ffb700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 0x7f18c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18e49cf700 1 -- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 msgr2=0x7f18c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f18dc07aa20 con 0x7f18e00c5930 2024-01-21T21:14:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.501+0000 7f18e49cf700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 0x7f18c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.506+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f18dc04bb40 con 0x7f18e00c5930 2024-01-21T21:14:22.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.692+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18e006bd20 con 0x7f18e00c5930 2024-01-21T21:14:22.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.692+0000 7f18d5ffb700 1 -- 172.21.15.133:0/2303977986 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18dc04ed90 con 0x7f18e00c5930 2024-01-21T21:14:22.694 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:14:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.694+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 msgr2=0x7f18c4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:22.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.694+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 0x7f18c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.694+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 msgr2=0x7f18e01650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.694+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f18dc00e900 tx=0x7f18dc009060).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 shutdown_connections 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f18c405f270 0x7f18c4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18e0137410 0x7f18e0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f18e00c5930 0x7f18e01650e0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 --2- 172.21.15.133:0/2303977986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18e0137030 0x7f18e0167ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 >> 172.21.15.133:0/2303977986 conn(0x7f18e0066a90 msgr2=0x7f18e0156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 shutdown_connections 2024-01-21T21:14:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.695+0000 7f18e7434700 1 -- 172.21.15.133:0/2303977986 wait complete. 2024-01-21T21:14:22.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.835+0000 7f9fa3ff4700 1 Processor -- start 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 -- start start 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f9c0bcf10 0x7f9f9c0630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9c14ee20 con 0x7f9f9c0c5ce0 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9c0bed10 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.836+0000 7f9fa3ff4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0bea30 con 0x7f9f9c14ea40 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa2591700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f9c0c5ce0 0x7f9f9c154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47692/0 (socket says 172.21.15.133:47692) 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa2591700 1 -- 172.21.15.133:0/3021462163 learned_addr learned my addr 172.21.15.133:0/3021462163 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 --2- 172.21.15.133:0/3021462163 >> v2:172.21.15.178:3300/0 conn(0x7f9f9c0bcf10 0x7f9f9c0630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa1d90700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa0d8e700 1 -- 172.21.15.133:0/3021462163 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885017211 0 0) 0x7f9f94001490 con 0x7f9f9c0c5ce0 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa0d8e700 1 -- 172.21.15.133:0/3021462163 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f880033f0 con 0x7f9f9c0c5ce0 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 -- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 msgr2=0x7f9f9c0c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 -- 172.21.15.133:0/3021462163 >> v1:172.21.15.133:6789/0 conn(0x7f9f9c0c5ce0 legacy=0x7f9f9c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 -- 172.21.15.133:0/3021462163 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0a7170 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa1d90700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa158f700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0630b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9f98009760 tx=0x7f9f98009060).ready entity=mon.1 client_cookie=2c6d7232d913cc9d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa0d8e700 1 -- 172.21.15.133:0/3021462163 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f980090d0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa0d8e700 1 -- 172.21.15.133:0/3021462163 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800d4a0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.837+0000 7f9fa0d8e700 1 -- 172.21.15.133:0/3021462163 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800d820 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0bcf10 msgr2=0x7f9f9c0630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0630b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f9f98009760 tx=0x7f9f98009060).stop 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/3021462163 shutdown_connections 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/3021462163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0630b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/3021462163 >> 172.21.15.133:0/3021462163 conn(0x7f9f9c0c7de0 msgr2=0x7f9f9c0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/3021462163 shutdown_connections 2024-01-21T21:14:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.838+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/3021462163 wait complete. 2024-01-21T21:14:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.839+0000 7f9fa3ff4700 1 Processor -- start 2024-01-21T21:14:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.839+0000 7f9fa3ff4700 1 -- start start 2024-01-21T21:14:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0c5ce0 0x7f9f9c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c14f7f0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0a78c0 con 0x7f9f9c0c5ce0 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa3ff4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0abf80 con 0x7f9f9c14ea40 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33040/0 (socket says 172.21.15.133:33040) 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 -- 172.21.15.133:0/2472388733 learned_addr learned my addr 172.21.15.133:0/2472388733 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa158f700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0c5ce0 0x7f9f9c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa2591700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 -- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 msgr2=0x7f9f9c0aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 -- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0c5ce0 msgr2=0x7f9f9c0ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0c5ce0 0x7f9f9c0ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 -- 172.21.15.133:0/2472388733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0092a0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.840+0000 7f9fa1d90700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f9f8c00e980 tx=0x7f9f8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.841+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c012600 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.841+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c012760 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.841+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f980092a0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.841+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c012ae0 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.841+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c0a7b10 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.842+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c0a7e80 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.842+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9f8c01b400 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.842+0000 7f9f927fc700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 0x7f9f80061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.843+0000 7f9fa158f700 1 -- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 msgr2=0x7f9f80061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.843+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f9f8c07ac30 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.843+0000 7f9fa158f700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 0x7f9f80061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:22.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:22.847+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f8c04b980 con 0x7f9f9c0bcf10 2024-01-21T21:14:22.871 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:22.869+0000 7f700eeb4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:14:22.943 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:22.942+0000 7f99ce411680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:14:22.980 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:22.978+0000 7f700eeb4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:23.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.028+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f9c0a7450 con 0x7f9f9c0bcf10 2024-01-21T21:14:23.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.028+0000 7f9f927fc700 1 -- 172.21.15.133:0/2472388733 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v147) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f8c04efa0 con 0x7f9f9c0bcf10 2024-01-21T21:14:23.030 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 msgr2=0x7f9f80061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 0x7f9f80061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 msgr2=0x7f9f9c0a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f9f8c00e980 tx=0x7f9f8c009060).stop 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 shutdown_connections 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f8005f270 0x7f9f80061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f9c14ea40 0x7f9f9c0aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f9c0bcf10 0x7f9f9c0a9fc0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 --2- 172.21.15.133:0/2472388733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9c0c5ce0 0x7f9f9c0ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 >> 172.21.15.133:0/2472388733 conn(0x7f9f9c0c7de0 msgr2=0x7f9f9c14daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 shutdown_connections 2024-01-21T21:14:23.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.030+0000 7f9fa3ff4700 1 -- 172.21.15.133:0/2472388733 wait complete. 2024-01-21T21:14:23.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T21:14:23.056 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.055+0000 7f99ce411680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:23.132 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:23.131+0000 7f700eeb4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.168+0000 7f301c9e2700 1 Processor -- start 2024-01-21T21:14:23.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.168+0000 7f301c9e2700 1 -- start start 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301c9e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301c9e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018068370 con 0x7f30180c5930 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301c9e2700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3018068650 con 0x7f3018137410 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301c9e2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3018068930 con 0x7f3018137030 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f3016d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f30180c5930 0x7f301815df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47698/0 (socket says 172.21.15.133:47698) 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f3016d9d700 1 -- 172.21.15.133:0/1302605539 learned_addr learned my addr 172.21.15.133:0/1302605539 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301659c700 1 --2- 172.21.15.133:0/1302605539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113692326 0 0) 0x7f3018068370 con 0x7f30180c5930 2024-01-21T21:14:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30000033f0 con 0x7f30180c5930 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518550571 0 0) 0x7f3018068650 con 0x7f3018137410 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018068370 con 0x7f3018137410 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301659c700 1 -- 172.21.15.133:0/1302605539 >> v1:172.21.15.178:6789/0 conn(0x7f3018137410 legacy=0x7f3018155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301659c700 1 -- 172.21.15.133:0/1302605539 >> v1:172.21.15.133:6789/0 conn(0x7f30180c5930 legacy=0x7f301815df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.169+0000 7f301659c700 1 -- 172.21.15.133:0/1302605539 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018068c10 con 0x7f3018137030 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301659c700 1 --2- 172.21.15.133:0/1302605539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018067d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3008009790 tx=0x7f3008009060).ready entity=mon.2 client_cookie=ee2d17f9ec51a2b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080090d0 con 0x7f3018137030 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800f510 con 0x7f3018137030 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301559a700 1 -- 172.21.15.133:0/1302605539 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800f890 con 0x7f3018137030 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301c9e2700 1 -- 172.21.15.133:0/1302605539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 msgr2=0x7f3018067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.170+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1302605539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018067d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3008009790 tx=0x7f3008009060).stop 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.171+0000 7f301c9e2700 1 -- 172.21.15.133:0/1302605539 shutdown_connections 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.171+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1302605539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018067d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.171+0000 7f301c9e2700 1 -- 172.21.15.133:0/1302605539 >> 172.21.15.133:0/1302605539 conn(0x7f3018066a90 msgr2=0x7f3018066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.171+0000 7f301c9e2700 1 -- 172.21.15.133:0/1302605539 shutdown_connections 2024-01-21T21:14:23.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.171+0000 7f301c9e2700 1 -- 172.21.15.133:0/1302605539 wait complete. 2024-01-21T21:14:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.172+0000 7f301c9e2700 1 Processor -- start 2024-01-21T21:14:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.172+0000 7f301c9e2700 1 -- start start 2024-01-21T21:14:23.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 0x7f30180abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815a930 con 0x7f30180c5930 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301813c2e0 con 0x7f3018137410 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301c9e2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301815a370 con 0x7f3018137030 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33048/0 (socket says 172.21.15.133:33048) 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 -- 172.21.15.133:0/1454858707 learned_addr learned my addr 172.21.15.133:0/1454858707 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f3016d9d700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 0x7f30180abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f3015d9b700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 -- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 msgr2=0x7f3018159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 -- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 msgr2=0x7f30180abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 0x7f30180abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 -- 172.21.15.133:0/1454858707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30080092a0 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f3016d9d700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 0x7f30180abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f3015d9b700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.173+0000 7f301659c700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f3018066530 tx=0x7f3008017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.174+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800f890 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.174+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800fc50 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.174+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301815a650 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.174+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300801b410 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.174+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3018136d60 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301813bdd0 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f300801b780 con 0x7f30180c5930 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f3006ffd700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 0x7f2ff8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f3015d9b700 1 -- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 msgr2=0x7f2ff8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:23.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f300807c080 con 0x7f30180c5930 2024-01-21T21:14:23.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.175+0000 7f3015d9b700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 0x7f2ff8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:23.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.185+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f301813bdd0 con 0x7f30180c5930 2024-01-21T21:14:23.208 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:23.206+0000 7f700eeb4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:14:23.220 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.219+0000 7f99ce411680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:23.275 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:23.274+0000 7f700eeb4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:14:23.298 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.297+0000 7f99ce411680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:14:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.354+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f301813bdd0 con 0x7f30180c5930 2024-01-21T21:14:23.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.355+0000 7f3006ffd700 1 -- 172.21.15.133:0/1454858707 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v147) v1 ==== 100+0+11 (secure 0 0 0) 0x7f301813bdd0 con 0x7f30180c5930 2024-01-21T21:14:23.356 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:14:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 msgr2=0x7f2ff8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 0x7f2ff8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 msgr2=0x7f3018136870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f3018066530 tx=0x7f3008017000).stop 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 shutdown_connections 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2ff805f270 0x7f2ff8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3018137410 0x7f30180abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30180c5930 0x7f3018136870 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 --2- 172.21.15.133:0/1454858707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3018137030 0x7f3018159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 >> 172.21.15.133:0/1454858707 conn(0x7f3018066a90 msgr2=0x7f3018066e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 shutdown_connections 2024-01-21T21:14:23.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.357+0000 7f301c9e2700 1 -- 172.21.15.133:0/1454858707 wait complete. 2024-01-21T21:14:23.368 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.367+0000 7f99ce411680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:14:23.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:23.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.526+0000 7f4b13f16700 1 Processor -- start 2024-01-21T21:14:23.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.526+0000 7f4b13f16700 1 -- start start 2024-01-21T21:14:23.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b13f16700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 0x7f4b0c137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b13f16700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c068370 con 0x7f4b0c137030 2024-01-21T21:14:23.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b13f16700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b0c068650 con 0x7f4b0c0c5930 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b13f16700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c068930 con 0x7f4b0c067d90 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b11cb2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4b0c137030 0x7f4b0c155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47710/0 (socket says 172.21.15.133:47710) 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b11cb2700 1 -- 172.21.15.133:0/2409771772 learned_addr learned my addr 172.21.15.133:0/2409771772 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.527+0000 7f4b114b1700 1 --2- 172.21.15.133:0/2409771772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 0x7f4b0c137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400146532 0 0) 0x7f4b0c068370 con 0x7f4b0c137030 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af80033f0 con 0x7f4b0c137030 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b114b1700 1 -- 172.21.15.133:0/2409771772 >> v1:172.21.15.178:6789/0 conn(0x7f4b0c0c5930 legacy=0x7f4b0c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681734628 0 0) 0x7f4b0c068650 con 0x7f4b0c0c5930 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b114b1700 1 -- 172.21.15.133:0/2409771772 >> v1:172.21.15.133:6789/0 conn(0x7f4b0c137030 legacy=0x7f4b0c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b114b1700 1 -- 172.21.15.133:0/2409771772 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c068c10 con 0x7f4b0c067d90 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b114b1700 1 --2- 172.21.15.133:0/2409771772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 0x7f4b0c137410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4afc009790 tx=0x7f4afc009060).ready entity=mon.2 client_cookie=2879eeba186b6d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b08001470 con 0x7f4b0c067d90 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc0090d0 con 0x7f4b0c067d90 2024-01-21T21:14:23.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.528+0000 7f4b10cb0700 1 -- 172.21.15.133:0/2409771772 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc012620 con 0x7f4b0c067d90 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 -- 172.21.15.133:0/2409771772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 msgr2=0x7f4b0c137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 --2- 172.21.15.133:0/2409771772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 0x7f4b0c137410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4afc009790 tx=0x7f4afc009060).stop 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 -- 172.21.15.133:0/2409771772 shutdown_connections 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 --2- 172.21.15.133:0/2409771772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c067d90 0x7f4b0c137410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 -- 172.21.15.133:0/2409771772 >> 172.21.15.133:0/2409771772 conn(0x7f4b0c066a90 msgr2=0x7f4b0c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 -- 172.21.15.133:0/2409771772 shutdown_connections 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.529+0000 7f4b13f16700 1 -- 172.21.15.133:0/2409771772 wait complete. 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.530+0000 7f4b13f16700 1 Processor -- start 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.530+0000 7f4b13f16700 1 -- start start 2024-01-21T21:14:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b0c067d90 0x7f4b0c1675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c137030 0x7f4b0c1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c167fc0 con 0x7f4b0c0c5930 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c13b300 con 0x7f4b0c067d90 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0c13bba0 con 0x7f4b0c137030 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33056/0 (socket says 172.21.15.133:33056) 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 -- 172.21.15.133:0/1476063237 learned_addr learned my addr 172.21.15.133:0/1476063237 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b11cb2700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b0c067d90 0x7f4b0c1675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b124b3700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c137030 0x7f4b0c1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c137030 msgr2=0x7f4b0c1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c137030 0x7f4b0c1633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b0c067d90 msgr2=0x7f4b0c1675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b0c067d90 0x7f4b0c1675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 -- 172.21.15.133:0/1476063237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc0092a0 con 0x7f4b0c0c5930 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b114b1700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f4b0c066530 tx=0x7f4afc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011810 con 0x7f4b0c0c5930 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc011970 con 0x7f4b0c0c5930 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b0c0c2760 con 0x7f4b0c0c5930 2024-01-21T21:14:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.531+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc011d30 con 0x7f4b0c0c5930 2024-01-21T21:14:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.532+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b0c13b830 con 0x7f4b0c0c5930 2024-01-21T21:14:23.538 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:23.530+0000 7f700eeb4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0c13b9c0 con 0x7f4b0c0c5930 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4afc01d600 con 0x7f4b0c0c5930 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b027fc700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 0x7f4af0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b11cb2700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 msgr2=0x7f4af0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f4afc07c050 con 0x7f4b0c0c5930 2024-01-21T21:14:23.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.533+0000 7f4b11cb2700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 0x7f4af0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:23.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.541+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4afc04ce00 con 0x7f4b0c0c5930 2024-01-21T21:14:23.640 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.638+0000 7f99ce411680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:14:23.719 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:23.717+0000 7f700eeb4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.734+0000 7f4b11cb2700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 msgr2=0x7f4af0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.734+0000 7f4b11cb2700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 0x7f4af0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.751+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b0c13b9c0 con 0x7f4b0c0c5930 2024-01-21T21:14:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.752+0000 7f4b027fc700 1 -- 172.21.15.133:0/1476063237 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f4afc050420 con 0x7f4b0c0c5930 2024-01-21T21:14:23.753 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:23.753 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 msgr2=0x7f4af0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 0x7f4af0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 msgr2=0x7f4b0c167ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f4b0c066530 tx=0x7f4afc009060).stop 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 shutdown_connections 2024-01-21T21:14:23.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f4af005f270 0x7f4af0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b0c137030 0x7f4b0c1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b0c067d90 0x7f4b0c1675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 --2- 172.21.15.133:0/1476063237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b0c0c5930 0x7f4b0c167ad0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 >> 172.21.15.133:0/1476063237 conn(0x7f4b0c066a90 msgr2=0x7f4b0c0c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 shutdown_connections 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.754+0000 7f4b13f16700 1 -- 172.21.15.133:0/1476063237 wait complete. 2024-01-21T21:14:23.757 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T21:14:23.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:23.830 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:23.829+0000 7f99ce411680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.888+0000 7f96362c3700 1 Processor -- start 2024-01-21T21:14:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.888+0000 7f96362c3700 1 -- start start 2024-01-21T21:14:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9630154520 0x7f96300ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300c6ae0 con 0x7f9630154520 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300c05e0 con 0x7f96300c6090 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f96362c3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96300ab620 con 0x7f9630154140 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f962f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9630154520 0x7f96300ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f9634860700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f962ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f962f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9630154520 0x7f96300ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33068/0 (socket says 172.21.15.133:33068) 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f9634860700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:43132/0 (socket says 172.21.15.133:43132) 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f962ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:45156/0 (socket says 172.21.15.133:45156) 2024-01-21T21:14:23.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.889+0000 7f962f7fe700 1 -- 172.21.15.133:0/966746734 learned_addr learned my addr 172.21.15.133:0/966746734 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 -- 172.21.15.133:0/966746734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 msgr2=0x7f9630158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 -- 172.21.15.133:0/966746734 >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 msgr2=0x7f96300c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 --2- 172.21.15.133:0/966746734 >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 -- 172.21.15.133:0/966746734 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300c0e40 con 0x7f9630154520 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962ffff700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f9634860700 1 --2- 172.21.15.133:0/966746734 >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962f7fe700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9630154520 0x7f96300ab130 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f9630062cc0 tx=0x7f96240090f0).ready entity=mon.0 client_cookie=803b3d2c616f81cb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962effd700 1 -- 172.21.15.133:0/966746734 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400f510 con 0x7f9630154520 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962effd700 1 -- 172.21.15.133:0/966746734 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962400f670 con 0x7f9630154520 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f962effd700 1 -- 172.21.15.133:0/966746734 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400fa10 con 0x7f9630154520 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 -- 172.21.15.133:0/966746734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9630154520 msgr2=0x7f96300ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9630154520 0x7f96300ab130 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7f9630062cc0 tx=0x7f96240090f0).stop 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 -- 172.21.15.133:0/966746734 shutdown_connections 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 --2- 172.21.15.133:0/966746734 >> v2:172.21.15.178:3300/0 conn(0x7f96300c6090 0x7f96300c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154140 0x7f9630158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 --2- 172.21.15.133:0/966746734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9630154520 0x7f96300ab130 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.890+0000 7f96362c3700 1 -- 172.21.15.133:0/966746734 >> 172.21.15.133:0/966746734 conn(0x7f963005e1e0 msgr2=0x7f963005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.891+0000 7f96362c3700 1 -- 172.21.15.133:0/966746734 shutdown_connections 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.891+0000 7f96362c3700 1 -- 172.21.15.133:0/966746734 wait complete. 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.892+0000 7f96362c3700 1 Processor -- start 2024-01-21T21:14:23.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.892+0000 7f96362c3700 1 -- start start 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630154140 0x7f9630152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154520 0x7f963014ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963014d910 con 0x7f96300c6090 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9630150610 con 0x7f9630154140 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f96362c3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9630167f50 con 0x7f9630154520 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f962ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f962ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33078/0 (socket says 172.21.15.133:33078) 2024-01-21T21:14:23.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f962ffff700 1 -- 172.21.15.133:0/2439173841 learned_addr learned my addr 172.21.15.133:0/2439173841 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f9634860700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154520 0x7f963014ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.893+0000 7f962f7fe700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630154140 0x7f9630152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 -- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154520 msgr2=0x7f963014ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154520 0x7f963014ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 -- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630154140 msgr2=0x7f9630152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630154140 0x7f9630152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 -- 172.21.15.133:0/2439173841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628009a20 con 0x7f96300c6090 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962ffff700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f962000ea20 tx=0x7f9620009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000c850 con 0x7f96300c6090 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000c9b0 con 0x7f96300c6090 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200092a0 con 0x7f96300c6090 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000cd30 con 0x7f96300c6090 2024-01-21T21:14:23.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.894+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9624009370 con 0x7f96300c6090 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.895+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963005fdf0 con 0x7f96300c6090 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.895+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f9620012600 con 0x7f96300c6090 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.896+0000 7f962cf74700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 0x7f961c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.896+0000 7f962f7fe700 1 -- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 msgr2=0x7f961c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.896+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f962007ad70 con 0x7f96300c6090 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.896+0000 7f962f7fe700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 0x7f961c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:23.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:23.900+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f962004bb20 con 0x7f96300c6090 2024-01-21T21:14:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.071+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9630150c40 con 0x7f96300c6090 2024-01-21T21:14:24.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.072+0000 7f962cf74700 1 -- 172.21.15.133:0/2439173841 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+18430 (secure 0 0 0) 0x7f9630150c40 con 0x7f96300c6090 2024-01-21T21:14:24.074 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:24.074 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":147,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:22.852670+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":147,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3f","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/937693422":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6832/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6833/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:0/1046605086":"2024-01-22T20:18:35.401302+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 msgr2=0x7f961c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 0x7f961c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 msgr2=0x7f963014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7f962000ea20 tx=0x7f9620009060).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 shutdown_connections 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f961c05f270 0x7f961c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9630154520 0x7f963014ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96300c6090 0x7f963014fc40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 --2- 172.21.15.133:0/2439173841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9630154140 0x7f9630152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 >> 172.21.15.133:0/2439173841 conn(0x7f963005e1e0 msgr2=0x7f963014ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 shutdown_connections 2024-01-21T21:14:24.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.074+0000 7f96362c3700 1 -- 172.21.15.133:0/2439173841 wait complete. 2024-01-21T21:14:24.091 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:14:24.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.209+0000 7fc41752c700 1 Processor -- start 2024-01-21T21:14:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 -- start start 2024-01-21T21:14:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc410069ef0 0x7fc410155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4100c3fb0 0x7fc410066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc410065660 con 0x7fc4100beb30 2024-01-21T21:14:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100bef10 con 0x7fc4100c3fb0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.210+0000 7fc41752c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc410156070 con 0x7fc410069ef0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4100c3fb0 0x7fc410066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4100c3fb0 0x7fc410066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33082/0 (socket says 172.21.15.133:33082) 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 -- 172.21.15.133:0/951905447 learned_addr learned my addr 172.21.15.133:0/951905447 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc4152c8700 1 --1- 172.21.15.133:0/951905447 >> v1:172.21.15.133:6789/0 conn(0x7fc4100beb30 0x7fc4100697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47714/0 (socket says 172.21.15.133:47714) 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc414ac7700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc410069ef0 0x7fc410155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 -- 172.21.15.133:0/951905447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc410069ef0 msgr2=0x7fc410155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc410069ef0 0x7fc410155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 -- 172.21.15.133:0/951905447 >> v1:172.21.15.133:6789/0 conn(0x7fc4100beb30 legacy=0x7fc4100697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc403fff700 1 -- 172.21.15.133:0/951905447 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735515341 0 0) 0x7fc410065660 con 0x7fc4100beb30 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 -- 172.21.15.133:0/951905447 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410065f00 con 0x7fc4100c3fb0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc415ac9700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100c3fb0 0x7fc410066390 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fc408009f50 tx=0x7fc408009840).ready entity=mon.0 client_cookie=89b80616fa51e075 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc403fff700 1 -- 172.21.15.133:0/951905447 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800e070 con 0x7fc4100c3fb0 2024-01-21T21:14:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc403fff700 1 -- 172.21.15.133:0/951905447 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800ba70 con 0x7fc4100c3fb0 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.211+0000 7fc403fff700 1 -- 172.21.15.133:0/951905447 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800bdf0 con 0x7fc4100c3fb0 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 -- 172.21.15.133:0/951905447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100c3fb0 msgr2=0x7fc410066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100c3fb0 0x7fc410066390 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fc408009f50 tx=0x7fc408009840).stop 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 -- 172.21.15.133:0/951905447 shutdown_connections 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100c3fb0 0x7fc410066390 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 --2- 172.21.15.133:0/951905447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc410069ef0 0x7fc410155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 -- 172.21.15.133:0/951905447 >> 172.21.15.133:0/951905447 conn(0x7fc4100c8010 msgr2=0x7fc4100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 -- 172.21.15.133:0/951905447 shutdown_connections 2024-01-21T21:14:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.212+0000 7fc41752c700 1 -- 172.21.15.133:0/951905447 wait complete. 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.213+0000 7fc41752c700 1 Processor -- start 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.213+0000 7fc41752c700 1 -- start start 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc410069ef0 0x7fc4100bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4100c3fb0 0x7fc4100a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100a7300 con 0x7fc4100beb30 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100bf860 con 0x7fc410069ef0 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc41752c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100bf250 con 0x7fc4100c3fb0 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33086/0 (socket says 172.21.15.133:33086) 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 -- 172.21.15.133:0/957799604 learned_addr learned my addr 172.21.15.133:0/957799604 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc415ac9700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4100c3fb0 0x7fc4100a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc4152c8700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc410069ef0 0x7fc4100bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4100c3fb0 msgr2=0x7fc4100a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4100c3fb0 0x7fc4100a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc410069ef0 msgr2=0x7fc4100bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc410069ef0 0x7fc4100bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 -- 172.21.15.133:0/957799604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408009ae0 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc414ac7700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fc40c006980 tx=0x7fc40c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.214+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c011590 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.215+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c0116f0 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.215+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c011a70 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.215+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4100a7020 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.215+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4100aa0b0 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fc40c012420 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4100bf090 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc401ffb700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 0x7fc3f4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc4152c8700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 msgr2=0x7fc3f4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7fc40c07a300 con 0x7fc4100beb30 2024-01-21T21:14:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.216+0000 7fc4152c8700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 0x7fc3f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:24.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.221+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc40c04af90 con 0x7fc4100beb30 2024-01-21T21:14:24.371 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.369+0000 7f700eeb4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:14:24.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.417+0000 7fc4152c8700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 msgr2=0x7fc3f4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:24.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.417+0000 7fc4152c8700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 0x7fc3f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.433+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc41005fdf0 con 0x7fc4100beb30 2024-01-21T21:14:24.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.433+0000 7fc401ffb700 1 -- 172.21.15.133:0/957799604 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fc40c04e5b0 con 0x7fc4100beb30 2024-01-21T21:14:24.435 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:24.435 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T21:14:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 msgr2=0x7fc3f4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 0x7fc3f4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 msgr2=0x7fc410138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fc40c006980 tx=0x7fc40c008040).stop 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 shutdown_connections 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc3f405f270 0x7fc3f4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4100c3fb0 0x7fc4100a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc410069ef0 0x7fc4100bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 --2- 172.21.15.133:0/957799604 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4100beb30 0x7fc410138e20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 >> 172.21.15.133:0/957799604 conn(0x7fc4100c8010 msgr2=0x7fc4100bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 shutdown_connections 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.436+0000 7fc41752c700 1 -- 172.21.15.133:0/957799604 wait complete. 2024-01-21T21:14:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T21:14:24.439 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.437+0000 7f700eeb4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:14:24.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:24.514 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.512+0000 7f700eeb4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:14:24.522 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:24.520+0000 7f99ce411680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:14:24.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.567+0000 7f40c999e700 1 Processor -- start 2024-01-21T21:14:24.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.567+0000 7f40c999e700 1 -- start start 2024-01-21T21:14:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40628b0 0x7f40c4062c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40c4069f90 0x7f40c4065930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40c4065e20 0x7f40c41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4067c30 con 0x7f40c4065e20 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4153400 con 0x7f40c4069f90 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c999e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4069b00 con 0x7f40c40628b0 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c919d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40c4065e20 0x7f40c41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c919d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40c4065e20 0x7f40c41523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33102/0 (socket says 172.21.15.133:33102) 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c919d700 1 -- 172.21.15.133:0/1192815228 learned_addr learned my addr 172.21.15.133:0/1192815228 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:24.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c899c700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40628b0 0x7f40c4062c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.568+0000 7f40c3fff700 1 --2- 172.21.15.133:0/1192815228 >> v2:172.21.15.178:3300/0 conn(0x7f40c4069f90 0x7f40c4065930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 -- 172.21.15.133:0/1192815228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40628b0 msgr2=0x7f40c4062c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40628b0 0x7f40c4062c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 -- 172.21.15.133:0/1192815228 >> v2:172.21.15.178:3300/0 conn(0x7f40c4069f90 msgr2=0x7f40c4065930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 --2- 172.21.15.133:0/1192815228 >> v2:172.21.15.178:3300/0 conn(0x7f40c4069f90 0x7f40c4065930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 -- 172.21.15.133:0/1192815228 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c406a3f0 con 0x7f40c4065e20 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c919d700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c4065e20 0x7f40c41523c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f40c40beba0 tx=0x7f40bc009840).ready entity=mon.0 client_cookie=262557d422bd89b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c37fe700 1 -- 172.21.15.133:0/1192815228 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00e070 con 0x7f40c4065e20 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c37fe700 1 -- 172.21.15.133:0/1192815228 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40bc00b970 con 0x7f40c4065e20 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c37fe700 1 -- 172.21.15.133:0/1192815228 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40bc00bcf0 con 0x7f40c4065e20 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c999e700 1 -- 172.21.15.133:0/1192815228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c4065e20 msgr2=0x7f40c41523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c999e700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c4065e20 0x7f40c41523c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f40c40beba0 tx=0x7f40bc009840).stop 2024-01-21T21:14:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c999e700 1 -- 172.21.15.133:0/1192815228 shutdown_connections 2024-01-21T21:14:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.569+0000 7f40c999e700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c4065e20 0x7f40c41523c0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.570+0000 7f40c999e700 1 --2- 172.21.15.133:0/1192815228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c40628b0 0x7f40c4062c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.570+0000 7f40c999e700 1 --2- 172.21.15.133:0/1192815228 >> v2:172.21.15.178:3300/0 conn(0x7f40c4069f90 0x7f40c4065930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.570+0000 7f40c999e700 1 -- 172.21.15.133:0/1192815228 >> 172.21.15.133:0/1192815228 conn(0x7f40c40c7bd0 msgr2=0x7f40c40c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.570+0000 7f40c999e700 1 -- 172.21.15.133:0/1192815228 shutdown_connections 2024-01-21T21:14:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.570+0000 7f40c999e700 1 -- 172.21.15.133:0/1192815228 wait complete. 2024-01-21T21:14:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.571+0000 7f40c999e700 1 Processor -- start 2024-01-21T21:14:24.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.571+0000 7f40c999e700 1 -- start start 2024-01-21T21:14:24.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.572+0000 7f40c999e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.572+0000 7f40c999e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 0x7f40c4137d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c4069f90 0x7f40c40aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40c0990 con 0x7f40c40628b0 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40a8dc0 con 0x7f40c4065e20 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40a9be0 con 0x7f40c4069f90 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c899c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c899c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33110/0 (socket says 172.21.15.133:33110) 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c899c700 1 -- 172.21.15.133:0/774003528 learned_addr learned my addr 172.21.15.133:0/774003528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 0x7f40c4137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c919d700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c4069f90 0x7f40c40aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c4069f90 msgr2=0x7f40c40aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c4069f90 0x7f40c40aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 msgr2=0x7f40c40a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 -- 172.21.15.133:0/774003528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009ae0 con 0x7f40c4065e20 2024-01-21T21:14:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c899c700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c3fff700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 0x7f40c4137d20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f40b000e6c0 tx=0x7f40b0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0012600 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b0012760 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c4138210 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0012ae0 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.573+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40a92b0 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f40b001b400 con 0x7f40c4065e20 2024-01-21T21:14:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c17fa700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 0x7f40a8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c899c700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 msgr2=0x7f40a8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f40b007aad0 con 0x7f40c4065e20 2024-01-21T21:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c899c700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 0x7f40a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.575+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c406c7b0 con 0x7f40c4065e20 2024-01-21T21:14:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.580+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f40b004f190 con 0x7f40c4065e20 2024-01-21T21:14:24.596 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:24.594+0000 7f99ce411680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:14:24.661 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.659+0000 7f700eeb4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:14:24.675 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:24.674+0000 7f99ce411680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:14:24.731 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.729+0000 7f700eeb4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:14:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.776+0000 7f40c899c700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 msgr2=0x7f40a8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.776+0000 7f40c899c700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 0x7f40a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.794+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40c40a9d20 con 0x7f40c4065e20 2024-01-21T21:14:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.795+0000 7f40c17fa700 1 -- 172.21.15.133:0/774003528 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f40b004ed80 con 0x7f40c4065e20 2024-01-21T21:14:24.796 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:24.796 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T20:18:19.606444+0000","modified":"2024-01-21T20:18:21.615679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8082},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8082":{"gid":8082,"name":"c","rank":0,"incarnation":47,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/602888662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":602888662},{"type":"v1","addr":"172.21.15.133:6837","nonce":602888662}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2024-01-21T21:14:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 msgr2=0x7f40a8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 0x7f40a8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 msgr2=0x7f40c4137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 0x7f40c4137d20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f40b000e6c0 tx=0x7f40b0009060).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 shutdown_connections 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f40a805f270 0x7f40a8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c4069f90 0x7f40c40aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40628b0 0x7f40c40a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 --2- 172.21.15.133:0/774003528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c4065e20 0x7f40c4137d20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 >> 172.21.15.133:0/774003528 conn(0x7f40c40c7bd0 msgr2=0x7f40c40ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 shutdown_connections 2024-01-21T21:14:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.797+0000 7f40c999e700 1 -- 172.21.15.133:0/774003528 wait complete. 2024-01-21T21:14:24.800 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2024-01-21T21:14:24.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:24.828 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:24.827+0000 7f99ce411680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:14:24.846 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.845+0000 7f700eeb4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:14:24.905 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:24.904+0000 7f99ce411680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:14:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 Processor -- start 2024-01-21T21:14:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 -- start start 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faccc154140 0x7faccc158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 0x7faccc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0ab620 con 0x7faccc154520 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc0c6ae0 con 0x7faccc154140 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.930+0000 7facd223f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c05e0 con 0x7faccc0c8120 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7facc2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faccc154520 0x7faccc0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47730/0 (socket says 172.21.15.133:47730) 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7facc2ffd700 1 -- 172.21.15.133:0/2671030331 learned_addr learned my addr 172.21.15.133:0/2671030331 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccb7fe700 1 --2- 172.21.15.133:0/2671030331 >> v2:172.21.15.178:3300/0 conn(0x7faccc154140 0x7faccc158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 --2- 172.21.15.133:0/2671030331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 0x7faccc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccaffd700 1 -- 172.21.15.133:0/2671030331 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574237267 0 0) 0x7faccc0ab620 con 0x7faccc154520 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccaffd700 1 -- 172.21.15.133:0/2671030331 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb80033f0 con 0x7faccc154520 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 -- 172.21.15.133:0/2671030331 >> v2:172.21.15.178:3300/0 conn(0x7faccc154140 msgr2=0x7faccc158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 --2- 172.21.15.133:0/2671030331 >> v2:172.21.15.178:3300/0 conn(0x7faccc154140 0x7faccc158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 -- 172.21.15.133:0/2671030331 >> v1:172.21.15.133:6789/0 conn(0x7faccc154520 legacy=0x7faccc0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 -- 172.21.15.133:0/2671030331 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0c0e40 con 0x7faccc0c8120 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccbfff700 1 --2- 172.21.15.133:0/2671030331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 0x7faccc0ab130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7facc4009e60 tx=0x7facc4009780).ready entity=mon.2 client_cookie=954e1b8a20adf895 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccaffd700 1 -- 172.21.15.133:0/2671030331 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400e070 con 0x7faccc0c8120 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccaffd700 1 -- 172.21.15.133:0/2671030331 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc400bab0 con 0x7faccc0c8120 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.931+0000 7faccaffd700 1 -- 172.21.15.133:0/2671030331 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400be30 con 0x7faccc0c8120 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 -- 172.21.15.133:0/2671030331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 msgr2=0x7faccc0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 --2- 172.21.15.133:0/2671030331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 0x7faccc0ab130 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7facc4009e60 tx=0x7facc4009780).stop 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 -- 172.21.15.133:0/2671030331 shutdown_connections 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 --2- 172.21.15.133:0/2671030331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc0c8120 0x7faccc0ab130 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 --2- 172.21.15.133:0/2671030331 >> v2:172.21.15.178:3300/0 conn(0x7faccc154140 0x7faccc158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 -- 172.21.15.133:0/2671030331 >> 172.21.15.133:0/2671030331 conn(0x7faccc05e1e0 msgr2=0x7faccc05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 -- 172.21.15.133:0/2671030331 shutdown_connections 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.932+0000 7facd223f700 1 -- 172.21.15.133:0/2671030331 wait complete. 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.933+0000 7facd223f700 1 Processor -- start 2024-01-21T21:14:24.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.933+0000 7facd223f700 1 -- start start 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc154140 0x7faccc0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc154520 0x7faccc0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0ca540 con 0x7faccc0c8120 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0abf70 con 0x7faccc154520 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facd223f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0ac210 con 0x7faccc154140 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7faccb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7faccb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33120/0 (socket says 172.21.15.133:33120) 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7faccb7fe700 1 -- 172.21.15.133:0/2870650064 learned_addr learned my addr 172.21.15.133:0/2870650064 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7faccbfff700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc154520 0x7faccc0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.934+0000 7facc2ffd700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc154140 0x7faccc0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 -- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc154140 msgr2=0x7faccc0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc154140 0x7faccc0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 -- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc154520 msgr2=0x7faccc0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc154520 0x7faccc0af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 -- 172.21.15.133:0/2870650064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4009a20 con 0x7faccc0c8120 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7faccb7fe700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7facbc00e930 tx=0x7facbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc009510 con 0x7faccc0c8120 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc012600 con 0x7faccc0c8120 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0c9ca0 con 0x7faccc0c8120 2024-01-21T21:14:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc012980 con 0x7faccc0c8120 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.935+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0ca260 con 0x7faccc0c8120 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.936+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc05fdf0 con 0x7faccc0c8120 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.936+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7facbc01b400 con 0x7faccc0c8120 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.937+0000 7facc8ff9700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 0x7facac061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.937+0000 7facc2ffd700 1 -- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 msgr2=0x7facac061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.937+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7facbc07ab20 con 0x7faccc0c8120 2024-01-21T21:14:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.937+0000 7facc2ffd700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 0x7facac061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:24.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:24.941+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7facbc04b870 con 0x7faccc0c8120 2024-01-21T21:14:24.958 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:24.956+0000 7f700eeb4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:25.028 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.026+0000 7f99ce411680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:14:25.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.111+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faccc0aa9a0 con 0x7faccc0c8120 2024-01-21T21:14:25.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.112+0000 7facc8ff9700 1 -- 172.21.15.133:0/2870650064 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+18430 (secure 0 0 0) 0x7facbc04ee90 con 0x7faccc0c8120 2024-01-21T21:14:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:25.114 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":147,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:22.852670+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-01-21T20:18:18.173848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-01-21T20:18:18.635617+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"147","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":147,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.30","mappings":[{"from":0,"to":2}]},{"pgid":"17.3f","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/937693422":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6832/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:6833/43404":"2024-01-22T20:18:35.401302+0000","172.21.15.133:0/1046605086":"2024-01-22T20:18:35.401302+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 msgr2=0x7facac061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 0x7facac061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 msgr2=0x7faccc0aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7facbc00e930 tx=0x7facbc009060).stop 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 shutdown_connections 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7facac05f270 0x7facac061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:25.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faccc154520 0x7faccc0af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faccc0c8120 0x7faccc0aa090 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 --2- 172.21.15.133:0/2870650064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faccc154140 0x7faccc0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 >> 172.21.15.133:0/2870650064 conn(0x7faccc05e1e0 msgr2=0x7faccc14fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.114+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 shutdown_connections 2024-01-21T21:14:25.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.115+0000 7facd223f700 1 -- 172.21.15.133:0/2870650064 wait complete. 2024-01-21T21:14:25.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T21:14:25.141 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.139+0000 7f99ce411680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:25.249 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:25.248+0000 7f700eeb4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:14:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.263+0000 7f89b60db700 1 Processor -- start 2024-01-21T21:14:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.263+0000 7f89b60db700 1 -- start start 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89b60db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89b0151f70 0x7f89b0152350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89b60db700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0068b00 con 0x7f89b00c3630 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89b60db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0067f30 con 0x7f89b00ab720 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89b60db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00681d0 con 0x7f89b0151f70 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89aeffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f89b00c3630 0x7f89b00ab010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47740/0 (socket says 172.21.15.133:47740) 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89aeffd700 1 -- 172.21.15.133:0/4168961756 learned_addr learned my addr 172.21.15.133:0/4168961756 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.264+0000 7f89af7fe700 1 --2- 172.21.15.133:0/4168961756 >> v2:172.21.15.178:3300/0 conn(0x7f89b0151f70 0x7f89b0152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416622643 0 0) 0x7f89b0068b00 con 0x7f89b00c3630 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89980033f0 con 0x7f89b00c3630 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720815298 0 0) 0x7f89b0067f30 con 0x7f89b00ab720 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89b0068b00 con 0x7f89b00ab720 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89af7fe700 1 -- 172.21.15.133:0/4168961756 >> v1:172.21.15.178:6789/0 conn(0x7f89b00ab720 legacy=0x7f89b00be220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89af7fe700 1 -- 172.21.15.133:0/4168961756 >> v1:172.21.15.133:6789/0 conn(0x7f89b00c3630 legacy=0x7f89b00ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89af7fe700 1 -- 172.21.15.133:0/4168961756 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b00684b0 con 0x7f89b0151f70 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89af7fe700 1 --2- 172.21.15.133:0/4168961756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b0152350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f89a0009e60 tx=0x7f89a0009780).ready entity=mon.1 client_cookie=c869e96d21139e92 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000e070 con 0x7f89b0151f70 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000bab0 con 0x7f89b0151f70 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.265+0000 7f89ae7fc700 1 -- 172.21.15.133:0/4168961756 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a000be30 con 0x7f89b0151f70 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 -- 172.21.15.133:0/4168961756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 msgr2=0x7f89b0152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 --2- 172.21.15.133:0/4168961756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b0152350 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f89a0009e60 tx=0x7f89a0009780).stop 2024-01-21T21:14:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 -- 172.21.15.133:0/4168961756 shutdown_connections 2024-01-21T21:14:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 --2- 172.21.15.133:0/4168961756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b0152350 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 -- 172.21.15.133:0/4168961756 >> 172.21.15.133:0/4168961756 conn(0x7f89b00c8f90 msgr2=0x7f89b00c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 -- 172.21.15.133:0/4168961756 shutdown_connections 2024-01-21T21:14:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.266+0000 7f89b60db700 1 -- 172.21.15.133:0/4168961756 wait complete. 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.267+0000 7f89b60db700 1 Processor -- start 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.267+0000 7f89b60db700 1 -- start start 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b00ab720 0x7f89b00c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b014aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00c00d0 con 0x7f89b00c3630 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b00c03b0 con 0x7f89b0151f70 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89b60db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b013e850 con 0x7f89b00ab720 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:25.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89aeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33124/0 (socket says 172.21.15.133:33124) 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89aeffd700 1 -- 172.21.15.133:0/2636893125 learned_addr learned my addr 172.21.15.133:0/2636893125 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89affff700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b014aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.268+0000 7f89af7fe700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b00ab720 0x7f89b00c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b00ab720 msgr2=0x7f89b00c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b00ab720 0x7f89b00c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 msgr2=0x7f89b014aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b014aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 -- 172.21.15.133:0/2636893125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009a20 con 0x7f89b00c3630 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89affff700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89aeffd700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f89a400c490 tx=0x7f89a4007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400ce40 con 0x7f89b00c3630 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a40072e0 con 0x7f89b00c3630 2024-01-21T21:14:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a40057a0 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b014afa0 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.269+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b00c2a60 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.270+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b00c0520 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.271+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 66) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f89a4005b90 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.271+0000 7f8997fff700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 0x7f899c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.271+0000 7f89af7fe700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 msgr2=0x7f899c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.271+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 7051+0+0 (secure 0 0 0) 0x7f89a4079e00 con 0x7f89b00c3630 2024-01-21T21:14:25.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.271+0000 7f89af7fe700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 0x7f899c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:25.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.278+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f89a404ac70 con 0x7f89b00c3630 2024-01-21T21:14:25.323 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:25.319+0000 7f700eeb4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:14:25.450 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.449+0000 7f99ce411680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:14:25.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.472+0000 7f89af7fe700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 msgr2=0x7f899c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:25.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.472+0000 7f89af7fe700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 0x7f899c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:25.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.496+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89b00c0ef0 con 0x7f89b00c3630 2024-01-21T21:14:25.525 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.524+0000 7f99ce411680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:14:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.543+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 67) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f89a4077770 con 0x7f89b00c3630 2024-01-21T21:14:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.544+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 msgr2=0x7f899c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:25.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.544+0000 7f8997fff700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 0x7f899c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:25.549 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:14:25.550 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:14:25.550 INFO:tasks.ceph.mds.c.smithi133.stderr:2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:14:25.565 INFO:tasks.ceph.mds.c.smithi133.stderr: -4> 2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:14:25.565 INFO:tasks.ceph.mds.c.smithi133.stderr: -3> 2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:14:25.565 INFO:tasks.ceph.mds.c.smithi133.stderr: -1> 2024-01-21T21:14:25.548+0000 7f2142ab9700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:14:25.585 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T21:14:25.606 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f99461b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f994a1c1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f99461b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f994a1c1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f99461b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f994a1c1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f99461b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f994a1c1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f99461b9700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.607 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:25.605+0000 7f994a1c1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:25.865 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T21:14:25.864+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T21:14:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.869+0000 7f8997fff700 1 -- 172.21.15.133:0/2636893125 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89a40732b0 con 0x7f89b00c3630 2024-01-21T21:14:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 msgr2=0x7f89b013e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f89a400c490 tx=0x7f89a4007ca0).stop 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 shutdown_connections 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f899c05f270 0x7f899c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b0151f70 0x7f89b014aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b00ab720 0x7f89b00c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 --2- 172.21.15.133:0/2636893125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89b00c3630 0x7f89b013e360 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 >> 172.21.15.133:0/2636893125 conn(0x7f89b00c8f90 msgr2=0x7f89b014c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 shutdown_connections 2024-01-21T21:14:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:25.872+0000 7f89b60db700 1 -- 172.21.15.133:0/2636893125 wait complete. 2024-01-21T21:14:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T21:14:25.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T21:14:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.003+0000 7ff9c9366700 1 Processor -- start 2024-01-21T21:14:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.003+0000 7ff9c9366700 1 -- start start 2024-01-21T21:14:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c9366700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9c41545a0 0x7ff9c40c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c9366700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40c67b0 0x7ff9c40c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c9366700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40c89d0 con 0x7ff9c40aa360 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c9366700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c40c7dc0 con 0x7ff9c41545a0 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c9366700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c80a0 con 0x7ff9c40c67b0 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9c41545a0 0x7ff9c40c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9c41545a0 0x7ff9c40c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33226/0 (socket says 172.21.15.133:33226) 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 -- 172.21.15.133:0/2038212374 learned_addr learned my addr 172.21.15.133:0/2038212374 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c37fe700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40c67b0 0x7ff9c40c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 -- 172.21.15.133:0/2038212374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40c67b0 msgr2=0x7ff9c40c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40c67b0 0x7ff9c40c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 -- 172.21.15.133:0/2038212374 >> v1:172.21.15.178:6789/0 conn(0x7ff9c40aa360 legacy=0x7ff9c40c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 -- 172.21.15.133:0/2038212374 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c40c8380 con 0x7ff9c41545a0 2024-01-21T21:14:26.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c2ffd700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c41545a0 0x7ff9c40c77b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff9b4006fd0 tx=0x7ff9b40090f0).ready entity=mon.0 client_cookie=cc820efa2b45a487 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c1ffb700 1 -- 172.21.15.133:0/2038212374 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400b580 con 0x7ff9c41545a0 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c1ffb700 1 -- 172.21.15.133:0/2038212374 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b400b6e0 con 0x7ff9c41545a0 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.004+0000 7ff9c1ffb700 1 -- 172.21.15.133:0/2038212374 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b400ba80 con 0x7ff9c41545a0 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 -- 172.21.15.133:0/2038212374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c41545a0 msgr2=0x7ff9c40c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c41545a0 0x7ff9c40c77b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7ff9b4006fd0 tx=0x7ff9b40090f0).stop 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 -- 172.21.15.133:0/2038212374 shutdown_connections 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c41545a0 0x7ff9c40c77b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 --2- 172.21.15.133:0/2038212374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40c67b0 0x7ff9c40c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 -- 172.21.15.133:0/2038212374 >> 172.21.15.133:0/2038212374 conn(0x7ff9c40649d0 msgr2=0x7ff9c4064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 -- 172.21.15.133:0/2038212374 shutdown_connections 2024-01-21T21:14:26.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.005+0000 7ff9c9366700 1 -- 172.21.15.133:0/2038212374 wait complete. 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.006+0000 7ff9c9366700 1 Processor -- start 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.006+0000 7ff9c9366700 1 -- start start 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40aa360 0x7ff9c40c4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9c41545a0 0x7ff9c4152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40c4a40 con 0x7ff9c40c67b0 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40aeea0 con 0x7ff9c41545a0 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c9366700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40af180 con 0x7ff9c40aa360 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33242/0 (socket says 172.21.15.133:33242) 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 -- 172.21.15.133:0/4553408 learned_addr learned my addr 172.21.15.133:0/4553408 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c37fe700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9c41545a0 0x7ff9c4152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c2ffd700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40aa360 0x7ff9c40c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 -- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40aa360 msgr2=0x7ff9c40c4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40aa360 0x7ff9c40c4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 -- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9c41545a0 msgr2=0x7ff9c4152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9c41545a0 0x7ff9c4152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.007+0000 7ff9c27fc700 1 -- 172.21.15.133:0/4553408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4009370 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9c27fc700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7ff9b800c440 tx=0x7ff9b8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007020 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b8007180 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007520 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40af460 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.008+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40c3290 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.009+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c40af900 con 0x7ff9c40c67b0 2024-01-21T21:14:26.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.009+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 67) v1 ==== 75270+0+0 (secure 0 0 0) 0x7ff9b80068b0 con 0x7ff9c40c67b0 2024-01-21T21:14:26.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.009+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 7265+0+0 (secure 0 0 0) 0x7ff9b8079770 con 0x7ff9c40c67b0 2024-01-21T21:14:26.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.013+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff9b8047b00 con 0x7ff9c40c67b0 2024-01-21T21:14:26.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.216+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9c405fdf0 con 0x7ff9c40c67b0 2024-01-21T21:14:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.546+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 68) v1 ==== 75340+0+0 (secure 0 0 0) 0x7ff9b8077290 con 0x7ff9c40c67b0 2024-01-21T21:14:26.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.546+0000 7ff9ab7fe700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 0x7ff9b00681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:26.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.547+0000 7ff9c2ffd700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 0x7ff9b00681e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:26.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.548+0000 7ff9c2ffd700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 0x7ff9b00681e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff9b4009fd0 tx=0x7ff9b4017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.871+0000 7ff9ab7fe700 1 -- 172.21.15.133:0/4553408 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9b8071040 con 0x7ff9c40c67b0 2024-01-21T21:14:26.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 msgr2=0x7ff9b00681e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 0x7ff9b00681e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff9b4009fd0 tx=0x7ff9b4017000).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 msgr2=0x7ff9c41571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7ff9b800c440 tx=0x7ff9b8007e00).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 shutdown_connections 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff9b00302f0 0x7ff9b00681e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9c41545a0 0x7ff9c4152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9c40aa360 0x7ff9c40c4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 --2- 172.21.15.133:0/4553408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9c40c67b0 0x7ff9c41571b0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 >> 172.21.15.133:0/4553408 conn(0x7ff9c40649d0 msgr2=0x7ff9c40c0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 shutdown_connections 2024-01-21T21:14:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:26.874+0000 7ff9c9366700 1 -- 172.21.15.133:0/4553408 wait complete. 2024-01-21T21:14:26.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T21:14:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 Processor -- start 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 -- start start 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00700aa5b0 0x7f00700c5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700c5cb0 con 0x7f00700aa1d0 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00700ae130 con 0x7f0070098a00 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.011+0000 7f00756bc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00701548c0 con 0x7f00700aa5b0 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f00700aa1d0 0x7f00700982f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47756/0 (socket says 172.21.15.133:47756) 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 -- 172.21.15.133:0/771671078 learned_addr learned my addr 172.21.15.133:0/771671078 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006e7fc700 1 --2- 172.21.15.133:0/771671078 >> v2:172.21.15.178:3300/0 conn(0x7f00700aa5b0 0x7f00700c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737022560 0 0) 0x7f00700c5cb0 con 0x7f00700aa1d0 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c0033f0 con 0x7f00700aa1d0 2024-01-21T21:14:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709464212 0 0) 0x7f005c0033f0 con 0x7f00700aa1d0 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 >> v2:172.21.15.178:3300/0 conn(0x7f00700aa5b0 msgr2=0x7f00700c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 --2- 172.21.15.133:0/771671078 >> v2:172.21.15.178:3300/0 conn(0x7f00700aa5b0 0x7f00700c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 >> v1:172.21.15.178:6789/0 conn(0x7f0070098a00 legacy=0x7f00700632d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0070098e90 con 0x7f00700aa1d0 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f00580015f0 con 0x7f00700aa1d0 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 >> v1:172.21.15.133:6789/0 conn(0x7f00700aa1d0 legacy=0x7f00700982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 0x7f005c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f005c004690 0x7f005c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c005000 0x7f005c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00701548c0 con 0x7f005c0038e0 2024-01-21T21:14:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00bf60 con 0x7f005c005000 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c00c0f0 con 0x7f005c004690 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 0x7f005c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006f7fe700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c005000 0x7f005c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006e7fc700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f005c004690 0x7f005c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 -- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f005c004690 msgr2=0x7f005c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f005c004690 0x7f005c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 -- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c005000 msgr2=0x7f005c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c005000 0x7f005c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006effd700 1 -- 172.21.15.133:0/771671078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0033f0 con 0x7f005c0038e0 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006f7fe700 1 -- 172.21.15.133:0/771671078 reap_dead start 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.012+0000 7f006e7fc700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f005c004690 0x7f005c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f006effd700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 0x7f005c003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f005800c190 tx=0x7f00700c7100).ready entity=mon.0 client_cookie=863654d1991e0e45 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800ca80 con 0x7f005c0038e0 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800cbe0 con 0x7f005c0038e0 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f006dffb700 1 -- 172.21.15.133:0/771671078 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580070d0 con 0x7f005c0038e0 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 -- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 msgr2=0x7f005c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 0x7f005c003d00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f005800c190 tx=0x7f00700c7100).stop 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 -- 172.21.15.133:0/771671078 shutdown_connections 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 --2- 172.21.15.133:0/771671078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f005c0038e0 0x7f005c003d00 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 -- 172.21.15.133:0/771671078 >> 172.21.15.133:0/771671078 conn(0x7f007005e1e0 msgr2=0x7f007005e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 -- 172.21.15.133:0/771671078 shutdown_connections 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.013+0000 7f00756bc700 1 -- 172.21.15.133:0/771671078 wait complete. 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 Processor -- start 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 -- start start 2024-01-21T21:14:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c0038e0 0x7f0070152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 0x7f00700acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00700c4bd0 con 0x7f0070155900 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00700ac1f0 con 0x7f005c0038e0 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f00756bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0070152f80 con 0x7f0070155d80 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.015+0000 7f006e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33264/0 (socket says 172.21.15.133:33264) 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 -- 172.21.15.133:0/3790680796 learned_addr learned my addr 172.21.15.133:0/3790680796 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006effd700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c0038e0 0x7f0070152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006f7fe700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 0x7f00700acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 -- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 msgr2=0x7f00700acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 0x7f00700acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 -- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c0038e0 msgr2=0x7f0070152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c0038e0 0x7f0070152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 -- 172.21.15.133:0/3790680796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00700ad640 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006f7fe700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 0x7f00700acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f006e7fc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f0060010900 tx=0x7f0060008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060014620 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060014780 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060014b00 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00700ad920 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.016+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00700ad280 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.017+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00700ac380 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.017+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 68) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f006001d400 con 0x7f0070155900 2024-01-21T21:14:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.018+0000 7f00677fe700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 0x7f00500614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.018+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 7265+0+0 (secure 0 0 0) 0x7f006007a620 con 0x7f0070155900 2024-01-21T21:14:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.018+0000 7f006effd700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 0x7f00500614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.018+0000 7f006effd700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 0x7f00500614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0058008fd0 tx=0x7f0058015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.022+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f006004b5e0 con 0x7f0070155900 2024-01-21T21:14:27.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.187+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f007005fdf0 con 0x7f0070155900 2024-01-21T21:14:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.877+0000 7f00677fe700 1 -- 172.21.15.133:0/3790680796 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 181+0+0 (secure 0 0 0) 0x7f006004ec00 con 0x7f0070155900 2024-01-21T21:14:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.881+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 msgr2=0x7f00500614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.881+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 0x7f00500614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0058008fd0 tx=0x7f0058015000).stop 2024-01-21T21:14:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.881+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 msgr2=0x7f00700ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.881+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f0060010900 tx=0x7f0060008040).stop 2024-01-21T21:14:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 shutdown_connections 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f005005f030 0x7f00500614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0070155d80 0x7f00700acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f005c0038e0 0x7f0070152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 --2- 172.21.15.133:0/3790680796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0070155900 0x7f00700ac680 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 >> 172.21.15.133:0/3790680796 conn(0x7f007005e1e0 msgr2=0x7f0070063f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 shutdown_connections 2024-01-21T21:14:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:27.882+0000 7f00756bc700 1 -- 172.21.15.133:0/3790680796 wait complete. 2024-01-21T21:14:27.885 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T21:14:27.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T21:14:28.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.017+0000 7f2719e2b700 1 Processor -- start 2024-01-21T21:14:28.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.017+0000 7f2719e2b700 1 -- start start 2024-01-21T21:14:28.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2719e2b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2714150de0 0x7f27141511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2719e2b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2714069510 0x7f2714069980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2719e2b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140be2b0 con 0x7f27140bd130 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2719e2b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2714069e70 con 0x7f2714069510 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2719e2b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140be740 con 0x7f2714150de0 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2713fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2714069510 0x7f2714069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2712ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f27140bd130 0x7f27140c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47760/0 (socket says 172.21.15.133:47760) 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.018+0000 7f2712ffd700 1 -- 172.21.15.133:0/1432541485 learned_addr learned my addr 172.21.15.133:0/1432541485 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f27137fe700 1 --2- 172.21.15.133:0/1432541485 >> v2:172.21.15.178:3300/0 conn(0x7f2714150de0 0x7f27141511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2713fff700 1 -- 172.21.15.133:0/1432541485 >> v2:172.21.15.178:3300/0 conn(0x7f2714150de0 msgr2=0x7f27141511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2713fff700 1 --2- 172.21.15.133:0/1432541485 >> v2:172.21.15.178:3300/0 conn(0x7f2714150de0 0x7f27141511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2713fff700 1 -- 172.21.15.133:0/1432541485 >> v1:172.21.15.133:6789/0 conn(0x7f27140bd130 legacy=0x7f27140c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2713fff700 1 -- 172.21.15.133:0/1432541485 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140bd6a0 con 0x7f2714069510 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f27127fc700 1 -- 172.21.15.133:0/1432541485 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724846430 0 0) 0x7f27140be2b0 con 0x7f27140bd130 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2713fff700 1 --2- 172.21.15.133:0/1432541485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714069510 0x7f2714069980 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f271405eb80 tx=0x7f270c009780).ready entity=mon.0 client_cookie=54259b2d91488090 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f27127fc700 1 -- 172.21.15.133:0/1432541485 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00e070 con 0x7f2714069510 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f27127fc700 1 -- 172.21.15.133:0/1432541485 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c00bc30 con 0x7f2714069510 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f27127fc700 1 -- 172.21.15.133:0/1432541485 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c012410 con 0x7f2714069510 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2719e2b700 1 -- 172.21.15.133:0/1432541485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714069510 msgr2=0x7f2714069980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.019+0000 7f2719e2b700 1 --2- 172.21.15.133:0/1432541485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714069510 0x7f2714069980 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f271405eb80 tx=0x7f270c009780).stop 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 -- 172.21.15.133:0/1432541485 shutdown_connections 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 --2- 172.21.15.133:0/1432541485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714069510 0x7f2714069980 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 --2- 172.21.15.133:0/1432541485 >> v2:172.21.15.178:3300/0 conn(0x7f2714150de0 0x7f27141511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 -- 172.21.15.133:0/1432541485 >> 172.21.15.133:0/1432541485 conn(0x7f27140c7d30 msgr2=0x7f27140c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 -- 172.21.15.133:0/1432541485 shutdown_connections 2024-01-21T21:14:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.020+0000 7f2719e2b700 1 -- 172.21.15.133:0/1432541485 wait complete. 2024-01-21T21:14:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.021+0000 7f2719e2b700 1 Processor -- start 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.021+0000 7f2719e2b700 1 -- start start 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714069510 0x7f2714161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 0x7f271414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714164590 con 0x7f2714150de0 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714161650 con 0x7f27140bd130 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140a86c0 con 0x7f2714069510 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33280/0 (socket says 172.21.15.133:33280) 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 -- 172.21.15.133:0/3335363691 learned_addr learned my addr 172.21.15.133:0/3335363691 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 -- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714069510 msgr2=0x7f2714161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714069510 0x7f2714161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 -- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 msgr2=0x7f271414afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2712ffd700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 0x7f271414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 0x7f271414afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 -- 172.21.15.133:0/3335363691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009a20 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2712ffd700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 0x7f271414afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2713fff700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f2714069020 tx=0x7f270c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c01f070 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c019630 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140a8bf0 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0199d0 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.022+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140a91b0 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.023+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271405fdf0 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.024+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 68) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f270c003040 con 0x7f2714150de0 2024-01-21T21:14:28.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.024+0000 7f26fbfff700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 0x7f27000614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.024+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6769+0+0 (secure 0 0 0) 0x7f270c07d7c0 con 0x7f2714150de0 2024-01-21T21:14:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.024+0000 7f27137fe700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 0x7f27000614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.024+0000 7f27137fe700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 0x7f27000614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f270800b8f0 tx=0x7f2708008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.028+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f270c04e9d0 con 0x7f2714150de0 2024-01-21T21:14:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.198+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f271406bd20 con 0x7f2714150de0 2024-01-21T21:14:28.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.552+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f270c07b4d0 con 0x7f2714150de0 2024-01-21T21:14:28.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.888+0000 7f26fbfff700 1 -- 172.21.15.133:0/3335363691 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 169+0+0 (secure 0 0 0) 0x7f270c0451e0 con 0x7f2714150de0 2024-01-21T21:14:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 msgr2=0x7f27000614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 0x7f27000614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f270800b8f0 tx=0x7f2708008040).stop 2024-01-21T21:14:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 msgr2=0x7f27140c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f2714069020 tx=0x7f270c009780).stop 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 shutdown_connections 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f270005f030 0x7f27000614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2714150de0 0x7f27140c31c0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714069510 0x7f2714161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 --2- 172.21.15.133:0/3335363691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140bd130 0x7f271414afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 >> 172.21.15.133:0/3335363691 conn(0x7f27140c7d30 msgr2=0x7f27140c7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 shutdown_connections 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:28.891+0000 7f2719e2b700 1 -- 172.21.15.133:0/3335363691 wait complete. 2024-01-21T21:14:28.893 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T21:14:28.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T21:14:29.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.023+0000 7f65be9d3700 1 Processor -- start 2024-01-21T21:14:29.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.023+0000 7f65be9d3700 1 -- start start 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 0x7f65b8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65b80697e0 0x7f65b8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b8069c40 0x7f65b8065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b8066040 con 0x7f65b80697e0 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b80634e0 con 0x7f65b8062c10 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65be9d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b806a130 con 0x7f65b8069c40 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65b80697e0 0x7f65b8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65b80697e0 0x7f65b8065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33286/0 (socket says 172.21.15.133:33286) 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 -- 172.21.15.133:0/4234465007 learned_addr learned my addr 172.21.15.133:0/4234465007 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b7fff700 1 --2- 172.21.15.133:0/4234465007 >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 0x7f65b8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65bcf70700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b8069c40 0x7f65b8065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 -- 172.21.15.133:0/4234465007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b8069c40 msgr2=0x7f65b8065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b8069c40 0x7f65b8065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 -- 172.21.15.133:0/4234465007 >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 msgr2=0x7f65b8062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4234465007 >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 0x7f65b8062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b77fe700 1 -- 172.21.15.133:0/4234465007 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b806a410 con 0x7f65b80697e0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.024+0000 7f65b7fff700 1 --2- 172.21.15.133:0/4234465007 >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 0x7f65b8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b80697e0 0x7f65b8065660 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f65b8069390 tx=0x7f65a80090f0).ready entity=mon.0 client_cookie=307f8b4fc928ea2c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65b6ffd700 1 -- 172.21.15.133:0/4234465007 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800b600 con 0x7f65b80697e0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65b6ffd700 1 -- 172.21.15.133:0/4234465007 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a800b760 con 0x7f65b80697e0 2024-01-21T21:14:29.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65b6ffd700 1 -- 172.21.15.133:0/4234465007 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800bb00 con 0x7f65b80697e0 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 -- 172.21.15.133:0/4234465007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b80697e0 msgr2=0x7f65b8065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b80697e0 0x7f65b8065660 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f65b8069390 tx=0x7f65a80090f0).stop 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 -- 172.21.15.133:0/4234465007 shutdown_connections 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b8069c40 0x7f65b8065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4234465007 >> v2:172.21.15.178:3300/0 conn(0x7f65b8062c10 0x7f65b8062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4234465007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b80697e0 0x7f65b8065660 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 -- 172.21.15.133:0/4234465007 >> 172.21.15.133:0/4234465007 conn(0x7f65b80c8010 msgr2=0x7f65b80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 -- 172.21.15.133:0/4234465007 shutdown_connections 2024-01-21T21:14:29.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.025+0000 7f65be9d3700 1 -- 172.21.15.133:0/4234465007 wait complete. 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.026+0000 7f65be9d3700 1 Processor -- start 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 -- start start 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b80697e0 0x7f65b80aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 0x7f65b80aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80aab30 con 0x7f65b8062c10 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80bfcc0 con 0x7f65b8069c40 2024-01-21T21:14:29.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65be9d3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80bf0b0 con 0x7f65b80697e0 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65b7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65b7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33300/0 (socket says 172.21.15.133:33300) 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.027+0000 7f65b7fff700 1 -- 172.21.15.133:0/4065156594 learned_addr learned my addr 172.21.15.133:0/4065156594 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65bcf70700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 0x7f65b80aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b80697e0 0x7f65b80aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 -- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b80697e0 msgr2=0x7f65b80aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b80697e0 0x7f65b80aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 -- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 msgr2=0x7f65b80aa640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 0x7f65b80aa640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 -- 172.21.15.133:0/4065156594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009370 con 0x7f65b8062c10 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65bcf70700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 0x7f65b80aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b7fff700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f65ac00d890 tx=0x7f65ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0125f0 con 0x7f65b8062c10 2024-01-21T21:14:29.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac012750 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b80bf390 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac012ad0 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.028+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b80bf950 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.029+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b80bffa0 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.029+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f65ac013480 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.030+0000 7f65b4ff9700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 0x7f65a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.030+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f65ac07a060 con 0x7f65b8062c10 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.030+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 0x7f65a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.030+0000 7f65b77fe700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 0x7f65a4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f65a8009fd0 tx=0x7f65a8017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.034+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f65ac04b1e0 con 0x7f65b8062c10 2024-01-21T21:14:29.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.197+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f65b805fdf0 con 0x7f65b8062c10 2024-01-21T21:14:29.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.200+0000 7f65b4ff9700 1 -- 172.21.15.133:0/4065156594 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f65ac04e800 con 0x7f65b8062c10 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 msgr2=0x7f65a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 0x7f65a4061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f65a8009fd0 tx=0x7f65a8017000).stop 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 msgr2=0x7f65b80aca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f65ac00d890 tx=0x7f65ac008040).stop 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 shutdown_connections 2024-01-21T21:14:29.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f65a405f150 0x7f65a4061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65b8069c40 0x7f65b80aa640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65b8062c10 0x7f65b80aca70 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 --2- 172.21.15.133:0/4065156594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65b80697e0 0x7f65b80aa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.202+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 >> 172.21.15.133:0/4065156594 conn(0x7f65b80c8010 msgr2=0x7f65b80be7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.203+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 shutdown_connections 2024-01-21T21:14:29.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.203+0000 7f65be9d3700 1 -- 172.21.15.133:0/4065156594 wait complete. 2024-01-21T21:14:29.219 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T21:14:29.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.335+0000 7f9c16632700 1 Processor -- start 2024-01-21T21:14:29.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.335+0000 7f9c16632700 1 -- start start 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c16632700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c10062ff0 0x7f9c10065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c16632700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c10069ef0 con 0x7f9c10065b50 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c16632700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c10065fe0 con 0x7f9c10062c10 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c16632700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1006a130 con 0x7f9c10062ff0 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c10062ff0 0x7f9c10065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c14bcf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c10065b50 0x7f9c100bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47772/0 (socket says 172.21.15.133:47772) 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c14bcf700 1 -- 172.21.15.133:0/4058377701 learned_addr learned my addr 172.21.15.133:0/4058377701 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/4058377701 >> v1:172.21.15.178:6789/0 conn(0x7f9c10062c10 legacy=0x7f9c100697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/4058377701 >> v1:172.21.15.133:6789/0 conn(0x7f9c10065b50 legacy=0x7f9c100bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/4058377701 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1006a410 con 0x7f9c10062ff0 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0effd700 1 -- 172.21.15.133:0/4058377701 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049801542 0 0) 0x7f9c08001490 con 0x7f9c10065b50 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0f7fe700 1 --2- 172.21.15.133:0/4058377701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c10065660 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f9c00009760 tx=0x7f9c00009060).ready entity=mon.0 client_cookie=b99cafe6d550d95b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.336+0000 7f9c0effd700 1 -- 172.21.15.133:0/4058377701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000090d0 con 0x7f9c10062ff0 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c0effd700 1 -- 172.21.15.133:0/4058377701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0000b520 con 0x7f9c10062ff0 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c0effd700 1 -- 172.21.15.133:0/4058377701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0000b8a0 con 0x7f9c10062ff0 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 -- 172.21.15.133:0/4058377701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 msgr2=0x7f9c10065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 --2- 172.21.15.133:0/4058377701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c10065660 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f9c00009760 tx=0x7f9c00009060).stop 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 -- 172.21.15.133:0/4058377701 shutdown_connections 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 --2- 172.21.15.133:0/4058377701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c10065660 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 -- 172.21.15.133:0/4058377701 >> 172.21.15.133:0/4058377701 conn(0x7f9c100c8010 msgr2=0x7f9c100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 -- 172.21.15.133:0/4058377701 shutdown_connections 2024-01-21T21:14:29.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.337+0000 7f9c16632700 1 -- 172.21.15.133:0/4058377701 wait complete. 2024-01-21T21:14:29.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.338+0000 7f9c16632700 1 Processor -- start 2024-01-21T21:14:29.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.338+0000 7f9c16632700 1 -- start start 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 0x7f9c100c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c10065b50 0x7f9c1015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100adb60 con 0x7f9c10062ff0 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1013be90 con 0x7f9c10065b50 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c16632700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1013afa0 con 0x7f9c10062c10 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c0f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c0f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33324/0 (socket says 172.21.15.133:33324) 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/2713470296 learned_addr learned my addr 172.21.15.133:0/2713470296 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.339+0000 7f9c14bcf700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c10065b50 0x7f9c1015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0ffff700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 0x7f9c100c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 msgr2=0x7f9c100c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 0x7f9c100c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c10065b50 msgr2=0x7f9c1015be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c10065b50 0x7f9c1015be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 -- 172.21.15.133:0/2713470296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000092a0 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0ffff700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 0x7f9c100c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0f7fe700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f9c00009eb0 tx=0x7f9c00017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c00011af0 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00011c50 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1013b280 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0001b410 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.340+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1013b840 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.341+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1005fdf0 con 0x7f9c10062ff0 2024-01-21T21:14:29.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.341+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9c0001b800 con 0x7f9c10062ff0 2024-01-21T21:14:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.342+0000 7f9c0cff9700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 0x7f9bfc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.342+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f9c0007be00 con 0x7f9c10062ff0 2024-01-21T21:14:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.342+0000 7f9c0ffff700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 0x7f9bfc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.342+0000 7f9c0ffff700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 0x7f9bfc061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9c0400a820 tx=0x7f9c04008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.346+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c0004cfe0 con 0x7f9c10062ff0 2024-01-21T21:14:29.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.508+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9c1013d3f0 con 0x7f9c10062ff0 2024-01-21T21:14:29.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.512+0000 7f9c0cff9700 1 -- 172.21.15.133:0/2713470296 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v29) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9c0001f0b0 con 0x7f9c10062ff0 2024-01-21T21:14:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 msgr2=0x7f9bfc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 0x7f9bfc061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9c0400a820 tx=0x7f9c04008040).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 msgr2=0x7f9c100bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f9c00009eb0 tx=0x7f9c00017000).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 shutdown_connections 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9bfc05f150 0x7f9bfc061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c10065b50 0x7f9c1015be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c10062c10 0x7f9c100c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 --2- 172.21.15.133:0/2713470296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c10062ff0 0x7f9c100bf270 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 >> 172.21.15.133:0/2713470296 conn(0x7f9c100c8010 msgr2=0x7f9c100c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 shutdown_connections 2024-01-21T21:14:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.515+0000 7f9c16632700 1 -- 172.21.15.133:0/2713470296 wait complete. 2024-01-21T21:14:29.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.649+0000 7f86e9f2d700 1 Processor -- start 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.649+0000 7f86e9f2d700 1 -- start start 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e9f2d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86e413a830 0x7f86e40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e9f2d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40c3890 con 0x7f86e413ac10 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e9f2d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40c3b70 con 0x7f86e40695b0 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e9f2d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40c3e50 con 0x7f86e413a830 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86e413ac10 0x7f86e40bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47778/0 (socket says 172.21.15.133:47778) 2024-01-21T21:14:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.650+0000 7f86e2ffd700 1 -- 172.21.15.133:0/3338944248 learned_addr learned my addr 172.21.15.133:0/3338944248 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e37fe700 1 --2- 172.21.15.133:0/3338944248 >> v2:172.21.15.178:3300/0 conn(0x7f86e413a830 0x7f86e40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948103818 0 0) 0x7f86e40c3890 con 0x7f86e413ac10 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86cc0033f0 con 0x7f86e413ac10 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2335591775 0 0) 0x7f86cc0033f0 con 0x7f86e413ac10 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 >> v2:172.21.15.178:3300/0 conn(0x7f86e413a830 msgr2=0x7f86e40c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 --2- 172.21.15.133:0/3338944248 >> v2:172.21.15.178:3300/0 conn(0x7f86e413a830 0x7f86e40c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 >> v1:172.21.15.178:6789/0 conn(0x7f86e40695b0 legacy=0x7f86e40699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40c4130 con 0x7f86e413ac10 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f86d8001470 con 0x7f86e413ac10 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 >> v1:172.21.15.133:6789/0 conn(0x7f86e413ac10 legacy=0x7f86e40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc0038e0 0x7f86cc003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc004690 0x7f86cc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 0x7f86cc00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c3e50 con 0x7f86cc005050 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc00bfe0 con 0x7f86cc004690 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc00c1a0 con 0x7f86cc0038e0 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e2ffd700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc004690 0x7f86cc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 0x7f86cc00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e37fe700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc0038e0 0x7f86cc003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 -- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc0038e0 msgr2=0x7f86cc003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc0038e0 0x7f86cc003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 -- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc004690 msgr2=0x7f86cc004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc004690 0x7f86cc004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.651+0000 7f86e3fff700 1 -- 172.21.15.133:0/3338944248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0033f0 con 0x7f86cc005050 2024-01-21T21:14:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e3fff700 1 -- 172.21.15.133:0/3338944248 reap_dead start 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e3fff700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 0x7f86cc00b8e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f86dc001e00 tx=0x7f86dc007f30).ready entity=mon.0 client_cookie=a4fe8455ef500d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc006a20 con 0x7f86cc005050 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc006b80 con 0x7f86cc005050 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e27fc700 1 -- 172.21.15.133:0/3338944248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00c5d0 con 0x7f86cc005050 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 -- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 msgr2=0x7f86cc00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 0x7f86cc00b8e0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f86dc001e00 tx=0x7f86dc007f30).stop 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 -- 172.21.15.133:0/3338944248 shutdown_connections 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/3338944248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86cc005050 0x7f86cc00b8e0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 -- 172.21.15.133:0/3338944248 >> 172.21.15.133:0/3338944248 conn(0x7f86e40c7dc0 msgr2=0x7f86e40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 -- 172.21.15.133:0/3338944248 shutdown_connections 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.652+0000 7f86e9f2d700 1 -- 172.21.15.133:0/3338944248 wait complete. 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.653+0000 7f86e9f2d700 1 Processor -- start 2024-01-21T21:14:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 -- start start 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc005050 0x7f86e4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 0x7f86e4139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4139e50 con 0x7f86e40c81a0 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e414ee30 con 0x7f86e414e630 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.654+0000 7f86e9f2d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c8b10 con 0x7f86cc005050 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33342/0 (socket says 172.21.15.133:33342) 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 -- 172.21.15.133:0/2962268316 learned_addr learned my addr 172.21.15.133:0/2962268316 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e2ffd700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 0x7f86e4139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e37fe700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc005050 0x7f86e4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 -- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc005050 msgr2=0x7f86e4151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc005050 0x7f86e4151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 -- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 msgr2=0x7f86e4139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 0x7f86e4139960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 -- 172.21.15.133:0/2962268316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e41525b0 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e2ffd700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 0x7f86e4139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e3fff700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f86dc001600 tx=0x7f86dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc00c5d0 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc00ce40 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4152890 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc006a20 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.655+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4152e50 con 0x7f86e40c81a0 2024-01-21T21:14:29.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.656+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e405fdf0 con 0x7f86e40c81a0 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.657+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f86dc01b040 con 0x7f86e40c81a0 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.657+0000 7f86cbfff700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 0x7f86d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.657+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f86dc018040 con 0x7f86e40c81a0 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.657+0000 7f86e37fe700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 0x7f86d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.657+0000 7f86e37fe700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 0x7f86d0061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f86d4006d80 tx=0x7f86d4008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.661+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86dc04c280 con 0x7f86e40c81a0 2024-01-21T21:14:29.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:29.892+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f86e40671a0 con 0x7f86e40c81a0 2024-01-21T21:14:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.887+0000 7f86cbfff700 1 -- 172.21.15.133:0/2962268316 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2414) v1 ==== 178+0+0 (secure 0 0 0) 0x7f86dc016020 con 0x7f86e40c81a0 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 msgr2=0x7f86d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 0x7f86d0061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f86d4006d80 tx=0x7f86d4008040).stop 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 msgr2=0x7f86e40c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f86dc001600 tx=0x7f86dc015000).stop 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 shutdown_connections 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86d005f150 0x7f86d0061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e40c81a0 0x7f86e40c8620 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86cc005050 0x7f86e4151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:30.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 --2- 172.21.15.133:0/2962268316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86e414e630 0x7f86e4139960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 >> 172.21.15.133:0/2962268316 conn(0x7f86e40c7dc0 msgr2=0x7f86e40661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 shutdown_connections 2024-01-21T21:14:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:30.890+0000 7f86e9f2d700 1 -- 172.21.15.133:0/2962268316 wait complete. 2024-01-21T21:14:30.906 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2024-01-21T21:14:30.906 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2024-01-21T21:14:30.906 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T21:14:30.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2024-01-21T21:14:31.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.027+0000 7f000a3a0700 1 Processor -- start 2024-01-21T21:14:31.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.027+0000 7f000a3a0700 1 -- start start 2024-01-21T21:14:31.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f000a3a0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0004069ef0 0x7f0004155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f000a3a0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0004065660 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f000a3a0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0004065f00 con 0x7f00040c3fb0 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f000a3a0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040bef10 con 0x7f0004069ef0 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0003fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f00040beb30 0x7f00040697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50592/0 (socket says 172.21.15.133:50592) 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0003fff700 1 -- 172.21.15.133:0/704921351 learned_addr learned my addr 172.21.15.133:0/704921351 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470749802 0 0) 0x7f0004065660 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec0033f0 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f00037fe700 1 --2- 172.21.15.133:0/704921351 >> v2:172.21.15.178:3300/0 conn(0x7f0004069ef0 0x7f0004155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741065670 0 0) 0x7effec0033f0 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 >> v2:172.21.15.178:3300/0 conn(0x7f0004069ef0 msgr2=0x7f0004155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 --2- 172.21.15.133:0/704921351 >> v2:172.21.15.178:3300/0 conn(0x7f0004069ef0 0x7f0004155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 >> v1:172.21.15.178:6789/0 conn(0x7f00040c3fb0 legacy=0x7f0004066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040c4740 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7efff4001470 con 0x7f00040beb30 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 >> v1:172.21.15.133:6789/0 conn(0x7f00040beb30 legacy=0x7f00040697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0038e0 0x7effec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec004690 0x7effec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 0x7effec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040bef10 con 0x7effec005120 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec00c080 con 0x7effec0038e0 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec00c240 con 0x7effec004690 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f000893d700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 0x7effec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.028+0000 7f0003fff700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0038e0 0x7effec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f00037fe700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec004690 0x7effec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 -- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec004690 msgr2=0x7effec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec004690 0x7effec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 -- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0038e0 msgr2=0x7effec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0038e0 0x7effec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 -- 172.21.15.133:0/704921351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec0033f0 con 0x7effec005120 2024-01-21T21:14:31.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 -- 172.21.15.133:0/704921351 reap_dead start 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000893d700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 0x7effec00b8e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7efffc001e30 tx=0x7efffc007f30).ready entity=mon.0 client_cookie=2e7c405c04da6193 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc006a20 con 0x7effec005120 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc006b80 con 0x7effec005120 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f0002ffd700 1 -- 172.21.15.133:0/704921351 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00c5d0 con 0x7effec005120 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000a3a0700 1 -- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 msgr2=0x7effec00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000a3a0700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 0x7effec00b8e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7efffc001e30 tx=0x7efffc007f30).stop 2024-01-21T21:14:31.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000a3a0700 1 -- 172.21.15.133:0/704921351 shutdown_connections 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000a3a0700 1 --2- 172.21.15.133:0/704921351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec005120 0x7effec00b8e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.029+0000 7f000a3a0700 1 -- 172.21.15.133:0/704921351 >> 172.21.15.133:0/704921351 conn(0x7f00040c8010 msgr2=0x7f00040c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.030+0000 7f000a3a0700 1 -- 172.21.15.133:0/704921351 shutdown_connections 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.030+0000 7f000a3a0700 1 -- 172.21.15.133:0/704921351 wait complete. 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.031+0000 7f000a3a0700 1 Processor -- start 2024-01-21T21:14:31.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.031+0000 7f000a3a0700 1 -- start start 2024-01-21T21:14:31.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec005120 0x7f0004136d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00040a4de0 0x7f00040a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040a5eb0 con 0x7f00040c1870 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041371f0 con 0x7f00040a4de0 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040a52a0 con 0x7effec005120 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58992/0 (socket says 172.21.15.133:58992) 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 -- 172.21.15.133:0/2695684377 learned_addr learned my addr 172.21.15.133:0/2695684377 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f00037fe700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00040a4de0 0x7f00040a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f0003fff700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec005120 0x7f0004136d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 -- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec005120 msgr2=0x7f0004136d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec005120 0x7f0004136d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 -- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00040a4de0 msgr2=0x7f00040a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00040a4de0 0x7f00040a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 -- 172.21.15.133:0/2695684377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040a5580 con 0x7f00040c1870 2024-01-21T21:14:31.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000893d700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f0004069360 tx=0x7efffc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00c5d0 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc013c00 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc006a20 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040a5860 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.032+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040a6830 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.033+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040c5800 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.034+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efffc003040 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.034+0000 7f0000ff9700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 0x7efff0061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.034+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7efffc07b300 con 0x7f00040c1870 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.034+0000 7f0003fff700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 0x7efff0061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:31.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.034+0000 7f0003fff700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 0x7efff0061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efff4000e50 tx=0x7efff4001e50).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:31.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.038+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efffc04c590 con 0x7f00040c1870 2024-01-21T21:14:31.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.267+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f000405fdf0 con 0x7f00040c1870 2024-01-21T21:14:31.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.890+0000 7f0000ff9700 1 -- 172.21.15.133:0/2695684377 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2415) v1 ==== 177+0+0 (secure 0 0 0) 0x7efffc023070 con 0x7f00040c1870 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 msgr2=0x7efff0061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 0x7efff0061640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7efff4000e50 tx=0x7efff4001e50).stop 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 msgr2=0x7f0004138960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7f0004069360 tx=0x7efffc016000).stop 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 shutdown_connections 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efff005f180 0x7efff0061640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00040c1870 0x7f0004138960 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec005120 0x7f0004136d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 --2- 172.21.15.133:0/2695684377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00040a4de0 0x7f00040a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:31.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 >> 172.21.15.133:0/2695684377 conn(0x7f00040c8010 msgr2=0x7f00040c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:31.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 shutdown_connections 2024-01-21T21:14:31.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:31.893+0000 7f000a3a0700 1 -- 172.21.15.133:0/2695684377 wait complete. 2024-01-21T21:14:31.908 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T21:14:32.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.029+0000 7f3ae24df700 1 Processor -- start 2024-01-21T21:14:32.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.029+0000 7f3ae24df700 1 -- start start 2024-01-21T21:14:32.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3ae24df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc1546b0 0x7f3adc154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3ae24df700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3adc0bc6d0 0x7f3adc066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3ae24df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3adc0654f0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3ae24df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc063700 con 0x7f3adc1546b0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3ae24df700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3adc063950 con 0x7f3adc0bc6d0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3adbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3adc1546b0 0x7f3adc154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3adb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3adc0a9e30 0x7f3adc065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50594/0 (socket says 172.21.15.133:50594) 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.030+0000 7f3adb7fe700 1 -- 172.21.15.133:0/231663483 learned_addr learned my addr 172.21.15.133:0/231663483 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adbfff700 1 -- 172.21.15.133:0/231663483 >> v2:172.21.15.178:3300/0 conn(0x7f3adc0bc6d0 msgr2=0x7f3adc066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adbfff700 1 --2- 172.21.15.133:0/231663483 >> v2:172.21.15.178:3300/0 conn(0x7f3adc0bc6d0 0x7f3adc066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adbfff700 1 -- 172.21.15.133:0/231663483 >> v1:172.21.15.133:6789/0 conn(0x7f3adc0a9e30 legacy=0x7f3adc065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adaffd700 1 -- 172.21.15.133:0/231663483 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883946625 0 0) 0x7f3adc0654f0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adbfff700 1 -- 172.21.15.133:0/231663483 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc065180 con 0x7f3adc1546b0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adbfff700 1 --2- 172.21.15.133:0/231663483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc1546b0 0x7f3adc154a90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f3adc065460 tx=0x7f3acc009060).ready entity=mon.0 client_cookie=78e0afa3ead575a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adaffd700 1 -- 172.21.15.133:0/231663483 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0090d0 con 0x7f3adc1546b0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adaffd700 1 -- 172.21.15.133:0/231663483 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00b580 con 0x7f3adc1546b0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3adaffd700 1 -- 172.21.15.133:0/231663483 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00b900 con 0x7f3adc1546b0 2024-01-21T21:14:32.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 -- 172.21.15.133:0/231663483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc1546b0 msgr2=0x7f3adc154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 --2- 172.21.15.133:0/231663483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc1546b0 0x7f3adc154a90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f3adc065460 tx=0x7f3acc009060).stop 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 -- 172.21.15.133:0/231663483 shutdown_connections 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 --2- 172.21.15.133:0/231663483 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc1546b0 0x7f3adc154a90 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 --2- 172.21.15.133:0/231663483 >> v2:172.21.15.178:3300/0 conn(0x7f3adc0bc6d0 0x7f3adc066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.031+0000 7f3ae24df700 1 -- 172.21.15.133:0/231663483 >> 172.21.15.133:0/231663483 conn(0x7f3adc0c8200 msgr2=0x7f3adc0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.032+0000 7f3ae24df700 1 -- 172.21.15.133:0/231663483 shutdown_connections 2024-01-21T21:14:32.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.032+0000 7f3ae24df700 1 -- 172.21.15.133:0/231663483 wait complete. 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.033+0000 7f3ae24df700 1 Processor -- start 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.033+0000 7f3ae24df700 1 -- start start 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 0x7f3adc165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 0x7f3adc147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc1661e0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0bfb30 con 0x7f3adc0bc6d0 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc0beea0 con 0x7f3adc1546b0 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59004/0 (socket says 172.21.15.133:59004) 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 -- 172.21.15.133:0/2580905891 learned_addr learned my addr 172.21.15.133:0/2580905891 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adb7fe700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 0x7f3adc165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 -- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 msgr2=0x7f3adc147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae0a7c700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 0x7f3adc147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 0x7f3adc147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 -- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 msgr2=0x7f3adc165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 0x7f3adc165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 -- 172.21.15.133:0/2580905891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0092a0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adb7fe700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 0x7f3adc165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae0a7c700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 0x7f3adc147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3adbfff700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f3acc009e80 tx=0x7f3acc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00b900 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00bcc0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc01b440 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc0bf200 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.034+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc0bf7c0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.035+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc05fdf0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.036+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3acc01b870 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.036+0000 7f3ad8ff9700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 0x7f3abc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.036+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f3acc07b9c0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.036+0000 7f3adb7fe700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 0x7f3abc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.037+0000 7f3adb7fe700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 0x7f3abc061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3adc0c0800 tx=0x7f3ac4009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.040+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3acc04cba0 con 0x7f3adc0a9e30 2024-01-21T21:14:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.205+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3adc0bd470 con 0x7f3adc0a9e30 2024-01-21T21:14:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.208+0000 7f3ad8ff9700 1 -- 172.21.15.133:0/2580905891 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3acc028020 con 0x7f3adc0a9e30 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 msgr2=0x7f3abc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 0x7f3abc061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3adc0c0800 tx=0x7f3ac4009040).stop 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 msgr2=0x7f3adc0be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f3acc009e80 tx=0x7f3acc017000).stop 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 shutdown_connections 2024-01-21T21:14:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3abc05f150 0x7f3abc061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3adc1546b0 0x7f3adc147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3adc0a9e30 0x7f3adc0be810 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 --2- 172.21.15.133:0/2580905891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3adc0bc6d0 0x7f3adc165cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 >> 172.21.15.133:0/2580905891 conn(0x7f3adc0c8200 msgr2=0x7f3adc0c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 shutdown_connections 2024-01-21T21:14:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.210+0000 7f3ae24df700 1 -- 172.21.15.133:0/2580905891 wait complete. 2024-01-21T21:14:32.224 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:14:32.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:14:32.273 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:14:32.326 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:14:32.326 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T21:14:32.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:32.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.441+0000 7fa99f1bd700 1 Processor -- start 2024-01-21T21:14:32.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.441+0000 7fa99f1bd700 1 -- start start 2024-01-21T21:14:32.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99f1bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9980c2b00 0x7fa998065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99f1bd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9980bd360 0x7fa998154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99f1bd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9981511f0 con 0x7fa9980a9e30 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99f1bd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa998065b20 con 0x7fa9980c2b00 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99f1bd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980c2240 con 0x7fa9980bd360 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9980c2b00 0x7fa998065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99cf59700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9980a9e30 0x7fa9980bcc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50598/0 (socket says 172.21.15.133:50598) 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa99cf59700 1 -- 172.21.15.133:0/1627033204 learned_addr learned my addr 172.21.15.133:0/1627033204 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 -- 172.21.15.133:0/1627033204 >> v2:172.21.15.178:3300/0 conn(0x7fa9980bd360 msgr2=0x7fa998154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 --2- 172.21.15.133:0/1627033204 >> v2:172.21.15.178:3300/0 conn(0x7fa9980bd360 0x7fa998154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 -- 172.21.15.133:0/1627033204 >> v1:172.21.15.133:6789/0 conn(0x7fa9980a9e30 legacy=0x7fa9980bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 -- 172.21.15.133:0/1627033204 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980c2f60 con 0x7fa9980c2b00 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa9977fe700 1 -- 172.21.15.133:0/1627033204 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693691100 0 0) 0x7fa98c001110 con 0x7fa9980a9e30 2024-01-21T21:14:32.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa997fff700 1 --2- 172.21.15.133:0/1627033204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980c2b00 0x7fa998065fb0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fa998065a90 tx=0x7fa984009060).ready entity=mon.0 client_cookie=c150cdcbbaadf61b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa9977fe700 1 -- 172.21.15.133:0/1627033204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9840090d0 con 0x7fa9980c2b00 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa9977fe700 1 -- 172.21.15.133:0/1627033204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400b580 con 0x7fa9980c2b00 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.442+0000 7fa9977fe700 1 -- 172.21.15.133:0/1627033204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400b900 con 0x7fa9980c2b00 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 -- 172.21.15.133:0/1627033204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980c2b00 msgr2=0x7fa998065fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/1627033204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980c2b00 0x7fa998065fb0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7fa998065a90 tx=0x7fa984009060).stop 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 -- 172.21.15.133:0/1627033204 shutdown_connections 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/1627033204 >> v2:172.21.15.178:3300/0 conn(0x7fa9980bd360 0x7fa998154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/1627033204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980c2b00 0x7fa998065fb0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 -- 172.21.15.133:0/1627033204 >> 172.21.15.133:0/1627033204 conn(0x7fa9980c8200 msgr2=0x7fa9980c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 -- 172.21.15.133:0/1627033204 shutdown_connections 2024-01-21T21:14:32.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.443+0000 7fa99f1bd700 1 -- 172.21.15.133:0/1627033204 wait complete. 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.444+0000 7fa99f1bd700 1 Processor -- start 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.444+0000 7fa99f1bd700 1 -- start start 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9980a9e30 0x7fa99814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 0x7fa9980bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981650f0 con 0x7fa9980bd360 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980a6b00 con 0x7fa9980a9e30 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99f1bd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980a6de0 con 0x7fa9980c2b00 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59024/0 (socket says 172.21.15.133:59024) 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 -- 172.21.15.133:0/2751875305 learned_addr learned my addr 172.21.15.133:0/2751875305 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:32.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99cf59700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9980a9e30 0x7fa99814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99d75a700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 0x7fa9980bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 -- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 msgr2=0x7fa9980bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 0x7fa9980bfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 -- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9980a9e30 msgr2=0x7fa99814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9980a9e30 0x7fa99814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa997fff700 1 -- 172.21.15.133:0/2751875305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840092a0 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.445+0000 7fa99d75a700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 0x7fa9980bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa997fff700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fa99805f8e0 tx=0x7fa984017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400b900 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984000d10 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9980a70c0 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98401c420 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.446+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99814dd90 con 0x7fa9980bd360 2024-01-21T21:14:32.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.447+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99805fdf0 con 0x7fa9980bd360 2024-01-21T21:14:32.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.447+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa98401c850 con 0x7fa9980bd360 2024-01-21T21:14:32.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.447+0000 7fa9957fa700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 0x7fa97c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:32.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.447+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa98407bd00 con 0x7fa9980bd360 2024-01-21T21:14:32.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.447+0000 7fa99cf59700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 0x7fa97c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:32.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.448+0000 7fa99cf59700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 0x7fa97c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa98c007fd0 tx=0x7fa98c007dd0).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:32.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.452+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa98404cee0 con 0x7fa9980bd360 2024-01-21T21:14:32.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.654+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9980c4ad0 con 0x7fa9980bd360 2024-01-21T21:14:32.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.654+0000 7fa9957fa700 1 -- 172.21.15.133:0/2751875305 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fa984020020 con 0x7fa9980bd360 2024-01-21T21:14:32.656 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:32.656 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7309,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/877866678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":877866678},{"type":"v1","addr":"172.21.15.178:6834","nonce":877866678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":7312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1641545496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1641545496},{"type":"v1","addr":"172.21.15.178:6835","nonce":1641545496}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/2340045761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2340045761},{"type":"v1","addr":"172.21.15.133:6836","nonce":2340045761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":8472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3790382627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3790382627},{"type":"v1","addr":"172.21.15.133:6837","nonce":3790382627}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 msgr2=0x7fa97c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 0x7fa97c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa98c007fd0 tx=0x7fa98c007dd0).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 msgr2=0x7fa9980c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7fa99805f8e0 tx=0x7fa984017000).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 shutdown_connections 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa97c05f150 0x7fa97c061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9980c2b00 0x7fa9980bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9980a9e30 0x7fa99814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 --2- 172.21.15.133:0/2751875305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9980bd360 0x7fa9980c0f10 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 >> 172.21.15.133:0/2751875305 conn(0x7fa9980c8200 msgr2=0x7fa9980c6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 shutdown_connections 2024-01-21T21:14:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:32.656+0000 7fa99f1bd700 1 -- 172.21.15.133:0/2751875305 wait complete. 2024-01-21T21:14:32.659 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 51 2024-01-21T21:14:32.670 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T21:14:32.670 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T21:14:32.670 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T21:14:32.670 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:14:32.670 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T21:14:32.670 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T21:14:32.671 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T21:14:32.671 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:14:32.671 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T21:14:32.671 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T21:14:32.671 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T21:14:32.671 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:14:32.671 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T21:14:32.671 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T21:14:32.672 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T21:14:32.672 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:14:32.680 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T21:14:32.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T21:14:32.684 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T21:14:32.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T21:14:32.685 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T21:14:32.685 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T21:14:32.722 INFO:tasks.ceph.mds.c:Started 2024-01-21T21:14:32.723 DEBUG:teuthology.parallel:result is None 2024-01-21T21:14:32.727 INFO:tasks.ceph.mds.d:Started 2024-01-21T21:14:32.727 DEBUG:teuthology.parallel:result is None 2024-01-21T21:14:32.728 INFO:tasks.ceph.mds.b:Started 2024-01-21T21:14:32.728 DEBUG:teuthology.parallel:result is None 2024-01-21T21:14:32.796 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T21:14:32.813 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T21:14:32.813 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T21:14:32.814 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-01-21T21:14:32.812+0000 7fe53c1b1700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-01-21T21:14:33.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-21T21:14:33.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:14:33.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:14:38.680 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T21:14:38.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T21:14:38.683 INFO:tasks.ceph.mds.a:Started 2024-01-21T21:14:38.684 DEBUG:teuthology.parallel:result is None 2024-01-21T21:14:38.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T21:14:38.769 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:14:38.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.814+0000 7fc4303fb700 1 Processor -- start 2024-01-21T21:14:38.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.815+0000 7fc4303fb700 1 -- start start 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc4303fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc42813a620 0x7fc4280a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc4303fb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 0x7fc428158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc4303fb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4281584f0 con 0x7fc4280626f0 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc4303fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280bd6f0 con 0x7fc42813a620 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc4303fb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280654e0 con 0x7fc42813aa00 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc42813a620 0x7fc4280a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc42813a620 0x7fc4280a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59062/0 (socket says 172.21.15.133:59062) 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 -- 172.21.15.133:0/861769983 learned_addr learned my addr 172.21.15.133:0/861769983 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42d996700 1 --2- 172.21.15.133:0/861769983 >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 0x7fc428158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 -- 172.21.15.133:0/861769983 >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 msgr2=0x7fc428158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 --2- 172.21.15.133:0/861769983 >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 0x7fc428158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 -- 172.21.15.133:0/861769983 >> v1:172.21.15.178:6789/0 conn(0x7fc4280626f0 legacy=0x7fc4280695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 -- 172.21.15.133:0/861769983 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428158730 con 0x7fc42813a620 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42d996700 1 --2- 172.21.15.133:0/861769983 >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 0x7fc428158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42e197700 1 --2- 172.21.15.133:0/861769983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc42813a620 0x7fc4280a6e30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fc42813e3f0 tx=0x7fc4240090f0).ready entity=mon.0 client_cookie=8eca62b4570543b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42d195700 1 -- 172.21.15.133:0/861769983 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400b600 con 0x7fc42813a620 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42d195700 1 -- 172.21.15.133:0/861769983 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42400b760 con 0x7fc42813a620 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.816+0000 7fc42d195700 1 -- 172.21.15.133:0/861769983 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42400bb00 con 0x7fc42813a620 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 -- 172.21.15.133:0/861769983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc42813a620 msgr2=0x7fc4280a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 --2- 172.21.15.133:0/861769983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc42813a620 0x7fc4280a6e30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fc42813e3f0 tx=0x7fc4240090f0).stop 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 -- 172.21.15.133:0/861769983 shutdown_connections 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 --2- 172.21.15.133:0/861769983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc42813a620 0x7fc4280a6e30 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 --2- 172.21.15.133:0/861769983 >> v2:172.21.15.178:3300/0 conn(0x7fc42813aa00 0x7fc428158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:38.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 -- 172.21.15.133:0/861769983 >> 172.21.15.133:0/861769983 conn(0x7fc4280c7dc0 msgr2=0x7fc4280c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:38.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 -- 172.21.15.133:0/861769983 shutdown_connections 2024-01-21T21:14:38.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.817+0000 7fc4303fb700 1 -- 172.21.15.133:0/861769983 wait complete. 2024-01-21T21:14:38.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.818+0000 7fc4303fb700 1 Processor -- start 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.818+0000 7fc4303fb700 1 -- start start 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 0x7fc42813c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 0x7fc4280a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42813cc30 con 0x7fc4280626f0 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42813cf10 con 0x7fc42813aa00 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc4303fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42813d1f0 con 0x7fc42813a620 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59076/0 (socket says 172.21.15.133:59076) 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 -- 172.21.15.133:0/277221627 learned_addr learned my addr 172.21.15.133:0/277221627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42d996700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 0x7fc42813c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e998700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 0x7fc4280a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 -- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 msgr2=0x7fc42813c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 0x7fc42813c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.819+0000 7fc42e197700 1 -- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 msgr2=0x7fc4280a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc42e197700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 0x7fc4280a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc42e197700 1 -- 172.21.15.133:0/277221627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc424009370 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc42d996700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 0x7fc42813c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc42e998700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 0x7fc4280a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc42e197700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fc424006fd0 tx=0x7fc424017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424002f30 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4240069b0 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4280aae10 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424024470 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.820+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc428139bf0 con 0x7fc4280626f0 2024-01-21T21:14:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.821+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42805fdf0 con 0x7fc4280626f0 2024-01-21T21:14:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.821+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc424021070 con 0x7fc4280626f0 2024-01-21T21:14:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.822+0000 7fc41affd700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 0x7fc40c0615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.822+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fc42407bcb0 con 0x7fc4280626f0 2024-01-21T21:14:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.822+0000 7fc42d996700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 0x7fc40c0615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.822+0000 7fc42d996700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 0x7fc40c0615e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc41c006d80 tx=0x7fc41c008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:38.826+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc42404ce90 con 0x7fc4280626f0 2024-01-21T21:14:39.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.005+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc42806a6a0 con 0x7fc4280626f0 2024-01-21T21:14:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.860+0000 7fc41affd700 1 -- 172.21.15.133:0/277221627 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v156) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc42806a6a0 con 0x7fc4280626f0 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 msgr2=0x7fc40c0615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 0x7fc40c0615e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc41c006d80 tx=0x7fc41c008040).stop 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 msgr2=0x7fc428139700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fc424006fd0 tx=0x7fc424017000).stop 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 shutdown_connections 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc40c05f120 0x7fc40c0615e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc42813aa00 0x7fc4280a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4280626f0 0x7fc428139700 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:39.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 --2- 172.21.15.133:0/277221627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc42813a620 0x7fc42813c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 >> 172.21.15.133:0/277221627 conn(0x7fc4280c7dc0 msgr2=0x7fc428156c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 shutdown_connections 2024-01-21T21:14:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:39.862+0000 7fc4303fb700 1 -- 172.21.15.133:0/277221627 wait complete. 2024-01-21T21:14:39.866 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T21:14:39.881 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T21:14:40.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.001+0000 7f1c6ffad700 1 Processor -- start 2024-01-21T21:14:40.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.001+0000 7f1c6ffad700 1 -- start start 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6ffad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c68155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6ffad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c68065660 con 0x7f1c680c3fb0 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6ffad700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c68065f00 con 0x7f1c680beb30 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6ffad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680bef10 con 0x7f1c68069ef0 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6e54a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c680c3fb0 0x7f1c68066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50610/0 (socket says 172.21.15.133:50610) 2024-01-21T21:14:40.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6e54a700 1 -- 172.21.15.133:0/3597676461 learned_addr learned my addr 172.21.15.133:0/3597676461 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6d548700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c68155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288326051 0 0) 0x7f1c68065660 con 0x7f1c680c3fb0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c540033f0 con 0x7f1c680c3fb0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1070721994 0 0) 0x7f1c540033f0 con 0x7f1c680c3fb0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 msgr2=0x7f1c68155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c68155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 >> v1:172.21.15.178:6789/0 conn(0x7f1c680beb30 legacy=0x7f1c680697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.002+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680c4740 con 0x7f1c680c3fb0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1c600017f0 con 0x7f1c680c3fb0 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 >> v1:172.21.15.133:6789/0 conn(0x7f1c680c3fb0 legacy=0x7f1c68066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c54003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c54003e00 0x7f1c54004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c54004b80 0x7f1c54005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680bef10 con 0x7f1c54004b80 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5400b990 con 0x7f1c54003e00 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5400dd60 con 0x7f1c68069ef0 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c54004b80 0x7f1c54005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6dd49700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c54003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6d548700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c54003e00 0x7f1c54004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 -- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 msgr2=0x7f1c54003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68069ef0 0x7f1c54003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 -- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c54003e00 msgr2=0x7f1c54004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c54003e00 0x7f1c54004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 -- 172.21.15.133:0/3597676461 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540033f0 con 0x7f1c54004b80 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6e54a700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c54004b80 0x7f1c54005000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f1c6000c5f0 tx=0x7f1c60001d90).ready entity=mon.0 client_cookie=15162740ee7df312 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60001fc0 con 0x7f1c54004b80 2024-01-21T21:14:40.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c60005b20 con 0x7f1c54004b80 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.003+0000 7f1c6cd47700 1 -- 172.21.15.133:0/3597676461 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c600070d0 con 0x7f1c54004b80 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 -- 172.21.15.133:0/3597676461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c54004b80 msgr2=0x7f1c54005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/3597676461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c54004b80 0x7f1c54005000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f1c6000c5f0 tx=0x7f1c60001d90).stop 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6e54a700 1 -- 172.21.15.133:0/3597676461 reap_dead start 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 -- 172.21.15.133:0/3597676461 shutdown_connections 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 -- 172.21.15.133:0/3597676461 >> 172.21.15.133:0/3597676461 conn(0x7f1c680c8010 msgr2=0x7f1c680c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 -- 172.21.15.133:0/3597676461 shutdown_connections 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.004+0000 7f1c6ffad700 1 -- 172.21.15.133:0/3597676461 wait complete. 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.005+0000 7f1c6ffad700 1 Processor -- start 2024-01-21T21:14:40.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.005+0000 7f1c6ffad700 1 -- start start 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68150a50 0x7f1c681544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c680a5f20 0x7f1c680a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68135360 con 0x7f1c68150670 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680a6870 con 0x7f1c680a5f20 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68134750 con 0x7f1c68150a50 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59100/0 (socket says 172.21.15.133:59100) 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 -- 172.21.15.133:0/286285474 learned_addr learned my addr 172.21.15.133:0/286285474 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6e54a700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c680a5f20 0x7f1c680a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6d548700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68150a50 0x7f1c681544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 -- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68150a50 msgr2=0x7f1c681544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68150a50 0x7f1c681544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 -- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c680a5f20 msgr2=0x7f1c680a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c680a5f20 0x7f1c680a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 -- 172.21.15.133:0/286285474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68134a30 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6dd49700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f1c64002a00 tx=0x7f1c64007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400f5f0 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400f750 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c68134d10 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.006+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400fad0 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.007+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c68135ce0 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.007+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c681351b0 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.008+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1c6401d3b0 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.008+0000 7f1c5e7fc700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 0x7f1c4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.008+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f1c64079e20 con 0x7f1c68150670 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.008+0000 7f1c6d548700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 0x7f1c4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.008+0000 7f1c6d548700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 0x7f1c4c061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1c58006f70 tx=0x7f1c58008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.012+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1c6404b200 con 0x7f1c68150670 2024-01-21T21:14:40.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-21T21:14:40.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.235+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1c68135640 con 0x7f1c68150670 2024-01-21T21:14:40.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.236+0000 7f1c5e7fc700 1 -- 172.21.15.133:0/286285474 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1c6404ee60 con 0x7f1c68150670 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.240 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.241 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.242 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T21:14:40.243 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T21:14:40.245 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.247 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:14:40.251 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T21:14:40.252 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 msgr2=0x7f1c4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 0x7f1c4c061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1c58006f70 tx=0x7f1c58008040).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 msgr2=0x7f1c681357f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f1c64002a00 tx=0x7f1c64007b90).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 shutdown_connections 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c4c05f150 0x7f1c4c061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c680a5f20 0x7f1c680a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c68150670 0x7f1c681357f0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 --2- 172.21.15.133:0/286285474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c68150a50 0x7f1c681544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 >> 172.21.15.133:0/286285474 conn(0x7f1c680c8010 msgr2=0x7f1c68067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 shutdown_connections 2024-01-21T21:14:40.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.238+0000 7f1c6ffad700 1 -- 172.21.15.133:0/286285474 wait complete. 2024-01-21T21:14:40.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.368+0000 7f2bf03d9700 1 Processor -- start 2024-01-21T21:14:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.368+0000 7f2bf03d9700 1 -- start start 2024-01-21T21:14:40.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bf03d9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2be8062e00 0x7f2be815d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bf03d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be80a50f0 con 0x7f2be81558c0 2024-01-21T21:14:40.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bf03d9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be80a4da0 con 0x7f2be8155ca0 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bf03d9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be80bde00 con 0x7f2be8062e00 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bee175700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2be81558c0 0x7f2be80626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42636/0 (socket says 172.21.15.133:42636) 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.369+0000 7f2bee175700 1 -- 172.21.15.133:0/1388944234 learned_addr learned my addr 172.21.15.133:0/1388944234 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bee976700 1 --2- 172.21.15.133:0/1388944234 >> v2:172.21.15.178:3300/0 conn(0x7f2be8062e00 0x7f2be815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bed173700 1 -- 172.21.15.133:0/1388944234 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284957337 0 0) 0x7f2be80a50f0 con 0x7f2be81558c0 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bed173700 1 -- 172.21.15.133:0/1388944234 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd40033f0 con 0x7f2be81558c0 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bee976700 1 -- 172.21.15.133:0/1388944234 >> v1:172.21.15.178:6789/0 conn(0x7f2be8155ca0 legacy=0x7f2be80bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bee976700 1 -- 172.21.15.133:0/1388944234 >> v1:172.21.15.133:6789/0 conn(0x7f2be81558c0 legacy=0x7f2be80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bee976700 1 -- 172.21.15.133:0/1388944234 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be80be0e0 con 0x7f2be8062e00 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bee976700 1 --2- 172.21.15.133:0/1388944234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be8062e00 0x7f2be815d150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2be0009e60 tx=0x7f2be0009780).ready entity=mon.1 client_cookie=4bd0201c6a99321a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bed173700 1 -- 172.21.15.133:0/1388944234 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be000e070 con 0x7f2be8062e00 2024-01-21T21:14:40.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bed173700 1 -- 172.21.15.133:0/1388944234 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be000bb60 con 0x7f2be8062e00 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.370+0000 7f2bed173700 1 -- 172.21.15.133:0/1388944234 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0012410 con 0x7f2be8062e00 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1388944234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be8062e00 msgr2=0x7f2be815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1388944234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be8062e00 0x7f2be815d150 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f2be0009e60 tx=0x7f2be0009780).stop 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1388944234 shutdown_connections 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1388944234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be8062e00 0x7f2be815d150 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1388944234 >> 172.21.15.133:0/1388944234 conn(0x7f2be80c8010 msgr2=0x7f2be80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1388944234 shutdown_connections 2024-01-21T21:14:40.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.371+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1388944234 wait complete. 2024-01-21T21:14:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.372+0000 7f2bf03d9700 1 Processor -- start 2024-01-21T21:14:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.372+0000 7f2bf03d9700 1 -- start start 2024-01-21T21:14:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be81558c0 0x7f2be8162480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 0x7f2be8162970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be8094990 con 0x7f2be8062e00 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be80957b0 con 0x7f2be81558c0 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be8094ba0 con 0x7f2be8155ca0 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50232/0 (socket says 172.21.15.133:50232) 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 -- 172.21.15.133:0/1999936460 learned_addr learned my addr 172.21.15.133:0/1999936460 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bed974700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be81558c0 0x7f2be8162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee976700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 0x7f2be8162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 -- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 msgr2=0x7f2be8162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 0x7f2be8162970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 -- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be81558c0 msgr2=0x7f2be8162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be81558c0 0x7f2be8162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 -- 172.21.15.133:0/1999936460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009a20 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee976700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 0x7f2be8162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bee175700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f2bd800c590 tx=0x7f2bd8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80072e0 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd8007440 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be8094e80 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.373+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80057a0 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.374+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be8095440 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.374+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be805fdf0 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.375+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2bd8005bd0 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.375+0000 7f2bdeffd700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 0x7f2bcc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.375+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f2bd8079a70 con 0x7f2be8062e00 2024-01-21T21:14:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.375+0000 7f2bed974700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 0x7f2bcc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.376+0000 7f2bed974700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 0x7f2bcc061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2be8092150 tx=0x7f2be4007d20).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.379+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2bd804ad40 con 0x7f2be8062e00 2024-01-21T21:14:40.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.541+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2be805f970 con 0x7f2be8062e00 2024-01-21T21:14:40.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.543+0000 7f2bdeffd700 1 -- 172.21.15.133:0/1999936460 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+14771 (secure 0 0 0) 0x7f2bd804e360 con 0x7f2be8062e00 2024-01-21T21:14:40.545 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:40.545 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":156,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:39.856075+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 msgr2=0x7f2bcc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 0x7f2bcc061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2be8092150 tx=0x7f2be4007d20).stop 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 msgr2=0x7f2be80922b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f2bd800c590 tx=0x7f2bd8007c80).stop 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 shutdown_connections 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bcc05f150 0x7f2bcc061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2be8155ca0 0x7f2be8162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2be8062e00 0x7f2be80922b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 --2- 172.21.15.133:0/1999936460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2be81558c0 0x7f2be8162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.544+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 >> 172.21.15.133:0/1999936460 conn(0x7f2be80c8010 msgr2=0x7f2be8150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.545+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 shutdown_connections 2024-01-21T21:14:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.545+0000 7f2bf03d9700 1 -- 172.21.15.133:0/1999936460 wait complete. 2024-01-21T21:14:40.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T21:14:40.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:14:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.676+0000 7f3910a20700 1 Processor -- start 2024-01-21T21:14:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.676+0000 7f3910a20700 1 -- start start 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.677+0000 7f3910a20700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f390c062c10 0x7f390c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.677+0000 7f3910a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 0x7f390c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.677+0000 7f3910a20700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0634e0 con 0x7f390c069c40 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.677+0000 7f3910a20700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c06a130 con 0x7f390c062c10 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.677+0000 7f3910a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c06a410 con 0x7f390c0697e0 2024-01-21T21:14:40.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 0x7f390c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f390c062c10 0x7f390c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f3909d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 0x7f390c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:52488/0 (socket says 172.21.15.133:52488) 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390ad9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f390c069c40 0x7f390c1583b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:39670/0 (socket says 172.21.15.133:39670) 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f3909d9b700 1 -- 172.21.15.133:0/1360516917 learned_addr learned my addr 172.21.15.133:0/1360516917 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f390c062c10 0x7f390c062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57516/0 (socket says 172.21.15.133:57516) 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 -- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 msgr2=0x7f390c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 --2- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 0x7f390c065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 -- 172.21.15.133:0/1360516917 >> v1:172.21.15.178:6789/0 conn(0x7f390c069c40 legacy=0x7f390c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390959a700 1 -- 172.21.15.133:0/1360516917 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662496727 0 0) 0x7f390c0634e0 con 0x7f390c069c40 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 -- 172.21.15.133:0/1360516917 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c06a6f0 con 0x7f390c062c10 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390a59c700 1 --2- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c062c10 0x7f390c062ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3900009760 tx=0x7f3900009060).ready entity=mon.1 client_cookie=52fdcebe5e2a9a4b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390959a700 1 -- 172.21.15.133:0/1360516917 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000090d0 con 0x7f390c062c10 2024-01-21T21:14:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390959a700 1 -- 172.21.15.133:0/1360516917 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390000f510 con 0x7f390c062c10 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.678+0000 7f390959a700 1 -- 172.21.15.133:0/1360516917 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000f890 con 0x7f390c062c10 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 -- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c062c10 msgr2=0x7f390c062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 --2- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c062c10 0x7f390c062ff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3900009760 tx=0x7f3900009060).stop 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 -- 172.21.15.133:0/1360516917 shutdown_connections 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 --2- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c062c10 0x7f390c062ff0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 --2- 172.21.15.133:0/1360516917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c0697e0 0x7f390c065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 -- 172.21.15.133:0/1360516917 >> 172.21.15.133:0/1360516917 conn(0x7f390c0c8010 msgr2=0x7f390c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 -- 172.21.15.133:0/1360516917 shutdown_connections 2024-01-21T21:14:40.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.679+0000 7f3910a20700 1 -- 172.21.15.133:0/1360516917 wait complete. 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.680+0000 7f3910a20700 1 Processor -- start 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.680+0000 7f3910a20700 1 -- start start 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c0697e0 0x7f390c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c069c40 0x7f390c13c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0a91f0 con 0x7f390c062c10 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c154760 con 0x7f390c0697e0 2024-01-21T21:14:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3910a20700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0a8060 con 0x7f390c069c40 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50236/0 (socket says 172.21.15.133:50236) 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 -- 172.21.15.133:0/1810551565 learned_addr learned my addr 172.21.15.133:0/1810551565 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f3909d9b700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c0697e0 0x7f390c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390ad9d700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c069c40 0x7f390c13c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 -- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c069c40 msgr2=0x7f390c13c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c069c40 0x7f390c13c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 -- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c0697e0 msgr2=0x7f390c0ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c0697e0 0x7f390c0ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 -- 172.21.15.133:0/1810551565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000092a0 con 0x7f390c062c10 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.681+0000 7f390a59c700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f3900009150 tx=0x7f3900017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.682+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390000fc50 con 0x7f390c062c10 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.682+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390000fdb0 con 0x7f390c062c10 2024-01-21T21:14:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.682+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390001b690 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.682+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c0a8340 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.682+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0a8900 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.683+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c0a94d0 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.683+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f390001ba80 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.683+0000 7f38faffd700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 0x7f38ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.684+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f390007b710 con 0x7f390c062c10 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.684+0000 7f3909d9b700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 0x7f38ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.684+0000 7f3909d9b700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 0x7f38ec061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f390c0add10 tx=0x7f38fc008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.688+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f390004caa0 con 0x7f390c062c10 2024-01-21T21:14:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.850+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f390c05fdf0 con 0x7f390c062c10 2024-01-21T21:14:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.850+0000 7f38faffd700 1 -- 172.21.15.133:0/1810551565 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v156) v1 ==== 110+0+10 (secure 0 0 0) 0x7f39000280b0 con 0x7f390c062c10 2024-01-21T21:14:40.853 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:14:40.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 msgr2=0x7f38ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 0x7f38ec061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f390c0add10 tx=0x7f38fc008040).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 msgr2=0x7f390c154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f3900009150 tx=0x7f3900017000).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 shutdown_connections 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f38ec05f150 0x7f38ec061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390c069c40 0x7f390c13c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f390c062c10 0x7f390c154270 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 --2- 172.21.15.133:0/1810551565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390c0697e0 0x7f390c0ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 >> 172.21.15.133:0/1810551565 conn(0x7f390c0c8010 msgr2=0x7f390c0a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 shutdown_connections 2024-01-21T21:14:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.852+0000 7f3910a20700 1 -- 172.21.15.133:0/1810551565 wait complete. 2024-01-21T21:14:40.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:14:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.983+0000 7f84898a7700 1 Processor -- start 2024-01-21T21:14:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.983+0000 7f84898a7700 1 -- start start 2024-01-21T21:14:40.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84898a7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8484062e00 0x7f84840a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84898a7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f848413aa00 0x7f8484158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84898a7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84841584f0 con 0x7f848413a620 2024-01-21T21:14:40.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84898a7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84840bd6f0 con 0x7f8484062e00 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84898a7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84840654e0 con 0x7f848413aa00 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84827fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8484062e00 0x7f84840a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f8482ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f848413a620 0x7f84840626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42642/0 (socket says 172.21.15.133:42642) 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84827fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8484062e00 0x7f84840a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50240/0 (socket says 172.21.15.133:50240) 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.984+0000 7f84827fc700 1 -- 172.21.15.133:0/2771008829 learned_addr learned my addr 172.21.15.133:0/2771008829 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84837fe700 1 --2- 172.21.15.133:0/2771008829 >> v2:172.21.15.178:3300/0 conn(0x7f848413aa00 0x7f8484158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84827fc700 1 -- 172.21.15.133:0/2771008829 >> v2:172.21.15.178:3300/0 conn(0x7f848413aa00 msgr2=0x7f8484158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84827fc700 1 --2- 172.21.15.133:0/2771008829 >> v2:172.21.15.178:3300/0 conn(0x7f848413aa00 0x7f8484158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84827fc700 1 -- 172.21.15.133:0/2771008829 >> v1:172.21.15.133:6789/0 conn(0x7f848413a620 legacy=0x7f84840626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84827fc700 1 -- 172.21.15.133:0/2771008829 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484158730 con 0x7f8484062e00 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f8481ffb700 1 -- 172.21.15.133:0/2771008829 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833682546 0 0) 0x7f8478001110 con 0x7f848413a620 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84827fc700 1 --2- 172.21.15.133:0/2771008829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84840a6e30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f8484068da0 tx=0x7f84740090f0).ready entity=mon.0 client_cookie=5be43a4359cac6de server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f8481ffb700 1 -- 172.21.15.133:0/2771008829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400b600 con 0x7f8484062e00 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f8481ffb700 1 -- 172.21.15.133:0/2771008829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847400b760 con 0x7f8484062e00 2024-01-21T21:14:40.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f8481ffb700 1 -- 172.21.15.133:0/2771008829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400bb00 con 0x7f8484062e00 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84898a7700 1 -- 172.21.15.133:0/2771008829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 msgr2=0x7f84840a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.985+0000 7f84898a7700 1 --2- 172.21.15.133:0/2771008829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84840a6e30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f8484068da0 tx=0x7f84740090f0).stop 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 -- 172.21.15.133:0/2771008829 shutdown_connections 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 --2- 172.21.15.133:0/2771008829 >> v2:172.21.15.178:3300/0 conn(0x7f848413aa00 0x7f8484158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 --2- 172.21.15.133:0/2771008829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84840a6e30 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 -- 172.21.15.133:0/2771008829 >> 172.21.15.133:0/2771008829 conn(0x7f84840c7dc0 msgr2=0x7f84840c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 -- 172.21.15.133:0/2771008829 shutdown_connections 2024-01-21T21:14:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.986+0000 7f84898a7700 1 -- 172.21.15.133:0/2771008829 wait complete. 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.987+0000 7f84898a7700 1 Processor -- start 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.987+0000 7f84898a7700 1 -- start start 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f848413a620 0x7f8484155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 0x7f84840aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840a7e80 con 0x7f8484062e00 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84840a8940 con 0x7f848413a620 2024-01-21T21:14:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84840a8370 con 0x7f848413aa00 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50248/0 (socket says 172.21.15.133:50248) 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 -- 172.21.15.133:0/3850799788 learned_addr learned my addr 172.21.15.133:0/3850799788 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84827fc700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f848413a620 0x7f8484155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84837fe700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 0x7f84840aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 -- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 msgr2=0x7f84840aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 0x7f84840aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 -- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f848413a620 msgr2=0x7f8484155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f848413a620 0x7f8484155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 -- 172.21.15.133:0/3850799788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474009370 con 0x7f8484062e00 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84837fe700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 0x7f84840aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f8482ffd700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f847800c4f0 tx=0x7f8478007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780072e0 con 0x7f8484062e00 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478007440 con 0x7f8484062e00 2024-01-21T21:14:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478005930 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.988+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84841657b0 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.989+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84840a85d0 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.990+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848405fdf0 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.990+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8478005ce0 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.990+0000 7f846b7fe700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 0x7f8470061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.990+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f8478079690 con 0x7f8484062e00 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.990+0000 7f84827fc700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 0x7f8470061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.991+0000 7f84827fc700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 0x7f8470061640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8484063200 tx=0x7f8474017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:40.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:40.994+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f847804aa20 con 0x7f8484062e00 2024-01-21T21:14:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.157+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f84841584f0 con 0x7f8484062e00 2024-01-21T21:14:41.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.157+0000 7f846b7fe700 1 -- 172.21.15.133:0/3850799788 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7f84841584f0 con 0x7f8484062e00 2024-01-21T21:14:41.160 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 msgr2=0x7f8470061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 0x7f8470061640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8484063200 tx=0x7f8474017000).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 msgr2=0x7f84841652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f847800c4f0 tx=0x7f8478007a90).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 shutdown_connections 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847005f180 0x7f8470061640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f848413aa00 0x7f84840aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8484062e00 0x7f84841652c0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 --2- 172.21.15.133:0/3850799788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f848413a620 0x7f8484155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 >> 172.21.15.133:0/3850799788 conn(0x7f84840c7dc0 msgr2=0x7f84840bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 shutdown_connections 2024-01-21T21:14:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.159+0000 7f84898a7700 1 -- 172.21.15.133:0/3850799788 wait complete. 2024-01-21T21:14:41.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T21:14:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.287+0000 7f8497c8b700 1 Processor -- start 2024-01-21T21:14:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.287+0000 7f8497c8b700 1 -- start start 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8497c8b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84900beb30 0x7f8490155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8497c8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8490069ef0 0x7f8490066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8497c8b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8490065660 con 0x7f84900c3fb0 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8497c8b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84900bef10 con 0x7f84900beb30 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8497c8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8490156070 con 0x7f8490069ef0 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8495a27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84900beb30 0x7f8490155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8495a27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f84900beb30 0x7f8490155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50262/0 (socket says 172.21.15.133:50262) 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8495a27700 1 -- 172.21.15.133:0/4037660222 learned_addr learned my addr 172.21.15.133:0/4037660222 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.288+0000 7f8496228700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8490069ef0 0x7f8490066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8495a27700 1 -- 172.21.15.133:0/4037660222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8490069ef0 msgr2=0x7f8490066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8495a27700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8490069ef0 0x7f8490066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8495a27700 1 -- 172.21.15.133:0/4037660222 >> v1:172.21.15.178:6789/0 conn(0x7f84900c3fb0 legacy=0x7f84900697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8495a27700 1 -- 172.21.15.133:0/4037660222 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490065f00 con 0x7f84900beb30 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8495a27700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84900beb30 0x7f8490155b80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f8480006fd0 tx=0x7f84800090f0).ready entity=mon.0 client_cookie=92f8ab513b8e9c5c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8494a25700 1 -- 172.21.15.133:0/4037660222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000b580 con 0x7f84900beb30 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8494a25700 1 -- 172.21.15.133:0/4037660222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000b6e0 con 0x7f84900beb30 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8494a25700 1 -- 172.21.15.133:0/4037660222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000ba80 con 0x7f84900beb30 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 -- 172.21.15.133:0/4037660222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84900beb30 msgr2=0x7f8490155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84900beb30 0x7f8490155b80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f8480006fd0 tx=0x7f84800090f0).stop 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 -- 172.21.15.133:0/4037660222 shutdown_connections 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84900beb30 0x7f8490155b80 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 --2- 172.21.15.133:0/4037660222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8490069ef0 0x7f8490066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.289+0000 7f8497c8b700 1 -- 172.21.15.133:0/4037660222 >> 172.21.15.133:0/4037660222 conn(0x7f84900c8010 msgr2=0x7f84900c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.290+0000 7f8497c8b700 1 -- 172.21.15.133:0/4037660222 shutdown_connections 2024-01-21T21:14:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.290+0000 7f8497c8b700 1 -- 172.21.15.133:0/4037660222 wait complete. 2024-01-21T21:14:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.291+0000 7f8497c8b700 1 Processor -- start 2024-01-21T21:14:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.291+0000 7f8497c8b700 1 -- start start 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.291+0000 7f8497c8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.291+0000 7f8497c8b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84900beb30 0x7f84901547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84900c3fb0 0x7f8490135dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c7780 con 0x7f8490069ef0 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c6e00 con 0x7f84900beb30 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900c18c0 con 0x7f84900c3fb0 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50274/0 (socket says 172.21.15.133:50274) 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 -- 172.21.15.133:0/1201882355 learned_addr learned my addr 172.21.15.133:0/1201882355 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8496228700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84900c3fb0 0x7f8490135dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495226700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84900beb30 0x7f84901547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 -- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84900c3fb0 msgr2=0x7f8490135dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84900c3fb0 0x7f8490135dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 -- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84900beb30 msgr2=0x7f84901547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84900beb30 0x7f84901547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 -- 172.21.15.133:0/1201882355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480009370 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8495a27700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f8490068a00 tx=0x7f8480017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480006d90 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8480006970 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900c67f0 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000be40 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.292+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900c6a90 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.293+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849005fdf0 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.294+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f848001c630 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.294+0000 7f84867fc700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 0x7f8474061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.294+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f848007bb20 con 0x7f8490069ef0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.294+0000 7f8495226700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 0x7f8474061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.294+0000 7f8495226700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 0x7f8474061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8490153d10 tx=0x7f848c007d40).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.298+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f848004ceb0 con 0x7f8490069ef0 2024-01-21T21:14:41.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.463+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f84900c4740 con 0x7f8490069ef0 2024-01-21T21:14:41.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.463+0000 7f84867fc700 1 -- 172.21.15.133:0/1201882355 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v156) v1 ==== 84+0+143 (secure 0 0 0) 0x7f848002a030 con 0x7f8490069ef0 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:41.466 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 msgr2=0x7f8474061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 0x7f8474061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8490153d10 tx=0x7f848c007d40).stop 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 msgr2=0x7f84900c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f8490068a00 tx=0x7f8480017000).stop 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 shutdown_connections 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f847405f150 0x7f8474061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84900c3fb0 0x7f8490135dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8490069ef0 0x7f84900c7290 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 --2- 172.21.15.133:0/1201882355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84900beb30 0x7f84901547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 >> 172.21.15.133:0/1201882355 conn(0x7f84900c8010 msgr2=0x7f8490137c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 shutdown_connections 2024-01-21T21:14:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.465+0000 7f8497c8b700 1 -- 172.21.15.133:0/1201882355 wait complete. 2024-01-21T21:14:41.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T21:14:41.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T21:14:41.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.599+0000 7f01617b3700 1 Processor -- start 2024-01-21T21:14:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.599+0000 7f01617b3700 1 -- start start 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f015c0bf4f0 0x7f015c0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c063c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f015c067d70 0x7f015c068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c0c3c60 con 0x7f015c0bf4f0 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015c068cf0 con 0x7f015c067d70 2024-01-21T21:14:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f01617b3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c064150 con 0x7f015c063800 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f015c0bf4f0 0x7f015c0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f015c0bf4f0 0x7f015c0c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50282/0 (socket says 172.21.15.133:50282) 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 -- 172.21.15.133:0/5927561 learned_addr learned my addr 172.21.15.133:0/5927561 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015a7fc700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015b7fe700 1 --2- 172.21.15.133:0/5927561 >> v2:172.21.15.178:3300/0 conn(0x7f015c067d70 0x7f015c068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 -- 172.21.15.133:0/5927561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 msgr2=0x7f015c063c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c063c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 -- 172.21.15.133:0/5927561 >> v2:172.21.15.178:3300/0 conn(0x7f015c067d70 msgr2=0x7f015c068200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 --2- 172.21.15.133:0/5927561 >> v2:172.21.15.178:3300/0 conn(0x7f015c067d70 0x7f015c068200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 -- 172.21.15.133:0/5927561 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c0bf8d0 con 0x7f015c0bf4f0 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.600+0000 7f015affd700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c40f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f015c0c6620 tx=0x7f01500090f0).ready entity=mon.0 client_cookie=4670e46621838656 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f0159ffb700 1 -- 172.21.15.133:0/5927561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000b600 con 0x7f015c0bf4f0 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f0159ffb700 1 -- 172.21.15.133:0/5927561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015000b760 con 0x7f015c0bf4f0 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f0159ffb700 1 -- 172.21.15.133:0/5927561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015000bae0 con 0x7f015c0bf4f0 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 -- 172.21.15.133:0/5927561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c0bf4f0 msgr2=0x7f015c0c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c40f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f015c0c6620 tx=0x7f01500090f0).stop 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 -- 172.21.15.133:0/5927561 shutdown_connections 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 --2- 172.21.15.133:0/5927561 >> v2:172.21.15.178:3300/0 conn(0x7f015c067d70 0x7f015c068200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c40f0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 --2- 172.21.15.133:0/5927561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c063c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 -- 172.21.15.133:0/5927561 >> 172.21.15.133:0/5927561 conn(0x7f015c066a70 msgr2=0x7f015c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 -- 172.21.15.133:0/5927561 shutdown_connections 2024-01-21T21:14:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.601+0000 7f01617b3700 1 -- 172.21.15.133:0/5927561 wait complete. 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.602+0000 7f01617b3700 1 Processor -- start 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.602+0000 7f01617b3700 1 -- start start 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0ac8d0 con 0x7f015c067d70 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0abfe0 con 0x7f015c0bf4f0 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f01617b3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c0ac280 con 0x7f015c063800 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f015a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f015a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50290/0 (socket says 172.21.15.133:50290) 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.603+0000 7f015a7fc700 1 -- 172.21.15.133:0/2326116693 learned_addr learned my addr 172.21.15.133:0/2326116693 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015affd700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015b7fe700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 -- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 msgr2=0x7f015c142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c142930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 -- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 msgr2=0x7f015c0c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 -- 172.21.15.133:0/2326116693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150009370 con 0x7f015c067d70 2024-01-21T21:14:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015b7fe700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f015a7fc700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f014c00d890 tx=0x7f014c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0125f0 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c012750 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f015c0ac560 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c012ad0 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.604+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015c0ad7b0 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.605+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015c05fdf0 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.605+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f014c013480 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.606+0000 7f01437fe700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 0x7f0148061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.606+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f014c079e80 con 0x7f015c067d70 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.606+0000 7f015affd700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 0x7f0148061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.606+0000 7f015affd700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 0x7f0148061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0150009130 tx=0x7f0150017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:41.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.610+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f014c04b1b0 con 0x7f015c067d70 2024-01-21T21:14:41.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.772+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f015c06bd20 con 0x7f015c067d70 2024-01-21T21:14:41.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.870+0000 7f01437fe700 1 -- 172.21.15.133:0/2326116693 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v157) v1 ==== 152+0+0 (secure 0 0 0) 0x7f014c04e7d0 con 0x7f015c067d70 2024-01-21T21:14:41.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.874+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 msgr2=0x7f0148061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.874+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 0x7f0148061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f0150009130 tx=0x7f0150017000).stop 2024-01-21T21:14:41.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.874+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 msgr2=0x7f015c0c0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:41.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.874+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f014c00d890 tx=0x7f014c008040).stop 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 shutdown_connections 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f014805f150 0x7f0148061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f015c0bf4f0 0x7f015c0c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f015c063800 0x7f015c142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 --2- 172.21.15.133:0/2326116693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f015c067d70 0x7f015c0c0d30 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 >> 172.21.15.133:0/2326116693 conn(0x7f015c066a70 msgr2=0x7f015c1519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.875+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 shutdown_connections 2024-01-21T21:14:41.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:41.876+0000 7f01617b3700 1 -- 172.21.15.133:0/2326116693 wait complete. 2024-01-21T21:14:41.879 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T21:14:41.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T21:14:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.012+0000 7fb5518ba700 1 Processor -- start 2024-01-21T21:14:42.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.012+0000 7fb5518ba700 1 -- start start 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.013+0000 7fb5518ba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c062c10 0x7fb54c062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.013+0000 7fb5518ba700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb54c0697e0 0x7fb54c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.013+0000 7fb5518ba700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0634e0 con 0x7fb54c069c40 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.013+0000 7fb5518ba700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c06a130 con 0x7fb54c0697e0 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.013+0000 7fb5518ba700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c06a410 con 0x7fb54c062c10 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb54c0697e0 0x7fb54c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c062c10 0x7fb54c062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb54c0697e0 0x7fb54c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:57584/0 (socket says 172.21.15.133:57584) 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 -- 172.21.15.133:0/3711386249 learned_addr learned my addr 172.21.15.133:0/3711386249 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 -- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c062c10 msgr2=0x7fb54c062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 --2- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c062c10 0x7fb54c062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 -- 172.21.15.133:0/3711386249 >> v1:172.21.15.178:6789/0 conn(0x7fb54c069c40 legacy=0x7fb54c1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 -- 172.21.15.133:0/3711386249 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c06a6f0 con 0x7fb54c0697e0 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb549ffb700 1 -- 172.21.15.133:0/3711386249 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047854500 0 0) 0x7fb54c0634e0 con 0x7fb54c069c40 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb54a7fc700 1 --2- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c0697e0 0x7fb54c065660 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fb53c006fd0 tx=0x7fb53c0090f0).ready entity=mon.1 client_cookie=1fdf580b809df9d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb549ffb700 1 -- 172.21.15.133:0/3711386249 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00b580 con 0x7fb54c0697e0 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb549ffb700 1 -- 172.21.15.133:0/3711386249 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00b6e0 con 0x7fb54c0697e0 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.014+0000 7fb549ffb700 1 -- 172.21.15.133:0/3711386249 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00ba80 con 0x7fb54c0697e0 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 -- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c0697e0 msgr2=0x7fb54c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c0697e0 0x7fb54c065660 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fb53c006fd0 tx=0x7fb53c0090f0).stop 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 -- 172.21.15.133:0/3711386249 shutdown_connections 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c062c10 0x7fb54c062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3711386249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c0697e0 0x7fb54c065660 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 -- 172.21.15.133:0/3711386249 >> 172.21.15.133:0/3711386249 conn(0x7fb54c0c8010 msgr2=0x7fb54c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:42.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 -- 172.21.15.133:0/3711386249 shutdown_connections 2024-01-21T21:14:42.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.015+0000 7fb5518ba700 1 -- 172.21.15.133:0/3711386249 wait complete. 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.016+0000 7fb5518ba700 1 Processor -- start 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.016+0000 7fb5518ba700 1 -- start start 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c0697e0 0x7fb54c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c069c40 0x7fb54c13c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a8a40 con 0x7fb54c062c10 2024-01-21T21:14:42.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a4da0 con 0x7fb54c069c40 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb5518ba700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a5320 con 0x7fb54c0697e0 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50300/0 (socket says 172.21.15.133:50300) 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 -- 172.21.15.133:0/3051613443 learned_addr learned my addr 172.21.15.133:0/3051613443 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54a7fc700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c0697e0 0x7fb54c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54b7fe700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c069c40 0x7fb54c13c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 -- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c0697e0 msgr2=0x7fb54c0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c0697e0 0x7fb54c0aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 -- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c069c40 msgr2=0x7fb54c13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.017+0000 7fb54affd700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c069c40 0x7fb54c13c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb54affd700 1 -- 172.21.15.133:0/3051613443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009370 con 0x7fb54c062c10 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb54affd700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fb54000e900 tx=0x7fb540009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000c640 con 0x7fb54c062c10 2024-01-21T21:14:42.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000c7a0 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000cb20 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c0a8480 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.018+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c0a5030 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.019+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c05fdf0 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.020+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb54001b400 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.020+0000 7fb5337fe700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 0x7fb5380615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.020+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fb54007acc0 con 0x7fb54c062c10 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.020+0000 7fb54a7fc700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 0x7fb5380615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:42.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.020+0000 7fb54a7fc700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 0x7fb5380615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb53c006fd0 tx=0x7fb53c017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:42.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.024+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb54004bfd0 con 0x7fb54c062c10 2024-01-21T21:14:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.188+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb54c0bcf70 con 0x7fb54c062c10 2024-01-21T21:14:42.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.871+0000 7fb5337fe700 1 -- 172.21.15.133:0/3051613443 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v158) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb540016020 con 0x7fb54c062c10 2024-01-21T21:14:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.875+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 msgr2=0x7fb5380615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.875+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 0x7fb5380615e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb53c006fd0 tx=0x7fb53c017000).stop 2024-01-21T21:14:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.875+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 msgr2=0x7fb54c0a7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:42.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.875+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fb54000e900 tx=0x7fb540009060).stop 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 shutdown_connections 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb53805f120 0x7fb5380615e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fb53c006fd0 tx=0x7fb53c017000).stop 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54c069c40 0x7fb54c13c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb54c062c10 0x7fb54c0a7ba0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 --2- 172.21.15.133:0/3051613443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb54c0697e0 0x7fb54c0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:42.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.876+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 >> 172.21.15.133:0/3051613443 conn(0x7fb54c0c8010 msgr2=0x7fb54c0c77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:42.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.878+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 shutdown_connections 2024-01-21T21:14:42.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:42.881+0000 7fb5518ba700 1 -- 172.21.15.133:0/3051613443 wait complete. 2024-01-21T21:14:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T21:14:42.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T21:14:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 Processor -- start 2024-01-21T21:14:43.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 -- start start 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 0x7fcc00062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 0x7fcc00065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc00069c40 0x7fcc00065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc00066040 con 0x7fcc00069c40 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.024+0000 7fcc05734700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000634e0 con 0x7fcc000697e0 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcc05734700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0006a130 con 0x7fcc00062c10 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc00069c40 0x7fcc00065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcc00069c40 0x7fcc00065b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50314/0 (socket says 172.21.15.133:50314) 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1506952388 learned_addr learned my addr 172.21.15.133:0/1506952388 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 0x7fcc00062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1506952388 >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 0x7fcc00065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1506952388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 msgr2=0x7fcc00062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 0x7fcc00062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1506952388 >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 msgr2=0x7fcc00065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1506952388 >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 0x7fcc00065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 -- 172.21.15.133:0/1506952388 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0006a410 con 0x7fcc00069c40 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 0x7fcc00062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1506952388 >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 0x7fcc00065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00069c40 0x7fcc00065b50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fcc0006a9f0 tx=0x7fcbf8009840).ready entity=mon.0 client_cookie=34ed4224b59cf1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfdffb700 1 -- 172.21.15.133:0/1506952388 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800e070 con 0x7fcc00069c40 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfdffb700 1 -- 172.21.15.133:0/1506952388 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf800ba50 con 0x7fcc00069c40 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.025+0000 7fcbfdffb700 1 -- 172.21.15.133:0/1506952388 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800bdd0 con 0x7fcc00069c40 2024-01-21T21:14:43.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 -- 172.21.15.133:0/1506952388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00069c40 msgr2=0x7fcc00065b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00069c40 0x7fcc00065b50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fcc0006a9f0 tx=0x7fcbf8009840).stop 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 -- 172.21.15.133:0/1506952388 shutdown_connections 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00069c40 0x7fcc00065b50 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 --2- 172.21.15.133:0/1506952388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00062c10 0x7fcc00062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 --2- 172.21.15.133:0/1506952388 >> v2:172.21.15.178:3300/0 conn(0x7fcc000697e0 0x7fcc00065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 -- 172.21.15.133:0/1506952388 >> 172.21.15.133:0/1506952388 conn(0x7fcc000c8010 msgr2=0x7fcc000c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 -- 172.21.15.133:0/1506952388 shutdown_connections 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.026+0000 7fcc05734700 1 -- 172.21.15.133:0/1506952388 wait complete. 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.027+0000 7fcc05734700 1 Processor -- start 2024-01-21T21:14:43.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.027+0000 7fcc05734700 1 -- start start 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 0x7fcc000a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 0x7fcc000aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000bf410 con 0x7fcc00062c10 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000aa620 con 0x7fcc000697e0 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcc05734700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00165220 con 0x7fcc00069c40 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50316/0 (socket says 172.21.15.133:50316) 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 -- 172.21.15.133:0/1957881041 learned_addr learned my addr 172.21.15.133:0/1957881041 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:43.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 0x7fcc000aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 0x7fcc000a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 -- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 msgr2=0x7fcc000aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 0x7fcc000aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 -- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 msgr2=0x7fcc000a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 0x7fcc000a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfeffd700 1 -- 172.21.15.133:0/1957881041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009ae0 con 0x7fcc00062c10 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbff7fe700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 0x7fcc000aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.028+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 0x7fcc000a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcbfeffd700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fcbf000d890 tx=0x7fcbf0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf00125f0 con 0x7fcc00062c10 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf0012750 con 0x7fcc00062c10 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc000abf60 con 0x7fcc00062c10 2024-01-21T21:14:43.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0012ad0 con 0x7fcc00062c10 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.029+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc00164970 con 0x7fcc00062c10 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.030+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0005fdf0 con 0x7fcc00062c10 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.030+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcbf0013480 con 0x7fcc00062c10 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.031+0000 7fcbe77fe700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 0x7fcbec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.031+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6677+0+0 (secure 0 0 0) 0x7fcbf007a1a0 con 0x7fcc00062c10 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.031+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 0x7fcbec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.031+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 0x7fcbec061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcbf4006fd0 tx=0x7fcbf4008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.035+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbf004b1e0 con 0x7fcc00062c10 2024-01-21T21:14:43.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.242+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcc0006a6f0 con 0x7fcc00062c10 2024-01-21T21:14:43.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.248+0000 7fcbe77fe700 1 -- 172.21.15.133:0/1957881041 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcbf004e800 con 0x7fcc00062c10 2024-01-21T21:14:43.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.256+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 msgr2=0x7fcbec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.256+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 0x7fcbec061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcbf4006fd0 tx=0x7fcbf4008040).stop 2024-01-21T21:14:43.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.256+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 msgr2=0x7fcc000aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.256+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7fcbf000d890 tx=0x7fcbf0008040).stop 2024-01-21T21:14:43.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 shutdown_connections 2024-01-21T21:14:43.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcbec05f150 0x7fcbec061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc00069c40 0x7fcc000aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc00062c10 0x7fcc000aba70 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 --2- 172.21.15.133:0/1957881041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc000697e0 0x7fcc000a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 >> 172.21.15.133:0/1957881041 conn(0x7fcc000c8010 msgr2=0x7fcc0013c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 shutdown_connections 2024-01-21T21:14:43.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.258+0000 7fcc05734700 1 -- 172.21.15.133:0/1957881041 wait complete. 2024-01-21T21:14:43.274 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 19 and data pool 20 2024-01-21T21:14:43.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.397+0000 7f7e965d4700 1 Processor -- start 2024-01-21T21:14:43.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.397+0000 7f7e965d4700 1 -- start start 2024-01-21T21:14:43.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.397+0000 7f7e965d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e90067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.397+0000 7f7e965d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90068370 con 0x7f7e900c5930 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e965d4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90068650 con 0x7f7e90137410 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e965d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90068930 con 0x7f7e90137030 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e94b71700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7e900c5930 0x7f7e9015df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42646/0 (socket says 172.21.15.133:42646) 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e94b71700 1 -- 172.21.15.133:0/1623533271 learned_addr learned my addr 172.21.15.133:0/1623533271 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256980106 0 0) 0x7f7e90068370 con 0x7f7e900c5930 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e780033f0 con 0x7f7e900c5930 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e90067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460944201 0 0) 0x7f7e780033f0 con 0x7f7e900c5930 2024-01-21T21:14:43.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 msgr2=0x7f7e90067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e90067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 >> v1:172.21.15.178:6789/0 conn(0x7f7e90137410 legacy=0x7f7e90155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90068c10 con 0x7f7e900c5930 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f7e880017f0 con 0x7f7e900c5930 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 >> v1:172.21.15.133:6789/0 conn(0x7f7e900c5930 legacy=0x7f7e9015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e78003910 0x7f7e78003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e78004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78004b80 0x7f7e78005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90068930 con 0x7f7e78003910 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800b9c0 con 0x7f7e78004b80 2024-01-21T21:14:43.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bb80 con 0x7f7e90137030 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.398+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e78003910 0x7f7e78003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e94b71700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78004b80 0x7f7e78005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8f7fe700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e78004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 -- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 msgr2=0x7f7e78004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e78004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 -- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78004b80 msgr2=0x7f7e78005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78004b80 0x7f7e78005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 -- 172.21.15.133:0/1623533271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780033f0 con 0x7f7e78003910 2024-01-21T21:14:43.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8f7fe700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e90137030 0x7f7e78004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e78003910 0x7f7e78003d30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f7e80006d80 tx=0x7f7e80009060).ready entity=mon.0 client_cookie=d3372caac9d1d393 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80009430 con 0x7f7e78003910 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80009e70 con 0x7f7e78003910 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e8effd700 1 -- 172.21.15.133:0/1623533271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000e850 con 0x7f7e78003910 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 -- 172.21.15.133:0/1623533271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e78003910 msgr2=0x7f7e78003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 --2- 172.21.15.133:0/1623533271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e78003910 0x7f7e78003d30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f7e80006d80 tx=0x7f7e80009060).stop 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e94b71700 1 -- 172.21.15.133:0/1623533271 reap_dead start 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 -- 172.21.15.133:0/1623533271 shutdown_connections 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 -- 172.21.15.133:0/1623533271 >> 172.21.15.133:0/1623533271 conn(0x7f7e90066a90 msgr2=0x7f7e90066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 -- 172.21.15.133:0/1623533271 shutdown_connections 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.399+0000 7f7e965d4700 1 -- 172.21.15.133:0/1623533271 wait complete. 2024-01-21T21:14:43.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.401+0000 7f7e965d4700 1 Processor -- start 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.401+0000 7f7e965d4700 1 -- start start 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.401+0000 7f7e965d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78003910 0x7f7e901351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 0x7f7e900ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900aeed0 con 0x7f7e900addc0 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c0720 con 0x7f7e78003910 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900ac820 con 0x7f7e900abeb0 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50328/0 (socket says 172.21.15.133:50328) 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 -- 172.21.15.133:0/2231394308 learned_addr learned my addr 172.21.15.133:0/2231394308 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78003910 0x7f7e901351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8f7fe700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 0x7f7e900ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 -- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 msgr2=0x7f7e900ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 0x7f7e900ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 -- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78003910 msgr2=0x7f7e901351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78003910 0x7f7e901351d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 -- 172.21.15.133:0/2231394308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e900aebf0 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8f7fe700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 0x7f7e900ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e94b71700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f7e90066070 tx=0x7f7e88001860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88007af0 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8800f870 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e900c00d0 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800fc30 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.402+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e901356c0 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.403+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9005fdf0 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.404+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7e88015410 con 0x7f7e900addc0 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.404+0000 7f7e8cff9700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 0x7f7e7c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.404+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7e8807a530 con 0x7f7e900addc0 2024-01-21T21:14:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.404+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 0x7f7e7c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.404+0000 7f7e8ffff700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 0x7f7e7c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7e80006d50 tx=0x7f7e8001a000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.408+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7e8804b510 con 0x7f7e900addc0 2024-01-21T21:14:43.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.572+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e90068ef0 con 0x7f7e900addc0 2024-01-21T21:14:43.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.573+0000 7f7e8cff9700 1 -- 172.21.15.133:0/2231394308 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f7e8804eb30 con 0x7f7e900addc0 2024-01-21T21:14:43.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:43.576 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":159,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:43.244544+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 msgr2=0x7f7e7c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 0x7f7e7c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7e80006d50 tx=0x7f7e8001a000).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 msgr2=0x7f7e900ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f7e90066070 tx=0x7f7e88001860).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 shutdown_connections 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7e7c05f150 0x7f7e7c061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e900addc0 0x7f7e900ae220 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e78003910 0x7f7e901351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 --2- 172.21.15.133:0/2231394308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900abeb0 0x7f7e900ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 >> 172.21.15.133:0/2231394308 conn(0x7f7e90066a90 msgr2=0x7f7e90066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 shutdown_connections 2024-01-21T21:14:43.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.575+0000 7f7e965d4700 1 -- 172.21.15.133:0/2231394308 wait complete. 2024-01-21T21:14:43.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.704+0000 7fd0694b6700 1 Processor -- start 2024-01-21T21:14:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.704+0000 7fd0694b6700 1 -- start start 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.704+0000 7fd0694b6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd064066360 0x7fd0640a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0694b6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0640689c0 0x7fd064068e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0694b6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640bc990 con 0x7fd0641527e0 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0694b6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640bbe50 con 0x7fd064066360 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0694b6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd064069300 con 0x7fd0640689c0 2024-01-21T21:14:43.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd064066360 0x7fd0640a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd064066360 0x7fd0640a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50334/0 (socket says 172.21.15.133:50334) 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 -- 172.21.15.133:0/2243517456 learned_addr learned my addr 172.21.15.133:0/2243517456 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 -- 172.21.15.133:0/2243517456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0640689c0 msgr2=0x7fd064068e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0637fe700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0640689c0 0x7fd064068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0640689c0 0x7fd064068e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 -- 172.21.15.133:0/2243517456 >> v1:172.21.15.178:6789/0 conn(0x7fd0641527e0 legacy=0x7fd0640651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 -- 172.21.15.133:0/2243517456 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640bc060 con 0x7fd064066360 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd0627fc700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0640a3d90 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd058006fd0 tx=0x7fd0580090f0).ready entity=mon.0 client_cookie=a344288c927652c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd061ffb700 1 -- 172.21.15.133:0/2243517456 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800b600 con 0x7fd064066360 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd061ffb700 1 -- 172.21.15.133:0/2243517456 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05800b760 con 0x7fd064066360 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.705+0000 7fd061ffb700 1 -- 172.21.15.133:0/2243517456 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05800bb00 con 0x7fd064066360 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 -- 172.21.15.133:0/2243517456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 msgr2=0x7fd0640a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0640a3d90 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd058006fd0 tx=0x7fd0580090f0).stop 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 -- 172.21.15.133:0/2243517456 shutdown_connections 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0640689c0 0x7fd064068e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 --2- 172.21.15.133:0/2243517456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0640a3d90 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 -- 172.21.15.133:0/2243517456 >> 172.21.15.133:0/2243517456 conn(0x7fd0640c6ef0 msgr2=0x7fd0640c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 -- 172.21.15.133:0/2243517456 shutdown_connections 2024-01-21T21:14:43.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.706+0000 7fd0694b6700 1 -- 172.21.15.133:0/2243517456 wait complete. 2024-01-21T21:14:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.708+0000 7fd0694b6700 1 Processor -- start 2024-01-21T21:14:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.708+0000 7fd0694b6700 1 -- start start 2024-01-21T21:14:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.708+0000 7fd0694b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.708+0000 7fd0694b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0640689c0 0x7fd064162f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.708+0000 7fd0694b6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0641527e0 0x7fd0640c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0694b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd064159820 con 0x7fd064066360 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0694b6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640a8460 con 0x7fd0640689c0 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0694b6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0640c1000 con 0x7fd0641527e0 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50342/0 (socket says 172.21.15.133:50342) 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 -- 172.21.15.133:0/1984801702 learned_addr learned my addr 172.21.15.133:0/1984801702 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 -- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0641527e0 msgr2=0x7fd0640c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0641527e0 0x7fd0640c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 -- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0640689c0 msgr2=0x7fd064162f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0627fc700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0640689c0 0x7fd064162f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0640689c0 0x7fd064162f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 -- 172.21.15.133:0/1984801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd058009370 con 0x7fd064066360 2024-01-21T21:14:43.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd062ffd700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fd05400c470 tx=0x7fd054007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400f470 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400f5f0 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0641459d0 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400f9b0 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.709+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0640a7be0 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.710+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0640a8210 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.711+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd054012400 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.711+0000 7fd04b7fe700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 0x7fd050061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.711+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fd0540799b0 con 0x7fd064066360 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.711+0000 7fd0627fc700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 0x7fd050061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:43.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.711+0000 7fd0627fc700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 0x7fd050061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd0640a96a0 tx=0x7fd058017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:43.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.715+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd054048b00 con 0x7fd064066360 2024-01-21T21:14:43.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.879+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0640bc340 con 0x7fd064066360 2024-01-21T21:14:43.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.880+0000 7fd04b7fe700 1 -- 172.21.15.133:0/1984801702 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+18004 (secure 0 0 0) 0x7fd05404aa40 con 0x7fd064066360 2024-01-21T21:14:43.883 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:43.883 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":159,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:43.244544+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 msgr2=0x7fd050061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 0x7fd050061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd0640a96a0 tx=0x7fd058017000).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 msgr2=0x7fd0641454e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fd05400c470 tx=0x7fd054007de0).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 shutdown_connections 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd05005f150 0x7fd050061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0641527e0 0x7fd0640c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd064066360 0x7fd0641454e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 --2- 172.21.15.133:0/1984801702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0640689c0 0x7fd064162f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:43.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 >> 172.21.15.133:0/1984801702 conn(0x7fd0640c6ef0 msgr2=0x7fd064064820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:43.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 shutdown_connections 2024-01-21T21:14:43.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:43.882+0000 7fd0694b6700 1 -- 172.21.15.133:0/1984801702 wait complete. 2024-01-21T21:14:43.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T21:14:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.014+0000 7fa7450fd700 1 Processor -- start 2024-01-21T21:14:44.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.014+0000 7fa7450fd700 1 -- start start 2024-01-21T21:14:44.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa7450fd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa740069ef0 0x7fa740155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa7450fd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa740065660 con 0x7fa7400c3fb0 2024-01-21T21:14:44.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa7450fd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa740065f00 con 0x7fa7400beb30 2024-01-21T21:14:44.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa7450fd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400bef10 con 0x7fa740069ef0 2024-01-21T21:14:44.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa73e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa740069ef0 0x7fa740155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa73f59e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa7400c3fb0 0x7fa740066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42660/0 (socket says 172.21.15.133:42660) 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73f59e700 1 -- 172.21.15.133:0/2294415582 learned_addr learned my addr 172.21.15.133:0/2294415582 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.015+0000 7fa73e59c700 1 --2- 172.21.15.133:0/2294415582 >> v2:172.21.15.133:3300/0 conn(0x7fa740069ef0 0x7fa740155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50344/0 (socket says 172.21.15.133:50344) 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73e59c700 1 -- 172.21.15.133:0/2294415582 >> v1:172.21.15.178:6789/0 conn(0x7fa7400beb30 legacy=0x7fa7400697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73e59c700 1 -- 172.21.15.133:0/2294415582 >> v1:172.21.15.133:6789/0 conn(0x7fa7400c3fb0 legacy=0x7fa740066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73e59c700 1 -- 172.21.15.133:0/2294415582 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400c4740 con 0x7fa740069ef0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73dd9b700 1 -- 172.21.15.133:0/2294415582 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000394674 0 0) 0x7fa740065660 con 0x7fa7400c3fb0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73e59c700 1 --2- 172.21.15.133:0/2294415582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa740069ef0 0x7fa740155b80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fa728009760 tx=0x7fa728009060).ready entity=mon.0 client_cookie=d540135aee709489 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73dd9b700 1 -- 172.21.15.133:0/2294415582 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728009120 con 0x7fa740069ef0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73dd9b700 1 -- 172.21.15.133:0/2294415582 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800b580 con 0x7fa740069ef0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.016+0000 7fa73dd9b700 1 -- 172.21.15.133:0/2294415582 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800b900 con 0x7fa740069ef0 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 -- 172.21.15.133:0/2294415582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa740069ef0 msgr2=0x7fa740155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 --2- 172.21.15.133:0/2294415582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa740069ef0 0x7fa740155b80 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fa728009760 tx=0x7fa728009060).stop 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 -- 172.21.15.133:0/2294415582 shutdown_connections 2024-01-21T21:14:44.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 --2- 172.21.15.133:0/2294415582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa740069ef0 0x7fa740155b80 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 -- 172.21.15.133:0/2294415582 >> 172.21.15.133:0/2294415582 conn(0x7fa7400c8010 msgr2=0x7fa7400c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:44.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 -- 172.21.15.133:0/2294415582 shutdown_connections 2024-01-21T21:14:44.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.017+0000 7fa7450fd700 1 -- 172.21.15.133:0/2294415582 wait complete. 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.018+0000 7fa7450fd700 1 Processor -- start 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.018+0000 7fa7450fd700 1 -- start start 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa740069ef0 0x7fa7400bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7400c3fb0 0x7fa7400c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401397d0 con 0x7fa7400beb30 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400ada60 con 0x7fa740069ef0 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa7450fd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400c1be0 con 0x7fa7400c3fb0 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50348/0 (socket says 172.21.15.133:50348) 2024-01-21T21:14:44.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 -- 172.21.15.133:0/3859409143 learned_addr learned my addr 172.21.15.133:0/3859409143 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73ed9d700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa740069ef0 0x7fa7400bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73f59e700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7400c3fb0 0x7fa7400c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 -- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7400c3fb0 msgr2=0x7fa7400c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7400c3fb0 0x7fa7400c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 -- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa740069ef0 msgr2=0x7fa7400bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa740069ef0 0x7fa7400bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.019+0000 7fa73e59c700 1 -- 172.21.15.133:0/3859409143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280092a0 con 0x7fa7400beb30 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa73e59c700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fa728009eb0 tx=0x7fa728017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800b900 con 0x7fa7400beb30 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728000d10 con 0x7fa7400beb30 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7400bf0b0 con 0x7fa7400beb30 2024-01-21T21:14:44.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72800bed0 con 0x7fa7400beb30 2024-01-21T21:14:44.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.020+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7400bf6f0 con 0x7fa7400beb30 2024-01-21T21:14:44.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.021+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74005fdf0 con 0x7fa7400beb30 2024-01-21T21:14:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.021+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa72801b650 con 0x7fa7400beb30 2024-01-21T21:14:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.021+0000 7fa7377fe700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 0x7fa720061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.022+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa72807bad0 con 0x7fa7400beb30 2024-01-21T21:14:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.022+0000 7fa73ed9d700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 0x7fa720061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.022+0000 7fa73ed9d700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 0x7fa720061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa730003860 tx=0x7fa730007d40).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.026+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa72804cb10 con 0x7fa7400beb30 2024-01-21T21:14:44.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.230+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa74006ac20 con 0x7fa7400beb30 2024-01-21T21:14:44.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.250+0000 7fa7377fe700 1 -- 172.21.15.133:0/3859409143 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa728050130 con 0x7fa7400beb30 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 msgr2=0x7fa720061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 0x7fa720061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa730003860 tx=0x7fa730007d40).stop 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 msgr2=0x7fa7400ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7fa728009eb0 tx=0x7fa728017000).stop 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 shutdown_connections 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa72005f150 0x7fa720061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7400c3fb0 0x7fa7400c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa740069ef0 0x7fa7400bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 --2- 172.21.15.133:0/3859409143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa7400beb30 0x7fa7400ad570 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 >> 172.21.15.133:0/3859409143 conn(0x7fa7400c8010 msgr2=0x7fa740062cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:44.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 shutdown_connections 2024-01-21T21:14:44.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.252+0000 7fa7450fd700 1 -- 172.21.15.133:0/3859409143 wait complete. 2024-01-21T21:14:44.267 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T21:14:44.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T21:14:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.383+0000 7fef37087700 1 Processor -- start 2024-01-21T21:14:44.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.384+0000 7fef37087700 1 -- start start 2024-01-21T21:14:44.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.384+0000 7fef37087700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30062e00 0x7fef300a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.384+0000 7fef37087700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300654e0 con 0x7fef3013aa00 2024-01-21T21:14:44.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.384+0000 7fef37087700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef30158730 con 0x7fef3013a620 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.384+0000 7fef37087700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300bd6f0 con 0x7fef30062e00 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30062e00 0x7fef300a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef30062e00 0x7fef300a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50354/0 (socket says 172.21.15.133:50354) 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef35624700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fef3013aa00 0x7fef30065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42664/0 (socket says 172.21.15.133:42664) 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 -- 172.21.15.133:0/3707824516 learned_addr learned my addr 172.21.15.133:0/3707824516 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 -- 172.21.15.133:0/3707824516 >> v1:172.21.15.178:6789/0 conn(0x7fef3013a620 legacy=0x7fef300626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 -- 172.21.15.133:0/3707824516 >> v1:172.21.15.133:6789/0 conn(0x7fef3013aa00 legacy=0x7fef30065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 -- 172.21.15.133:0/3707824516 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30158a10 con 0x7fef30062e00 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3707824516 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302048898 0 0) 0x7fef300654e0 con 0x7fef3013aa00 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2ffff700 1 --2- 172.21.15.133:0/3707824516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef300a6e30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fef1c006fd0 tx=0x7fef1c0090f0).ready entity=mon.0 client_cookie=549881637e4caea2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3707824516 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00b600 con 0x7fef30062e00 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3707824516 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00b760 con 0x7fef30062e00 2024-01-21T21:14:44.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.385+0000 7fef2f7fe700 1 -- 172.21.15.133:0/3707824516 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00bb00 con 0x7fef30062e00 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 -- 172.21.15.133:0/3707824516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 msgr2=0x7fef300a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 --2- 172.21.15.133:0/3707824516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef300a6e30 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fef1c006fd0 tx=0x7fef1c0090f0).stop 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 -- 172.21.15.133:0/3707824516 shutdown_connections 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 --2- 172.21.15.133:0/3707824516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef300a6e30 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 -- 172.21.15.133:0/3707824516 >> 172.21.15.133:0/3707824516 conn(0x7fef300c7dc0 msgr2=0x7fef300c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 -- 172.21.15.133:0/3707824516 shutdown_connections 2024-01-21T21:14:44.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.386+0000 7fef37087700 1 -- 172.21.15.133:0/3707824516 wait complete. 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.387+0000 7fef37087700 1 Processor -- start 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.387+0000 7fef37087700 1 -- start start 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef3013a620 0x7fef300a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef3013aa00 0x7fef300accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300a8450 con 0x7fef30062e00 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef300a9190 con 0x7fef3013aa00 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef37087700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef300a9470 con 0x7fef3013a620 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50366/0 (socket says 172.21.15.133:50366) 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 -- 172.21.15.133:0/3743417452 learned_addr learned my addr 172.21.15.133:0/3743417452 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef35624700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef3013aa00 0x7fef300accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef2ffff700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef3013a620 0x7fef300a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 -- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef3013a620 msgr2=0x7fef300a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef3013a620 0x7fef300a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 -- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef3013aa00 msgr2=0x7fef300accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef3013aa00 0x7fef300accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 -- 172.21.15.133:0/3743417452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009370 con 0x7fef30062e00 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.388+0000 7fef34e23700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fef2400b490 tx=0x7fef24009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.389+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24012410 con 0x7fef30062e00 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.389+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef240125b0 con 0x7fef30062e00 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.389+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef300a9750 con 0x7fef30062e00 2024-01-21T21:14:44.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.389+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24012970 con 0x7fef30062e00 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.389+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef30156760 con 0x7fef30062e00 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.390+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef3005fdf0 con 0x7fef30062e00 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.390+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fef24012ce0 con 0x7fef30062e00 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.390+0000 7fef2d7fa700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 0x7fef14061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.390+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fef2407a1e0 con 0x7fef30062e00 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.390+0000 7fef2ffff700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 0x7fef14061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:44.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.391+0000 7fef2ffff700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 0x7fef14061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fef30063200 tx=0x7fef1c017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:44.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.394+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef2404b220 con 0x7fef30062e00 2024-01-21T21:14:44.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:44.597+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fef300aa860 con 0x7fef30062e00 2024-01-21T21:14:45.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.252+0000 7fef2d7fa700 1 -- 172.21.15.133:0/3743417452 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) v1 ==== 122+0+0 (secure 0 0 0) 0x7fef2404e840 con 0x7fef30062e00 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.254+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 msgr2=0x7fef14061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.254+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 0x7fef14061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fef30063200 tx=0x7fef1c017000).stop 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.254+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 msgr2=0x7fef30156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.254+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fef2400b490 tx=0x7fef24009060).stop 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 shutdown_connections 2024-01-21T21:14:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fef1405f150 0x7fef14061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef3013aa00 0x7fef300accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef30062e00 0x7fef30156270 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 --2- 172.21.15.133:0/3743417452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef3013a620 0x7fef300a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 >> 172.21.15.133:0/3743417452 conn(0x7fef300c7dc0 msgr2=0x7fef301570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 shutdown_connections 2024-01-21T21:14:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.255+0000 7fef37087700 1 -- 172.21.15.133:0/3743417452 wait complete. 2024-01-21T21:14:45.272 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T21:14:45.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:45.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.390+0000 7fa041ff0700 1 Processor -- start 2024-01-21T21:14:45.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.390+0000 7fa041ff0700 1 -- start start 2024-01-21T21:14:45.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa041ff0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa03c155b80 0x7fa03c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa041ff0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c065660 con 0x7fa03c069ef0 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa041ff0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c065f00 con 0x7fa03c0beb30 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa041ff0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0bef10 con 0x7fa03c155b80 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa03affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa03c069ef0 0x7fa03c066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42666/0 (socket says 172.21.15.133:42666) 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa03affd700 1 -- 172.21.15.133:0/2947447614 learned_addr learned my addr 172.21.15.133:0/2947447614 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.391+0000 7fa03bfff700 1 --2- 172.21.15.133:0/2947447614 >> v2:172.21.15.178:3300/0 conn(0x7fa03c155b80 0x7fa03c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893837899 0 0) 0x7fa03c065660 con 0x7fa03c069ef0 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0280033f0 con 0x7fa03c069ef0 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205390398 0 0) 0x7fa03c065f00 con 0x7fa03c0beb30 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c065660 con 0x7fa03c0beb30 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453515616 0 0) 0x7fa0280033f0 con 0x7fa03c069ef0 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 >> v2:172.21.15.178:3300/0 conn(0x7fa03c155b80 msgr2=0x7fa03c0c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 --2- 172.21.15.133:0/2947447614 >> v2:172.21.15.178:3300/0 conn(0x7fa03c155b80 0x7fa03c0c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 >> v1:172.21.15.178:6789/0 conn(0x7fa03c0beb30 legacy=0x7fa03c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0c44a0 con 0x7fa03c069ef0 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fa024001470 con 0x7fa03c069ef0 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 >> v1:172.21.15.133:6789/0 conn(0x7fa03c069ef0 legacy=0x7fa03c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa028003a70 0x7fa028003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa028004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa028005050 0x7fa02800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0bef10 con 0x7fa028004690 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800bfc0 con 0x7fa028005050 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800c180 con 0x7fa028003a70 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa028004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03bfff700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa028005050 0x7fa02800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03b7fe700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa028003a70 0x7fa028003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 -- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa028003a70 msgr2=0x7fa028003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa028003a70 0x7fa028003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 -- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa028005050 msgr2=0x7fa02800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa028005050 0x7fa02800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03bfff700 1 -- 172.21.15.133:0/2947447614 reap_dead start 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 -- 172.21.15.133:0/2947447614 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280033f0 con 0x7fa028004690 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.392+0000 7fa03affd700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa028004b10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fa02400c160 tx=0x7fa024001e10).ready entity=mon.0 client_cookie=8fb1151f270156e5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02400c990 con 0x7fa028004690 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02400caf0 con 0x7fa028004690 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa03a7fc700 1 -- 172.21.15.133:0/2947447614 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0240070d0 con 0x7fa028004690 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 -- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 msgr2=0x7fa028004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa028004b10 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fa02400c160 tx=0x7fa024001e10).stop 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 -- 172.21.15.133:0/2947447614 shutdown_connections 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 --2- 172.21.15.133:0/2947447614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa028004b10 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 -- 172.21.15.133:0/2947447614 >> 172.21.15.133:0/2947447614 conn(0x7fa03c0c8010 msgr2=0x7fa03c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 -- 172.21.15.133:0/2947447614 shutdown_connections 2024-01-21T21:14:45.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.393+0000 7fa041ff0700 1 -- 172.21.15.133:0/2947447614 wait complete. 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.395+0000 7fa041ff0700 1 Processor -- start 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.395+0000 7fa041ff0700 1 -- start start 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c0ac990 0x7fa03c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c1652f0 0x7fa03c165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0adad0 con 0x7fa028004690 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c5540 con 0x7fa03c0ac990 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa041ff0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c1e30 con 0x7fa03c1652f0 2024-01-21T21:14:45.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50380/0 (socket says 172.21.15.133:50380) 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 -- 172.21.15.133:0/3640783857 learned_addr learned my addr 172.21.15.133:0/3640783857 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03bfff700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c1652f0 0x7fa03c165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03affd700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c0ac990 0x7fa03c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 -- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c1652f0 msgr2=0x7fa03c165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c1652f0 0x7fa03c165750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 -- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c0ac990 msgr2=0x7fa03c0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c0ac990 0x7fa03c0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 -- 172.21.15.133:0/3640783857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0ace50 con 0x7fa028004690 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.396+0000 7fa03b7fe700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa02c0010e0 tx=0x7fa02c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.397+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c007030 con 0x7fa028004690 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.397+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c007190 con 0x7fa028004690 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.397+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0ad130 con 0x7fa028004690 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.397+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c007530 con 0x7fa028004690 2024-01-21T21:14:45.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.397+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0ad6f0 con 0x7fa028004690 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.398+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0adc10 con 0x7fa028004690 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.398+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa02c0068b0 con 0x7fa028004690 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.398+0000 7fa033fff700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 0x7fa01c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.398+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa02c07c9d0 con 0x7fa028004690 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.398+0000 7fa03affd700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 0x7fa01c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.399+0000 7fa03affd700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 0x7fa01c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa024001e70 tx=0x7fa024015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.402+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa03c0adc10 con 0x7fa028004690 2024-01-21T21:14:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.611+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa03c0adc10 con 0x7fa028004690 2024-01-21T21:14:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.612+0000 7fa033fff700 1 -- 172.21.15.133:0/3640783857 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fa03c0adc10 con 0x7fa028004690 2024-01-21T21:14:45.616 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:45.617 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 msgr2=0x7fa01c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 0x7fa01c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa024001e70 tx=0x7fa024015000).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 msgr2=0x7fa03c0c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7fa02c0010e0 tx=0x7fa02c007bb0).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 shutdown_connections 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa01c05f150 0x7fa01c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c1652f0 0x7fa03c165750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa028004690 0x7fa03c0c4b60 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 --2- 172.21.15.133:0/3640783857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c0ac990 0x7fa03c0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 >> 172.21.15.133:0/3640783857 conn(0x7fa03c0c8010 msgr2=0x7fa03c0697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 shutdown_connections 2024-01-21T21:14:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.614+0000 7fa041ff0700 1 -- 172.21.15.133:0/3640783857 wait complete. 2024-01-21T21:14:45.619 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:14:45.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:14:45.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.742+0000 7fa34b162700 1 Processor -- start 2024-01-21T21:14:45.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.742+0000 7fa34b162700 1 -- start start 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa34b162700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa344063e10 0x7fa344069f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa34b162700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344155960 0x7fa34415be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa34b162700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344067850 con 0x7fa344155580 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa34b162700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa344066ce0 con 0x7fa344063e10 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa34b162700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440659c0 con 0x7fa344155960 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa344063e10 0x7fa344069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa344063e10 0x7fa344069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50392/0 (socket says 172.21.15.133:50392) 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 -- 172.21.15.133:0/2210681186 learned_addr learned my addr 172.21.15.133:0/2210681186 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:45.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa3496ff700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344155960 0x7fa34415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 -- 172.21.15.133:0/2210681186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344155960 msgr2=0x7fa34415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344155960 0x7fa34415be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 -- 172.21.15.133:0/2210681186 >> v1:172.21.15.178:6789/0 conn(0x7fa344155580 legacy=0x7fa344063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 -- 172.21.15.133:0/2210681186 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344065ca0 con 0x7fa344063e10 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa343fff700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344063e10 0x7fa344069f60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fa330006fd0 tx=0x7fa3300090f0).ready entity=mon.0 client_cookie=da6c794c2570a627 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa3437fe700 1 -- 172.21.15.133:0/2210681186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000b600 con 0x7fa344063e10 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa3437fe700 1 -- 172.21.15.133:0/2210681186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000b760 con 0x7fa344063e10 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.743+0000 7fa3437fe700 1 -- 172.21.15.133:0/2210681186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000bb00 con 0x7fa344063e10 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 -- 172.21.15.133:0/2210681186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344063e10 msgr2=0x7fa344069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344063e10 0x7fa344069f60 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7fa330006fd0 tx=0x7fa3300090f0).stop 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 -- 172.21.15.133:0/2210681186 shutdown_connections 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344155960 0x7fa34415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 --2- 172.21.15.133:0/2210681186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344063e10 0x7fa344069f60 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 -- 172.21.15.133:0/2210681186 >> 172.21.15.133:0/2210681186 conn(0x7fa3440c4a90 msgr2=0x7fa344068e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:45.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 -- 172.21.15.133:0/2210681186 shutdown_connections 2024-01-21T21:14:45.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.744+0000 7fa34b162700 1 -- 172.21.15.133:0/2210681186 wait complete. 2024-01-21T21:14:45.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.745+0000 7fa34b162700 1 Processor -- start 2024-01-21T21:14:45.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.745+0000 7fa34b162700 1 -- start start 2024-01-21T21:14:45.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 0x7fa344148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 0x7fa34414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34414d3a0 con 0x7fa344155960 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34414cb90 con 0x7fa344155580 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa34b162700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34414c690 con 0x7fa344063e10 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50398/0 (socket says 172.21.15.133:50398) 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 -- 172.21.15.133:0/2661921233 learned_addr learned my addr 172.21.15.133:0/2661921233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa343fff700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 0x7fa34414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa348efe700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 0x7fa344148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 -- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 msgr2=0x7fa344148c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 0x7fa344148c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 -- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 msgr2=0x7fa34414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 0x7fa34414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa3496ff700 1 -- 172.21.15.133:0/2661921233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009370 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa343fff700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 0x7fa34414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.746+0000 7fa348efe700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 0x7fa344148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa3496ff700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fa33c00cdb0 tx=0x7fa33c0077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00aa80 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c00abe0 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34414cde0 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c00f400 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.747+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34414c320 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.748+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa34414c800 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.748+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa33c00d040 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.748+0000 7fa3417fa700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 0x7fa328061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.749+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa33c07a5b0 con 0x7fa344155960 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.749+0000 7fa348efe700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 0x7fa328061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:45.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.749+0000 7fa348efe700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 0x7fa328061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa338002780 tx=0x7fa338009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:45.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.753+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa33c04b5f0 con 0x7fa344155960 2024-01-21T21:14:45.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.917+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa34405fdf0 con 0x7fa344155960 2024-01-21T21:14:45.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.918+0000 7fa3417fa700 1 -- 172.21.15.133:0/2661921233 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+17991 (secure 0 0 0) 0x7fa33c01d020 con 0x7fa344155960 2024-01-21T21:14:45.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:45.920 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":160,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:44.246724+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:14:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.919+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 msgr2=0x7fa328061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.919+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 0x7fa328061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa338002780 tx=0x7fa338009040).stop 2024-01-21T21:14:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.919+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 msgr2=0x7fa34413d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.919+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fa33c00cdb0 tx=0x7fa33c0077d0).stop 2024-01-21T21:14:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 shutdown_connections 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa32805f180 0x7fa328061640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa344155960 0x7fa34413d7c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa344063e10 0x7fa344148c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 --2- 172.21.15.133:0/2661921233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa344155580 0x7fa34414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 >> 172.21.15.133:0/2661921233 conn(0x7fa3440c4a90 msgr2=0x7fa344068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 shutdown_connections 2024-01-21T21:14:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:45.920+0000 7fa34b162700 1 -- 172.21.15.133:0/2661921233 wait complete. 2024-01-21T21:14:45.934 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T21:14:45.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:14:46.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.047+0000 7f98e07a4700 1 Processor -- start 2024-01-21T21:14:46.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.047+0000 7f98e07a4700 1 -- start start 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d8062c10 0x7f98d8062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d80697e0 0x7f98d8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98d8069c40 0x7f98d8065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d8066040 con 0x7f98d8062c10 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80634e0 con 0x7f98d8069c40 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.048+0000 7f98e07a4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d806a130 con 0x7f98d80697e0 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d8062c10 0x7f98d8062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d8062c10 0x7f98d8062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50412/0 (socket says 172.21.15.133:50412) 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 -- 172.21.15.133:0/3660110427 learned_addr learned my addr 172.21.15.133:0/3660110427 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98ddd3f700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d80697e0 0x7f98d8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98ded41700 1 --2- 172.21.15.133:0/3660110427 >> v2:172.21.15.178:3300/0 conn(0x7f98d8069c40 0x7f98d8065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 -- 172.21.15.133:0/3660110427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d80697e0 msgr2=0x7f98d8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d80697e0 0x7f98d8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 -- 172.21.15.133:0/3660110427 >> v2:172.21.15.178:3300/0 conn(0x7f98d8069c40 msgr2=0x7f98d8065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 --2- 172.21.15.133:0/3660110427 >> v2:172.21.15.178:3300/0 conn(0x7f98d8069c40 0x7f98d8065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 -- 172.21.15.133:0/3660110427 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d806a410 con 0x7f98d8062c10 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98de540700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8062c10 0x7f98d8062ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f98d8067340 tx=0x7f98c80090f0).ready entity=mon.0 client_cookie=b6bbc82369b4cd64 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98dd53e700 1 -- 172.21.15.133:0/3660110427 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800b600 con 0x7f98d8062c10 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98dd53e700 1 -- 172.21.15.133:0/3660110427 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800b760 con 0x7f98d8062c10 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.049+0000 7f98dd53e700 1 -- 172.21.15.133:0/3660110427 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c800bb00 con 0x7f98d8062c10 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 -- 172.21.15.133:0/3660110427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8062c10 msgr2=0x7f98d8062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8062c10 0x7f98d8062ff0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f98d8067340 tx=0x7f98c80090f0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 -- 172.21.15.133:0/3660110427 shutdown_connections 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 --2- 172.21.15.133:0/3660110427 >> v2:172.21.15.178:3300/0 conn(0x7f98d8069c40 0x7f98d8065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8062c10 0x7f98d8062ff0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 --2- 172.21.15.133:0/3660110427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d80697e0 0x7f98d8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 -- 172.21.15.133:0/3660110427 >> 172.21.15.133:0/3660110427 conn(0x7f98d80c8010 msgr2=0x7f98d80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 -- 172.21.15.133:0/3660110427 shutdown_connections 2024-01-21T21:14:46.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.050+0000 7f98e07a4700 1 -- 172.21.15.133:0/3660110427 wait complete. 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.051+0000 7f98e07a4700 1 Processor -- start 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.051+0000 7f98e07a4700 1 -- start start 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d8062c10 0x7f98d80a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98d80697e0 0x7f98d813c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d813cd80 con 0x7f98d8069c40 2024-01-21T21:14:46.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80acc40 con 0x7f98d80697e0 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98e07a4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80ac030 con 0x7f98d8062c10 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50424/0 (socket says 172.21.15.133:50424) 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ddd3f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98d80697e0 0x7f98d813c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 -- 172.21.15.133:0/2576379284 learned_addr learned my addr 172.21.15.133:0/2576379284 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98de540700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d8062c10 0x7f98d80a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 -- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d8062c10 msgr2=0x7f98d80a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d8062c10 0x7f98d80a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 -- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98d80697e0 msgr2=0x7f98d813c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98d80697e0 0x7f98d813c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 -- 172.21.15.133:0/2576379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009370 con 0x7f98d8069c40 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.052+0000 7f98ded41700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f98d0009fa0 tx=0x7f98d0009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.053+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000ebc0 con 0x7f98d8069c40 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.053+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000ed20 con 0x7f98d8069c40 2024-01-21T21:14:46.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.053+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d80ac310 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.053+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0014610 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.053+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d80ac8d0 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.054+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d80acdd0 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.054+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f98d001d3b0 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.054+0000 7f98ceffd700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 0x7f98bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.055+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f98d007a8f0 con 0x7f98d8069c40 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.055+0000 7f98de540700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 0x7f98bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.055+0000 7f98de540700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 0x7f98bc061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f98c800b3c0 tx=0x7f98c8017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.059+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f98d004b8d0 con 0x7f98d8069c40 2024-01-21T21:14:46.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.217+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98d806a6f0 con 0x7f98bc05f150 2024-01-21T21:14:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.227+0000 7f98ceffd700 1 -- 172.21.15.133:0/2576379284 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349965 (secure 0 0 0) 0x7f98d806a6f0 con 0x7f98bc05f150 2024-01-21T21:14:46.234 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 msgr2=0x7f98bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 0x7f98bc061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f98c800b3c0 tx=0x7f98c8017000).stop 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 msgr2=0x7f98d813c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f98d0009fa0 tx=0x7f98d0009900).stop 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 shutdown_connections 2024-01-21T21:14:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f98bc05f150 0x7f98bc061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d8069c40 0x7f98d813c890 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98d8062c10 0x7f98d80a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 --2- 172.21.15.133:0/2576379284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98d80697e0 0x7f98d813c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 >> 172.21.15.133:0/2576379284 conn(0x7f98d80c8010 msgr2=0x7f98d81543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 shutdown_connections 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.231+0000 7f98e07a4700 1 -- 172.21.15.133:0/2576379284 wait complete. 2024-01-21T21:14:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:14:46.245 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T21:14:45.554804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453368,"kb_used_data":15160,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752521352,"statfs":{"total":773094113280,"available":770581864448,"internally_reserved":0,"allocated":15523840,"data_stored":8264382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5035530,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-522,"num_write_kb":-5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.324593"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674458+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:14:39.674458+0000","last_peered":"2024-01-21T21:14:39.674458+0000","last_clean":"2024-01-21T21:14:39.674458+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:14:39.674458+0000","last_undegraded":"2024-01-21T21:14:39.674458+0000","last_fullsized":"2024-01-21T21:14:39.674458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787727+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:14:38.787727+0000","last_peered":"2024-01-21T21:14:38.787727+0000","last_clean":"2024-01-21T21:14:38.787727+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:14:38.787727+0000","last_undegraded":"2024-01-21T21:14:38.787727+0000","last_fullsized":"2024-01-21T21:14:38.787727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787363+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:14:38.787363+0000","last_peered":"2024-01-21T21:14:38.787363+0000","last_clean":"2024-01-21T21:14:38.787363+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:14:38.787363+0000","last_undegraded":"2024-01-21T21:14:38.787363+0000","last_fullsized":"2024-01-21T21:14:38.787363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787747+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:14:38.787747+0000","last_peered":"2024-01-21T21:14:38.787747+0000","last_clean":"2024-01-21T21:14:38.787747+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:14:38.787747+0000","last_undegraded":"2024-01-21T21:14:38.787747+0000","last_fullsized":"2024-01-21T21:14:38.787747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":128,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674346+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:14:39.674346+0000","last_peered":"2024-01-21T21:14:39.674346+0000","last_clean":"2024-01-21T21:14:39.674346+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:14:39.674346+0000","last_undegraded":"2024-01-21T21:14:39.674346+0000","last_fullsized":"2024-01-21T21:14:39.674346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674410+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:14:39.674410+0000","last_peered":"2024-01-21T21:14:39.674410+0000","last_clean":"2024-01-21T21:14:39.674410+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:14:39.674410+0000","last_undegraded":"2024-01-21T21:14:39.674410+0000","last_fullsized":"2024-01-21T21:14:39.674410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674216+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:14:39.674216+0000","last_peered":"2024-01-21T21:14:39.674216+0000","last_clean":"2024-01-21T21:14:39.674216+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:14:39.674216+0000","last_undegraded":"2024-01-21T21:14:39.674216+0000","last_fullsized":"2024-01-21T21:14:39.674216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064660,"statfs":{"total":96636764160,"available":96322211840,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.315},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.875},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":0.82199999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":0.85399999999999998},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.35199999999999998},"max":{"1min":0.75,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.748}]},{"osd":4,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.502},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.32200000000000001},"max":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303088,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068752,"statfs":{"total":96636764160,"available":96326402048,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.443},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.623},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.59899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.63100000000000001,"15min":0.64600000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.67400000000000004},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":0.58299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.749},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.018},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.95999999999999996,"15min":0.999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.501}]},{"osd":7,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.879,"5min":0.96399999999999997,"15min":1.079},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":1.044,"15min":1.044},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.33100000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.371}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.495},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.878}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.746}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.62}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060560,"statfs":{"total":96636764160,"available":96318013440,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:14:46.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:14:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.399+0000 7fcd6c857700 1 Processor -- start 2024-01-21T21:14:46.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.399+0000 7fcd6c857700 1 -- start start 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd6c857700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd68067d90 0x7fcd68137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd6c857700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 0x7fcd680c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd6c857700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680c6250 con 0x7fcd68137030 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd6c857700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd68068370 con 0x7fcd68067d90 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd6c857700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd68068650 con 0x7fcd680c5930 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd68067d90 0x7fcd68137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd68067d90 0x7fcd68137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50428/0 (socket says 172.21.15.133:50428) 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 -- 172.21.15.133:0/97021678 learned_addr learned my addr 172.21.15.133:0/97021678 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd66d9d700 1 --2- 172.21.15.133:0/97021678 >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 0x7fcd680c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 -- 172.21.15.133:0/97021678 >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 msgr2=0x7fcd680c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 --2- 172.21.15.133:0/97021678 >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 0x7fcd680c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 -- 172.21.15.133:0/97021678 >> v1:172.21.15.178:6789/0 conn(0x7fcd68137030 legacy=0x7fcd68155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd65d9b700 1 -- 172.21.15.133:0/97021678 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68068930 con 0x7fcd68067d90 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.400+0000 7fcd66d9d700 1 --2- 172.21.15.133:0/97021678 >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 0x7fcd680c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd65d9b700 1 --2- 172.21.15.133:0/97021678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd68137410 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fcd68066070 tx=0x7fcd580090f0).ready entity=mon.0 client_cookie=af4361dca490e034 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6559a700 1 -- 172.21.15.133:0/97021678 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800b5a0 con 0x7fcd68067d90 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6559a700 1 -- 172.21.15.133:0/97021678 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5800b700 con 0x7fcd68067d90 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6559a700 1 -- 172.21.15.133:0/97021678 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5800baa0 con 0x7fcd68067d90 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 -- 172.21.15.133:0/97021678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 msgr2=0x7fcd68137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 --2- 172.21.15.133:0/97021678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd68137410 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fcd68066070 tx=0x7fcd580090f0).stop 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 -- 172.21.15.133:0/97021678 shutdown_connections 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 --2- 172.21.15.133:0/97021678 >> v2:172.21.15.178:3300/0 conn(0x7fcd680c5930 0x7fcd680c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 --2- 172.21.15.133:0/97021678 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd68137410 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 -- 172.21.15.133:0/97021678 >> 172.21.15.133:0/97021678 conn(0x7fcd68066a90 msgr2=0x7fcd68066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 -- 172.21.15.133:0/97021678 shutdown_connections 2024-01-21T21:14:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.401+0000 7fcd6c857700 1 -- 172.21.15.133:0/97021678 wait complete. 2024-01-21T21:14:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 Processor -- start 2024-01-21T21:14:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 -- start start 2024-01-21T21:14:46.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680c5930 0x7fcd68136850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd68137030 0x7fcd68165330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68138b80 con 0x7fcd68067d90 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68165d80 con 0x7fcd68137030 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.403+0000 7fcd6c857700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68166060 con 0x7fcd680c5930 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50442/0 (socket says 172.21.15.133:50442) 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 -- 172.21.15.133:0/949667905 learned_addr learned my addr 172.21.15.133:0/949667905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd66d9d700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd68137030 0x7fcd68165330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd65d9b700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680c5930 0x7fcd68136850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 -- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680c5930 msgr2=0x7fcd68136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680c5930 0x7fcd68136850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 -- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd68137030 msgr2=0x7fcd68165330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd68137030 0x7fcd68165330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 -- 172.21.15.133:0/949667905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009370 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6659c700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fcd5c00b460 tx=0x7fcd5c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00be60 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c012410 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68166340 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c0127b0 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.404+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd68138730 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.405+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6805fdf0 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.406+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcd5c012b60 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.406+0000 7fcd56ffd700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 0x7fcd48061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.406+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fcd5c07a210 con 0x7fcd68067d90 2024-01-21T21:14:46.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.406+0000 7fcd65d9b700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 0x7fcd48061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.406+0000 7fcd65d9b700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 0x7fcd48061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcd58009130 tx=0x7fcd58015000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.410+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcd5c04b250 con 0x7fcd68067d90 2024-01-21T21:14:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.569+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd68138980 con 0x7fcd4805f150 2024-01-21T21:14:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.579+0000 7fcd56ffd700 1 -- 172.21.15.133:0/949667905 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349965 (secure 0 0 0) 0x7fcd68138980 con 0x7fcd4805f150 2024-01-21T21:14:46.585 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 msgr2=0x7fcd48061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 0x7fcd48061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fcd58009130 tx=0x7fcd58015000).stop 2024-01-21T21:14:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 msgr2=0x7fcd680abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fcd5c00b460 tx=0x7fcd5c006f20).stop 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 shutdown_connections 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fcd4805f150 0x7fcd48061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd68137030 0x7fcd68165330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd68067d90 0x7fcd680abeb0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 --2- 172.21.15.133:0/949667905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680c5930 0x7fcd68136850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 >> 172.21.15.133:0/949667905 conn(0x7fcd68066a90 msgr2=0x7fcd680c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 shutdown_connections 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.582+0000 7fcd6c857700 1 -- 172.21.15.133:0/949667905 wait complete. 2024-01-21T21:14:46.589 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:14:46.596 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T21:14:45.554804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453368,"kb_used_data":15160,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752521352,"statfs":{"total":773094113280,"available":770581864448,"internally_reserved":0,"allocated":15523840,"data_stored":8264382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5035530,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-522,"num_write_kb":-5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.324593"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674458+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:14:39.674458+0000","last_peered":"2024-01-21T21:14:39.674458+0000","last_clean":"2024-01-21T21:14:39.674458+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:14:39.674458+0000","last_undegraded":"2024-01-21T21:14:39.674458+0000","last_fullsized":"2024-01-21T21:14:39.674458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787727+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:14:38.787727+0000","last_peered":"2024-01-21T21:14:38.787727+0000","last_clean":"2024-01-21T21:14:38.787727+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:14:38.787727+0000","last_undegraded":"2024-01-21T21:14:38.787727+0000","last_fullsized":"2024-01-21T21:14:38.787727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787363+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:14:38.787363+0000","last_peered":"2024-01-21T21:14:38.787363+0000","last_clean":"2024-01-21T21:14:38.787363+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:14:38.787363+0000","last_undegraded":"2024-01-21T21:14:38.787363+0000","last_fullsized":"2024-01-21T21:14:38.787363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787747+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:14:38.787747+0000","last_peered":"2024-01-21T21:14:38.787747+0000","last_clean":"2024-01-21T21:14:38.787747+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:14:38.787747+0000","last_undegraded":"2024-01-21T21:14:38.787747+0000","last_fullsized":"2024-01-21T21:14:38.787747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":128,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674346+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:14:39.674346+0000","last_peered":"2024-01-21T21:14:39.674346+0000","last_clean":"2024-01-21T21:14:39.674346+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:14:39.674346+0000","last_undegraded":"2024-01-21T21:14:39.674346+0000","last_fullsized":"2024-01-21T21:14:39.674346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674410+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:14:39.674410+0000","last_peered":"2024-01-21T21:14:39.674410+0000","last_clean":"2024-01-21T21:14:39.674410+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:14:39.674410+0000","last_undegraded":"2024-01-21T21:14:39.674410+0000","last_fullsized":"2024-01-21T21:14:39.674410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674216+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:14:39.674216+0000","last_peered":"2024-01-21T21:14:39.674216+0000","last_clean":"2024-01-21T21:14:39.674216+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:14:39.674216+0000","last_undegraded":"2024-01-21T21:14:39.674216+0000","last_fullsized":"2024-01-21T21:14:39.674216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064660,"statfs":{"total":96636764160,"available":96322211840,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.315},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.875},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":0.82199999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":0.85399999999999998},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.35199999999999998},"max":{"1min":0.75,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.748}]},{"osd":4,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.502},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.32200000000000001},"max":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303088,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068752,"statfs":{"total":96636764160,"available":96326402048,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.443},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.623},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.59899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.63100000000000001,"15min":0.64600000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.67400000000000004},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":0.58299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.749},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.018},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.95999999999999996,"15min":0.999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.501}]},{"osd":7,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.879,"5min":0.96399999999999997,"15min":1.079},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":1.044,"15min":1.044},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.33100000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.371}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.495},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.878}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.746}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.62}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060560,"statfs":{"total":96636764160,"available":96318013440,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:14:46.602 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:14:46.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.750+0000 7fb4202d4700 1 Processor -- start 2024-01-21T21:14:46.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.750+0000 7fb4202d4700 1 -- start start 2024-01-21T21:14:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb4202d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4181558c0 0x7fb4180626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb4202d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb418155ca0 0x7fb418062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb4202d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180a50f0 con 0x7fb4180bd180 2024-01-21T21:14:46.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb4202d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180630d0 con 0x7fb4181558c0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb4202d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180a4da0 con 0x7fb418155ca0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb41e070700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4181558c0 0x7fb4180626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb41e871700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4180bd180 0x7fb4180bd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42668/0 (socket says 172.21.15.133:42668) 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb41e871700 1 -- 172.21.15.133:0/3099400520 learned_addr learned my addr 172.21.15.133:0/3099400520 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.751+0000 7fb41d86f700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb418155ca0 0x7fb418062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41e070700 1 -- 172.21.15.133:0/3099400520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb418155ca0 msgr2=0x7fb418062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41e070700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb418155ca0 0x7fb418062be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41e070700 1 -- 172.21.15.133:0/3099400520 >> v1:172.21.15.133:6789/0 conn(0x7fb4180bd180 legacy=0x7fb4180bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41d06e700 1 -- 172.21.15.133:0/3099400520 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50115447 0 0) 0x7fb4180a50f0 con 0x7fb4180bd180 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41e070700 1 -- 172.21.15.133:0/3099400520 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180bde00 con 0x7fb4181558c0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41e070700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4181558c0 0x7fb4180626f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fb408009760 tx=0x7fb408009060).ready entity=mon.0 client_cookie=46901f6ea5bff06b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41d06e700 1 -- 172.21.15.133:0/3099400520 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080090d0 con 0x7fb4181558c0 2024-01-21T21:14:46.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41d06e700 1 -- 172.21.15.133:0/3099400520 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40800f510 con 0x7fb4181558c0 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb41d06e700 1 -- 172.21.15.133:0/3099400520 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800f890 con 0x7fb4181558c0 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb4202d4700 1 -- 172.21.15.133:0/3099400520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4181558c0 msgr2=0x7fb4180626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.752+0000 7fb4202d4700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4181558c0 0x7fb4180626f0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fb408009760 tx=0x7fb408009060).stop 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 -- 172.21.15.133:0/3099400520 shutdown_connections 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4181558c0 0x7fb4180626f0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 --2- 172.21.15.133:0/3099400520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb418155ca0 0x7fb418062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 -- 172.21.15.133:0/3099400520 >> 172.21.15.133:0/3099400520 conn(0x7fb4180c8010 msgr2=0x7fb4180c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 -- 172.21.15.133:0/3099400520 shutdown_connections 2024-01-21T21:14:46.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.753+0000 7fb4202d4700 1 -- 172.21.15.133:0/3099400520 wait complete. 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.754+0000 7fb4202d4700 1 Processor -- start 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.754+0000 7fb4202d4700 1 -- start start 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4180bd180 0x7fb418164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4181558c0 0x7fb418147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb418065660 con 0x7fb418155ca0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180c1120 con 0x7fb4181558c0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb4202d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb418065870 con 0x7fb4180bd180 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb41e871700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb41e871700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50462/0 (socket says 172.21.15.133:50462) 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb41e871700 1 -- 172.21.15.133:0/985243301 learned_addr learned my addr 172.21.15.133:0/985243301 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb41e070700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4180bd180 0x7fb418164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.755+0000 7fb41d86f700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4181558c0 0x7fb418147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 -- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4180bd180 msgr2=0x7fb418164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4180bd180 0x7fb418164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 -- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4181558c0 msgr2=0x7fb418147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4181558c0 0x7fb418147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 -- 172.21.15.133:0/985243301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080092a0 con 0x7fb418155ca0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb41e871700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fb41000c730 tx=0x7fb410001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410005d30 con 0x7fb418155ca0 2024-01-21T21:14:46.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb410005e90 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb418065b50 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410007300 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.756+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418164bf0 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.757+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41805fdf0 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.757+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb4100076b0 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.758+0000 7fb40ef78700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 0x7fb3fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.758+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb410079ee0 con 0x7fb418155ca0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.758+0000 7fb41e070700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 0x7fb3fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:46.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.758+0000 7fb41e070700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 0x7fb3fc061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb408009fd0 tx=0x7fb408017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:46.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.762+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb41004af20 con 0x7fb418155ca0 2024-01-21T21:14:46.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.922+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb41805f970 con 0x7fb3fc05f150 2024-01-21T21:14:46.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.931+0000 7fb40ef78700 1 -- 172.21.15.133:0/985243301 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349965 (secure 0 0 0) 0x7fb41805f970 con 0x7fb3fc05f150 2024-01-21T21:14:46.938 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:46.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 msgr2=0x7fb3fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 0x7fb3fc061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb408009fd0 tx=0x7fb408017000).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 msgr2=0x7fb4180c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fb41000c730 tx=0x7fb410001520).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 shutdown_connections 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb3fc05f150 0x7fb3fc061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb418155ca0 0x7fb4180c6ef0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4180bd180 0x7fb418164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 --2- 172.21.15.133:0/985243301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4181558c0 0x7fb418147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.934+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 >> 172.21.15.133:0/985243301 conn(0x7fb4180c8010 msgr2=0x7fb4180c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.935+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 shutdown_connections 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:46.935+0000 7fb4202d4700 1 -- 172.21.15.133:0/985243301 wait complete. 2024-01-21T21:14:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:14:46.949 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-01-21T21:14:45.554804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2453368,"kb_used_data":15160,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752521352,"statfs":{"total":773094113280,"available":770581864448,"internally_reserved":0,"allocated":15523840,"data_stored":8264382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5035530,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-522,"num_write_kb":-5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.324593"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674458+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:14:39.674458+0000","last_peered":"2024-01-21T21:14:39.674458+0000","last_clean":"2024-01-21T21:14:39.674458+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:14:39.674458+0000","last_undegraded":"2024-01-21T21:14:39.674458+0000","last_fullsized":"2024-01-21T21:14:39.674458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787727+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:14:38.787727+0000","last_peered":"2024-01-21T21:14:38.787727+0000","last_clean":"2024-01-21T21:14:38.787727+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:14:38.787727+0000","last_undegraded":"2024-01-21T21:14:38.787727+0000","last_fullsized":"2024-01-21T21:14:38.787727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787363+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:14:38.787363+0000","last_peered":"2024-01-21T21:14:38.787363+0000","last_clean":"2024-01-21T21:14:38.787363+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:14:38.787363+0000","last_undegraded":"2024-01-21T21:14:38.787363+0000","last_fullsized":"2024-01-21T21:14:38.787363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":141,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:38.787747+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:14:38.787747+0000","last_peered":"2024-01-21T21:14:38.787747+0000","last_clean":"2024-01-21T21:14:38.787747+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:14:38.787747+0000","last_undegraded":"2024-01-21T21:14:38.787747+0000","last_fullsized":"2024-01-21T21:14:38.787747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":128,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674346+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:14:39.674346+0000","last_peered":"2024-01-21T21:14:39.674346+0000","last_clean":"2024-01-21T21:14:39.674346+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:14:39.674346+0000","last_undegraded":"2024-01-21T21:14:39.674346+0000","last_fullsized":"2024-01-21T21:14:39.674346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674323+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:14:39.674323+0000","last_peered":"2024-01-21T21:14:39.674323+0000","last_clean":"2024-01-21T21:14:39.674323+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:14:39.674323+0000","last_undegraded":"2024-01-21T21:14:39.674323+0000","last_fullsized":"2024-01-21T21:14:39.674323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":129,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674410+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:14:39.674410+0000","last_peered":"2024-01-21T21:14:39.674410+0000","last_clean":"2024-01-21T21:14:39.674410+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:14:39.674410+0000","last_undegraded":"2024-01-21T21:14:39.674410+0000","last_fullsized":"2024-01-21T21:14:39.674410+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:42.868042+0000","last_change":"2024-01-21T21:14:42.868042+0000","last_active":"2024-01-21T21:14:42.868042+0000","last_peered":"2024-01-21T21:14:42.868042+0000","last_clean":"2024-01-21T21:14:42.868042+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:42.868042+0000","last_undegraded":"2024-01-21T21:14:42.868042+0000","last_fullsized":"2024-01-21T21:14:42.868042+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:14:41.861326+0000","last_change":"2024-01-21T21:14:41.861326+0000","last_active":"2024-01-21T21:14:41.861326+0000","last_peered":"2024-01-21T21:14:41.861326+0000","last_clean":"2024-01-21T21:14:41.861326+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:14:41.861326+0000","last_undegraded":"2024-01-21T21:14:41.861326+0000","last_fullsized":"2024-01-21T21:14:41.861326+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-01-21T21:14:39.674216+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:14:39.674216+0000","last_peered":"2024-01-21T21:14:39.674216+0000","last_clean":"2024-01-21T21:14:39.674216+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:14:39.674216+0000","last_undegraded":"2024-01-21T21:14:39.674216+0000","last_fullsized":"2024-01-21T21:14:39.674216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575750,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064660,"statfs":{"total":96636764160,"available":96322211840,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.315},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.875},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":0.82199999999999995},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":0.85399999999999998},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.35199999999999998},"max":{"1min":0.75,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.748}]},{"osd":4,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.502},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.621},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.32200000000000001},"max":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303088,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068752,"statfs":{"total":96636764160,"available":96326402048,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.443},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.45800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.623},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.59899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575751,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303084,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068756,"statfs":{"total":96636764160,"available":96326406144,"internally_reserved":0,"allocated":1937408,"data_stored":1032327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.41499999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.495},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.439}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.65700000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.79700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575751,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.63100000000000001,"15min":0.64600000000000002},"last":0.38},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.67400000000000004},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":0.58299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.749},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.018},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.95999999999999996,"15min":0.999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.501}]},{"osd":7,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.879,"5min":0.96399999999999997,"15min":1.079},"last":0.623},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":1.044,"15min":1.044},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575751,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.33100000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.25600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.371}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.495},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307184,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064656,"statfs":{"total":96636764160,"available":96322207744,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.71399999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.878}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.746}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.62}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575750,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311280,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060560,"statfs":{"total":96636764160,"available":96318013440,"internally_reserved":0,"allocated":1941504,"data_stored":1033288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.42399999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.505},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:14:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2024-01-21T21:14:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3f is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3e is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2024-01-21T21:14:46.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2024-01-21T21:14:46.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2024-01-21T21:14:46.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.36 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2024-01-21T21:14:46.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2024-01-21T21:14:46.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2d is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2024-01-21T21:14:46.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2a is not active+clean 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.26 is not active+clean 2024-01-21T21:14:46.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.23 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.22 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2024-01-21T21:14:46.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.19 is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2024-01-21T21:14:46.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.d is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.c is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.a is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2024-01-21T21:14:46.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.7 is not active+clean 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2024-01-21T21:14:46.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2024-01-21T21:14:46.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2024-01-21T21:14:46.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2024-01-21T21:14:46.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:42.868042+0000', 'last_change': '2024-01-21T21:14:42.868042+0000', 'last_active': '2024-01-21T21:14:42.868042+0000', 'last_peered': '2024-01-21T21:14:42.868042+0000', 'last_clean': '2024-01-21T21:14:42.868042+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:42.868042+0000', 'last_undegraded': '2024-01-21T21:14:42.868042+0000', 'last_fullsized': '2024-01-21T21:14:42.868042+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:42.868042+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.16 is not active+clean 2024-01-21T21:14:46.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:14:41.861326+0000', 'last_change': '2024-01-21T21:14:41.861326+0000', 'last_active': '2024-01-21T21:14:41.861326+0000', 'last_peered': '2024-01-21T21:14:41.861326+0000', 'last_clean': '2024-01-21T21:14:41.861326+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:14:41.861326+0000', 'last_undegraded': '2024-01-21T21:14:41.861326+0000', 'last_fullsized': '2024-01-21T21:14:41.861326+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'last_clean_scrub_stamp': '2024-01-21T21:14:41.861326+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:14:46.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T21:14:47.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.101+0000 7f96cb659700 1 Processor -- start 2024-01-21T21:14:47.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.101+0000 7f96cb659700 1 -- start start 2024-01-21T21:14:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96cb659700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96cb659700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96c40c8120 0x7f96c40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96cb659700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40ab620 con 0x7f96c4154520 2024-01-21T21:14:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96cb659700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40c6ae0 con 0x7f96c40c8120 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96cb659700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40c05e0 con 0x7f96c4154140 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96c9bf6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96c40c8120 0x7f96c40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96c8bf4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f96c4154520 0x7f96c40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42674/0 (socket says 172.21.15.133:42674) 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96c8bf4700 1 -- 172.21.15.133:0/49513520 learned_addr learned my addr 172.21.15.133:0/49513520 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.102+0000 7f96c9bf6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f96c40c8120 0x7f96c40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50466/0 (socket says 172.21.15.133:50466) 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c93f5700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c9bf6700 1 -- 172.21.15.133:0/49513520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 msgr2=0x7f96c4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c9bf6700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c9bf6700 1 -- 172.21.15.133:0/49513520 >> v1:172.21.15.133:6789/0 conn(0x7f96c4154520 legacy=0x7f96c40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c9bf6700 1 -- 172.21.15.133:0/49513520 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40c0e40 con 0x7f96c40c8120 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96bbfff700 1 -- 172.21.15.133:0/49513520 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109806188 0 0) 0x7f96c40ab620 con 0x7f96c4154520 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96c9bf6700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c40ab130 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f96bc009e60 tx=0x7f96bc009780).ready entity=mon.0 client_cookie=a9dc3ffece6c767d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96bbfff700 1 -- 172.21.15.133:0/49513520 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc00e070 con 0x7f96c40c8120 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96bbfff700 1 -- 172.21.15.133:0/49513520 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc00bc30 con 0x7f96c40c8120 2024-01-21T21:14:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.103+0000 7f96bbfff700 1 -- 172.21.15.133:0/49513520 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc012410 con 0x7f96c40c8120 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 -- 172.21.15.133:0/49513520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 msgr2=0x7f96c40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c40ab130 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f96bc009e60 tx=0x7f96bc009780).stop 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 -- 172.21.15.133:0/49513520 shutdown_connections 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c40ab130 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 --2- 172.21.15.133:0/49513520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 -- 172.21.15.133:0/49513520 >> 172.21.15.133:0/49513520 conn(0x7f96c405e1e0 msgr2=0x7f96c405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 -- 172.21.15.133:0/49513520 shutdown_connections 2024-01-21T21:14:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.104+0000 7f96cb659700 1 -- 172.21.15.133:0/49513520 wait complete. 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.105+0000 7f96cb659700 1 Processor -- start 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.105+0000 7f96cb659700 1 -- start start 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c414f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 0x7f96c40b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4150eb0 con 0x7f96c40c8120 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4150300 con 0x7f96c4154520 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4150510 con 0x7f96c4154140 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50470/0 (socket says 172.21.15.133:50470) 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 -- 172.21.15.133:0/1501044459 learned_addr learned my addr 172.21.15.133:0/1501044459 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c9bf6700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 0x7f96c40b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c8bf4700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c414f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 -- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 msgr2=0x7f96c414f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c414f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 -- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 msgr2=0x7f96c40b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 0x7f96c40b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 -- 172.21.15.133:0/1501044459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009a20 con 0x7f96c40c8120 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c9bf6700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 0x7f96c40b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c8bf4700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96c93f5700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f96b400d890 tx=0x7f96b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b40125f0 con 0x7f96c40c8120 2024-01-21T21:14:47.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4012750 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c41507f0 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.106+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4012ad0 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.107+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c414fe90 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c405fdf0 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f96b4013480 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96b9ffb700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 0x7f96a8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f96b407a5b0 con 0x7f96c40c8120 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96c8bf4700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 0x7f96a8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.108+0000 7f96c8bf4700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 0x7f96a8061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f96c4153370 tx=0x7f96c0009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.112+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96b404b590 con 0x7f96c40c8120 2024-01-21T21:14:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.338+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f96c40c00f0 con 0x7f96c40c8120 2024-01-21T21:14:47.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.338+0000 7f96b9ffb700 1 -- 172.21.15.133:0/1501044459 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1025 (secure 0 0 0) 0x7f96b404ebb0 con 0x7f96c40c8120 2024-01-21T21:14:47.341 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:47.341 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4558,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":160,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":128},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2512248832,"bytes_avail":770581864448,"bytes_total":773094113280,"unknown_pgs_ratio":0.9343065619468689},"fsmap":{"epoch":56,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8586}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-01-21T21:04:38.176179+0000","services":{}},"progress_events":{}} 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 msgr2=0x7f96a8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 0x7f96a8061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f96c4153370 tx=0x7f96c0009040).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 msgr2=0x7f96c414c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f96b400d890 tx=0x7f96b4008040).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 shutdown_connections 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f96a805f150 0x7f96a8061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96c4154520 0x7f96c40b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96c40c8120 0x7f96c414c990 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 --2- 172.21.15.133:0/1501044459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96c4154140 0x7f96c414f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 >> 172.21.15.133:0/1501044459 conn(0x7f96c405e1e0 msgr2=0x7f96c40ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 shutdown_connections 2024-01-21T21:14:47.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.340+0000 7f96cb659700 1 -- 172.21.15.133:0/1501044459 wait complete. 2024-01-21T21:14:47.354 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T21:14:47.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:14:47.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.467+0000 7f5e27c53700 1 Processor -- start 2024-01-21T21:14:47.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.468+0000 7f5e27c53700 1 -- start start 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.468+0000 7f5e27c53700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e20062ff0 0x7f5e20065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.468+0000 7f5e27c53700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20069ef0 con 0x7f5e20062c10 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.468+0000 7f5e27c53700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e20065fe0 con 0x7f5e20065b50 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.468+0000 7f5e27c53700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e2006a130 con 0x7f5e20062ff0 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e259ef700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5e20062c10 0x7f5e200697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42686/0 (socket says 172.21.15.133:42686) 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e259ef700 1 -- 172.21.15.133:0/3382848538 learned_addr learned my addr 172.21.15.133:0/3382848538 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e251ee700 1 --2- 172.21.15.133:0/3382848538 >> v2:172.21.15.178:3300/0 conn(0x7f5e20062ff0 0x7f5e20065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383543791 0 0) 0x7f5e14001110 con 0x7f5e20062c10 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c0033f0 con 0x7f5e20062c10 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231211237 0 0) 0x7f5e0c0033f0 con 0x7f5e20062c10 2024-01-21T21:14:47.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 >> v2:172.21.15.178:3300/0 conn(0x7f5e20062ff0 msgr2=0x7f5e20065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 --2- 172.21.15.133:0/3382848538 >> v2:172.21.15.178:3300/0 conn(0x7f5e20062ff0 0x7f5e20065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 >> v1:172.21.15.178:6789/0 conn(0x7f5e20065b50 legacy=0x7f5e200bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2006a410 con 0x7f5e20062c10 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f5e14001600 con 0x7f5e20062c10 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 >> v1:172.21.15.133:6789/0 conn(0x7f5e20062c10 legacy=0x7f5e200697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c0038e0 0x7f5e0c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c004690 0x7f5e0c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 0x7f5e0c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2006a130 con 0x7f5e0c005050 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c00bfe0 con 0x7f5e0c0038e0 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c00c1a0 con 0x7f5e0c004690 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 0x7f5e0c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e259ef700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c0038e0 0x7f5e0c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.469+0000 7f5e251ee700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c004690 0x7f5e0c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 -- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c004690 msgr2=0x7f5e0c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c004690 0x7f5e0c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 -- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c0038e0 msgr2=0x7f5e0c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c0038e0 0x7f5e0c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 -- 172.21.15.133:0/3382848538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0033f0 con 0x7f5e0c005050 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 -- 172.21.15.133:0/3382848538 reap_dead start 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 0x7f5e0c00b8e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5e18001e00 tx=0x7f5e18007f30).ready entity=mon.0 client_cookie=d70cf62e4bbc6205 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18006a20 con 0x7f5e0c005050 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18006b80 con 0x7f5e0c005050 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e249ed700 1 -- 172.21.15.133:0/3382848538 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800c5d0 con 0x7f5e0c005050 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e27c53700 1 -- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 msgr2=0x7f5e0c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 0x7f5e0c00b8e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f5e18001e00 tx=0x7f5e18007f30).stop 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e27c53700 1 -- 172.21.15.133:0/3382848538 shutdown_connections 2024-01-21T21:14:47.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3382848538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e0c005050 0x7f5e0c00b8e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.470+0000 7f5e27c53700 1 -- 172.21.15.133:0/3382848538 >> 172.21.15.133:0/3382848538 conn(0x7f5e200c8010 msgr2=0x7f5e200c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.471+0000 7f5e27c53700 1 -- 172.21.15.133:0/3382848538 shutdown_connections 2024-01-21T21:14:47.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.471+0000 7f5e27c53700 1 -- 172.21.15.133:0/3382848538 wait complete. 2024-01-21T21:14:47.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.472+0000 7f5e27c53700 1 Processor -- start 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.472+0000 7f5e27c53700 1 -- start start 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c005050 0x7f5e20136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 0x7f5e200aa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200c0ec0 con 0x7f5e20164f60 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2013d300 con 0x7f5e0c005050 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e27c53700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200aa570 con 0x7f5e200a9c00 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e261f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e261f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50478/0 (socket says 172.21.15.133:50478) 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e261f0700 1 -- 172.21.15.133:0/3383905608 learned_addr learned my addr 172.21.15.133:0/3383905608 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e259ef700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c005050 0x7f5e20136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e251ee700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 0x7f5e200aa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.473+0000 7f5e261f0700 1 -- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 msgr2=0x7f5e200aa080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 0x7f5e200aa080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e261f0700 1 -- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c005050 msgr2=0x7f5e20136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c005050 0x7f5e20136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e261f0700 1 -- 172.21.15.133:0/3383905608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e20137150 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e251ee700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 0x7f5e200aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e261f0700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5e18009000 tx=0x7f5e18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800c5d0 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1800ce40 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18006a20 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e201658d0 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.474+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e200c0870 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.475+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2005fdf0 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.475+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5e1801b040 con 0x7f5e20164f60 2024-01-21T21:14:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.476+0000 7f5e127fc700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.476+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f5e18018040 con 0x7f5e20164f60 2024-01-21T21:14:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.476+0000 7f5e259ef700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.476+0000 7f5e259ef700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 0x7f5e04061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5e140079e0 tx=0x7f5e14009040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:47.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.480+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5e1804c150 con 0x7f5e20164f60 2024-01-21T21:14:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.640+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e200c8e40 con 0x7f5e0405f150 2024-01-21T21:14:47.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.650+0000 7f5e127fc700 1 -- 172.21.15.133:0/3383905608 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361899 (secure 0 0 0) 0x7f5e200c8e40 con 0x7f5e0405f150 2024-01-21T21:14:47.657 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 msgr2=0x7f5e04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 0x7f5e04061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f5e140079e0 tx=0x7f5e14009040).stop 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 msgr2=0x7f5e201653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f5e18009000 tx=0x7f5e18015000).stop 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 shutdown_connections 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5e0405f150 0x7f5e04061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e20164f60 0x7f5e201653e0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c005050 0x7f5e20136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 --2- 172.21.15.133:0/3383905608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e200a9c00 0x7f5e200aa080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.653+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 >> 172.21.15.133:0/3383905608 conn(0x7f5e200c8010 msgr2=0x7f5e200bd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.654+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 shutdown_connections 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:47.654+0000 7f5e27c53700 1 -- 172.21.15.133:0/3383905608 wait complete. 2024-01-21T21:14:47.661 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:14:47.668 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-01-21T21:14:47.555153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":239,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453816,"kb_used_data":15608,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752520904,"statfs":{"total":773094113280,"available":770581405696,"internally_reserved":0,"allocated":15982592,"data_stored":8504250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5035530,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-522,"num_write_kb":-5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.324593"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258686+0000","last_change":"2024-01-21T21:14:43.256284+0000","last_active":"2024-01-21T21:14:43.258686+0000","last_peered":"2024-01-21T21:14:43.258686+0000","last_clean":"2024-01-21T21:14:43.258686+0000","last_became_active":"2024-01-21T21:14:43.255974+0000","last_became_peered":"2024-01-21T21:14:43.255974+0000","last_unstale":"2024-01-21T21:14:43.258686+0000","last_undegraded":"2024-01-21T21:14:43.258686+0000","last_fullsized":"2024-01-21T21:14:43.258686+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"159'3","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263848+0000","last_change":"2024-01-21T21:14:42.887349+0000","last_active":"2024-01-21T21:14:43.263848+0000","last_peered":"2024-01-21T21:14:43.263848+0000","last_clean":"2024-01-21T21:14:43.263848+0000","last_became_active":"2024-01-21T21:14:42.887092+0000","last_became_peered":"2024-01-21T21:14:42.887092+0000","last_unstale":"2024-01-21T21:14:43.263848+0000","last_undegraded":"2024-01-21T21:14:43.263848+0000","last_fullsized":"2024-01-21T21:14:43.263848+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275195+0000","last_change":"2024-01-21T21:14:43.274368+0000","last_active":"2024-01-21T21:14:43.275195+0000","last_peered":"2024-01-21T21:14:43.275195+0000","last_clean":"2024-01-21T21:14:43.275195+0000","last_became_active":"2024-01-21T21:14:43.274073+0000","last_became_peered":"2024-01-21T21:14:43.274073+0000","last_unstale":"2024-01-21T21:14:43.275195+0000","last_undegraded":"2024-01-21T21:14:43.275195+0000","last_fullsized":"2024-01-21T21:14:43.275195+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258456+0000","last_change":"2024-01-21T21:14:42.892056+0000","last_active":"2024-01-21T21:14:43.258456+0000","last_peered":"2024-01-21T21:14:43.258456+0000","last_clean":"2024-01-21T21:14:43.258456+0000","last_became_active":"2024-01-21T21:14:42.891773+0000","last_became_peered":"2024-01-21T21:14:42.891773+0000","last_unstale":"2024-01-21T21:14:43.258456+0000","last_undegraded":"2024-01-21T21:14:43.258456+0000","last_fullsized":"2024-01-21T21:14:43.258456+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265170+0000","last_change":"2024-01-21T21:14:43.262703+0000","last_active":"2024-01-21T21:14:43.265170+0000","last_peered":"2024-01-21T21:14:43.265170+0000","last_clean":"2024-01-21T21:14:43.265170+0000","last_became_active":"2024-01-21T21:14:43.262461+0000","last_became_peered":"2024-01-21T21:14:43.262461+0000","last_unstale":"2024-01-21T21:14:43.265170+0000","last_undegraded":"2024-01-21T21:14:43.265170+0000","last_fullsized":"2024-01-21T21:14:43.265170+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259620+0000","last_change":"2024-01-21T21:14:42.890627+0000","last_active":"2024-01-21T21:14:43.259620+0000","last_peered":"2024-01-21T21:14:43.259620+0000","last_clean":"2024-01-21T21:14:43.259620+0000","last_became_active":"2024-01-21T21:14:42.890367+0000","last_became_peered":"2024-01-21T21:14:42.890367+0000","last_unstale":"2024-01-21T21:14:43.259620+0000","last_undegraded":"2024-01-21T21:14:43.259620+0000","last_fullsized":"2024-01-21T21:14:43.259620+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271082+0000","last_change":"2024-01-21T21:14:43.269125+0000","last_active":"2024-01-21T21:14:43.271082+0000","last_peered":"2024-01-21T21:14:43.271082+0000","last_clean":"2024-01-21T21:14:43.271082+0000","last_became_active":"2024-01-21T21:14:43.268866+0000","last_became_peered":"2024-01-21T21:14:43.268866+0000","last_unstale":"2024-01-21T21:14:43.271082+0000","last_undegraded":"2024-01-21T21:14:43.271082+0000","last_fullsized":"2024-01-21T21:14:43.271082+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276854+0000","last_change":"2024-01-21T21:14:42.885529+0000","last_active":"2024-01-21T21:14:43.276854+0000","last_peered":"2024-01-21T21:14:43.276854+0000","last_clean":"2024-01-21T21:14:43.276854+0000","last_became_active":"2024-01-21T21:14:42.885254+0000","last_became_peered":"2024-01-21T21:14:42.885254+0000","last_unstale":"2024-01-21T21:14:43.276854+0000","last_undegraded":"2024-01-21T21:14:43.276854+0000","last_fullsized":"2024-01-21T21:14:43.276854+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.254062+0000","last_change":"2024-01-21T21:14:43.253234+0000","last_active":"2024-01-21T21:14:43.254062+0000","last_peered":"2024-01-21T21:14:43.254062+0000","last_clean":"2024-01-21T21:14:43.254062+0000","last_became_active":"2024-01-21T21:14:43.252832+0000","last_became_peered":"2024-01-21T21:14:43.252832+0000","last_unstale":"2024-01-21T21:14:43.254062+0000","last_undegraded":"2024-01-21T21:14:43.254062+0000","last_fullsized":"2024-01-21T21:14:43.254062+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271500+0000","last_change":"2024-01-21T21:14:42.890050+0000","last_active":"2024-01-21T21:14:43.271500+0000","last_peered":"2024-01-21T21:14:43.271500+0000","last_clean":"2024-01-21T21:14:43.271500+0000","last_became_active":"2024-01-21T21:14:42.889548+0000","last_became_peered":"2024-01-21T21:14:42.889548+0000","last_unstale":"2024-01-21T21:14:43.271500+0000","last_undegraded":"2024-01-21T21:14:43.271500+0000","last_fullsized":"2024-01-21T21:14:43.271500+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.278261+0000","last_change":"2024-01-21T21:14:43.277266+0000","last_active":"2024-01-21T21:14:43.278261+0000","last_peered":"2024-01-21T21:14:43.278261+0000","last_clean":"2024-01-21T21:14:43.278261+0000","last_became_active":"2024-01-21T21:14:43.276968+0000","last_became_peered":"2024-01-21T21:14:43.276968+0000","last_unstale":"2024-01-21T21:14:43.278261+0000","last_undegraded":"2024-01-21T21:14:43.278261+0000","last_fullsized":"2024-01-21T21:14:43.278261+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276097+0000","last_change":"2024-01-21T21:14:42.886759+0000","last_active":"2024-01-21T21:14:43.276097+0000","last_peered":"2024-01-21T21:14:43.276097+0000","last_clean":"2024-01-21T21:14:43.276097+0000","last_became_active":"2024-01-21T21:14:42.886507+0000","last_became_peered":"2024-01-21T21:14:42.886507+0000","last_unstale":"2024-01-21T21:14:43.276097+0000","last_undegraded":"2024-01-21T21:14:43.276097+0000","last_fullsized":"2024-01-21T21:14:43.276097+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260314+0000","last_change":"2024-01-21T21:14:43.254765+0000","last_active":"2024-01-21T21:14:43.260314+0000","last_peered":"2024-01-21T21:14:43.260314+0000","last_clean":"2024-01-21T21:14:43.260314+0000","last_became_active":"2024-01-21T21:14:43.254478+0000","last_became_peered":"2024-01-21T21:14:43.254478+0000","last_unstale":"2024-01-21T21:14:43.260314+0000","last_undegraded":"2024-01-21T21:14:43.260314+0000","last_fullsized":"2024-01-21T21:14:43.260314+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253160+0000","last_change":"2024-01-21T21:14:42.891850+0000","last_active":"2024-01-21T21:14:43.253160+0000","last_peered":"2024-01-21T21:14:43.253160+0000","last_clean":"2024-01-21T21:14:43.253160+0000","last_became_active":"2024-01-21T21:14:42.891587+0000","last_became_peered":"2024-01-21T21:14:42.891587+0000","last_unstale":"2024-01-21T21:14:43.253160+0000","last_undegraded":"2024-01-21T21:14:43.253160+0000","last_fullsized":"2024-01-21T21:14:43.253160+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275880+0000","last_change":"2024-01-21T21:14:43.263267+0000","last_active":"2024-01-21T21:14:43.275880+0000","last_peered":"2024-01-21T21:14:43.275880+0000","last_clean":"2024-01-21T21:14:43.275880+0000","last_became_active":"2024-01-21T21:14:43.262989+0000","last_became_peered":"2024-01-21T21:14:43.262989+0000","last_unstale":"2024-01-21T21:14:43.275880+0000","last_undegraded":"2024-01-21T21:14:43.275880+0000","last_fullsized":"2024-01-21T21:14:43.275880+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260569+0000","last_change":"2024-01-21T21:14:42.899695+0000","last_active":"2024-01-21T21:14:43.260569+0000","last_peered":"2024-01-21T21:14:43.260569+0000","last_clean":"2024-01-21T21:14:43.260569+0000","last_became_active":"2024-01-21T21:14:42.899329+0000","last_became_peered":"2024-01-21T21:14:42.899329+0000","last_unstale":"2024-01-21T21:14:43.260569+0000","last_undegraded":"2024-01-21T21:14:43.260569+0000","last_fullsized":"2024-01-21T21:14:43.260569+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271320+0000","last_change":"2024-01-21T21:14:43.270338+0000","last_active":"2024-01-21T21:14:43.271320+0000","last_peered":"2024-01-21T21:14:43.271320+0000","last_clean":"2024-01-21T21:14:43.271320+0000","last_became_active":"2024-01-21T21:14:43.270069+0000","last_became_peered":"2024-01-21T21:14:43.270069+0000","last_unstale":"2024-01-21T21:14:43.271320+0000","last_undegraded":"2024-01-21T21:14:43.271320+0000","last_fullsized":"2024-01-21T21:14:43.271320+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259667+0000","last_change":"2024-01-21T21:14:42.897684+0000","last_active":"2024-01-21T21:14:43.259667+0000","last_peered":"2024-01-21T21:14:43.259667+0000","last_clean":"2024-01-21T21:14:43.259667+0000","last_became_active":"2024-01-21T21:14:42.897399+0000","last_became_peered":"2024-01-21T21:14:42.897399+0000","last_unstale":"2024-01-21T21:14:43.259667+0000","last_undegraded":"2024-01-21T21:14:43.259667+0000","last_fullsized":"2024-01-21T21:14:43.259667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277414+0000","last_change":"2024-01-21T21:14:43.276365+0000","last_active":"2024-01-21T21:14:43.277414+0000","last_peered":"2024-01-21T21:14:43.277414+0000","last_clean":"2024-01-21T21:14:43.277414+0000","last_became_active":"2024-01-21T21:14:43.276111+0000","last_became_peered":"2024-01-21T21:14:43.276111+0000","last_unstale":"2024-01-21T21:14:43.277414+0000","last_undegraded":"2024-01-21T21:14:43.277414+0000","last_fullsized":"2024-01-21T21:14:43.277414+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258553+0000","last_change":"2024-01-21T21:14:42.891619+0000","last_active":"2024-01-21T21:14:43.258553+0000","last_peered":"2024-01-21T21:14:43.258553+0000","last_clean":"2024-01-21T21:14:43.258553+0000","last_became_active":"2024-01-21T21:14:42.891355+0000","last_became_peered":"2024-01-21T21:14:42.891355+0000","last_unstale":"2024-01-21T21:14:43.258553+0000","last_undegraded":"2024-01-21T21:14:43.258553+0000","last_fullsized":"2024-01-21T21:14:43.258553+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279867+0000","last_change":"2024-01-21T21:14:43.276657+0000","last_active":"2024-01-21T21:14:43.279867+0000","last_peered":"2024-01-21T21:14:43.279867+0000","last_clean":"2024-01-21T21:14:43.279867+0000","last_became_active":"2024-01-21T21:14:43.276338+0000","last_became_peered":"2024-01-21T21:14:43.276338+0000","last_unstale":"2024-01-21T21:14:43.279867+0000","last_undegraded":"2024-01-21T21:14:43.279867+0000","last_fullsized":"2024-01-21T21:14:43.279867+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.249577+0000","last_change":"2024-01-21T21:14:42.892990+0000","last_active":"2024-01-21T21:14:43.249577+0000","last_peered":"2024-01-21T21:14:43.249577+0000","last_clean":"2024-01-21T21:14:43.249577+0000","last_became_active":"2024-01-21T21:14:42.892718+0000","last_became_peered":"2024-01-21T21:14:42.892718+0000","last_unstale":"2024-01-21T21:14:43.249577+0000","last_undegraded":"2024-01-21T21:14:43.249577+0000","last_fullsized":"2024-01-21T21:14:43.249577+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268059+0000","last_change":"2024-01-21T21:14:43.263159+0000","last_active":"2024-01-21T21:14:43.268059+0000","last_peered":"2024-01-21T21:14:43.268059+0000","last_clean":"2024-01-21T21:14:43.268059+0000","last_became_active":"2024-01-21T21:14:43.262823+0000","last_became_peered":"2024-01-21T21:14:43.262823+0000","last_unstale":"2024-01-21T21:14:43.268059+0000","last_undegraded":"2024-01-21T21:14:43.268059+0000","last_fullsized":"2024-01-21T21:14:43.268059+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274973+0000","last_change":"2024-01-21T21:14:42.895671+0000","last_active":"2024-01-21T21:14:43.274973+0000","last_peered":"2024-01-21T21:14:43.274973+0000","last_clean":"2024-01-21T21:14:43.274973+0000","last_became_active":"2024-01-21T21:14:42.895409+0000","last_became_peered":"2024-01-21T21:14:42.895409+0000","last_unstale":"2024-01-21T21:14:43.274973+0000","last_undegraded":"2024-01-21T21:14:43.274973+0000","last_fullsized":"2024-01-21T21:14:43.274973+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280337+0000","last_change":"2024-01-21T21:14:43.277512+0000","last_active":"2024-01-21T21:14:43.280337+0000","last_peered":"2024-01-21T21:14:43.280337+0000","last_clean":"2024-01-21T21:14:43.280337+0000","last_became_active":"2024-01-21T21:14:43.277227+0000","last_became_peered":"2024-01-21T21:14:43.277227+0000","last_unstale":"2024-01-21T21:14:43.280337+0000","last_undegraded":"2024-01-21T21:14:43.280337+0000","last_fullsized":"2024-01-21T21:14:43.280337+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264280+0000","last_change":"2024-01-21T21:14:42.892402+0000","last_active":"2024-01-21T21:14:43.264280+0000","last_peered":"2024-01-21T21:14:43.264280+0000","last_clean":"2024-01-21T21:14:43.264280+0000","last_became_active":"2024-01-21T21:14:42.891951+0000","last_became_peered":"2024-01-21T21:14:42.891951+0000","last_unstale":"2024-01-21T21:14:43.264280+0000","last_undegraded":"2024-01-21T21:14:43.264280+0000","last_fullsized":"2024-01-21T21:14:43.264280+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270948+0000","last_change":"2024-01-21T21:14:43.267005+0000","last_active":"2024-01-21T21:14:43.270948+0000","last_peered":"2024-01-21T21:14:43.270948+0000","last_clean":"2024-01-21T21:14:43.270948+0000","last_became_active":"2024-01-21T21:14:43.266543+0000","last_became_peered":"2024-01-21T21:14:43.266543+0000","last_unstale":"2024-01-21T21:14:43.270948+0000","last_undegraded":"2024-01-21T21:14:43.270948+0000","last_fullsized":"2024-01-21T21:14:43.270948+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258303+0000","last_change":"2024-01-21T21:14:42.896305+0000","last_active":"2024-01-21T21:14:43.258303+0000","last_peered":"2024-01-21T21:14:43.258303+0000","last_clean":"2024-01-21T21:14:43.258303+0000","last_became_active":"2024-01-21T21:14:42.895983+0000","last_became_peered":"2024-01-21T21:14:42.895983+0000","last_unstale":"2024-01-21T21:14:43.258303+0000","last_undegraded":"2024-01-21T21:14:43.258303+0000","last_fullsized":"2024-01-21T21:14:43.258303+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261011+0000","last_change":"2024-01-21T21:14:43.258006+0000","last_active":"2024-01-21T21:14:43.261011+0000","last_peered":"2024-01-21T21:14:43.261011+0000","last_clean":"2024-01-21T21:14:43.261011+0000","last_became_active":"2024-01-21T21:14:43.257752+0000","last_became_peered":"2024-01-21T21:14:43.257752+0000","last_unstale":"2024-01-21T21:14:43.261011+0000","last_undegraded":"2024-01-21T21:14:43.261011+0000","last_fullsized":"2024-01-21T21:14:43.261011+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260219+0000","last_change":"2024-01-21T21:14:42.893560+0000","last_active":"2024-01-21T21:14:43.260219+0000","last_peered":"2024-01-21T21:14:43.260219+0000","last_clean":"2024-01-21T21:14:43.260219+0000","last_became_active":"2024-01-21T21:14:42.892823+0000","last_became_peered":"2024-01-21T21:14:42.892823+0000","last_unstale":"2024-01-21T21:14:43.260219+0000","last_undegraded":"2024-01-21T21:14:43.260219+0000","last_fullsized":"2024-01-21T21:14:43.260219+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.267751+0000","last_change":"2024-01-21T21:14:43.262616+0000","last_active":"2024-01-21T21:14:43.267751+0000","last_peered":"2024-01-21T21:14:43.267751+0000","last_clean":"2024-01-21T21:14:43.267751+0000","last_became_active":"2024-01-21T21:14:43.262364+0000","last_became_peered":"2024-01-21T21:14:43.262364+0000","last_unstale":"2024-01-21T21:14:43.267751+0000","last_undegraded":"2024-01-21T21:14:43.267751+0000","last_fullsized":"2024-01-21T21:14:43.267751+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277920+0000","last_change":"2024-01-21T21:14:42.889690+0000","last_active":"2024-01-21T21:14:43.277920+0000","last_peered":"2024-01-21T21:14:43.277920+0000","last_clean":"2024-01-21T21:14:43.277920+0000","last_became_active":"2024-01-21T21:14:42.889425+0000","last_became_peered":"2024-01-21T21:14:42.889425+0000","last_unstale":"2024-01-21T21:14:43.277920+0000","last_undegraded":"2024-01-21T21:14:43.277920+0000","last_fullsized":"2024-01-21T21:14:43.277920+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268929+0000","last_change":"2024-01-21T21:14:43.264829+0000","last_active":"2024-01-21T21:14:43.268929+0000","last_peered":"2024-01-21T21:14:43.268929+0000","last_clean":"2024-01-21T21:14:43.268929+0000","last_became_active":"2024-01-21T21:14:43.264403+0000","last_became_peered":"2024-01-21T21:14:43.264403+0000","last_unstale":"2024-01-21T21:14:43.268929+0000","last_undegraded":"2024-01-21T21:14:43.268929+0000","last_fullsized":"2024-01-21T21:14:43.268929+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253589+0000","last_change":"2024-01-21T21:14:42.885487+0000","last_active":"2024-01-21T21:14:43.253589+0000","last_peered":"2024-01-21T21:14:43.253589+0000","last_clean":"2024-01-21T21:14:43.253589+0000","last_became_active":"2024-01-21T21:14:42.885202+0000","last_became_peered":"2024-01-21T21:14:42.885202+0000","last_unstale":"2024-01-21T21:14:43.253589+0000","last_undegraded":"2024-01-21T21:14:43.253589+0000","last_fullsized":"2024-01-21T21:14:43.253589+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271649+0000","last_change":"2024-01-21T21:14:43.269828+0000","last_active":"2024-01-21T21:14:43.271649+0000","last_peered":"2024-01-21T21:14:43.271649+0000","last_clean":"2024-01-21T21:14:43.271649+0000","last_became_active":"2024-01-21T21:14:43.269556+0000","last_became_peered":"2024-01-21T21:14:43.269556+0000","last_unstale":"2024-01-21T21:14:43.271649+0000","last_undegraded":"2024-01-21T21:14:43.271649+0000","last_fullsized":"2024-01-21T21:14:43.271649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266296+0000","last_change":"2024-01-21T21:14:42.889934+0000","last_active":"2024-01-21T21:14:43.266296+0000","last_peered":"2024-01-21T21:14:43.266296+0000","last_clean":"2024-01-21T21:14:43.266296+0000","last_became_active":"2024-01-21T21:14:42.889448+0000","last_became_peered":"2024-01-21T21:14:42.889448+0000","last_unstale":"2024-01-21T21:14:43.266296+0000","last_undegraded":"2024-01-21T21:14:43.266296+0000","last_fullsized":"2024-01-21T21:14:43.266296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265272+0000","last_change":"2024-01-21T21:14:43.261503+0000","last_active":"2024-01-21T21:14:43.265272+0000","last_peered":"2024-01-21T21:14:43.265272+0000","last_clean":"2024-01-21T21:14:43.265272+0000","last_became_active":"2024-01-21T21:14:43.261201+0000","last_became_peered":"2024-01-21T21:14:43.261201+0000","last_unstale":"2024-01-21T21:14:43.265272+0000","last_undegraded":"2024-01-21T21:14:43.265272+0000","last_fullsized":"2024-01-21T21:14:43.265272+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261769+0000","last_change":"2024-01-21T21:14:42.887319+0000","last_active":"2024-01-21T21:14:43.261769+0000","last_peered":"2024-01-21T21:14:43.261769+0000","last_clean":"2024-01-21T21:14:43.261769+0000","last_became_active":"2024-01-21T21:14:42.887063+0000","last_became_peered":"2024-01-21T21:14:42.887063+0000","last_unstale":"2024-01-21T21:14:43.261769+0000","last_undegraded":"2024-01-21T21:14:43.261769+0000","last_fullsized":"2024-01-21T21:14:43.261769+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264800+0000","last_change":"2024-01-21T21:14:43.263225+0000","last_active":"2024-01-21T21:14:43.264800+0000","last_peered":"2024-01-21T21:14:43.264800+0000","last_clean":"2024-01-21T21:14:43.264800+0000","last_became_active":"2024-01-21T21:14:43.262728+0000","last_became_peered":"2024-01-21T21:14:43.262728+0000","last_unstale":"2024-01-21T21:14:43.264800+0000","last_undegraded":"2024-01-21T21:14:43.264800+0000","last_fullsized":"2024-01-21T21:14:43.264800+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253373+0000","last_change":"2024-01-21T21:14:42.895258+0000","last_active":"2024-01-21T21:14:43.253373+0000","last_peered":"2024-01-21T21:14:43.253373+0000","last_clean":"2024-01-21T21:14:43.253373+0000","last_became_active":"2024-01-21T21:14:42.895036+0000","last_became_peered":"2024-01-21T21:14:42.895036+0000","last_unstale":"2024-01-21T21:14:43.253373+0000","last_undegraded":"2024-01-21T21:14:43.253373+0000","last_fullsized":"2024-01-21T21:14:43.253373+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280853+0000","last_change":"2024-01-21T21:14:43.277865+0000","last_active":"2024-01-21T21:14:43.280853+0000","last_peered":"2024-01-21T21:14:43.280853+0000","last_clean":"2024-01-21T21:14:43.280853+0000","last_became_active":"2024-01-21T21:14:43.276736+0000","last_became_peered":"2024-01-21T21:14:43.276736+0000","last_unstale":"2024-01-21T21:14:43.280853+0000","last_undegraded":"2024-01-21T21:14:43.280853+0000","last_fullsized":"2024-01-21T21:14:43.280853+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271720+0000","last_change":"2024-01-21T21:14:42.896718+0000","last_active":"2024-01-21T21:14:43.271720+0000","last_peered":"2024-01-21T21:14:43.271720+0000","last_clean":"2024-01-21T21:14:43.271720+0000","last_became_active":"2024-01-21T21:14:42.896429+0000","last_became_peered":"2024-01-21T21:14:42.896429+0000","last_unstale":"2024-01-21T21:14:43.271720+0000","last_undegraded":"2024-01-21T21:14:43.271720+0000","last_fullsized":"2024-01-21T21:14:43.271720+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275143+0000","last_change":"2024-01-21T21:14:43.273221+0000","last_active":"2024-01-21T21:14:43.275143+0000","last_peered":"2024-01-21T21:14:43.275143+0000","last_clean":"2024-01-21T21:14:43.275143+0000","last_became_active":"2024-01-21T21:14:43.272915+0000","last_became_peered":"2024-01-21T21:14:43.272915+0000","last_unstale":"2024-01-21T21:14:43.275143+0000","last_undegraded":"2024-01-21T21:14:43.275143+0000","last_fullsized":"2024-01-21T21:14:43.275143+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.248911+0000","last_change":"2024-01-21T21:14:42.895468+0000","last_active":"2024-01-21T21:14:43.248911+0000","last_peered":"2024-01-21T21:14:43.248911+0000","last_clean":"2024-01-21T21:14:43.248911+0000","last_became_active":"2024-01-21T21:14:42.895151+0000","last_became_peered":"2024-01-21T21:14:42.895151+0000","last_unstale":"2024-01-21T21:14:43.248911+0000","last_undegraded":"2024-01-21T21:14:43.248911+0000","last_fullsized":"2024-01-21T21:14:43.248911+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271881+0000","last_change":"2024-01-21T21:14:43.269900+0000","last_active":"2024-01-21T21:14:43.271881+0000","last_peered":"2024-01-21T21:14:43.271881+0000","last_clean":"2024-01-21T21:14:43.271881+0000","last_became_active":"2024-01-21T21:14:43.269628+0000","last_became_peered":"2024-01-21T21:14:43.269628+0000","last_unstale":"2024-01-21T21:14:43.271881+0000","last_undegraded":"2024-01-21T21:14:43.271881+0000","last_fullsized":"2024-01-21T21:14:43.271881+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258714+0000","last_change":"2024-01-21T21:14:42.897701+0000","last_active":"2024-01-21T21:14:43.258714+0000","last_peered":"2024-01-21T21:14:43.258714+0000","last_clean":"2024-01-21T21:14:43.258714+0000","last_became_active":"2024-01-21T21:14:42.897432+0000","last_became_peered":"2024-01-21T21:14:42.897432+0000","last_unstale":"2024-01-21T21:14:43.258714+0000","last_undegraded":"2024-01-21T21:14:43.258714+0000","last_fullsized":"2024-01-21T21:14:43.258714+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271367+0000","last_change":"2024-01-21T21:14:43.270480+0000","last_active":"2024-01-21T21:14:43.271367+0000","last_peered":"2024-01-21T21:14:43.271367+0000","last_clean":"2024-01-21T21:14:43.271367+0000","last_became_active":"2024-01-21T21:14:43.270172+0000","last_became_peered":"2024-01-21T21:14:43.270172+0000","last_unstale":"2024-01-21T21:14:43.271367+0000","last_undegraded":"2024-01-21T21:14:43.271367+0000","last_fullsized":"2024-01-21T21:14:43.271367+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.248647+0000","last_change":"2024-01-21T21:14:42.885775+0000","last_active":"2024-01-21T21:14:43.248647+0000","last_peered":"2024-01-21T21:14:43.248647+0000","last_clean":"2024-01-21T21:14:43.248647+0000","last_became_active":"2024-01-21T21:14:42.885533+0000","last_became_peered":"2024-01-21T21:14:42.885533+0000","last_unstale":"2024-01-21T21:14:43.248647+0000","last_undegraded":"2024-01-21T21:14:43.248647+0000","last_fullsized":"2024-01-21T21:14:43.248647+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266152+0000","last_change":"2024-01-21T21:14:43.262497+0000","last_active":"2024-01-21T21:14:43.266152+0000","last_peered":"2024-01-21T21:14:43.266152+0000","last_clean":"2024-01-21T21:14:43.266152+0000","last_became_active":"2024-01-21T21:14:43.262232+0000","last_became_peered":"2024-01-21T21:14:43.262232+0000","last_unstale":"2024-01-21T21:14:43.266152+0000","last_undegraded":"2024-01-21T21:14:43.266152+0000","last_fullsized":"2024-01-21T21:14:43.266152+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259678+0000","last_change":"2024-01-21T21:14:42.891399+0000","last_active":"2024-01-21T21:14:43.259678+0000","last_peered":"2024-01-21T21:14:43.259678+0000","last_clean":"2024-01-21T21:14:43.259678+0000","last_became_active":"2024-01-21T21:14:42.891049+0000","last_became_peered":"2024-01-21T21:14:42.891049+0000","last_unstale":"2024-01-21T21:14:43.259678+0000","last_undegraded":"2024-01-21T21:14:43.259678+0000","last_fullsized":"2024-01-21T21:14:43.259678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263123+0000","last_change":"2024-01-21T21:14:43.260912+0000","last_active":"2024-01-21T21:14:43.263123+0000","last_peered":"2024-01-21T21:14:43.263123+0000","last_clean":"2024-01-21T21:14:43.263123+0000","last_became_active":"2024-01-21T21:14:43.260635+0000","last_became_peered":"2024-01-21T21:14:43.260635+0000","last_unstale":"2024-01-21T21:14:43.263123+0000","last_undegraded":"2024-01-21T21:14:43.263123+0000","last_fullsized":"2024-01-21T21:14:43.263123+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266389+0000","last_change":"2024-01-21T21:14:42.890451+0000","last_active":"2024-01-21T21:14:43.266389+0000","last_peered":"2024-01-21T21:14:43.266389+0000","last_clean":"2024-01-21T21:14:43.266389+0000","last_became_active":"2024-01-21T21:14:42.890191+0000","last_became_peered":"2024-01-21T21:14:42.890191+0000","last_unstale":"2024-01-21T21:14:43.266389+0000","last_undegraded":"2024-01-21T21:14:43.266389+0000","last_fullsized":"2024-01-21T21:14:43.266389+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271073+0000","last_change":"2024-01-21T21:14:43.262065+0000","last_active":"2024-01-21T21:14:43.271073+0000","last_peered":"2024-01-21T21:14:43.271073+0000","last_clean":"2024-01-21T21:14:43.271073+0000","last_became_active":"2024-01-21T21:14:43.261783+0000","last_became_peered":"2024-01-21T21:14:43.261783+0000","last_unstale":"2024-01-21T21:14:43.271073+0000","last_undegraded":"2024-01-21T21:14:43.271073+0000","last_fullsized":"2024-01-21T21:14:43.271073+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.257001+0000","last_change":"2024-01-21T21:14:42.886882+0000","last_active":"2024-01-21T21:14:43.257001+0000","last_peered":"2024-01-21T21:14:43.257001+0000","last_clean":"2024-01-21T21:14:43.257001+0000","last_became_active":"2024-01-21T21:14:42.886563+0000","last_became_peered":"2024-01-21T21:14:42.886563+0000","last_unstale":"2024-01-21T21:14:43.257001+0000","last_undegraded":"2024-01-21T21:14:43.257001+0000","last_fullsized":"2024-01-21T21:14:43.257001+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270633+0000","last_change":"2024-01-21T21:14:43.262275+0000","last_active":"2024-01-21T21:14:43.270633+0000","last_peered":"2024-01-21T21:14:43.270633+0000","last_clean":"2024-01-21T21:14:43.270633+0000","last_became_active":"2024-01-21T21:14:43.261995+0000","last_became_peered":"2024-01-21T21:14:43.261995+0000","last_unstale":"2024-01-21T21:14:43.270633+0000","last_undegraded":"2024-01-21T21:14:43.270633+0000","last_fullsized":"2024-01-21T21:14:43.270633+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.250196+0000","last_change":"2024-01-21T21:14:42.898738+0000","last_active":"2024-01-21T21:14:43.250196+0000","last_peered":"2024-01-21T21:14:43.250196+0000","last_clean":"2024-01-21T21:14:43.250196+0000","last_became_active":"2024-01-21T21:14:42.898464+0000","last_became_peered":"2024-01-21T21:14:42.898464+0000","last_unstale":"2024-01-21T21:14:43.250196+0000","last_undegraded":"2024-01-21T21:14:43.250196+0000","last_fullsized":"2024-01-21T21:14:43.250196+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261920+0000","last_change":"2024-01-21T21:14:43.254437+0000","last_active":"2024-01-21T21:14:43.261920+0000","last_peered":"2024-01-21T21:14:43.261920+0000","last_clean":"2024-01-21T21:14:43.261920+0000","last_became_active":"2024-01-21T21:14:43.254209+0000","last_became_peered":"2024-01-21T21:14:43.254209+0000","last_unstale":"2024-01-21T21:14:43.261920+0000","last_undegraded":"2024-01-21T21:14:43.261920+0000","last_fullsized":"2024-01-21T21:14:43.261920+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255601+0000","last_change":"2024-01-21T21:14:42.891615+0000","last_active":"2024-01-21T21:14:43.255601+0000","last_peered":"2024-01-21T21:14:43.255601+0000","last_clean":"2024-01-21T21:14:43.255601+0000","last_became_active":"2024-01-21T21:14:42.890981+0000","last_became_peered":"2024-01-21T21:14:42.890981+0000","last_unstale":"2024-01-21T21:14:43.255601+0000","last_undegraded":"2024-01-21T21:14:43.255601+0000","last_fullsized":"2024-01-21T21:14:43.255601+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274883+0000","last_change":"2024-01-21T21:14:43.272906+0000","last_active":"2024-01-21T21:14:43.274883+0000","last_peered":"2024-01-21T21:14:43.274883+0000","last_clean":"2024-01-21T21:14:43.274883+0000","last_became_active":"2024-01-21T21:14:43.272512+0000","last_became_peered":"2024-01-21T21:14:43.272512+0000","last_unstale":"2024-01-21T21:14:43.274883+0000","last_undegraded":"2024-01-21T21:14:43.274883+0000","last_fullsized":"2024-01-21T21:14:43.274883+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.256907+0000","last_change":"2024-01-21T21:14:42.890184+0000","last_active":"2024-01-21T21:14:43.256907+0000","last_peered":"2024-01-21T21:14:43.256907+0000","last_clean":"2024-01-21T21:14:43.256907+0000","last_became_active":"2024-01-21T21:14:42.889723+0000","last_became_peered":"2024-01-21T21:14:42.889723+0000","last_unstale":"2024-01-21T21:14:43.256907+0000","last_undegraded":"2024-01-21T21:14:43.256907+0000","last_fullsized":"2024-01-21T21:14:43.256907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.273241+0000","last_change":"2024-01-21T21:14:43.269993+0000","last_active":"2024-01-21T21:14:43.273241+0000","last_peered":"2024-01-21T21:14:43.273241+0000","last_clean":"2024-01-21T21:14:43.273241+0000","last_became_active":"2024-01-21T21:14:43.269714+0000","last_became_peered":"2024-01-21T21:14:43.269714+0000","last_unstale":"2024-01-21T21:14:43.273241+0000","last_undegraded":"2024-01-21T21:14:43.273241+0000","last_fullsized":"2024-01-21T21:14:43.273241+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271051+0000","last_change":"2024-01-21T21:14:42.891059+0000","last_active":"2024-01-21T21:14:43.271051+0000","last_peered":"2024-01-21T21:14:43.271051+0000","last_clean":"2024-01-21T21:14:43.271051+0000","last_became_active":"2024-01-21T21:14:42.890711+0000","last_became_peered":"2024-01-21T21:14:42.890711+0000","last_unstale":"2024-01-21T21:14:43.271051+0000","last_undegraded":"2024-01-21T21:14:43.271051+0000","last_fullsized":"2024-01-21T21:14:43.271051+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270874+0000","last_change":"2024-01-21T21:14:43.262731+0000","last_active":"2024-01-21T21:14:43.270874+0000","last_peered":"2024-01-21T21:14:43.270874+0000","last_clean":"2024-01-21T21:14:43.270874+0000","last_became_active":"2024-01-21T21:14:43.262440+0000","last_became_peered":"2024-01-21T21:14:43.262440+0000","last_unstale":"2024-01-21T21:14:43.270874+0000","last_undegraded":"2024-01-21T21:14:43.270874+0000","last_fullsized":"2024-01-21T21:14:43.270874+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253059+0000","last_change":"2024-01-21T21:14:42.886213+0000","last_active":"2024-01-21T21:14:43.253059+0000","last_peered":"2024-01-21T21:14:43.253059+0000","last_clean":"2024-01-21T21:14:43.253059+0000","last_became_active":"2024-01-21T21:14:42.885772+0000","last_became_peered":"2024-01-21T21:14:42.885772+0000","last_unstale":"2024-01-21T21:14:43.253059+0000","last_undegraded":"2024-01-21T21:14:43.253059+0000","last_fullsized":"2024-01-21T21:14:43.253059+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264404+0000","last_change":"2024-01-21T21:14:43.261696+0000","last_active":"2024-01-21T21:14:43.264404+0000","last_peered":"2024-01-21T21:14:43.264404+0000","last_clean":"2024-01-21T21:14:43.264404+0000","last_became_active":"2024-01-21T21:14:43.261389+0000","last_became_peered":"2024-01-21T21:14:43.261389+0000","last_unstale":"2024-01-21T21:14:43.264404+0000","last_undegraded":"2024-01-21T21:14:43.264404+0000","last_fullsized":"2024-01-21T21:14:43.264404+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270765+0000","last_change":"2024-01-21T21:14:42.889032+0000","last_active":"2024-01-21T21:14:43.270765+0000","last_peered":"2024-01-21T21:14:43.270765+0000","last_clean":"2024-01-21T21:14:43.270765+0000","last_became_active":"2024-01-21T21:14:42.888722+0000","last_became_peered":"2024-01-21T21:14:42.888722+0000","last_unstale":"2024-01-21T21:14:43.270765+0000","last_undegraded":"2024-01-21T21:14:43.270765+0000","last_fullsized":"2024-01-21T21:14:43.270765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265714+0000","last_change":"2024-01-21T21:14:43.261660+0000","last_active":"2024-01-21T21:14:43.265714+0000","last_peered":"2024-01-21T21:14:43.265714+0000","last_clean":"2024-01-21T21:14:43.265714+0000","last_became_active":"2024-01-21T21:14:43.261336+0000","last_became_peered":"2024-01-21T21:14:43.261336+0000","last_unstale":"2024-01-21T21:14:43.265714+0000","last_undegraded":"2024-01-21T21:14:43.265714+0000","last_fullsized":"2024-01-21T21:14:43.265714+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271412+0000","last_change":"2024-01-21T21:14:42.896395+0000","last_active":"2024-01-21T21:14:43.271412+0000","last_peered":"2024-01-21T21:14:43.271412+0000","last_clean":"2024-01-21T21:14:43.271412+0000","last_became_active":"2024-01-21T21:14:42.895691+0000","last_became_peered":"2024-01-21T21:14:42.895691+0000","last_unstale":"2024-01-21T21:14:43.271412+0000","last_undegraded":"2024-01-21T21:14:43.271412+0000","last_fullsized":"2024-01-21T21:14:43.271412+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271638+0000","last_change":"2024-01-21T21:14:43.269947+0000","last_active":"2024-01-21T21:14:43.271638+0000","last_peered":"2024-01-21T21:14:43.271638+0000","last_clean":"2024-01-21T21:14:43.271638+0000","last_became_active":"2024-01-21T21:14:43.269683+0000","last_became_peered":"2024-01-21T21:14:43.269683+0000","last_unstale":"2024-01-21T21:14:43.271638+0000","last_undegraded":"2024-01-21T21:14:43.271638+0000","last_fullsized":"2024-01-21T21:14:43.271638+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.272740+0000","last_change":"2024-01-21T21:14:42.895653+0000","last_active":"2024-01-21T21:14:43.272740+0000","last_peered":"2024-01-21T21:14:43.272740+0000","last_clean":"2024-01-21T21:14:43.272740+0000","last_became_active":"2024-01-21T21:14:42.895337+0000","last_became_peered":"2024-01-21T21:14:42.895337+0000","last_unstale":"2024-01-21T21:14:43.272740+0000","last_undegraded":"2024-01-21T21:14:43.272740+0000","last_fullsized":"2024-01-21T21:14:43.272740+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276309+0000","last_change":"2024-01-21T21:14:43.269963+0000","last_active":"2024-01-21T21:14:43.276309+0000","last_peered":"2024-01-21T21:14:43.276309+0000","last_clean":"2024-01-21T21:14:43.276309+0000","last_became_active":"2024-01-21T21:14:43.269511+0000","last_became_peered":"2024-01-21T21:14:43.269511+0000","last_unstale":"2024-01-21T21:14:43.276309+0000","last_undegraded":"2024-01-21T21:14:43.276309+0000","last_fullsized":"2024-01-21T21:14:43.276309+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263606+0000","last_change":"2024-01-21T21:14:42.892663+0000","last_active":"2024-01-21T21:14:43.263606+0000","last_peered":"2024-01-21T21:14:43.263606+0000","last_clean":"2024-01-21T21:14:43.263606+0000","last_became_active":"2024-01-21T21:14:42.892381+0000","last_became_peered":"2024-01-21T21:14:42.892381+0000","last_unstale":"2024-01-21T21:14:43.263606+0000","last_undegraded":"2024-01-21T21:14:43.263606+0000","last_fullsized":"2024-01-21T21:14:43.263606+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270818+0000","last_change":"2024-01-21T21:14:43.262952+0000","last_active":"2024-01-21T21:14:43.270818+0000","last_peered":"2024-01-21T21:14:43.270818+0000","last_clean":"2024-01-21T21:14:43.270818+0000","last_became_active":"2024-01-21T21:14:43.262679+0000","last_became_peered":"2024-01-21T21:14:43.262679+0000","last_unstale":"2024-01-21T21:14:43.270818+0000","last_undegraded":"2024-01-21T21:14:43.270818+0000","last_fullsized":"2024-01-21T21:14:43.270818+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253456+0000","last_change":"2024-01-21T21:14:42.887590+0000","last_active":"2024-01-21T21:14:43.253456+0000","last_peered":"2024-01-21T21:14:43.253456+0000","last_clean":"2024-01-21T21:14:43.253456+0000","last_became_active":"2024-01-21T21:14:42.887286+0000","last_became_peered":"2024-01-21T21:14:42.887286+0000","last_unstale":"2024-01-21T21:14:43.253456+0000","last_undegraded":"2024-01-21T21:14:43.253456+0000","last_fullsized":"2024-01-21T21:14:43.253456+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261292+0000","last_change":"2024-01-21T21:14:43.257873+0000","last_active":"2024-01-21T21:14:43.261292+0000","last_peered":"2024-01-21T21:14:43.261292+0000","last_clean":"2024-01-21T21:14:43.261292+0000","last_became_active":"2024-01-21T21:14:43.257205+0000","last_became_peered":"2024-01-21T21:14:43.257205+0000","last_unstale":"2024-01-21T21:14:43.261292+0000","last_undegraded":"2024-01-21T21:14:43.261292+0000","last_fullsized":"2024-01-21T21:14:43.261292+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.252060+0000","last_change":"2024-01-21T21:14:42.890929+0000","last_active":"2024-01-21T21:14:43.252060+0000","last_peered":"2024-01-21T21:14:43.252060+0000","last_clean":"2024-01-21T21:14:43.252060+0000","last_became_active":"2024-01-21T21:14:42.890659+0000","last_became_peered":"2024-01-21T21:14:42.890659+0000","last_unstale":"2024-01-21T21:14:43.252060+0000","last_undegraded":"2024-01-21T21:14:43.252060+0000","last_fullsized":"2024-01-21T21:14:43.252060+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279708+0000","last_change":"2024-01-21T21:14:43.276657+0000","last_active":"2024-01-21T21:14:43.279708+0000","last_peered":"2024-01-21T21:14:43.279708+0000","last_clean":"2024-01-21T21:14:43.279708+0000","last_became_active":"2024-01-21T21:14:43.276380+0000","last_became_peered":"2024-01-21T21:14:43.276380+0000","last_unstale":"2024-01-21T21:14:43.279708+0000","last_undegraded":"2024-01-21T21:14:43.279708+0000","last_fullsized":"2024-01-21T21:14:43.279708+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258483+0000","last_change":"2024-01-21T21:14:42.899105+0000","last_active":"2024-01-21T21:14:43.258483+0000","last_peered":"2024-01-21T21:14:43.258483+0000","last_clean":"2024-01-21T21:14:43.258483+0000","last_became_active":"2024-01-21T21:14:42.898832+0000","last_became_peered":"2024-01-21T21:14:42.898832+0000","last_unstale":"2024-01-21T21:14:43.258483+0000","last_undegraded":"2024-01-21T21:14:43.258483+0000","last_fullsized":"2024-01-21T21:14:43.258483+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274876+0000","last_change":"2024-01-21T21:14:43.272805+0000","last_active":"2024-01-21T21:14:43.274876+0000","last_peered":"2024-01-21T21:14:43.274876+0000","last_clean":"2024-01-21T21:14:43.274876+0000","last_became_active":"2024-01-21T21:14:43.271730+0000","last_became_peered":"2024-01-21T21:14:43.271730+0000","last_unstale":"2024-01-21T21:14:43.274876+0000","last_undegraded":"2024-01-21T21:14:43.274876+0000","last_fullsized":"2024-01-21T21:14:43.274876+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260707+0000","last_change":"2024-01-21T21:14:42.899375+0000","last_active":"2024-01-21T21:14:43.260707+0000","last_peered":"2024-01-21T21:14:43.260707+0000","last_clean":"2024-01-21T21:14:43.260707+0000","last_became_active":"2024-01-21T21:14:42.899150+0000","last_became_peered":"2024-01-21T21:14:42.899150+0000","last_unstale":"2024-01-21T21:14:43.260707+0000","last_undegraded":"2024-01-21T21:14:43.260707+0000","last_fullsized":"2024-01-21T21:14:43.260707+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277902+0000","last_change":"2024-01-21T21:14:43.277022+0000","last_active":"2024-01-21T21:14:43.277902+0000","last_peered":"2024-01-21T21:14:43.277902+0000","last_clean":"2024-01-21T21:14:43.277902+0000","last_became_active":"2024-01-21T21:14:43.276772+0000","last_became_peered":"2024-01-21T21:14:43.276772+0000","last_unstale":"2024-01-21T21:14:43.277902+0000","last_undegraded":"2024-01-21T21:14:43.277902+0000","last_fullsized":"2024-01-21T21:14:43.277902+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265656+0000","last_change":"2024-01-21T21:14:42.898028+0000","last_active":"2024-01-21T21:14:43.265656+0000","last_peered":"2024-01-21T21:14:43.265656+0000","last_clean":"2024-01-21T21:14:43.265656+0000","last_became_active":"2024-01-21T21:14:42.897633+0000","last_became_peered":"2024-01-21T21:14:42.897633+0000","last_unstale":"2024-01-21T21:14:43.265656+0000","last_undegraded":"2024-01-21T21:14:43.265656+0000","last_fullsized":"2024-01-21T21:14:43.265656+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280638+0000","last_change":"2024-01-21T21:14:43.280234+0000","last_active":"2024-01-21T21:14:43.280638+0000","last_peered":"2024-01-21T21:14:43.280638+0000","last_clean":"2024-01-21T21:14:43.280638+0000","last_became_active":"2024-01-21T21:14:43.280014+0000","last_became_peered":"2024-01-21T21:14:43.280014+0000","last_unstale":"2024-01-21T21:14:43.280638+0000","last_undegraded":"2024-01-21T21:14:43.280638+0000","last_fullsized":"2024-01-21T21:14:43.280638+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268843+0000","last_change":"2024-01-21T21:14:42.886103+0000","last_active":"2024-01-21T21:14:43.268843+0000","last_peered":"2024-01-21T21:14:43.268843+0000","last_clean":"2024-01-21T21:14:43.268843+0000","last_became_active":"2024-01-21T21:14:42.885830+0000","last_became_peered":"2024-01-21T21:14:42.885830+0000","last_unstale":"2024-01-21T21:14:43.268843+0000","last_undegraded":"2024-01-21T21:14:43.268843+0000","last_fullsized":"2024-01-21T21:14:43.268843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275164+0000","last_change":"2024-01-21T21:14:43.273977+0000","last_active":"2024-01-21T21:14:43.275164+0000","last_peered":"2024-01-21T21:14:43.275164+0000","last_clean":"2024-01-21T21:14:43.275164+0000","last_became_active":"2024-01-21T21:14:43.271943+0000","last_became_peered":"2024-01-21T21:14:43.271943+0000","last_unstale":"2024-01-21T21:14:43.275164+0000","last_undegraded":"2024-01-21T21:14:43.275164+0000","last_fullsized":"2024-01-21T21:14:43.275164+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258768+0000","last_change":"2024-01-21T21:14:42.898493+0000","last_active":"2024-01-21T21:14:43.258768+0000","last_peered":"2024-01-21T21:14:43.258768+0000","last_clean":"2024-01-21T21:14:43.258768+0000","last_became_active":"2024-01-21T21:14:42.898204+0000","last_became_peered":"2024-01-21T21:14:42.898204+0000","last_unstale":"2024-01-21T21:14:43.258768+0000","last_undegraded":"2024-01-21T21:14:43.258768+0000","last_fullsized":"2024-01-21T21:14:43.258768+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266806+0000","last_change":"2024-01-21T21:14:43.264094+0000","last_active":"2024-01-21T21:14:43.266806+0000","last_peered":"2024-01-21T21:14:43.266806+0000","last_clean":"2024-01-21T21:14:43.266806+0000","last_became_active":"2024-01-21T21:14:43.263806+0000","last_became_peered":"2024-01-21T21:14:43.263806+0000","last_unstale":"2024-01-21T21:14:43.266806+0000","last_undegraded":"2024-01-21T21:14:43.266806+0000","last_fullsized":"2024-01-21T21:14:43.266806+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253460+0000","last_change":"2024-01-21T21:14:42.890084+0000","last_active":"2024-01-21T21:14:43.253460+0000","last_peered":"2024-01-21T21:14:43.253460+0000","last_clean":"2024-01-21T21:14:43.253460+0000","last_became_active":"2024-01-21T21:14:42.889782+0000","last_became_peered":"2024-01-21T21:14:42.889782+0000","last_unstale":"2024-01-21T21:14:43.253460+0000","last_undegraded":"2024-01-21T21:14:43.253460+0000","last_fullsized":"2024-01-21T21:14:43.253460+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271053+0000","last_change":"2024-01-21T21:14:43.269068+0000","last_active":"2024-01-21T21:14:43.271053+0000","last_peered":"2024-01-21T21:14:43.271053+0000","last_clean":"2024-01-21T21:14:43.271053+0000","last_became_active":"2024-01-21T21:14:43.268782+0000","last_became_peered":"2024-01-21T21:14:43.268782+0000","last_unstale":"2024-01-21T21:14:43.271053+0000","last_undegraded":"2024-01-21T21:14:43.271053+0000","last_fullsized":"2024-01-21T21:14:43.271053+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270931+0000","last_change":"2024-01-21T21:14:42.892407+0000","last_active":"2024-01-21T21:14:43.270931+0000","last_peered":"2024-01-21T21:14:43.270931+0000","last_clean":"2024-01-21T21:14:43.270931+0000","last_became_active":"2024-01-21T21:14:42.892140+0000","last_became_peered":"2024-01-21T21:14:42.892140+0000","last_unstale":"2024-01-21T21:14:43.270931+0000","last_undegraded":"2024-01-21T21:14:43.270931+0000","last_fullsized":"2024-01-21T21:14:43.270931+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277388+0000","last_change":"2024-01-21T21:14:43.276303+0000","last_active":"2024-01-21T21:14:43.277388+0000","last_peered":"2024-01-21T21:14:43.277388+0000","last_clean":"2024-01-21T21:14:43.277388+0000","last_became_active":"2024-01-21T21:14:43.276017+0000","last_became_peered":"2024-01-21T21:14:43.276017+0000","last_unstale":"2024-01-21T21:14:43.277388+0000","last_undegraded":"2024-01-21T21:14:43.277388+0000","last_fullsized":"2024-01-21T21:14:43.277388+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255801+0000","last_change":"2024-01-21T21:14:42.892707+0000","last_active":"2024-01-21T21:14:43.255801+0000","last_peered":"2024-01-21T21:14:43.255801+0000","last_clean":"2024-01-21T21:14:43.255801+0000","last_became_active":"2024-01-21T21:14:42.892244+0000","last_became_peered":"2024-01-21T21:14:42.892244+0000","last_unstale":"2024-01-21T21:14:43.255801+0000","last_undegraded":"2024-01-21T21:14:43.255801+0000","last_fullsized":"2024-01-21T21:14:43.255801+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279725+0000","last_change":"2024-01-21T21:14:43.276723+0000","last_active":"2024-01-21T21:14:43.279725+0000","last_peered":"2024-01-21T21:14:43.279725+0000","last_clean":"2024-01-21T21:14:43.279725+0000","last_became_active":"2024-01-21T21:14:43.276432+0000","last_became_peered":"2024-01-21T21:14:43.276432+0000","last_unstale":"2024-01-21T21:14:43.279725+0000","last_undegraded":"2024-01-21T21:14:43.279725+0000","last_fullsized":"2024-01-21T21:14:43.279725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268979+0000","last_change":"2024-01-21T21:14:42.891250+0000","last_active":"2024-01-21T21:14:43.268979+0000","last_peered":"2024-01-21T21:14:43.268979+0000","last_clean":"2024-01-21T21:14:43.268979+0000","last_became_active":"2024-01-21T21:14:42.890768+0000","last_became_peered":"2024-01-21T21:14:42.890768+0000","last_unstale":"2024-01-21T21:14:43.268979+0000","last_undegraded":"2024-01-21T21:14:43.268979+0000","last_fullsized":"2024-01-21T21:14:43.268979+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.269936+0000","last_change":"2024-01-21T21:14:43.266222+0000","last_active":"2024-01-21T21:14:43.269936+0000","last_peered":"2024-01-21T21:14:43.269936+0000","last_clean":"2024-01-21T21:14:43.269936+0000","last_became_active":"2024-01-21T21:14:43.265934+0000","last_became_peered":"2024-01-21T21:14:43.265934+0000","last_unstale":"2024-01-21T21:14:43.269936+0000","last_undegraded":"2024-01-21T21:14:43.269936+0000","last_fullsized":"2024-01-21T21:14:43.269936+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258553+0000","last_change":"2024-01-21T21:14:42.896924+0000","last_active":"2024-01-21T21:14:43.258553+0000","last_peered":"2024-01-21T21:14:43.258553+0000","last_clean":"2024-01-21T21:14:43.258553+0000","last_became_active":"2024-01-21T21:14:42.895843+0000","last_became_peered":"2024-01-21T21:14:42.895843+0000","last_unstale":"2024-01-21T21:14:43.258553+0000","last_undegraded":"2024-01-21T21:14:43.258553+0000","last_fullsized":"2024-01-21T21:14:43.258553+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280176+0000","last_change":"2024-01-21T21:14:43.277564+0000","last_active":"2024-01-21T21:14:43.280176+0000","last_peered":"2024-01-21T21:14:43.280176+0000","last_clean":"2024-01-21T21:14:43.280176+0000","last_became_active":"2024-01-21T21:14:43.276149+0000","last_became_peered":"2024-01-21T21:14:43.276149+0000","last_unstale":"2024-01-21T21:14:43.280176+0000","last_undegraded":"2024-01-21T21:14:43.280176+0000","last_fullsized":"2024-01-21T21:14:43.280176+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271275+0000","last_change":"2024-01-21T21:14:42.890450+0000","last_active":"2024-01-21T21:14:43.271275+0000","last_peered":"2024-01-21T21:14:43.271275+0000","last_clean":"2024-01-21T21:14:43.271275+0000","last_became_active":"2024-01-21T21:14:42.890188+0000","last_became_peered":"2024-01-21T21:14:42.890188+0000","last_unstale":"2024-01-21T21:14:43.271275+0000","last_undegraded":"2024-01-21T21:14:43.271275+0000","last_fullsized":"2024-01-21T21:14:43.271275+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270655+0000","last_change":"2024-01-21T21:14:43.262830+0000","last_active":"2024-01-21T21:14:43.270655+0000","last_peered":"2024-01-21T21:14:43.270655+0000","last_clean":"2024-01-21T21:14:43.270655+0000","last_became_active":"2024-01-21T21:14:43.262214+0000","last_became_peered":"2024-01-21T21:14:43.262214+0000","last_unstale":"2024-01-21T21:14:43.270655+0000","last_undegraded":"2024-01-21T21:14:43.270655+0000","last_fullsized":"2024-01-21T21:14:43.270655+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253922+0000","last_change":"2024-01-21T21:14:42.895754+0000","last_active":"2024-01-21T21:14:43.253922+0000","last_peered":"2024-01-21T21:14:43.253922+0000","last_clean":"2024-01-21T21:14:43.253922+0000","last_became_active":"2024-01-21T21:14:42.895322+0000","last_became_peered":"2024-01-21T21:14:42.895322+0000","last_unstale":"2024-01-21T21:14:43.253922+0000","last_undegraded":"2024-01-21T21:14:43.253922+0000","last_fullsized":"2024-01-21T21:14:43.253922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274815+0000","last_change":"2024-01-21T21:14:43.272778+0000","last_active":"2024-01-21T21:14:43.274815+0000","last_peered":"2024-01-21T21:14:43.274815+0000","last_clean":"2024-01-21T21:14:43.274815+0000","last_became_active":"2024-01-21T21:14:43.271801+0000","last_became_peered":"2024-01-21T21:14:43.271801+0000","last_unstale":"2024-01-21T21:14:43.274815+0000","last_undegraded":"2024-01-21T21:14:43.274815+0000","last_fullsized":"2024-01-21T21:14:43.274815+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253635+0000","last_change":"2024-01-21T21:14:42.887130+0000","last_active":"2024-01-21T21:14:43.253635+0000","last_peered":"2024-01-21T21:14:43.253635+0000","last_clean":"2024-01-21T21:14:43.253635+0000","last_became_active":"2024-01-21T21:14:42.886927+0000","last_became_peered":"2024-01-21T21:14:42.886927+0000","last_unstale":"2024-01-21T21:14:43.253635+0000","last_undegraded":"2024-01-21T21:14:43.253635+0000","last_fullsized":"2024-01-21T21:14:43.253635+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260863+0000","last_change":"2024-01-21T21:14:43.254409+0000","last_active":"2024-01-21T21:14:43.260863+0000","last_peered":"2024-01-21T21:14:43.260863+0000","last_clean":"2024-01-21T21:14:43.260863+0000","last_became_active":"2024-01-21T21:14:43.254132+0000","last_became_peered":"2024-01-21T21:14:43.254132+0000","last_unstale":"2024-01-21T21:14:43.260863+0000","last_undegraded":"2024-01-21T21:14:43.260863+0000","last_fullsized":"2024-01-21T21:14:43.260863+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258221+0000","last_change":"2024-01-21T21:14:42.892178+0000","last_active":"2024-01-21T21:14:43.258221+0000","last_peered":"2024-01-21T21:14:43.258221+0000","last_clean":"2024-01-21T21:14:43.258221+0000","last_became_active":"2024-01-21T21:14:42.891911+0000","last_became_peered":"2024-01-21T21:14:42.891911+0000","last_unstale":"2024-01-21T21:14:43.258221+0000","last_undegraded":"2024-01-21T21:14:43.258221+0000","last_fullsized":"2024-01-21T21:14:43.258221+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.269314+0000","last_change":"2024-01-21T21:14:43.267451+0000","last_active":"2024-01-21T21:14:43.269314+0000","last_peered":"2024-01-21T21:14:43.269314+0000","last_clean":"2024-01-21T21:14:43.269314+0000","last_became_active":"2024-01-21T21:14:43.265437+0000","last_became_peered":"2024-01-21T21:14:43.265437+0000","last_unstale":"2024-01-21T21:14:43.269314+0000","last_undegraded":"2024-01-21T21:14:43.269314+0000","last_fullsized":"2024-01-21T21:14:43.269314+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.251625+0000","last_change":"2024-01-21T21:14:42.890365+0000","last_active":"2024-01-21T21:14:43.251625+0000","last_peered":"2024-01-21T21:14:43.251625+0000","last_clean":"2024-01-21T21:14:43.251625+0000","last_became_active":"2024-01-21T21:14:42.890074+0000","last_became_peered":"2024-01-21T21:14:42.890074+0000","last_unstale":"2024-01-21T21:14:43.251625+0000","last_undegraded":"2024-01-21T21:14:43.251625+0000","last_fullsized":"2024-01-21T21:14:43.251625+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266756+0000","last_change":"2024-01-21T21:14:43.262260+0000","last_active":"2024-01-21T21:14:43.266756+0000","last_peered":"2024-01-21T21:14:43.266756+0000","last_clean":"2024-01-21T21:14:43.266756+0000","last_became_active":"2024-01-21T21:14:43.261994+0000","last_became_peered":"2024-01-21T21:14:43.261994+0000","last_unstale":"2024-01-21T21:14:43.266756+0000","last_undegraded":"2024-01-21T21:14:43.266756+0000","last_fullsized":"2024-01-21T21:14:43.266756+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265031+0000","last_change":"2024-01-21T21:14:42.893032+0000","last_active":"2024-01-21T21:14:43.265031+0000","last_peered":"2024-01-21T21:14:43.265031+0000","last_clean":"2024-01-21T21:14:43.265031+0000","last_became_active":"2024-01-21T21:14:42.892639+0000","last_became_peered":"2024-01-21T21:14:42.892639+0000","last_unstale":"2024-01-21T21:14:43.265031+0000","last_undegraded":"2024-01-21T21:14:43.265031+0000","last_fullsized":"2024-01-21T21:14:43.265031+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270686+0000","last_change":"2024-01-21T21:14:43.269863+0000","last_active":"2024-01-21T21:14:43.270686+0000","last_peered":"2024-01-21T21:14:43.270686+0000","last_clean":"2024-01-21T21:14:43.270686+0000","last_became_active":"2024-01-21T21:14:43.269593+0000","last_became_peered":"2024-01-21T21:14:43.269593+0000","last_unstale":"2024-01-21T21:14:43.270686+0000","last_undegraded":"2024-01-21T21:14:43.270686+0000","last_fullsized":"2024-01-21T21:14:43.270686+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258572+0000","last_change":"2024-01-21T21:14:42.897275+0000","last_active":"2024-01-21T21:14:43.258572+0000","last_peered":"2024-01-21T21:14:43.258572+0000","last_clean":"2024-01-21T21:14:43.258572+0000","last_became_active":"2024-01-21T21:14:42.896628+0000","last_became_peered":"2024-01-21T21:14:42.896628+0000","last_unstale":"2024-01-21T21:14:43.258572+0000","last_undegraded":"2024-01-21T21:14:43.258572+0000","last_fullsized":"2024-01-21T21:14:43.258572+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274756+0000","last_change":"2024-01-21T21:14:43.272527+0000","last_active":"2024-01-21T21:14:43.274756+0000","last_peered":"2024-01-21T21:14:43.274756+0000","last_clean":"2024-01-21T21:14:43.274756+0000","last_became_active":"2024-01-21T21:14:43.271602+0000","last_became_peered":"2024-01-21T21:14:43.271602+0000","last_unstale":"2024-01-21T21:14:43.274756+0000","last_undegraded":"2024-01-21T21:14:43.274756+0000","last_fullsized":"2024-01-21T21:14:43.274756+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.256191+0000","last_change":"2024-01-21T21:14:42.892782+0000","last_active":"2024-01-21T21:14:43.256191+0000","last_peered":"2024-01-21T21:14:43.256191+0000","last_clean":"2024-01-21T21:14:43.256191+0000","last_became_active":"2024-01-21T21:14:42.892495+0000","last_became_peered":"2024-01-21T21:14:42.892495+0000","last_unstale":"2024-01-21T21:14:43.256191+0000","last_undegraded":"2024-01-21T21:14:43.256191+0000","last_fullsized":"2024-01-21T21:14:43.256191+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271105+0000","last_change":"2024-01-21T21:14:43.267592+0000","last_active":"2024-01-21T21:14:43.271105+0000","last_peered":"2024-01-21T21:14:43.271105+0000","last_clean":"2024-01-21T21:14:43.271105+0000","last_became_active":"2024-01-21T21:14:43.266390+0000","last_became_peered":"2024-01-21T21:14:43.266390+0000","last_unstale":"2024-01-21T21:14:43.271105+0000","last_undegraded":"2024-01-21T21:14:43.271105+0000","last_fullsized":"2024-01-21T21:14:43.271105+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"159'3","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.273790+0000","last_change":"2024-01-21T21:14:42.890202+0000","last_active":"2024-01-21T21:14:43.273790+0000","last_peered":"2024-01-21T21:14:43.273790+0000","last_clean":"2024-01-21T21:14:43.273790+0000","last_became_active":"2024-01-21T21:14:42.889904+0000","last_became_peered":"2024-01-21T21:14:42.889904+0000","last_unstale":"2024-01-21T21:14:43.273790+0000","last_undegraded":"2024-01-21T21:14:43.273790+0000","last_fullsized":"2024-01-21T21:14:43.273790+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258285+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:14:43.258285+0000","last_peered":"2024-01-21T21:14:43.258285+0000","last_clean":"2024-01-21T21:14:43.258285+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:14:43.258285+0000","last_undegraded":"2024-01-21T21:14:43.258285+0000","last_fullsized":"2024-01-21T21:14:43.258285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266121+0000","last_change":"2024-01-21T21:14:43.264505+0000","last_active":"2024-01-21T21:14:43.266121+0000","last_peered":"2024-01-21T21:14:43.266121+0000","last_clean":"2024-01-21T21:14:43.266121+0000","last_became_active":"2024-01-21T21:14:43.264014+0000","last_became_peered":"2024-01-21T21:14:43.264014+0000","last_unstale":"2024-01-21T21:14:43.266121+0000","last_undegraded":"2024-01-21T21:14:43.266121+0000","last_fullsized":"2024-01-21T21:14:43.266121+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.267079+0000","last_change":"2024-01-21T21:14:42.892193+0000","last_active":"2024-01-21T21:14:43.267079+0000","last_peered":"2024-01-21T21:14:43.267079+0000","last_clean":"2024-01-21T21:14:43.267079+0000","last_became_active":"2024-01-21T21:14:42.891405+0000","last_became_peered":"2024-01-21T21:14:42.891405+0000","last_unstale":"2024-01-21T21:14:43.267079+0000","last_undegraded":"2024-01-21T21:14:43.267079+0000","last_fullsized":"2024-01-21T21:14:43.267079+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.250472+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:14:43.250472+0000","last_peered":"2024-01-21T21:14:43.250472+0000","last_clean":"2024-01-21T21:14:43.250472+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:14:43.250472+0000","last_undegraded":"2024-01-21T21:14:43.250472+0000","last_fullsized":"2024-01-21T21:14:43.250472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271934+0000","last_change":"2024-01-21T21:14:43.270193+0000","last_active":"2024-01-21T21:14:43.271934+0000","last_peered":"2024-01-21T21:14:43.271934+0000","last_clean":"2024-01-21T21:14:43.271934+0000","last_became_active":"2024-01-21T21:14:43.269930+0000","last_became_peered":"2024-01-21T21:14:43.269930+0000","last_unstale":"2024-01-21T21:14:43.271934+0000","last_undegraded":"2024-01-21T21:14:43.271934+0000","last_fullsized":"2024-01-21T21:14:43.271934+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271771+0000","last_change":"2024-01-21T21:14:42.897283+0000","last_active":"2024-01-21T21:14:43.271771+0000","last_peered":"2024-01-21T21:14:43.271771+0000","last_clean":"2024-01-21T21:14:43.271771+0000","last_became_active":"2024-01-21T21:14:42.896603+0000","last_became_peered":"2024-01-21T21:14:42.896603+0000","last_unstale":"2024-01-21T21:14:43.271771+0000","last_undegraded":"2024-01-21T21:14:43.271771+0000","last_fullsized":"2024-01-21T21:14:43.271771+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260297+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:14:43.260297+0000","last_peered":"2024-01-21T21:14:43.260297+0000","last_clean":"2024-01-21T21:14:43.260297+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:14:43.260297+0000","last_undegraded":"2024-01-21T21:14:43.260297+0000","last_fullsized":"2024-01-21T21:14:43.260297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277897+0000","last_change":"2024-01-21T21:14:43.276874+0000","last_active":"2024-01-21T21:14:43.277897+0000","last_peered":"2024-01-21T21:14:43.277897+0000","last_clean":"2024-01-21T21:14:43.277897+0000","last_became_active":"2024-01-21T21:14:43.276598+0000","last_became_peered":"2024-01-21T21:14:43.276598+0000","last_unstale":"2024-01-21T21:14:43.277897+0000","last_undegraded":"2024-01-21T21:14:43.277897+0000","last_fullsized":"2024-01-21T21:14:43.277897+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264925+0000","last_change":"2024-01-21T21:14:42.892056+0000","last_active":"2024-01-21T21:14:43.264925+0000","last_peered":"2024-01-21T21:14:43.264925+0000","last_clean":"2024-01-21T21:14:43.264925+0000","last_became_active":"2024-01-21T21:14:42.891715+0000","last_became_peered":"2024-01-21T21:14:42.891715+0000","last_unstale":"2024-01-21T21:14:43.264925+0000","last_undegraded":"2024-01-21T21:14:43.264925+0000","last_fullsized":"2024-01-21T21:14:43.264925+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.251713+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:14:43.251713+0000","last_peered":"2024-01-21T21:14:43.251713+0000","last_clean":"2024-01-21T21:14:43.251713+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:14:43.251713+0000","last_undegraded":"2024-01-21T21:14:43.251713+0000","last_fullsized":"2024-01-21T21:14:43.251713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":132,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263345+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:14:43.263345+0000","last_peered":"2024-01-21T21:14:43.263345+0000","last_clean":"2024-01-21T21:14:43.263345+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:14:43.263345+0000","last_undegraded":"2024-01-21T21:14:43.263345+0000","last_fullsized":"2024-01-21T21:14:43.263345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274858+0000","last_change":"2024-01-21T21:14:43.272830+0000","last_active":"2024-01-21T21:14:43.274858+0000","last_peered":"2024-01-21T21:14:43.274858+0000","last_clean":"2024-01-21T21:14:43.274858+0000","last_became_active":"2024-01-21T21:14:43.272418+0000","last_became_peered":"2024-01-21T21:14:43.272418+0000","last_unstale":"2024-01-21T21:14:43.274858+0000","last_undegraded":"2024-01-21T21:14:43.274858+0000","last_fullsized":"2024-01-21T21:14:43.274858+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258806+0000","last_change":"2024-01-21T21:14:42.898029+0000","last_active":"2024-01-21T21:14:43.258806+0000","last_peered":"2024-01-21T21:14:43.258806+0000","last_clean":"2024-01-21T21:14:43.258806+0000","last_became_active":"2024-01-21T21:14:42.897376+0000","last_became_peered":"2024-01-21T21:14:42.897376+0000","last_unstale":"2024-01-21T21:14:43.258806+0000","last_undegraded":"2024-01-21T21:14:43.258806+0000","last_fullsized":"2024-01-21T21:14:43.258806+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263452+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:14:43.263452+0000","last_peered":"2024-01-21T21:14:43.263452+0000","last_clean":"2024-01-21T21:14:43.263452+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:14:43.263452+0000","last_undegraded":"2024-01-21T21:14:43.263452+0000","last_fullsized":"2024-01-21T21:14:43.263452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.272318+0000","last_change":"2024-01-21T21:14:43.268303+0000","last_active":"2024-01-21T21:14:43.272318+0000","last_peered":"2024-01-21T21:14:43.272318+0000","last_clean":"2024-01-21T21:14:43.272318+0000","last_became_active":"2024-01-21T21:14:43.268012+0000","last_became_peered":"2024-01-21T21:14:43.268012+0000","last_unstale":"2024-01-21T21:14:43.272318+0000","last_undegraded":"2024-01-21T21:14:43.272318+0000","last_fullsized":"2024-01-21T21:14:43.272318+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276502+0000","last_change":"2024-01-21T21:14:42.893806+0000","last_active":"2024-01-21T21:14:43.276502+0000","last_peered":"2024-01-21T21:14:43.276502+0000","last_clean":"2024-01-21T21:14:43.276502+0000","last_became_active":"2024-01-21T21:14:42.893442+0000","last_became_peered":"2024-01-21T21:14:42.893442+0000","last_unstale":"2024-01-21T21:14:43.276502+0000","last_undegraded":"2024-01-21T21:14:43.276502+0000","last_fullsized":"2024-01-21T21:14:43.276502+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264407+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:14:43.264407+0000","last_peered":"2024-01-21T21:14:43.264407+0000","last_clean":"2024-01-21T21:14:43.264407+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:14:43.264407+0000","last_undegraded":"2024-01-21T21:14:43.264407+0000","last_fullsized":"2024-01-21T21:14:43.264407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275930+0000","last_change":"2024-01-21T21:14:43.265492+0000","last_active":"2024-01-21T21:14:43.275930+0000","last_peered":"2024-01-21T21:14:43.275930+0000","last_clean":"2024-01-21T21:14:43.275930+0000","last_became_active":"2024-01-21T21:14:43.265228+0000","last_became_peered":"2024-01-21T21:14:43.265228+0000","last_unstale":"2024-01-21T21:14:43.275930+0000","last_undegraded":"2024-01-21T21:14:43.275930+0000","last_fullsized":"2024-01-21T21:14:43.275930+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.252625+0000","last_change":"2024-01-21T21:14:42.899486+0000","last_active":"2024-01-21T21:14:43.252625+0000","last_peered":"2024-01-21T21:14:43.252625+0000","last_clean":"2024-01-21T21:14:43.252625+0000","last_became_active":"2024-01-21T21:14:42.899167+0000","last_became_peered":"2024-01-21T21:14:42.899167+0000","last_unstale":"2024-01-21T21:14:43.252625+0000","last_undegraded":"2024-01-21T21:14:43.252625+0000","last_fullsized":"2024-01-21T21:14:43.252625+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258756+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:14:43.258756+0000","last_peered":"2024-01-21T21:14:43.258756+0000","last_clean":"2024-01-21T21:14:43.258756+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:14:43.258756+0000","last_undegraded":"2024-01-21T21:14:43.258756+0000","last_fullsized":"2024-01-21T21:14:43.258756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268017+0000","last_change":"2024-01-21T21:14:43.263007+0000","last_active":"2024-01-21T21:14:43.268017+0000","last_peered":"2024-01-21T21:14:43.268017+0000","last_clean":"2024-01-21T21:14:43.268017+0000","last_became_active":"2024-01-21T21:14:43.262098+0000","last_became_peered":"2024-01-21T21:14:43.262098+0000","last_unstale":"2024-01-21T21:14:43.268017+0000","last_undegraded":"2024-01-21T21:14:43.268017+0000","last_fullsized":"2024-01-21T21:14:43.268017+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255457+0000","last_change":"2024-01-21T21:14:42.893736+0000","last_active":"2024-01-21T21:14:43.255457+0000","last_peered":"2024-01-21T21:14:43.255457+0000","last_clean":"2024-01-21T21:14:43.255457+0000","last_became_active":"2024-01-21T21:14:42.889276+0000","last_became_peered":"2024-01-21T21:14:42.889276+0000","last_unstale":"2024-01-21T21:14:43.255457+0000","last_undegraded":"2024-01-21T21:14:43.255457+0000","last_fullsized":"2024-01-21T21:14:43.255457+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259853+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:14:43.259853+0000","last_peered":"2024-01-21T21:14:43.259853+0000","last_clean":"2024-01-21T21:14:43.259853+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:14:43.259853+0000","last_undegraded":"2024-01-21T21:14:43.259853+0000","last_fullsized":"2024-01-21T21:14:43.259853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575751,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1062468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.315},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.875},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":0.82199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":0.85399999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.35199999999999998},"max":{"1min":0.75,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.495},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.32200000000000001},"max":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575753,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1990656,"data_stored":1062695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.29599999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.309}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.34300000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.498}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575752,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303144,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068696,"statfs":{"total":96636764160,"available":96326344704,"internally_reserved":0,"allocated":1998848,"data_stored":1061860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.315},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.628}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575752,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.63100000000000001,"15min":0.64600000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.67400000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":0.58299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.749},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.92000000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.018},"last":0.85899999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.95999999999999996,"15min":0.999},"last":0.878},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.879,"5min":0.96399999999999997,"15min":1.079},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":1.044,"15min":1.044},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575752,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.308}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.53000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575752,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.495},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311336,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060504,"statfs":{"total":96636764160,"available":96317956096,"internally_reserved":0,"allocated":1998848,"data_stored":1063609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.627},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:14:48.861 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:14:48.859+0000 7f02d054d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:14:50.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:14:50.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.804+0000 7f1cb5a26700 1 Processor -- start 2024-01-21T21:14:50.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.804+0000 7f1cb5a26700 1 -- start start 2024-01-21T21:14:50.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cb5a26700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1cb00c3c20 0x7f1cb013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cb5a26700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb00c64d0 con 0x7f1cb013a9e0 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cb5a26700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb0067f10 con 0x7f1cb00c3840 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cb5a26700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb00681f0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1cb00c3c20 0x7f1cb013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1cb00c3c20 0x7f1cb013a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46674/0 (socket says 172.21.15.133:46674) 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1caf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1cb013a9e0 0x7f1cb00bdf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43272/0 (socket says 172.21.15.133:43272) 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 -- 172.21.15.133:0/3880397715 learned_addr learned my addr 172.21.15.133:0/3880397715 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 -- 172.21.15.133:0/3880397715 >> v1:172.21.15.178:6789/0 conn(0x7f1cb00c3840 legacy=0x7f1cb00c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 -- 172.21.15.133:0/3880397715 >> v1:172.21.15.133:6789/0 conn(0x7f1cb013a9e0 legacy=0x7f1cb00bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 -- 172.21.15.133:0/3880397715 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb00684d0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cadffb700 1 -- 172.21.15.133:0/3880397715 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971328164 0 0) 0x7f1ca8001490 con 0x7f1cb013a9e0 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cae7fc700 1 --2- 172.21.15.133:0/3880397715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb013a4f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f1ca4006fd0 tx=0x7f1ca40090f0).ready entity=mon.0 client_cookie=75a1b1d2bebe20e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cadffb700 1 -- 172.21.15.133:0/3880397715 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400b600 con 0x7f1cb00c3c20 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cadffb700 1 -- 172.21.15.133:0/3880397715 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca400b760 con 0x7f1cb00c3c20 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.805+0000 7f1cadffb700 1 -- 172.21.15.133:0/3880397715 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400bb00 con 0x7f1cb00c3c20 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 -- 172.21.15.133:0/3880397715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 msgr2=0x7f1cb013a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/3880397715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb013a4f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f1ca4006fd0 tx=0x7f1ca40090f0).stop 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 -- 172.21.15.133:0/3880397715 shutdown_connections 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/3880397715 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb013a4f0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 -- 172.21.15.133:0/3880397715 >> 172.21.15.133:0/3880397715 conn(0x7f1cb0066a70 msgr2=0x7f1cb0066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 -- 172.21.15.133:0/3880397715 shutdown_connections 2024-01-21T21:14:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.806+0000 7f1cb5a26700 1 -- 172.21.15.133:0/3880397715 wait complete. 2024-01-21T21:14:50.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.807+0000 7f1cb5a26700 1 Processor -- start 2024-01-21T21:14:50.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.807+0000 7f1cb5a26700 1 -- start start 2024-01-21T21:14:50.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cb00c3840 0x7f1cb0164640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 0x7f1cb0136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00aebf0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00adfe0 con 0x7f1cb013a9e0 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cb5a26700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00ae2c0 con 0x7f1cb00c3840 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46688/0 (socket says 172.21.15.133:46688) 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 -- 172.21.15.133:0/1428129103 learned_addr learned my addr 172.21.15.133:0/1428129103 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1caf7fe700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 0x7f1cb0136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1caeffd700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cb00c3840 0x7f1cb0164640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 -- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cb00c3840 msgr2=0x7f1cb0164640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cb00c3840 0x7f1cb0164640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 -- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 msgr2=0x7f1cb0136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.808+0000 7f1cae7fc700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 0x7f1cb0136240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1cae7fc700 1 -- 172.21.15.133:0/1428129103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4009370 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1caf7fe700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 0x7f1cb0136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1cae7fc700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f1ca4009f50 tx=0x7f1ca4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca40069b0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca400b8d0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb00ae5a0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca401c420 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.809+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb00adb80 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.810+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb00aed60 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.810+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1ca401c7d0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.811+0000 7f1c977fe700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 0x7f1c9c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.811+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1ca407c1f0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.811+0000 7f1caeffd700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 0x7f1c9c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:50.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.811+0000 7f1caeffd700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 0x7f1c9c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1cb0162260 tx=0x7f1ca0008040).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:50.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.815+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1ca404d1d0 con 0x7f1cb00c3c20 2024-01-21T21:14:50.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.982+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1cb0068ec0 con 0x7f1c9c05f150 2024-01-21T21:14:50.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.992+0000 7f1c977fe700 1 -- 172.21.15.133:0/1428129103 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361899 (secure 0 0 0) 0x7f1cb0068ec0 con 0x7f1c9c05f150 2024-01-21T21:14:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 msgr2=0x7f1c9c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 0x7f1c9c061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1cb0162260 tx=0x7f1ca0008040).stop 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 msgr2=0x7f1cb00ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f1ca4009f50 tx=0x7f1ca4017000).stop 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 shutdown_connections 2024-01-21T21:14:51.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f1c9c05f150 0x7f1c9c061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cb013a9e0 0x7f1cb0136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cb00c3840 0x7f1cb0164640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 --2- 172.21.15.133:0/1428129103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cb00c3c20 0x7f1cb00ad690 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 >> 172.21.15.133:0/1428129103 conn(0x7f1cb0066a70 msgr2=0x7f1cb00c7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 shutdown_connections 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:50.996+0000 7f1cb5a26700 1 -- 172.21.15.133:0/1428129103 wait complete. 2024-01-21T21:14:51.002 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:14:51.009 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-01-21T21:14:49.555703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":239,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453816,"kb_used_data":15608,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752520904,"statfs":{"total":773094113280,"available":770581405696,"internally_reserved":0,"allocated":15982592,"data_stored":8504250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5035530,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-522,"num_write_kb":-5311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":-554,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.325143"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258686+0000","last_change":"2024-01-21T21:14:43.256284+0000","last_active":"2024-01-21T21:14:43.258686+0000","last_peered":"2024-01-21T21:14:43.258686+0000","last_clean":"2024-01-21T21:14:43.258686+0000","last_became_active":"2024-01-21T21:14:43.255974+0000","last_became_peered":"2024-01-21T21:14:43.255974+0000","last_unstale":"2024-01-21T21:14:43.258686+0000","last_undegraded":"2024-01-21T21:14:43.258686+0000","last_fullsized":"2024-01-21T21:14:43.258686+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3f","version":"159'3","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263848+0000","last_change":"2024-01-21T21:14:42.887349+0000","last_active":"2024-01-21T21:14:43.263848+0000","last_peered":"2024-01-21T21:14:43.263848+0000","last_clean":"2024-01-21T21:14:43.263848+0000","last_became_active":"2024-01-21T21:14:42.887092+0000","last_became_peered":"2024-01-21T21:14:42.887092+0000","last_unstale":"2024-01-21T21:14:43.263848+0000","last_undegraded":"2024-01-21T21:14:43.263848+0000","last_fullsized":"2024-01-21T21:14:43.263848+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275195+0000","last_change":"2024-01-21T21:14:43.274368+0000","last_active":"2024-01-21T21:14:43.275195+0000","last_peered":"2024-01-21T21:14:43.275195+0000","last_clean":"2024-01-21T21:14:43.275195+0000","last_became_active":"2024-01-21T21:14:43.274073+0000","last_became_peered":"2024-01-21T21:14:43.274073+0000","last_unstale":"2024-01-21T21:14:43.275195+0000","last_undegraded":"2024-01-21T21:14:43.275195+0000","last_fullsized":"2024-01-21T21:14:43.275195+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258456+0000","last_change":"2024-01-21T21:14:42.892056+0000","last_active":"2024-01-21T21:14:43.258456+0000","last_peered":"2024-01-21T21:14:43.258456+0000","last_clean":"2024-01-21T21:14:43.258456+0000","last_became_active":"2024-01-21T21:14:42.891773+0000","last_became_peered":"2024-01-21T21:14:42.891773+0000","last_unstale":"2024-01-21T21:14:43.258456+0000","last_undegraded":"2024-01-21T21:14:43.258456+0000","last_fullsized":"2024-01-21T21:14:43.258456+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265170+0000","last_change":"2024-01-21T21:14:43.262703+0000","last_active":"2024-01-21T21:14:43.265170+0000","last_peered":"2024-01-21T21:14:43.265170+0000","last_clean":"2024-01-21T21:14:43.265170+0000","last_became_active":"2024-01-21T21:14:43.262461+0000","last_became_peered":"2024-01-21T21:14:43.262461+0000","last_unstale":"2024-01-21T21:14:43.265170+0000","last_undegraded":"2024-01-21T21:14:43.265170+0000","last_fullsized":"2024-01-21T21:14:43.265170+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259620+0000","last_change":"2024-01-21T21:14:42.890627+0000","last_active":"2024-01-21T21:14:43.259620+0000","last_peered":"2024-01-21T21:14:43.259620+0000","last_clean":"2024-01-21T21:14:43.259620+0000","last_became_active":"2024-01-21T21:14:42.890367+0000","last_became_peered":"2024-01-21T21:14:42.890367+0000","last_unstale":"2024-01-21T21:14:43.259620+0000","last_undegraded":"2024-01-21T21:14:43.259620+0000","last_fullsized":"2024-01-21T21:14:43.259620+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271082+0000","last_change":"2024-01-21T21:14:43.269125+0000","last_active":"2024-01-21T21:14:43.271082+0000","last_peered":"2024-01-21T21:14:43.271082+0000","last_clean":"2024-01-21T21:14:43.271082+0000","last_became_active":"2024-01-21T21:14:43.268866+0000","last_became_peered":"2024-01-21T21:14:43.268866+0000","last_unstale":"2024-01-21T21:14:43.271082+0000","last_undegraded":"2024-01-21T21:14:43.271082+0000","last_fullsized":"2024-01-21T21:14:43.271082+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276854+0000","last_change":"2024-01-21T21:14:42.885529+0000","last_active":"2024-01-21T21:14:43.276854+0000","last_peered":"2024-01-21T21:14:43.276854+0000","last_clean":"2024-01-21T21:14:43.276854+0000","last_became_active":"2024-01-21T21:14:42.885254+0000","last_became_peered":"2024-01-21T21:14:42.885254+0000","last_unstale":"2024-01-21T21:14:43.276854+0000","last_undegraded":"2024-01-21T21:14:43.276854+0000","last_fullsized":"2024-01-21T21:14:43.276854+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.254062+0000","last_change":"2024-01-21T21:14:43.253234+0000","last_active":"2024-01-21T21:14:43.254062+0000","last_peered":"2024-01-21T21:14:43.254062+0000","last_clean":"2024-01-21T21:14:43.254062+0000","last_became_active":"2024-01-21T21:14:43.252832+0000","last_became_peered":"2024-01-21T21:14:43.252832+0000","last_unstale":"2024-01-21T21:14:43.254062+0000","last_undegraded":"2024-01-21T21:14:43.254062+0000","last_fullsized":"2024-01-21T21:14:43.254062+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271500+0000","last_change":"2024-01-21T21:14:42.890050+0000","last_active":"2024-01-21T21:14:43.271500+0000","last_peered":"2024-01-21T21:14:43.271500+0000","last_clean":"2024-01-21T21:14:43.271500+0000","last_became_active":"2024-01-21T21:14:42.889548+0000","last_became_peered":"2024-01-21T21:14:42.889548+0000","last_unstale":"2024-01-21T21:14:43.271500+0000","last_undegraded":"2024-01-21T21:14:43.271500+0000","last_fullsized":"2024-01-21T21:14:43.271500+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.278261+0000","last_change":"2024-01-21T21:14:43.277266+0000","last_active":"2024-01-21T21:14:43.278261+0000","last_peered":"2024-01-21T21:14:43.278261+0000","last_clean":"2024-01-21T21:14:43.278261+0000","last_became_active":"2024-01-21T21:14:43.276968+0000","last_became_peered":"2024-01-21T21:14:43.276968+0000","last_unstale":"2024-01-21T21:14:43.278261+0000","last_undegraded":"2024-01-21T21:14:43.278261+0000","last_fullsized":"2024-01-21T21:14:43.278261+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3a","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276097+0000","last_change":"2024-01-21T21:14:42.886759+0000","last_active":"2024-01-21T21:14:43.276097+0000","last_peered":"2024-01-21T21:14:43.276097+0000","last_clean":"2024-01-21T21:14:43.276097+0000","last_became_active":"2024-01-21T21:14:42.886507+0000","last_became_peered":"2024-01-21T21:14:42.886507+0000","last_unstale":"2024-01-21T21:14:43.276097+0000","last_undegraded":"2024-01-21T21:14:43.276097+0000","last_fullsized":"2024-01-21T21:14:43.276097+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260314+0000","last_change":"2024-01-21T21:14:43.254765+0000","last_active":"2024-01-21T21:14:43.260314+0000","last_peered":"2024-01-21T21:14:43.260314+0000","last_clean":"2024-01-21T21:14:43.260314+0000","last_became_active":"2024-01-21T21:14:43.254478+0000","last_became_peered":"2024-01-21T21:14:43.254478+0000","last_unstale":"2024-01-21T21:14:43.260314+0000","last_undegraded":"2024-01-21T21:14:43.260314+0000","last_fullsized":"2024-01-21T21:14:43.260314+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253160+0000","last_change":"2024-01-21T21:14:42.891850+0000","last_active":"2024-01-21T21:14:43.253160+0000","last_peered":"2024-01-21T21:14:43.253160+0000","last_clean":"2024-01-21T21:14:43.253160+0000","last_became_active":"2024-01-21T21:14:42.891587+0000","last_became_peered":"2024-01-21T21:14:42.891587+0000","last_unstale":"2024-01-21T21:14:43.253160+0000","last_undegraded":"2024-01-21T21:14:43.253160+0000","last_fullsized":"2024-01-21T21:14:43.253160+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275880+0000","last_change":"2024-01-21T21:14:43.263267+0000","last_active":"2024-01-21T21:14:43.275880+0000","last_peered":"2024-01-21T21:14:43.275880+0000","last_clean":"2024-01-21T21:14:43.275880+0000","last_became_active":"2024-01-21T21:14:43.262989+0000","last_became_peered":"2024-01-21T21:14:43.262989+0000","last_unstale":"2024-01-21T21:14:43.275880+0000","last_undegraded":"2024-01-21T21:14:43.275880+0000","last_fullsized":"2024-01-21T21:14:43.275880+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260569+0000","last_change":"2024-01-21T21:14:42.899695+0000","last_active":"2024-01-21T21:14:43.260569+0000","last_peered":"2024-01-21T21:14:43.260569+0000","last_clean":"2024-01-21T21:14:43.260569+0000","last_became_active":"2024-01-21T21:14:42.899329+0000","last_became_peered":"2024-01-21T21:14:42.899329+0000","last_unstale":"2024-01-21T21:14:43.260569+0000","last_undegraded":"2024-01-21T21:14:43.260569+0000","last_fullsized":"2024-01-21T21:14:43.260569+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271320+0000","last_change":"2024-01-21T21:14:43.270338+0000","last_active":"2024-01-21T21:14:43.271320+0000","last_peered":"2024-01-21T21:14:43.271320+0000","last_clean":"2024-01-21T21:14:43.271320+0000","last_became_active":"2024-01-21T21:14:43.270069+0000","last_became_peered":"2024-01-21T21:14:43.270069+0000","last_unstale":"2024-01-21T21:14:43.271320+0000","last_undegraded":"2024-01-21T21:14:43.271320+0000","last_fullsized":"2024-01-21T21:14:43.271320+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259667+0000","last_change":"2024-01-21T21:14:42.897684+0000","last_active":"2024-01-21T21:14:43.259667+0000","last_peered":"2024-01-21T21:14:43.259667+0000","last_clean":"2024-01-21T21:14:43.259667+0000","last_became_active":"2024-01-21T21:14:42.897399+0000","last_became_peered":"2024-01-21T21:14:42.897399+0000","last_unstale":"2024-01-21T21:14:43.259667+0000","last_undegraded":"2024-01-21T21:14:43.259667+0000","last_fullsized":"2024-01-21T21:14:43.259667+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277414+0000","last_change":"2024-01-21T21:14:43.276365+0000","last_active":"2024-01-21T21:14:43.277414+0000","last_peered":"2024-01-21T21:14:43.277414+0000","last_clean":"2024-01-21T21:14:43.277414+0000","last_became_active":"2024-01-21T21:14:43.276111+0000","last_became_peered":"2024-01-21T21:14:43.276111+0000","last_unstale":"2024-01-21T21:14:43.277414+0000","last_undegraded":"2024-01-21T21:14:43.277414+0000","last_fullsized":"2024-01-21T21:14:43.277414+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258553+0000","last_change":"2024-01-21T21:14:42.891619+0000","last_active":"2024-01-21T21:14:43.258553+0000","last_peered":"2024-01-21T21:14:43.258553+0000","last_clean":"2024-01-21T21:14:43.258553+0000","last_became_active":"2024-01-21T21:14:42.891355+0000","last_became_peered":"2024-01-21T21:14:42.891355+0000","last_unstale":"2024-01-21T21:14:43.258553+0000","last_undegraded":"2024-01-21T21:14:43.258553+0000","last_fullsized":"2024-01-21T21:14:43.258553+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279867+0000","last_change":"2024-01-21T21:14:43.276657+0000","last_active":"2024-01-21T21:14:43.279867+0000","last_peered":"2024-01-21T21:14:43.279867+0000","last_clean":"2024-01-21T21:14:43.279867+0000","last_became_active":"2024-01-21T21:14:43.276338+0000","last_became_peered":"2024-01-21T21:14:43.276338+0000","last_unstale":"2024-01-21T21:14:43.279867+0000","last_undegraded":"2024-01-21T21:14:43.279867+0000","last_fullsized":"2024-01-21T21:14:43.279867+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.249577+0000","last_change":"2024-01-21T21:14:42.892990+0000","last_active":"2024-01-21T21:14:43.249577+0000","last_peered":"2024-01-21T21:14:43.249577+0000","last_clean":"2024-01-21T21:14:43.249577+0000","last_became_active":"2024-01-21T21:14:42.892718+0000","last_became_peered":"2024-01-21T21:14:42.892718+0000","last_unstale":"2024-01-21T21:14:43.249577+0000","last_undegraded":"2024-01-21T21:14:43.249577+0000","last_fullsized":"2024-01-21T21:14:43.249577+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268059+0000","last_change":"2024-01-21T21:14:43.263159+0000","last_active":"2024-01-21T21:14:43.268059+0000","last_peered":"2024-01-21T21:14:43.268059+0000","last_clean":"2024-01-21T21:14:43.268059+0000","last_became_active":"2024-01-21T21:14:43.262823+0000","last_became_peered":"2024-01-21T21:14:43.262823+0000","last_unstale":"2024-01-21T21:14:43.268059+0000","last_undegraded":"2024-01-21T21:14:43.268059+0000","last_fullsized":"2024-01-21T21:14:43.268059+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.34","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274973+0000","last_change":"2024-01-21T21:14:42.895671+0000","last_active":"2024-01-21T21:14:43.274973+0000","last_peered":"2024-01-21T21:14:43.274973+0000","last_clean":"2024-01-21T21:14:43.274973+0000","last_became_active":"2024-01-21T21:14:42.895409+0000","last_became_peered":"2024-01-21T21:14:42.895409+0000","last_unstale":"2024-01-21T21:14:43.274973+0000","last_undegraded":"2024-01-21T21:14:43.274973+0000","last_fullsized":"2024-01-21T21:14:43.274973+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280337+0000","last_change":"2024-01-21T21:14:43.277512+0000","last_active":"2024-01-21T21:14:43.280337+0000","last_peered":"2024-01-21T21:14:43.280337+0000","last_clean":"2024-01-21T21:14:43.280337+0000","last_became_active":"2024-01-21T21:14:43.277227+0000","last_became_peered":"2024-01-21T21:14:43.277227+0000","last_unstale":"2024-01-21T21:14:43.280337+0000","last_undegraded":"2024-01-21T21:14:43.280337+0000","last_fullsized":"2024-01-21T21:14:43.280337+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.33","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264280+0000","last_change":"2024-01-21T21:14:42.892402+0000","last_active":"2024-01-21T21:14:43.264280+0000","last_peered":"2024-01-21T21:14:43.264280+0000","last_clean":"2024-01-21T21:14:43.264280+0000","last_became_active":"2024-01-21T21:14:42.891951+0000","last_became_peered":"2024-01-21T21:14:42.891951+0000","last_unstale":"2024-01-21T21:14:43.264280+0000","last_undegraded":"2024-01-21T21:14:43.264280+0000","last_fullsized":"2024-01-21T21:14:43.264280+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270948+0000","last_change":"2024-01-21T21:14:43.267005+0000","last_active":"2024-01-21T21:14:43.270948+0000","last_peered":"2024-01-21T21:14:43.270948+0000","last_clean":"2024-01-21T21:14:43.270948+0000","last_became_active":"2024-01-21T21:14:43.266543+0000","last_became_peered":"2024-01-21T21:14:43.266543+0000","last_unstale":"2024-01-21T21:14:43.270948+0000","last_undegraded":"2024-01-21T21:14:43.270948+0000","last_fullsized":"2024-01-21T21:14:43.270948+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258303+0000","last_change":"2024-01-21T21:14:42.896305+0000","last_active":"2024-01-21T21:14:43.258303+0000","last_peered":"2024-01-21T21:14:43.258303+0000","last_clean":"2024-01-21T21:14:43.258303+0000","last_became_active":"2024-01-21T21:14:42.895983+0000","last_became_peered":"2024-01-21T21:14:42.895983+0000","last_unstale":"2024-01-21T21:14:43.258303+0000","last_undegraded":"2024-01-21T21:14:43.258303+0000","last_fullsized":"2024-01-21T21:14:43.258303+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261011+0000","last_change":"2024-01-21T21:14:43.258006+0000","last_active":"2024-01-21T21:14:43.261011+0000","last_peered":"2024-01-21T21:14:43.261011+0000","last_clean":"2024-01-21T21:14:43.261011+0000","last_became_active":"2024-01-21T21:14:43.257752+0000","last_became_peered":"2024-01-21T21:14:43.257752+0000","last_unstale":"2024-01-21T21:14:43.261011+0000","last_undegraded":"2024-01-21T21:14:43.261011+0000","last_fullsized":"2024-01-21T21:14:43.261011+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260219+0000","last_change":"2024-01-21T21:14:42.893560+0000","last_active":"2024-01-21T21:14:43.260219+0000","last_peered":"2024-01-21T21:14:43.260219+0000","last_clean":"2024-01-21T21:14:43.260219+0000","last_became_active":"2024-01-21T21:14:42.892823+0000","last_became_peered":"2024-01-21T21:14:42.892823+0000","last_unstale":"2024-01-21T21:14:43.260219+0000","last_undegraded":"2024-01-21T21:14:43.260219+0000","last_fullsized":"2024-01-21T21:14:43.260219+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.267751+0000","last_change":"2024-01-21T21:14:43.262616+0000","last_active":"2024-01-21T21:14:43.267751+0000","last_peered":"2024-01-21T21:14:43.267751+0000","last_clean":"2024-01-21T21:14:43.267751+0000","last_became_active":"2024-01-21T21:14:43.262364+0000","last_became_peered":"2024-01-21T21:14:43.262364+0000","last_unstale":"2024-01-21T21:14:43.267751+0000","last_undegraded":"2024-01-21T21:14:43.267751+0000","last_fullsized":"2024-01-21T21:14:43.267751+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.30","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277920+0000","last_change":"2024-01-21T21:14:42.889690+0000","last_active":"2024-01-21T21:14:43.277920+0000","last_peered":"2024-01-21T21:14:43.277920+0000","last_clean":"2024-01-21T21:14:43.277920+0000","last_became_active":"2024-01-21T21:14:42.889425+0000","last_became_peered":"2024-01-21T21:14:42.889425+0000","last_unstale":"2024-01-21T21:14:43.277920+0000","last_undegraded":"2024-01-21T21:14:43.277920+0000","last_fullsized":"2024-01-21T21:14:43.277920+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268929+0000","last_change":"2024-01-21T21:14:43.264829+0000","last_active":"2024-01-21T21:14:43.268929+0000","last_peered":"2024-01-21T21:14:43.268929+0000","last_clean":"2024-01-21T21:14:43.268929+0000","last_became_active":"2024-01-21T21:14:43.264403+0000","last_became_peered":"2024-01-21T21:14:43.264403+0000","last_unstale":"2024-01-21T21:14:43.268929+0000","last_undegraded":"2024-01-21T21:14:43.268929+0000","last_fullsized":"2024-01-21T21:14:43.268929+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253589+0000","last_change":"2024-01-21T21:14:42.885487+0000","last_active":"2024-01-21T21:14:43.253589+0000","last_peered":"2024-01-21T21:14:43.253589+0000","last_clean":"2024-01-21T21:14:43.253589+0000","last_became_active":"2024-01-21T21:14:42.885202+0000","last_became_peered":"2024-01-21T21:14:42.885202+0000","last_unstale":"2024-01-21T21:14:43.253589+0000","last_undegraded":"2024-01-21T21:14:43.253589+0000","last_fullsized":"2024-01-21T21:14:43.253589+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271649+0000","last_change":"2024-01-21T21:14:43.269828+0000","last_active":"2024-01-21T21:14:43.271649+0000","last_peered":"2024-01-21T21:14:43.271649+0000","last_clean":"2024-01-21T21:14:43.271649+0000","last_became_active":"2024-01-21T21:14:43.269556+0000","last_became_peered":"2024-01-21T21:14:43.269556+0000","last_unstale":"2024-01-21T21:14:43.271649+0000","last_undegraded":"2024-01-21T21:14:43.271649+0000","last_fullsized":"2024-01-21T21:14:43.271649+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266296+0000","last_change":"2024-01-21T21:14:42.889934+0000","last_active":"2024-01-21T21:14:43.266296+0000","last_peered":"2024-01-21T21:14:43.266296+0000","last_clean":"2024-01-21T21:14:43.266296+0000","last_became_active":"2024-01-21T21:14:42.889448+0000","last_became_peered":"2024-01-21T21:14:42.889448+0000","last_unstale":"2024-01-21T21:14:43.266296+0000","last_undegraded":"2024-01-21T21:14:43.266296+0000","last_fullsized":"2024-01-21T21:14:43.266296+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265272+0000","last_change":"2024-01-21T21:14:43.261503+0000","last_active":"2024-01-21T21:14:43.265272+0000","last_peered":"2024-01-21T21:14:43.265272+0000","last_clean":"2024-01-21T21:14:43.265272+0000","last_became_active":"2024-01-21T21:14:43.261201+0000","last_became_peered":"2024-01-21T21:14:43.261201+0000","last_unstale":"2024-01-21T21:14:43.265272+0000","last_undegraded":"2024-01-21T21:14:43.265272+0000","last_fullsized":"2024-01-21T21:14:43.265272+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.2d","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261769+0000","last_change":"2024-01-21T21:14:42.887319+0000","last_active":"2024-01-21T21:14:43.261769+0000","last_peered":"2024-01-21T21:14:43.261769+0000","last_clean":"2024-01-21T21:14:43.261769+0000","last_became_active":"2024-01-21T21:14:42.887063+0000","last_became_peered":"2024-01-21T21:14:42.887063+0000","last_unstale":"2024-01-21T21:14:43.261769+0000","last_undegraded":"2024-01-21T21:14:43.261769+0000","last_fullsized":"2024-01-21T21:14:43.261769+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264800+0000","last_change":"2024-01-21T21:14:43.263225+0000","last_active":"2024-01-21T21:14:43.264800+0000","last_peered":"2024-01-21T21:14:43.264800+0000","last_clean":"2024-01-21T21:14:43.264800+0000","last_became_active":"2024-01-21T21:14:43.262728+0000","last_became_peered":"2024-01-21T21:14:43.262728+0000","last_unstale":"2024-01-21T21:14:43.264800+0000","last_undegraded":"2024-01-21T21:14:43.264800+0000","last_fullsized":"2024-01-21T21:14:43.264800+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253373+0000","last_change":"2024-01-21T21:14:42.895258+0000","last_active":"2024-01-21T21:14:43.253373+0000","last_peered":"2024-01-21T21:14:43.253373+0000","last_clean":"2024-01-21T21:14:43.253373+0000","last_became_active":"2024-01-21T21:14:42.895036+0000","last_became_peered":"2024-01-21T21:14:42.895036+0000","last_unstale":"2024-01-21T21:14:43.253373+0000","last_undegraded":"2024-01-21T21:14:43.253373+0000","last_fullsized":"2024-01-21T21:14:43.253373+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280853+0000","last_change":"2024-01-21T21:14:43.277865+0000","last_active":"2024-01-21T21:14:43.280853+0000","last_peered":"2024-01-21T21:14:43.280853+0000","last_clean":"2024-01-21T21:14:43.280853+0000","last_became_active":"2024-01-21T21:14:43.276736+0000","last_became_peered":"2024-01-21T21:14:43.276736+0000","last_unstale":"2024-01-21T21:14:43.280853+0000","last_undegraded":"2024-01-21T21:14:43.280853+0000","last_fullsized":"2024-01-21T21:14:43.280853+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271720+0000","last_change":"2024-01-21T21:14:42.896718+0000","last_active":"2024-01-21T21:14:43.271720+0000","last_peered":"2024-01-21T21:14:43.271720+0000","last_clean":"2024-01-21T21:14:43.271720+0000","last_became_active":"2024-01-21T21:14:42.896429+0000","last_became_peered":"2024-01-21T21:14:42.896429+0000","last_unstale":"2024-01-21T21:14:43.271720+0000","last_undegraded":"2024-01-21T21:14:43.271720+0000","last_fullsized":"2024-01-21T21:14:43.271720+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275143+0000","last_change":"2024-01-21T21:14:43.273221+0000","last_active":"2024-01-21T21:14:43.275143+0000","last_peered":"2024-01-21T21:14:43.275143+0000","last_clean":"2024-01-21T21:14:43.275143+0000","last_became_active":"2024-01-21T21:14:43.272915+0000","last_became_peered":"2024-01-21T21:14:43.272915+0000","last_unstale":"2024-01-21T21:14:43.275143+0000","last_undegraded":"2024-01-21T21:14:43.275143+0000","last_fullsized":"2024-01-21T21:14:43.275143+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.248911+0000","last_change":"2024-01-21T21:14:42.895468+0000","last_active":"2024-01-21T21:14:43.248911+0000","last_peered":"2024-01-21T21:14:43.248911+0000","last_clean":"2024-01-21T21:14:43.248911+0000","last_became_active":"2024-01-21T21:14:42.895151+0000","last_became_peered":"2024-01-21T21:14:42.895151+0000","last_unstale":"2024-01-21T21:14:43.248911+0000","last_undegraded":"2024-01-21T21:14:43.248911+0000","last_fullsized":"2024-01-21T21:14:43.248911+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271881+0000","last_change":"2024-01-21T21:14:43.269900+0000","last_active":"2024-01-21T21:14:43.271881+0000","last_peered":"2024-01-21T21:14:43.271881+0000","last_clean":"2024-01-21T21:14:43.271881+0000","last_became_active":"2024-01-21T21:14:43.269628+0000","last_became_peered":"2024-01-21T21:14:43.269628+0000","last_unstale":"2024-01-21T21:14:43.271881+0000","last_undegraded":"2024-01-21T21:14:43.271881+0000","last_fullsized":"2024-01-21T21:14:43.271881+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258714+0000","last_change":"2024-01-21T21:14:42.897701+0000","last_active":"2024-01-21T21:14:43.258714+0000","last_peered":"2024-01-21T21:14:43.258714+0000","last_clean":"2024-01-21T21:14:43.258714+0000","last_became_active":"2024-01-21T21:14:42.897432+0000","last_became_peered":"2024-01-21T21:14:42.897432+0000","last_unstale":"2024-01-21T21:14:43.258714+0000","last_undegraded":"2024-01-21T21:14:43.258714+0000","last_fullsized":"2024-01-21T21:14:43.258714+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271367+0000","last_change":"2024-01-21T21:14:43.270480+0000","last_active":"2024-01-21T21:14:43.271367+0000","last_peered":"2024-01-21T21:14:43.271367+0000","last_clean":"2024-01-21T21:14:43.271367+0000","last_became_active":"2024-01-21T21:14:43.270172+0000","last_became_peered":"2024-01-21T21:14:43.270172+0000","last_unstale":"2024-01-21T21:14:43.271367+0000","last_undegraded":"2024-01-21T21:14:43.271367+0000","last_fullsized":"2024-01-21T21:14:43.271367+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.248647+0000","last_change":"2024-01-21T21:14:42.885775+0000","last_active":"2024-01-21T21:14:43.248647+0000","last_peered":"2024-01-21T21:14:43.248647+0000","last_clean":"2024-01-21T21:14:43.248647+0000","last_became_active":"2024-01-21T21:14:42.885533+0000","last_became_peered":"2024-01-21T21:14:42.885533+0000","last_unstale":"2024-01-21T21:14:43.248647+0000","last_undegraded":"2024-01-21T21:14:43.248647+0000","last_fullsized":"2024-01-21T21:14:43.248647+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266152+0000","last_change":"2024-01-21T21:14:43.262497+0000","last_active":"2024-01-21T21:14:43.266152+0000","last_peered":"2024-01-21T21:14:43.266152+0000","last_clean":"2024-01-21T21:14:43.266152+0000","last_became_active":"2024-01-21T21:14:43.262232+0000","last_became_peered":"2024-01-21T21:14:43.262232+0000","last_unstale":"2024-01-21T21:14:43.266152+0000","last_undegraded":"2024-01-21T21:14:43.266152+0000","last_fullsized":"2024-01-21T21:14:43.266152+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259678+0000","last_change":"2024-01-21T21:14:42.891399+0000","last_active":"2024-01-21T21:14:43.259678+0000","last_peered":"2024-01-21T21:14:43.259678+0000","last_clean":"2024-01-21T21:14:43.259678+0000","last_became_active":"2024-01-21T21:14:42.891049+0000","last_became_peered":"2024-01-21T21:14:42.891049+0000","last_unstale":"2024-01-21T21:14:43.259678+0000","last_undegraded":"2024-01-21T21:14:43.259678+0000","last_fullsized":"2024-01-21T21:14:43.259678+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263123+0000","last_change":"2024-01-21T21:14:43.260912+0000","last_active":"2024-01-21T21:14:43.263123+0000","last_peered":"2024-01-21T21:14:43.263123+0000","last_clean":"2024-01-21T21:14:43.263123+0000","last_became_active":"2024-01-21T21:14:43.260635+0000","last_became_peered":"2024-01-21T21:14:43.260635+0000","last_unstale":"2024-01-21T21:14:43.263123+0000","last_undegraded":"2024-01-21T21:14:43.263123+0000","last_fullsized":"2024-01-21T21:14:43.263123+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266389+0000","last_change":"2024-01-21T21:14:42.890451+0000","last_active":"2024-01-21T21:14:43.266389+0000","last_peered":"2024-01-21T21:14:43.266389+0000","last_clean":"2024-01-21T21:14:43.266389+0000","last_became_active":"2024-01-21T21:14:42.890191+0000","last_became_peered":"2024-01-21T21:14:42.890191+0000","last_unstale":"2024-01-21T21:14:43.266389+0000","last_undegraded":"2024-01-21T21:14:43.266389+0000","last_fullsized":"2024-01-21T21:14:43.266389+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271073+0000","last_change":"2024-01-21T21:14:43.262065+0000","last_active":"2024-01-21T21:14:43.271073+0000","last_peered":"2024-01-21T21:14:43.271073+0000","last_clean":"2024-01-21T21:14:43.271073+0000","last_became_active":"2024-01-21T21:14:43.261783+0000","last_became_peered":"2024-01-21T21:14:43.261783+0000","last_unstale":"2024-01-21T21:14:43.271073+0000","last_undegraded":"2024-01-21T21:14:43.271073+0000","last_fullsized":"2024-01-21T21:14:43.271073+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.257001+0000","last_change":"2024-01-21T21:14:42.886882+0000","last_active":"2024-01-21T21:14:43.257001+0000","last_peered":"2024-01-21T21:14:43.257001+0000","last_clean":"2024-01-21T21:14:43.257001+0000","last_became_active":"2024-01-21T21:14:42.886563+0000","last_became_peered":"2024-01-21T21:14:42.886563+0000","last_unstale":"2024-01-21T21:14:43.257001+0000","last_undegraded":"2024-01-21T21:14:43.257001+0000","last_fullsized":"2024-01-21T21:14:43.257001+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270633+0000","last_change":"2024-01-21T21:14:43.262275+0000","last_active":"2024-01-21T21:14:43.270633+0000","last_peered":"2024-01-21T21:14:43.270633+0000","last_clean":"2024-01-21T21:14:43.270633+0000","last_became_active":"2024-01-21T21:14:43.261995+0000","last_became_peered":"2024-01-21T21:14:43.261995+0000","last_unstale":"2024-01-21T21:14:43.270633+0000","last_undegraded":"2024-01-21T21:14:43.270633+0000","last_fullsized":"2024-01-21T21:14:43.270633+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.250196+0000","last_change":"2024-01-21T21:14:42.898738+0000","last_active":"2024-01-21T21:14:43.250196+0000","last_peered":"2024-01-21T21:14:43.250196+0000","last_clean":"2024-01-21T21:14:43.250196+0000","last_became_active":"2024-01-21T21:14:42.898464+0000","last_became_peered":"2024-01-21T21:14:42.898464+0000","last_unstale":"2024-01-21T21:14:43.250196+0000","last_undegraded":"2024-01-21T21:14:43.250196+0000","last_fullsized":"2024-01-21T21:14:43.250196+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261920+0000","last_change":"2024-01-21T21:14:43.254437+0000","last_active":"2024-01-21T21:14:43.261920+0000","last_peered":"2024-01-21T21:14:43.261920+0000","last_clean":"2024-01-21T21:14:43.261920+0000","last_became_active":"2024-01-21T21:14:43.254209+0000","last_became_peered":"2024-01-21T21:14:43.254209+0000","last_unstale":"2024-01-21T21:14:43.261920+0000","last_undegraded":"2024-01-21T21:14:43.261920+0000","last_fullsized":"2024-01-21T21:14:43.261920+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255601+0000","last_change":"2024-01-21T21:14:42.891615+0000","last_active":"2024-01-21T21:14:43.255601+0000","last_peered":"2024-01-21T21:14:43.255601+0000","last_clean":"2024-01-21T21:14:43.255601+0000","last_became_active":"2024-01-21T21:14:42.890981+0000","last_became_peered":"2024-01-21T21:14:42.890981+0000","last_unstale":"2024-01-21T21:14:43.255601+0000","last_undegraded":"2024-01-21T21:14:43.255601+0000","last_fullsized":"2024-01-21T21:14:43.255601+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274883+0000","last_change":"2024-01-21T21:14:43.272906+0000","last_active":"2024-01-21T21:14:43.274883+0000","last_peered":"2024-01-21T21:14:43.274883+0000","last_clean":"2024-01-21T21:14:43.274883+0000","last_became_active":"2024-01-21T21:14:43.272512+0000","last_became_peered":"2024-01-21T21:14:43.272512+0000","last_unstale":"2024-01-21T21:14:43.274883+0000","last_undegraded":"2024-01-21T21:14:43.274883+0000","last_fullsized":"2024-01-21T21:14:43.274883+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.256907+0000","last_change":"2024-01-21T21:14:42.890184+0000","last_active":"2024-01-21T21:14:43.256907+0000","last_peered":"2024-01-21T21:14:43.256907+0000","last_clean":"2024-01-21T21:14:43.256907+0000","last_became_active":"2024-01-21T21:14:42.889723+0000","last_became_peered":"2024-01-21T21:14:42.889723+0000","last_unstale":"2024-01-21T21:14:43.256907+0000","last_undegraded":"2024-01-21T21:14:43.256907+0000","last_fullsized":"2024-01-21T21:14:43.256907+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.273241+0000","last_change":"2024-01-21T21:14:43.269993+0000","last_active":"2024-01-21T21:14:43.273241+0000","last_peered":"2024-01-21T21:14:43.273241+0000","last_clean":"2024-01-21T21:14:43.273241+0000","last_became_active":"2024-01-21T21:14:43.269714+0000","last_became_peered":"2024-01-21T21:14:43.269714+0000","last_unstale":"2024-01-21T21:14:43.273241+0000","last_undegraded":"2024-01-21T21:14:43.273241+0000","last_fullsized":"2024-01-21T21:14:43.273241+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271051+0000","last_change":"2024-01-21T21:14:42.891059+0000","last_active":"2024-01-21T21:14:43.271051+0000","last_peered":"2024-01-21T21:14:43.271051+0000","last_clean":"2024-01-21T21:14:43.271051+0000","last_became_active":"2024-01-21T21:14:42.890711+0000","last_became_peered":"2024-01-21T21:14:42.890711+0000","last_unstale":"2024-01-21T21:14:43.271051+0000","last_undegraded":"2024-01-21T21:14:43.271051+0000","last_fullsized":"2024-01-21T21:14:43.271051+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270874+0000","last_change":"2024-01-21T21:14:43.262731+0000","last_active":"2024-01-21T21:14:43.270874+0000","last_peered":"2024-01-21T21:14:43.270874+0000","last_clean":"2024-01-21T21:14:43.270874+0000","last_became_active":"2024-01-21T21:14:43.262440+0000","last_became_peered":"2024-01-21T21:14:43.262440+0000","last_unstale":"2024-01-21T21:14:43.270874+0000","last_undegraded":"2024-01-21T21:14:43.270874+0000","last_fullsized":"2024-01-21T21:14:43.270874+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253059+0000","last_change":"2024-01-21T21:14:42.886213+0000","last_active":"2024-01-21T21:14:43.253059+0000","last_peered":"2024-01-21T21:14:43.253059+0000","last_clean":"2024-01-21T21:14:43.253059+0000","last_became_active":"2024-01-21T21:14:42.885772+0000","last_became_peered":"2024-01-21T21:14:42.885772+0000","last_unstale":"2024-01-21T21:14:43.253059+0000","last_undegraded":"2024-01-21T21:14:43.253059+0000","last_fullsized":"2024-01-21T21:14:43.253059+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264404+0000","last_change":"2024-01-21T21:14:43.261696+0000","last_active":"2024-01-21T21:14:43.264404+0000","last_peered":"2024-01-21T21:14:43.264404+0000","last_clean":"2024-01-21T21:14:43.264404+0000","last_became_active":"2024-01-21T21:14:43.261389+0000","last_became_peered":"2024-01-21T21:14:43.261389+0000","last_unstale":"2024-01-21T21:14:43.264404+0000","last_undegraded":"2024-01-21T21:14:43.264404+0000","last_fullsized":"2024-01-21T21:14:43.264404+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270765+0000","last_change":"2024-01-21T21:14:42.889032+0000","last_active":"2024-01-21T21:14:43.270765+0000","last_peered":"2024-01-21T21:14:43.270765+0000","last_clean":"2024-01-21T21:14:43.270765+0000","last_became_active":"2024-01-21T21:14:42.888722+0000","last_became_peered":"2024-01-21T21:14:42.888722+0000","last_unstale":"2024-01-21T21:14:43.270765+0000","last_undegraded":"2024-01-21T21:14:43.270765+0000","last_fullsized":"2024-01-21T21:14:43.270765+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265714+0000","last_change":"2024-01-21T21:14:43.261660+0000","last_active":"2024-01-21T21:14:43.265714+0000","last_peered":"2024-01-21T21:14:43.265714+0000","last_clean":"2024-01-21T21:14:43.265714+0000","last_became_active":"2024-01-21T21:14:43.261336+0000","last_became_peered":"2024-01-21T21:14:43.261336+0000","last_unstale":"2024-01-21T21:14:43.265714+0000","last_undegraded":"2024-01-21T21:14:43.265714+0000","last_fullsized":"2024-01-21T21:14:43.265714+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271412+0000","last_change":"2024-01-21T21:14:42.896395+0000","last_active":"2024-01-21T21:14:43.271412+0000","last_peered":"2024-01-21T21:14:43.271412+0000","last_clean":"2024-01-21T21:14:43.271412+0000","last_became_active":"2024-01-21T21:14:42.895691+0000","last_became_peered":"2024-01-21T21:14:42.895691+0000","last_unstale":"2024-01-21T21:14:43.271412+0000","last_undegraded":"2024-01-21T21:14:43.271412+0000","last_fullsized":"2024-01-21T21:14:43.271412+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271638+0000","last_change":"2024-01-21T21:14:43.269947+0000","last_active":"2024-01-21T21:14:43.271638+0000","last_peered":"2024-01-21T21:14:43.271638+0000","last_clean":"2024-01-21T21:14:43.271638+0000","last_became_active":"2024-01-21T21:14:43.269683+0000","last_became_peered":"2024-01-21T21:14:43.269683+0000","last_unstale":"2024-01-21T21:14:43.271638+0000","last_undegraded":"2024-01-21T21:14:43.271638+0000","last_fullsized":"2024-01-21T21:14:43.271638+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.272740+0000","last_change":"2024-01-21T21:14:42.895653+0000","last_active":"2024-01-21T21:14:43.272740+0000","last_peered":"2024-01-21T21:14:43.272740+0000","last_clean":"2024-01-21T21:14:43.272740+0000","last_became_active":"2024-01-21T21:14:42.895337+0000","last_became_peered":"2024-01-21T21:14:42.895337+0000","last_unstale":"2024-01-21T21:14:43.272740+0000","last_undegraded":"2024-01-21T21:14:43.272740+0000","last_fullsized":"2024-01-21T21:14:43.272740+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276309+0000","last_change":"2024-01-21T21:14:43.269963+0000","last_active":"2024-01-21T21:14:43.276309+0000","last_peered":"2024-01-21T21:14:43.276309+0000","last_clean":"2024-01-21T21:14:43.276309+0000","last_became_active":"2024-01-21T21:14:43.269511+0000","last_became_peered":"2024-01-21T21:14:43.269511+0000","last_unstale":"2024-01-21T21:14:43.276309+0000","last_undegraded":"2024-01-21T21:14:43.276309+0000","last_fullsized":"2024-01-21T21:14:43.276309+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263606+0000","last_change":"2024-01-21T21:14:42.892663+0000","last_active":"2024-01-21T21:14:43.263606+0000","last_peered":"2024-01-21T21:14:43.263606+0000","last_clean":"2024-01-21T21:14:43.263606+0000","last_became_active":"2024-01-21T21:14:42.892381+0000","last_became_peered":"2024-01-21T21:14:42.892381+0000","last_unstale":"2024-01-21T21:14:43.263606+0000","last_undegraded":"2024-01-21T21:14:43.263606+0000","last_fullsized":"2024-01-21T21:14:43.263606+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270818+0000","last_change":"2024-01-21T21:14:43.262952+0000","last_active":"2024-01-21T21:14:43.270818+0000","last_peered":"2024-01-21T21:14:43.270818+0000","last_clean":"2024-01-21T21:14:43.270818+0000","last_became_active":"2024-01-21T21:14:43.262679+0000","last_became_peered":"2024-01-21T21:14:43.262679+0000","last_unstale":"2024-01-21T21:14:43.270818+0000","last_undegraded":"2024-01-21T21:14:43.270818+0000","last_fullsized":"2024-01-21T21:14:43.270818+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253456+0000","last_change":"2024-01-21T21:14:42.887590+0000","last_active":"2024-01-21T21:14:43.253456+0000","last_peered":"2024-01-21T21:14:43.253456+0000","last_clean":"2024-01-21T21:14:43.253456+0000","last_became_active":"2024-01-21T21:14:42.887286+0000","last_became_peered":"2024-01-21T21:14:42.887286+0000","last_unstale":"2024-01-21T21:14:43.253456+0000","last_undegraded":"2024-01-21T21:14:43.253456+0000","last_fullsized":"2024-01-21T21:14:43.253456+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.261292+0000","last_change":"2024-01-21T21:14:43.257873+0000","last_active":"2024-01-21T21:14:43.261292+0000","last_peered":"2024-01-21T21:14:43.261292+0000","last_clean":"2024-01-21T21:14:43.261292+0000","last_became_active":"2024-01-21T21:14:43.257205+0000","last_became_peered":"2024-01-21T21:14:43.257205+0000","last_unstale":"2024-01-21T21:14:43.261292+0000","last_undegraded":"2024-01-21T21:14:43.261292+0000","last_fullsized":"2024-01-21T21:14:43.261292+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.252060+0000","last_change":"2024-01-21T21:14:42.890929+0000","last_active":"2024-01-21T21:14:43.252060+0000","last_peered":"2024-01-21T21:14:43.252060+0000","last_clean":"2024-01-21T21:14:43.252060+0000","last_became_active":"2024-01-21T21:14:42.890659+0000","last_became_peered":"2024-01-21T21:14:42.890659+0000","last_unstale":"2024-01-21T21:14:43.252060+0000","last_undegraded":"2024-01-21T21:14:43.252060+0000","last_fullsized":"2024-01-21T21:14:43.252060+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279708+0000","last_change":"2024-01-21T21:14:43.276657+0000","last_active":"2024-01-21T21:14:43.279708+0000","last_peered":"2024-01-21T21:14:43.279708+0000","last_clean":"2024-01-21T21:14:43.279708+0000","last_became_active":"2024-01-21T21:14:43.276380+0000","last_became_peered":"2024-01-21T21:14:43.276380+0000","last_unstale":"2024-01-21T21:14:43.279708+0000","last_undegraded":"2024-01-21T21:14:43.279708+0000","last_fullsized":"2024-01-21T21:14:43.279708+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258483+0000","last_change":"2024-01-21T21:14:42.899105+0000","last_active":"2024-01-21T21:14:43.258483+0000","last_peered":"2024-01-21T21:14:43.258483+0000","last_clean":"2024-01-21T21:14:43.258483+0000","last_became_active":"2024-01-21T21:14:42.898832+0000","last_became_peered":"2024-01-21T21:14:42.898832+0000","last_unstale":"2024-01-21T21:14:43.258483+0000","last_undegraded":"2024-01-21T21:14:43.258483+0000","last_fullsized":"2024-01-21T21:14:43.258483+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274876+0000","last_change":"2024-01-21T21:14:43.272805+0000","last_active":"2024-01-21T21:14:43.274876+0000","last_peered":"2024-01-21T21:14:43.274876+0000","last_clean":"2024-01-21T21:14:43.274876+0000","last_became_active":"2024-01-21T21:14:43.271730+0000","last_became_peered":"2024-01-21T21:14:43.271730+0000","last_unstale":"2024-01-21T21:14:43.274876+0000","last_undegraded":"2024-01-21T21:14:43.274876+0000","last_fullsized":"2024-01-21T21:14:43.274876+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260707+0000","last_change":"2024-01-21T21:14:42.899375+0000","last_active":"2024-01-21T21:14:43.260707+0000","last_peered":"2024-01-21T21:14:43.260707+0000","last_clean":"2024-01-21T21:14:43.260707+0000","last_became_active":"2024-01-21T21:14:42.899150+0000","last_became_peered":"2024-01-21T21:14:42.899150+0000","last_unstale":"2024-01-21T21:14:43.260707+0000","last_undegraded":"2024-01-21T21:14:43.260707+0000","last_fullsized":"2024-01-21T21:14:43.260707+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277902+0000","last_change":"2024-01-21T21:14:43.277022+0000","last_active":"2024-01-21T21:14:43.277902+0000","last_peered":"2024-01-21T21:14:43.277902+0000","last_clean":"2024-01-21T21:14:43.277902+0000","last_became_active":"2024-01-21T21:14:43.276772+0000","last_became_peered":"2024-01-21T21:14:43.276772+0000","last_unstale":"2024-01-21T21:14:43.277902+0000","last_undegraded":"2024-01-21T21:14:43.277902+0000","last_fullsized":"2024-01-21T21:14:43.277902+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265656+0000","last_change":"2024-01-21T21:14:42.898028+0000","last_active":"2024-01-21T21:14:43.265656+0000","last_peered":"2024-01-21T21:14:43.265656+0000","last_clean":"2024-01-21T21:14:43.265656+0000","last_became_active":"2024-01-21T21:14:42.897633+0000","last_became_peered":"2024-01-21T21:14:42.897633+0000","last_unstale":"2024-01-21T21:14:43.265656+0000","last_undegraded":"2024-01-21T21:14:43.265656+0000","last_fullsized":"2024-01-21T21:14:43.265656+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280638+0000","last_change":"2024-01-21T21:14:43.280234+0000","last_active":"2024-01-21T21:14:43.280638+0000","last_peered":"2024-01-21T21:14:43.280638+0000","last_clean":"2024-01-21T21:14:43.280638+0000","last_became_active":"2024-01-21T21:14:43.280014+0000","last_became_peered":"2024-01-21T21:14:43.280014+0000","last_unstale":"2024-01-21T21:14:43.280638+0000","last_undegraded":"2024-01-21T21:14:43.280638+0000","last_fullsized":"2024-01-21T21:14:43.280638+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268843+0000","last_change":"2024-01-21T21:14:42.886103+0000","last_active":"2024-01-21T21:14:43.268843+0000","last_peered":"2024-01-21T21:14:43.268843+0000","last_clean":"2024-01-21T21:14:43.268843+0000","last_became_active":"2024-01-21T21:14:42.885830+0000","last_became_peered":"2024-01-21T21:14:42.885830+0000","last_unstale":"2024-01-21T21:14:43.268843+0000","last_undegraded":"2024-01-21T21:14:43.268843+0000","last_fullsized":"2024-01-21T21:14:43.268843+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275164+0000","last_change":"2024-01-21T21:14:43.273977+0000","last_active":"2024-01-21T21:14:43.275164+0000","last_peered":"2024-01-21T21:14:43.275164+0000","last_clean":"2024-01-21T21:14:43.275164+0000","last_became_active":"2024-01-21T21:14:43.271943+0000","last_became_peered":"2024-01-21T21:14:43.271943+0000","last_unstale":"2024-01-21T21:14:43.275164+0000","last_undegraded":"2024-01-21T21:14:43.275164+0000","last_fullsized":"2024-01-21T21:14:43.275164+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258768+0000","last_change":"2024-01-21T21:14:42.898493+0000","last_active":"2024-01-21T21:14:43.258768+0000","last_peered":"2024-01-21T21:14:43.258768+0000","last_clean":"2024-01-21T21:14:43.258768+0000","last_became_active":"2024-01-21T21:14:42.898204+0000","last_became_peered":"2024-01-21T21:14:42.898204+0000","last_unstale":"2024-01-21T21:14:43.258768+0000","last_undegraded":"2024-01-21T21:14:43.258768+0000","last_fullsized":"2024-01-21T21:14:43.258768+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266806+0000","last_change":"2024-01-21T21:14:43.264094+0000","last_active":"2024-01-21T21:14:43.266806+0000","last_peered":"2024-01-21T21:14:43.266806+0000","last_clean":"2024-01-21T21:14:43.266806+0000","last_became_active":"2024-01-21T21:14:43.263806+0000","last_became_peered":"2024-01-21T21:14:43.263806+0000","last_unstale":"2024-01-21T21:14:43.266806+0000","last_undegraded":"2024-01-21T21:14:43.266806+0000","last_fullsized":"2024-01-21T21:14:43.266806+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253460+0000","last_change":"2024-01-21T21:14:42.890084+0000","last_active":"2024-01-21T21:14:43.253460+0000","last_peered":"2024-01-21T21:14:43.253460+0000","last_clean":"2024-01-21T21:14:43.253460+0000","last_became_active":"2024-01-21T21:14:42.889782+0000","last_became_peered":"2024-01-21T21:14:42.889782+0000","last_unstale":"2024-01-21T21:14:43.253460+0000","last_undegraded":"2024-01-21T21:14:43.253460+0000","last_fullsized":"2024-01-21T21:14:43.253460+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271053+0000","last_change":"2024-01-21T21:14:43.269068+0000","last_active":"2024-01-21T21:14:43.271053+0000","last_peered":"2024-01-21T21:14:43.271053+0000","last_clean":"2024-01-21T21:14:43.271053+0000","last_became_active":"2024-01-21T21:14:43.268782+0000","last_became_peered":"2024-01-21T21:14:43.268782+0000","last_unstale":"2024-01-21T21:14:43.271053+0000","last_undegraded":"2024-01-21T21:14:43.271053+0000","last_fullsized":"2024-01-21T21:14:43.271053+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270931+0000","last_change":"2024-01-21T21:14:42.892407+0000","last_active":"2024-01-21T21:14:43.270931+0000","last_peered":"2024-01-21T21:14:43.270931+0000","last_clean":"2024-01-21T21:14:43.270931+0000","last_became_active":"2024-01-21T21:14:42.892140+0000","last_became_peered":"2024-01-21T21:14:42.892140+0000","last_unstale":"2024-01-21T21:14:43.270931+0000","last_undegraded":"2024-01-21T21:14:43.270931+0000","last_fullsized":"2024-01-21T21:14:43.270931+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277388+0000","last_change":"2024-01-21T21:14:43.276303+0000","last_active":"2024-01-21T21:14:43.277388+0000","last_peered":"2024-01-21T21:14:43.277388+0000","last_clean":"2024-01-21T21:14:43.277388+0000","last_became_active":"2024-01-21T21:14:43.276017+0000","last_became_peered":"2024-01-21T21:14:43.276017+0000","last_unstale":"2024-01-21T21:14:43.277388+0000","last_undegraded":"2024-01-21T21:14:43.277388+0000","last_fullsized":"2024-01-21T21:14:43.277388+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255801+0000","last_change":"2024-01-21T21:14:42.892707+0000","last_active":"2024-01-21T21:14:43.255801+0000","last_peered":"2024-01-21T21:14:43.255801+0000","last_clean":"2024-01-21T21:14:43.255801+0000","last_became_active":"2024-01-21T21:14:42.892244+0000","last_became_peered":"2024-01-21T21:14:42.892244+0000","last_unstale":"2024-01-21T21:14:43.255801+0000","last_undegraded":"2024-01-21T21:14:43.255801+0000","last_fullsized":"2024-01-21T21:14:43.255801+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.279725+0000","last_change":"2024-01-21T21:14:43.276723+0000","last_active":"2024-01-21T21:14:43.279725+0000","last_peered":"2024-01-21T21:14:43.279725+0000","last_clean":"2024-01-21T21:14:43.279725+0000","last_became_active":"2024-01-21T21:14:43.276432+0000","last_became_peered":"2024-01-21T21:14:43.276432+0000","last_unstale":"2024-01-21T21:14:43.279725+0000","last_undegraded":"2024-01-21T21:14:43.279725+0000","last_fullsized":"2024-01-21T21:14:43.279725+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268979+0000","last_change":"2024-01-21T21:14:42.891250+0000","last_active":"2024-01-21T21:14:43.268979+0000","last_peered":"2024-01-21T21:14:43.268979+0000","last_clean":"2024-01-21T21:14:43.268979+0000","last_became_active":"2024-01-21T21:14:42.890768+0000","last_became_peered":"2024-01-21T21:14:42.890768+0000","last_unstale":"2024-01-21T21:14:43.268979+0000","last_undegraded":"2024-01-21T21:14:43.268979+0000","last_fullsized":"2024-01-21T21:14:43.268979+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.269936+0000","last_change":"2024-01-21T21:14:43.266222+0000","last_active":"2024-01-21T21:14:43.269936+0000","last_peered":"2024-01-21T21:14:43.269936+0000","last_clean":"2024-01-21T21:14:43.269936+0000","last_became_active":"2024-01-21T21:14:43.265934+0000","last_became_peered":"2024-01-21T21:14:43.265934+0000","last_unstale":"2024-01-21T21:14:43.269936+0000","last_undegraded":"2024-01-21T21:14:43.269936+0000","last_fullsized":"2024-01-21T21:14:43.269936+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258553+0000","last_change":"2024-01-21T21:14:42.896924+0000","last_active":"2024-01-21T21:14:43.258553+0000","last_peered":"2024-01-21T21:14:43.258553+0000","last_clean":"2024-01-21T21:14:43.258553+0000","last_became_active":"2024-01-21T21:14:42.895843+0000","last_became_peered":"2024-01-21T21:14:42.895843+0000","last_unstale":"2024-01-21T21:14:43.258553+0000","last_undegraded":"2024-01-21T21:14:43.258553+0000","last_fullsized":"2024-01-21T21:14:43.258553+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.280176+0000","last_change":"2024-01-21T21:14:43.277564+0000","last_active":"2024-01-21T21:14:43.280176+0000","last_peered":"2024-01-21T21:14:43.280176+0000","last_clean":"2024-01-21T21:14:43.280176+0000","last_became_active":"2024-01-21T21:14:43.276149+0000","last_became_peered":"2024-01-21T21:14:43.276149+0000","last_unstale":"2024-01-21T21:14:43.280176+0000","last_undegraded":"2024-01-21T21:14:43.280176+0000","last_fullsized":"2024-01-21T21:14:43.280176+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271275+0000","last_change":"2024-01-21T21:14:42.890450+0000","last_active":"2024-01-21T21:14:43.271275+0000","last_peered":"2024-01-21T21:14:43.271275+0000","last_clean":"2024-01-21T21:14:43.271275+0000","last_became_active":"2024-01-21T21:14:42.890188+0000","last_became_peered":"2024-01-21T21:14:42.890188+0000","last_unstale":"2024-01-21T21:14:43.271275+0000","last_undegraded":"2024-01-21T21:14:43.271275+0000","last_fullsized":"2024-01-21T21:14:43.271275+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270655+0000","last_change":"2024-01-21T21:14:43.262830+0000","last_active":"2024-01-21T21:14:43.270655+0000","last_peered":"2024-01-21T21:14:43.270655+0000","last_clean":"2024-01-21T21:14:43.270655+0000","last_became_active":"2024-01-21T21:14:43.262214+0000","last_became_peered":"2024-01-21T21:14:43.262214+0000","last_unstale":"2024-01-21T21:14:43.270655+0000","last_undegraded":"2024-01-21T21:14:43.270655+0000","last_fullsized":"2024-01-21T21:14:43.270655+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253922+0000","last_change":"2024-01-21T21:14:42.895754+0000","last_active":"2024-01-21T21:14:43.253922+0000","last_peered":"2024-01-21T21:14:43.253922+0000","last_clean":"2024-01-21T21:14:43.253922+0000","last_became_active":"2024-01-21T21:14:42.895322+0000","last_became_peered":"2024-01-21T21:14:42.895322+0000","last_unstale":"2024-01-21T21:14:43.253922+0000","last_undegraded":"2024-01-21T21:14:43.253922+0000","last_fullsized":"2024-01-21T21:14:43.253922+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274815+0000","last_change":"2024-01-21T21:14:43.272778+0000","last_active":"2024-01-21T21:14:43.274815+0000","last_peered":"2024-01-21T21:14:43.274815+0000","last_clean":"2024-01-21T21:14:43.274815+0000","last_became_active":"2024-01-21T21:14:43.271801+0000","last_became_peered":"2024-01-21T21:14:43.271801+0000","last_unstale":"2024-01-21T21:14:43.274815+0000","last_undegraded":"2024-01-21T21:14:43.274815+0000","last_fullsized":"2024-01-21T21:14:43.274815+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.253635+0000","last_change":"2024-01-21T21:14:42.887130+0000","last_active":"2024-01-21T21:14:43.253635+0000","last_peered":"2024-01-21T21:14:43.253635+0000","last_clean":"2024-01-21T21:14:43.253635+0000","last_became_active":"2024-01-21T21:14:42.886927+0000","last_became_peered":"2024-01-21T21:14:42.886927+0000","last_unstale":"2024-01-21T21:14:43.253635+0000","last_undegraded":"2024-01-21T21:14:43.253635+0000","last_fullsized":"2024-01-21T21:14:43.253635+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260863+0000","last_change":"2024-01-21T21:14:43.254409+0000","last_active":"2024-01-21T21:14:43.260863+0000","last_peered":"2024-01-21T21:14:43.260863+0000","last_clean":"2024-01-21T21:14:43.260863+0000","last_became_active":"2024-01-21T21:14:43.254132+0000","last_became_peered":"2024-01-21T21:14:43.254132+0000","last_unstale":"2024-01-21T21:14:43.260863+0000","last_undegraded":"2024-01-21T21:14:43.260863+0000","last_fullsized":"2024-01-21T21:14:43.260863+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258221+0000","last_change":"2024-01-21T21:14:42.892178+0000","last_active":"2024-01-21T21:14:43.258221+0000","last_peered":"2024-01-21T21:14:43.258221+0000","last_clean":"2024-01-21T21:14:43.258221+0000","last_became_active":"2024-01-21T21:14:42.891911+0000","last_became_peered":"2024-01-21T21:14:42.891911+0000","last_unstale":"2024-01-21T21:14:43.258221+0000","last_undegraded":"2024-01-21T21:14:43.258221+0000","last_fullsized":"2024-01-21T21:14:43.258221+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.269314+0000","last_change":"2024-01-21T21:14:43.267451+0000","last_active":"2024-01-21T21:14:43.269314+0000","last_peered":"2024-01-21T21:14:43.269314+0000","last_clean":"2024-01-21T21:14:43.269314+0000","last_became_active":"2024-01-21T21:14:43.265437+0000","last_became_peered":"2024-01-21T21:14:43.265437+0000","last_unstale":"2024-01-21T21:14:43.269314+0000","last_undegraded":"2024-01-21T21:14:43.269314+0000","last_fullsized":"2024-01-21T21:14:43.269314+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.251625+0000","last_change":"2024-01-21T21:14:42.890365+0000","last_active":"2024-01-21T21:14:43.251625+0000","last_peered":"2024-01-21T21:14:43.251625+0000","last_clean":"2024-01-21T21:14:43.251625+0000","last_became_active":"2024-01-21T21:14:42.890074+0000","last_became_peered":"2024-01-21T21:14:42.890074+0000","last_unstale":"2024-01-21T21:14:43.251625+0000","last_undegraded":"2024-01-21T21:14:43.251625+0000","last_fullsized":"2024-01-21T21:14:43.251625+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266756+0000","last_change":"2024-01-21T21:14:43.262260+0000","last_active":"2024-01-21T21:14:43.266756+0000","last_peered":"2024-01-21T21:14:43.266756+0000","last_clean":"2024-01-21T21:14:43.266756+0000","last_became_active":"2024-01-21T21:14:43.261994+0000","last_became_peered":"2024-01-21T21:14:43.261994+0000","last_unstale":"2024-01-21T21:14:43.266756+0000","last_undegraded":"2024-01-21T21:14:43.266756+0000","last_fullsized":"2024-01-21T21:14:43.266756+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.265031+0000","last_change":"2024-01-21T21:14:42.893032+0000","last_active":"2024-01-21T21:14:43.265031+0000","last_peered":"2024-01-21T21:14:43.265031+0000","last_clean":"2024-01-21T21:14:43.265031+0000","last_became_active":"2024-01-21T21:14:42.892639+0000","last_became_peered":"2024-01-21T21:14:42.892639+0000","last_unstale":"2024-01-21T21:14:43.265031+0000","last_undegraded":"2024-01-21T21:14:43.265031+0000","last_fullsized":"2024-01-21T21:14:43.265031+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.270686+0000","last_change":"2024-01-21T21:14:43.269863+0000","last_active":"2024-01-21T21:14:43.270686+0000","last_peered":"2024-01-21T21:14:43.270686+0000","last_clean":"2024-01-21T21:14:43.270686+0000","last_became_active":"2024-01-21T21:14:43.269593+0000","last_became_peered":"2024-01-21T21:14:43.269593+0000","last_unstale":"2024-01-21T21:14:43.270686+0000","last_undegraded":"2024-01-21T21:14:43.270686+0000","last_fullsized":"2024-01-21T21:14:43.270686+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258572+0000","last_change":"2024-01-21T21:14:42.897275+0000","last_active":"2024-01-21T21:14:43.258572+0000","last_peered":"2024-01-21T21:14:43.258572+0000","last_clean":"2024-01-21T21:14:43.258572+0000","last_became_active":"2024-01-21T21:14:42.896628+0000","last_became_peered":"2024-01-21T21:14:42.896628+0000","last_unstale":"2024-01-21T21:14:43.258572+0000","last_undegraded":"2024-01-21T21:14:43.258572+0000","last_fullsized":"2024-01-21T21:14:43.258572+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274756+0000","last_change":"2024-01-21T21:14:43.272527+0000","last_active":"2024-01-21T21:14:43.274756+0000","last_peered":"2024-01-21T21:14:43.274756+0000","last_clean":"2024-01-21T21:14:43.274756+0000","last_became_active":"2024-01-21T21:14:43.271602+0000","last_became_peered":"2024-01-21T21:14:43.271602+0000","last_unstale":"2024-01-21T21:14:43.274756+0000","last_undegraded":"2024-01-21T21:14:43.274756+0000","last_fullsized":"2024-01-21T21:14:43.274756+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.256191+0000","last_change":"2024-01-21T21:14:42.892782+0000","last_active":"2024-01-21T21:14:43.256191+0000","last_peered":"2024-01-21T21:14:43.256191+0000","last_clean":"2024-01-21T21:14:43.256191+0000","last_became_active":"2024-01-21T21:14:42.892495+0000","last_became_peered":"2024-01-21T21:14:42.892495+0000","last_unstale":"2024-01-21T21:14:43.256191+0000","last_undegraded":"2024-01-21T21:14:43.256191+0000","last_fullsized":"2024-01-21T21:14:43.256191+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271105+0000","last_change":"2024-01-21T21:14:43.267592+0000","last_active":"2024-01-21T21:14:43.271105+0000","last_peered":"2024-01-21T21:14:43.271105+0000","last_clean":"2024-01-21T21:14:43.271105+0000","last_became_active":"2024-01-21T21:14:43.266390+0000","last_became_peered":"2024-01-21T21:14:43.266390+0000","last_unstale":"2024-01-21T21:14:43.271105+0000","last_undegraded":"2024-01-21T21:14:43.271105+0000","last_fullsized":"2024-01-21T21:14:43.271105+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"159'3","reported_seq":13,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.273790+0000","last_change":"2024-01-21T21:14:42.890202+0000","last_active":"2024-01-21T21:14:43.273790+0000","last_peered":"2024-01-21T21:14:43.273790+0000","last_clean":"2024-01-21T21:14:43.273790+0000","last_became_active":"2024-01-21T21:14:42.889904+0000","last_became_peered":"2024-01-21T21:14:42.889904+0000","last_unstale":"2024-01-21T21:14:43.273790+0000","last_undegraded":"2024-01-21T21:14:43.273790+0000","last_fullsized":"2024-01-21T21:14:43.273790+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258285+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:14:43.258285+0000","last_peered":"2024-01-21T21:14:43.258285+0000","last_clean":"2024-01-21T21:14:43.258285+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:14:43.258285+0000","last_undegraded":"2024-01-21T21:14:43.258285+0000","last_fullsized":"2024-01-21T21:14:43.258285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.266121+0000","last_change":"2024-01-21T21:14:43.264505+0000","last_active":"2024-01-21T21:14:43.266121+0000","last_peered":"2024-01-21T21:14:43.266121+0000","last_clean":"2024-01-21T21:14:43.266121+0000","last_became_active":"2024-01-21T21:14:43.264014+0000","last_became_peered":"2024-01-21T21:14:43.264014+0000","last_unstale":"2024-01-21T21:14:43.266121+0000","last_undegraded":"2024-01-21T21:14:43.266121+0000","last_fullsized":"2024-01-21T21:14:43.266121+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"159'1","reported_seq":11,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.267079+0000","last_change":"2024-01-21T21:14:42.892193+0000","last_active":"2024-01-21T21:14:43.267079+0000","last_peered":"2024-01-21T21:14:43.267079+0000","last_clean":"2024-01-21T21:14:43.267079+0000","last_became_active":"2024-01-21T21:14:42.891405+0000","last_became_peered":"2024-01-21T21:14:42.891405+0000","last_unstale":"2024-01-21T21:14:43.267079+0000","last_undegraded":"2024-01-21T21:14:43.267079+0000","last_fullsized":"2024-01-21T21:14:43.267079+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.250472+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:14:43.250472+0000","last_peered":"2024-01-21T21:14:43.250472+0000","last_clean":"2024-01-21T21:14:43.250472+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:14:43.250472+0000","last_undegraded":"2024-01-21T21:14:43.250472+0000","last_fullsized":"2024-01-21T21:14:43.250472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271934+0000","last_change":"2024-01-21T21:14:43.270193+0000","last_active":"2024-01-21T21:14:43.271934+0000","last_peered":"2024-01-21T21:14:43.271934+0000","last_clean":"2024-01-21T21:14:43.271934+0000","last_became_active":"2024-01-21T21:14:43.269930+0000","last_became_peered":"2024-01-21T21:14:43.269930+0000","last_unstale":"2024-01-21T21:14:43.271934+0000","last_undegraded":"2024-01-21T21:14:43.271934+0000","last_fullsized":"2024-01-21T21:14:43.271934+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"159'4","reported_seq":14,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.271771+0000","last_change":"2024-01-21T21:14:42.897283+0000","last_active":"2024-01-21T21:14:43.271771+0000","last_peered":"2024-01-21T21:14:43.271771+0000","last_clean":"2024-01-21T21:14:43.271771+0000","last_became_active":"2024-01-21T21:14:42.896603+0000","last_became_peered":"2024-01-21T21:14:42.896603+0000","last_unstale":"2024-01-21T21:14:43.271771+0000","last_undegraded":"2024-01-21T21:14:43.271771+0000","last_fullsized":"2024-01-21T21:14:43.271771+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.260297+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:14:43.260297+0000","last_peered":"2024-01-21T21:14:43.260297+0000","last_clean":"2024-01-21T21:14:43.260297+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:14:43.260297+0000","last_undegraded":"2024-01-21T21:14:43.260297+0000","last_fullsized":"2024-01-21T21:14:43.260297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.277897+0000","last_change":"2024-01-21T21:14:43.276874+0000","last_active":"2024-01-21T21:14:43.277897+0000","last_peered":"2024-01-21T21:14:43.277897+0000","last_clean":"2024-01-21T21:14:43.277897+0000","last_became_active":"2024-01-21T21:14:43.276598+0000","last_became_peered":"2024-01-21T21:14:43.276598+0000","last_unstale":"2024-01-21T21:14:43.277897+0000","last_undegraded":"2024-01-21T21:14:43.277897+0000","last_fullsized":"2024-01-21T21:14:43.277897+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264925+0000","last_change":"2024-01-21T21:14:42.892056+0000","last_active":"2024-01-21T21:14:43.264925+0000","last_peered":"2024-01-21T21:14:43.264925+0000","last_clean":"2024-01-21T21:14:43.264925+0000","last_became_active":"2024-01-21T21:14:42.891715+0000","last_became_peered":"2024-01-21T21:14:42.891715+0000","last_unstale":"2024-01-21T21:14:43.264925+0000","last_undegraded":"2024-01-21T21:14:43.264925+0000","last_fullsized":"2024-01-21T21:14:43.264925+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.251713+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:14:43.251713+0000","last_peered":"2024-01-21T21:14:43.251713+0000","last_clean":"2024-01-21T21:14:43.251713+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:14:43.251713+0000","last_undegraded":"2024-01-21T21:14:43.251713+0000","last_fullsized":"2024-01-21T21:14:43.251713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":132,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263345+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:14:43.263345+0000","last_peered":"2024-01-21T21:14:43.263345+0000","last_clean":"2024-01-21T21:14:43.263345+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:14:43.263345+0000","last_undegraded":"2024-01-21T21:14:43.263345+0000","last_fullsized":"2024-01-21T21:14:43.263345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.274858+0000","last_change":"2024-01-21T21:14:43.272830+0000","last_active":"2024-01-21T21:14:43.274858+0000","last_peered":"2024-01-21T21:14:43.274858+0000","last_clean":"2024-01-21T21:14:43.274858+0000","last_became_active":"2024-01-21T21:14:43.272418+0000","last_became_peered":"2024-01-21T21:14:43.272418+0000","last_unstale":"2024-01-21T21:14:43.274858+0000","last_undegraded":"2024-01-21T21:14:43.274858+0000","last_fullsized":"2024-01-21T21:14:43.274858+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258806+0000","last_change":"2024-01-21T21:14:42.898029+0000","last_active":"2024-01-21T21:14:43.258806+0000","last_peered":"2024-01-21T21:14:43.258806+0000","last_clean":"2024-01-21T21:14:43.258806+0000","last_became_active":"2024-01-21T21:14:42.897376+0000","last_became_peered":"2024-01-21T21:14:42.897376+0000","last_unstale":"2024-01-21T21:14:43.258806+0000","last_undegraded":"2024-01-21T21:14:43.258806+0000","last_fullsized":"2024-01-21T21:14:43.258806+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.263452+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:14:43.263452+0000","last_peered":"2024-01-21T21:14:43.263452+0000","last_clean":"2024-01-21T21:14:43.263452+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:14:43.263452+0000","last_undegraded":"2024-01-21T21:14:43.263452+0000","last_fullsized":"2024-01-21T21:14:43.263452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.272318+0000","last_change":"2024-01-21T21:14:43.268303+0000","last_active":"2024-01-21T21:14:43.272318+0000","last_peered":"2024-01-21T21:14:43.272318+0000","last_clean":"2024-01-21T21:14:43.272318+0000","last_became_active":"2024-01-21T21:14:43.268012+0000","last_became_peered":"2024-01-21T21:14:43.268012+0000","last_unstale":"2024-01-21T21:14:43.272318+0000","last_undegraded":"2024-01-21T21:14:43.272318+0000","last_fullsized":"2024-01-21T21:14:43.272318+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"159'2","reported_seq":12,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.276502+0000","last_change":"2024-01-21T21:14:42.893806+0000","last_active":"2024-01-21T21:14:43.276502+0000","last_peered":"2024-01-21T21:14:43.276502+0000","last_clean":"2024-01-21T21:14:43.276502+0000","last_became_active":"2024-01-21T21:14:42.893442+0000","last_became_peered":"2024-01-21T21:14:42.893442+0000","last_unstale":"2024-01-21T21:14:43.276502+0000","last_undegraded":"2024-01-21T21:14:43.276502+0000","last_fullsized":"2024-01-21T21:14:43.276502+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.264407+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:14:43.264407+0000","last_peered":"2024-01-21T21:14:43.264407+0000","last_clean":"2024-01-21T21:14:43.264407+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:14:43.264407+0000","last_undegraded":"2024-01-21T21:14:43.264407+0000","last_fullsized":"2024-01-21T21:14:43.264407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.275930+0000","last_change":"2024-01-21T21:14:43.265492+0000","last_active":"2024-01-21T21:14:43.275930+0000","last_peered":"2024-01-21T21:14:43.275930+0000","last_clean":"2024-01-21T21:14:43.275930+0000","last_became_active":"2024-01-21T21:14:43.265228+0000","last_became_peered":"2024-01-21T21:14:43.265228+0000","last_unstale":"2024-01-21T21:14:43.275930+0000","last_undegraded":"2024-01-21T21:14:43.275930+0000","last_fullsized":"2024-01-21T21:14:43.275930+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.252625+0000","last_change":"2024-01-21T21:14:42.899486+0000","last_active":"2024-01-21T21:14:43.252625+0000","last_peered":"2024-01-21T21:14:43.252625+0000","last_clean":"2024-01-21T21:14:43.252625+0000","last_became_active":"2024-01-21T21:14:42.899167+0000","last_became_peered":"2024-01-21T21:14:42.899167+0000","last_unstale":"2024-01-21T21:14:43.252625+0000","last_undegraded":"2024-01-21T21:14:43.252625+0000","last_fullsized":"2024-01-21T21:14:43.252625+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.258756+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:14:43.258756+0000","last_peered":"2024-01-21T21:14:43.258756+0000","last_clean":"2024-01-21T21:14:43.258756+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:14:43.258756+0000","last_undegraded":"2024-01-21T21:14:43.258756+0000","last_fullsized":"2024-01-21T21:14:43.258756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.268017+0000","last_change":"2024-01-21T21:14:43.263007+0000","last_active":"2024-01-21T21:14:43.268017+0000","last_peered":"2024-01-21T21:14:43.268017+0000","last_clean":"2024-01-21T21:14:43.268017+0000","last_became_active":"2024-01-21T21:14:43.262098+0000","last_became_peered":"2024-01-21T21:14:43.262098+0000","last_unstale":"2024-01-21T21:14:43.268017+0000","last_undegraded":"2024-01-21T21:14:43.268017+0000","last_fullsized":"2024-01-21T21:14:43.268017+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":158,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:42.868042+0000","last_clean_scrub_stamp":"2024-01-21T21:14:42.868042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.255457+0000","last_change":"2024-01-21T21:14:42.893736+0000","last_active":"2024-01-21T21:14:43.255457+0000","last_peered":"2024-01-21T21:14:43.255457+0000","last_clean":"2024-01-21T21:14:43.255457+0000","last_became_active":"2024-01-21T21:14:42.889276+0000","last_became_peered":"2024-01-21T21:14:42.889276+0000","last_unstale":"2024-01-21T21:14:43.255457+0000","last_undegraded":"2024-01-21T21:14:43.255457+0000","last_fullsized":"2024-01-21T21:14:43.255457+0000","mapping_epoch":157,"log_start":"0'0","ondisk_log_start":"0'0","created":157,"last_epoch_clean":158,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:14:41.861326+0000","last_clean_scrub_stamp":"2024-01-21T21:14:41.861326+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":128,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-01-21T21:14:43.259853+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:14:43.259853+0000","last_peered":"2024-01-21T21:14:43.259853+0000","last_clean":"2024-01-21T21:14:43.259853+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:14:43.259853+0000","last_undegraded":"2024-01-21T21:14:43.259853+0000","last_fullsized":"2024-01-21T21:14:43.259853+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575751,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1062468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.315},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.34499999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.46800000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834575751,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48299999999999998,"5min":0.38,"15min":0.28899999999999998},"max":{"1min":0.745,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.56100000000000005,"5min":0.48799999999999999,"15min":0.436},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.875},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.34799999999999998},"max":{"1min":0.73499999999999999,"5min":0.754,"15min":0.82199999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.45300000000000001,"5min":0.39900000000000002,"15min":0.36199999999999999},"max":{"1min":0.70799999999999996,"5min":0.80300000000000005,"15min":0.85399999999999998},"last":0.61699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.43099999999999999,"5min":0.38900000000000001,"15min":0.34300000000000003},"max":{"1min":0.66500000000000004,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57799999999999996,"15min":0.58999999999999997},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.35199999999999998},"max":{"1min":0.75,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.40000000000000002,"15min":0.32700000000000001},"max":{"1min":0.71899999999999997,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":0.76600000000000001,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45700000000000002,"15min":0.46400000000000002},"min":{"1min":0.35699999999999998,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.72599999999999998,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.68999999999999995,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.58399999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49199999999999999,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.495},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.379},"max":{"1min":0.78500000000000003,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:14:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.54400000000000004},"min":{"1min":0.372,"5min":0.34399999999999997,"15min":0.32200000000000001},"max":{"1min":0.80400000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57499999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575753,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1990656,"data_stored":1062695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.29599999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.309}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.34300000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.498}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575752,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303144,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068696,"statfs":{"total":96636764160,"available":96326344704,"internally_reserved":0,"allocated":1998848,"data_stored":1061860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.315},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.628}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834575752,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41899999999999998,"15min":0.40600000000000003},"min":{"1min":0.27300000000000002,"5min":0.26500000000000001,"15min":0.23699999999999999},"max":{"1min":0.55500000000000005,"5min":0.63100000000000001,"15min":0.64600000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.44700000000000001,"15min":0.434},"min":{"1min":0.36799999999999999,"5min":0.314,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.67400000000000004},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41699999999999998,"15min":0.40300000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.441},"min":{"1min":0.33200000000000002,"5min":0.30599999999999999,"15min":0.27900000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45700000000000002,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.30099999999999999},"max":{"1min":0.58299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.47499999999999998},"min":{"1min":0.36499999999999999,"5min":0.34000000000000002,"15min":0.316},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.749},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67900000000000005,"15min":0.68000000000000005},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.51100000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.92000000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.44,"15min":0.42099999999999999},"max":{"1min":0.85099999999999998,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":1.018},"last":0.85899999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":0.95999999999999996,"15min":0.999},"last":0.878},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.45600000000000002},"max":{"1min":0.89000000000000001,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.45500000000000002,"15min":0.443},"max":{"1min":0.879,"5min":0.96399999999999997,"15min":1.079},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71099999999999997,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42799999999999999},"max":{"1min":0.91500000000000004,"5min":1.044,"15min":1.044},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575752,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.308}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.50800000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.59499999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.53000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575752,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307240,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064600,"statfs":{"total":96636764160,"available":96322150400,"internally_reserved":0,"allocated":1998848,"data_stored":1063319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.495},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311336,"kb_used_data":1952,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060504,"statfs":{"total":96636764160,"available":96317956096,"internally_reserved":0,"allocated":1998848,"data_stored":1063609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.39800000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.57199999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55800000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.58599999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.627},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:14:51.015 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T21:14:51.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T21:14:51.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.171+0000 7fa826c8b700 1 Processor -- start 2024-01-21T21:14:51.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.171+0000 7fa826c8b700 1 -- start start 2024-01-21T21:14:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa8200a9d10 0x7fa8200ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8200aa0f0 0x7fa820063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 0x7fa8201551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8200640d0 con 0x7fa8200aa0f0 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa820063750 con 0x7fa8200a9d10 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa826c8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82005e380 con 0x7fa8200c4920 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8200aa0f0 0x7fa820063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8200aa0f0 0x7fa820063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46694/0 (socket says 172.21.15.133:46694) 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 -- 172.21.15.133:0/1691077716 learned_addr learned my addr 172.21.15.133:0/1691077716 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa824a27700 1 --2- 172.21.15.133:0/1691077716 >> v2:172.21.15.178:3300/0 conn(0x7fa8200a9d10 0x7fa8200ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa825228700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 0x7fa8201551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 -- 172.21.15.133:0/1691077716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 msgr2=0x7fa8201551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 0x7fa8201551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 -- 172.21.15.133:0/1691077716 >> v2:172.21.15.178:3300/0 conn(0x7fa8200a9d10 msgr2=0x7fa8200ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 --2- 172.21.15.133:0/1691077716 >> v2:172.21.15.178:3300/0 conn(0x7fa8200a9d10 0x7fa8200ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 -- 172.21.15.133:0/1691077716 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82005e660 con 0x7fa8200aa0f0 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa825228700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 0x7fa8201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.172+0000 7fa81ffff700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200aa0f0 0x7fa820063be0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa82005f0d0 tx=0x7fa80c0090f0).ready entity=mon.0 client_cookie=7fcdf7635723389a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa81f7fe700 1 -- 172.21.15.133:0/1691077716 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00b520 con 0x7fa8200aa0f0 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa81f7fe700 1 -- 172.21.15.133:0/1691077716 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00b680 con 0x7fa8200aa0f0 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa81f7fe700 1 -- 172.21.15.133:0/1691077716 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00ba20 con 0x7fa8200aa0f0 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 -- 172.21.15.133:0/1691077716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200aa0f0 msgr2=0x7fa820063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200aa0f0 0x7fa820063be0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa82005f0d0 tx=0x7fa80c0090f0).stop 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 -- 172.21.15.133:0/1691077716 shutdown_connections 2024-01-21T21:14:51.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200c4920 0x7fa8201551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 --2- 172.21.15.133:0/1691077716 >> v2:172.21.15.178:3300/0 conn(0x7fa8200a9d10 0x7fa8200ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 --2- 172.21.15.133:0/1691077716 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200aa0f0 0x7fa820063be0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 -- 172.21.15.133:0/1691077716 >> 172.21.15.133:0/1691077716 conn(0x7fa8200c8200 msgr2=0x7fa8200c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 -- 172.21.15.133:0/1691077716 shutdown_connections 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.173+0000 7fa826c8b700 1 -- 172.21.15.133:0/1691077716 wait complete. 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.174+0000 7fa826c8b700 1 Processor -- start 2024-01-21T21:14:51.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.174+0000 7fa826c8b700 1 -- start start 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200a9d10 0x7fa82013e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 0x7fa8200c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200c1ad0 con 0x7fa8200c4920 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa820155660 con 0x7fa8200aa0f0 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa826c8b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200c1230 con 0x7fa8200a9d10 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa825228700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa825228700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46700/0 (socket says 172.21.15.133:46700) 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa825228700 1 -- 172.21.15.133:0/4126151390 learned_addr learned my addr 172.21.15.133:0/4126151390 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.175+0000 7fa824a27700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200a9d10 0x7fa82013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa81ffff700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 0x7fa8200c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 -- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200a9d10 msgr2=0x7fa82013e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200a9d10 0x7fa82013e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 -- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 msgr2=0x7fa8200c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 0x7fa8200c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 -- 172.21.15.133:0/4126151390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009370 con 0x7fa8200c4920 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa81ffff700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 0x7fa8200c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa825228700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fa81800f390 tx=0x7fa8180099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818012460 con 0x7fa8200c4920 2024-01-21T21:14:51.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8180125c0 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8200c1510 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818012940 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.176+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8200c3610 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.177+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8201557d0 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.177+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa818012d30 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.178+0000 7fa81d7fa700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 0x7fa804061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.178+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fa81807d400 con 0x7fa8200c4920 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.178+0000 7fa824a27700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 0x7fa804061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.178+0000 7fa824a27700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 0x7fa804061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa814009c30 tx=0x7fa814009060).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.182+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa81804e440 con 0x7fa8200c4920 2024-01-21T21:14:51.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.414+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa8200633e0 con 0x7fa8200c4920 2024-01-21T21:14:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.417+0000 7fa81d7fa700 1 -- 172.21.15.133:0/4126151390 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa818020020 con 0x7fa8200c4920 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 msgr2=0x7fa804061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 0x7fa804061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa814009c30 tx=0x7fa814009060).stop 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 msgr2=0x7fa8200c0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7fa81800f390 tx=0x7fa8180099b0).stop 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 shutdown_connections 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fa80405f150 0x7fa804061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8200c4920 0x7fa8200c0c10 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8200a9d10 0x7fa82013e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 --2- 172.21.15.133:0/4126151390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8200aa0f0 0x7fa8200c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 >> 172.21.15.133:0/4126151390 conn(0x7fa8200c8200 msgr2=0x7fa8200c2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 shutdown_connections 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.419+0000 7fa826c8b700 1 -- 172.21.15.133:0/4126151390 wait complete. 2024-01-21T21:14:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T21:14:51.433 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:14:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.548+0000 7f0d35a4c700 1 Processor -- start 2024-01-21T21:14:51.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.548+0000 7f0d35a4c700 1 -- start start 2024-01-21T21:14:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d35a4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d300c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d35a4c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d300c6590 0x7f0d300c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d35a4c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d300c89d0 con 0x7f0d301545a0 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d35a4c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d300c6a20 con 0x7f0d300c6590 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d35a4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300c7dc0 con 0x7f0d300c77b0 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d300c6590 0x7f0d300c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2e7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d300c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d300c6590 0x7f0d300c0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:44536/0 (socket says 172.21.15.133:44536) 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2effd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0d301545a0 0x7f0d300aa360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:33040/0 (socket says 172.21.15.133:33040) 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2f7fe700 1 -- 172.21.15.133:0/3644389165 learned_addr learned my addr 172.21.15.133:0/3644389165 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.549+0000 7f0d2e7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d300c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:36910/0 (socket says 172.21.15.133:36910) 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2f7fe700 1 -- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 msgr2=0x7f0d300c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2f7fe700 1 --2- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d300c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2f7fe700 1 -- 172.21.15.133:0/3644389165 >> v1:172.21.15.178:6789/0 conn(0x7f0d301545a0 legacy=0x7f0d300aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2f7fe700 1 -- 172.21.15.133:0/3644389165 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300c80a0 con 0x7f0d300c6590 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2f7fe700 1 --2- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d300c6590 0x7f0d300c0750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d28009f20 tx=0x7f0d28009840).ready entity=mon.1 client_cookie=2751601081aee1e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2dffb700 1 -- 172.21.15.133:0/3644389165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800e070 con 0x7f0d300c6590 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2dffb700 1 -- 172.21.15.133:0/3644389165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2800b9d0 con 0x7f0d300c6590 2024-01-21T21:14:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.550+0000 7f0d2dffb700 1 -- 172.21.15.133:0/3644389165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2800bd50 con 0x7f0d300c6590 2024-01-21T21:14:51.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 -- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d300c6590 msgr2=0x7f0d300c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d300c6590 0x7f0d300c0750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d28009f20 tx=0x7f0d28009840).stop 2024-01-21T21:14:51.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 -- 172.21.15.133:0/3644389165 shutdown_connections 2024-01-21T21:14:51.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d300c6590 0x7f0d300c0750 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/3644389165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d300c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 -- 172.21.15.133:0/3644389165 >> 172.21.15.133:0/3644389165 conn(0x7f0d300649d0 msgr2=0x7f0d30064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 -- 172.21.15.133:0/3644389165 shutdown_connections 2024-01-21T21:14:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.551+0000 7f0d35a4c700 1 -- 172.21.15.133:0/3644389165 wait complete. 2024-01-21T21:14:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.552+0000 7f0d35a4c700 1 Processor -- start 2024-01-21T21:14:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.552+0000 7f0d35a4c700 1 -- start start 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d3013e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d301545a0 0x7f0d301516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300ae840 con 0x7f0d300c6590 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30152d60 con 0x7f0d301545a0 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d35a4c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30152150 con 0x7f0d300c77b0 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46704/0 (socket says 172.21.15.133:46704) 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 -- 172.21.15.133:0/4066454504 learned_addr learned my addr 172.21.15.133:0/4066454504 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2e7fc700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d3013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2f7fe700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d301545a0 0x7f0d301516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 -- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 msgr2=0x7f0d3013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d3013e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 -- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d301545a0 msgr2=0x7f0d301516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d301545a0 0x7f0d301516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.553+0000 7f0d2effd700 1 -- 172.21.15.133:0/4066454504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d28009ae0 con 0x7f0d300c6590 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d2effd700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f0d20007fd0 tx=0x7f0d20007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2000ce10 con 0x7f0d300c6590 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200072e0 con 0x7f0d300c6590 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d30152430 con 0x7f0d300c6590 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200056e0 con 0x7f0d300c6590 2024-01-21T21:14:51.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.554+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d301529f0 con 0x7f0d300c6590 2024-01-21T21:14:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.555+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3005fdf0 con 0x7f0d300c6590 2024-01-21T21:14:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.555+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0d20005ad0 con 0x7f0d300c6590 2024-01-21T21:14:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.555+0000 7f0d177fe700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 0x7f0d1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:51.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.555+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f0d20079be0 con 0x7f0d300c6590 2024-01-21T21:14:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.555+0000 7f0d2e7fc700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 0x7f0d1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.556+0000 7f0d2e7fc700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 0x7f0d1c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0d300c1100 tx=0x7f0d24009060).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:51.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.560+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0d2004ac20 con 0x7f0d300c6590 2024-01-21T21:14:51.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.766+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d30152bb0 con 0x7f0d300c6590 2024-01-21T21:14:51.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.766+0000 7f0d177fe700 1 -- 172.21.15.133:0/4066454504 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f0d20018030 con 0x7f0d300c6590 2024-01-21T21:14:51.768 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:14:51.768 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 msgr2=0x7f0d1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 0x7f0d1c061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0d300c1100 tx=0x7f0d24009060).stop 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 msgr2=0x7f0d300ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f0d20007fd0 tx=0x7f0d20007df0).stop 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 shutdown_connections 2024-01-21T21:14:51.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0d1c05f150 0x7f0d1c061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d301545a0 0x7f0d301516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d300c6590 0x7f0d300ae350 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 --2- 172.21.15.133:0/4066454504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d300c77b0 0x7f0d3013e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 >> 172.21.15.133:0/4066454504 conn(0x7f0d300649d0 msgr2=0x7f0d300c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 shutdown_connections 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:51.768+0000 7f0d35a4c700 1 -- 172.21.15.133:0/4066454504 wait complete. 2024-01-21T21:14:51.771 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:14:52.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T21:14:43.244882+0000', 'modified': '2024-01-21T21:14:45.250408+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8586': {'gid': 8586, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2061608456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2061608456}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2061608456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T21:14:52.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T21:14:52.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-21T21:14:52.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.308+0000 7f8757108700 1 Processor -- start 2024-01-21T21:14:52.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.308+0000 7f8757108700 1 -- start start 2024-01-21T21:14:52.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8757108700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8750062e00 0x7f87500a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8757108700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87500654e0 con 0x7f875013a620 2024-01-21T21:14:52.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8757108700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8750158730 con 0x7f875013aa00 2024-01-21T21:14:52.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8757108700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87500bd6f0 con 0x7f8750062e00 2024-01-21T21:14:52.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8754ea4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f875013a620 0x7f87500626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43278/0 (socket says 172.21.15.133:43278) 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f8754ea4700 1 -- 172.21.15.133:0/3243828010 learned_addr learned my addr 172.21.15.133:0/3243828010 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874ffff700 1 --2- 172.21.15.133:0/3243828010 >> v2:172.21.15.178:3300/0 conn(0x7f8750062e00 0x7f87500a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859525192 0 0) 0x7f87500654e0 con 0x7f875013a620 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87400033f0 con 0x7f875013a620 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4244238251 0 0) 0x7f87400033f0 con 0x7f875013a620 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 >> v2:172.21.15.178:3300/0 conn(0x7f8750062e00 msgr2=0x7f87500a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 --2- 172.21.15.133:0/3243828010 >> v2:172.21.15.178:3300/0 conn(0x7f8750062e00 0x7f87500a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.309+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 >> v1:172.21.15.178:6789/0 conn(0x7f875013aa00 legacy=0x7f8750065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750158a10 con 0x7f875013a620 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8744001470 con 0x7f875013a620 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 >> v1:172.21.15.133:6789/0 conn(0x7f875013a620 legacy=0x7f87500626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400038e0 0x7f8740003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 0x7f8740004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740005050 0x7f874000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500bd6f0 con 0x7f8740004690 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874000bfe0 con 0x7f8740005050 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874000c1a0 con 0x7f87400038e0 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 0x7f8740004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400038e0 0x7f8740003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f87556a5700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740005050 0x7f874000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 -- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400038e0 msgr2=0x7f8740003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400038e0 0x7f8740003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 -- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740005050 msgr2=0x7f874000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740005050 0x7f874000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 -- 172.21.15.133:0/3243828010 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400033f0 con 0x7f8740004690 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f87556a5700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740005050 0x7f874000b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f87556a5700 1 -- 172.21.15.133:0/3243828010 reap_dead start 2024-01-21T21:14:52.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874ffff700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 0x7f8740004b10 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f873c006d80 tx=0x7f873c009060).ready entity=mon.0 client_cookie=f3658da352d96790 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c009e90 con 0x7f8740004690 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00e610 con 0x7f8740004690 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.310+0000 7f874f7fe700 1 -- 172.21.15.133:0/3243828010 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00e9d0 con 0x7f8740004690 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 -- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 msgr2=0x7f8740004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 0x7f8740004b10 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f873c006d80 tx=0x7f873c009060).stop 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 -- 172.21.15.133:0/3243828010 shutdown_connections 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 --2- 172.21.15.133:0/3243828010 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8740004690 0x7f8740004b10 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 -- 172.21.15.133:0/3243828010 >> 172.21.15.133:0/3243828010 conn(0x7f87500c7dc0 msgr2=0x7f87500c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 -- 172.21.15.133:0/3243828010 shutdown_connections 2024-01-21T21:14:52.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.311+0000 7f8757108700 1 -- 172.21.15.133:0/3243828010 wait complete. 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.312+0000 7f8757108700 1 Processor -- start 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.312+0000 7f8757108700 1 -- start start 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740004690 0x7f87500aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8750139b00 0x7f8750066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500bf8f0 con 0x7f87500bf110 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87500bfbd0 con 0x7f8740004690 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87500bfeb0 con 0x7f8750139b00 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46718/0 (socket says 172.21.15.133:46718) 2024-01-21T21:14:52.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 -- 172.21.15.133:0/3332117903 learned_addr learned my addr 172.21.15.133:0/3332117903 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 -- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8750139b00 msgr2=0x7f8750066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8750139b00 0x7f8750066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 -- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740004690 msgr2=0x7f87500aa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740004690 0x7f87500aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 -- 172.21.15.133:0/3332117903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500c0190 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874ffff700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f8750063200 tx=0x7f873c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874d7fa700 1 -- 172.21.15.133:0/3332117903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c000bc0 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874d7fa700 1 -- 172.21.15.133:0/3332117903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00ed80 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87500c0470 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f874d7fa700 1 -- 172.21.15.133:0/3332117903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c024640 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.314+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750066a70 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.316+0000 7f874d7fa700 1 -- 172.21.15.133:0/3332117903 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f873c0123f0 con 0x7f87500bf110 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.316+0000 7f874d7fa700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 0x7f8734061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.316+0000 7f874d7fa700 1 -- 172.21.15.133:0/3332117903 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f873c07ba80 con 0x7f87500bf110 2024-01-21T21:14:52.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.316+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 0x7f8734061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.316+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 0x7f8734061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8744007c50 tx=0x7f8744001e50).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.318+0000 7f8768aabb80 1 Processor -- start 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.318+0000 7f8768aabb80 1 -- start start 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 0x5646aaa29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aa9a53d0 con 0x5646aaa29df0 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aa96abe0 con 0x5646aaa772c0 2024-01-21T21:14:52.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646aa980260 con 0x5646aaa2e620 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46734/0 (socket says 172.21.15.133:46734) 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 -- 172.21.15.133:0/3318272020 learned_addr learned my addr 172.21.15.133:0/3318272020 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f874ffff700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 0x5646aaa29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 -- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 msgr2=0x5646aaa2ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 -- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 msgr2=0x5646aaa29900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 0x5646aaa29900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 -- 172.21.15.133:0/3318272020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646aa9792f0 con 0x5646aaa29df0 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f874ffff700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 0x5646aaa29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f87556a5700 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f8750068d70 tx=0x7f8748009040).ready entity=mon.0 client_cookie=ade35e351cf119e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.319+0000 7f873a7fc700 1 -- 172.21.15.133:0/3318272020 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748010450 con 0x5646aaa29df0 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f873a7fc700 1 -- 172.21.15.133:0/3318272020 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87480105b0 con 0x5646aaa29df0 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f873a7fc700 1 -- 172.21.15.133:0/3318272020 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748010970 con 0x5646aaa29df0 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 -- 172.21.15.133:0/3318272020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 msgr2=0x5646aaa2a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f8750068d70 tx=0x7f8748009040).stop 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 -- 172.21.15.133:0/3318272020 shutdown_connections 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa29df0 0x5646aaa2a270 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3318272020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa772c0 0x5646aaa29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 -- 172.21.15.133:0/3318272020 >> 172.21.15.133:0/3318272020 conn(0x5646aa8972e0 msgr2=0x5646aaa77750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 -- 172.21.15.133:0/3318272020 shutdown_connections 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.320+0000 7f8768aabb80 1 -- 172.21.15.133:0/3318272020 wait complete. 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.321+0000 7f8768aabb80 1 -- start start 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.321+0000 7f8768aabb80 1 Processor -- start 2024-01-21T21:14:52.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa5d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 0x5646aaa4fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aa9803a0 con 0x5646aaa2e620 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aa980620 con 0x5646aaa29df0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646aa94b990 con 0x5646aaa772c0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 10 client.0 ll_register_callbacks cb 0x5646aa9ee610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46744/0 (socket says 172.21.15.133:46744) 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 -- 172.21.15.133:0/2725654561 learned_addr learned my addr 172.21.15.133:0/2725654561 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8754ea4700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa5d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f87556a5700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 0x5646aaa4fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 -- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 msgr2=0x5646aaa4fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 0x5646aaa4fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 -- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 msgr2=0x5646aaa5d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa5d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 -- 172.21.15.133:0/2725654561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874800f040 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f87556a5700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 0x5646aaa4fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f874ffff700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f873c050650 tx=0x7f873c009fd0).ready entity=mon.0 client_cookie=d9114c8d992ff88c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f872f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c050080 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f873c0506c0 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646aaa28df0 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f873c055e60 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 10 client.8745 fetch_fsmap learned FSMap version 56 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.322+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5646aa974520 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646aaa28df0 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f873c035020 con 0x5646aaa2e620 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 10 client.8745 fetch_fsmap finished waiting for FSMap version 56 2024-01-21T21:14:52.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 10 client.8745 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 20 client.8745 populate_metadata read hostname 'smithi133' 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa728b0 0x5646aaa72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 4 client.8745 mds_command: new command op to 8586 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 --> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646aa975d60 con 0x5646aaa728b0 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8754ea4700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa728b0 0x5646aaa72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f872f7fe700 10 client.8745 ms_handle_connect on v2:172.21.15.133:6836/2061608456 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.323+0000 7f8754ea4700 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa728b0 0x5646aaa72c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=80966f6ca6830a4e server_cookie=75bc95c009264a83 in_seq=0 out_seq=0 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f872f7fe700 1 -- 172.21.15.133:0/2725654561 <== mds.0 v2:172.21.15.133:6836/2061608456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x5646aa975d60 con 0x5646aaa728b0 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f872f7fe700 10 client.8745 handle_command_reply: tid=0 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 client.8745 shutdown 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 msgr2=0x5646aaa4f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f873c050650 tx=0x7f873c009fd0).stop 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 shutdown_connections 2024-01-21T21:14:52.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa728b0 0x5646aaa72c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa772c0 0x5646aaa4fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa5d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f872f7fe700 0 client.8745 ms_handle_reset on v2:172.21.15.133:6836/2061608456 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 --2- 172.21.15.133:0/2725654561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa2e620 0x5646aaa4f990 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 >> 172.21.15.133:0/2725654561 conn(0x5646aa8972e0 msgr2=0x5646aaa2c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 shutdown_connections 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 1 -- 172.21.15.133:0/2725654561 wait complete. 2024-01-21T21:14:52.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.324+0000 7f8768aabb80 20 client.8745 trim_cache size 0 max 16384 2024-01-21T21:14:52.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.340+0000 7f8768aabb80 1 Processor -- start 2024-01-21T21:14:52.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.340+0000 7f8768aabb80 1 -- start start 2024-01-21T21:14:52.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aaa28420 con 0x5646aaa772c0 2024-01-21T21:14:52.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aaa2dbf0 con 0x5646aaa29df0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646aaa50260 con 0x5646aaa2e620 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46752/0 (socket says 172.21.15.133:46752) 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 -- 172.21.15.133:0/431029241 learned_addr learned my addr 172.21.15.133:0/431029241 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f8754ea4700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 -- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 msgr2=0x5646aaa2ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f874ffff700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 -- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 msgr2=0x5646aaa72c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.341+0000 7f87556a5700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f87556a5700 1 -- 172.21.15.133:0/431029241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646aa974270 con 0x5646aaa772c0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8754ea4700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f87556a5700 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f8748007fd0 tx=0x7f8748009040).ready entity=mon.0 client_cookie=8f4732ff59afdade server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f873affd700 1 -- 172.21.15.133:0/431029241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748007d80 con 0x5646aaa772c0 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f873affd700 1 -- 172.21.15.133:0/431029241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748010d60 con 0x5646aaa772c0 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f873affd700 1 -- 172.21.15.133:0/431029241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748001190 con 0x5646aaa772c0 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 -- 172.21.15.133:0/431029241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 msgr2=0x5646aaa2eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f8748007fd0 tx=0x7f8748009040).stop 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 -- 172.21.15.133:0/431029241 shutdown_connections 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa2eef0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 --2- 172.21.15.133:0/431029241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa2e620 0x5646aaa2ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 -- 172.21.15.133:0/431029241 >> 172.21.15.133:0/431029241 conn(0x5646aa8972e0 msgr2=0x5646aaa77750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 -- 172.21.15.133:0/431029241 shutdown_connections 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.342+0000 7f8768aabb80 1 -- 172.21.15.133:0/431029241 wait complete. 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.343+0000 7f8768aabb80 1 -- start start 2024-01-21T21:14:52.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.343+0000 7f8768aabb80 1 Processor -- start 2024-01-21T21:14:52.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa2e620 0x5646aaa73180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aaa73670 con 0x5646aaa772c0 2024-01-21T21:14:52.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646aaad9550 con 0x5646aaa2e620 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646aaa56360 con 0x5646aaa29df0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8768aabb80 10 client.0 ll_register_callbacks cb 0x5646aa9ee610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46754/0 (socket says 172.21.15.133:46754) 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 -- 172.21.15.133:0/3647321528 learned_addr learned my addr 172.21.15.133:0/3647321528 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f874ffff700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa2e620 0x5646aaa73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 -- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa29df0 msgr2=0x5646aaa72c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 -- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa2e620 msgr2=0x5646aaa73180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa2e620 0x5646aaa73180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 -- 172.21.15.133:0/3647321528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748019040 con 0x5646aaa772c0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f87556a5700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x5646aaa77720 tx=0x7f8748021000).ready entity=mon.0 client_cookie=3681a7bb1a4fe843 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f872f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.344+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748010450 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87480105b0 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f8748015650 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8748001170 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 10 client.8751 fetch_fsmap learned FSMap version 56 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5646aa7edf80 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87480105b0 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8748015a20 con 0x5646aaa772c0 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 10 client.8751 fetch_fsmap finished waiting for FSMap version 56 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 10 client.8751 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 20 client.8751 populate_metadata read hostname 'smithi133' 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa743b0 0x5646aaa74790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 4 client.8751 mds_command: new command op to 8586 tid=0[{"prefix": "status"}] 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 --> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5646aa96c7d0 con 0x5646aaa743b0 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa743b0 0x5646aaa74790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f872f7fe700 10 client.8751 ms_handle_connect on v2:172.21.15.133:6836/2061608456 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.345+0000 7f8754ea4700 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa743b0 0x5646aaa74790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c9343ab06324a765 server_cookie=6bc680ce3b4c5c57 in_seq=0 out_seq=0 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f872f7fe700 1 -- 172.21.15.133:0/3647321528 <== mds.0 v2:172.21.15.133:6836/2061608456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5646aa96c7d0 con 0x5646aaa743b0 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f872f7fe700 10 client.8751 handle_command_reply: tid=0 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 client.8751 shutdown 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 msgr2=0x5646aaa73ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x5646aaa77720 tx=0x7f8748021000).stop 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 shutdown_connections 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:6836/2061608456,v1:172.21.15.133:6837/2061608456] conn(0x5646aaa743b0 0x5646aaa74790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x5646aaa772c0 0x5646aaa73ec0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5646aaa29df0 0x5646aaa72c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f872f7fe700 0 client.8751 ms_handle_reset on v2:172.21.15.133:6836/2061608456 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 --2- 172.21.15.133:0/3647321528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646aaa2e620 0x5646aaa73180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 >> 172.21.15.133:0/3647321528 conn(0x5646aa8972e0 msgr2=0x5646aaa2ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 shutdown_connections 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 1 -- 172.21.15.133:0/3647321528 wait complete. 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8768aabb80 20 client.8751 trim_cache size 0 max 16384 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 8586, 2024-01-21T21:14:52.354 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.0998151939999996, 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 56, 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 160, 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 160, 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.576405306 2024-01-21T21:14:52.355 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 msgr2=0x7f8734061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 0x7f8734061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8744007c50 tx=0x7f8744001e50).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 msgr2=0x7f8750139610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f8750063200 tx=0x7f873c01a000).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 shutdown_connections 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f873405f150 0x7f8734061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8750139b00 0x7f8750066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8740004690 0x7f87500aa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 --2- 172.21.15.133:0/3332117903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87500bf110 0x7f8750139610 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.346+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 >> 172.21.15.133:0/3332117903 conn(0x7f87500c7dc0 msgr2=0x7f8750155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.347+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 shutdown_connections 2024-01-21T21:14:52.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.347+0000 7f8757108700 1 -- 172.21.15.133:0/3332117903 wait complete. 2024-01-21T21:14:52.360 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T21:14:52.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.461+0000 7fe61c398700 1 Processor -- start 2024-01-21T21:14:52.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.461+0000 7fe61c398700 1 -- start start 2024-01-21T21:14:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe614150c80 0x7fe6140c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe6140c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6140c4040 0x7fe6140694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140c72a0 con 0x7fe614150c80 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140c6920 con 0x7fe6140c4040 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.462+0000 7fe61c398700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c5d10 con 0x7fe6140c5810 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe614150c80 0x7fe6140c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe614150c80 0x7fe6140c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46762/0 (socket says 172.21.15.133:46762) 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 -- 172.21.15.133:0/1853329308 learned_addr learned my addr 172.21.15.133:0/1853329308 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe619933700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe6140c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a935700 1 --2- 172.21.15.133:0/1853329308 >> v2:172.21.15.178:3300/0 conn(0x7fe6140c4040 0x7fe6140694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 -- 172.21.15.133:0/1853329308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 msgr2=0x7fe6140c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe6140c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 -- 172.21.15.133:0/1853329308 >> v2:172.21.15.178:3300/0 conn(0x7fe6140c4040 msgr2=0x7fe6140694b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 --2- 172.21.15.133:0/1853329308 >> v2:172.21.15.178:3300/0 conn(0x7fe6140c4040 0x7fe6140694b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 -- 172.21.15.133:0/1853329308 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140c5ff0 con 0x7fe614150c80 2024-01-21T21:14:52.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe61a134700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c6db0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fe614068720 tx=0x7fe6080090f0).ready entity=mon.0 client_cookie=f1f8734814d43d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe619132700 1 -- 172.21.15.133:0/1853329308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800b600 con 0x7fe614150c80 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe619132700 1 -- 172.21.15.133:0/1853329308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800b760 con 0x7fe614150c80 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.463+0000 7fe619132700 1 -- 172.21.15.133:0/1853329308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800bae0 con 0x7fe614150c80 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 -- 172.21.15.133:0/1853329308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 msgr2=0x7fe6140c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c6db0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7fe614068720 tx=0x7fe6080090f0).stop 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 -- 172.21.15.133:0/1853329308 shutdown_connections 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 --2- 172.21.15.133:0/1853329308 >> v2:172.21.15.178:3300/0 conn(0x7fe6140c4040 0x7fe6140694b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c6db0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 --2- 172.21.15.133:0/1853329308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe6140c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 -- 172.21.15.133:0/1853329308 >> 172.21.15.133:0/1853329308 conn(0x7fe6140c7cb0 msgr2=0x7fe6140c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 -- 172.21.15.133:0/1853329308 shutdown_connections 2024-01-21T21:14:52.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.464+0000 7fe61c398700 1 -- 172.21.15.133:0/1853329308 wait complete. 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.465+0000 7fe61c398700 1 Processor -- start 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.465+0000 7fe61c398700 1 -- start start 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6140c4040 0x7fe6140c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe61414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614164770 con 0x7fe614150c80 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614165740 con 0x7fe6140c4040 2024-01-21T21:14:52.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61c398700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6141652b0 con 0x7fe6140c5810 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46776/0 (socket says 172.21.15.133:46776) 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 -- 172.21.15.133:0/797158899 learned_addr learned my addr 172.21.15.133:0/797158899 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe619933700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe61414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a134700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6140c4040 0x7fe6140c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 -- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 msgr2=0x7fe61414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe61414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 -- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6140c4040 msgr2=0x7fe6140c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6140c4040 0x7fe6140c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 -- 172.21.15.133:0/797158899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608009370 con 0x7fe614150c80 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe61a935700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fe60c007f50 tx=0x7fe60c0098a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00eb70 con 0x7fe614150c80 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.466+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00ecd0 con 0x7fe614150c80 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.467+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61414abc0 con 0x7fe614150c80 2024-01-21T21:14:52.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.467+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c014610 con 0x7fe614150c80 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.467+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614164980 con 0x7fe614150c80 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.467+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe614165460 con 0x7fe614150c80 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.468+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe60c01d3b0 con 0x7fe614150c80 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.468+0000 7fe606ffd700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 0x7fe5f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.468+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fe60c07a800 con 0x7fe614150c80 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.468+0000 7fe61a134700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 0x7fe5f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:52.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.468+0000 7fe61a134700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 0x7fe5f8061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe608009130 tx=0x7fe608017000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:52.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.472+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe614165460 con 0x7fe614150c80 2024-01-21T21:14:52.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.679+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe614165460 con 0x7fe614150c80 2024-01-21T21:14:52.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.679+0000 7fe606ffd700 1 -- 172.21.15.133:0/797158899 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe614165460 con 0x7fe614150c80 2024-01-21T21:14:52.681 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 msgr2=0x7fe5f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 0x7fe5f8061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe608009130 tx=0x7fe608017000).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 msgr2=0x7fe6140c0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fe60c007f50 tx=0x7fe60c0098a0).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 shutdown_connections 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5f805f150 0x7fe5f8061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe614150c80 0x7fe6140c0850 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6140c4040 0x7fe6140c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 --2- 172.21.15.133:0/797158899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6140c5810 0x7fe61414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 >> 172.21.15.133:0/797158899 conn(0x7fe6140c7cb0 msgr2=0x7fe61414c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 shutdown_connections 2024-01-21T21:14:52.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:52.681+0000 7fe61c398700 1 -- 172.21.15.133:0/797158899 wait complete. 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T21:14:52.693 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T21:14:52.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T21:14:52.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T21:14:52.694 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:14:52.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.694 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T21:14:52.711 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T21:14:52.712 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 37839sec preferred_lft 37839sec 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T21:14:52.713 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:14:52.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.714 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T21:14:52.778 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T21:14:52.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.779 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T21:14:52.838 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T21:14:52.838 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T21:14:52.839 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T21:14:52.839 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T21:14:52.839 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T21:14:52.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T21:14:52.839 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T21:14:52.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.945 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:14:52.962 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T21:14:52.962 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T21:14:52.962 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:14:52.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:52.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T21:14:53.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:53.030 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T21:14:53.087 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T21:14:53.087 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:14:53.168 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:14:53.169 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:14:53.190 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:14:53.190 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:14:53.192 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T21:14:53.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:14:53.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T21:14:53.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T21:14:53.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.419+0000 7ff8a1ff8700 1 Processor -- start 2024-01-21T21:14:53.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.419+0000 7ff8a1ff8700 1 -- start start 2024-01-21T21:14:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff8a1ff8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff89c154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff8a1ff8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c159010 con 0x7ff89c0c8120 2024-01-21T21:14:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff8a1ff8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c0c0e40 con 0x7ff89c154140 2024-01-21T21:14:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff8a1ff8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c154a10 con 0x7ff89c158bb0 2024-01-21T21:14:53.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff89affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff89c0c8120 0x7ff89c0c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43292/0 (socket says 172.21.15.133:43292) 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff89affd700 1 -- 172.21.15.133:0/316964128 learned_addr learned my addr 172.21.15.133:0/316964128 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff89bfff700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff89c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086872203 0 0) 0x7ff890001110 con 0x7ff89c0c8120 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.420+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8840033f0 con 0x7ff89c0c8120 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915279564 0 0) 0x7ff8840033f0 con 0x7ff89c0c8120 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 msgr2=0x7ff89c154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff89c154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 >> v1:172.21.15.178:6789/0 conn(0x7ff89c154140 legacy=0x7ff89c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0c6800 con 0x7ff89c0c8120 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff890001600 con 0x7ff89c0c8120 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 >> v1:172.21.15.133:6789/0 conn(0x7ff89c0c8120 legacy=0x7ff89c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff884003910 0x7ff884003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff884005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400b990 con 0x7ff884003910 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400bad0 con 0x7ff884004690 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88400bc90 con 0x7ff89c158bb0 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff884003910 0x7ff884003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89bfff700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff884005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89affd700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 -- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 msgr2=0x7ff884005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89c158bb0 0x7ff884005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 -- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff884004690 msgr2=0x7ff884004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 -- 172.21.15.133:0/316964128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840033f0 con 0x7ff884003910 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89affd700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff884004690 0x7ff884004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff884003910 0x7ff884003d30 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7ff88c001e30 tx=0x7ff88c007f30).ready entity=mon.0 client_cookie=fcb0f8051a16576d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c006a20 con 0x7ff884003910 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c006b80 con 0x7ff884003910 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.421+0000 7ff89a7fc700 1 -- 172.21.15.133:0/316964128 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00c5d0 con 0x7ff884003910 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/316964128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff884003910 msgr2=0x7ff884003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/316964128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff884003910 0x7ff884003d30 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7ff88c001e30 tx=0x7ff88c007f30).stop 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff89bfff700 1 -- 172.21.15.133:0/316964128 reap_dead start 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/316964128 shutdown_connections 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/316964128 >> 172.21.15.133:0/316964128 conn(0x7ff89c05e1e0 msgr2=0x7ff89c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/316964128 shutdown_connections 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.422+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/316964128 wait complete. 2024-01-21T21:14:53.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.423+0000 7ff8a1ff8700 1 Processor -- start 2024-01-21T21:14:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.423+0000 7ff8a1ff8700 1 -- start start 2024-01-21T21:14:53.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff884003910 0x7ff89c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89c145820 0x7ff89c145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c153600 con 0x7ff89c168340 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1538e0 con 0x7ff89c145820 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff8a1ff8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0c34f0 con 0x7ff884003910 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff89affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff89affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46792/0 (socket says 172.21.15.133:46792) 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.424+0000 7ff89affd700 1 -- 172.21.15.133:0/3185219143 learned_addr learned my addr 172.21.15.133:0/3185219143 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89bfff700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89c145820 0x7ff89c145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 -- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff884003910 msgr2=0x7ff89c0c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff884003910 0x7ff89c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 -- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89c145820 msgr2=0x7ff89c145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89c145820 0x7ff89c145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 -- 172.21.15.133:0/3185219143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c0c37d0 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff89affd700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7ff89000e810 tx=0x7ff890000cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890010520 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890010680 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c0c41e0 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890010a00 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.425+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c1532b0 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.426+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c0c39c0 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.426+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff890014430 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.426+0000 7ff883fff700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 0x7ff888061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.427+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff890079d90 con 0x7ff89c168340 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.427+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 0x7ff888061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.427+0000 7ff89b7fe700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 0x7ff888061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff88c001390 tx=0x7ff88c016000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.431+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff890049b00 con 0x7ff89c168340 2024-01-21T21:14:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.633+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff89c159010 con 0x7ff88805f150 2024-01-21T21:14:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.635+0000 7ff883fff700 1 -- 172.21.15.133:0/3185219143 <== mgr.8379 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff89c159010 con 0x7ff88805f150 2024-01-21T21:14:53.636 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:14:53.636 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:14:53.637 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T21:14:53.637 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:14:53.637 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 msgr2=0x7ff888061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 0x7ff888061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff88c001390 tx=0x7ff88c016000).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 msgr2=0x7ff89c1687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7ff89000e810 tx=0x7ff890000cc0).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 shutdown_connections 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff88805f150 0x7ff888061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89c145820 0x7ff89c145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff884003910 0x7ff89c0c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 --2- 172.21.15.133:0/3185219143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff89c168340 0x7ff89c1687c0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 >> 172.21.15.133:0/3185219143 conn(0x7ff89c05e1e0 msgr2=0x7ff89c0ad690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 shutdown_connections 2024-01-21T21:14:53.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.637+0000 7ff8a1ff8700 1 -- 172.21.15.133:0/3185219143 wait complete. 2024-01-21T21:14:53.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T21:14:53.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.772+0000 7f917301b700 1 Processor -- start 2024-01-21T21:14:53.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.772+0000 7f917301b700 1 -- start start 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f917301b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f917301b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f916c065490 0x7f916c0658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f917301b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c065000 con 0x7f916c0a3d90 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f917301b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c069540 con 0x7f916c065490 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f917301b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c064410 con 0x7f916c0bc8a0 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f91715b8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f916c0a3d90 0x7f916c06a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43308/0 (socket says 172.21.15.133:43308) 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f91715b8700 1 -- 172.21.15.133:0/829250377 learned_addr learned my addr 172.21.15.133:0/829250377 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f9170db7700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 --2- 172.21.15.133:0/829250377 >> v2:172.21.15.178:3300/0 conn(0x7f916c065490 0x7f916c0658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916b7fe700 1 -- 172.21.15.133:0/829250377 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439977496 0 0) 0x7f916c065000 con 0x7f916c0a3d90 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916b7fe700 1 -- 172.21.15.133:0/829250377 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f915c0033f0 con 0x7f916c0a3d90 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 -- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 msgr2=0x7f916c0bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 -- 172.21.15.133:0/829250377 >> v1:172.21.15.133:6789/0 conn(0x7f916c0a3d90 legacy=0x7f916c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 -- 172.21.15.133:0/829250377 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c0646d0 con 0x7f916c065490 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f9170db7700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.773+0000 7f916bfff700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c065490 0x7f916c0658d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9158009760 tx=0x7f9158009060).ready entity=mon.1 client_cookie=d1ca9c45528c2446 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f916b7fe700 1 -- 172.21.15.133:0/829250377 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580090d0 con 0x7f916c065490 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f916b7fe700 1 -- 172.21.15.133:0/829250377 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915800d4a0 con 0x7f916c065490 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f916b7fe700 1 -- 172.21.15.133:0/829250377 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800d820 con 0x7f916c065490 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 -- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c065490 msgr2=0x7f916c0658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c065490 0x7f916c0658d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9158009760 tx=0x7f9158009060).stop 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 -- 172.21.15.133:0/829250377 shutdown_connections 2024-01-21T21:14:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 --2- 172.21.15.133:0/829250377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c065490 0x7f916c0658d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 -- 172.21.15.133:0/829250377 >> 172.21.15.133:0/829250377 conn(0x7f916c0c6ef0 msgr2=0x7f916c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 -- 172.21.15.133:0/829250377 shutdown_connections 2024-01-21T21:14:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.774+0000 7f917301b700 1 -- 172.21.15.133:0/829250377 wait complete. 2024-01-21T21:14:53.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.775+0000 7f917301b700 1 Processor -- start 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.775+0000 7f917301b700 1 -- start start 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 0x7f916c0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c092de0 con 0x7f916c065490 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0ac710 con 0x7f916c0a3d90 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f917301b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c091b90 con 0x7f916c0bc8a0 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f9170db7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f9170db7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46794/0 (socket says 172.21.15.133:46794) 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.776+0000 7f9170db7700 1 -- 172.21.15.133:0/1679819970 learned_addr learned my addr 172.21.15.133:0/1679819970 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f91715b8700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f916bfff700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 0x7f916c0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 -- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 msgr2=0x7f916c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 -- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 msgr2=0x7f916c0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 0x7f916c0c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 -- 172.21.15.133:0/1679819970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91600092a0 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f916bfff700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 0x7f916c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f9170db7700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f916000e980 tx=0x7f9160009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000ee70 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000c850 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91580092a0 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000cbd0 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.777+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c092110 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.778+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c092760 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.779+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 69) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f916001b400 con 0x7f916c065490 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.779+0000 7f91697fa700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 0x7f9150061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:53.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.779+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f916007aa30 con 0x7f916c065490 2024-01-21T21:14:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.779+0000 7f916bfff700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 0x7f9150061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:53.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.779+0000 7f916bfff700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 0x7f9150061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9158009760 tx=0x7f9158016000).ready entity=mgr.8379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:53.783+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f916004ba10 con 0x7f916c065490 2024-01-21T21:14:54.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.000+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f916c0bd9b0 con 0x7f916c065490 2024-01-21T21:14:54.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.865+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 70) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f9160078570 con 0x7f916c065490 2024-01-21T21:14:54.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.866+0000 7f91697fa700 1 -- 172.21.15.133:0/1679819970 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v70) v1 ==== 92+0+0 (secure 0 0 0) 0x7f9160072020 con 0x7f916c065490 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 msgr2=0x7f9150061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 0x7f9150061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9158009760 tx=0x7f9158016000).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 msgr2=0x7f916c0928f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f916000e980 tx=0x7f9160009060).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 shutdown_connections 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f915005f150 0x7f9150061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f916c0bc8a0 0x7f916c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f916c065490 0x7f916c0928f0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 --2- 172.21.15.133:0/1679819970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f916c0a3d90 0x7f916c0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 >> 172.21.15.133:0/1679819970 conn(0x7f916c0c6ef0 msgr2=0x7f916c155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 shutdown_connections 2024-01-21T21:14:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:54.868+0000 7f917301b700 1 -- 172.21.15.133:0/1679819970 wait complete. 2024-01-21T21:14:54.884 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T21:14:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.006+0000 7f0186d3a700 1 Processor -- start 2024-01-21T21:14:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 -- start start 2024-01-21T21:14:55.009 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:55.006+0000 7f2428602680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 0x7f0180153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f0180062b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0180153750 con 0x7f0180155d30 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800671e0 con 0x7f0180066e00 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.007+0000 7f0186d3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0180063060 con 0x7f01800626f0 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f01852d7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0180155d30 0x7f01801561c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43336/0 (socket says 172.21.15.133:43336) 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f01852d7700 1 -- 172.21.15.133:0/1812588320 learned_addr learned my addr 172.21.15.133:0/1812588320 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 --2- 172.21.15.133:0/1812588320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f0180062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f0184ad6700 1 --2- 172.21.15.133:0/1812588320 >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 0x7f0180153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017f7fe700 1 -- 172.21.15.133:0/1812588320 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681188910 0 0) 0x7f0180153750 con 0x7f0180155d30 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017f7fe700 1 -- 172.21.15.133:0/1812588320 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01700033f0 con 0x7f0180155d30 2024-01-21T21:14:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 -- 172.21.15.133:0/1812588320 >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 msgr2=0x7f0180153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 --2- 172.21.15.133:0/1812588320 >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 0x7f0180153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 -- 172.21.15.133:0/1812588320 >> v1:172.21.15.133:6789/0 conn(0x7f0180155d30 legacy=0x7f01801561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 -- 172.21.15.133:0/1812588320 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800662e0 con 0x7f01800626f0 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f0184ad6700 1 --2- 172.21.15.133:0/1812588320 >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 0x7f0180153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017ffff700 1 --2- 172.21.15.133:0/1812588320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f0180062b70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f016c009760 tx=0x7f016c009060).ready entity=mon.2 client_cookie=ff102b5880dea8d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017f7fe700 1 -- 172.21.15.133:0/1812588320 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c009120 con 0x7f01800626f0 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017f7fe700 1 -- 172.21.15.133:0/1812588320 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00d4a0 con 0x7f01800626f0 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.008+0000 7f017f7fe700 1 -- 172.21.15.133:0/1812588320 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00d820 con 0x7f01800626f0 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 -- 172.21.15.133:0/1812588320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 msgr2=0x7f0180062b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 --2- 172.21.15.133:0/1812588320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f0180062b70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f016c009760 tx=0x7f016c009060).stop 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 -- 172.21.15.133:0/1812588320 shutdown_connections 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 --2- 172.21.15.133:0/1812588320 >> v2:172.21.15.178:3300/0 conn(0x7f0180066e00 0x7f0180153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 --2- 172.21.15.133:0/1812588320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f0180062b70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 -- 172.21.15.133:0/1812588320 >> 172.21.15.133:0/1812588320 conn(0x7f01800c7dc0 msgr2=0x7f01800c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 -- 172.21.15.133:0/1812588320 shutdown_connections 2024-01-21T21:14:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.009+0000 7f0186d3a700 1 -- 172.21.15.133:0/1812588320 wait complete. 2024-01-21T21:14:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.010+0000 7f0186d3a700 1 Processor -- start 2024-01-21T21:14:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.010+0000 7f0186d3a700 1 -- start start 2024-01-21T21:14:55.013 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f15006b5680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f018014f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 0x7f01801561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180156b80 con 0x7f0180155d30 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c0640 con 0x7f0180066e00 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0186d3a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0180162270 con 0x7f01800626f0 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f01852d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f01852d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46816/0 (socket says 172.21.15.133:46816) 2024-01-21T21:14:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f01852d7700 1 -- 172.21.15.133:0/2590883538 learned_addr learned my addr 172.21.15.133:0/2590883538 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f0184ad6700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f018014f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.011+0000 7f017ffff700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 0x7f01801561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 -- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 msgr2=0x7f018014f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f018014f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 -- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 msgr2=0x7f01801561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 0x7f01801561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 -- 172.21.15.133:0/2590883538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740092a0 con 0x7f0180155d30 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f0184ad6700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f018014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f017ffff700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 0x7f01801561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f01852d7700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f0178005ad0 tx=0x7f01780015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0178005d30 con 0x7f0180155d30 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0178005e90 con 0x7f0180155d30 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016c0092a0 con 0x7f0180155d30 2024-01-21T21:14:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780072e0 con 0x7f0180155d30 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.012+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800ab780 con 0x7f0180155d30 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.013+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800c07d0 con 0x7f0180155d30 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.014+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 70) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f01780076d0 con 0x7f0180155d30 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.014+0000 7f017d7fa700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 0x7f0164061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.014+0000 7f0184ad6700 1 -- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 msgr2=0x7f0164061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.015+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f0178079d50 con 0x7f0180155d30 2024-01-21T21:14:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.015+0000 7f0184ad6700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 0x7f0164061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.019+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f017807d030 con 0x7f0180155d30 2024-01-21T21:14:55.072 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:55.070+0000 7f2428602680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:14:55.079 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:55.078+0000 7f15006b5680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:14:55.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.191+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0180069990 con 0x7f0180155d30 2024-01-21T21:14:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.195+0000 7f017d7fa700 1 -- 172.21.15.133:0/2590883538 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f017804ad30 con 0x7f0180155d30 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 msgr2=0x7f0164061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 0x7f0164061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 msgr2=0x7f0180156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f0178005ad0 tx=0x7f01780015b0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 shutdown_connections 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f016405f1a0 0x7f0164061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0180155d30 0x7f0180156690 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800626f0 0x7f018014f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 --2- 172.21.15.133:0/2590883538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180066e00 0x7f01801561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 >> 172.21.15.133:0/2590883538 conn(0x7f01800c7dc0 msgr2=0x7f01800c6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 shutdown_connections 2024-01-21T21:14:55.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.198+0000 7f0186d3a700 1 -- 172.21.15.133:0/2590883538 wait complete. 2024-01-21T21:14:55.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:14:55.212 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T21:14:55.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2024-01-21T21:14:55.345 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:55.343+0000 7f2428602680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:14:55.378 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:55.376+0000 7f15006b5680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:14:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.395+0000 7f5fb6ee6700 1 Processor -- start 2024-01-21T21:14:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.395+0000 7f5fb6ee6700 1 -- start start 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb6ee6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb6ee6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fb00c5330 0x7f5fb0153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb6ee6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00c37c0 con 0x7f5fb0157f30 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb6ee6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0158ed0 con 0x7f5fb00c5330 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb6ee6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01583b0 con 0x7f5fb0066b50 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fb00c5330 0x7f5fb0153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5fb00c5330 0x7f5fb0153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46820/0 (socket says 172.21.15.133:46820) 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 -- 172.21.15.133:0/1545904632 learned_addr learned my addr 172.21.15.133:0/1545904632 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5faffff700 1 --1- 172.21.15.133:0/1545904632 >> v1:172.21.15.133:6789/0 conn(0x7f5fb0157f30 0x7f5fb00bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43340/0 (socket says 172.21.15.133:43340) 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 -- 172.21.15.133:0/1545904632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 msgr2=0x7f5fb0066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 -- 172.21.15.133:0/1545904632 >> v1:172.21.15.133:6789/0 conn(0x7f5fb0157f30 legacy=0x7f5fb00bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5faf7fe700 1 -- 172.21.15.133:0/1545904632 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665274232 0 0) 0x7f5fb00c37c0 con 0x7f5fb0157f30 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.396+0000 7f5fb5483700 1 -- 172.21.15.133:0/1545904632 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00c57c0 con 0x7f5fb00c5330 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb5483700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb0153e50 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f5fa8009f20 tx=0x7f5fa8009840).ready entity=mon.0 client_cookie=1c2d55a3d7ee0bf6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5faf7fe700 1 -- 172.21.15.133:0/1545904632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800e070 con 0x7f5fb00c5330 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5faf7fe700 1 -- 172.21.15.133:0/1545904632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800b9d0 con 0x7f5fb00c5330 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5faf7fe700 1 -- 172.21.15.133:0/1545904632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800bd50 con 0x7f5fb00c5330 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/1545904632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 msgr2=0x7f5fb0153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb0153e50 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f5fa8009f20 tx=0x7f5fa8009840).stop 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/1545904632 shutdown_connections 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb0153e50 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/1545904632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/1545904632 >> 172.21.15.133:0/1545904632 conn(0x7f5fb00c8f60 msgr2=0x7f5fb00c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/1545904632 shutdown_connections 2024-01-21T21:14:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.397+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/1545904632 wait complete. 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 Processor -- start 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 -- start start 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fb0157f30 0x7f5fb0164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ad750 con 0x7f5fb00c5330 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ae550 con 0x7f5fb0157f30 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.399+0000 7f5fb6ee6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00ad940 con 0x7f5fb0066b50 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:46824/0 (socket says 172.21.15.133:46824) 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 -- 172.21.15.133:0/453278910 learned_addr learned my addr 172.21.15.133:0/453278910 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fb5483700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fb0157f30 0x7f5fb0164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 msgr2=0x7f5fb0147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fb0157f30 msgr2=0x7f5fb0164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fb0157f30 0x7f5fb0164e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009ae0 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5faffff700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f5f9c00c490 tx=0x7f5f9c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0070d0 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c007230 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00adc20 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0056e0 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.400+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00ae1e0 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.401+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00ae6e0 con 0x7f5fb00c5330 2024-01-21T21:14:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.402+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 70) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f5f9c005ca0 con 0x7f5fb00c5330 2024-01-21T21:14:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.402+0000 7f5fad7fa700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:14:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.402+0000 7f5fb4c82700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.402+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f5f9c079e60 con 0x7f5fb00c5330 2024-01-21T21:14:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.402+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:14:55.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.406+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5f9c04aea0 con 0x7f5fb00c5330 2024-01-21T21:14:55.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.602+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fb0158630 con 0x7f5f9405f1a0 2024-01-21T21:14:55.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.603+0000 7f5fb4c82700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:55.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:55.603+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:14:55.956 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:55.954+0000 7f2428602680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:14:56.001 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:55.999+0000 7f15006b5680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:14:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:56.004+0000 7f5fb4c82700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:56.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:56.004+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T21:14:56.027 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.026+0000 7f2428602680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:14:56.072 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:56.071+0000 7f15006b5680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:14:56.212 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.210+0000 7f2428602680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:14:56.260 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:56.258+0000 7f15006b5680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:14:56.630 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.629+0000 7f2428602680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:14:56.680 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:56.678+0000 7f15006b5680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:14:56.732 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.731+0000 7f2428602680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:56.783 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:56.782+0000 7f15006b5680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:56.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:56.805+0000 7f5fb4c82700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:56.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:56.805+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T21:14:56.884 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.883+0000 7f2428602680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:56.938 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:56.937+0000 7f15006b5680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:56.959 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:56.957+0000 7f2428602680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:14:57.013 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:57.011+0000 7f15006b5680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:14:57.026 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:57.024+0000 7f2428602680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:14:57.080 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:57.079+0000 7f15006b5680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:14:57.279 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:57.278+0000 7f2428602680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:14:57.337 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:57.335+0000 7f15006b5680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:14:57.463 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:57.461+0000 7f2428602680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:57.521 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:57.519+0000 7f15006b5680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:14:58.111 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.109+0000 7f2428602680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:14:58.171 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.169+0000 7f15006b5680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:14:58.178 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.177+0000 7f2428602680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:14:58.239 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.238+0000 7f15006b5680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:14:58.253 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.252+0000 7f2428602680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:14:58.315 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.313+0000 7f15006b5680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:14:58.399 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.397+0000 7f2428602680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:14:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:58.406+0000 7f5fb4c82700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:14:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:58.406+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T21:14:58.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.462+0000 7f15006b5680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:14:58.468 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.467+0000 7f2428602680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:14:58.533 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.532+0000 7f15006b5680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:14:58.582 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.581+0000 7f2428602680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:14:58.649 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.648+0000 7f15006b5680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:14:58.689 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.687+0000 7f2428602680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:58.757 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:58.755+0000 7f15006b5680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:14:58.982 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:58.980+0000 7f2428602680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:14:59.051 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.050+0000 7f15006b5680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:14:59.052 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:14:59.051+0000 7f2428602680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:14:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:59.120+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 71) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f5f9c07d030 con 0x7f5fb00c5330 2024-01-21T21:14:59.124 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.123+0000 7f15006b5680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:14:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:59.143+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 72) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f5f9c077d20 con 0x7f5fb00c5330 2024-01-21T21:14:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:59.143+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f94061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:14:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:14:59.143+0000 7f5fad7fa700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f94061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f1474455700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f1474455700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f1474455700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f1474455700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f1474455700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.208 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f147745b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.209 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f147745b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.209 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f147745b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.209 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f147745b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:14:59.209 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:14:59.206+0000 7f147745b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.145+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mon.0 v2:172.21.15.133:3300/0 9 ==== mgrmap(e 73) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f5f9c0429f0 con 0x7f5fb00c5330 2024-01-21T21:15:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.146+0000 7f5fad7fa700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f940615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.146+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fb0158630 con 0x7f5f9405f1a0 2024-01-21T21:15:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.146+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f940615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.148+0000 7f5fb4c82700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f940615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5fb00c7980 tx=0x7f5fa4009060).ready entity=mgr.8790 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.164+0000 7f5fad7fa700 1 -- 172.21.15.133:0/453278910 <== mgr.8790 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5fb0158630 con 0x7f5f9405f1a0 2024-01-21T21:15:00.166 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 msgr2=0x7f5f940615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f940615e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f5fb00c7980 tx=0x7f5fa4009060).stop 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 msgr2=0x7f5fb00ad260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f5f9c00c490 tx=0x7f5f9c007e00).stop 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 shutdown_connections 2024-01-21T21:15:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f5f9405f1a0 0x7f5f940615e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fb0157f30 0x7f5fb0164e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fb0066b50 0x7f5fb0147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 --2- 172.21.15.133:0/453278910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fb00c5330 0x7f5fb00ad260 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 >> 172.21.15.133:0/453278910 conn(0x7f5fb00c8f60 msgr2=0x7f5fb00aade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 shutdown_connections 2024-01-21T21:15:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.167+0000 7f5fb6ee6700 1 -- 172.21.15.133:0/453278910 wait complete. 2024-01-21T21:15:00.182 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T21:15:00.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2024-01-21T21:15:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.306+0000 7fc5d3f24700 1 Processor -- start 2024-01-21T21:15:00.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 -- start start 2024-01-21T21:15:00.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc157f30 0x7fc5cc0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5cc0bdec0 0x7fc5cc153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc158ed0 con 0x7fc5cc157f30 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c5820 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.307+0000 7fc5d3f24700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c37c0 con 0x7fc5cc066b50 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc157f30 0x7fc5cc0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5cc157f30 0x7fc5cc0c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58618/0 (socket says 172.21.15.133:58618) 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 -- 172.21.15.133:0/500177592 learned_addr learned my addr 172.21.15.133:0/500177592 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d1cc0700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d24c1700 1 --2- 172.21.15.133:0/500177592 >> v2:172.21.15.178:3300/0 conn(0x7fc5cc0bdec0 0x7fc5cc153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 -- 172.21.15.133:0/500177592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 msgr2=0x7fc5cc066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 -- 172.21.15.133:0/500177592 >> v2:172.21.15.178:3300/0 conn(0x7fc5cc0bdec0 msgr2=0x7fc5cc153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/500177592 >> v2:172.21.15.178:3300/0 conn(0x7fc5cc0bdec0 0x7fc5cc153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 -- 172.21.15.133:0/500177592 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc1583b0 con 0x7fc5cc157f30 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d1cc0700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0c5330 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fc5cc0c9e50 tx=0x7fc5c00090f0).ready entity=mon.0 client_cookie=1790b97adebfe861 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d0cbe700 1 -- 172.21.15.133:0/500177592 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000b600 con 0x7fc5cc157f30 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d0cbe700 1 -- 172.21.15.133:0/500177592 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000b760 con 0x7fc5cc157f30 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.308+0000 7fc5d0cbe700 1 -- 172.21.15.133:0/500177592 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000bb00 con 0x7fc5cc157f30 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 -- 172.21.15.133:0/500177592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc157f30 msgr2=0x7fc5cc0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0c5330 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fc5cc0c9e50 tx=0x7fc5c00090f0).stop 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 -- 172.21.15.133:0/500177592 shutdown_connections 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/500177592 >> v2:172.21.15.178:3300/0 conn(0x7fc5cc0bdec0 0x7fc5cc153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/500177592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0c5330 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 -- 172.21.15.133:0/500177592 >> 172.21.15.133:0/500177592 conn(0x7fc5cc0c8f60 msgr2=0x7fc5cc0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 -- 172.21.15.133:0/500177592 shutdown_connections 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.309+0000 7fc5d3f24700 1 -- 172.21.15.133:0/500177592 wait complete. 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.310+0000 7fc5d3f24700 1 Processor -- start 2024-01-21T21:15:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.310+0000 7fc5d3f24700 1 -- start start 2024-01-21T21:15:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc0c1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0aeab0 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c1f50 con 0x7fc5cc157f30 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d3f24700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0adbc0 con 0x7fc5cc066b50 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58622/0 (socket says 172.21.15.133:58622) 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 -- 172.21.15.133:0/3774090793 learned_addr learned my addr 172.21.15.133:0/3774090793 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d24c1700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d1cc0700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc0c1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 -- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 msgr2=0x7fc5cc0c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc0c1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 -- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5cc157f30 msgr2=0x7fc5cc0acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 -- 172.21.15.133:0/3774090793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c0009370 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.311+0000 7fc5d14bf700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc5c0011000 tx=0x7fc5c0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.312+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0006d90 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.312+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000bec0 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.312+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc0adea0 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.312+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0002f30 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.312+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc0ae460 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.313+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0aec60 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.313+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 73) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc5c0021070 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.313+0000 7fc5ca7fc700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 0x7fc5b8061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.313+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fc5c007bb90 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.313+0000 7fc5d1cc0700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 0x7fc5b8061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.314+0000 7fc5d1cc0700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 0x7fc5b8061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc5c4006d80 tx=0x7fc5c4008040).ready entity=mgr.8790 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.317+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc5cc0aec60 con 0x7fc5cc0bdec0 2024-01-21T21:15:00.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.504+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5cc05fdf0 con 0x7fc5b805f0b0 2024-01-21T21:15:00.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.508+0000 7fc5ca7fc700 1 -- 172.21.15.133:0/3774090793 <== mgr.8790 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc5cc05fdf0 con 0x7fc5b805f0b0 2024-01-21T21:15:00.510 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path snap_test_dir1 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 msgr2=0x7fc5b8061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 0x7fc5b8061570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fc5c4006d80 tx=0x7fc5c4008040).stop 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 msgr2=0x7fc5cc0ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fc5c0011000 tx=0x7fc5c0017000).stop 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 shutdown_connections 2024-01-21T21:15:00.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc5b805f0b0 0x7fc5b8061570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5cc157f30 0x7fc5cc0acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5cc066b50 0x7fc5cc0c1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 --2- 172.21.15.133:0/3774090793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5cc0bdec0 0x7fc5cc0ac8c0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 >> 172.21.15.133:0/3774090793 conn(0x7fc5cc0c8f60 msgr2=0x7fc5cc0c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 shutdown_connections 2024-01-21T21:15:00.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.510+0000 7fc5d3f24700 1 -- 172.21.15.133:0/3774090793 wait complete. 2024-01-21T21:15:00.524 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-01-21T21:15:00.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2024-01-21T21:15:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.642+0000 7f6874208700 1 Processor -- start 2024-01-21T21:15:00.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.642+0000 7f6874208700 1 -- start start 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6874208700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f686c069be0 0x7f686c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6874208700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c0c23b0 con 0x7f686c13a7b0 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6874208700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c067600 con 0x7f686c0bda90 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6874208700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0663c0 con 0x7f686c069be0 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f68727a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f686c069be0 0x7f686c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6871fa4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f686c13a7b0 0x7f686c066b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54628/0 (socket says 172.21.15.133:54628) 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.643+0000 7f6871fa4700 1 -- 172.21.15.133:0/1360863132 learned_addr learned my addr 172.21.15.133:0/1360863132 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:00.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f68727a5700 1 -- 172.21.15.133:0/1360863132 >> v1:172.21.15.178:6789/0 conn(0x7f686c0bda90 legacy=0x7f686c0694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f68727a5700 1 -- 172.21.15.133:0/1360863132 >> v1:172.21.15.133:6789/0 conn(0x7f686c13a7b0 legacy=0x7f686c066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f68727a5700 1 -- 172.21.15.133:0/1360863132 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c0678e0 con 0x7f686c069be0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6870fa2700 1 -- 172.21.15.133:0/1360863132 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570696116 0 0) 0x7f686c0c23b0 con 0x7f686c13a7b0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f68727a5700 1 --2- 172.21.15.133:0/1360863132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c069be0 0x7f686c15bba0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f6864009e60 tx=0x7f6864009780).ready entity=mon.0 client_cookie=23d6ab40b5b02a34 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6870fa2700 1 -- 172.21.15.133:0/1360863132 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400e070 con 0x7f686c069be0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6870fa2700 1 -- 172.21.15.133:0/1360863132 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686400bc30 con 0x7f686c069be0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6870fa2700 1 -- 172.21.15.133:0/1360863132 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864012410 con 0x7f686c069be0 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 -- 172.21.15.133:0/1360863132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c069be0 msgr2=0x7f686c15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 --2- 172.21.15.133:0/1360863132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c069be0 0x7f686c15bba0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f6864009e60 tx=0x7f6864009780).stop 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 -- 172.21.15.133:0/1360863132 shutdown_connections 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 --2- 172.21.15.133:0/1360863132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c069be0 0x7f686c15bba0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 -- 172.21.15.133:0/1360863132 >> 172.21.15.133:0/1360863132 conn(0x7f686c0c7d20 msgr2=0x7f686c0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.644+0000 7f6874208700 1 -- 172.21.15.133:0/1360863132 shutdown_connections 2024-01-21T21:15:00.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.645+0000 7f6874208700 1 -- 172.21.15.133:0/1360863132 wait complete. 2024-01-21T21:15:00.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 Processor -- start 2024-01-21T21:15:00.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 -- start start 2024-01-21T21:15:00.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f686c069be0 0x7f686c0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f686c13a7b0 0x7f686c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c0626f0 0x7f686c062b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c1669a0 con 0x7f686c0626f0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c14e640 con 0x7f686c13a7b0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.646+0000 7f6874208700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0c1910 con 0x7f686c069be0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c0626f0 0x7f686c062b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c0626f0 0x7f686c062b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58632/0 (socket says 172.21.15.133:58632) 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 -- 172.21.15.133:0/4260869993 learned_addr learned my addr 172.21.15.133:0/4260869993 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68717a3700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f686c13a7b0 0x7f686c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f6871fa4700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f686c069be0 0x7f686c0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 -- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f686c069be0 msgr2=0x7f686c0c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f686c069be0 0x7f686c0c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 -- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f686c13a7b0 msgr2=0x7f686c14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f686c13a7b0 0x7f686c14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:00.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 -- 172.21.15.133:0/4260869993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6864009a20 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68717a3700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f686c13a7b0 0x7f686c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68727a5700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f686c0626f0 0x7f686c062b70 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f686400b6c0 tx=0x7f6864009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864021070 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68640117d0 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f6874208700 1 -- 172.21.15.133:0/4260869993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c063060 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864011b90 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.647+0000 7f6874208700 1 -- 172.21.15.133:0/4260869993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c0c0fe0 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.648+0000 7f6874208700 1 -- 172.21.15.133:0/4260869993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c0c1ac0 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.648+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 73) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f686401d420 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.649+0000 7f68627fc700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f685005f080 0x7f6850061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.649+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f686407c320 con 0x7f686c0626f0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.649+0000 7f6871fa4700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f685005f080 0x7f6850061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:00.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.649+0000 7f6871fa4700 1 --2- 172.21.15.133:0/4260869993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f685005f080 0x7f6850061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f685c00c7d0 tx=0x7f685c009040).ready entity=mgr.8790 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:00.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.653+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f686c0c1ac0 con 0x7f686c0626f0 2024-01-21T21:15:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.840+0000 7f6874208700 1 -- 172.21.15.133:0/4260869993 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f686c0c1a80 con 0x7f685005f080 2024-01-21T21:15:00.842 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:00.841+0000 7f147f46b700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2024-01-21T21:15:00.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:00.841+0000 7f68627fc700 1 -- 172.21.15.133:0/4260869993 <== mgr.8790 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f686c0c1a80 con 0x7f685005f080 2024-01-21T21:15:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2024-01-21T21:15:00.847 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-01-21T21:15:00.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:15:00.848 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T21:15:00.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T21:15:01.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.023+0000 7fc62b653700 1 Processor -- start 2024-01-21T21:15:01.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.023+0000 7fc62b653700 1 -- start start 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc62b653700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc624155cb0 0x7fc624156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc62b653700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6240bde60 0x7fc6240be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc62b653700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc624156650 con 0x7fc6241351d0 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc62b653700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240c61a0 con 0x7fc6240bde60 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc62b653700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240c5350 con 0x7fc624155cb0 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc629bf0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6240bde60 0x7fc6240be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.024+0000 7fc6293ef700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6241351d0 0x7fc6240c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54634/0 (socket says 172.21.15.133:54634) 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc6293ef700 1 -- 172.21.15.133:0/283716039 learned_addr learned my addr 172.21.15.133:0/283716039 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc628bee700 1 --2- 172.21.15.133:0/283716039 >> v2:172.21.15.178:3300/0 conn(0x7fc624155cb0 0x7fc624156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc629bf0700 1 -- 172.21.15.133:0/283716039 >> v2:172.21.15.178:3300/0 conn(0x7fc624155cb0 msgr2=0x7fc624156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc629bf0700 1 --2- 172.21.15.133:0/283716039 >> v2:172.21.15.178:3300/0 conn(0x7fc624155cb0 0x7fc624156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc629bf0700 1 -- 172.21.15.133:0/283716039 >> v1:172.21.15.133:6789/0 conn(0x7fc6241351d0 legacy=0x7fc6240c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc629bf0700 1 -- 172.21.15.133:0/283716039 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240c55d0 con 0x7fc6240bde60 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc61bfff700 1 -- 172.21.15.133:0/283716039 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016900566 0 0) 0x7fc614001110 con 0x7fc6241351d0 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc629bf0700 1 --2- 172.21.15.133:0/283716039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240be2b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fc62406a7e0 tx=0x7fc61c009780).ready entity=mon.0 client_cookie=df4281c791a7db4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc61bfff700 1 -- 172.21.15.133:0/283716039 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00e070 con 0x7fc6240bde60 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc61bfff700 1 -- 172.21.15.133:0/283716039 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61c00bc30 con 0x7fc6240bde60 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.025+0000 7fc61bfff700 1 -- 172.21.15.133:0/283716039 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61c012410 con 0x7fc6240bde60 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 -- 172.21.15.133:0/283716039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 msgr2=0x7fc6240be2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 --2- 172.21.15.133:0/283716039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240be2b0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fc62406a7e0 tx=0x7fc61c009780).stop 2024-01-21T21:15:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 -- 172.21.15.133:0/283716039 shutdown_connections 2024-01-21T21:15:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 --2- 172.21.15.133:0/283716039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240be2b0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 --2- 172.21.15.133:0/283716039 >> v2:172.21.15.178:3300/0 conn(0x7fc624155cb0 0x7fc624156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 -- 172.21.15.133:0/283716039 >> 172.21.15.133:0/283716039 conn(0x7fc624066a90 msgr2=0x7fc624066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 -- 172.21.15.133:0/283716039 shutdown_connections 2024-01-21T21:15:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.026+0000 7fc62b653700 1 -- 172.21.15.133:0/283716039 wait complete. 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.027+0000 7fc62b653700 1 Processor -- start 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.027+0000 7fc62b653700 1 -- start start 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6241351d0 0x7fc6240acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc624155cb0 0x7fc6240ad210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240acbc0 con 0x7fc6240bde60 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ae520 con 0x7fc624155cb0 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240ad700 con 0x7fc6241351d0 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58660/0 (socket says 172.21.15.133:58660) 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 -- 172.21.15.133:0/654742627 learned_addr learned my addr 172.21.15.133:0/654742627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc629bf0700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc624155cb0 0x7fc6240ad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc628bee700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6241351d0 0x7fc6240acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 -- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6241351d0 msgr2=0x7fc6240acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6241351d0 0x7fc6240acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 -- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc624155cb0 msgr2=0x7fc6240ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc624155cb0 0x7fc6240ad210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 -- 172.21.15.133:0/654742627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c009a20 con 0x7fc6240bde60 2024-01-21T21:15:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc6293ef700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fc614001eb0 tx=0x7fc614007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140070d0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614007230 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140075d0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.028+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6240c7ce0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.029+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6241683e0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.030+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62405fdf0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.030+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 73) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc614005bc0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.030+0000 7fc619ffb700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 0x7fc608061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.030+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fc6140799a0 con 0x7fc6240bde60 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.030+0000 7fc628bee700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 0x7fc608061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:01.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.031+0000 7fc628bee700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 0x7fc608061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc624150210 tx=0x7fc620008040).ready entity=mgr.8790 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:01.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.034+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc61404ab00 con 0x7fc6240bde60 2024-01-21T21:15:01.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:01.245+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fc624156650 con 0x7fc6240bde60 2024-01-21T21:15:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.152+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc614077600 con 0x7fc6240bde60 2024-01-21T21:15:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.154+0000 7fc619ffb700 1 -- 172.21.15.133:0/654742627 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v74) v1 ==== 93+0+0 (secure 0 0 0) 0x7fc614073260 con 0x7fc6240bde60 2024-01-21T21:15:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.157+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 msgr2=0x7fc608061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.157+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 0x7fc608061540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc624150210 tx=0x7fc620008040).stop 2024-01-21T21:15:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.157+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 msgr2=0x7fc6240c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.157+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fc614001eb0 tx=0x7fc614007e90).stop 2024-01-21T21:15:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 shutdown_connections 2024-01-21T21:15:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc60805f080 0x7fc608061540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc624155cb0 0x7fc6240ad210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6240bde60 0x7fc6240c9570 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 --2- 172.21.15.133:0/654742627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6241351d0 0x7fc6240acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 >> 172.21.15.133:0/654742627 conn(0x7fc624066a90 msgr2=0x7fc6241396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 shutdown_connections 2024-01-21T21:15:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.158+0000 7fc62b653700 1 -- 172.21.15.133:0/654742627 wait complete. 2024-01-21T21:15:02.175 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:15:02.175 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:15:02.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:15:02.262 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:15:02.262 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T21:15:02.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:15:02.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T21:15:02.298 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:02.297+0000 7fe40a14b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:15:02.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:15:02.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:02.301 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T21:15:02.305 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:02.304+0000 7fb6282d0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:15:02.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:02.361 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:02.359+0000 7fe40a14b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:15:02.371 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:02.370+0000 7fb6282d0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:15:02.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.480+0000 7f10ad5de700 1 Processor -- start 2024-01-21T21:15:02.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.480+0000 7f10ad5de700 1 -- start start 2024-01-21T21:15:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10ad5de700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 0x7f10a8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10ad5de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a80c0e40 con 0x7f10a8154520 2024-01-21T21:15:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10ad5de700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a8154980 con 0x7f10a80c8120 2024-01-21T21:15:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10ad5de700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80c6ae0 con 0x7f10a8154140 2024-01-21T21:15:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a67fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f10a8154520 0x7f10a80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54654/0 (socket says 172.21.15.133:54654) 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a67fc700 1 -- 172.21.15.133:0/2814382660 learned_addr learned my addr 172.21.15.133:0/2814382660 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a6ffd700 1 --2- 172.21.15.133:0/2814382660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 0x7f10a8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103841872 0 0) 0x7f10a80c0e40 con 0x7f10a8154520 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10900033f0 con 0x7f10a8154520 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738082083 0 0) 0x7f10a8154980 con 0x7f10a80c8120 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.481+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a80c0e40 con 0x7f10a80c8120 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a6ffd700 1 -- 172.21.15.133:0/2814382660 >> v1:172.21.15.178:6789/0 conn(0x7f10a80c8120 legacy=0x7f10a80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a6ffd700 1 -- 172.21.15.133:0/2814382660 >> v1:172.21.15.133:6789/0 conn(0x7f10a8154520 legacy=0x7f10a80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2578499624 0 0) 0x7f10900033f0 con 0x7f10a8154520 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a6ffd700 1 -- 172.21.15.133:0/2814382660 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80c6800 con 0x7f10a8154140 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a6ffd700 1 --2- 172.21.15.133:0/2814382660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 0x7f10a8158bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1098009790 tx=0x7f1098009060).ready entity=mon.2 client_cookie=910a00468b0a8832 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c001470 con 0x7f10a8154140 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098011400 con 0x7f10a8154140 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10a5ffb700 1 -- 172.21.15.133:0/2814382660 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098011780 con 0x7f10a8154140 2024-01-21T21:15:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10ad5de700 1 -- 172.21.15.133:0/2814382660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 msgr2=0x7f10a8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.482+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2814382660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 0x7f10a8158bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f1098009790 tx=0x7f1098009060).stop 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.483+0000 7f10ad5de700 1 -- 172.21.15.133:0/2814382660 shutdown_connections 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.483+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2814382660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a8154140 0x7f10a8158bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.483+0000 7f10ad5de700 1 -- 172.21.15.133:0/2814382660 >> 172.21.15.133:0/2814382660 conn(0x7f10a805e1e0 msgr2=0x7f10a805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.483+0000 7f10ad5de700 1 -- 172.21.15.133:0/2814382660 shutdown_connections 2024-01-21T21:15:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.483+0000 7f10ad5de700 1 -- 172.21.15.133:0/2814382660 wait complete. 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.484+0000 7f10ad5de700 1 Processor -- start 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.484+0000 7f10ad5de700 1 -- start start 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a80c8120 0x7f10a81448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 0x7f10a80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8144d90 con 0x7f10a8154140 2024-01-21T21:15:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a8155570 con 0x7f10a8154520 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10ad5de700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80b10e0 con 0x7f10a80c8120 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10a67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10a67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58672/0 (socket says 172.21.15.133:58672) 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10a67fc700 1 -- 172.21.15.133:0/2556816830 learned_addr learned my addr 172.21.15.133:0/2556816830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10a6ffd700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a80c8120 0x7f10a81448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.485+0000 7f10a77fe700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 0x7f10a80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a80c8120 msgr2=0x7f10a81448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a80c8120 0x7f10a81448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 msgr2=0x7f10a80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 0x7f10a80b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 -- 172.21.15.133:0/2556816830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980092a0 con 0x7f10a8154140 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a77fe700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 0x7f10a80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10a67fc700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f109c00c810 tx=0x7f109c0019b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0072e0 con 0x7f10a8154140 2024-01-21T21:15:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a80ae7f0 con 0x7f10a8154140 2024-01-21T21:15:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a80ae1a0 con 0x7f10a8154140 2024-01-21T21:15:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c007460 con 0x7f10a8154140 2024-01-21T21:15:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.486+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0059f0 con 0x7f10a8154140 2024-01-21T21:15:02.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.488+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1088005120 con 0x7f10a8154140 2024-01-21T21:15:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.488+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f109c013450 con 0x7f10a8154140 2024-01-21T21:15:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.488+0000 7f108f7fe700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 0x7f10940617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.489+0000 7f10a6ffd700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 msgr2=0x7f10940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.489+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f109c079fb0 con 0x7f10a8154140 2024-01-21T21:15:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.489+0000 7f10a6ffd700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 0x7f10940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:02.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.492+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f109c04ace0 con 0x7f10a8154140 2024-01-21T21:15:02.635 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:02.633+0000 7fe40a14b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:15:02.660 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:02.658+0000 7fb6282d0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:15:02.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.690+0000 7f10a6ffd700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 msgr2=0x7f10940617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:02.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.690+0000 7f10a6ffd700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 0x7f10940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:15:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.705+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10880057f0 con 0x7f10a8154140 2024-01-21T21:15:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.705+0000 7f108f7fe700 1 -- 172.21.15.133:0/2556816830 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f109c018070 con 0x7f10a8154140 2024-01-21T21:15:02.706 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:02.707 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 msgr2=0x7f10940617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 0x7f10940617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 msgr2=0x7f10a80c2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f109c00c810 tx=0x7f109c0019b0).stop 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 shutdown_connections 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f109405f300 0x7f10940617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a8154520 0x7f10a80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a80c8120 0x7f10a81448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 --2- 172.21.15.133:0/2556816830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10a8154140 0x7f10a80c2160 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 >> 172.21.15.133:0/2556816830 conn(0x7f10a805e1e0 msgr2=0x7f10a80ac680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 shutdown_connections 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.707+0000 7f10ad5de700 1 -- 172.21.15.133:0/2556816830 wait complete. 2024-01-21T21:15:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:15:02.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.878+0000 7fc0186c9700 1 Processor -- start 2024-01-21T21:15:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.878+0000 7fc0186c9700 1 -- start start 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc0186c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010062c10 0x7fc010062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc0186c9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc010065d70 0x7fc0100bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc0186c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0100634e0 con 0x7fc0100697e0 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc0186c9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01006a130 con 0x7fc010065d70 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc0186c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01006a410 con 0x7fc010062c10 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc015c64700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc0100697e0 0x7fc010065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54662/0 (socket says 172.21.15.133:54662) 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.879+0000 7fc015c64700 1 -- 172.21.15.133:0/3004131515 learned_addr learned my addr 172.21.15.133:0/3004131515 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016465700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010062c10 0x7fc010062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 --2- 172.21.15.133:0/3004131515 >> v2:172.21.15.178:3300/0 conn(0x7fc010065d70 0x7fc0100bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc015463700 1 -- 172.21.15.133:0/3004131515 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708742843 0 0) 0x7fc0100634e0 con 0x7fc0100697e0 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc015463700 1 -- 172.21.15.133:0/3004131515 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbffc0033f0 con 0x7fc0100697e0 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 -- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010062c10 msgr2=0x7fc010062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010062c10 0x7fc010062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 -- 172.21.15.133:0/3004131515 >> v1:172.21.15.133:6789/0 conn(0x7fc0100697e0 legacy=0x7fc010065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 -- 172.21.15.133:0/3004131515 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01006a6f0 con 0x7fc010065d70 2024-01-21T21:15:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc016c66700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010065d70 0x7fc0100bd770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc008009e60 tx=0x7fc008009780).ready entity=mon.1 client_cookie=cb492b63345d94a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc015463700 1 -- 172.21.15.133:0/3004131515 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800e070 con 0x7fc010065d70 2024-01-21T21:15:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc015463700 1 -- 172.21.15.133:0/3004131515 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00800bab0 con 0x7fc010065d70 2024-01-21T21:15:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.880+0000 7fc015463700 1 -- 172.21.15.133:0/3004131515 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00800be30 con 0x7fc010065d70 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 -- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010065d70 msgr2=0x7fc0100bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010065d70 0x7fc0100bd770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fc008009e60 tx=0x7fc008009780).stop 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 -- 172.21.15.133:0/3004131515 shutdown_connections 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010062c10 0x7fc010062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 --2- 172.21.15.133:0/3004131515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010065d70 0x7fc0100bd770 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 -- 172.21.15.133:0/3004131515 >> 172.21.15.133:0/3004131515 conn(0x7fc0100c8010 msgr2=0x7fc0100c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 -- 172.21.15.133:0/3004131515 shutdown_connections 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.881+0000 7fc0186c9700 1 -- 172.21.15.133:0/3004131515 wait complete. 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.882+0000 7fc0186c9700 1 Processor -- start 2024-01-21T21:15:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.882+0000 7fc0186c9700 1 -- start start 2024-01-21T21:15:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010065d70 0x7fc0100ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100ac180 con 0x7fc0100697e0 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100adf30 con 0x7fc010062c10 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc0186c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0100abcc0 con 0x7fc010065d70 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016465700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc015c64700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010065d70 0x7fc0100ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58674/0 (socket says 172.21.15.133:58674) 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016465700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:45840/0 (socket says 172.21.15.133:45840) 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 -- 172.21.15.133:0/2664091837 learned_addr learned my addr 172.21.15.133:0/2664091837 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 -- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010065d70 msgr2=0x7fc0100ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010065d70 0x7fc0100ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 -- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 msgr2=0x7fc010154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016c66700 1 -- 172.21.15.133:0/2664091837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008009a20 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.883+0000 7fc016465700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc016c66700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fc00800b610 tx=0x7fc008009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008012ea0 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00801d630 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00801d9f0 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0100aa1d0 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.884+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0100aa790 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.885+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0100ac2f0 con 0x7fc0100697e0 2024-01-21T21:15:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.885+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fc008027460 con 0x7fc0100697e0 2024-01-21T21:15:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.886+0000 7fc006ffd700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 0x7fbff40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.886+0000 7fc016465700 1 -- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 msgr2=0x7fbff40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.886+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fc00807c6b0 con 0x7fc0100697e0 2024-01-21T21:15:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.886+0000 7fc016465700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 0x7fbff40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:02.890+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc00804d2d0 con 0x7fc0100697e0 2024-01-21T21:15:03.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.061+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0100bcf70 con 0x7fc0100697e0 2024-01-21T21:15:03.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.062+0000 7fc006ffd700 1 -- 172.21.15.133:0/2664091837 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18238 (secure 0 0 0) 0x7fc0080508f0 con 0x7fc0100697e0 2024-01-21T21:15:03.063 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:03.063 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":161,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:59.136516+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6833/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:6832/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/3113152115":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/2502467621":"2024-01-22T21:14:59.136484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 msgr2=0x7fbff40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 0x7fbff40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 msgr2=0x7fc010139810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fc00800b610 tx=0x7fc008009780).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 shutdown_connections 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fbff405f300 0x7fbff40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0100697e0 0x7fc010139810 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc010062c10 0x7fc010154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 --2- 172.21.15.133:0/2664091837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc010065d70 0x7fc0100ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 >> 172.21.15.133:0/2664091837 conn(0x7fc0100c8010 msgr2=0x7fc0100a5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 shutdown_connections 2024-01-21T21:15:03.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.064+0000 7fc0186c9700 1 -- 172.21.15.133:0/2664091837 wait complete. 2024-01-21T21:15:03.078 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T21:14:41.802158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T21:14:42.217893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T21:15:03.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:15:03.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.200+0000 7fd03a44c700 1 Processor -- start 2024-01-21T21:15:03.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.200+0000 7fd03a44c700 1 -- start start 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.201+0000 7fd03a44c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd034062e00 0x7fd0340a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.201+0000 7fd03a44c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0340654e0 con 0x7fd03413aa00 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.201+0000 7fd03a44c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd034158730 con 0x7fd03413a620 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.201+0000 7fd03a44c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0340bd6f0 con 0x7fd034062e00 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd034062e00 0x7fd0340a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0389e9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd03413aa00 0x7fd034065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54670/0 (socket says 172.21.15.133:54670) 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0389e9700 1 -- 172.21.15.133:0/1563280192 learned_addr learned my addr 172.21.15.133:0/1563280192 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 --2- 172.21.15.133:0/1563280192 >> v2:172.21.15.133:3300/0 conn(0x7fd034062e00 0x7fd0340a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58682/0 (socket says 172.21.15.133:58682) 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 -- 172.21.15.133:0/1563280192 >> v1:172.21.15.178:6789/0 conn(0x7fd03413a620 legacy=0x7fd0340626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 -- 172.21.15.133:0/1563280192 >> v1:172.21.15.133:6789/0 conn(0x7fd03413aa00 legacy=0x7fd034065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd032ffd700 1 -- 172.21.15.133:0/1563280192 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876125601 0 0) 0x7fd0340654e0 con 0x7fd03413aa00 2024-01-21T21:15:03.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 -- 172.21.15.133:0/1563280192 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034158a10 con 0x7fd034062e00 2024-01-21T21:15:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd0337fe700 1 --2- 172.21.15.133:0/1563280192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd034062e00 0x7fd0340a6e30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd01c009760 tx=0x7fd01c009060).ready entity=mon.0 client_cookie=bd30e470350a6946 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd032ffd700 1 -- 172.21.15.133:0/1563280192 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c009120 con 0x7fd034062e00 2024-01-21T21:15:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd032ffd700 1 -- 172.21.15.133:0/1563280192 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c00b580 con 0x7fd034062e00 2024-01-21T21:15:03.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.202+0000 7fd032ffd700 1 -- 172.21.15.133:0/1563280192 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00b900 con 0x7fd034062e00 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 -- 172.21.15.133:0/1563280192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd034062e00 msgr2=0x7fd0340a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 --2- 172.21.15.133:0/1563280192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd034062e00 0x7fd0340a6e30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd01c009760 tx=0x7fd01c009060).stop 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 -- 172.21.15.133:0/1563280192 shutdown_connections 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 --2- 172.21.15.133:0/1563280192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd034062e00 0x7fd0340a6e30 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 -- 172.21.15.133:0/1563280192 >> 172.21.15.133:0/1563280192 conn(0x7fd0340c7dc0 msgr2=0x7fd0340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 -- 172.21.15.133:0/1563280192 shutdown_connections 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.203+0000 7fd03a44c700 1 -- 172.21.15.133:0/1563280192 wait complete. 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.204+0000 7fd03a44c700 1 Processor -- start 2024-01-21T21:15:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.204+0000 7fd03a44c700 1 -- start start 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd034062e00 0x7fd0340a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd03413aa00 0x7fd0341397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340a8a90 con 0x7fd03413a620 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd034168980 con 0x7fd034062e00 2024-01-21T21:15:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd03a44c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340a9890 con 0x7fd03413aa00 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd0337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd0337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58694/0 (socket says 172.21.15.133:58694) 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd0337fe700 1 -- 172.21.15.133:0/4183738265 learned_addr learned my addr 172.21.15.133:0/4183738265 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd033fff700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd034062e00 0x7fd0340a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.205+0000 7fd0389e9700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd03413aa00 0x7fd0341397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd03413aa00 msgr2=0x7fd0341397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd03413aa00 0x7fd0341397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd034062e00 msgr2=0x7fd0340a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd034062e00 0x7fd0340a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 -- 172.21.15.133:0/4183738265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0092a0 con 0x7fd03413a620 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd0337fe700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fd01c00b340 tx=0x7fd01c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00b900 con 0x7fd03413a620 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c000d10 con 0x7fd03413a620 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0340a8c80 con 0x7fd03413a620 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00bed0 con 0x7fd03413a620 2024-01-21T21:15:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.206+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0340a9240 con 0x7fd03413a620 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.207+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03405fdf0 con 0x7fd03413a620 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.207+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd01c01b650 con 0x7fd03413a620 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.208+0000 7fd030ff9700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 0x7fd0140617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.208+0000 7fd033fff700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 msgr2=0x7fd0140617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.208+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fd01c07bea0 con 0x7fd03413a620 2024-01-21T21:15:03.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.208+0000 7fd033fff700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 0x7fd0140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:03.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.212+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd01c04cc30 con 0x7fd03413a620 2024-01-21T21:15:03.248 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:03.246+0000 7fe40a14b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:15:03.313 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:03.312+0000 7fb6282d0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:15:03.321 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:03.320+0000 7fe40a14b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:15:03.386 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:03.385+0000 7fb6282d0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:15:03.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.409+0000 7fd033fff700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 msgr2=0x7fd0140617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:03.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.409+0000 7fd033fff700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 0x7fd0140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:15:03.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.418+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd03406a6a0 con 0x7fd03413a620 2024-01-21T21:15:03.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.418+0000 7fd030ff9700 1 -- 172.21.15.133:0/4183738265 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v161) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd01c0280b0 con 0x7fd03413a620 2024-01-21T21:15:03.420 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:15:03.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 msgr2=0x7fd0140617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:03.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 0x7fd0140617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 msgr2=0x7fd034168490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fd01c00b340 tx=0x7fd01c017000).stop 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 shutdown_connections 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fd01405f300 0x7fd0140617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd03413aa00 0x7fd0341397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd034062e00 0x7fd0340a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 --2- 172.21.15.133:0/4183738265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd03413a620 0x7fd034168490 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 >> 172.21.15.133:0/4183738265 conn(0x7fd0340c7dc0 msgr2=0x7fd0340c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 shutdown_connections 2024-01-21T21:15:03.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.421+0000 7fd03a44c700 1 -- 172.21.15.133:0/4183738265 wait complete. 2024-01-21T21:15:03.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:15:03.508 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:03.506+0000 7fe40a14b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:15:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.557+0000 7fe5fdad5700 1 Processor -- start 2024-01-21T21:15:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.557+0000 7fe5fdad5700 1 -- start start 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.557+0000 7fe5fdad5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f8154140 0x7fe5f8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.557+0000 7fe5fdad5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5f8154520 0x7fe5f80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.557+0000 7fe5fdad5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5fdad5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f80c6ae0 con 0x7fe5f8154140 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5fdad5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f80c05e0 con 0x7fe5f8154520 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5fdad5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80ab620 con 0x7fe5f80c6090 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f8154140 0x7fe5f8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5f8154140 0x7fe5f8158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58702/0 (socket says 172.21.15.133:58702) 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 -- 172.21.15.133:0/317932218 learned_addr learned my addr 172.21.15.133:0/317932218 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5eeffd700 1 --2- 172.21.15.133:0/317932218 >> v2:172.21.15.178:3300/0 conn(0x7fe5f8154520 0x7fe5f80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f7fff700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 -- 172.21.15.133:0/317932218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 msgr2=0x7fe5f80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f80c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 -- 172.21.15.133:0/317932218 >> v2:172.21.15.178:3300/0 conn(0x7fe5f8154520 msgr2=0x7fe5f80ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 --2- 172.21.15.133:0/317932218 >> v2:172.21.15.178:3300/0 conn(0x7fe5f8154520 0x7fe5f80ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 -- 172.21.15.133:0/317932218 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f80c0e40 con 0x7fe5f8154140 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f77fe700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154140 0x7fe5f8158bb0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fe5f8062cf0 tx=0x7fe5e80090f0).ready entity=mon.0 client_cookie=a3cd9a968f8c6837 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f6ffd700 1 -- 172.21.15.133:0/317932218 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800f510 con 0x7fe5f8154140 2024-01-21T21:15:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f6ffd700 1 -- 172.21.15.133:0/317932218 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800f670 con 0x7fe5f8154140 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.558+0000 7fe5f6ffd700 1 -- 172.21.15.133:0/317932218 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800fa10 con 0x7fe5f8154140 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 -- 172.21.15.133:0/317932218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154140 msgr2=0x7fe5f8158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154140 0x7fe5f8158bb0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fe5f8062cf0 tx=0x7fe5e80090f0).stop 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 -- 172.21.15.133:0/317932218 shutdown_connections 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f80c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/317932218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154140 0x7fe5f8158bb0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/317932218 >> v2:172.21.15.178:3300/0 conn(0x7fe5f8154520 0x7fe5f80ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 -- 172.21.15.133:0/317932218 >> 172.21.15.133:0/317932218 conn(0x7fe5f805e1e0 msgr2=0x7fe5f805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 -- 172.21.15.133:0/317932218 shutdown_connections 2024-01-21T21:15:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.559+0000 7fe5fdad5700 1 -- 172.21.15.133:0/317932218 wait complete. 2024-01-21T21:15:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.560+0000 7fe5fdad5700 1 Processor -- start 2024-01-21T21:15:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.560+0000 7fe5fdad5700 1 -- start start 2024-01-21T21:15:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f81523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 0x7fe5f814cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8164a10 con 0x7fe5f8154520 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8165840 con 0x7fe5f8154140 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5fdad5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f8164c30 con 0x7fe5f80c6090 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58718/0 (socket says 172.21.15.133:58718) 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5f7fff700 1 -- 172.21.15.133:0/992176798 learned_addr learned my addr 172.21.15.133:0/992176798 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5f77fe700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f81523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.561+0000 7fe5eeffd700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 0x7fe5f814cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 -- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 msgr2=0x7fe5f81523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f81523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 -- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 msgr2=0x7fe5f8158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 -- 172.21.15.133:0/992176798 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8009370 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5f7fff700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5eeffd700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 0x7fe5f814cc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe5e000e6f0 tx=0x7fe5e0009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0012600 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0012760 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0012ae0 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f8164f10 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.562+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f81654d0 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.563+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f805fdf0 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.563+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe5e001b400 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.564+0000 7fe5f4f74700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 0x7fe5d80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.564+0000 7fe5f77fe700 1 -- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 msgr2=0x7fe5d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.564+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fe5e007a9d0 con 0x7fe5f8154140 2024-01-21T21:15:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.564+0000 7fe5f77fe700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 0x7fe5d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.568+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe5e004b700 con 0x7fe5f8154140 2024-01-21T21:15:03.585 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:03.584+0000 7fb6282d0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:15:03.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:15:03.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:15:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.740+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5f80aa980 con 0x7fe5f8154140 2024-01-21T21:15:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.740+0000 7fe5f4f74700 1 -- 172.21.15.133:0/992176798 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v161) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5e004ed20 con 0x7fe5f8154140 2024-01-21T21:15:03.742 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 msgr2=0x7fe5d80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 0x7fe5d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 msgr2=0x7fe5f814cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 0x7fe5f814cc20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fe5e000e6f0 tx=0x7fe5e0009060).stop 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 shutdown_connections 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe5d805f300 0x7fe5d80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5f8154520 0x7fe5f8158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5f80c6090 0x7fe5f81523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 --2- 172.21.15.133:0/992176798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5f8154140 0x7fe5f814cc20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 >> 172.21.15.133:0/992176798 conn(0x7fe5f805e1e0 msgr2=0x7fe5f80c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 shutdown_connections 2024-01-21T21:15:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.742+0000 7fe5fdad5700 1 -- 172.21.15.133:0/992176798 wait complete. 2024-01-21T21:15:03.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T21:15:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.917+0000 7f56c801d700 1 Processor -- start 2024-01-21T21:15:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.917+0000 7f56c801d700 1 -- start start 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c801d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f56c0155cb0 0x7f56c0156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c801d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56c00bde60 0x7f56c00be2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c801d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c0156650 con 0x7f56c01351d0 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c801d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00c61a0 con 0x7f56c00bde60 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c801d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00c5350 con 0x7f56c0155cb0 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56c00bde60 0x7f56c00be2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c5db9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f56c01351d0 0x7f56c00c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54672/0 (socket says 172.21.15.133:54672) 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c5db9700 1 -- 172.21.15.133:0/2017629042 learned_addr learned my addr 172.21.15.133:0/2017629042 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c55b8700 1 --2- 172.21.15.133:0/2017629042 >> v2:172.21.15.178:3300/0 conn(0x7f56c0155cb0 0x7f56c0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 -- 172.21.15.133:0/2017629042 >> v2:172.21.15.178:3300/0 conn(0x7f56c0155cb0 msgr2=0x7f56c0156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 --2- 172.21.15.133:0/2017629042 >> v2:172.21.15.178:3300/0 conn(0x7f56c0155cb0 0x7f56c0156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 -- 172.21.15.133:0/2017629042 >> v1:172.21.15.133:6789/0 conn(0x7f56c01351d0 legacy=0x7f56c00c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 -- 172.21.15.133:0/2017629042 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00c55d0 con 0x7f56c00bde60 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c4db7700 1 -- 172.21.15.133:0/2017629042 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019950105 0 0) 0x7f56bc001110 con 0x7f56c01351d0 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.919+0000 7f56c65ba700 1 --2- 172.21.15.133:0/2017629042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00be2b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f56c006a7e0 tx=0x7f56b8009780).ready entity=mon.0 client_cookie=7722b6d2339852cc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.920+0000 7f56c4db7700 1 -- 172.21.15.133:0/2017629042 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800e070 con 0x7f56c00bde60 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.920+0000 7f56c4db7700 1 -- 172.21.15.133:0/2017629042 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800bb60 con 0x7f56c00bde60 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.920+0000 7f56c4db7700 1 -- 172.21.15.133:0/2017629042 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8012410 con 0x7f56c00bde60 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.920+0000 7f56c801d700 1 -- 172.21.15.133:0/2017629042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 msgr2=0x7f56c00be2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.920+0000 7f56c801d700 1 --2- 172.21.15.133:0/2017629042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00be2b0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f56c006a7e0 tx=0x7f56b8009780).stop 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 -- 172.21.15.133:0/2017629042 shutdown_connections 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 --2- 172.21.15.133:0/2017629042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00be2b0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 --2- 172.21.15.133:0/2017629042 >> v2:172.21.15.178:3300/0 conn(0x7f56c0155cb0 0x7f56c0156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 -- 172.21.15.133:0/2017629042 >> 172.21.15.133:0/2017629042 conn(0x7f56c0066a90 msgr2=0x7f56c0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 -- 172.21.15.133:0/2017629042 shutdown_connections 2024-01-21T21:15:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.921+0000 7f56c801d700 1 -- 172.21.15.133:0/2017629042 wait complete. 2024-01-21T21:15:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.923+0000 7f56c801d700 1 Processor -- start 2024-01-21T21:15:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.923+0000 7f56c801d700 1 -- start start 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c01351d0 0x7f56c0135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c0155cb0 0x7f56c00a8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0135d80 con 0x7f56c00bde60 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c014e9a0 con 0x7f56c01351d0 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c801d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c014dd90 con 0x7f56c0155cb0 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58734/0 (socket says 172.21.15.133:58734) 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 -- 172.21.15.133:0/1754138290 learned_addr learned my addr 172.21.15.133:0/1754138290 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c55b8700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c01351d0 0x7f56c0135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c65ba700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c0155cb0 0x7f56c00a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 -- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c0155cb0 msgr2=0x7f56c00a8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c0155cb0 0x7f56c00a8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 -- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c01351d0 msgr2=0x7f56c0135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c01351d0 0x7f56c0135890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 -- 172.21.15.133:0/1754138290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8009a20 con 0x7f56c00bde60 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.924+0000 7f56c5db9700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f56bc001eb0 tx=0x7f56bc007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.925+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0070d0 con 0x7f56c00bde60 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.925+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc007230 con 0x7f56c00bde60 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.925+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c014e070 con 0x7f56c00bde60 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.925+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0075d0 con 0x7f56c00bde60 2024-01-21T21:15:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.925+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c014e630 con 0x7f56c00bde60 2024-01-21T21:15:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.926+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c005fdf0 con 0x7f56c00bde60 2024-01-21T21:15:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.926+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f56bc005bc0 con 0x7f56c00bde60 2024-01-21T21:15:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.927+0000 7f56b67fc700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 0x7f56a40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.927+0000 7f56c55b8700 1 -- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 msgr2=0x7f56a40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.927+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f56bc079f80 con 0x7f56c00bde60 2024-01-21T21:15:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.927+0000 7f56c55b8700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 0x7f56a40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:03.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:03.931+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f56bc04ad10 con 0x7f56c00bde60 2024-01-21T21:15:03.935 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:03.934+0000 7fe40a14b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:15:04.033 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.032+0000 7fb6282d0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:15:04.040 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.039+0000 7fe40a14b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.099+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56c0156650 con 0x7f56c00bde60 2024-01-21T21:15:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.100+0000 7f56b67fc700 1 -- 172.21.15.133:0/1754138290 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v161) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56c0156650 con 0x7f56c00bde60 2024-01-21T21:15:04.101 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:15:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.101+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 msgr2=0x7f56a40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.101+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 0x7f56a40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.101+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 msgr2=0x7f56c00653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.101+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f56bc001eb0 tx=0x7f56bc007e90).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 shutdown_connections 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f56a405f300 0x7f56a40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c0155cb0 0x7f56c00a8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56c00bde60 0x7f56c00653f0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 --2- 172.21.15.133:0/1754138290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c01351d0 0x7f56c0135890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 >> 172.21.15.133:0/1754138290 conn(0x7f56c0066a90 msgr2=0x7f56c0138dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 shutdown_connections 2024-01-21T21:15:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.102+0000 7f56c801d700 1 -- 172.21.15.133:0/1754138290 wait complete. 2024-01-21T21:15:04.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T21:15:04.146 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.145+0000 7fb6282d0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:04.194 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.192+0000 7fe40a14b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.238+0000 7f6dc81f8700 1 Processor -- start 2024-01-21T21:15:04.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.238+0000 7f6dc81f8700 1 -- start start 2024-01-21T21:15:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6dc0137030 0x7f6dc0067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc0137410 0x7f6dc0155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc00c5930 0x7f6dc00c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc00c6290 con 0x7f6dc0137410 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc01557f0 con 0x7f6dc0137030 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc81f8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0068370 con 0x7f6dc00c5930 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc5793700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc0137410 0x7f6dc0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc5793700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dc0137410 0x7f6dc0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58750/0 (socket says 172.21.15.133:58750) 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.239+0000 7f6dc5793700 1 -- 172.21.15.133:0/1977293124 learned_addr learned my addr 172.21.15.133:0/1977293124 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5f94700 1 --2- 172.21.15.133:0/1977293124 >> v2:172.21.15.178:3300/0 conn(0x7f6dc0137030 0x7f6dc0067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc6795700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc00c5930 0x7f6dc00c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 -- 172.21.15.133:0/1977293124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc00c5930 msgr2=0x7f6dc00c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc00c5930 0x7f6dc00c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 -- 172.21.15.133:0/1977293124 >> v2:172.21.15.178:3300/0 conn(0x7f6dc0137030 msgr2=0x7f6dc0067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 --2- 172.21.15.133:0/1977293124 >> v2:172.21.15.178:3300/0 conn(0x7f6dc0137030 0x7f6dc0067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 -- 172.21.15.133:0/1977293124 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc0068650 con 0x7f6dc0137410 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc5793700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc0137410 0x7f6dc0155300 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f6dc00c8e10 tx=0x7f6db00090f0).ready entity=mon.0 client_cookie=480560d7121d539f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc4f92700 1 -- 172.21.15.133:0/1977293124 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000f510 con 0x7f6dc0137410 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc4f92700 1 -- 172.21.15.133:0/1977293124 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000f670 con 0x7f6dc0137410 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.240+0000 7f6dc4f92700 1 -- 172.21.15.133:0/1977293124 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000fa10 con 0x7f6dc0137410 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1977293124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc0137410 msgr2=0x7f6dc0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc0137410 0x7f6dc0155300 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f6dc00c8e10 tx=0x7f6db00090f0).stop 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1977293124 shutdown_connections 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc00c5930 0x7f6dc00c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1977293124 >> v2:172.21.15.178:3300/0 conn(0x7f6dc0137030 0x7f6dc0067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1977293124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc0137410 0x7f6dc0155300 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1977293124 >> 172.21.15.133:0/1977293124 conn(0x7f6dc0066a90 msgr2=0x7f6dc0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1977293124 shutdown_connections 2024-01-21T21:15:04.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.241+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1977293124 wait complete. 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.242+0000 7f6dc81f8700 1 Processor -- start 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.242+0000 7f6dc81f8700 1 -- start start 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dc0137030 0x7f6dc013c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc0137410 0x7f6dc013c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00c0690 con 0x7f6dc00c5930 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc00c2000 con 0x7f6dc0137030 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc81f8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0167ec0 con 0x7f6dc0137410 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58756/0 (socket says 172.21.15.133:58756) 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 -- 172.21.15.133:0/1599459862 learned_addr learned my addr 172.21.15.133:0/1599459862 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5793700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dc0137030 0x7f6dc013c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc6795700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc0137410 0x7f6dc013c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 -- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc0137410 msgr2=0x7f6dc013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc0137410 0x7f6dc013c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 -- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dc0137030 msgr2=0x7f6dc013c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dc0137030 0x7f6dc013c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.243+0000 7f6dc5f94700 1 -- 172.21.15.133:0/1599459862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009370 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6dc5f94700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f6dbc00e930 tx=0x7f6dbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc009390 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc012600 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc01681a0 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc012980 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.244+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc00c0320 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.245+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc00bfe70 con 0x7f6dc00c5930 2024-01-21T21:15:04.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.245+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f6dbc01b400 con 0x7f6dc00c5930 2024-01-21T21:15:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.246+0000 7f6db67fc700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 0x7f6da40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.246+0000 7f6dc5793700 1 -- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 msgr2=0x7f6da40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.246+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f6dbc07aac0 con 0x7f6dc00c5930 2024-01-21T21:15:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.246+0000 7f6dc5793700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 0x7f6da40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:04.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.250+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6dbc04b7f0 con 0x7f6dc00c5930 2024-01-21T21:15:04.269 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.267+0000 7fe40a14b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:15:04.311 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.309+0000 7fb6282d0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:04.336 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.334+0000 7fe40a14b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:15:04.388 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.387+0000 7fb6282d0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:15:04.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.421+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dc005fdf0 con 0x7f6dc00c5930 2024-01-21T21:15:04.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.421+0000 7f6db67fc700 1 -- 172.21.15.133:0/1599459862 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6dbc04ee10 con 0x7f6dc00c5930 2024-01-21T21:15:04.423 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 msgr2=0x7f6da40617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 0x7f6da40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 msgr2=0x7f6dc013d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f6dbc00e930 tx=0x7f6dbc009060).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 shutdown_connections 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6da405f300 0x7f6da40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dc0137410 0x7f6dc013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc00c5930 0x7f6dc013d3f0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 --2- 172.21.15.133:0/1599459862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dc0137030 0x7f6dc013c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 >> 172.21.15.133:0/1599459862 conn(0x7f6dc0066a90 msgr2=0x7f6dc01559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 shutdown_connections 2024-01-21T21:15:04.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.423+0000 7f6dc81f8700 1 -- 172.21.15.133:0/1599459862 wait complete. 2024-01-21T21:15:04.437 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:04.458 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.457+0000 7fb6282d0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:15:04.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.576+0000 7f3795bd5700 1 Processor -- start 2024-01-21T21:15:04.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.576+0000 7f3795bd5700 1 -- start start 2024-01-21T21:15:04.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.576+0000 7f3795bd5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3790154140 0x7f3790158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.576+0000 7f3795bd5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3790154520 0x7f37900ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f3795bd5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37900ab620 con 0x7f37900c6090 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f3795bd5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37900c6ae0 con 0x7f3790154520 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f3795bd5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c05e0 con 0x7f3790154140 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3790154520 0x7f37900ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f37900c6090 0x7f37900c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54682/0 (socket says 172.21.15.133:54682) 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3790154520 0x7f37900ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58764/0 (socket says 172.21.15.133:58764) 2024-01-21T21:15:04.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378ffff700 1 -- 172.21.15.133:0/3040679190 learned_addr learned my addr 172.21.15.133:0/3040679190 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378f7fe700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3790154140 0x7f3790158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 -- 172.21.15.133:0/3040679190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3790154140 msgr2=0x7f3790158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3790154140 0x7f3790158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 -- 172.21.15.133:0/3040679190 >> v1:172.21.15.133:6789/0 conn(0x7f37900c6090 legacy=0x7f37900c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 -- 172.21.15.133:0/3040679190 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37900c0e40 con 0x7f3790154520 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378effd700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154520 0x7f37900ab130 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f3784009760 tx=0x7f3784009060).ready entity=mon.0 client_cookie=e162a2141f76cf1b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378e7fc700 1 -- 172.21.15.133:0/3040679190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400f510 con 0x7f3790154520 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378e7fc700 1 -- 172.21.15.133:0/3040679190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400f670 con 0x7f3790154520 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.577+0000 7f378e7fc700 1 -- 172.21.15.133:0/3040679190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400f9f0 con 0x7f3790154520 2024-01-21T21:15:04.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 -- 172.21.15.133:0/3040679190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154520 msgr2=0x7f37900ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154520 0x7f37900ab130 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f3784009760 tx=0x7f3784009060).stop 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 -- 172.21.15.133:0/3040679190 shutdown_connections 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3790154140 0x7f3790158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 --2- 172.21.15.133:0/3040679190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154520 0x7f37900ab130 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 -- 172.21.15.133:0/3040679190 >> 172.21.15.133:0/3040679190 conn(0x7f379005e1e0 msgr2=0x7f379005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 -- 172.21.15.133:0/3040679190 shutdown_connections 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.578+0000 7f3795bd5700 1 -- 172.21.15.133:0/3040679190 wait complete. 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.579+0000 7f3795bd5700 1 Processor -- start 2024-01-21T21:15:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.579+0000 7f3795bd5700 1 -- start start 2024-01-21T21:15:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37900c6090 0x7f3790141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3790154520 0x7f3790158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790142330 con 0x7f3790154140 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c3720 con 0x7f3790154520 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f3795bd5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37900c3a00 con 0x7f37900c6090 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f378effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f378effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58778/0 (socket says 172.21.15.133:58778) 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f378effd700 1 -- 172.21.15.133:0/1637339042 learned_addr learned my addr 172.21.15.133:0/1637339042 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f378f7fe700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37900c6090 0x7f3790141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.580+0000 7f378ffff700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3790154520 0x7f3790158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37900c6090 msgr2=0x7f3790141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37900c6090 0x7f3790141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3790154520 msgr2=0x7f3790158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3790154520 0x7f3790158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 -- 172.21.15.133:0/1637339042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840092a0 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f378effd700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f379006afd0 tx=0x7f3784017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378400f7e0 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378400f940 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37900c3ce0 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378401b660 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.581+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37900c42a0 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.582+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379005fdf0 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.582+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f378401ba50 con 0x7f3790154140 2024-01-21T21:15:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.582+0000 7f3777fff700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 0x7f377c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.582+0000 7f378f7fe700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 msgr2=0x7f377c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.583+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f378407ba70 con 0x7f3790154140 2024-01-21T21:15:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.583+0000 7f378f7fe700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 0x7f377c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.586+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f378404c800 con 0x7f3790154140 2024-01-21T21:15:04.590 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.588+0000 7fe40a14b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:15:04.730 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.729+0000 7fb6282d0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:15:04.772 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:04.770+0000 7fe40a14b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.784+0000 7f378f7fe700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 msgr2=0x7f377c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.784+0000 7f378f7fe700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 0x7f377c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:15:04.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.800+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3790158a50 con 0x7f3790154140 2024-01-21T21:15:04.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.801+0000 7f3777fff700 1 -- 172.21.15.133:0/1637339042 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f378401f090 con 0x7f3790154140 2024-01-21T21:15:04.802 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:04.802 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:15:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 msgr2=0x7f377c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 0x7f377c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 msgr2=0x7f37900c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f379006afd0 tx=0x7f3784017000).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 shutdown_connections 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f377c05f300 0x7f377c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3790154520 0x7f3790158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37900c6090 0x7f3790141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 --2- 172.21.15.133:0/1637339042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3790154140 0x7f37900c47c0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 >> 172.21.15.133:0/1637339042 conn(0x7f379005e1e0 msgr2=0x7f379014e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 shutdown_connections 2024-01-21T21:15:04.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.803+0000 7f3795bd5700 1 -- 172.21.15.133:0/1637339042 wait complete. 2024-01-21T21:15:04.806 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:15:04.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:04.926 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:04.925+0000 7fb6282d0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.943+0000 7f0e02894700 1 Processor -- start 2024-01-21T21:15:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.943+0000 7f0e02894700 1 -- start start 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e02894700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dfc065d70 0x7f0dfc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e02894700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc069ef0 con 0x7f0dfc062ff0 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e02894700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc06a130 con 0x7f0dfc062c10 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e02894700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc06a410 con 0x7f0dfc065d70 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dfc065d70 0x7f0dfc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0dfb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0dfc062ff0 0x7f0dfc065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54694/0 (socket says 172.21.15.133:54694) 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0dfc065d70 0x7f0dfc15f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58782/0 (socket says 172.21.15.133:58782) 2024-01-21T21:15:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0dfb7fe700 1 -- 172.21.15.133:0/3484585360 learned_addr learned my addr 172.21.15.133:0/3484585360 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 -- 172.21.15.133:0/3484585360 >> v1:172.21.15.178:6789/0 conn(0x7f0dfc062c10 legacy=0x7f0dfc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 -- 172.21.15.133:0/3484585360 >> v1:172.21.15.133:6789/0 conn(0x7f0dfc062ff0 legacy=0x7f0dfc065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 -- 172.21.15.133:0/3484585360 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc06a6f0 con 0x7f0dfc065d70 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0e00e31700 1 --2- 172.21.15.133:0/3484585360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc065d70 0x7f0dfc15f750 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f0df4009e60 tx=0x7f0df4009780).ready entity=mon.0 client_cookie=3cd28756501d2431 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0dfaffd700 1 -- 172.21.15.133:0/3484585360 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df400e070 con 0x7f0dfc065d70 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0dfaffd700 1 -- 172.21.15.133:0/3484585360 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df400bc30 con 0x7f0dfc065d70 2024-01-21T21:15:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.944+0000 7f0dfaffd700 1 -- 172.21.15.133:0/3484585360 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4012410 con 0x7f0dfc065d70 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 -- 172.21.15.133:0/3484585360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc065d70 msgr2=0x7f0dfc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 --2- 172.21.15.133:0/3484585360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc065d70 0x7f0dfc15f750 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f0df4009e60 tx=0x7f0df4009780).stop 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 -- 172.21.15.133:0/3484585360 shutdown_connections 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 --2- 172.21.15.133:0/3484585360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc065d70 0x7f0dfc15f750 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 -- 172.21.15.133:0/3484585360 >> 172.21.15.133:0/3484585360 conn(0x7f0dfc0c8010 msgr2=0x7f0dfc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:04.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 -- 172.21.15.133:0/3484585360 shutdown_connections 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.945+0000 7f0e02894700 1 -- 172.21.15.133:0/3484585360 wait complete. 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.946+0000 7f0e02894700 1 Processor -- start 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.946+0000 7f0e02894700 1 -- start start 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dfc062c10 0x7f0dfc0a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 0x7f0dfc0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0a5ac0 con 0x7f0dfc062ff0 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0a8f10 con 0x7f0dfc062c10 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0e02894700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0a4e40 con 0x7f0dfc065d70 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0dfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58784/0 (socket says 172.21.15.133:58784) 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0dfb7fe700 1 -- 172.21.15.133:0/745686434 learned_addr learned my addr 172.21.15.133:0/745686434 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.947+0000 7f0dfbfff700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dfc062c10 0x7f0dfc0a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0e00e31700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 0x7f0dfc0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 -- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 msgr2=0x7f0dfc0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 0x7f0dfc0ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 -- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dfc062c10 msgr2=0x7f0dfc0a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dfc062c10 0x7f0dfc0a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 -- 172.21.15.133:0/745686434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009a20 con 0x7f0dfc062ff0 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0e00e31700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 0x7f0dfc0ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0dfb7fe700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0df0007fd0 tx=0x7f0df0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00072e0 con 0x7f0dfc062ff0 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0007440 con 0x7f0dfc062ff0 2024-01-21T21:15:04.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc0a5120 con 0x7f0dfc062ff0 2024-01-21T21:15:04.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00057a0 con 0x7f0dfc062ff0 2024-01-21T21:15:04.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.948+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc0a56e0 con 0x7f0dfc062ff0 2024-01-21T21:15:04.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.949+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc0a5c00 con 0x7f0dfc062ff0 2024-01-21T21:15:04.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.949+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f0df0005b90 con 0x7f0dfc062ff0 2024-01-21T21:15:04.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.950+0000 7f0df8ff9700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 0x7f0de80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:04.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.950+0000 7f0dfbfff700 1 -- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 msgr2=0x7f0de80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:04.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.950+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f0df0079f40 con 0x7f0dfc062ff0 2024-01-21T21:15:04.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.950+0000 7f0dfbfff700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 0x7f0de80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:04.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:04.954+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0dfc0a5c00 con 0x7f0dfc062ff0 2024-01-21T21:15:05.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.126+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dfc069ef0 con 0x7f0dfc062ff0 2024-01-21T21:15:05.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.127+0000 7f0df8ff9700 1 -- 172.21.15.133:0/745686434 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18238 (secure 0 0 0) 0x7f0dfc069ef0 con 0x7f0dfc062ff0 2024-01-21T21:15:05.129 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:05.129 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":161,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:59.136516+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6833/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:6832/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/3113152115":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/2502467621":"2024-01-22T21:14:59.136484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:05.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 msgr2=0x7f0de80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:05.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 0x7f0de80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 msgr2=0x7f0dfc0aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f0df0007fd0 tx=0x7f0df0007df0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 shutdown_connections 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0de805f300 0x7f0de80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dfc065d70 0x7f0dfc0ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dfc062c10 0x7f0dfc0a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 --2- 172.21.15.133:0/745686434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dfc062ff0 0x7f0dfc0aa4d0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 >> 172.21.15.133:0/745686434 conn(0x7f0dfc0c8010 msgr2=0x7f0dfc0c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 shutdown_connections 2024-01-21T21:15:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.129+0000 7f0e02894700 1 -- 172.21.15.133:0/745686434 wait complete. 2024-01-21T21:15:05.143 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:15:05.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:05.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.261+0000 7f8f8718b700 1 Processor -- start 2024-01-21T21:15:05.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.261+0000 7f8f8718b700 1 -- start start 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f80062c10 0x7f8f80062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f800697e0 0x7f8f80065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f80065b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f80066040 con 0x7f8f80062c10 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f800634e0 con 0x7f8f800697e0 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f8718b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8006a130 con 0x7f8f80069c40 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.262+0000 7f8f84f27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f80062c10 0x7f8f80062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f80062c10 0x7f8f80062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58786/0 (socket says 172.21.15.133:58786) 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 -- 172.21.15.133:0/907109653 learned_addr learned my addr 172.21.15.133:0/907109653 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f7ffff700 1 --2- 172.21.15.133:0/907109653 >> v2:172.21.15.178:3300/0 conn(0x7f8f800697e0 0x7f8f80065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f85728700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f80065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 -- 172.21.15.133:0/907109653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 msgr2=0x7f8f80065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f80065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 -- 172.21.15.133:0/907109653 >> v2:172.21.15.178:3300/0 conn(0x7f8f800697e0 msgr2=0x7f8f80065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 --2- 172.21.15.133:0/907109653 >> v2:172.21.15.178:3300/0 conn(0x7f8f800697e0 0x7f8f80065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 -- 172.21.15.133:0/907109653 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8006a410 con 0x7f8f80062c10 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f85728700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f80065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f84f27700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f80062c10 0x7f8f80062ff0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f8f800c9080 tx=0x7f8f740090f0).ready entity=mon.0 client_cookie=e9f18cb6bad7d25b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f7f7fe700 1 -- 172.21.15.133:0/907109653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400b520 con 0x7f8f80062c10 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f7f7fe700 1 -- 172.21.15.133:0/907109653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400b680 con 0x7f8f80062c10 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.263+0000 7f8f7f7fe700 1 -- 172.21.15.133:0/907109653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400ba20 con 0x7f8f80062c10 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 -- 172.21.15.133:0/907109653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f80062c10 msgr2=0x7f8f80062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f80062c10 0x7f8f80062ff0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f8f800c9080 tx=0x7f8f740090f0).stop 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 -- 172.21.15.133:0/907109653 shutdown_connections 2024-01-21T21:15:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f80065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 --2- 172.21.15.133:0/907109653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f80062c10 0x7f8f80062ff0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 --2- 172.21.15.133:0/907109653 >> v2:172.21.15.178:3300/0 conn(0x7f8f800697e0 0x7f8f80065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 -- 172.21.15.133:0/907109653 >> 172.21.15.133:0/907109653 conn(0x7f8f800c8010 msgr2=0x7f8f800c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 -- 172.21.15.133:0/907109653 shutdown_connections 2024-01-21T21:15:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.264+0000 7f8f8718b700 1 -- 172.21.15.133:0/907109653 wait complete. 2024-01-21T21:15:05.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.265+0000 7f8f8718b700 1 Processor -- start 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.265+0000 7f8f8718b700 1 -- start start 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 0x7f8f800a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f800a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800a8b60 con 0x7f8f800697e0 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800aa7a0 con 0x7f8f80062c10 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f8718b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800a8e00 con 0x7f8f80069c40 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f84f27700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 0x7f8f800a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f84f27700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:45932/0 (socket says 172.21.15.133:45932) 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f84f27700 1 -- 172.21.15.133:0/91945112 learned_addr learned my addr 172.21.15.133:0/91945112 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f85728700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f800a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 msgr2=0x7f8f800a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f800a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 msgr2=0x7f8f800a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 -- 172.21.15.133:0/91945112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009370 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f84f27700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.266+0000 7f8f7ffff700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 0x7f8f800a66b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f8f6c00e6f0 tx=0x7f8f6c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.267+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c012600 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.267+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c012760 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.267+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c012ae0 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.267+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f800a90e0 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.267+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f80158b40 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.268+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f8005fdf0 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.268+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f8f6c01b400 con 0x7f8f800697e0 2024-01-21T21:15:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.268+0000 7f8f7d7fa700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 0x7f8f640617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.268+0000 7f8f84f27700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 msgr2=0x7f8f640617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.268+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f8f6c07a9d0 con 0x7f8f800697e0 2024-01-21T21:15:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.269+0000 7f8f84f27700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 0x7f8f640617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:05.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.273+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8f6c04b700 con 0x7f8f800697e0 2024-01-21T21:15:05.426 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.424+0000 7fe40a14b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:15:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.470+0000 7f8f84f27700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 msgr2=0x7f8f640617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.470+0000 7f8f84f27700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 0x7f8f640617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:15:05.494 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.492+0000 7fe40a14b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:15:05.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.494+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f800c8e40 con 0x7f8f800697e0 2024-01-21T21:15:05.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.494+0000 7f8f7d7fa700 1 -- 172.21.15.133:0/91945112 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f8f6c04ed20 con 0x7f8f800697e0 2024-01-21T21:15:05.496 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:05.496 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:15:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 msgr2=0x7f8f640617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 0x7f8f640617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 msgr2=0x7f8f800a66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 0x7f8f800a66b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f8f6c00e6f0 tx=0x7f8f6c009060).stop 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 shutdown_connections 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8f6405f300 0x7f8f640617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f80069c40 0x7f8f800a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f80062c10 0x7f8f800a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 --2- 172.21.15.133:0/91945112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f800697e0 0x7f8f800a66b0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 >> 172.21.15.133:0/91945112 conn(0x7f8f800c8010 msgr2=0x7f8f800656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 shutdown_connections 2024-01-21T21:15:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.497+0000 7f8f8718b700 1 -- 172.21.15.133:0/91945112 wait complete. 2024-01-21T21:15:05.500 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:15:05.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:05.569 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.567+0000 7fe40a14b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:15:05.630 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:05.629+0000 7fb6282d0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:15:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.632+0000 7fb2ec839700 1 Processor -- start 2024-01-21T21:15:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.632+0000 7fb2ec839700 1 -- start start 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2ec839700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2e8137030 0x7fb2e8067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2ec839700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2e8137410 0x7fb2e8155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2ec839700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e81557f0 con 0x7fb2e80c5930 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2ec839700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e8068370 con 0x7fb2e8137030 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2ec839700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e8068650 con 0x7fb2e8137410 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2e8137030 0x7fb2e8067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2e80c5930 0x7fb2e80c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54710/0 (socket says 172.21.15.133:54710) 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e6d9d700 1 -- 172.21.15.133:0/1231628057 learned_addr learned my addr 172.21.15.133:0/1231628057 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e5d9b700 1 --2- 172.21.15.133:0/1231628057 >> v2:172.21.15.178:3300/0 conn(0x7fb2e8137410 0x7fb2e8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 -- 172.21.15.133:0/1231628057 >> v2:172.21.15.178:3300/0 conn(0x7fb2e8137410 msgr2=0x7fb2e8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 --2- 172.21.15.133:0/1231628057 >> v2:172.21.15.178:3300/0 conn(0x7fb2e8137410 0x7fb2e8155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 -- 172.21.15.133:0/1231628057 >> v1:172.21.15.133:6789/0 conn(0x7fb2e80c5930 legacy=0x7fb2e80c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 -- 172.21.15.133:0/1231628057 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8068930 con 0x7fb2e8137030 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e559a700 1 -- 172.21.15.133:0/1231628057 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716676374 0 0) 0x7fb2e81557f0 con 0x7fb2e80c5930 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e659c700 1 --2- 172.21.15.133:0/1231628057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e8137030 0x7fb2e8067d90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fb2e80af0d0 tx=0x7fb2d8009060).ready entity=mon.0 client_cookie=d5616b510816e3c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e559a700 1 -- 172.21.15.133:0/1231628057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80090d0 con 0x7fb2e8137030 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e559a700 1 -- 172.21.15.133:0/1231628057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d800f510 con 0x7fb2e8137030 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.633+0000 7fb2e559a700 1 -- 172.21.15.133:0/1231628057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d800f890 con 0x7fb2e8137030 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 -- 172.21.15.133:0/1231628057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e8137030 msgr2=0x7fb2e8067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1231628057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e8137030 0x7fb2e8067d90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fb2e80af0d0 tx=0x7fb2d8009060).stop 2024-01-21T21:15:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 -- 172.21.15.133:0/1231628057 shutdown_connections 2024-01-21T21:15:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1231628057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e8137030 0x7fb2e8067d90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1231628057 >> v2:172.21.15.178:3300/0 conn(0x7fb2e8137410 0x7fb2e8155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 -- 172.21.15.133:0/1231628057 >> 172.21.15.133:0/1231628057 conn(0x7fb2e8066a90 msgr2=0x7fb2e8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 -- 172.21.15.133:0/1231628057 shutdown_connections 2024-01-21T21:15:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.634+0000 7fb2ec839700 1 -- 172.21.15.133:0/1231628057 wait complete. 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.636+0000 7fb2ec839700 1 Processor -- start 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.636+0000 7fb2ec839700 1 -- start start 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2e8137030 0x7fb2e8135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 0x7fb2e80ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80c1f30 con 0x7fb2e80c5930 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80c28b0 con 0x7fb2e8137410 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2ec839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e80c1320 con 0x7fb2e8137030 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58822/0 (socket says 172.21.15.133:58822) 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e659c700 1 -- 172.21.15.133:0/1169713934 learned_addr learned my addr 172.21.15.133:0/1169713934 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 0x7fb2e80ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e5d9b700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2e8137030 0x7fb2e8135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 -- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2e8137030 msgr2=0x7fb2e8135b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2e8137030 0x7fb2e8135b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 -- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 msgr2=0x7fb2e80c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e6d9d700 1 -- 172.21.15.133:0/1169713934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80092a0 con 0x7fb2e8137410 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.637+0000 7fb2e659c700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2e6d9d700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 0x7fb2e80ad560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fb2e000c810 tx=0x7fb2e0007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0005d30 con 0x7fb2e8137410 2024-01-21T21:15:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e0005e90 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e80c1600 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0007300 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.638+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e80c1bc0 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.639+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e80c20e0 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.639+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb2e00076b0 con 0x7fb2e8137410 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.639+0000 7fb2d6ffd700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb2c805f300 0x7fb2c80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.639+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fb2e007a050 con 0x7fb2e8137410 2024-01-21T21:15:05.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.644+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb2e80c20e0 con 0x7fb2e8137410 2024-01-21T21:15:05.704 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:05.703+0000 7fb6282d0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:15:05.716 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.714+0000 7fe40a14b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:15:05.782 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:05.781+0000 7fb6282d0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:15:05.786 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.784+0000 7fe40a14b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:15:05.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.857+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2e805fdf0 con 0x7fb2e8137410 2024-01-21T21:15:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.858+0000 7fb2d6ffd700 1 -- 172.21.15.133:0/1169713934 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4503 (secure 0 0 0) 0x7fb2e004ade0 con 0x7fb2e8137410 2024-01-21T21:15:05.859 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:05.860 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:14:43.244882+0000","modified":"2024-01-21T21:14:45.250408+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2061608456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2061608456},{"type":"v1","addr":"172.21.15.133:6837","nonce":2061608456}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb2c805f300 msgr2=0x7fb2c80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb2c805f300 0x7fb2c80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 msgr2=0x7fb2e80ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 0x7fb2e80ad560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fb2e000c810 tx=0x7fb2e0007f90).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 shutdown_connections 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb2c805f300 0x7fb2c80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2e8137410 0x7fb2e80ad560 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2e80c5930 0x7fb2e80c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 --2- 172.21.15.133:0/1169713934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2e8137030 0x7fb2e8135b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 >> 172.21.15.133:0/1169713934 conn(0x7fb2e8066a90 msgr2=0x7fb2e80c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 shutdown_connections 2024-01-21T21:15:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.860+0000 7fb2ec839700 1 -- 172.21.15.133:0/1169713934 wait complete. 2024-01-21T21:15:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2024-01-21T21:15:05.874 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:05.901 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:05.900+0000 7fe40a14b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:15:05.939 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:05.938+0000 7fb6282d0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:15:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.991+0000 7f2c102aa700 1 Processor -- start 2024-01-21T21:15:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.991+0000 7f2c102aa700 1 -- start start 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.992+0000 7f2c102aa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.992+0000 7f2c102aa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c08154b50 con 0x7f2c081542f0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c102aa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c08158c00 con 0x7f2c081546d0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c102aa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c08159090 con 0x7f2c080aa7a0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e046700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2c081542f0 0x7f2c080c60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54724/0 (socket says 172.21.15.133:54724) 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e046700 1 -- 172.21.15.133:0/3331889126 learned_addr learned my addr 172.21.15.133:0/3331889126 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e847700 1 --2- 172.21.15.133:0/3331889126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116473393 0 0) 0x7f2c08154b50 con 0x7f2c081542f0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf40033f0 con 0x7f2c081542f0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318097462 0 0) 0x7f2c08158c00 con 0x7f2c081546d0 2024-01-21T21:15:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c08154b50 con 0x7f2c081546d0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e847700 1 -- 172.21.15.133:0/3331889126 >> v1:172.21.15.178:6789/0 conn(0x7f2c081546d0 legacy=0x7f2c080aa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e847700 1 -- 172.21.15.133:0/3331889126 >> v1:172.21.15.133:6789/0 conn(0x7f2c081542f0 legacy=0x7f2c080c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e847700 1 -- 172.21.15.133:0/3331889126 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080c67c0 con 0x7f2c080aa7a0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0e847700 1 --2- 172.21.15.133:0/3331889126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0815f500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c00009e90 tx=0x7f2c00009780).ready entity=mon.2 client_cookie=b074482e828f6b21 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.993+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000e070 con 0x7f2c080aa7a0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000bab0 con 0x7f2c080aa7a0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c0d044700 1 -- 172.21.15.133:0/3331889126 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000be30 con 0x7f2c080aa7a0 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 -- 172.21.15.133:0/3331889126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 msgr2=0x7f2c0815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 --2- 172.21.15.133:0/3331889126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0815f500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f2c00009e90 tx=0x7f2c00009780).stop 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 -- 172.21.15.133:0/3331889126 shutdown_connections 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 --2- 172.21.15.133:0/3331889126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0815f500 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 -- 172.21.15.133:0/3331889126 >> 172.21.15.133:0/3331889126 conn(0x7f2c0805e1e0 msgr2=0x7f2c0805e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 -- 172.21.15.133:0/3331889126 shutdown_connections 2024-01-21T21:15:05.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.994+0000 7f2c102aa700 1 -- 172.21.15.133:0/3331889126 wait complete. 2024-01-21T21:15:06.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.995+0000 7f2c102aa700 1 Processor -- start 2024-01-21T21:15:06.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.995+0000 7f2c102aa700 1 -- start start 2024-01-21T21:15:06.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c081546d0 0x7f2c080c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0814cc90 con 0x7f2c081542f0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0814da80 con 0x7f2c081546d0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c102aa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0814ce70 con 0x7f2c080aa7a0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c0d845700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c0d845700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58830/0 (socket says 172.21.15.133:58830) 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c0d845700 1 -- 172.21.15.133:0/2495864339 learned_addr learned my addr 172.21.15.133:0/2495864339 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c0e046700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.996+0000 7f2c0e847700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c081546d0 0x7f2c080c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 -- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 msgr2=0x7f2c0814ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0814ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 -- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c081546d0 msgr2=0x7f2c080c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c081546d0 0x7f2c080c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 -- 172.21.15.133:0/2495864339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009a20 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c0d845700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f2bf800c440 tx=0x7f2bf8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8012400 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf8012560 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8012920 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0814d150 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.997+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0814d710 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.998+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0805fdf0 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.998+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2bf801b3b0 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.999+0000 7f2bfef78700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 0x7f2bec0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.999+0000 7f2c0e046700 1 -- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 msgr2=0x7f2bec0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.999+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7f2bf8079f70 con 0x7f2c081542f0 2024-01-21T21:15:06.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:05.999+0000 7f2c0e046700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 0x7f2bec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:06.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.003+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2bf804aca0 con 0x7f2c081542f0 2024-01-21T21:15:06.010 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:06.008+0000 7fe40a14b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:06.021 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.020+0000 7fb6282d0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:15:06.143 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.142+0000 7fb6282d0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:15:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.186+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c080c0210 con 0x7f2c081542f0 2024-01-21T21:15:06.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.187+0000 7f2bfef78700 1 -- 172.21.15.133:0/2495864339 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+18238 (secure 0 0 0) 0x7f2bf804e2c0 con 0x7f2c081542f0 2024-01-21T21:15:06.189 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:06.190 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":161,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:14:59.136516+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:14:41.802158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-01-21T21:14:42.217893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6833/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:6832/43404":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/3113152115":"2024-01-22T21:14:59.136484+0000","172.21.15.133:0/2502467621":"2024-01-22T21:14:59.136484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:06.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 msgr2=0x7f2bec0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:06.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 0x7f2bec0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:06.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 msgr2=0x7f2c080af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f2bf800c440 tx=0x7f2bf8007c50).stop 2024-01-21T21:15:06.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 shutdown_connections 2024-01-21T21:15:06.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2bec05f300 0x7f2bec0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c081546d0 0x7f2c080c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c080aa7a0 0x7f2c0814ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 --2- 172.21.15.133:0/2495864339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c081542f0 0x7f2c080af9f0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 >> 172.21.15.133:0/2495864339 conn(0x7f2c0805e1e0 msgr2=0x7f2c08063910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 shutdown_connections 2024-01-21T21:15:06.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.189+0000 7f2c102aa700 1 -- 172.21.15.133:0/2495864339 wait complete. 2024-01-21T21:15:06.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T21:15:06.258 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.257+0000 7fb6282d0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:06.302 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:06.300+0000 7fe40a14b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:15:06.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.323+0000 7ff8f8fd7700 1 Processor -- start 2024-01-21T21:15:06.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.323+0000 7ff8f8fd7700 1 -- start start 2024-01-21T21:15:06.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.324+0000 7ff8f8fd7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8f4154140 0x7ff8f4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.324+0000 7ff8f8fd7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8f4154520 0x7ff8f40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.324+0000 7ff8f8fd7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40ab620 con 0x7ff8f40c6090 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.324+0000 7ff8f8fd7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40c6ae0 con 0x7ff8f4154520 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.324+0000 7ff8f8fd7700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40c05e0 con 0x7ff8f4154140 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8f4154520 0x7ff8f40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8f4154520 0x7ff8f40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58838/0 (socket says 172.21.15.133:58838) 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 -- 172.21.15.133:0/59356045 learned_addr learned my addr 172.21.15.133:0/59356045 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f259c700 1 --2- 172.21.15.133:0/59356045 >> v2:172.21.15.178:3300/0 conn(0x7ff8f4154140 0x7ff8f4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 -- 172.21.15.133:0/59356045 >> v2:172.21.15.178:3300/0 conn(0x7ff8f4154140 msgr2=0x7ff8f4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 --2- 172.21.15.133:0/59356045 >> v2:172.21.15.178:3300/0 conn(0x7ff8f4154140 0x7ff8f4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 -- 172.21.15.133:0/59356045 >> v1:172.21.15.178:6789/0 conn(0x7ff8f40c6090 legacy=0x7ff8f40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 -- 172.21.15.133:0/59356045 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40c0e40 con 0x7ff8f4154520 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f1d9b700 1 --2- 172.21.15.133:0/59356045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f40ab130 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff8f4083d70 tx=0x7ff8e80090f0).ready entity=mon.0 client_cookie=bd5914a1d151ac3e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f159a700 1 -- 172.21.15.133:0/59356045 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800b520 con 0x7ff8f4154520 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f159a700 1 -- 172.21.15.133:0/59356045 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800b680 con 0x7ff8f4154520 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.325+0000 7ff8f159a700 1 -- 172.21.15.133:0/59356045 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800ba00 con 0x7ff8f4154520 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/59356045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 msgr2=0x7ff8f40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/59356045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f40ab130 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff8f4083d70 tx=0x7ff8e80090f0).stop 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/59356045 shutdown_connections 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/59356045 >> v2:172.21.15.178:3300/0 conn(0x7ff8f4154140 0x7ff8f4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/59356045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f40ab130 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/59356045 >> 172.21.15.133:0/59356045 conn(0x7ff8f405e1e0 msgr2=0x7ff8f405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/59356045 shutdown_connections 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.326+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/59356045 wait complete. 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.327+0000 7ff8f8fd7700 1 Processor -- start 2024-01-21T21:15:06.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.327+0000 7ff8f8fd7700 1 -- start start 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 0x7ff8f4168800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 0x7ff8f413b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4168cf0 con 0x7ff8f4154520 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f413bd00 con 0x7ff8f40c6090 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f8fd7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4150c10 con 0x7ff8f4154140 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 0x7ff8f4168800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58846/0 (socket says 172.21.15.133:58846) 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f2d9d700 1 -- 172.21.15.133:0/413150767 learned_addr learned my addr 172.21.15.133:0/413150767 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.328+0000 7ff8f1d9b700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 0x7ff8f413b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 -- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 msgr2=0x7ff8f413b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 0x7ff8f413b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 -- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 msgr2=0x7ff8f4164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:06.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 -- 172.21.15.133:0/413150767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e8009370 con 0x7ff8f40c6090 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f1d9b700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 0x7ff8f413b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f2d9d700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f259c700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 0x7ff8f4168800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7ff8e400e850 tx=0x7ff8e4009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4009430 con 0x7ff8f40c6090 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4012600 con 0x7ff8f40c6090 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f4164fb0 con 0x7ff8f40c6090 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4012980 con 0x7ff8f40c6090 2024-01-21T21:15:06.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.329+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f4165570 con 0x7ff8f40c6090 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.330+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f405fdf0 con 0x7ff8f40c6090 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.331+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 74) v1 ==== 75605+0+0 (secure 0 0 0) 0x7ff8e401b400 con 0x7ff8f40c6090 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.331+0000 7ff8e2ffd700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 0x7ff8d40617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.331+0000 7ff8f1d9b700 1 -- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 msgr2=0x7ff8d40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.331+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6949+0+0 (secure 0 0 0) 0x7ff8e407ac30 con 0x7ff8f40c6090 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.331+0000 7ff8f1d9b700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 0x7ff8d40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:06.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.335+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff8e404f3f0 con 0x7ff8f40c6090 2024-01-21T21:15:06.373 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:06.372+0000 7fe40a14b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:15:06.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.553+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff8f40aa980 con 0x7ff8f40c6090 2024-01-21T21:15:06.566 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.565+0000 7fb6282d0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:15:06.639 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.638+0000 7fb6282d0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:15:06.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.657+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mgrmap(e 75) v1 ==== 75270+0+0 (secure 0 0 0) 0x7ff8e40784c0 con 0x7ff8f40c6090 2024-01-21T21:15:06.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.658+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 msgr2=0x7ff8d40617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-21T21:15:06.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:06.658+0000 7ff8e2ffd700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 0x7ff8d40617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:06.664 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:15:06.664 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:15:06.664 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:15:06.667 INFO:tasks.ceph.mds.a.smithi133.stderr: -2177> 2024-01-21T21:14:48.859+0000 7f02d054d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:15:06.670 INFO:tasks.ceph.mds.a.smithi133.stderr: -5> 2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:15:06.670 INFO:tasks.ceph.mds.a.smithi133.stderr: -4> 2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:15:06.670 INFO:tasks.ceph.mds.a.smithi133.stderr: -1> 2024-01-21T21:15:06.662+0000 7f02ccd46700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:15:06.690 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a0078700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a0078700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a0078700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a0078700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a0078700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a387f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a387f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a387f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a387f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:06.719 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:06.717+0000 7fb5a387f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:07.162 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T21:15:07.161+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T21:15:07.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.169+0000 7ff8e2ffd700 1 -- 172.21.15.133:0/413150767 <== mon.1 v2:172.21.15.178:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff8e406cfd0 con 0x7ff8f40c6090 2024-01-21T21:15:07.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 msgr2=0x7ff8f4168800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:07.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 0x7ff8f4168800 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7ff8e400e850 tx=0x7ff8e4009060).stop 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 shutdown_connections 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff8d405f300 0x7ff8d40617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8f4154520 0x7ff8f4164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f40c6090 0x7ff8f4168800 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 --2- 172.21.15.133:0/413150767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f4154140 0x7ff8f413b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 >> 172.21.15.133:0/413150767 conn(0x7ff8f405e1e0 msgr2=0x7ff8f414ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 shutdown_connections 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.172+0000 7ff8f8fd7700 1 -- 172.21.15.133:0/413150767 wait complete. 2024-01-21T21:15:07.174 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T21:15:07.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T21:15:07.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.305+0000 7f45ca8fb700 1 Processor -- start 2024-01-21T21:15:07.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.305+0000 7f45ca8fb700 1 -- start start 2024-01-21T21:15:07.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45ca8fb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 0x7f45c4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45ca8fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45c4069ef0 0x7f45c4066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45ca8fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c4065660 con 0x7f45c40c3fb0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45ca8fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c40bef10 con 0x7f45c4069ef0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45ca8fb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c4156070 con 0x7f45c40beb30 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45c8e98700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45c4069ef0 0x7f45c4066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45c37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f45c40c3fb0 0x7f45c40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54730/0 (socket says 172.21.15.133:54730) 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45c37fe700 1 -- 172.21.15.133:0/2195976798 learned_addr learned my addr 172.21.15.133:0/2195976798 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.306+0000 7f45c3fff700 1 --2- 172.21.15.133:0/2195976798 >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 0x7f45c4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c8e98700 1 -- 172.21.15.133:0/2195976798 >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 msgr2=0x7f45c4155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c8e98700 1 --2- 172.21.15.133:0/2195976798 >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 0x7f45c4155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c8e98700 1 -- 172.21.15.133:0/2195976798 >> v1:172.21.15.133:6789/0 conn(0x7f45c40c3fb0 legacy=0x7f45c40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c8e98700 1 -- 172.21.15.133:0/2195976798 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4065f00 con 0x7f45c4069ef0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c2ffd700 1 -- 172.21.15.133:0/2195976798 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881604394 0 0) 0x7f45c4065660 con 0x7f45c40c3fb0 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c3fff700 1 --2- 172.21.15.133:0/2195976798 >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 0x7f45c4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:07.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c8e98700 1 --2- 172.21.15.133:0/2195976798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c4069ef0 0x7f45c4066390 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f45c40650a0 tx=0x7f45bc009780).ready entity=mon.0 client_cookie=7bfef6c34ffb2672 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c2ffd700 1 -- 172.21.15.133:0/2195976798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc00e070 con 0x7f45c4069ef0 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c2ffd700 1 -- 172.21.15.133:0/2195976798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc00bbf0 con 0x7f45c4069ef0 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45c2ffd700 1 -- 172.21.15.133:0/2195976798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc012410 con 0x7f45c4069ef0 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 -- 172.21.15.133:0/2195976798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c4069ef0 msgr2=0x7f45c4066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/2195976798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c4069ef0 0x7f45c4066390 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f45c40650a0 tx=0x7f45bc009780).stop 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 -- 172.21.15.133:0/2195976798 shutdown_connections 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/2195976798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c4069ef0 0x7f45c4066390 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/2195976798 >> v2:172.21.15.178:3300/0 conn(0x7f45c40beb30 0x7f45c4155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 -- 172.21.15.133:0/2195976798 >> 172.21.15.133:0/2195976798 conn(0x7f45c40c8010 msgr2=0x7f45c40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 -- 172.21.15.133:0/2195976798 shutdown_connections 2024-01-21T21:15:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.307+0000 7f45ca8fb700 1 -- 172.21.15.133:0/2195976798 wait complete. 2024-01-21T21:15:07.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.309+0000 7f45ca8fb700 1 Processor -- start 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.309+0000 7f45ca8fb700 1 -- start start 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 0x7f45c40a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 0x7f45c4150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4169440 con 0x7f45c40beb30 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c40a5cf0 con 0x7f45c4069ef0 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c4168550 con 0x7f45c40c3fb0 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58950/0 (socket says 172.21.15.133:58950) 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 -- 172.21.15.133:0/3069944231 learned_addr learned my addr 172.21.15.133:0/3069944231 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c3fff700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 0x7f45c40a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c8e98700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 0x7f45c4150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 -- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 msgr2=0x7f45c4150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 0x7f45c4150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 -- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 msgr2=0x7f45c40a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 0x7f45c40a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 -- 172.21.15.133:0/3069944231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc009a20 con 0x7f45c40beb30 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c3fff700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 0x7f45c40a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c8e98700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 0x7f45c4150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c37fe700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f45b400c4e0 tx=0x7f45b4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40072e0 con 0x7f45c40beb30 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4007440 con 0x7f45c40beb30 2024-01-21T21:15:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c4168830 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40057a0 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.310+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c4168df0 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.312+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 75) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f45b4005bd0 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.312+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c4164fd0 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.312+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f45b4079e10 con 0x7f45c40beb30 2024-01-21T21:15:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.316+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45b404ae40 con 0x7f45c40beb30 2024-01-21T21:15:07.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.521+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f45c40c4740 con 0x7f45c40beb30 2024-01-21T21:15:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.660+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 76) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f45b407d030 con 0x7f45c40beb30 2024-01-21T21:15:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.661+0000 7f45c0ff9700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 0x7f45b0068130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:07.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.661+0000 7f45c3fff700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 0x7f45b0068130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:07.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:07.661+0000 7f45c3fff700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 0x7f45b0068130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f45b8006d80 tx=0x7f45b8008040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:08.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.170+0000 7f45c0ff9700 1 -- 172.21.15.133:0/3069944231 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f45b4074310 con 0x7f45c40beb30 2024-01-21T21:15:08.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.172+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 msgr2=0x7f45b0068130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.172+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 0x7f45b0068130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f45b8006d80 tx=0x7f45b8008040).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.172+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 msgr2=0x7f45c4139bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.172+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f45b400c4e0 tx=0x7f45b4007c70).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 shutdown_connections 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45b00302c0 0x7f45b0068130 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45c40c3fb0 0x7f45c4150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45c4069ef0 0x7f45c40a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 --2- 172.21.15.133:0/3069944231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45c40beb30 0x7f45c4139bc0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 >> 172.21.15.133:0/3069944231 conn(0x7f45c40c8010 msgr2=0x7f45c40bdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 shutdown_connections 2024-01-21T21:15:08.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.173+0000 7f45ca8fb700 1 -- 172.21.15.133:0/3069944231 wait complete. 2024-01-21T21:15:08.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T21:15:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.310+0000 7f9f24d85700 1 Processor -- start 2024-01-21T21:15:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.310+0000 7f9f24d85700 1 -- start start 2024-01-21T21:15:08.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.311+0000 7f9f24d85700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f20066f30 0x7f9f20157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.311+0000 7f9f24d85700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.311+0000 7f9f24d85700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200c37c0 con 0x7f9f20066b50 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.311+0000 7f9f24d85700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f20158ed0 con 0x7f9f20066f30 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.311+0000 7f9f24d85700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20158420 con 0x7f9f200c5330 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f20066f30 0x7f9f20157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f20066f30 0x7f9f20157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:46116/0 (socket says 172.21.15.133:46116) 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/4124781110 learned_addr learned my addr 172.21.15.133:0/4124781110 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1e59c700 1 --1- 172.21.15.133:0/4124781110 >> v1:172.21.15.178:6789/0 conn(0x7f9f20066b50 0x7f9f200bdec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:50152/0 (socket says 172.21.15.133:50152) 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 msgr2=0x7f9f20153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/4124781110 >> v1:172.21.15.178:6789/0 conn(0x7f9f20066b50 legacy=0x7f9f200bdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/4124781110 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200c5780 con 0x7f9f20066f30 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1ed9d700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1dd9b700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066f30 0x7f9f20157f30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f9f10006fd0 tx=0x7f9f100090f0).ready entity=mon.1 client_cookie=8f3a4239b6bcef94 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.312+0000 7f9f1d59a700 1 -- 172.21.15.133:0/4124781110 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000b580 con 0x7f9f20066f30 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f1d59a700 1 -- 172.21.15.133:0/4124781110 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000b6e0 con 0x7f9f20066f30 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f1d59a700 1 -- 172.21.15.133:0/4124781110 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000ba80 con 0x7f9f20066f30 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 -- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066f30 msgr2=0x7f9f20157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066f30 0x7f9f20157f30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f9f10006fd0 tx=0x7f9f100090f0).stop 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 -- 172.21.15.133:0/4124781110 shutdown_connections 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 --2- 172.21.15.133:0/4124781110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066f30 0x7f9f20157f30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 -- 172.21.15.133:0/4124781110 >> 172.21.15.133:0/4124781110 conn(0x7f9f200c8f60 msgr2=0x7f9f200c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 -- 172.21.15.133:0/4124781110 shutdown_connections 2024-01-21T21:15:08.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.313+0000 7f9f24d85700 1 -- 172.21.15.133:0/4124781110 wait complete. 2024-01-21T21:15:08.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.314+0000 7f9f24d85700 1 Processor -- start 2024-01-21T21:15:08.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 -- start start 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066b50 0x7f9f20165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20167530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c00a0 con 0x7f9f20066f30 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20164fa0 con 0x7f9f20066b50 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f24d85700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f20165280 con 0x7f9f200c5330 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f1dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f1dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58962/0 (socket says 172.21.15.133:58962) 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.315+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/1107782966 learned_addr learned my addr 172.21.15.133:0/1107782966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1ed9d700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20167530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1e59c700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066b50 0x7f9f20165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 msgr2=0x7f9f20167530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20167530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066b50 msgr2=0x7f9f20165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066b50 0x7f9f20165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 -- 172.21.15.133:0/1107782966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f18009a20 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f1dd9b700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f9f2006a1e0 tx=0x7f9f10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10006970 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000be40 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10009370 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1001c420 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.316+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f200c02f0 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.317+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f200c0510 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.317+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 76) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f9f1001c810 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.318+0000 7f9f0effd700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 0x7f9f000614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.318+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7250+0+0 (secure 0 0 0) 0x7f9f1007bff0 con 0x7f9f20066f30 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.318+0000 7f9f1e59c700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 0x7f9f000614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:08.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.318+0000 7f9f1e59c700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 0x7f9f000614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9f200c8e40 tx=0x7f9f14007d30).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:08.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.322+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f1004d020 con 0x7f9f20066f30 2024-01-21T21:15:08.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:08.486+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9f20067610 con 0x7f9f20066f30 2024-01-21T21:15:09.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.172+0000 7f9f0effd700 1 -- 172.21.15.133:0/1107782966 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9f1002a030 con 0x7f9f20066f30 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 msgr2=0x7f9f000614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 0x7f9f000614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f9f200c8e40 tx=0x7f9f14007d30).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 msgr2=0x7f9f200becc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f9f2006a1e0 tx=0x7f9f10017000).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 shutdown_connections 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9f0005f030 0x7f9f000614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f200c5330 0x7f9f20167530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f20066b50 0x7f9f20165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 --2- 172.21.15.133:0/1107782966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f20066f30 0x7f9f200becc0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 >> 172.21.15.133:0/1107782966 conn(0x7f9f200c8f60 msgr2=0x7f9f200aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:09.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 shutdown_connections 2024-01-21T21:15:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.176+0000 7f9f24d85700 1 -- 172.21.15.133:0/1107782966 wait complete. 2024-01-21T21:15:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T21:15:09.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T21:15:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.316+0000 7f2fa553e700 1 Processor -- start 2024-01-21T21:15:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.316+0000 7f2fa553e700 1 -- start start 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2fa553e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2fa005e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2fa553e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2fa014ecb0 0x7f2fa0155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2fa553e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00c9040 con 0x7f2fa0155a60 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2fa553e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00c9290 con 0x7f2fa014ecb0 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2fa553e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c9570 con 0x7f2fa014e8d0 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2f9f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fa0155a60 0x7f2fa00c0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54736/0 (socket says 172.21.15.133:54736) 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.317+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/4038603771 learned_addr learned my addr 172.21.15.133:0/4038603771 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/4038603771 >> v2:172.21.15.178:3300/0 conn(0x7f2fa014ecb0 0x7f2fa0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670469420 0 0) 0x7f2fa00c9040 con 0x7f2fa0155a60 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9effd700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2fa005e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f880033f0 con 0x7f2fa0155a60 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353812436 0 0) 0x7f2f880033f0 con 0x7f2fa0155a60 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 msgr2=0x7f2fa005e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2fa005e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 >> v2:172.21.15.178:3300/0 conn(0x7f2fa014ecb0 msgr2=0x7f2fa0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 --2- 172.21.15.133:0/4038603771 >> v2:172.21.15.178:3300/0 conn(0x7f2fa014ecb0 0x7f2fa0155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00c9850 con 0x7f2fa0155a60 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f2f980017f0 con 0x7f2fa0155a60 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 >> v1:172.21.15.133:6789/0 conn(0x7f2fa0155a60 legacy=0x7f2fa00c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f880038e0 0x7f2f88003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f88004690 0x7f2f88004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2f88005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c9290 con 0x7f2f88004690 2024-01-21T21:15:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c9570 con 0x7f2f880038e0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8800b8e0 con 0x7f2fa014e8d0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f88004690 0x7f2f88004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9effd700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f880038e0 0x7f2f88003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9f7fe700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2f88005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 msgr2=0x7f2f88005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa014e8d0 0x7f2f88005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f880038e0 msgr2=0x7f2f88003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f880038e0 0x7f2f88003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/4038603771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880033f0 con 0x7f2f88004690 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.318+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f88004690 0x7f2f88004b10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f2fa0083bb0 tx=0x7f2f90009060).ready entity=mon.0 client_cookie=162b831e2cacdab6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90009e90 con 0x7f2f88004690 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90009430 con 0x7f2f88004690 2024-01-21T21:15:09.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2f9dffb700 1 -- 172.21.15.133:0/4038603771 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000e850 con 0x7f2f88004690 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 -- 172.21.15.133:0/4038603771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f88004690 msgr2=0x7f2f88004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 --2- 172.21.15.133:0/4038603771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f88004690 0x7f2f88004b10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f2fa0083bb0 tx=0x7f2f90009060).stop 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/4038603771 reap_dead start 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 -- 172.21.15.133:0/4038603771 shutdown_connections 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 -- 172.21.15.133:0/4038603771 >> 172.21.15.133:0/4038603771 conn(0x7f2fa0084eb0 msgr2=0x7f2fa00947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 -- 172.21.15.133:0/4038603771 shutdown_connections 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.319+0000 7f2fa553e700 1 -- 172.21.15.133:0/4038603771 wait complete. 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.320+0000 7f2fa553e700 1 Processor -- start 2024-01-21T21:15:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 -- start start 2024-01-21T21:15:09.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88004690 0x7f2fa0165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa0167c40 0x7f2fa00c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0097ed0 con 0x7f2fa014b380 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa014c060 con 0x7f2f88004690 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2fa553e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c7390 con 0x7f2fa0167c40 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2f9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2f9f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58974/0 (socket says 172.21.15.133:58974) 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.321+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/2872721574 learned_addr learned my addr 172.21.15.133:0/2872721574 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9effd700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88004690 0x7f2fa0165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa0167c40 0x7f2fa00c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa0167c40 msgr2=0x7f2fa00c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa0167c40 0x7f2fa00c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88004690 msgr2=0x7f2fa0165130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88004690 0x7f2fa0165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 -- 172.21.15.133:0/2872721574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0098040 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f9f7fe700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f2f98001350 tx=0x7f2f98001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980020a0 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9800fb50 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa0165620 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98012350 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.322+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0168400 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.323+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa00981d0 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.323+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 76) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f2f980126c0 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.324+0000 7f2f877fe700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 0x7f2f8c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.324+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6812+0+0 (secure 0 0 0) 0x7f2f98079a40 con 0x7f2fa014b380 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.324+0000 7f2f9effd700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 0x7f2f8c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:09.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.324+0000 7f2f9effd700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 0x7f2f8c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2f94009270 tx=0x7f2f94008040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:09.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.328+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f9804ab20 con 0x7f2fa014b380 2024-01-21T21:15:09.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.493+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2fa00c9b30 con 0x7f2fa014b380 2024-01-21T21:15:09.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:09.667+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2f98077620 con 0x7f2fa014b380 2024-01-21T21:15:10.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.175+0000 7f2f877fe700 1 -- 172.21.15.133:0/2872721574 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2f98073240 con 0x7f2fa014b380 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 msgr2=0x7f2f8c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 0x7f2f8c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2f94009270 tx=0x7f2f94008040).stop 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 msgr2=0x7f2fa014b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f2f98001350 tx=0x7f2f98001d90).stop 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 shutdown_connections 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f2f8c05f030 0x7f2f8c0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa014b380 0x7f2fa014b7e0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f88004690 0x7f2fa0165130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 --2- 172.21.15.133:0/2872721574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa0167c40 0x7f2fa00c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 >> 172.21.15.133:0/2872721574 conn(0x7f2fa0084eb0 msgr2=0x7f2fa0064300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 shutdown_connections 2024-01-21T21:15:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.180+0000 7f2fa553e700 1 -- 172.21.15.133:0/2872721574 wait complete. 2024-01-21T21:15:10.183 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T21:15:10.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T21:15:10.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.316+0000 7f967a681700 1 Processor -- start 2024-01-21T21:15:10.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.316+0000 7f967a681700 1 -- start start 2024-01-21T21:15:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.316+0000 7f967a681700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413a620 0x7f96740a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.316+0000 7f967a681700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f967413aa00 0x7f9674158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f967a681700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96741584f0 con 0x7f96740626f0 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f967a681700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96740bd6f0 con 0x7f967413aa00 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f967a681700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740654e0 con 0x7f967413a620 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f967413aa00 0x7f9674158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f967413aa00 0x7f9674158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50852/0 (socket says 172.21.15.133:50852) 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 -- 172.21.15.133:0/2395799122 learned_addr learned my addr 172.21.15.133:0/2395799122 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f9673fff700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413a620 0x7f96740a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 -- 172.21.15.133:0/2395799122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413a620 msgr2=0x7f96740a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413a620 0x7f96740a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 -- 172.21.15.133:0/2395799122 >> v1:172.21.15.178:6789/0 conn(0x7f96740626f0 legacy=0x7f96740695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 -- 172.21.15.133:0/2395799122 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9674158730 con 0x7f967413aa00 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f966bfff700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413aa00 0x7f9674158000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f965c006fd0 tx=0x7f965c0090f0).ready entity=mon.0 client_cookie=b47efa64a6d894e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f96737fe700 1 -- 172.21.15.133:0/2395799122 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00b600 con 0x7f967413aa00 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f96737fe700 1 -- 172.21.15.133:0/2395799122 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00b760 con 0x7f967413aa00 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.317+0000 7f96737fe700 1 -- 172.21.15.133:0/2395799122 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00bb00 con 0x7f967413aa00 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 -- 172.21.15.133:0/2395799122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413aa00 msgr2=0x7f9674158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413aa00 0x7f9674158000 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f965c006fd0 tx=0x7f965c0090f0).stop 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 -- 172.21.15.133:0/2395799122 shutdown_connections 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413a620 0x7f96740a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 --2- 172.21.15.133:0/2395799122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413aa00 0x7f9674158000 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 -- 172.21.15.133:0/2395799122 >> 172.21.15.133:0/2395799122 conn(0x7f96740c7dc0 msgr2=0x7f96740c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 -- 172.21.15.133:0/2395799122 shutdown_connections 2024-01-21T21:15:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.318+0000 7f967a681700 1 -- 172.21.15.133:0/2395799122 wait complete. 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.319+0000 7f967a681700 1 Processor -- start 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 -- start start 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 0x7f96740bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413aa00 0x7f9674167ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f967413d4e0 con 0x7f967413a620 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96741688f0 con 0x7f96740626f0 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.320+0000 7f967a681700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96740bf350 con 0x7f967413aa00 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50866/0 (socket says 172.21.15.133:50866) 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 -- 172.21.15.133:0/2585893435 learned_addr learned my addr 172.21.15.133:0/2585893435 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f9673fff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 0x7f96740bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f9678c1e700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413aa00 0x7f9674167ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 -- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413aa00 msgr2=0x7f9674167ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413aa00 0x7f9674167ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 -- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 msgr2=0x7f96740bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 0x7f96740bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 -- 172.21.15.133:0/2585893435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c009370 con 0x7f967413a620 2024-01-21T21:15:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f9673fff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 0x7f96740bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f966bfff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f96740690c0 tx=0x7f965c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c00bec0 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c00b8d0 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f967413cbf0 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c024470 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.321+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f967413ce90 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.322+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96740c2150 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.323+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f965c021070 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.323+0000 7f96717fa700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 0x7f9654061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.323+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f965c07bcf0 con 0x7f967413a620 2024-01-21T21:15:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.323+0000 7f9673fff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 0x7f9654061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.323+0000 7f9673fff700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 0x7f9654061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f966400bb60 tx=0x7f9664008040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.327+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96740c2150 con 0x7f967413a620 2024-01-21T21:15:10.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.491+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f96740c2150 con 0x7f967413a620 2024-01-21T21:15:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.494+0000 7f96717fa700 1 -- 172.21.15.133:0/2585893435 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96740c2150 con 0x7f967413a620 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 msgr2=0x7f9654061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 0x7f9654061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f966400bb60 tx=0x7f9664008040).stop 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 msgr2=0x7f96740ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f96740690c0 tx=0x7f965c017000).stop 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 shutdown_connections 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f965405f150 0x7f9654061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f967413aa00 0x7f9674167ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96740626f0 0x7f96740bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 --2- 172.21.15.133:0/2585893435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f967413a620 0x7f96740ad7d0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 >> 172.21.15.133:0/2585893435 conn(0x7f96740c7dc0 msgr2=0x7f9674157880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 shutdown_connections 2024-01-21T21:15:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.496+0000 7f967a681700 1 -- 172.21.15.133:0/2585893435 wait complete. 2024-01-21T21:15:10.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T21:15:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.625+0000 7fb35dd08700 1 Processor -- start 2024-01-21T21:15:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 -- start start 2024-01-21T21:15:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb35813a830 0x7fb3580c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 0x7fb3580bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3580c3890 con 0x7fb3580695b0 2024-01-21T21:15:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3580c3b70 con 0x7fb35813a830 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.626+0000 7fb35dd08700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3580c3e50 con 0x7fb35813ac10 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb35813a830 0x7fb3580c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb357fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb3580695b0 0x7fb3580699c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34494/0 (socket says 172.21.15.133:34494) 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb357fff700 1 -- 172.21.15.133:0/1202578297 learned_addr learned my addr 172.21.15.133:0/1202578297 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb356ffd700 1 --2- 172.21.15.133:0/1202578297 >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 0x7fb3580bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 -- 172.21.15.133:0/1202578297 >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 msgr2=0x7fb3580bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 --2- 172.21.15.133:0/1202578297 >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 0x7fb3580bce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 -- 172.21.15.133:0/1202578297 >> v1:172.21.15.133:6789/0 conn(0x7fb3580695b0 legacy=0x7fb3580699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 -- 172.21.15.133:0/1202578297 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580c4130 con 0x7fb35813a830 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3567fc700 1 -- 172.21.15.133:0/1202578297 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110156869 0 0) 0x7fb3580c3890 con 0x7fb3580695b0 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb356ffd700 1 --2- 172.21.15.133:0/1202578297 >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 0x7fb3580bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3577fe700 1 --2- 172.21.15.133:0/1202578297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813a830 0x7fb3580c3220 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7fb3580694b0 tx=0x7fb340009060).ready entity=mon.0 client_cookie=9cc6851f678405f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3567fc700 1 -- 172.21.15.133:0/1202578297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400090d0 con 0x7fb35813a830 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3567fc700 1 -- 172.21.15.133:0/1202578297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34000b580 con 0x7fb35813a830 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.627+0000 7fb3567fc700 1 -- 172.21.15.133:0/1202578297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34000b900 con 0x7fb35813a830 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 -- 172.21.15.133:0/1202578297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813a830 msgr2=0x7fb3580c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 --2- 172.21.15.133:0/1202578297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813a830 0x7fb3580c3220 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7fb3580694b0 tx=0x7fb340009060).stop 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 -- 172.21.15.133:0/1202578297 shutdown_connections 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 --2- 172.21.15.133:0/1202578297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813a830 0x7fb3580c3220 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 --2- 172.21.15.133:0/1202578297 >> v2:172.21.15.178:3300/0 conn(0x7fb35813ac10 0x7fb3580bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 -- 172.21.15.133:0/1202578297 >> 172.21.15.133:0/1202578297 conn(0x7fb3580c7dc0 msgr2=0x7fb3580c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 -- 172.21.15.133:0/1202578297 shutdown_connections 2024-01-21T21:15:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.628+0000 7fb35dd08700 1 -- 172.21.15.133:0/1202578297 wait complete. 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.629+0000 7fb35dd08700 1 Processor -- start 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.629+0000 7fb35dd08700 1 -- start start 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3580695b0 0x7fb358165250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35813a830 0x7fb3580c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358168ae0 con 0x7fb35813ac10 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358168800 con 0x7fb35813a830 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb35dd08700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb358164770 con 0x7fb3580695b0 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50870/0 (socket says 172.21.15.133:50870) 2024-01-21T21:15:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 -- 172.21.15.133:0/505430750 learned_addr learned my addr 172.21.15.133:0/505430750 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb356ffd700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35813a830 0x7fb3580c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb3577fe700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3580695b0 0x7fb358165250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 -- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3580695b0 msgr2=0x7fb358165250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3580695b0 0x7fb358165250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 -- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35813a830 msgr2=0x7fb3580c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35813a830 0x7fb3580c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 -- 172.21.15.133:0/505430750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400092a0 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.630+0000 7fb357fff700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fb35000c810 tx=0x7fb3500014d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.631+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350005d30 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.631+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350005e90 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.631+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350007320 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.631+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358164a50 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.631+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb358150b60 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.632+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35805fdf0 con 0x7fb35813ac10 2024-01-21T21:15:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.632+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb350007710 con 0x7fb35813ac10 2024-01-21T21:15:10.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.632+0000 7fb34ffff700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 0x7fb3380615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.632+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7fb35007a1e0 con 0x7fb35813ac10 2024-01-21T21:15:10.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.632+0000 7fb3577fe700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 0x7fb3380615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.633+0000 7fb3577fe700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 0x7fb3380615e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb34000b340 tx=0x7fb340017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.636+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb35004b3a0 con 0x7fb35813ac10 2024-01-21T21:15:10.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.799+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb3580c4410 con 0x7fb35813ac10 2024-01-21T21:15:10.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.803+0000 7fb34ffff700 1 -- 172.21.15.133:0/505430750 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v33) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb35004e9c0 con 0x7fb35813ac10 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 msgr2=0x7fb3380615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 0x7fb3380615e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb34000b340 tx=0x7fb340017000).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 msgr2=0x7fb358150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fb35000c810 tx=0x7fb3500014d0).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 shutdown_connections 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb33805f120 0x7fb3380615e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb35813ac10 0x7fb358150670 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3580695b0 0x7fb358165250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 --2- 172.21.15.133:0/505430750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35813a830 0x7fb3580c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 >> 172.21.15.133:0/505430750 conn(0x7fb3580c7dc0 msgr2=0x7fb358065200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 shutdown_connections 2024-01-21T21:15:10.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.805+0000 7fb35dd08700 1 -- 172.21.15.133:0/505430750 wait complete. 2024-01-21T21:15:10.819 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2024-01-21T21:15:10.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.934+0000 7f0cddafe700 1 Processor -- start 2024-01-21T21:15:10.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.934+0000 7f0cddafe700 1 -- start start 2024-01-21T21:15:10.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.934+0000 7f0cddafe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cd8155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.934+0000 7f0cddafe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd8065660 con 0x7f0cd8069ef0 2024-01-21T21:15:10.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cddafe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd8065f00 con 0x7f0cd80c3fb0 2024-01-21T21:15:10.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cddafe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80bef10 con 0x7f0cd80beb30 2024-01-21T21:15:10.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cd8069ef0 0x7f0cd8066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34508/0 (socket says 172.21.15.133:34508) 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd7fff700 1 -- 172.21.15.133:0/3119862671 learned_addr learned my addr 172.21.15.133:0/3119862671 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471456876 0 0) 0x7f0cd8065660 con 0x7f0cd8069ef0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc00033f0 con 0x7f0cd8069ef0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd77fe700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cd8155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 823267376 0 0) 0x7f0cc00033f0 con 0x7f0cd8069ef0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 msgr2=0x7f0cd8155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cd8155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 >> v1:172.21.15.178:6789/0 conn(0x7f0cd80c3fb0 legacy=0x7f0cd80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80c4740 con 0x7f0cd8069ef0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0cd00017f0 con 0x7f0cd8069ef0 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 >> v1:172.21.15.133:6789/0 conn(0x7f0cd8069ef0 legacy=0x7f0cd8066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc0003910 0x7f0cc0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cc0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cc0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80bef10 con 0x7f0cc0004690 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc000ba70 con 0x7f0cc0003910 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc000bc30 con 0x7f0cd80beb30 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cc0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd77fe700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc0003910 0x7f0cc0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.935+0000 7f0cd7fff700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cc0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 -- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 msgr2=0x7f0cc0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cc0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 -- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc0003910 msgr2=0x7f0cc0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc0003910 0x7f0cc0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 -- 172.21.15.133:0/3119862671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00033f0 con 0x7f0cc0004690 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd7fff700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80beb30 0x7f0cc0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cc0004b10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f0ccc001710 tx=0x7f0ccc007b70).ready entity=mon.0 client_cookie=94b4df438a8afb7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc013410 con 0x7f0cc0004690 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc013570 con 0x7f0cc0004690 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd67fc700 1 -- 172.21.15.133:0/3119862671 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc013910 con 0x7f0cc0004690 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 -- 172.21.15.133:0/3119862671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 msgr2=0x7f0cc0004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3119862671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cc0004b10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7f0ccc001710 tx=0x7f0ccc007b70).stop 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cd7fff700 1 -- 172.21.15.133:0/3119862671 reap_dead start 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 -- 172.21.15.133:0/3119862671 shutdown_connections 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 -- 172.21.15.133:0/3119862671 >> 172.21.15.133:0/3119862671 conn(0x7f0cd80c8010 msgr2=0x7f0cd80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 -- 172.21.15.133:0/3119862671 shutdown_connections 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.936+0000 7f0cddafe700 1 -- 172.21.15.133:0/3119862671 wait complete. 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.938+0000 7f0cddafe700 1 Processor -- start 2024-01-21T21:15:10.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.938+0000 7f0cddafe700 1 -- start start 2024-01-21T21:15:10.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80a7950 0x7f0cd8150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd81511a0 0x7f0cd80a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80bfae0 con 0x7f0cc0004690 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80aa2d0 con 0x7f0cd81511a0 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80aa590 con 0x7f0cd80a7950 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50894/0 (socket says 172.21.15.133:50894) 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 -- 172.21.15.133:0/3083732170 learned_addr learned my addr 172.21.15.133:0/3083732170 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd7fff700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd81511a0 0x7f0cd80a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80a7950 0x7f0cd8150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 -- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80a7950 msgr2=0x7f0cd8150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80a7950 0x7f0cd8150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 -- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd81511a0 msgr2=0x7f0cd80a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd81511a0 0x7f0cd80a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 -- 172.21.15.133:0/3083732170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd80aa870 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cd77fe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f0cc80109b0 tx=0x7f0cc8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800e8d0 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc800ea30 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800edb0 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd80bf490 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.939+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd80a5f40 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.940+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd80bfdc0 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.941+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0cc8014680 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.941+0000 7f0cbffff700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 0x7f0cc4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.941+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f0cc807a5b0 con 0x7f0cc0004690 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.941+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 0x7f0cc4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:10.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.941+0000 7f0cd6ffd700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 0x7f0cc4061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0cd8133420 tx=0x7f0ccc016000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:10.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:10.945+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0cc804b770 con 0x7f0cc0004690 2024-01-21T21:15:11.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.173+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f0cd805fdf0 con 0x7f0cc0004690 2024-01-21T21:15:11.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.177+0000 7f0cbffff700 1 -- 172.21.15.133:0/3083732170 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2446) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0cc804ed90 con 0x7f0cc0004690 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 msgr2=0x7f0cc4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 0x7f0cc4061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0cd8133420 tx=0x7f0ccc016000).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 msgr2=0x7f0cd80a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7f0cc80109b0 tx=0x7f0cc8008040).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 shutdown_connections 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f0cc405f150 0x7f0cc4061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd81511a0 0x7f0cd80a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc0004690 0x7f0cd80a9de0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 --2- 172.21.15.133:0/3083732170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd80a7950 0x7f0cd8150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 >> 172.21.15.133:0/3083732170 conn(0x7f0cd80c8010 msgr2=0x7f0cd80bd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:11.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 shutdown_connections 2024-01-21T21:15:11.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.179+0000 7f0cddafe700 1 -- 172.21.15.133:0/3083732170 wait complete. 2024-01-21T21:15:11.193 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2024-01-21T21:15:11.193 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2024-01-21T21:15:11.193 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T21:15:11.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2024-01-21T21:15:11.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.307+0000 7ffbd8c65700 1 Processor -- start 2024-01-21T21:15:11.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.307+0000 7ffbd8c65700 1 -- start start 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.308+0000 7ffbd8c65700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffbd4151fa0 0x7ffbd40bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.308+0000 7ffbd8c65700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.308+0000 7ffbd8c65700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd4069ca0 con 0x7ffbd40626f0 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.308+0000 7ffbd8c65700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40c6a40 con 0x7ffbd4151fa0 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.308+0000 7ffbd8c65700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4069650 con 0x7ffbd4152380 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffbd4151fa0 0x7ffbd40bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd1d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffbd4151fa0 0x7ffbd40bcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:45470/0 (socket says 172.21.15.133:45470) 2024-01-21T21:15:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 -- 172.21.15.133:0/2200300265 learned_addr learned my addr 172.21.15.133:0/2200300265 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd1d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53494/0 (socket says 172.21.15.133:53494) 2024-01-21T21:15:11.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd2d9d700 1 --1- 172.21.15.133:0/2200300265 >> v1:172.21.15.178:6789/0 conn(0x7ffbd40626f0 0x7ffbd406a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43006/0 (socket says 172.21.15.133:43006) 2024-01-21T21:15:11.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 -- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 msgr2=0x7ffbd40a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:11.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 -- 172.21.15.133:0/2200300265 >> v1:172.21.15.178:6789/0 conn(0x7ffbd40626f0 legacy=0x7ffbd406a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd159a700 1 -- 172.21.15.133:0/2200300265 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67314022 0 0) 0x7ffbd4069ca0 con 0x7ffbd40626f0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 -- 172.21.15.133:0/2200300265 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4069930 con 0x7ffbd4151fa0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd1d9b700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd259c700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40bcd40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7ffbc4006fd0 tx=0x7ffbc40090f0).ready entity=mon.1 client_cookie=55679bae349eaa25 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.309+0000 7ffbd159a700 1 -- 172.21.15.133:0/2200300265 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400b580 con 0x7ffbd4151fa0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd159a700 1 -- 172.21.15.133:0/2200300265 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc400b6e0 con 0x7ffbd4151fa0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd159a700 1 -- 172.21.15.133:0/2200300265 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc400ba80 con 0x7ffbd4151fa0 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 -- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 msgr2=0x7ffbd40bcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40bcd40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7ffbc4006fd0 tx=0x7ffbc40090f0).stop 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 -- 172.21.15.133:0/2200300265 shutdown_connections 2024-01-21T21:15:11.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40bcd40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/2200300265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4152380 0x7ffbd40a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 -- 172.21.15.133:0/2200300265 >> 172.21.15.133:0/2200300265 conn(0x7ffbd40c7de0 msgr2=0x7ffbd40c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 -- 172.21.15.133:0/2200300265 shutdown_connections 2024-01-21T21:15:11.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.310+0000 7ffbd8c65700 1 -- 172.21.15.133:0/2200300265 wait complete. 2024-01-21T21:15:11.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.312+0000 7ffbd8c65700 1 Processor -- start 2024-01-21T21:15:11.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.312+0000 7ffbd8c65700 1 -- start start 2024-01-21T21:15:11.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd40626f0 0x7ffbd4144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40ac720 con 0x7ffbd4152380 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40c06d0 con 0x7ffbd4151fa0 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd8c65700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41452b0 con 0x7ffbd40626f0 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50898/0 (socket says 172.21.15.133:50898) 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 -- 172.21.15.133:0/1279426472 learned_addr learned my addr 172.21.15.133:0/1279426472 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd259c700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd40626f0 0x7ffbd4144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd1d9b700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 -- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd40626f0 msgr2=0x7ffbd4144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd40626f0 0x7ffbd4144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 -- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 msgr2=0x7ffbd40abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:11.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 -- 172.21.15.133:0/1279426472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0092a0 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.313+0000 7ffbd2d9d700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7ffbcc00c7e0 tx=0x7ffbcc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.314+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc005c70 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.314+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc005dd0 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.314+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4009370 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.314+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc007320 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.314+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd41620b0 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.315+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd405fdf0 con 0x7ffbd4152380 2024-01-21T21:15:11.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.315+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ffbcc007710 con 0x7ffbd4152380 2024-01-21T21:15:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.315+0000 7ffbcaffd700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 0x7ffbb40615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.316+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7ffbcc07a260 con 0x7ffbd4152380 2024-01-21T21:15:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.316+0000 7ffbd259c700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 0x7ffbb40615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:11.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.316+0000 7ffbd259c700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 0x7ffbb40615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ffbc400b340 tx=0x7ffbc4017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.319+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffbcc04b420 con 0x7ffbd4152380 2024-01-21T21:15:11.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:11.548+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7ffbd40bd230 con 0x7ffbd4152380 2024-01-21T21:15:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.179+0000 7ffbcaffd700 1 -- 172.21.15.133:0/1279426472 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2447) v1 ==== 168+0+0 (secure 0 0 0) 0x7ffbcc04ea40 con 0x7ffbd4152380 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.181+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 msgr2=0x7ffbb40615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.181+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 0x7ffbb40615e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ffbc400b340 tx=0x7ffbc4017000).stop 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.181+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 msgr2=0x7ffbd40ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.181+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7ffbcc00c7e0 tx=0x7ffbcc007f60).stop 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 shutdown_connections 2024-01-21T21:15:12.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ffbb405f120 0x7ffbb40615e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd4152380 0x7ffbd40ac230 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd40626f0 0x7ffbd4144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 --2- 172.21.15.133:0/1279426472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd4151fa0 0x7ffbd40abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 >> 172.21.15.133:0/1279426472 conn(0x7ffbd40c7de0 msgr2=0x7ffbd40ad350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 shutdown_connections 2024-01-21T21:15:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.182+0000 7ffbd8c65700 1 -- 172.21.15.133:0/1279426472 wait complete. 2024-01-21T21:15:12.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T21:15:12.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.315+0000 7f591c697700 1 Processor -- start 2024-01-21T21:15:12.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.315+0000 7f591c697700 1 -- start start 2024-01-21T21:15:12.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.316+0000 7f591c697700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5914062e00 0x7f59140a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.316+0000 7f591c697700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.316+0000 7f591c697700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59141584f0 con 0x7f591413a620 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.316+0000 7f591c697700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59140bd6f0 con 0x7f5914062e00 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.316+0000 7f591c697700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59140654e0 con 0x7f591413aa00 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5914062e00 0x7f59140a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f591a433700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f591413a620 0x7f59140626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34518/0 (socket says 172.21.15.133:34518) 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f591a433700 1 -- 172.21.15.133:0/2892731588 learned_addr learned my addr 172.21.15.133:0/2892731588 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f591ac34700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 -- 172.21.15.133:0/2892731588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 msgr2=0x7f5914158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 -- 172.21.15.133:0/2892731588 >> v1:172.21.15.133:6789/0 conn(0x7f591413a620 legacy=0x7f59140626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919431700 1 -- 172.21.15.133:0/2892731588 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757855417 0 0) 0x7f5908001110 con 0x7f591413a620 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 -- 172.21.15.133:0/2892731588 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914158730 con 0x7f5914062e00 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919c32700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5914062e00 0x7f59140a6e30 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f5910009760 tx=0x7f5910009060).ready entity=mon.0 client_cookie=6ddb4b757902a965 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919431700 1 -- 172.21.15.133:0/2892731588 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100090d0 con 0x7f5914062e00 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919431700 1 -- 172.21.15.133:0/2892731588 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591000b580 con 0x7f5914062e00 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.317+0000 7f5919431700 1 -- 172.21.15.133:0/2892731588 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000b900 con 0x7f5914062e00 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 -- 172.21.15.133:0/2892731588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5914062e00 msgr2=0x7f59140a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5914062e00 0x7f59140a6e30 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 rx=0x7f5910009760 tx=0x7f5910009060).stop 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 -- 172.21.15.133:0/2892731588 shutdown_connections 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 --2- 172.21.15.133:0/2892731588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5914062e00 0x7f59140a6e30 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 -- 172.21.15.133:0/2892731588 >> 172.21.15.133:0/2892731588 conn(0x7f59140c7dc0 msgr2=0x7f59140c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:12.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 -- 172.21.15.133:0/2892731588 shutdown_connections 2024-01-21T21:15:12.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.318+0000 7f591c697700 1 -- 172.21.15.133:0/2892731588 wait complete. 2024-01-21T21:15:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.319+0000 7f591c697700 1 Processor -- start 2024-01-21T21:15:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.319+0000 7f591c697700 1 -- start start 2024-01-21T21:15:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 0x7f59141398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5914139dd0 con 0x7f591413a620 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59140c0030 con 0x7f5914062e00 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59140aa4b0 con 0x7f591413aa00 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50914/0 (socket says 172.21.15.133:50914) 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 -- 172.21.15.133:0/2395250806 learned_addr learned my addr 172.21.15.133:0/2395250806 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591a433700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 0x7f59141398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591ac34700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 -- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 msgr2=0x7f5914157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 -- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 msgr2=0x7f59141398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 0x7f59141398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 -- 172.21.15.133:0/2395250806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100092a0 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591a433700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 0x7f59141398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591ac34700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5919c32700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f5910011000 tx=0x7f5910017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000b900 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910006950 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59140a9b80 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591001b410 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.320+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59140aa140 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.321+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591405fdf0 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.322+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f591001b840 con 0x7f591413a620 2024-01-21T21:15:12.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.323+0000 7f5906ffd700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 0x7f58f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.323+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f591007bf30 con 0x7f591413a620 2024-01-21T21:15:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.323+0000 7f591a433700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 0x7f58f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.323+0000 7f591a433700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 0x7f58f8061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5908007fd0 tx=0x7f5908009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.326+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f591004d190 con 0x7f591413a620 2024-01-21T21:15:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.490+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f591406a6a0 con 0x7f591413a620 2024-01-21T21:15:12.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.493+0000 7f5906ffd700 1 -- 172.21.15.133:0/2395250806 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59100507b0 con 0x7f591413a620 2024-01-21T21:15:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 msgr2=0x7f58f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 0x7f58f8061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f5908007fd0 tx=0x7f5908009040).stop 2024-01-21T21:15:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 msgr2=0x7f59140bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f5910011000 tx=0x7f5910017000).stop 2024-01-21T21:15:12.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 shutdown_connections 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f58f805f150 0x7f58f8061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f591413aa00 0x7f5914157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5914062e00 0x7f59141398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.495+0000 7f591c697700 1 --2- 172.21.15.133:0/2395250806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f591413a620 0x7f59140bf730 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.496+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 >> 172.21.15.133:0/2395250806 conn(0x7f59140c7dc0 msgr2=0x7f5914065970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.496+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 shutdown_connections 2024-01-21T21:15:12.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.496+0000 7f591c697700 1 -- 172.21.15.133:0/2395250806 wait complete. 2024-01-21T21:15:12.509 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:15:12.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:15:12.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:15:12.601 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:15:12.601 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T21:15:12.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:12.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.717+0000 7f8bbbcbe700 1 Processor -- start 2024-01-21T21:15:12.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.717+0000 7f8bbbcbe700 1 -- start start 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bbbcbe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bb4062ff0 0x7f8bb4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bbbcbe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb4069ef0 con 0x7f8bb4062c10 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bbbcbe700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb4065fe0 con 0x7f8bb4065b50 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bbbcbe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb406a130 con 0x7f8bb4062ff0 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bb9259700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bb4062ff0 0x7f8bb4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bb9a5a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8bb4062c10 0x7f8bb40697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34520/0 (socket says 172.21.15.133:34520) 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.718+0000 7f8bb9a5a700 1 -- 172.21.15.133:0/3263487085 learned_addr learned my addr 172.21.15.133:0/3263487085 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb9259700 1 -- 172.21.15.133:0/3263487085 >> v1:172.21.15.178:6789/0 conn(0x7f8bb4065b50 legacy=0x7f8bb40bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb9259700 1 -- 172.21.15.133:0/3263487085 >> v1:172.21.15.133:6789/0 conn(0x7f8bb4062c10 legacy=0x7f8bb40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb9259700 1 -- 172.21.15.133:0/3263487085 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb406a410 con 0x7f8bb4062ff0 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb8a58700 1 -- 172.21.15.133:0/3263487085 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164053961 0 0) 0x7f8ba4001110 con 0x7f8bb4062c10 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb9259700 1 --2- 172.21.15.133:0/3263487085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb4065660 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8bb0009760 tx=0x7f8bb0009060).ready entity=mon.0 client_cookie=c4c003b421698856 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb8a58700 1 -- 172.21.15.133:0/3263487085 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0009120 con 0x7f8bb4062ff0 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb8a58700 1 -- 172.21.15.133:0/3263487085 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000b580 con 0x7f8bb4062ff0 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bb8a58700 1 -- 172.21.15.133:0/3263487085 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000b900 con 0x7f8bb4062ff0 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/3263487085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 msgr2=0x7f8bb4065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/3263487085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb4065660 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8bb0009760 tx=0x7f8bb0009060).stop 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/3263487085 shutdown_connections 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/3263487085 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb4065660 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/3263487085 >> 172.21.15.133:0/3263487085 conn(0x7f8bb40c8010 msgr2=0x7f8bb40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/3263487085 shutdown_connections 2024-01-21T21:15:12.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.719+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/3263487085 wait complete. 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 Processor -- start 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 -- start start 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 0x7f8bb413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 0x7f8bb40a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40a9f00 con 0x7f8bb4062ff0 2024-01-21T21:15:12.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40ac890 con 0x7f8bb4065b50 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bbbcbe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb40abc80 con 0x7f8bb4062c10 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bb9259700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.721+0000 7f8bb9259700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50928/0 (socket says 172.21.15.133:50928) 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 -- 172.21.15.133:0/1160089138 learned_addr learned my addr 172.21.15.133:0/1160089138 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bba25b700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 0x7f8bb40a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9a5a700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 0x7f8bb413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 -- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 msgr2=0x7f8bb413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 0x7f8bb413c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 -- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 msgr2=0x7f8bb40a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 0x7f8bb40a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 -- 172.21.15.133:0/1160089138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb00092a0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9a5a700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 0x7f8bb413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bba25b700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 0x7f8bb40a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bb9259700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8bb0009eb0 tx=0x7f8bb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000bcc0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000be20 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb001b620 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb40abf60 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.722+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb40ac520 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.723+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb405fdf0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.723+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f8bb001bc20 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.724+0000 7f8baa7fc700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 0x7f8b98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.724+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f8bb007c0e0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.724+0000 7f8bb9a5a700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 0x7f8b98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:12.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.724+0000 7f8bb9a5a700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 0x7f8b98061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ba4000c00 tx=0x7f8ba4009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:12.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.728+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8bb004d2a0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.935+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb40c8e40 con 0x7f8bb4062ff0 2024-01-21T21:15:12.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.936+0000 7f8baa7fc700 1 -- 172.21.15.133:0/1160089138 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f8bb0029df0 con 0x7f8bb4062ff0 2024-01-21T21:15:12.937 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:12.937 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1829824128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1829824128},{"type":"v1","addr":"172.21.15.133:6837","nonce":1829824128}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7705,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2617522402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2617522402},{"type":"v1","addr":"172.21.15.178:6835","nonce":2617522402}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7708,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/2371824133","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2371824133},{"type":"v1","addr":"172.21.15.178:6834","nonce":2371824133}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8562,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1640241003","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1640241003},{"type":"v1","addr":"172.21.15.133:6835","nonce":1640241003}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[]} 2024-01-21T21:15:12.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 msgr2=0x7f8b98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 0x7f8b98061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f8ba4000c00 tx=0x7f8ba4009040).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 msgr2=0x7f8bb40a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8bb0009eb0 tx=0x7f8bb0017000).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 shutdown_connections 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f8b9805f150 0x7f8b98061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8bb4065b50 0x7f8bb40a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8bb4062c10 0x7f8bb413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 --2- 172.21.15.133:0/1160089138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bb4062ff0 0x7f8bb40a9520 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 >> 172.21.15.133:0/1160089138 conn(0x7f8bb40c8010 msgr2=0x7f8bb40c2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 shutdown_connections 2024-01-21T21:15:12.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:12.938+0000 7f8bbbcbe700 1 -- 172.21.15.133:0/1160089138 wait complete. 2024-01-21T21:15:12.941 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 58 2024-01-21T21:15:12.951 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T21:15:12.951 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T21:15:12.952 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T21:15:12.952 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:15:12.952 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T21:15:12.952 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T21:15:12.952 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T21:15:12.952 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:15:12.952 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T21:15:12.953 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T21:15:12.953 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T21:15:12.953 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:15:12.953 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T21:15:12.953 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T21:15:12.953 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T21:15:12.953 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:15:12.961 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T21:15:12.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T21:15:12.961 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T21:15:12.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T21:15:12.964 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T21:15:12.965 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T21:15:12.965 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T21:15:12.965 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T21:15:13.003 INFO:tasks.ceph.mds.c:Started 2024-01-21T21:15:13.003 DEBUG:teuthology.parallel:result is None 2024-01-21T21:15:13.004 INFO:tasks.ceph.mds.a:Started 2024-01-21T21:15:13.004 DEBUG:teuthology.parallel:result is None 2024-01-21T21:15:13.007 INFO:tasks.ceph.mds.d:Started 2024-01-21T21:15:13.007 DEBUG:teuthology.parallel:result is None 2024-01-21T21:15:13.008 INFO:tasks.ceph.mds.b:Started 2024-01-21T21:15:13.008 DEBUG:teuthology.parallel:result is None 2024-01-21T21:15:13.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T21:15:13.078 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:15:13.079 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T21:15:13.095 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T21:15:13.096 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T21:15:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.136+0000 7f51c48e5700 1 Processor -- start 2024-01-21T21:15:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.136+0000 7f51c48e5700 1 -- start start 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51c48e5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51c48e5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51c48e5700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c0068760 con 0x7f51c00bfb60 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51c48e5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c01533e0 con 0x7f51c0152f70 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51c48e5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c3ee0 con 0x7f51c00bf780 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bed9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bed9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:45516/0 (socket says 172.21.15.133:45516) 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53548/0 (socket says 172.21.15.133:53548) 2024-01-21T21:15:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bdd9b700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f51c00bfb60 0x7f51c0152860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43026/0 (socket says 172.21.15.133:43026) 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bed9d700 1 -- 172.21.15.133:0/1182802627 learned_addr learned my addr 172.21.15.133:0/1182802627 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 -- 172.21.15.133:0/1182802627 >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 msgr2=0x7f51c00c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 --2- 172.21.15.133:0/1182802627 >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 -- 172.21.15.133:0/1182802627 >> v1:172.21.15.178:6789/0 conn(0x7f51c00bfb60 legacy=0x7f51c0152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bd59a700 1 -- 172.21.15.133:0/1182802627 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514833657 0 0) 0x7f51c0068760 con 0x7f51c00bfb60 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 -- 172.21.15.133:0/1182802627 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c01535d0 con 0x7f51c00bf780 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51bed9d700 1 --2- 172.21.15.133:0/1182802627 >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.137+0000 7f51be59c700 1 --2- 172.21.15.133:0/1182802627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f51b0009760 tx=0x7f51b0009060).ready entity=mon.2 client_cookie=8ea6812470395feb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51bd59a700 1 -- 172.21.15.133:0/1182802627 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00090d0 con 0x7f51c00bf780 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51bd59a700 1 -- 172.21.15.133:0/1182802627 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000f510 con 0x7f51c00bf780 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51bd59a700 1 -- 172.21.15.133:0/1182802627 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000f890 con 0x7f51c00bf780 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 -- 172.21.15.133:0/1182802627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 msgr2=0x7f51c00c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 --2- 172.21.15.133:0/1182802627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f51b0009760 tx=0x7f51b0009060).stop 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 -- 172.21.15.133:0/1182802627 shutdown_connections 2024-01-21T21:15:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 --2- 172.21.15.133:0/1182802627 >> v2:172.21.15.178:3300/0 conn(0x7f51c0152f70 0x7f51c00c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 --2- 172.21.15.133:0/1182802627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c00c3500 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 -- 172.21.15.133:0/1182802627 >> 172.21.15.133:0/1182802627 conn(0x7f51c0066a90 msgr2=0x7f51c0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 -- 172.21.15.133:0/1182802627 shutdown_connections 2024-01-21T21:15:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.138+0000 7f51c48e5700 1 -- 172.21.15.133:0/1182802627 wait complete. 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 Processor -- start 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 -- start start 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c0152f70 0x7f51c0162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0162eb0 con 0x7f51c00bfb60 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c2170 con 0x7f51c0152f70 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.140+0000 7f51c48e5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c00c1840 con 0x7f51c00bf780 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50958/0 (socket says 172.21.15.133:50958) 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 -- 172.21.15.133:0/3342034458 learned_addr learned my addr 172.21.15.133:0/3342034458 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51be59c700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bed9d700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c0152f70 0x7f51c0162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 -- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 msgr2=0x7f51c0156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c0156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 -- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c0152f70 msgr2=0x7f51c0162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c0152f70 0x7f51c0162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 -- 172.21.15.133:0/3342034458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009ae0 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51bdd9b700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f51b400c440 tx=0x7f51b4007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40072e0 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4007440 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00092a0 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40058f0 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.141+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c00c1e00 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.142+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c005fdf0 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.143+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f51b4005d20 con 0x7f51c00bfb60 2024-01-21T21:15:13.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.143+0000 7f51aeffd700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 0x7f51a00615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.143+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f51b4079b60 con 0x7f51c00bfb60 2024-01-21T21:15:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.143+0000 7f51be59c700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 0x7f51a00615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:13.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.143+0000 7f51be59c700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 0x7f51a00615e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f51b0009fd0 tx=0x7f51b0017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:13.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.147+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f51b404ad20 con 0x7f51c00bfb60 2024-01-21T21:15:13.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:13.326+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f51c014c950 con 0x7f51c00bfb60 2024-01-21T21:15:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.182+0000 7f51aeffd700 1 -- 172.21.15.133:0/3342034458 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) v1 ==== 97+0+0 (secure 0 0 0) 0x7f51b404e340 con 0x7f51c00bfb60 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 msgr2=0x7f51a00615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 0x7f51a00615e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f51b0009fd0 tx=0x7f51b0017000).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 msgr2=0x7f51c0163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f51b400c440 tx=0x7f51b4007bd0).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 shutdown_connections 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f51a005f120 0x7f51a00615e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c0152f70 0x7f51c0162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c00bf780 0x7f51c0156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 --2- 172.21.15.133:0/3342034458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51c00bfb60 0x7f51c0163040 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 >> 172.21.15.133:0/3342034458 conn(0x7f51c0066a90 msgr2=0x7f51c014be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 shutdown_connections 2024-01-21T21:15:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.186+0000 7f51c48e5700 1 -- 172.21.15.133:0/3342034458 wait complete. 2024-01-21T21:15:14.189 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T21:15:14.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T21:15:14.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.327+0000 7fefeb94c700 1 Processor -- start 2024-01-21T21:15:14.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.327+0000 7fefeb94c700 1 -- start start 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefeb94c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefe40beb30 0x7fefe4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefeb94c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 0x7fefe40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefeb94c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe4065660 con 0x7fefe4069cd0 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefeb94c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40bef10 con 0x7fefe40beb30 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefeb94c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe4156070 con 0x7fefe40c3fb0 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefe40beb30 0x7fefe4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe9ee9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefe4069cd0 0x7fefe4151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34530/0 (socket says 172.21.15.133:34530) 2024-01-21T21:15:14.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe9ee9700 1 -- 172.21.15.133:0/1395011315 learned_addr learned my addr 172.21.15.133:0/1395011315 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe8ee7700 1 --2- 172.21.15.133:0/1395011315 >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 0x7fefe40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 -- 172.21.15.133:0/1395011315 >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 msgr2=0x7fefe40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 --2- 172.21.15.133:0/1395011315 >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 0x7fefe40697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 -- 172.21.15.133:0/1395011315 >> v1:172.21.15.133:6789/0 conn(0x7fefe4069cd0 legacy=0x7fefe4151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 -- 172.21.15.133:0/1395011315 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4065f00 con 0x7fefe40beb30 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefdbfff700 1 -- 172.21.15.133:0/1395011315 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399059386 0 0) 0x7fefe4065660 con 0x7fefe4069cd0 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe8ee7700 1 --2- 172.21.15.133:0/1395011315 >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 0x7fefe40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.328+0000 7fefe96e8700 1 --2- 172.21.15.133:0/1395011315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4155b80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fefe405ecd0 tx=0x7fefe0009060).ready entity=mon.0 client_cookie=26ce31b6bb0baf1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefdbfff700 1 -- 172.21.15.133:0/1395011315 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe00090d0 con 0x7fefe40beb30 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefdbfff700 1 -- 172.21.15.133:0/1395011315 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000b520 con 0x7fefe40beb30 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefdbfff700 1 -- 172.21.15.133:0/1395011315 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000b8a0 con 0x7fefe40beb30 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 -- 172.21.15.133:0/1395011315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 msgr2=0x7fefe4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 --2- 172.21.15.133:0/1395011315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4155b80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7fefe405ecd0 tx=0x7fefe0009060).stop 2024-01-21T21:15:14.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 -- 172.21.15.133:0/1395011315 shutdown_connections 2024-01-21T21:15:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 --2- 172.21.15.133:0/1395011315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4155b80 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 --2- 172.21.15.133:0/1395011315 >> v2:172.21.15.178:3300/0 conn(0x7fefe40c3fb0 0x7fefe40697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 -- 172.21.15.133:0/1395011315 >> 172.21.15.133:0/1395011315 conn(0x7fefe40c8010 msgr2=0x7fefe40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 -- 172.21.15.133:0/1395011315 shutdown_connections 2024-01-21T21:15:14.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.329+0000 7fefeb94c700 1 -- 172.21.15.133:0/1395011315 wait complete. 2024-01-21T21:15:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.330+0000 7fefeb94c700 1 Processor -- start 2024-01-21T21:15:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.330+0000 7fefeb94c700 1 -- start start 2024-01-21T21:15:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe4069cd0 0x7fefe41399c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c3fb0 0x7fefe40bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4161b20 con 0x7fefe40beb30 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40a5300 con 0x7fefe4069cd0 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefeb94c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4161560 con 0x7fefe40c3fb0 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefe8ee7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefe8ee7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:50982/0 (socket says 172.21.15.133:50982) 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefe8ee7700 1 -- 172.21.15.133:0/3441686268 learned_addr learned my addr 172.21.15.133:0/3441686268 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefe96e8700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe4069cd0 0x7fefe41399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.331+0000 7fefe9ee9700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c3fb0 0x7fefe40bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 -- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c3fb0 msgr2=0x7fefe40bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c3fb0 0x7fefe40bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 -- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe4069cd0 msgr2=0x7fefe41399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe4069cd0 0x7fefe41399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 -- 172.21.15.133:0/3441686268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe00092a0 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefe8ee7700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7fefd400c880 tx=0x7fefd4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4010580 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40106e0 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4010a60 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe4161840 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.332+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe4139eb0 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.333+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40a5440 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.333+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fefd401b460 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.334+0000 7fefd9ffb700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 0x7fefc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.334+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7fefd407a1a0 con 0x7fefe40beb30 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.334+0000 7fefe96e8700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 0x7fefc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.334+0000 7fefe96e8700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 0x7fefc8061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fefe40bdda0 tx=0x7fefe0017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.338+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fefe40a5440 con 0x7fefe40beb30 2024-01-21T21:15:14.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.563+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fefe40a5440 con 0x7fefe40beb30 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.563+0000 7fefd9ffb700 1 -- 172.21.15.133:0/3441686268 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fefe40a5440 con 0x7fefe40beb30 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T21:15:14.565 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.566 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.567 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.568 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.569 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.571 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T21:15:14.572 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.573 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.574 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.575 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.576 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T21:15:14.577 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.565+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 msgr2=0x7fefc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.565+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 0x7fefc8061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fefe40bdda0 tx=0x7fefe0017000).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 msgr2=0x7fefe4160af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7fefd400c880 tx=0x7fefd4008040).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 shutdown_connections 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fefc805f150 0x7fefc8061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c3fb0 0x7fefe40bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe4069cd0 0x7fefe41399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 --2- 172.21.15.133:0/3441686268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefe40beb30 0x7fefe4160af0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 >> 172.21.15.133:0/3441686268 conn(0x7fefe40c8010 msgr2=0x7fefe41523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 shutdown_connections 2024-01-21T21:15:14.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.566+0000 7fefeb94c700 1 -- 172.21.15.133:0/3441686268 wait complete. 2024-01-21T21:15:14.580 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.694+0000 7f21869fe700 1 Processor -- start 2024-01-21T21:15:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.694+0000 7f21869fe700 1 -- start start 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f21869fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2180069ef0 0x7f2180155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f21869fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21800c3fb0 0x7f2180066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f21869fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2180065660 con 0x7f21800beb30 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f21869fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800bef10 con 0x7f2180069ef0 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f21869fe700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2180156070 con 0x7f21800c3fb0 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2180069ef0 0x7f2180155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21800beb30 0x7f21800697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34542/0 (socket says 172.21.15.133:34542) 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217ffff700 1 -- 172.21.15.133:0/2367757626 learned_addr learned my addr 172.21.15.133:0/2367757626 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f2184f9b700 1 --2- 172.21.15.133:0/2367757626 >> v2:172.21.15.178:3300/0 conn(0x7f21800c3fb0 0x7f2180066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 -- 172.21.15.133:0/2367757626 >> v2:172.21.15.178:3300/0 conn(0x7f21800c3fb0 msgr2=0x7f2180066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 --2- 172.21.15.133:0/2367757626 >> v2:172.21.15.178:3300/0 conn(0x7f21800c3fb0 0x7f2180066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 -- 172.21.15.133:0/2367757626 >> v1:172.21.15.133:6789/0 conn(0x7f21800beb30 legacy=0x7f21800697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 -- 172.21.15.133:0/2367757626 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180065f00 con 0x7f2180069ef0 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217effd700 1 -- 172.21.15.133:0/2367757626 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800083568 0 0) 0x7f2180065660 con 0x7f21800beb30 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217f7fe700 1 --2- 172.21.15.133:0/2367757626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f2180155b80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f2180060070 tx=0x7f2170009060).ready entity=mon.0 client_cookie=b29d7ddb38f0785b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.695+0000 7f217effd700 1 -- 172.21.15.133:0/2367757626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700090d0 con 0x7f2180069ef0 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f217effd700 1 -- 172.21.15.133:0/2367757626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217000f510 con 0x7f2180069ef0 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f217effd700 1 -- 172.21.15.133:0/2367757626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f217000f890 con 0x7f2180069ef0 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 -- 172.21.15.133:0/2367757626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 msgr2=0x7f2180155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 --2- 172.21.15.133:0/2367757626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f2180155b80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7f2180060070 tx=0x7f2170009060).stop 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 -- 172.21.15.133:0/2367757626 shutdown_connections 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 --2- 172.21.15.133:0/2367757626 >> v2:172.21.15.178:3300/0 conn(0x7f21800c3fb0 0x7f2180066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 --2- 172.21.15.133:0/2367757626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f2180155b80 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 -- 172.21.15.133:0/2367757626 >> 172.21.15.133:0/2367757626 conn(0x7f21800c8010 msgr2=0x7f21800c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 -- 172.21.15.133:0/2367757626 shutdown_connections 2024-01-21T21:15:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.696+0000 7f21869fe700 1 -- 172.21.15.133:0/2367757626 wait complete. 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.698+0000 7f21869fe700 1 Processor -- start 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.698+0000 7f21869fe700 1 -- start start 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800beb30 0x7f21800adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800c3fb0 0x7f21801380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800ae050 con 0x7f2180069ef0 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800a7290 con 0x7f21800c3fb0 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800c00c0 con 0x7f21800beb30 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51010/0 (socket says 172.21.15.133:51010) 2024-01-21T21:15:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 -- 172.21.15.133:0/588641625 learned_addr learned my addr 172.21.15.133:0/588641625 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217f7fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800beb30 0x7f21800adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f2184f9b700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800c3fb0 0x7f21801380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 -- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800beb30 msgr2=0x7f21800adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800beb30 0x7f21800adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 -- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800c3fb0 msgr2=0x7f21801380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800c3fb0 0x7f21801380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 -- 172.21.15.133:0/588641625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700092a0 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217ffff700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f216800c4e0 tx=0x7f2168007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21680072e0 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21800c0360 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2168007440 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.699+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21680057a0 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.700+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21800c0920 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.701+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f218005fdf0 con 0x7f2180069ef0 2024-01-21T21:15:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.701+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2168005b90 con 0x7f2180069ef0 2024-01-21T21:15:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.701+0000 7f217cff9700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 0x7f2160061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.701+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f2168079bc0 con 0x7f2180069ef0 2024-01-21T21:15:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.701+0000 7f217f7fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 0x7f2160061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.702+0000 7f217f7fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 0x7f2160061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2180060070 tx=0x7f2170017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.705+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f216804ae90 con 0x7f2180069ef0 2024-01-21T21:15:14.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.873+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21800c4740 con 0x7f2180069ef0 2024-01-21T21:15:14.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.874+0000 7f217cff9700 1 -- 172.21.15.133:0/588641625 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+14771 (secure 0 0 0) 0x7f216804e4b0 con 0x7f2180069ef0 2024-01-21T21:15:14.875 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:14.876 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":170,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:15:14.179430+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 msgr2=0x7f2160061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 0x7f2160061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2180060070 tx=0x7f2170017000).stop 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 msgr2=0x7f21800a6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f216800c4e0 tx=0x7f2168007c70).stop 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 shutdown_connections 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f216005f150 0x7f2160061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21800c3fb0 0x7f21801380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2180069ef0 0x7f21800a6c20 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 --2- 172.21.15.133:0/588641625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21800beb30 0x7f21800adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:14.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 >> 172.21.15.133:0/588641625 conn(0x7f21800c8010 msgr2=0x7f2180138b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:14.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 shutdown_connections 2024-01-21T21:15:14.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:14.876+0000 7f21869fe700 1 -- 172.21.15.133:0/588641625 wait complete. 2024-01-21T21:15:14.890 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T21:15:14.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:15:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.007+0000 7fe4d1a75700 1 Processor -- start 2024-01-21T21:15:15.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.007+0000 7fe4d1a75700 1 -- start start 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4d1a75700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4cc0a6e30 0x7fe4cc13aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4d1a75700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc0654e0 con 0x7fe4cc13a620 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4d1a75700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc158730 con 0x7fe4cc062e00 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4d1a75700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0bd6f0 con 0x7fe4cc0a6e30 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4cb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe4cc13a620 0x7fe4cc0626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34556/0 (socket says 172.21.15.133:34556) 2024-01-21T21:15:15.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4cb7fe700 1 -- 172.21.15.133:0/3583686742 learned_addr learned my addr 172.21.15.133:0/3583686742 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> v2:172.21.15.178:3300/0 conn(0x7fe4cc0a6e30 0x7fe4cc13aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455407055 0 0) 0x7fe4cc0654e0 con 0x7fe4cc13a620 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.008+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b80033f0 con 0x7fe4cc13a620 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747304329 0 0) 0x7fe4b80033f0 con 0x7fe4cc13a620 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 >> v2:172.21.15.178:3300/0 conn(0x7fe4cc0a6e30 msgr2=0x7fe4cc13aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 --2- 172.21.15.133:0/3583686742 >> v2:172.21.15.178:3300/0 conn(0x7fe4cc0a6e30 0x7fe4cc13aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 >> v1:172.21.15.178:6789/0 conn(0x7fe4cc062e00 legacy=0x7fe4cc065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc158a10 con 0x7fe4cc13a620 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe4b4001470 con 0x7fe4cc13a620 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> v2:172.21.15.178:3300/0 conn(0x7fe4cc0a6e30 0x7fe4cc13aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 >> v1:172.21.15.133:6789/0 conn(0x7fe4cc13a620 legacy=0x7fe4cc0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b80038e0 0x7fe4b8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b8004690 0x7fe4b8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 0x7fe4b800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0bd6f0 con 0x7fe4b8005050 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800bfe0 con 0x7fe4b8004690 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b800c1a0 con 0x7fe4b80038e0 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 0x7fe4b800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cb7fe700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b80038e0 0x7fe4b8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4caffd700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b8004690 0x7fe4b8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b80038e0 msgr2=0x7fe4b8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b80038e0 0x7fe4b8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b8004690 msgr2=0x7fe4b8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b8004690 0x7fe4b8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3583686742 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80033f0 con 0x7fe4b8005050 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cb7fe700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b80038e0 0x7fe4b8003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3583686742 reap_dead start 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 0x7fe4b800b8e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fe4c40094d0 tx=0x7fe4c400b040).ready entity=mon.0 client_cookie=ba0bb0ddc2e58633 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4017070 con 0x7fe4b8005050 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400f040 con 0x7fe4b8005050 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.009+0000 7fe4ca7fc700 1 -- 172.21.15.133:0/3583686742 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400ee70 con 0x7fe4b8005050 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 msgr2=0x7fe4b800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 0x7fe4b800b8e0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7fe4c40094d0 tx=0x7fe4c400b040).stop 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3583686742 shutdown_connections 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3583686742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4b8005050 0x7fe4b800b8e0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3583686742 >> 172.21.15.133:0/3583686742 conn(0x7fe4cc0c7dc0 msgr2=0x7fe4cc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3583686742 shutdown_connections 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.010+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3583686742 wait complete. 2024-01-21T21:15:15.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.011+0000 7fe4d1a75700 1 Processor -- start 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.011+0000 7fe4d1a75700 1 -- start start 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b8005050 0x7fe4cc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc15a9b0 0x7fe4cc155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0bef70 con 0x7fe4cc156060 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc1564e0 con 0x7fe4cc15a9b0 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4d1a75700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0a8ef0 con 0x7fe4b8005050 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51030/0 (socket says 172.21.15.133:51030) 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3107471673 learned_addr learned my addr 172.21.15.133:0/3107471673 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cb7fe700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b8005050 0x7fe4cc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4caffd700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc15a9b0 0x7fe4cc155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b8005050 msgr2=0x7fe4cc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b8005050 0x7fe4cc15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc15a9b0 msgr2=0x7fe4cc155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc15a9b0 0x7fe4cc155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.012+0000 7fe4cbfff700 1 -- 172.21.15.133:0/3107471673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0a91d0 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4cbfff700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fe4cc13aef0 tx=0x7fe4c4019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4009c50 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c401d630 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc0a94b0 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c401d9f0 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.013+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc0a9790 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.014+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe4c4023070 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.014+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc164770 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.014+0000 7fe4c3fff700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 0x7fe4ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.014+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7fe4c407c210 con 0x7fe4cc156060 2024-01-21T21:15:15.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.014+0000 7fe4cb7fe700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 0x7fe4ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.015+0000 7fe4cb7fe700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 0x7fe4ac061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe4b4001c00 tx=0x7fe4b40010e0).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.019+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe4cc164770 con 0x7fe4cc156060 2024-01-21T21:15:15.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.182+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe4cc164770 con 0x7fe4cc156060 2024-01-21T21:15:15.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.183+0000 7fe4c3fff700 1 -- 172.21.15.133:0/3107471673 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v170) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe4cc164770 con 0x7fe4cc156060 2024-01-21T21:15:15.184 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 msgr2=0x7fe4ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 0x7fe4ac061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe4b4001c00 tx=0x7fe4b40010e0).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 msgr2=0x7fe4cc0a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7fe4cc13aef0 tx=0x7fe4c4019000).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 shutdown_connections 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fe4ac05f150 0x7fe4ac061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4cc156060 0x7fe4cc0a8180 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b8005050 0x7fe4cc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 --2- 172.21.15.133:0/3107471673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4cc15a9b0 0x7fe4cc155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 >> 172.21.15.133:0/3107471673 conn(0x7fe4cc0c7dc0 msgr2=0x7fe4cc0c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 shutdown_connections 2024-01-21T21:15:15.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.185+0000 7fe4d1a75700 1 -- 172.21.15.133:0/3107471673 wait complete. 2024-01-21T21:15:15.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:15:15.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.317+0000 7f9b10693700 1 Processor -- start 2024-01-21T21:15:15.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.317+0000 7f9b10693700 1 -- start start 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b10693700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b080aa0f0 0x7f9b080ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b10693700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b08063750 con 0x7f9b081558d0 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b10693700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0805e380 con 0x7f9b080a9d10 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b10693700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0805e660 con 0x7f9b080aa0f0 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b0dc2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b080aa0f0 0x7f9b080ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b0ec30700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b081558d0 0x7f9b080c2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34568/0 (socket says 172.21.15.133:34568) 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b0dc2e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b080aa0f0 0x7f9b080ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51032/0 (socket says 172.21.15.133:51032) 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.318+0000 7f9b0ec30700 1 -- 172.21.15.133:0/3466361980 learned_addr learned my addr 172.21.15.133:0/3466361980 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0dc2e700 1 -- 172.21.15.133:0/3466361980 >> v1:172.21.15.178:6789/0 conn(0x7f9b080a9d10 legacy=0x7f9b081551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0dc2e700 1 -- 172.21.15.133:0/3466361980 >> v1:172.21.15.133:6789/0 conn(0x7f9b081558d0 legacy=0x7f9b080c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0d42d700 1 -- 172.21.15.133:0/3466361980 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607903951 0 0) 0x7f9b08063750 con 0x7f9b081558d0 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0dc2e700 1 -- 172.21.15.133:0/3466361980 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b080633e0 con 0x7f9b080aa0f0 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0dc2e700 1 --2- 172.21.15.133:0/3466361980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080aa0f0 0x7f9b080ad410 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f9b04009760 tx=0x7f9b04009060).ready entity=mon.0 client_cookie=45a126bc1768b45d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0d42d700 1 -- 172.21.15.133:0/3466361980 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04009120 con 0x7f9b080aa0f0 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0d42d700 1 -- 172.21.15.133:0/3466361980 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400b580 con 0x7f9b080aa0f0 2024-01-21T21:15:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.319+0000 7f9b0d42d700 1 -- 172.21.15.133:0/3466361980 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400b900 con 0x7f9b080aa0f0 2024-01-21T21:15:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 -- 172.21.15.133:0/3466361980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080aa0f0 msgr2=0x7f9b080ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 --2- 172.21.15.133:0/3466361980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080aa0f0 0x7f9b080ad410 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f9b04009760 tx=0x7f9b04009060).stop 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 -- 172.21.15.133:0/3466361980 shutdown_connections 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 --2- 172.21.15.133:0/3466361980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080aa0f0 0x7f9b080ad410 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 -- 172.21.15.133:0/3466361980 >> 172.21.15.133:0/3466361980 conn(0x7f9b080c8200 msgr2=0x7f9b080c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 -- 172.21.15.133:0/3466361980 shutdown_connections 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.320+0000 7f9b10693700 1 -- 172.21.15.133:0/3466361980 wait complete. 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.321+0000 7f9b10693700 1 Processor -- start 2024-01-21T21:15:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.321+0000 7f9b10693700 1 -- start start 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b080aa0f0 0x7f9b08152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b081558d0 0x7f9b0814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081554d0 con 0x7f9b080a9d10 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b08152d20 con 0x7f9b081558d0 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b081556e0 con 0x7f9b080aa0f0 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51042/0 (socket says 172.21.15.133:51042) 2024-01-21T21:15:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 -- 172.21.15.133:0/1206821663 learned_addr learned my addr 172.21.15.133:0/1206821663 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0ec30700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b081558d0 0x7f9b0814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0dc2e700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b080aa0f0 0x7f9b08152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 -- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b080aa0f0 msgr2=0x7f9b08152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b080aa0f0 0x7f9b08152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 -- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b081558d0 msgr2=0x7f9b0814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b081558d0 0x7f9b0814f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 -- 172.21.15.133:0/1206821663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040092a0 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b0e42f700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f9af800c4c0 tx=0x7f9af8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8007020 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8001e90 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b08154010 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af80073b0 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.322+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b080c2ad0 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.323+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b080c2cc0 con 0x7f9b080a9d10 2024-01-21T21:15:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.324+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9af80068b0 con 0x7f9b080a9d10 2024-01-21T21:15:15.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.324+0000 7f9afeffd700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 0x7f9aec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.324+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f9af8079b10 con 0x7f9b080a9d10 2024-01-21T21:15:15.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.324+0000 7f9b0dc2e700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 0x7f9aec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.325+0000 7f9b0dc2e700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 0x7f9aec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9b08150f30 tx=0x7f9b04017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.328+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9af804aea0 con 0x7f9b080a9d10 2024-01-21T21:15:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.492+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9b0805fdf0 con 0x7f9b080a9d10 2024-01-21T21:15:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.492+0000 7f9afeffd700 1 -- 172.21.15.133:0/1206821663 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9af804e4c0 con 0x7f9b080a9d10 2024-01-21T21:15:15.494 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:15:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 msgr2=0x7f9aec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 0x7f9aec061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9b08150f30 tx=0x7f9b04017000).stop 2024-01-21T21:15:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 msgr2=0x7f9b08154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 rx=0x7f9af800c4c0 tx=0x7f9af8007e00).stop 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 shutdown_connections 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f9aec05f150 0x7f9aec061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b081558d0 0x7f9b0814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b080a9d10 0x7f9b08154fe0 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 --2- 172.21.15.133:0/1206821663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b080aa0f0 0x7f9b08152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.494+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 >> 172.21.15.133:0/1206821663 conn(0x7f9b080c8200 msgr2=0x7f9b08069060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.495+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 shutdown_connections 2024-01-21T21:15:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.495+0000 7f9b10693700 1 -- 172.21.15.133:0/1206821663 wait complete. 2024-01-21T21:15:15.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T21:15:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.625+0000 7f9454600700 1 Processor -- start 2024-01-21T21:15:15.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.625+0000 7f9454600700 1 -- start start 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 0x7f944c154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f944c0a9e30 0x7f944c0bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f944c065980 0x7f944c065e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c0654f0 con 0x7f944c065980 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c063950 con 0x7f944c0a9e30 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9454600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c065180 con 0x7f944c1546b0 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f944c065980 0x7f944c065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f944c065980 0x7f944c065e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51056/0 (socket says 172.21.15.133:51056) 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 -- 172.21.15.133:0/3915160645 learned_addr learned my addr 172.21.15.133:0/3915160645 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f945239c700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 0x7f944c154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9451b9b700 1 --2- 172.21.15.133:0/3915160645 >> v2:172.21.15.178:3300/0 conn(0x7f944c0a9e30 0x7f944c0bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 -- 172.21.15.133:0/3915160645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 msgr2=0x7f944c154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 0x7f944c154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 -- 172.21.15.133:0/3915160645 >> v2:172.21.15.178:3300/0 conn(0x7f944c0a9e30 msgr2=0x7f944c0bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 --2- 172.21.15.133:0/3915160645 >> v2:172.21.15.178:3300/0 conn(0x7f944c0a9e30 0x7f944c0bc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 -- 172.21.15.133:0/3915160645 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0c4c80 con 0x7f944c065980 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f945239c700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 0x7f944c154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f9452b9d700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c065980 0x7f944c065e30 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f944c05f8b0 tx=0x7f9444009840).ready entity=mon.0 client_cookie=c72bf24c8fb48c67 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f945139a700 1 -- 172.21.15.133:0/3915160645 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400e070 con 0x7f944c065980 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f945139a700 1 -- 172.21.15.133:0/3915160645 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400ba50 con 0x7f944c065980 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.626+0000 7f945139a700 1 -- 172.21.15.133:0/3915160645 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400bdd0 con 0x7f944c065980 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 -- 172.21.15.133:0/3915160645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c065980 msgr2=0x7f944c065e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c065980 0x7f944c065e30 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f944c05f8b0 tx=0x7f9444009840).stop 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 -- 172.21.15.133:0/3915160645 shutdown_connections 2024-01-21T21:15:15.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c065980 0x7f944c065e30 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 --2- 172.21.15.133:0/3915160645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c1546b0 0x7f944c154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 --2- 172.21.15.133:0/3915160645 >> v2:172.21.15.178:3300/0 conn(0x7f944c0a9e30 0x7f944c0bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 -- 172.21.15.133:0/3915160645 >> 172.21.15.133:0/3915160645 conn(0x7f944c0c8200 msgr2=0x7f944c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 -- 172.21.15.133:0/3915160645 shutdown_connections 2024-01-21T21:15:15.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.627+0000 7f9454600700 1 -- 172.21.15.133:0/3915160645 wait complete. 2024-01-21T21:15:15.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.628+0000 7f9454600700 1 Processor -- start 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.628+0000 7f9454600700 1 -- start start 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f944c065980 0x7f944c14d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c0a9e30 0x7f944c14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0a95d0 con 0x7f944c1546b0 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1648f0 con 0x7f944c065980 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9454600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c164bd0 con 0x7f944c0a9e30 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9452b9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9452b9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51070/0 (socket says 172.21.15.133:51070) 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9452b9d700 1 -- 172.21.15.133:0/1214824056 learned_addr learned my addr 172.21.15.133:0/1214824056 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f9451b9b700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c0a9e30 0x7f944c14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.629+0000 7f945239c700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f944c065980 0x7f944c14d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 -- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c0a9e30 msgr2=0x7f944c14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c0a9e30 0x7f944c14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 -- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f944c065980 msgr2=0x7f944c14d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f944c065980 0x7f944c14d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 -- 172.21.15.133:0/1214824056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9444009ae0 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9452b9d700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f9444009fd0 tx=0x7f9444009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94440092e0 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944401e470 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c164eb0 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944401e810 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.630+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c14d5d0 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.631+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c05fdf0 con 0x7f944c1546b0 2024-01-21T21:15:15.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.631+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9444003040 con 0x7f944c1546b0 2024-01-21T21:15:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.631+0000 7f9442ffd700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 0x7f9430061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.632+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f944407b630 con 0x7f944c1546b0 2024-01-21T21:15:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.632+0000 7f945239c700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 0x7f9430061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.632+0000 7f945239c700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 0x7f9430061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f944800ab40 tx=0x7f9448008040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.636+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f944404ca70 con 0x7f944c1546b0 2024-01-21T21:15:15.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.803+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f944c05e850 con 0x7f944c1546b0 2024-01-21T21:15:15.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.803+0000 7f9442ffd700 1 -- 172.21.15.133:0/1214824056 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9444023070 con 0x7f944c1546b0 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:15:15.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:15.806 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T21:15:15.806 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T21:15:15.806 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:15.806 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 msgr2=0x7f9430061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 0x7f9430061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f944800ab40 tx=0x7f9448008040).stop 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 msgr2=0x7f944c14f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f9444009fd0 tx=0x7f9444009840).stop 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 shutdown_connections 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f943005f150 0x7f9430061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f944c1546b0 0x7f944c14f7f0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f944c065980 0x7f944c14d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 --2- 172.21.15.133:0/1214824056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f944c0a9e30 0x7f944c14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 >> 172.21.15.133:0/1214824056 conn(0x7f944c0c8200 msgr2=0x7f944c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 shutdown_connections 2024-01-21T21:15:15.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.805+0000 7f9454600700 1 -- 172.21.15.133:0/1214824056 wait complete. 2024-01-21T21:15:15.818 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T21:15:15.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T21:15:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.937+0000 7f3c26e31700 1 Processor -- start 2024-01-21T21:15:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.937+0000 7f3c26e31700 1 -- start start 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c26e31700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c20154960 0x7f3c200c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c26e31700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 0x7f3c20063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c26e31700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c20157f30 con 0x7f3c200c5060 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c26e31700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200674d0 con 0x7f3c20154960 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c26e31700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c20154ed0 con 0x7f3c200c3560 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c1ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c20154960 0x7f3c200c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c1ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c20154960 0x7f3c200c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51080/0 (socket says 172.21.15.133:51080) 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.938+0000 7f3c1ffff700 1 -- 172.21.15.133:0/819984893 learned_addr learned my addr 172.21.15.133:0/819984893 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c253ce700 1 --2- 172.21.15.133:0/819984893 >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 0x7f3c20063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1ffff700 1 -- 172.21.15.133:0/819984893 >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 msgr2=0x7f3c20063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1ffff700 1 --2- 172.21.15.133:0/819984893 >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 0x7f3c20063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1ffff700 1 -- 172.21.15.133:0/819984893 >> v1:172.21.15.178:6789/0 conn(0x7f3c200c5060 legacy=0x7f3c20066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1ffff700 1 -- 172.21.15.133:0/819984893 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c201551b0 con 0x7f3c20154960 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c253ce700 1 --2- 172.21.15.133:0/819984893 >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 0x7f3c20063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1ffff700 1 --2- 172.21.15.133:0/819984893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20154960 0x7f3c200c5440 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f3c200653d0 tx=0x7f3c0c0090f0).ready entity=mon.0 client_cookie=a6875596e3ed7902 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1f7fe700 1 -- 172.21.15.133:0/819984893 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00b5a0 con 0x7f3c20154960 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1f7fe700 1 -- 172.21.15.133:0/819984893 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00b700 con 0x7f3c20154960 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c1f7fe700 1 -- 172.21.15.133:0/819984893 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00baa0 con 0x7f3c20154960 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c26e31700 1 -- 172.21.15.133:0/819984893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20154960 msgr2=0x7f3c200c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c26e31700 1 --2- 172.21.15.133:0/819984893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20154960 0x7f3c200c5440 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f3c200653d0 tx=0x7f3c0c0090f0).stop 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c26e31700 1 -- 172.21.15.133:0/819984893 shutdown_connections 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c26e31700 1 --2- 172.21.15.133:0/819984893 >> v2:172.21.15.178:3300/0 conn(0x7f3c200c3560 0x7f3c20063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.939+0000 7f3c26e31700 1 --2- 172.21.15.133:0/819984893 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c20154960 0x7f3c200c5440 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.940+0000 7f3c26e31700 1 -- 172.21.15.133:0/819984893 >> 172.21.15.133:0/819984893 conn(0x7f3c200c8f60 msgr2=0x7f3c200c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.940+0000 7f3c26e31700 1 -- 172.21.15.133:0/819984893 shutdown_connections 2024-01-21T21:15:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.940+0000 7f3c26e31700 1 -- 172.21.15.133:0/819984893 wait complete. 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.941+0000 7f3c26e31700 1 Processor -- start 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.941+0000 7f3c26e31700 1 -- start start 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 0x7f3c200c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c20154960 0x7f3c201536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201646a0 con 0x7f3c200c5060 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200c3130 con 0x7f3c200c3560 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2013ec00 con 0x7f3c20154960 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51094/0 (socket says 172.21.15.133:51094) 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 -- 172.21.15.133:0/960903714 learned_addr learned my addr 172.21.15.133:0/960903714 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c24bcd700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 0x7f3c200c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c253ce700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c20154960 0x7f3c201536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 -- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c20154960 msgr2=0x7f3c201536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c20154960 0x7f3c201536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 -- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 msgr2=0x7f3c200c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 0x7f3c200c2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 -- 172.21.15.133:0/960903714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c009370 con 0x7f3c200c5060 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c24bcd700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 0x7f3c200c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1ffff700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f3c200693a0 tx=0x7f3c0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00b870 con 0x7f3c200c5060 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0c00b9d0 con 0x7f3c200c5060 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2013eee0 con 0x7f3c200c5060 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c01c420 con 0x7f3c200c5060 2024-01-21T21:15:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.942+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c200c2d20 con 0x7f3c200c5060 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.943+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2013ea60 con 0x7f3c200c5060 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.944+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3c0c022030 con 0x7f3c200c5060 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.944+0000 7f3c1d7fa700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 0x7f3c04061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.944+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f3c0c07bb90 con 0x7f3c200c5060 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.944+0000 7f3c24bcd700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 0x7f3c04061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.945+0000 7f3c24bcd700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 0x7f3c04061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3c14002780 tx=0x7f3c14009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:15.948+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c2013ea60 con 0x7f3c200c5060 2024-01-21T21:15:16.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.112+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3c2013ea60 con 0x7f3c200c5060 2024-01-21T21:15:16.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.204+0000 7f3c1d7fa700 1 -- 172.21.15.133:0/960903714 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3c2013ea60 con 0x7f3c200c5060 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 msgr2=0x7f3c04061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 0x7f3c04061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3c14002780 tx=0x7f3c14009040).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 msgr2=0x7f3c2013e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f3c200693a0 tx=0x7f3c0c015000).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 shutdown_connections 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f3c0405f150 0x7f3c04061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c20154960 0x7f3c201536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c200c3560 0x7f3c200c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 --2- 172.21.15.133:0/960903714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c200c5060 0x7f3c2013e100 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 >> 172.21.15.133:0/960903714 conn(0x7f3c200c8f60 msgr2=0x7f3c201525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 shutdown_connections 2024-01-21T21:15:16.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.207+0000 7f3c26e31700 1 -- 172.21.15.133:0/960903714 wait complete. 2024-01-21T21:15:16.264 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T21:15:16.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T21:15:16.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.385+0000 7fba88aaa700 1 Processor -- start 2024-01-21T21:15:16.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.385+0000 7fba88aaa700 1 -- start start 2024-01-21T21:15:16.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba88aaa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba84069ef0 0x7fba84155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba88aaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba88aaa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba84065660 con 0x7fba840beb30 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba88aaa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba840bef10 con 0x7fba84069ef0 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba88aaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba84156070 con 0x7fba840c3fb0 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba81d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba84069ef0 0x7fba84155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba82d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba82d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53634/0 (socket says 172.21.15.133:53634) 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba81d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba84069ef0 0x7fba84155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:45630/0 (socket says 172.21.15.133:45630) 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba82d9d700 1 -- 172.21.15.133:0/2962531092 learned_addr learned my addr 172.21.15.133:0/2962531092 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:16.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.386+0000 7fba8259c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fba840beb30 0x7fba840697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43064/0 (socket says 172.21.15.133:43064) 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba81d9b700 1 -- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 msgr2=0x7fba84066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba81d9b700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba81d9b700 1 -- 172.21.15.133:0/2962531092 >> v1:172.21.15.178:6789/0 conn(0x7fba840beb30 legacy=0x7fba840697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba8159a700 1 -- 172.21.15.133:0/2962531092 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364673266 0 0) 0x7fba84065660 con 0x7fba840beb30 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba81d9b700 1 -- 172.21.15.133:0/2962531092 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84065f00 con 0x7fba84069ef0 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba82d9d700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba81d9b700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba84069ef0 0x7fba84155b80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fba74009760 tx=0x7fba74009060).ready entity=mon.1 client_cookie=71cabf4e2481f383 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba8159a700 1 -- 172.21.15.133:0/2962531092 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740090d0 con 0x7fba84069ef0 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba8159a700 1 -- 172.21.15.133:0/2962531092 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400f510 con 0x7fba84069ef0 2024-01-21T21:15:16.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.387+0000 7fba8159a700 1 -- 172.21.15.133:0/2962531092 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400f890 con 0x7fba84069ef0 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 -- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba84069ef0 msgr2=0x7fba84155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba84069ef0 0x7fba84155b80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fba74009760 tx=0x7fba74009060).stop 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 -- 172.21.15.133:0/2962531092 shutdown_connections 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba840c3fb0 0x7fba84066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 --2- 172.21.15.133:0/2962531092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba84069ef0 0x7fba84155b80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 -- 172.21.15.133:0/2962531092 >> 172.21.15.133:0/2962531092 conn(0x7fba840c8010 msgr2=0x7fba840c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 -- 172.21.15.133:0/2962531092 shutdown_connections 2024-01-21T21:15:16.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.388+0000 7fba88aaa700 1 -- 172.21.15.133:0/2962531092 wait complete. 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.389+0000 7fba88aaa700 1 Processor -- start 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.389+0000 7fba88aaa700 1 -- start start 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 0x7fba84168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 0x7fba840aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba840c07f0 con 0x7fba840beb30 2024-01-21T21:15:16.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84153160 con 0x7fba840c3fb0 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba88aaa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba841533c0 con 0x7fba84069ef0 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51104/0 (socket says 172.21.15.133:51104) 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 -- 172.21.15.133:0/3661436241 learned_addr learned my addr 172.21.15.133:0/3661436241 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba82d9d700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 0x7fba840aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba8259c700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 0x7fba84168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 -- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 msgr2=0x7fba84168fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 0x7fba84168fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 -- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 msgr2=0x7fba840aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 0x7fba840aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 -- 172.21.15.133:0/3661436241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009ae0 con 0x7fba840beb30 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba82d9d700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 0x7fba840aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba8259c700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 0x7fba84168fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:16.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.390+0000 7fba81d9b700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fba84068a00 tx=0x7fba74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.391+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74009e30 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.391+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400fc50 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.391+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740092a0 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.391+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7401b410 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.391+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba84153980 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.392+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba840c0960 con 0x7fba840beb30 2024-01-21T21:15:16.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.392+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fba7401b7c0 con 0x7fba840beb30 2024-01-21T21:15:16.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.392+0000 7fba72ffd700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 0x7fba64061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:16.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.392+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fba7407bc90 con 0x7fba840beb30 2024-01-21T21:15:16.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.393+0000 7fba8259c700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 0x7fba64061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:16.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.393+0000 7fba8259c700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 0x7fba64061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba780011e0 tx=0x7fba78007b10).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:16.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.397+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fba7404ce50 con 0x7fba840beb30 2024-01-21T21:15:16.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:16.562+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fba8405fdf0 con 0x7fba840beb30 2024-01-21T21:15:17.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.211+0000 7fba72ffd700 1 -- 172.21.15.133:0/3661436241 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) v1 ==== 170+0+0 (secure 0 0 0) 0x7fba74028070 con 0x7fba840beb30 2024-01-21T21:15:17.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 msgr2=0x7fba64061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 0x7fba64061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fba780011e0 tx=0x7fba78007b10).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 msgr2=0x7fba84152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7fba84068a00 tx=0x7fba74017000).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 shutdown_connections 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fba6405f150 0x7fba64061610 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7fba780011e0 tx=0x7fba78007b10).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba840c3fb0 0x7fba840aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba84069ef0 0x7fba84168fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 --2- 172.21.15.133:0/3661436241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba840beb30 0x7fba84152c70 secure :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0x7fba84068a00 tx=0x7fba74017000).stop 2024-01-21T21:15:17.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.218+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 >> 172.21.15.133:0/3661436241 conn(0x7fba840c8010 msgr2=0x7fba8413ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:17.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.222+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 shutdown_connections 2024-01-21T21:15:17.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.222+0000 7fba88aaa700 1 -- 172.21.15.133:0/3661436241 wait complete. 2024-01-21T21:15:17.232 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T21:15:17.245 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T21:15:17.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.365+0000 7f45c3b70700 1 Processor -- start 2024-01-21T21:15:17.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.365+0000 7f45c3b70700 1 -- start start 2024-01-21T21:15:17.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c3b70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45bc154a90 0x7f45bc0a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c3b70700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0bc6d0 0x7f45bc066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c3b70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc0654f0 con 0x7f45bc1546b0 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c3b70700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc063700 con 0x7f45bc154a90 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c3b70700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc063950 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45bc154a90 0x7f45bc0a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c190c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f45bc1546b0 0x7f45bc065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34578/0 (socket says 172.21.15.133:34578) 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c190c700 1 -- 172.21.15.133:0/870620919 learned_addr learned my addr 172.21.15.133:0/870620919 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 -- 172.21.15.133:0/870620919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0bc6d0 msgr2=0x7f45bc066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c210d700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0bc6d0 0x7f45bc066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c090a700 1 -- 172.21.15.133:0/870620919 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462959118 0 0) 0x7f45bc0654f0 con 0x7f45bc1546b0 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0bc6d0 0x7f45bc066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 -- 172.21.15.133:0/870620919 >> v1:172.21.15.133:6789/0 conn(0x7f45bc1546b0 legacy=0x7f45bc065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 -- 172.21.15.133:0/870620919 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc065180 con 0x7f45bc154a90 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c110b700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc154a90 0x7f45bc0a9e30 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8009060).ready entity=mon.0 client_cookie=546da71d8437c43a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c090a700 1 -- 172.21.15.133:0/870620919 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80090d0 con 0x7f45bc154a90 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c090a700 1 -- 172.21.15.133:0/870620919 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800b580 con 0x7f45bc154a90 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.366+0000 7f45c090a700 1 -- 172.21.15.133:0/870620919 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800b900 con 0x7f45bc154a90 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 -- 172.21.15.133:0/870620919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc154a90 msgr2=0x7f45bc0a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc154a90 0x7f45bc0a9e30 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8009060).stop 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 -- 172.21.15.133:0/870620919 shutdown_connections 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0bc6d0 0x7f45bc066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 --2- 172.21.15.133:0/870620919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc154a90 0x7f45bc0a9e30 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 -- 172.21.15.133:0/870620919 >> 172.21.15.133:0/870620919 conn(0x7f45bc0c8200 msgr2=0x7f45bc0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 -- 172.21.15.133:0/870620919 shutdown_connections 2024-01-21T21:15:17.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.367+0000 7f45c3b70700 1 -- 172.21.15.133:0/870620919 wait complete. 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.368+0000 7f45c3b70700 1 Processor -- start 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.368+0000 7f45c3b70700 1 -- start start 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 0x7f45bc0ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 0x7f45bc0abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c52b0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c0ef0 con 0x7f45bc154a90 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c3b70700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0c11d0 con 0x7f45bc1546b0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51126/0 (socket says 172.21.15.133:51126) 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 -- 172.21.15.133:0/2985287086 learned_addr learned my addr 172.21.15.133:0/2985287086 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c110b700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 0x7f45bc0ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c210d700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 0x7f45bc0abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 -- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 msgr2=0x7f45bc0ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 0x7f45bc0ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 -- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 msgr2=0x7f45bc0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 0x7f45bc0abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 -- 172.21.15.133:0/2985287086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80092a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c110b700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 0x7f45bc0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:17.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c210d700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 0x7f45bc0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45c190c700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f45ac001eb0 tx=0x7f45ac007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.369+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0072e0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.370+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac007440 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.370+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0057a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.370+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc0c14b0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.370+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc0ace30 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.371+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc0c16a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.371+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f45ac005b90 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.371+0000 7f45b27fc700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 0x7f45a0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.371+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6677+0+0 (secure 0 0 0) 0x7f45ac079c00 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.371+0000 7f45c110b700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 0x7f45a0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.372+0000 7f45c110b700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 0x7f45a0061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.376+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f45bc0c16a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.581+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45bc0c16a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.587+0000 7f45b27fc700 1 -- 172.21.15.133:0/2985287086 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7f45bc0c16a0 con 0x7f45bc0bc6d0 2024-01-21T21:15:17.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 msgr2=0x7f45a0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 0x7f45a0061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f45b8009760 tx=0x7f45b8017000).stop 2024-01-21T21:15:17.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 msgr2=0x7f45bc0c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 rx=0x7f45ac001eb0 tx=0x7f45ac007e90).stop 2024-01-21T21:15:17.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 shutdown_connections 2024-01-21T21:15:17.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f45a005f150 0x7f45a0061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc154a90 0x7f45bc0abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45bc0bc6d0 0x7f45bc0c0950 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 --2- 172.21.15.133:0/2985287086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc1546b0 0x7f45bc0ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.590+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 >> 172.21.15.133:0/2985287086 conn(0x7f45bc0c8200 msgr2=0x7f45bc0697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:17.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.593+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 shutdown_connections 2024-01-21T21:15:17.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.593+0000 7f45c3b70700 1 -- 172.21.15.133:0/2985287086 wait complete. 2024-01-21T21:15:17.596 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 21 and data pool 22 2024-01-21T21:15:17.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:17.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.734+0000 7f86d65a1700 1 Processor -- start 2024-01-21T21:15:17.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.734+0000 7f86d65a1700 1 -- start start 2024-01-21T21:15:17.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d65a1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86d00beb30 0x7f86d0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d65a1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86d0069ef0 0x7f86d0066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d65a1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d0065660 con 0x7f86d00c3fb0 2024-01-21T21:15:17.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d65a1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d00bef10 con 0x7f86d00beb30 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d65a1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d0156070 con 0x7f86d0069ef0 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86d00beb30 0x7f86d0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86d00beb30 0x7f86d0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51136/0 (socket says 172.21.15.133:51136) 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 -- 172.21.15.133:0/3981364594 learned_addr learned my addr 172.21.15.133:0/3981364594 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86d4b3e700 1 --2- 172.21.15.133:0/3981364594 >> v2:172.21.15.178:3300/0 conn(0x7f86d0069ef0 0x7f86d0066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 -- 172.21.15.133:0/3981364594 >> v2:172.21.15.178:3300/0 conn(0x7f86d0069ef0 msgr2=0x7f86d0066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 --2- 172.21.15.133:0/3981364594 >> v2:172.21.15.178:3300/0 conn(0x7f86d0069ef0 0x7f86d0066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 -- 172.21.15.133:0/3981364594 >> v1:172.21.15.178:6789/0 conn(0x7f86d00c3fb0 legacy=0x7f86d00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 -- 172.21.15.133:0/3981364594 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d0065f00 con 0x7f86d00beb30 2024-01-21T21:15:17.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86cffff700 1 --2- 172.21.15.133:0/3981364594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0155b80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f86d0069360 tx=0x7f86c000b3b0).ready entity=mon.0 client_cookie=e132ddd3203ad120 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86ceffd700 1 -- 172.21.15.133:0/3981364594 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c000dac0 con 0x7f86d00beb30 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86ceffd700 1 -- 172.21.15.133:0/3981364594 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c000dc20 con 0x7f86d00beb30 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.735+0000 7f86ceffd700 1 -- 172.21.15.133:0/3981364594 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0010470 con 0x7f86d00beb30 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 -- 172.21.15.133:0/3981364594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 msgr2=0x7f86d0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 --2- 172.21.15.133:0/3981364594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0155b80 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7f86d0069360 tx=0x7f86c000b3b0).stop 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 -- 172.21.15.133:0/3981364594 shutdown_connections 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 --2- 172.21.15.133:0/3981364594 >> v2:172.21.15.178:3300/0 conn(0x7f86d0069ef0 0x7f86d0066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 --2- 172.21.15.133:0/3981364594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0155b80 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 -- 172.21.15.133:0/3981364594 >> 172.21.15.133:0/3981364594 conn(0x7f86d00c8010 msgr2=0x7f86d00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:17.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 -- 172.21.15.133:0/3981364594 shutdown_connections 2024-01-21T21:15:17.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.736+0000 7f86d65a1700 1 -- 172.21.15.133:0/3981364594 wait complete. 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.737+0000 7f86d65a1700 1 Processor -- start 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.738+0000 7f86d65a1700 1 -- start start 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 0x7f86d0163f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86d00c3fb0 0x7f86d00a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c1fa0 con 0x7f86d00beb30 2024-01-21T21:15:17.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00bfd40 con 0x7f86d0069ef0 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c1110 con 0x7f86d00c3fb0 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51138/0 (socket says 172.21.15.133:51138) 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 -- 172.21.15.133:0/1036796238 learned_addr learned my addr 172.21.15.133:0/1036796238 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cffff700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 0x7f86d0163f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d4b3e700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86d00c3fb0 0x7f86d00a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 -- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86d00c3fb0 msgr2=0x7f86d00a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86d00c3fb0 0x7f86d00a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 -- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 msgr2=0x7f86d0163f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 0x7f86d0163f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 -- 172.21.15.133:0/1036796238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c000b610 con 0x7f86d00beb30 2024-01-21T21:15:17.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cffff700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 0x7f86d0163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86cf7fe700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f86c400c470 tx=0x7f86c4007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400f470 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400f5f0 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00c1390 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400f9b0 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.739+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d00c19d0 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.740+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d0160a50 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.741+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f86c4012400 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.741+0000 7f86ccff9700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 0x7f86bc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.741+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f86c4079910 con 0x7f86d00beb30 2024-01-21T21:15:17.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.741+0000 7f86cffff700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 0x7f86bc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:17.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.742+0000 7f86cffff700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 0x7f86bc061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f86c0007010 tx=0x7f86c000b3b0).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:17.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.745+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f86c4048b00 con 0x7f86d00beb30 2024-01-21T21:15:17.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.910+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86d00c1cf0 con 0x7f86d00beb30 2024-01-21T21:15:17.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.911+0000 7f86ccff9700 1 -- 172.21.15.133:0/1036796238 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f86d0160a50 con 0x7f86d00beb30 2024-01-21T21:15:17.912 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:17.912 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":173,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:15:17.582801+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 msgr2=0x7f86bc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 0x7f86bc061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f86c0007010 tx=0x7f86c000b3b0).stop 2024-01-21T21:15:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 msgr2=0x7f86d0139fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7f86c400c470 tx=0x7f86c4007de0).stop 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 shutdown_connections 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f86bc05f150 0x7f86bc061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86d00c3fb0 0x7f86d00a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86d0069ef0 0x7f86d0163f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 --2- 172.21.15.133:0/1036796238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86d00beb30 0x7f86d0139fd0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.912+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 >> 172.21.15.133:0/1036796238 conn(0x7f86d00c8010 msgr2=0x7f86d00697e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.913+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 shutdown_connections 2024-01-21T21:15:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:17.913+0000 7f86d65a1700 1 -- 172.21.15.133:0/1036796238 wait complete. 2024-01-21T21:15:17.926 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:18.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.040+0000 7f7dbc4c4700 1 Processor -- start 2024-01-21T21:15:18.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.041+0000 7f7dbc4c4700 1 -- start start 2024-01-21T21:15:18.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.041+0000 7f7dbc4c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7db40a9d10 0x7f7db40ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.041+0000 7f7dbc4c4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7db40aa0f0 0x7f7db4063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dbc4c4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db4063750 con 0x7f7db40c4920 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dbc4c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40640d0 con 0x7f7db40a9d10 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dbc4c4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db405e380 con 0x7f7db40aa0f0 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7db40a9d10 0x7f7db40ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7db40a9d10 0x7f7db40ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51146/0 (socket says 172.21.15.133:51146) 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 -- 172.21.15.133:0/221388550 learned_addr learned my addr 172.21.15.133:0/221388550 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7db9a5f700 1 --2- 172.21.15.133:0/221388550 >> v2:172.21.15.178:3300/0 conn(0x7f7db40aa0f0 0x7f7db4063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 -- 172.21.15.133:0/221388550 >> v2:172.21.15.178:3300/0 conn(0x7f7db40aa0f0 msgr2=0x7f7db4063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 --2- 172.21.15.133:0/221388550 >> v2:172.21.15.178:3300/0 conn(0x7f7db40aa0f0 0x7f7db4063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 -- 172.21.15.133:0/221388550 >> v1:172.21.15.178:6789/0 conn(0x7f7db40c4920 legacy=0x7f7db41551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 -- 172.21.15.133:0/221388550 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db405e660 con 0x7f7db40a9d10 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7dba260700 1 --2- 172.21.15.133:0/221388550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40a9d10 0x7f7db40ad410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f7db40c1ce0 tx=0x7f7da40090f0).ready entity=mon.0 client_cookie=d8c8f3017e7371ca server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7db925e700 1 -- 172.21.15.133:0/221388550 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400b5a0 con 0x7f7db40a9d10 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7db925e700 1 -- 172.21.15.133:0/221388550 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400b700 con 0x7f7db40a9d10 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.042+0000 7f7db925e700 1 -- 172.21.15.133:0/221388550 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400baa0 con 0x7f7db40a9d10 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/221388550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40a9d10 msgr2=0x7f7db40ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/221388550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40a9d10 0x7f7db40ad410 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7f7db40c1ce0 tx=0x7f7da40090f0).stop 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/221388550 shutdown_connections 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/221388550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40a9d10 0x7f7db40ad410 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/221388550 >> v2:172.21.15.178:3300/0 conn(0x7f7db40aa0f0 0x7f7db4063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/221388550 >> 172.21.15.133:0/221388550 conn(0x7f7db40c8200 msgr2=0x7f7db40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/221388550 shutdown_connections 2024-01-21T21:15:18.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.043+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/221388550 wait complete. 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.044+0000 7f7dbc4c4700 1 Processor -- start 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.044+0000 7f7dbc4c4700 1 -- start start 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7db40a9d10 0x7f7db4144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7db40c4920 0x7f7db40bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db4165c50 con 0x7f7db40aa0f0 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40c0140 con 0x7f7db40c4920 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbc4c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40c0420 con 0x7f7db40a9d10 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51156/0 (socket says 172.21.15.133:51156) 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 -- 172.21.15.133:0/2970572816 learned_addr learned my addr 172.21.15.133:0/2970572816 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dba260700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7db40a9d10 0x7f7db4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7dbaa61700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7db40c4920 0x7f7db40bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 -- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7db40a9d10 msgr2=0x7f7db4144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7db40a9d10 0x7f7db4144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 -- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7db40c4920 msgr2=0x7f7db40bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7db40c4920 0x7f7db40bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 -- 172.21.15.133:0/2970572816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4009370 con 0x7f7db40aa0f0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.045+0000 7f7db9a5f700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f7db000c880 tx=0x7f7db0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0010580 con 0x7f7db40aa0f0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00106e0 con 0x7f7db40aa0f0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db4154260 con 0x7f7db40aa0f0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0010a60 con 0x7f7db40aa0f0 2024-01-21T21:15:18.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db4153f50 con 0x7f7db40aa0f0 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.046+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db405fdf0 con 0x7f7db40aa0f0 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.047+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7db001b460 con 0x7f7db40aa0f0 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.047+0000 7f7daaffd700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 0x7f7d98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.047+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7db007a2f0 con 0x7f7db40aa0f0 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.047+0000 7f7dba260700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 0x7f7d98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.048+0000 7f7dba260700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 0x7f7d98061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7da4009130 tx=0x7f7da4015000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.052+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7db004b2d0 con 0x7f7db40aa0f0 2024-01-21T21:15:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.217+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7db4063430 con 0x7f7db40aa0f0 2024-01-21T21:15:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.218+0000 7f7daaffd700 1 -- 172.21.15.133:0/2970572816 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+18004 (secure 0 0 0) 0x7f7db004e8f0 con 0x7f7db40aa0f0 2024-01-21T21:15:18.219 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:18.219 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":173,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:15:17.582801+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 msgr2=0x7f7d98061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 0x7f7d98061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f7da4009130 tx=0x7f7da4015000).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 msgr2=0x7f7db40bf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7f7db000c880 tx=0x7f7db0008040).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 shutdown_connections 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7d9805f150 0x7f7d98061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7db40c4920 0x7f7db40bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7db40a9d10 0x7f7db4144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 --2- 172.21.15.133:0/2970572816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7db40aa0f0 0x7f7db40bf5d0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 >> 172.21.15.133:0/2970572816 conn(0x7f7db40c8200 msgr2=0x7f7db40c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 shutdown_connections 2024-01-21T21:15:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.220+0000 7f7dbc4c4700 1 -- 172.21.15.133:0/2970572816 wait complete. 2024-01-21T21:15:18.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T21:15:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.354+0000 7ff5460db700 1 Processor -- start 2024-01-21T21:15:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.354+0000 7ff5460db700 1 -- start start 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff5460db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff540065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff5460db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5400bd360 0x7ff540154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff5460db700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5401511f0 con 0x7ff5400a9e30 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff5460db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff540065b20 con 0x7ff5400bd360 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff5460db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c2240 con 0x7ff5400c2b00 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff53f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff5400a9e30 0x7ff5400bcc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34584/0 (socket says 172.21.15.133:34584) 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.355+0000 7ff53f7fe700 1 -- 172.21.15.133:0/1033751793 learned_addr learned my addr 172.21.15.133:0/1033751793 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53ffff700 1 --2- 172.21.15.133:0/1033751793 >> v2:172.21.15.178:3300/0 conn(0x7ff5400bd360 0x7ff540154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700604754 0 0) 0x7ff530001490 con 0x7ff5400a9e30 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff540065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c004500 con 0x7ff5400a9e30 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 324828882 0 0) 0x7ff52c004500 con 0x7ff5400a9e30 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 msgr2=0x7ff540065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff540065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 >> v2:172.21.15.178:3300/0 conn(0x7ff5400bd360 msgr2=0x7ff540154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 --2- 172.21.15.133:0/1033751793 >> v2:172.21.15.178:3300/0 conn(0x7ff5400bd360 0x7ff540154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400c2f60 con 0x7ff5400a9e30 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff530001980 con 0x7ff5400a9e30 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 >> v1:172.21.15.133:6789/0 conn(0x7ff5400a9e30 legacy=0x7ff5400bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff52c004a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff52c004f40 0x7ff52c003310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff52c003800 0x7ff52c003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540065b20 con 0x7ff52c004f40 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400c2240 con 0x7ff52c003800 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c00b920 con 0x7ff5400c2b00 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff52c004f40 0x7ff52c003310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53f7fe700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff52c004a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53ffff700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff52c003800 0x7ff52c003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 -- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 msgr2=0x7ff52c004a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5400c2b00 0x7ff52c004a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 -- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff52c003800 msgr2=0x7ff52c003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff52c003800 0x7ff52c003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 -- 172.21.15.133:0/1033751793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c004500 con 0x7ff52c004f40 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53ffff700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff52c003800 0x7ff52c003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.356+0000 7ff53effd700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff52c004f40 0x7ff52c003310 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7ff52800bc80 tx=0x7ff52800b220).ready entity=mon.0 client_cookie=60e2fb8d28578962 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800b650 con 0x7ff52c004f40 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528010710 con 0x7ff52c004f40 2024-01-21T21:15:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff53e7fc700 1 -- 172.21.15.133:0/1033751793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528010a90 con 0x7ff52c004f40 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 -- 172.21.15.133:0/1033751793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff52c004f40 msgr2=0x7ff52c003310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 --2- 172.21.15.133:0/1033751793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff52c004f40 0x7ff52c003310 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7ff52800bc80 tx=0x7ff52800b220).stop 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff53ffff700 1 -- 172.21.15.133:0/1033751793 reap_dead start 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 -- 172.21.15.133:0/1033751793 shutdown_connections 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 -- 172.21.15.133:0/1033751793 >> 172.21.15.133:0/1033751793 conn(0x7ff5400c8200 msgr2=0x7ff5400c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 -- 172.21.15.133:0/1033751793 shutdown_connections 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.357+0000 7ff5460db700 1 -- 172.21.15.133:0/1033751793 wait complete. 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.358+0000 7ff5460db700 1 Processor -- start 2024-01-21T21:15:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.358+0000 7ff5460db700 1 -- start start 2024-01-21T21:15:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 0x7ff54014e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5400ad3d0 0x7ff5400c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54014ea00 con 0x7ff5400acf70 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540163a70 con 0x7ff5400ad3d0 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff5460db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff540163cc0 con 0x7ff52c004f40 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff53effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff53effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51170/0 (socket says 172.21.15.133:51170) 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff53effd700 1 -- 172.21.15.133:0/2379943712 learned_addr learned my addr 172.21.15.133:0/2379943712 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.359+0000 7ff53ffff700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5400ad3d0 0x7ff5400c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53f7fe700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 0x7ff54014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 -- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 msgr2=0x7ff54014e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 0x7ff54014e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 -- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5400ad3d0 msgr2=0x7ff5400c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5400ad3d0 0x7ff5400c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 -- 172.21.15.133:0/2379943712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540163fa0 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53f7fe700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 0x7ff54014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff53effd700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7ff52c0056b0 tx=0x7ff52801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528023070 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528010880 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528027620 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff540164280 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.360+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540164840 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.361+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54005fdf0 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.361+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5280143f0 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.361+0000 7ff537fff700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 0x7ff520061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.362+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff52807da90 con 0x7ff5400acf70 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.362+0000 7ff53f7fe700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 0x7ff520061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.362+0000 7ff53f7fe700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 0x7ff520061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff530001b30 tx=0x7ff530009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.366+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff52804eb20 con 0x7ff5400acf70 2024-01-21T21:15:18.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.575+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff5400c24e0 con 0x7ff5400acf70 2024-01-21T21:15:18.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.587+0000 7ff537fff700 1 -- 172.21.15.133:0/2379943712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff52802c0b0 con 0x7ff5400acf70 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 msgr2=0x7ff520061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 0x7ff520061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff530001b30 tx=0x7ff530009040).stop 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 msgr2=0x7ff54014a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7ff52c0056b0 tx=0x7ff52801a000).stop 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 shutdown_connections 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff52005f150 0x7ff520061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5400ad3d0 0x7ff5400c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff52c004f40 0x7ff54014e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 --2- 172.21.15.133:0/2379943712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5400acf70 0x7ff54014a3b0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.589+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 >> 172.21.15.133:0/2379943712 conn(0x7ff5400c8200 msgr2=0x7ff5400c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:18.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.590+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 shutdown_connections 2024-01-21T21:15:18.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.590+0000 7ff5460db700 1 -- 172.21.15.133:0/2379943712 wait complete. 2024-01-21T21:15:18.603 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T21:15:18.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T21:15:18.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.723+0000 7ff2e1cb1700 1 Processor -- start 2024-01-21T21:15:18.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.723+0000 7ff2e1cb1700 1 -- start start 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2e1cb1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2dc1351d0 0x7ff2dc0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2e1cb1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc0c3c60 0x7ff2dc155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2e1cb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc156650 con 0x7ff2dc1561a0 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2e1cb1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c61a0 con 0x7ff2dc1351d0 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2e1cb1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c5350 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2dc1351d0 0x7ff2dc0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2dbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff2dc1561a0 0x7ff2dc1526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34592/0 (socket says 172.21.15.133:34592) 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2dbfff700 1 -- 172.21.15.133:0/1589016193 learned_addr learned my addr 172.21.15.133:0/1589016193 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1589016193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc0c3c60 msgr2=0x7ff2dc155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 --2- 172.21.15.133:0/1589016193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc0c3c60 0x7ff2dc155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:18.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1589016193 >> v1:172.21.15.133:6789/0 conn(0x7ff2dc1561a0 legacy=0x7ff2dc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1589016193 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0c55d0 con 0x7ff2dc1351d0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2da7fc700 1 -- 172.21.15.133:0/1589016193 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864879097 0 0) 0x7ff2d4001490 con 0x7ff2dc1561a0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2db7fe700 1 --2- 172.21.15.133:0/1589016193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc1351d0 0x7ff2dc0c3770 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7ff2cc009760 tx=0x7ff2cc009060).ready entity=mon.0 client_cookie=a3bf7d65d287e4fe server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2da7fc700 1 -- 172.21.15.133:0/1589016193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0090d0 con 0x7ff2dc1351d0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2da7fc700 1 -- 172.21.15.133:0/1589016193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00b580 con 0x7ff2dc1351d0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.724+0000 7ff2da7fc700 1 -- 172.21.15.133:0/1589016193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00b900 con 0x7ff2dc1351d0 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1589016193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc1351d0 msgr2=0x7ff2dc0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1589016193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc1351d0 0x7ff2dc0c3770 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7ff2cc009760 tx=0x7ff2cc009060).stop 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1589016193 shutdown_connections 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1589016193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc1351d0 0x7ff2dc0c3770 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1589016193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc0c3c60 0x7ff2dc155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1589016193 >> 172.21.15.133:0/1589016193 conn(0x7ff2dc066a90 msgr2=0x7ff2dc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:18.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1589016193 shutdown_connections 2024-01-21T21:15:18.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.725+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1589016193 wait complete. 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.726+0000 7ff2e1cb1700 1 Processor -- start 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.727+0000 7ff2e1cb1700 1 -- start start 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.727+0000 7ff2e1cb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc1351d0 0x7ff2dc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2dc1561a0 0x7ff2dc0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0ae5f0 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0ae8d0 con 0x7ff2dc1561a0 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0aebb0 con 0x7ff2dc1351d0 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51180/0 (socket says 172.21.15.133:51180) 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1994662022 learned_addr learned my addr 172.21.15.133:0/1994662022 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc1351d0 msgr2=0x7ff2dc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc1351d0 0x7ff2dc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2dc1561a0 msgr2=0x7ff2dc0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2dc1561a0 0x7ff2dc0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 -- 172.21.15.133:0/1994662022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0092a0 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2db7fe700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7ff2cc009eb0 tx=0x7ff2cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00b900 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00bcc0 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2dc0aee90 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc01b440 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.728+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc0ae270 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.729+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc0c0280 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.730+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff2cc01b7b0 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.730+0000 7ff2c3fff700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 0x7ff2c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:18.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.730+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7ff2cc07bc40 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.730+0000 7ff2daffd700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 0x7ff2c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:18.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.730+0000 7ff2daffd700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 0x7ff2c8061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff2dc14c0d0 tx=0x7ff2d0006b90).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:18.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.734+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff2dc0c0280 con 0x7ff2dc0c3c60 2024-01-21T21:15:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:18.940+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff2dc0c0280 con 0x7ff2dc0c3c60 2024-01-21T21:15:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.592+0000 7ff2c3fff700 1 -- 172.21.15.133:0/1994662022 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff2dc0c0280 con 0x7ff2dc0c3c60 2024-01-21T21:15:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.594+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 msgr2=0x7ff2c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.594+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 0x7ff2c8061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff2dc14c0d0 tx=0x7ff2d0006b90).stop 2024-01-21T21:15:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.594+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 msgr2=0x7ff2dc1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.594+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7ff2cc009eb0 tx=0x7ff2cc017000).stop 2024-01-21T21:15:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 shutdown_connections 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7ff2c805f150 0x7ff2c8061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2dc1561a0 0x7ff2dc0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2dc0c3c60 0x7ff2dc1558d0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 --2- 172.21.15.133:0/1994662022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2dc1351d0 0x7ff2dc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 >> 172.21.15.133:0/1994662022 conn(0x7ff2dc066a90 msgr2=0x7ff2dc0bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 shutdown_connections 2024-01-21T21:15:19.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.595+0000 7ff2e1cb1700 1 -- 172.21.15.133:0/1994662022 wait complete. 2024-01-21T21:15:19.610 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T21:15:19.610 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:19.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 Processor -- start 2024-01-21T21:15:19.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 -- start start 2024-01-21T21:15:19.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61f8062ff0 0x7f61f8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8069ef0 con 0x7f61f8065b50 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8065fe0 con 0x7f61f8062c10 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.729+0000 7f61fd869700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f806a130 con 0x7f61f8062ff0 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61f8065b50 0x7f61f80bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34598/0 (socket says 172.21.15.133:34598) 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f77fe700 1 -- 172.21.15.133:0/2653441938 learned_addr learned my addr 172.21.15.133:0/2653441938 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f67fc700 1 --2- 172.21.15.133:0/2653441938 >> v2:172.21.15.178:3300/0 conn(0x7f61f8062ff0 0x7f61f8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807327835 0 0) 0x7f61f0001490 con 0x7f61f8065b50 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e40033f0 con 0x7f61f8065b50 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438712033 0 0) 0x7f61e40033f0 con 0x7f61f8065b50 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 >> v2:172.21.15.178:3300/0 conn(0x7f61f8062ff0 msgr2=0x7f61f8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 --2- 172.21.15.133:0/2653441938 >> v2:172.21.15.178:3300/0 conn(0x7f61f8062ff0 0x7f61f8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 >> v1:172.21.15.178:6789/0 conn(0x7f61f8062c10 legacy=0x7f61f80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f806a410 con 0x7f61f8065b50 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f61f0001980 con 0x7f61f8065b50 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 >> v1:172.21.15.133:6789/0 conn(0x7f61f8065b50 legacy=0x7f61f80bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61e40038e0 0x7f61e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61e4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61e4005050 0x7f61e400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f806a130 con 0x7f61e4004690 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e400bfe0 con 0x7f61e4005050 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e400c1a0 con 0x7f61e40038e0 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f67fc700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61e4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f6ffd700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61e40038e0 0x7f61e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.730+0000 7f61f77fe700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61e4005050 0x7f61e400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 -- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61e40038e0 msgr2=0x7f61e4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61e40038e0 0x7f61e4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 -- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61e4005050 msgr2=0x7f61e400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61e4005050 0x7f61e400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 -- 172.21.15.133:0/2653441938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40033f0 con 0x7f61e4004690 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f77fe700 1 -- 172.21.15.133:0/2653441938 reap_dead start 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f6ffd700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61e40038e0 0x7f61e4003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f67fc700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61e4004b10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f61e8006d80 tx=0x7f61e8009060).ready entity=mon.0 client_cookie=ae18c6f700fca82b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8009e90 con 0x7f61e4004690 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800e640 con 0x7f61e4004690 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61f5ffb700 1 -- 172.21.15.133:0/2653441938 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ea00 con 0x7f61e4004690 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 -- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 msgr2=0x7f61e4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61e4004b10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 rx=0x7f61e8006d80 tx=0x7f61e8009060).stop 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 -- 172.21.15.133:0/2653441938 shutdown_connections 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 --2- 172.21.15.133:0/2653441938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61e4004b10 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 -- 172.21.15.133:0/2653441938 >> 172.21.15.133:0/2653441938 conn(0x7f61f80c8010 msgr2=0x7f61f80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 -- 172.21.15.133:0/2653441938 shutdown_connections 2024-01-21T21:15:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.731+0000 7f61fd869700 1 -- 172.21.15.133:0/2653441938 wait complete. 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.733+0000 7f61fd869700 1 Processor -- start 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.733+0000 7f61fd869700 1 -- start start 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 0x7f61f813ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 0x7f61f80a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80a9600 con 0x7f61e4004690 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8157c30 con 0x7f61f80addf0 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61fd869700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8154ec0 con 0x7f61f813bf10 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51198/0 (socket says 172.21.15.133:51198) 2024-01-21T21:15:19.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 -- 172.21.15.133:0/4101326278 learned_addr learned my addr 172.21.15.133:0/4101326278 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f77fe700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 0x7f61f80a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f67fc700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 0x7f61f813ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 -- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 msgr2=0x7f61f80a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 0x7f61f80a9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 -- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 msgr2=0x7f61f813ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 0x7f61f813ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f6ffd700 1 -- 172.21.15.133:0/4101326278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f81551a0 con 0x7f61e4004690 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f77fe700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 0x7f61f80a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.734+0000 7f61f67fc700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 0x7f61f813ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61f6ffd700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f61e0000c00 tx=0x7f61e0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ee10 con 0x7f61e4004690 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0010450 con 0x7f61e4004690 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80ac170 con 0x7f61e4004690 2024-01-21T21:15:19.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00107d0 con 0x7f61e4004690 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.735+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f80a9fc0 con 0x7f61e4004690 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.736+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80a9920 con 0x7f61e4004690 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.736+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f61e0010b80 con 0x7f61e4004690 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.736+0000 7f61ef7fe700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 0x7f61d8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.736+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f61e007a400 con 0x7f61e4004690 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.736+0000 7f61f67fc700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 0x7f61d8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.737+0000 7f61f67fc700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 0x7f61d8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f61f8069c50 tx=0x7f61e801a000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:19.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.740+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f61e004b440 con 0x7f61e4004690 2024-01-21T21:15:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.947+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61f80aa660 con 0x7f61e4004690 2024-01-21T21:15:19.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.948+0000 7f61ef7fe700 1 -- 172.21.15.133:0/4101326278 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f61e004ea60 con 0x7f61e4004690 2024-01-21T21:15:19.949 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:19.949 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:15:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 msgr2=0x7f61d8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 0x7f61d8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f61f8069c50 tx=0x7f61e801a000).stop 2024-01-21T21:15:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 msgr2=0x7f61f80abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f61e0000c00 tx=0x7f61e0009040).stop 2024-01-21T21:15:19.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 shutdown_connections 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f61d805f150 0x7f61d8061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f813bf10 0x7f61f80a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61e4004690 0x7f61f80abc80 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 --2- 172.21.15.133:0/4101326278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80addf0 0x7f61f813ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 >> 172.21.15.133:0/4101326278 conn(0x7f61f80c8010 msgr2=0x7f61f80be390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 shutdown_connections 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:19.950+0000 7f61fd869700 1 -- 172.21.15.133:0/4101326278 wait complete. 2024-01-21T21:15:19.953 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:15:19.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:15:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.078+0000 7f7ff9583700 1 Processor -- start 2024-01-21T21:15:20.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.078+0000 7f7ff9583700 1 -- start start 2024-01-21T21:15:20.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff9583700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4069ef0 0x7f7ff4155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff9583700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 0x7f7ff4066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff9583700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff4065660 con 0x7f7ff40beb30 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff9583700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff40bef10 con 0x7f7ff4069ef0 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff9583700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff4156070 con 0x7f7ff40c3fb0 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4069ef0 0x7f7ff4155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4069ef0 0x7f7ff4155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51208/0 (socket says 172.21.15.133:51208) 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2180309486 learned_addr learned my addr 172.21.15.133:0/2180309486 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff37fe700 1 --2- 172.21.15.133:0/2180309486 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 0x7f7ff4066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2180309486 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 msgr2=0x7f7ff4066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 --2- 172.21.15.133:0/2180309486 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 0x7f7ff4066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2180309486 >> v1:172.21.15.178:6789/0 conn(0x7f7ff40beb30 legacy=0x7f7ff40697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2180309486 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4065f00 con 0x7f7ff4069ef0 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff37fe700 1 --2- 172.21.15.133:0/2180309486 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 0x7f7ff4066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff27fc700 1 --2- 172.21.15.133:0/2180309486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4069ef0 0x7f7ff4155b80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7ff4060070 tx=0x7f7fe40090f0).ready entity=mon.0 client_cookie=9b1d5eac5df20e04 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff1ffb700 1 -- 172.21.15.133:0/2180309486 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400b580 con 0x7f7ff4069ef0 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff1ffb700 1 -- 172.21.15.133:0/2180309486 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400b6e0 con 0x7f7ff4069ef0 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.080+0000 7f7ff1ffb700 1 -- 172.21.15.133:0/2180309486 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400ba80 con 0x7f7ff4069ef0 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 -- 172.21.15.133:0/2180309486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4069ef0 msgr2=0x7f7ff4155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2180309486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4069ef0 0x7f7ff4155b80 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f7ff4060070 tx=0x7f7fe40090f0).stop 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 -- 172.21.15.133:0/2180309486 shutdown_connections 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2180309486 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c3fb0 0x7f7ff4066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2180309486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4069ef0 0x7f7ff4155b80 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 -- 172.21.15.133:0/2180309486 >> 172.21.15.133:0/2180309486 conn(0x7f7ff40c8010 msgr2=0x7f7ff40c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 -- 172.21.15.133:0/2180309486 shutdown_connections 2024-01-21T21:15:20.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.081+0000 7f7ff9583700 1 -- 172.21.15.133:0/2180309486 wait complete. 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.082+0000 7f7ff9583700 1 Processor -- start 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.082+0000 7f7ff9583700 1 -- start start 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 0x7f7ff40aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff40c3fb0 0x7f7ff4162840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c0920 con 0x7f7ff40beb30 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c0ea0 con 0x7f7ff4069ef0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff9583700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4163340 con 0x7f7ff40c3fb0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51210/0 (socket says 172.21.15.133:51210) 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2357645129 learned_addr learned my addr 172.21.15.133:0/2357645129 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff2ffd700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 0x7f7ff40aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff37fe700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff40c3fb0 0x7f7ff4162840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff40c3fb0 msgr2=0x7f7ff4162840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff40c3fb0 0x7f7ff4162840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 msgr2=0x7f7ff40aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.083+0000 7f7ff27fc700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 0x7f7ff40aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7ff27fc700 1 -- 172.21.15.133:0/2357645129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009370 con 0x7f7ff40beb30 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7ff2ffd700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 0x7f7ff40aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7ff27fc700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f7fe4006df0 tx=0x7f7fe4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400b850 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400b9b0 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe401c670 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff4163620 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.084+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff40ab4b0 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.085+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff4163840 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.085+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7fe401ca60 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.086+0000 7f7fdb7fe700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 0x7f7fe0061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.086+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f7fe407bf10 con 0x7f7ff40beb30 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.086+0000 7f7ff2ffd700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 0x7f7fe0061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.086+0000 7f7ff2ffd700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 0x7f7fe0061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7fe8002780 tx=0x7f7fe8009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.090+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7fe404cf50 con 0x7f7ff40beb30 2024-01-21T21:15:20.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.253+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ff40c1030 con 0x7f7ff40beb30 2024-01-21T21:15:20.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.254+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/2357645129 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+17991 (secure 0 0 0) 0x7f7fe402a070 con 0x7f7ff40beb30 2024-01-21T21:15:20.255 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:20.256 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":174,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:15:18.585186+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 msgr2=0x7f7fe0061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 0x7f7fe0061640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7fe8002780 tx=0x7f7fe8009040).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 msgr2=0x7f7ff4150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 rx=0x7f7fe4006df0 tx=0x7f7fe4017000).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 shutdown_connections 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7fe005f180 0x7f7fe0061640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff40c3fb0 0x7f7ff4162840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff4069ef0 0x7f7ff40aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 --2- 172.21.15.133:0/2357645129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff40beb30 0x7f7ff4150d20 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 >> 172.21.15.133:0/2357645129 conn(0x7f7ff40c8010 msgr2=0x7f7ff40bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 shutdown_connections 2024-01-21T21:15:20.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.256+0000 7f7ff9583700 1 -- 172.21.15.133:0/2357645129 wait complete. 2024-01-21T21:15:20.270 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T21:15:20.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:15:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.384+0000 7f6a3384f700 1 Processor -- start 2024-01-21T21:15:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 -- start start 2024-01-21T21:15:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6a2c0aa6a0 0x7f6a2c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c0694e0 con 0x7f6a2c0c4890 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c0aab30 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.385+0000 7f6a3384f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0aadf0 con 0x7f6a2c158a20 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a31dec700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6a2c0aa6a0 0x7f6a2c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53830/0 (socket says 172.21.15.133:53830) 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 -- 172.21.15.133:0/2334581449 learned_addr learned my addr 172.21.15.133:0/2334581449 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a315eb700 1 --1- 172.21.15.133:0/2334581449 >> v1:172.21.15.178:6789/0 conn(0x7f6a2c0c4890 0x7f6a2c069970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:43474/0 (socket says 172.21.15.133:43474) 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 -- 172.21.15.133:0/2334581449 >> v2:172.21.15.178:3300/0 conn(0x7f6a2c0aa6a0 msgr2=0x7f6a2c153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 --2- 172.21.15.133:0/2334581449 >> v2:172.21.15.178:3300/0 conn(0x7f6a2c0aa6a0 0x7f6a2c153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 -- 172.21.15.133:0/2334581449 >> v1:172.21.15.178:6789/0 conn(0x7f6a2c0c4890 legacy=0x7f6a2c069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 -- 172.21.15.133:0/2334581449 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0ab0d0 con 0x7f6a2c158a20 2024-01-21T21:15:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a30dea700 1 --2- 172.21.15.133:0/2334581449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a28009830 tx=0x7f6a280090f0).ready entity=mon.2 client_cookie=4cfa4ab054933e14 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a23fff700 1 -- 172.21.15.133:0/2334581449 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800b580 con 0x7f6a2c158a20 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a23fff700 1 -- 172.21.15.133:0/2334581449 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800b6e0 con 0x7f6a2c158a20 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.386+0000 7f6a23fff700 1 -- 172.21.15.133:0/2334581449 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2800ba80 con 0x7f6a2c158a20 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 -- 172.21.15.133:0/2334581449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 msgr2=0x7f6a2c0c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 --2- 172.21.15.133:0/2334581449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f6a28009830 tx=0x7f6a280090f0).stop 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 -- 172.21.15.133:0/2334581449 shutdown_connections 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 --2- 172.21.15.133:0/2334581449 >> v2:172.21.15.178:3300/0 conn(0x7f6a2c0aa6a0 0x7f6a2c153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 --2- 172.21.15.133:0/2334581449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c158a20 0x7f6a2c0c4c70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 -- 172.21.15.133:0/2334581449 >> 172.21.15.133:0/2334581449 conn(0x7f6a2c0c7fb0 msgr2=0x7f6a2c0c3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 -- 172.21.15.133:0/2334581449 shutdown_connections 2024-01-21T21:15:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.387+0000 7f6a3384f700 1 -- 172.21.15.133:0/2334581449 wait complete. 2024-01-21T21:15:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.388+0000 7f6a3384f700 1 Processor -- start 2024-01-21T21:15:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.388+0000 7f6a3384f700 1 -- start start 2024-01-21T21:15:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c0c4890 0x7f6a2c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 0x7f6a2c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c3c30 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c37a0 con 0x7f6a2c158a20 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a3384f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0c2e70 con 0x7f6a2c0c4890 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a315eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a315eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35424/0 (socket says 172.21.15.133:35424) 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a315eb700 1 -- 172.21.15.133:0/1493309813 learned_addr learned my addr 172.21.15.133:0/1493309813 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a31dec700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 0x7f6a2c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a30dea700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c0c4890 0x7f6a2c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a315eb700 1 -- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c0c4890 msgr2=0x7f6a2c1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.389+0000 7f6a315eb700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c0c4890 0x7f6a2c1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a315eb700 1 -- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 msgr2=0x7f6a2c157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a315eb700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 0x7f6a2c157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a315eb700 1 -- 172.21.15.133:0/1493309813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28009370 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a31dec700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 0x7f6a2c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a315eb700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f6a1c00c490 tx=0x7f6a1c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0072e0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c007440 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0c3150 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0058f0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.390+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c151670 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.391+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c05fdf0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.391+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6a1c005ca0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.391+0000 7f6a21ffb700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 0x7f6a10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.392+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f6a1c079cb0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.392+0000 7f6a30dea700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 0x7f6a10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.392+0000 7f6a30dea700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 0x7f6a10061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6a2c1565d0 tx=0x7f6a28017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.396+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6a1c04acf0 con 0x7f6a2c0aa6a0 2024-01-21T21:15:20.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.557+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a2c06a0d0 con 0x7f6a1005f150 2024-01-21T21:15:20.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.567+0000 7f6a21ffb700 1 -- 172.21.15.133:0/1493309813 <== mgr.8874 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361805 (secure 0 0 0) 0x7f6a2c06a0d0 con 0x7f6a1005f150 2024-01-21T21:15:20.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:20.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 msgr2=0x7f6a10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 0x7f6a10061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6a2c1565d0 tx=0x7f6a28017000).stop 2024-01-21T21:15:20.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 msgr2=0x7f6a2c151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f6a1c00c490 tx=0x7f6a1c007df0).stop 2024-01-21T21:15:20.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 shutdown_connections 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f6a1005f150 0x7f6a10061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a2c158a20 0x7f6a2c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0aa6a0 0x7f6a2c151180 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 --2- 172.21.15.133:0/1493309813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a2c0c4890 0x7f6a2c1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 >> 172.21.15.133:0/1493309813 conn(0x7f6a2c0c7fb0 msgr2=0x7f6a2c0c5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 shutdown_connections 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.571+0000 7f6a3384f700 1 -- 172.21.15.133:0/1493309813 wait complete. 2024-01-21T21:15:20.577 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:15:20.584 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-01-21T21:15:18.667086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454936,"kb_used_data":16728,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752519784,"statfs":{"total":773094113280,"available":770580258816,"internally_reserved":0,"allocated":17129472,"data_stored":9145870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.581792"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.616081+0000","last_change":"2024-01-21T21:15:17.616081+0000","last_active":"2024-01-21T21:15:17.616081+0000","last_peered":"2024-01-21T21:15:17.616081+0000","last_clean":"2024-01-21T21:15:17.616081+0000","last_became_active":"2024-01-21T21:15:17.615869+0000","last_became_peered":"2024-01-21T21:15:17.615869+0000","last_unstale":"2024-01-21T21:15:17.616081+0000","last_undegraded":"2024-01-21T21:15:17.616081+0000","last_fullsized":"2024-01-21T21:15:17.616081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"173'3","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.603319+0000","last_change":"2024-01-21T21:15:17.228959+0000","last_active":"2024-01-21T21:15:17.603319+0000","last_peered":"2024-01-21T21:15:17.603319+0000","last_clean":"2024-01-21T21:15:17.603319+0000","last_became_active":"2024-01-21T21:15:17.228633+0000","last_became_peered":"2024-01-21T21:15:17.228633+0000","last_unstale":"2024-01-21T21:15:17.603319+0000","last_undegraded":"2024-01-21T21:15:17.603319+0000","last_fullsized":"2024-01-21T21:15:17.603319+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598581+0000","last_change":"2024-01-21T21:15:17.598581+0000","last_active":"2024-01-21T21:15:17.598581+0000","last_peered":"2024-01-21T21:15:17.598581+0000","last_clean":"2024-01-21T21:15:17.598581+0000","last_became_active":"2024-01-21T21:15:17.598311+0000","last_became_peered":"2024-01-21T21:15:17.598311+0000","last_unstale":"2024-01-21T21:15:17.598581+0000","last_undegraded":"2024-01-21T21:15:17.598581+0000","last_fullsized":"2024-01-21T21:15:17.598581+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233806+0000","last_change":"2024-01-21T21:15:17.229300+0000","last_active":"2024-01-21T21:15:17.233806+0000","last_peered":"2024-01-21T21:15:17.233806+0000","last_clean":"2024-01-21T21:15:17.233806+0000","last_became_active":"2024-01-21T21:15:17.229035+0000","last_became_peered":"2024-01-21T21:15:17.229035+0000","last_unstale":"2024-01-21T21:15:17.233806+0000","last_undegraded":"2024-01-21T21:15:17.233806+0000","last_fullsized":"2024-01-21T21:15:17.233806+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.615043+0000","last_change":"2024-01-21T21:15:17.615043+0000","last_active":"2024-01-21T21:15:17.615043+0000","last_peered":"2024-01-21T21:15:17.615043+0000","last_clean":"2024-01-21T21:15:17.615043+0000","last_became_active":"2024-01-21T21:15:17.614849+0000","last_became_peered":"2024-01-21T21:15:17.614849+0000","last_unstale":"2024-01-21T21:15:17.615043+0000","last_undegraded":"2024-01-21T21:15:17.615043+0000","last_fullsized":"2024-01-21T21:15:17.615043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239381+0000","last_change":"2024-01-21T21:15:17.234602+0000","last_active":"2024-01-21T21:15:17.239381+0000","last_peered":"2024-01-21T21:15:17.239381+0000","last_clean":"2024-01-21T21:15:17.239381+0000","last_became_active":"2024-01-21T21:15:17.234300+0000","last_became_peered":"2024-01-21T21:15:17.234300+0000","last_unstale":"2024-01-21T21:15:17.239381+0000","last_undegraded":"2024-01-21T21:15:17.239381+0000","last_fullsized":"2024-01-21T21:15:17.239381+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600830+0000","last_change":"2024-01-21T21:15:17.600830+0000","last_active":"2024-01-21T21:15:17.600830+0000","last_peered":"2024-01-21T21:15:17.600830+0000","last_clean":"2024-01-21T21:15:17.600830+0000","last_became_active":"2024-01-21T21:15:17.600549+0000","last_became_peered":"2024-01-21T21:15:17.600549+0000","last_unstale":"2024-01-21T21:15:17.600830+0000","last_undegraded":"2024-01-21T21:15:17.600830+0000","last_fullsized":"2024-01-21T21:15:17.600830+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607885+0000","last_change":"2024-01-21T21:15:17.237096+0000","last_active":"2024-01-21T21:15:17.607885+0000","last_peered":"2024-01-21T21:15:17.607885+0000","last_clean":"2024-01-21T21:15:17.607885+0000","last_became_active":"2024-01-21T21:15:17.236801+0000","last_became_peered":"2024-01-21T21:15:17.236801+0000","last_unstale":"2024-01-21T21:15:17.607885+0000","last_undegraded":"2024-01-21T21:15:17.607885+0000","last_fullsized":"2024-01-21T21:15:17.607885+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612179+0000","last_change":"2024-01-21T21:15:17.612179+0000","last_active":"2024-01-21T21:15:17.612179+0000","last_peered":"2024-01-21T21:15:17.612179+0000","last_clean":"2024-01-21T21:15:17.612179+0000","last_became_active":"2024-01-21T21:15:17.611899+0000","last_became_peered":"2024-01-21T21:15:17.611899+0000","last_unstale":"2024-01-21T21:15:17.612179+0000","last_undegraded":"2024-01-21T21:15:17.612179+0000","last_fullsized":"2024-01-21T21:15:17.612179+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.589523+0000","last_change":"2024-01-21T21:15:17.222327+0000","last_active":"2024-01-21T21:15:17.589523+0000","last_peered":"2024-01-21T21:15:17.589523+0000","last_clean":"2024-01-21T21:15:17.589523+0000","last_became_active":"2024-01-21T21:15:17.221996+0000","last_became_peered":"2024-01-21T21:15:17.221996+0000","last_unstale":"2024-01-21T21:15:17.589523+0000","last_undegraded":"2024-01-21T21:15:17.589523+0000","last_fullsized":"2024-01-21T21:15:17.589523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597411+0000","last_change":"2024-01-21T21:15:17.597411+0000","last_active":"2024-01-21T21:15:17.597411+0000","last_peered":"2024-01-21T21:15:17.597411+0000","last_clean":"2024-01-21T21:15:17.597411+0000","last_became_active":"2024-01-21T21:15:17.597083+0000","last_became_peered":"2024-01-21T21:15:17.597083+0000","last_unstale":"2024-01-21T21:15:17.597411+0000","last_undegraded":"2024-01-21T21:15:17.597411+0000","last_fullsized":"2024-01-21T21:15:17.597411+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.590960+0000","last_change":"2024-01-21T21:15:17.236846+0000","last_active":"2024-01-21T21:15:17.590960+0000","last_peered":"2024-01-21T21:15:17.590960+0000","last_clean":"2024-01-21T21:15:17.590960+0000","last_became_active":"2024-01-21T21:15:17.236243+0000","last_became_peered":"2024-01-21T21:15:17.236243+0000","last_unstale":"2024-01-21T21:15:17.590960+0000","last_undegraded":"2024-01-21T21:15:17.590960+0000","last_fullsized":"2024-01-21T21:15:17.590960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610826+0000","last_change":"2024-01-21T21:15:17.610826+0000","last_active":"2024-01-21T21:15:17.610826+0000","last_peered":"2024-01-21T21:15:17.610826+0000","last_clean":"2024-01-21T21:15:17.610826+0000","last_became_active":"2024-01-21T21:15:17.610410+0000","last_became_peered":"2024-01-21T21:15:17.610410+0000","last_unstale":"2024-01-21T21:15:17.610826+0000","last_undegraded":"2024-01-21T21:15:17.610826+0000","last_fullsized":"2024-01-21T21:15:17.610826+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.231087+0000","last_change":"2024-01-21T21:15:17.227840+0000","last_active":"2024-01-21T21:15:17.231087+0000","last_peered":"2024-01-21T21:15:17.231087+0000","last_clean":"2024-01-21T21:15:17.231087+0000","last_became_active":"2024-01-21T21:15:17.227482+0000","last_became_peered":"2024-01-21T21:15:17.227482+0000","last_unstale":"2024-01-21T21:15:17.231087+0000","last_undegraded":"2024-01-21T21:15:17.231087+0000","last_fullsized":"2024-01-21T21:15:17.231087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610764+0000","last_change":"2024-01-21T21:15:17.610764+0000","last_active":"2024-01-21T21:15:17.610764+0000","last_peered":"2024-01-21T21:15:17.610764+0000","last_clean":"2024-01-21T21:15:17.610764+0000","last_became_active":"2024-01-21T21:15:17.610478+0000","last_became_peered":"2024-01-21T21:15:17.610478+0000","last_unstale":"2024-01-21T21:15:17.610764+0000","last_undegraded":"2024-01-21T21:15:17.610764+0000","last_fullsized":"2024-01-21T21:15:17.610764+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242263+0000","last_change":"2024-01-21T21:15:17.227486+0000","last_active":"2024-01-21T21:15:17.242263+0000","last_peered":"2024-01-21T21:15:17.242263+0000","last_clean":"2024-01-21T21:15:17.242263+0000","last_became_active":"2024-01-21T21:15:17.224860+0000","last_became_peered":"2024-01-21T21:15:17.224860+0000","last_unstale":"2024-01-21T21:15:17.242263+0000","last_undegraded":"2024-01-21T21:15:17.242263+0000","last_fullsized":"2024-01-21T21:15:17.242263+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611670+0000","last_change":"2024-01-21T21:15:17.611670+0000","last_active":"2024-01-21T21:15:17.611670+0000","last_peered":"2024-01-21T21:15:17.611670+0000","last_clean":"2024-01-21T21:15:17.611670+0000","last_became_active":"2024-01-21T21:15:17.611080+0000","last_became_peered":"2024-01-21T21:15:17.611080+0000","last_unstale":"2024-01-21T21:15:17.611670+0000","last_undegraded":"2024-01-21T21:15:17.611670+0000","last_fullsized":"2024-01-21T21:15:17.611670+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.236257+0000","last_change":"2024-01-21T21:15:17.225017+0000","last_active":"2024-01-21T21:15:17.236257+0000","last_peered":"2024-01-21T21:15:17.236257+0000","last_clean":"2024-01-21T21:15:17.236257+0000","last_became_active":"2024-01-21T21:15:17.224748+0000","last_became_peered":"2024-01-21T21:15:17.224748+0000","last_unstale":"2024-01-21T21:15:17.236257+0000","last_undegraded":"2024-01-21T21:15:17.236257+0000","last_fullsized":"2024-01-21T21:15:17.236257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612926+0000","last_change":"2024-01-21T21:15:17.612926+0000","last_active":"2024-01-21T21:15:17.612926+0000","last_peered":"2024-01-21T21:15:17.612926+0000","last_clean":"2024-01-21T21:15:17.612926+0000","last_became_active":"2024-01-21T21:15:17.612017+0000","last_became_peered":"2024-01-21T21:15:17.612017+0000","last_unstale":"2024-01-21T21:15:17.612926+0000","last_undegraded":"2024-01-21T21:15:17.612926+0000","last_fullsized":"2024-01-21T21:15:17.612926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.238286+0000","last_change":"2024-01-21T21:15:17.234446+0000","last_active":"2024-01-21T21:15:17.238286+0000","last_peered":"2024-01-21T21:15:17.238286+0000","last_clean":"2024-01-21T21:15:17.238286+0000","last_became_active":"2024-01-21T21:15:17.234075+0000","last_became_peered":"2024-01-21T21:15:17.234075+0000","last_unstale":"2024-01-21T21:15:17.238286+0000","last_undegraded":"2024-01-21T21:15:17.238286+0000","last_fullsized":"2024-01-21T21:15:17.238286+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601912+0000","last_change":"2024-01-21T21:15:17.601912+0000","last_active":"2024-01-21T21:15:17.601912+0000","last_peered":"2024-01-21T21:15:17.601912+0000","last_clean":"2024-01-21T21:15:17.601912+0000","last_became_active":"2024-01-21T21:15:17.601648+0000","last_became_peered":"2024-01-21T21:15:17.601648+0000","last_unstale":"2024-01-21T21:15:17.601912+0000","last_undegraded":"2024-01-21T21:15:17.601912+0000","last_fullsized":"2024-01-21T21:15:17.601912+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242290+0000","last_change":"2024-01-21T21:15:17.228209+0000","last_active":"2024-01-21T21:15:17.242290+0000","last_peered":"2024-01-21T21:15:17.242290+0000","last_clean":"2024-01-21T21:15:17.242290+0000","last_became_active":"2024-01-21T21:15:17.227939+0000","last_became_peered":"2024-01-21T21:15:17.227939+0000","last_unstale":"2024-01-21T21:15:17.242290+0000","last_undegraded":"2024-01-21T21:15:17.242290+0000","last_fullsized":"2024-01-21T21:15:17.242290+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606374+0000","last_change":"2024-01-21T21:15:17.606374+0000","last_active":"2024-01-21T21:15:17.606374+0000","last_peered":"2024-01-21T21:15:17.606374+0000","last_clean":"2024-01-21T21:15:17.606374+0000","last_became_active":"2024-01-21T21:15:17.606090+0000","last_became_peered":"2024-01-21T21:15:17.606090+0000","last_unstale":"2024-01-21T21:15:17.606374+0000","last_undegraded":"2024-01-21T21:15:17.606374+0000","last_fullsized":"2024-01-21T21:15:17.606374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610185+0000","last_change":"2024-01-21T21:15:17.235000+0000","last_active":"2024-01-21T21:15:17.610185+0000","last_peered":"2024-01-21T21:15:17.610185+0000","last_clean":"2024-01-21T21:15:17.610185+0000","last_became_active":"2024-01-21T21:15:17.234726+0000","last_became_peered":"2024-01-21T21:15:17.234726+0000","last_unstale":"2024-01-21T21:15:17.610185+0000","last_undegraded":"2024-01-21T21:15:17.610185+0000","last_fullsized":"2024-01-21T21:15:17.610185+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604432+0000","last_change":"2024-01-21T21:15:17.604432+0000","last_active":"2024-01-21T21:15:17.604432+0000","last_peered":"2024-01-21T21:15:17.604432+0000","last_clean":"2024-01-21T21:15:17.604432+0000","last_became_active":"2024-01-21T21:15:17.604078+0000","last_became_peered":"2024-01-21T21:15:17.604078+0000","last_unstale":"2024-01-21T21:15:17.604432+0000","last_undegraded":"2024-01-21T21:15:17.604432+0000","last_fullsized":"2024-01-21T21:15:17.604432+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.588945+0000","last_change":"2024-01-21T21:15:17.230413+0000","last_active":"2024-01-21T21:15:17.588945+0000","last_peered":"2024-01-21T21:15:17.588945+0000","last_clean":"2024-01-21T21:15:17.588945+0000","last_became_active":"2024-01-21T21:15:17.229950+0000","last_became_peered":"2024-01-21T21:15:17.229950+0000","last_unstale":"2024-01-21T21:15:17.588945+0000","last_undegraded":"2024-01-21T21:15:17.588945+0000","last_fullsized":"2024-01-21T21:15:17.588945+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614676+0000","last_change":"2024-01-21T21:15:17.614676+0000","last_active":"2024-01-21T21:15:17.614676+0000","last_peered":"2024-01-21T21:15:17.614676+0000","last_clean":"2024-01-21T21:15:17.614676+0000","last_became_active":"2024-01-21T21:15:17.614351+0000","last_became_peered":"2024-01-21T21:15:17.614351+0000","last_unstale":"2024-01-21T21:15:17.614676+0000","last_undegraded":"2024-01-21T21:15:17.614676+0000","last_fullsized":"2024-01-21T21:15:17.614676+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233045+0000","last_change":"2024-01-21T21:15:17.230421+0000","last_active":"2024-01-21T21:15:17.233045+0000","last_peered":"2024-01-21T21:15:17.233045+0000","last_clean":"2024-01-21T21:15:17.233045+0000","last_became_active":"2024-01-21T21:15:17.230046+0000","last_became_peered":"2024-01-21T21:15:17.230046+0000","last_unstale":"2024-01-21T21:15:17.233045+0000","last_undegraded":"2024-01-21T21:15:17.233045+0000","last_fullsized":"2024-01-21T21:15:17.233045+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611705+0000","last_change":"2024-01-21T21:15:17.611705+0000","last_active":"2024-01-21T21:15:17.611705+0000","last_peered":"2024-01-21T21:15:17.611705+0000","last_clean":"2024-01-21T21:15:17.611705+0000","last_became_active":"2024-01-21T21:15:17.611241+0000","last_became_peered":"2024-01-21T21:15:17.611241+0000","last_unstale":"2024-01-21T21:15:17.611705+0000","last_undegraded":"2024-01-21T21:15:17.611705+0000","last_fullsized":"2024-01-21T21:15:17.611705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240090+0000","last_change":"2024-01-21T21:15:17.239084+0000","last_active":"2024-01-21T21:15:17.240090+0000","last_peered":"2024-01-21T21:15:17.240090+0000","last_clean":"2024-01-21T21:15:17.240090+0000","last_became_active":"2024-01-21T21:15:17.238802+0000","last_became_peered":"2024-01-21T21:15:17.238802+0000","last_unstale":"2024-01-21T21:15:17.240090+0000","last_undegraded":"2024-01-21T21:15:17.240090+0000","last_fullsized":"2024-01-21T21:15:17.240090+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605955+0000","last_change":"2024-01-21T21:15:17.605955+0000","last_active":"2024-01-21T21:15:17.605955+0000","last_peered":"2024-01-21T21:15:17.605955+0000","last_clean":"2024-01-21T21:15:17.605955+0000","last_became_active":"2024-01-21T21:15:17.605704+0000","last_became_peered":"2024-01-21T21:15:17.605704+0000","last_unstale":"2024-01-21T21:15:17.605955+0000","last_undegraded":"2024-01-21T21:15:17.605955+0000","last_fullsized":"2024-01-21T21:15:17.605955+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610495+0000","last_change":"2024-01-21T21:15:17.226381+0000","last_active":"2024-01-21T21:15:17.610495+0000","last_peered":"2024-01-21T21:15:17.610495+0000","last_clean":"2024-01-21T21:15:17.610495+0000","last_became_active":"2024-01-21T21:15:17.226092+0000","last_became_peered":"2024-01-21T21:15:17.226092+0000","last_unstale":"2024-01-21T21:15:17.610495+0000","last_undegraded":"2024-01-21T21:15:17.610495+0000","last_fullsized":"2024-01-21T21:15:17.610495+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.599642+0000","last_change":"2024-01-21T21:15:17.599642+0000","last_active":"2024-01-21T21:15:17.599642+0000","last_peered":"2024-01-21T21:15:17.599642+0000","last_clean":"2024-01-21T21:15:17.599642+0000","last_became_active":"2024-01-21T21:15:17.597900+0000","last_became_peered":"2024-01-21T21:15:17.597900+0000","last_unstale":"2024-01-21T21:15:17.599642+0000","last_undegraded":"2024-01-21T21:15:17.599642+0000","last_fullsized":"2024-01-21T21:15:17.599642+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239504+0000","last_change":"2024-01-21T21:15:17.238258+0000","last_active":"2024-01-21T21:15:17.239504+0000","last_peered":"2024-01-21T21:15:17.239504+0000","last_clean":"2024-01-21T21:15:17.239504+0000","last_became_active":"2024-01-21T21:15:17.237609+0000","last_became_peered":"2024-01-21T21:15:17.237609+0000","last_unstale":"2024-01-21T21:15:17.239504+0000","last_undegraded":"2024-01-21T21:15:17.239504+0000","last_fullsized":"2024-01-21T21:15:17.239504+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607977+0000","last_change":"2024-01-21T21:15:17.607977+0000","last_active":"2024-01-21T21:15:17.607977+0000","last_peered":"2024-01-21T21:15:17.607977+0000","last_clean":"2024-01-21T21:15:17.607977+0000","last_became_active":"2024-01-21T21:15:17.607675+0000","last_became_peered":"2024-01-21T21:15:17.607675+0000","last_unstale":"2024-01-21T21:15:17.607977+0000","last_undegraded":"2024-01-21T21:15:17.607977+0000","last_fullsized":"2024-01-21T21:15:17.607977+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239477+0000","last_change":"2024-01-21T21:15:17.236527+0000","last_active":"2024-01-21T21:15:17.239477+0000","last_peered":"2024-01-21T21:15:17.239477+0000","last_clean":"2024-01-21T21:15:17.239477+0000","last_became_active":"2024-01-21T21:15:17.236272+0000","last_became_peered":"2024-01-21T21:15:17.236272+0000","last_unstale":"2024-01-21T21:15:17.239477+0000","last_undegraded":"2024-01-21T21:15:17.239477+0000","last_fullsized":"2024-01-21T21:15:17.239477+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611118+0000","last_change":"2024-01-21T21:15:17.611118+0000","last_active":"2024-01-21T21:15:17.611118+0000","last_peered":"2024-01-21T21:15:17.611118+0000","last_clean":"2024-01-21T21:15:17.611118+0000","last_became_active":"2024-01-21T21:15:17.610584+0000","last_became_peered":"2024-01-21T21:15:17.610584+0000","last_unstale":"2024-01-21T21:15:17.611118+0000","last_undegraded":"2024-01-21T21:15:17.611118+0000","last_fullsized":"2024-01-21T21:15:17.611118+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.589214+0000","last_change":"2024-01-21T21:15:17.234928+0000","last_active":"2024-01-21T21:15:17.589214+0000","last_peered":"2024-01-21T21:15:17.589214+0000","last_clean":"2024-01-21T21:15:17.589214+0000","last_became_active":"2024-01-21T21:15:17.234699+0000","last_became_peered":"2024-01-21T21:15:17.234699+0000","last_unstale":"2024-01-21T21:15:17.589214+0000","last_undegraded":"2024-01-21T21:15:17.589214+0000","last_fullsized":"2024-01-21T21:15:17.589214+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611698+0000","last_change":"2024-01-21T21:15:17.611698+0000","last_active":"2024-01-21T21:15:17.611698+0000","last_peered":"2024-01-21T21:15:17.611698+0000","last_clean":"2024-01-21T21:15:17.611698+0000","last_became_active":"2024-01-21T21:15:17.610948+0000","last_became_peered":"2024-01-21T21:15:17.610948+0000","last_unstale":"2024-01-21T21:15:17.611698+0000","last_undegraded":"2024-01-21T21:15:17.611698+0000","last_fullsized":"2024-01-21T21:15:17.611698+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234351+0000","last_change":"2024-01-21T21:15:17.225621+0000","last_active":"2024-01-21T21:15:17.234351+0000","last_peered":"2024-01-21T21:15:17.234351+0000","last_clean":"2024-01-21T21:15:17.234351+0000","last_became_active":"2024-01-21T21:15:17.225334+0000","last_became_peered":"2024-01-21T21:15:17.225334+0000","last_unstale":"2024-01-21T21:15:17.234351+0000","last_undegraded":"2024-01-21T21:15:17.234351+0000","last_fullsized":"2024-01-21T21:15:17.234351+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609747+0000","last_change":"2024-01-21T21:15:17.609747+0000","last_active":"2024-01-21T21:15:17.609747+0000","last_peered":"2024-01-21T21:15:17.609747+0000","last_clean":"2024-01-21T21:15:17.609747+0000","last_became_active":"2024-01-21T21:15:17.606665+0000","last_became_peered":"2024-01-21T21:15:17.606665+0000","last_unstale":"2024-01-21T21:15:17.609747+0000","last_undegraded":"2024-01-21T21:15:17.609747+0000","last_fullsized":"2024-01-21T21:15:17.609747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.593431+0000","last_change":"2024-01-21T21:15:17.234397+0000","last_active":"2024-01-21T21:15:17.593431+0000","last_peered":"2024-01-21T21:15:17.593431+0000","last_clean":"2024-01-21T21:15:17.593431+0000","last_became_active":"2024-01-21T21:15:17.234142+0000","last_became_peered":"2024-01-21T21:15:17.234142+0000","last_unstale":"2024-01-21T21:15:17.593431+0000","last_undegraded":"2024-01-21T21:15:17.593431+0000","last_fullsized":"2024-01-21T21:15:17.593431+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610645+0000","last_change":"2024-01-21T21:15:17.610645+0000","last_active":"2024-01-21T21:15:17.610645+0000","last_peered":"2024-01-21T21:15:17.610645+0000","last_clean":"2024-01-21T21:15:17.610645+0000","last_became_active":"2024-01-21T21:15:17.610385+0000","last_became_peered":"2024-01-21T21:15:17.610385+0000","last_unstale":"2024-01-21T21:15:17.610645+0000","last_undegraded":"2024-01-21T21:15:17.610645+0000","last_fullsized":"2024-01-21T21:15:17.610645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.226447+0000","last_change":"2024-01-21T21:15:17.225271+0000","last_active":"2024-01-21T21:15:17.226447+0000","last_peered":"2024-01-21T21:15:17.226447+0000","last_clean":"2024-01-21T21:15:17.226447+0000","last_became_active":"2024-01-21T21:15:17.224969+0000","last_became_peered":"2024-01-21T21:15:17.224969+0000","last_unstale":"2024-01-21T21:15:17.226447+0000","last_undegraded":"2024-01-21T21:15:17.226447+0000","last_fullsized":"2024-01-21T21:15:17.226447+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598623+0000","last_change":"2024-01-21T21:15:17.598623+0000","last_active":"2024-01-21T21:15:17.598623+0000","last_peered":"2024-01-21T21:15:17.598623+0000","last_clean":"2024-01-21T21:15:17.598623+0000","last_became_active":"2024-01-21T21:15:17.598337+0000","last_became_peered":"2024-01-21T21:15:17.598337+0000","last_unstale":"2024-01-21T21:15:17.598623+0000","last_undegraded":"2024-01-21T21:15:17.598623+0000","last_fullsized":"2024-01-21T21:15:17.598623+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233053+0000","last_change":"2024-01-21T21:15:17.230598+0000","last_active":"2024-01-21T21:15:17.233053+0000","last_peered":"2024-01-21T21:15:17.233053+0000","last_clean":"2024-01-21T21:15:17.233053+0000","last_became_active":"2024-01-21T21:15:17.230283+0000","last_became_peered":"2024-01-21T21:15:17.230283+0000","last_unstale":"2024-01-21T21:15:17.233053+0000","last_undegraded":"2024-01-21T21:15:17.233053+0000","last_fullsized":"2024-01-21T21:15:17.233053+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604191+0000","last_change":"2024-01-21T21:15:17.604191+0000","last_active":"2024-01-21T21:15:17.604191+0000","last_peered":"2024-01-21T21:15:17.604191+0000","last_clean":"2024-01-21T21:15:17.604191+0000","last_became_active":"2024-01-21T21:15:17.603584+0000","last_became_peered":"2024-01-21T21:15:17.603584+0000","last_unstale":"2024-01-21T21:15:17.604191+0000","last_undegraded":"2024-01-21T21:15:17.604191+0000","last_fullsized":"2024-01-21T21:15:17.604191+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.235687+0000","last_change":"2024-01-21T21:15:17.229510+0000","last_active":"2024-01-21T21:15:17.235687+0000","last_peered":"2024-01-21T21:15:17.235687+0000","last_clean":"2024-01-21T21:15:17.235687+0000","last_became_active":"2024-01-21T21:15:17.229048+0000","last_became_peered":"2024-01-21T21:15:17.229048+0000","last_unstale":"2024-01-21T21:15:17.235687+0000","last_undegraded":"2024-01-21T21:15:17.235687+0000","last_fullsized":"2024-01-21T21:15:17.235687+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605044+0000","last_change":"2024-01-21T21:15:17.605044+0000","last_active":"2024-01-21T21:15:17.605044+0000","last_peered":"2024-01-21T21:15:17.605044+0000","last_clean":"2024-01-21T21:15:17.605044+0000","last_became_active":"2024-01-21T21:15:17.604745+0000","last_became_peered":"2024-01-21T21:15:17.604745+0000","last_unstale":"2024-01-21T21:15:17.605044+0000","last_undegraded":"2024-01-21T21:15:17.605044+0000","last_fullsized":"2024-01-21T21:15:17.605044+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234505+0000","last_change":"2024-01-21T21:15:17.226316+0000","last_active":"2024-01-21T21:15:17.234505+0000","last_peered":"2024-01-21T21:15:17.234505+0000","last_clean":"2024-01-21T21:15:17.234505+0000","last_became_active":"2024-01-21T21:15:17.225963+0000","last_became_peered":"2024-01-21T21:15:17.225963+0000","last_unstale":"2024-01-21T21:15:17.234505+0000","last_undegraded":"2024-01-21T21:15:17.234505+0000","last_fullsized":"2024-01-21T21:15:17.234505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604014+0000","last_change":"2024-01-21T21:15:17.604014+0000","last_active":"2024-01-21T21:15:17.604014+0000","last_peered":"2024-01-21T21:15:17.604014+0000","last_clean":"2024-01-21T21:15:17.604014+0000","last_became_active":"2024-01-21T21:15:17.603730+0000","last_became_peered":"2024-01-21T21:15:17.603730+0000","last_unstale":"2024-01-21T21:15:17.604014+0000","last_undegraded":"2024-01-21T21:15:17.604014+0000","last_fullsized":"2024-01-21T21:15:17.604014+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242407+0000","last_change":"2024-01-21T21:15:17.231525+0000","last_active":"2024-01-21T21:15:17.242407+0000","last_peered":"2024-01-21T21:15:17.242407+0000","last_clean":"2024-01-21T21:15:17.242407+0000","last_became_active":"2024-01-21T21:15:17.231257+0000","last_became_peered":"2024-01-21T21:15:17.231257+0000","last_unstale":"2024-01-21T21:15:17.242407+0000","last_undegraded":"2024-01-21T21:15:17.242407+0000","last_fullsized":"2024-01-21T21:15:17.242407+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609809+0000","last_change":"2024-01-21T21:15:17.609809+0000","last_active":"2024-01-21T21:15:17.609809+0000","last_peered":"2024-01-21T21:15:17.609809+0000","last_clean":"2024-01-21T21:15:17.609809+0000","last_became_active":"2024-01-21T21:15:17.608561+0000","last_became_peered":"2024-01-21T21:15:17.608561+0000","last_unstale":"2024-01-21T21:15:17.609809+0000","last_undegraded":"2024-01-21T21:15:17.609809+0000","last_fullsized":"2024-01-21T21:15:17.609809+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.241888+0000","last_change":"2024-01-21T21:15:17.235378+0000","last_active":"2024-01-21T21:15:17.241888+0000","last_peered":"2024-01-21T21:15:17.241888+0000","last_clean":"2024-01-21T21:15:17.241888+0000","last_became_active":"2024-01-21T21:15:17.235123+0000","last_became_peered":"2024-01-21T21:15:17.235123+0000","last_unstale":"2024-01-21T21:15:17.241888+0000","last_undegraded":"2024-01-21T21:15:17.241888+0000","last_fullsized":"2024-01-21T21:15:17.241888+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601446+0000","last_change":"2024-01-21T21:15:17.601446+0000","last_active":"2024-01-21T21:15:17.601446+0000","last_peered":"2024-01-21T21:15:17.601446+0000","last_clean":"2024-01-21T21:15:17.601446+0000","last_became_active":"2024-01-21T21:15:17.601155+0000","last_became_peered":"2024-01-21T21:15:17.601155+0000","last_unstale":"2024-01-21T21:15:17.601446+0000","last_undegraded":"2024-01-21T21:15:17.601446+0000","last_fullsized":"2024-01-21T21:15:17.601446+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.244882+0000","last_change":"2024-01-21T21:15:17.240027+0000","last_active":"2024-01-21T21:15:17.244882+0000","last_peered":"2024-01-21T21:15:17.244882+0000","last_clean":"2024-01-21T21:15:17.244882+0000","last_became_active":"2024-01-21T21:15:17.239755+0000","last_became_peered":"2024-01-21T21:15:17.239755+0000","last_unstale":"2024-01-21T21:15:17.244882+0000","last_undegraded":"2024-01-21T21:15:17.244882+0000","last_fullsized":"2024-01-21T21:15:17.244882+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606743+0000","last_change":"2024-01-21T21:15:17.606743+0000","last_active":"2024-01-21T21:15:17.606743+0000","last_peered":"2024-01-21T21:15:17.606743+0000","last_clean":"2024-01-21T21:15:17.606743+0000","last_became_active":"2024-01-21T21:15:17.606411+0000","last_became_peered":"2024-01-21T21:15:17.606411+0000","last_unstale":"2024-01-21T21:15:17.606743+0000","last_undegraded":"2024-01-21T21:15:17.606743+0000","last_fullsized":"2024-01-21T21:15:17.606743+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242481+0000","last_change":"2024-01-21T21:15:17.238719+0000","last_active":"2024-01-21T21:15:17.242481+0000","last_peered":"2024-01-21T21:15:17.242481+0000","last_clean":"2024-01-21T21:15:17.242481+0000","last_became_active":"2024-01-21T21:15:17.238362+0000","last_became_peered":"2024-01-21T21:15:17.238362+0000","last_unstale":"2024-01-21T21:15:17.242481+0000","last_undegraded":"2024-01-21T21:15:17.242481+0000","last_fullsized":"2024-01-21T21:15:17.242481+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600292+0000","last_change":"2024-01-21T21:15:17.600292+0000","last_active":"2024-01-21T21:15:17.600292+0000","last_peered":"2024-01-21T21:15:17.600292+0000","last_clean":"2024-01-21T21:15:17.600292+0000","last_became_active":"2024-01-21T21:15:17.600025+0000","last_became_peered":"2024-01-21T21:15:17.600025+0000","last_unstale":"2024-01-21T21:15:17.600292+0000","last_undegraded":"2024-01-21T21:15:17.600292+0000","last_fullsized":"2024-01-21T21:15:17.600292+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240989+0000","last_change":"2024-01-21T21:15:17.240417+0000","last_active":"2024-01-21T21:15:17.240989+0000","last_peered":"2024-01-21T21:15:17.240989+0000","last_clean":"2024-01-21T21:15:17.240989+0000","last_became_active":"2024-01-21T21:15:17.240101+0000","last_became_peered":"2024-01-21T21:15:17.240101+0000","last_unstale":"2024-01-21T21:15:17.240989+0000","last_undegraded":"2024-01-21T21:15:17.240989+0000","last_fullsized":"2024-01-21T21:15:17.240989+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610655+0000","last_change":"2024-01-21T21:15:17.610655+0000","last_active":"2024-01-21T21:15:17.610655+0000","last_peered":"2024-01-21T21:15:17.610655+0000","last_clean":"2024-01-21T21:15:17.610655+0000","last_became_active":"2024-01-21T21:15:17.610377+0000","last_became_peered":"2024-01-21T21:15:17.610377+0000","last_unstale":"2024-01-21T21:15:17.610655+0000","last_undegraded":"2024-01-21T21:15:17.610655+0000","last_fullsized":"2024-01-21T21:15:17.610655+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239499+0000","last_change":"2024-01-21T21:15:17.236851+0000","last_active":"2024-01-21T21:15:17.239499+0000","last_peered":"2024-01-21T21:15:17.239499+0000","last_clean":"2024-01-21T21:15:17.239499+0000","last_became_active":"2024-01-21T21:15:17.236574+0000","last_became_peered":"2024-01-21T21:15:17.236574+0000","last_unstale":"2024-01-21T21:15:17.239499+0000","last_undegraded":"2024-01-21T21:15:17.239499+0000","last_fullsized":"2024-01-21T21:15:17.239499+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604519+0000","last_change":"2024-01-21T21:15:17.604519+0000","last_active":"2024-01-21T21:15:17.604519+0000","last_peered":"2024-01-21T21:15:17.604519+0000","last_clean":"2024-01-21T21:15:17.604519+0000","last_became_active":"2024-01-21T21:15:17.604250+0000","last_became_peered":"2024-01-21T21:15:17.604250+0000","last_unstale":"2024-01-21T21:15:17.604519+0000","last_undegraded":"2024-01-21T21:15:17.604519+0000","last_fullsized":"2024-01-21T21:15:17.604519+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.230775+0000","last_change":"2024-01-21T21:15:17.222522+0000","last_active":"2024-01-21T21:15:17.230775+0000","last_peered":"2024-01-21T21:15:17.230775+0000","last_clean":"2024-01-21T21:15:17.230775+0000","last_became_active":"2024-01-21T21:15:17.222257+0000","last_became_peered":"2024-01-21T21:15:17.222257+0000","last_unstale":"2024-01-21T21:15:17.230775+0000","last_undegraded":"2024-01-21T21:15:17.230775+0000","last_fullsized":"2024-01-21T21:15:17.230775+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597343+0000","last_change":"2024-01-21T21:15:17.597343+0000","last_active":"2024-01-21T21:15:17.597343+0000","last_peered":"2024-01-21T21:15:17.597343+0000","last_clean":"2024-01-21T21:15:17.597343+0000","last_became_active":"2024-01-21T21:15:17.597099+0000","last_became_peered":"2024-01-21T21:15:17.597099+0000","last_unstale":"2024-01-21T21:15:17.597343+0000","last_undegraded":"2024-01-21T21:15:17.597343+0000","last_fullsized":"2024-01-21T21:15:17.597343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598964+0000","last_change":"2024-01-21T21:15:17.236722+0000","last_active":"2024-01-21T21:15:17.598964+0000","last_peered":"2024-01-21T21:15:17.598964+0000","last_clean":"2024-01-21T21:15:17.598964+0000","last_became_active":"2024-01-21T21:15:17.236058+0000","last_became_peered":"2024-01-21T21:15:17.236058+0000","last_unstale":"2024-01-21T21:15:17.598964+0000","last_undegraded":"2024-01-21T21:15:17.598964+0000","last_fullsized":"2024-01-21T21:15:17.598964+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612410+0000","last_change":"2024-01-21T21:15:17.612410+0000","last_active":"2024-01-21T21:15:17.612410+0000","last_peered":"2024-01-21T21:15:17.612410+0000","last_clean":"2024-01-21T21:15:17.612410+0000","last_became_active":"2024-01-21T21:15:17.612011+0000","last_became_peered":"2024-01-21T21:15:17.612011+0000","last_unstale":"2024-01-21T21:15:17.612410+0000","last_undegraded":"2024-01-21T21:15:17.612410+0000","last_fullsized":"2024-01-21T21:15:17.612410+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.595182+0000","last_change":"2024-01-21T21:15:17.235349+0000","last_active":"2024-01-21T21:15:17.595182+0000","last_peered":"2024-01-21T21:15:17.595182+0000","last_clean":"2024-01-21T21:15:17.595182+0000","last_became_active":"2024-01-21T21:15:17.234961+0000","last_became_peered":"2024-01-21T21:15:17.234961+0000","last_unstale":"2024-01-21T21:15:17.595182+0000","last_undegraded":"2024-01-21T21:15:17.595182+0000","last_fullsized":"2024-01-21T21:15:17.595182+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612894+0000","last_change":"2024-01-21T21:15:17.612894+0000","last_active":"2024-01-21T21:15:17.612894+0000","last_peered":"2024-01-21T21:15:17.612894+0000","last_clean":"2024-01-21T21:15:17.612894+0000","last_became_active":"2024-01-21T21:15:17.612602+0000","last_became_peered":"2024-01-21T21:15:17.612602+0000","last_unstale":"2024-01-21T21:15:17.612894+0000","last_undegraded":"2024-01-21T21:15:17.612894+0000","last_fullsized":"2024-01-21T21:15:17.612894+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610251+0000","last_change":"2024-01-21T21:15:17.234426+0000","last_active":"2024-01-21T21:15:17.610251+0000","last_peered":"2024-01-21T21:15:17.610251+0000","last_clean":"2024-01-21T21:15:17.610251+0000","last_became_active":"2024-01-21T21:15:17.234094+0000","last_became_peered":"2024-01-21T21:15:17.234094+0000","last_unstale":"2024-01-21T21:15:17.610251+0000","last_undegraded":"2024-01-21T21:15:17.610251+0000","last_fullsized":"2024-01-21T21:15:17.610251+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610643+0000","last_change":"2024-01-21T21:15:17.610643+0000","last_active":"2024-01-21T21:15:17.610643+0000","last_peered":"2024-01-21T21:15:17.610643+0000","last_clean":"2024-01-21T21:15:17.610643+0000","last_became_active":"2024-01-21T21:15:17.610342+0000","last_became_peered":"2024-01-21T21:15:17.610342+0000","last_unstale":"2024-01-21T21:15:17.610643+0000","last_undegraded":"2024-01-21T21:15:17.610643+0000","last_fullsized":"2024-01-21T21:15:17.610643+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239199+0000","last_change":"2024-01-21T21:15:17.225866+0000","last_active":"2024-01-21T21:15:17.239199+0000","last_peered":"2024-01-21T21:15:17.239199+0000","last_clean":"2024-01-21T21:15:17.239199+0000","last_became_active":"2024-01-21T21:15:17.225573+0000","last_became_peered":"2024-01-21T21:15:17.225573+0000","last_unstale":"2024-01-21T21:15:17.239199+0000","last_undegraded":"2024-01-21T21:15:17.239199+0000","last_fullsized":"2024-01-21T21:15:17.239199+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607483+0000","last_change":"2024-01-21T21:15:17.607483+0000","last_active":"2024-01-21T21:15:17.607483+0000","last_peered":"2024-01-21T21:15:17.607483+0000","last_clean":"2024-01-21T21:15:17.607483+0000","last_became_active":"2024-01-21T21:15:17.607202+0000","last_became_peered":"2024-01-21T21:15:17.607202+0000","last_unstale":"2024-01-21T21:15:17.607483+0000","last_undegraded":"2024-01-21T21:15:17.607483+0000","last_fullsized":"2024-01-21T21:15:17.607483+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239265+0000","last_change":"2024-01-21T21:15:17.236658+0000","last_active":"2024-01-21T21:15:17.239265+0000","last_peered":"2024-01-21T21:15:17.239265+0000","last_clean":"2024-01-21T21:15:17.239265+0000","last_became_active":"2024-01-21T21:15:17.236374+0000","last_became_peered":"2024-01-21T21:15:17.236374+0000","last_unstale":"2024-01-21T21:15:17.239265+0000","last_undegraded":"2024-01-21T21:15:17.239265+0000","last_fullsized":"2024-01-21T21:15:17.239265+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612429+0000","last_change":"2024-01-21T21:15:17.612429+0000","last_active":"2024-01-21T21:15:17.612429+0000","last_peered":"2024-01-21T21:15:17.612429+0000","last_clean":"2024-01-21T21:15:17.612429+0000","last_became_active":"2024-01-21T21:15:17.612189+0000","last_became_peered":"2024-01-21T21:15:17.612189+0000","last_unstale":"2024-01-21T21:15:17.612429+0000","last_undegraded":"2024-01-21T21:15:17.612429+0000","last_fullsized":"2024-01-21T21:15:17.612429+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239462+0000","last_change":"2024-01-21T21:15:17.236781+0000","last_active":"2024-01-21T21:15:17.239462+0000","last_peered":"2024-01-21T21:15:17.239462+0000","last_clean":"2024-01-21T21:15:17.239462+0000","last_became_active":"2024-01-21T21:15:17.236469+0000","last_became_peered":"2024-01-21T21:15:17.236469+0000","last_unstale":"2024-01-21T21:15:17.239462+0000","last_undegraded":"2024-01-21T21:15:17.239462+0000","last_fullsized":"2024-01-21T21:15:17.239462+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602045+0000","last_change":"2024-01-21T21:15:17.602045+0000","last_active":"2024-01-21T21:15:17.602045+0000","last_peered":"2024-01-21T21:15:17.602045+0000","last_clean":"2024-01-21T21:15:17.602045+0000","last_became_active":"2024-01-21T21:15:17.601789+0000","last_became_peered":"2024-01-21T21:15:17.601789+0000","last_unstale":"2024-01-21T21:15:17.602045+0000","last_undegraded":"2024-01-21T21:15:17.602045+0000","last_fullsized":"2024-01-21T21:15:17.602045+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225146+0000","last_change":"2024-01-21T21:15:17.224503+0000","last_active":"2024-01-21T21:15:17.225146+0000","last_peered":"2024-01-21T21:15:17.225146+0000","last_clean":"2024-01-21T21:15:17.225146+0000","last_became_active":"2024-01-21T21:15:17.224234+0000","last_became_peered":"2024-01-21T21:15:17.224234+0000","last_unstale":"2024-01-21T21:15:17.225146+0000","last_undegraded":"2024-01-21T21:15:17.225146+0000","last_fullsized":"2024-01-21T21:15:17.225146+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609034+0000","last_change":"2024-01-21T21:15:17.609034+0000","last_active":"2024-01-21T21:15:17.609034+0000","last_peered":"2024-01-21T21:15:17.609034+0000","last_clean":"2024-01-21T21:15:17.609034+0000","last_became_active":"2024-01-21T21:15:17.608727+0000","last_became_peered":"2024-01-21T21:15:17.608727+0000","last_unstale":"2024-01-21T21:15:17.609034+0000","last_undegraded":"2024-01-21T21:15:17.609034+0000","last_fullsized":"2024-01-21T21:15:17.609034+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.222397+0000","last_change":"2024-01-21T21:15:17.216678+0000","last_active":"2024-01-21T21:15:17.222397+0000","last_peered":"2024-01-21T21:15:17.222397+0000","last_clean":"2024-01-21T21:15:17.222397+0000","last_became_active":"2024-01-21T21:15:17.216390+0000","last_became_peered":"2024-01-21T21:15:17.216390+0000","last_unstale":"2024-01-21T21:15:17.222397+0000","last_undegraded":"2024-01-21T21:15:17.222397+0000","last_fullsized":"2024-01-21T21:15:17.222397+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602691+0000","last_change":"2024-01-21T21:15:17.602691+0000","last_active":"2024-01-21T21:15:17.602691+0000","last_peered":"2024-01-21T21:15:17.602691+0000","last_clean":"2024-01-21T21:15:17.602691+0000","last_became_active":"2024-01-21T21:15:17.602410+0000","last_became_peered":"2024-01-21T21:15:17.602410+0000","last_unstale":"2024-01-21T21:15:17.602691+0000","last_undegraded":"2024-01-21T21:15:17.602691+0000","last_fullsized":"2024-01-21T21:15:17.602691+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601167+0000","last_change":"2024-01-21T21:15:17.230434+0000","last_active":"2024-01-21T21:15:17.601167+0000","last_peered":"2024-01-21T21:15:17.601167+0000","last_clean":"2024-01-21T21:15:17.601167+0000","last_became_active":"2024-01-21T21:15:17.230141+0000","last_became_peered":"2024-01-21T21:15:17.230141+0000","last_unstale":"2024-01-21T21:15:17.601167+0000","last_undegraded":"2024-01-21T21:15:17.601167+0000","last_fullsized":"2024-01-21T21:15:17.601167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.608022+0000","last_change":"2024-01-21T21:15:17.608022+0000","last_active":"2024-01-21T21:15:17.608022+0000","last_peered":"2024-01-21T21:15:17.608022+0000","last_clean":"2024-01-21T21:15:17.608022+0000","last_became_active":"2024-01-21T21:15:17.607674+0000","last_became_peered":"2024-01-21T21:15:17.607674+0000","last_unstale":"2024-01-21T21:15:17.608022+0000","last_undegraded":"2024-01-21T21:15:17.608022+0000","last_fullsized":"2024-01-21T21:15:17.608022+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607088+0000","last_change":"2024-01-21T21:15:17.242925+0000","last_active":"2024-01-21T21:15:17.607088+0000","last_peered":"2024-01-21T21:15:17.607088+0000","last_clean":"2024-01-21T21:15:17.607088+0000","last_became_active":"2024-01-21T21:15:17.242635+0000","last_became_peered":"2024-01-21T21:15:17.242635+0000","last_unstale":"2024-01-21T21:15:17.607088+0000","last_undegraded":"2024-01-21T21:15:17.607088+0000","last_fullsized":"2024-01-21T21:15:17.607088+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597750+0000","last_change":"2024-01-21T21:15:17.597750+0000","last_active":"2024-01-21T21:15:17.597750+0000","last_peered":"2024-01-21T21:15:17.597750+0000","last_clean":"2024-01-21T21:15:17.597750+0000","last_became_active":"2024-01-21T21:15:17.597460+0000","last_became_peered":"2024-01-21T21:15:17.597460+0000","last_unstale":"2024-01-21T21:15:17.597750+0000","last_undegraded":"2024-01-21T21:15:17.597750+0000","last_fullsized":"2024-01-21T21:15:17.597750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242462+0000","last_change":"2024-01-21T21:15:17.238562+0000","last_active":"2024-01-21T21:15:17.242462+0000","last_peered":"2024-01-21T21:15:17.242462+0000","last_clean":"2024-01-21T21:15:17.242462+0000","last_became_active":"2024-01-21T21:15:17.238324+0000","last_became_peered":"2024-01-21T21:15:17.238324+0000","last_unstale":"2024-01-21T21:15:17.242462+0000","last_undegraded":"2024-01-21T21:15:17.242462+0000","last_fullsized":"2024-01-21T21:15:17.242462+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.613259+0000","last_change":"2024-01-21T21:15:17.613259+0000","last_active":"2024-01-21T21:15:17.613259+0000","last_peered":"2024-01-21T21:15:17.613259+0000","last_clean":"2024-01-21T21:15:17.613259+0000","last_became_active":"2024-01-21T21:15:17.612962+0000","last_became_peered":"2024-01-21T21:15:17.612962+0000","last_unstale":"2024-01-21T21:15:17.613259+0000","last_undegraded":"2024-01-21T21:15:17.613259+0000","last_fullsized":"2024-01-21T21:15:17.613259+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239092+0000","last_change":"2024-01-21T21:15:17.230478+0000","last_active":"2024-01-21T21:15:17.239092+0000","last_peered":"2024-01-21T21:15:17.239092+0000","last_clean":"2024-01-21T21:15:17.239092+0000","last_became_active":"2024-01-21T21:15:17.230192+0000","last_became_peered":"2024-01-21T21:15:17.230192+0000","last_unstale":"2024-01-21T21:15:17.239092+0000","last_undegraded":"2024-01-21T21:15:17.239092+0000","last_fullsized":"2024-01-21T21:15:17.239092+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606036+0000","last_change":"2024-01-21T21:15:17.606036+0000","last_active":"2024-01-21T21:15:17.606036+0000","last_peered":"2024-01-21T21:15:17.606036+0000","last_clean":"2024-01-21T21:15:17.606036+0000","last_became_active":"2024-01-21T21:15:17.605729+0000","last_became_peered":"2024-01-21T21:15:17.605729+0000","last_unstale":"2024-01-21T21:15:17.606036+0000","last_undegraded":"2024-01-21T21:15:17.606036+0000","last_fullsized":"2024-01-21T21:15:17.606036+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.586917+0000","last_change":"2024-01-21T21:15:17.227441+0000","last_active":"2024-01-21T21:15:17.586917+0000","last_peered":"2024-01-21T21:15:17.586917+0000","last_clean":"2024-01-21T21:15:17.586917+0000","last_became_active":"2024-01-21T21:15:17.227177+0000","last_became_peered":"2024-01-21T21:15:17.227177+0000","last_unstale":"2024-01-21T21:15:17.586917+0000","last_undegraded":"2024-01-21T21:15:17.586917+0000","last_fullsized":"2024-01-21T21:15:17.586917+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.593197+0000","last_change":"2024-01-21T21:15:17.593197+0000","last_active":"2024-01-21T21:15:17.593197+0000","last_peered":"2024-01-21T21:15:17.593197+0000","last_clean":"2024-01-21T21:15:17.593197+0000","last_became_active":"2024-01-21T21:15:17.592902+0000","last_became_peered":"2024-01-21T21:15:17.592902+0000","last_unstale":"2024-01-21T21:15:17.593197+0000","last_undegraded":"2024-01-21T21:15:17.593197+0000","last_fullsized":"2024-01-21T21:15:17.593197+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240803+0000","last_change":"2024-01-21T21:15:17.240106+0000","last_active":"2024-01-21T21:15:17.240803+0000","last_peered":"2024-01-21T21:15:17.240803+0000","last_clean":"2024-01-21T21:15:17.240803+0000","last_became_active":"2024-01-21T21:15:17.239693+0000","last_became_peered":"2024-01-21T21:15:17.239693+0000","last_unstale":"2024-01-21T21:15:17.240803+0000","last_undegraded":"2024-01-21T21:15:17.240803+0000","last_fullsized":"2024-01-21T21:15:17.240803+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606060+0000","last_change":"2024-01-21T21:15:17.606060+0000","last_active":"2024-01-21T21:15:17.606060+0000","last_peered":"2024-01-21T21:15:17.606060+0000","last_clean":"2024-01-21T21:15:17.606060+0000","last_became_active":"2024-01-21T21:15:17.605726+0000","last_became_peered":"2024-01-21T21:15:17.605726+0000","last_unstale":"2024-01-21T21:15:17.606060+0000","last_undegraded":"2024-01-21T21:15:17.606060+0000","last_fullsized":"2024-01-21T21:15:17.606060+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.231068+0000","last_change":"2024-01-21T21:15:17.227487+0000","last_active":"2024-01-21T21:15:17.231068+0000","last_peered":"2024-01-21T21:15:17.231068+0000","last_clean":"2024-01-21T21:15:17.231068+0000","last_became_active":"2024-01-21T21:15:17.226949+0000","last_became_peered":"2024-01-21T21:15:17.226949+0000","last_unstale":"2024-01-21T21:15:17.231068+0000","last_undegraded":"2024-01-21T21:15:17.231068+0000","last_fullsized":"2024-01-21T21:15:17.231068+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611954+0000","last_change":"2024-01-21T21:15:17.611954+0000","last_active":"2024-01-21T21:15:17.611954+0000","last_peered":"2024-01-21T21:15:17.611954+0000","last_clean":"2024-01-21T21:15:17.611954+0000","last_became_active":"2024-01-21T21:15:17.611632+0000","last_became_peered":"2024-01-21T21:15:17.611632+0000","last_unstale":"2024-01-21T21:15:17.611954+0000","last_undegraded":"2024-01-21T21:15:17.611954+0000","last_fullsized":"2024-01-21T21:15:17.611954+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233003+0000","last_change":"2024-01-21T21:15:17.229614+0000","last_active":"2024-01-21T21:15:17.233003+0000","last_peered":"2024-01-21T21:15:17.233003+0000","last_clean":"2024-01-21T21:15:17.233003+0000","last_became_active":"2024-01-21T21:15:17.229021+0000","last_became_peered":"2024-01-21T21:15:17.229021+0000","last_unstale":"2024-01-21T21:15:17.233003+0000","last_undegraded":"2024-01-21T21:15:17.233003+0000","last_fullsized":"2024-01-21T21:15:17.233003+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611139+0000","last_change":"2024-01-21T21:15:17.611139+0000","last_active":"2024-01-21T21:15:17.611139+0000","last_peered":"2024-01-21T21:15:17.611139+0000","last_clean":"2024-01-21T21:15:17.611139+0000","last_became_active":"2024-01-21T21:15:17.610867+0000","last_became_peered":"2024-01-21T21:15:17.610867+0000","last_unstale":"2024-01-21T21:15:17.611139+0000","last_undegraded":"2024-01-21T21:15:17.611139+0000","last_fullsized":"2024-01-21T21:15:17.611139+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.615261+0000","last_change":"2024-01-21T21:15:17.231017+0000","last_active":"2024-01-21T21:15:17.615261+0000","last_peered":"2024-01-21T21:15:17.615261+0000","last_clean":"2024-01-21T21:15:17.615261+0000","last_became_active":"2024-01-21T21:15:17.230744+0000","last_became_peered":"2024-01-21T21:15:17.230744+0000","last_unstale":"2024-01-21T21:15:17.615261+0000","last_undegraded":"2024-01-21T21:15:17.615261+0000","last_fullsized":"2024-01-21T21:15:17.615261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611508+0000","last_change":"2024-01-21T21:15:17.611508+0000","last_active":"2024-01-21T21:15:17.611508+0000","last_peered":"2024-01-21T21:15:17.611508+0000","last_clean":"2024-01-21T21:15:17.611508+0000","last_became_active":"2024-01-21T21:15:17.611092+0000","last_became_peered":"2024-01-21T21:15:17.611092+0000","last_unstale":"2024-01-21T21:15:17.611508+0000","last_undegraded":"2024-01-21T21:15:17.611508+0000","last_fullsized":"2024-01-21T21:15:17.611508+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.232884+0000","last_change":"2024-01-21T21:15:17.231350+0000","last_active":"2024-01-21T21:15:17.232884+0000","last_peered":"2024-01-21T21:15:17.232884+0000","last_clean":"2024-01-21T21:15:17.232884+0000","last_became_active":"2024-01-21T21:15:17.230584+0000","last_became_peered":"2024-01-21T21:15:17.230584+0000","last_unstale":"2024-01-21T21:15:17.232884+0000","last_undegraded":"2024-01-21T21:15:17.232884+0000","last_fullsized":"2024-01-21T21:15:17.232884+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602755+0000","last_change":"2024-01-21T21:15:17.602755+0000","last_active":"2024-01-21T21:15:17.602755+0000","last_peered":"2024-01-21T21:15:17.602755+0000","last_clean":"2024-01-21T21:15:17.602755+0000","last_became_active":"2024-01-21T21:15:17.602469+0000","last_became_peered":"2024-01-21T21:15:17.602469+0000","last_unstale":"2024-01-21T21:15:17.602755+0000","last_undegraded":"2024-01-21T21:15:17.602755+0000","last_fullsized":"2024-01-21T21:15:17.602755+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242312+0000","last_change":"2024-01-21T21:15:17.228219+0000","last_active":"2024-01-21T21:15:17.242312+0000","last_peered":"2024-01-21T21:15:17.242312+0000","last_clean":"2024-01-21T21:15:17.242312+0000","last_became_active":"2024-01-21T21:15:17.228023+0000","last_became_peered":"2024-01-21T21:15:17.228023+0000","last_unstale":"2024-01-21T21:15:17.242312+0000","last_undegraded":"2024-01-21T21:15:17.242312+0000","last_fullsized":"2024-01-21T21:15:17.242312+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614538+0000","last_change":"2024-01-21T21:15:17.614538+0000","last_active":"2024-01-21T21:15:17.614538+0000","last_peered":"2024-01-21T21:15:17.614538+0000","last_clean":"2024-01-21T21:15:17.614538+0000","last_became_active":"2024-01-21T21:15:17.614267+0000","last_became_peered":"2024-01-21T21:15:17.614267+0000","last_unstale":"2024-01-21T21:15:17.614538+0000","last_undegraded":"2024-01-21T21:15:17.614538+0000","last_fullsized":"2024-01-21T21:15:17.614538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225262+0000","last_change":"2024-01-21T21:15:17.221564+0000","last_active":"2024-01-21T21:15:17.225262+0000","last_peered":"2024-01-21T21:15:17.225262+0000","last_clean":"2024-01-21T21:15:17.225262+0000","last_became_active":"2024-01-21T21:15:17.221354+0000","last_became_peered":"2024-01-21T21:15:17.221354+0000","last_unstale":"2024-01-21T21:15:17.225262+0000","last_undegraded":"2024-01-21T21:15:17.225262+0000","last_fullsized":"2024-01-21T21:15:17.225262+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605070+0000","last_change":"2024-01-21T21:15:17.605070+0000","last_active":"2024-01-21T21:15:17.605070+0000","last_peered":"2024-01-21T21:15:17.605070+0000","last_clean":"2024-01-21T21:15:17.605070+0000","last_became_active":"2024-01-21T21:15:17.604782+0000","last_became_peered":"2024-01-21T21:15:17.604782+0000","last_unstale":"2024-01-21T21:15:17.605070+0000","last_undegraded":"2024-01-21T21:15:17.605070+0000","last_fullsized":"2024-01-21T21:15:17.605070+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234784+0000","last_change":"2024-01-21T21:15:17.232333+0000","last_active":"2024-01-21T21:15:17.234784+0000","last_peered":"2024-01-21T21:15:17.234784+0000","last_clean":"2024-01-21T21:15:17.234784+0000","last_became_active":"2024-01-21T21:15:17.232023+0000","last_became_peered":"2024-01-21T21:15:17.232023+0000","last_unstale":"2024-01-21T21:15:17.234784+0000","last_undegraded":"2024-01-21T21:15:17.234784+0000","last_fullsized":"2024-01-21T21:15:17.234784+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612041+0000","last_change":"2024-01-21T21:15:17.612041+0000","last_active":"2024-01-21T21:15:17.612041+0000","last_peered":"2024-01-21T21:15:17.612041+0000","last_clean":"2024-01-21T21:15:17.612041+0000","last_became_active":"2024-01-21T21:15:17.611738+0000","last_became_peered":"2024-01-21T21:15:17.611738+0000","last_unstale":"2024-01-21T21:15:17.612041+0000","last_undegraded":"2024-01-21T21:15:17.612041+0000","last_fullsized":"2024-01-21T21:15:17.612041+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234286+0000","last_change":"2024-01-21T21:15:17.225201+0000","last_active":"2024-01-21T21:15:17.234286+0000","last_peered":"2024-01-21T21:15:17.234286+0000","last_clean":"2024-01-21T21:15:17.234286+0000","last_became_active":"2024-01-21T21:15:17.223054+0000","last_became_peered":"2024-01-21T21:15:17.223054+0000","last_unstale":"2024-01-21T21:15:17.234286+0000","last_undegraded":"2024-01-21T21:15:17.234286+0000","last_fullsized":"2024-01-21T21:15:17.234286+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602545+0000","last_change":"2024-01-21T21:15:17.602545+0000","last_active":"2024-01-21T21:15:17.602545+0000","last_peered":"2024-01-21T21:15:17.602545+0000","last_clean":"2024-01-21T21:15:17.602545+0000","last_became_active":"2024-01-21T21:15:17.602321+0000","last_became_peered":"2024-01-21T21:15:17.602321+0000","last_unstale":"2024-01-21T21:15:17.602545+0000","last_undegraded":"2024-01-21T21:15:17.602545+0000","last_fullsized":"2024-01-21T21:15:17.602545+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227373+0000","last_change":"2024-01-21T21:15:17.225730+0000","last_active":"2024-01-21T21:15:17.227373+0000","last_peered":"2024-01-21T21:15:17.227373+0000","last_clean":"2024-01-21T21:15:17.227373+0000","last_became_active":"2024-01-21T21:15:17.225454+0000","last_became_peered":"2024-01-21T21:15:17.225454+0000","last_unstale":"2024-01-21T21:15:17.227373+0000","last_undegraded":"2024-01-21T21:15:17.227373+0000","last_fullsized":"2024-01-21T21:15:17.227373+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604970+0000","last_change":"2024-01-21T21:15:17.604970+0000","last_active":"2024-01-21T21:15:17.604970+0000","last_peered":"2024-01-21T21:15:17.604970+0000","last_clean":"2024-01-21T21:15:17.604970+0000","last_became_active":"2024-01-21T21:15:17.604707+0000","last_became_peered":"2024-01-21T21:15:17.604707+0000","last_unstale":"2024-01-21T21:15:17.604970+0000","last_undegraded":"2024-01-21T21:15:17.604970+0000","last_fullsized":"2024-01-21T21:15:17.604970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.238413+0000","last_change":"2024-01-21T21:15:17.235335+0000","last_active":"2024-01-21T21:15:17.238413+0000","last_peered":"2024-01-21T21:15:17.238413+0000","last_clean":"2024-01-21T21:15:17.238413+0000","last_became_active":"2024-01-21T21:15:17.235071+0000","last_became_peered":"2024-01-21T21:15:17.235071+0000","last_unstale":"2024-01-21T21:15:17.238413+0000","last_undegraded":"2024-01-21T21:15:17.238413+0000","last_fullsized":"2024-01-21T21:15:17.238413+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600425+0000","last_change":"2024-01-21T21:15:17.600425+0000","last_active":"2024-01-21T21:15:17.600425+0000","last_peered":"2024-01-21T21:15:17.600425+0000","last_clean":"2024-01-21T21:15:17.600425+0000","last_became_active":"2024-01-21T21:15:17.599844+0000","last_became_peered":"2024-01-21T21:15:17.599844+0000","last_unstale":"2024-01-21T21:15:17.600425+0000","last_undegraded":"2024-01-21T21:15:17.600425+0000","last_fullsized":"2024-01-21T21:15:17.600425+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598940+0000","last_change":"2024-01-21T21:15:17.232544+0000","last_active":"2024-01-21T21:15:17.598940+0000","last_peered":"2024-01-21T21:15:17.598940+0000","last_clean":"2024-01-21T21:15:17.598940+0000","last_became_active":"2024-01-21T21:15:17.232322+0000","last_became_peered":"2024-01-21T21:15:17.232322+0000","last_unstale":"2024-01-21T21:15:17.598940+0000","last_undegraded":"2024-01-21T21:15:17.598940+0000","last_fullsized":"2024-01-21T21:15:17.598940+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.220942+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:15:17.220942+0000","last_peered":"2024-01-21T21:15:17.220942+0000","last_clean":"2024-01-21T21:15:17.220942+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:15:17.220942+0000","last_undegraded":"2024-01-21T21:15:17.220942+0000","last_fullsized":"2024-01-21T21:15:17.220942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610972+0000","last_change":"2024-01-21T21:15:17.610972+0000","last_active":"2024-01-21T21:15:17.610972+0000","last_peered":"2024-01-21T21:15:17.610972+0000","last_clean":"2024-01-21T21:15:17.610972+0000","last_became_active":"2024-01-21T21:15:17.610257+0000","last_became_peered":"2024-01-21T21:15:17.610257+0000","last_unstale":"2024-01-21T21:15:17.610972+0000","last_undegraded":"2024-01-21T21:15:17.610972+0000","last_fullsized":"2024-01-21T21:15:17.610972+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"173'3","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.616943+0000","last_change":"2024-01-21T21:15:17.231458+0000","last_active":"2024-01-21T21:15:17.616943+0000","last_peered":"2024-01-21T21:15:17.616943+0000","last_clean":"2024-01-21T21:15:17.616943+0000","last_became_active":"2024-01-21T21:15:17.231210+0000","last_became_peered":"2024-01-21T21:15:17.231210+0000","last_unstale":"2024-01-21T21:15:17.616943+0000","last_undegraded":"2024-01-21T21:15:17.616943+0000","last_fullsized":"2024-01-21T21:15:17.616943+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":157,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.216099+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:15:17.216099+0000","last_peered":"2024-01-21T21:15:17.216099+0000","last_clean":"2024-01-21T21:15:17.216099+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:15:17.216099+0000","last_undegraded":"2024-01-21T21:15:17.216099+0000","last_fullsized":"2024-01-21T21:15:17.216099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.613010+0000","last_change":"2024-01-21T21:15:17.613010+0000","last_active":"2024-01-21T21:15:17.613010+0000","last_peered":"2024-01-21T21:15:17.613010+0000","last_clean":"2024-01-21T21:15:17.613010+0000","last_became_active":"2024-01-21T21:15:17.612115+0000","last_became_peered":"2024-01-21T21:15:17.612115+0000","last_unstale":"2024-01-21T21:15:17.613010+0000","last_undegraded":"2024-01-21T21:15:17.613010+0000","last_fullsized":"2024-01-21T21:15:17.613010+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.224201+0000","last_change":"2024-01-21T21:15:17.222723+0000","last_active":"2024-01-21T21:15:17.224201+0000","last_peered":"2024-01-21T21:15:17.224201+0000","last_clean":"2024-01-21T21:15:17.224201+0000","last_became_active":"2024-01-21T21:15:17.222463+0000","last_became_peered":"2024-01-21T21:15:17.222463+0000","last_unstale":"2024-01-21T21:15:17.224201+0000","last_undegraded":"2024-01-21T21:15:17.224201+0000","last_fullsized":"2024-01-21T21:15:17.224201+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.224630+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:15:17.224630+0000","last_peered":"2024-01-21T21:15:17.224630+0000","last_clean":"2024-01-21T21:15:17.224630+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:15:17.224630+0000","last_undegraded":"2024-01-21T21:15:17.224630+0000","last_fullsized":"2024-01-21T21:15:17.224630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604245+0000","last_change":"2024-01-21T21:15:17.604245+0000","last_active":"2024-01-21T21:15:17.604245+0000","last_peered":"2024-01-21T21:15:17.604245+0000","last_clean":"2024-01-21T21:15:17.604245+0000","last_became_active":"2024-01-21T21:15:17.603944+0000","last_became_peered":"2024-01-21T21:15:17.603944+0000","last_unstale":"2024-01-21T21:15:17.604245+0000","last_undegraded":"2024-01-21T21:15:17.604245+0000","last_fullsized":"2024-01-21T21:15:17.604245+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604485+0000","last_change":"2024-01-21T21:15:17.227687+0000","last_active":"2024-01-21T21:15:17.604485+0000","last_peered":"2024-01-21T21:15:17.604485+0000","last_clean":"2024-01-21T21:15:17.604485+0000","last_became_active":"2024-01-21T21:15:17.227320+0000","last_became_peered":"2024-01-21T21:15:17.227320+0000","last_unstale":"2024-01-21T21:15:17.604485+0000","last_undegraded":"2024-01-21T21:15:17.604485+0000","last_fullsized":"2024-01-21T21:15:17.604485+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":157,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.216157+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:15:17.216157+0000","last_peered":"2024-01-21T21:15:17.216157+0000","last_clean":"2024-01-21T21:15:17.216157+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:15:17.216157+0000","last_undegraded":"2024-01-21T21:15:17.216157+0000","last_fullsized":"2024-01-21T21:15:17.216157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225681+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:15:17.225681+0000","last_peered":"2024-01-21T21:15:17.225681+0000","last_clean":"2024-01-21T21:15:17.225681+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:15:17.225681+0000","last_undegraded":"2024-01-21T21:15:17.225681+0000","last_fullsized":"2024-01-21T21:15:17.225681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604453+0000","last_change":"2024-01-21T21:15:17.604453+0000","last_active":"2024-01-21T21:15:17.604453+0000","last_peered":"2024-01-21T21:15:17.604453+0000","last_clean":"2024-01-21T21:15:17.604453+0000","last_became_active":"2024-01-21T21:15:17.603775+0000","last_became_peered":"2024-01-21T21:15:17.603775+0000","last_unstale":"2024-01-21T21:15:17.604453+0000","last_undegraded":"2024-01-21T21:15:17.604453+0000","last_fullsized":"2024-01-21T21:15:17.604453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239518+0000","last_change":"2024-01-21T21:15:17.238575+0000","last_active":"2024-01-21T21:15:17.239518+0000","last_peered":"2024-01-21T21:15:17.239518+0000","last_clean":"2024-01-21T21:15:17.239518+0000","last_became_active":"2024-01-21T21:15:17.237969+0000","last_became_peered":"2024-01-21T21:15:17.237969+0000","last_unstale":"2024-01-21T21:15:17.239518+0000","last_undegraded":"2024-01-21T21:15:17.239518+0000","last_fullsized":"2024-01-21T21:15:17.239518+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.226589+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:15:17.226589+0000","last_peered":"2024-01-21T21:15:17.226589+0000","last_clean":"2024-01-21T21:15:17.226589+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:15:17.226589+0000","last_undegraded":"2024-01-21T21:15:17.226589+0000","last_fullsized":"2024-01-21T21:15:17.226589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614847+0000","last_change":"2024-01-21T21:15:17.614847+0000","last_active":"2024-01-21T21:15:17.614847+0000","last_peered":"2024-01-21T21:15:17.614847+0000","last_clean":"2024-01-21T21:15:17.614847+0000","last_became_active":"2024-01-21T21:15:17.614365+0000","last_became_peered":"2024-01-21T21:15:17.614365+0000","last_unstale":"2024-01-21T21:15:17.614847+0000","last_undegraded":"2024-01-21T21:15:17.614847+0000","last_fullsized":"2024-01-21T21:15:17.614847+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239294+0000","last_change":"2024-01-21T21:15:17.233802+0000","last_active":"2024-01-21T21:15:17.239294+0000","last_peered":"2024-01-21T21:15:17.239294+0000","last_clean":"2024-01-21T21:15:17.239294+0000","last_became_active":"2024-01-21T21:15:17.228015+0000","last_became_peered":"2024-01-21T21:15:17.228015+0000","last_unstale":"2024-01-21T21:15:17.239294+0000","last_undegraded":"2024-01-21T21:15:17.239294+0000","last_fullsized":"2024-01-21T21:15:17.239294+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227572+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:15:17.227572+0000","last_peered":"2024-01-21T21:15:17.227572+0000","last_clean":"2024-01-21T21:15:17.227572+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:15:17.227572+0000","last_undegraded":"2024-01-21T21:15:17.227572+0000","last_fullsized":"2024-01-21T21:15:17.227572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605893+0000","last_change":"2024-01-21T21:15:17.605893+0000","last_active":"2024-01-21T21:15:17.605893+0000","last_peered":"2024-01-21T21:15:17.605893+0000","last_clean":"2024-01-21T21:15:17.605893+0000","last_became_active":"2024-01-21T21:15:17.605622+0000","last_became_peered":"2024-01-21T21:15:17.605622+0000","last_unstale":"2024-01-21T21:15:17.605893+0000","last_undegraded":"2024-01-21T21:15:17.605893+0000","last_fullsized":"2024-01-21T21:15:17.605893+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239459+0000","last_change":"2024-01-21T21:15:17.235600+0000","last_active":"2024-01-21T21:15:17.239459+0000","last_peered":"2024-01-21T21:15:17.239459+0000","last_clean":"2024-01-21T21:15:17.239459+0000","last_became_active":"2024-01-21T21:15:17.235291+0000","last_became_peered":"2024-01-21T21:15:17.235291+0000","last_unstale":"2024-01-21T21:15:17.239459+0000","last_undegraded":"2024-01-21T21:15:17.239459+0000","last_fullsized":"2024-01-21T21:15:17.239459+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.222714+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:15:17.222714+0000","last_peered":"2024-01-21T21:15:17.222714+0000","last_clean":"2024-01-21T21:15:17.222714+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:15:17.222714+0000","last_undegraded":"2024-01-21T21:15:17.222714+0000","last_fullsized":"2024-01-21T21:15:17.222714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604860+0000","last_change":"2024-01-21T21:15:17.604860+0000","last_active":"2024-01-21T21:15:17.604860+0000","last_peered":"2024-01-21T21:15:17.604860+0000","last_clean":"2024-01-21T21:15:17.604860+0000","last_became_active":"2024-01-21T21:15:17.604491+0000","last_became_peered":"2024-01-21T21:15:17.604491+0000","last_unstale":"2024-01-21T21:15:17.604860+0000","last_undegraded":"2024-01-21T21:15:17.604860+0000","last_fullsized":"2024-01-21T21:15:17.604860+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610764+0000","last_change":"2024-01-21T21:15:17.231084+0000","last_active":"2024-01-21T21:15:17.610764+0000","last_peered":"2024-01-21T21:15:17.610764+0000","last_clean":"2024-01-21T21:15:17.610764+0000","last_became_active":"2024-01-21T21:15:17.230805+0000","last_became_peered":"2024-01-21T21:15:17.230805+0000","last_unstale":"2024-01-21T21:15:17.610764+0000","last_undegraded":"2024-01-21T21:15:17.610764+0000","last_fullsized":"2024-01-21T21:15:17.610764+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227690+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:15:17.227690+0000","last_peered":"2024-01-21T21:15:17.227690+0000","last_clean":"2024-01-21T21:15:17.227690+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:15:17.227690+0000","last_undegraded":"2024-01-21T21:15:17.227690+0000","last_fullsized":"2024-01-21T21:15:17.227690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575756,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307380,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064460,"statfs":{"total":96636764160,"available":96322007040,"internally_reserved":0,"allocated":2142208,"data_stored":1146022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.66300000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.746}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.76400000000000001,"5min":0.81299999999999994,"15min":0.875},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.63100000000000001,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.85399999999999998},"last":0.37}]},{"osd":2,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.84699999999999998,"15min":0.86799999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":0.84499999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68500000000000005,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.5},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.79200000000000004,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575758,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.307},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.36299999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575757,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":2170880,"data_stored":1154625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.435}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.45900000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.60299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575757,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41799999999999998,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":0.59399999999999997,"5min":0.62,"15min":0.67400000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40899999999999997,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.438,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57299999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33100000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.629,"5min":0.72499999999999998,"15min":0.749},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.69699999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92000000000000004,"5min":1,"15min":1},"last":0.876}]},{"osd":5,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":1.018},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":0.95299999999999996,"15min":0.999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.079},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42799999999999999},"max":{"1min":0.83699999999999997,"5min":1.044,"15min":1.044},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.38},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.754}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575757,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307384,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064456,"statfs":{"total":96636764160,"available":96322002944,"internally_reserved":0,"allocated":2146304,"data_stored":1146983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.72699999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060372,"statfs":{"total":96636764160,"available":96317820928,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.628}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45900000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.44},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48399999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:15:20.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:15:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.741+0000 7f542da52700 1 Processor -- start 2024-01-21T21:15:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.741+0000 7f542da52700 1 -- start start 2024-01-21T21:15:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54281545a0 0x7f54280c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54280aa360 0x7f54280c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54280c6590 0x7f54281582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280c6a40 con 0x7f54280aa360 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54280c89d0 con 0x7f54280c6590 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f542da52700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54280c7dc0 con 0x7f54281545a0 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54280aa360 0x7f54280c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54280aa360 0x7f54280c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35430/0 (socket says 172.21.15.133:35430) 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 -- 172.21.15.133:0/3254391336 learned_addr learned my addr 172.21.15.133:0/3254391336 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 -- 172.21.15.133:0/3254391336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54281545a0 msgr2=0x7f54280c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 --2- 172.21.15.133:0/3254391336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54281545a0 0x7f54280c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 -- 172.21.15.133:0/3254391336 >> v2:172.21.15.178:3300/0 conn(0x7f54280c6590 msgr2=0x7f54281582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 --2- 172.21.15.133:0/3254391336 >> v2:172.21.15.178:3300/0 conn(0x7f54280c6590 0x7f54281582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 -- 172.21.15.133:0/3254391336 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280c80a0 con 0x7f54280aa360 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f54267fc700 1 --2- 172.21.15.133:0/3254391336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54280c60a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f54280635a0 tx=0x7f541c0090f0).ready entity=mon.0 client_cookie=b4e201cb70426e0e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f5425ffb700 1 -- 172.21.15.133:0/3254391336 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00b600 con 0x7f54280aa360 2024-01-21T21:15:20.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f5425ffb700 1 -- 172.21.15.133:0/3254391336 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00b760 con 0x7f54280aa360 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.742+0000 7f5425ffb700 1 -- 172.21.15.133:0/3254391336 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c00bb00 con 0x7f54280aa360 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 -- 172.21.15.133:0/3254391336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 msgr2=0x7f54280c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 --2- 172.21.15.133:0/3254391336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54280c60a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 rx=0x7f54280635a0 tx=0x7f541c0090f0).stop 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 -- 172.21.15.133:0/3254391336 shutdown_connections 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 --2- 172.21.15.133:0/3254391336 >> v2:172.21.15.178:3300/0 conn(0x7f54280c6590 0x7f54281582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 --2- 172.21.15.133:0/3254391336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54281545a0 0x7f54280c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 --2- 172.21.15.133:0/3254391336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54280c60a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 -- 172.21.15.133:0/3254391336 >> 172.21.15.133:0/3254391336 conn(0x7f54280649d0 msgr2=0x7f5428064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 -- 172.21.15.133:0/3254391336 shutdown_connections 2024-01-21T21:15:20.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.743+0000 7f542da52700 1 -- 172.21.15.133:0/3254391336 wait complete. 2024-01-21T21:15:20.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.744+0000 7f542da52700 1 Processor -- start 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.744+0000 7f542da52700 1 -- start start 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54280c6590 0x7f54280b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281545a0 0x7f5428154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5428146680 con 0x7f54280aa360 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54280b0010 con 0x7f54281545a0 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f542da52700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5428157b90 con 0x7f54280c6590 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35438/0 (socket says 172.21.15.133:35438) 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 -- 172.21.15.133:0/3597778349 learned_addr learned my addr 172.21.15.133:0/3597778349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f54267fc700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54280c6590 0x7f54280b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f54277fe700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281545a0 0x7f5428154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 -- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54280c6590 msgr2=0x7f54280b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54280c6590 0x7f54280b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 -- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281545a0 msgr2=0x7f5428154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281545a0 0x7f5428154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 -- 172.21.15.133:0/3597778349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009370 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.745+0000 7f5426ffd700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f541800b610 tx=0x7f5418009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.746+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418002320 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.746+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54180024a0 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.746+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54280af160 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.746+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5418002860 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.746+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54280af6e0 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.747+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542805fdf0 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.747+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5418002c10 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.747+0000 7f540f7fe700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 0x7f5414061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.747+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f541807a1d0 con 0x7f54280aa360 2024-01-21T21:15:20.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.747+0000 7f54267fc700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 0x7f5414061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:20.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.748+0000 7f54267fc700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 0x7f5414061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f54280635a0 tx=0x7f541c017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:20.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.751+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f541804b210 con 0x7f54280aa360 2024-01-21T21:15:20.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.909+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54280c8380 con 0x7f541405f150 2024-01-21T21:15:20.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.918+0000 7f540f7fe700 1 -- 172.21.15.133:0/3597778349 <== mgr.8874 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+361805 (secure 0 0 0) 0x7f54280c8380 con 0x7f541405f150 2024-01-21T21:15:20.924 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 msgr2=0x7f5414061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 0x7f5414061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f54280635a0 tx=0x7f541c017000).stop 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 msgr2=0x7f54281576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f541800b610 tx=0x7f5418009060).stop 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 shutdown_connections 2024-01-21T21:15:20.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f541405f150 0x7f5414061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54281545a0 0x7f5428154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54280aa360 0x7f54281576a0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 --2- 172.21.15.133:0/3597778349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54280c6590 0x7f54280b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 >> 172.21.15.133:0/3597778349 conn(0x7f54280649d0 msgr2=0x7f54280c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 shutdown_connections 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:20.922+0000 7f542da52700 1 -- 172.21.15.133:0/3597778349 wait complete. 2024-01-21T21:15:20.928 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:15:20.936 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:15:20.667523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":59,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454936,"kb_used_data":16728,"kb_used_omap":0,"kb_used_meta":2438144,"kb_avail":752519784,"statfs":{"total":773094113280,"available":770580258816,"internally_reserved":0,"allocated":17129472,"data_stored":9145870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2496659456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10876,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-63,"num_write_kb":-31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.582230"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.616081+0000","last_change":"2024-01-21T21:15:17.616081+0000","last_active":"2024-01-21T21:15:17.616081+0000","last_peered":"2024-01-21T21:15:17.616081+0000","last_clean":"2024-01-21T21:15:17.616081+0000","last_became_active":"2024-01-21T21:15:17.615869+0000","last_became_peered":"2024-01-21T21:15:17.615869+0000","last_unstale":"2024-01-21T21:15:17.616081+0000","last_undegraded":"2024-01-21T21:15:17.616081+0000","last_fullsized":"2024-01-21T21:15:17.616081+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3f","version":"173'3","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.603319+0000","last_change":"2024-01-21T21:15:17.228959+0000","last_active":"2024-01-21T21:15:17.603319+0000","last_peered":"2024-01-21T21:15:17.603319+0000","last_clean":"2024-01-21T21:15:17.603319+0000","last_became_active":"2024-01-21T21:15:17.228633+0000","last_became_peered":"2024-01-21T21:15:17.228633+0000","last_unstale":"2024-01-21T21:15:17.603319+0000","last_undegraded":"2024-01-21T21:15:17.603319+0000","last_fullsized":"2024-01-21T21:15:17.603319+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598581+0000","last_change":"2024-01-21T21:15:17.598581+0000","last_active":"2024-01-21T21:15:17.598581+0000","last_peered":"2024-01-21T21:15:17.598581+0000","last_clean":"2024-01-21T21:15:17.598581+0000","last_became_active":"2024-01-21T21:15:17.598311+0000","last_became_peered":"2024-01-21T21:15:17.598311+0000","last_unstale":"2024-01-21T21:15:17.598581+0000","last_undegraded":"2024-01-21T21:15:17.598581+0000","last_fullsized":"2024-01-21T21:15:17.598581+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233806+0000","last_change":"2024-01-21T21:15:17.229300+0000","last_active":"2024-01-21T21:15:17.233806+0000","last_peered":"2024-01-21T21:15:17.233806+0000","last_clean":"2024-01-21T21:15:17.233806+0000","last_became_active":"2024-01-21T21:15:17.229035+0000","last_became_peered":"2024-01-21T21:15:17.229035+0000","last_unstale":"2024-01-21T21:15:17.233806+0000","last_undegraded":"2024-01-21T21:15:17.233806+0000","last_fullsized":"2024-01-21T21:15:17.233806+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.615043+0000","last_change":"2024-01-21T21:15:17.615043+0000","last_active":"2024-01-21T21:15:17.615043+0000","last_peered":"2024-01-21T21:15:17.615043+0000","last_clean":"2024-01-21T21:15:17.615043+0000","last_became_active":"2024-01-21T21:15:17.614849+0000","last_became_peered":"2024-01-21T21:15:17.614849+0000","last_unstale":"2024-01-21T21:15:17.615043+0000","last_undegraded":"2024-01-21T21:15:17.615043+0000","last_fullsized":"2024-01-21T21:15:17.615043+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239381+0000","last_change":"2024-01-21T21:15:17.234602+0000","last_active":"2024-01-21T21:15:17.239381+0000","last_peered":"2024-01-21T21:15:17.239381+0000","last_clean":"2024-01-21T21:15:17.239381+0000","last_became_active":"2024-01-21T21:15:17.234300+0000","last_became_peered":"2024-01-21T21:15:17.234300+0000","last_unstale":"2024-01-21T21:15:17.239381+0000","last_undegraded":"2024-01-21T21:15:17.239381+0000","last_fullsized":"2024-01-21T21:15:17.239381+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600830+0000","last_change":"2024-01-21T21:15:17.600830+0000","last_active":"2024-01-21T21:15:17.600830+0000","last_peered":"2024-01-21T21:15:17.600830+0000","last_clean":"2024-01-21T21:15:17.600830+0000","last_became_active":"2024-01-21T21:15:17.600549+0000","last_became_peered":"2024-01-21T21:15:17.600549+0000","last_unstale":"2024-01-21T21:15:17.600830+0000","last_undegraded":"2024-01-21T21:15:17.600830+0000","last_fullsized":"2024-01-21T21:15:17.600830+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3c","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607885+0000","last_change":"2024-01-21T21:15:17.237096+0000","last_active":"2024-01-21T21:15:17.607885+0000","last_peered":"2024-01-21T21:15:17.607885+0000","last_clean":"2024-01-21T21:15:17.607885+0000","last_became_active":"2024-01-21T21:15:17.236801+0000","last_became_peered":"2024-01-21T21:15:17.236801+0000","last_unstale":"2024-01-21T21:15:17.607885+0000","last_undegraded":"2024-01-21T21:15:17.607885+0000","last_fullsized":"2024-01-21T21:15:17.607885+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612179+0000","last_change":"2024-01-21T21:15:17.612179+0000","last_active":"2024-01-21T21:15:17.612179+0000","last_peered":"2024-01-21T21:15:17.612179+0000","last_clean":"2024-01-21T21:15:17.612179+0000","last_became_active":"2024-01-21T21:15:17.611899+0000","last_became_peered":"2024-01-21T21:15:17.611899+0000","last_unstale":"2024-01-21T21:15:17.612179+0000","last_undegraded":"2024-01-21T21:15:17.612179+0000","last_fullsized":"2024-01-21T21:15:17.612179+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.589523+0000","last_change":"2024-01-21T21:15:17.222327+0000","last_active":"2024-01-21T21:15:17.589523+0000","last_peered":"2024-01-21T21:15:17.589523+0000","last_clean":"2024-01-21T21:15:17.589523+0000","last_became_active":"2024-01-21T21:15:17.221996+0000","last_became_peered":"2024-01-21T21:15:17.221996+0000","last_unstale":"2024-01-21T21:15:17.589523+0000","last_undegraded":"2024-01-21T21:15:17.589523+0000","last_fullsized":"2024-01-21T21:15:17.589523+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597411+0000","last_change":"2024-01-21T21:15:17.597411+0000","last_active":"2024-01-21T21:15:17.597411+0000","last_peered":"2024-01-21T21:15:17.597411+0000","last_clean":"2024-01-21T21:15:17.597411+0000","last_became_active":"2024-01-21T21:15:17.597083+0000","last_became_peered":"2024-01-21T21:15:17.597083+0000","last_unstale":"2024-01-21T21:15:17.597411+0000","last_undegraded":"2024-01-21T21:15:17.597411+0000","last_fullsized":"2024-01-21T21:15:17.597411+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.590960+0000","last_change":"2024-01-21T21:15:17.236846+0000","last_active":"2024-01-21T21:15:17.590960+0000","last_peered":"2024-01-21T21:15:17.590960+0000","last_clean":"2024-01-21T21:15:17.590960+0000","last_became_active":"2024-01-21T21:15:17.236243+0000","last_became_peered":"2024-01-21T21:15:17.236243+0000","last_unstale":"2024-01-21T21:15:17.590960+0000","last_undegraded":"2024-01-21T21:15:17.590960+0000","last_fullsized":"2024-01-21T21:15:17.590960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610826+0000","last_change":"2024-01-21T21:15:17.610826+0000","last_active":"2024-01-21T21:15:17.610826+0000","last_peered":"2024-01-21T21:15:17.610826+0000","last_clean":"2024-01-21T21:15:17.610826+0000","last_became_active":"2024-01-21T21:15:17.610410+0000","last_became_peered":"2024-01-21T21:15:17.610410+0000","last_unstale":"2024-01-21T21:15:17.610826+0000","last_undegraded":"2024-01-21T21:15:17.610826+0000","last_fullsized":"2024-01-21T21:15:17.610826+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.231087+0000","last_change":"2024-01-21T21:15:17.227840+0000","last_active":"2024-01-21T21:15:17.231087+0000","last_peered":"2024-01-21T21:15:17.231087+0000","last_clean":"2024-01-21T21:15:17.231087+0000","last_became_active":"2024-01-21T21:15:17.227482+0000","last_became_peered":"2024-01-21T21:15:17.227482+0000","last_unstale":"2024-01-21T21:15:17.231087+0000","last_undegraded":"2024-01-21T21:15:17.231087+0000","last_fullsized":"2024-01-21T21:15:17.231087+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610764+0000","last_change":"2024-01-21T21:15:17.610764+0000","last_active":"2024-01-21T21:15:17.610764+0000","last_peered":"2024-01-21T21:15:17.610764+0000","last_clean":"2024-01-21T21:15:17.610764+0000","last_became_active":"2024-01-21T21:15:17.610478+0000","last_became_peered":"2024-01-21T21:15:17.610478+0000","last_unstale":"2024-01-21T21:15:17.610764+0000","last_undegraded":"2024-01-21T21:15:17.610764+0000","last_fullsized":"2024-01-21T21:15:17.610764+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242263+0000","last_change":"2024-01-21T21:15:17.227486+0000","last_active":"2024-01-21T21:15:17.242263+0000","last_peered":"2024-01-21T21:15:17.242263+0000","last_clean":"2024-01-21T21:15:17.242263+0000","last_became_active":"2024-01-21T21:15:17.224860+0000","last_became_peered":"2024-01-21T21:15:17.224860+0000","last_unstale":"2024-01-21T21:15:17.242263+0000","last_undegraded":"2024-01-21T21:15:17.242263+0000","last_fullsized":"2024-01-21T21:15:17.242263+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611670+0000","last_change":"2024-01-21T21:15:17.611670+0000","last_active":"2024-01-21T21:15:17.611670+0000","last_peered":"2024-01-21T21:15:17.611670+0000","last_clean":"2024-01-21T21:15:17.611670+0000","last_became_active":"2024-01-21T21:15:17.611080+0000","last_became_peered":"2024-01-21T21:15:17.611080+0000","last_unstale":"2024-01-21T21:15:17.611670+0000","last_undegraded":"2024-01-21T21:15:17.611670+0000","last_fullsized":"2024-01-21T21:15:17.611670+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.236257+0000","last_change":"2024-01-21T21:15:17.225017+0000","last_active":"2024-01-21T21:15:17.236257+0000","last_peered":"2024-01-21T21:15:17.236257+0000","last_clean":"2024-01-21T21:15:17.236257+0000","last_became_active":"2024-01-21T21:15:17.224748+0000","last_became_peered":"2024-01-21T21:15:17.224748+0000","last_unstale":"2024-01-21T21:15:17.236257+0000","last_undegraded":"2024-01-21T21:15:17.236257+0000","last_fullsized":"2024-01-21T21:15:17.236257+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612926+0000","last_change":"2024-01-21T21:15:17.612926+0000","last_active":"2024-01-21T21:15:17.612926+0000","last_peered":"2024-01-21T21:15:17.612926+0000","last_clean":"2024-01-21T21:15:17.612926+0000","last_became_active":"2024-01-21T21:15:17.612017+0000","last_became_peered":"2024-01-21T21:15:17.612017+0000","last_unstale":"2024-01-21T21:15:17.612926+0000","last_undegraded":"2024-01-21T21:15:17.612926+0000","last_fullsized":"2024-01-21T21:15:17.612926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.238286+0000","last_change":"2024-01-21T21:15:17.234446+0000","last_active":"2024-01-21T21:15:17.238286+0000","last_peered":"2024-01-21T21:15:17.238286+0000","last_clean":"2024-01-21T21:15:17.238286+0000","last_became_active":"2024-01-21T21:15:17.234075+0000","last_became_peered":"2024-01-21T21:15:17.234075+0000","last_unstale":"2024-01-21T21:15:17.238286+0000","last_undegraded":"2024-01-21T21:15:17.238286+0000","last_fullsized":"2024-01-21T21:15:17.238286+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601912+0000","last_change":"2024-01-21T21:15:17.601912+0000","last_active":"2024-01-21T21:15:17.601912+0000","last_peered":"2024-01-21T21:15:17.601912+0000","last_clean":"2024-01-21T21:15:17.601912+0000","last_became_active":"2024-01-21T21:15:17.601648+0000","last_became_peered":"2024-01-21T21:15:17.601648+0000","last_unstale":"2024-01-21T21:15:17.601912+0000","last_undegraded":"2024-01-21T21:15:17.601912+0000","last_fullsized":"2024-01-21T21:15:17.601912+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242290+0000","last_change":"2024-01-21T21:15:17.228209+0000","last_active":"2024-01-21T21:15:17.242290+0000","last_peered":"2024-01-21T21:15:17.242290+0000","last_clean":"2024-01-21T21:15:17.242290+0000","last_became_active":"2024-01-21T21:15:17.227939+0000","last_became_peered":"2024-01-21T21:15:17.227939+0000","last_unstale":"2024-01-21T21:15:17.242290+0000","last_undegraded":"2024-01-21T21:15:17.242290+0000","last_fullsized":"2024-01-21T21:15:17.242290+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606374+0000","last_change":"2024-01-21T21:15:17.606374+0000","last_active":"2024-01-21T21:15:17.606374+0000","last_peered":"2024-01-21T21:15:17.606374+0000","last_clean":"2024-01-21T21:15:17.606374+0000","last_became_active":"2024-01-21T21:15:17.606090+0000","last_became_peered":"2024-01-21T21:15:17.606090+0000","last_unstale":"2024-01-21T21:15:17.606374+0000","last_undegraded":"2024-01-21T21:15:17.606374+0000","last_fullsized":"2024-01-21T21:15:17.606374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.34","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610185+0000","last_change":"2024-01-21T21:15:17.235000+0000","last_active":"2024-01-21T21:15:17.610185+0000","last_peered":"2024-01-21T21:15:17.610185+0000","last_clean":"2024-01-21T21:15:17.610185+0000","last_became_active":"2024-01-21T21:15:17.234726+0000","last_became_peered":"2024-01-21T21:15:17.234726+0000","last_unstale":"2024-01-21T21:15:17.610185+0000","last_undegraded":"2024-01-21T21:15:17.610185+0000","last_fullsized":"2024-01-21T21:15:17.610185+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604432+0000","last_change":"2024-01-21T21:15:17.604432+0000","last_active":"2024-01-21T21:15:17.604432+0000","last_peered":"2024-01-21T21:15:17.604432+0000","last_clean":"2024-01-21T21:15:17.604432+0000","last_became_active":"2024-01-21T21:15:17.604078+0000","last_became_peered":"2024-01-21T21:15:17.604078+0000","last_unstale":"2024-01-21T21:15:17.604432+0000","last_undegraded":"2024-01-21T21:15:17.604432+0000","last_fullsized":"2024-01-21T21:15:17.604432+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.33","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.588945+0000","last_change":"2024-01-21T21:15:17.230413+0000","last_active":"2024-01-21T21:15:17.588945+0000","last_peered":"2024-01-21T21:15:17.588945+0000","last_clean":"2024-01-21T21:15:17.588945+0000","last_became_active":"2024-01-21T21:15:17.229950+0000","last_became_peered":"2024-01-21T21:15:17.229950+0000","last_unstale":"2024-01-21T21:15:17.588945+0000","last_undegraded":"2024-01-21T21:15:17.588945+0000","last_fullsized":"2024-01-21T21:15:17.588945+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614676+0000","last_change":"2024-01-21T21:15:17.614676+0000","last_active":"2024-01-21T21:15:17.614676+0000","last_peered":"2024-01-21T21:15:17.614676+0000","last_clean":"2024-01-21T21:15:17.614676+0000","last_became_active":"2024-01-21T21:15:17.614351+0000","last_became_peered":"2024-01-21T21:15:17.614351+0000","last_unstale":"2024-01-21T21:15:17.614676+0000","last_undegraded":"2024-01-21T21:15:17.614676+0000","last_fullsized":"2024-01-21T21:15:17.614676+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233045+0000","last_change":"2024-01-21T21:15:17.230421+0000","last_active":"2024-01-21T21:15:17.233045+0000","last_peered":"2024-01-21T21:15:17.233045+0000","last_clean":"2024-01-21T21:15:17.233045+0000","last_became_active":"2024-01-21T21:15:17.230046+0000","last_became_peered":"2024-01-21T21:15:17.230046+0000","last_unstale":"2024-01-21T21:15:17.233045+0000","last_undegraded":"2024-01-21T21:15:17.233045+0000","last_fullsized":"2024-01-21T21:15:17.233045+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611705+0000","last_change":"2024-01-21T21:15:17.611705+0000","last_active":"2024-01-21T21:15:17.611705+0000","last_peered":"2024-01-21T21:15:17.611705+0000","last_clean":"2024-01-21T21:15:17.611705+0000","last_became_active":"2024-01-21T21:15:17.611241+0000","last_became_peered":"2024-01-21T21:15:17.611241+0000","last_unstale":"2024-01-21T21:15:17.611705+0000","last_undegraded":"2024-01-21T21:15:17.611705+0000","last_fullsized":"2024-01-21T21:15:17.611705+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240090+0000","last_change":"2024-01-21T21:15:17.239084+0000","last_active":"2024-01-21T21:15:17.240090+0000","last_peered":"2024-01-21T21:15:17.240090+0000","last_clean":"2024-01-21T21:15:17.240090+0000","last_became_active":"2024-01-21T21:15:17.238802+0000","last_became_peered":"2024-01-21T21:15:17.238802+0000","last_unstale":"2024-01-21T21:15:17.240090+0000","last_undegraded":"2024-01-21T21:15:17.240090+0000","last_fullsized":"2024-01-21T21:15:17.240090+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605955+0000","last_change":"2024-01-21T21:15:17.605955+0000","last_active":"2024-01-21T21:15:17.605955+0000","last_peered":"2024-01-21T21:15:17.605955+0000","last_clean":"2024-01-21T21:15:17.605955+0000","last_became_active":"2024-01-21T21:15:17.605704+0000","last_became_peered":"2024-01-21T21:15:17.605704+0000","last_unstale":"2024-01-21T21:15:17.605955+0000","last_undegraded":"2024-01-21T21:15:17.605955+0000","last_fullsized":"2024-01-21T21:15:17.605955+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.30","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610495+0000","last_change":"2024-01-21T21:15:17.226381+0000","last_active":"2024-01-21T21:15:17.610495+0000","last_peered":"2024-01-21T21:15:17.610495+0000","last_clean":"2024-01-21T21:15:17.610495+0000","last_became_active":"2024-01-21T21:15:17.226092+0000","last_became_peered":"2024-01-21T21:15:17.226092+0000","last_unstale":"2024-01-21T21:15:17.610495+0000","last_undegraded":"2024-01-21T21:15:17.610495+0000","last_fullsized":"2024-01-21T21:15:17.610495+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.599642+0000","last_change":"2024-01-21T21:15:17.599642+0000","last_active":"2024-01-21T21:15:17.599642+0000","last_peered":"2024-01-21T21:15:17.599642+0000","last_clean":"2024-01-21T21:15:17.599642+0000","last_became_active":"2024-01-21T21:15:17.597900+0000","last_became_peered":"2024-01-21T21:15:17.597900+0000","last_unstale":"2024-01-21T21:15:17.599642+0000","last_undegraded":"2024-01-21T21:15:17.599642+0000","last_fullsized":"2024-01-21T21:15:17.599642+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239504+0000","last_change":"2024-01-21T21:15:17.238258+0000","last_active":"2024-01-21T21:15:17.239504+0000","last_peered":"2024-01-21T21:15:17.239504+0000","last_clean":"2024-01-21T21:15:17.239504+0000","last_became_active":"2024-01-21T21:15:17.237609+0000","last_became_peered":"2024-01-21T21:15:17.237609+0000","last_unstale":"2024-01-21T21:15:17.239504+0000","last_undegraded":"2024-01-21T21:15:17.239504+0000","last_fullsized":"2024-01-21T21:15:17.239504+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607977+0000","last_change":"2024-01-21T21:15:17.607977+0000","last_active":"2024-01-21T21:15:17.607977+0000","last_peered":"2024-01-21T21:15:17.607977+0000","last_clean":"2024-01-21T21:15:17.607977+0000","last_became_active":"2024-01-21T21:15:17.607675+0000","last_became_peered":"2024-01-21T21:15:17.607675+0000","last_unstale":"2024-01-21T21:15:17.607977+0000","last_undegraded":"2024-01-21T21:15:17.607977+0000","last_fullsized":"2024-01-21T21:15:17.607977+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239477+0000","last_change":"2024-01-21T21:15:17.236527+0000","last_active":"2024-01-21T21:15:17.239477+0000","last_peered":"2024-01-21T21:15:17.239477+0000","last_clean":"2024-01-21T21:15:17.239477+0000","last_became_active":"2024-01-21T21:15:17.236272+0000","last_became_peered":"2024-01-21T21:15:17.236272+0000","last_unstale":"2024-01-21T21:15:17.239477+0000","last_undegraded":"2024-01-21T21:15:17.239477+0000","last_fullsized":"2024-01-21T21:15:17.239477+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611118+0000","last_change":"2024-01-21T21:15:17.611118+0000","last_active":"2024-01-21T21:15:17.611118+0000","last_peered":"2024-01-21T21:15:17.611118+0000","last_clean":"2024-01-21T21:15:17.611118+0000","last_became_active":"2024-01-21T21:15:17.610584+0000","last_became_peered":"2024-01-21T21:15:17.610584+0000","last_unstale":"2024-01-21T21:15:17.611118+0000","last_undegraded":"2024-01-21T21:15:17.611118+0000","last_fullsized":"2024-01-21T21:15:17.611118+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2d","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.589214+0000","last_change":"2024-01-21T21:15:17.234928+0000","last_active":"2024-01-21T21:15:17.589214+0000","last_peered":"2024-01-21T21:15:17.589214+0000","last_clean":"2024-01-21T21:15:17.589214+0000","last_became_active":"2024-01-21T21:15:17.234699+0000","last_became_peered":"2024-01-21T21:15:17.234699+0000","last_unstale":"2024-01-21T21:15:17.589214+0000","last_undegraded":"2024-01-21T21:15:17.589214+0000","last_fullsized":"2024-01-21T21:15:17.589214+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611698+0000","last_change":"2024-01-21T21:15:17.611698+0000","last_active":"2024-01-21T21:15:17.611698+0000","last_peered":"2024-01-21T21:15:17.611698+0000","last_clean":"2024-01-21T21:15:17.611698+0000","last_became_active":"2024-01-21T21:15:17.610948+0000","last_became_peered":"2024-01-21T21:15:17.610948+0000","last_unstale":"2024-01-21T21:15:17.611698+0000","last_undegraded":"2024-01-21T21:15:17.611698+0000","last_fullsized":"2024-01-21T21:15:17.611698+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234351+0000","last_change":"2024-01-21T21:15:17.225621+0000","last_active":"2024-01-21T21:15:17.234351+0000","last_peered":"2024-01-21T21:15:17.234351+0000","last_clean":"2024-01-21T21:15:17.234351+0000","last_became_active":"2024-01-21T21:15:17.225334+0000","last_became_peered":"2024-01-21T21:15:17.225334+0000","last_unstale":"2024-01-21T21:15:17.234351+0000","last_undegraded":"2024-01-21T21:15:17.234351+0000","last_fullsized":"2024-01-21T21:15:17.234351+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609747+0000","last_change":"2024-01-21T21:15:17.609747+0000","last_active":"2024-01-21T21:15:17.609747+0000","last_peered":"2024-01-21T21:15:17.609747+0000","last_clean":"2024-01-21T21:15:17.609747+0000","last_became_active":"2024-01-21T21:15:17.606665+0000","last_became_peered":"2024-01-21T21:15:17.606665+0000","last_unstale":"2024-01-21T21:15:17.609747+0000","last_undegraded":"2024-01-21T21:15:17.609747+0000","last_fullsized":"2024-01-21T21:15:17.609747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.593431+0000","last_change":"2024-01-21T21:15:17.234397+0000","last_active":"2024-01-21T21:15:17.593431+0000","last_peered":"2024-01-21T21:15:17.593431+0000","last_clean":"2024-01-21T21:15:17.593431+0000","last_became_active":"2024-01-21T21:15:17.234142+0000","last_became_peered":"2024-01-21T21:15:17.234142+0000","last_unstale":"2024-01-21T21:15:17.593431+0000","last_undegraded":"2024-01-21T21:15:17.593431+0000","last_fullsized":"2024-01-21T21:15:17.593431+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610645+0000","last_change":"2024-01-21T21:15:17.610645+0000","last_active":"2024-01-21T21:15:17.610645+0000","last_peered":"2024-01-21T21:15:17.610645+0000","last_clean":"2024-01-21T21:15:17.610645+0000","last_became_active":"2024-01-21T21:15:17.610385+0000","last_became_peered":"2024-01-21T21:15:17.610385+0000","last_unstale":"2024-01-21T21:15:17.610645+0000","last_undegraded":"2024-01-21T21:15:17.610645+0000","last_fullsized":"2024-01-21T21:15:17.610645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.226447+0000","last_change":"2024-01-21T21:15:17.225271+0000","last_active":"2024-01-21T21:15:17.226447+0000","last_peered":"2024-01-21T21:15:17.226447+0000","last_clean":"2024-01-21T21:15:17.226447+0000","last_became_active":"2024-01-21T21:15:17.224969+0000","last_became_peered":"2024-01-21T21:15:17.224969+0000","last_unstale":"2024-01-21T21:15:17.226447+0000","last_undegraded":"2024-01-21T21:15:17.226447+0000","last_fullsized":"2024-01-21T21:15:17.226447+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598623+0000","last_change":"2024-01-21T21:15:17.598623+0000","last_active":"2024-01-21T21:15:17.598623+0000","last_peered":"2024-01-21T21:15:17.598623+0000","last_clean":"2024-01-21T21:15:17.598623+0000","last_became_active":"2024-01-21T21:15:17.598337+0000","last_became_peered":"2024-01-21T21:15:17.598337+0000","last_unstale":"2024-01-21T21:15:17.598623+0000","last_undegraded":"2024-01-21T21:15:17.598623+0000","last_fullsized":"2024-01-21T21:15:17.598623+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233053+0000","last_change":"2024-01-21T21:15:17.230598+0000","last_active":"2024-01-21T21:15:17.233053+0000","last_peered":"2024-01-21T21:15:17.233053+0000","last_clean":"2024-01-21T21:15:17.233053+0000","last_became_active":"2024-01-21T21:15:17.230283+0000","last_became_peered":"2024-01-21T21:15:17.230283+0000","last_unstale":"2024-01-21T21:15:17.233053+0000","last_undegraded":"2024-01-21T21:15:17.233053+0000","last_fullsized":"2024-01-21T21:15:17.233053+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604191+0000","last_change":"2024-01-21T21:15:17.604191+0000","last_active":"2024-01-21T21:15:17.604191+0000","last_peered":"2024-01-21T21:15:17.604191+0000","last_clean":"2024-01-21T21:15:17.604191+0000","last_became_active":"2024-01-21T21:15:17.603584+0000","last_became_peered":"2024-01-21T21:15:17.603584+0000","last_unstale":"2024-01-21T21:15:17.604191+0000","last_undegraded":"2024-01-21T21:15:17.604191+0000","last_fullsized":"2024-01-21T21:15:17.604191+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.235687+0000","last_change":"2024-01-21T21:15:17.229510+0000","last_active":"2024-01-21T21:15:17.235687+0000","last_peered":"2024-01-21T21:15:17.235687+0000","last_clean":"2024-01-21T21:15:17.235687+0000","last_became_active":"2024-01-21T21:15:17.229048+0000","last_became_peered":"2024-01-21T21:15:17.229048+0000","last_unstale":"2024-01-21T21:15:17.235687+0000","last_undegraded":"2024-01-21T21:15:17.235687+0000","last_fullsized":"2024-01-21T21:15:17.235687+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605044+0000","last_change":"2024-01-21T21:15:17.605044+0000","last_active":"2024-01-21T21:15:17.605044+0000","last_peered":"2024-01-21T21:15:17.605044+0000","last_clean":"2024-01-21T21:15:17.605044+0000","last_became_active":"2024-01-21T21:15:17.604745+0000","last_became_peered":"2024-01-21T21:15:17.604745+0000","last_unstale":"2024-01-21T21:15:17.605044+0000","last_undegraded":"2024-01-21T21:15:17.605044+0000","last_fullsized":"2024-01-21T21:15:17.605044+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234505+0000","last_change":"2024-01-21T21:15:17.226316+0000","last_active":"2024-01-21T21:15:17.234505+0000","last_peered":"2024-01-21T21:15:17.234505+0000","last_clean":"2024-01-21T21:15:17.234505+0000","last_became_active":"2024-01-21T21:15:17.225963+0000","last_became_peered":"2024-01-21T21:15:17.225963+0000","last_unstale":"2024-01-21T21:15:17.234505+0000","last_undegraded":"2024-01-21T21:15:17.234505+0000","last_fullsized":"2024-01-21T21:15:17.234505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604014+0000","last_change":"2024-01-21T21:15:17.604014+0000","last_active":"2024-01-21T21:15:17.604014+0000","last_peered":"2024-01-21T21:15:17.604014+0000","last_clean":"2024-01-21T21:15:17.604014+0000","last_became_active":"2024-01-21T21:15:17.603730+0000","last_became_peered":"2024-01-21T21:15:17.603730+0000","last_unstale":"2024-01-21T21:15:17.604014+0000","last_undegraded":"2024-01-21T21:15:17.604014+0000","last_fullsized":"2024-01-21T21:15:17.604014+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242407+0000","last_change":"2024-01-21T21:15:17.231525+0000","last_active":"2024-01-21T21:15:17.242407+0000","last_peered":"2024-01-21T21:15:17.242407+0000","last_clean":"2024-01-21T21:15:17.242407+0000","last_became_active":"2024-01-21T21:15:17.231257+0000","last_became_peered":"2024-01-21T21:15:17.231257+0000","last_unstale":"2024-01-21T21:15:17.242407+0000","last_undegraded":"2024-01-21T21:15:17.242407+0000","last_fullsized":"2024-01-21T21:15:17.242407+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609809+0000","last_change":"2024-01-21T21:15:17.609809+0000","last_active":"2024-01-21T21:15:17.609809+0000","last_peered":"2024-01-21T21:15:17.609809+0000","last_clean":"2024-01-21T21:15:17.609809+0000","last_became_active":"2024-01-21T21:15:17.608561+0000","last_became_peered":"2024-01-21T21:15:17.608561+0000","last_unstale":"2024-01-21T21:15:17.609809+0000","last_undegraded":"2024-01-21T21:15:17.609809+0000","last_fullsized":"2024-01-21T21:15:17.609809+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.241888+0000","last_change":"2024-01-21T21:15:17.235378+0000","last_active":"2024-01-21T21:15:17.241888+0000","last_peered":"2024-01-21T21:15:17.241888+0000","last_clean":"2024-01-21T21:15:17.241888+0000","last_became_active":"2024-01-21T21:15:17.235123+0000","last_became_peered":"2024-01-21T21:15:17.235123+0000","last_unstale":"2024-01-21T21:15:17.241888+0000","last_undegraded":"2024-01-21T21:15:17.241888+0000","last_fullsized":"2024-01-21T21:15:17.241888+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601446+0000","last_change":"2024-01-21T21:15:17.601446+0000","last_active":"2024-01-21T21:15:17.601446+0000","last_peered":"2024-01-21T21:15:17.601446+0000","last_clean":"2024-01-21T21:15:17.601446+0000","last_became_active":"2024-01-21T21:15:17.601155+0000","last_became_peered":"2024-01-21T21:15:17.601155+0000","last_unstale":"2024-01-21T21:15:17.601446+0000","last_undegraded":"2024-01-21T21:15:17.601446+0000","last_fullsized":"2024-01-21T21:15:17.601446+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.244882+0000","last_change":"2024-01-21T21:15:17.240027+0000","last_active":"2024-01-21T21:15:17.244882+0000","last_peered":"2024-01-21T21:15:17.244882+0000","last_clean":"2024-01-21T21:15:17.244882+0000","last_became_active":"2024-01-21T21:15:17.239755+0000","last_became_peered":"2024-01-21T21:15:17.239755+0000","last_unstale":"2024-01-21T21:15:17.244882+0000","last_undegraded":"2024-01-21T21:15:17.244882+0000","last_fullsized":"2024-01-21T21:15:17.244882+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606743+0000","last_change":"2024-01-21T21:15:17.606743+0000","last_active":"2024-01-21T21:15:17.606743+0000","last_peered":"2024-01-21T21:15:17.606743+0000","last_clean":"2024-01-21T21:15:17.606743+0000","last_became_active":"2024-01-21T21:15:17.606411+0000","last_became_peered":"2024-01-21T21:15:17.606411+0000","last_unstale":"2024-01-21T21:15:17.606743+0000","last_undegraded":"2024-01-21T21:15:17.606743+0000","last_fullsized":"2024-01-21T21:15:17.606743+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242481+0000","last_change":"2024-01-21T21:15:17.238719+0000","last_active":"2024-01-21T21:15:17.242481+0000","last_peered":"2024-01-21T21:15:17.242481+0000","last_clean":"2024-01-21T21:15:17.242481+0000","last_became_active":"2024-01-21T21:15:17.238362+0000","last_became_peered":"2024-01-21T21:15:17.238362+0000","last_unstale":"2024-01-21T21:15:17.242481+0000","last_undegraded":"2024-01-21T21:15:17.242481+0000","last_fullsized":"2024-01-21T21:15:17.242481+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600292+0000","last_change":"2024-01-21T21:15:17.600292+0000","last_active":"2024-01-21T21:15:17.600292+0000","last_peered":"2024-01-21T21:15:17.600292+0000","last_clean":"2024-01-21T21:15:17.600292+0000","last_became_active":"2024-01-21T21:15:17.600025+0000","last_became_peered":"2024-01-21T21:15:17.600025+0000","last_unstale":"2024-01-21T21:15:17.600292+0000","last_undegraded":"2024-01-21T21:15:17.600292+0000","last_fullsized":"2024-01-21T21:15:17.600292+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240989+0000","last_change":"2024-01-21T21:15:17.240417+0000","last_active":"2024-01-21T21:15:17.240989+0000","last_peered":"2024-01-21T21:15:17.240989+0000","last_clean":"2024-01-21T21:15:17.240989+0000","last_became_active":"2024-01-21T21:15:17.240101+0000","last_became_peered":"2024-01-21T21:15:17.240101+0000","last_unstale":"2024-01-21T21:15:17.240989+0000","last_undegraded":"2024-01-21T21:15:17.240989+0000","last_fullsized":"2024-01-21T21:15:17.240989+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610655+0000","last_change":"2024-01-21T21:15:17.610655+0000","last_active":"2024-01-21T21:15:17.610655+0000","last_peered":"2024-01-21T21:15:17.610655+0000","last_clean":"2024-01-21T21:15:17.610655+0000","last_became_active":"2024-01-21T21:15:17.610377+0000","last_became_peered":"2024-01-21T21:15:17.610377+0000","last_unstale":"2024-01-21T21:15:17.610655+0000","last_undegraded":"2024-01-21T21:15:17.610655+0000","last_fullsized":"2024-01-21T21:15:17.610655+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239499+0000","last_change":"2024-01-21T21:15:17.236851+0000","last_active":"2024-01-21T21:15:17.239499+0000","last_peered":"2024-01-21T21:15:17.239499+0000","last_clean":"2024-01-21T21:15:17.239499+0000","last_became_active":"2024-01-21T21:15:17.236574+0000","last_became_peered":"2024-01-21T21:15:17.236574+0000","last_unstale":"2024-01-21T21:15:17.239499+0000","last_undegraded":"2024-01-21T21:15:17.239499+0000","last_fullsized":"2024-01-21T21:15:17.239499+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604519+0000","last_change":"2024-01-21T21:15:17.604519+0000","last_active":"2024-01-21T21:15:17.604519+0000","last_peered":"2024-01-21T21:15:17.604519+0000","last_clean":"2024-01-21T21:15:17.604519+0000","last_became_active":"2024-01-21T21:15:17.604250+0000","last_became_peered":"2024-01-21T21:15:17.604250+0000","last_unstale":"2024-01-21T21:15:17.604519+0000","last_undegraded":"2024-01-21T21:15:17.604519+0000","last_fullsized":"2024-01-21T21:15:17.604519+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.230775+0000","last_change":"2024-01-21T21:15:17.222522+0000","last_active":"2024-01-21T21:15:17.230775+0000","last_peered":"2024-01-21T21:15:17.230775+0000","last_clean":"2024-01-21T21:15:17.230775+0000","last_became_active":"2024-01-21T21:15:17.222257+0000","last_became_peered":"2024-01-21T21:15:17.222257+0000","last_unstale":"2024-01-21T21:15:17.230775+0000","last_undegraded":"2024-01-21T21:15:17.230775+0000","last_fullsized":"2024-01-21T21:15:17.230775+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597343+0000","last_change":"2024-01-21T21:15:17.597343+0000","last_active":"2024-01-21T21:15:17.597343+0000","last_peered":"2024-01-21T21:15:17.597343+0000","last_clean":"2024-01-21T21:15:17.597343+0000","last_became_active":"2024-01-21T21:15:17.597099+0000","last_became_peered":"2024-01-21T21:15:17.597099+0000","last_unstale":"2024-01-21T21:15:17.597343+0000","last_undegraded":"2024-01-21T21:15:17.597343+0000","last_fullsized":"2024-01-21T21:15:17.597343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598964+0000","last_change":"2024-01-21T21:15:17.236722+0000","last_active":"2024-01-21T21:15:17.598964+0000","last_peered":"2024-01-21T21:15:17.598964+0000","last_clean":"2024-01-21T21:15:17.598964+0000","last_became_active":"2024-01-21T21:15:17.236058+0000","last_became_peered":"2024-01-21T21:15:17.236058+0000","last_unstale":"2024-01-21T21:15:17.598964+0000","last_undegraded":"2024-01-21T21:15:17.598964+0000","last_fullsized":"2024-01-21T21:15:17.598964+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612410+0000","last_change":"2024-01-21T21:15:17.612410+0000","last_active":"2024-01-21T21:15:17.612410+0000","last_peered":"2024-01-21T21:15:17.612410+0000","last_clean":"2024-01-21T21:15:17.612410+0000","last_became_active":"2024-01-21T21:15:17.612011+0000","last_became_peered":"2024-01-21T21:15:17.612011+0000","last_unstale":"2024-01-21T21:15:17.612410+0000","last_undegraded":"2024-01-21T21:15:17.612410+0000","last_fullsized":"2024-01-21T21:15:17.612410+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.595182+0000","last_change":"2024-01-21T21:15:17.235349+0000","last_active":"2024-01-21T21:15:17.595182+0000","last_peered":"2024-01-21T21:15:17.595182+0000","last_clean":"2024-01-21T21:15:17.595182+0000","last_became_active":"2024-01-21T21:15:17.234961+0000","last_became_peered":"2024-01-21T21:15:17.234961+0000","last_unstale":"2024-01-21T21:15:17.595182+0000","last_undegraded":"2024-01-21T21:15:17.595182+0000","last_fullsized":"2024-01-21T21:15:17.595182+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612894+0000","last_change":"2024-01-21T21:15:17.612894+0000","last_active":"2024-01-21T21:15:17.612894+0000","last_peered":"2024-01-21T21:15:17.612894+0000","last_clean":"2024-01-21T21:15:17.612894+0000","last_became_active":"2024-01-21T21:15:17.612602+0000","last_became_peered":"2024-01-21T21:15:17.612602+0000","last_unstale":"2024-01-21T21:15:17.612894+0000","last_undegraded":"2024-01-21T21:15:17.612894+0000","last_fullsized":"2024-01-21T21:15:17.612894+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610251+0000","last_change":"2024-01-21T21:15:17.234426+0000","last_active":"2024-01-21T21:15:17.610251+0000","last_peered":"2024-01-21T21:15:17.610251+0000","last_clean":"2024-01-21T21:15:17.610251+0000","last_became_active":"2024-01-21T21:15:17.234094+0000","last_became_peered":"2024-01-21T21:15:17.234094+0000","last_unstale":"2024-01-21T21:15:17.610251+0000","last_undegraded":"2024-01-21T21:15:17.610251+0000","last_fullsized":"2024-01-21T21:15:17.610251+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610643+0000","last_change":"2024-01-21T21:15:17.610643+0000","last_active":"2024-01-21T21:15:17.610643+0000","last_peered":"2024-01-21T21:15:17.610643+0000","last_clean":"2024-01-21T21:15:17.610643+0000","last_became_active":"2024-01-21T21:15:17.610342+0000","last_became_peered":"2024-01-21T21:15:17.610342+0000","last_unstale":"2024-01-21T21:15:17.610643+0000","last_undegraded":"2024-01-21T21:15:17.610643+0000","last_fullsized":"2024-01-21T21:15:17.610643+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239199+0000","last_change":"2024-01-21T21:15:17.225866+0000","last_active":"2024-01-21T21:15:17.239199+0000","last_peered":"2024-01-21T21:15:17.239199+0000","last_clean":"2024-01-21T21:15:17.239199+0000","last_became_active":"2024-01-21T21:15:17.225573+0000","last_became_peered":"2024-01-21T21:15:17.225573+0000","last_unstale":"2024-01-21T21:15:17.239199+0000","last_undegraded":"2024-01-21T21:15:17.239199+0000","last_fullsized":"2024-01-21T21:15:17.239199+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607483+0000","last_change":"2024-01-21T21:15:17.607483+0000","last_active":"2024-01-21T21:15:17.607483+0000","last_peered":"2024-01-21T21:15:17.607483+0000","last_clean":"2024-01-21T21:15:17.607483+0000","last_became_active":"2024-01-21T21:15:17.607202+0000","last_became_peered":"2024-01-21T21:15:17.607202+0000","last_unstale":"2024-01-21T21:15:17.607483+0000","last_undegraded":"2024-01-21T21:15:17.607483+0000","last_fullsized":"2024-01-21T21:15:17.607483+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239265+0000","last_change":"2024-01-21T21:15:17.236658+0000","last_active":"2024-01-21T21:15:17.239265+0000","last_peered":"2024-01-21T21:15:17.239265+0000","last_clean":"2024-01-21T21:15:17.239265+0000","last_became_active":"2024-01-21T21:15:17.236374+0000","last_became_peered":"2024-01-21T21:15:17.236374+0000","last_unstale":"2024-01-21T21:15:17.239265+0000","last_undegraded":"2024-01-21T21:15:17.239265+0000","last_fullsized":"2024-01-21T21:15:17.239265+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612429+0000","last_change":"2024-01-21T21:15:17.612429+0000","last_active":"2024-01-21T21:15:17.612429+0000","last_peered":"2024-01-21T21:15:17.612429+0000","last_clean":"2024-01-21T21:15:17.612429+0000","last_became_active":"2024-01-21T21:15:17.612189+0000","last_became_peered":"2024-01-21T21:15:17.612189+0000","last_unstale":"2024-01-21T21:15:17.612429+0000","last_undegraded":"2024-01-21T21:15:17.612429+0000","last_fullsized":"2024-01-21T21:15:17.612429+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239462+0000","last_change":"2024-01-21T21:15:17.236781+0000","last_active":"2024-01-21T21:15:17.239462+0000","last_peered":"2024-01-21T21:15:17.239462+0000","last_clean":"2024-01-21T21:15:17.239462+0000","last_became_active":"2024-01-21T21:15:17.236469+0000","last_became_peered":"2024-01-21T21:15:17.236469+0000","last_unstale":"2024-01-21T21:15:17.239462+0000","last_undegraded":"2024-01-21T21:15:17.239462+0000","last_fullsized":"2024-01-21T21:15:17.239462+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602045+0000","last_change":"2024-01-21T21:15:17.602045+0000","last_active":"2024-01-21T21:15:17.602045+0000","last_peered":"2024-01-21T21:15:17.602045+0000","last_clean":"2024-01-21T21:15:17.602045+0000","last_became_active":"2024-01-21T21:15:17.601789+0000","last_became_peered":"2024-01-21T21:15:17.601789+0000","last_unstale":"2024-01-21T21:15:17.602045+0000","last_undegraded":"2024-01-21T21:15:17.602045+0000","last_fullsized":"2024-01-21T21:15:17.602045+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225146+0000","last_change":"2024-01-21T21:15:17.224503+0000","last_active":"2024-01-21T21:15:17.225146+0000","last_peered":"2024-01-21T21:15:17.225146+0000","last_clean":"2024-01-21T21:15:17.225146+0000","last_became_active":"2024-01-21T21:15:17.224234+0000","last_became_peered":"2024-01-21T21:15:17.224234+0000","last_unstale":"2024-01-21T21:15:17.225146+0000","last_undegraded":"2024-01-21T21:15:17.225146+0000","last_fullsized":"2024-01-21T21:15:17.225146+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.609034+0000","last_change":"2024-01-21T21:15:17.609034+0000","last_active":"2024-01-21T21:15:17.609034+0000","last_peered":"2024-01-21T21:15:17.609034+0000","last_clean":"2024-01-21T21:15:17.609034+0000","last_became_active":"2024-01-21T21:15:17.608727+0000","last_became_peered":"2024-01-21T21:15:17.608727+0000","last_unstale":"2024-01-21T21:15:17.609034+0000","last_undegraded":"2024-01-21T21:15:17.609034+0000","last_fullsized":"2024-01-21T21:15:17.609034+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.222397+0000","last_change":"2024-01-21T21:15:17.216678+0000","last_active":"2024-01-21T21:15:17.222397+0000","last_peered":"2024-01-21T21:15:17.222397+0000","last_clean":"2024-01-21T21:15:17.222397+0000","last_became_active":"2024-01-21T21:15:17.216390+0000","last_became_peered":"2024-01-21T21:15:17.216390+0000","last_unstale":"2024-01-21T21:15:17.222397+0000","last_undegraded":"2024-01-21T21:15:17.222397+0000","last_fullsized":"2024-01-21T21:15:17.222397+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602691+0000","last_change":"2024-01-21T21:15:17.602691+0000","last_active":"2024-01-21T21:15:17.602691+0000","last_peered":"2024-01-21T21:15:17.602691+0000","last_clean":"2024-01-21T21:15:17.602691+0000","last_became_active":"2024-01-21T21:15:17.602410+0000","last_became_peered":"2024-01-21T21:15:17.602410+0000","last_unstale":"2024-01-21T21:15:17.602691+0000","last_undegraded":"2024-01-21T21:15:17.602691+0000","last_fullsized":"2024-01-21T21:15:17.602691+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.601167+0000","last_change":"2024-01-21T21:15:17.230434+0000","last_active":"2024-01-21T21:15:17.601167+0000","last_peered":"2024-01-21T21:15:17.601167+0000","last_clean":"2024-01-21T21:15:17.601167+0000","last_became_active":"2024-01-21T21:15:17.230141+0000","last_became_peered":"2024-01-21T21:15:17.230141+0000","last_unstale":"2024-01-21T21:15:17.601167+0000","last_undegraded":"2024-01-21T21:15:17.601167+0000","last_fullsized":"2024-01-21T21:15:17.601167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.608022+0000","last_change":"2024-01-21T21:15:17.608022+0000","last_active":"2024-01-21T21:15:17.608022+0000","last_peered":"2024-01-21T21:15:17.608022+0000","last_clean":"2024-01-21T21:15:17.608022+0000","last_became_active":"2024-01-21T21:15:17.607674+0000","last_became_peered":"2024-01-21T21:15:17.607674+0000","last_unstale":"2024-01-21T21:15:17.608022+0000","last_undegraded":"2024-01-21T21:15:17.608022+0000","last_fullsized":"2024-01-21T21:15:17.608022+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.607088+0000","last_change":"2024-01-21T21:15:17.242925+0000","last_active":"2024-01-21T21:15:17.607088+0000","last_peered":"2024-01-21T21:15:17.607088+0000","last_clean":"2024-01-21T21:15:17.607088+0000","last_became_active":"2024-01-21T21:15:17.242635+0000","last_became_peered":"2024-01-21T21:15:17.242635+0000","last_unstale":"2024-01-21T21:15:17.607088+0000","last_undegraded":"2024-01-21T21:15:17.607088+0000","last_fullsized":"2024-01-21T21:15:17.607088+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.597750+0000","last_change":"2024-01-21T21:15:17.597750+0000","last_active":"2024-01-21T21:15:17.597750+0000","last_peered":"2024-01-21T21:15:17.597750+0000","last_clean":"2024-01-21T21:15:17.597750+0000","last_became_active":"2024-01-21T21:15:17.597460+0000","last_became_peered":"2024-01-21T21:15:17.597460+0000","last_unstale":"2024-01-21T21:15:17.597750+0000","last_undegraded":"2024-01-21T21:15:17.597750+0000","last_fullsized":"2024-01-21T21:15:17.597750+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242462+0000","last_change":"2024-01-21T21:15:17.238562+0000","last_active":"2024-01-21T21:15:17.242462+0000","last_peered":"2024-01-21T21:15:17.242462+0000","last_clean":"2024-01-21T21:15:17.242462+0000","last_became_active":"2024-01-21T21:15:17.238324+0000","last_became_peered":"2024-01-21T21:15:17.238324+0000","last_unstale":"2024-01-21T21:15:17.242462+0000","last_undegraded":"2024-01-21T21:15:17.242462+0000","last_fullsized":"2024-01-21T21:15:17.242462+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.613259+0000","last_change":"2024-01-21T21:15:17.613259+0000","last_active":"2024-01-21T21:15:17.613259+0000","last_peered":"2024-01-21T21:15:17.613259+0000","last_clean":"2024-01-21T21:15:17.613259+0000","last_became_active":"2024-01-21T21:15:17.612962+0000","last_became_peered":"2024-01-21T21:15:17.612962+0000","last_unstale":"2024-01-21T21:15:17.613259+0000","last_undegraded":"2024-01-21T21:15:17.613259+0000","last_fullsized":"2024-01-21T21:15:17.613259+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239092+0000","last_change":"2024-01-21T21:15:17.230478+0000","last_active":"2024-01-21T21:15:17.239092+0000","last_peered":"2024-01-21T21:15:17.239092+0000","last_clean":"2024-01-21T21:15:17.239092+0000","last_became_active":"2024-01-21T21:15:17.230192+0000","last_became_peered":"2024-01-21T21:15:17.230192+0000","last_unstale":"2024-01-21T21:15:17.239092+0000","last_undegraded":"2024-01-21T21:15:17.239092+0000","last_fullsized":"2024-01-21T21:15:17.239092+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606036+0000","last_change":"2024-01-21T21:15:17.606036+0000","last_active":"2024-01-21T21:15:17.606036+0000","last_peered":"2024-01-21T21:15:17.606036+0000","last_clean":"2024-01-21T21:15:17.606036+0000","last_became_active":"2024-01-21T21:15:17.605729+0000","last_became_peered":"2024-01-21T21:15:17.605729+0000","last_unstale":"2024-01-21T21:15:17.606036+0000","last_undegraded":"2024-01-21T21:15:17.606036+0000","last_fullsized":"2024-01-21T21:15:17.606036+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.586917+0000","last_change":"2024-01-21T21:15:17.227441+0000","last_active":"2024-01-21T21:15:17.586917+0000","last_peered":"2024-01-21T21:15:17.586917+0000","last_clean":"2024-01-21T21:15:17.586917+0000","last_became_active":"2024-01-21T21:15:17.227177+0000","last_became_peered":"2024-01-21T21:15:17.227177+0000","last_unstale":"2024-01-21T21:15:17.586917+0000","last_undegraded":"2024-01-21T21:15:17.586917+0000","last_fullsized":"2024-01-21T21:15:17.586917+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.593197+0000","last_change":"2024-01-21T21:15:17.593197+0000","last_active":"2024-01-21T21:15:17.593197+0000","last_peered":"2024-01-21T21:15:17.593197+0000","last_clean":"2024-01-21T21:15:17.593197+0000","last_became_active":"2024-01-21T21:15:17.592902+0000","last_became_peered":"2024-01-21T21:15:17.592902+0000","last_unstale":"2024-01-21T21:15:17.593197+0000","last_undegraded":"2024-01-21T21:15:17.593197+0000","last_fullsized":"2024-01-21T21:15:17.593197+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.240803+0000","last_change":"2024-01-21T21:15:17.240106+0000","last_active":"2024-01-21T21:15:17.240803+0000","last_peered":"2024-01-21T21:15:17.240803+0000","last_clean":"2024-01-21T21:15:17.240803+0000","last_became_active":"2024-01-21T21:15:17.239693+0000","last_became_peered":"2024-01-21T21:15:17.239693+0000","last_unstale":"2024-01-21T21:15:17.240803+0000","last_undegraded":"2024-01-21T21:15:17.240803+0000","last_fullsized":"2024-01-21T21:15:17.240803+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.606060+0000","last_change":"2024-01-21T21:15:17.606060+0000","last_active":"2024-01-21T21:15:17.606060+0000","last_peered":"2024-01-21T21:15:17.606060+0000","last_clean":"2024-01-21T21:15:17.606060+0000","last_became_active":"2024-01-21T21:15:17.605726+0000","last_became_peered":"2024-01-21T21:15:17.605726+0000","last_unstale":"2024-01-21T21:15:17.606060+0000","last_undegraded":"2024-01-21T21:15:17.606060+0000","last_fullsized":"2024-01-21T21:15:17.606060+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.231068+0000","last_change":"2024-01-21T21:15:17.227487+0000","last_active":"2024-01-21T21:15:17.231068+0000","last_peered":"2024-01-21T21:15:17.231068+0000","last_clean":"2024-01-21T21:15:17.231068+0000","last_became_active":"2024-01-21T21:15:17.226949+0000","last_became_peered":"2024-01-21T21:15:17.226949+0000","last_unstale":"2024-01-21T21:15:17.231068+0000","last_undegraded":"2024-01-21T21:15:17.231068+0000","last_fullsized":"2024-01-21T21:15:17.231068+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611954+0000","last_change":"2024-01-21T21:15:17.611954+0000","last_active":"2024-01-21T21:15:17.611954+0000","last_peered":"2024-01-21T21:15:17.611954+0000","last_clean":"2024-01-21T21:15:17.611954+0000","last_became_active":"2024-01-21T21:15:17.611632+0000","last_became_peered":"2024-01-21T21:15:17.611632+0000","last_unstale":"2024-01-21T21:15:17.611954+0000","last_undegraded":"2024-01-21T21:15:17.611954+0000","last_fullsized":"2024-01-21T21:15:17.611954+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.233003+0000","last_change":"2024-01-21T21:15:17.229614+0000","last_active":"2024-01-21T21:15:17.233003+0000","last_peered":"2024-01-21T21:15:17.233003+0000","last_clean":"2024-01-21T21:15:17.233003+0000","last_became_active":"2024-01-21T21:15:17.229021+0000","last_became_peered":"2024-01-21T21:15:17.229021+0000","last_unstale":"2024-01-21T21:15:17.233003+0000","last_undegraded":"2024-01-21T21:15:17.233003+0000","last_fullsized":"2024-01-21T21:15:17.233003+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611139+0000","last_change":"2024-01-21T21:15:17.611139+0000","last_active":"2024-01-21T21:15:17.611139+0000","last_peered":"2024-01-21T21:15:17.611139+0000","last_clean":"2024-01-21T21:15:17.611139+0000","last_became_active":"2024-01-21T21:15:17.610867+0000","last_became_peered":"2024-01-21T21:15:17.610867+0000","last_unstale":"2024-01-21T21:15:17.611139+0000","last_undegraded":"2024-01-21T21:15:17.611139+0000","last_fullsized":"2024-01-21T21:15:17.611139+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.615261+0000","last_change":"2024-01-21T21:15:17.231017+0000","last_active":"2024-01-21T21:15:17.615261+0000","last_peered":"2024-01-21T21:15:17.615261+0000","last_clean":"2024-01-21T21:15:17.615261+0000","last_became_active":"2024-01-21T21:15:17.230744+0000","last_became_peered":"2024-01-21T21:15:17.230744+0000","last_unstale":"2024-01-21T21:15:17.615261+0000","last_undegraded":"2024-01-21T21:15:17.615261+0000","last_fullsized":"2024-01-21T21:15:17.615261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.611508+0000","last_change":"2024-01-21T21:15:17.611508+0000","last_active":"2024-01-21T21:15:17.611508+0000","last_peered":"2024-01-21T21:15:17.611508+0000","last_clean":"2024-01-21T21:15:17.611508+0000","last_became_active":"2024-01-21T21:15:17.611092+0000","last_became_peered":"2024-01-21T21:15:17.611092+0000","last_unstale":"2024-01-21T21:15:17.611508+0000","last_undegraded":"2024-01-21T21:15:17.611508+0000","last_fullsized":"2024-01-21T21:15:17.611508+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.232884+0000","last_change":"2024-01-21T21:15:17.231350+0000","last_active":"2024-01-21T21:15:17.232884+0000","last_peered":"2024-01-21T21:15:17.232884+0000","last_clean":"2024-01-21T21:15:17.232884+0000","last_became_active":"2024-01-21T21:15:17.230584+0000","last_became_peered":"2024-01-21T21:15:17.230584+0000","last_unstale":"2024-01-21T21:15:17.232884+0000","last_undegraded":"2024-01-21T21:15:17.232884+0000","last_fullsized":"2024-01-21T21:15:17.232884+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602755+0000","last_change":"2024-01-21T21:15:17.602755+0000","last_active":"2024-01-21T21:15:17.602755+0000","last_peered":"2024-01-21T21:15:17.602755+0000","last_clean":"2024-01-21T21:15:17.602755+0000","last_became_active":"2024-01-21T21:15:17.602469+0000","last_became_peered":"2024-01-21T21:15:17.602469+0000","last_unstale":"2024-01-21T21:15:17.602755+0000","last_undegraded":"2024-01-21T21:15:17.602755+0000","last_fullsized":"2024-01-21T21:15:17.602755+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.242312+0000","last_change":"2024-01-21T21:15:17.228219+0000","last_active":"2024-01-21T21:15:17.242312+0000","last_peered":"2024-01-21T21:15:17.242312+0000","last_clean":"2024-01-21T21:15:17.242312+0000","last_became_active":"2024-01-21T21:15:17.228023+0000","last_became_peered":"2024-01-21T21:15:17.228023+0000","last_unstale":"2024-01-21T21:15:17.242312+0000","last_undegraded":"2024-01-21T21:15:17.242312+0000","last_fullsized":"2024-01-21T21:15:17.242312+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614538+0000","last_change":"2024-01-21T21:15:17.614538+0000","last_active":"2024-01-21T21:15:17.614538+0000","last_peered":"2024-01-21T21:15:17.614538+0000","last_clean":"2024-01-21T21:15:17.614538+0000","last_became_active":"2024-01-21T21:15:17.614267+0000","last_became_peered":"2024-01-21T21:15:17.614267+0000","last_unstale":"2024-01-21T21:15:17.614538+0000","last_undegraded":"2024-01-21T21:15:17.614538+0000","last_fullsized":"2024-01-21T21:15:17.614538+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225262+0000","last_change":"2024-01-21T21:15:17.221564+0000","last_active":"2024-01-21T21:15:17.225262+0000","last_peered":"2024-01-21T21:15:17.225262+0000","last_clean":"2024-01-21T21:15:17.225262+0000","last_became_active":"2024-01-21T21:15:17.221354+0000","last_became_peered":"2024-01-21T21:15:17.221354+0000","last_unstale":"2024-01-21T21:15:17.225262+0000","last_undegraded":"2024-01-21T21:15:17.225262+0000","last_fullsized":"2024-01-21T21:15:17.225262+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605070+0000","last_change":"2024-01-21T21:15:17.605070+0000","last_active":"2024-01-21T21:15:17.605070+0000","last_peered":"2024-01-21T21:15:17.605070+0000","last_clean":"2024-01-21T21:15:17.605070+0000","last_became_active":"2024-01-21T21:15:17.604782+0000","last_became_peered":"2024-01-21T21:15:17.604782+0000","last_unstale":"2024-01-21T21:15:17.605070+0000","last_undegraded":"2024-01-21T21:15:17.605070+0000","last_fullsized":"2024-01-21T21:15:17.605070+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234784+0000","last_change":"2024-01-21T21:15:17.232333+0000","last_active":"2024-01-21T21:15:17.234784+0000","last_peered":"2024-01-21T21:15:17.234784+0000","last_clean":"2024-01-21T21:15:17.234784+0000","last_became_active":"2024-01-21T21:15:17.232023+0000","last_became_peered":"2024-01-21T21:15:17.232023+0000","last_unstale":"2024-01-21T21:15:17.234784+0000","last_undegraded":"2024-01-21T21:15:17.234784+0000","last_fullsized":"2024-01-21T21:15:17.234784+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.612041+0000","last_change":"2024-01-21T21:15:17.612041+0000","last_active":"2024-01-21T21:15:17.612041+0000","last_peered":"2024-01-21T21:15:17.612041+0000","last_clean":"2024-01-21T21:15:17.612041+0000","last_became_active":"2024-01-21T21:15:17.611738+0000","last_became_peered":"2024-01-21T21:15:17.611738+0000","last_unstale":"2024-01-21T21:15:17.612041+0000","last_undegraded":"2024-01-21T21:15:17.612041+0000","last_fullsized":"2024-01-21T21:15:17.612041+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.234286+0000","last_change":"2024-01-21T21:15:17.225201+0000","last_active":"2024-01-21T21:15:17.234286+0000","last_peered":"2024-01-21T21:15:17.234286+0000","last_clean":"2024-01-21T21:15:17.234286+0000","last_became_active":"2024-01-21T21:15:17.223054+0000","last_became_peered":"2024-01-21T21:15:17.223054+0000","last_unstale":"2024-01-21T21:15:17.234286+0000","last_undegraded":"2024-01-21T21:15:17.234286+0000","last_fullsized":"2024-01-21T21:15:17.234286+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.602545+0000","last_change":"2024-01-21T21:15:17.602545+0000","last_active":"2024-01-21T21:15:17.602545+0000","last_peered":"2024-01-21T21:15:17.602545+0000","last_clean":"2024-01-21T21:15:17.602545+0000","last_became_active":"2024-01-21T21:15:17.602321+0000","last_became_peered":"2024-01-21T21:15:17.602321+0000","last_unstale":"2024-01-21T21:15:17.602545+0000","last_undegraded":"2024-01-21T21:15:17.602545+0000","last_fullsized":"2024-01-21T21:15:17.602545+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227373+0000","last_change":"2024-01-21T21:15:17.225730+0000","last_active":"2024-01-21T21:15:17.227373+0000","last_peered":"2024-01-21T21:15:17.227373+0000","last_clean":"2024-01-21T21:15:17.227373+0000","last_became_active":"2024-01-21T21:15:17.225454+0000","last_became_peered":"2024-01-21T21:15:17.225454+0000","last_unstale":"2024-01-21T21:15:17.227373+0000","last_undegraded":"2024-01-21T21:15:17.227373+0000","last_fullsized":"2024-01-21T21:15:17.227373+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604970+0000","last_change":"2024-01-21T21:15:17.604970+0000","last_active":"2024-01-21T21:15:17.604970+0000","last_peered":"2024-01-21T21:15:17.604970+0000","last_clean":"2024-01-21T21:15:17.604970+0000","last_became_active":"2024-01-21T21:15:17.604707+0000","last_became_peered":"2024-01-21T21:15:17.604707+0000","last_unstale":"2024-01-21T21:15:17.604970+0000","last_undegraded":"2024-01-21T21:15:17.604970+0000","last_fullsized":"2024-01-21T21:15:17.604970+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.238413+0000","last_change":"2024-01-21T21:15:17.235335+0000","last_active":"2024-01-21T21:15:17.238413+0000","last_peered":"2024-01-21T21:15:17.238413+0000","last_clean":"2024-01-21T21:15:17.238413+0000","last_became_active":"2024-01-21T21:15:17.235071+0000","last_became_peered":"2024-01-21T21:15:17.235071+0000","last_unstale":"2024-01-21T21:15:17.238413+0000","last_undegraded":"2024-01-21T21:15:17.238413+0000","last_fullsized":"2024-01-21T21:15:17.238413+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.600425+0000","last_change":"2024-01-21T21:15:17.600425+0000","last_active":"2024-01-21T21:15:17.600425+0000","last_peered":"2024-01-21T21:15:17.600425+0000","last_clean":"2024-01-21T21:15:17.600425+0000","last_became_active":"2024-01-21T21:15:17.599844+0000","last_became_peered":"2024-01-21T21:15:17.599844+0000","last_unstale":"2024-01-21T21:15:17.600425+0000","last_undegraded":"2024-01-21T21:15:17.600425+0000","last_fullsized":"2024-01-21T21:15:17.600425+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"173'1","reported_seq":10,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.598940+0000","last_change":"2024-01-21T21:15:17.232544+0000","last_active":"2024-01-21T21:15:17.598940+0000","last_peered":"2024-01-21T21:15:17.598940+0000","last_clean":"2024-01-21T21:15:17.598940+0000","last_became_active":"2024-01-21T21:15:17.232322+0000","last_became_peered":"2024-01-21T21:15:17.232322+0000","last_unstale":"2024-01-21T21:15:17.598940+0000","last_undegraded":"2024-01-21T21:15:17.598940+0000","last_fullsized":"2024-01-21T21:15:17.598940+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.220942+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:15:17.220942+0000","last_peered":"2024-01-21T21:15:17.220942+0000","last_clean":"2024-01-21T21:15:17.220942+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:15:17.220942+0000","last_undegraded":"2024-01-21T21:15:17.220942+0000","last_fullsized":"2024-01-21T21:15:17.220942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610972+0000","last_change":"2024-01-21T21:15:17.610972+0000","last_active":"2024-01-21T21:15:17.610972+0000","last_peered":"2024-01-21T21:15:17.610972+0000","last_clean":"2024-01-21T21:15:17.610972+0000","last_became_active":"2024-01-21T21:15:17.610257+0000","last_became_peered":"2024-01-21T21:15:17.610257+0000","last_unstale":"2024-01-21T21:15:17.610972+0000","last_undegraded":"2024-01-21T21:15:17.610972+0000","last_fullsized":"2024-01-21T21:15:17.610972+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"173'3","reported_seq":12,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.616943+0000","last_change":"2024-01-21T21:15:17.231458+0000","last_active":"2024-01-21T21:15:17.616943+0000","last_peered":"2024-01-21T21:15:17.616943+0000","last_clean":"2024-01-21T21:15:17.616943+0000","last_became_active":"2024-01-21T21:15:17.231210+0000","last_became_peered":"2024-01-21T21:15:17.231210+0000","last_unstale":"2024-01-21T21:15:17.616943+0000","last_undegraded":"2024-01-21T21:15:17.616943+0000","last_fullsized":"2024-01-21T21:15:17.616943+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":157,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.216099+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:15:17.216099+0000","last_peered":"2024-01-21T21:15:17.216099+0000","last_clean":"2024-01-21T21:15:17.216099+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:15:17.216099+0000","last_undegraded":"2024-01-21T21:15:17.216099+0000","last_fullsized":"2024-01-21T21:15:17.216099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.613010+0000","last_change":"2024-01-21T21:15:17.613010+0000","last_active":"2024-01-21T21:15:17.613010+0000","last_peered":"2024-01-21T21:15:17.613010+0000","last_clean":"2024-01-21T21:15:17.613010+0000","last_became_active":"2024-01-21T21:15:17.612115+0000","last_became_peered":"2024-01-21T21:15:17.612115+0000","last_unstale":"2024-01-21T21:15:17.613010+0000","last_undegraded":"2024-01-21T21:15:17.613010+0000","last_fullsized":"2024-01-21T21:15:17.613010+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.224201+0000","last_change":"2024-01-21T21:15:17.222723+0000","last_active":"2024-01-21T21:15:17.224201+0000","last_peered":"2024-01-21T21:15:17.224201+0000","last_clean":"2024-01-21T21:15:17.224201+0000","last_became_active":"2024-01-21T21:15:17.222463+0000","last_became_peered":"2024-01-21T21:15:17.222463+0000","last_unstale":"2024-01-21T21:15:17.224201+0000","last_undegraded":"2024-01-21T21:15:17.224201+0000","last_fullsized":"2024-01-21T21:15:17.224201+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":149,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.224630+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:15:17.224630+0000","last_peered":"2024-01-21T21:15:17.224630+0000","last_clean":"2024-01-21T21:15:17.224630+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:15:17.224630+0000","last_undegraded":"2024-01-21T21:15:17.224630+0000","last_fullsized":"2024-01-21T21:15:17.224630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604245+0000","last_change":"2024-01-21T21:15:17.604245+0000","last_active":"2024-01-21T21:15:17.604245+0000","last_peered":"2024-01-21T21:15:17.604245+0000","last_clean":"2024-01-21T21:15:17.604245+0000","last_became_active":"2024-01-21T21:15:17.603944+0000","last_became_peered":"2024-01-21T21:15:17.603944+0000","last_unstale":"2024-01-21T21:15:17.604245+0000","last_undegraded":"2024-01-21T21:15:17.604245+0000","last_fullsized":"2024-01-21T21:15:17.604245+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"173'2","reported_seq":11,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604485+0000","last_change":"2024-01-21T21:15:17.227687+0000","last_active":"2024-01-21T21:15:17.604485+0000","last_peered":"2024-01-21T21:15:17.604485+0000","last_clean":"2024-01-21T21:15:17.604485+0000","last_became_active":"2024-01-21T21:15:17.227320+0000","last_became_peered":"2024-01-21T21:15:17.227320+0000","last_unstale":"2024-01-21T21:15:17.604485+0000","last_undegraded":"2024-01-21T21:15:17.604485+0000","last_fullsized":"2024-01-21T21:15:17.604485+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":157,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.216157+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:15:17.216157+0000","last_peered":"2024-01-21T21:15:17.216157+0000","last_clean":"2024-01-21T21:15:17.216157+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:15:17.216157+0000","last_undegraded":"2024-01-21T21:15:17.216157+0000","last_fullsized":"2024-01-21T21:15:17.216157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":142,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.225681+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:15:17.225681+0000","last_peered":"2024-01-21T21:15:17.225681+0000","last_clean":"2024-01-21T21:15:17.225681+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:15:17.225681+0000","last_undegraded":"2024-01-21T21:15:17.225681+0000","last_fullsized":"2024-01-21T21:15:17.225681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604453+0000","last_change":"2024-01-21T21:15:17.604453+0000","last_active":"2024-01-21T21:15:17.604453+0000","last_peered":"2024-01-21T21:15:17.604453+0000","last_clean":"2024-01-21T21:15:17.604453+0000","last_became_active":"2024-01-21T21:15:17.603775+0000","last_became_peered":"2024-01-21T21:15:17.603775+0000","last_unstale":"2024-01-21T21:15:17.604453+0000","last_undegraded":"2024-01-21T21:15:17.604453+0000","last_fullsized":"2024-01-21T21:15:17.604453+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239518+0000","last_change":"2024-01-21T21:15:17.238575+0000","last_active":"2024-01-21T21:15:17.239518+0000","last_peered":"2024-01-21T21:15:17.239518+0000","last_clean":"2024-01-21T21:15:17.239518+0000","last_became_active":"2024-01-21T21:15:17.237969+0000","last_became_peered":"2024-01-21T21:15:17.237969+0000","last_unstale":"2024-01-21T21:15:17.239518+0000","last_undegraded":"2024-01-21T21:15:17.239518+0000","last_fullsized":"2024-01-21T21:15:17.239518+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":140,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.226589+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:15:17.226589+0000","last_peered":"2024-01-21T21:15:17.226589+0000","last_clean":"2024-01-21T21:15:17.226589+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:15:17.226589+0000","last_undegraded":"2024-01-21T21:15:17.226589+0000","last_fullsized":"2024-01-21T21:15:17.226589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.614847+0000","last_change":"2024-01-21T21:15:17.614847+0000","last_active":"2024-01-21T21:15:17.614847+0000","last_peered":"2024-01-21T21:15:17.614847+0000","last_clean":"2024-01-21T21:15:17.614847+0000","last_became_active":"2024-01-21T21:15:17.614365+0000","last_became_peered":"2024-01-21T21:15:17.614365+0000","last_unstale":"2024-01-21T21:15:17.614847+0000","last_undegraded":"2024-01-21T21:15:17.614847+0000","last_fullsized":"2024-01-21T21:15:17.614847+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239294+0000","last_change":"2024-01-21T21:15:17.233802+0000","last_active":"2024-01-21T21:15:17.239294+0000","last_peered":"2024-01-21T21:15:17.239294+0000","last_clean":"2024-01-21T21:15:17.239294+0000","last_became_active":"2024-01-21T21:15:17.228015+0000","last_became_peered":"2024-01-21T21:15:17.228015+0000","last_unstale":"2024-01-21T21:15:17.239294+0000","last_undegraded":"2024-01-21T21:15:17.239294+0000","last_fullsized":"2024-01-21T21:15:17.239294+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227572+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:15:17.227572+0000","last_peered":"2024-01-21T21:15:17.227572+0000","last_clean":"2024-01-21T21:15:17.227572+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:15:17.227572+0000","last_undegraded":"2024-01-21T21:15:17.227572+0000","last_fullsized":"2024-01-21T21:15:17.227572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.605893+0000","last_change":"2024-01-21T21:15:17.605893+0000","last_active":"2024-01-21T21:15:17.605893+0000","last_peered":"2024-01-21T21:15:17.605893+0000","last_clean":"2024-01-21T21:15:17.605893+0000","last_became_active":"2024-01-21T21:15:17.605622+0000","last_became_peered":"2024-01-21T21:15:17.605622+0000","last_unstale":"2024-01-21T21:15:17.605893+0000","last_undegraded":"2024-01-21T21:15:17.605893+0000","last_fullsized":"2024-01-21T21:15:17.605893+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.239459+0000","last_change":"2024-01-21T21:15:17.235600+0000","last_active":"2024-01-21T21:15:17.239459+0000","last_peered":"2024-01-21T21:15:17.239459+0000","last_clean":"2024-01-21T21:15:17.239459+0000","last_became_active":"2024-01-21T21:15:17.235291+0000","last_became_peered":"2024-01-21T21:15:17.235291+0000","last_unstale":"2024-01-21T21:15:17.239459+0000","last_undegraded":"2024-01-21T21:15:17.239459+0000","last_fullsized":"2024-01-21T21:15:17.239459+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.222714+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:15:17.222714+0000","last_peered":"2024-01-21T21:15:17.222714+0000","last_clean":"2024-01-21T21:15:17.222714+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:15:17.222714+0000","last_undegraded":"2024-01-21T21:15:17.222714+0000","last_fullsized":"2024-01-21T21:15:17.222714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.604860+0000","last_change":"2024-01-21T21:15:17.604860+0000","last_active":"2024-01-21T21:15:17.604860+0000","last_peered":"2024-01-21T21:15:17.604860+0000","last_clean":"2024-01-21T21:15:17.604860+0000","last_became_active":"2024-01-21T21:15:17.604491+0000","last_became_peered":"2024-01-21T21:15:17.604491+0000","last_unstale":"2024-01-21T21:15:17.604860+0000","last_undegraded":"2024-01-21T21:15:17.604860+0000","last_fullsized":"2024-01-21T21:15:17.604860+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:17.203761+0000","last_clean_scrub_stamp":"2024-01-21T21:15:17.203761+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"173'4","reported_seq":13,"reported_epoch":173,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.610764+0000","last_change":"2024-01-21T21:15:17.231084+0000","last_active":"2024-01-21T21:15:17.610764+0000","last_peered":"2024-01-21T21:15:17.610764+0000","last_clean":"2024-01-21T21:15:17.610764+0000","last_became_active":"2024-01-21T21:15:17.230805+0000","last_became_peered":"2024-01-21T21:15:17.230805+0000","last_unstale":"2024-01-21T21:15:17.610764+0000","last_undegraded":"2024-01-21T21:15:17.610764+0000","last_fullsized":"2024-01-21T21:15:17.610764+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:15:16.198773+0000","last_clean_scrub_stamp":"2024-01-21T21:15:16.198773+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":139,"reported_epoch":172,"state":"active+clean","last_fresh":"2024-01-21T21:15:17.227690+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:15:17.227690+0000","last_peered":"2024-01-21T21:15:17.227690+0000","last_clean":"2024-01-21T21:15:17.227690+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:15:17.227690+0000","last_undegraded":"2024-01-21T21:15:17.227690+0000","last_fullsized":"2024-01-21T21:15:17.227690+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575756,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307380,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064460,"statfs":{"total":96636764160,"available":96322007040,"internally_reserved":0,"allocated":2142208,"data_stored":1146022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61199999999999999,"15min":0.621},"min":{"1min":0.31,"5min":0.31,"15min":0.29199999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.83499999999999996},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41699999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.66300000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59999999999999998,"15min":0.59199999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.33300000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.36799999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.80500000000000005},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.38300000000000001,"15min":0.36099999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.61299999999999999,"15min":0.59999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.34399999999999997},"max":{"1min":2.8980000000000001,"5min":2.8980000000000001,"15min":2.8980000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.46300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.746}]},{"osd":4,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.498,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.31,"15min":0.31},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.79600000000000004},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":0.626,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.317,"15min":0.317},"max":{"1min":15.683999999999999,"5min":15.683999999999999,"15min":15.683999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35699999999999998,"15min":0.33100000000000002},"max":{"1min":0.745,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.52600000000000002},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33500000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.70699999999999996,"5min":0.80100000000000005,"15min":0.89600000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.61899999999999999,"15min":0.629},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.436},"max":{"1min":0.76400000000000001,"5min":0.81299999999999994,"15min":0.875},"last":0.50700000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.63100000000000001,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.2300000000000004,"5min":6.2300000000000004,"15min":6.2300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55600000000000005,"15min":0.56799999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.752,"15min":0.85399999999999998},"last":0.37}]},{"osd":2,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56299999999999994,"15min":0.57199999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.34300000000000003},"max":{"1min":0.72599999999999998,"5min":0.84099999999999997,"15min":0.92700000000000005},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57199999999999995,"15min":0.58699999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35199999999999998},"max":{"1min":0.72899999999999998,"5min":0.84699999999999998,"15min":0.86799999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57699999999999996,"15min":0.58799999999999997},"min":{"1min":0.40699999999999997,"5min":0.40400000000000003,"15min":0.32700000000000001},"max":{"1min":0.68899999999999995,"5min":0.82699999999999996,"15min":0.91100000000000003},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":0.84499999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.33400000000000002,"5min":0.29399999999999998,"15min":0.28899999999999998},"max":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.91200000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68500000000000005,"5min":0.76500000000000001,"15min":0.95299999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.495,"15min":0.5},"min":{"1min":0.314,"5min":0.30599999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.81699999999999995,"15min":0.82699999999999996},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56699999999999995,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.379},"max":{"1min":0.79200000000000004,"5min":0.86399999999999999,"15min":0.88300000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:15:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53500000000000003},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.80000000000000004,"15min":0.89100000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.74399999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575758,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303276,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068564,"statfs":{"total":96636764160,"available":96326209536,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.40100000000000002,"15min":0.40500000000000003},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.23200000000000001},"max":{"1min":0.59499999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.307},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.255},"max":{"1min":0.628,"5min":0.65300000000000002,"15min":0.66100000000000003},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.31,"5min":0.29099999999999998,"15min":0.28299999999999997},"max":{"1min":0.52000000000000002,"5min":0.60899999999999999,"15min":0.629},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41899999999999998,"15min":0.42699999999999999},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.53900000000000003,"5min":0.622,"15min":0.66100000000000003},"last":0.36299999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.32800000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.67500000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"min":{"1min":0.312,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.55100000000000005,"5min":0.62,"15min":0.65000000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.621},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.84999999999999998,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40999999999999998},"max":{"1min":0.77200000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.54700000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":0.88900000000000001,"15min":0.997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.52000000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80800000000000005,"5min":0.96299999999999997,"15min":1.0069999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.443},"max":{"1min":0.86499999999999999,"5min":1.036,"15min":1.036},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.52600000000000002,"5min":0.49299999999999999,"15min":0.46899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0509999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:14:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.44900000000000001},"max":{"1min":0.79800000000000004,"5min":1.0109999999999999,"15min":1.02},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67200000000000004,"15min":0.67500000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.79000000000000004,"5min":0.97799999999999998,"15min":1.0349999999999999},"last":0.65600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575757,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":2170880,"data_stored":1154625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38},"min":{"1min":0.27100000000000002,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.5,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.41799999999999998,"15min":0.42099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.64700000000000002},"last":0.32600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.437},"min":{"1min":0.29399999999999998,"5min":0.29299999999999998,"15min":0.27100000000000002},"max":{"1min":0.55500000000000005,"5min":0.627,"15min":0.88700000000000001},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.29899999999999999},"max":{"1min":0.57899999999999996,"5min":0.64400000000000002,"15min":0.85999999999999999},"last":0.435}]},{"osd":3,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.439,"15min":0.44},"min":{"1min":0.32700000000000001,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":0.878},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.44800000000000001,"15min":0.44900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30599999999999999},"max":{"1min":0.61199999999999999,"5min":0.67600000000000005,"15min":1.0549999999999999},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.45000000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85199999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.63400000000000001,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.443,"15min":0.42299999999999999},"max":{"1min":0.78600000000000003,"5min":1.02,"15min":1.02},"last":0.52200000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.441,"15min":0.439},"max":{"1min":0.89600000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65400000000000003,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.89100000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67700000000000005,"15min":0.69299999999999995},"min":{"1min":0.46600000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.879,"5min":1.044,"15min":1.044},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68400000000000005,"15min":0.68999999999999995},"min":{"1min":0.54900000000000004,"5min":0.51000000000000001,"15min":0.439},"max":{"1min":0.89300000000000002,"5min":0.94699999999999995,"15min":0.94799999999999995},"last":0.45900000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:14:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67200000000000004,"15min":0.68300000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.504,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.879,"5min":0.98499999999999999,"15min":1.0129999999999999},"last":0.60299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575757,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.41799999999999998,"15min":0.40699999999999997},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.442,"15min":0.432},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.27200000000000002},"max":{"1min":0.59399999999999997,"5min":0.62,"15min":0.67400000000000004},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.40899999999999997,"15min":0.40300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.438,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.57299999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.33100000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.44500000000000001,"15min":0.45000000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.62,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.47499999999999998,"15min":0.47199999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.629,"5min":0.72499999999999998,"15min":0.749},"last":0.56000000000000005}]},{"osd":4,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.67300000000000004,"15min":0.67500000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88500000000000001,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.69699999999999995,"15min":0.69499999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.92000000000000004,"5min":1,"15min":1},"last":0.876}]},{"osd":5,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.64900000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42099999999999999},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.45200000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85899999999999999,"5min":0.90300000000000002,"15min":1.018},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.65800000000000003,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.878,"5min":0.95299999999999996,"15min":0.999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.89600000000000002,"5min":0.96399999999999997,"15min":1.079},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.42799999999999999},"max":{"1min":0.83699999999999997,"5min":1.044,"15min":1.044},"last":0.80900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575757,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307372,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064468,"statfs":{"total":96636764160,"available":96322015232,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38600000000000001,"15min":0.39600000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.55100000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.432,"15min":0.436},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.60399999999999998,"5min":1.238,"15min":1.238},"last":0.34100000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.39300000000000002,"15min":0.39800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53000000000000003,"5min":1.353,"15min":1.353},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.42099999999999999,"15min":0.42499999999999999},"min":{"1min":0.28599999999999998,"5min":0.28100000000000003,"15min":0.27300000000000002},"max":{"1min":0.503,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.47499999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63200000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.38},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.307},"max":{"1min":0.59399999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60699999999999998,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78300000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.73399999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.754}]},{"osd":5,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.74199999999999999,"5min":1.486,"15min":1.486},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.63300000000000001,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85599999999999998,"5min":0.95299999999999996,"15min":1.0529999999999999},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90200000000000002,"5min":0.96699999999999997,"15min":1.006},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85899999999999999,"5min":1.099,"15min":1.099},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:14:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64800000000000002,"15min":0.65600000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82999999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.66700000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46000000000000002},"max":{"1min":0.87,"5min":1.522,"15min":1.522},"last":0.57099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575757,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307384,"kb_used_data":2096,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064456,"statfs":{"total":96636764160,"available":96322002944,"internally_reserved":0,"allocated":2146304,"data_stored":1146983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.62,"15min":0.626},"min":{"1min":0.41199999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81299999999999994,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.47099999999999997,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80800000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56100000000000005}]},{"osd":2,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58399999999999996,"15min":0.58899999999999997},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.374},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83599999999999997},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75800000000000001,"5min":0.80300000000000005,"15min":0.82999999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61699999999999999,"15min":0.61399999999999999},"min":{"1min":0.41599999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.49199999999999999,"15min":0.48299999999999998},"min":{"1min":0.372,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70299999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.66100000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.34799999999999998,"5min":0.33900000000000002,"15min":0.32600000000000001},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.44500000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":1.069},"last":0.72699999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:14:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.878},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.35499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575756,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060372,"statfs":{"total":96636764160,"available":96317820928,"internally_reserved":0,"allocated":2134016,"data_stored":1139648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.622,"15min":0.61499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.42199999999999999},"max":{"1min":0.78300000000000003,"5min":0.84499999999999997,"15min":0.84599999999999997},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.379,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.79500000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.32700000000000001},"max":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.83499999999999996},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.42499999999999999,"5min":0.36799999999999999,"15min":0.33900000000000002},"max":{"1min":0.71599999999999997,"5min":0.75700000000000001,"15min":0.82199999999999995},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.42699999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.77200000000000002,"15min":0.77500000000000002},"last":0.628}]},{"osd":3,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.41599999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.878},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.503,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.29799999999999999},"max":{"1min":0.61799999999999999,"5min":0.72299999999999998,"15min":0.747},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.32900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72199999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45900000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.51700000000000002,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.314},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.44},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.51600000000000001,"15min":0.51200000000000001},"min":{"1min":0.372,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48399999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:14:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.33800000000000002},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.83099999999999996},"last":0.503}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:15:20.941 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T21:15:20.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T21:15:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.097+0000 7fba1c995700 1 Processor -- start 2024-01-21T21:15:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.097+0000 7fba1c995700 1 -- start start 2024-01-21T21:15:21.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.098+0000 7fba1c995700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba18065d70 0x7fba1815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.098+0000 7fba1c995700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba18069ef0 con 0x7fba18062c10 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.098+0000 7fba1c995700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1806a130 con 0x7fba18062ff0 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.098+0000 7fba1c995700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1806a410 con 0x7fba18065d70 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba18065d70 0x7fba1815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fba18062c10 0x7fba180697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39098/0 (socket says 172.21.15.133:39098) 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba18065d70 0x7fba1815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35446/0 (socket says 172.21.15.133:35446) 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1659c700 1 -- 172.21.15.133:0/1510516656 learned_addr learned my addr 172.21.15.133:0/1510516656 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 -- 172.21.15.133:0/1510516656 >> v1:172.21.15.178:6789/0 conn(0x7fba18062ff0 legacy=0x7fba18065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 -- 172.21.15.133:0/1510516656 >> v1:172.21.15.133:6789/0 conn(0x7fba18062c10 legacy=0x7fba180697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 -- 172.21.15.133:0/1510516656 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1806a6f0 con 0x7fba18065d70 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1559a700 1 -- 172.21.15.133:0/1510516656 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784724512 0 0) 0x7fba0c001110 con 0x7fba18062c10 2024-01-21T21:15:21.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba16d9d700 1 --2- 172.21.15.133:0/1510516656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18065d70 0x7fba1815f750 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fba10009e60 tx=0x7fba10009780).ready entity=mon.0 client_cookie=7ffd7924b444bf3a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1559a700 1 -- 172.21.15.133:0/1510516656 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000e070 con 0x7fba18065d70 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1559a700 1 -- 172.21.15.133:0/1510516656 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000bc30 con 0x7fba18065d70 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.099+0000 7fba1559a700 1 -- 172.21.15.133:0/1510516656 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10012410 con 0x7fba18065d70 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 -- 172.21.15.133:0/1510516656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18065d70 msgr2=0x7fba1815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 --2- 172.21.15.133:0/1510516656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18065d70 0x7fba1815f750 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7fba10009e60 tx=0x7fba10009780).stop 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 -- 172.21.15.133:0/1510516656 shutdown_connections 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 --2- 172.21.15.133:0/1510516656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18065d70 0x7fba1815f750 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 -- 172.21.15.133:0/1510516656 >> 172.21.15.133:0/1510516656 conn(0x7fba180c8010 msgr2=0x7fba180c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 -- 172.21.15.133:0/1510516656 shutdown_connections 2024-01-21T21:15:21.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.100+0000 7fba1c995700 1 -- 172.21.15.133:0/1510516656 wait complete. 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.101+0000 7fba1c995700 1 Processor -- start 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 -- start start 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba18062c10 0x7fba180a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 0x7fba18157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180a7c70 con 0x7fba18062ff0 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180a7f30 con 0x7fba18065d70 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.102+0000 7fba1c995700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180a8210 con 0x7fba18062c10 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35448/0 (socket says 172.21.15.133:35448) 2024-01-21T21:15:21.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 -- 172.21.15.133:0/2204678714 learned_addr learned my addr 172.21.15.133:0/2204678714 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba16d9d700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 0x7fba18157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba1659c700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba18062c10 0x7fba180a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 -- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba18062c10 msgr2=0x7fba180a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba18062c10 0x7fba180a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 -- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 msgr2=0x7fba18157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 0x7fba18157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 -- 172.21.15.133:0/2204678714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba10009a20 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba16d9d700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 0x7fba18157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba15d9b700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fba0800c4c0 tx=0x7fba08007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08007020 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08001e90 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba180a84f0 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080073b0 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.103+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1813ae10 con 0x7fba18062ff0 2024-01-21T21:15:21.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.104+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1805fdf0 con 0x7fba18062ff0 2024-01-21T21:15:21.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.105+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fba080068b0 con 0x7fba18062ff0 2024-01-21T21:15:21.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.105+0000 7fba06ffd700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 0x7fb9f8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.105+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fba08079dd0 con 0x7fba18062ff0 2024-01-21T21:15:21.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.105+0000 7fba1659c700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 0x7fb9f8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.105+0000 7fba1659c700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 0x7fb9f8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba0c001660 tx=0x7fba0c009040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.109+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fba0804ae10 con 0x7fba18062ff0 2024-01-21T21:15:21.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.337+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fba180c7870 con 0x7fba18062ff0 2024-01-21T21:15:21.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.340+0000 7fba06ffd700 1 -- 172.21.15.133:0/2204678714 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v44) v1 ==== 190+0+0 (secure 0 0 0) 0x7fba0807b020 con 0x7fba18062ff0 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 msgr2=0x7fb9f8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 0x7fb9f8061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fba0c001660 tx=0x7fba0c009040).stop 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 msgr2=0x7fba1813a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fba0800c4c0 tx=0x7fba08007e00).stop 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 shutdown_connections 2024-01-21T21:15:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.342+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb9f805f150 0x7fb9f8061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba18065d70 0x7fba18157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba18062c10 0x7fba180a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 --2- 172.21.15.133:0/2204678714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba18062ff0 0x7fba1813a920 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 >> 172.21.15.133:0/2204678714 conn(0x7fba180c8010 msgr2=0x7fba180a5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 shutdown_connections 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.343+0000 7fba1c995700 1 -- 172.21.15.133:0/2204678714 wait complete. 2024-01-21T21:15:21.345 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T21:15:21.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:15:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 Processor -- start 2024-01-21T21:15:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 -- start start 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdac8155ca0 0x7fdac80bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 0x7fdac80bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80a50f0 con 0x7fdac81558c0 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80bdb60 con 0x7fdac8155ca0 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.471+0000 7fdacf09e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80a4da0 con 0x7fdac8062e00 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacce3a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdac81558c0 0x7fdac80626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39112/0 (socket says 172.21.15.133:39112) 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacce3a700 1 -- 172.21.15.133:0/3706163847 learned_addr learned my addr 172.21.15.133:0/3706163847 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 --2- 172.21.15.133:0/3706163847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 0x7fdac80bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac7fff700 1 --2- 172.21.15.133:0/3706163847 >> v2:172.21.15.178:3300/0 conn(0x7fdac8155ca0 0x7fdac80bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976078121 0 0) 0x7fdac80a50f0 con 0x7fdac81558c0 2024-01-21T21:15:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab80033f0 con 0x7fdac81558c0 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 -- 172.21.15.133:0/3706163847 >> v2:172.21.15.178:3300/0 conn(0x7fdac8155ca0 msgr2=0x7fdac80bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 --2- 172.21.15.133:0/3706163847 >> v2:172.21.15.178:3300/0 conn(0x7fdac8155ca0 0x7fdac80bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 -- 172.21.15.133:0/3706163847 >> v1:172.21.15.133:6789/0 conn(0x7fdac81558c0 legacy=0x7fdac80626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1400059578 0 0) 0x7fdab80033f0 con 0x7fdac81558c0 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 -- 172.21.15.133:0/3706163847 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80bde00 con 0x7fdac8062e00 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdacd63b700 1 --2- 172.21.15.133:0/3706163847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 0x7fdac80bd670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdac0009e60 tx=0x7fdac0009780).ready entity=mon.2 client_cookie=48b78b2671443dd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000e070 con 0x7fdac8062e00 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000b7a0 con 0x7fdac8062e00 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.472+0000 7fdac77fe700 1 -- 172.21.15.133:0/3706163847 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc001470 con 0x7fdac8062e00 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 -- 172.21.15.133:0/3706163847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 msgr2=0x7fdac80bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 --2- 172.21.15.133:0/3706163847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 0x7fdac80bd670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fdac0009e60 tx=0x7fdac0009780).stop 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 -- 172.21.15.133:0/3706163847 shutdown_connections 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 --2- 172.21.15.133:0/3706163847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac8062e00 0x7fdac80bd670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 --2- 172.21.15.133:0/3706163847 >> v2:172.21.15.178:3300/0 conn(0x7fdac8155ca0 0x7fdac80bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 -- 172.21.15.133:0/3706163847 >> 172.21.15.133:0/3706163847 conn(0x7fdac80c8010 msgr2=0x7fdac80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:21.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 -- 172.21.15.133:0/3706163847 shutdown_connections 2024-01-21T21:15:21.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.473+0000 7fdacf09e700 1 -- 172.21.15.133:0/3706163847 wait complete. 2024-01-21T21:15:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.474+0000 7fdacf09e700 1 Processor -- start 2024-01-21T21:15:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.474+0000 7fdacf09e700 1 -- start start 2024-01-21T21:15:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdac8062e00 0x7fdac80ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac81558c0 0x7fdac80aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac8156d40 con 0x7fdac8155ca0 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80ab8a0 con 0x7fdac8062e00 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacf09e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80abb80 con 0x7fdac81558c0 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35456/0 (socket says 172.21.15.133:35456) 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 -- 172.21.15.133:0/303964116 learned_addr learned my addr 172.21.15.133:0/303964116 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacce3a700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdac8062e00 0x7fdac80ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdac7fff700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac81558c0 0x7fdac80aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 -- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac81558c0 msgr2=0x7fdac80aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac81558c0 0x7fdac80aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 -- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdac8062e00 msgr2=0x7fdac80ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdac8062e00 0x7fdac80ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.475+0000 7fdacd63b700 1 -- 172.21.15.133:0/303964116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009a20 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdacd63b700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fdac80a4ee0 tx=0x7fdac0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac001d420 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac001d580 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac80abe60 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac001d940 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.476+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac80ab4b0 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.477+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac8157180 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.477+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdac0003040 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.477+0000 7fdac57fa700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.478+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fdac007be40 con 0x7fdac8155ca0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.478+0000 7fdacce3a700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:21.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.478+0000 7fdacce3a700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdabc004bc0 tx=0x7fdabc001680).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:21.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.482+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdac004ce80 con 0x7fdac8155ca0 2024-01-21T21:15:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.689+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac8157330 con 0x7fdac8155ca0 2024-01-21T21:15:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.690+0000 7fdac57fa700 1 -- 172.21.15.133:0/303964116 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fdac00504a0 con 0x7fdac8155ca0 2024-01-21T21:15:21.691 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:15:21.691 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 msgr2=0x7fdaac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 0x7fdaac061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdabc004bc0 tx=0x7fdabc001680).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 msgr2=0x7fdac8147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7fdac80a4ee0 tx=0x7fdac0009780).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 shutdown_connections 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fdaac05f150 0x7fdaac061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdac8155ca0 0x7fdac8147e10 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdac8062e00 0x7fdac80ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 --2- 172.21.15.133:0/303964116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdac81558c0 0x7fdac80aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 >> 172.21.15.133:0/303964116 conn(0x7fdac80c8010 msgr2=0x7fdac80c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 shutdown_connections 2024-01-21T21:15:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:21.692+0000 7fdacf09e700 1 -- 172.21.15.133:0/303964116 wait complete. 2024-01-21T21:15:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:15:22.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T21:15:17.583147+0000', 'modified': '2024-01-21T21:15:19.589489+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9060}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9060': {'gid': 9060, 'name': 'a', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2898630270', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 2898630270}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2898630270}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T21:15:22.108 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T21:15:22.108 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-21T21:15:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.225+0000 7fb251ce1700 1 Processor -- start 2024-01-21T21:15:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.225+0000 7fb251ce1700 1 -- start start 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.225+0000 7fb251ce1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c13a830 0x7fb24c0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb251ce1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb24c0695b0 0x7fb24c069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb251ce1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c069ef0 con 0x7fb24c13ac10 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb251ce1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0c3890 con 0x7fb24c0695b0 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb251ce1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c3b70 con 0x7fb24c13a830 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb24c0695b0 0x7fb24c069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb24c0695b0 0x7fb24c069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35472/0 (socket says 172.21.15.133:35472) 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 -- 172.21.15.133:0/3903463788 learned_addr learned my addr 172.21.15.133:0/3903463788 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c13a830 0x7fb24c0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 -- 172.21.15.133:0/3903463788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c13a830 msgr2=0x7fb24c0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c13a830 0x7fb24c0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 -- 172.21.15.133:0/3903463788 >> v1:172.21.15.178:6789/0 conn(0x7fb24c13ac10 legacy=0x7fb24c0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 -- 172.21.15.133:0/3903463788 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0c3e50 con 0x7fb24c0695b0 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24bfff700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c0695b0 0x7fb24c069a00 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fb244006fd0 tx=0x7fb2440090f0).ready entity=mon.0 client_cookie=97bb067b90637961 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24a7fc700 1 -- 172.21.15.133:0/3903463788 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400b600 con 0x7fb24c0695b0 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24a7fc700 1 -- 172.21.15.133:0/3903463788 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400b760 con 0x7fb24c0695b0 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.226+0000 7fb24a7fc700 1 -- 172.21.15.133:0/3903463788 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400bb00 con 0x7fb24c0695b0 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 -- 172.21.15.133:0/3903463788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c0695b0 msgr2=0x7fb24c069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c0695b0 0x7fb24c069a00 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fb244006fd0 tx=0x7fb2440090f0).stop 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 -- 172.21.15.133:0/3903463788 shutdown_connections 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c0695b0 0x7fb24c069a00 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 --2- 172.21.15.133:0/3903463788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c13a830 0x7fb24c0c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 -- 172.21.15.133:0/3903463788 >> 172.21.15.133:0/3903463788 conn(0x7fb24c0c7dc0 msgr2=0x7fb24c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 -- 172.21.15.133:0/3903463788 shutdown_connections 2024-01-21T21:15:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.227+0000 7fb251ce1700 1 -- 172.21.15.133:0/3903463788 wait complete. 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.228+0000 7fb251ce1700 1 Processor -- start 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.228+0000 7fb251ce1700 1 -- start start 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c0695b0 0x7fb24c137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb24c13ac10 0x7fb24c065200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0aa5d0 con 0x7fb24c13a830 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0a9300 con 0x7fb24c13ac10 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb251ce1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0aa140 con 0x7fb24c0695b0 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35484/0 (socket says 172.21.15.133:35484) 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 -- 172.21.15.133:0/1741097661 learned_addr learned my addr 172.21.15.133:0/1741097661 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c0695b0 0x7fb24c137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24bfff700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb24c13ac10 0x7fb24c065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 -- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c0695b0 msgr2=0x7fb24c137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c0695b0 0x7fb24c137bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 -- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb24c13ac10 msgr2=0x7fb24c065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb24c13ac10 0x7fb24c065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 -- 172.21.15.133:0/1741097661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244009370 con 0x7fb24c13a830 2024-01-21T21:15:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.229+0000 7fb24affd700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fb23400c4f0 tx=0x7fb234007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.230+0000 7fb243fff700 1 -- 172.21.15.133:0/1741097661 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234007020 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.230+0000 7fb243fff700 1 -- 172.21.15.133:0/1741097661 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2340071a0 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.230+0000 7fb243fff700 1 -- 172.21.15.133:0/1741097661 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234007560 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.230+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c0a9530 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.230+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0a9af0 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.231+0000 7fb243fff700 1 -- 172.21.15.133:0/1741097661 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb2340068b0 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.231+0000 7fb243fff700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 0x7fb22c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.231+0000 7fb243fff700 1 -- 172.21.15.133:0/1741097661 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb234079dd0 con 0x7fb24c13a830 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.232+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 0x7fb22c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.232+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 0x7fb22c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb23c009fd0 tx=0x7fb23c009880).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.233+0000 7fb263684b80 1 Processor -- start 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 -- start start 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd5e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fd5f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fcda3d0 con 0x55566fd63620 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fc9fbe0 con 0x55566fd5edf0 2024-01-21T21:15:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.234+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55566fcb5260 con 0x55566fdac2c0 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35488/0 (socket says 172.21.15.133:35488) 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 -- 172.21.15.133:0/1316698162 learned_addr learned my addr 172.21.15.133:0/1316698162 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24bfff700 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fd5f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24affd700 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd5e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 -- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 msgr2=0x55566fd5e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd5e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 -- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 msgr2=0x55566fd5f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fd5f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 -- 172.21.15.133:0/1316698162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55566fcae2f0 con 0x55566fd63620 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fb23c015750 tx=0x7fb23c015000).ready entity=mon.0 client_cookie=6f48cfd6ed68d38b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb2417fa700 1 -- 172.21.15.133:0/1316698162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0146e0 con 0x55566fd63620 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb2417fa700 1 -- 172.21.15.133:0/1316698162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c014840 con 0x55566fd63620 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.235+0000 7fb2417fa700 1 -- 172.21.15.133:0/1316698162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c014c00 con 0x55566fd63620 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- 172.21.15.133:0/1316698162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 msgr2=0x55566fd63a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fb23c015750 tx=0x7fb23c015000).stop 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- 172.21.15.133:0/1316698162 shutdown_connections 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fd5f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fd63a00 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 --2- 172.21.15.133:0/1316698162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd5e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- 172.21.15.133:0/1316698162 >> 172.21.15.133:0/1316698162 conn(0x55566fbcc2e0 msgr2=0x55566fdac750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- 172.21.15.133:0/1316698162 shutdown_connections 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- 172.21.15.133:0/1316698162 wait complete. 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.236+0000 7fb263684b80 1 -- start start 2024-01-21T21:15:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 Processor -- start 2024-01-21T21:15:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd8b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd91720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fcb53a0 con 0x55566fd5edf0 2024-01-21T21:15:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fcb5620 con 0x55566fd63620 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55566fc80990 con 0x55566fdac2c0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb263684b80 10 client.0 ll_register_callbacks cb 0x55566fd23610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb24b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35502/0 (socket says 172.21.15.133:35502) 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.237+0000 7fb24b7fe700 1 -- 172.21.15.133:0/281685778 learned_addr learned my addr 172.21.15.133:0/281685778 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24affd700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd8b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24bfff700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd91720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 -- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 msgr2=0x55566fd91720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd91720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 -- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 msgr2=0x55566fd8b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd8b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 -- 172.21.15.133:0/281685778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c011040 con 0x55566fd5edf0 2024-01-21T21:15:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fb23c015ea0 tx=0x7fb23c017000).ready entity=mon.0 client_cookie=73587c001f09968f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c014c90 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb23c014df0 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55566fd5ddf0 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb23c021830 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 10 client.9201 fetch_fsmap learned FSMap version 62 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55566fca9520 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55566fd5ddf0 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb23c021990 con 0x55566fd5edf0 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 10 client.9201 fetch_fsmap finished waiting for FSMap version 62 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 10 client.9201 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 20 client.9201 populate_metadata read hostname 'smithi133' 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fd5f270 0x55566fd5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 4 client.9201 mds_command: new command op to 9060 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T21:15:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.238+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 --> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55566fcaad60 con 0x55566fd5f270 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb24affd700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fd5f270 0x55566fd5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb24affd700 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fd5f270 0x55566fd5f650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=83f48820c65a4dca server_cookie=58666c83f7244b6e in_seq=0 out_seq=0 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb22a7fc700 10 client.9201 ms_handle_connect on v2:172.21.15.133:6834/2898630270 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb22a7fc700 1 -- 172.21.15.133:0/281685778 <== mds.0 v2:172.21.15.133:6834/2898630270 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55566fcaad60 con 0x55566fd5f270 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb22a7fc700 10 client.9201 handle_command_reply: tid=0 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.239+0000 7fb263684b80 1 client.9201 shutdown 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 msgr2=0x55566fdb8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fb23c015ea0 tx=0x7fb23c017000).stop 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 shutdown_connections 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fd5f270 0x55566fd5f650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd91720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd5edf0 0x55566fdb8df0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb22a7fc700 0 client.9201 ms_handle_reset on v2:172.21.15.133:6834/2898630270 2024-01-21T21:15:22.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 --2- 172.21.15.133:0/281685778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd8b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 >> 172.21.15.133:0/281685778 conn(0x55566fbcc2e0 msgr2=0x55566fd63ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 shutdown_connections 2024-01-21T21:15:22.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 1 -- 172.21.15.133:0/281685778 wait complete. 2024-01-21T21:15:22.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.240+0000 7fb263684b80 20 client.9201 trim_cache size 0 max 16384 2024-01-21T21:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.257+0000 7fb263684b80 1 Processor -- start 2024-01-21T21:15:22.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.257+0000 7fb263684b80 1 -- start start 2024-01-21T21:15:22.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fd5edf0 0x55566fd90940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd65480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fd5b600 con 0x55566fdac2c0 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fd62c50 con 0x55566fd63620 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55566fd60650 con 0x55566fd5edf0 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35510/0 (socket says 172.21.15.133:35510) 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 -- 172.21.15.133:0/2621174341 learned_addr learned my addr 172.21.15.133:0/2621174341 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fd5edf0 0x55566fd90940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24affd700 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd65480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 -- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fd5edf0 msgr2=0x55566fd90940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fd5edf0 0x55566fd90940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 -- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 msgr2=0x55566fd65480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd65480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.258+0000 7fb24bfff700 1 -- 172.21.15.133:0/2621174341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55566fca9270 con 0x55566fdac2c0 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb24bfff700 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fb24c068c60 tx=0x7fb244017000).ready entity=mon.0 client_cookie=7b01a4e8e5deacc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb241ffb700 1 -- 172.21.15.133:0/2621174341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb244022070 con 0x55566fdac2c0 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb241ffb700 1 -- 172.21.15.133:0/2621174341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb244006ad0 con 0x55566fdac2c0 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb241ffb700 1 -- 172.21.15.133:0/2621174341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400bae0 con 0x55566fdac2c0 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 -- 172.21.15.133:0/2621174341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 msgr2=0x55566fdad070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 rx=0x7fb24c068c60 tx=0x7fb244017000).stop 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 -- 172.21.15.133:0/2621174341 shutdown_connections 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fdac2c0 0x55566fdad070 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fd5edf0 0x55566fd90940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 --2- 172.21.15.133:0/2621174341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd63620 0x55566fd65480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 -- 172.21.15.133:0/2621174341 >> 172.21.15.133:0/2621174341 conn(0x55566fbcc2e0 msgr2=0x55566fdadf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 -- 172.21.15.133:0/2621174341 shutdown_connections 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.259+0000 7fb263684b80 1 -- 172.21.15.133:0/2621174341 wait complete. 2024-01-21T21:15:22.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.260+0000 7fb263684b80 1 -- start start 2024-01-21T21:15:22.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.260+0000 7fb263684b80 1 Processor -- start 2024-01-21T21:15:22.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fe0dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fdad980 con 0x55566fd63620 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55566fdc9350 con 0x55566fd5edf0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55566fd8dec0 con 0x55566fdac2c0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 10 client.0 ll_register_callbacks cb 0x55566fd23610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35526/0 (socket says 172.21.15.133:35526) 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 -- 172.21.15.133:0/220247702 learned_addr learned my addr 172.21.15.133:0/220247702 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24bfff700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fe0dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 -- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 msgr2=0x55566fd8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd8a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 -- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 msgr2=0x55566fe0dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fe0dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 -- 172.21.15.133:0/220247702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0c3e50 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24bfff700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fe0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb24affd700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fb23404afd0 tx=0x7fb234060040).ready entity=mon.0 client_cookie=d3b91ccded432736 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb22a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234059040 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb23c014840 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.261+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb234063070 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb23404b1e0 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 10 client.9207 fetch_fsmap learned FSMap version 62 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55566fb22f80 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c014840 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb234010300 con 0x55566fd63620 2024-01-21T21:15:22.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 10 client.9207 fetch_fsmap finished waiting for FSMap version 62 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 10 client.9207 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 20 client.9207 populate_metadata read hostname 'smithi133' 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fda7090 0x55566fda7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 4 client.9207 mds_command: new command op to 9060 tid=0[{"prefix": "status"}] 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 --> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55566fca17d0 con 0x55566fda7090 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fda7090 0x55566fda7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 10 client.9207 ms_handle_connect on v2:172.21.15.133:6834/2898630270 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb24b7fe700 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fda7090 0x55566fda7470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e1b179950e881db6 server_cookie=5651b0c6c1144daa in_seq=0 out_seq=0 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 1 -- 172.21.15.133:0/220247702 <== mds.0 v2:172.21.15.133:6834/2898630270 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55566fca17d0 con 0x55566fda7090 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb22a7fc700 10 client.9207 handle_command_reply: tid=0 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 client.9207 shutdown 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 msgr2=0x55566fdadeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7fb23404afd0 tx=0x7fb234060040).stop 2024-01-21T21:15:22.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.262+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 shutdown_connections 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:6834/2898630270,v1:172.21.15.133:6837/2898630270] conn(0x55566fda7090 0x55566fda7470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55566fdac2c0 0x55566fd8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb22a7fc700 0 client.9207 ms_handle_reset on v2:172.21.15.133:6834/2898630270 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55566fd5edf0 0x55566fe0dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 --2- 172.21.15.133:0/220247702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55566fd63620 0x55566fdadeb0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 >> 172.21.15.133:0/220247702 conn(0x55566fbcc2e0 msgr2=0x55566fd5f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 shutdown_connections 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 1 -- 172.21.15.133:0/220247702 wait complete. 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb263684b80 20 client.9207 trim_cache size 0 max 16384 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T21:15:22.271 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9060, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 4.6783561130000004, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 62, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 174, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 174, 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 9.1835145239999996 2024-01-21T21:15:22.272 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 msgr2=0x7fb22c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 0x7fb22c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb23c009fd0 tx=0x7fb23c009880).stop 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 msgr2=0x7fb24c0a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fb23400c4f0 tx=0x7fb234007da0).stop 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 shutdown_connections 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb22c05f150 0x7fb22c061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb24c13ac10 0x7fb24c065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb24c0695b0 0x7fb24c137bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 --2- 172.21.15.133:0/1741097661 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb24c13a830 0x7fb24c0a7740 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 >> 172.21.15.133:0/1741097661 conn(0x7fb24c0c7dc0 msgr2=0x7fb24c066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 shutdown_connections 2024-01-21T21:15:22.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.263+0000 7fb251ce1700 1 -- 172.21.15.133:0/1741097661 wait complete. 2024-01-21T21:15:22.276 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T21:15:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.378+0000 7fb715cc4700 1 Processor -- start 2024-01-21T21:15:22.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 -- start start 2024-01-21T21:15:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb710063430 0x7fb7100c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710155530 con 0x7fb7100c5d00 2024-01-21T21:15:22.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb710154920 con 0x7fb710063430 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.379+0000 7fb715cc4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710154c00 con 0x7fb710153e90 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53924/0 (socket says 172.21.15.133:53924) 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb710063430 0x7fb7100c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 -- 172.21.15.133:0/3071981916 learned_addr learned my addr 172.21.15.133:0/3071981916 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 -- 172.21.15.133:0/3071981916 >> v2:172.21.15.178:3300/0 conn(0x7fb710063430 msgr2=0x7fb7100c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 --2- 172.21.15.133:0/3071981916 >> v2:172.21.15.178:3300/0 conn(0x7fb710063430 0x7fb7100c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 -- 172.21.15.133:0/3071981916 >> v1:172.21.15.178:6789/0 conn(0x7fb7100c5d00 legacy=0x7fb7100bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 -- 172.21.15.133:0/3071981916 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710154ee0 con 0x7fb710153e90 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70f7fe700 1 --2- 172.21.15.133:0/3071981916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb700006fd0 tx=0x7fb7000090f0).ready entity=mon.2 client_cookie=1e01c84616005850 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70e7fc700 1 -- 172.21.15.133:0/3071981916 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000b580 con 0x7fb710153e90 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70e7fc700 1 -- 172.21.15.133:0/3071981916 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b6e0 con 0x7fb710153e90 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.380+0000 7fb70e7fc700 1 -- 172.21.15.133:0/3071981916 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ba60 con 0x7fb710153e90 2024-01-21T21:15:22.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 -- 172.21.15.133:0/3071981916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 msgr2=0x7fb710154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 --2- 172.21.15.133:0/3071981916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fb700006fd0 tx=0x7fb7000090f0).stop 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 -- 172.21.15.133:0/3071981916 shutdown_connections 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 --2- 172.21.15.133:0/3071981916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb710153e90 0x7fb710154270 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 --2- 172.21.15.133:0/3071981916 >> v2:172.21.15.178:3300/0 conn(0x7fb710063430 0x7fb7100c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 -- 172.21.15.133:0/3071981916 >> 172.21.15.133:0/3071981916 conn(0x7fb7100c7cb0 msgr2=0x7fb7100c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 -- 172.21.15.133:0/3071981916 shutdown_connections 2024-01-21T21:15:22.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.381+0000 7fb715cc4700 1 -- 172.21.15.133:0/3071981916 wait complete. 2024-01-21T21:15:22.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.382+0000 7fb715cc4700 1 Processor -- start 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.382+0000 7fb715cc4700 1 -- start start 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb710152460 0x7fb7101528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 0x7fb7100a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100a6fc0 con 0x7fb710153e90 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71014de70 con 0x7fb710152460 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb715cc4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7100bfbf0 con 0x7fb7100a6220 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35532/0 (socket says 172.21.15.133:35532) 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 -- 172.21.15.133:0/2324469945 learned_addr learned my addr 172.21.15.133:0/2324469945 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70effd700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb710152460 0x7fb7101528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70ffff700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 0x7fb7100a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 -- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 msgr2=0x7fb7100a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 0x7fb7100a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 -- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb710152460 msgr2=0x7fb7101528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb710152460 0x7fb7101528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70f7fe700 1 -- 172.21.15.133:0/2324469945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009370 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.383+0000 7fb70ffff700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 0x7fb7100a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb70f7fe700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fb700009ea0 tx=0x7fb700017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000b850 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b9b0 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70001d680 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7100a57f0 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.384+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7100a5c80 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.385+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7100475e0 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.385+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb70001d9f0 con 0x7fb710153e90 2024-01-21T21:15:22.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.385+0000 7fb6f7fff700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 0x7fb6fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.385+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb70007c400 con 0x7fb710153e90 2024-01-21T21:15:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.385+0000 7fb70effd700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 0x7fb6fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:22.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.386+0000 7fb70effd700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 0x7fb6fc061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb710151e30 tx=0x7fb704008040).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:22.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.389+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb70004d440 con 0x7fb710153e90 2024-01-21T21:15:22.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.594+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb71006ab50 con 0x7fb710153e90 2024-01-21T21:15:22.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.594+0000 7fb6f7fff700 1 -- 172.21.15.133:0/2324469945 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb700050a60 con 0x7fb710153e90 2024-01-21T21:15:22.596 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T21:15:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.596+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 msgr2=0x7fb6fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.596+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 0x7fb6fc061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb710151e30 tx=0x7fb704008040).stop 2024-01-21T21:15:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.596+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 msgr2=0x7fb71014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.596+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7fb700009ea0 tx=0x7fb700017000).stop 2024-01-21T21:15:22.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.596+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 shutdown_connections 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb6fc05f150 0x7fb6fc061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7100a6220 0x7fb7100a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb710153e90 0x7fb71014d980 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 --2- 172.21.15.133:0/2324469945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb710152460 0x7fb7101528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 >> 172.21.15.133:0/2324469945 conn(0x7fb7100c7cb0 msgr2=0x7fb710066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 shutdown_connections 2024-01-21T21:15:22.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:22.597+0000 7fb715cc4700 1 -- 172.21.15.133:0/2324469945 wait complete. 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T21:15:22.609 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T21:15:22.610 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T21:15:22.610 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:15:22.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.610 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T21:15:22.627 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T21:15:22.627 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T21:15:22.628 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 37809sec preferred_lft 37809sec 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T21:15:22.629 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.630 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:15:22.630 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T21:15:22.630 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T21:15:22.630 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:15:22.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.630 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T21:15:22.695 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T21:15:22.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.696 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T21:15:22.755 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T21:15:22.756 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T21:15:22.756 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T21:15:22.756 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T21:15:22.756 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T21:15:22.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.756 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T21:15:22.756 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T21:15:22.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T21:15:22.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T21:15:22.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T21:15:22.757 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T21:15:22.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.862 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:15:22.880 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T21:15:22.880 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T21:15:22.880 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:15:22.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T21:15:22.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:22.947 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T21:15:23.004 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T21:15:23.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:15:23.085 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:15:23.086 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:15:23.106 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:15:23.106 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:15:23.109 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T21:15:23.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:15:23.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T21:15:23.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T21:15:23.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.332+0000 7efe41e7a700 1 Processor -- start 2024-01-21T21:15:23.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 -- start start 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe3c066e00 0x7efe3c153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe3c062b70 0x7efe3c156440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c153750 con 0x7efe3c0626f0 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0671e0 con 0x7efe3c066e00 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.333+0000 7efe41e7a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0662e0 con 0x7efe3c062b70 2024-01-21T21:15:23.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe3c066e00 0x7efe3c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe3c066e00 0x7efe3c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35546/0 (socket says 172.21.15.133:35546) 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 -- 172.21.15.133:0/3826546641 learned_addr learned my addr 172.21.15.133:0/3826546641 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3bfff700 1 --2- 172.21.15.133:0/3826546641 >> v2:172.21.15.178:3300/0 conn(0x7efe3c062b70 0x7efe3c156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 -- 172.21.15.133:0/3826546641 >> v2:172.21.15.178:3300/0 conn(0x7efe3c062b70 msgr2=0x7efe3c156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 --2- 172.21.15.133:0/3826546641 >> v2:172.21.15.178:3300/0 conn(0x7efe3c062b70 0x7efe3c156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 -- 172.21.15.133:0/3826546641 >> v1:172.21.15.178:6789/0 conn(0x7efe3c0626f0 legacy=0x7efe3c155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 -- 172.21.15.133:0/3826546641 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c069990 con 0x7efe3c066e00 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3b7fe700 1 --2- 172.21.15.133:0/3826546641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c153260 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7efe3c0aaac0 tx=0x7efe2c0090f0).ready entity=mon.0 client_cookie=ee9f7e1797a44032 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3a7fc700 1 -- 172.21.15.133:0/3826546641 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00b600 con 0x7efe3c066e00 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3a7fc700 1 -- 172.21.15.133:0/3826546641 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00b760 con 0x7efe3c066e00 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.334+0000 7efe3a7fc700 1 -- 172.21.15.133:0/3826546641 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00bb00 con 0x7efe3c066e00 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 -- 172.21.15.133:0/3826546641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 msgr2=0x7efe3c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 --2- 172.21.15.133:0/3826546641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c153260 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7efe3c0aaac0 tx=0x7efe2c0090f0).stop 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 -- 172.21.15.133:0/3826546641 shutdown_connections 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 --2- 172.21.15.133:0/3826546641 >> v2:172.21.15.178:3300/0 conn(0x7efe3c062b70 0x7efe3c156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 --2- 172.21.15.133:0/3826546641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c153260 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 -- 172.21.15.133:0/3826546641 >> 172.21.15.133:0/3826546641 conn(0x7efe3c0c7dc0 msgr2=0x7efe3c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 -- 172.21.15.133:0/3826546641 shutdown_connections 2024-01-21T21:15:23.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.335+0000 7efe41e7a700 1 -- 172.21.15.133:0/3826546641 wait complete. 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.336+0000 7efe41e7a700 1 Processor -- start 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.336+0000 7efe41e7a700 1 -- start start 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe3c0626f0 0x7efe3c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 0x7efe3c0ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c167c90 con 0x7efe3c066e00 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c167f70 con 0x7efe3c0626f0 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c168250 con 0x7efe3c062b70 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35554/0 (socket says 172.21.15.133:35554) 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 -- 172.21.15.133:0/596763993 learned_addr learned my addr 172.21.15.133:0/596763993 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3b7fe700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe3c0626f0 0x7efe3c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3affd700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 0x7efe3c0ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 -- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 msgr2=0x7efe3c0ad740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 0x7efe3c0ad740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 -- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe3c0626f0 msgr2=0x7efe3c147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe3c0626f0 0x7efe3c147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 -- 172.21.15.133:0/596763993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009370 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3affd700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 0x7efe3c0ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe3bfff700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7efe34009fa0 tx=0x7efe34009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ec70 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400edd0 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.337+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c168530 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.338+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34014610 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.338+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c147c40 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.339+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c1688a0 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.339+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7efe3401d3b0 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.339+0000 7efe33fff700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 0x7efe1c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.339+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7efe3407a990 con 0x7efe3c066e00 2024-01-21T21:15:23.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.339+0000 7efe3b7fe700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 0x7efe1c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.340+0000 7efe3b7fe700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 0x7efe1c061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efe2c00b3c0 tx=0x7efe2c017000).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.343+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7efe3404b970 con 0x7efe3c066e00 2024-01-21T21:15:23.502 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:15:23.501+0000 7fbba7eb9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:15:23.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.532+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efe3c1680e0 con 0x7efe1c05f150 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.534+0000 7efe33fff700 1 -- 172.21.15.133:0/596763993 <== mgr.8874 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7efe3c1680e0 con 0x7efe1c05f150 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:15:23.535 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:15:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 msgr2=0x7efe1c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 0x7efe1c061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7efe2c00b3c0 tx=0x7efe2c017000).stop 2024-01-21T21:15:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 msgr2=0x7efe3c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7efe34009fa0 tx=0x7efe34009900).stop 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 shutdown_connections 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7efe1c05f150 0x7efe1c061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe3c066e00 0x7efe3c0c6d70 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe3c0626f0 0x7efe3c147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.535+0000 7efe41e7a700 1 --2- 172.21.15.133:0/596763993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe3c062b70 0x7efe3c0ad740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.536+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 >> 172.21.15.133:0/596763993 conn(0x7efe3c0c7dc0 msgr2=0x7efe3c1518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.536+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 shutdown_connections 2024-01-21T21:15:23.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.536+0000 7efe41e7a700 1 -- 172.21.15.133:0/596763993 wait complete. 2024-01-21T21:15:23.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T21:15:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.670+0000 7faa34233700 1 Processor -- start 2024-01-21T21:15:23.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.670+0000 7faa34233700 1 -- start start 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa34233700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa2c0a9ac0 0x7faa2c0be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa34233700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0bfa40 con 0x7faa2c0c3c10 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa34233700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0bee30 con 0x7faa2c13b970 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa34233700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c0bf110 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa317ce700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faa2c0c3c10 0x7faa2c0be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39120/0 (socket says 172.21.15.133:39120) 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa317ce700 1 -- 172.21.15.133:0/3004010374 learned_addr learned my addr 172.21.15.133:0/3004010374 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa327d0700 1 --2- 172.21.15.133:0/3004010374 >> v2:172.21.15.178:3300/0 conn(0x7faa2c0a9ac0 0x7faa2c0be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550848401 0 0) 0x7faa2c0bfa40 con 0x7faa2c0c3c10 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa180033f0 con 0x7faa2c0c3c10 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49941184 0 0) 0x7faa180033f0 con 0x7faa2c0c3c10 2024-01-21T21:15:23.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa327d0700 1 -- 172.21.15.133:0/3004010374 >> v1:172.21.15.178:6789/0 conn(0x7faa2c13b970 legacy=0x7faa2c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa327d0700 1 -- 172.21.15.133:0/3004010374 >> v1:172.21.15.133:6789/0 conn(0x7faa2c0c3c10 legacy=0x7faa2c0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.671+0000 7faa327d0700 1 -- 172.21.15.133:0/3004010374 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0bf3f0 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa327d0700 1 --2- 172.21.15.133:0/3004010374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0a9ac0 0x7faa2c0be810 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7faa24009e60 tx=0x7faa24009780).ready entity=mon.1 client_cookie=cf1aa080fdd7cd37 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400e070 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400b850 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa30fcd700 1 -- 172.21.15.133:0/3004010374 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c001470 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 -- 172.21.15.133:0/3004010374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0a9ac0 msgr2=0x7faa2c0be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 --2- 172.21.15.133:0/3004010374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0a9ac0 0x7faa2c0be810 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7faa24009e60 tx=0x7faa24009780).stop 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 -- 172.21.15.133:0/3004010374 shutdown_connections 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 --2- 172.21.15.133:0/3004010374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0a9ac0 0x7faa2c0be810 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 -- 172.21.15.133:0/3004010374 >> 172.21.15.133:0/3004010374 conn(0x7faa2c066a70 msgr2=0x7faa2c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 -- 172.21.15.133:0/3004010374 shutdown_connections 2024-01-21T21:15:23.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.672+0000 7faa34233700 1 -- 172.21.15.133:0/3004010374 wait complete. 2024-01-21T21:15:23.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 Processor -- start 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 -- start start 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2c0a9ac0 0x7faa2c133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0c3c10 0x7faa2c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c068750 con 0x7faa2c13b970 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c135040 con 0x7faa2c0c3c10 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa34233700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c134430 con 0x7faa2c0a9ac0 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa327d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa327d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35568/0 (socket says 172.21.15.133:35568) 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.674+0000 7faa327d0700 1 -- 172.21.15.133:0/4176893830 learned_addr learned my addr 172.21.15.133:0/4176893830 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa317ce700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0c3c10 0x7faa2c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa31fcf700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2c0a9ac0 0x7faa2c133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 -- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2c0a9ac0 msgr2=0x7faa2c133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2c0a9ac0 0x7faa2c133400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 -- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0c3c10 msgr2=0x7faa2c067d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0c3c10 0x7faa2c067d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 -- 172.21.15.133:0/4176893830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24009a20 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa327d0700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7faa2c06a220 tx=0x7faa2c1527f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24013e60 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa240096f0 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c134710 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2401e6a0 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.675+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c134cd0 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.676+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c1351d0 con 0x7faa2c13b970 2024-01-21T21:15:23.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.676+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 77) v1 ==== 75446+0+0 (secure 0 0 0) 0x7faa24003030 con 0x7faa2c13b970 2024-01-21T21:15:23.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.677+0000 7faa227fc700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 0x7faa10061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:23.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.677+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7faa2407bb00 con 0x7faa2c13b970 2024-01-21T21:15:23.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.677+0000 7faa31fcf700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 0x7faa10061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:23.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.677+0000 7faa31fcf700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 0x7faa10061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa28003960 tx=0x7faa28007d40).ready entity=mgr.8874 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:23.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.681+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7faa2404cae0 con 0x7faa2c13b970 2024-01-21T21:15:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:23.889+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7faa2c0bf6d0 con 0x7faa2c13b970 2024-01-21T21:15:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.611+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 78) v1 ==== 75463+0+0 (secure 0 0 0) 0x7faa24079640 con 0x7faa2c13b970 2024-01-21T21:15:24.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.611+0000 7faa227fc700 1 -- 172.21.15.133:0/4176893830 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v78) v1 ==== 92+0+0 (secure 0 0 0) 0x7faa24042980 con 0x7faa2c13b970 2024-01-21T21:15:24.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.614+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 msgr2=0x7faa10061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.614+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 0x7faa10061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faa28003960 tx=0x7faa28007d40).stop 2024-01-21T21:15:24.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.614+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 msgr2=0x7faa2c068260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.614+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 rx=0x7faa2c06a220 tx=0x7faa2c1527f0).stop 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 shutdown_connections 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7faa1005f150 0x7faa10061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa2c13b970 0x7faa2c068260 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa2c0a9ac0 0x7faa2c133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 --2- 172.21.15.133:0/4176893830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa2c0c3c10 0x7faa2c067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 >> 172.21.15.133:0/4176893830 conn(0x7faa2c066a70 msgr2=0x7faa2c0adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 shutdown_connections 2024-01-21T21:15:24.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.615+0000 7faa34233700 1 -- 172.21.15.133:0/4176893830 wait complete. 2024-01-21T21:15:24.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T21:15:24.754 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:24.752+0000 7fd07120c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:15:24.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.756+0000 7fc83ab11700 1 Processor -- start 2024-01-21T21:15:24.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.756+0000 7fc83ab11700 1 -- start start 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc83ab11700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 0x7fc834158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc83ab11700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340c0e40 con 0x7fc834154140 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc83ab11700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc834154980 con 0x7fc834154520 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc83ab11700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c6ae0 con 0x7fc8340c8120 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8388ad700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc834154140 0x7fc8340c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39138/0 (socket says 172.21.15.133:39138) 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8388ad700 1 -- 172.21.15.133:0/1007158897 learned_addr learned my addr 172.21.15.133:0/1007158897 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc833fff700 1 --2- 172.21.15.133:0/1007158897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 0x7fc834158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887854663 0 0) 0x7fc8340c0e40 con 0x7fc834154140 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8240033f0 con 0x7fc834154140 2024-01-21T21:15:24.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704815127 0 0) 0x7fc834154980 con 0x7fc834154520 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8340c0e40 con 0x7fc834154520 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc833fff700 1 -- 172.21.15.133:0/1007158897 >> v1:172.21.15.178:6789/0 conn(0x7fc834154520 legacy=0x7fc8340c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc833fff700 1 -- 172.21.15.133:0/1007158897 >> v1:172.21.15.133:6789/0 conn(0x7fc834154140 legacy=0x7fc8340c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533723962 0 0) 0x7fc8240033f0 con 0x7fc834154140 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc833fff700 1 -- 172.21.15.133:0/1007158897 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340c6800 con 0x7fc8340c8120 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.757+0000 7fc833fff700 1 --2- 172.21.15.133:0/1007158897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 0x7fc834158bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc820009790 tx=0x7fc820009060).ready entity=mon.2 client_cookie=d9ed92f190e17e56 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828001470 con 0x7fc8340c8120 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc820011400 con 0x7fc8340c8120 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc8337fe700 1 -- 172.21.15.133:0/1007158897 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820011780 con 0x7fc8340c8120 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 -- 172.21.15.133:0/1007158897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 msgr2=0x7fc834158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 --2- 172.21.15.133:0/1007158897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 0x7fc834158bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fc820009790 tx=0x7fc820009060).stop 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 -- 172.21.15.133:0/1007158897 shutdown_connections 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 --2- 172.21.15.133:0/1007158897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340c8120 0x7fc834158bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 -- 172.21.15.133:0/1007158897 >> 172.21.15.133:0/1007158897 conn(0x7fc83405e1e0 msgr2=0x7fc83405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:24.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 -- 172.21.15.133:0/1007158897 shutdown_connections 2024-01-21T21:15:24.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.758+0000 7fc83ab11700 1 -- 172.21.15.133:0/1007158897 wait complete. 2024-01-21T21:15:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.760+0000 7fc83ab11700 1 Processor -- start 2024-01-21T21:15:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.760+0000 7fc83ab11700 1 -- start start 2024-01-21T21:15:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 0x7fc83414d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340b0120 con 0x7fc834154520 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834165490 con 0x7fc8340c8120 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc83ab11700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc834165770 con 0x7fc834154140 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc8390ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc833fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc8388ad700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 0x7fc83414d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:24.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc8390ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35576/0 (socket says 172.21.15.133:35576) 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc8390ae700 1 -- 172.21.15.133:0/624498496 learned_addr learned my addr 172.21.15.133:0/624498496 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.761+0000 7fc833fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:53970/0 (socket says 172.21.15.133:53970) 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 -- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 msgr2=0x7fc834164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 -- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 msgr2=0x7fc83414d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 0x7fc83414d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 -- 172.21.15.133:0/624498496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200092a0 con 0x7fc834154520 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc833fff700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8388ad700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 0x7fc83414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8390ae700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fc82c00c7c0 tx=0x7fc82c00cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c002020 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c002180 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834165a50 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c001590 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.762+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83414d500 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.763+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8340b05b0 con 0x7fc834154520 2024-01-21T21:15:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.763+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 78) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fc82c001980 con 0x7fc834154520 2024-01-21T21:15:24.768 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:24.764+0000 7f2d7e6c6680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:15:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.764+0000 7fc8317fa700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 0x7fc818061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.764+0000 7fc8388ad700 1 -- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 msgr2=0x7fc818061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.764+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc82c079b10 con 0x7fc834154520 2024-01-21T21:15:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.764+0000 7fc8388ad700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 0x7fc818061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:24.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.768+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc82c047b00 con 0x7fc834154520 2024-01-21T21:15:24.818 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:24.816+0000 7fd07120c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:15:24.831 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:24.829+0000 7f2d7e6c6680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:15:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.941+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc83405fdf0 con 0x7fc834154520 2024-01-21T21:15:24.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.944+0000 7fc8317fa700 1 -- 172.21.15.133:0/624498496 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8340b05b0 con 0x7fc834154520 2024-01-21T21:15:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 msgr2=0x7fc818061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:24.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 0x7fc818061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 msgr2=0x7fc8340b0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7fc82c00c7c0 tx=0x7fc82c00cad0).stop 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 shutdown_connections 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc81805f1a0 0x7fc818061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc834154520 0x7fc8340b0890 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340c8120 0x7fc83414d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 --2- 172.21.15.133:0/624498496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc834154140 0x7fc834164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 >> 172.21.15.133:0/624498496 conn(0x7fc83405e1e0 msgr2=0x7fc83414d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 shutdown_connections 2024-01-21T21:15:24.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:24.946+0000 7fc83ab11700 1 -- 172.21.15.133:0/624498496 wait complete. 2024-01-21T21:15:24.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:15:24.960 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T21:15:24.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:15:24.982 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2024-01-21T21:15:25.040 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2024-01-21T21:15:25.096 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:25.095+0000 7fd07120c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:15:25.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:25.117+0000 7f2d7e6c6680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:15:25.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.205+0000 7fc25f5d4700 1 Processor -- start 2024-01-21T21:15:25.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.205+0000 7fc25f5d4700 1 -- start start 2024-01-21T21:15:25.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc258066b50 0x7fc258066f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2580bdec0 0x7fc258153e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc258158ed0 con 0x7fc258066b50 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580c5820 con 0x7fc2580bdec0 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25f5d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580c37c0 con 0x7fc258157f30 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25d370700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc258066b50 0x7fc258066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25d370700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc258066b50 0x7fc258066f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35578/0 (socket says 172.21.15.133:35578) 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25d370700 1 -- 172.21.15.133:0/3461797445 learned_addr learned my addr 172.21.15.133:0/3461797445 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25db71700 1 --2- 172.21.15.133:0/3461797445 >> v2:172.21.15.178:3300/0 conn(0x7fc2580bdec0 0x7fc258153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.206+0000 7fc25cb6f700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 -- 172.21.15.133:0/3461797445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 msgr2=0x7fc2580c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 -- 172.21.15.133:0/3461797445 >> v2:172.21.15.178:3300/0 conn(0x7fc2580bdec0 msgr2=0x7fc258153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 --2- 172.21.15.133:0/3461797445 >> v2:172.21.15.178:3300/0 conn(0x7fc2580bdec0 0x7fc258153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 -- 172.21.15.133:0/3461797445 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2581583b0 con 0x7fc258066b50 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc25d370700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc258066b50 0x7fc258066f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fc2580c9e50 tx=0x7fc2540090f0).ready entity=mon.0 client_cookie=137335a893c311cf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc24ffff700 1 -- 172.21.15.133:0/3461797445 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400f510 con 0x7fc258066b50 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc24ffff700 1 -- 172.21.15.133:0/3461797445 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400f670 con 0x7fc258066b50 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.207+0000 7fc24ffff700 1 -- 172.21.15.133:0/3461797445 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400f9f0 con 0x7fc258066b50 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 -- 172.21.15.133:0/3461797445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc258066b50 msgr2=0x7fc258066f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc258066b50 0x7fc258066f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fc2580c9e50 tx=0x7fc2540090f0).stop 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 -- 172.21.15.133:0/3461797445 shutdown_connections 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/3461797445 >> v2:172.21.15.178:3300/0 conn(0x7fc2580bdec0 0x7fc258153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc258066b50 0x7fc258066f30 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/3461797445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 -- 172.21.15.133:0/3461797445 >> 172.21.15.133:0/3461797445 conn(0x7fc2580c8f60 msgr2=0x7fc2580c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 -- 172.21.15.133:0/3461797445 shutdown_connections 2024-01-21T21:15:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.208+0000 7fc25f5d4700 1 -- 172.21.15.133:0/3461797445 wait complete. 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.209+0000 7fc25f5d4700 1 Processor -- start 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.209+0000 7fc25f5d4700 1 -- start start 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258066b50 0x7fc258153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580c0ae0 con 0x7fc2580bdec0 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580c1c40 con 0x7fc258066b50 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25f5d4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580c1990 con 0x7fc258157f30 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35582/0 (socket says 172.21.15.133:35582) 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 -- 172.21.15.133:0/1007358777 learned_addr learned my addr 172.21.15.133:0/1007358777 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258066b50 0x7fc258153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25db71700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 msgr2=0x7fc2580639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258066b50 msgr2=0x7fc258153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258066b50 0x7fc258153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009370 con 0x7fc2580bdec0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc25cb6f700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fc24800e930 tx=0x7fc248009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248012600 con 0x7fc2580bdec0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.211+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248012760 con 0x7fc2580bdec0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.212+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248012ae0 con 0x7fc2580bdec0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.212+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2580c01b0 con 0x7fc2580bdec0 2024-01-21T21:15:25.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.212+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2580c0770 con 0x7fc2580bdec0 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2580c0c90 con 0x7fc2580bdec0 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 78) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fc24801b400 con 0x7fc2580bdec0 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc24dffb700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fc24807a780 con 0x7fc2580bdec0 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc25d370700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:25.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.213+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:15:25.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.218+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc2580c0c90 con 0x7fc2580bdec0 2024-01-21T21:15:25.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.414+0000 7fc25d370700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:25.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.414+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:15:25.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.417+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2580c0c90 con 0x7fc23c05f1d0 2024-01-21T21:15:25.717 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:25.716+0000 7fd07120c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:15:25.749 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:25.747+0000 7f2d7e6c6680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:15:25.789 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:25.788+0000 7fd07120c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:15:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.815+0000 7fc25d370700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:25.815+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T21:15:25.821 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:25.820+0000 7f2d7e6c6680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:15:25.975 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:25.975+0000 7fd07120c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:15:26.008 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.007+0000 7f2d7e6c6680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:15:26.395 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:26.394+0000 7fd07120c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:15:26.438 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.436+0000 7f2d7e6c6680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:15:26.498 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:26.497+0000 7fd07120c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:26.541 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.539+0000 7f2d7e6c6680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:26.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:26.616+0000 7fc25d370700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:26.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:26.616+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T21:15:26.652 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:26.651+0000 7fd07120c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:26.695 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.693+0000 7f2d7e6c6680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:26.726 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:26.726+0000 7fd07120c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:15:26.769 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.768+0000 7f2d7e6c6680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:15:26.793 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:26.792+0000 7fd07120c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:15:26.836 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:26.835+0000 7f2d7e6c6680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:15:27.049 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:27.048+0000 7fd07120c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:15:27.091 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:27.089+0000 7f2d7e6c6680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:15:27.231 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:27.231+0000 7fd07120c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:27.274 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:27.273+0000 7f2d7e6c6680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:15:27.883 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:27.882+0000 7fd07120c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:15:27.924 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:27.923+0000 7f2d7e6c6680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:15:27.952 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:27.951+0000 7fd07120c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:15:27.993 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:27.991+0000 7f2d7e6c6680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:15:28.027 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.026+0000 7fd07120c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:15:28.068 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.066+0000 7f2d7e6c6680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:15:28.174 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.173+0000 7fd07120c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:15:28.215 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.214+0000 7f2d7e6c6680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:15:28.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:28.217+0000 7fc25d370700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/43404 2024-01-21T21:15:28.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:28.217+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T21:15:28.244 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.244+0000 7fd07120c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:15:28.286 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.285+0000 7f2d7e6c6680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:15:28.359 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.359+0000 7fd07120c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:15:28.401 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.400+0000 7f2d7e6c6680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:15:28.468 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.467+0000 7fd07120c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:28.509 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.508+0000 7f2d7e6c6680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:15:28.759 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.758+0000 7fd07120c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:15:28.801 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.799+0000 7f2d7e6c6680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:15:28.831 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:15:28.830+0000 7fd07120c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:15:28.872 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.871+0000 7f2d7e6c6680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:15:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:28.890+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 79) v1 ==== 75287+0+0 (secure 0 0 0) 0x7fc2480782c0 con 0x7fc2580bdec0 2024-01-21T21:15:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:28.891+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:15:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:28.891+0000 7fc24dffb700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:15:28.961 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.959+0000 7f2cf2466700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.961 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.959+0000 7f2cf2466700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.961 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.959+0000 7f2cf2466700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.961 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.959+0000 7f2cf2466700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.961 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.959+0000 7f2cf2466700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.962 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.960+0000 7f2cf4c6b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.962 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.960+0000 7f2cf4c6b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.962 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.960+0000 7f2cf4c6b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.962 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.960+0000 7f2cf4c6b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:28.962 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:15:28.960+0000 7f2cf4c6b700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:15:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.902+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 80) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fc248078640 con 0x7fc2580bdec0 2024-01-21T21:15:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.903+0000 7fc24dffb700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.903+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2580c0c90 con 0x7fc23c05f1d0 2024-01-21T21:15:29.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.904+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:29.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.905+0000 7fc25d370700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc254008000 tx=0x7fc254017000).ready entity=mgr.9240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:29.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.917+0000 7fc24dffb700 1 -- 172.21.15.133:0/1007358777 <== mgr.9240 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc2580c0c90 con 0x7fc23c05f1d0 2024-01-21T21:15:29.918 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path /snap_test_dir1/test_restart 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 msgr2=0x7fc23c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc254008000 tx=0x7fc254017000).stop 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 msgr2=0x7fc2580c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 rx=0x7fc24800e930 tx=0x7fc248009060).stop 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 shutdown_connections 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fc23c05f1d0 0x7fc23c061610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:29.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc258157f30 0x7fc2580639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc258066b50 0x7fc258153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 --2- 172.21.15.133:0/1007358777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2580bdec0 0x7fc2580c14a0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 >> 172.21.15.133:0/1007358777 conn(0x7fc2580c8f60 msgr2=0x7fc2580adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 shutdown_connections 2024-01-21T21:15:29.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:29.919+0000 7fc25f5d4700 1 -- 172.21.15.133:0/1007358777 wait complete. 2024-01-21T21:15:29.933 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2024-01-21T21:15:29.933 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2024-01-21T21:15:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.094+0000 7fca4e78d700 1 Processor -- start 2024-01-21T21:15:30.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.094+0000 7fca4e78d700 1 -- start start 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4e78d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 0x7fca48063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4e78d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4e78d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca480667c0 con 0x7fca480bc400 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4e78d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca48065e90 con 0x7fca480638c0 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4e78d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca48066170 con 0x7fca480bc8b0 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca47fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 0x7fca48063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54096/0 (socket says 172.21.15.133:54096) 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca47fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 0x7fca48063ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:37130/0 (socket says 172.21.15.133:37130) 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 -- 172.21.15.133:0/1170045061 learned_addr learned my addr 172.21.15.133:0/1170045061 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 -- 172.21.15.133:0/1170045061 >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 msgr2=0x7fca48063ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:15:30.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 --2- 172.21.15.133:0/1170045061 >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 0x7fca48063ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 -- 172.21.15.133:0/1170045061 >> v1:172.21.15.178:6789/0 conn(0x7fca480bc400 legacy=0x7fca48066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 -- 172.21.15.133:0/1170045061 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca48066450 con 0x7fca480bc8b0 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.095+0000 7fca4cd2a700 1 --2- 172.21.15.133:0/1170045061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fca40009f20 tx=0x7fca40009840).ready entity=mon.2 client_cookie=18039988c89bd6e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca46ffd700 1 -- 172.21.15.133:0/1170045061 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000e070 con 0x7fca480bc8b0 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca46ffd700 1 -- 172.21.15.133:0/1170045061 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4000b9d0 con 0x7fca480bc8b0 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca46ffd700 1 -- 172.21.15.133:0/1170045061 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4000bd50 con 0x7fca480bc8b0 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 -- 172.21.15.133:0/1170045061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 msgr2=0x7fca480c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 --2- 172.21.15.133:0/1170045061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fca40009f20 tx=0x7fca40009840).stop 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 -- 172.21.15.133:0/1170045061 shutdown_connections 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 --2- 172.21.15.133:0/1170045061 >> v2:172.21.15.178:3300/0 conn(0x7fca480638c0 0x7fca48063ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 --2- 172.21.15.133:0/1170045061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca480c2bc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 -- 172.21.15.133:0/1170045061 >> 172.21.15.133:0/1170045061 conn(0x7fca480c4a10 msgr2=0x7fca48068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:30.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 -- 172.21.15.133:0/1170045061 shutdown_connections 2024-01-21T21:15:30.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.096+0000 7fca4e78d700 1 -- 172.21.15.133:0/1170045061 wait complete. 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.097+0000 7fca4e78d700 1 Processor -- start 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 -- start start 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 0x7fca480a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca48141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480a5d30 con 0x7fca480bc400 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca480a61c0 con 0x7fca480638c0 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca4e78d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca480a5120 con 0x7fca480bc8b0 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35678/0 (socket says 172.21.15.133:35678) 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.098+0000 7fca477fe700 1 -- 172.21.15.133:0/2073465207 learned_addr learned my addr 172.21.15.133:0/2073465207 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca47fff700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 0x7fca480a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca4cd2a700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca48141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 -- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 msgr2=0x7fca48141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca48141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 -- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 msgr2=0x7fca480a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 0x7fca480a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 -- 172.21.15.133:0/2073465207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40009ae0 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca47fff700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 0x7fca480a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca477fe700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fca3c00c440 tx=0x7fca3c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00f470 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c00f5d0 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00f970 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca480a5400 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.099+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca480a59c0 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.100+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca480a5ea0 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.100+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 80) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fca3c01b3b0 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.101+0000 7fca44ff9700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 0x7fca34061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.101+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6949+0+0 (secure 0 0 0) 0x7fca3c079780 con 0x7fca480bc400 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.101+0000 7fca47fff700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 0x7fca34061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:15:30.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.101+0000 7fca47fff700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 0x7fca34061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca480ad400 tx=0x7fca38008040).ready entity=mgr.9240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:15:30.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.105+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fca3c048b00 con 0x7fca480bc400 2024-01-21T21:15:30.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.291+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fca4805fdf0 con 0x7fca3405f080 2024-01-21T21:15:30.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.296+0000 7fca44ff9700 1 -- 172.21.15.133:0/2073465207 <== mgr.9240 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7fca4805fdf0 con 0x7fca3405f080 2024-01-21T21:15:30.297 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule activated for path /snap_test_dir1/test_restart 2024-01-21T21:15:30.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.297+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 msgr2=0x7fca34061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.297+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 0x7fca34061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fca480ad400 tx=0x7fca38008040).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.297+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 msgr2=0x7fca480a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.297+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7fca3c00c440 tx=0x7fca3c007dc0).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 shutdown_connections 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fca3405f080 0x7fca34061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca480bc8b0 0x7fca48141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca480638c0 0x7fca480a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 --2- 172.21.15.133:0/2073465207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca480bc400 0x7fca480a96e0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 >> 172.21.15.133:0/2073465207 conn(0x7fca480c4a10 msgr2=0x7fca480c2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 shutdown_connections 2024-01-21T21:15:30.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:15:30.298+0000 7fca4e78d700 1 -- 172.21.15.133:0/2073465207 wait complete. 2024-01-21T21:15:30.311 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2024-01-21T21:15:33.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:15:33.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:16:00.302 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:16:00.300+0000 7f2ce444a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:16:00.303 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:16:00.300+0000 7f2ce444a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:16:00.303 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:16:00.300+0000 7f2ce444a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:16:00.303 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:16:00.300+0000 7f2ce444a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:16:00.303 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:16:00.300+0000 7f2ce444a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:16:04.082 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:16:04.085 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:16:34.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:16:34.206 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:17:04.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:17:04.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:17:34.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:17:34.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:18:04.658 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:18:04.661 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:18:34.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:18:34.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:19:04.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:19:04.944 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:19:35.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:19:35.049 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:20:05.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:20:05.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:20:35.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:20:35.350 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:21:05.500 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:21:05.504 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:21:35.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:21:35.625 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:22:05.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:22:05.782 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:22:35.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:22:35.925 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:23:06.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:23:06.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:23:36.159 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:23:36.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:24:06.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:24:06.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:24:36.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:24:36.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:25:06.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:25:06.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:25:36.772 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:25:36.776 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:26:06.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:26:06.905 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:26:16.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:26:16.313 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_16_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_17_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_18_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_19_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_20_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_21_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_22_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_23_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_24_00_UTC 2024-01-21T21:26:16.337 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_25_00_UTC 2024-01-21T21:26:16.338 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_26_00_UTC 2024-01-21T21:26:16.338 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-21_16_00_UTC', 'scheduled-2024-01-21-21_17_00_UTC', 'scheduled-2024-01-21-21_18_00_UTC', 'scheduled-2024-01-21-21_19_00_UTC', 'scheduled-2024-01-21-21_20_00_UTC', 'scheduled-2024-01-21-21_21_00_UTC', 'scheduled-2024-01-21-21_22_00_UTC', 'scheduled-2024-01-21-21_23_00_UTC', 'scheduled-2024-01-21-21_24_00_UTC', 'scheduled-2024-01-21-21_25_00_UTC', 'scheduled-2024-01-21-21_26_00_UTC'] 2024-01-21T21:26:16.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2024-01-21T21:26:16.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.503+0000 7f7b2eedd700 1 Processor -- start 2024-01-21T21:26:16.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.503+0000 7f7b2eedd700 1 -- start start 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b2eedd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b280aa0f0 0x7f7b280aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b2eedd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b280694d0 0x7f7b28066240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b2eedd700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b28069a40 con 0x7f7b28151bc0 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b2eedd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b28069d20 con 0x7f7b280694d0 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b2eedd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2806a000 con 0x7f7b280aa0f0 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b280694d0 0x7f7b28066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b280694d0 0x7f7b28066240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38894/0 (socket says 172.21.15.133:38894) 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 -- 172.21.15.133:0/1442525188 learned_addr learned my addr 172.21.15.133:0/1442525188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 -- 172.21.15.133:0/1442525188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b280aa0f0 msgr2=0x7f7b280aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 --2- 172.21.15.133:0/1442525188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b280aa0f0 0x7f7b280aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 -- 172.21.15.133:0/1442525188 >> v1:172.21.15.178:6789/0 conn(0x7f7b28151bc0 legacy=0x7f7b28152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 -- 172.21.15.133:0/1442525188 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2806a2e0 con 0x7f7b280694d0 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b27fff700 1 --2- 172.21.15.133:0/1442525188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28066240 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f7b14006fd0 tx=0x7f7b140090f0).ready entity=mon.0 client_cookie=d66c97428cce2d28 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b277fe700 1 -- 172.21.15.133:0/1442525188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400b600 con 0x7f7b280694d0 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b277fe700 1 -- 172.21.15.133:0/1442525188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1400b760 con 0x7f7b280694d0 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.504+0000 7f7b277fe700 1 -- 172.21.15.133:0/1442525188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400bae0 con 0x7f7b280694d0 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 -- 172.21.15.133:0/1442525188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 msgr2=0x7f7b28066240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/1442525188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28066240 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f7b14006fd0 tx=0x7f7b140090f0).stop 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 -- 172.21.15.133:0/1442525188 shutdown_connections 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/1442525188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b280aa0f0 0x7f7b280aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:26:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/1442525188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28066240 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 -- 172.21.15.133:0/1442525188 >> 172.21.15.133:0/1442525188 conn(0x7f7b280c7d20 msgr2=0x7f7b280c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:26:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 -- 172.21.15.133:0/1442525188 shutdown_connections 2024-01-21T21:26:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.505+0000 7f7b2eedd700 1 -- 172.21.15.133:0/1442525188 wait complete. 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.506+0000 7f7b2eedd700 1 Processor -- start 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.506+0000 7f7b2eedd700 1 -- start start 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b280aa0f0 0x7f7b2814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 0x7f7b2814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280ad3b0 con 0x7f7b280694d0 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28150300 con 0x7f7b280aa0f0 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2eedd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280ac7a0 con 0x7f7b28151bc0 2024-01-21T21:26:16.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2cc79700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2cc79700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38906/0 (socket says 172.21.15.133:38906) 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2cc79700 1 -- 172.21.15.133:0/2387199986 learned_addr learned my addr 172.21.15.133:0/2387199986 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b2d47a700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 0x7f7b2814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.507+0000 7f7b27fff700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b280aa0f0 0x7f7b2814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 -- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 msgr2=0x7f7b2814b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 0x7f7b2814b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 -- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b280aa0f0 msgr2=0x7f7b2814fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b280aa0f0 0x7f7b2814fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 -- 172.21.15.133:0/2387199986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009370 con 0x7f7b280694d0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2d47a700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 0x7f7b2814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2cc79700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f7b1c00b530 tx=0x7f7b1c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00d4a0 con 0x7f7b280694d0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00d620 con 0x7f7b280694d0 2024-01-21T21:26:16.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280aca80 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00d9e0 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.508+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b280ad040 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.509+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b28150e30 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.509+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 83) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f7b1c012410 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.509+0000 7f7b257fa700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 0x7f7b0c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.510+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7036+0+0 (secure 0 0 0) 0x7f7b1c07a6f0 con 0x7f7b280694d0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.510+0000 7f7b27fff700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 0x7f7b0c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.510+0000 7f7b27fff700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 0x7f7b0c061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7b14006fd0 tx=0x7f7b14017000).ready entity=mgr.9240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.514+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7b1c04b450 con 0x7f7b280694d0 2024-01-21T21:26:16.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.700+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 --> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b2805fdf0 con 0x7f7b0c05f2c0 2024-01-21T21:26:16.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.702+0000 7f7b257fa700 1 -- 172.21.15.133:0/2387199986 <== mgr.9240 v2:172.21.15.133:6832/43404 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f7b2805fdf0 con 0x7f7b0c05f2c0 2024-01-21T21:26:16.704 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:26:16.704 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T21:15:29", "first": "2024-01-21T21:16:00", "last": "2024-01-21T21:26:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 msgr2=0x7f7b0c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 0x7f7b0c061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f7b14006fd0 tx=0x7f7b14017000).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 msgr2=0x7f7b28146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f7b1c00b530 tx=0x7f7b1c0090f0).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 shutdown_connections 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7f7b0c05f2c0 0x7f7b0c061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b28151bc0 0x7f7b2814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b280694d0 0x7f7b28146b70 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 --2- 172.21.15.133:0/2387199986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b280aa0f0 0x7f7b2814fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.703+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 >> 172.21.15.133:0/2387199986 conn(0x7f7b280c7d20 msgr2=0x7f7b280a81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.704+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 shutdown_connections 2024-01-21T21:26:16.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.704+0000 7f7b2eedd700 1 -- 172.21.15.133:0/2387199986 wait complete. 2024-01-21T21:26:16.717 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T21:15:29", "first": "2024-01-21T21:16:00", "last": "2024-01-21T21:26:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2024-01-21T21:26:16.718 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T21:15:29', 'first': '2024-01-21T21:16:00', 'last': '2024-01-21T21:26:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2024-01-21T21:26:16.718 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-01-21T21:26:16.718 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-01-21T21:26:16.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-21T21:26:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.832+0000 7fb5de5f5700 1 Processor -- start 2024-01-21T21:26:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.832+0000 7fb5de5f5700 1 -- start start 2024-01-21T21:26:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5de5f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5d80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5de5f5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5d80c6220 0x7fb5d80bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5de5f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d8067f10 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5de5f5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80681f0 con 0x7fb5d80c6220 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5de5f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80684d0 con 0x7fb5d80c3840 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5d77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5d80c5dc0 0x7fb5d813a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45752/0 (socket says 172.21.15.133:45752) 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.833+0000 7fb5d77fe700 1 -- 172.21.15.133:0/4165353737 learned_addr learned my addr 172.21.15.133:0/4165353737 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/4165353737 >> v2:172.21.15.178:3300/0 conn(0x7fb5d80c6220 0x7fb5d80bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d7fff700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5d80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056159576 0 0) 0x7fb5d8067f10 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c40033f0 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2666084220 0 0) 0x7fb5c40033f0 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 msgr2=0x7fb5d80c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5d80c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 >> v2:172.21.15.178:3300/0 conn(0x7fb5d80c6220 msgr2=0x7fb5d80bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 --2- 172.21.15.133:0/4165353737 >> v2:172.21.15.178:3300/0 conn(0x7fb5d80c6220 0x7fb5d80bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80687b0 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb5c8001470 con 0x7fb5d80c5dc0 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 >> v1:172.21.15.133:6789/0 conn(0x7fb5d80c5dc0 legacy=0x7fb5d813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c40038e0 0x7fb5c4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5c4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5c4004b80 0x7fb5c4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80681f0 con 0x7fb5c4004b80 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d80684d0 con 0x7fb5c40038e0 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c400b8e0 con 0x7fb5d80c3840 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5c4004b80 0x7fb5c4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d77fe700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5c4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5d7fff700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c40038e0 0x7fb5c4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 -- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 msgr2=0x7fb5c4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d80c3840 0x7fb5c4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 -- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c40038e0 msgr2=0x7fb5c4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c40038e0 0x7fb5c4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.834+0000 7fb5dcb92700 1 -- 172.21.15.133:0/4165353737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40033f0 con 0x7fb5c4004b80 2024-01-21T21:26:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5c4004b80 0x7fb5c4005000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fb5d000e210 tx=0x7fb5d000b040).ready entity=mon.0 client_cookie=5aceed1223242e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0009ac0 con 0x7fb5c4004b80 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d000f040 con 0x7fb5c4004b80 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5d6ffd700 1 -- 172.21.15.133:0/4165353737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000ecd0 con 0x7fb5c4004b80 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 -- 172.21.15.133:0/4165353737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5c4004b80 msgr2=0x7fb5c4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/4165353737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5c4004b80 0x7fb5c4005000 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fb5d000e210 tx=0x7fb5d000b040).stop 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5dcb92700 1 -- 172.21.15.133:0/4165353737 reap_dead start 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 -- 172.21.15.133:0/4165353737 shutdown_connections 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 -- 172.21.15.133:0/4165353737 >> 172.21.15.133:0/4165353737 conn(0x7fb5d8066a70 msgr2=0x7fb5d8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 -- 172.21.15.133:0/4165353737 shutdown_connections 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.835+0000 7fb5de5f5700 1 -- 172.21.15.133:0/4165353737 wait complete. 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.836+0000 7fb5de5f5700 1 Processor -- start 2024-01-21T21:26:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 -- start start 2024-01-21T21:26:16.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d8152be0 0x7fb5d813c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 0x7fb5d8063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8157ba0 con 0x7fb5d8152fc0 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d813d660 con 0x7fb5d813daf0 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.837+0000 7fb5de5f5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d813ca50 con 0x7fb5d8152be0 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38930/0 (socket says 172.21.15.133:38930) 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 -- 172.21.15.133:0/1519652983 learned_addr learned my addr 172.21.15.133:0/1519652983 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 0x7fb5d8063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 -- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d8152be0 msgr2=0x7fb5d813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d8152be0 0x7fb5d813c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 -- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 msgr2=0x7fb5d8063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 0x7fb5d8063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 -- 172.21.15.133:0/1519652983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d813cd30 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5dcb92700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 0x7fb5d8063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d77fe700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fb5c8007fd0 tx=0x7fb5d81548e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800f610 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c800f770 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d813d010 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c800faf0 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.838+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d813df50 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.839+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d805fdf0 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.839+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 83) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fb5c801d3b0 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.840+0000 7fb5d4ff9700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 0x7fb5b8061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.840+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 7036+0+0 (secure 0 0 0) 0x7fb5c807a140 con 0x7fb5d8152fc0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.840+0000 7fb5d7fff700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 0x7fb5b8061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:26:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.840+0000 7fb5d7fff700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 0x7fb5b8061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb5c0006d30 tx=0x7fb5c0009060).ready entity=mgr.9240 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:26:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:16.844+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5c804af50 con 0x7fb5d8152fc0 2024-01-21T21:26:17.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.049+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb5d813d7d0 con 0x7fb5d8152fc0 2024-01-21T21:26:17.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.052+0000 7fb5d4ff9700 1 -- 172.21.15.133:0/1519652983 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v83) v1 ==== 74+0+149161 (secure 0 0 0) 0x7fb5c80476c0 con 0x7fb5d8152fc0 2024-01-21T21:26:17.056 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 msgr2=0x7fb5b8061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 0x7fb5b8061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fb5c0006d30 tx=0x7fb5c0009060).stop 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 msgr2=0x7fb5d81576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fb5c8007fd0 tx=0x7fb5d81548e0).stop 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 shutdown_connections 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:6832/43404,v1:172.21.15.133:6833/43404] conn(0x7fb5b805f2c0 0x7fb5b8061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5d813daf0 0x7fb5d8063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5d8152be0 0x7fb5d813c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:26:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 --2- 172.21.15.133:0/1519652983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5d8152fc0 0x7fb5d81576b0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:26:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 >> 172.21.15.133:0/1519652983 conn(0x7fb5d8066a70 msgr2=0x7fb5d80bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:26:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 shutdown_connections 2024-01-21T21:26:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:26:17.054+0000 7fb5de5f5700 1 -- 172.21.15.133:0/1519652983 wait complete. 2024-01-21T21:26:17.068 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":83,"active_gid":9240,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":43404},{"type":"v1","addr":"172.21.15.133:6833","nonce":43404}]},"active_addr":"172.21.15.133:6833/43404","active_change":"2024-01-21T21:15:28.885753+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":7295,"name":"x","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":175,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2411234209}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":87070792}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":4030620961}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":431323944}]}]} 2024-01-21T21:26:17.072 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2024-01-21T21:26:17.072 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-21T21:26:17.072 INFO:tasks.ceph.mgr.y:Stopping old one... 2024-01-21T21:26:17.072 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-21T21:26:17.072 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:26:17.097 INFO:tasks.ceph.mgr.y:Stopped 2024-01-21T21:26:17.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-21T21:26:17.140 INFO:tasks.ceph.mgr.y:Started 2024-01-21T21:26:17.316 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:17.314+0000 7f8f71cca680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:26:17.378 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:17.376+0000 7f8f71cca680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:26:17.648 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:17.646+0000 7f8f71cca680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:26:18.258 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:18.256+0000 7f8f71cca680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:26:18.330 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:18.328+0000 7f8f71cca680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:26:18.518 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:18.516+0000 7f8f71cca680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:26:18.938 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:18.936+0000 7f8f71cca680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:26:19.041 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.039+0000 7f8f71cca680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:26:19.195 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.193+0000 7f8f71cca680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:26:19.270 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.268+0000 7f8f71cca680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:26:19.338 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.336+0000 7f8f71cca680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:26:19.592 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.591+0000 7f8f71cca680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:26:19.778 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:19.776+0000 7f8f71cca680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:26:20.432 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.430+0000 7f8f71cca680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:26:20.500 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.498+0000 7f8f71cca680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:26:20.576 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.574+0000 7f8f71cca680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:26:20.723 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.721+0000 7f8f71cca680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:26:20.795 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.793+0000 7f8f71cca680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:26:20.910 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:20.909+0000 7f8f71cca680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:26:21.019 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.017+0000 7f8f71cca680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:26:21.312 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.310+0000 7f8f71cca680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:26:21.383 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.381+0000 7f8f71cca680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:26:21.470 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee5269700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.470 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee5269700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.470 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee826f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee5269700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee826f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee5269700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee826f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee5269700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee826f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:21.471 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:26:21.468+0000 7f8ee826f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:26:37.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:26:37.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:27:00.462 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:27:00.459+0000 7f8ef027f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:27:00.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:27:00.459+0000 7f8ef027f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:27:00.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:27:00.459+0000 7f8ef027f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:27:00.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:27:00.459+0000 7f8ef027f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:27:00.463 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:27:00.459+0000 7f8ef027f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:27:07.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:27:07.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:27:37.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:27:37.318 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:28:07.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:28:07.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:28:37.548 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:28:37.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:29:07.703 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:29:07.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:29:37.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:29:37.852 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:30:07.968 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:30:07.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:30:38.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:30:38.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:31:08.379 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:31:08.382 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:31:17.142 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2024-01-21T21:31:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.272+0000 7f4943934700 1 Processor -- start 2024-01-21T21:31:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.273+0000 7f4943934700 1 -- start start 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4943934700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f493c150de0 0x7f493c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4943934700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c069510 0x7f493c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4943934700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0be2b0 con 0x7f493c0bd130 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4943934700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c069e90 con 0x7f493c150de0 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4943934700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0be740 con 0x7f493c069510 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f493c150de0 0x7f493c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f493c150de0 0x7f493c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47930/0 (socket says 172.21.15.133:47930) 2024-01-21T21:31:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 -- 172.21.15.133:0/1320331503 learned_addr learned my addr 172.21.15.133:0/1320331503 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4941ed1700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c069510 0x7f493c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 -- 172.21.15.133:0/1320331503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c069510 msgr2=0x7f493c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c069510 0x7f493c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 -- 172.21.15.133:0/1320331503 >> v1:172.21.15.178:6789/0 conn(0x7f493c0bd130 legacy=0x7f493c0c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 -- 172.21.15.133:0/1320331503 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0bd6a0 con 0x7f493c150de0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f49416d0700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c150de0 0x7f493c1511c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f4938006fd0 tx=0x7f49380090f0).ready entity=mon.0 client_cookie=6a708b725be59c06 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4933fff700 1 -- 172.21.15.133:0/1320331503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800b580 con 0x7f493c150de0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4933fff700 1 -- 172.21.15.133:0/1320331503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800b6e0 con 0x7f493c150de0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.274+0000 7f4933fff700 1 -- 172.21.15.133:0/1320331503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800ba60 con 0x7f493c150de0 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 -- 172.21.15.133:0/1320331503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c150de0 msgr2=0x7f493c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c150de0 0x7f493c1511c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f4938006fd0 tx=0x7f49380090f0).stop 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 -- 172.21.15.133:0/1320331503 shutdown_connections 2024-01-21T21:31:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c150de0 0x7f493c1511c0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 --2- 172.21.15.133:0/1320331503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c069510 0x7f493c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 -- 172.21.15.133:0/1320331503 >> 172.21.15.133:0/1320331503 conn(0x7f493c0c7d30 msgr2=0x7f493c0c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 -- 172.21.15.133:0/1320331503 shutdown_connections 2024-01-21T21:31:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.275+0000 7f4943934700 1 -- 172.21.15.133:0/1320331503 wait complete. 2024-01-21T21:31:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.276+0000 7f4943934700 1 Processor -- start 2024-01-21T21:31:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.276+0000 7f4943934700 1 -- start start 2024-01-21T21:31:17.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069510 0x7f493c1684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c150de0 0x7f493c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c165540 con 0x7f493c0bd130 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c164930 con 0x7f493c069510 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4943934700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c164c10 con 0x7f493c150de0 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4940ecf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4940ecf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47934/0 (socket says 172.21.15.133:47934) 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4940ecf700 1 -- 172.21.15.133:0/943454488 learned_addr learned my addr 172.21.15.133:0/943454488 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f49416d0700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069510 0x7f493c1684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.277+0000 7f4941ed1700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c150de0 0x7f493c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 -- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c150de0 msgr2=0x7f493c0a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c150de0 0x7f493c0a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 -- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069510 msgr2=0x7f493c1684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069510 0x7f493c1684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 -- 172.21.15.133:0/943454488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009370 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4940ecf700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f492c00c440 tx=0x7f492c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c007020 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c007180 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c007520 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c164ef0 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.278+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c1645e0 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.279+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c05fdf0 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.279+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 88) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f492c0068b0 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.280+0000 7f4931ffb700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 0x7f4920061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.280+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f492c079c00 con 0x7f493c0bd130 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.280+0000 7f49416d0700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 0x7f4920061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.280+0000 7f49416d0700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 0x7f4920061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f493c167b10 tx=0x7f4938017000).ready entity=mgr.9309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.284+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f492c047b00 con 0x7f493c0bd130 2024-01-21T21:31:17.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.473+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f493c06a350 con 0x7f492005f2c0 2024-01-21T21:31:17.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.477+0000 7f4931ffb700 1 -- 172.21.15.133:0/943454488 <== mgr.9309 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f493c06a350 con 0x7f492005f2c0 2024-01-21T21:31:17.481 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2024-01-21T21:31:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.479+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 msgr2=0x7f4920061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.479+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 0x7f4920061780 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f493c167b10 tx=0x7f4938017000).stop 2024-01-21T21:31:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.479+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 msgr2=0x7f493c152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f492c00c440 tx=0x7f492c007e00).stop 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 shutdown_connections 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493c150de0 0x7f493c0a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f492005f2c0 0x7f4920061780 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f493c069510 0x7f493c1684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 --2- 172.21.15.133:0/943454488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f493c0bd130 0x7f493c152fd0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 >> 172.21.15.133:0/943454488 conn(0x7f493c0c7d30 msgr2=0x7f493c0a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 shutdown_connections 2024-01-21T21:31:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.480+0000 7f4943934700 1 -- 172.21.15.133:0/943454488 wait complete. 2024-01-21T21:31:17.495 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2024-01-21T21:31:17.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:17.495 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2024-01-21T21:31:17.513 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_16_00_UTC 2024-01-21T21:31:17.513 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_17_00_UTC 2024-01-21T21:31:17.513 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_18_00_UTC 2024-01-21T21:31:17.513 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_19_00_UTC 2024-01-21T21:31:17.513 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_20_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_21_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_22_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_23_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_24_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_25_00_UTC 2024-01-21T21:31:17.514 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_26_00_UTC 2024-01-21T21:31:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_27_00_UTC 2024-01-21T21:31:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_28_00_UTC 2024-01-21T21:31:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_29_00_UTC 2024-01-21T21:31:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_30_00_UTC 2024-01-21T21:31:17.515 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_31_00_UTC 2024-01-21T21:31:17.516 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-01-21-21_16_00_UTC', 'scheduled-2024-01-21-21_17_00_UTC', 'scheduled-2024-01-21-21_18_00_UTC', 'scheduled-2024-01-21-21_19_00_UTC', 'scheduled-2024-01-21-21_20_00_UTC', 'scheduled-2024-01-21-21_21_00_UTC', 'scheduled-2024-01-21-21_22_00_UTC', 'scheduled-2024-01-21-21_23_00_UTC', 'scheduled-2024-01-21-21_24_00_UTC', 'scheduled-2024-01-21-21_25_00_UTC', 'scheduled-2024-01-21-21_26_00_UTC', 'scheduled-2024-01-21-21_27_00_UTC', 'scheduled-2024-01-21-21_28_00_UTC', 'scheduled-2024-01-21-21_29_00_UTC', 'scheduled-2024-01-21-21_30_00_UTC', 'scheduled-2024-01-21-21_31_00_UTC'] 2024-01-21T21:31:17.516 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2024-01-21T21:31:17.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.671+0000 7f17ca097700 1 Processor -- start 2024-01-21T21:31:17.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.671+0000 7f17ca097700 1 -- start start 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17ca097700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c414e8d0 0x7f17c405e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17ca097700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17c414ecb0 0x7f17c4155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17ca097700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40c9040 con 0x7f17c4155a60 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17ca097700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40c9290 con 0x7f17c414e8d0 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17ca097700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40c9570 con 0x7f17c414ecb0 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c414e8d0 0x7f17c405e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c414e8d0 0x7f17c405e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47944/0 (socket says 172.21.15.133:47944) 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 -- 172.21.15.133:0/1645215561 learned_addr learned my addr 172.21.15.133:0/1645215561 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c2ffd700 1 --2- 172.21.15.133:0/1645215561 >> v2:172.21.15.178:3300/0 conn(0x7f17c414ecb0 0x7f17c4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 -- 172.21.15.133:0/1645215561 >> v2:172.21.15.178:3300/0 conn(0x7f17c414ecb0 msgr2=0x7f17c4155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:17.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 --2- 172.21.15.133:0/1645215561 >> v2:172.21.15.178:3300/0 conn(0x7f17c414ecb0 0x7f17c4155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 -- 172.21.15.133:0/1645215561 >> v1:172.21.15.178:6789/0 conn(0x7f17c4155a60 legacy=0x7f17c40c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 -- 172.21.15.133:0/1645215561 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40c9850 con 0x7f17c414e8d0 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c37fe700 1 --2- 172.21.15.133:0/1645215561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c405e9c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f17c40c5dc0 tx=0x7f17b40090f0).ready entity=mon.0 client_cookie=526d9cd86af37b3b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c27fc700 1 -- 172.21.15.133:0/1645215561 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400b5a0 con 0x7f17c414e8d0 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c27fc700 1 -- 172.21.15.133:0/1645215561 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400b700 con 0x7f17c414e8d0 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.672+0000 7f17c27fc700 1 -- 172.21.15.133:0/1645215561 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400ba80 con 0x7f17c414e8d0 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 -- 172.21.15.133:0/1645215561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 msgr2=0x7f17c405e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 --2- 172.21.15.133:0/1645215561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c405e9c0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7f17c40c5dc0 tx=0x7f17b40090f0).stop 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 -- 172.21.15.133:0/1645215561 shutdown_connections 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 --2- 172.21.15.133:0/1645215561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c405e9c0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 --2- 172.21.15.133:0/1645215561 >> v2:172.21.15.178:3300/0 conn(0x7f17c414ecb0 0x7f17c4155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 -- 172.21.15.133:0/1645215561 >> 172.21.15.133:0/1645215561 conn(0x7f17c4084eb0 msgr2=0x7f17c40947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 -- 172.21.15.133:0/1645215561 shutdown_connections 2024-01-21T21:31:17.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.673+0000 7f17ca097700 1 -- 172.21.15.133:0/1645215561 wait complete. 2024-01-21T21:31:17.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.674+0000 7f17ca097700 1 Processor -- start 2024-01-21T21:31:17.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.674+0000 7f17ca097700 1 -- start start 2024-01-21T21:31:17.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 0x7f17c4143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 0x7f17c414bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c3190 con 0x7f17c414e8d0 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41442d0 con 0x7f17c4155a60 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17ca097700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c2580 con 0x7f17c414ecb0 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47960/0 (socket says 172.21.15.133:47960) 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 -- 172.21.15.133:0/1060071204 learned_addr learned my addr 172.21.15.133:0/1060071204 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c2ffd700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 0x7f17c4143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c3fff700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 0x7f17c414bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 -- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 msgr2=0x7f17c4143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 0x7f17c4143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 -- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 msgr2=0x7f17c414bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 0x7f17c414bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 -- 172.21.15.133:0/1060071204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009370 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c2ffd700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 0x7f17c4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c3fff700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 0x7f17c414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.675+0000 7f17c37fe700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f17b4009130 tx=0x7f17b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.676+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b400b870 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.676+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b400b9d0 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.676+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40c2860 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.676+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b401a430 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.676+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c40c2e20 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.677+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c405fdf0 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.677+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 88) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f17b4021020 con 0x7f17c414e8d0 2024-01-21T21:31:17.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.677+0000 7f17abfff700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 0x7f17b0061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:17.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.677+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f17b407be30 con 0x7f17c414e8d0 2024-01-21T21:31:17.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.677+0000 7f17c2ffd700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 0x7f17b0061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:17.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.678+0000 7f17c2ffd700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 0x7f17b0061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f17c414ad50 tx=0x7f17b8008040).ready entity=mgr.9309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:17.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.681+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f17b404cb40 con 0x7f17c414e8d0 2024-01-21T21:31:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.868+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17c40c32d0 con 0x7f17b005f2c0 2024-01-21T21:31:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.869+0000 7f17abfff700 1 -- 172.21.15.133:0/1060071204 <== mgr.9309 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f17b800f710 con 0x7f17b005f2c0 2024-01-21T21:31:17.873 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:17.873 INFO:teuthology.orchestra.run.smithi133.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T21:15:29", "first": "2024-01-21T21:16:00", "last": "2024-01-21T21:31:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 msgr2=0x7f17b0061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 0x7f17b0061780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f17c414ad50 tx=0x7f17b8008040).stop 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 msgr2=0x7f17c40abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7f17b4009130 tx=0x7f17b4015000).stop 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 shutdown_connections 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f17b005f2c0 0x7f17b0061780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17c4155a60 0x7f17c414bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c414e8d0 0x7f17c40abb30 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 --2- 172.21.15.133:0/1060071204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17c414ecb0 0x7f17c4143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 >> 172.21.15.133:0/1060071204 conn(0x7f17c4084eb0 msgr2=0x7f17c405e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 shutdown_connections 2024-01-21T21:31:17.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:17.871+0000 7f17ca097700 1 -- 172.21.15.133:0/1060071204 wait complete. 2024-01-21T21:31:17.886 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2024-01-21T00:00:00", "created": "2024-01-21T21:15:29", "first": "2024-01-21T21:16:00", "last": "2024-01-21T21:31:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2024-01-21T21:31:17.887 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2024-01-21T00:00:00', 'created': '2024-01-21T21:15:29', 'first': '2024-01-21T21:16:00', 'last': '2024-01-21T21:31:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2024-01-21T21:31:17.887 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2024-01-21T21:31:17.887 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2024-01-21T21:31:17.887 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2024-01-21T21:31:18.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.003+0000 7fb131ccb700 1 Processor -- start 2024-01-21T21:31:18.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.003+0000 7fb131ccb700 1 -- start start 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb131ccb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c152010 0x7fb12c0669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb131ccb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb12c1523f0 0x7fb12c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb131ccb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c1566f0 con 0x7fb12c066ea0 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb131ccb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c0beef0 con 0x7fb12c1523f0 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb131ccb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c067400 con 0x7fb12c152010 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb12c1523f0 0x7fb12c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb12c1523f0 0x7fb12c0ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47974/0 (socket says 172.21.15.133:47974) 2024-01-21T21:31:18.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 -- 172.21.15.133:0/765475280 learned_addr learned my addr 172.21.15.133:0/765475280 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12b7fe700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c152010 0x7fb12c0669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 -- 172.21.15.133:0/765475280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c152010 msgr2=0x7fb12c0669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c152010 0x7fb12c0669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 -- 172.21.15.133:0/765475280 >> v1:172.21.15.178:6789/0 conn(0x7fb12c066ea0 legacy=0x7fb12c067ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 -- 172.21.15.133:0/765475280 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c155dc0 con 0x7fb12c1523f0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.004+0000 7fb12affd700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ab0e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7fb114006fd0 tx=0x7fb1140090f0).ready entity=mon.0 client_cookie=6cbb92366a0bdf08 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb12a7fc700 1 -- 172.21.15.133:0/765475280 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11400b600 con 0x7fb12c1523f0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb12a7fc700 1 -- 172.21.15.133:0/765475280 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11400b760 con 0x7fb12c1523f0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb12a7fc700 1 -- 172.21.15.133:0/765475280 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11400bae0 con 0x7fb12c1523f0 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 -- 172.21.15.133:0/765475280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 msgr2=0x7fb12c0ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ab0e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7fb114006fd0 tx=0x7fb1140090f0).stop 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 -- 172.21.15.133:0/765475280 shutdown_connections 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c152010 0x7fb12c0669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 --2- 172.21.15.133:0/765475280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ab0e0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 -- 172.21.15.133:0/765475280 >> 172.21.15.133:0/765475280 conn(0x7fb12c0c8f60 msgr2=0x7fb12c0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:18.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 -- 172.21.15.133:0/765475280 shutdown_connections 2024-01-21T21:31:18.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.005+0000 7fb131ccb700 1 -- 172.21.15.133:0/765475280 wait complete. 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.006+0000 7fb131ccb700 1 Processor -- start 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 -- start start 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c066ea0 0x7fb12c064210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb12c152010 0x7fb12c0a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c2670 con 0x7fb12c1523f0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c064700 con 0x7fb12c152010 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb131ccb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c15d0 con 0x7fb12c066ea0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47982/0 (socket says 172.21.15.133:47982) 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.007+0000 7fb12bfff700 1 -- 172.21.15.133:0/44410084 learned_addr learned my addr 172.21.15.133:0/44410084 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12affd700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb12c152010 0x7fb12c0a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12b7fe700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c066ea0 0x7fb12c064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 -- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c066ea0 msgr2=0x7fb12c064210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c066ea0 0x7fb12c064210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 -- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb12c152010 msgr2=0x7fb12c0a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb12c152010 0x7fb12c0a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 -- 172.21.15.133:0/44410084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114009370 con 0x7fb12c1523f0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb12bfff700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fb11c00c490 tx=0x7fb11c007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c002ea0 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00f470 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c0c18b0 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00f810 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.008+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c0c1e70 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.009+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c05fdf0 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.009+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 88) v1 ==== 75577+0+0 (secure 0 0 0) 0x7fb11c00fc00 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.009+0000 7fb123fff700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 0x7fb110061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.010+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7fb11c079ca0 con 0x7fb12c1523f0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.010+0000 7fb12b7fe700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 0x7fb110061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.010+0000 7fb12b7fe700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 0x7fb110061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb1240075a0 tx=0x7fb1240097a0).ready entity=mgr.9309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:18.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.014+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb11c047b00 con 0x7fb12c1523f0 2024-01-21T21:31:18.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.201+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12c0c2480 con 0x7fb11005f2c0 2024-01-21T21:31:18.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.205+0000 7fb123fff700 1 -- 172.21.15.133:0/44410084 <== mgr.9309 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fb12c0c2480 con 0x7fb11005f2c0 2024-01-21T21:31:18.209 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path /snap_test_dir1/test_restart 2024-01-21T21:31:18.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 msgr2=0x7fb110061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:18.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 0x7fb110061780 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fb1240075a0 tx=0x7fb1240097a0).stop 2024-01-21T21:31:18.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 msgr2=0x7fb12c0ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:18.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7fb11c00c490 tx=0x7fb11c007de0).stop 2024-01-21T21:31:18.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 shutdown_connections 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb12c1523f0 0x7fb12c0ad220 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb12c066ea0 0x7fb12c064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb11005f2c0 0x7fb110061780 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 --2- 172.21.15.133:0/44410084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb12c152010 0x7fb12c0a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.207+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 >> 172.21.15.133:0/44410084 conn(0x7fb12c0c8f60 msgr2=0x7fb12c0c7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.208+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 shutdown_connections 2024-01-21T21:31:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:18.208+0000 7fb131ccb700 1 -- 172.21.15.133:0/44410084 wait complete. 2024-01-21T21:31:18.223 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2024-01-21T21:31:18.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.223 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_16_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_17_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_18_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_19_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_20_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_21_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_22_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_23_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_24_00_UTC 2024-01-21T21:31:18.241 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_25_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_26_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_27_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_28_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_29_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_30_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_31_00_UTC 2024-01-21T21:31:18.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_16_00_UTC 2024-01-21T21:31:18.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.242 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_16_00_UTC) 2024-01-21T21:31:18.304 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_17_00_UTC 2024-01-21T21:31:18.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.305 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_17_00_UTC) 2024-01-21T21:31:18.368 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_18_00_UTC 2024-01-21T21:31:18.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.369 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_18_00_UTC) 2024-01-21T21:31:18.430 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_19_00_UTC 2024-01-21T21:31:18.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.430 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_19_00_UTC) 2024-01-21T21:31:18.493 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_20_00_UTC 2024-01-21T21:31:18.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.494 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_20_00_UTC) 2024-01-21T21:31:18.556 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_21_00_UTC 2024-01-21T21:31:18.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.556 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_21_00_UTC) 2024-01-21T21:31:18.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_22_00_UTC 2024-01-21T21:31:18.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.619 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_22_00_UTC) 2024-01-21T21:31:18.682 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_23_00_UTC 2024-01-21T21:31:18.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.682 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_23_00_UTC) 2024-01-21T21:31:18.744 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_24_00_UTC 2024-01-21T21:31:18.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.744 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_24_00_UTC) 2024-01-21T21:31:18.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_25_00_UTC 2024-01-21T21:31:18.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.808 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_25_00_UTC) 2024-01-21T21:31:18.870 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_26_00_UTC 2024-01-21T21:31:18.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.871 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_26_00_UTC) 2024-01-21T21:31:18.934 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_27_00_UTC 2024-01-21T21:31:18.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.934 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_27_00_UTC) 2024-01-21T21:31:18.997 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_28_00_UTC 2024-01-21T21:31:18.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:18.998 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_28_00_UTC) 2024-01-21T21:31:19.059 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_29_00_UTC 2024-01-21T21:31:19.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:19.060 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_29_00_UTC) 2024-01-21T21:31:19.123 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_30_00_UTC 2024-01-21T21:31:19.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:19.123 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_30_00_UTC) 2024-01-21T21:31:19.186 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_31_00_UTC 2024-01-21T21:31:19.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:19.186 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2024-01-21-21_31_00_UTC) 2024-01-21T21:31:19.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:19.249 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2024-01-21T21:31:19.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T21:31:19.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.463+0000 7f354f5ae700 1 Processor -- start 2024-01-21T21:31:19.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.463+0000 7f354f5ae700 1 -- start start 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354f5ae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3548137030 0x7f3548067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354f5ae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f35480c5930 0x7f35480c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354f5ae700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35480c6250 con 0x7f3548137410 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354f5ae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3548068370 con 0x7f3548137030 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354f5ae700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3548068650 con 0x7f35480c5930 2024-01-21T21:31:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3548137030 0x7f3548067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3548137030 0x7f3548067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47988/0 (socket says 172.21.15.133:47988) 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 -- 172.21.15.133:0/1115761054 learned_addr learned my addr 172.21.15.133:0/1115761054 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354db4b700 1 --2- 172.21.15.133:0/1115761054 >> v2:172.21.15.178:3300/0 conn(0x7f35480c5930 0x7f35480c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 -- 172.21.15.133:0/1115761054 >> v2:172.21.15.178:3300/0 conn(0x7f35480c5930 msgr2=0x7f35480c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 --2- 172.21.15.133:0/1115761054 >> v2:172.21.15.178:3300/0 conn(0x7f35480c5930 0x7f35480c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 -- 172.21.15.133:0/1115761054 >> v1:172.21.15.178:6789/0 conn(0x7f3548137410 legacy=0x7f3548155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.464+0000 7f354d34a700 1 -- 172.21.15.133:0/1115761054 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3548068930 con 0x7f3548137030 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354d34a700 1 --2- 172.21.15.133:0/1115761054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137030 0x7f3548067d90 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f3548066070 tx=0x7f35440090f0).ready entity=mon.0 client_cookie=78bfd63492128cc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:19.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f353ffff700 1 -- 172.21.15.133:0/1115761054 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400b5a0 con 0x7f3548137030 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f353ffff700 1 -- 172.21.15.133:0/1115761054 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400b700 con 0x7f3548137030 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f353ffff700 1 -- 172.21.15.133:0/1115761054 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400baa0 con 0x7f3548137030 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 -- 172.21.15.133:0/1115761054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137030 msgr2=0x7f3548067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 --2- 172.21.15.133:0/1115761054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137030 0x7f3548067d90 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f3548066070 tx=0x7f35440090f0).stop 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 -- 172.21.15.133:0/1115761054 shutdown_connections 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 --2- 172.21.15.133:0/1115761054 >> v2:172.21.15.178:3300/0 conn(0x7f35480c5930 0x7f35480c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 --2- 172.21.15.133:0/1115761054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137030 0x7f3548067d90 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 -- 172.21.15.133:0/1115761054 >> 172.21.15.133:0/1115761054 conn(0x7f3548066a90 msgr2=0x7f3548066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 -- 172.21.15.133:0/1115761054 shutdown_connections 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.465+0000 7f354f5ae700 1 -- 172.21.15.133:0/1115761054 wait complete. 2024-01-21T21:31:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.466+0000 7f354f5ae700 1 Processor -- start 2024-01-21T21:31:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 -- start start 2024-01-21T21:31:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35480c5930 0x7f354813a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548137030 0x7f3548157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481397c0 con 0x7f3548137410 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3548139aa0 con 0x7f35480c5930 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354f5ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3548155240 con 0x7f3548137030 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354db4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354db4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:47992/0 (socket says 172.21.15.133:47992) 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354db4b700 1 -- 172.21.15.133:0/2409187514 learned_addr learned my addr 172.21.15.133:0/2409187514 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.467+0000 7f354d34a700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35480c5930 0x7f354813a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354cb49700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548137030 0x7f3548157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 -- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548137030 msgr2=0x7f3548157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548137030 0x7f3548157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 -- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35480c5930 msgr2=0x7f354813a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35480c5930 0x7f354813a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 -- 172.21.15.133:0/2409187514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544009370 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354db4b700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f3540007f20 tx=0x7f3540009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000eca0 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000ee00 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540014610 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3548155520 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.468+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354813aae0 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.469+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354805fdf0 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.469+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 88) v1 ==== 75577+0+0 (secure 0 0 0) 0x7f3540014980 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.470+0000 7f353dffb700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 0x7f352c061780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.470+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f354007ad60 con 0x7f3548137410 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.470+0000 7f354d34a700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 0x7f352c061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.470+0000 7f354d34a700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 0x7f352c061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3544009130 tx=0x7f3544015000).ready entity=mgr.9309 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.474+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f354004ba70 con 0x7f3548137410 2024-01-21T21:31:19.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:19.680+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f35480c7250 con 0x7f3548137410 2024-01-21T21:31:20.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.106+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3540078570 con 0x7f3548137410 2024-01-21T21:31:20.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.107+0000 7f353dffb700 1 -- 172.21.15.133:0/2409187514 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v89) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3540073340 con 0x7f3548137410 2024-01-21T21:31:20.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 msgr2=0x7f352c061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 0x7f352c061780 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f3544009130 tx=0x7f3544015000).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 msgr2=0x7f35480ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f3540007f20 tx=0x7f3540009860).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 shutdown_connections 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3548137410 0x7f35480ac680 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f352c05f2c0 0x7f352c061780 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35480c5930 0x7f354813a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 --2- 172.21.15.133:0/2409187514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548137030 0x7f3548157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 >> 172.21.15.133:0/2409187514 conn(0x7f3548066a90 msgr2=0x7f35480bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 shutdown_connections 2024-01-21T21:31:20.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.110+0000 7f354f5ae700 1 -- 172.21.15.133:0/2409187514 wait complete. 2024-01-21T21:31:20.130 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:31:20.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:31:20.180 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:31:20.225 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:31:20.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T21:31:20.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:20.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T21:31:20.257 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:20.253+0000 7fe45f446680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:31:20.258 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:20.255+0000 7eff6b751680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:31:20.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:31:20.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:20.270 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T21:31:20.319 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:20.317+0000 7fe45f446680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:31:20.324 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:20.321+0000 7eff6b751680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:31:20.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.481+0000 7f3e219e4700 1 Processor -- start 2024-01-21T21:31:20.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.481+0000 7f3e219e4700 1 -- start start 2024-01-21T21:31:20.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e219e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e1c1351d0 0x7f3e1c0c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e219e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0c61a0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e219e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0c5350 con 0x7f3e1c0c3c60 2024-01-21T21:31:20.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e219e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c0c55d0 con 0x7f3e1c1351d0 2024-01-21T21:31:20.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e1affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e1c1351d0 0x7f3e1c0c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e1affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e1c1351d0 0x7f3e1c0c3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53900/0 (socket says 172.21.15.133:53900) 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e1affd700 1 -- 172.21.15.133:0/3243288241 learned_addr learned my addr 172.21.15.133:0/3243288241 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.482+0000 7f3e1b7fe700 1 --1- 172.21.15.133:0/3243288241 >> v1:172.21.15.133:6789/0 conn(0x7f3e1c1563c0 0x7f3e1c0bde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40664/0 (socket says 172.21.15.133:40664) 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e1affd700 1 -- 172.21.15.133:0/3243288241 >> v1:172.21.15.178:6789/0 conn(0x7f3e1c0c3c60 legacy=0x7f3e1c155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e1affd700 1 -- 172.21.15.133:0/3243288241 >> v1:172.21.15.133:6789/0 conn(0x7f3e1c1563c0 legacy=0x7f3e1c0bde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e1affd700 1 -- 172.21.15.133:0/3243288241 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0c5870 con 0x7f3e1c1351d0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e1affd700 1 --2- 172.21.15.133:0/3243288241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c0c3770 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f3e0c006fd0 tx=0x7f3e0c0090f0).ready entity=mon.0 client_cookie=e2edf0835ade49c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e19ffb700 1 -- 172.21.15.133:0/3243288241 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00b600 con 0x7f3e1c1351d0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e19ffb700 1 -- 172.21.15.133:0/3243288241 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00b760 con 0x7f3e1c1351d0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.483+0000 7f3e19ffb700 1 -- 172.21.15.133:0/3243288241 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00bb00 con 0x7f3e1c1351d0 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 -- 172.21.15.133:0/3243288241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 msgr2=0x7f3e1c0c3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 --2- 172.21.15.133:0/3243288241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c0c3770 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7f3e0c006fd0 tx=0x7f3e0c0090f0).stop 2024-01-21T21:31:20.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 -- 172.21.15.133:0/3243288241 shutdown_connections 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 --2- 172.21.15.133:0/3243288241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c0c3770 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 -- 172.21.15.133:0/3243288241 >> 172.21.15.133:0/3243288241 conn(0x7f3e1c066a90 msgr2=0x7f3e1c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 -- 172.21.15.133:0/3243288241 shutdown_connections 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.484+0000 7f3e219e4700 1 -- 172.21.15.133:0/3243288241 wait complete. 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.485+0000 7f3e219e4700 1 Processor -- start 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.485+0000 7f3e219e4700 1 -- start start 2024-01-21T21:31:20.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e1c0c3c60 0x7f3e1c1397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 0x7f3e1c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c13a1a0 con 0x7f3e1c1351d0 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c128110 con 0x7f3e1c0c3c60 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.486+0000 7f3e219e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c127500 con 0x7f3e1c1563c0 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53902/0 (socket says 172.21.15.133:53902) 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1a7fc700 1 -- 172.21.15.133:0/2244875490 learned_addr learned my addr 172.21.15.133:0/2244875490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1affd700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e1c0c3c60 0x7f3e1c1397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 0x7f3e1c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e1c0c3c60 msgr2=0x7f3e1c1397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e1c0c3c60 0x7f3e1c1397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 msgr2=0x7f3e1c139cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 -- 172.21.15.133:0/2244875490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009370 con 0x7f3e1c1563c0 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1a7fc700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e1b7fe700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 0x7f3e1c0c0f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3e1400c7c0 tx=0x7f3e14001530).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:20.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14005c70 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14005dd0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c1277e0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e140072e0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.487+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c127da0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.488+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c05fdf0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.489+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f3e140076d0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.489+0000 7f3e037fe700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 0x7f3e08061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.489+0000 7f3e1affd700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 msgr2=0x7f3e08061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.489+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f3e1407a1f0 con 0x7f3e1c1563c0 2024-01-21T21:31:20.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.489+0000 7f3e1affd700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 0x7f3e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:20.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.493+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3e1404af00 con 0x7f3e1c1563c0 2024-01-21T21:31:20.593 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:20.590+0000 7fe45f446680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:31:20.611 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:20.608+0000 7eff6b751680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:31:20.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.690+0000 7f3e1affd700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 msgr2=0x7f3e08061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:20.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.690+0000 7f3e1affd700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 0x7f3e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:20.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.706+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e1c0c5b50 con 0x7f3e1c1563c0 2024-01-21T21:31:20.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.707+0000 7f3e037fe700 1 -- 172.21.15.133:0/2244875490 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f3e14018020 con 0x7f3e1c1563c0 2024-01-21T21:31:20.710 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:20.710 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 msgr2=0x7f3e08061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 0x7f3e08061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 msgr2=0x7f3e1c0c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 0x7f3e1c0c0f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3e1400c7c0 tx=0x7f3e14001530).stop 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 shutdown_connections 2024-01-21T21:31:20.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e1c1563c0 0x7f3e1c0c0f70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3e0805f270 0x7f3e08061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e1c0c3c60 0x7f3e1c1397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 --2- 172.21.15.133:0/2244875490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e1c1351d0 0x7f3e1c139cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 >> 172.21.15.133:0/2244875490 conn(0x7f3e1c066a90 msgr2=0x7f3e1c0abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 shutdown_connections 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.709+0000 7f3e219e4700 1 -- 172.21.15.133:0/2244875490 wait complete. 2024-01-21T21:31:20.714 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:31:20.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.841+0000 7f63e7120700 1 Processor -- start 2024-01-21T21:31:20.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.841+0000 7f63e7120700 1 -- start start 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e7120700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e00c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e7120700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63e00c3c60 0x7f63e0155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e7120700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e00c61a0 con 0x7f63e01561a0 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e7120700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e0156630 con 0x7f63e00c3c60 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e7120700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c5350 con 0x7f63e01351d0 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63dffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63e00c3c60 0x7f63e0155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e56bd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f63e01561a0 0x7f63e01526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40674/0 (socket says 172.21.15.133:40674) 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.842+0000 7f63e56bd700 1 -- 172.21.15.133:0/539333951 learned_addr learned my addr 172.21.15.133:0/539333951 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63e4ebc700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e00c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63dffff700 1 -- 172.21.15.133:0/539333951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 msgr2=0x7f63e00c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63dffff700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e00c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63dffff700 1 -- 172.21.15.133:0/539333951 >> v1:172.21.15.133:6789/0 conn(0x7f63e01561a0 legacy=0x7f63e01526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63dffff700 1 -- 172.21.15.133:0/539333951 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00c55d0 con 0x7f63e00c3c60 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63dffff700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e0155cb0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f63cc009760 tx=0x7f63cc009060).ready entity=mon.0 client_cookie=e1a499e2f4571c8f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63df7fe700 1 -- 172.21.15.133:0/539333951 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0090d0 con 0x7f63e00c3c60 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63df7fe700 1 -- 172.21.15.133:0/539333951 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc00f510 con 0x7f63e00c3c60 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.843+0000 7f63df7fe700 1 -- 172.21.15.133:0/539333951 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00f890 con 0x7f63e00c3c60 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 -- 172.21.15.133:0/539333951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 msgr2=0x7f63e0155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e0155cb0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7f63cc009760 tx=0x7f63cc009060).stop 2024-01-21T21:31:20.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 -- 172.21.15.133:0/539333951 shutdown_connections 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e00c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 --2- 172.21.15.133:0/539333951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e0155cb0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 -- 172.21.15.133:0/539333951 >> 172.21.15.133:0/539333951 conn(0x7f63e0066a90 msgr2=0x7f63e0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 -- 172.21.15.133:0/539333951 shutdown_connections 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.844+0000 7f63e7120700 1 -- 172.21.15.133:0/539333951 wait complete. 2024-01-21T21:31:20.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.846+0000 7f63e7120700 1 Processor -- start 2024-01-21T21:31:20.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.846+0000 7f63e7120700 1 -- start start 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e01649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63e01561a0 0x7f63e0164e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0064220 con 0x7f63e00c3c60 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00c9be0 con 0x7f63e01561a0 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e7120700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e0063930 con 0x7f63e01351d0 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53932/0 (socket says 172.21.15.133:53932) 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 -- 172.21.15.133:0/654691793 learned_addr learned my addr 172.21.15.133:0/654691793 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63dffff700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e01649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e56bd700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63e01561a0 0x7f63e0164e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:20.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 -- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 msgr2=0x7f63e01649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e01649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 -- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63e01561a0 msgr2=0x7f63e0164e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63e01561a0 0x7f63e0164e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.847+0000 7f63e4ebc700 1 -- 172.21.15.133:0/654691793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0092a0 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63e4ebc700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f63d400e900 tx=0x7f63d4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d40093b0 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d4012600 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e0063bd0 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d4012980 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.848+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e00c6d10 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.849+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e005fdf0 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.849+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f63d4012d30 con 0x7f63e00c3c60 2024-01-21T21:31:20.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.849+0000 7f63dd7fa700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 0x7f63c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.850+0000 7f63dffff700 1 -- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 msgr2=0x7f63c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.850+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f63d407aaf0 con 0x7f63e00c3c60 2024-01-21T21:31:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.850+0000 7f63dffff700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 0x7f63c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:20.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:20.854+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f63d404b800 con 0x7f63e00c3c60 2024-01-21T21:31:21.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.021+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e00c5870 con 0x7f63e00c3c60 2024-01-21T21:31:21.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.022+0000 7f63dd7fa700 1 -- 172.21.15.133:0/654691793 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+18631 (secure 0 0 0) 0x7f63d404ee20 con 0x7f63e00c3c60 2024-01-21T21:31:21.025 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:21.026 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":178,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:26:21.395858+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.c","mappings":[{"from":4,"to":3}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2411234209":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/87070792":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/4030620961":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/278818299":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6833/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6832/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:0/431323944":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/1221203277":"2024-01-22T21:15:28.885597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 msgr2=0x7f63c4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:21.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 0x7f63c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 msgr2=0x7f63e01653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7f63d400e900 tx=0x7f63d4009060).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 shutdown_connections 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63c405f270 0x7f63c4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63e01561a0 0x7f63e0164e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e00c3c60 0x7f63e01653c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 --2- 172.21.15.133:0/654691793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63e01351d0 0x7f63e01649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 >> 172.21.15.133:0/654691793 conn(0x7f63e0066a90 msgr2=0x7f63e0139820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 shutdown_connections 2024-01-21T21:31:21.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.024+0000 7f63e7120700 1 -- 172.21.15.133:0/654691793 wait complete. 2024-01-21T21:31:21.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T21:15:16.140843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T21:15:16.590297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T21:31:21.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:31:21.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.160+0000 7f64e493a700 1 Processor -- start 2024-01-21T21:31:21.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.161+0000 7f64e493a700 1 -- start start 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.161+0000 7f64e493a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64e00c8120 0x7f64e0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.161+0000 7f64e493a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 0x7f64e00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.161+0000 7f64e493a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e00ab620 con 0x7f64e0154140 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64e493a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00c6ae0 con 0x7f64e00c8120 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64e493a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c05e0 con 0x7f64e0154520 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64e00c8120 0x7f64e0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64de59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64e0154140 0x7f64e00c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40676/0 (socket says 172.21.15.133:40676) 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64de59c700 1 -- 172.21.15.133:0/630701593 learned_addr learned my addr 172.21.15.133:0/630701593 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ded9d700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 0x7f64e00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 -- 172.21.15.133:0/630701593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 msgr2=0x7f64e00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 0x7f64e00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 -- 172.21.15.133:0/630701593 >> v1:172.21.15.133:6789/0 conn(0x7f64e0154140 legacy=0x7f64e00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 -- 172.21.15.133:0/630701593 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e00c0e40 con 0x7f64e00c8120 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64dd59a700 1 -- 172.21.15.133:0/630701593 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154813822 0 0) 0x7f64e00ab620 con 0x7f64e0154140 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ded9d700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 0x7f64e00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64ddd9b700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00c8120 0x7f64e0158bb0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f64d4009760 tx=0x7f64d4009060).ready entity=mon.0 client_cookie=b0a20cf6fb7ce6c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64dd59a700 1 -- 172.21.15.133:0/630701593 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400b580 con 0x7f64e00c8120 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64dd59a700 1 -- 172.21.15.133:0/630701593 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400b6e0 con 0x7f64e00c8120 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.162+0000 7f64dd59a700 1 -- 172.21.15.133:0/630701593 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400ba60 con 0x7f64e00c8120 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 -- 172.21.15.133:0/630701593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00c8120 msgr2=0x7f64e0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00c8120 0x7f64e0158bb0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f64d4009760 tx=0x7f64d4009060).stop 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 -- 172.21.15.133:0/630701593 shutdown_connections 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154520 0x7f64e00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 --2- 172.21.15.133:0/630701593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00c8120 0x7f64e0158bb0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 -- 172.21.15.133:0/630701593 >> 172.21.15.133:0/630701593 conn(0x7f64e005e1e0 msgr2=0x7f64e005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 -- 172.21.15.133:0/630701593 shutdown_connections 2024-01-21T21:31:21.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.163+0000 7f64e493a700 1 -- 172.21.15.133:0/630701593 wait complete. 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.164+0000 7f64e493a700 1 Processor -- start 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 -- start start 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64e00c8120 0x7f64e0147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154140 0x7f64e0168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0147740 con 0x7f64e0154520 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0168af0 con 0x7f64e00c8120 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64e493a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00b0e00 con 0x7f64e0154140 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64ded9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64ded9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53948/0 (socket says 172.21.15.133:53948) 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64ded9d700 1 -- 172.21.15.133:0/259565817 learned_addr learned my addr 172.21.15.133:0/259565817 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64de59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64e00c8120 0x7f64e0147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.165+0000 7f64ddd9b700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154140 0x7f64e0168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154140 msgr2=0x7f64e0168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154140 0x7f64e0168600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64e00c8120 msgr2=0x7f64e0147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64e00c8120 0x7f64e0147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 -- 172.21.15.133:0/259565817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40092a0 con 0x7f64e0154520 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ded9d700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f64d800d180 tx=0x7f64d8009a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d800dcc0 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d800f040 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e00b1050 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8013600 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.166+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e0147080 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.167+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f64d80139f0 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.168+0000 7f64ceffd700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 0x7f64c0061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.168+0000 7f64de59c700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 msgr2=0x7f64c0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.168+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f64d807aea0 con 0x7f64e0154520 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.168+0000 7f64de59c700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 0x7f64c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:21.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.169+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e0147880 con 0x7f64e0154520 2024-01-21T21:31:21.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.173+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f64e0147880 con 0x7f64e0154520 2024-01-21T21:31:21.206 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:21.204+0000 7fe45f446680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:31:21.278 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:21.275+0000 7fe45f446680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:31:21.279 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:21.275+0000 7eff6b751680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:31:21.355 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:21.352+0000 7eff6b751680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:31:21.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.369+0000 7f64de59c700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 msgr2=0x7f64c0061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:21.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.369+0000 7f64de59c700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 0x7f64c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.407+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64e0147880 con 0x7f64e0154520 2024-01-21T21:31:21.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.407+0000 7f64ceffd700 1 -- 172.21.15.133:0/259565817 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v178) v1 ==== 110+0+10 (secure 0 0 0) 0x7f64e0147880 con 0x7f64e0154520 2024-01-21T21:31:21.411 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:31:21.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 msgr2=0x7f64c0061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:21.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 0x7f64c0061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 msgr2=0x7f64e00b0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f64d800d180 tx=0x7f64d8009a50).stop 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 shutdown_connections 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e0154520 0x7f64e00b0910 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f64c005f270 0x7f64c0061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64e00c8120 0x7f64e0147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 --2- 172.21.15.133:0/259565817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64e0154140 0x7f64e0168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 >> 172.21.15.133:0/259565817 conn(0x7f64e005e1e0 msgr2=0x7f64e00ad530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 shutdown_connections 2024-01-21T21:31:21.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.410+0000 7f64e493a700 1 -- 172.21.15.133:0/259565817 wait complete. 2024-01-21T21:31:21.427 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:31:21.464 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:21.462+0000 7fe45f446680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:31:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.547+0000 7f42e80cf700 1 Processor -- start 2024-01-21T21:31:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.547+0000 7f42e80cf700 1 -- start start 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e80cf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e0067d90 0x7f42e0137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e80cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42e00c5930 0x7f42e00c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e80cf700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e00c62b0 con 0x7f42e0137030 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e80cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e0068370 con 0x7f42e00c5930 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e80cf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0068650 con 0x7f42e0067d90 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42e00c5930 0x7f42e00c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42e00c5930 0x7f42e00c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53956/0 (socket says 172.21.15.133:53956) 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 -- 172.21.15.133:0/213862502 learned_addr learned my addr 172.21.15.133:0/213862502 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e566a700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e0067d90 0x7f42e0137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 -- 172.21.15.133:0/213862502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e0067d90 msgr2=0x7f42e0137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e4e69700 1 -- 172.21.15.133:0/213862502 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758155421 0 0) 0x7f42e00c62b0 con 0x7f42e0137030 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e0067d90 0x7f42e0137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 -- 172.21.15.133:0/213862502 >> v1:172.21.15.178:6789/0 conn(0x7f42e0137030 legacy=0x7f42e0155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.548+0000 7f42e666c700 1 -- 172.21.15.133:0/213862502 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0068930 con 0x7f42e00c5930 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e666c700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e00c5930 0x7f42e00c5dc0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f42d8009f20 tx=0x7f42d8009840).ready entity=mon.0 client_cookie=e5f7a8e435073bee server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e4e69700 1 -- 172.21.15.133:0/213862502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800e070 con 0x7f42e00c5930 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e4e69700 1 -- 172.21.15.133:0/213862502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d800b9d0 con 0x7f42e00c5930 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e4e69700 1 -- 172.21.15.133:0/213862502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d800bd50 con 0x7f42e00c5930 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 -- 172.21.15.133:0/213862502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e00c5930 msgr2=0x7f42e00c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e00c5930 0x7f42e00c5dc0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f42d8009f20 tx=0x7f42d8009840).stop 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 -- 172.21.15.133:0/213862502 shutdown_connections 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e00c5930 0x7f42e00c5dc0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 --2- 172.21.15.133:0/213862502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e0067d90 0x7f42e0137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 -- 172.21.15.133:0/213862502 >> 172.21.15.133:0/213862502 conn(0x7f42e0066a90 msgr2=0x7f42e0066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 -- 172.21.15.133:0/213862502 shutdown_connections 2024-01-21T21:31:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.549+0000 7f42e80cf700 1 -- 172.21.15.133:0/213862502 wait complete. 2024-01-21T21:31:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 Processor -- start 2024-01-21T21:31:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 -- start start 2024-01-21T21:31:21.556 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:21.551+0000 7eff6b751680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42e0067d90 0x7f42e00adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e00c5930 0x7f42e0136870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e0155140 con 0x7f42e0137030 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01553e0 con 0x7f42e0067d90 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e80cf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e01556c0 con 0x7f42e00c5930 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e666c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e666c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53960/0 (socket says 172.21.15.133:53960) 2024-01-21T21:31:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.551+0000 7f42e666c700 1 -- 172.21.15.133:0/1971074733 learned_addr learned my addr 172.21.15.133:0/1971074733 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e566a700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e00c5930 0x7f42e0136870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e5e6b700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42e0067d90 0x7f42e00adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 -- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e00c5930 msgr2=0x7f42e0136870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e00c5930 0x7f42e0136870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 -- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42e0067d90 msgr2=0x7f42e00adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42e0067d90 0x7f42e00adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 -- 172.21.15.133:0/1971074733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8009ae0 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e666c700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f42d800b610 tx=0x7f42d8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80092e0 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d801e470 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e01559a0 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d801e810 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.552+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e01580b0 con 0x7f42e0137030 2024-01-21T21:31:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.553+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e0155b60 con 0x7f42e0137030 2024-01-21T21:31:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.553+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f42d8003040 con 0x7f42e0137030 2024-01-21T21:31:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.554+0000 7f42d67fc700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 0x7f42c4061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.554+0000 7f42e5e6b700 1 -- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 msgr2=0x7f42c4061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.554+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f42d807bb60 con 0x7f42e0137030 2024-01-21T21:31:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.554+0000 7f42e5e6b700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 0x7f42c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:21.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.558+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f42d804c920 con 0x7f42e0137030 2024-01-21T21:31:21.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.726+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42e005fdf0 con 0x7f42e0137030 2024-01-21T21:31:21.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.726+0000 7f42d67fc700 1 -- 172.21.15.133:0/1971074733 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v178) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42d8023020 con 0x7f42e0137030 2024-01-21T21:31:21.730 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 msgr2=0x7f42c4061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 0x7f42c4061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 msgr2=0x7f42e0137cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f42d800b610 tx=0x7f42d8009840).stop 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 shutdown_connections 2024-01-21T21:31:21.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42e0137030 0x7f42e0137cb0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f42c405f270 0x7f42c4061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42e0067d90 0x7f42e00adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 --2- 172.21.15.133:0/1971074733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42e00c5930 0x7f42e0136870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 >> 172.21.15.133:0/1971074733 conn(0x7f42e0066a90 msgr2=0x7f42e00c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 shutdown_connections 2024-01-21T21:31:21.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.728+0000 7f42e80cf700 1 -- 172.21.15.133:0/1971074733 wait complete. 2024-01-21T21:31:21.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T21:31:21.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.866+0000 7f21b8ad6700 1 Processor -- start 2024-01-21T21:31:21.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.866+0000 7f21b8ad6700 1 -- start start 2024-01-21T21:31:21.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b8ad6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21b4154140 0x7f21b4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b8ad6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21b40c8120 0x7f21b40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b8ad6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b40ab620 con 0x7f21b4154520 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b8ad6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40c6ae0 con 0x7f21b4154140 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b8ad6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b40c05e0 con 0x7f21b40c8120 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.867+0000 7f21b259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21b4154140 0x7f21b4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21b4154140 0x7f21b4158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53974/0 (socket says 172.21.15.133:53974) 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 -- 172.21.15.133:0/2386922842 learned_addr learned my addr 172.21.15.133:0/2386922842 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b2d9d700 1 --2- 172.21.15.133:0/2386922842 >> v2:172.21.15.178:3300/0 conn(0x7f21b40c8120 0x7f21b40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 -- 172.21.15.133:0/2386922842 >> v2:172.21.15.178:3300/0 conn(0x7f21b40c8120 msgr2=0x7f21b40ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 --2- 172.21.15.133:0/2386922842 >> v2:172.21.15.178:3300/0 conn(0x7f21b40c8120 0x7f21b40ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 -- 172.21.15.133:0/2386922842 >> v1:172.21.15.178:6789/0 conn(0x7f21b4154520 legacy=0x7f21b40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 -- 172.21.15.133:0/2386922842 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40c0e40 con 0x7f21b4154140 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b259c700 1 --2- 172.21.15.133:0/2386922842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4158bb0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f21a4006fd0 tx=0x7f21a40090f0).ready entity=mon.0 client_cookie=445d133c63c09010 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b159a700 1 -- 172.21.15.133:0/2386922842 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400b520 con 0x7f21b4154140 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b159a700 1 -- 172.21.15.133:0/2386922842 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400b680 con 0x7f21b4154140 2024-01-21T21:31:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.868+0000 7f21b159a700 1 -- 172.21.15.133:0/2386922842 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400ba00 con 0x7f21b4154140 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 -- 172.21.15.133:0/2386922842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 msgr2=0x7f21b4158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/2386922842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4158bb0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f21a4006fd0 tx=0x7f21a40090f0).stop 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 -- 172.21.15.133:0/2386922842 shutdown_connections 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/2386922842 >> v2:172.21.15.178:3300/0 conn(0x7f21b40c8120 0x7f21b40ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/2386922842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4158bb0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 -- 172.21.15.133:0/2386922842 >> 172.21.15.133:0/2386922842 conn(0x7f21b405e1e0 msgr2=0x7f21b405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 -- 172.21.15.133:0/2386922842 shutdown_connections 2024-01-21T21:31:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.869+0000 7f21b8ad6700 1 -- 172.21.15.133:0/2386922842 wait complete. 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.870+0000 7f21b8ad6700 1 Processor -- start 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.870+0000 7f21b8ad6700 1 -- start start 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 0x7f21b4147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 0x7f21b40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40c9e40 con 0x7f21b4154140 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40c9290 con 0x7f21b4154520 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b8ad6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b40c9510 con 0x7f21b40c8120 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 0x7f21b40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 0x7f21b4147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53984/0 (socket says 172.21.15.133:53984) 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 0x7f21b4147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:60332/0 (socket says 172.21.15.133:60332) 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b1d9b700 1 -- 172.21.15.133:0/3758127656 learned_addr learned my addr 172.21.15.133:0/3758127656 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 -- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 msgr2=0x7f21b4147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 0x7f21b4147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 -- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 msgr2=0x7f21b4144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.871+0000 7f21b2d9d700 1 -- 172.21.15.133:0/3758127656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009370 con 0x7f21b4154520 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21b2d9d700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 0x7f21b40ca2d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f21ac009e50 tx=0x7f21ac00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00caa0 con 0x7f21b4154520 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00f040 con 0x7f21b4154520 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00ce10 con 0x7f21b4154520 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b40c97f0 con 0x7f21b4154520 2024-01-21T21:31:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.872+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b4146d60 con 0x7f21b4154520 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.873+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b405fdf0 con 0x7f21b4154520 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.873+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f21ac013610 con 0x7f21b4154520 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.873+0000 7f21a2ffd700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 0x7f2194061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.873+0000 7f21b259c700 1 -- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 msgr2=0x7f2194061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.873+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f21ac07af70 con 0x7f21b4154520 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.874+0000 7f21b259c700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 0x7f2194061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:21.878+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f21ac0a9b00 con 0x7f21b4154520 2024-01-21T21:31:21.887 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:21.884+0000 7fe45f446680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:31:21.991 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:21.988+0000 7fe45f446680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:21.997 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:21.993+0000 7eff6b751680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:31:22.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.047+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21b4063040 con 0x7f21b4154520 2024-01-21T21:31:22.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.047+0000 7f21a2ffd700 1 -- 172.21.15.133:0/3758127656 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v178) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21ac04bc80 con 0x7f21b4154520 2024-01-21T21:31:22.051 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 msgr2=0x7f2194061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 0x7f2194061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 msgr2=0x7f21b40ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 0x7f21b40ca2d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f21ac009e50 tx=0x7f21ac00b040).stop 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 shutdown_connections 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f219405f270 0x7f2194061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21b4154520 0x7f21b40ca2d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21b40c8120 0x7f21b4147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 --2- 172.21.15.133:0/3758127656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21b4154140 0x7f21b4144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 >> 172.21.15.133:0/3758127656 conn(0x7f21b405e1e0 msgr2=0x7f21b40c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 shutdown_connections 2024-01-21T21:31:22.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.049+0000 7f21b8ad6700 1 -- 172.21.15.133:0/3758127656 wait complete. 2024-01-21T21:31:22.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T21:31:22.107 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.104+0000 7eff6b751680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:22.145 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:22.143+0000 7fe45f446680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.183+0000 7fd41bcc8700 1 Processor -- start 2024-01-21T21:31:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.184+0000 7fd41bcc8700 1 -- start start 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd41bcc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd414062c10 0x7fd414062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd41bcc8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4140634e0 con 0x7fd4140697e0 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd41bcc8700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41406a130 con 0x7fd414065d70 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd41bcc8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41406a410 con 0x7fd414062c10 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419a64700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd414062c10 0x7fd414062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419263700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd4140697e0 0x7fd414065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40678/0 (socket says 172.21.15.133:40678) 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419263700 1 -- 172.21.15.133:0/2135731342 learned_addr learned my addr 172.21.15.133:0/2135731342 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419a64700 1 -- 172.21.15.133:0/2135731342 >> v1:172.21.15.178:6789/0 conn(0x7fd414065d70 legacy=0x7fd4140bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419a64700 1 -- 172.21.15.133:0/2135731342 >> v1:172.21.15.133:6789/0 conn(0x7fd4140697e0 legacy=0x7fd414065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419a64700 1 -- 172.21.15.133:0/2135731342 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41406a6f0 con 0x7fd414062c10 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd418a62700 1 -- 172.21.15.133:0/2135731342 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014425025 0 0) 0x7fd4140634e0 con 0x7fd4140697e0 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd419a64700 1 --2- 172.21.15.133:0/2135731342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414062c10 0x7fd414062ff0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fd40c009760 tx=0x7fd40c009060).ready entity=mon.0 client_cookie=88eebd573fe89826 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd418a62700 1 -- 172.21.15.133:0/2135731342 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c009120 con 0x7fd414062c10 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd418a62700 1 -- 172.21.15.133:0/2135731342 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00b580 con 0x7fd414062c10 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.185+0000 7fd418a62700 1 -- 172.21.15.133:0/2135731342 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00b900 con 0x7fd414062c10 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 -- 172.21.15.133:0/2135731342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414062c10 msgr2=0x7fd414062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/2135731342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414062c10 0x7fd414062ff0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 rx=0x7fd40c009760 tx=0x7fd40c009060).stop 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 -- 172.21.15.133:0/2135731342 shutdown_connections 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/2135731342 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414062c10 0x7fd414062ff0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 -- 172.21.15.133:0/2135731342 >> 172.21.15.133:0/2135731342 conn(0x7fd4140c8010 msgr2=0x7fd4140c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 -- 172.21.15.133:0/2135731342 shutdown_connections 2024-01-21T21:31:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.186+0000 7fd41bcc8700 1 -- 172.21.15.133:0/2135731342 wait complete. 2024-01-21T21:31:22.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.187+0000 7fd41bcc8700 1 Processor -- start 2024-01-21T21:31:22.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 -- start start 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd414062c10 0x7fd4141540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4140697e0 0x7fd414155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414156d20 con 0x7fd414065d70 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd414157b20 con 0x7fd4140697e0 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41bcc8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd414156f10 con 0x7fd414062c10 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd419263700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd419263700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54002/0 (socket says 172.21.15.133:54002) 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd419263700 1 -- 172.21.15.133:0/510859479 learned_addr learned my addr 172.21.15.133:0/510859479 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd41a265700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4140697e0 0x7fd414155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.188+0000 7fd419a64700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd414062c10 0x7fd4141540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 -- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd414062c10 msgr2=0x7fd4141540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd414062c10 0x7fd4141540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 -- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4140697e0 msgr2=0x7fd414155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4140697e0 0x7fd414155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 -- 172.21.15.133:0/510859479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0092a0 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd419263700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fd40400c4c0 tx=0x7fd404007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400ce30 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4040072e0 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4141571f0 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4040057a0 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.189+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4141577b0 con 0x7fd414065d70 2024-01-21T21:31:22.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.190+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41405fdf0 con 0x7fd414065d70 2024-01-21T21:31:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.191+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fd404005bd0 con 0x7fd414065d70 2024-01-21T21:31:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.191+0000 7fd40a7fc700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 0x7fd3f8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.191+0000 7fd419a64700 1 -- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 msgr2=0x7fd3f8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.191+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7fd404079f10 con 0x7fd414065d70 2024-01-21T21:31:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.191+0000 7fd419a64700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 0x7fd3f8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.195+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd40404ac20 con 0x7fd414065d70 2024-01-21T21:31:22.221 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:22.219+0000 7fe45f446680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:31:22.268 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.264+0000 7eff6b751680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:22.289 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:22.286+0000 7fe45f446680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:31:22.344 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.340+0000 7eff6b751680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:31:22.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.365+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4140bcf70 con 0x7fd414065d70 2024-01-21T21:31:22.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.366+0000 7fd40a7fc700 1 -- 172.21.15.133:0/510859479 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd40404e240 con 0x7fd414065d70 2024-01-21T21:31:22.369 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:31:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 msgr2=0x7fd3f8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:22.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 0x7fd3f8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 msgr2=0x7fd414157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fd40400c4c0 tx=0x7fd404007c10).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 shutdown_connections 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3f805f270 0x7fd3f8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4140697e0 0x7fd414155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd414062c10 0x7fd4141540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 --2- 172.21.15.133:0/510859479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd414065d70 0x7fd414157fb0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 >> 172.21.15.133:0/510859479 conn(0x7fd4140c8010 msgr2=0x7fd414065660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 shutdown_connections 2024-01-21T21:31:22.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.368+0000 7fd41bcc8700 1 -- 172.21.15.133:0/510859479 wait complete. 2024-01-21T21:31:22.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:22.414 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.411+0000 7eff6b751680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:31:22.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.529+0000 7f2684f54700 1 Processor -- start 2024-01-21T21:31:22.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.529+0000 7f2684f54700 1 -- start start 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f2684f54700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 0x7f2680158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f2684f54700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 0x7f26800ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f2684f54700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800ab620 con 0x7f26800c6090 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f2684f54700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800c6ae0 con 0x7f2680154520 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f2684f54700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26800c05e0 con 0x7f2680154140 2024-01-21T21:31:22.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26800c6090 0x7f26800c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40690/0 (socket says 172.21.15.133:40690) 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267ed9d700 1 -- 172.21.15.133:0/4210945752 learned_addr learned my addr 172.21.15.133:0/4210945752 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267dd9b700 1 --2- 172.21.15.133:0/4210945752 >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 0x7f26800ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267e59c700 1 --2- 172.21.15.133:0/4210945752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 0x7f2680158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267d59a700 1 -- 172.21.15.133:0/4210945752 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203188956 0 0) 0x7f26800ab620 con 0x7f26800c6090 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267d59a700 1 -- 172.21.15.133:0/4210945752 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26680033f0 con 0x7f26800c6090 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267e59c700 1 -- 172.21.15.133:0/4210945752 >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 msgr2=0x7f26800ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267e59c700 1 --2- 172.21.15.133:0/4210945752 >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 0x7f26800ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267e59c700 1 -- 172.21.15.133:0/4210945752 >> v1:172.21.15.133:6789/0 conn(0x7f26800c6090 legacy=0x7f26800c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.530+0000 7f267e59c700 1 -- 172.21.15.133:0/4210945752 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800c0e40 con 0x7f2680154140 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f267dd9b700 1 --2- 172.21.15.133:0/4210945752 >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 0x7f26800ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f267e59c700 1 --2- 172.21.15.133:0/4210945752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 0x7f2680158bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2670009760 tx=0x7f2670009060).ready entity=mon.2 client_cookie=c8ac67723ac89b48 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f267d59a700 1 -- 172.21.15.133:0/4210945752 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000d4a0 con 0x7f2680154140 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f267d59a700 1 -- 172.21.15.133:0/4210945752 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000d600 con 0x7f2680154140 2024-01-21T21:31:22.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f267d59a700 1 -- 172.21.15.133:0/4210945752 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000d980 con 0x7f2680154140 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 -- 172.21.15.133:0/4210945752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 msgr2=0x7f2680158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 --2- 172.21.15.133:0/4210945752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 0x7f2680158bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f2670009760 tx=0x7f2670009060).stop 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 -- 172.21.15.133:0/4210945752 shutdown_connections 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 --2- 172.21.15.133:0/4210945752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154140 0x7f2680158bb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 --2- 172.21.15.133:0/4210945752 >> v2:172.21.15.178:3300/0 conn(0x7f2680154520 0x7f26800ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 -- 172.21.15.133:0/4210945752 >> 172.21.15.133:0/4210945752 conn(0x7f268005e1e0 msgr2=0x7f268005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 -- 172.21.15.133:0/4210945752 shutdown_connections 2024-01-21T21:31:22.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.531+0000 7f2684f54700 1 -- 172.21.15.133:0/4210945752 wait complete. 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.533+0000 7f2684f54700 1 Processor -- start 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.533+0000 7f2684f54700 1 -- start start 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2680154140 0x7f26800ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154520 0x7f26800cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268014e1e0 con 0x7f26800c6090 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268014e3f0 con 0x7f2680154140 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268014e6d0 con 0x7f2680154520 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54006/0 (socket says 172.21.15.133:54006) 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 -- 172.21.15.133:0/3427558567 learned_addr learned my addr 172.21.15.133:0/3427558567 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267dd9b700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2680154140 0x7f26800ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267ed9d700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154520 0x7f26800cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154520 msgr2=0x7f26800cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154520 0x7f26800cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2680154140 msgr2=0x7f26800ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2680154140 0x7f26800ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 -- 172.21.15.133:0/3427558567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740092a0 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f267e59c700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f2670009d50 tx=0x7f2670016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670021070 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2670000bc0 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 -- 172.21.15.133:0/3427558567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700092a0 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000d980 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.534+0000 7f2684f54700 1 -- 172.21.15.133:0/3427558567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268014ec90 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.535+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268005fdf0 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.536+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f267001d640 con 0x7f26800c6090 2024-01-21T21:31:22.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.536+0000 7f266effd700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 0x7f2660061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.536+0000 7f267dd9b700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 msgr2=0x7f2660061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.536+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7f267007bc20 con 0x7f26800c6090 2024-01-21T21:31:22.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.536+0000 7f267dd9b700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 0x7f2660061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:22.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.540+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f267004c930 con 0x7f26800c6090 2024-01-21T21:31:22.545 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:22.543+0000 7fe45f446680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:31:22.700 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.696+0000 7eff6b751680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:31:22.731 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:22.729+0000 7fe45f446680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:22.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.737+0000 7f267dd9b700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 msgr2=0x7f2660061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:22.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.737+0000 7f267dd9b700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 0x7f2660061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:22.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.769+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26800c00f0 con 0x7f26800c6090 2024-01-21T21:31:22.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.769+0000 7f266effd700 1 -- 172.21.15.133:0/3427558567 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f267004ff50 con 0x7f26800c6090 2024-01-21T21:31:22.773 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:22.773 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:31:22.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 msgr2=0x7f2660061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:22.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 0x7f2660061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 msgr2=0x7f268014fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f2670009d50 tx=0x7f2670016000).stop 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 shutdown_connections 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2680154520 0x7f26800cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800c6090 0x7f268014fa10 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f266005f270 0x7f2660061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 --2- 172.21.15.133:0/3427558567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2680154140 0x7f26800ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.771+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 >> 172.21.15.133:0/3427558567 conn(0x7f268005e1e0 msgr2=0x7f26800c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.772+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 shutdown_connections 2024-01-21T21:31:22.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.772+0000 7f266cff9700 1 -- 172.21.15.133:0/3427558567 wait complete. 2024-01-21T21:31:22.777 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:31:22.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:22.892 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:22.888+0000 7eff6b751680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.905+0000 7ff1ab3b2700 1 Processor -- start 2024-01-21T21:31:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 -- start start 2024-01-21T21:31:22.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413a620 0x7ff1a40a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1a413aa00 0x7ff1a4158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1a40626f0 0x7ff1a4062ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40bd6f0 con 0x7ff1a413aa00 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a41584f0 con 0x7ff1a40626f0 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.906+0000 7ff1ab3b2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4063090 con 0x7ff1a413a620 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1a413aa00 0x7ff1a4158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1a413aa00 0x7ff1a4158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54016/0 (socket says 172.21.15.133:54016) 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 -- 172.21.15.133:0/35053862 learned_addr learned my addr 172.21.15.133:0/35053862 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a994f700 1 --2- 172.21.15.133:0/35053862 >> v2:172.21.15.178:3300/0 conn(0x7ff1a40626f0 0x7ff1a4062ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a914e700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413a620 0x7ff1a40a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 -- 172.21.15.133:0/35053862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413a620 msgr2=0x7ff1a40a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413a620 0x7ff1a40a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 -- 172.21.15.133:0/35053862 >> v2:172.21.15.178:3300/0 conn(0x7ff1a40626f0 msgr2=0x7ff1a4062ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 --2- 172.21.15.133:0/35053862 >> v2:172.21.15.178:3300/0 conn(0x7ff1a40626f0 0x7ff1a4062ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 -- 172.21.15.133:0/35053862 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40654e0 con 0x7ff1a413aa00 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff1a894d700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413aa00 0x7ff1a4158000 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7ff1a40be880 tx=0x7ff1940090f0).ready entity=mon.0 client_cookie=2c168d4f48d4f65b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff19bfff700 1 -- 172.21.15.133:0/35053862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400f510 con 0x7ff1a413aa00 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff19bfff700 1 -- 172.21.15.133:0/35053862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19400f670 con 0x7ff1a413aa00 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.907+0000 7ff19bfff700 1 -- 172.21.15.133:0/35053862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19400fa10 con 0x7ff1a413aa00 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/35053862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413aa00 msgr2=0x7ff1a4158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413aa00 0x7ff1a4158000 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7ff1a40be880 tx=0x7ff1940090f0).stop 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/35053862 shutdown_connections 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/35053862 >> v2:172.21.15.178:3300/0 conn(0x7ff1a40626f0 0x7ff1a4062ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413a620 0x7ff1a40a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/35053862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413aa00 0x7ff1a4158000 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/35053862 >> 172.21.15.133:0/35053862 conn(0x7ff1a40c7dc0 msgr2=0x7ff1a40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/35053862 shutdown_connections 2024-01-21T21:31:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.908+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/35053862 wait complete. 2024-01-21T21:31:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.909+0000 7ff1ab3b2700 1 Processor -- start 2024-01-21T21:31:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 -- start start 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a40626f0 0x7ff1a413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413aa00 0x7ff1a40aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40adca0 con 0x7ff1a413a620 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40ad090 con 0x7ff1a40626f0 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.910+0000 7ff1ab3b2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40ad370 con 0x7ff1a413aa00 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54032/0 (socket says 172.21.15.133:54032) 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 -- 172.21.15.133:0/2388465079 learned_addr learned my addr 172.21.15.133:0/2388465079 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a914e700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a40626f0 0x7ff1a413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a994f700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413aa00 0x7ff1a40aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 -- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413aa00 msgr2=0x7ff1a40aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413aa00 0x7ff1a40aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 -- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a40626f0 msgr2=0x7ff1a413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a40626f0 0x7ff1a413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 -- 172.21.15.133:0/2388465079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194009370 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1a894d700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7ff1a40690c0 tx=0x7ff194016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194006d90 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194000bc0 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a40ad650 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19401b430 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.911+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a413cc60 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a405fdf0 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ff19401b7e0 con 0x7ff1a413a620 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff199ffb700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 0x7ff188061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff1a914e700 1 -- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 msgr2=0x7ff188061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7208+0+0 (secure 0 0 0) 0x7ff19407bed0 con 0x7ff1a413a620 2024-01-21T21:31:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.913+0000 7ff1a914e700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 0x7ff188061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:22.917+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff19404cbe0 con 0x7ff1a413a620 2024-01-21T21:31:23.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.087+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a406a6a0 con 0x7ff1a413a620 2024-01-21T21:31:23.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.088+0000 7ff199ffb700 1 -- 172.21.15.133:0/2388465079 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+18631 (secure 0 0 0) 0x7ff194015070 con 0x7ff1a413a620 2024-01-21T21:31:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:23.092 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":178,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:26:21.395858+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.c","mappings":[{"from":4,"to":3}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2411234209":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/87070792":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/4030620961":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/278818299":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6833/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6832/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:0/431323944":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/1221203277":"2024-01-22T21:15:28.885597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 msgr2=0x7ff188061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 0x7ff188061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 msgr2=0x7ff1a40ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7ff1a40690c0 tx=0x7ff194016000).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 shutdown_connections 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1a413aa00 0x7ff1a40aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff18805f270 0x7ff188061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1a40626f0 0x7ff1a413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 --2- 172.21.15.133:0/2388465079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1a413a620 0x7ff1a40ac510 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 >> 172.21.15.133:0/2388465079 conn(0x7ff1a40c7dc0 msgr2=0x7ff1a40bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 shutdown_connections 2024-01-21T21:31:23.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.090+0000 7ff1ab3b2700 1 -- 172.21.15.133:0/2388465079 wait complete. 2024-01-21T21:31:23.107 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:31:23.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:23.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.248+0000 7fb58a7d1700 1 Processor -- start 2024-01-21T21:31:23.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 -- start start 2024-01-21T21:31:23.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb584137030 0x7fb584067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb584137410 0x7fb584155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5841557f0 con 0x7fb5840c5930 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584068370 con 0x7fb584137030 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb58a7d1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584068650 con 0x7fb584137410 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.249+0000 7fb583fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb584137030 0x7fb584067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb588d6e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5840c5930 0x7fb5840c5d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40702/0 (socket says 172.21.15.133:40702) 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb584137030 0x7fb584067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54040/0 (socket says 172.21.15.133:54040) 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb588d6e700 1 -- 172.21.15.133:0/2044784428 learned_addr learned my addr 172.21.15.133:0/2044784428 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb5837fe700 1 --2- 172.21.15.133:0/2044784428 >> v2:172.21.15.178:3300/0 conn(0x7fb584137410 0x7fb584155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 -- 172.21.15.133:0/2044784428 >> v2:172.21.15.178:3300/0 conn(0x7fb584137410 msgr2=0x7fb584155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 --2- 172.21.15.133:0/2044784428 >> v2:172.21.15.178:3300/0 conn(0x7fb584137410 0x7fb584155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 -- 172.21.15.133:0/2044784428 >> v1:172.21.15.133:6789/0 conn(0x7fb5840c5930 legacy=0x7fb5840c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 -- 172.21.15.133:0/2044784428 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584068930 con 0x7fb584137030 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb583fff700 1 --2- 172.21.15.133:0/2044784428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb584137030 0x7fb584067d90 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7fb5840af0d0 tx=0x7fb574009060).ready entity=mon.0 client_cookie=69b618473d110e33 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb582ffd700 1 -- 172.21.15.133:0/2044784428 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740090d0 con 0x7fb584137030 2024-01-21T21:31:23.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb582ffd700 1 -- 172.21.15.133:0/2044784428 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400f510 con 0x7fb584137030 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.250+0000 7fb582ffd700 1 -- 172.21.15.133:0/2044784428 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400f890 con 0x7fb584137030 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2044784428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb584137030 msgr2=0x7fb584067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2044784428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb584137030 0x7fb584067d90 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7fb5840af0d0 tx=0x7fb574009060).stop 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2044784428 shutdown_connections 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2044784428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb584137030 0x7fb584067d90 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2044784428 >> v2:172.21.15.178:3300/0 conn(0x7fb584137410 0x7fb584155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2044784428 >> 172.21.15.133:0/2044784428 conn(0x7fb584066a90 msgr2=0x7fb584066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2044784428 shutdown_connections 2024-01-21T21:31:23.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.251+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2044784428 wait complete. 2024-01-21T21:31:23.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.252+0000 7fb58a7d1700 1 Processor -- start 2024-01-21T21:31:23.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.252+0000 7fb58a7d1700 1 -- start start 2024-01-21T21:31:23.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb584137030 0x7fb58413d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb584137410 0x7fb584159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb584136ed0 con 0x7fb5840c5930 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58413de90 con 0x7fb584137410 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb58a7d1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58413ad60 con 0x7fb584137030 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54048/0 (socket says 172.21.15.133:54048) 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 -- 172.21.15.133:0/2730548557 learned_addr learned my addr 172.21.15.133:0/2730548557 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb588d6e700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb584137410 0x7fb584159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb5837fe700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb584137030 0x7fb58413d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb584137030 msgr2=0x7fb58413d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb584137030 0x7fb58413d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb584137410 msgr2=0x7fb584159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb584137410 0x7fb584159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 -- 172.21.15.133:0/2730548557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5740092a0 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.253+0000 7fb583fff700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fb574009dd0 tx=0x7fb574017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.254+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400fea0 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.254+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57400f680 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.254+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57401b440 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.254+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58413b040 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.254+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58413b600 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.255+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840abeb0 con 0x7fb5840c5930 2024-01-21T21:31:23.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.255+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7fb57401b830 con 0x7fb5840c5930 2024-01-21T21:31:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.256+0000 7fb580ff9700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 0x7fb570061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.256+0000 7fb5837fe700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 msgr2=0x7fb570061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.256+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7264+0+0 (secure 0 0 0) 0x7fb57407be90 con 0x7fb5840c5930 2024-01-21T21:31:23.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.256+0000 7fb5837fe700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 0x7fb570061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:23.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.259+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb5840abeb0 con 0x7fb5840c5930 2024-01-21T21:31:23.456 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.453+0000 7fe45f446680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:31:23.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.457+0000 7fb5837fe700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 msgr2=0x7fb570061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:23.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.457+0000 7fb5837fe700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 0x7fb570061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.511+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5840abeb0 con 0x7fb5840c5930 2024-01-21T21:31:23.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.512+0000 7fb580ff9700 1 -- 172.21.15.133:0/2730548557 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7fb5840abeb0 con 0x7fb5840c5930 2024-01-21T21:31:23.515 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:23.515 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:31:23.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 msgr2=0x7fb570061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:23.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 0x7fb570061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 msgr2=0x7fb5841369e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fb574009dd0 tx=0x7fb574017000).stop 2024-01-21T21:31:23.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 shutdown_connections 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb57005f270 0x7fb570061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb584137410 0x7fb584159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5840c5930 0x7fb5841369e0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 --2- 172.21.15.133:0/2730548557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb584137030 0x7fb58413d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.514+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 >> 172.21.15.133:0/2730548557 conn(0x7fb584066a90 msgr2=0x7fb584157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.515+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 shutdown_connections 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.515+0000 7fb58a7d1700 1 -- 172.21.15.133:0/2730548557 wait complete. 2024-01-21T21:31:23.518 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:31:23.526 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.523+0000 7fe45f446680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:31:23.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:23.601 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.598+0000 7fe45f446680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:31:23.639 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:23.636+0000 7eff6b751680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:31:23.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.648+0000 7f2fafc47700 1 Processor -- start 2024-01-21T21:31:23.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.648+0000 7f2fafc47700 1 -- start start 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fafc47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fa8158bb0 0x7f2fa8154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fafc47700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa80c0e40 con 0x7f2fa8154140 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fafc47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa80c6800 con 0x7f2fa80c8120 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fafc47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa8154a10 con 0x7f2fa8158bb0 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fae1e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fa8158bb0 0x7f2fa8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fad9e3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fa8154140 0x7f2fa80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40706/0 (socket says 172.21.15.133:40706) 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fad9e3700 1 -- 172.21.15.133:0/3385555022 learned_addr learned my addr 172.21.15.133:0/3385555022 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fac9e1700 1 -- 172.21.15.133:0/3385555022 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549513944 0 0) 0x7f2fa80c0e40 con 0x7f2fa8154140 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fac9e1700 1 -- 172.21.15.133:0/3385555022 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f940033f0 con 0x7f2fa8154140 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fae1e4700 1 -- 172.21.15.133:0/3385555022 >> v1:172.21.15.178:6789/0 conn(0x7f2fa80c8120 legacy=0x7f2fa80c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fae1e4700 1 -- 172.21.15.133:0/3385555022 >> v1:172.21.15.133:6789/0 conn(0x7f2fa8154140 legacy=0x7f2fa80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fae1e4700 1 -- 172.21.15.133:0/3385555022 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa80c07f0 con 0x7f2fa8158bb0 2024-01-21T21:31:23.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.649+0000 7f2fae1e4700 1 --2- 172.21.15.133:0/3385555022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8158bb0 0x7f2fa8154520 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2fa0009e60 tx=0x7f2fa0009780).ready entity=mon.0 client_cookie=e8bda2ca51222d42 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fac9e1700 1 -- 172.21.15.133:0/3385555022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000e070 con 0x7f2fa8158bb0 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fac9e1700 1 -- 172.21.15.133:0/3385555022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000bb60 con 0x7f2fa8158bb0 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fac9e1700 1 -- 172.21.15.133:0/3385555022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0012410 con 0x7f2fa8158bb0 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 -- 172.21.15.133:0/3385555022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8158bb0 msgr2=0x7f2fa8154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 --2- 172.21.15.133:0/3385555022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8158bb0 0x7f2fa8154520 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f2fa0009e60 tx=0x7f2fa0009780).stop 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 -- 172.21.15.133:0/3385555022 shutdown_connections 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 --2- 172.21.15.133:0/3385555022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8158bb0 0x7f2fa8154520 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 -- 172.21.15.133:0/3385555022 >> 172.21.15.133:0/3385555022 conn(0x7f2fa805e1e0 msgr2=0x7f2fa805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 -- 172.21.15.133:0/3385555022 shutdown_connections 2024-01-21T21:31:23.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.650+0000 7f2fafc47700 1 -- 172.21.15.133:0/3385555022 wait complete. 2024-01-21T21:31:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.652+0000 7f2fafc47700 1 Processor -- start 2024-01-21T21:31:23.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.652+0000 7f2fafc47700 1 -- start start 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa80c8120 0x7f2fa80c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa8158bb0 0x7f2fa814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814bde0 con 0x7f2fa8154140 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814af70 con 0x7f2fa80c8120 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fafc47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa8148690 con 0x7f2fa8158bb0 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54068/0 (socket says 172.21.15.133:54068) 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 -- 172.21.15.133:0/1971573712 learned_addr learned my addr 172.21.15.133:0/1971573712 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad9e3700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa80c8120 0x7f2fa80c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fae1e4700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa8158bb0 0x7f2fa814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa8158bb0 msgr2=0x7f2fa814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa8158bb0 0x7f2fa814b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa80c8120 msgr2=0x7f2fa80c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa80c8120 0x7f2fa80c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 -- 172.21.15.133:0/1971573712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0009a20 con 0x7f2fa8154140 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.653+0000 7f2fad1e2700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f2f9800c4c0 tx=0x7f2f98007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.654+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800ce70 con 0x7f2fa8154140 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.654+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98001e90 con 0x7f2fa8154140 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.654+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa814a0c0 con 0x7f2fa8154140 2024-01-21T21:31:23.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.654+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007250 con 0x7f2fa8154140 2024-01-21T21:31:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.654+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa814a640 con 0x7f2fa8154140 2024-01-21T21:31:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.655+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa814b0e0 con 0x7f2fa8154140 2024-01-21T21:31:23.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.656+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f2f980066a0 con 0x7f2fa8154140 2024-01-21T21:31:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.656+0000 7f2f9e7fc700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 0x7f2f8c061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.656+0000 7f2fad9e3700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 msgr2=0x7f2f8c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.656+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f2f9807a6a0 con 0x7f2fa8154140 2024-01-21T21:31:23.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.656+0000 7f2fad9e3700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 0x7f2f8c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.660+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f9804b460 con 0x7f2fa8154140 2024-01-21T21:31:23.720 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:23.717+0000 7eff6b751680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:31:23.748 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.745+0000 7fe45f446680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:31:23.798 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:23.796+0000 7eff6b751680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:31:23.818 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.815+0000 7fe45f446680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:31:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.857+0000 7f2fad9e3700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 msgr2=0x7f2f8c061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.857+0000 7f2fad9e3700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 0x7f2f8c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:23.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.887+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fa805fdf0 con 0x7f2fa8154140 2024-01-21T21:31:23.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.887+0000 7f2f9e7fc700 1 -- 172.21.15.133:0/1971573712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4499 (secure 0 0 0) 0x7f2f9804ea80 con 0x7f2fa8154140 2024-01-21T21:31:23.890 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:23.890 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:15:17.583147+0000","modified":"2024-01-21T21:15:19.589489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9060},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9060":{"gid":9060,"name":"a","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2898630270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2898630270},{"type":"v1","addr":"172.21.15.133:6837","nonce":2898630270}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 msgr2=0x7f2f8c061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 0x7f2f8c061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 msgr2=0x7f2fa814b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f2f9800c4c0 tx=0x7f2f98007e00).stop 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 shutdown_connections 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fa8158bb0 0x7f2fa814b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f8c05f270 0x7f2f8c061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:23.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fa80c8120 0x7f2fa80c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 --2- 172.21.15.133:0/1971573712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fa8154140 0x7f2fa814b400 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 >> 172.21.15.133:0/1971573712 conn(0x7f2fa805e1e0 msgr2=0x7f2fa80ad3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 shutdown_connections 2024-01-21T21:31:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:23.889+0000 7f2fafc47700 1 -- 172.21.15.133:0/1971573712 wait complete. 2024-01-21T21:31:23.893 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2024-01-21T21:31:23.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:23.935 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:23.930+0000 7fe45f446680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:31:23.954 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:23.952+0000 7eff6b751680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:31:24.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.020+0000 7f4aebc51700 1 Processor -- start 2024-01-21T21:31:24.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.020+0000 7f4aebc51700 1 -- start start 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aebc51700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae4137030 0x7f4ae4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aebc51700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ae40c5930 0x7f4ae40c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aebc51700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40c62d0 con 0x7f4ae4137410 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aebc51700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae4068370 con 0x7f4ae40c5930 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aebc51700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4068650 con 0x7f4ae4137030 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ae40c5930 0x7f4ae40c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ae40c5930 0x7f4ae40c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54082/0 (socket says 172.21.15.133:54082) 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 -- 172.21.15.133:0/2512261679 learned_addr learned my addr 172.21.15.133:0/2512261679 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4ae99ed700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae4137030 0x7f4ae4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 -- 172.21.15.133:0/2512261679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae4137030 msgr2=0x7f4ae4067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae4137030 0x7f4ae4067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 -- 172.21.15.133:0/2512261679 >> v1:172.21.15.178:6789/0 conn(0x7f4ae4137410 legacy=0x7f4ae4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 -- 172.21.15.133:0/2512261679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae4068930 con 0x7f4ae40c5930 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.021+0000 7f4aea1ee700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae40c5930 0x7f4ae40c5de0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f4adc009f20 tx=0x7f4adc009840).ready entity=mon.0 client_cookie=1287be0451798f76 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4ae89eb700 1 -- 172.21.15.133:0/2512261679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00e070 con 0x7f4ae40c5930 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4ae89eb700 1 -- 172.21.15.133:0/2512261679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00b9d0 con 0x7f4ae40c5930 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4ae89eb700 1 -- 172.21.15.133:0/2512261679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc00bd50 con 0x7f4ae40c5930 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 -- 172.21.15.133:0/2512261679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae40c5930 msgr2=0x7f4ae40c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae40c5930 0x7f4ae40c5de0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f4adc009f20 tx=0x7f4adc009840).stop 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 -- 172.21.15.133:0/2512261679 shutdown_connections 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae40c5930 0x7f4ae40c5de0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 --2- 172.21.15.133:0/2512261679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae4137030 0x7f4ae4067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 -- 172.21.15.133:0/2512261679 >> 172.21.15.133:0/2512261679 conn(0x7f4ae4066a90 msgr2=0x7f4ae4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 -- 172.21.15.133:0/2512261679 shutdown_connections 2024-01-21T21:31:24.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.022+0000 7f4aebc51700 1 -- 172.21.15.133:0/2512261679 wait complete. 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 Processor -- start 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 -- start start 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae40c5930 0x7f4ae4157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4137030 0x7f4ae4156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4156c40 con 0x7f4ae4137410 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ac290 con 0x7f4ae4137030 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aebc51700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ac570 con 0x7f4ae40c5930 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aea1ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aea1ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54090/0 (socket says 172.21.15.133:54090) 2024-01-21T21:31:24.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.024+0000 7f4aea1ee700 1 -- 172.21.15.133:0/235778436 learned_addr learned my addr 172.21.15.133:0/235778436 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4ae91ec700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4137030 0x7f4ae4156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4ae99ed700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae40c5930 0x7f4ae4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 -- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae40c5930 msgr2=0x7f4ae4157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae40c5930 0x7f4ae4157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 -- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4137030 msgr2=0x7f4ae4156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4137030 0x7f4ae4156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 -- 172.21.15.133:0/235778436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009ae0 con 0x7f4ae4137410 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aea1ee700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f4ae4066530 tx=0x7f4adc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0092e0 con 0x7f4ae4137410 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc007080 con 0x7f4ae4137410 2024-01-21T21:31:24.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae40ac850 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc01e680 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.025+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae41653a0 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.026+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae41655c0 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.027+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7f4adc003040 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.027+0000 7f4ada7fc700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 0x7f4ac8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.027+0000 7f4ae99ed700 1 -- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 msgr2=0x7f4ac8061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.027+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7264+0+0 (secure 0 0 0) 0x7f4adc07bb70 con 0x7f4ae4137410 2024-01-21T21:31:24.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.027+0000 7f4ae99ed700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 0x7f4ac8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:24.032 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.027+0000 7eff6b751680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:31:24.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.035+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4adc04c900 con 0x7f4ae4137410 2024-01-21T21:31:24.041 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:24.039+0000 7fe45f446680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:24.152 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.150+0000 7eff6b751680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:31:24.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.204+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae405fdf0 con 0x7f4ae4137410 2024-01-21T21:31:24.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.206+0000 7f4ada7fc700 1 -- 172.21.15.133:0/235778436 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+18746 (secure 0 0 0) 0x7f4adc031950 con 0x7f4ae4137410 2024-01-21T21:31:24.209 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:24.209 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":179,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:23.105678+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:15:16.140843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-01-21T21:15:16.590297+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.c","mappings":[{"from":4,"to":3}]},{"pgid":"22.25","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/2411234209":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/87070792":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/4030620961":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/278818299":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6833/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:6832/43404":"2024-01-22T21:15:28.885597+0000","172.21.15.133:0/431323944":"2024-01-22T21:26:21.395820+0000","172.21.15.133:0/1221203277":"2024-01-22T21:15:28.885597+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 msgr2=0x7f4ac8061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 0x7f4ac8061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 msgr2=0x7f4ae4156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7f4ae4066530 tx=0x7f4adc009840).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 shutdown_connections 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ae4137410 0x7f4ae4156750 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae40c5930 0x7f4ae4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4ac805f270 0x7f4ac8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 --2- 172.21.15.133:0/235778436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae4137030 0x7f4ae4156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 >> 172.21.15.133:0/235778436 conn(0x7f4ae4066a90 msgr2=0x7f4ae40c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 shutdown_connections 2024-01-21T21:31:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.208+0000 7f4aebc51700 1 -- 172.21.15.133:0/235778436 wait complete. 2024-01-21T21:31:24.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T21:31:24.267 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.264+0000 7eff6b751680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:24.333 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:24.330+0000 7fe45f446680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:31:24.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.341+0000 7ffa8db0b700 1 Processor -- start 2024-01-21T21:31:24.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.341+0000 7ffa8db0b700 1 -- start start 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.341+0000 7ffa8db0b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137030 0x7ffa88067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.341+0000 7ffa8db0b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa880c5930 0x7ffa880c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa8db0b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa880c62d0 con 0x7ffa88137410 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa8db0b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa88068370 con 0x7ffa880c5930 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa8db0b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88068650 con 0x7ffa88137030 2024-01-21T21:31:24.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa880c5930 0x7ffa880c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa880c5930 0x7ffa880c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54102/0 (socket says 172.21.15.133:54102) 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 -- 172.21.15.133:0/4111226985 learned_addr learned my addr 172.21.15.133:0/4111226985 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa877fe700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137030 0x7ffa88067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 -- 172.21.15.133:0/4111226985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137030 msgr2=0x7ffa88067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137030 0x7ffa88067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 -- 172.21.15.133:0/4111226985 >> v1:172.21.15.178:6789/0 conn(0x7ffa88137410 legacy=0x7ffa88155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 -- 172.21.15.133:0/4111226985 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88068930 con 0x7ffa880c5930 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa87fff700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa880c5930 0x7ffa880c5de0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7ffa80006fd0 tx=0x7ffa800090f0).ready entity=mon.0 client_cookie=f8c1efe3a5d4d535 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa867fc700 1 -- 172.21.15.133:0/4111226985 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000b580 con 0x7ffa880c5930 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa867fc700 1 -- 172.21.15.133:0/4111226985 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000b6e0 con 0x7ffa880c5930 2024-01-21T21:31:24.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.342+0000 7ffa867fc700 1 -- 172.21.15.133:0/4111226985 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000ba80 con 0x7ffa880c5930 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 -- 172.21.15.133:0/4111226985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa880c5930 msgr2=0x7ffa880c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa880c5930 0x7ffa880c5de0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7ffa80006fd0 tx=0x7ffa800090f0).stop 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 -- 172.21.15.133:0/4111226985 shutdown_connections 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa880c5930 0x7ffa880c5de0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/4111226985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137030 0x7ffa88067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 -- 172.21.15.133:0/4111226985 >> 172.21.15.133:0/4111226985 conn(0x7ffa88066a90 msgr2=0x7ffa88066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 -- 172.21.15.133:0/4111226985 shutdown_connections 2024-01-21T21:31:24.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.343+0000 7ffa8db0b700 1 -- 172.21.15.133:0/4111226985 wait complete. 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.344+0000 7ffa8db0b700 1 Processor -- start 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 -- start start 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880c5930 0x7ffa88157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137410 0x7ffa88156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88156c40 con 0x7ffa88137030 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880ac290 con 0x7ffa880c5930 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa8db0b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880ac570 con 0x7ffa88137410 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.345+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa877fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880c5930 0x7ffa88157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54112/0 (socket says 172.21.15.133:54112) 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa87fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137410 0x7ffa88156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 -- 172.21.15.133:0/3821672257 learned_addr learned my addr 172.21.15.133:0/3821672257 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137410 msgr2=0x7ffa88156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137410 0x7ffa88156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880c5930 msgr2=0x7ffa88157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880c5930 0x7ffa88157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 -- 172.21.15.133:0/3821672257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009370 con 0x7ffa88137030 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa86ffd700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7ffa7c00c440 tx=0x7ffa7c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c007020 con 0x7ffa88137030 2024-01-21T21:31:24.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c007180 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa880ac850 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c007520 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.346+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa881653a0 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.347+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88165590 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.348+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 89) v1 ==== 75560+0+0 (secure 0 0 0) 0x7ffa7c0068b0 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.348+0000 7ffa6ffff700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 0x7ffa74061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.348+0000 7ffa877fe700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 msgr2=0x7ffa74061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.348+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 7264+0+0 (secure 0 0 0) 0x7ffa7c079f50 con 0x7ffa88137030 2024-01-21T21:31:24.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.348+0000 7ffa877fe700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 0x7ffa74061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:24.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.352+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ffa7c04ac30 con 0x7ffa88137030 2024-01-21T21:31:24.406 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:24.403+0000 7fe45f446680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:31:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.549+0000 7ffa877fe700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 msgr2=0x7ffa74061730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:24.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.549+0000 7ffa877fe700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 0x7ffa74061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:24.566 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.564+0000 7eff6b751680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:31:24.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.566+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ffa880c62d0 con 0x7ffa88137030 2024-01-21T21:31:24.639 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.637+0000 7eff6b751680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:31:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.657+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 90) v1 ==== 75270+0+0 (secure 0 0 0) 0x7ffa7c079020 con 0x7ffa88137030 2024-01-21T21:31:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.657+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 msgr2=0x7ffa74061730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:24.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:24.657+0000 7ffa6ffff700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 0x7ffa74061730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:24.662 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:31:24.662 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:31:24.662 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:31:24.677 INFO:tasks.ceph.mds.a.smithi133.stderr: -4> 2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:31:24.678 INFO:tasks.ceph.mds.a.smithi133.stderr: -3> 2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:31:24.678 INFO:tasks.ceph.mds.a.smithi133.stderr: -1> 2024-01-21T21:31:24.660+0000 7fbba46b2700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:31:24.699 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee64ff700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee64ff700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee64ff700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee64ff700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee64ff700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.727 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee2cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.728 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee2cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.728 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee2cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.728 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee2cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:24.728 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:24.725+0000 7efee2cf8700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:25.113 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T21:31:25.111+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T21:31:25.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.117+0000 7ffa6ffff700 1 -- 172.21.15.133:0/3821672257 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7ffa7c072e70 con 0x7ffa88137030 2024-01-21T21:31:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 msgr2=0x7ffa88156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7ffa7c00c440 tx=0x7ffa7c007dd0).stop 2024-01-21T21:31:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 shutdown_connections 2024-01-21T21:31:25.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa88137410 0x7ffa88156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ffa7405f270 0x7ffa74061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880c5930 0x7ffa88157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 --2- 172.21.15.133:0/3821672257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa88137030 0x7ffa88156260 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 >> 172.21.15.133:0/3821672257 conn(0x7ffa88066a90 msgr2=0x7ffa880c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 shutdown_connections 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.120+0000 7ffa8db0b700 1 -- 172.21.15.133:0/3821672257 wait complete. 2024-01-21T21:31:25.123 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T21:31:25.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T21:31:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.249+0000 7fcb733eb700 1 Processor -- start 2024-01-21T21:31:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.250+0000 7fcb733eb700 1 -- start start 2024-01-21T21:31:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb733eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb733eb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c065660 con 0x7fcb6c069ef0 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb733eb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c065f00 con 0x7fcb6c0beb30 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb733eb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c0bef10 con 0x7fcb6c155b80 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54234/0 (socket says 172.21.15.133:54234) 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 -- 172.21.15.133:0/3955814174 learned_addr learned my addr 172.21.15.133:0/3955814174 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb70986700 1 --1- 172.21.15.133:0/3955814174 >> v1:172.21.15.133:6789/0 conn(0x7fcb6c069ef0 0x7fcb6c066390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40720/0 (socket says 172.21.15.133:40720) 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 -- 172.21.15.133:0/3955814174 >> v1:172.21.15.178:6789/0 conn(0x7fcb6c0beb30 legacy=0x7fcb6c0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 -- 172.21.15.133:0/3955814174 >> v1:172.21.15.133:6789/0 conn(0x7fcb6c069ef0 legacy=0x7fcb6c066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 -- 172.21.15.133:0/3955814174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c0c44a0 con 0x7fcb6c155b80 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb71988700 1 --2- 172.21.15.133:0/3955814174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fcb64009f20 tx=0x7fcb64009840).ready entity=mon.0 client_cookie=7518a6eaf68c4149 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb63fff700 1 -- 172.21.15.133:0/3955814174 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400e070 con 0x7fcb6c155b80 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb63fff700 1 -- 172.21.15.133:0/3955814174 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6400ba80 con 0x7fcb6c155b80 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.251+0000 7fcb63fff700 1 -- 172.21.15.133:0/3955814174 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6400be00 con 0x7fcb6c155b80 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 -- 172.21.15.133:0/3955814174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c155b80 msgr2=0x7fcb6c0c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 --2- 172.21.15.133:0/3955814174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fcb64009f20 tx=0x7fcb64009840).stop 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 -- 172.21.15.133:0/3955814174 shutdown_connections 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 --2- 172.21.15.133:0/3955814174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0c3fb0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 -- 172.21.15.133:0/3955814174 >> 172.21.15.133:0/3955814174 conn(0x7fcb6c0c8010 msgr2=0x7fcb6c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 -- 172.21.15.133:0/3955814174 shutdown_connections 2024-01-21T21:31:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.252+0000 7fcb733eb700 1 -- 172.21.15.133:0/3955814174 wait complete. 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.253+0000 7fcb733eb700 1 Processor -- start 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.253+0000 7fcb733eb700 1 -- start start 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 0x7fcb6c0bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0bf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c1388c0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0bfb50 con 0x7fcb6c155b80 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb733eb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c0bfe30 con 0x7fcb6c0beb30 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54236/0 (socket says 172.21.15.133:54236) 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 -- 172.21.15.133:0/2528212503 learned_addr learned my addr 172.21.15.133:0/2528212503 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71988700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0bf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb70986700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 0x7fcb6c0bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 -- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 msgr2=0x7fcb6c0bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 0x7fcb6c0bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 -- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb6c155b80 msgr2=0x7fcb6c0bf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0bf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 -- 172.21.15.133:0/2528212503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009ae0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb70986700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 0x7fcb6c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.254+0000 7fcb71187700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fcb6800c4c0 tx=0x7fcb68007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.255+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68007020 con 0x7fcb6c069ef0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.255+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68001e90 con 0x7fcb6c069ef0 2024-01-21T21:31:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.255+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c0c0110 con 0x7fcb6c069ef0 2024-01-21T21:31:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.255+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680073b0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.255+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c0c06d0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.256+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c095ee0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.256+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 90) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fcb680068b0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.257+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7580+0+0 (secure 0 0 0) 0x7fcb68079eb0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.261+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcb6804ada0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.466+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb6c05fdf0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.659+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 91) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fcb680778a0 con 0x7fcb6c069ef0 2024-01-21T21:31:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.659+0000 7fcb61ffb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 0x7fcb500684f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.660+0000 7fcb70986700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 0x7fcb500684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:25.661+0000 7fcb70986700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 0x7fcb500684f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fcb6c1515e0 tx=0x7fcb5c007c90).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:26.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.119+0000 7fcb61ffb700 1 -- 172.21.15.133:0/2528212503 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb6806f0d0 con 0x7fcb6c069ef0 2024-01-21T21:31:26.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 msgr2=0x7fcb500684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 0x7fcb500684f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fcb6c1515e0 tx=0x7fcb5c007c90).stop 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 msgr2=0x7fcb6c1383d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fcb6800c4c0 tx=0x7fcb68007e00).stop 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 shutdown_connections 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcb50030300 0x7fcb500684f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb6c155b80 0x7fcb6c0bf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb6c069ef0 0x7fcb6c1383d0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 --2- 172.21.15.133:0/2528212503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb6c0beb30 0x7fcb6c0bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 >> 172.21.15.133:0/2528212503 conn(0x7fcb6c0c8010 msgr2=0x7fcb6c0bdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 shutdown_connections 2024-01-21T21:31:26.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.121+0000 7fcb733eb700 1 -- 172.21.15.133:0/2528212503 wait complete. 2024-01-21T21:31:26.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T21:31:26.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.262+0000 7f4d801a6700 1 Processor -- start 2024-01-21T21:31:26.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 -- start start 2024-01-21T21:31:26.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d78137750 0x7f4d78138030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d780be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d78065cc0 con 0x7f4d780bdce0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d780c4620 con 0x7f4d78137750 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.263+0000 7f4d801a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c3df0 con 0x7f4d780c3960 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7d741700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4d780bdce0 0x7f4d780c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40734/0 (socket says 172.21.15.133:40734) 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7d741700 1 -- 172.21.15.133:0/3089566199 learned_addr learned my addr 172.21.15.133:0/3089566199 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861042716 0 0) 0x7f4d78065cc0 con 0x7f4d780bdce0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> v2:172.21.15.178:3300/0 conn(0x7f4d78137750 0x7f4d78138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d640033f0 con 0x7f4d780bdce0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7e743700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d780be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216709389 0 0) 0x7f4d640033f0 con 0x7f4d780bdce0 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 msgr2=0x7f4d780be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:26.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d780be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 >> v2:172.21.15.178:3300/0 conn(0x7f4d78137750 msgr2=0x7f4d78138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 --2- 172.21.15.133:0/3089566199 >> v2:172.21.15.178:3300/0 conn(0x7f4d78137750 0x7f4d78138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780be630 con 0x7f4d780bdce0 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f4d74001470 con 0x7f4d780bdce0 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7e743700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d780be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> v2:172.21.15.178:3300/0 conn(0x7f4d78137750 0x7f4d78138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 >> v1:172.21.15.133:6789/0 conn(0x7f4d780bdce0 legacy=0x7f4d780c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d64003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d64004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d64004b80 0x7f4d64005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c3df0 con 0x7f4d640038e0 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6400b8e0 con 0x7f4d64004b80 2024-01-21T21:31:26.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6400ba70 con 0x7f4d780c3960 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d64003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7d741700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d64004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.264+0000 7f4d7e743700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d64004b80 0x7f4d64005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 -- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 msgr2=0x7f4d64004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780c3960 0x7f4d64004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 -- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d64004b80 msgr2=0x7f4d64005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d64004b80 0x7f4d64005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 -- 172.21.15.133:0/3089566199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640033f0 con 0x7f4d640038e0 2024-01-21T21:31:26.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7df42700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d64003d00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4d6800bb00 tx=0x7f4d68008040).ready entity=mon.0 client_cookie=87d8bfa6aebbf084 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800b410 con 0x7f4d640038e0 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6800d5d0 con 0x7f4d640038e0 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7cf40700 1 -- 172.21.15.133:0/3089566199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800d950 con 0x7f4d640038e0 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d801a6700 1 -- 172.21.15.133:0/3089566199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 msgr2=0x7f4d64003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d801a6700 1 --2- 172.21.15.133:0/3089566199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d64003d00 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f4d6800bb00 tx=0x7f4d68008040).stop 2024-01-21T21:31:26.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d7e743700 1 -- 172.21.15.133:0/3089566199 reap_dead start 2024-01-21T21:31:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d801a6700 1 -- 172.21.15.133:0/3089566199 shutdown_connections 2024-01-21T21:31:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.265+0000 7f4d801a6700 1 -- 172.21.15.133:0/3089566199 >> 172.21.15.133:0/3089566199 conn(0x7f4d780c7cd0 msgr2=0x7f4d780c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.266+0000 7f4d801a6700 1 -- 172.21.15.133:0/3089566199 shutdown_connections 2024-01-21T21:31:26.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.266+0000 7f4d801a6700 1 -- 172.21.15.133:0/3089566199 wait complete. 2024-01-21T21:31:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.267+0000 7f4d801a6700 1 Processor -- start 2024-01-21T21:31:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.267+0000 7f4d801a6700 1 -- start start 2024-01-21T21:31:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780a7b20 0x7f4d780c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780a7fa0 0x7f4d780c1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78134010 con 0x7f4d640038e0 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d780c1960 con 0x7f4d780a7b20 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d801a6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78152d70 con 0x7f4d780a7fa0 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54244/0 (socket says 172.21.15.133:54244) 2024-01-21T21:31:26.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 -- 172.21.15.133:0/1989902597 learned_addr learned my addr 172.21.15.133:0/1989902597 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7d741700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780a7b20 0x7f4d780c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7e743700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780a7fa0 0x7f4d780c1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 -- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780a7fa0 msgr2=0x7f4d780c1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780a7fa0 0x7f4d780c1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 -- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780a7b20 msgr2=0x7f4d780c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:26.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780a7b20 0x7f4d780c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.268+0000 7f4d7df42700 1 -- 172.21.15.133:0/1989902597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78152160 con 0x7f4d640038e0 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d7df42700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f4d6800d440 tx=0x7f4d68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800dd00 con 0x7f4d640038e0 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68021070 con 0x7f4d640038e0 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6800de80 con 0x7f4d640038e0 2024-01-21T21:31:26.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d78152440 con 0x7f4d640038e0 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.269+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d78152a00 con 0x7f4d640038e0 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.270+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7805fdf0 con 0x7f4d640038e0 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.270+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 91) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f4d68005880 con 0x7f4d640038e0 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.270+0000 7f4d6e7fc700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 0x7f4d5c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.270+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7580+0+0 (secure 0 0 0) 0x7f4d6807ba70 con 0x7f4d640038e0 2024-01-21T21:31:26.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.271+0000 7f4d7d741700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 0x7f4d5c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.271+0000 7f4d7d741700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 0x7f4d5c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4d74001620 tx=0x7f4d74001e90).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:26.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.275+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4d6804c910 con 0x7f4d640038e0 2024-01-21T21:31:26.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:26.437+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d780c4060 con 0x7f4d640038e0 2024-01-21T21:31:27.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.122+0000 7f4d6e7fc700 1 -- 172.21.15.133:0/1989902597 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4d6802b070 con 0x7f4d640038e0 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 msgr2=0x7f4d5c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 0x7f4d5c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f4d74001620 tx=0x7f4d74001e90).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 msgr2=0x7f4d780aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f4d6800d440 tx=0x7f4d68008040).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 shutdown_connections 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d780a7fa0 0x7f4d780c1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d640038e0 0x7f4d780aa150 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4d5c05f030 0x7f4d5c0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 --2- 172.21.15.133:0/1989902597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780a7b20 0x7f4d780c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 >> 172.21.15.133:0/1989902597 conn(0x7f4d780c7cd0 msgr2=0x7f4d780c5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 shutdown_connections 2024-01-21T21:31:27.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.125+0000 7f4d801a6700 1 -- 172.21.15.133:0/1989902597 wait complete. 2024-01-21T21:31:27.129 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T21:31:27.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T21:31:27.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.261+0000 7f7130596700 1 Processor -- start 2024-01-21T21:31:27.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.262+0000 7f7130596700 1 -- start start 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71281504b0 0x7f7128063700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7128150890 0x7f7128063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71280c2ba0 0x7f71280c3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280640e0 con 0x7f71280c2ba0 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7128154ef0 con 0x7f7128150890 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f7130596700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128154320 con 0x7f71281504b0 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71280c2ba0 0x7f71280c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f71280c2ba0 0x7f71280c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54256/0 (socket says 172.21.15.133:54256) 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 -- 172.21.15.133:0/1961546770 learned_addr learned my addr 172.21.15.133:0/1961546770 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:27.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712e332700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71281504b0 0x7f7128063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712db31700 1 --2- 172.21.15.133:0/1961546770 >> v2:172.21.15.178:3300/0 conn(0x7f7128150890 0x7f7128063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 -- 172.21.15.133:0/1961546770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71281504b0 msgr2=0x7f7128063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71281504b0 0x7f7128063700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 -- 172.21.15.133:0/1961546770 >> v2:172.21.15.178:3300/0 conn(0x7f7128150890 msgr2=0x7f7128063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 --2- 172.21.15.133:0/1961546770 >> v2:172.21.15.178:3300/0 conn(0x7f7128150890 0x7f7128063bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 -- 172.21.15.133:0/1961546770 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71281545c0 con 0x7f71280c2ba0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.263+0000 7f712eb33700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280c2ba0 0x7f71280c3050 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f71280642a0 tx=0x7f712000ba50).ready entity=mon.0 client_cookie=7b860305484a770a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f712d330700 1 -- 172.21.15.133:0/1961546770 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120010070 con 0x7f71280c2ba0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f712d330700 1 -- 172.21.15.133:0/1961546770 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000de90 con 0x7f71280c2ba0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f712d330700 1 -- 172.21.15.133:0/1961546770 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120015680 con 0x7f71280c2ba0 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 -- 172.21.15.133:0/1961546770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280c2ba0 msgr2=0x7f71280c3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280c2ba0 0x7f71280c3050 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 rx=0x7f71280642a0 tx=0x7f712000ba50).stop 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 -- 172.21.15.133:0/1961546770 shutdown_connections 2024-01-21T21:31:27.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280c2ba0 0x7f71280c3050 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 --2- 172.21.15.133:0/1961546770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71281504b0 0x7f7128063700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 --2- 172.21.15.133:0/1961546770 >> v2:172.21.15.178:3300/0 conn(0x7f7128150890 0x7f7128063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 -- 172.21.15.133:0/1961546770 >> 172.21.15.133:0/1961546770 conn(0x7f71280c49e0 msgr2=0x7f7128068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:27.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 -- 172.21.15.133:0/1961546770 shutdown_connections 2024-01-21T21:31:27.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.264+0000 7f7130596700 1 -- 172.21.15.133:0/1961546770 wait complete. 2024-01-21T21:31:27.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 Processor -- start 2024-01-21T21:31:27.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 -- start start 2024-01-21T21:31:27.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71280c2ba0 0x7f7128164be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7128150890 0x7f71280a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280a8330 con 0x7f71281504b0 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712814b6d0 con 0x7f71280c2ba0 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.266+0000 7f7130596700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280a7720 con 0x7f7128150890 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54268/0 (socket says 172.21.15.133:54268) 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 -- 172.21.15.133:0/1792758431 learned_addr learned my addr 172.21.15.133:0/1792758431 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712e332700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71280c2ba0 0x7f7128164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 -- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7128150890 msgr2=0x7f71280a6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7128150890 0x7f71280a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 -- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71280c2ba0 msgr2=0x7f7128164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71280c2ba0 0x7f7128164be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:27.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 -- 172.21.15.133:0/1792758431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712000bcf0 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f712db31700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f7124006980 tx=0x7f7124008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400f520 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400f680 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71280a7a00 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400fa00 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.267+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71280a7fc0 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.268+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280a84e0 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.268+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 91) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f7124013480 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.269+0000 7f711effd700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 0x7f710c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.269+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 7113+0+0 (secure 0 0 0) 0x7f7124079f50 con 0x7f71281504b0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.269+0000 7f712e332700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 0x7f710c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:27.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.269+0000 7f712e332700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 0x7f710c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f711800bb20 tx=0x7f7118008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:27.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.273+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f71280a84e0 con 0x7f71281504b0 2024-01-21T21:31:27.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.437+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f712805fdf0 con 0x7f71281504b0 2024-01-21T21:31:27.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:27.666+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7124077b10 con 0x7f71281504b0 2024-01-21T21:31:28.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.123+0000 7f711effd700 1 -- 172.21.15.133:0/1792758431 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7124073160 con 0x7f71281504b0 2024-01-21T21:31:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.126+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 msgr2=0x7f710c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.126+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 0x7f710c0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f711800bb20 tx=0x7f7118008040).stop 2024-01-21T21:31:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.126+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 msgr2=0x7f712814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.126+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f7124006980 tx=0x7f7124008040).stop 2024-01-21T21:31:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 shutdown_connections 2024-01-21T21:31:28.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7128150890 0x7f71280a6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f710c05f030 0x7f710c0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71280c2ba0 0x7f7128164be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 --2- 172.21.15.133:0/1792758431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71281504b0 0x7f712814b1e0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 >> 172.21.15.133:0/1792758431 conn(0x7f71280c49e0 msgr2=0x7f71280bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 shutdown_connections 2024-01-21T21:31:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.127+0000 7f7130596700 1 -- 172.21.15.133:0/1792758431 wait complete. 2024-01-21T21:31:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T21:31:28.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T21:31:28.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.267+0000 7f5aa6ef5700 1 Processor -- start 2024-01-21T21:31:28.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.267+0000 7f5aa6ef5700 1 -- start start 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa6ef5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5aa014ea40 0x7f5aa00c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa6ef5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa00bcf10 0x7f5aa00630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa6ef5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa014ee20 con 0x7f5aa00c5ce0 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa6ef5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa00bed10 con 0x7f5aa014ea40 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa6ef5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00bea30 con 0x7f5aa00bcf10 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5aa014ea40 0x7f5aa00c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5aa014ea40 0x7f5aa00c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54280/0 (socket says 172.21.15.133:54280) 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa5492700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5aa00c5ce0 0x7f5aa0154870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40736/0 (socket says 172.21.15.133:40736) 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 -- 172.21.15.133:0/1373248525 learned_addr learned my addr 172.21.15.133:0/1373248525 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 -- 172.21.15.133:0/1373248525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa00bcf10 msgr2=0x7f5aa00630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 --2- 172.21.15.133:0/1373248525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa00bcf10 0x7f5aa00630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 -- 172.21.15.133:0/1373248525 >> v1:172.21.15.133:6789/0 conn(0x7f5aa00c5ce0 legacy=0x7f5aa0154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 -- 172.21.15.133:0/1373248525 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00a7170 con 0x7f5aa014ea40 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5a9f7fe700 1 -- 172.21.15.133:0/1373248525 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883768493 0 0) 0x7f5a98001490 con 0x7f5aa00c5ce0 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5aa4c91700 1 --2- 172.21.15.133:0/1373248525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa014ea40 0x7f5aa00c77e0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f5a94006fd0 tx=0x7f5a940090f0).ready entity=mon.0 client_cookie=4435745b11ff7fde server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5a9f7fe700 1 -- 172.21.15.133:0/1373248525 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400b600 con 0x7f5aa014ea40 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5a9f7fe700 1 -- 172.21.15.133:0/1373248525 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400b760 con 0x7f5aa014ea40 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.268+0000 7f5a9f7fe700 1 -- 172.21.15.133:0/1373248525 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400bb00 con 0x7f5aa014ea40 2024-01-21T21:31:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/1373248525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa014ea40 msgr2=0x7f5aa00c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/1373248525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa014ea40 0x7f5aa00c77e0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7f5a94006fd0 tx=0x7f5a940090f0).stop 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/1373248525 shutdown_connections 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/1373248525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa014ea40 0x7f5aa00c77e0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/1373248525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa00bcf10 0x7f5aa00630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/1373248525 >> 172.21.15.133:0/1373248525 conn(0x7f5aa00c7de0 msgr2=0x7f5aa00c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/1373248525 shutdown_connections 2024-01-21T21:31:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.269+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/1373248525 wait complete. 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.270+0000 7f5aa6ef5700 1 Processor -- start 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.270+0000 7f5aa6ef5700 1 -- start start 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 0x7f5aa00c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa014ea40 0x7f5aa0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00c3d60 con 0x7f5aa00bcf10 2024-01-21T21:31:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00c3150 con 0x7f5aa00c5ce0 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa6ef5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00c3430 con 0x7f5aa014ea40 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa4c91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa4c91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54282/0 (socket says 172.21.15.133:54282) 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa4c91700 1 -- 172.21.15.133:0/3549462353 learned_addr learned my addr 172.21.15.133:0/3549462353 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5a9ffff700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 0x7f5aa00c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.271+0000 7f5aa5492700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa014ea40 0x7f5aa0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 -- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa014ea40 msgr2=0x7f5aa0158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa014ea40 0x7f5aa0158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 -- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 msgr2=0x7f5aa00c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 0x7f5aa00c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 -- 172.21.15.133:0/3549462353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94009370 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5a9ffff700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 0x7f5aa00c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa4c91700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f5a94009f50 tx=0x7f5a94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94000bc0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400b8d0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94000d20 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa00c3710 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.272+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa014c2a0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.273+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa005fdf0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.273+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5a94021070 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.273+0000 7f5a9d7fa700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 0x7f5a840615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.273+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7f5a9407c020 con 0x7f5aa00bcf10 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.274+0000 7f5a9ffff700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 0x7f5a840615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.274+0000 7f5a9ffff700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 0x7f5a840615e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5aa0151fc0 tx=0x7f5a8c008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.278+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5a9404d0e0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.442+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5aa01507b0 con 0x7f5aa00bcf10 2024-01-21T21:31:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.446+0000 7f5a9d7fa700 1 -- 172.21.15.133:0/3549462353 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a94029070 con 0x7f5aa00bcf10 2024-01-21T21:31:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 msgr2=0x7f5a840615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 0x7f5a840615e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5aa0151fc0 tx=0x7f5a8c008040).stop 2024-01-21T21:31:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 msgr2=0x7f5aa014bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f5a94009f50 tx=0x7f5a94017000).stop 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 shutdown_connections 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5aa014ea40 0x7f5aa0158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5aa00bcf10 0x7f5aa014bdb0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5a8405f120 0x7f5a840615e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 --2- 172.21.15.133:0/3549462353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5aa00c5ce0 0x7f5aa00c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 >> 172.21.15.133:0/3549462353 conn(0x7f5aa00c7de0 msgr2=0x7f5aa0153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 shutdown_connections 2024-01-21T21:31:28.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.448+0000 7f5aa6ef5700 1 -- 172.21.15.133:0/3549462353 wait complete. 2024-01-21T21:31:28.462 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T21:31:28.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.577+0000 7f13a315b700 1 Processor -- start 2024-01-21T21:31:28.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.577+0000 7f13a315b700 1 -- start start 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a315b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f139c13b970 0x7f139c0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a315b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f139c0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a315b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0bfa40 con 0x7f139c0c39f0 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a315b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0c3e70 con 0x7f139c13b970 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a315b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0bee30 con 0x7f139c0be810 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f139bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f139c0c39f0 0x7f139c0be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40752/0 (socket says 172.21.15.133:40752) 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f139bfff700 1 -- 172.21.15.133:0/2412353627 learned_addr learned my addr 172.21.15.133:0/2412353627 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a0ef7700 1 --2- 172.21.15.133:0/2412353627 >> v2:172.21.15.178:3300/0 conn(0x7f139c13b970 0x7f139c0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f13a16f8700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f139c0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927375172 0 0) 0x7f139c0bfa40 con 0x7f139c0c39f0 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.578+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f138c0033f0 con 0x7f139c0c39f0 2024-01-21T21:31:28.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 423252500 0 0) 0x7f138c0033f0 con 0x7f139c0c39f0 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 msgr2=0x7f139c0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f139c0a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 >> v2:172.21.15.178:3300/0 conn(0x7f139c13b970 msgr2=0x7f139c0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 --2- 172.21.15.133:0/2412353627 >> v2:172.21.15.178:3300/0 conn(0x7f139c13b970 0x7f139c0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0bf110 con 0x7f139c0c39f0 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f1388001470 con 0x7f139c0c39f0 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 >> v1:172.21.15.133:6789/0 conn(0x7f139c0c39f0 legacy=0x7f139c0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f138c0038e0 0x7f138c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f138c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f138c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c3e70 con 0x7f138c004690 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0bee30 con 0x7f138c0038e0 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138c00b8e0 con 0x7f139c0be810 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f138c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f13a0ef7700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f138c0038e0 0x7f138c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f13a16f8700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f138c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 -- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 msgr2=0x7f138c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c0be810 0x7f138c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 -- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f138c0038e0 msgr2=0x7f138c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f138c0038e0 0x7f138c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 -- 172.21.15.133:0/2412353627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c0033f0 con 0x7f138c004690 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139bfff700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f138c004b10 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f138800c210 tx=0x7f1388001e90).ready entity=mon.0 client_cookie=79a5e34a0d44566a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388007a60 con 0x7f138c004690 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138800cae0 con 0x7f138c004690 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.579+0000 7f139b7fe700 1 -- 172.21.15.133:0/2412353627 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138800ce60 con 0x7f138c004690 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 -- 172.21.15.133:0/2412353627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 msgr2=0x7f138c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 --2- 172.21.15.133:0/2412353627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f138c004b10 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f138800c210 tx=0x7f1388001e90).stop 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a16f8700 1 -- 172.21.15.133:0/2412353627 reap_dead start 2024-01-21T21:31:28.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 -- 172.21.15.133:0/2412353627 shutdown_connections 2024-01-21T21:31:28.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 -- 172.21.15.133:0/2412353627 >> 172.21.15.133:0/2412353627 conn(0x7f139c066a70 msgr2=0x7f139c066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 -- 172.21.15.133:0/2412353627 shutdown_connections 2024-01-21T21:31:28.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.580+0000 7f13a315b700 1 -- 172.21.15.133:0/2412353627 wait complete. 2024-01-21T21:31:28.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.581+0000 7f13a315b700 1 Processor -- start 2024-01-21T21:31:28.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.581+0000 7f13a315b700 1 -- start start 2024-01-21T21:31:28.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c152760 0x7f139c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f139c164460 0x7f139c158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c152ec0 con 0x7f138c004690 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c0c10 con 0x7f139c164460 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a315b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c14b0 con 0x7f139c152760 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54296/0 (socket says 172.21.15.133:54296) 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 -- 172.21.15.133:0/2815084862 learned_addr learned my addr 172.21.15.133:0/2815084862 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 -- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c152760 msgr2=0x7f139c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c152760 0x7f139c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 -- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f139c164460 msgr2=0x7f139c158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a16f8700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f139c164460 0x7f139c158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f139c164460 0x7f139c158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.582+0000 7f13a0ef7700 1 -- 172.21.15.133:0/2815084862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c151cb0 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13a0ef7700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f1390011a20 tx=0x7f1390009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000f8c0 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000fa20 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c152be0 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000fda0 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.583+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c0c1140 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.584+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c05fdf0 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.584+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1390014650 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.584+0000 7f13997fa700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 0x7f1380061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.584+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7f139007b000 con 0x7f138c004690 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.584+0000 7f139bfff700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 0x7f1380061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.585+0000 7f139bfff700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 0x7f1380061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f139c0c05a0 tx=0x7f1388015000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.588+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f139004c0c0 con 0x7f138c004690 2024-01-21T21:31:28.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.760+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f139c159800 con 0x7f138c004690 2024-01-21T21:31:28.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.764+0000 7f13997fa700 1 -- 172.21.15.133:0/2815084862 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f139004f6e0 con 0x7f138c004690 2024-01-21T21:31:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.766+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 msgr2=0x7f1380061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.766+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 0x7f1380061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f139c0c05a0 tx=0x7f1388015000).stop 2024-01-21T21:31:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.766+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 msgr2=0x7f139c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.766+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f1390011a20 tx=0x7f1390009060).stop 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 shutdown_connections 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f138005f150 0x7f1380061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f139c164460 0x7f139c158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f138c004690 0x7f139c1517c0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 --2- 172.21.15.133:0/2815084862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f139c152760 0x7f139c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 >> 172.21.15.133:0/2815084862 conn(0x7f139c066a70 msgr2=0x7f139c0c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 shutdown_connections 2024-01-21T21:31:28.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.767+0000 7f13a315b700 1 -- 172.21.15.133:0/2815084862 wait complete. 2024-01-21T21:31:28.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2024-01-21T21:31:28.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.894+0000 7f503c1ba700 1 Processor -- start 2024-01-21T21:31:28.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 -- start start 2024-01-21T21:31:28.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5034062e00 0x7f50340a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f503413aa00 0x7f5034158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50341584f0 con 0x7f503413a620 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340bd6f0 con 0x7f503413aa00 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.895+0000 7f503c1ba700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340654e0 con 0x7f5034062e00 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f503413aa00 0x7f5034158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f503413aa00 0x7f5034158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54312/0 (socket says 172.21.15.133:54312) 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 -- 172.21.15.133:0/3846490584 learned_addr learned my addr 172.21.15.133:0/3846490584 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f5039755700 1 --2- 172.21.15.133:0/3846490584 >> v2:172.21.15.178:3300/0 conn(0x7f5034062e00 0x7f50340a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 -- 172.21.15.133:0/3846490584 >> v2:172.21.15.178:3300/0 conn(0x7f5034062e00 msgr2=0x7f50340a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 --2- 172.21.15.133:0/3846490584 >> v2:172.21.15.178:3300/0 conn(0x7f5034062e00 0x7f50340a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 -- 172.21.15.133:0/3846490584 >> v1:172.21.15.178:6789/0 conn(0x7f503413a620 legacy=0x7f50340626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 -- 172.21.15.133:0/3846490584 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034158730 con 0x7f503413aa00 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f503a757700 1 --2- 172.21.15.133:0/3846490584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f503413aa00 0x7f5034158000 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f503413e3f0 tx=0x7f502c009840).ready entity=mon.0 client_cookie=ac9c26e2cd0be337 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f5038f54700 1 -- 172.21.15.133:0/3846490584 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00e070 con 0x7f503413aa00 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f5038f54700 1 -- 172.21.15.133:0/3846490584 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c00ba50 con 0x7f503413aa00 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.896+0000 7f5038f54700 1 -- 172.21.15.133:0/3846490584 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00bdd0 con 0x7f503413aa00 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 -- 172.21.15.133:0/3846490584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f503413aa00 msgr2=0x7f5034158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 --2- 172.21.15.133:0/3846490584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f503413aa00 0x7f5034158000 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7f503413e3f0 tx=0x7f502c009840).stop 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 -- 172.21.15.133:0/3846490584 shutdown_connections 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 --2- 172.21.15.133:0/3846490584 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f503413aa00 0x7f5034158000 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 --2- 172.21.15.133:0/3846490584 >> v2:172.21.15.178:3300/0 conn(0x7f5034062e00 0x7f50340a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 -- 172.21.15.133:0/3846490584 >> 172.21.15.133:0/3846490584 conn(0x7f50340c7dc0 msgr2=0x7f50340c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 -- 172.21.15.133:0/3846490584 shutdown_connections 2024-01-21T21:31:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.897+0000 7f503c1ba700 1 -- 172.21.15.133:0/3846490584 wait complete. 2024-01-21T21:31:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.898+0000 7f503c1ba700 1 Processor -- start 2024-01-21T21:31:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.898+0000 7f503c1ba700 1 -- start start 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503413a620 0x7f50340ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503413aa00 0x7f50341573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340ac4a0 con 0x7f5034062e00 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340ab890 con 0x7f503413aa00 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f503c1ba700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340abb70 con 0x7f503413a620 2024-01-21T21:31:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f5039f56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f5039f56700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54322/0 (socket says 172.21.15.133:54322) 2024-01-21T21:31:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.899+0000 7f5039f56700 1 -- 172.21.15.133:0/4292044453 learned_addr learned my addr 172.21.15.133:0/4292044453 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 -- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503413a620 msgr2=0x7f50340ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503413a620 0x7f50340ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:28.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f503a757700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503413aa00 0x7f50341573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 -- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503413aa00 msgr2=0x7f50341573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503413aa00 0x7f50341573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 -- 172.21.15.133:0/4292044453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c009ae0 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f5039f56700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f502800c440 tx=0x7f5028007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800f470 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502800f5d0 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340abe50 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502800f970 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.900+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50340ab430 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.901+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340ac2f0 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.901+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f502801b3b0 con 0x7f5034062e00 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.902+0000 7f50267fc700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 0x7f5018061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:28.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.902+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7f5028079720 con 0x7f5034062e00 2024-01-21T21:31:28.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.902+0000 7f5039755700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 0x7f5018061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:28.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.902+0000 7f5039755700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 0x7f5018061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f503413e3c0 tx=0x7f5030008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:28.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:28.906+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5028048b00 con 0x7f5034062e00 2024-01-21T21:31:29.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:29.133+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f50341584f0 con 0x7f5034062e00 2024-01-21T21:31:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.133+0000 7f50267fc700 1 -- 172.21.15.133:0/4292044453 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2956) v1 ==== 165+0+0 (secure 0 0 0) 0x7f50341584f0 con 0x7f5034062e00 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 msgr2=0x7f5018061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 0x7f5018061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f503413e3c0 tx=0x7f5030008040).stop 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 msgr2=0x7f50340aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 rx=0x7f502800c440 tx=0x7f5028007dc0).stop 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 shutdown_connections 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f501805f180 0x7f5018061640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503413aa00 0x7f50341573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5034062e00 0x7f50340aaf40 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 --2- 172.21.15.133:0/4292044453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503413a620 0x7f50340ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 >> 172.21.15.133:0/4292044453 conn(0x7f50340c7dc0 msgr2=0x7f50340c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 shutdown_connections 2024-01-21T21:31:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.135+0000 7f503c1ba700 1 -- 172.21.15.133:0/4292044453 wait complete. 2024-01-21T21:31:30.152 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2024-01-21T21:31:30.153 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2024-01-21T21:31:30.153 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-01-21T21:31:30.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2024-01-21T21:31:30.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.273+0000 7f3903640700 1 Processor -- start 2024-01-21T21:31:30.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.273+0000 7f3903640700 1 -- start start 2024-01-21T21:31:30.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3903640700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38fc13b970 0x7f38fc0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3903640700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc0bfa40 con 0x7f38fc0be810 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3903640700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc0c3e70 con 0x7f38fc0c39f0 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3903640700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc0bee30 con 0x7f38fc13b970 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f39013dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38fc13b970 0x7f38fc0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3901bdd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f38fc0be810 0x7f38fc0a8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47020/0 (socket says 172.21.15.133:47020) 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f3901bdd700 1 -- 172.21.15.133:0/958748421 learned_addr learned my addr 172.21.15.133:0/958748421 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f39013dc700 1 -- 172.21.15.133:0/958748421 >> v1:172.21.15.178:6789/0 conn(0x7f38fc0c39f0 legacy=0x7f38fc0be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f39013dc700 1 -- 172.21.15.133:0/958748421 >> v1:172.21.15.133:6789/0 conn(0x7f38fc0be810 legacy=0x7f38fc0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f38f3fff700 1 -- 172.21.15.133:0/958748421 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924131192 0 0) 0x7f38fc0bfa40 con 0x7f38fc0be810 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f39013dc700 1 -- 172.21.15.133:0/958748421 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc0bf110 con 0x7f38fc13b970 2024-01-21T21:31:30.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f39013dc700 1 --2- 172.21.15.133:0/958748421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc13b970 0x7f38fc0c3500 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f38f8009760 tx=0x7f38f8009060).ready entity=mon.0 client_cookie=fa3df4ad8a215579 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f38f3fff700 1 -- 172.21.15.133:0/958748421 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8009120 con 0x7f38fc13b970 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f38f3fff700 1 -- 172.21.15.133:0/958748421 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800b580 con 0x7f38fc13b970 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.274+0000 7f38f3fff700 1 -- 172.21.15.133:0/958748421 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800b900 con 0x7f38fc13b970 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 -- 172.21.15.133:0/958748421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc13b970 msgr2=0x7f38fc0c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 --2- 172.21.15.133:0/958748421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc13b970 0x7f38fc0c3500 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f38f8009760 tx=0x7f38f8009060).stop 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 -- 172.21.15.133:0/958748421 shutdown_connections 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 --2- 172.21.15.133:0/958748421 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc13b970 0x7f38fc0c3500 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 -- 172.21.15.133:0/958748421 >> 172.21.15.133:0/958748421 conn(0x7f38fc066a70 msgr2=0x7f38fc066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 -- 172.21.15.133:0/958748421 shutdown_connections 2024-01-21T21:31:30.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.275+0000 7f3903640700 1 -- 172.21.15.133:0/958748421 wait complete. 2024-01-21T21:31:30.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.276+0000 7f3903640700 1 Processor -- start 2024-01-21T21:31:30.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.276+0000 7f3903640700 1 -- start start 2024-01-21T21:31:30.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:30.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 0x7f38fc12caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 0x7f38fc155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc12a520 con 0x7f38fc0be810 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0c08d0 con 0x7f38fc0c39f0 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3903640700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc155ed0 con 0x7f38fc13b970 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59184/0 (socket says 172.21.15.133:59184) 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 -- 172.21.15.133:0/4289880210 learned_addr learned my addr 172.21.15.133:0/4289880210 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3900bdb700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 0x7f38fc12caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 -- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 msgr2=0x7f38fc155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3901bdd700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 0x7f38fc155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 0x7f38fc155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 -- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 msgr2=0x7f38fc12caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 0x7f38fc12caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:30.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f39013dc700 1 -- 172.21.15.133:0/4289880210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f80092a0 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3900bdb700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 0x7f38fc12caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.277+0000 7f3901bdd700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 0x7f38fc155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f39013dc700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f38f8009eb0 tx=0x7f38f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8006970 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800bcc0 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f801b440 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc0bffa0 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.278+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc0c0560 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.279+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc0c50c0 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.279+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f38f801b830 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.280+0000 7f38f1ffb700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 0x7f38e0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.280+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7f38f807bb70 con 0x7f38fc0be810 2024-01-21T21:31:30.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.280+0000 7f3900bdb700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 0x7f38e0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:30.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.280+0000 7f3900bdb700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 0x7f38e0061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f38fc0c8100 tx=0x7f38ec009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:30.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.284+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f38f804cc30 con 0x7f38fc0be810 2024-01-21T21:31:30.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:30.511+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f38fc0c31e0 con 0x7f38fc0be810 2024-01-21T21:31:31.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.137+0000 7f38f1ffb700 1 -- 172.21.15.133:0/4289880210 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2957) v1 ==== 166+0+0 (secure 0 0 0) 0x7f38f80280e0 con 0x7f38fc0be810 2024-01-21T21:31:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 msgr2=0x7f38e0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 0x7f38e0061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f38fc0c8100 tx=0x7f38ec009040).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 msgr2=0x7f38fc12a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f38f8009eb0 tx=0x7f38f8017000).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 shutdown_connections 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38fc13b970 0x7f38fc155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38fc0be810 0x7f38fc12a030 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f38e005f150 0x7f38e0061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 --2- 172.21.15.133:0/4289880210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38fc0c39f0 0x7f38fc12caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 >> 172.21.15.133:0/4289880210 conn(0x7f38fc066a70 msgr2=0x7f38fc0ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 shutdown_connections 2024-01-21T21:31:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.139+0000 7f3903640700 1 -- 172.21.15.133:0/4289880210 wait complete. 2024-01-21T21:31:31.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T21:31:31.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.278+0000 7fc4d3a5b700 1 Processor -- start 2024-01-21T21:31:31.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 -- start start 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4cc154140 0x7fc4cc158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4cc154520 0x7fc4cc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0ab620 con 0x7fc4cc0c6090 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc0c6ae0 con 0x7fc4cc154520 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.279+0000 7fc4d3a5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc0c05e0 con 0x7fc4cc154140 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4cc154520 0x7fc4cc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d1ff8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4cc0c6090 0x7fc4cc0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47030/0 (socket says 172.21.15.133:47030) 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4cc154520 0x7fc4cc0ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59196/0 (socket says 172.21.15.133:59196) 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d1ff8700 1 -- 172.21.15.133:0/116722393 learned_addr learned my addr 172.21.15.133:0/116722393 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d17f7700 1 --2- 172.21.15.133:0/116722393 >> v2:172.21.15.178:3300/0 conn(0x7fc4cc154140 0x7fc4cc158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/116722393 >> v2:172.21.15.178:3300/0 conn(0x7fc4cc154140 msgr2=0x7fc4cc158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 --2- 172.21.15.133:0/116722393 >> v2:172.21.15.178:3300/0 conn(0x7fc4cc154140 0x7fc4cc158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/116722393 >> v1:172.21.15.133:6789/0 conn(0x7fc4cc0c6090 legacy=0x7fc4cc0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/116722393 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0c0e40 con 0x7fc4cc154520 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4c3fff700 1 -- 172.21.15.133:0/116722393 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205120808 0 0) 0x7fc4cc0ab620 con 0x7fc4cc0c6090 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4d0ff6700 1 --2- 172.21.15.133:0/116722393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154520 0x7fc4cc0ab130 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fc4cc083d70 tx=0x7fc4c8009060).ready entity=mon.0 client_cookie=c0278be8c809c04c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4c3fff700 1 -- 172.21.15.133:0/116722393 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800b580 con 0x7fc4cc154520 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4c3fff700 1 -- 172.21.15.133:0/116722393 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800b6e0 con 0x7fc4cc154520 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.280+0000 7fc4c3fff700 1 -- 172.21.15.133:0/116722393 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800ba60 con 0x7fc4cc154520 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/116722393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154520 msgr2=0x7fc4cc0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/116722393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154520 0x7fc4cc0ab130 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7fc4cc083d70 tx=0x7fc4c8009060).stop 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/116722393 shutdown_connections 2024-01-21T21:31:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/116722393 >> v2:172.21.15.178:3300/0 conn(0x7fc4cc154140 0x7fc4cc158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/116722393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154520 0x7fc4cc0ab130 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/116722393 >> 172.21.15.133:0/116722393 conn(0x7fc4cc05e1e0 msgr2=0x7fc4cc05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/116722393 shutdown_connections 2024-01-21T21:31:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.281+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/116722393 wait complete. 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.282+0000 7fc4d3a5b700 1 Processor -- start 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.282+0000 7fc4d3a5b700 1 -- start start 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4cc0c6090 0x7fc4cc152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc154520 0x7fc4cc063440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1515b0 con 0x7fc4cc154140 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1523f0 con 0x7fc4cc154520 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc1517e0 con 0x7fc4cc0c6090 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59208/0 (socket says 172.21.15.133:59208) 2024-01-21T21:31:31.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/1796388029 learned_addr learned my addr 172.21.15.133:0/1796388029 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d1ff8700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc154520 0x7fc4cc063440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4cc0c6090 msgr2=0x7fc4cc152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4cc0c6090 0x7fc4cc152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc154520 msgr2=0x7fc4cc063440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc154520 0x7fc4cc063440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 -- 172.21.15.133:0/1796388029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80092a0 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d0ff6700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc4cc06afd0 tx=0x7fc4c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800ba60 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c8000c90 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c801b640 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.283+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc151ac0 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.284+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc152080 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.285+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc05fdf0 con 0x7fc4cc154140 2024-01-21T21:31:31.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.285+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc4c801ba70 con 0x7fc4cc154140 2024-01-21T21:31:31.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.285+0000 7fc4c1ffb700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 0x7fc4b0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.285+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7fc4c807bba0 con 0x7fc4cc154140 2024-01-21T21:31:31.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.285+0000 7fc4d17f7700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 0x7fc4b0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.286+0000 7fc4d17f7700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 0x7fc4b0061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc4bc00a880 tx=0x7fc4bc008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.289+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc4c804cc60 con 0x7fc4cc154140 2024-01-21T21:31:31.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.453+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4cc0aa980 con 0x7fc4cc154140 2024-01-21T21:31:31.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.457+0000 7fc4c1ffb700 1 -- 172.21.15.133:0/1796388029 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc4c801f020 con 0x7fc4cc154140 2024-01-21T21:31:31.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 msgr2=0x7fc4b0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 0x7fc4b0061610 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fc4bc00a880 tx=0x7fc4bc008040).stop 2024-01-21T21:31:31.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 msgr2=0x7fc4cc14f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7fc4cc06afd0 tx=0x7fc4c8017000).stop 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 shutdown_connections 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc4b005f150 0x7fc4b0061610 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4cc154520 0x7fc4cc063440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4cc0c6090 0x7fc4cc152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 --2- 172.21.15.133:0/1796388029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4cc154140 0x7fc4cc14f9b0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 >> 172.21.15.133:0/1796388029 conn(0x7fc4cc05e1e0 msgr2=0x7fc4cc14d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 shutdown_connections 2024-01-21T21:31:31.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.459+0000 7fc4d3a5b700 1 -- 172.21.15.133:0/1796388029 wait complete. 2024-01-21T21:31:31.473 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:31:31.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:31:31.514 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:31:31.562 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:31:31.563 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T21:31:31.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:31.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.676+0000 7f9a15841700 1 Processor -- start 2024-01-21T21:31:31.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.676+0000 7f9a15841700 1 -- start start 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 0x7f9a100bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a10065980 0x7f9a10065e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100654f0 con 0x7f9a10065980 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a10063950 con 0x7f9a100a9e30 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a15841700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10065180 con 0x7f9a101546b0 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a10065980 0x7f9a10065e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a10065980 0x7f9a10065e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59216/0 (socket says 172.21.15.133:59216) 2024-01-21T21:31:31.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 -- 172.21.15.133:0/2119571264 learned_addr learned my addr 172.21.15.133:0/2119571264 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/2119571264 >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 0x7f9a100bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0effd700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 -- 172.21.15.133:0/2119571264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 msgr2=0x7f9a10154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 -- 172.21.15.133:0/2119571264 >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 msgr2=0x7f9a100bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 --2- 172.21.15.133:0/2119571264 >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 0x7f9a100bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 -- 172.21.15.133:0/2119571264 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100c4c80 con 0x7f9a10065980 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0effd700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/2119571264 >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 0x7f9a100bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.677+0000 7f9a0f7fe700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a10065e30 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f9a1005f8b0 tx=0x7f9a08009840).ready entity=mon.0 client_cookie=85c7ac9ad90d48ed server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a0dffb700 1 -- 172.21.15.133:0/2119571264 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800e070 con 0x7f9a10065980 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a0dffb700 1 -- 172.21.15.133:0/2119571264 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0800ba50 con 0x7f9a10065980 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a0dffb700 1 -- 172.21.15.133:0/2119571264 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800bdd0 con 0x7f9a10065980 2024-01-21T21:31:31.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 -- 172.21.15.133:0/2119571264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 msgr2=0x7f9a10065e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a10065e30 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f9a1005f8b0 tx=0x7f9a08009840).stop 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 -- 172.21.15.133:0/2119571264 shutdown_connections 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a10065e30 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 --2- 172.21.15.133:0/2119571264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 --2- 172.21.15.133:0/2119571264 >> v2:172.21.15.178:3300/0 conn(0x7f9a100a9e30 0x7f9a100bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 -- 172.21.15.133:0/2119571264 >> 172.21.15.133:0/2119571264 conn(0x7f9a100c8200 msgr2=0x7f9a100c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 -- 172.21.15.133:0/2119571264 shutdown_connections 2024-01-21T21:31:31.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.678+0000 7f9a15841700 1 -- 172.21.15.133:0/2119571264 wait complete. 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.679+0000 7f9a15841700 1 Processor -- start 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 -- start start 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 0x7f9a100a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100a8e00 con 0x7f9a10065980 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100a7fa0 con 0x7f9a100a9e30 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a15841700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10149b20 con 0x7f9a101546b0 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a0effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a0effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59220/0 (socket says 172.21.15.133:59220) 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.680+0000 7f9a0effd700 1 -- 172.21.15.133:0/1778097225 learned_addr learned my addr 172.21.15.133:0/1778097225 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0f7fe700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 0x7f9a100a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 -- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 msgr2=0x7f9a10149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 -- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 msgr2=0x7f9a100a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 0x7f9a100a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 -- 172.21.15.133:0/1778097225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08009ae0 con 0x7f9a10065980 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 0x7f9a100a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a0effd700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f9a0400d8f0 tx=0x7f9a04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040125f0 con 0x7f9a10065980 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04012750 con 0x7f9a10065980 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04012ad0 con 0x7f9a10065980 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100a81f0 con 0x7f9a10065980 2024-01-21T21:31:31.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.681+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100a87b0 con 0x7f9a10065980 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.682+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9a04013480 con 0x7f9a10065980 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.682+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a100a90e0 con 0x7f9a10065980 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.683+0000 7f99f77fe700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 0x7f99fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.683+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6641+0+0 (secure 0 0 0) 0x7f9a0407a500 con 0x7f9a10065980 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.683+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 0x7f99fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:31.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.683+0000 7f9a0e7fc700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 0x7f99fc061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9a10150950 tx=0x7f9a00008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:31.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.687+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9a0404b4a0 con 0x7f9a10065980 2024-01-21T21:31:31.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.889+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a1005fdf0 con 0x7f9a10065980 2024-01-21T21:31:31.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.890+0000 7f99f77fe700 1 -- 172.21.15.133:0/1778097225 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f9a0404eac0 con 0x7f9a10065980 2024-01-21T21:31:31.893 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:31.893 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/509412972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":509412972},{"type":"v1","addr":"172.21.15.178:6834","nonce":509412972}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":8119,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2511959828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2511959828},{"type":"v1","addr":"172.21.15.178:6835","nonce":2511959828}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9057,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/816001297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":816001297},{"type":"v1","addr":"172.21.15.133:6836","nonce":816001297}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":9486,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3742334360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3742334360},{"type":"v1","addr":"172.21.15.133:6837","nonce":3742334360}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[]} 2024-01-21T21:31:31.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 msgr2=0x7f99fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 0x7f99fc061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9a10150950 tx=0x7f9a00008040).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 msgr2=0x7f9a100a9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f9a0400d8f0 tx=0x7f9a04008040).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 shutdown_connections 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a101546b0 0x7f9a10149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a10065980 0x7f9a100a9290 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f99fc05f150 0x7f99fc061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 --2- 172.21.15.133:0/1778097225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a100a9e30 0x7f9a100a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 >> 172.21.15.133:0/1778097225 conn(0x7f9a100c8200 msgr2=0x7f9a10068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 shutdown_connections 2024-01-21T21:31:31.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:31.892+0000 7f9a15841700 1 -- 172.21.15.133:0/1778097225 wait complete. 2024-01-21T21:31:31.896 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 64 2024-01-21T21:31:31.907 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T21:31:31.907 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T21:31:31.907 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T21:31:31.907 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:31:31.907 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T21:31:31.907 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T21:31:31.908 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T21:31:31.908 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:31:31.908 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T21:31:31.908 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T21:31:31.908 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T21:31:31.908 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:31:31.908 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T21:31:31.908 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T21:31:31.909 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T21:31:31.909 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:31:31.916 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T21:31:31.916 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T21:31:31.917 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T21:31:31.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T21:31:31.920 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T21:31:31.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T21:31:31.921 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T21:31:31.921 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T21:31:31.959 INFO:tasks.ceph.mds.a:Started 2024-01-21T21:31:31.959 DEBUG:teuthology.parallel:result is None 2024-01-21T21:31:31.959 INFO:tasks.ceph.mds.c:Started 2024-01-21T21:31:31.960 DEBUG:teuthology.parallel:result is None 2024-01-21T21:31:31.963 INFO:tasks.ceph.mds.b:Started 2024-01-21T21:31:31.963 DEBUG:teuthology.parallel:result is None 2024-01-21T21:31:31.963 INFO:tasks.ceph.mds.d:Started 2024-01-21T21:31:31.964 DEBUG:teuthology.parallel:result is None 2024-01-21T21:31:31.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T21:31:32.034 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T21:31:32.035 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:31:32.045 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T21:31:32.045 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T21:31:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.088+0000 7ff841de0700 1 Processor -- start 2024-01-21T21:31:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.089+0000 7ff841de0700 1 -- start start 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.089+0000 7ff841de0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff83c1558c0 0x7ff83c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.089+0000 7ff841de0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c0a50f0 con 0x7ff83c0bd890 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.089+0000 7ff841de0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c0a4da0 con 0x7ff83c155ca0 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.089+0000 7ff841de0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c0bde00 con 0x7ff83c1558c0 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff83c0bd890 0x7ff83c0a5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47044/0 (socket says 172.21.15.133:47044) 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83bfff700 1 -- 172.21.15.133:0/2475535618 learned_addr learned my addr 172.21.15.133:0/2475535618 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83b7fe700 1 --2- 172.21.15.133:0/2475535618 >> v2:172.21.15.178:3300/0 conn(0x7ff83c1558c0 0x7ff83c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391308803 0 0) 0x7ff83c0a50f0 con 0x7ff83c0bd890 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8240033f0 con 0x7ff83c0bd890 2024-01-21T21:31:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736719188 0 0) 0x7ff83c0a4da0 con 0x7ff83c155ca0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff83c0a50f0 con 0x7ff83c155ca0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83b7fe700 1 -- 172.21.15.133:0/2475535618 >> v1:172.21.15.178:6789/0 conn(0x7ff83c155ca0 legacy=0x7ff83c0bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83b7fe700 1 -- 172.21.15.133:0/2475535618 >> v1:172.21.15.133:6789/0 conn(0x7ff83c0bd890 legacy=0x7ff83c0a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83b7fe700 1 -- 172.21.15.133:0/2475535618 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0be0e0 con 0x7ff83c1558c0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83b7fe700 1 --2- 172.21.15.133:0/2475535618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c1558c0 0x7ff83c0626f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7ff82c009760 tx=0x7ff82c009060).ready entity=mon.1 client_cookie=391b59fb00f4316e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00d4a0 con 0x7ff83c1558c0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00d600 con 0x7ff83c1558c0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.090+0000 7ff83a7fc700 1 -- 172.21.15.133:0/2475535618 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00d980 con 0x7ff83c1558c0 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 -- 172.21.15.133:0/2475535618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c1558c0 msgr2=0x7ff83c0626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 --2- 172.21.15.133:0/2475535618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c1558c0 0x7ff83c0626f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7ff82c009760 tx=0x7ff82c009060).stop 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 -- 172.21.15.133:0/2475535618 shutdown_connections 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 --2- 172.21.15.133:0/2475535618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c1558c0 0x7ff83c0626f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 -- 172.21.15.133:0/2475535618 >> 172.21.15.133:0/2475535618 conn(0x7ff83c0c8010 msgr2=0x7ff83c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 -- 172.21.15.133:0/2475535618 shutdown_connections 2024-01-21T21:31:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.091+0000 7ff841de0700 1 -- 172.21.15.133:0/2475535618 wait complete. 2024-01-21T21:31:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.092+0000 7ff841de0700 1 Processor -- start 2024-01-21T21:31:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.092+0000 7ff841de0700 1 -- start start 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c0bd890 0x7ff83c0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff83c1558c0 0x7ff83c0952e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0ab4b0 con 0x7ff83c155ca0 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0c1050 con 0x7ff83c0bd890 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff841de0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0c1330 con 0x7ff83c1558c0 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59262/0 (socket says 172.21.15.133:59262) 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 -- 172.21.15.133:0/428053891 learned_addr learned my addr 172.21.15.133:0/428053891 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83b7fe700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c0bd890 0x7ff83c0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83affd700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff83c1558c0 0x7ff83c0952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 -- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff83c1558c0 msgr2=0x7ff83c0952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff83c1558c0 0x7ff83c0952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 -- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c0bd890 msgr2=0x7ff83c0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c0bd890 0x7ff83c0aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 -- 172.21.15.133:0/428053891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0092a0 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff83bfff700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7ff834001560 tx=0x7ff8340015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.093+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834005d30 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.094+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834005e90 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.094+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c0c1610 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.094+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340072e0 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.094+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c0957d0 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.095+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c0c2430 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.095+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff834007650 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.095+0000 7ff823fff700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 0x7ff828061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.095+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6641+0+0 (secure 0 0 0) 0x7ff834079e40 con 0x7ff83c155ca0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.095+0000 7ff83b7fe700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 0x7ff828061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.096+0000 7ff83b7fe700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 0x7ff828061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff82c009630 tx=0x7ff82c016000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.099+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff83404af00 con 0x7ff83c155ca0 2024-01-21T21:31:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:32.280+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff83c05fdf0 con 0x7ff83c155ca0 2024-01-21T21:31:33.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.144+0000 7ff823fff700 1 -- 172.21.15.133:0/428053891 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v188) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff834018030 con 0x7ff83c155ca0 2024-01-21T21:31:33.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 msgr2=0x7ff828061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 0x7ff828061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff82c009630 tx=0x7ff82c016000).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 msgr2=0x7ff83c0abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7ff834001560 tx=0x7ff8340015b0).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 shutdown_connections 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff83c155ca0 0x7ff83c0abad0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff82805f150 0x7ff828061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff83c0bd890 0x7ff83c0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 --2- 172.21.15.133:0/428053891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff83c1558c0 0x7ff83c0952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 >> 172.21.15.133:0/428053891 conn(0x7ff83c0c8010 msgr2=0x7ff83c150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 shutdown_connections 2024-01-21T21:31:33.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.147+0000 7ff841de0700 1 -- 172.21.15.133:0/428053891 wait complete. 2024-01-21T21:31:33.151 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T21:31:33.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T21:31:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.283+0000 7fa1bf433700 1 Processor -- start 2024-01-21T21:31:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.284+0000 7fa1bf433700 1 -- start start 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.284+0000 7fa1bf433700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa1b8155cb0 0x7fa1b8156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.284+0000 7fa1bf433700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b8156650 con 0x7fa1b80bde60 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.284+0000 7fa1bf433700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b80c61a0 con 0x7fa1b81351d0 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.284+0000 7fa1bf433700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80c5350 con 0x7fa1b8155cb0 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bd9d0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1b80bde60 0x7fa1b80be2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47054/0 (socket says 172.21.15.133:47054) 2024-01-21T21:31:33.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bd9d0700 1 -- 172.21.15.133:0/259869486 learned_addr learned my addr 172.21.15.133:0/259869486 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/259869486 >> v2:172.21.15.178:3300/0 conn(0x7fa1b8155cb0 0x7fa1b8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12430957 0 0) 0x7fa1b0001490 con 0x7fa1b80bde60 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a40033f0 con 0x7fa1b80bde60 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1227134905 0 0) 0x7fa1a40033f0 con 0x7fa1b80bde60 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 >> v2:172.21.15.178:3300/0 conn(0x7fa1b8155cb0 msgr2=0x7fa1b8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 --2- 172.21.15.133:0/259869486 >> v2:172.21.15.178:3300/0 conn(0x7fa1b8155cb0 0x7fa1b8156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 >> v1:172.21.15.178:6789/0 conn(0x7fa1b81351d0 legacy=0x7fa1b80c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80c55d0 con 0x7fa1b80bde60 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fa1b0001980 con 0x7fa1b80bde60 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 >> v1:172.21.15.133:6789/0 conn(0x7fa1b80bde60 legacy=0x7fa1b80be2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a40038e0 0x7fa1a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 0x7fa1a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1a4005050 0x7fa1a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80c5350 con 0x7fa1a4004690 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400bfe0 con 0x7fa1a4005050 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a400c1a0 con 0x7fa1a40038e0 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 0x7fa1a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bd9d0700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1a4005050 0x7fa1a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.285+0000 7fa1bd1cf700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a40038e0 0x7fa1a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a40038e0 msgr2=0x7fa1a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a40038e0 0x7fa1a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1a4005050 msgr2=0x7fa1a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1a4005050 0x7fa1a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/259869486 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a40033f0 con 0x7fa1a4004690 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bd9d0700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1a4005050 0x7fa1a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bd9d0700 1 -- 172.21.15.133:0/259869486 reap_dead start 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 0x7fa1a4004b10 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fa1ac006d80 tx=0x7fa1ac009060).ready entity=mon.0 client_cookie=3aaf6eecbc7a1701 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac009e90 con 0x7fa1a4004690 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00e640 con 0x7fa1a4004690 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1abfff700 1 -- 172.21.15.133:0/259869486 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00ea00 con 0x7fa1a4004690 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bf433700 1 -- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 msgr2=0x7fa1a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bf433700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 0x7fa1a4004b10 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7fa1ac006d80 tx=0x7fa1ac009060).stop 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bf433700 1 -- 172.21.15.133:0/259869486 shutdown_connections 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bf433700 1 --2- 172.21.15.133:0/259869486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a4004690 0x7fa1a4004b10 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.286+0000 7fa1bf433700 1 -- 172.21.15.133:0/259869486 >> 172.21.15.133:0/259869486 conn(0x7fa1b8066a90 msgr2=0x7fa1b8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.287+0000 7fa1bf433700 1 -- 172.21.15.133:0/259869486 shutdown_connections 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.287+0000 7fa1bf433700 1 -- 172.21.15.133:0/259869486 wait complete. 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.288+0000 7fa1bf433700 1 Processor -- start 2024-01-21T21:31:33.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.288+0000 7fa1bf433700 1 -- start start 2024-01-21T21:31:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a4004690 0x7fa1b8064210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1b81546a0 0x7fa1b8154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8064700 con 0x7fa1b80a9f00 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80ab060 con 0x7fa1b81546a0 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8155010 con 0x7fa1a4004690 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59284/0 (socket says 172.21.15.133:59284) 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/2499790687 learned_addr learned my addr 172.21.15.133:0/2499790687 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a4004690 msgr2=0x7fa1b8064210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a4004690 0x7fa1b8064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1b81546a0 msgr2=0x7fa1b8154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1b81546a0 0x7fa1b8154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 -- 172.21.15.133:0/2499790687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b8065020 con 0x7fa1b80a9f00 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bc9ce700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fa1ac01ce50 tx=0x7fa1ac01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac000bc0 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ac00ed70 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b80aa450 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ac00eee0 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.289+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b80aaa10 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.290+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b805fdf0 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.291+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa1ac0123f0 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.291+0000 7fa1a9ffb700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 0x7fa19c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.291+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7fa1ac07b790 con 0x7fa1b80a9f00 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.291+0000 7fa1bd1cf700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 0x7fa19c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.292+0000 7fa1bd1cf700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 0x7fa19c061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa1b4007fd0 tx=0x7fa1b4009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.295+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa1ac04ca60 con 0x7fa1b80a9f00 2024-01-21T21:31:33.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.522+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa1b80c5870 con 0x7fa1b80a9f00 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.522+0000 7fa1a9ffb700 1 -- 172.21.15.133:0/2499790687 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v50) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa1ac016090 con 0x7fa1b80a9f00 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:31:33.525 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.527 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.528 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.529 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T21:31:33.530 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.531 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.532 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.533 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T21:31:33.534 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T21:31:33.536 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:31:33.537 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.538 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T21:31:33.539 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 msgr2=0x7fa19c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 0x7fa19c061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa1b4007fd0 tx=0x7fa1b4009040).stop 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 msgr2=0x7fa1b8163dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fa1ac01ce50 tx=0x7fa1ac01a000).stop 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 shutdown_connections 2024-01-21T21:31:33.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa19c05f150 0x7fa19c061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1b81546a0 0x7fa1b8154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1a4004690 0x7fa1b8064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 --2- 172.21.15.133:0/2499790687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b80a9f00 0x7fa1b8163dc0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 >> 172.21.15.133:0/2499790687 conn(0x7fa1b8066a90 msgr2=0x7fa1b80c1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 shutdown_connections 2024-01-21T21:31:33.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.524+0000 7fa1bf433700 1 -- 172.21.15.133:0/2499790687 wait complete. 2024-01-21T21:31:33.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:33.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.656+0000 7f24c06ed700 1 Processor -- start 2024-01-21T21:31:33.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.656+0000 7f24c06ed700 1 -- start start 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24c06ed700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24b8065d70 0x7f24b815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24c06ed700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b8069ef0 con 0x7f24b8062c10 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24c06ed700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b806a130 con 0x7f24b8062ff0 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24c06ed700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b806a410 con 0x7f24b8065d70 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24bec8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24b8065d70 0x7f24b815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24bec8a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24b8065d70 0x7f24b815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59296/0 (socket says 172.21.15.133:59296) 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24be489700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f24b8062c10 0x7f24b80697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47060/0 (socket says 172.21.15.133:47060) 2024-01-21T21:31:33.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.657+0000 7f24bec8a700 1 -- 172.21.15.133:0/2111469417 learned_addr learned my addr 172.21.15.133:0/2111469417 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bec8a700 1 -- 172.21.15.133:0/2111469417 >> v1:172.21.15.178:6789/0 conn(0x7f24b8062ff0 legacy=0x7f24b8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bec8a700 1 -- 172.21.15.133:0/2111469417 >> v1:172.21.15.133:6789/0 conn(0x7f24b8062c10 legacy=0x7f24b80697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bec8a700 1 -- 172.21.15.133:0/2111469417 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b806a6f0 con 0x7f24b8065d70 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bd487700 1 -- 172.21.15.133:0/2111469417 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991375963 0 0) 0x7f24b4001490 con 0x7f24b8062c10 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bec8a700 1 --2- 172.21.15.133:0/2111469417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b815f750 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f24b0006fd0 tx=0x7f24b00090f0).ready entity=mon.0 client_cookie=8d9bada218dc73a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bd487700 1 -- 172.21.15.133:0/2111469417 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000b600 con 0x7f24b8065d70 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bd487700 1 -- 172.21.15.133:0/2111469417 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000b760 con 0x7f24b8065d70 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24bd487700 1 -- 172.21.15.133:0/2111469417 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000bb00 con 0x7f24b8065d70 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24c06ed700 1 -- 172.21.15.133:0/2111469417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 msgr2=0x7f24b815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.658+0000 7f24c06ed700 1 --2- 172.21.15.133:0/2111469417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b815f750 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f24b0006fd0 tx=0x7f24b00090f0).stop 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.659+0000 7f24c06ed700 1 -- 172.21.15.133:0/2111469417 shutdown_connections 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.659+0000 7f24c06ed700 1 --2- 172.21.15.133:0/2111469417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b815f750 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.659+0000 7f24c06ed700 1 -- 172.21.15.133:0/2111469417 >> 172.21.15.133:0/2111469417 conn(0x7f24b80c8010 msgr2=0x7f24b80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.659+0000 7f24c06ed700 1 -- 172.21.15.133:0/2111469417 shutdown_connections 2024-01-21T21:31:33.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.659+0000 7f24c06ed700 1 -- 172.21.15.133:0/2111469417 wait complete. 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.660+0000 7f24c06ed700 1 Processor -- start 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.660+0000 7f24c06ed700 1 -- start start 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.660+0000 7f24c06ed700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 0x7f24b8139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b8062ff0 0x7f24b80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80aa890 con 0x7f24b8065d70 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80ac100 con 0x7f24b8062c10 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80ab060 con 0x7f24b8062ff0 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59304/0 (socket says 172.21.15.133:59304) 2024-01-21T21:31:33.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 -- 172.21.15.133:0/3968564208 learned_addr learned my addr 172.21.15.133:0/3968564208 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24be489700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 0x7f24b8139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 -- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b8062ff0 msgr2=0x7f24b80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b8062ff0 0x7f24b80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 -- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 msgr2=0x7f24b8139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 0x7f24b8139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 -- 172.21.15.133:0/3968564208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b0009370 con 0x7f24b8065d70 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24be489700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 0x7f24b8139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24bec8a700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f24b0011000 tx=0x7f24b0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000bae0 con 0x7f24b8065d70 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b0025420 con 0x7f24b8065d70 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b80ab340 con 0x7f24b8065d70 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0025590 con 0x7f24b8065d70 2024-01-21T21:31:33.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.661+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b80ab900 con 0x7f24b8065d70 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.662+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b80690e0 con 0x7f24b8065d70 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.662+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f24b0022020 con 0x7f24b8065d70 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.663+0000 7f24aeffd700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 0x7f249c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.663+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f24b007bcc0 con 0x7f24b8065d70 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.663+0000 7f24be489700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 0x7f249c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.663+0000 7f24be489700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 0x7f249c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f24b813a5f0 tx=0x7f24b4009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.667+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f24b004d030 con 0x7f24b8065d70 2024-01-21T21:31:33.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.830+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24b80abf10 con 0x7f24b8065d70 2024-01-21T21:31:33.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.831+0000 7f24aeffd700 1 -- 172.21.15.133:0/3968564208 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+14817 (secure 0 0 0) 0x7f24b002a030 con 0x7f24b8065d70 2024-01-21T21:31:33.833 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:33.833 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":188,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:33.138438+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:33.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 msgr2=0x7f249c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 0x7f249c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f24b813a5f0 tx=0x7f24b4009040).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 msgr2=0x7f24b80aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7f24b0011000 tx=0x7f24b0017000).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 shutdown_connections 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24b8065d70 0x7f24b80aa3a0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f249c05f150 0x7f249c061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24b8062c10 0x7f24b8139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 --2- 172.21.15.133:0/3968564208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24b8062ff0 0x7f24b80a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 >> 172.21.15.133:0/3968564208 conn(0x7f24b80c8010 msgr2=0x7f24b80a6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 shutdown_connections 2024-01-21T21:31:33.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.833+0000 7f24c06ed700 1 -- 172.21.15.133:0/3968564208 wait complete. 2024-01-21T21:31:33.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T21:31:33.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:31:33.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.965+0000 7fb10a177700 1 Processor -- start 2024-01-21T21:31:33.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.965+0000 7fb10a177700 1 -- start start 2024-01-21T21:31:33.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.965+0000 7fb10a177700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb104137170 0x7fb104063800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.965+0000 7fb10a177700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040be770 con 0x7fb104137550 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb10a177700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1040bde60 con 0x7fb104068580 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb10a177700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb104155ac0 con 0x7fb104137170 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb102ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb104137550 0x7fb104067e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47068/0 (socket says 172.21.15.133:47068) 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb102ffd700 1 -- 172.21.15.133:0/4129971600 learned_addr learned my addr 172.21.15.133:0/4129971600 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639428982 0 0) 0x7fb1040be770 con 0x7fb104137550 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec0033f0 con 0x7fb104137550 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1037fe700 1 --2- 172.21.15.133:0/4129971600 >> v2:172.21.15.178:3300/0 conn(0x7fb104137170 0x7fb104063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944575145 0 0) 0x7fb0ec0033f0 con 0x7fb104137550 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 >> v2:172.21.15.178:3300/0 conn(0x7fb104137170 msgr2=0x7fb104063800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 --2- 172.21.15.133:0/4129971600 >> v2:172.21.15.178:3300/0 conn(0x7fb104137170 0x7fb104063800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 >> v1:172.21.15.178:6789/0 conn(0x7fb104068580 legacy=0x7fb10415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104068be0 con 0x7fb104137550 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fb0f8001470 con 0x7fb104137550 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 >> v1:172.21.15.133:6789/0 conn(0x7fb104137550 legacy=0x7fb104067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ec0038e0 0x7fb0ec003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec004690 0x7fb0ec004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 0x7fb0ec00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c050 con 0x7fb0ec005120 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c1c0 con 0x7fb0ec0038e0 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c380 con 0x7fb0ec004690 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb1037fe700 1 --2- 172.21.15.133:0/4129971600 >> v2:172.21.15.178:3300/0 conn(0x7fb104137170 0x7fb104063800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb103fff700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 0x7fb0ec00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.966+0000 7fb102ffd700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec004690 0x7fb0ec004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb1037fe700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ec0038e0 0x7fb0ec003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 -- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec004690 msgr2=0x7fb0ec004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec004690 0x7fb0ec004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 -- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ec0038e0 msgr2=0x7fb0ec003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ec0038e0 0x7fb0ec003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 -- 172.21.15.133:0/4129971600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0033f0 con 0x7fb0ec005120 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 -- 172.21.15.133:0/4129971600 reap_dead start 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb103fff700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 0x7fb0ec00b8e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fb0fc001e30 tx=0x7fb0fc007f30).ready entity=mon.0 client_cookie=b3557b3094c3fe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc006a20 con 0x7fb0ec005120 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc006b80 con 0x7fb0ec005120 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb1027fc700 1 -- 172.21.15.133:0/4129971600 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00c5d0 con 0x7fb0ec005120 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 -- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 msgr2=0x7fb0ec00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 0x7fb0ec00b8e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7fb0fc001e30 tx=0x7fb0fc007f30).stop 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 -- 172.21.15.133:0/4129971600 shutdown_connections 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 --2- 172.21.15.133:0/4129971600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0ec005120 0x7fb0ec00b8e0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 -- 172.21.15.133:0/4129971600 >> 172.21.15.133:0/4129971600 conn(0x7fb104066a90 msgr2=0x7fb104066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 -- 172.21.15.133:0/4129971600 shutdown_connections 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.967+0000 7fb10a177700 1 -- 172.21.15.133:0/4129971600 wait complete. 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.969+0000 7fb10a177700 1 Processor -- start 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.969+0000 7fb10a177700 1 -- start start 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.969+0000 7fb10a177700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 0x7fb10414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1040c8fe0 0x7fb1040ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb104168810 con 0x7fb1040c8b60 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040c86d0 con 0x7fb1040c8fe0 2024-01-21T21:31:33.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb104168250 con 0x7fb0ec005120 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59314/0 (socket says 172.21.15.133:59314) 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 -- 172.21.15.133:0/2448683397 learned_addr learned my addr 172.21.15.133:0/2448683397 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb1037fe700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 0x7fb10414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb103fff700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1040c8fe0 0x7fb1040ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 -- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 msgr2=0x7fb10414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 0x7fb10414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 -- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1040c8fe0 msgr2=0x7fb1040ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1040c8fe0 0x7fb1040ae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 -- 172.21.15.133:0/2448683397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104168530 con 0x7fb1040c8b60 2024-01-21T21:31:33.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb1037fe700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 0x7fb10414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb102ffd700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fb0f8001ce0 tx=0x7fb0f8001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8001470 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f8000f70 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1040c8360 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800f870 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.970+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb104156e80 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.971+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1040c81c0 con 0x7fb1040c8b60 2024-01-21T21:31:33.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.972+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb0f800fbe0 con 0x7fb1040c8b60 2024-01-21T21:31:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.972+0000 7fb0ebfff700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 0x7fb0f0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.972+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7fb0f80799d0 con 0x7fb1040c8b60 2024-01-21T21:31:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.972+0000 7fb1037fe700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 0x7fb0f0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.972+0000 7fb1037fe700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 0x7fb0f0061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb0f400da80 tx=0x7fb0f4008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:33.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:33.976+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb1040c81c0 con 0x7fb1040c8b60 2024-01-21T21:31:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.140+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb1040c81c0 con 0x7fb1040c8b60 2024-01-21T21:31:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.140+0000 7fb0ebfff700 1 -- 172.21.15.133:0/2448683397 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v188) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb1040c81c0 con 0x7fb1040c8b60 2024-01-21T21:31:34.143 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:31:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 msgr2=0x7fb0f0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 0x7fb0f0061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb0f400da80 tx=0x7fb0f4008040).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 msgr2=0x7fb104167870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7fb0f8001ce0 tx=0x7fb0f8001e50).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 shutdown_connections 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb0f005f150 0x7fb0f0061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1040c8fe0 0x7fb1040ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ec005120 0x7fb10414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 --2- 172.21.15.133:0/2448683397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1040c8b60 0x7fb104167870 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 >> 172.21.15.133:0/2448683397 conn(0x7fb104066a90 msgr2=0x7fb10414e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 shutdown_connections 2024-01-21T21:31:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.142+0000 7fb10a177700 1 -- 172.21.15.133:0/2448683397 wait complete. 2024-01-21T21:31:34.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:31:34.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.274+0000 7f57b3fbf700 1 Processor -- start 2024-01-21T21:31:34.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.274+0000 7f57b3fbf700 1 -- start start 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b3fbf700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57ac062ff0 0x7f57ac065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b3fbf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57ac065b50 0x7f57ac0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b3fbf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac069ef0 con 0x7f57ac062c10 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b3fbf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac065fe0 con 0x7f57ac065b50 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b3fbf700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac06a130 con 0x7f57ac062ff0 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57ac065b50 0x7f57ac0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b1d5b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57ac062c10 0x7f57ac0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47082/0 (socket says 172.21.15.133:47082) 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b1d5b700 1 -- 172.21.15.133:0/2220266862 learned_addr learned my addr 172.21.15.133:0/2220266862 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b155a700 1 --2- 172.21.15.133:0/2220266862 >> v2:172.21.15.178:3300/0 conn(0x7f57ac062ff0 0x7f57ac065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 -- 172.21.15.133:0/2220266862 >> v2:172.21.15.178:3300/0 conn(0x7f57ac062ff0 msgr2=0x7f57ac065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 --2- 172.21.15.133:0/2220266862 >> v2:172.21.15.178:3300/0 conn(0x7f57ac062ff0 0x7f57ac065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 -- 172.21.15.133:0/2220266862 >> v1:172.21.15.133:6789/0 conn(0x7f57ac062c10 legacy=0x7f57ac0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 -- 172.21.15.133:0/2220266862 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac06a410 con 0x7f57ac065b50 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b0d59700 1 -- 172.21.15.133:0/2220266862 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205883851 0 0) 0x7f57a8001110 con 0x7f57ac062c10 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b255c700 1 --2- 172.21.15.133:0/2220266862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0bd770 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f57ac0c9080 tx=0x7f57a4009780).ready entity=mon.0 client_cookie=b61e8e094786b33f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b0d59700 1 -- 172.21.15.133:0/2220266862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400e070 con 0x7f57ac065b50 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b0d59700 1 -- 172.21.15.133:0/2220266862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400bc30 con 0x7f57ac065b50 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.275+0000 7f57b0d59700 1 -- 172.21.15.133:0/2220266862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4012410 con 0x7f57ac065b50 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 -- 172.21.15.133:0/2220266862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 msgr2=0x7f57ac0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/2220266862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0bd770 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 rx=0x7f57ac0c9080 tx=0x7f57a4009780).stop 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 -- 172.21.15.133:0/2220266862 shutdown_connections 2024-01-21T21:31:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/2220266862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0bd770 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/2220266862 >> v2:172.21.15.178:3300/0 conn(0x7f57ac062ff0 0x7f57ac065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 -- 172.21.15.133:0/2220266862 >> 172.21.15.133:0/2220266862 conn(0x7f57ac0c8010 msgr2=0x7f57ac0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 -- 172.21.15.133:0/2220266862 shutdown_connections 2024-01-21T21:31:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.276+0000 7f57b3fbf700 1 -- 172.21.15.133:0/2220266862 wait complete. 2024-01-21T21:31:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 Processor -- start 2024-01-21T21:31:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 -- start start 2024-01-21T21:31:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57ac062c10 0x7f57ac0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 0x7f57ac138110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0ab4b0 con 0x7f57ac065b50 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0aaae0 con 0x7f57ac062ff0 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.278+0000 7f57b3fbf700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0ad320 con 0x7f57ac062c10 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59330/0 (socket says 172.21.15.133:59330) 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 -- 172.21.15.133:0/234622758 learned_addr learned my addr 172.21.15.133:0/234622758 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b155a700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 0x7f57ac138110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 -- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57ac062c10 msgr2=0x7f57ac0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b1d5b700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57ac062c10 0x7f57ac0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57ac062c10 0x7f57ac0aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 -- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 msgr2=0x7f57ac138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 0x7f57ac138110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 -- 172.21.15.133:0/234622758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4009a20 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b155a700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 0x7f57ac138110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b255c700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f57a400b6c0 tx=0x7f57a4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a401d700 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a401d860 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac1390e0 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a401dc00 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.279+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac0accd0 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.280+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac05fdf0 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.280+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f57a4027460 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.281+0000 7f57a27fc700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 0x7f5790061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.281+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f57a407c190 con 0x7f57ac065b50 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.281+0000 7f57b1d5b700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 0x7f5790061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.281+0000 7f57b1d5b700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 0x7f5790061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f57a8001660 tx=0x7f57a8009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.285+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f57a404d4a0 con 0x7f57ac065b50 2024-01-21T21:31:34.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.448+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57ac0c8e40 con 0x7f57ac065b50 2024-01-21T21:31:34.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.448+0000 7f57a27fc700 1 -- 172.21.15.133:0/234622758 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57a4050ac0 con 0x7f57ac065b50 2024-01-21T21:31:34.452 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 msgr2=0x7f5790061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 0x7f5790061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f57a8001660 tx=0x7f57a8009040).stop 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 msgr2=0x7f57ac0ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f57a400b6c0 tx=0x7f57a4009780).stop 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 shutdown_connections 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57ac065b50 0x7f57ac0ad7b0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57ac062c10 0x7f57ac0aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f579005f150 0x7f5790061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 --2- 172.21.15.133:0/234622758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57ac062ff0 0x7f57ac138110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 >> 172.21.15.133:0/234622758 conn(0x7f57ac0c8010 msgr2=0x7f57ac0bd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 shutdown_connections 2024-01-21T21:31:34.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.450+0000 7f57b3fbf700 1 -- 172.21.15.133:0/234622758 wait complete. 2024-01-21T21:31:34.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T21:31:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.578+0000 7fe5484e0700 1 Processor -- start 2024-01-21T21:31:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.578+0000 7fe5484e0700 1 -- start start 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.579+0000 7fe5484e0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5400a9e30 0x7fe5400c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.579+0000 7fe5484e0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 0x7fe5400bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.579+0000 7fe5484e0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5401511f0 con 0x7fe5400bd140 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.579+0000 7fe5484e0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5400c2ff0 con 0x7fe5400a9e30 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.579+0000 7fe5484e0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe540065b20 con 0x7fe540065fb0 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe545a7b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 0x7fe5400bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5400a9e30 0x7fe5400c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5400a9e30 0x7fe5400c2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:53066/0 (socket says 172.21.15.133:53066) 2024-01-21T21:31:34.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe546a7d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe5400bd140 0x7fe5400626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:56334/0 (socket says 172.21.15.133:56334) 2024-01-21T21:31:34.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 -- 172.21.15.133:0/1235420002 learned_addr learned my addr 172.21.15.133:0/1235420002 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:34.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe545a7b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 0x7fe5400bcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:39628/0 (socket says 172.21.15.133:39628) 2024-01-21T21:31:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 -- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 msgr2=0x7fe5400bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 --2- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 0x7fe5400bcc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 -- 172.21.15.133:0/1235420002 >> v1:172.21.15.178:6789/0 conn(0x7fe5400bd140 legacy=0x7fe5400626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 -- 172.21.15.133:0/1235420002 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5400c2240 con 0x7fe5400a9e30 2024-01-21T21:31:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54627c700 1 --2- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5400a9e30 0x7fe5400c2b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fe530006fd0 tx=0x7fe5300090f0).ready entity=mon.1 client_cookie=aa207c194ce765ec server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54527a700 1 -- 172.21.15.133:0/1235420002 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000b580 con 0x7fe5400a9e30 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54527a700 1 -- 172.21.15.133:0/1235420002 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000b6e0 con 0x7fe5400a9e30 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.580+0000 7fe54527a700 1 -- 172.21.15.133:0/1235420002 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ba80 con 0x7fe5400a9e30 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 -- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5400a9e30 msgr2=0x7fe5400c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 --2- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5400a9e30 0x7fe5400c2b00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fe530006fd0 tx=0x7fe5300090f0).stop 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 -- 172.21.15.133:0/1235420002 shutdown_connections 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 --2- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5400a9e30 0x7fe5400c2b00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 --2- 172.21.15.133:0/1235420002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe540065fb0 0x7fe5400bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 -- 172.21.15.133:0/1235420002 >> 172.21.15.133:0/1235420002 conn(0x7fe5400c8200 msgr2=0x7fe5400c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 -- 172.21.15.133:0/1235420002 shutdown_connections 2024-01-21T21:31:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.581+0000 7fe5484e0700 1 -- 172.21.15.133:0/1235420002 wait complete. 2024-01-21T21:31:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.582+0000 7fe5484e0700 1 Processor -- start 2024-01-21T21:31:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.583+0000 7fe5484e0700 1 -- start start 2024-01-21T21:31:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.583+0000 7fe5484e0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 0x7fe540141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.583+0000 7fe5484e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.583+0000 7fe5484e0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5400bd140 0x7fe540153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe5484e0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5400bf690 con 0x7fe5400a9e30 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe5484e0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe540141970 con 0x7fe540065fb0 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe5484e0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe540151430 con 0x7fe5400bd140 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59342/0 (socket says 172.21.15.133:59342) 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 -- 172.21.15.133:0/2316971839 learned_addr learned my addr 172.21.15.133:0/2316971839 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe54627c700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 0x7fe540141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe546a7d700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5400bd140 0x7fe540153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 -- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5400bd140 msgr2=0x7fe540153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5400bd140 0x7fe540153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 -- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 msgr2=0x7fe540141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 0x7fe540141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 -- 172.21.15.133:0/2316971839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009370 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe54627c700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 0x7fe540141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe545a7b700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe53c00e930 tx=0x7fe53c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00eed0 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00c850 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00cbd0 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe540151710 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.584+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5400bf320 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.585+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54005fdf0 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.586+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe53c01b400 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.586+0000 7fe536ffd700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 0x7fe524061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.586+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7fe53c07a6f0 con 0x7fe5400a9e30 2024-01-21T21:31:34.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.586+0000 7fe54627c700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 0x7fe524061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.586+0000 7fe54627c700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 0x7fe524061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe530009fd0 tx=0x7fe530017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.590+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe53c04bab0 con 0x7fe5400a9e30 2024-01-21T21:31:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.757+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe5400666b0 con 0x7fe5400a9e30 2024-01-21T21:31:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.758+0000 7fe536ffd700 1 -- 172.21.15.133:0/2316971839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v188) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe53c04f0d0 con 0x7fe5400a9e30 2024-01-21T21:31:34.760 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:34.760 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:34.761 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:31:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 msgr2=0x7fe524061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 0x7fe524061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe530009fd0 tx=0x7fe530017000).stop 2024-01-21T21:31:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 msgr2=0x7fe5401651a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7fe53c00e930 tx=0x7fe53c009060).stop 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 shutdown_connections 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5400bd140 0x7fe540153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe52405f150 0x7fe524061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe540065fb0 0x7fe540141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 --2- 172.21.15.133:0/2316971839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5400a9e30 0x7fe5401651a0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 >> 172.21.15.133:0/2316971839 conn(0x7fe5400c8200 msgr2=0x7fe5400c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 shutdown_connections 2024-01-21T21:31:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.760+0000 7fe5484e0700 1 -- 172.21.15.133:0/2316971839 wait complete. 2024-01-21T21:31:34.774 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T21:31:34.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T21:31:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.892+0000 7f94e133a700 1 Processor -- start 2024-01-21T21:31:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.892+0000 7f94e133a700 1 -- start start 2024-01-21T21:31:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94dc154210 0x7f94dc0be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94dc067e50 0x7f94dc0c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc1545f0 0x7f94dc0668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc0c35b0 con 0x7f94dc154210 2024-01-21T21:31:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc068350 con 0x7f94dc067e50 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94e133a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc068630 con 0x7f94dc1545f0 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94daffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94dc154210 0x7f94dc0be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94daffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f94dc154210 0x7f94dc0be290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59344/0 (socket says 172.21.15.133:59344) 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.893+0000 7f94daffd700 1 -- 172.21.15.133:0/3830545322 learned_addr learned my addr 172.21.15.133:0/3830545322 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94db7fe700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc1545f0 0x7f94dc0668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 -- 172.21.15.133:0/3830545322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc1545f0 msgr2=0x7f94dc0668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94da7fc700 1 --2- 172.21.15.133:0/3830545322 >> v2:172.21.15.178:3300/0 conn(0x7f94dc067e50 0x7f94dc0c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc1545f0 0x7f94dc0668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 -- 172.21.15.133:0/3830545322 >> v2:172.21.15.178:3300/0 conn(0x7f94dc067e50 msgr2=0x7f94dc0c5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 --2- 172.21.15.133:0/3830545322 >> v2:172.21.15.178:3300/0 conn(0x7f94dc067e50 0x7f94dc0c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 -- 172.21.15.133:0/3830545322 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc068910 con 0x7f94dc154210 2024-01-21T21:31:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94daffd700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc154210 0x7f94dc0be290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f94dc0655a0 tx=0x7f94d00090f0).ready entity=mon.0 client_cookie=44532752cd29e207 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94d9ffb700 1 -- 172.21.15.133:0/3830545322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000b600 con 0x7f94dc154210 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94d9ffb700 1 -- 172.21.15.133:0/3830545322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000b760 con 0x7f94dc154210 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94d9ffb700 1 -- 172.21.15.133:0/3830545322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000bae0 con 0x7f94dc154210 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94e133a700 1 -- 172.21.15.133:0/3830545322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc154210 msgr2=0x7f94dc0be290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.894+0000 7f94e133a700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc154210 0x7f94dc0be290 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 rx=0x7f94dc0655a0 tx=0x7f94d00090f0).stop 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 -- 172.21.15.133:0/3830545322 shutdown_connections 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc1545f0 0x7f94dc0668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 --2- 172.21.15.133:0/3830545322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc154210 0x7f94dc0be290 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 --2- 172.21.15.133:0/3830545322 >> v2:172.21.15.178:3300/0 conn(0x7f94dc067e50 0x7f94dc0c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 -- 172.21.15.133:0/3830545322 >> 172.21.15.133:0/3830545322 conn(0x7f94dc0c8f10 msgr2=0x7f94dc0c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 -- 172.21.15.133:0/3830545322 shutdown_connections 2024-01-21T21:31:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.895+0000 7f94e133a700 1 -- 172.21.15.133:0/3830545322 wait complete. 2024-01-21T21:31:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.896+0000 7f94e133a700 1 Processor -- start 2024-01-21T21:31:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.896+0000 7f94e133a700 1 -- start start 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc154210 0x7f94dc149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 0x7f94dc167f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc150fa0 con 0x7f94dc067e50 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc151b20 con 0x7f94dc1545f0 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc151fb0 con 0x7f94dc154210 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59352/0 (socket says 172.21.15.133:59352) 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 -- 172.21.15.133:0/311864963 learned_addr learned my addr 172.21.15.133:0/311864963 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94db7fe700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 0x7f94dc167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94da7fc700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc154210 0x7f94dc149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 -- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc154210 msgr2=0x7f94dc149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc154210 0x7f94dc149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 -- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 msgr2=0x7f94dc167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 0x7f94dc167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 -- 172.21.15.133:0/311864963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009370 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94db7fe700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 0x7f94dc167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94daffd700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f94d0009130 tx=0x7f94d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000bae0 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d0000c90 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc1511f0 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d001c670 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.897+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc1517b0 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.898+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc151e00 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.899+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f94d001ca20 con 0x7f94dc067e50 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.899+0000 7f94c37fe700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 0x7f94c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.899+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5953+0+0 (secure 0 0 0) 0x7f94d007bed0 con 0x7f94dc067e50 2024-01-21T21:31:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.899+0000 7f94da7fc700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 0x7f94c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.899+0000 7f94da7fc700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 0x7f94c8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94cc006fd0 tx=0x7f94cc008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:34.903+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f94d004d240 con 0x7f94dc067e50 2024-01-21T21:31:35.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.067+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f94dc0be0a0 con 0x7f94dc067e50 2024-01-21T21:31:35.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.150+0000 7f94c37fe700 1 -- 172.21.15.133:0/311864963 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v189) v1 ==== 152+0+0 (secure 0 0 0) 0x7f94d002a020 con 0x7f94dc067e50 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.154+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 msgr2=0x7f94c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.154+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 0x7f94c8061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f94cc006fd0 tx=0x7f94cc008040).stop 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.154+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 msgr2=0x7f94dc152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.154+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f94d0009130 tx=0x7f94d0017000).stop 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 shutdown_connections 2024-01-21T21:31:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f94c805f150 0x7f94c8061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94dc1545f0 0x7f94dc167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94dc067e50 0x7f94dc152b40 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 --2- 172.21.15.133:0/311864963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94dc154210 0x7f94dc149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 >> 172.21.15.133:0/311864963 conn(0x7f94dc0c8f10 msgr2=0x7f94dc0be260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 shutdown_connections 2024-01-21T21:31:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.155+0000 7f94e133a700 1 -- 172.21.15.133:0/311864963 wait complete. 2024-01-21T21:31:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T21:31:35.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T21:31:35.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.292+0000 7f76b15bc700 1 Processor -- start 2024-01-21T21:31:35.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.292+0000 7f76b15bc700 1 -- start start 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.293+0000 7f76b15bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.293+0000 7f76b15bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ac0c39f0 0x7f76ac0be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.293+0000 7f76b15bc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac0bfa40 con 0x7f76ac0be5f0 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.293+0000 7f76b15bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0c3e70 con 0x7f76ac0c39f0 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.293+0000 7f76b15bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0bee30 con 0x7f76ac13b970 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ac0c39f0 0x7f76ac0be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ac0c39f0 0x7f76ac0be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59360/0 (socket says 172.21.15.133:59360) 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 -- 172.21.15.133:0/3127327438 learned_addr learned my addr 172.21.15.133:0/3127327438 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aaffd700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 -- 172.21.15.133:0/3127327438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 msgr2=0x7f76ac0c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac0c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 -- 172.21.15.133:0/3127327438 >> v1:172.21.15.178:6789/0 conn(0x7f76ac0be5f0 legacy=0x7f76ac0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 -- 172.21.15.133:0/3127327438 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0bf110 con 0x7f76ac0c39f0 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c39f0 0x7f76ac0be100 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f769c006fd0 tx=0x7f769c0090f0).ready entity=mon.0 client_cookie=f990d8c742d0924c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76a9ffb700 1 -- 172.21.15.133:0/3127327438 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00b600 con 0x7f76ac0c39f0 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76a9ffb700 1 -- 172.21.15.133:0/3127327438 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c00b760 con 0x7f76ac0c39f0 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.294+0000 7f76a9ffb700 1 -- 172.21.15.133:0/3127327438 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00bb00 con 0x7f76ac0c39f0 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 -- 172.21.15.133:0/3127327438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c39f0 msgr2=0x7f76ac0be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c39f0 0x7f76ac0be100 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f769c006fd0 tx=0x7f769c0090f0).stop 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 -- 172.21.15.133:0/3127327438 shutdown_connections 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac0c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 --2- 172.21.15.133:0/3127327438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c39f0 0x7f76ac0be100 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 -- 172.21.15.133:0/3127327438 >> 172.21.15.133:0/3127327438 conn(0x7f76ac066a70 msgr2=0x7f76ac066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 -- 172.21.15.133:0/3127327438 shutdown_connections 2024-01-21T21:31:35.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.295+0000 7f76b15bc700 1 -- 172.21.15.133:0/3127327438 wait complete. 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.296+0000 7f76b15bc700 1 Processor -- start 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 -- start start 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 0x7f76ac138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac1554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac155ec0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0c0a00 con 0x7f76ac0c39f0 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.297+0000 7f76b15bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0c00d0 con 0x7f76ac13b970 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59362/0 (socket says 172.21.15.133:59362) 2024-01-21T21:31:35.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 -- 172.21.15.133:0/2432115079 learned_addr learned my addr 172.21.15.133:0/2432115079 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 0x7f76ac138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 -- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 msgr2=0x7f76ac1554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76ab7fe700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac1554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac1554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 -- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 msgr2=0x7f76ac138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 0x7f76ac138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 -- 172.21.15.133:0/2432115079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c009370 con 0x7f76ac0be5f0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 0x7f76ac138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76ab7fe700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76aaffd700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f76a000d890 tx=0x7f76a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00125f0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0012750 con 0x7f76ac0be5f0 2024-01-21T21:31:35.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac0c03b0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0012ad0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.298+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac1629f0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.299+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac05fdf0 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.300+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f76a0013480 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.300+0000 7f76937fe700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 0x7f7698061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.300+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f76a007a210 con 0x7f76ac0be5f0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.300+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 0x7f7698061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:35.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.301+0000 7f76aa7fc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 0x7f7698061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f769c006fd0 tx=0x7f769c017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:35.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.305+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76a004b350 con 0x7f76ac0be5f0 2024-01-21T21:31:35.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:35.470+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f76ac0bf3f0 con 0x7f76ac0be5f0 2024-01-21T21:31:36.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.154+0000 7f76937fe700 1 -- 172.21.15.133:0/2432115079 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v190) v1 ==== 170+0+0 (secure 0 0 0) 0x7f76a004e970 con 0x7f76ac0be5f0 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 msgr2=0x7f7698061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 0x7f7698061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f769c006fd0 tx=0x7f769c017000).stop 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 msgr2=0x7f76ac162500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f76a000d890 tx=0x7f76a0008040).stop 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 shutdown_connections 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ac13b970 0x7f76ac1554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0be5f0 0x7f76ac162500 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f769805f150 0x7f7698061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 --2- 172.21.15.133:0/2432115079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ac0c39f0 0x7f76ac138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 >> 172.21.15.133:0/2432115079 conn(0x7f76ac066a70 msgr2=0x7f76ac0ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.158+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 shutdown_connections 2024-01-21T21:31:36.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.159+0000 7f76b15bc700 1 -- 172.21.15.133:0/2432115079 wait complete. 2024-01-21T21:31:36.165 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T21:31:36.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T21:31:36.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.308+0000 7f2e592dc700 1 Processor -- start 2024-01-21T21:31:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.308+0000 7f2e592dc700 1 -- start start 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e592dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c3840 0x7f2e540c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e592dc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e540c6220 0x7f2e540bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e592dc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e54067f10 con 0x7f2e540c5dc0 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e592dc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e540681f0 con 0x7f2e540c6220 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e592dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540684d0 con 0x7f2e540c3840 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e537fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e540c6220 0x7f2e540bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e52ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c3840 0x7f2e540c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e527fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2e540c5dc0 0x7f2e5413a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:56356/0 (socket says 172.21.15.133:56356) 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e527fc700 1 -- 172.21.15.133:0/3947872263 learned_addr learned my addr 172.21.15.133:0/3947872263 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e537fe700 1 -- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c3840 msgr2=0x7f2e540c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e537fe700 1 --2- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c3840 0x7f2e540c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e537fe700 1 -- 172.21.15.133:0/3947872263 >> v1:172.21.15.178:6789/0 conn(0x7f2e540c5dc0 legacy=0x7f2e5413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3947872263 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722615441 0 0) 0x7f2e54067f10 con 0x7f2e540c5dc0 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.309+0000 7f2e537fe700 1 -- 172.21.15.133:0/3947872263 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540687b0 con 0x7f2e540c6220 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e537fe700 1 --2- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c6220 0x7f2e540bdf60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).ready entity=mon.1 client_cookie=b4b3d2f3c0f09d14 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3947872263 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e070 con 0x7f2e540c6220 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3947872263 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00bb60 con 0x7f2e540c6220 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e51ffb700 1 -- 172.21.15.133:0/3947872263 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c012410 con 0x7f2e540c6220 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 -- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c6220 msgr2=0x7f2e540bdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 --2- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c6220 0x7f2e540bdf60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f2e4c009e60 tx=0x7f2e4c009780).stop 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 -- 172.21.15.133:0/3947872263 shutdown_connections 2024-01-21T21:31:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 --2- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c6220 0x7f2e540bdf60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 --2- 172.21.15.133:0/3947872263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c3840 0x7f2e540c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 -- 172.21.15.133:0/3947872263 >> 172.21.15.133:0/3947872263 conn(0x7f2e54066a70 msgr2=0x7f2e54066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 -- 172.21.15.133:0/3947872263 shutdown_connections 2024-01-21T21:31:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.310+0000 7f2e592dc700 1 -- 172.21.15.133:0/3947872263 wait complete. 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 Processor -- start 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 -- start start 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c3840 0x7f2e54167a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c6220 0x7f2e541312b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54063ab0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541317a0 con 0x7f2e540c3840 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.312+0000 7f2e592dc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e54168050 con 0x7f2e540c6220 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59370/0 (socket says 172.21.15.133:59370) 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 -- 172.21.15.133:0/433117577 learned_addr learned my addr 172.21.15.133:0/433117577 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e52ffd700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c3840 0x7f2e54167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e537fe700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c6220 0x7f2e541312b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 -- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c6220 msgr2=0x7f2e541312b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c6220 0x7f2e541312b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 -- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c3840 msgr2=0x7f2e54167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c3840 0x7f2e54167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 -- 172.21.15.133:0/433117577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009a20 con 0x7f2e540c5dc0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e527fc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f2e4400c4a0 tx=0x7f2e44007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440072e0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44007440 con 0x7f2e540c5dc0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e54168330 con 0x7f2e540c5dc0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440057a0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.313+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e541688f0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.314+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5405fdf0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.315+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2e44005bd0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.315+0000 7f2e3b7fe700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.315+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6705+0+0 (secure 0 0 0) 0x7f2e44079c10 con 0x7f2e540c5dc0 2024-01-21T21:31:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.315+0000 7f2e52ffd700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.315+0000 7f2e52ffd700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 0x7f2e40061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2e541341d0 tx=0x7f2e48008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.319+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e4404ac90 con 0x7f2e540c5dc0 2024-01-21T21:31:36.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.525+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2e54068a90 con 0x7f2e540c5dc0 2024-01-21T21:31:36.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.531+0000 7f2e3b7fe700 1 -- 172.21.15.133:0/433117577 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2e4404e2b0 con 0x7f2e540c5dc0 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 msgr2=0x7f2e40061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 0x7f2e40061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2e541341d0 tx=0x7f2e48008040).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 msgr2=0x7f2e54151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f2e4400c4a0 tx=0x7f2e44007c30).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 shutdown_connections 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e540c6220 0x7f2e541312b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e4005f150 0x7f2e40061610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e540c3840 0x7f2e54167a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 --2- 172.21.15.133:0/433117577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e540c5dc0 0x7f2e54151ed0 secure :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0x7f2e4400c4a0 tx=0x7f2e44007c30).stop 2024-01-21T21:31:36.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.541+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 >> 172.21.15.133:0/433117577 conn(0x7f2e54066a70 msgr2=0x7f2e541550c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.544+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 shutdown_connections 2024-01-21T21:31:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.545+0000 7f2e592dc700 1 -- 172.21.15.133:0/433117577 wait complete. 2024-01-21T21:31:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 23 and data pool 24 2024-01-21T21:31:36.567 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.680+0000 7fd3a0335700 1 Processor -- start 2024-01-21T21:31:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.680+0000 7fd3a0335700 1 -- start start 2024-01-21T21:31:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd3a0335700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3980bcf10 0x7fd3980c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd3a0335700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3980c5ce0 0x7fd3980c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd3a0335700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39814ee20 con 0x7fd39814ea40 2024-01-21T21:31:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd3a0335700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980bed10 con 0x7fd3980bcf10 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd3a0335700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c6620 con 0x7fd3980c5ce0 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd39d8d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3980bcf10 0x7fd3980c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd39d8d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3980bcf10 0x7fd3980c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59382/0 (socket says 172.21.15.133:59382) 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.681+0000 7fd39d8d0700 1 -- 172.21.15.133:0/171695991 learned_addr learned my addr 172.21.15.133:0/171695991 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d8d0700 1 -- 172.21.15.133:0/171695991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3980c5ce0 msgr2=0x7fd3980c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39e8d2700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3980c5ce0 0x7fd3980c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d8d0700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3980c5ce0 0x7fd3980c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d8d0700 1 -- 172.21.15.133:0/171695991 >> v1:172.21.15.178:6789/0 conn(0x7fd39814ea40 legacy=0x7fd3980630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d8d0700 1 -- 172.21.15.133:0/171695991 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980bea30 con 0x7fd3980bcf10 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d8d0700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980bcf10 0x7fd3980c77e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7fd388006fd0 tx=0x7fd3880090f0).ready entity=mon.0 client_cookie=681a8b4bacf6a00 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d0cf700 1 -- 172.21.15.133:0/171695991 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800b600 con 0x7fd3980bcf10 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d0cf700 1 -- 172.21.15.133:0/171695991 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800b760 con 0x7fd3980bcf10 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd39d0cf700 1 -- 172.21.15.133:0/171695991 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bb00 con 0x7fd3980bcf10 2024-01-21T21:31:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd3a0335700 1 -- 172.21.15.133:0/171695991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980bcf10 msgr2=0x7fd3980c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.682+0000 7fd3a0335700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980bcf10 0x7fd3980c77e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 rx=0x7fd388006fd0 tx=0x7fd3880090f0).stop 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 -- 172.21.15.133:0/171695991 shutdown_connections 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3980c5ce0 0x7fd3980c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 --2- 172.21.15.133:0/171695991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980bcf10 0x7fd3980c77e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 -- 172.21.15.133:0/171695991 >> 172.21.15.133:0/171695991 conn(0x7fd3980c7de0 msgr2=0x7fd3980c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 -- 172.21.15.133:0/171695991 shutdown_connections 2024-01-21T21:31:36.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.683+0000 7fd3a0335700 1 -- 172.21.15.133:0/171695991 wait complete. 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.684+0000 7fd3a0335700 1 Processor -- start 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.684+0000 7fd3a0335700 1 -- start start 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.684+0000 7fd3a0335700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3980bcf10 0x7fd398164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 0x7fd3980acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a9640 con 0x7fd3980c5ce0 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a9030 con 0x7fd3980bcf10 2024-01-21T21:31:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c03f0 con 0x7fd39814ea40 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59390/0 (socket says 172.21.15.133:59390) 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 -- 172.21.15.133:0/2336333105 learned_addr learned my addr 172.21.15.133:0/2336333105 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39e0d1700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3980bcf10 0x7fd398164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39e8d2700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 0x7fd3980acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 -- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 msgr2=0x7fd3980acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 0x7fd3980acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 -- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3980bcf10 msgr2=0x7fd398164720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3980bcf10 0x7fd398164720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 -- 172.21.15.133:0/2336333105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009370 con 0x7fd3980c5ce0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39e8d2700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 0x7fd3980acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd39d8d0700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fd388009f50 tx=0x7fd388017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bec0 con 0x7fd3980c5ce0 2024-01-21T21:31:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800b8d0 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3980a92d0 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388024470 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.685+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39814d170 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.686+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39814d390 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.686+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd388021070 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.687+0000 7fd38effd700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 0x7fd37c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.687+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fd38807be40 con 0x7fd3980c5ce0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.687+0000 7fd39e0d1700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 0x7fd37c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.687+0000 7fd39e0d1700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 0x7fd37c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd39400b9b0 tx=0x7fd394008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.691+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd38804ce60 con 0x7fd3980c5ce0 2024-01-21T21:31:36.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.854+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd39814ee20 con 0x7fd3980c5ce0 2024-01-21T21:31:36.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.855+0000 7fd38effd700 1 -- 172.21.15.133:0/2336333105 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18050 (secure 0 0 0) 0x7fd39814ee20 con 0x7fd3980c5ce0 2024-01-21T21:31:36.858 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:36.858 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":191,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:36.526251+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:36.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 msgr2=0x7fd37c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 0x7fd37c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd39400b9b0 tx=0x7fd394008040).stop 2024-01-21T21:31:36.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 msgr2=0x7fd39814cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fd388009f50 tx=0x7fd388017000).stop 2024-01-21T21:31:36.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 shutdown_connections 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd39814ea40 0x7fd3980acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd37c05f150 0x7fd37c061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3980bcf10 0x7fd398164720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 --2- 172.21.15.133:0/2336333105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3980c5ce0 0x7fd39814cc80 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 >> 172.21.15.133:0/2336333105 conn(0x7fd3980c7de0 msgr2=0x7fd3980a5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 shutdown_connections 2024-01-21T21:31:36.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.857+0000 7fd3a0335700 1 -- 172.21.15.133:0/2336333105 wait complete. 2024-01-21T21:31:36.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:36.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.984+0000 7f189c05b700 1 Processor -- start 2024-01-21T21:31:36.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 -- start start 2024-01-21T21:31:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1894154140 0x7f1894158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18940c8120 0x7f18940ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940ab620 con 0x7f1894154520 2024-01-21T21:31:36.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940c6ae0 con 0x7f1894154140 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f189c05b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940c05e0 con 0x7f18940c8120 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.985+0000 7f1899df7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1894154140 0x7f1894158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1894154140 0x7f1894158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59404/0 (socket says 172.21.15.133:59404) 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 -- 172.21.15.133:0/2751346199 learned_addr learned my addr 172.21.15.133:0/2751346199 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f189a5f8700 1 --2- 172.21.15.133:0/2751346199 >> v2:172.21.15.178:3300/0 conn(0x7f18940c8120 0x7f18940ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 -- 172.21.15.133:0/2751346199 >> v2:172.21.15.178:3300/0 conn(0x7f18940c8120 msgr2=0x7f18940ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 --2- 172.21.15.133:0/2751346199 >> v2:172.21.15.178:3300/0 conn(0x7f18940c8120 0x7f18940ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 -- 172.21.15.133:0/2751346199 >> v1:172.21.15.178:6789/0 conn(0x7f1894154520 legacy=0x7f18940c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 -- 172.21.15.133:0/2751346199 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940c0e40 con 0x7f1894154140 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1899df7700 1 --2- 172.21.15.133:0/2751346199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f1894158bb0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f1884006fd0 tx=0x7f18840090f0).ready entity=mon.0 client_cookie=fd32d5bfb416df5b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1898df5700 1 -- 172.21.15.133:0/2751346199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400b580 con 0x7f1894154140 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1898df5700 1 -- 172.21.15.133:0/2751346199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400b6e0 con 0x7f1894154140 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.986+0000 7f1898df5700 1 -- 172.21.15.133:0/2751346199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400ba60 con 0x7f1894154140 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 -- 172.21.15.133:0/2751346199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 msgr2=0x7f1894158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 --2- 172.21.15.133:0/2751346199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f1894158bb0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7f1884006fd0 tx=0x7f18840090f0).stop 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 -- 172.21.15.133:0/2751346199 shutdown_connections 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 --2- 172.21.15.133:0/2751346199 >> v2:172.21.15.178:3300/0 conn(0x7f18940c8120 0x7f18940ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 --2- 172.21.15.133:0/2751346199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f1894158bb0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 -- 172.21.15.133:0/2751346199 >> 172.21.15.133:0/2751346199 conn(0x7f189405e1e0 msgr2=0x7f189405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 -- 172.21.15.133:0/2751346199 shutdown_connections 2024-01-21T21:31:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.987+0000 7f189c05b700 1 -- 172.21.15.133:0/2751346199 wait complete. 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.988+0000 7f189c05b700 1 Processor -- start 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.988+0000 7f189c05b700 1 -- start start 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18940c8120 0x7f189414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894154520 0x7f18940cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18940cb880 con 0x7f1894154140 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894165880 con 0x7f18940c8120 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894164cb0 con 0x7f1894154520 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59416/0 (socket says 172.21.15.133:59416) 2024-01-21T21:31:36.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 -- 172.21.15.133:0/1833556899 learned_addr learned my addr 172.21.15.133:0/1833556899 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f1899df7700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18940c8120 0x7f189414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189a5f8700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894154520 0x7f18940cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 -- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894154520 msgr2=0x7f18940cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894154520 0x7f18940cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 -- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18940c8120 msgr2=0x7f189414cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18940c8120 0x7f189414cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 -- 172.21.15.133:0/1833556899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009370 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f18995f6700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f189000b460 tx=0x7f1890006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000be60 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890012410 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18900127b0 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1894164f50 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.989+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1894165590 con 0x7f1894154140 2024-01-21T21:31:36.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.990+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18940af650 con 0x7f1894154140 2024-01-21T21:31:36.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.991+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f1890012b60 con 0x7f1894154140 2024-01-21T21:31:36.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.991+0000 7f188a7fc700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 0x7f1878061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:36.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.991+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f189007a1e0 con 0x7f1894154140 2024-01-21T21:31:36.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.991+0000 7f1899df7700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 0x7f1878061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:36.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.992+0000 7f1899df7700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 0x7f1878061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1884009130 tx=0x7f1884017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:36.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:36.995+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f189004b200 con 0x7f1894154140 2024-01-21T21:31:37.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.161+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18940c85b0 con 0x7f1894154140 2024-01-21T21:31:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.162+0000 7f188a7fc700 1 -- 172.21.15.133:0/1833556899 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18050 (secure 0 0 0) 0x7f189004e820 con 0x7f1894154140 2024-01-21T21:31:37.165 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:37.165 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":191,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:36.526251+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 msgr2=0x7f1878061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 0x7f1878061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1884009130 tx=0x7f1884017000).stop 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 msgr2=0x7f18940caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f189000b460 tx=0x7f1890006f20).stop 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 shutdown_connections 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894154520 0x7f18940cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f187805f150 0x7f1878061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18940c8120 0x7f189414cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 --2- 172.21.15.133:0/1833556899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1894154140 0x7f18940caea0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 >> 172.21.15.133:0/1833556899 conn(0x7f189405e1e0 msgr2=0x7f18940c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 shutdown_connections 2024-01-21T21:31:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.164+0000 7f189c05b700 1 -- 172.21.15.133:0/1833556899 wait complete. 2024-01-21T21:31:37.179 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T21:31:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.295+0000 7ff61090a700 1 Processor -- start 2024-01-21T21:31:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.295+0000 7ff61090a700 1 -- start start 2024-01-21T21:31:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff61090a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c066460 0x7ff60c0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff61090a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff60c1521e0 0x7ff60c152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff61090a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c065fd0 con 0x7ff60c0acbc0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff61090a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c063be0 con 0x7ff60c1521e0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff61090a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0653c0 con 0x7ff60c066460 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff60ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff60c1521e0 0x7ff60c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.296+0000 7ff60ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff60c1521e0 0x7ff60c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59418/0 (socket says 172.21.15.133:59418) 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 -- 172.21.15.133:0/284336774 learned_addr learned my addr 172.21.15.133:0/284336774 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff609d9b700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c066460 0x7ff60c0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 -- 172.21.15.133:0/284336774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c066460 msgr2=0x7ff60c0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c066460 0x7ff60c0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 -- 172.21.15.133:0/284336774 >> v1:172.21.15.178:6789/0 conn(0x7ff60c0acbc0 legacy=0x7ff60c0634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 -- 172.21.15.133:0/284336774 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0656a0 con 0x7ff60c1521e0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60ad9d700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c1521e0 0x7ff60c152610 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7ff604009f20 tx=0x7ff604009840).ready entity=mon.0 client_cookie=b39ef144c16ad262 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60959a700 1 -- 172.21.15.133:0/284336774 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400e070 con 0x7ff60c1521e0 2024-01-21T21:31:37.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60959a700 1 -- 172.21.15.133:0/284336774 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400ba80 con 0x7ff60c1521e0 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.297+0000 7ff60959a700 1 -- 172.21.15.133:0/284336774 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400be00 con 0x7ff60c1521e0 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 -- 172.21.15.133:0/284336774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c1521e0 msgr2=0x7ff60c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c1521e0 0x7ff60c152610 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7ff604009f20 tx=0x7ff604009840).stop 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 -- 172.21.15.133:0/284336774 shutdown_connections 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c1521e0 0x7ff60c152610 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 --2- 172.21.15.133:0/284336774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c066460 0x7ff60c0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 -- 172.21.15.133:0/284336774 >> 172.21.15.133:0/284336774 conn(0x7ff60c0c8200 msgr2=0x7ff60c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 -- 172.21.15.133:0/284336774 shutdown_connections 2024-01-21T21:31:37.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.298+0000 7ff61090a700 1 -- 172.21.15.133:0/284336774 wait complete. 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.299+0000 7ff61090a700 1 Processor -- start 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.299+0000 7ff61090a700 1 -- start start 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff60c066460 0x7ff60c151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c1521e0 0x7ff60c069a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c069f00 con 0x7ff60c0acbc0 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1638f0 con 0x7ff60c066460 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff61090a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c156fc0 con 0x7ff60c1521e0 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59426/0 (socket says 172.21.15.133:59426) 2024-01-21T21:31:37.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 -- 172.21.15.133:0/2617687439 learned_addr learned my addr 172.21.15.133:0/2617687439 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff60ad9d700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c1521e0 0x7ff60c069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff60a59c700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff60c066460 0x7ff60c151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 -- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c1521e0 msgr2=0x7ff60c069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c1521e0 0x7ff60c069a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 -- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff60c066460 msgr2=0x7ff60c151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff60c066460 0x7ff60c151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 -- 172.21.15.133:0/2617687439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009ae0 con 0x7ff60c0acbc0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff609d9b700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7ff5fc00d890 tx=0x7ff5fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.300+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00f520 con 0x7ff60c0acbc0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.301+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00f680 con 0x7ff60c0acbc0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.301+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c1572a0 con 0x7ff60c0acbc0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.301+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00fa00 con 0x7ff60c0acbc0 2024-01-21T21:31:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.301+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c163580 con 0x7ff60c0acbc0 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.302+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c163a80 con 0x7ff60c0acbc0 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.302+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff5fc013480 con 0x7ff60c0acbc0 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.302+0000 7ff5faffd700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 0x7ff5ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.302+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff5fc07a060 con 0x7ff60c0acbc0 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.302+0000 7ff60a59c700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 0x7ff5ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.303+0000 7ff60a59c700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 0x7ff5ec061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff60c165840 tx=0x7ff600009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.306+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff5fc04b020 con 0x7ff60c0acbc0 2024-01-21T21:31:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.513+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff60c065980 con 0x7ff60c0acbc0 2024-01-21T21:31:37.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.537+0000 7ff5faffd700 1 -- 172.21.15.133:0/2617687439 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff5fc04e640 con 0x7ff60c0acbc0 2024-01-21T21:31:37.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.539+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 msgr2=0x7ff5ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.539+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 0x7ff5ec061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff60c165840 tx=0x7ff600009040).stop 2024-01-21T21:31:37.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.539+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 msgr2=0x7ff60c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.539+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7ff5fc00d890 tx=0x7ff5fc008040).stop 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 shutdown_connections 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff60c1521e0 0x7ff60c069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff5ec05f150 0x7ff5ec061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff60c066460 0x7ff60c151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 --2- 172.21.15.133:0/2617687439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c0acbc0 0x7ff60c069520 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 >> 172.21.15.133:0/2617687439 conn(0x7ff60c0c8200 msgr2=0x7ff60c0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 shutdown_connections 2024-01-21T21:31:37.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.540+0000 7ff61090a700 1 -- 172.21.15.133:0/2617687439 wait complete. 2024-01-21T21:31:37.554 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T21:31:37.554 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T21:31:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.670+0000 7f319db83700 1 Processor -- start 2024-01-21T21:31:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.670+0000 7f319db83700 1 -- start start 2024-01-21T21:31:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f319db83700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3198062ff0 0x7f3198065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f319db83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f319db83700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3198069ef0 con 0x7f3198062c10 2024-01-21T21:31:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f319db83700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3198065fe0 con 0x7f3198062ff0 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f319db83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319806a130 con 0x7f3198065b50 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3198062ff0 0x7f3198065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3198062ff0 0x7f3198065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59428/0 (socket says 172.21.15.133:59428) 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 -- 172.21.15.133:0/1919586274 learned_addr learned my addr 172.21.15.133:0/1919586274 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f31977fe700 1 --1- 172.21.15.133:0/1919586274 >> v1:172.21.15.133:6789/0 conn(0x7f3198062c10 0x7f31980697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47088/0 (socket says 172.21.15.133:47088) 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3197fff700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 -- 172.21.15.133:0/1919586274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 msgr2=0x7f31980bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 -- 172.21.15.133:0/1919586274 >> v1:172.21.15.133:6789/0 conn(0x7f3198062c10 legacy=0x7f31980697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f31967fc700 1 -- 172.21.15.133:0/1919586274 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487766151 0 0) 0x7f318c001110 con 0x7f3198062c10 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.671+0000 7f3196ffd700 1 -- 172.21.15.133:0/1919586274 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319806a410 con 0x7f3198062ff0 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f3196ffd700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f3198065660 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f3188006fd0 tx=0x7f31880090f0).ready entity=mon.0 client_cookie=5f304b783a95e292 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f31967fc700 1 -- 172.21.15.133:0/1919586274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800b580 con 0x7f3198062ff0 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f31967fc700 1 -- 172.21.15.133:0/1919586274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800b6e0 con 0x7f3198062ff0 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f31967fc700 1 -- 172.21.15.133:0/1919586274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800ba80 con 0x7f3198062ff0 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 -- 172.21.15.133:0/1919586274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 msgr2=0x7f3198065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f3198065660 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f3188006fd0 tx=0x7f31880090f0).stop 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 -- 172.21.15.133:0/1919586274 shutdown_connections 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 --2- 172.21.15.133:0/1919586274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f3198065660 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 -- 172.21.15.133:0/1919586274 >> 172.21.15.133:0/1919586274 conn(0x7f31980c8010 msgr2=0x7f31980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 -- 172.21.15.133:0/1919586274 shutdown_connections 2024-01-21T21:31:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.672+0000 7f319db83700 1 -- 172.21.15.133:0/1919586274 wait complete. 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.674+0000 7f319db83700 1 Processor -- start 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.674+0000 7f319db83700 1 -- start start 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.674+0000 7f319db83700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3198062c10 0x7f319813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.674+0000 7f319db83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980abc70 con 0x7f3198062ff0 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c45b0 con 0x7f3198062c10 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980ab060 con 0x7f3198065b50 2024-01-21T21:31:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59444/0 (socket says 172.21.15.133:59444) 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 -- 172.21.15.133:0/3153491313 learned_addr learned my addr 172.21.15.133:0/3153491313 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3197fff700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f31977fe700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3198062c10 0x7f319813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 -- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 msgr2=0x7f31980c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 -- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3198062c10 msgr2=0x7f319813b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3198062c10 0x7f319813b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 -- 172.21.15.133:0/3153491313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009370 con 0x7f3198062ff0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f3196ffd700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f31980692f0 tx=0x7f3188017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188006930 con 0x7f3198062ff0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800be40 con 0x7f3198062ff0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31980ab340 con 0x7f3198062ff0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318801c420 con 0x7f3198062ff0 2024-01-21T21:31:37.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.675+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31980ab900 con 0x7f3198062ff0 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.676+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31980abde0 con 0x7f3198062ff0 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.677+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f318801c810 con 0x7f3198062ff0 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.677+0000 7f317ffff700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 0x7f3184061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.677+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f318807bf50 con 0x7f3198062ff0 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.677+0000 7f31977fe700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 0x7f3184061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:37.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.677+0000 7f31977fe700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 0x7f3184061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f318c007750 tx=0x7f318c007c90).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:37.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.681+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f318804cf70 con 0x7f3198062ff0 2024-01-21T21:31:37.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:37.889+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f319806a6f0 con 0x7f3198062ff0 2024-01-21T21:31:38.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:31:38.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.538+0000 7f317ffff700 1 -- 172.21.15.133:0/3153491313 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) v1 ==== 122+0+0 (secure 0 0 0) 0x7f318802a030 con 0x7f3198062ff0 2024-01-21T21:31:38.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 msgr2=0x7f3184061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 0x7f3184061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f318c007750 tx=0x7f318c007c90).stop 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 msgr2=0x7f319813a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f31980692f0 tx=0x7f3188017000).stop 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 shutdown_connections 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3198065b50 0x7f31980c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f318405f150 0x7f3184061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3198062c10 0x7f319813b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 --2- 172.21.15.133:0/3153491313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3198062ff0 0x7f319813a770 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.540+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 >> 172.21.15.133:0/3153491313 conn(0x7f31980c8010 msgr2=0x7f31980a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.541+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 shutdown_connections 2024-01-21T21:31:38.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.541+0000 7f319db83700 1 -- 172.21.15.133:0/3153491313 wait complete. 2024-01-21T21:31:38.557 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T21:31:38.557 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.753+0000 7fcc0212c700 1 Processor -- start 2024-01-21T21:31:38.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.753+0000 7fcc0212c700 1 -- start start 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcc0212c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbfc13a620 0x7fcbfc0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcc0212c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbfc13aa00 0x7fcbfc158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcc0212c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc1584f0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcc0212c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc0bd6f0 con 0x7fcbfc13aa00 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcc0212c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc0654e0 con 0x7fcbfc13a620 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbfc13aa00 0x7fcbfc158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbfc13aa00 0x7fcbfc158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59448/0 (socket says 172.21.15.133:59448) 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 -- 172.21.15.133:0/1623220459 learned_addr learned my addr 172.21.15.133:0/1623220459 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 -- 172.21.15.133:0/1623220459 >> v2:172.21.15.178:3300/0 conn(0x7fcbfc13a620 msgr2=0x7fcbfc0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 --2- 172.21.15.133:0/1623220459 >> v2:172.21.15.178:3300/0 conn(0x7fcbfc13a620 0x7fcbfc0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 -- 172.21.15.133:0/1623220459 >> v1:172.21.15.178:6789/0 conn(0x7fcbfc0626f0 legacy=0x7fcbfc0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:38.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 -- 172.21.15.133:0/1623220459 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc158730 con 0x7fcbfc13aa00 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfaffd700 1 --2- 172.21.15.133:0/1623220459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc158000 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7fcbfc068f20 tx=0x7fcbf00090f0).ready entity=mon.0 client_cookie=92ac78f6a7c37cbf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfa7fc700 1 -- 172.21.15.133:0/1623220459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000b5a0 con 0x7fcbfc13aa00 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfa7fc700 1 -- 172.21.15.133:0/1623220459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000b700 con 0x7fcbfc13aa00 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.754+0000 7fcbfa7fc700 1 -- 172.21.15.133:0/1623220459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000baa0 con 0x7fcbfc13aa00 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 -- 172.21.15.133:0/1623220459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc13aa00 msgr2=0x7fcbfc158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 --2- 172.21.15.133:0/1623220459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc158000 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7fcbfc068f20 tx=0x7fcbf00090f0).stop 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 -- 172.21.15.133:0/1623220459 shutdown_connections 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 --2- 172.21.15.133:0/1623220459 >> v2:172.21.15.178:3300/0 conn(0x7fcbfc13a620 0x7fcbfc0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 --2- 172.21.15.133:0/1623220459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc158000 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 -- 172.21.15.133:0/1623220459 >> 172.21.15.133:0/1623220459 conn(0x7fcbfc0c7dc0 msgr2=0x7fcbfc0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 -- 172.21.15.133:0/1623220459 shutdown_connections 2024-01-21T21:31:38.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.755+0000 7fcc0212c700 1 -- 172.21.15.133:0/1623220459 wait complete. 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.756+0000 7fcc0212c700 1 Processor -- start 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.756+0000 7fcc0212c700 1 -- start start 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc13a620 0x7fcbfc165260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0abf60 con 0x7fcbfc0626f0 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc165750 con 0x7fcbfc13aa00 2024-01-21T21:31:38.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcc0212c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0ab350 con 0x7fcbfc13a620 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59462/0 (socket says 172.21.15.133:59462) 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 -- 172.21.15.133:0/2492497096 learned_addr learned my addr 172.21.15.133:0/2492497096 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfbfff700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 -- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc13a620 msgr2=0x7fcbfc165260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc13a620 0x7fcbfc165260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 -- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc13aa00 msgr2=0x7fcbfc155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 -- 172.21.15.133:0/2492497096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009370 con 0x7fcbfc0626f0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.757+0000 7fcbfb7fe700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7fcbec00b560 tx=0x7fcbec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.758+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00d4a0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.758+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec00d620 con 0x7fcbfc0626f0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.758+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc0ab630 con 0x7fcbfc0626f0 2024-01-21T21:31:38.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.758+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00d9e0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.758+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc0abbf0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.759+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc05fdf0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.759+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcbec012410 con 0x7fcbfc0626f0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.759+0000 7fcbe3fff700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 0x7fcbe8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.759+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fcbec07a2d0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.759+0000 7fcbfaffd700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 0x7fcbe8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:38.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.760+0000 7fcbfaffd700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 0x7fcbe8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcbfc0aa780 tx=0x7fcbf0015000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:38.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.763+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcbec04b290 con 0x7fcbfc0626f0 2024-01-21T21:31:38.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.969+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbfc06a6a0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.969+0000 7fcbe3fff700 1 -- 172.21.15.133:0/2492497096 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fcbec04e8b0 con 0x7fcbfc0626f0 2024-01-21T21:31:38.972 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:38.972 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:31:38.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 msgr2=0x7fcbe8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 0x7fcbe8061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcbfc0aa780 tx=0x7fcbf0015000).stop 2024-01-21T21:31:38.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 msgr2=0x7fcbfc0aad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:38.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7fcbec00b560 tx=0x7fcbec0090f0).stop 2024-01-21T21:31:38.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 shutdown_connections 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcbe805f150 0x7fcbe8061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc13aa00 0x7fcbfc155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbfc0626f0 0x7fcbfc0aad70 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 --2- 172.21.15.133:0/2492497096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc13a620 0x7fcbfc165260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 >> 172.21.15.133:0/2492497096 conn(0x7fcbfc0c7dc0 msgr2=0x7fcbfc0c2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 shutdown_connections 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:38.971+0000 7fcc0212c700 1 -- 172.21.15.133:0/2492497096 wait complete. 2024-01-21T21:31:38.975 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:31:38.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:31:39.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.099+0000 7fc99a543700 1 Processor -- start 2024-01-21T21:31:39.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.099+0000 7fc99a543700 1 -- start start 2024-01-21T21:31:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc99a543700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc9940a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc99a543700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9940654f0 con 0x7fc9941546b0 2024-01-21T21:31:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc99a543700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc994063700 con 0x7fc9940bc6d0 2024-01-21T21:31:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc99a543700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc994063950 con 0x7fc994154a90 2024-01-21T21:31:39.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc993fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc9941546b0 0x7fc994065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47092/0 (socket says 172.21.15.133:47092) 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc993fff700 1 -- 172.21.15.133:0/2158822481 learned_addr learned my addr 172.21.15.133:0/2158822481 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.100+0000 7fc9937fe700 1 --2- 172.21.15.133:0/2158822481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc9940a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121800613 0 0) 0x7fc9940654f0 con 0x7fc9941546b0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc97c0033f0 con 0x7fc9941546b0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704994439 0 0) 0x7fc994063700 con 0x7fc9940bc6d0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9940654f0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1239850402 0 0) 0x7fc97c0033f0 con 0x7fc9941546b0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc9937fe700 1 -- 172.21.15.133:0/2158822481 >> v1:172.21.15.178:6789/0 conn(0x7fc9940bc6d0 legacy=0x7fc994066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc9937fe700 1 -- 172.21.15.133:0/2158822481 >> v1:172.21.15.133:6789/0 conn(0x7fc9941546b0 legacy=0x7fc994065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc9937fe700 1 -- 172.21.15.133:0/2158822481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc994065180 con 0x7fc994154a90 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc9937fe700 1 --2- 172.21.15.133:0/2158822481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc9940a9e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fc988009790 tx=0x7fc988009060).ready entity=mon.2 client_cookie=c74d991cd1cb34a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984001470 con 0x7fc994154a90 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9880090d0 con 0x7fc994154a90 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.101+0000 7fc992ffd700 1 -- 172.21.15.133:0/2158822481 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011610 con 0x7fc994154a90 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 -- 172.21.15.133:0/2158822481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 msgr2=0x7fc9940a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 --2- 172.21.15.133:0/2158822481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc9940a9e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fc988009790 tx=0x7fc988009060).stop 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 -- 172.21.15.133:0/2158822481 shutdown_connections 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 --2- 172.21.15.133:0/2158822481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc9940a9e30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 -- 172.21.15.133:0/2158822481 >> 172.21.15.133:0/2158822481 conn(0x7fc9940c8200 msgr2=0x7fc9940c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 -- 172.21.15.133:0/2158822481 shutdown_connections 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.102+0000 7fc99a543700 1 -- 172.21.15.133:0/2158822481 wait complete. 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.103+0000 7fc99a543700 1 Processor -- start 2024-01-21T21:31:39.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.103+0000 7fc99a543700 1 -- start start 2024-01-21T21:31:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9941546b0 0x7fc9940aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc994147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994157340 con 0x7fc9940bc6d0 2024-01-21T21:31:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940aac10 con 0x7fc9941546b0 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc99a543700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940aae70 con 0x7fc994154a90 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59476/0 (socket says 172.21.15.133:59476) 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 -- 172.21.15.133:0/148287513 learned_addr learned my addr 172.21.15.133:0/148287513 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc9937fe700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9941546b0 0x7fc9940aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc998ae0700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc994147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 -- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 msgr2=0x7fc994147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc994147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 -- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9941546b0 msgr2=0x7fc9940aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9941546b0 0x7fc9940aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 -- 172.21.15.133:0/148287513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880092a0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc998ae0700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc994147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.104+0000 7fc993fff700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fc98400c5f0 tx=0x7fc984001980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.105+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984007170 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.105+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840072f0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.105+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840048c0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.105+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9940ab150 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.105+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc994148850 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.106+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99405fdf0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.106+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc984004c70 con 0x7fc9940bc6d0 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.106+0000 7fc990ff9700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 0x7fc980061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.106+0000 7fc9937fe700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 0x7fc980061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.107+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fc984079e30 con 0x7fc9940bc6d0 2024-01-21T21:31:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.107+0000 7fc9937fe700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 0x7fc980061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc988009790 tx=0x7fc988016000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.111+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc98404adf0 con 0x7fc9940bc6d0 2024-01-21T21:31:39.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.274+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc99405e390 con 0x7fc9940bc6d0 2024-01-21T21:31:39.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.275+0000 7fc990ff9700 1 -- 172.21.15.133:0/148287513 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18037 (secure 0 0 0) 0x7fc98404e410 con 0x7fc9940bc6d0 2024-01-21T21:31:39.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:39.278 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":192,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:37.528341+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:31:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 msgr2=0x7fc980061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 0x7fc980061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc988009790 tx=0x7fc988016000).stop 2024-01-21T21:31:39.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 msgr2=0x7fc994156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fc98400c5f0 tx=0x7fc984001980).stop 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 shutdown_connections 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc994154a90 0x7fc994147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9940bc6d0 0x7fc994156e50 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc98005f150 0x7fc980061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 --2- 172.21.15.133:0/148287513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9941546b0 0x7fc9940aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 >> 172.21.15.133:0/148287513 conn(0x7fc9940c8200 msgr2=0x7fc9940697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 shutdown_connections 2024-01-21T21:31:39.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.277+0000 7fc99a543700 1 -- 172.21.15.133:0/148287513 wait complete. 2024-01-21T21:31:39.291 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T21:31:39.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:31:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.404+0000 7fe5a468b700 1 Processor -- start 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.404+0000 7fe5a468b700 1 -- start start 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a468b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 0x7fe59c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a468b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a468b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0a50f0 con 0x7fe59c0bd180 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a468b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0630d0 con 0x7fe59c1558c0 2024-01-21T21:31:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a468b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0a4da0 con 0x7fe59c155ca0 2024-01-21T21:31:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a1c26700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a2427700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 0x7fe59c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a1c26700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:39788/0 (socket says 172.21.15.133:39788) 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a1c26700 1 -- 172.21.15.133:0/581296708 learned_addr learned my addr 172.21.15.133:0/581296708 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.405+0000 7fe5a2c28700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe59c0bd180 0x7fe59c0bd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:56412/0 (socket says 172.21.15.133:56412) 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1c26700 1 -- 172.21.15.133:0/581296708 >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 msgr2=0x7fe59c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1c26700 1 --2- 172.21.15.133:0/581296708 >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 0x7fe59c0626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1c26700 1 -- 172.21.15.133:0/581296708 >> v1:172.21.15.178:6789/0 conn(0x7fe59c0bd180 legacy=0x7fe59c0bd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1c26700 1 -- 172.21.15.133:0/581296708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0bde00 con 0x7fe59c155ca0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a2427700 1 --2- 172.21.15.133:0/581296708 >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 0x7fe59c0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1c26700 1 --2- 172.21.15.133:0/581296708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fe58c006fd0 tx=0x7fe58c0090f0).ready entity=mon.2 client_cookie=da2d4b53bea73291 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1425700 1 -- 172.21.15.133:0/581296708 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00b580 con 0x7fe59c155ca0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1425700 1 -- 172.21.15.133:0/581296708 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00b6e0 con 0x7fe59c155ca0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a1425700 1 -- 172.21.15.133:0/581296708 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00ba80 con 0x7fe59c155ca0 2024-01-21T21:31:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 -- 172.21.15.133:0/581296708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 msgr2=0x7fe59c062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 --2- 172.21.15.133:0/581296708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fe58c006fd0 tx=0x7fe58c0090f0).stop 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 -- 172.21.15.133:0/581296708 shutdown_connections 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 --2- 172.21.15.133:0/581296708 >> v2:172.21.15.178:3300/0 conn(0x7fe59c1558c0 0x7fe59c0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 --2- 172.21.15.133:0/581296708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c062be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.406+0000 7fe5a468b700 1 -- 172.21.15.133:0/581296708 >> 172.21.15.133:0/581296708 conn(0x7fe59c0c8010 msgr2=0x7fe59c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.407+0000 7fe5a468b700 1 -- 172.21.15.133:0/581296708 shutdown_connections 2024-01-21T21:31:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.407+0000 7fe5a468b700 1 -- 172.21.15.133:0/581296708 wait complete. 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 Processor -- start 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 -- start start 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 0x7fe59c14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c0a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0c1580 con 0x7fe59c1558c0 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0c1a10 con 0x7fe59c0bd180 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.408+0000 7fe5a468b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0c0970 con 0x7fe59c155ca0 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59480/0 (socket says 172.21.15.133:59480) 2024-01-21T21:31:39.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 -- 172.21.15.133:0/1730056254 learned_addr learned my addr 172.21.15.133:0/1730056254 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a2427700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 0x7fe59c14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a2c28700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c0a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 -- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 msgr2=0x7fe59c0a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c0a9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 -- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 msgr2=0x7fe59c14f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 0x7fe59c14f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 -- 172.21.15.133:0/1730056254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980092a0 con 0x7fe59c1558c0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a2427700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 0x7fe59c14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a1c26700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fe58c009ea0 tx=0x7fe58c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c00be40 con 0x7fe59c1558c0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00b850 con 0x7fe59c1558c0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c009370 con 0x7fe59c1558c0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58c01d680 con 0x7fe59c1558c0 2024-01-21T21:31:39.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.409+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c0c0f30 con 0x7fe59c1558c0 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.410+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c0c16f0 con 0x7fe59c1558c0 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.410+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe58c01dab0 con 0x7fe59c1558c0 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.411+0000 7fe592ffd700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 0x7fe580061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.411+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fe58c07c220 con 0x7fe59c1558c0 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.411+0000 7fe5a2427700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 0x7fe580061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.411+0000 7fe5a2427700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 0x7fe580061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe598009270 tx=0x7fe598008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.415+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe58c04d240 con 0x7fe59c1558c0 2024-01-21T21:31:39.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.576+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe59c065210 con 0x7fe58005f150 2024-01-21T21:31:39.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.586+0000 7fe592ffd700 1 -- 172.21.15.133:0/1730056254 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353297 (secure 0 0 0) 0x7fe59c065210 con 0x7fe58005f150 2024-01-21T21:31:39.595 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 msgr2=0x7fe580061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 0x7fe580061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe598009270 tx=0x7fe598008040).stop 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 msgr2=0x7fe59c0ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fe58c009ea0 tx=0x7fe58c017000).stop 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 shutdown_connections 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe59c155ca0 0x7fe59c0a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe58005f150 0x7fe580061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe59c0bd180 0x7fe59c14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 --2- 172.21.15.133:0/1730056254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe59c1558c0 0x7fe59c0ac960 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 >> 172.21.15.133:0/1730056254 conn(0x7fe59c0c8010 msgr2=0x7fe59c1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 shutdown_connections 2024-01-21T21:31:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.589+0000 7fe5a468b700 1 -- 172.21.15.133:0/1730056254 wait complete. 2024-01-21T21:31:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:31:39.604 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:31:38.665835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460724,"kb_used_data":18420,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752513996,"statfs":{"total":773094113280,"available":770574331904,"internally_reserved":0,"allocated":18862080,"data_stored":10153187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600805,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-207,"num_write_kb":-726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.455733"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154392+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157098+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152339+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151492+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156385+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154681+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155114+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157415+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156660+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156609+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156877+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156603+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151990+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152755+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154720+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156288+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154320+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157447+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155048+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154300+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156093+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.158395+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156074+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151871+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153455+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151849+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151096+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151500+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155508+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155249+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154684+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155378+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153037+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151107+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154111+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150628+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153017+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153691+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151016+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150648+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154190+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150731+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153087+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151083+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153255+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154325+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153793+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155079+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154683+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153708+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155216+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155062+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151925+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152950+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151067+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546153+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:31:33.546153+0000","last_peered":"2024-01-21T21:31:33.546153+0000","last_clean":"2024-01-21T21:31:33.546153+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:31:33.546153+0000","last_undegraded":"2024-01-21T21:31:33.546153+0000","last_fullsized":"2024-01-21T21:31:33.546153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154788+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145304+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:31:33.145304+0000","last_peered":"2024-01-21T21:31:33.145304+0000","last_clean":"2024-01-21T21:31:33.145304+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:31:33.145304+0000","last_undegraded":"2024-01-21T21:31:33.145304+0000","last_fullsized":"2024-01-21T21:31:33.145304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154780+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546167+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:31:33.546167+0000","last_peered":"2024-01-21T21:31:33.546167+0000","last_clean":"2024-01-21T21:31:33.546167+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:31:33.546167+0000","last_undegraded":"2024-01-21T21:31:33.546167+0000","last_fullsized":"2024-01-21T21:31:33.546167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156830+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145312+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:31:33.145312+0000","last_peered":"2024-01-21T21:31:33.145312+0000","last_clean":"2024-01-21T21:31:33.145312+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:31:33.145312+0000","last_undegraded":"2024-01-21T21:31:33.145312+0000","last_fullsized":"2024-01-21T21:31:33.145312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546395+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:31:33.546395+0000","last_peered":"2024-01-21T21:31:33.546395+0000","last_clean":"2024-01-21T21:31:33.546395+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:31:33.546395+0000","last_undegraded":"2024-01-21T21:31:33.546395+0000","last_fullsized":"2024-01-21T21:31:33.546395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155293+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546414+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:31:33.546414+0000","last_peered":"2024-01-21T21:31:33.546414+0000","last_clean":"2024-01-21T21:31:33.546414+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:31:33.546414+0000","last_undegraded":"2024-01-21T21:31:33.546414+0000","last_fullsized":"2024-01-21T21:31:33.546414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150583+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546417+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:31:33.546417+0000","last_peered":"2024-01-21T21:31:33.546417+0000","last_clean":"2024-01-21T21:31:33.546417+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:31:33.546417+0000","last_undegraded":"2024-01-21T21:31:33.546417+0000","last_fullsized":"2024-01-21T21:31:33.546417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153558+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546241+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:31:33.546241+0000","last_peered":"2024-01-21T21:31:33.546241+0000","last_clean":"2024-01-21T21:31:33.546241+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:31:33.546241+0000","last_undegraded":"2024-01-21T21:31:33.546241+0000","last_fullsized":"2024-01-21T21:31:33.546241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155704+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546354+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:31:33.546354+0000","last_peered":"2024-01-21T21:31:33.546354+0000","last_clean":"2024-01-21T21:31:33.546354+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:31:33.546354+0000","last_undegraded":"2024-01-21T21:31:33.546354+0000","last_fullsized":"2024-01-21T21:31:33.546354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2359296,"data_stored":1271017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.84199999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.58799999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.495,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72699999999999998,"5min":0.75,"15min":0.91700000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.80200000000000005,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.84399999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82199999999999995},"last":0.36799999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060148,"statfs":{"total":96636764160,"available":96317591552,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.29599999999999999,"15min":0.29199999999999998},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.53900000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.374,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.83799999999999997},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.38},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.75900000000000001,"15min":0.81499999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.39400000000000002},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.48499999999999999,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.75,"5min":0.75,"15min":0.78500000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.98199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66200000000000003},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.70099999999999996},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.318}]},{"osd":3,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.55400000000000005,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.93100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.45100000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.036},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.56599999999999995,"5min":0.45900000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.97799999999999998},"last":0.441}]},{"osd":7,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.878,"5min":0.98499999999999999,"15min":1.159},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575951,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2347008,"data_stored":1264112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.622},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.443,"15min":0.441},"min":{"1min":0.315,"5min":0.251,"15min":0.251},"max":{"1min":0.57999999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.39200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36099999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.439},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66800000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.621,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33300000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.434},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.503,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.442},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":0.98199999999999998,"5min":1.022,"15min":1.022},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.45300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.503}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.0189999999999999,"5min":1.04,"15min":1.04},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60299999999999998,"15min":0.65800000000000003},"last":0.32800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.53300000000000003,"5min":0.61099999999999999,"15min":0.69199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.27500000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.315},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32900000000000001,"15min":0.315},"max":{"1min":0.61099999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.378}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90800000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.35599999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.439},"max":{"1min":0.86399999999999999,"5min":0.97099999999999997,"15min":1.2410000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":1.1819999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.94099999999999995,"15min":0.98299999999999998},"last":0.59599999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307584,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064256,"statfs":{"total":96636764160,"available":96321798144,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.441},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.63300000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.58599999999999997,"5min":0.72099999999999997,"15min":0.73099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68200000000000005},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.69099999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96699999999999997,"5min":1.004,"15min":1.004},"last":0.436},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.92900000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40799999999999997},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.995,"15min":0.995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.97199999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.22900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.88200000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.85299999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.54600000000000004,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.53000000000000003,"5min":0.39300000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.84299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.38},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.745},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.77100000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.65400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.495}]},{"osd":7,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311680,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060160,"statfs":{"total":96636764160,"available":96317603840,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.93500000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.71099999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.496,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.91100000000000003},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.874},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.95899999999999996},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.82799999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":0.80900000000000005,"15min":0.85999999999999999},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:31:39.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:31:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.758+0000 7f896faf9700 1 Processor -- start 2024-01-21T21:31:39.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.758+0000 7f896faf9700 1 -- start start 2024-01-21T21:31:39.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896faf9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89680aa0f0 0x7f89680ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896faf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f8968063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896faf9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8968063750 con 0x7f89680a9d10 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896faf9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89680640d0 con 0x7f89680aa0f0 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896faf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896805e380 con 0x7f89681558d0 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.759+0000 7f896d895700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f89680a9d10 0x7f89681551c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47102/0 (socket says 172.21.15.133:47102) 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896d895700 1 -- 172.21.15.133:0/284203044 learned_addr learned my addr 172.21.15.133:0/284203044 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896d094700 1 --2- 172.21.15.133:0/284203044 >> v2:172.21.15.178:3300/0 conn(0x7f89680aa0f0 0x7f89680ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896e096700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f8968063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998446401 0 0) 0x7f8968063750 con 0x7f89680a9d10 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89540033f0 con 0x7f89680a9d10 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3149886486 0 0) 0x7f89540033f0 con 0x7f89680a9d10 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 msgr2=0x7f8968063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f8968063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 >> v2:172.21.15.178:3300/0 conn(0x7f89680aa0f0 msgr2=0x7f89680ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 --2- 172.21.15.133:0/284203044 >> v2:172.21.15.178:3300/0 conn(0x7f89680aa0f0 0x7f89680ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896805e660 con 0x7f89680a9d10 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f8958001470 con 0x7f89680a9d10 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 >> v1:172.21.15.133:6789/0 conn(0x7f89680a9d10 legacy=0x7f89681551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f89540038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8954003e10 0x7f8954004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680640d0 con 0x7f8954003e10 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896805e380 con 0x7f8954004b80 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895400b8e0 con 0x7f89681558d0 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896d094700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8954003e10 0x7f8954004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896d895700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f89540038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896e096700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.760+0000 7f896d094700 1 -- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 msgr2=0x7f89540038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896d094700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89681558d0 0x7f89540038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896d094700 1 -- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8954004b80 msgr2=0x7f8954005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:39.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896d094700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896d094700 1 -- 172.21.15.133:0/284203044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540033f0 con 0x7f8954003e10 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896e096700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8954004b80 0x7f8954005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896d094700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8954003e10 0x7f8954004690 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f8964009ab0 tx=0x7f8964009060).ready entity=mon.0 client_cookie=7d0a8fe90cb3de81 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964009430 con 0x7f8954003e10 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896400e640 con 0x7f8954003e10 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896c893700 1 -- 172.21.15.133:0/284203044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400e9c0 con 0x7f8954003e10 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 -- 172.21.15.133:0/284203044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8954003e10 msgr2=0x7f8954004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 --2- 172.21.15.133:0/284203044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8954003e10 0x7f8954004690 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f8964009ab0 tx=0x7f8964009060).stop 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896e096700 1 -- 172.21.15.133:0/284203044 reap_dead start 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 -- 172.21.15.133:0/284203044 shutdown_connections 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 -- 172.21.15.133:0/284203044 >> 172.21.15.133:0/284203044 conn(0x7f89680c8200 msgr2=0x7f89680c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 -- 172.21.15.133:0/284203044 shutdown_connections 2024-01-21T21:31:39.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.761+0000 7f896faf9700 1 -- 172.21.15.133:0/284203044 wait complete. 2024-01-21T21:31:39.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 Processor -- start 2024-01-21T21:31:39.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 -- start start 2024-01-21T21:31:39.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8954003e10 0x7f896814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 0x7f89680aa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8968163160 con 0x7f89680aac10 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89680ab090 con 0x7f896814b750 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.763+0000 7f896faf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8968162880 con 0x7f8954003e10 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59492/0 (socket says 172.21.15.133:59492) 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 -- 172.21.15.133:0/1830520640 learned_addr learned my addr 172.21.15.133:0/1830520640 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896d094700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 0x7f89680aa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896d895700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8954003e10 0x7f896814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 -- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8954003e10 msgr2=0x7f896814bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8954003e10 0x7f896814bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 -- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 msgr2=0x7f89680aa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 0x7f89680aa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 -- 172.21.15.133:0/1830520640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896814c390 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896d094700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 0x7f89680aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896e096700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f89680bd3d0 tx=0x7f896000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000e030 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8960011d30 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896814cc00 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960009b70 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.764+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8968162df0 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.765+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8968162fb0 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.765+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f89600158f0 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.766+0000 7f895e7fc700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 0x7f894c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.766+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f896000f070 con 0x7f89680aac10 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.766+0000 7f896d895700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 0x7f894c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:39.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.766+0000 7f896d895700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 0x7f894c061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8958001620 tx=0x7f8958009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:39.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.770+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f896004bda0 con 0x7f89680aac10 2024-01-21T21:31:39.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.930+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f896805fdf0 con 0x7f894c05f150 2024-01-21T21:31:39.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.939+0000 7f895e7fc700 1 -- 172.21.15.133:0/1830520640 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353297 (secure 0 0 0) 0x7f896805fdf0 con 0x7f894c05f150 2024-01-21T21:31:39.946 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:39.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.942+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 msgr2=0x7f894c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.942+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 0x7f894c061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f8958001620 tx=0x7f8958009040).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 msgr2=0x7f8968165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7f89680bd3d0 tx=0x7f896000b040).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 shutdown_connections 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89680aac10 0x7f8968165e90 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8954003e10 0x7f896814bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f894c05f150 0x7f894c061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 --2- 172.21.15.133:0/1830520640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f896814b750 0x7f89680aa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 >> 172.21.15.133:0/1830520640 conn(0x7f89680c8200 msgr2=0x7f8968069dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 shutdown_connections 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:39.943+0000 7f896faf9700 1 -- 172.21.15.133:0/1830520640 wait complete. 2024-01-21T21:31:39.949 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:31:39.957 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:31:38.665835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460724,"kb_used_data":18420,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752513996,"statfs":{"total":773094113280,"available":770574331904,"internally_reserved":0,"allocated":18862080,"data_stored":10153187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600805,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-207,"num_write_kb":-726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.455733"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154392+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157098+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152339+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151492+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156385+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154681+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155114+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157415+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156660+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156609+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156877+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156603+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151990+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152755+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154720+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156288+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154320+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157447+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155048+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154300+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156093+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.158395+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156074+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151871+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153455+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151849+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151096+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151500+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155508+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155249+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154684+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155378+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153037+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151107+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154111+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150628+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153017+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153691+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151016+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150648+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154190+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150731+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153087+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151083+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153255+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154325+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153793+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155079+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154683+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153708+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155216+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155062+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151925+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152950+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151067+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546153+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:31:33.546153+0000","last_peered":"2024-01-21T21:31:33.546153+0000","last_clean":"2024-01-21T21:31:33.546153+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:31:33.546153+0000","last_undegraded":"2024-01-21T21:31:33.546153+0000","last_fullsized":"2024-01-21T21:31:33.546153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154788+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145304+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:31:33.145304+0000","last_peered":"2024-01-21T21:31:33.145304+0000","last_clean":"2024-01-21T21:31:33.145304+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:31:33.145304+0000","last_undegraded":"2024-01-21T21:31:33.145304+0000","last_fullsized":"2024-01-21T21:31:33.145304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154780+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546167+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:31:33.546167+0000","last_peered":"2024-01-21T21:31:33.546167+0000","last_clean":"2024-01-21T21:31:33.546167+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:31:33.546167+0000","last_undegraded":"2024-01-21T21:31:33.546167+0000","last_fullsized":"2024-01-21T21:31:33.546167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156830+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145312+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:31:33.145312+0000","last_peered":"2024-01-21T21:31:33.145312+0000","last_clean":"2024-01-21T21:31:33.145312+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:31:33.145312+0000","last_undegraded":"2024-01-21T21:31:33.145312+0000","last_fullsized":"2024-01-21T21:31:33.145312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546395+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:31:33.546395+0000","last_peered":"2024-01-21T21:31:33.546395+0000","last_clean":"2024-01-21T21:31:33.546395+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:31:33.546395+0000","last_undegraded":"2024-01-21T21:31:33.546395+0000","last_fullsized":"2024-01-21T21:31:33.546395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155293+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546414+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:31:33.546414+0000","last_peered":"2024-01-21T21:31:33.546414+0000","last_clean":"2024-01-21T21:31:33.546414+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:31:33.546414+0000","last_undegraded":"2024-01-21T21:31:33.546414+0000","last_fullsized":"2024-01-21T21:31:33.546414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150583+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546417+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:31:33.546417+0000","last_peered":"2024-01-21T21:31:33.546417+0000","last_clean":"2024-01-21T21:31:33.546417+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:31:33.546417+0000","last_undegraded":"2024-01-21T21:31:33.546417+0000","last_fullsized":"2024-01-21T21:31:33.546417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153558+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546241+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:31:33.546241+0000","last_peered":"2024-01-21T21:31:33.546241+0000","last_clean":"2024-01-21T21:31:33.546241+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:31:33.546241+0000","last_undegraded":"2024-01-21T21:31:33.546241+0000","last_fullsized":"2024-01-21T21:31:33.546241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155704+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546354+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:31:33.546354+0000","last_peered":"2024-01-21T21:31:33.546354+0000","last_clean":"2024-01-21T21:31:33.546354+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:31:33.546354+0000","last_undegraded":"2024-01-21T21:31:33.546354+0000","last_fullsized":"2024-01-21T21:31:33.546354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2359296,"data_stored":1271017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.84199999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.58799999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.495,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72699999999999998,"5min":0.75,"15min":0.91700000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.80200000000000005,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.84399999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82199999999999995},"last":0.36799999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060148,"statfs":{"total":96636764160,"available":96317591552,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.29599999999999999,"15min":0.29199999999999998},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.53900000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.374,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.83799999999999997},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.38},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.75900000000000001,"15min":0.81499999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.39400000000000002},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.48499999999999999,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.75,"5min":0.75,"15min":0.78500000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.98199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66200000000000003},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.70099999999999996},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.318}]},{"osd":3,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.55400000000000005,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.93100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.45100000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.036},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.56599999999999995,"5min":0.45900000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.97799999999999998},"last":0.441}]},{"osd":7,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.878,"5min":0.98499999999999999,"15min":1.159},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575951,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2347008,"data_stored":1264112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.622},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.443,"15min":0.441},"min":{"1min":0.315,"5min":0.251,"15min":0.251},"max":{"1min":0.57999999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.39200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36099999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.439},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66800000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.621,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33300000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.434},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.503,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.442},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":0.98199999999999998,"5min":1.022,"15min":1.022},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.45300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.503}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.0189999999999999,"5min":1.04,"15min":1.04},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60299999999999998,"15min":0.65800000000000003},"last":0.32800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.53300000000000003,"5min":0.61099999999999999,"15min":0.69199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.27500000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.315},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32900000000000001,"15min":0.315},"max":{"1min":0.61099999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.378}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90800000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.35599999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.439},"max":{"1min":0.86399999999999999,"5min":0.97099999999999997,"15min":1.2410000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":1.1819999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.94099999999999995,"15min":0.98299999999999998},"last":0.59599999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307584,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064256,"statfs":{"total":96636764160,"available":96321798144,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.441},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.63300000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.58599999999999997,"5min":0.72099999999999997,"15min":0.73099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68200000000000005},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.69099999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96699999999999997,"5min":1.004,"15min":1.004},"last":0.436},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.92900000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40799999999999997},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.995,"15min":0.995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.97199999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.22900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.88200000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.85299999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.54600000000000004,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.53000000000000003,"5min":0.39300000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.84299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.38},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.745},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.77100000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.65400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.495}]},{"osd":7,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311680,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060160,"statfs":{"total":96636764160,"available":96317603840,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.93500000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.71099999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.496,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.91100000000000003},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.874},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.95899999999999996},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.82799999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":0.80900000000000005,"15min":0.85999999999999999},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:31:39.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:31:40.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.112+0000 7f293932a700 1 Processor -- start 2024-01-21T21:31:40.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.112+0000 7f293932a700 1 -- start start 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f293932a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f293413b970 0x7f29340c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f293932a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f29340a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f293932a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340bfa40 con 0x7f29340c39f0 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f293932a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29340c3e70 con 0x7f293413b970 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f293932a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340bee30 con 0x7f29340be810 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f293413b970 0x7f29340c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f293413b970 0x7f29340c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59508/0 (socket says 172.21.15.133:59508) 2024-01-21T21:31:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 -- 172.21.15.133:0/838800763 learned_addr learned my addr 172.21.15.133:0/838800763 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f29337fe700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f29340a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 -- 172.21.15.133:0/838800763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 msgr2=0x7f29340a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f29340a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 -- 172.21.15.133:0/838800763 >> v1:172.21.15.178:6789/0 conn(0x7f29340c39f0 legacy=0x7f29340be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 -- 172.21.15.133:0/838800763 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340bf110 con 0x7f293413b970 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f29337fe700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f29340a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2932ffd700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f293413b970 0x7f29340c3500 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f2924006fd0 tx=0x7f29240090f0).ready entity=mon.0 client_cookie=ec2eccfd38707c88 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2931ffb700 1 -- 172.21.15.133:0/838800763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400b600 con 0x7f293413b970 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2931ffb700 1 -- 172.21.15.133:0/838800763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400b760 con 0x7f293413b970 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.113+0000 7f2931ffb700 1 -- 172.21.15.133:0/838800763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400bb00 con 0x7f293413b970 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 -- 172.21.15.133:0/838800763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f293413b970 msgr2=0x7f29340c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f293413b970 0x7f29340c3500 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f2924006fd0 tx=0x7f29240090f0).stop 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 -- 172.21.15.133:0/838800763 shutdown_connections 2024-01-21T21:31:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f293413b970 0x7f29340c3500 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 --2- 172.21.15.133:0/838800763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f29340a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 -- 172.21.15.133:0/838800763 >> 172.21.15.133:0/838800763 conn(0x7f2934066a70 msgr2=0x7f2934066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 -- 172.21.15.133:0/838800763 shutdown_connections 2024-01-21T21:31:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.114+0000 7f293932a700 1 -- 172.21.15.133:0/838800763 wait complete. 2024-01-21T21:31:40.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.115+0000 7f293932a700 1 Processor -- start 2024-01-21T21:31:40.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.115+0000 7f293932a700 1 -- start start 2024-01-21T21:31:40.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f2934152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293413b970 0x7f2934162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29341542d0 con 0x7f29340c39f0 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934153040 con 0x7f293413b970 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f293932a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934153320 con 0x7f29340be810 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f29327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f29327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59516/0 (socket says 172.21.15.133:59516) 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f29327fc700 1 -- 172.21.15.133:0/4112554279 learned_addr learned my addr 172.21.15.133:0/4112554279 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f2932ffd700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f2934152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.116+0000 7f29337fe700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293413b970 0x7f2934162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 -- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 msgr2=0x7f2934152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f2934152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 -- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293413b970 msgr2=0x7f2934162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293413b970 0x7f2934162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 -- 172.21.15.133:0/4112554279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009370 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f29327fc700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f292800c4c0 tx=0x7f2928007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292800ce70 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928001e90 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934153600 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928007250 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.117+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2934152c50 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.118+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29341547b0 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.118+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f29280066a0 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.119+0000 7f291b7fe700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 0x7f2920061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.119+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f2928079d10 con 0x7f29340c39f0 2024-01-21T21:31:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.119+0000 7f2932ffd700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 0x7f2920061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.119+0000 7f2932ffd700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 0x7f2920061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2934157dd0 tx=0x7f2924017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.123+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f29341547b0 con 0x7f29340c39f0 2024-01-21T21:31:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.281+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29341547b0 con 0x7f292005f150 2024-01-21T21:31:40.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.291+0000 7f291b7fe700 1 -- 172.21.15.133:0/4112554279 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353297 (secure 0 0 0) 0x7f29341547b0 con 0x7f292005f150 2024-01-21T21:31:40.298 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:40.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 msgr2=0x7f2920061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 0x7f2920061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2934157dd0 tx=0x7f2924017000).stop 2024-01-21T21:31:40.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 msgr2=0x7f2934139aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f292800c4c0 tx=0x7f2928007e00).stop 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 shutdown_connections 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f292005f150 0x7f2920061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f293413b970 0x7f2934162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29340be810 0x7f2934152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 --2- 172.21.15.133:0/4112554279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29340c39f0 0x7f2934139aa0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 >> 172.21.15.133:0/4112554279 conn(0x7f2934066a70 msgr2=0x7f293413a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 shutdown_connections 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.294+0000 7f293932a700 1 -- 172.21.15.133:0/4112554279 wait complete. 2024-01-21T21:31:40.301 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:31:40.309 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:31:38.665835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460724,"kb_used_data":18420,"kb_used_omap":0,"kb_used_meta":2442240,"kb_avail":752513996,"statfs":{"total":773094113280,"available":770574331904,"internally_reserved":0,"allocated":18862080,"data_stored":10153187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2500853760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600805,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-207,"num_write_kb":-726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.455733"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154392+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157098+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152339+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151492+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156385+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154681+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155114+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157415+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156660+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156609+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156877+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156603+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151990+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152755+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154720+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156288+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154320+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.157447+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155048+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154300+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156093+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.158395+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156074+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151871+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153455+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151849+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151096+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151500+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155508+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155249+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154684+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155378+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153037+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151107+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154111+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150628+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153017+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153691+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151016+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155199+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150648+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154190+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150731+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153087+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151083+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153255+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154325+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153793+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155079+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154683+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153708+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155216+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155062+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151925+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.152950+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.151067+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546153+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:31:33.546153+0000","last_peered":"2024-01-21T21:31:33.546153+0000","last_clean":"2024-01-21T21:31:33.546153+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:31:33.546153+0000","last_undegraded":"2024-01-21T21:31:33.546153+0000","last_fullsized":"2024-01-21T21:31:33.546153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154788+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145304+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:31:33.145304+0000","last_peered":"2024-01-21T21:31:33.145304+0000","last_clean":"2024-01-21T21:31:33.145304+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:31:33.145304+0000","last_undegraded":"2024-01-21T21:31:33.145304+0000","last_fullsized":"2024-01-21T21:31:33.145304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.154780+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546167+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:31:33.546167+0000","last_peered":"2024-01-21T21:31:33.546167+0000","last_clean":"2024-01-21T21:31:33.546167+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:31:33.546167+0000","last_undegraded":"2024-01-21T21:31:33.546167+0000","last_fullsized":"2024-01-21T21:31:33.546167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.156830+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.145312+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:31:33.145312+0000","last_peered":"2024-01-21T21:31:33.145312+0000","last_clean":"2024-01-21T21:31:33.145312+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:31:33.145312+0000","last_undegraded":"2024-01-21T21:31:33.145312+0000","last_fullsized":"2024-01-21T21:31:33.145312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546395+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:31:33.546395+0000","last_peered":"2024-01-21T21:31:33.546395+0000","last_clean":"2024-01-21T21:31:33.546395+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:31:33.546395+0000","last_undegraded":"2024-01-21T21:31:33.546395+0000","last_fullsized":"2024-01-21T21:31:33.546395+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155293+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546414+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:31:33.546414+0000","last_peered":"2024-01-21T21:31:33.546414+0000","last_clean":"2024-01-21T21:31:33.546414+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:31:33.546414+0000","last_undegraded":"2024-01-21T21:31:33.546414+0000","last_fullsized":"2024-01-21T21:31:33.546414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.150583+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546417+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:31:33.546417+0000","last_peered":"2024-01-21T21:31:33.546417+0000","last_clean":"2024-01-21T21:31:33.546417+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:31:33.546417+0000","last_undegraded":"2024-01-21T21:31:33.546417+0000","last_fullsized":"2024-01-21T21:31:33.546417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.153558+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546241+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:31:33.546241+0000","last_peered":"2024-01-21T21:31:33.546241+0000","last_clean":"2024-01-21T21:31:33.546241+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:31:33.546241+0000","last_undegraded":"2024-01-21T21:31:33.546241+0000","last_fullsized":"2024-01-21T21:31:33.546241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:31:36.148251+0000","last_change":"2024-01-21T21:31:36.148251+0000","last_active":"2024-01-21T21:31:36.148251+0000","last_peered":"2024-01-21T21:31:36.148251+0000","last_clean":"2024-01-21T21:31:36.148251+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:36.148251+0000","last_undegraded":"2024-01-21T21:31:36.148251+0000","last_fullsized":"2024-01-21T21:31:36.148251+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:31:35.144839+0000","last_change":"2024-01-21T21:31:35.155704+0000","last_active":"2024-01-21T21:31:35.144839+0000","last_peered":"2024-01-21T21:31:35.144839+0000","last_clean":"2024-01-21T21:31:35.144839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:31:35.144839+0000","last_undegraded":"2024-01-21T21:31:35.144839+0000","last_fullsized":"2024-01-21T21:31:35.144839+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":153,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-01-21T21:31:33.546354+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:31:33.546354+0000","last_peered":"2024-01-21T21:31:33.546354+0000","last_clean":"2024-01-21T21:31:33.546354+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:31:33.546354+0000","last_undegraded":"2024-01-21T21:31:33.546354+0000","last_fullsized":"2024-01-21T21:31:33.546354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307592,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064248,"statfs":{"total":96636764160,"available":96321789952,"internally_reserved":0,"allocated":2359296,"data_stored":1271017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.84199999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.58799999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.495,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72699999999999998,"5min":0.75,"15min":0.91700000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.80200000000000005,"15min":0.84899999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.84399999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82199999999999995},"last":0.36799999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.44800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060148,"statfs":{"total":96636764160,"available":96317591552,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.29599999999999999,"15min":0.29199999999999998},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.53900000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.374,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.83799999999999997},"last":0.67300000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.38},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.622},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.75900000000000001,"15min":0.81499999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.39400000000000002},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.872},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.48499999999999999,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.75,"5min":0.75,"15min":0.78500000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73499999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.98199999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575952,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66200000000000003},"last":0.48699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.70099999999999996},"last":0.373},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.318}]},{"osd":3,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.55400000000000005,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.39900000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.93100000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.45100000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.036},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.56599999999999995,"5min":0.45900000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.97799999999999998},"last":0.441}]},{"osd":7,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.498},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.878,"5min":0.98499999999999999,"15min":1.159},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575951,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303484,"kb_used_data":2292,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068356,"statfs":{"total":96636764160,"available":96325996544,"internally_reserved":0,"allocated":2347008,"data_stored":1264112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.622},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38100000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.443,"15min":0.441},"min":{"1min":0.315,"5min":0.251,"15min":0.251},"max":{"1min":0.57999999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.39200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36099999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.439},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66800000000000004},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.621,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.33300000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.434},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.503,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.49299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.442},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":0.98199999999999998,"5min":1.022,"15min":1.022},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.45300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.503}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.0189999999999999,"5min":1.04,"15min":1.04},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60299999999999998,"15min":0.65800000000000003},"last":0.32800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.53300000000000003,"5min":0.61099999999999999,"15min":0.69199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.27500000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.33900000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.315},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32900000000000001,"15min":0.315},"max":{"1min":0.61099999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.378}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90800000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.35599999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.439},"max":{"1min":0.86399999999999999,"5min":0.97099999999999997,"15min":1.2410000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":1.1819999999999999},"last":0.40300000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.94099999999999995,"15min":0.98299999999999998},"last":0.59599999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"last":0.42799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575951,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307584,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064256,"statfs":{"total":96636764160,"available":96321798144,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.441},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.63300000000000001},"last":0.32200000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.58599999999999997,"5min":0.72099999999999997,"15min":0.73099999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68200000000000005},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.69099999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96699999999999997,"5min":1.004,"15min":1.004},"last":0.436},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.92900000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40799999999999997},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.995,"15min":0.995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.97199999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575951,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307596,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064244,"statfs":{"total":96636764160,"available":96321785856,"internally_reserved":0,"allocated":2363392,"data_stored":1271978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.22900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.88200000000000001},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.85299999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.54600000000000004,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.60399999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.53000000000000003,"5min":0.39300000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.84299999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.38},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.56000000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.745},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.77100000000000002},"last":0.48099999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.65400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.495}]},{"osd":7,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311680,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060160,"statfs":{"total":96636764160,"available":96317603840,"internally_reserved":0,"allocated":2351104,"data_stored":1265073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.93500000000000005},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.71099999999999997}]},{"osd":1,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.496,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.91100000000000003},"last":0.66000000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.64800000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.874},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.88700000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.95899999999999996},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.81699999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.46000000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.82799999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":0.80900000000000005,"15min":0.85999999999999999},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:31:40.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2024-01-21T21:31:40.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3f is not active+clean 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154392+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3e is not active+clean 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.157098+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3d is not active+clean 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.152339+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3c is not active+clean 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151492+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3b is not active+clean 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156385+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3a is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154681+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.39 is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155114+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.38 is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.157415+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2024-01-21T21:31:40.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.37 is not active+clean 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156660+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.36 is not active+clean 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156609+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.35 is not active+clean 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156877+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.34 is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156603+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.33 is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151990+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.32 is not active+clean 2024-01-21T21:31:40.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.152755+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.31 is not active+clean 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154720+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.30 is not active+clean 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156288+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2f is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154320+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2e is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.157447+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2d is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155048+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2024-01-21T21:31:40.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2c is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151199+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2b is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154300+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2a is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156093+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2024-01-21T21:31:40.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.29 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.158395+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.28 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156074+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.27 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151871+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2024-01-21T21:31:40.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.26 is not active+clean 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153455+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.25 is not active+clean 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151849+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.24 is not active+clean 2024-01-21T21:31:40.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151096+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.23 is not active+clean 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151500+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.22 is not active+clean 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155508+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.21 is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155249+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.20 is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154684+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1f is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155378+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2024-01-21T21:31:40.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1e is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153037+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1d is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151107+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1c is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154111+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2024-01-21T21:31:40.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1b is not active+clean 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.150628+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1a is not active+clean 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153017+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.19 is not active+clean 2024-01-21T21:31:40.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153691+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.18 is not active+clean 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151016+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.f is not active+clean 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155199+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.e is not active+clean 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.150648+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.d is not active+clean 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154190+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.c is not active+clean 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.150731+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.b is not active+clean 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153087+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.a is not active+clean 2024-01-21T21:31:40.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151083+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2024-01-21T21:31:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.9 is not active+clean 2024-01-21T21:31:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153255+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.8 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154325+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.7 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153793+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.6 is not active+clean 2024-01-21T21:31:40.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155079+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.5 is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154683+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.4 is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153708+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.3 is not active+clean 2024-01-21T21:31:40.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155216+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.2 is not active+clean 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155062+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.1 is not active+clean 2024-01-21T21:31:40.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151925+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.0 is not active+clean 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.152950+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2024-01-21T21:31:40.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.11 is not active+clean 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.151067+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.17 is not active+clean 2024-01-21T21:31:40.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154788+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2024-01-21T21:31:40.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.14 is not active+clean 2024-01-21T21:31:40.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.154780+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2024-01-21T21:31:40.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.16 is not active+clean 2024-01-21T21:31:40.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.156830+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2024-01-21T21:31:40.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.15 is not active+clean 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155293+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.10 is not active+clean 2024-01-21T21:31:40.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.150583+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:31:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2024-01-21T21:31:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.13 is not active+clean 2024-01-21T21:31:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.153558+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:31:40.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2024-01-21T21:31:40.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:31:36.148251+0000', 'last_change': '2024-01-21T21:31:36.148251+0000', 'last_active': '2024-01-21T21:31:36.148251+0000', 'last_peered': '2024-01-21T21:31:36.148251+0000', 'last_clean': '2024-01-21T21:31:36.148251+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:36.148251+0000', 'last_undegraded': '2024-01-21T21:31:36.148251+0000', 'last_fullsized': '2024-01-21T21:31:36.148251+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:36.148251+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:31:40.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 23.12 is not active+clean 2024-01-21T21:31:40.346 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:31:35.144839+0000', 'last_change': '2024-01-21T21:31:35.155704+0000', 'last_active': '2024-01-21T21:31:35.144839+0000', 'last_peered': '2024-01-21T21:31:35.144839+0000', 'last_clean': '2024-01-21T21:31:35.144839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:31:35.144839+0000', 'last_undegraded': '2024-01-21T21:31:35.144839+0000', 'last_fullsized': '2024-01-21T21:31:35.144839+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'last_clean_scrub_stamp': '2024-01-21T21:31:35.144839+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:31:40.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T21:31:40.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.463+0000 7f0ceb8c9700 1 Processor -- start 2024-01-21T21:31:40.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.463+0000 7f0ceb8c9700 1 -- start start 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ce413a830 0x7f0ce40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce413ac10 0x7f0ce40bce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce40695b0 0x7f0ce4069a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce4069f10 con 0x7f0ce40695b0 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce40c3890 con 0x7f0ce413a830 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ceb8c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40c3b70 con 0x7f0ce413ac10 2024-01-21T21:31:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce40695b0 0x7f0ce4069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ce40695b0 0x7f0ce4069a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34188/0 (socket says 172.21.15.133:34188) 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 -- 172.21.15.133:0/1692139905 learned_addr learned my addr 172.21.15.133:0/1692139905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9665700 1 --2- 172.21.15.133:0/1692139905 >> v2:172.21.15.178:3300/0 conn(0x7f0ce413a830 0x7f0ce40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce8e64700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce413ac10 0x7f0ce40bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 -- 172.21.15.133:0/1692139905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce413ac10 msgr2=0x7f0ce40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce413ac10 0x7f0ce40bce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 -- 172.21.15.133:0/1692139905 >> v2:172.21.15.178:3300/0 conn(0x7f0ce413a830 msgr2=0x7f0ce40c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/1692139905 >> v2:172.21.15.178:3300/0 conn(0x7f0ce413a830 0x7f0ce40c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 -- 172.21.15.133:0/1692139905 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40c3e50 con 0x7f0ce40695b0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce40695b0 0x7f0ce4069a20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f0ce4068230 tx=0x7f0cdc009840).ready entity=mon.0 client_cookie=671476f344ca6d38 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0cdbfff700 1 -- 172.21.15.133:0/1692139905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00e070 con 0x7f0ce40695b0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0cdbfff700 1 -- 172.21.15.133:0/1692139905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00ba50 con 0x7f0ce40695b0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.464+0000 7f0cdbfff700 1 -- 172.21.15.133:0/1692139905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bdd0 con 0x7f0ce40695b0 2024-01-21T21:31:40.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/1692139905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce40695b0 msgr2=0x7f0ce4069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce40695b0 0x7f0ce4069a20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f0ce4068230 tx=0x7f0cdc009840).stop 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/1692139905 shutdown_connections 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce40695b0 0x7f0ce4069a20 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/1692139905 >> v2:172.21.15.178:3300/0 conn(0x7f0ce413a830 0x7f0ce40c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/1692139905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce413ac10 0x7f0ce40bce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/1692139905 >> 172.21.15.133:0/1692139905 conn(0x7f0ce40c7dc0 msgr2=0x7f0ce40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/1692139905 shutdown_connections 2024-01-21T21:31:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.465+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/1692139905 wait complete. 2024-01-21T21:31:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 Processor -- start 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 -- start start 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce40695b0 0x7f0ce4136b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ce413a830 0x7f0ce4066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.467+0000 7f0ceb8c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4164930 con 0x7f0ce413ac10 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ceb8c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4066b70 con 0x7f0ce413a830 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ceb8c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce41603d0 con 0x7f0ce40695b0 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34190/0 (socket says 172.21.15.133:34190) 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 -- 172.21.15.133:0/775225699 learned_addr learned my addr 172.21.15.133:0/775225699 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce8e64700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ce413a830 0x7f0ce4066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 -- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce40695b0 msgr2=0x7f0ce4136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce40695b0 0x7f0ce4136b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 -- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ce413a830 msgr2=0x7f0ce4066190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ce413a830 0x7f0ce4066190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 -- 172.21.15.133:0/775225699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009ae0 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ce9e66700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f0cdc009fd0 tx=0x7f0cdc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bdd0 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00b6c0 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4160c60 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc01d670 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.468+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce4160610 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.469+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce405fdf0 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.470+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0cdc003040 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.470+0000 7f0cd9ffb700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 0x7f0cc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.470+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f0cdc07b9d0 con 0x7f0ce413ac10 2024-01-21T21:31:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.470+0000 7f0ce9665700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 0x7f0cc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.471+0000 7f0ce9665700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 0x7f0cc8061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0ce000b850 tx=0x7f0ce0008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.474+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0cdc04caa0 con 0x7f0ce413ac10 2024-01-21T21:31:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.704+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0ce40c4130 con 0x7f0ce413ac10 2024-01-21T21:31:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.705+0000 7f0cd9ffb700 1 -- 172.21.15.133:0/775225699 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1113 (secure 0 0 0) 0x7f0ce40c4130 con 0x7f0ce413ac10 2024-01-21T21:31:40.707 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:40.707 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5571,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":192,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2519781376,"bytes_avail":770574331904,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":68,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9585}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-01-21T21:27:23.426385+0000","services":{}},"progress_events":{}} 2024-01-21T21:31:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 msgr2=0x7f0cc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 0x7f0cc8061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f0ce000b850 tx=0x7f0ce0008040).stop 2024-01-21T21:31:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 msgr2=0x7f0ce4066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f0cdc009fd0 tx=0x7f0cdc009840).stop 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 shutdown_connections 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ce413ac10 0x7f0ce4066680 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ce40695b0 0x7f0ce4136b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0cc805f150 0x7f0cc8061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 --2- 172.21.15.133:0/775225699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ce413a830 0x7f0ce4066190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.706+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 >> 172.21.15.133:0/775225699 conn(0x7f0ce40c7dc0 msgr2=0x7f0ce4137a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.707+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 shutdown_connections 2024-01-21T21:31:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.707+0000 7f0ceb8c9700 1 -- 172.21.15.133:0/775225699 wait complete. 2024-01-21T21:31:40.721 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T21:31:40.721 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:31:40.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.835+0000 7f9c7672c700 1 Processor -- start 2024-01-21T21:31:40.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.835+0000 7f9c7672c700 1 -- start start 2024-01-21T21:31:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.836+0000 7f9c7672c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.836+0000 7f9c7672c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 0x7f9c700bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.836+0000 7f9c7672c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c700634e0 con 0x7f9c700697e0 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.836+0000 7f9c7672c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7006a130 con 0x7f9c70065d70 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.836+0000 7f9c7672c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7006a410 con 0x7f9c70062c10 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c74cc9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 0x7f9c700bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:57716/0 (socket says 172.21.15.133:57716) 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 -- 172.21.15.133:0/2967584010 learned_addr learned my addr 172.21.15.133:0/2967584010 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6f7fe700 1 --1- 172.21.15.133:0/2967584010 >> v1:172.21.15.178:6789/0 conn(0x7f9c700697e0 0x7f9c70065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35962/0 (socket says 172.21.15.133:35962) 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 -- 172.21.15.133:0/2967584010 >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 msgr2=0x7f9c700bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 --2- 172.21.15.133:0/2967584010 >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 0x7f9c700bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 -- 172.21.15.133:0/2967584010 >> v1:172.21.15.178:6789/0 conn(0x7f9c700697e0 legacy=0x7f9c70065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 -- 172.21.15.133:0/2967584010 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7006a6f0 con 0x7f9c70062c10 2024-01-21T21:31:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6effd700 1 -- 172.21.15.133:0/2967584010 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127158144 0 0) 0x7f9c700634e0 con 0x7f9c700697e0 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c74cc9700 1 --2- 172.21.15.133:0/2967584010 >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 0x7f9c700bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6ffff700 1 --2- 172.21.15.133:0/2967584010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9c64006fd0 tx=0x7f9c640090f0).ready entity=mon.2 client_cookie=3d2b6625e3d1bb07 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6effd700 1 -- 172.21.15.133:0/2967584010 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400b580 con 0x7f9c70062c10 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6effd700 1 -- 172.21.15.133:0/2967584010 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400b6e0 con 0x7f9c70062c10 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.837+0000 7f9c6effd700 1 -- 172.21.15.133:0/2967584010 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400ba80 con 0x7f9c70062c10 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 -- 172.21.15.133:0/2967584010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 msgr2=0x7f9c70062ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 --2- 172.21.15.133:0/2967584010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9c64006fd0 tx=0x7f9c640090f0).stop 2024-01-21T21:31:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 -- 172.21.15.133:0/2967584010 shutdown_connections 2024-01-21T21:31:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 --2- 172.21.15.133:0/2967584010 >> v2:172.21.15.178:3300/0 conn(0x7f9c70065d70 0x7f9c700bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 --2- 172.21.15.133:0/2967584010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c70062ff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 -- 172.21.15.133:0/2967584010 >> 172.21.15.133:0/2967584010 conn(0x7f9c700c8010 msgr2=0x7f9c700c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 -- 172.21.15.133:0/2967584010 shutdown_connections 2024-01-21T21:31:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.838+0000 7f9c7672c700 1 -- 172.21.15.133:0/2967584010 wait complete. 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.839+0000 7f9c7672c700 1 Processor -- start 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.840+0000 7f9c7672c700 1 -- start start 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c7013a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c70065d70 0x7f9c700ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700a8940 con 0x7f9c700697e0 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700ac070 con 0x7f9c70065d70 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7013a570 con 0x7f9c70062c10 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34206/0 (socket says 172.21.15.133:34206) 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 -- 172.21.15.133:0/3758231131 learned_addr learned my addr 172.21.15.133:0/3758231131 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:40.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c6ffff700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c7013a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c6f7fe700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c70065d70 0x7f9c700ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 -- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 msgr2=0x7f9c7013a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c7013a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 -- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c70065d70 msgr2=0x7f9c700ab690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c70065d70 0x7f9c700ab690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 -- 172.21.15.133:0/3758231131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009a20 con 0x7f9c700697e0 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c74cc9700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f9c68009fc0 tx=0x7f9c6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6800cbd0 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6800f040 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c64009370 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68013400 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.841+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c700a8b20 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7005fdf0 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9c680137f0 con 0x7f9c700697e0 2024-01-21T21:31:40.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c6cff9700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 0x7f9c5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f9c6807ad70 con 0x7f9c700697e0 2024-01-21T21:31:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c6ffff700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 0x7f9c5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.843+0000 7f9c6ffff700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 0x7f9c5c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9c6400b340 tx=0x7f9c64017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:40.847+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c6804bd90 con 0x7f9c700697e0 2024-01-21T21:31:41.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.005+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c700c8e40 con 0x7f9c5c05f150 2024-01-21T21:31:41.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.014+0000 7f9c6cff9700 1 -- 172.21.15.133:0/3758231131 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362232 (secure 0 0 0) 0x7f9c700c8e40 con 0x7f9c5c05f150 2024-01-21T21:31:41.021 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 msgr2=0x7f9c5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 0x7f9c5c061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9c6400b340 tx=0x7f9c64017000).stop 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 msgr2=0x7f9c700abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f9c68009fc0 tx=0x7f9c6800b040).stop 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 shutdown_connections 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c700697e0 0x7f9c700abb80 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c70062c10 0x7f9c7013a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c5c05f150 0x7f9c5c061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:41.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 --2- 172.21.15.133:0/3758231131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c70065d70 0x7f9c700ab690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 >> 172.21.15.133:0/3758231131 conn(0x7f9c700c8010 msgr2=0x7f9c700a4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 shutdown_connections 2024-01-21T21:31:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:41.018+0000 7f9c7672c700 1 -- 172.21.15.133:0/3758231131 wait complete. 2024-01-21T21:31:41.025 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:31:41.032 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T21:31:40.666142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469304,"kb_used_data":18808,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505416,"statfs":{"total":773094113280,"available":770565545984,"internally_reserved":0,"allocated":19259392,"data_stored":10359426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600805,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-207,"num_write_kb":-726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.455733"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552421+0000","last_change":"2024-01-21T21:31:36.550278+0000","last_active":"2024-01-21T21:31:36.552421+0000","last_peered":"2024-01-21T21:31:36.552421+0000","last_clean":"2024-01-21T21:31:36.552421+0000","last_became_active":"2024-01-21T21:31:36.549828+0000","last_became_peered":"2024-01-21T21:31:36.549828+0000","last_unstale":"2024-01-21T21:31:36.552421+0000","last_undegraded":"2024-01-21T21:31:36.552421+0000","last_fullsized":"2024-01-21T21:31:36.552421+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557282+0000","last_change":"2024-01-21T21:31:36.175333+0000","last_active":"2024-01-21T21:31:36.557282+0000","last_peered":"2024-01-21T21:31:36.557282+0000","last_clean":"2024-01-21T21:31:36.557282+0000","last_became_active":"2024-01-21T21:31:36.174967+0000","last_became_peered":"2024-01-21T21:31:36.174967+0000","last_unstale":"2024-01-21T21:31:36.557282+0000","last_undegraded":"2024-01-21T21:31:36.557282+0000","last_fullsized":"2024-01-21T21:31:36.557282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556878+0000","last_change":"2024-01-21T21:31:36.551648+0000","last_active":"2024-01-21T21:31:36.556878+0000","last_peered":"2024-01-21T21:31:36.556878+0000","last_clean":"2024-01-21T21:31:36.556878+0000","last_became_active":"2024-01-21T21:31:36.551380+0000","last_became_peered":"2024-01-21T21:31:36.551380+0000","last_unstale":"2024-01-21T21:31:36.556878+0000","last_undegraded":"2024-01-21T21:31:36.556878+0000","last_fullsized":"2024-01-21T21:31:36.556878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.540546+0000","last_change":"2024-01-21T21:31:36.176595+0000","last_active":"2024-01-21T21:31:36.540546+0000","last_peered":"2024-01-21T21:31:36.540546+0000","last_clean":"2024-01-21T21:31:36.540546+0000","last_became_active":"2024-01-21T21:31:36.176294+0000","last_became_peered":"2024-01-21T21:31:36.176294+0000","last_unstale":"2024-01-21T21:31:36.540546+0000","last_undegraded":"2024-01-21T21:31:36.540546+0000","last_fullsized":"2024-01-21T21:31:36.540546+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555850+0000","last_change":"2024-01-21T21:31:36.552483+0000","last_active":"2024-01-21T21:31:36.555850+0000","last_peered":"2024-01-21T21:31:36.555850+0000","last_clean":"2024-01-21T21:31:36.555850+0000","last_became_active":"2024-01-21T21:31:36.549251+0000","last_became_peered":"2024-01-21T21:31:36.549251+0000","last_unstale":"2024-01-21T21:31:36.555850+0000","last_undegraded":"2024-01-21T21:31:36.555850+0000","last_fullsized":"2024-01-21T21:31:36.555850+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531923+0000","last_change":"2024-01-21T21:31:36.169282+0000","last_active":"2024-01-21T21:31:36.531923+0000","last_peered":"2024-01-21T21:31:36.531923+0000","last_clean":"2024-01-21T21:31:36.531923+0000","last_became_active":"2024-01-21T21:31:36.168960+0000","last_became_peered":"2024-01-21T21:31:36.168960+0000","last_unstale":"2024-01-21T21:31:36.531923+0000","last_undegraded":"2024-01-21T21:31:36.531923+0000","last_fullsized":"2024-01-21T21:31:36.531923+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561765+0000","last_change":"2024-01-21T21:31:36.548143+0000","last_active":"2024-01-21T21:31:36.561765+0000","last_peered":"2024-01-21T21:31:36.561765+0000","last_clean":"2024-01-21T21:31:36.561765+0000","last_became_active":"2024-01-21T21:31:36.547756+0000","last_became_peered":"2024-01-21T21:31:36.547756+0000","last_unstale":"2024-01-21T21:31:36.561765+0000","last_undegraded":"2024-01-21T21:31:36.561765+0000","last_fullsized":"2024-01-21T21:31:36.561765+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.549147+0000","last_change":"2024-01-21T21:31:36.179598+0000","last_active":"2024-01-21T21:31:36.549147+0000","last_peered":"2024-01-21T21:31:36.549147+0000","last_clean":"2024-01-21T21:31:36.549147+0000","last_became_active":"2024-01-21T21:31:36.179228+0000","last_became_peered":"2024-01-21T21:31:36.179228+0000","last_unstale":"2024-01-21T21:31:36.549147+0000","last_undegraded":"2024-01-21T21:31:36.549147+0000","last_fullsized":"2024-01-21T21:31:36.549147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555587+0000","last_change":"2024-01-21T21:31:36.553796+0000","last_active":"2024-01-21T21:31:36.555587+0000","last_peered":"2024-01-21T21:31:36.555587+0000","last_clean":"2024-01-21T21:31:36.555587+0000","last_became_active":"2024-01-21T21:31:36.553508+0000","last_became_peered":"2024-01-21T21:31:36.553508+0000","last_unstale":"2024-01-21T21:31:36.555587+0000","last_undegraded":"2024-01-21T21:31:36.555587+0000","last_fullsized":"2024-01-21T21:31:36.555587+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.553022+0000","last_change":"2024-01-21T21:31:36.168889+0000","last_active":"2024-01-21T21:31:36.553022+0000","last_peered":"2024-01-21T21:31:36.553022+0000","last_clean":"2024-01-21T21:31:36.553022+0000","last_became_active":"2024-01-21T21:31:36.168604+0000","last_became_peered":"2024-01-21T21:31:36.168604+0000","last_unstale":"2024-01-21T21:31:36.553022+0000","last_undegraded":"2024-01-21T21:31:36.553022+0000","last_fullsized":"2024-01-21T21:31:36.553022+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556998+0000","last_change":"2024-01-21T21:31:36.550284+0000","last_active":"2024-01-21T21:31:36.556998+0000","last_peered":"2024-01-21T21:31:36.556998+0000","last_clean":"2024-01-21T21:31:36.556998+0000","last_became_active":"2024-01-21T21:31:36.549986+0000","last_became_peered":"2024-01-21T21:31:36.549986+0000","last_unstale":"2024-01-21T21:31:36.556998+0000","last_undegraded":"2024-01-21T21:31:36.556998+0000","last_fullsized":"2024-01-21T21:31:36.556998+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555980+0000","last_change":"2024-01-21T21:31:36.172204+0000","last_active":"2024-01-21T21:31:36.555980+0000","last_peered":"2024-01-21T21:31:36.555980+0000","last_clean":"2024-01-21T21:31:36.555980+0000","last_became_active":"2024-01-21T21:31:36.171907+0000","last_became_peered":"2024-01-21T21:31:36.171907+0000","last_unstale":"2024-01-21T21:31:36.555980+0000","last_undegraded":"2024-01-21T21:31:36.555980+0000","last_fullsized":"2024-01-21T21:31:36.555980+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555000+0000","last_change":"2024-01-21T21:31:36.550255+0000","last_active":"2024-01-21T21:31:36.555000+0000","last_peered":"2024-01-21T21:31:36.555000+0000","last_clean":"2024-01-21T21:31:36.555000+0000","last_became_active":"2024-01-21T21:31:36.549899+0000","last_became_peered":"2024-01-21T21:31:36.549899+0000","last_unstale":"2024-01-21T21:31:36.555000+0000","last_undegraded":"2024-01-21T21:31:36.555000+0000","last_fullsized":"2024-01-21T21:31:36.555000+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.533779+0000","last_change":"2024-01-21T21:31:36.170215+0000","last_active":"2024-01-21T21:31:36.533779+0000","last_peered":"2024-01-21T21:31:36.533779+0000","last_clean":"2024-01-21T21:31:36.533779+0000","last_became_active":"2024-01-21T21:31:36.169933+0000","last_became_peered":"2024-01-21T21:31:36.169933+0000","last_unstale":"2024-01-21T21:31:36.533779+0000","last_undegraded":"2024-01-21T21:31:36.533779+0000","last_fullsized":"2024-01-21T21:31:36.533779+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554908+0000","last_change":"2024-01-21T21:31:36.549562+0000","last_active":"2024-01-21T21:31:36.554908+0000","last_peered":"2024-01-21T21:31:36.554908+0000","last_clean":"2024-01-21T21:31:36.554908+0000","last_became_active":"2024-01-21T21:31:36.544521+0000","last_became_peered":"2024-01-21T21:31:36.544521+0000","last_unstale":"2024-01-21T21:31:36.554908+0000","last_undegraded":"2024-01-21T21:31:36.554908+0000","last_fullsized":"2024-01-21T21:31:36.554908+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536606+0000","last_change":"2024-01-21T21:31:36.169692+0000","last_active":"2024-01-21T21:31:36.536606+0000","last_peered":"2024-01-21T21:31:36.536606+0000","last_clean":"2024-01-21T21:31:36.536606+0000","last_became_active":"2024-01-21T21:31:36.168807+0000","last_became_peered":"2024-01-21T21:31:36.168807+0000","last_unstale":"2024-01-21T21:31:36.536606+0000","last_undegraded":"2024-01-21T21:31:36.536606+0000","last_fullsized":"2024-01-21T21:31:36.536606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555009+0000","last_change":"2024-01-21T21:31:36.550650+0000","last_active":"2024-01-21T21:31:36.555009+0000","last_peered":"2024-01-21T21:31:36.555009+0000","last_clean":"2024-01-21T21:31:36.555009+0000","last_became_active":"2024-01-21T21:31:36.550301+0000","last_became_peered":"2024-01-21T21:31:36.550301+0000","last_unstale":"2024-01-21T21:31:36.555009+0000","last_undegraded":"2024-01-21T21:31:36.555009+0000","last_fullsized":"2024-01-21T21:31:36.555009+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535751+0000","last_change":"2024-01-21T21:31:36.177126+0000","last_active":"2024-01-21T21:31:36.535751+0000","last_peered":"2024-01-21T21:31:36.535751+0000","last_clean":"2024-01-21T21:31:36.535751+0000","last_became_active":"2024-01-21T21:31:36.176862+0000","last_became_peered":"2024-01-21T21:31:36.176862+0000","last_unstale":"2024-01-21T21:31:36.535751+0000","last_undegraded":"2024-01-21T21:31:36.535751+0000","last_fullsized":"2024-01-21T21:31:36.535751+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555056+0000","last_change":"2024-01-21T21:31:36.551157+0000","last_active":"2024-01-21T21:31:36.555056+0000","last_peered":"2024-01-21T21:31:36.555056+0000","last_clean":"2024-01-21T21:31:36.555056+0000","last_became_active":"2024-01-21T21:31:36.550889+0000","last_became_peered":"2024-01-21T21:31:36.550889+0000","last_unstale":"2024-01-21T21:31:36.555056+0000","last_undegraded":"2024-01-21T21:31:36.555056+0000","last_fullsized":"2024-01-21T21:31:36.555056+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.540658+0000","last_change":"2024-01-21T21:31:36.181312+0000","last_active":"2024-01-21T21:31:36.540658+0000","last_peered":"2024-01-21T21:31:36.540658+0000","last_clean":"2024-01-21T21:31:36.540658+0000","last_became_active":"2024-01-21T21:31:36.181030+0000","last_became_peered":"2024-01-21T21:31:36.181030+0000","last_unstale":"2024-01-21T21:31:36.540658+0000","last_undegraded":"2024-01-21T21:31:36.540658+0000","last_fullsized":"2024-01-21T21:31:36.540658+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555604+0000","last_change":"2024-01-21T21:31:36.553742+0000","last_active":"2024-01-21T21:31:36.555604+0000","last_peered":"2024-01-21T21:31:36.555604+0000","last_clean":"2024-01-21T21:31:36.555604+0000","last_became_active":"2024-01-21T21:31:36.553456+0000","last_became_peered":"2024-01-21T21:31:36.553456+0000","last_unstale":"2024-01-21T21:31:36.555604+0000","last_undegraded":"2024-01-21T21:31:36.555604+0000","last_fullsized":"2024-01-21T21:31:36.555604+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535963+0000","last_change":"2024-01-21T21:31:36.169009+0000","last_active":"2024-01-21T21:31:36.535963+0000","last_peered":"2024-01-21T21:31:36.535963+0000","last_clean":"2024-01-21T21:31:36.535963+0000","last_became_active":"2024-01-21T21:31:36.168722+0000","last_became_peered":"2024-01-21T21:31:36.168722+0000","last_unstale":"2024-01-21T21:31:36.535963+0000","last_undegraded":"2024-01-21T21:31:36.535963+0000","last_fullsized":"2024-01-21T21:31:36.535963+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557586+0000","last_change":"2024-01-21T21:31:36.553976+0000","last_active":"2024-01-21T21:31:36.557586+0000","last_peered":"2024-01-21T21:31:36.557586+0000","last_clean":"2024-01-21T21:31:36.557586+0000","last_became_active":"2024-01-21T21:31:36.552683+0000","last_became_peered":"2024-01-21T21:31:36.552683+0000","last_unstale":"2024-01-21T21:31:36.557586+0000","last_undegraded":"2024-01-21T21:31:36.557586+0000","last_fullsized":"2024-01-21T21:31:36.557586+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557279+0000","last_change":"2024-01-21T21:31:36.176657+0000","last_active":"2024-01-21T21:31:36.557279+0000","last_peered":"2024-01-21T21:31:36.557279+0000","last_clean":"2024-01-21T21:31:36.557279+0000","last_became_active":"2024-01-21T21:31:36.176268+0000","last_became_peered":"2024-01-21T21:31:36.176268+0000","last_unstale":"2024-01-21T21:31:36.557279+0000","last_undegraded":"2024-01-21T21:31:36.557279+0000","last_fullsized":"2024-01-21T21:31:36.557279+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552518+0000","last_change":"2024-01-21T21:31:36.549906+0000","last_active":"2024-01-21T21:31:36.552518+0000","last_peered":"2024-01-21T21:31:36.552518+0000","last_clean":"2024-01-21T21:31:36.552518+0000","last_became_active":"2024-01-21T21:31:36.549646+0000","last_became_peered":"2024-01-21T21:31:36.549646+0000","last_unstale":"2024-01-21T21:31:36.552518+0000","last_undegraded":"2024-01-21T21:31:36.552518+0000","last_fullsized":"2024-01-21T21:31:36.552518+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.549631+0000","last_change":"2024-01-21T21:31:36.172651+0000","last_active":"2024-01-21T21:31:36.549631+0000","last_peered":"2024-01-21T21:31:36.549631+0000","last_clean":"2024-01-21T21:31:36.549631+0000","last_became_active":"2024-01-21T21:31:36.172364+0000","last_became_peered":"2024-01-21T21:31:36.172364+0000","last_unstale":"2024-01-21T21:31:36.549631+0000","last_undegraded":"2024-01-21T21:31:36.549631+0000","last_fullsized":"2024-01-21T21:31:36.549631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557143+0000","last_change":"2024-01-21T21:31:36.552856+0000","last_active":"2024-01-21T21:31:36.557143+0000","last_peered":"2024-01-21T21:31:36.557143+0000","last_clean":"2024-01-21T21:31:36.557143+0000","last_became_active":"2024-01-21T21:31:36.551959+0000","last_became_peered":"2024-01-21T21:31:36.551959+0000","last_unstale":"2024-01-21T21:31:36.557143+0000","last_undegraded":"2024-01-21T21:31:36.557143+0000","last_fullsized":"2024-01-21T21:31:36.557143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532381+0000","last_change":"2024-01-21T21:31:36.175486+0000","last_active":"2024-01-21T21:31:36.532381+0000","last_peered":"2024-01-21T21:31:36.532381+0000","last_clean":"2024-01-21T21:31:36.532381+0000","last_became_active":"2024-01-21T21:31:36.174579+0000","last_became_peered":"2024-01-21T21:31:36.174579+0000","last_unstale":"2024-01-21T21:31:36.532381+0000","last_undegraded":"2024-01-21T21:31:36.532381+0000","last_fullsized":"2024-01-21T21:31:36.532381+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547218+0000","last_change":"2024-01-21T21:31:36.545028+0000","last_active":"2024-01-21T21:31:36.547218+0000","last_peered":"2024-01-21T21:31:36.547218+0000","last_clean":"2024-01-21T21:31:36.547218+0000","last_became_active":"2024-01-21T21:31:36.544665+0000","last_became_peered":"2024-01-21T21:31:36.544665+0000","last_unstale":"2024-01-21T21:31:36.547218+0000","last_undegraded":"2024-01-21T21:31:36.547218+0000","last_fullsized":"2024-01-21T21:31:36.547218+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536733+0000","last_change":"2024-01-21T21:31:36.179272+0000","last_active":"2024-01-21T21:31:36.536733+0000","last_peered":"2024-01-21T21:31:36.536733+0000","last_clean":"2024-01-21T21:31:36.536733+0000","last_became_active":"2024-01-21T21:31:36.178970+0000","last_became_peered":"2024-01-21T21:31:36.178970+0000","last_unstale":"2024-01-21T21:31:36.536733+0000","last_undegraded":"2024-01-21T21:31:36.536733+0000","last_fullsized":"2024-01-21T21:31:36.536733+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556631+0000","last_change":"2024-01-21T21:31:36.553009+0000","last_active":"2024-01-21T21:31:36.556631+0000","last_peered":"2024-01-21T21:31:36.556631+0000","last_clean":"2024-01-21T21:31:36.556631+0000","last_became_active":"2024-01-21T21:31:36.551621+0000","last_became_peered":"2024-01-21T21:31:36.551621+0000","last_unstale":"2024-01-21T21:31:36.556631+0000","last_undegraded":"2024-01-21T21:31:36.556631+0000","last_fullsized":"2024-01-21T21:31:36.556631+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548876+0000","last_change":"2024-01-21T21:31:36.177467+0000","last_active":"2024-01-21T21:31:36.548876+0000","last_peered":"2024-01-21T21:31:36.548876+0000","last_clean":"2024-01-21T21:31:36.548876+0000","last_became_active":"2024-01-21T21:31:36.177061+0000","last_became_peered":"2024-01-21T21:31:36.177061+0000","last_unstale":"2024-01-21T21:31:36.548876+0000","last_undegraded":"2024-01-21T21:31:36.548876+0000","last_fullsized":"2024-01-21T21:31:36.548876+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546171+0000","last_change":"2024-01-21T21:31:36.544600+0000","last_active":"2024-01-21T21:31:36.546171+0000","last_peered":"2024-01-21T21:31:36.546171+0000","last_clean":"2024-01-21T21:31:36.546171+0000","last_became_active":"2024-01-21T21:31:36.544330+0000","last_became_peered":"2024-01-21T21:31:36.544330+0000","last_unstale":"2024-01-21T21:31:36.546171+0000","last_undegraded":"2024-01-21T21:31:36.546171+0000","last_fullsized":"2024-01-21T21:31:36.546171+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547248+0000","last_change":"2024-01-21T21:31:36.186710+0000","last_active":"2024-01-21T21:31:36.547248+0000","last_peered":"2024-01-21T21:31:36.547248+0000","last_clean":"2024-01-21T21:31:36.547248+0000","last_became_active":"2024-01-21T21:31:36.186382+0000","last_became_peered":"2024-01-21T21:31:36.186382+0000","last_unstale":"2024-01-21T21:31:36.547248+0000","last_undegraded":"2024-01-21T21:31:36.547248+0000","last_fullsized":"2024-01-21T21:31:36.547248+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556631+0000","last_change":"2024-01-21T21:31:36.543364+0000","last_active":"2024-01-21T21:31:36.556631+0000","last_peered":"2024-01-21T21:31:36.556631+0000","last_clean":"2024-01-21T21:31:36.556631+0000","last_became_active":"2024-01-21T21:31:36.543104+0000","last_became_peered":"2024-01-21T21:31:36.543104+0000","last_unstale":"2024-01-21T21:31:36.556631+0000","last_undegraded":"2024-01-21T21:31:36.556631+0000","last_fullsized":"2024-01-21T21:31:36.556631+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537425+0000","last_change":"2024-01-21T21:31:36.187589+0000","last_active":"2024-01-21T21:31:36.537425+0000","last_peered":"2024-01-21T21:31:36.537425+0000","last_clean":"2024-01-21T21:31:36.537425+0000","last_became_active":"2024-01-21T21:31:36.187287+0000","last_became_peered":"2024-01-21T21:31:36.187287+0000","last_unstale":"2024-01-21T21:31:36.537425+0000","last_undegraded":"2024-01-21T21:31:36.537425+0000","last_fullsized":"2024-01-21T21:31:36.537425+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547500+0000","last_change":"2024-01-21T21:31:36.546789+0000","last_active":"2024-01-21T21:31:36.547500+0000","last_peered":"2024-01-21T21:31:36.547500+0000","last_clean":"2024-01-21T21:31:36.547500+0000","last_became_active":"2024-01-21T21:31:36.546478+0000","last_became_peered":"2024-01-21T21:31:36.546478+0000","last_unstale":"2024-01-21T21:31:36.547500+0000","last_undegraded":"2024-01-21T21:31:36.547500+0000","last_fullsized":"2024-01-21T21:31:36.547500+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557626+0000","last_change":"2024-01-21T21:31:36.186780+0000","last_active":"2024-01-21T21:31:36.557626+0000","last_peered":"2024-01-21T21:31:36.557626+0000","last_clean":"2024-01-21T21:31:36.557626+0000","last_became_active":"2024-01-21T21:31:36.186417+0000","last_became_peered":"2024-01-21T21:31:36.186417+0000","last_unstale":"2024-01-21T21:31:36.557626+0000","last_undegraded":"2024-01-21T21:31:36.557626+0000","last_fullsized":"2024-01-21T21:31:36.557626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555716+0000","last_change":"2024-01-21T21:31:36.553928+0000","last_active":"2024-01-21T21:31:36.555716+0000","last_peered":"2024-01-21T21:31:36.555716+0000","last_clean":"2024-01-21T21:31:36.555716+0000","last_became_active":"2024-01-21T21:31:36.553581+0000","last_became_peered":"2024-01-21T21:31:36.553581+0000","last_unstale":"2024-01-21T21:31:36.555716+0000","last_undegraded":"2024-01-21T21:31:36.555716+0000","last_fullsized":"2024-01-21T21:31:36.555716+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531189+0000","last_change":"2024-01-21T21:31:36.173433+0000","last_active":"2024-01-21T21:31:36.531189+0000","last_peered":"2024-01-21T21:31:36.531189+0000","last_clean":"2024-01-21T21:31:36.531189+0000","last_became_active":"2024-01-21T21:31:36.173190+0000","last_became_peered":"2024-01-21T21:31:36.173190+0000","last_unstale":"2024-01-21T21:31:36.531189+0000","last_undegraded":"2024-01-21T21:31:36.531189+0000","last_fullsized":"2024-01-21T21:31:36.531189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561970+0000","last_change":"2024-01-21T21:31:36.554110+0000","last_active":"2024-01-21T21:31:36.561970+0000","last_peered":"2024-01-21T21:31:36.561970+0000","last_clean":"2024-01-21T21:31:36.561970+0000","last_became_active":"2024-01-21T21:31:36.553500+0000","last_became_peered":"2024-01-21T21:31:36.553500+0000","last_unstale":"2024-01-21T21:31:36.561970+0000","last_undegraded":"2024-01-21T21:31:36.561970+0000","last_fullsized":"2024-01-21T21:31:36.561970+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556892+0000","last_change":"2024-01-21T21:31:36.166148+0000","last_active":"2024-01-21T21:31:36.556892+0000","last_peered":"2024-01-21T21:31:36.556892+0000","last_clean":"2024-01-21T21:31:36.556892+0000","last_became_active":"2024-01-21T21:31:36.165878+0000","last_became_peered":"2024-01-21T21:31:36.165878+0000","last_unstale":"2024-01-21T21:31:36.556892+0000","last_undegraded":"2024-01-21T21:31:36.556892+0000","last_fullsized":"2024-01-21T21:31:36.556892+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550879+0000","last_change":"2024-01-21T21:31:36.547810+0000","last_active":"2024-01-21T21:31:36.550879+0000","last_peered":"2024-01-21T21:31:36.550879+0000","last_clean":"2024-01-21T21:31:36.550879+0000","last_became_active":"2024-01-21T21:31:36.547512+0000","last_became_peered":"2024-01-21T21:31:36.547512+0000","last_unstale":"2024-01-21T21:31:36.550879+0000","last_undegraded":"2024-01-21T21:31:36.550879+0000","last_fullsized":"2024-01-21T21:31:36.550879+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539849+0000","last_change":"2024-01-21T21:31:36.171387+0000","last_active":"2024-01-21T21:31:36.539849+0000","last_peered":"2024-01-21T21:31:36.539849+0000","last_clean":"2024-01-21T21:31:36.539849+0000","last_became_active":"2024-01-21T21:31:36.171153+0000","last_became_peered":"2024-01-21T21:31:36.171153+0000","last_unstale":"2024-01-21T21:31:36.539849+0000","last_undegraded":"2024-01-21T21:31:36.539849+0000","last_fullsized":"2024-01-21T21:31:36.539849+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558272+0000","last_change":"2024-01-21T21:31:36.557233+0000","last_active":"2024-01-21T21:31:36.558272+0000","last_peered":"2024-01-21T21:31:36.558272+0000","last_clean":"2024-01-21T21:31:36.558272+0000","last_became_active":"2024-01-21T21:31:36.556972+0000","last_became_peered":"2024-01-21T21:31:36.556972+0000","last_unstale":"2024-01-21T21:31:36.558272+0000","last_undegraded":"2024-01-21T21:31:36.558272+0000","last_fullsized":"2024-01-21T21:31:36.558272+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547364+0000","last_change":"2024-01-21T21:31:36.187190+0000","last_active":"2024-01-21T21:31:36.547364+0000","last_peered":"2024-01-21T21:31:36.547364+0000","last_clean":"2024-01-21T21:31:36.547364+0000","last_became_active":"2024-01-21T21:31:36.186877+0000","last_became_peered":"2024-01-21T21:31:36.186877+0000","last_unstale":"2024-01-21T21:31:36.547364+0000","last_undegraded":"2024-01-21T21:31:36.547364+0000","last_fullsized":"2024-01-21T21:31:36.547364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560902+0000","last_change":"2024-01-21T21:31:36.543886+0000","last_active":"2024-01-21T21:31:36.560902+0000","last_peered":"2024-01-21T21:31:36.560902+0000","last_clean":"2024-01-21T21:31:36.560902+0000","last_became_active":"2024-01-21T21:31:36.543593+0000","last_became_peered":"2024-01-21T21:31:36.543593+0000","last_unstale":"2024-01-21T21:31:36.560902+0000","last_undegraded":"2024-01-21T21:31:36.560902+0000","last_fullsized":"2024-01-21T21:31:36.560902+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536700+0000","last_change":"2024-01-21T21:31:36.167706+0000","last_active":"2024-01-21T21:31:36.536700+0000","last_peered":"2024-01-21T21:31:36.536700+0000","last_clean":"2024-01-21T21:31:36.536700+0000","last_became_active":"2024-01-21T21:31:36.167403+0000","last_became_peered":"2024-01-21T21:31:36.167403+0000","last_unstale":"2024-01-21T21:31:36.536700+0000","last_undegraded":"2024-01-21T21:31:36.536700+0000","last_fullsized":"2024-01-21T21:31:36.536700+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552400+0000","last_change":"2024-01-21T21:31:36.550085+0000","last_active":"2024-01-21T21:31:36.552400+0000","last_peered":"2024-01-21T21:31:36.552400+0000","last_clean":"2024-01-21T21:31:36.552400+0000","last_became_active":"2024-01-21T21:31:36.549490+0000","last_became_peered":"2024-01-21T21:31:36.549490+0000","last_unstale":"2024-01-21T21:31:36.552400+0000","last_undegraded":"2024-01-21T21:31:36.552400+0000","last_fullsized":"2024-01-21T21:31:36.552400+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532592+0000","last_change":"2024-01-21T21:31:36.170032+0000","last_active":"2024-01-21T21:31:36.532592+0000","last_peered":"2024-01-21T21:31:36.532592+0000","last_clean":"2024-01-21T21:31:36.532592+0000","last_became_active":"2024-01-21T21:31:36.169097+0000","last_became_peered":"2024-01-21T21:31:36.169097+0000","last_unstale":"2024-01-21T21:31:36.532592+0000","last_undegraded":"2024-01-21T21:31:36.532592+0000","last_fullsized":"2024-01-21T21:31:36.532592+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548461+0000","last_change":"2024-01-21T21:31:36.543358+0000","last_active":"2024-01-21T21:31:36.548461+0000","last_peered":"2024-01-21T21:31:36.548461+0000","last_clean":"2024-01-21T21:31:36.548461+0000","last_became_active":"2024-01-21T21:31:36.543126+0000","last_became_peered":"2024-01-21T21:31:36.543126+0000","last_unstale":"2024-01-21T21:31:36.548461+0000","last_undegraded":"2024-01-21T21:31:36.548461+0000","last_fullsized":"2024-01-21T21:31:36.548461+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.533988+0000","last_change":"2024-01-21T21:31:36.180646+0000","last_active":"2024-01-21T21:31:36.533988+0000","last_peered":"2024-01-21T21:31:36.533988+0000","last_clean":"2024-01-21T21:31:36.533988+0000","last_became_active":"2024-01-21T21:31:36.180347+0000","last_became_peered":"2024-01-21T21:31:36.180347+0000","last_unstale":"2024-01-21T21:31:36.533988+0000","last_undegraded":"2024-01-21T21:31:36.533988+0000","last_fullsized":"2024-01-21T21:31:36.533988+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550745+0000","last_change":"2024-01-21T21:31:36.548212+0000","last_active":"2024-01-21T21:31:36.550745+0000","last_peered":"2024-01-21T21:31:36.550745+0000","last_clean":"2024-01-21T21:31:36.550745+0000","last_became_active":"2024-01-21T21:31:36.547789+0000","last_became_peered":"2024-01-21T21:31:36.547789+0000","last_unstale":"2024-01-21T21:31:36.550745+0000","last_undegraded":"2024-01-21T21:31:36.550745+0000","last_fullsized":"2024-01-21T21:31:36.550745+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532030+0000","last_change":"2024-01-21T21:31:36.179346+0000","last_active":"2024-01-21T21:31:36.532030+0000","last_peered":"2024-01-21T21:31:36.532030+0000","last_clean":"2024-01-21T21:31:36.532030+0000","last_became_active":"2024-01-21T21:31:36.179055+0000","last_became_peered":"2024-01-21T21:31:36.179055+0000","last_unstale":"2024-01-21T21:31:36.532030+0000","last_undegraded":"2024-01-21T21:31:36.532030+0000","last_fullsized":"2024-01-21T21:31:36.532030+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561997+0000","last_change":"2024-01-21T21:31:36.554320+0000","last_active":"2024-01-21T21:31:36.561997+0000","last_peered":"2024-01-21T21:31:36.561997+0000","last_clean":"2024-01-21T21:31:36.561997+0000","last_became_active":"2024-01-21T21:31:36.553562+0000","last_became_peered":"2024-01-21T21:31:36.553562+0000","last_unstale":"2024-01-21T21:31:36.561997+0000","last_undegraded":"2024-01-21T21:31:36.561997+0000","last_fullsized":"2024-01-21T21:31:36.561997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532075+0000","last_change":"2024-01-21T21:31:36.178938+0000","last_active":"2024-01-21T21:31:36.532075+0000","last_peered":"2024-01-21T21:31:36.532075+0000","last_clean":"2024-01-21T21:31:36.532075+0000","last_became_active":"2024-01-21T21:31:36.175985+0000","last_became_peered":"2024-01-21T21:31:36.175985+0000","last_unstale":"2024-01-21T21:31:36.532075+0000","last_undegraded":"2024-01-21T21:31:36.532075+0000","last_fullsized":"2024-01-21T21:31:36.532075+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558190+0000","last_change":"2024-01-21T21:31:36.552807+0000","last_active":"2024-01-21T21:31:36.558190+0000","last_peered":"2024-01-21T21:31:36.558190+0000","last_clean":"2024-01-21T21:31:36.558190+0000","last_became_active":"2024-01-21T21:31:36.552576+0000","last_became_peered":"2024-01-21T21:31:36.552576+0000","last_unstale":"2024-01-21T21:31:36.558190+0000","last_undegraded":"2024-01-21T21:31:36.558190+0000","last_fullsized":"2024-01-21T21:31:36.558190+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532491+0000","last_change":"2024-01-21T21:31:36.176449+0000","last_active":"2024-01-21T21:31:36.532491+0000","last_peered":"2024-01-21T21:31:36.532491+0000","last_clean":"2024-01-21T21:31:36.532491+0000","last_became_active":"2024-01-21T21:31:36.176179+0000","last_became_peered":"2024-01-21T21:31:36.176179+0000","last_unstale":"2024-01-21T21:31:36.532491+0000","last_undegraded":"2024-01-21T21:31:36.532491+0000","last_fullsized":"2024-01-21T21:31:36.532491+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557018+0000","last_change":"2024-01-21T21:31:36.552068+0000","last_active":"2024-01-21T21:31:36.557018+0000","last_peered":"2024-01-21T21:31:36.557018+0000","last_clean":"2024-01-21T21:31:36.557018+0000","last_became_active":"2024-01-21T21:31:36.551330+0000","last_became_peered":"2024-01-21T21:31:36.551330+0000","last_unstale":"2024-01-21T21:31:36.557018+0000","last_undegraded":"2024-01-21T21:31:36.557018+0000","last_fullsized":"2024-01-21T21:31:36.557018+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551393+0000","last_change":"2024-01-21T21:31:36.175304+0000","last_active":"2024-01-21T21:31:36.551393+0000","last_peered":"2024-01-21T21:31:36.551393+0000","last_clean":"2024-01-21T21:31:36.551393+0000","last_became_active":"2024-01-21T21:31:36.174999+0000","last_became_peered":"2024-01-21T21:31:36.174999+0000","last_unstale":"2024-01-21T21:31:36.551393+0000","last_undegraded":"2024-01-21T21:31:36.551393+0000","last_fullsized":"2024-01-21T21:31:36.551393+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555694+0000","last_change":"2024-01-21T21:31:36.553728+0000","last_active":"2024-01-21T21:31:36.555694+0000","last_peered":"2024-01-21T21:31:36.555694+0000","last_clean":"2024-01-21T21:31:36.555694+0000","last_became_active":"2024-01-21T21:31:36.553438+0000","last_became_peered":"2024-01-21T21:31:36.553438+0000","last_unstale":"2024-01-21T21:31:36.555694+0000","last_undegraded":"2024-01-21T21:31:36.555694+0000","last_fullsized":"2024-01-21T21:31:36.555694+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550503+0000","last_change":"2024-01-21T21:31:36.173327+0000","last_active":"2024-01-21T21:31:36.550503+0000","last_peered":"2024-01-21T21:31:36.550503+0000","last_clean":"2024-01-21T21:31:36.550503+0000","last_became_active":"2024-01-21T21:31:36.172684+0000","last_became_peered":"2024-01-21T21:31:36.172684+0000","last_unstale":"2024-01-21T21:31:36.550503+0000","last_undegraded":"2024-01-21T21:31:36.550503+0000","last_fullsized":"2024-01-21T21:31:36.550503+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554951+0000","last_change":"2024-01-21T21:31:36.549741+0000","last_active":"2024-01-21T21:31:36.554951+0000","last_peered":"2024-01-21T21:31:36.554951+0000","last_clean":"2024-01-21T21:31:36.554951+0000","last_became_active":"2024-01-21T21:31:36.544314+0000","last_became_peered":"2024-01-21T21:31:36.544314+0000","last_unstale":"2024-01-21T21:31:36.554951+0000","last_undegraded":"2024-01-21T21:31:36.554951+0000","last_fullsized":"2024-01-21T21:31:36.554951+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536665+0000","last_change":"2024-01-21T21:31:36.186877+0000","last_active":"2024-01-21T21:31:36.536665+0000","last_peered":"2024-01-21T21:31:36.536665+0000","last_clean":"2024-01-21T21:31:36.536665+0000","last_became_active":"2024-01-21T21:31:36.186610+0000","last_became_peered":"2024-01-21T21:31:36.186610+0000","last_unstale":"2024-01-21T21:31:36.536665+0000","last_undegraded":"2024-01-21T21:31:36.536665+0000","last_fullsized":"2024-01-21T21:31:36.536665+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551375+0000","last_change":"2024-01-21T21:31:36.549049+0000","last_active":"2024-01-21T21:31:36.551375+0000","last_peered":"2024-01-21T21:31:36.551375+0000","last_clean":"2024-01-21T21:31:36.551375+0000","last_became_active":"2024-01-21T21:31:36.547704+0000","last_became_peered":"2024-01-21T21:31:36.547704+0000","last_unstale":"2024-01-21T21:31:36.551375+0000","last_undegraded":"2024-01-21T21:31:36.551375+0000","last_fullsized":"2024-01-21T21:31:36.551375+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.562161+0000","last_change":"2024-01-21T21:31:36.165840+0000","last_active":"2024-01-21T21:31:36.562161+0000","last_peered":"2024-01-21T21:31:36.562161+0000","last_clean":"2024-01-21T21:31:36.562161+0000","last_became_active":"2024-01-21T21:31:36.165517+0000","last_became_peered":"2024-01-21T21:31:36.165517+0000","last_unstale":"2024-01-21T21:31:36.562161+0000","last_undegraded":"2024-01-21T21:31:36.562161+0000","last_fullsized":"2024-01-21T21:31:36.562161+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560945+0000","last_change":"2024-01-21T21:31:36.544211+0000","last_active":"2024-01-21T21:31:36.560945+0000","last_peered":"2024-01-21T21:31:36.560945+0000","last_clean":"2024-01-21T21:31:36.560945+0000","last_became_active":"2024-01-21T21:31:36.543942+0000","last_became_peered":"2024-01-21T21:31:36.543942+0000","last_unstale":"2024-01-21T21:31:36.560945+0000","last_undegraded":"2024-01-21T21:31:36.560945+0000","last_fullsized":"2024-01-21T21:31:36.560945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551900+0000","last_change":"2024-01-21T21:31:36.180618+0000","last_active":"2024-01-21T21:31:36.551900+0000","last_peered":"2024-01-21T21:31:36.551900+0000","last_clean":"2024-01-21T21:31:36.551900+0000","last_became_active":"2024-01-21T21:31:36.180338+0000","last_became_peered":"2024-01-21T21:31:36.180338+0000","last_unstale":"2024-01-21T21:31:36.551900+0000","last_undegraded":"2024-01-21T21:31:36.551900+0000","last_fullsized":"2024-01-21T21:31:36.551900+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.553781+0000","last_change":"2024-01-21T21:31:36.548291+0000","last_active":"2024-01-21T21:31:36.553781+0000","last_peered":"2024-01-21T21:31:36.553781+0000","last_clean":"2024-01-21T21:31:36.553781+0000","last_became_active":"2024-01-21T21:31:36.548007+0000","last_became_peered":"2024-01-21T21:31:36.548007+0000","last_unstale":"2024-01-21T21:31:36.553781+0000","last_undegraded":"2024-01-21T21:31:36.553781+0000","last_fullsized":"2024-01-21T21:31:36.553781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556683+0000","last_change":"2024-01-21T21:31:36.187695+0000","last_active":"2024-01-21T21:31:36.556683+0000","last_peered":"2024-01-21T21:31:36.556683+0000","last_clean":"2024-01-21T21:31:36.556683+0000","last_became_active":"2024-01-21T21:31:36.187230+0000","last_became_peered":"2024-01-21T21:31:36.187230+0000","last_unstale":"2024-01-21T21:31:36.556683+0000","last_undegraded":"2024-01-21T21:31:36.556683+0000","last_fullsized":"2024-01-21T21:31:36.556683+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550558+0000","last_change":"2024-01-21T21:31:36.548838+0000","last_active":"2024-01-21T21:31:36.550558+0000","last_peered":"2024-01-21T21:31:36.550558+0000","last_clean":"2024-01-21T21:31:36.550558+0000","last_became_active":"2024-01-21T21:31:36.547760+0000","last_became_peered":"2024-01-21T21:31:36.547760+0000","last_unstale":"2024-01-21T21:31:36.550558+0000","last_undegraded":"2024-01-21T21:31:36.550558+0000","last_fullsized":"2024-01-21T21:31:36.550558+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546072+0000","last_change":"2024-01-21T21:31:36.187117+0000","last_active":"2024-01-21T21:31:36.546072+0000","last_peered":"2024-01-21T21:31:36.546072+0000","last_clean":"2024-01-21T21:31:36.546072+0000","last_became_active":"2024-01-21T21:31:36.186816+0000","last_became_peered":"2024-01-21T21:31:36.186816+0000","last_unstale":"2024-01-21T21:31:36.546072+0000","last_undegraded":"2024-01-21T21:31:36.546072+0000","last_fullsized":"2024-01-21T21:31:36.546072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555127+0000","last_change":"2024-01-21T21:31:36.549734+0000","last_active":"2024-01-21T21:31:36.555127+0000","last_peered":"2024-01-21T21:31:36.555127+0000","last_clean":"2024-01-21T21:31:36.555127+0000","last_became_active":"2024-01-21T21:31:36.549449+0000","last_became_peered":"2024-01-21T21:31:36.549449+0000","last_unstale":"2024-01-21T21:31:36.555127+0000","last_undegraded":"2024-01-21T21:31:36.555127+0000","last_fullsized":"2024-01-21T21:31:36.555127+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531385+0000","last_change":"2024-01-21T21:31:36.177225+0000","last_active":"2024-01-21T21:31:36.531385+0000","last_peered":"2024-01-21T21:31:36.531385+0000","last_clean":"2024-01-21T21:31:36.531385+0000","last_became_active":"2024-01-21T21:31:36.175755+0000","last_became_peered":"2024-01-21T21:31:36.175755+0000","last_unstale":"2024-01-21T21:31:36.531385+0000","last_undegraded":"2024-01-21T21:31:36.531385+0000","last_fullsized":"2024-01-21T21:31:36.531385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.562798+0000","last_change":"2024-01-21T21:31:36.561515+0000","last_active":"2024-01-21T21:31:36.562798+0000","last_peered":"2024-01-21T21:31:36.562798+0000","last_clean":"2024-01-21T21:31:36.562798+0000","last_became_active":"2024-01-21T21:31:36.561236+0000","last_became_peered":"2024-01-21T21:31:36.561236+0000","last_unstale":"2024-01-21T21:31:36.562798+0000","last_undegraded":"2024-01-21T21:31:36.562798+0000","last_fullsized":"2024-01-21T21:31:36.562798+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534405+0000","last_change":"2024-01-21T21:31:36.169232+0000","last_active":"2024-01-21T21:31:36.534405+0000","last_peered":"2024-01-21T21:31:36.534405+0000","last_clean":"2024-01-21T21:31:36.534405+0000","last_became_active":"2024-01-21T21:31:36.168960+0000","last_became_peered":"2024-01-21T21:31:36.168960+0000","last_unstale":"2024-01-21T21:31:36.534405+0000","last_undegraded":"2024-01-21T21:31:36.534405+0000","last_fullsized":"2024-01-21T21:31:36.534405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552781+0000","last_change":"2024-01-21T21:31:36.547755+0000","last_active":"2024-01-21T21:31:36.552781+0000","last_peered":"2024-01-21T21:31:36.552781+0000","last_clean":"2024-01-21T21:31:36.552781+0000","last_became_active":"2024-01-21T21:31:36.547506+0000","last_became_peered":"2024-01-21T21:31:36.547506+0000","last_unstale":"2024-01-21T21:31:36.552781+0000","last_undegraded":"2024-01-21T21:31:36.552781+0000","last_fullsized":"2024-01-21T21:31:36.552781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546520+0000","last_change":"2024-01-21T21:31:36.186613+0000","last_active":"2024-01-21T21:31:36.546520+0000","last_peered":"2024-01-21T21:31:36.546520+0000","last_clean":"2024-01-21T21:31:36.546520+0000","last_became_active":"2024-01-21T21:31:36.186293+0000","last_became_peered":"2024-01-21T21:31:36.186293+0000","last_unstale":"2024-01-21T21:31:36.546520+0000","last_undegraded":"2024-01-21T21:31:36.546520+0000","last_fullsized":"2024-01-21T21:31:36.546520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555159+0000","last_change":"2024-01-21T21:31:36.550838+0000","last_active":"2024-01-21T21:31:36.555159+0000","last_peered":"2024-01-21T21:31:36.555159+0000","last_clean":"2024-01-21T21:31:36.555159+0000","last_became_active":"2024-01-21T21:31:36.550541+0000","last_became_peered":"2024-01-21T21:31:36.550541+0000","last_unstale":"2024-01-21T21:31:36.555159+0000","last_undegraded":"2024-01-21T21:31:36.555159+0000","last_fullsized":"2024-01-21T21:31:36.555159+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531027+0000","last_change":"2024-01-21T21:31:36.177501+0000","last_active":"2024-01-21T21:31:36.531027+0000","last_peered":"2024-01-21T21:31:36.531027+0000","last_clean":"2024-01-21T21:31:36.531027+0000","last_became_active":"2024-01-21T21:31:36.177196+0000","last_became_peered":"2024-01-21T21:31:36.177196+0000","last_unstale":"2024-01-21T21:31:36.531027+0000","last_undegraded":"2024-01-21T21:31:36.531027+0000","last_fullsized":"2024-01-21T21:31:36.531027+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555031+0000","last_change":"2024-01-21T21:31:36.550917+0000","last_active":"2024-01-21T21:31:36.555031+0000","last_peered":"2024-01-21T21:31:36.555031+0000","last_clean":"2024-01-21T21:31:36.555031+0000","last_became_active":"2024-01-21T21:31:36.550637+0000","last_became_peered":"2024-01-21T21:31:36.550637+0000","last_unstale":"2024-01-21T21:31:36.555031+0000","last_undegraded":"2024-01-21T21:31:36.555031+0000","last_fullsized":"2024-01-21T21:31:36.555031+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556808+0000","last_change":"2024-01-21T21:31:36.166455+0000","last_active":"2024-01-21T21:31:36.556808+0000","last_peered":"2024-01-21T21:31:36.556808+0000","last_clean":"2024-01-21T21:31:36.556808+0000","last_became_active":"2024-01-21T21:31:36.166148+0000","last_became_peered":"2024-01-21T21:31:36.166148+0000","last_unstale":"2024-01-21T21:31:36.556808+0000","last_undegraded":"2024-01-21T21:31:36.556808+0000","last_fullsized":"2024-01-21T21:31:36.556808+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546125+0000","last_change":"2024-01-21T21:31:36.544404+0000","last_active":"2024-01-21T21:31:36.546125+0000","last_peered":"2024-01-21T21:31:36.546125+0000","last_clean":"2024-01-21T21:31:36.546125+0000","last_became_active":"2024-01-21T21:31:36.543742+0000","last_became_peered":"2024-01-21T21:31:36.543742+0000","last_unstale":"2024-01-21T21:31:36.546125+0000","last_undegraded":"2024-01-21T21:31:36.546125+0000","last_fullsized":"2024-01-21T21:31:36.546125+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550780+0000","last_change":"2024-01-21T21:31:36.190145+0000","last_active":"2024-01-21T21:31:36.550780+0000","last_peered":"2024-01-21T21:31:36.550780+0000","last_clean":"2024-01-21T21:31:36.550780+0000","last_became_active":"2024-01-21T21:31:36.189792+0000","last_became_peered":"2024-01-21T21:31:36.189792+0000","last_unstale":"2024-01-21T21:31:36.550780+0000","last_undegraded":"2024-01-21T21:31:36.550780+0000","last_fullsized":"2024-01-21T21:31:36.550780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.543273+0000","last_change":"2024-01-21T21:31:36.542444+0000","last_active":"2024-01-21T21:31:36.543273+0000","last_peered":"2024-01-21T21:31:36.543273+0000","last_clean":"2024-01-21T21:31:36.543273+0000","last_became_active":"2024-01-21T21:31:36.542141+0000","last_became_peered":"2024-01-21T21:31:36.542141+0000","last_unstale":"2024-01-21T21:31:36.543273+0000","last_undegraded":"2024-01-21T21:31:36.543273+0000","last_fullsized":"2024-01-21T21:31:36.543273+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534800+0000","last_change":"2024-01-21T21:31:36.172736+0000","last_active":"2024-01-21T21:31:36.534800+0000","last_peered":"2024-01-21T21:31:36.534800+0000","last_clean":"2024-01-21T21:31:36.534800+0000","last_became_active":"2024-01-21T21:31:36.172403+0000","last_became_peered":"2024-01-21T21:31:36.172403+0000","last_unstale":"2024-01-21T21:31:36.534800+0000","last_undegraded":"2024-01-21T21:31:36.534800+0000","last_fullsized":"2024-01-21T21:31:36.534800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556744+0000","last_change":"2024-01-21T21:31:36.548797+0000","last_active":"2024-01-21T21:31:36.556744+0000","last_peered":"2024-01-21T21:31:36.556744+0000","last_clean":"2024-01-21T21:31:36.556744+0000","last_became_active":"2024-01-21T21:31:36.548509+0000","last_became_peered":"2024-01-21T21:31:36.548509+0000","last_unstale":"2024-01-21T21:31:36.556744+0000","last_undegraded":"2024-01-21T21:31:36.556744+0000","last_fullsized":"2024-01-21T21:31:36.556744+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532171+0000","last_change":"2024-01-21T21:31:36.178936+0000","last_active":"2024-01-21T21:31:36.532171+0000","last_peered":"2024-01-21T21:31:36.532171+0000","last_clean":"2024-01-21T21:31:36.532171+0000","last_became_active":"2024-01-21T21:31:36.175956+0000","last_became_peered":"2024-01-21T21:31:36.175956+0000","last_unstale":"2024-01-21T21:31:36.532171+0000","last_undegraded":"2024-01-21T21:31:36.532171+0000","last_fullsized":"2024-01-21T21:31:36.532171+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561955+0000","last_change":"2024-01-21T21:31:36.553794+0000","last_active":"2024-01-21T21:31:36.561955+0000","last_peered":"2024-01-21T21:31:36.561955+0000","last_clean":"2024-01-21T21:31:36.561955+0000","last_became_active":"2024-01-21T21:31:36.553484+0000","last_became_peered":"2024-01-21T21:31:36.553484+0000","last_unstale":"2024-01-21T21:31:36.561955+0000","last_undegraded":"2024-01-21T21:31:36.561955+0000","last_fullsized":"2024-01-21T21:31:36.561955+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547774+0000","last_change":"2024-01-21T21:31:36.177856+0000","last_active":"2024-01-21T21:31:36.547774+0000","last_peered":"2024-01-21T21:31:36.547774+0000","last_clean":"2024-01-21T21:31:36.547774+0000","last_became_active":"2024-01-21T21:31:36.177529+0000","last_became_peered":"2024-01-21T21:31:36.177529+0000","last_unstale":"2024-01-21T21:31:36.547774+0000","last_undegraded":"2024-01-21T21:31:36.547774+0000","last_fullsized":"2024-01-21T21:31:36.547774+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550019+0000","last_change":"2024-01-21T21:31:36.545774+0000","last_active":"2024-01-21T21:31:36.550019+0000","last_peered":"2024-01-21T21:31:36.550019+0000","last_clean":"2024-01-21T21:31:36.550019+0000","last_became_active":"2024-01-21T21:31:36.545492+0000","last_became_peered":"2024-01-21T21:31:36.545492+0000","last_unstale":"2024-01-21T21:31:36.550019+0000","last_undegraded":"2024-01-21T21:31:36.550019+0000","last_fullsized":"2024-01-21T21:31:36.550019+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532610+0000","last_change":"2024-01-21T21:31:36.172599+0000","last_active":"2024-01-21T21:31:36.532610+0000","last_peered":"2024-01-21T21:31:36.532610+0000","last_clean":"2024-01-21T21:31:36.532610+0000","last_became_active":"2024-01-21T21:31:36.172312+0000","last_became_peered":"2024-01-21T21:31:36.172312+0000","last_unstale":"2024-01-21T21:31:36.532610+0000","last_undegraded":"2024-01-21T21:31:36.532610+0000","last_fullsized":"2024-01-21T21:31:36.532610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548416+0000","last_change":"2024-01-21T21:31:36.544497+0000","last_active":"2024-01-21T21:31:36.548416+0000","last_peered":"2024-01-21T21:31:36.548416+0000","last_clean":"2024-01-21T21:31:36.548416+0000","last_became_active":"2024-01-21T21:31:36.544261+0000","last_became_peered":"2024-01-21T21:31:36.544261+0000","last_unstale":"2024-01-21T21:31:36.548416+0000","last_undegraded":"2024-01-21T21:31:36.548416+0000","last_fullsized":"2024-01-21T21:31:36.548416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546536+0000","last_change":"2024-01-21T21:31:36.167539+0000","last_active":"2024-01-21T21:31:36.546536+0000","last_peered":"2024-01-21T21:31:36.546536+0000","last_clean":"2024-01-21T21:31:36.546536+0000","last_became_active":"2024-01-21T21:31:36.167290+0000","last_became_peered":"2024-01-21T21:31:36.167290+0000","last_unstale":"2024-01-21T21:31:36.546536+0000","last_undegraded":"2024-01-21T21:31:36.546536+0000","last_fullsized":"2024-01-21T21:31:36.546536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551787+0000","last_change":"2024-01-21T21:31:36.549699+0000","last_active":"2024-01-21T21:31:36.551787+0000","last_peered":"2024-01-21T21:31:36.551787+0000","last_clean":"2024-01-21T21:31:36.551787+0000","last_became_active":"2024-01-21T21:31:36.549445+0000","last_became_peered":"2024-01-21T21:31:36.549445+0000","last_unstale":"2024-01-21T21:31:36.551787+0000","last_undegraded":"2024-01-21T21:31:36.551787+0000","last_fullsized":"2024-01-21T21:31:36.551787+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539501+0000","last_change":"2024-01-21T21:31:36.176339+0000","last_active":"2024-01-21T21:31:36.539501+0000","last_peered":"2024-01-21T21:31:36.539501+0000","last_clean":"2024-01-21T21:31:36.539501+0000","last_became_active":"2024-01-21T21:31:36.176010+0000","last_became_peered":"2024-01-21T21:31:36.176010+0000","last_unstale":"2024-01-21T21:31:36.539501+0000","last_undegraded":"2024-01-21T21:31:36.539501+0000","last_fullsized":"2024-01-21T21:31:36.539501+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.542607+0000","last_change":"2024-01-21T21:31:36.540080+0000","last_active":"2024-01-21T21:31:36.542607+0000","last_peered":"2024-01-21T21:31:36.542607+0000","last_clean":"2024-01-21T21:31:36.542607+0000","last_became_active":"2024-01-21T21:31:36.539770+0000","last_became_peered":"2024-01-21T21:31:36.539770+0000","last_unstale":"2024-01-21T21:31:36.542607+0000","last_undegraded":"2024-01-21T21:31:36.542607+0000","last_fullsized":"2024-01-21T21:31:36.542607+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.545035+0000","last_change":"2024-01-21T21:31:36.171201+0000","last_active":"2024-01-21T21:31:36.545035+0000","last_peered":"2024-01-21T21:31:36.545035+0000","last_clean":"2024-01-21T21:31:36.545035+0000","last_became_active":"2024-01-21T21:31:36.170811+0000","last_became_peered":"2024-01-21T21:31:36.170811+0000","last_unstale":"2024-01-21T21:31:36.545035+0000","last_undegraded":"2024-01-21T21:31:36.545035+0000","last_fullsized":"2024-01-21T21:31:36.545035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554804+0000","last_change":"2024-01-21T21:31:36.549220+0000","last_active":"2024-01-21T21:31:36.554804+0000","last_peered":"2024-01-21T21:31:36.554804+0000","last_clean":"2024-01-21T21:31:36.554804+0000","last_became_active":"2024-01-21T21:31:36.548983+0000","last_became_peered":"2024-01-21T21:31:36.548983+0000","last_unstale":"2024-01-21T21:31:36.554804+0000","last_undegraded":"2024-01-21T21:31:36.554804+0000","last_fullsized":"2024-01-21T21:31:36.554804+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537606+0000","last_change":"2024-01-21T21:31:36.182472+0000","last_active":"2024-01-21T21:31:36.537606+0000","last_peered":"2024-01-21T21:31:36.537606+0000","last_clean":"2024-01-21T21:31:36.537606+0000","last_became_active":"2024-01-21T21:31:36.182026+0000","last_became_peered":"2024-01-21T21:31:36.182026+0000","last_unstale":"2024-01-21T21:31:36.537606+0000","last_undegraded":"2024-01-21T21:31:36.537606+0000","last_fullsized":"2024-01-21T21:31:36.537606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548980+0000","last_change":"2024-01-21T21:31:36.545890+0000","last_active":"2024-01-21T21:31:36.548980+0000","last_peered":"2024-01-21T21:31:36.548980+0000","last_clean":"2024-01-21T21:31:36.548980+0000","last_became_active":"2024-01-21T21:31:36.545633+0000","last_became_peered":"2024-01-21T21:31:36.545633+0000","last_unstale":"2024-01-21T21:31:36.548980+0000","last_undegraded":"2024-01-21T21:31:36.548980+0000","last_fullsized":"2024-01-21T21:31:36.548980+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537336+0000","last_change":"2024-01-21T21:31:36.174723+0000","last_active":"2024-01-21T21:31:36.537336+0000","last_peered":"2024-01-21T21:31:36.537336+0000","last_clean":"2024-01-21T21:31:36.537336+0000","last_became_active":"2024-01-21T21:31:36.174423+0000","last_became_peered":"2024-01-21T21:31:36.174423+0000","last_unstale":"2024-01-21T21:31:36.537336+0000","last_undegraded":"2024-01-21T21:31:36.537336+0000","last_fullsized":"2024-01-21T21:31:36.537336+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555068+0000","last_change":"2024-01-21T21:31:36.551270+0000","last_active":"2024-01-21T21:31:36.555068+0000","last_peered":"2024-01-21T21:31:36.555068+0000","last_clean":"2024-01-21T21:31:36.555068+0000","last_became_active":"2024-01-21T21:31:36.550998+0000","last_became_peered":"2024-01-21T21:31:36.550998+0000","last_unstale":"2024-01-21T21:31:36.555068+0000","last_undegraded":"2024-01-21T21:31:36.555068+0000","last_fullsized":"2024-01-21T21:31:36.555068+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546164+0000","last_change":"2024-01-21T21:31:36.186853+0000","last_active":"2024-01-21T21:31:36.546164+0000","last_peered":"2024-01-21T21:31:36.546164+0000","last_clean":"2024-01-21T21:31:36.546164+0000","last_became_active":"2024-01-21T21:31:36.186450+0000","last_became_peered":"2024-01-21T21:31:36.186450+0000","last_unstale":"2024-01-21T21:31:36.546164+0000","last_undegraded":"2024-01-21T21:31:36.546164+0000","last_fullsized":"2024-01-21T21:31:36.546164+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556368+0000","last_change":"2024-01-21T21:31:36.552490+0000","last_active":"2024-01-21T21:31:36.556368+0000","last_peered":"2024-01-21T21:31:36.556368+0000","last_clean":"2024-01-21T21:31:36.556368+0000","last_became_active":"2024-01-21T21:31:36.552009+0000","last_became_peered":"2024-01-21T21:31:36.552009+0000","last_unstale":"2024-01-21T21:31:36.556368+0000","last_undegraded":"2024-01-21T21:31:36.556368+0000","last_fullsized":"2024-01-21T21:31:36.556368+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551286+0000","last_change":"2024-01-21T21:31:36.172774+0000","last_active":"2024-01-21T21:31:36.551286+0000","last_peered":"2024-01-21T21:31:36.551286+0000","last_clean":"2024-01-21T21:31:36.551286+0000","last_became_active":"2024-01-21T21:31:36.172451+0000","last_became_peered":"2024-01-21T21:31:36.172451+0000","last_unstale":"2024-01-21T21:31:36.551286+0000","last_undegraded":"2024-01-21T21:31:36.551286+0000","last_fullsized":"2024-01-21T21:31:36.551286+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548003+0000","last_change":"2024-01-21T21:31:36.546055+0000","last_active":"2024-01-21T21:31:36.548003+0000","last_peered":"2024-01-21T21:31:36.548003+0000","last_clean":"2024-01-21T21:31:36.548003+0000","last_became_active":"2024-01-21T21:31:36.545761+0000","last_became_peered":"2024-01-21T21:31:36.545761+0000","last_unstale":"2024-01-21T21:31:36.548003+0000","last_undegraded":"2024-01-21T21:31:36.548003+0000","last_fullsized":"2024-01-21T21:31:36.548003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536851+0000","last_change":"2024-01-21T21:31:36.188064+0000","last_active":"2024-01-21T21:31:36.536851+0000","last_peered":"2024-01-21T21:31:36.536851+0000","last_clean":"2024-01-21T21:31:36.536851+0000","last_became_active":"2024-01-21T21:31:36.187906+0000","last_became_peered":"2024-01-21T21:31:36.187906+0000","last_unstale":"2024-01-21T21:31:36.536851+0000","last_undegraded":"2024-01-21T21:31:36.536851+0000","last_fullsized":"2024-01-21T21:31:36.536851+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561940+0000","last_change":"2024-01-21T21:31:36.553681+0000","last_active":"2024-01-21T21:31:36.561940+0000","last_peered":"2024-01-21T21:31:36.561940+0000","last_clean":"2024-01-21T21:31:36.561940+0000","last_became_active":"2024-01-21T21:31:36.553400+0000","last_became_peered":"2024-01-21T21:31:36.553400+0000","last_unstale":"2024-01-21T21:31:36.561940+0000","last_undegraded":"2024-01-21T21:31:36.561940+0000","last_fullsized":"2024-01-21T21:31:36.561940+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532820+0000","last_change":"2024-01-21T21:31:36.187970+0000","last_active":"2024-01-21T21:31:36.532820+0000","last_peered":"2024-01-21T21:31:36.532820+0000","last_clean":"2024-01-21T21:31:36.532820+0000","last_became_active":"2024-01-21T21:31:36.187441+0000","last_became_peered":"2024-01-21T21:31:36.187441+0000","last_unstale":"2024-01-21T21:31:36.532820+0000","last_undegraded":"2024-01-21T21:31:36.532820+0000","last_fullsized":"2024-01-21T21:31:36.532820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558072+0000","last_change":"2024-01-21T21:31:36.550713+0000","last_active":"2024-01-21T21:31:36.558072+0000","last_peered":"2024-01-21T21:31:36.558072+0000","last_clean":"2024-01-21T21:31:36.558072+0000","last_became_active":"2024-01-21T21:31:36.550406+0000","last_became_peered":"2024-01-21T21:31:36.550406+0000","last_unstale":"2024-01-21T21:31:36.558072+0000","last_undegraded":"2024-01-21T21:31:36.558072+0000","last_fullsized":"2024-01-21T21:31:36.558072+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.530459+0000","last_change":"2024-01-21T21:31:36.177332+0000","last_active":"2024-01-21T21:31:36.530459+0000","last_peered":"2024-01-21T21:31:36.530459+0000","last_clean":"2024-01-21T21:31:36.530459+0000","last_became_active":"2024-01-21T21:31:36.176707+0000","last_became_peered":"2024-01-21T21:31:36.176707+0000","last_unstale":"2024-01-21T21:31:36.530459+0000","last_undegraded":"2024-01-21T21:31:36.530459+0000","last_fullsized":"2024-01-21T21:31:36.530459+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.543424+0000","last_change":"2024-01-21T21:31:36.542727+0000","last_active":"2024-01-21T21:31:36.543424+0000","last_peered":"2024-01-21T21:31:36.543424+0000","last_clean":"2024-01-21T21:31:36.543424+0000","last_became_active":"2024-01-21T21:31:36.542429+0000","last_became_peered":"2024-01-21T21:31:36.542429+0000","last_unstale":"2024-01-21T21:31:36.543424+0000","last_undegraded":"2024-01-21T21:31:36.543424+0000","last_fullsized":"2024-01-21T21:31:36.543424+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532830+0000","last_change":"2024-01-21T21:31:36.169923+0000","last_active":"2024-01-21T21:31:36.532830+0000","last_peered":"2024-01-21T21:31:36.532830+0000","last_clean":"2024-01-21T21:31:36.532830+0000","last_became_active":"2024-01-21T21:31:36.169580+0000","last_became_peered":"2024-01-21T21:31:36.169580+0000","last_unstale":"2024-01-21T21:31:36.532830+0000","last_undegraded":"2024-01-21T21:31:36.532830+0000","last_fullsized":"2024-01-21T21:31:36.532830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532159+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:31:36.532159+0000","last_peered":"2024-01-21T21:31:36.532159+0000","last_clean":"2024-01-21T21:31:36.532159+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:31:36.532159+0000","last_undegraded":"2024-01-21T21:31:36.532159+0000","last_fullsized":"2024-01-21T21:31:36.532159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548918+0000","last_change":"2024-01-21T21:31:36.546199+0000","last_active":"2024-01-21T21:31:36.548918+0000","last_peered":"2024-01-21T21:31:36.548918+0000","last_clean":"2024-01-21T21:31:36.548918+0000","last_became_active":"2024-01-21T21:31:36.545911+0000","last_became_peered":"2024-01-21T21:31:36.545911+0000","last_unstale":"2024-01-21T21:31:36.548918+0000","last_undegraded":"2024-01-21T21:31:36.548918+0000","last_fullsized":"2024-01-21T21:31:36.548918+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537879+0000","last_change":"2024-01-21T21:31:36.178261+0000","last_active":"2024-01-21T21:31:36.537879+0000","last_peered":"2024-01-21T21:31:36.537879+0000","last_clean":"2024-01-21T21:31:36.537879+0000","last_became_active":"2024-01-21T21:31:36.177980+0000","last_became_peered":"2024-01-21T21:31:36.177980+0000","last_unstale":"2024-01-21T21:31:36.537879+0000","last_undegraded":"2024-01-21T21:31:36.537879+0000","last_fullsized":"2024-01-21T21:31:36.537879+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532598+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:31:36.532598+0000","last_peered":"2024-01-21T21:31:36.532598+0000","last_clean":"2024-01-21T21:31:36.532598+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:31:36.532598+0000","last_undegraded":"2024-01-21T21:31:36.532598+0000","last_fullsized":"2024-01-21T21:31:36.532598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558059+0000","last_change":"2024-01-21T21:31:36.550640+0000","last_active":"2024-01-21T21:31:36.558059+0000","last_peered":"2024-01-21T21:31:36.558059+0000","last_clean":"2024-01-21T21:31:36.558059+0000","last_became_active":"2024-01-21T21:31:36.550375+0000","last_became_peered":"2024-01-21T21:31:36.550375+0000","last_unstale":"2024-01-21T21:31:36.558059+0000","last_undegraded":"2024-01-21T21:31:36.558059+0000","last_fullsized":"2024-01-21T21:31:36.558059+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561067+0000","last_change":"2024-01-21T21:31:36.179322+0000","last_active":"2024-01-21T21:31:36.561067+0000","last_peered":"2024-01-21T21:31:36.561067+0000","last_clean":"2024-01-21T21:31:36.561067+0000","last_became_active":"2024-01-21T21:31:36.179049+0000","last_became_peered":"2024-01-21T21:31:36.179049+0000","last_unstale":"2024-01-21T21:31:36.561067+0000","last_undegraded":"2024-01-21T21:31:36.561067+0000","last_fullsized":"2024-01-21T21:31:36.561067+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546400+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:31:36.546400+0000","last_peered":"2024-01-21T21:31:36.546400+0000","last_clean":"2024-01-21T21:31:36.546400+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:31:36.546400+0000","last_undegraded":"2024-01-21T21:31:36.546400+0000","last_fullsized":"2024-01-21T21:31:36.546400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551589+0000","last_change":"2024-01-21T21:31:36.546318+0000","last_active":"2024-01-21T21:31:36.551589+0000","last_peered":"2024-01-21T21:31:36.551589+0000","last_clean":"2024-01-21T21:31:36.551589+0000","last_became_active":"2024-01-21T21:31:36.545986+0000","last_became_peered":"2024-01-21T21:31:36.545986+0000","last_unstale":"2024-01-21T21:31:36.551589+0000","last_undegraded":"2024-01-21T21:31:36.551589+0000","last_fullsized":"2024-01-21T21:31:36.551589+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537516+0000","last_change":"2024-01-21T21:31:36.182338+0000","last_active":"2024-01-21T21:31:36.537516+0000","last_peered":"2024-01-21T21:31:36.537516+0000","last_clean":"2024-01-21T21:31:36.537516+0000","last_became_active":"2024-01-21T21:31:36.181623+0000","last_became_peered":"2024-01-21T21:31:36.181623+0000","last_unstale":"2024-01-21T21:31:36.537516+0000","last_undegraded":"2024-01-21T21:31:36.537516+0000","last_fullsized":"2024-01-21T21:31:36.537516+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532476+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:31:36.532476+0000","last_peered":"2024-01-21T21:31:36.532476+0000","last_clean":"2024-01-21T21:31:36.532476+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:31:36.532476+0000","last_undegraded":"2024-01-21T21:31:36.532476+0000","last_fullsized":"2024-01-21T21:31:36.532476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":158,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539587+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:31:36.539587+0000","last_peered":"2024-01-21T21:31:36.539587+0000","last_clean":"2024-01-21T21:31:36.539587+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:31:36.539587+0000","last_undegraded":"2024-01-21T21:31:36.539587+0000","last_fullsized":"2024-01-21T21:31:36.539587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560998+0000","last_change":"2024-01-21T21:31:36.545186+0000","last_active":"2024-01-21T21:31:36.560998+0000","last_peered":"2024-01-21T21:31:36.560998+0000","last_clean":"2024-01-21T21:31:36.560998+0000","last_became_active":"2024-01-21T21:31:36.544954+0000","last_became_peered":"2024-01-21T21:31:36.544954+0000","last_unstale":"2024-01-21T21:31:36.560998+0000","last_undegraded":"2024-01-21T21:31:36.560998+0000","last_fullsized":"2024-01-21T21:31:36.560998+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.559020+0000","last_change":"2024-01-21T21:31:36.170376+0000","last_active":"2024-01-21T21:31:36.559020+0000","last_peered":"2024-01-21T21:31:36.559020+0000","last_clean":"2024-01-21T21:31:36.559020+0000","last_became_active":"2024-01-21T21:31:36.169942+0000","last_became_peered":"2024-01-21T21:31:36.169942+0000","last_unstale":"2024-01-21T21:31:36.559020+0000","last_undegraded":"2024-01-21T21:31:36.559020+0000","last_fullsized":"2024-01-21T21:31:36.559020+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539664+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:31:36.539664+0000","last_peered":"2024-01-21T21:31:36.539664+0000","last_clean":"2024-01-21T21:31:36.539664+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:31:36.539664+0000","last_undegraded":"2024-01-21T21:31:36.539664+0000","last_fullsized":"2024-01-21T21:31:36.539664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.559944+0000","last_change":"2024-01-21T21:31:36.557402+0000","last_active":"2024-01-21T21:31:36.559944+0000","last_peered":"2024-01-21T21:31:36.559944+0000","last_clean":"2024-01-21T21:31:36.559944+0000","last_became_active":"2024-01-21T21:31:36.557125+0000","last_became_peered":"2024-01-21T21:31:36.557125+0000","last_unstale":"2024-01-21T21:31:36.559944+0000","last_undegraded":"2024-01-21T21:31:36.559944+0000","last_fullsized":"2024-01-21T21:31:36.559944+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550988+0000","last_change":"2024-01-21T21:31:36.177004+0000","last_active":"2024-01-21T21:31:36.550988+0000","last_peered":"2024-01-21T21:31:36.550988+0000","last_clean":"2024-01-21T21:31:36.550988+0000","last_became_active":"2024-01-21T21:31:36.176645+0000","last_became_peered":"2024-01-21T21:31:36.176645+0000","last_unstale":"2024-01-21T21:31:36.550988+0000","last_undegraded":"2024-01-21T21:31:36.550988+0000","last_fullsized":"2024-01-21T21:31:36.550988+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539197+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:31:36.539197+0000","last_peered":"2024-01-21T21:31:36.539197+0000","last_clean":"2024-01-21T21:31:36.539197+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:31:36.539197+0000","last_undegraded":"2024-01-21T21:31:36.539197+0000","last_fullsized":"2024-01-21T21:31:36.539197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552346+0000","last_change":"2024-01-21T21:31:36.550085+0000","last_active":"2024-01-21T21:31:36.552346+0000","last_peered":"2024-01-21T21:31:36.552346+0000","last_clean":"2024-01-21T21:31:36.552346+0000","last_became_active":"2024-01-21T21:31:36.549363+0000","last_became_peered":"2024-01-21T21:31:36.549363+0000","last_unstale":"2024-01-21T21:31:36.552346+0000","last_undegraded":"2024-01-21T21:31:36.552346+0000","last_fullsized":"2024-01-21T21:31:36.552346+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546107+0000","last_change":"2024-01-21T21:31:36.173888+0000","last_active":"2024-01-21T21:31:36.546107+0000","last_peered":"2024-01-21T21:31:36.546107+0000","last_clean":"2024-01-21T21:31:36.546107+0000","last_became_active":"2024-01-21T21:31:36.173412+0000","last_became_peered":"2024-01-21T21:31:36.173412+0000","last_unstale":"2024-01-21T21:31:36.546107+0000","last_undegraded":"2024-01-21T21:31:36.546107+0000","last_fullsized":"2024-01-21T21:31:36.546107+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534369+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:31:36.534369+0000","last_peered":"2024-01-21T21:31:36.534369+0000","last_clean":"2024-01-21T21:31:36.534369+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:31:36.534369+0000","last_undegraded":"2024-01-21T21:31:36.534369+0000","last_fullsized":"2024-01-21T21:31:36.534369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552943+0000","last_change":"2024-01-21T21:31:36.541848+0000","last_active":"2024-01-21T21:31:36.552943+0000","last_peered":"2024-01-21T21:31:36.552943+0000","last_clean":"2024-01-21T21:31:36.552943+0000","last_became_active":"2024-01-21T21:31:36.541544+0000","last_became_peered":"2024-01-21T21:31:36.541544+0000","last_unstale":"2024-01-21T21:31:36.552943+0000","last_undegraded":"2024-01-21T21:31:36.552943+0000","last_fullsized":"2024-01-21T21:31:36.552943+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536752+0000","last_change":"2024-01-21T21:31:36.167793+0000","last_active":"2024-01-21T21:31:36.536752+0000","last_peered":"2024-01-21T21:31:36.536752+0000","last_clean":"2024-01-21T21:31:36.536752+0000","last_became_active":"2024-01-21T21:31:36.167480+0000","last_became_peered":"2024-01-21T21:31:36.167480+0000","last_unstale":"2024-01-21T21:31:36.536752+0000","last_undegraded":"2024-01-21T21:31:36.536752+0000","last_fullsized":"2024-01-21T21:31:36.536752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535846+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:31:36.535846+0000","last_peered":"2024-01-21T21:31:36.535846+0000","last_clean":"2024-01-21T21:31:36.535846+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:31:36.535846+0000","last_undegraded":"2024-01-21T21:31:36.535846+0000","last_fullsized":"2024-01-21T21:31:36.535846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575951,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2404352,"data_stored":1295077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.84199999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.495,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72699999999999998,"5min":0.75,"15min":0.91700000000000004},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.80200000000000005,"15min":0.84899999999999998},"last":0.503}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61499999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.84399999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82199999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575951,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311732,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060108,"statfs":{"total":96636764160,"available":96317550592,"internally_reserved":0,"allocated":2404352,"data_stored":1295484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.29599999999999999,"15min":0.29199999999999998},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.374,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.83799999999999997},"last":0.66400000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.38},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.75900000000000001,"15min":0.81499999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.39400000000000002},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.872},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.48499999999999999,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.75,"5min":0.75,"15min":0.78500000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.98199999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575953,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303544,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068296,"statfs":{"total":96636764160,"available":96325935104,"internally_reserved":0,"allocated":2408448,"data_stored":1295236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66200000000000003},"last":0.443}]},{"osd":2,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.70099999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.55400000000000005,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.93100000000000005},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.036},"last":0.755},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.56599999999999995,"5min":0.45900000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.97799999999999998},"last":0.79000000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.878,"5min":0.98499999999999999,"15min":1.159},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575952,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064208,"statfs":{"total":96636764160,"available":96321748992,"internally_reserved":0,"allocated":2400256,"data_stored":1293665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.622},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28999999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.443,"15min":0.441},"min":{"1min":0.315,"5min":0.251,"15min":0.251},"max":{"1min":0.57999999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.39200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.439},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66800000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.621,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.503,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":0.98199999999999998,"5min":1.022,"15min":1.022},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.45300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.625},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.0189999999999999,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575952,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2404352,"data_stored":1294662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60299999999999998,"15min":0.65800000000000003},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.53300000000000003,"5min":0.61099999999999999,"15min":0.69199999999999995},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.27500000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.34200000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32900000000000001,"15min":0.315},"max":{"1min":0.61099999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90800000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.439},"max":{"1min":0.86399999999999999,"5min":0.97099999999999997,"15min":1.2410000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":1.1819999999999999},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.94099999999999995,"15min":0.98299999999999998},"last":0.497}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575952,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064196,"statfs":{"total":96636764160,"available":96321736704,"internally_reserved":0,"allocated":2412544,"data_stored":1295258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.441},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.63300000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.58599999999999997,"5min":0.72099999999999997,"15min":0.73099999999999998},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68200000000000005},"last":0.34699999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.69099999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96699999999999997,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.92900000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40799999999999997},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.995,"15min":0.995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.97199999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575952,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064196,"statfs":{"total":96636764160,"available":96321736704,"internally_reserved":0,"allocated":2412544,"data_stored":1294774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.22900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.499},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.88200000000000001},"last":0.626}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.85299999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.54600000000000004,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.53000000000000003,"5min":0.39300000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.84299999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.38},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.745},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.77100000000000002},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.65400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575951,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056004,"statfs":{"total":96636764160,"available":96313348096,"internally_reserved":0,"allocated":2412544,"data_stored":1295270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.93500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.496,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.91100000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.874},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.88700000000000001},"last":0.63},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.95899999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.81699999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.82799999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":0.80900000000000005,"15min":0.85999999999999999},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:31:42.465 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:31:42.462+0000 7f226af1e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:31:44.040 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:31:44.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.167+0000 7f14b85ef700 1 Processor -- start 2024-01-21T21:31:44.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.167+0000 7f14b85ef700 1 -- start start 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b85ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f14b01546b0 0x7f14b0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b85ef700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14b00bc6d0 0x7f14b0066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b85ef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00654f0 con 0x7f14b00a9e30 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b85ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b0063700 con 0x7f14b01546b0 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b85ef700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b0063950 con 0x7f14b00bc6d0 2024-01-21T21:31:44.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b638b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f14b01546b0 0x7f14b0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b5b8a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f14b00a9e30 0x7f14b0065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54424/0 (socket says 172.21.15.133:54424) 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b5b8a700 1 -- 172.21.15.133:0/2098418908 learned_addr learned my addr 172.21.15.133:0/2098418908 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b638b700 1 --2- 172.21.15.133:0/2098418908 >> v2:172.21.15.133:3300/0 conn(0x7f14b01546b0 0x7f14b0154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34218/0 (socket says 172.21.15.133:34218) 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.168+0000 7f14b6b8c700 1 --2- 172.21.15.133:0/2098418908 >> v2:172.21.15.178:3300/0 conn(0x7f14b00bc6d0 0x7f14b0066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b638b700 1 -- 172.21.15.133:0/2098418908 >> v2:172.21.15.178:3300/0 conn(0x7f14b00bc6d0 msgr2=0x7f14b0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b638b700 1 --2- 172.21.15.133:0/2098418908 >> v2:172.21.15.178:3300/0 conn(0x7f14b00bc6d0 0x7f14b0066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b638b700 1 -- 172.21.15.133:0/2098418908 >> v1:172.21.15.133:6789/0 conn(0x7f14b00a9e30 legacy=0x7f14b0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b638b700 1 -- 172.21.15.133:0/2098418908 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0065180 con 0x7f14b01546b0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b5389700 1 -- 172.21.15.133:0/2098418908 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262333628 0 0) 0x7f14b00654f0 con 0x7f14b00a9e30 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b638b700 1 --2- 172.21.15.133:0/2098418908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b01546b0 0x7f14b0154a90 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f14b0065460 tx=0x7f14ac009060).ready entity=mon.0 client_cookie=abb21599c28a882d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b5389700 1 -- 172.21.15.133:0/2098418908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0090d0 con 0x7f14b01546b0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b5389700 1 -- 172.21.15.133:0/2098418908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00f510 con 0x7f14b01546b0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b5389700 1 -- 172.21.15.133:0/2098418908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00f890 con 0x7f14b01546b0 2024-01-21T21:31:44.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b85ef700 1 -- 172.21.15.133:0/2098418908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b01546b0 msgr2=0x7f14b0154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.169+0000 7f14b85ef700 1 --2- 172.21.15.133:0/2098418908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b01546b0 0x7f14b0154a90 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f14b0065460 tx=0x7f14ac009060).stop 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 -- 172.21.15.133:0/2098418908 shutdown_connections 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 --2- 172.21.15.133:0/2098418908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b01546b0 0x7f14b0154a90 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 --2- 172.21.15.133:0/2098418908 >> v2:172.21.15.178:3300/0 conn(0x7f14b00bc6d0 0x7f14b0066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 -- 172.21.15.133:0/2098418908 >> 172.21.15.133:0/2098418908 conn(0x7f14b00c8200 msgr2=0x7f14b00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 -- 172.21.15.133:0/2098418908 shutdown_connections 2024-01-21T21:31:44.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.170+0000 7f14b85ef700 1 -- 172.21.15.133:0/2098418908 wait complete. 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.171+0000 7f14b85ef700 1 Processor -- start 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.171+0000 7f14b85ef700 1 -- start start 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b00a9e30 0x7f14b014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 0x7f14b00698c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b0069db0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00abb50 con 0x7f14b00a9e30 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b85ef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ac3f0 con 0x7f14b01546b0 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34232/0 (socket says 172.21.15.133:34232) 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 -- 172.21.15.133:0/1648905049 learned_addr learned my addr 172.21.15.133:0/1648905049 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:44.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b638b700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b00a9e30 0x7f14b014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b6b8c700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 0x7f14b00698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 -- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 msgr2=0x7f14b00698c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 0x7f14b00698c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 -- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b00a9e30 msgr2=0x7f14b014f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b00a9e30 0x7f14b014f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 -- 172.21.15.133:0/1648905049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0092a0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b6b8c700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 0x7f14b00698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.172+0000 7f14b5b8a700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f14a0001eb0 tx=0x7f14a0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.173+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000ce90 con 0x7f14b00bc6d0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.173+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a00072e0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.173+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b00ab5c0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.173+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0007680 con 0x7f14b00bc6d0 2024-01-21T21:31:44.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.173+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00ac080 con 0x7f14b00bc6d0 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.174+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b00ac5a0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.174+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f14a00059b0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.174+0000 7f14a6ffd700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 0x7f1494061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.175+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f14a0079b70 con 0x7f14b00bc6d0 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.175+0000 7f14b638b700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 0x7f1494061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.175+0000 7f14b638b700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 0x7f1494061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f14b0065460 tx=0x7f14ac017000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.179+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f14b00ac5a0 con 0x7f14b00bc6d0 2024-01-21T21:31:44.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.341+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14b00ac560 con 0x7f149405f150 2024-01-21T21:31:44.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.351+0000 7f14a6ffd700 1 -- 172.21.15.133:0/1648905049 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362232 (secure 0 0 0) 0x7f14b00ac560 con 0x7f149405f150 2024-01-21T21:31:44.358 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 msgr2=0x7f1494061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 0x7f1494061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f14b0065460 tx=0x7f14ac017000).stop 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 msgr2=0x7f14b00693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f14a0001eb0 tx=0x7f14a0007e90).stop 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 shutdown_connections 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14b01546b0 0x7f14b00698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f149405f150 0x7f1494061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b00a9e30 0x7f14b014f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 --2- 172.21.15.133:0/1648905049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14b00bc6d0 0x7f14b00693d0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 >> 172.21.15.133:0/1648905049 conn(0x7f14b00c8200 msgr2=0x7f14b0151490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:44.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 shutdown_connections 2024-01-21T21:31:44.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.354+0000 7f14b85ef700 1 -- 172.21.15.133:0/1648905049 wait complete. 2024-01-21T21:31:44.362 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:31:44.369 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T21:31:42.666851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2469304,"kb_used_data":18808,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752505416,"statfs":{"total":773094113280,"available":770565545984,"internally_reserved":0,"allocated":19259392,"data_stored":10359426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-600805,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-207,"num_write_kb":-726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.456442"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552421+0000","last_change":"2024-01-21T21:31:36.550278+0000","last_active":"2024-01-21T21:31:36.552421+0000","last_peered":"2024-01-21T21:31:36.552421+0000","last_clean":"2024-01-21T21:31:36.552421+0000","last_became_active":"2024-01-21T21:31:36.549828+0000","last_became_peered":"2024-01-21T21:31:36.549828+0000","last_unstale":"2024-01-21T21:31:36.552421+0000","last_undegraded":"2024-01-21T21:31:36.552421+0000","last_fullsized":"2024-01-21T21:31:36.552421+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3f","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557282+0000","last_change":"2024-01-21T21:31:36.175333+0000","last_active":"2024-01-21T21:31:36.557282+0000","last_peered":"2024-01-21T21:31:36.557282+0000","last_clean":"2024-01-21T21:31:36.557282+0000","last_became_active":"2024-01-21T21:31:36.174967+0000","last_became_peered":"2024-01-21T21:31:36.174967+0000","last_unstale":"2024-01-21T21:31:36.557282+0000","last_undegraded":"2024-01-21T21:31:36.557282+0000","last_fullsized":"2024-01-21T21:31:36.557282+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556878+0000","last_change":"2024-01-21T21:31:36.551648+0000","last_active":"2024-01-21T21:31:36.556878+0000","last_peered":"2024-01-21T21:31:36.556878+0000","last_clean":"2024-01-21T21:31:36.556878+0000","last_became_active":"2024-01-21T21:31:36.551380+0000","last_became_peered":"2024-01-21T21:31:36.551380+0000","last_unstale":"2024-01-21T21:31:36.556878+0000","last_undegraded":"2024-01-21T21:31:36.556878+0000","last_fullsized":"2024-01-21T21:31:36.556878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.540546+0000","last_change":"2024-01-21T21:31:36.176595+0000","last_active":"2024-01-21T21:31:36.540546+0000","last_peered":"2024-01-21T21:31:36.540546+0000","last_clean":"2024-01-21T21:31:36.540546+0000","last_became_active":"2024-01-21T21:31:36.176294+0000","last_became_peered":"2024-01-21T21:31:36.176294+0000","last_unstale":"2024-01-21T21:31:36.540546+0000","last_undegraded":"2024-01-21T21:31:36.540546+0000","last_fullsized":"2024-01-21T21:31:36.540546+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555850+0000","last_change":"2024-01-21T21:31:36.552483+0000","last_active":"2024-01-21T21:31:36.555850+0000","last_peered":"2024-01-21T21:31:36.555850+0000","last_clean":"2024-01-21T21:31:36.555850+0000","last_became_active":"2024-01-21T21:31:36.549251+0000","last_became_peered":"2024-01-21T21:31:36.549251+0000","last_unstale":"2024-01-21T21:31:36.555850+0000","last_undegraded":"2024-01-21T21:31:36.555850+0000","last_fullsized":"2024-01-21T21:31:36.555850+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531923+0000","last_change":"2024-01-21T21:31:36.169282+0000","last_active":"2024-01-21T21:31:36.531923+0000","last_peered":"2024-01-21T21:31:36.531923+0000","last_clean":"2024-01-21T21:31:36.531923+0000","last_became_active":"2024-01-21T21:31:36.168960+0000","last_became_peered":"2024-01-21T21:31:36.168960+0000","last_unstale":"2024-01-21T21:31:36.531923+0000","last_undegraded":"2024-01-21T21:31:36.531923+0000","last_fullsized":"2024-01-21T21:31:36.531923+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561765+0000","last_change":"2024-01-21T21:31:36.548143+0000","last_active":"2024-01-21T21:31:36.561765+0000","last_peered":"2024-01-21T21:31:36.561765+0000","last_clean":"2024-01-21T21:31:36.561765+0000","last_became_active":"2024-01-21T21:31:36.547756+0000","last_became_peered":"2024-01-21T21:31:36.547756+0000","last_unstale":"2024-01-21T21:31:36.561765+0000","last_undegraded":"2024-01-21T21:31:36.561765+0000","last_fullsized":"2024-01-21T21:31:36.561765+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.549147+0000","last_change":"2024-01-21T21:31:36.179598+0000","last_active":"2024-01-21T21:31:36.549147+0000","last_peered":"2024-01-21T21:31:36.549147+0000","last_clean":"2024-01-21T21:31:36.549147+0000","last_became_active":"2024-01-21T21:31:36.179228+0000","last_became_peered":"2024-01-21T21:31:36.179228+0000","last_unstale":"2024-01-21T21:31:36.549147+0000","last_undegraded":"2024-01-21T21:31:36.549147+0000","last_fullsized":"2024-01-21T21:31:36.549147+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555587+0000","last_change":"2024-01-21T21:31:36.553796+0000","last_active":"2024-01-21T21:31:36.555587+0000","last_peered":"2024-01-21T21:31:36.555587+0000","last_clean":"2024-01-21T21:31:36.555587+0000","last_became_active":"2024-01-21T21:31:36.553508+0000","last_became_peered":"2024-01-21T21:31:36.553508+0000","last_unstale":"2024-01-21T21:31:36.555587+0000","last_undegraded":"2024-01-21T21:31:36.555587+0000","last_fullsized":"2024-01-21T21:31:36.555587+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.553022+0000","last_change":"2024-01-21T21:31:36.168889+0000","last_active":"2024-01-21T21:31:36.553022+0000","last_peered":"2024-01-21T21:31:36.553022+0000","last_clean":"2024-01-21T21:31:36.553022+0000","last_became_active":"2024-01-21T21:31:36.168604+0000","last_became_peered":"2024-01-21T21:31:36.168604+0000","last_unstale":"2024-01-21T21:31:36.553022+0000","last_undegraded":"2024-01-21T21:31:36.553022+0000","last_fullsized":"2024-01-21T21:31:36.553022+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556998+0000","last_change":"2024-01-21T21:31:36.550284+0000","last_active":"2024-01-21T21:31:36.556998+0000","last_peered":"2024-01-21T21:31:36.556998+0000","last_clean":"2024-01-21T21:31:36.556998+0000","last_became_active":"2024-01-21T21:31:36.549986+0000","last_became_peered":"2024-01-21T21:31:36.549986+0000","last_unstale":"2024-01-21T21:31:36.556998+0000","last_undegraded":"2024-01-21T21:31:36.556998+0000","last_fullsized":"2024-01-21T21:31:36.556998+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555980+0000","last_change":"2024-01-21T21:31:36.172204+0000","last_active":"2024-01-21T21:31:36.555980+0000","last_peered":"2024-01-21T21:31:36.555980+0000","last_clean":"2024-01-21T21:31:36.555980+0000","last_became_active":"2024-01-21T21:31:36.171907+0000","last_became_peered":"2024-01-21T21:31:36.171907+0000","last_unstale":"2024-01-21T21:31:36.555980+0000","last_undegraded":"2024-01-21T21:31:36.555980+0000","last_fullsized":"2024-01-21T21:31:36.555980+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555000+0000","last_change":"2024-01-21T21:31:36.550255+0000","last_active":"2024-01-21T21:31:36.555000+0000","last_peered":"2024-01-21T21:31:36.555000+0000","last_clean":"2024-01-21T21:31:36.555000+0000","last_became_active":"2024-01-21T21:31:36.549899+0000","last_became_peered":"2024-01-21T21:31:36.549899+0000","last_unstale":"2024-01-21T21:31:36.555000+0000","last_undegraded":"2024-01-21T21:31:36.555000+0000","last_fullsized":"2024-01-21T21:31:36.555000+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.533779+0000","last_change":"2024-01-21T21:31:36.170215+0000","last_active":"2024-01-21T21:31:36.533779+0000","last_peered":"2024-01-21T21:31:36.533779+0000","last_clean":"2024-01-21T21:31:36.533779+0000","last_became_active":"2024-01-21T21:31:36.169933+0000","last_became_peered":"2024-01-21T21:31:36.169933+0000","last_unstale":"2024-01-21T21:31:36.533779+0000","last_undegraded":"2024-01-21T21:31:36.533779+0000","last_fullsized":"2024-01-21T21:31:36.533779+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554908+0000","last_change":"2024-01-21T21:31:36.549562+0000","last_active":"2024-01-21T21:31:36.554908+0000","last_peered":"2024-01-21T21:31:36.554908+0000","last_clean":"2024-01-21T21:31:36.554908+0000","last_became_active":"2024-01-21T21:31:36.544521+0000","last_became_peered":"2024-01-21T21:31:36.544521+0000","last_unstale":"2024-01-21T21:31:36.554908+0000","last_undegraded":"2024-01-21T21:31:36.554908+0000","last_fullsized":"2024-01-21T21:31:36.554908+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536606+0000","last_change":"2024-01-21T21:31:36.169692+0000","last_active":"2024-01-21T21:31:36.536606+0000","last_peered":"2024-01-21T21:31:36.536606+0000","last_clean":"2024-01-21T21:31:36.536606+0000","last_became_active":"2024-01-21T21:31:36.168807+0000","last_became_peered":"2024-01-21T21:31:36.168807+0000","last_unstale":"2024-01-21T21:31:36.536606+0000","last_undegraded":"2024-01-21T21:31:36.536606+0000","last_fullsized":"2024-01-21T21:31:36.536606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555009+0000","last_change":"2024-01-21T21:31:36.550650+0000","last_active":"2024-01-21T21:31:36.555009+0000","last_peered":"2024-01-21T21:31:36.555009+0000","last_clean":"2024-01-21T21:31:36.555009+0000","last_became_active":"2024-01-21T21:31:36.550301+0000","last_became_peered":"2024-01-21T21:31:36.550301+0000","last_unstale":"2024-01-21T21:31:36.555009+0000","last_undegraded":"2024-01-21T21:31:36.555009+0000","last_fullsized":"2024-01-21T21:31:36.555009+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535751+0000","last_change":"2024-01-21T21:31:36.177126+0000","last_active":"2024-01-21T21:31:36.535751+0000","last_peered":"2024-01-21T21:31:36.535751+0000","last_clean":"2024-01-21T21:31:36.535751+0000","last_became_active":"2024-01-21T21:31:36.176862+0000","last_became_peered":"2024-01-21T21:31:36.176862+0000","last_unstale":"2024-01-21T21:31:36.535751+0000","last_undegraded":"2024-01-21T21:31:36.535751+0000","last_fullsized":"2024-01-21T21:31:36.535751+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555056+0000","last_change":"2024-01-21T21:31:36.551157+0000","last_active":"2024-01-21T21:31:36.555056+0000","last_peered":"2024-01-21T21:31:36.555056+0000","last_clean":"2024-01-21T21:31:36.555056+0000","last_became_active":"2024-01-21T21:31:36.550889+0000","last_became_peered":"2024-01-21T21:31:36.550889+0000","last_unstale":"2024-01-21T21:31:36.555056+0000","last_undegraded":"2024-01-21T21:31:36.555056+0000","last_fullsized":"2024-01-21T21:31:36.555056+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.540658+0000","last_change":"2024-01-21T21:31:36.181312+0000","last_active":"2024-01-21T21:31:36.540658+0000","last_peered":"2024-01-21T21:31:36.540658+0000","last_clean":"2024-01-21T21:31:36.540658+0000","last_became_active":"2024-01-21T21:31:36.181030+0000","last_became_peered":"2024-01-21T21:31:36.181030+0000","last_unstale":"2024-01-21T21:31:36.540658+0000","last_undegraded":"2024-01-21T21:31:36.540658+0000","last_fullsized":"2024-01-21T21:31:36.540658+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555604+0000","last_change":"2024-01-21T21:31:36.553742+0000","last_active":"2024-01-21T21:31:36.555604+0000","last_peered":"2024-01-21T21:31:36.555604+0000","last_clean":"2024-01-21T21:31:36.555604+0000","last_became_active":"2024-01-21T21:31:36.553456+0000","last_became_peered":"2024-01-21T21:31:36.553456+0000","last_unstale":"2024-01-21T21:31:36.555604+0000","last_undegraded":"2024-01-21T21:31:36.555604+0000","last_fullsized":"2024-01-21T21:31:36.555604+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535963+0000","last_change":"2024-01-21T21:31:36.169009+0000","last_active":"2024-01-21T21:31:36.535963+0000","last_peered":"2024-01-21T21:31:36.535963+0000","last_clean":"2024-01-21T21:31:36.535963+0000","last_became_active":"2024-01-21T21:31:36.168722+0000","last_became_peered":"2024-01-21T21:31:36.168722+0000","last_unstale":"2024-01-21T21:31:36.535963+0000","last_undegraded":"2024-01-21T21:31:36.535963+0000","last_fullsized":"2024-01-21T21:31:36.535963+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557586+0000","last_change":"2024-01-21T21:31:36.553976+0000","last_active":"2024-01-21T21:31:36.557586+0000","last_peered":"2024-01-21T21:31:36.557586+0000","last_clean":"2024-01-21T21:31:36.557586+0000","last_became_active":"2024-01-21T21:31:36.552683+0000","last_became_peered":"2024-01-21T21:31:36.552683+0000","last_unstale":"2024-01-21T21:31:36.557586+0000","last_undegraded":"2024-01-21T21:31:36.557586+0000","last_fullsized":"2024-01-21T21:31:36.557586+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.34","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557279+0000","last_change":"2024-01-21T21:31:36.176657+0000","last_active":"2024-01-21T21:31:36.557279+0000","last_peered":"2024-01-21T21:31:36.557279+0000","last_clean":"2024-01-21T21:31:36.557279+0000","last_became_active":"2024-01-21T21:31:36.176268+0000","last_became_peered":"2024-01-21T21:31:36.176268+0000","last_unstale":"2024-01-21T21:31:36.557279+0000","last_undegraded":"2024-01-21T21:31:36.557279+0000","last_fullsized":"2024-01-21T21:31:36.557279+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552518+0000","last_change":"2024-01-21T21:31:36.549906+0000","last_active":"2024-01-21T21:31:36.552518+0000","last_peered":"2024-01-21T21:31:36.552518+0000","last_clean":"2024-01-21T21:31:36.552518+0000","last_became_active":"2024-01-21T21:31:36.549646+0000","last_became_peered":"2024-01-21T21:31:36.549646+0000","last_unstale":"2024-01-21T21:31:36.552518+0000","last_undegraded":"2024-01-21T21:31:36.552518+0000","last_fullsized":"2024-01-21T21:31:36.552518+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.33","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.549631+0000","last_change":"2024-01-21T21:31:36.172651+0000","last_active":"2024-01-21T21:31:36.549631+0000","last_peered":"2024-01-21T21:31:36.549631+0000","last_clean":"2024-01-21T21:31:36.549631+0000","last_became_active":"2024-01-21T21:31:36.172364+0000","last_became_peered":"2024-01-21T21:31:36.172364+0000","last_unstale":"2024-01-21T21:31:36.549631+0000","last_undegraded":"2024-01-21T21:31:36.549631+0000","last_fullsized":"2024-01-21T21:31:36.549631+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557143+0000","last_change":"2024-01-21T21:31:36.552856+0000","last_active":"2024-01-21T21:31:36.557143+0000","last_peered":"2024-01-21T21:31:36.557143+0000","last_clean":"2024-01-21T21:31:36.557143+0000","last_became_active":"2024-01-21T21:31:36.551959+0000","last_became_peered":"2024-01-21T21:31:36.551959+0000","last_unstale":"2024-01-21T21:31:36.557143+0000","last_undegraded":"2024-01-21T21:31:36.557143+0000","last_fullsized":"2024-01-21T21:31:36.557143+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532381+0000","last_change":"2024-01-21T21:31:36.175486+0000","last_active":"2024-01-21T21:31:36.532381+0000","last_peered":"2024-01-21T21:31:36.532381+0000","last_clean":"2024-01-21T21:31:36.532381+0000","last_became_active":"2024-01-21T21:31:36.174579+0000","last_became_peered":"2024-01-21T21:31:36.174579+0000","last_unstale":"2024-01-21T21:31:36.532381+0000","last_undegraded":"2024-01-21T21:31:36.532381+0000","last_fullsized":"2024-01-21T21:31:36.532381+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547218+0000","last_change":"2024-01-21T21:31:36.545028+0000","last_active":"2024-01-21T21:31:36.547218+0000","last_peered":"2024-01-21T21:31:36.547218+0000","last_clean":"2024-01-21T21:31:36.547218+0000","last_became_active":"2024-01-21T21:31:36.544665+0000","last_became_peered":"2024-01-21T21:31:36.544665+0000","last_unstale":"2024-01-21T21:31:36.547218+0000","last_undegraded":"2024-01-21T21:31:36.547218+0000","last_fullsized":"2024-01-21T21:31:36.547218+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536733+0000","last_change":"2024-01-21T21:31:36.179272+0000","last_active":"2024-01-21T21:31:36.536733+0000","last_peered":"2024-01-21T21:31:36.536733+0000","last_clean":"2024-01-21T21:31:36.536733+0000","last_became_active":"2024-01-21T21:31:36.178970+0000","last_became_peered":"2024-01-21T21:31:36.178970+0000","last_unstale":"2024-01-21T21:31:36.536733+0000","last_undegraded":"2024-01-21T21:31:36.536733+0000","last_fullsized":"2024-01-21T21:31:36.536733+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556631+0000","last_change":"2024-01-21T21:31:36.553009+0000","last_active":"2024-01-21T21:31:36.556631+0000","last_peered":"2024-01-21T21:31:36.556631+0000","last_clean":"2024-01-21T21:31:36.556631+0000","last_became_active":"2024-01-21T21:31:36.551621+0000","last_became_peered":"2024-01-21T21:31:36.551621+0000","last_unstale":"2024-01-21T21:31:36.556631+0000","last_undegraded":"2024-01-21T21:31:36.556631+0000","last_fullsized":"2024-01-21T21:31:36.556631+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.30","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548876+0000","last_change":"2024-01-21T21:31:36.177467+0000","last_active":"2024-01-21T21:31:36.548876+0000","last_peered":"2024-01-21T21:31:36.548876+0000","last_clean":"2024-01-21T21:31:36.548876+0000","last_became_active":"2024-01-21T21:31:36.177061+0000","last_became_peered":"2024-01-21T21:31:36.177061+0000","last_unstale":"2024-01-21T21:31:36.548876+0000","last_undegraded":"2024-01-21T21:31:36.548876+0000","last_fullsized":"2024-01-21T21:31:36.548876+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546171+0000","last_change":"2024-01-21T21:31:36.544600+0000","last_active":"2024-01-21T21:31:36.546171+0000","last_peered":"2024-01-21T21:31:36.546171+0000","last_clean":"2024-01-21T21:31:36.546171+0000","last_became_active":"2024-01-21T21:31:36.544330+0000","last_became_peered":"2024-01-21T21:31:36.544330+0000","last_unstale":"2024-01-21T21:31:36.546171+0000","last_undegraded":"2024-01-21T21:31:36.546171+0000","last_fullsized":"2024-01-21T21:31:36.546171+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547248+0000","last_change":"2024-01-21T21:31:36.186710+0000","last_active":"2024-01-21T21:31:36.547248+0000","last_peered":"2024-01-21T21:31:36.547248+0000","last_clean":"2024-01-21T21:31:36.547248+0000","last_became_active":"2024-01-21T21:31:36.186382+0000","last_became_peered":"2024-01-21T21:31:36.186382+0000","last_unstale":"2024-01-21T21:31:36.547248+0000","last_undegraded":"2024-01-21T21:31:36.547248+0000","last_fullsized":"2024-01-21T21:31:36.547248+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556631+0000","last_change":"2024-01-21T21:31:36.543364+0000","last_active":"2024-01-21T21:31:36.556631+0000","last_peered":"2024-01-21T21:31:36.556631+0000","last_clean":"2024-01-21T21:31:36.556631+0000","last_became_active":"2024-01-21T21:31:36.543104+0000","last_became_peered":"2024-01-21T21:31:36.543104+0000","last_unstale":"2024-01-21T21:31:36.556631+0000","last_undegraded":"2024-01-21T21:31:36.556631+0000","last_fullsized":"2024-01-21T21:31:36.556631+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537425+0000","last_change":"2024-01-21T21:31:36.187589+0000","last_active":"2024-01-21T21:31:36.537425+0000","last_peered":"2024-01-21T21:31:36.537425+0000","last_clean":"2024-01-21T21:31:36.537425+0000","last_became_active":"2024-01-21T21:31:36.187287+0000","last_became_peered":"2024-01-21T21:31:36.187287+0000","last_unstale":"2024-01-21T21:31:36.537425+0000","last_undegraded":"2024-01-21T21:31:36.537425+0000","last_fullsized":"2024-01-21T21:31:36.537425+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547500+0000","last_change":"2024-01-21T21:31:36.546789+0000","last_active":"2024-01-21T21:31:36.547500+0000","last_peered":"2024-01-21T21:31:36.547500+0000","last_clean":"2024-01-21T21:31:36.547500+0000","last_became_active":"2024-01-21T21:31:36.546478+0000","last_became_peered":"2024-01-21T21:31:36.546478+0000","last_unstale":"2024-01-21T21:31:36.547500+0000","last_undegraded":"2024-01-21T21:31:36.547500+0000","last_fullsized":"2024-01-21T21:31:36.547500+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557626+0000","last_change":"2024-01-21T21:31:36.186780+0000","last_active":"2024-01-21T21:31:36.557626+0000","last_peered":"2024-01-21T21:31:36.557626+0000","last_clean":"2024-01-21T21:31:36.557626+0000","last_became_active":"2024-01-21T21:31:36.186417+0000","last_became_peered":"2024-01-21T21:31:36.186417+0000","last_unstale":"2024-01-21T21:31:36.557626+0000","last_undegraded":"2024-01-21T21:31:36.557626+0000","last_fullsized":"2024-01-21T21:31:36.557626+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555716+0000","last_change":"2024-01-21T21:31:36.553928+0000","last_active":"2024-01-21T21:31:36.555716+0000","last_peered":"2024-01-21T21:31:36.555716+0000","last_clean":"2024-01-21T21:31:36.555716+0000","last_became_active":"2024-01-21T21:31:36.553581+0000","last_became_peered":"2024-01-21T21:31:36.553581+0000","last_unstale":"2024-01-21T21:31:36.555716+0000","last_undegraded":"2024-01-21T21:31:36.555716+0000","last_fullsized":"2024-01-21T21:31:36.555716+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531189+0000","last_change":"2024-01-21T21:31:36.173433+0000","last_active":"2024-01-21T21:31:36.531189+0000","last_peered":"2024-01-21T21:31:36.531189+0000","last_clean":"2024-01-21T21:31:36.531189+0000","last_became_active":"2024-01-21T21:31:36.173190+0000","last_became_peered":"2024-01-21T21:31:36.173190+0000","last_unstale":"2024-01-21T21:31:36.531189+0000","last_undegraded":"2024-01-21T21:31:36.531189+0000","last_fullsized":"2024-01-21T21:31:36.531189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561970+0000","last_change":"2024-01-21T21:31:36.554110+0000","last_active":"2024-01-21T21:31:36.561970+0000","last_peered":"2024-01-21T21:31:36.561970+0000","last_clean":"2024-01-21T21:31:36.561970+0000","last_became_active":"2024-01-21T21:31:36.553500+0000","last_became_peered":"2024-01-21T21:31:36.553500+0000","last_unstale":"2024-01-21T21:31:36.561970+0000","last_undegraded":"2024-01-21T21:31:36.561970+0000","last_fullsized":"2024-01-21T21:31:36.561970+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556892+0000","last_change":"2024-01-21T21:31:36.166148+0000","last_active":"2024-01-21T21:31:36.556892+0000","last_peered":"2024-01-21T21:31:36.556892+0000","last_clean":"2024-01-21T21:31:36.556892+0000","last_became_active":"2024-01-21T21:31:36.165878+0000","last_became_peered":"2024-01-21T21:31:36.165878+0000","last_unstale":"2024-01-21T21:31:36.556892+0000","last_undegraded":"2024-01-21T21:31:36.556892+0000","last_fullsized":"2024-01-21T21:31:36.556892+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550879+0000","last_change":"2024-01-21T21:31:36.547810+0000","last_active":"2024-01-21T21:31:36.550879+0000","last_peered":"2024-01-21T21:31:36.550879+0000","last_clean":"2024-01-21T21:31:36.550879+0000","last_became_active":"2024-01-21T21:31:36.547512+0000","last_became_peered":"2024-01-21T21:31:36.547512+0000","last_unstale":"2024-01-21T21:31:36.550879+0000","last_undegraded":"2024-01-21T21:31:36.550879+0000","last_fullsized":"2024-01-21T21:31:36.550879+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539849+0000","last_change":"2024-01-21T21:31:36.171387+0000","last_active":"2024-01-21T21:31:36.539849+0000","last_peered":"2024-01-21T21:31:36.539849+0000","last_clean":"2024-01-21T21:31:36.539849+0000","last_became_active":"2024-01-21T21:31:36.171153+0000","last_became_peered":"2024-01-21T21:31:36.171153+0000","last_unstale":"2024-01-21T21:31:36.539849+0000","last_undegraded":"2024-01-21T21:31:36.539849+0000","last_fullsized":"2024-01-21T21:31:36.539849+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558272+0000","last_change":"2024-01-21T21:31:36.557233+0000","last_active":"2024-01-21T21:31:36.558272+0000","last_peered":"2024-01-21T21:31:36.558272+0000","last_clean":"2024-01-21T21:31:36.558272+0000","last_became_active":"2024-01-21T21:31:36.556972+0000","last_became_peered":"2024-01-21T21:31:36.556972+0000","last_unstale":"2024-01-21T21:31:36.558272+0000","last_undegraded":"2024-01-21T21:31:36.558272+0000","last_fullsized":"2024-01-21T21:31:36.558272+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547364+0000","last_change":"2024-01-21T21:31:36.187190+0000","last_active":"2024-01-21T21:31:36.547364+0000","last_peered":"2024-01-21T21:31:36.547364+0000","last_clean":"2024-01-21T21:31:36.547364+0000","last_became_active":"2024-01-21T21:31:36.186877+0000","last_became_peered":"2024-01-21T21:31:36.186877+0000","last_unstale":"2024-01-21T21:31:36.547364+0000","last_undegraded":"2024-01-21T21:31:36.547364+0000","last_fullsized":"2024-01-21T21:31:36.547364+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560902+0000","last_change":"2024-01-21T21:31:36.543886+0000","last_active":"2024-01-21T21:31:36.560902+0000","last_peered":"2024-01-21T21:31:36.560902+0000","last_clean":"2024-01-21T21:31:36.560902+0000","last_became_active":"2024-01-21T21:31:36.543593+0000","last_became_peered":"2024-01-21T21:31:36.543593+0000","last_unstale":"2024-01-21T21:31:36.560902+0000","last_undegraded":"2024-01-21T21:31:36.560902+0000","last_fullsized":"2024-01-21T21:31:36.560902+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536700+0000","last_change":"2024-01-21T21:31:36.167706+0000","last_active":"2024-01-21T21:31:36.536700+0000","last_peered":"2024-01-21T21:31:36.536700+0000","last_clean":"2024-01-21T21:31:36.536700+0000","last_became_active":"2024-01-21T21:31:36.167403+0000","last_became_peered":"2024-01-21T21:31:36.167403+0000","last_unstale":"2024-01-21T21:31:36.536700+0000","last_undegraded":"2024-01-21T21:31:36.536700+0000","last_fullsized":"2024-01-21T21:31:36.536700+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552400+0000","last_change":"2024-01-21T21:31:36.550085+0000","last_active":"2024-01-21T21:31:36.552400+0000","last_peered":"2024-01-21T21:31:36.552400+0000","last_clean":"2024-01-21T21:31:36.552400+0000","last_became_active":"2024-01-21T21:31:36.549490+0000","last_became_peered":"2024-01-21T21:31:36.549490+0000","last_unstale":"2024-01-21T21:31:36.552400+0000","last_undegraded":"2024-01-21T21:31:36.552400+0000","last_fullsized":"2024-01-21T21:31:36.552400+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532592+0000","last_change":"2024-01-21T21:31:36.170032+0000","last_active":"2024-01-21T21:31:36.532592+0000","last_peered":"2024-01-21T21:31:36.532592+0000","last_clean":"2024-01-21T21:31:36.532592+0000","last_became_active":"2024-01-21T21:31:36.169097+0000","last_became_peered":"2024-01-21T21:31:36.169097+0000","last_unstale":"2024-01-21T21:31:36.532592+0000","last_undegraded":"2024-01-21T21:31:36.532592+0000","last_fullsized":"2024-01-21T21:31:36.532592+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548461+0000","last_change":"2024-01-21T21:31:36.543358+0000","last_active":"2024-01-21T21:31:36.548461+0000","last_peered":"2024-01-21T21:31:36.548461+0000","last_clean":"2024-01-21T21:31:36.548461+0000","last_became_active":"2024-01-21T21:31:36.543126+0000","last_became_peered":"2024-01-21T21:31:36.543126+0000","last_unstale":"2024-01-21T21:31:36.548461+0000","last_undegraded":"2024-01-21T21:31:36.548461+0000","last_fullsized":"2024-01-21T21:31:36.548461+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.533988+0000","last_change":"2024-01-21T21:31:36.180646+0000","last_active":"2024-01-21T21:31:36.533988+0000","last_peered":"2024-01-21T21:31:36.533988+0000","last_clean":"2024-01-21T21:31:36.533988+0000","last_became_active":"2024-01-21T21:31:36.180347+0000","last_became_peered":"2024-01-21T21:31:36.180347+0000","last_unstale":"2024-01-21T21:31:36.533988+0000","last_undegraded":"2024-01-21T21:31:36.533988+0000","last_fullsized":"2024-01-21T21:31:36.533988+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550745+0000","last_change":"2024-01-21T21:31:36.548212+0000","last_active":"2024-01-21T21:31:36.550745+0000","last_peered":"2024-01-21T21:31:36.550745+0000","last_clean":"2024-01-21T21:31:36.550745+0000","last_became_active":"2024-01-21T21:31:36.547789+0000","last_became_peered":"2024-01-21T21:31:36.547789+0000","last_unstale":"2024-01-21T21:31:36.550745+0000","last_undegraded":"2024-01-21T21:31:36.550745+0000","last_fullsized":"2024-01-21T21:31:36.550745+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532030+0000","last_change":"2024-01-21T21:31:36.179346+0000","last_active":"2024-01-21T21:31:36.532030+0000","last_peered":"2024-01-21T21:31:36.532030+0000","last_clean":"2024-01-21T21:31:36.532030+0000","last_became_active":"2024-01-21T21:31:36.179055+0000","last_became_peered":"2024-01-21T21:31:36.179055+0000","last_unstale":"2024-01-21T21:31:36.532030+0000","last_undegraded":"2024-01-21T21:31:36.532030+0000","last_fullsized":"2024-01-21T21:31:36.532030+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561997+0000","last_change":"2024-01-21T21:31:36.554320+0000","last_active":"2024-01-21T21:31:36.561997+0000","last_peered":"2024-01-21T21:31:36.561997+0000","last_clean":"2024-01-21T21:31:36.561997+0000","last_became_active":"2024-01-21T21:31:36.553562+0000","last_became_peered":"2024-01-21T21:31:36.553562+0000","last_unstale":"2024-01-21T21:31:36.561997+0000","last_undegraded":"2024-01-21T21:31:36.561997+0000","last_fullsized":"2024-01-21T21:31:36.561997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532075+0000","last_change":"2024-01-21T21:31:36.178938+0000","last_active":"2024-01-21T21:31:36.532075+0000","last_peered":"2024-01-21T21:31:36.532075+0000","last_clean":"2024-01-21T21:31:36.532075+0000","last_became_active":"2024-01-21T21:31:36.175985+0000","last_became_peered":"2024-01-21T21:31:36.175985+0000","last_unstale":"2024-01-21T21:31:36.532075+0000","last_undegraded":"2024-01-21T21:31:36.532075+0000","last_fullsized":"2024-01-21T21:31:36.532075+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558190+0000","last_change":"2024-01-21T21:31:36.552807+0000","last_active":"2024-01-21T21:31:36.558190+0000","last_peered":"2024-01-21T21:31:36.558190+0000","last_clean":"2024-01-21T21:31:36.558190+0000","last_became_active":"2024-01-21T21:31:36.552576+0000","last_became_peered":"2024-01-21T21:31:36.552576+0000","last_unstale":"2024-01-21T21:31:36.558190+0000","last_undegraded":"2024-01-21T21:31:36.558190+0000","last_fullsized":"2024-01-21T21:31:36.558190+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532491+0000","last_change":"2024-01-21T21:31:36.176449+0000","last_active":"2024-01-21T21:31:36.532491+0000","last_peered":"2024-01-21T21:31:36.532491+0000","last_clean":"2024-01-21T21:31:36.532491+0000","last_became_active":"2024-01-21T21:31:36.176179+0000","last_became_peered":"2024-01-21T21:31:36.176179+0000","last_unstale":"2024-01-21T21:31:36.532491+0000","last_undegraded":"2024-01-21T21:31:36.532491+0000","last_fullsized":"2024-01-21T21:31:36.532491+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.557018+0000","last_change":"2024-01-21T21:31:36.552068+0000","last_active":"2024-01-21T21:31:36.557018+0000","last_peered":"2024-01-21T21:31:36.557018+0000","last_clean":"2024-01-21T21:31:36.557018+0000","last_became_active":"2024-01-21T21:31:36.551330+0000","last_became_peered":"2024-01-21T21:31:36.551330+0000","last_unstale":"2024-01-21T21:31:36.557018+0000","last_undegraded":"2024-01-21T21:31:36.557018+0000","last_fullsized":"2024-01-21T21:31:36.557018+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551393+0000","last_change":"2024-01-21T21:31:36.175304+0000","last_active":"2024-01-21T21:31:36.551393+0000","last_peered":"2024-01-21T21:31:36.551393+0000","last_clean":"2024-01-21T21:31:36.551393+0000","last_became_active":"2024-01-21T21:31:36.174999+0000","last_became_peered":"2024-01-21T21:31:36.174999+0000","last_unstale":"2024-01-21T21:31:36.551393+0000","last_undegraded":"2024-01-21T21:31:36.551393+0000","last_fullsized":"2024-01-21T21:31:36.551393+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555694+0000","last_change":"2024-01-21T21:31:36.553728+0000","last_active":"2024-01-21T21:31:36.555694+0000","last_peered":"2024-01-21T21:31:36.555694+0000","last_clean":"2024-01-21T21:31:36.555694+0000","last_became_active":"2024-01-21T21:31:36.553438+0000","last_became_peered":"2024-01-21T21:31:36.553438+0000","last_unstale":"2024-01-21T21:31:36.555694+0000","last_undegraded":"2024-01-21T21:31:36.555694+0000","last_fullsized":"2024-01-21T21:31:36.555694+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550503+0000","last_change":"2024-01-21T21:31:36.173327+0000","last_active":"2024-01-21T21:31:36.550503+0000","last_peered":"2024-01-21T21:31:36.550503+0000","last_clean":"2024-01-21T21:31:36.550503+0000","last_became_active":"2024-01-21T21:31:36.172684+0000","last_became_peered":"2024-01-21T21:31:36.172684+0000","last_unstale":"2024-01-21T21:31:36.550503+0000","last_undegraded":"2024-01-21T21:31:36.550503+0000","last_fullsized":"2024-01-21T21:31:36.550503+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554951+0000","last_change":"2024-01-21T21:31:36.549741+0000","last_active":"2024-01-21T21:31:36.554951+0000","last_peered":"2024-01-21T21:31:36.554951+0000","last_clean":"2024-01-21T21:31:36.554951+0000","last_became_active":"2024-01-21T21:31:36.544314+0000","last_became_peered":"2024-01-21T21:31:36.544314+0000","last_unstale":"2024-01-21T21:31:36.554951+0000","last_undegraded":"2024-01-21T21:31:36.554951+0000","last_fullsized":"2024-01-21T21:31:36.554951+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536665+0000","last_change":"2024-01-21T21:31:36.186877+0000","last_active":"2024-01-21T21:31:36.536665+0000","last_peered":"2024-01-21T21:31:36.536665+0000","last_clean":"2024-01-21T21:31:36.536665+0000","last_became_active":"2024-01-21T21:31:36.186610+0000","last_became_peered":"2024-01-21T21:31:36.186610+0000","last_unstale":"2024-01-21T21:31:36.536665+0000","last_undegraded":"2024-01-21T21:31:36.536665+0000","last_fullsized":"2024-01-21T21:31:36.536665+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551375+0000","last_change":"2024-01-21T21:31:36.549049+0000","last_active":"2024-01-21T21:31:36.551375+0000","last_peered":"2024-01-21T21:31:36.551375+0000","last_clean":"2024-01-21T21:31:36.551375+0000","last_became_active":"2024-01-21T21:31:36.547704+0000","last_became_peered":"2024-01-21T21:31:36.547704+0000","last_unstale":"2024-01-21T21:31:36.551375+0000","last_undegraded":"2024-01-21T21:31:36.551375+0000","last_fullsized":"2024-01-21T21:31:36.551375+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.562161+0000","last_change":"2024-01-21T21:31:36.165840+0000","last_active":"2024-01-21T21:31:36.562161+0000","last_peered":"2024-01-21T21:31:36.562161+0000","last_clean":"2024-01-21T21:31:36.562161+0000","last_became_active":"2024-01-21T21:31:36.165517+0000","last_became_peered":"2024-01-21T21:31:36.165517+0000","last_unstale":"2024-01-21T21:31:36.562161+0000","last_undegraded":"2024-01-21T21:31:36.562161+0000","last_fullsized":"2024-01-21T21:31:36.562161+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560945+0000","last_change":"2024-01-21T21:31:36.544211+0000","last_active":"2024-01-21T21:31:36.560945+0000","last_peered":"2024-01-21T21:31:36.560945+0000","last_clean":"2024-01-21T21:31:36.560945+0000","last_became_active":"2024-01-21T21:31:36.543942+0000","last_became_peered":"2024-01-21T21:31:36.543942+0000","last_unstale":"2024-01-21T21:31:36.560945+0000","last_undegraded":"2024-01-21T21:31:36.560945+0000","last_fullsized":"2024-01-21T21:31:36.560945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551900+0000","last_change":"2024-01-21T21:31:36.180618+0000","last_active":"2024-01-21T21:31:36.551900+0000","last_peered":"2024-01-21T21:31:36.551900+0000","last_clean":"2024-01-21T21:31:36.551900+0000","last_became_active":"2024-01-21T21:31:36.180338+0000","last_became_peered":"2024-01-21T21:31:36.180338+0000","last_unstale":"2024-01-21T21:31:36.551900+0000","last_undegraded":"2024-01-21T21:31:36.551900+0000","last_fullsized":"2024-01-21T21:31:36.551900+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.553781+0000","last_change":"2024-01-21T21:31:36.548291+0000","last_active":"2024-01-21T21:31:36.553781+0000","last_peered":"2024-01-21T21:31:36.553781+0000","last_clean":"2024-01-21T21:31:36.553781+0000","last_became_active":"2024-01-21T21:31:36.548007+0000","last_became_peered":"2024-01-21T21:31:36.548007+0000","last_unstale":"2024-01-21T21:31:36.553781+0000","last_undegraded":"2024-01-21T21:31:36.553781+0000","last_fullsized":"2024-01-21T21:31:36.553781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556683+0000","last_change":"2024-01-21T21:31:36.187695+0000","last_active":"2024-01-21T21:31:36.556683+0000","last_peered":"2024-01-21T21:31:36.556683+0000","last_clean":"2024-01-21T21:31:36.556683+0000","last_became_active":"2024-01-21T21:31:36.187230+0000","last_became_peered":"2024-01-21T21:31:36.187230+0000","last_unstale":"2024-01-21T21:31:36.556683+0000","last_undegraded":"2024-01-21T21:31:36.556683+0000","last_fullsized":"2024-01-21T21:31:36.556683+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550558+0000","last_change":"2024-01-21T21:31:36.548838+0000","last_active":"2024-01-21T21:31:36.550558+0000","last_peered":"2024-01-21T21:31:36.550558+0000","last_clean":"2024-01-21T21:31:36.550558+0000","last_became_active":"2024-01-21T21:31:36.547760+0000","last_became_peered":"2024-01-21T21:31:36.547760+0000","last_unstale":"2024-01-21T21:31:36.550558+0000","last_undegraded":"2024-01-21T21:31:36.550558+0000","last_fullsized":"2024-01-21T21:31:36.550558+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546072+0000","last_change":"2024-01-21T21:31:36.187117+0000","last_active":"2024-01-21T21:31:36.546072+0000","last_peered":"2024-01-21T21:31:36.546072+0000","last_clean":"2024-01-21T21:31:36.546072+0000","last_became_active":"2024-01-21T21:31:36.186816+0000","last_became_peered":"2024-01-21T21:31:36.186816+0000","last_unstale":"2024-01-21T21:31:36.546072+0000","last_undegraded":"2024-01-21T21:31:36.546072+0000","last_fullsized":"2024-01-21T21:31:36.546072+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555127+0000","last_change":"2024-01-21T21:31:36.549734+0000","last_active":"2024-01-21T21:31:36.555127+0000","last_peered":"2024-01-21T21:31:36.555127+0000","last_clean":"2024-01-21T21:31:36.555127+0000","last_became_active":"2024-01-21T21:31:36.549449+0000","last_became_peered":"2024-01-21T21:31:36.549449+0000","last_unstale":"2024-01-21T21:31:36.555127+0000","last_undegraded":"2024-01-21T21:31:36.555127+0000","last_fullsized":"2024-01-21T21:31:36.555127+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531385+0000","last_change":"2024-01-21T21:31:36.177225+0000","last_active":"2024-01-21T21:31:36.531385+0000","last_peered":"2024-01-21T21:31:36.531385+0000","last_clean":"2024-01-21T21:31:36.531385+0000","last_became_active":"2024-01-21T21:31:36.175755+0000","last_became_peered":"2024-01-21T21:31:36.175755+0000","last_unstale":"2024-01-21T21:31:36.531385+0000","last_undegraded":"2024-01-21T21:31:36.531385+0000","last_fullsized":"2024-01-21T21:31:36.531385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.562798+0000","last_change":"2024-01-21T21:31:36.561515+0000","last_active":"2024-01-21T21:31:36.562798+0000","last_peered":"2024-01-21T21:31:36.562798+0000","last_clean":"2024-01-21T21:31:36.562798+0000","last_became_active":"2024-01-21T21:31:36.561236+0000","last_became_peered":"2024-01-21T21:31:36.561236+0000","last_unstale":"2024-01-21T21:31:36.562798+0000","last_undegraded":"2024-01-21T21:31:36.562798+0000","last_fullsized":"2024-01-21T21:31:36.562798+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534405+0000","last_change":"2024-01-21T21:31:36.169232+0000","last_active":"2024-01-21T21:31:36.534405+0000","last_peered":"2024-01-21T21:31:36.534405+0000","last_clean":"2024-01-21T21:31:36.534405+0000","last_became_active":"2024-01-21T21:31:36.168960+0000","last_became_peered":"2024-01-21T21:31:36.168960+0000","last_unstale":"2024-01-21T21:31:36.534405+0000","last_undegraded":"2024-01-21T21:31:36.534405+0000","last_fullsized":"2024-01-21T21:31:36.534405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552781+0000","last_change":"2024-01-21T21:31:36.547755+0000","last_active":"2024-01-21T21:31:36.552781+0000","last_peered":"2024-01-21T21:31:36.552781+0000","last_clean":"2024-01-21T21:31:36.552781+0000","last_became_active":"2024-01-21T21:31:36.547506+0000","last_became_peered":"2024-01-21T21:31:36.547506+0000","last_unstale":"2024-01-21T21:31:36.552781+0000","last_undegraded":"2024-01-21T21:31:36.552781+0000","last_fullsized":"2024-01-21T21:31:36.552781+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546520+0000","last_change":"2024-01-21T21:31:36.186613+0000","last_active":"2024-01-21T21:31:36.546520+0000","last_peered":"2024-01-21T21:31:36.546520+0000","last_clean":"2024-01-21T21:31:36.546520+0000","last_became_active":"2024-01-21T21:31:36.186293+0000","last_became_peered":"2024-01-21T21:31:36.186293+0000","last_unstale":"2024-01-21T21:31:36.546520+0000","last_undegraded":"2024-01-21T21:31:36.546520+0000","last_fullsized":"2024-01-21T21:31:36.546520+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555159+0000","last_change":"2024-01-21T21:31:36.550838+0000","last_active":"2024-01-21T21:31:36.555159+0000","last_peered":"2024-01-21T21:31:36.555159+0000","last_clean":"2024-01-21T21:31:36.555159+0000","last_became_active":"2024-01-21T21:31:36.550541+0000","last_became_peered":"2024-01-21T21:31:36.550541+0000","last_unstale":"2024-01-21T21:31:36.555159+0000","last_undegraded":"2024-01-21T21:31:36.555159+0000","last_fullsized":"2024-01-21T21:31:36.555159+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.531027+0000","last_change":"2024-01-21T21:31:36.177501+0000","last_active":"2024-01-21T21:31:36.531027+0000","last_peered":"2024-01-21T21:31:36.531027+0000","last_clean":"2024-01-21T21:31:36.531027+0000","last_became_active":"2024-01-21T21:31:36.177196+0000","last_became_peered":"2024-01-21T21:31:36.177196+0000","last_unstale":"2024-01-21T21:31:36.531027+0000","last_undegraded":"2024-01-21T21:31:36.531027+0000","last_fullsized":"2024-01-21T21:31:36.531027+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555031+0000","last_change":"2024-01-21T21:31:36.550917+0000","last_active":"2024-01-21T21:31:36.555031+0000","last_peered":"2024-01-21T21:31:36.555031+0000","last_clean":"2024-01-21T21:31:36.555031+0000","last_became_active":"2024-01-21T21:31:36.550637+0000","last_became_peered":"2024-01-21T21:31:36.550637+0000","last_unstale":"2024-01-21T21:31:36.555031+0000","last_undegraded":"2024-01-21T21:31:36.555031+0000","last_fullsized":"2024-01-21T21:31:36.555031+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556808+0000","last_change":"2024-01-21T21:31:36.166455+0000","last_active":"2024-01-21T21:31:36.556808+0000","last_peered":"2024-01-21T21:31:36.556808+0000","last_clean":"2024-01-21T21:31:36.556808+0000","last_became_active":"2024-01-21T21:31:36.166148+0000","last_became_peered":"2024-01-21T21:31:36.166148+0000","last_unstale":"2024-01-21T21:31:36.556808+0000","last_undegraded":"2024-01-21T21:31:36.556808+0000","last_fullsized":"2024-01-21T21:31:36.556808+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546125+0000","last_change":"2024-01-21T21:31:36.544404+0000","last_active":"2024-01-21T21:31:36.546125+0000","last_peered":"2024-01-21T21:31:36.546125+0000","last_clean":"2024-01-21T21:31:36.546125+0000","last_became_active":"2024-01-21T21:31:36.543742+0000","last_became_peered":"2024-01-21T21:31:36.543742+0000","last_unstale":"2024-01-21T21:31:36.546125+0000","last_undegraded":"2024-01-21T21:31:36.546125+0000","last_fullsized":"2024-01-21T21:31:36.546125+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550780+0000","last_change":"2024-01-21T21:31:36.190145+0000","last_active":"2024-01-21T21:31:36.550780+0000","last_peered":"2024-01-21T21:31:36.550780+0000","last_clean":"2024-01-21T21:31:36.550780+0000","last_became_active":"2024-01-21T21:31:36.189792+0000","last_became_peered":"2024-01-21T21:31:36.189792+0000","last_unstale":"2024-01-21T21:31:36.550780+0000","last_undegraded":"2024-01-21T21:31:36.550780+0000","last_fullsized":"2024-01-21T21:31:36.550780+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.543273+0000","last_change":"2024-01-21T21:31:36.542444+0000","last_active":"2024-01-21T21:31:36.543273+0000","last_peered":"2024-01-21T21:31:36.543273+0000","last_clean":"2024-01-21T21:31:36.543273+0000","last_became_active":"2024-01-21T21:31:36.542141+0000","last_became_peered":"2024-01-21T21:31:36.542141+0000","last_unstale":"2024-01-21T21:31:36.543273+0000","last_undegraded":"2024-01-21T21:31:36.543273+0000","last_fullsized":"2024-01-21T21:31:36.543273+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534800+0000","last_change":"2024-01-21T21:31:36.172736+0000","last_active":"2024-01-21T21:31:36.534800+0000","last_peered":"2024-01-21T21:31:36.534800+0000","last_clean":"2024-01-21T21:31:36.534800+0000","last_became_active":"2024-01-21T21:31:36.172403+0000","last_became_peered":"2024-01-21T21:31:36.172403+0000","last_unstale":"2024-01-21T21:31:36.534800+0000","last_undegraded":"2024-01-21T21:31:36.534800+0000","last_fullsized":"2024-01-21T21:31:36.534800+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556744+0000","last_change":"2024-01-21T21:31:36.548797+0000","last_active":"2024-01-21T21:31:36.556744+0000","last_peered":"2024-01-21T21:31:36.556744+0000","last_clean":"2024-01-21T21:31:36.556744+0000","last_became_active":"2024-01-21T21:31:36.548509+0000","last_became_peered":"2024-01-21T21:31:36.548509+0000","last_unstale":"2024-01-21T21:31:36.556744+0000","last_undegraded":"2024-01-21T21:31:36.556744+0000","last_fullsized":"2024-01-21T21:31:36.556744+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532171+0000","last_change":"2024-01-21T21:31:36.178936+0000","last_active":"2024-01-21T21:31:36.532171+0000","last_peered":"2024-01-21T21:31:36.532171+0000","last_clean":"2024-01-21T21:31:36.532171+0000","last_became_active":"2024-01-21T21:31:36.175956+0000","last_became_peered":"2024-01-21T21:31:36.175956+0000","last_unstale":"2024-01-21T21:31:36.532171+0000","last_undegraded":"2024-01-21T21:31:36.532171+0000","last_fullsized":"2024-01-21T21:31:36.532171+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561955+0000","last_change":"2024-01-21T21:31:36.553794+0000","last_active":"2024-01-21T21:31:36.561955+0000","last_peered":"2024-01-21T21:31:36.561955+0000","last_clean":"2024-01-21T21:31:36.561955+0000","last_became_active":"2024-01-21T21:31:36.553484+0000","last_became_peered":"2024-01-21T21:31:36.553484+0000","last_unstale":"2024-01-21T21:31:36.561955+0000","last_undegraded":"2024-01-21T21:31:36.561955+0000","last_fullsized":"2024-01-21T21:31:36.561955+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.547774+0000","last_change":"2024-01-21T21:31:36.177856+0000","last_active":"2024-01-21T21:31:36.547774+0000","last_peered":"2024-01-21T21:31:36.547774+0000","last_clean":"2024-01-21T21:31:36.547774+0000","last_became_active":"2024-01-21T21:31:36.177529+0000","last_became_peered":"2024-01-21T21:31:36.177529+0000","last_unstale":"2024-01-21T21:31:36.547774+0000","last_undegraded":"2024-01-21T21:31:36.547774+0000","last_fullsized":"2024-01-21T21:31:36.547774+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550019+0000","last_change":"2024-01-21T21:31:36.545774+0000","last_active":"2024-01-21T21:31:36.550019+0000","last_peered":"2024-01-21T21:31:36.550019+0000","last_clean":"2024-01-21T21:31:36.550019+0000","last_became_active":"2024-01-21T21:31:36.545492+0000","last_became_peered":"2024-01-21T21:31:36.545492+0000","last_unstale":"2024-01-21T21:31:36.550019+0000","last_undegraded":"2024-01-21T21:31:36.550019+0000","last_fullsized":"2024-01-21T21:31:36.550019+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532610+0000","last_change":"2024-01-21T21:31:36.172599+0000","last_active":"2024-01-21T21:31:36.532610+0000","last_peered":"2024-01-21T21:31:36.532610+0000","last_clean":"2024-01-21T21:31:36.532610+0000","last_became_active":"2024-01-21T21:31:36.172312+0000","last_became_peered":"2024-01-21T21:31:36.172312+0000","last_unstale":"2024-01-21T21:31:36.532610+0000","last_undegraded":"2024-01-21T21:31:36.532610+0000","last_fullsized":"2024-01-21T21:31:36.532610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548416+0000","last_change":"2024-01-21T21:31:36.544497+0000","last_active":"2024-01-21T21:31:36.548416+0000","last_peered":"2024-01-21T21:31:36.548416+0000","last_clean":"2024-01-21T21:31:36.548416+0000","last_became_active":"2024-01-21T21:31:36.544261+0000","last_became_peered":"2024-01-21T21:31:36.544261+0000","last_unstale":"2024-01-21T21:31:36.548416+0000","last_undegraded":"2024-01-21T21:31:36.548416+0000","last_fullsized":"2024-01-21T21:31:36.548416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546536+0000","last_change":"2024-01-21T21:31:36.167539+0000","last_active":"2024-01-21T21:31:36.546536+0000","last_peered":"2024-01-21T21:31:36.546536+0000","last_clean":"2024-01-21T21:31:36.546536+0000","last_became_active":"2024-01-21T21:31:36.167290+0000","last_became_peered":"2024-01-21T21:31:36.167290+0000","last_unstale":"2024-01-21T21:31:36.546536+0000","last_undegraded":"2024-01-21T21:31:36.546536+0000","last_fullsized":"2024-01-21T21:31:36.546536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551787+0000","last_change":"2024-01-21T21:31:36.549699+0000","last_active":"2024-01-21T21:31:36.551787+0000","last_peered":"2024-01-21T21:31:36.551787+0000","last_clean":"2024-01-21T21:31:36.551787+0000","last_became_active":"2024-01-21T21:31:36.549445+0000","last_became_peered":"2024-01-21T21:31:36.549445+0000","last_unstale":"2024-01-21T21:31:36.551787+0000","last_undegraded":"2024-01-21T21:31:36.551787+0000","last_fullsized":"2024-01-21T21:31:36.551787+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539501+0000","last_change":"2024-01-21T21:31:36.176339+0000","last_active":"2024-01-21T21:31:36.539501+0000","last_peered":"2024-01-21T21:31:36.539501+0000","last_clean":"2024-01-21T21:31:36.539501+0000","last_became_active":"2024-01-21T21:31:36.176010+0000","last_became_peered":"2024-01-21T21:31:36.176010+0000","last_unstale":"2024-01-21T21:31:36.539501+0000","last_undegraded":"2024-01-21T21:31:36.539501+0000","last_fullsized":"2024-01-21T21:31:36.539501+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.542607+0000","last_change":"2024-01-21T21:31:36.540080+0000","last_active":"2024-01-21T21:31:36.542607+0000","last_peered":"2024-01-21T21:31:36.542607+0000","last_clean":"2024-01-21T21:31:36.542607+0000","last_became_active":"2024-01-21T21:31:36.539770+0000","last_became_peered":"2024-01-21T21:31:36.539770+0000","last_unstale":"2024-01-21T21:31:36.542607+0000","last_undegraded":"2024-01-21T21:31:36.542607+0000","last_fullsized":"2024-01-21T21:31:36.542607+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.545035+0000","last_change":"2024-01-21T21:31:36.171201+0000","last_active":"2024-01-21T21:31:36.545035+0000","last_peered":"2024-01-21T21:31:36.545035+0000","last_clean":"2024-01-21T21:31:36.545035+0000","last_became_active":"2024-01-21T21:31:36.170811+0000","last_became_peered":"2024-01-21T21:31:36.170811+0000","last_unstale":"2024-01-21T21:31:36.545035+0000","last_undegraded":"2024-01-21T21:31:36.545035+0000","last_fullsized":"2024-01-21T21:31:36.545035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.554804+0000","last_change":"2024-01-21T21:31:36.549220+0000","last_active":"2024-01-21T21:31:36.554804+0000","last_peered":"2024-01-21T21:31:36.554804+0000","last_clean":"2024-01-21T21:31:36.554804+0000","last_became_active":"2024-01-21T21:31:36.548983+0000","last_became_peered":"2024-01-21T21:31:36.548983+0000","last_unstale":"2024-01-21T21:31:36.554804+0000","last_undegraded":"2024-01-21T21:31:36.554804+0000","last_fullsized":"2024-01-21T21:31:36.554804+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537606+0000","last_change":"2024-01-21T21:31:36.182472+0000","last_active":"2024-01-21T21:31:36.537606+0000","last_peered":"2024-01-21T21:31:36.537606+0000","last_clean":"2024-01-21T21:31:36.537606+0000","last_became_active":"2024-01-21T21:31:36.182026+0000","last_became_peered":"2024-01-21T21:31:36.182026+0000","last_unstale":"2024-01-21T21:31:36.537606+0000","last_undegraded":"2024-01-21T21:31:36.537606+0000","last_fullsized":"2024-01-21T21:31:36.537606+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548980+0000","last_change":"2024-01-21T21:31:36.545890+0000","last_active":"2024-01-21T21:31:36.548980+0000","last_peered":"2024-01-21T21:31:36.548980+0000","last_clean":"2024-01-21T21:31:36.548980+0000","last_became_active":"2024-01-21T21:31:36.545633+0000","last_became_peered":"2024-01-21T21:31:36.545633+0000","last_unstale":"2024-01-21T21:31:36.548980+0000","last_undegraded":"2024-01-21T21:31:36.548980+0000","last_fullsized":"2024-01-21T21:31:36.548980+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537336+0000","last_change":"2024-01-21T21:31:36.174723+0000","last_active":"2024-01-21T21:31:36.537336+0000","last_peered":"2024-01-21T21:31:36.537336+0000","last_clean":"2024-01-21T21:31:36.537336+0000","last_became_active":"2024-01-21T21:31:36.174423+0000","last_became_peered":"2024-01-21T21:31:36.174423+0000","last_unstale":"2024-01-21T21:31:36.537336+0000","last_undegraded":"2024-01-21T21:31:36.537336+0000","last_fullsized":"2024-01-21T21:31:36.537336+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.555068+0000","last_change":"2024-01-21T21:31:36.551270+0000","last_active":"2024-01-21T21:31:36.555068+0000","last_peered":"2024-01-21T21:31:36.555068+0000","last_clean":"2024-01-21T21:31:36.555068+0000","last_became_active":"2024-01-21T21:31:36.550998+0000","last_became_peered":"2024-01-21T21:31:36.550998+0000","last_unstale":"2024-01-21T21:31:36.555068+0000","last_undegraded":"2024-01-21T21:31:36.555068+0000","last_fullsized":"2024-01-21T21:31:36.555068+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546164+0000","last_change":"2024-01-21T21:31:36.186853+0000","last_active":"2024-01-21T21:31:36.546164+0000","last_peered":"2024-01-21T21:31:36.546164+0000","last_clean":"2024-01-21T21:31:36.546164+0000","last_became_active":"2024-01-21T21:31:36.186450+0000","last_became_peered":"2024-01-21T21:31:36.186450+0000","last_unstale":"2024-01-21T21:31:36.546164+0000","last_undegraded":"2024-01-21T21:31:36.546164+0000","last_fullsized":"2024-01-21T21:31:36.546164+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.556368+0000","last_change":"2024-01-21T21:31:36.552490+0000","last_active":"2024-01-21T21:31:36.556368+0000","last_peered":"2024-01-21T21:31:36.556368+0000","last_clean":"2024-01-21T21:31:36.556368+0000","last_became_active":"2024-01-21T21:31:36.552009+0000","last_became_peered":"2024-01-21T21:31:36.552009+0000","last_unstale":"2024-01-21T21:31:36.556368+0000","last_undegraded":"2024-01-21T21:31:36.556368+0000","last_fullsized":"2024-01-21T21:31:36.556368+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551286+0000","last_change":"2024-01-21T21:31:36.172774+0000","last_active":"2024-01-21T21:31:36.551286+0000","last_peered":"2024-01-21T21:31:36.551286+0000","last_clean":"2024-01-21T21:31:36.551286+0000","last_became_active":"2024-01-21T21:31:36.172451+0000","last_became_peered":"2024-01-21T21:31:36.172451+0000","last_unstale":"2024-01-21T21:31:36.551286+0000","last_undegraded":"2024-01-21T21:31:36.551286+0000","last_fullsized":"2024-01-21T21:31:36.551286+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548003+0000","last_change":"2024-01-21T21:31:36.546055+0000","last_active":"2024-01-21T21:31:36.548003+0000","last_peered":"2024-01-21T21:31:36.548003+0000","last_clean":"2024-01-21T21:31:36.548003+0000","last_became_active":"2024-01-21T21:31:36.545761+0000","last_became_peered":"2024-01-21T21:31:36.545761+0000","last_unstale":"2024-01-21T21:31:36.548003+0000","last_undegraded":"2024-01-21T21:31:36.548003+0000","last_fullsized":"2024-01-21T21:31:36.548003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536851+0000","last_change":"2024-01-21T21:31:36.188064+0000","last_active":"2024-01-21T21:31:36.536851+0000","last_peered":"2024-01-21T21:31:36.536851+0000","last_clean":"2024-01-21T21:31:36.536851+0000","last_became_active":"2024-01-21T21:31:36.187906+0000","last_became_peered":"2024-01-21T21:31:36.187906+0000","last_unstale":"2024-01-21T21:31:36.536851+0000","last_undegraded":"2024-01-21T21:31:36.536851+0000","last_fullsized":"2024-01-21T21:31:36.536851+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561940+0000","last_change":"2024-01-21T21:31:36.553681+0000","last_active":"2024-01-21T21:31:36.561940+0000","last_peered":"2024-01-21T21:31:36.561940+0000","last_clean":"2024-01-21T21:31:36.561940+0000","last_became_active":"2024-01-21T21:31:36.553400+0000","last_became_peered":"2024-01-21T21:31:36.553400+0000","last_unstale":"2024-01-21T21:31:36.561940+0000","last_undegraded":"2024-01-21T21:31:36.561940+0000","last_fullsized":"2024-01-21T21:31:36.561940+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532820+0000","last_change":"2024-01-21T21:31:36.187970+0000","last_active":"2024-01-21T21:31:36.532820+0000","last_peered":"2024-01-21T21:31:36.532820+0000","last_clean":"2024-01-21T21:31:36.532820+0000","last_became_active":"2024-01-21T21:31:36.187441+0000","last_became_peered":"2024-01-21T21:31:36.187441+0000","last_unstale":"2024-01-21T21:31:36.532820+0000","last_undegraded":"2024-01-21T21:31:36.532820+0000","last_fullsized":"2024-01-21T21:31:36.532820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558072+0000","last_change":"2024-01-21T21:31:36.550713+0000","last_active":"2024-01-21T21:31:36.558072+0000","last_peered":"2024-01-21T21:31:36.558072+0000","last_clean":"2024-01-21T21:31:36.558072+0000","last_became_active":"2024-01-21T21:31:36.550406+0000","last_became_peered":"2024-01-21T21:31:36.550406+0000","last_unstale":"2024-01-21T21:31:36.558072+0000","last_undegraded":"2024-01-21T21:31:36.558072+0000","last_fullsized":"2024-01-21T21:31:36.558072+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.530459+0000","last_change":"2024-01-21T21:31:36.177332+0000","last_active":"2024-01-21T21:31:36.530459+0000","last_peered":"2024-01-21T21:31:36.530459+0000","last_clean":"2024-01-21T21:31:36.530459+0000","last_became_active":"2024-01-21T21:31:36.176707+0000","last_became_peered":"2024-01-21T21:31:36.176707+0000","last_unstale":"2024-01-21T21:31:36.530459+0000","last_undegraded":"2024-01-21T21:31:36.530459+0000","last_fullsized":"2024-01-21T21:31:36.530459+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.543424+0000","last_change":"2024-01-21T21:31:36.542727+0000","last_active":"2024-01-21T21:31:36.543424+0000","last_peered":"2024-01-21T21:31:36.543424+0000","last_clean":"2024-01-21T21:31:36.543424+0000","last_became_active":"2024-01-21T21:31:36.542429+0000","last_became_peered":"2024-01-21T21:31:36.542429+0000","last_unstale":"2024-01-21T21:31:36.543424+0000","last_undegraded":"2024-01-21T21:31:36.543424+0000","last_fullsized":"2024-01-21T21:31:36.543424+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532830+0000","last_change":"2024-01-21T21:31:36.169923+0000","last_active":"2024-01-21T21:31:36.532830+0000","last_peered":"2024-01-21T21:31:36.532830+0000","last_clean":"2024-01-21T21:31:36.532830+0000","last_became_active":"2024-01-21T21:31:36.169580+0000","last_became_peered":"2024-01-21T21:31:36.169580+0000","last_unstale":"2024-01-21T21:31:36.532830+0000","last_undegraded":"2024-01-21T21:31:36.532830+0000","last_fullsized":"2024-01-21T21:31:36.532830+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":160,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532159+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:31:36.532159+0000","last_peered":"2024-01-21T21:31:36.532159+0000","last_clean":"2024-01-21T21:31:36.532159+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:31:36.532159+0000","last_undegraded":"2024-01-21T21:31:36.532159+0000","last_fullsized":"2024-01-21T21:31:36.532159+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.548918+0000","last_change":"2024-01-21T21:31:36.546199+0000","last_active":"2024-01-21T21:31:36.548918+0000","last_peered":"2024-01-21T21:31:36.548918+0000","last_clean":"2024-01-21T21:31:36.548918+0000","last_became_active":"2024-01-21T21:31:36.545911+0000","last_became_peered":"2024-01-21T21:31:36.545911+0000","last_unstale":"2024-01-21T21:31:36.548918+0000","last_undegraded":"2024-01-21T21:31:36.548918+0000","last_fullsized":"2024-01-21T21:31:36.548918+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537879+0000","last_change":"2024-01-21T21:31:36.178261+0000","last_active":"2024-01-21T21:31:36.537879+0000","last_peered":"2024-01-21T21:31:36.537879+0000","last_clean":"2024-01-21T21:31:36.537879+0000","last_became_active":"2024-01-21T21:31:36.177980+0000","last_became_peered":"2024-01-21T21:31:36.177980+0000","last_unstale":"2024-01-21T21:31:36.537879+0000","last_undegraded":"2024-01-21T21:31:36.537879+0000","last_fullsized":"2024-01-21T21:31:36.537879+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532598+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:31:36.532598+0000","last_peered":"2024-01-21T21:31:36.532598+0000","last_clean":"2024-01-21T21:31:36.532598+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:31:36.532598+0000","last_undegraded":"2024-01-21T21:31:36.532598+0000","last_fullsized":"2024-01-21T21:31:36.532598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.558059+0000","last_change":"2024-01-21T21:31:36.550640+0000","last_active":"2024-01-21T21:31:36.558059+0000","last_peered":"2024-01-21T21:31:36.558059+0000","last_clean":"2024-01-21T21:31:36.558059+0000","last_became_active":"2024-01-21T21:31:36.550375+0000","last_became_peered":"2024-01-21T21:31:36.550375+0000","last_unstale":"2024-01-21T21:31:36.558059+0000","last_undegraded":"2024-01-21T21:31:36.558059+0000","last_fullsized":"2024-01-21T21:31:36.558059+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.561067+0000","last_change":"2024-01-21T21:31:36.179322+0000","last_active":"2024-01-21T21:31:36.561067+0000","last_peered":"2024-01-21T21:31:36.561067+0000","last_clean":"2024-01-21T21:31:36.561067+0000","last_became_active":"2024-01-21T21:31:36.179049+0000","last_became_peered":"2024-01-21T21:31:36.179049+0000","last_unstale":"2024-01-21T21:31:36.561067+0000","last_undegraded":"2024-01-21T21:31:36.561067+0000","last_fullsized":"2024-01-21T21:31:36.561067+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":166,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546400+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:31:36.546400+0000","last_peered":"2024-01-21T21:31:36.546400+0000","last_clean":"2024-01-21T21:31:36.546400+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:31:36.546400+0000","last_undegraded":"2024-01-21T21:31:36.546400+0000","last_fullsized":"2024-01-21T21:31:36.546400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.551589+0000","last_change":"2024-01-21T21:31:36.546318+0000","last_active":"2024-01-21T21:31:36.551589+0000","last_peered":"2024-01-21T21:31:36.551589+0000","last_clean":"2024-01-21T21:31:36.551589+0000","last_became_active":"2024-01-21T21:31:36.545986+0000","last_became_peered":"2024-01-21T21:31:36.545986+0000","last_unstale":"2024-01-21T21:31:36.551589+0000","last_undegraded":"2024-01-21T21:31:36.551589+0000","last_fullsized":"2024-01-21T21:31:36.551589+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.537516+0000","last_change":"2024-01-21T21:31:36.182338+0000","last_active":"2024-01-21T21:31:36.537516+0000","last_peered":"2024-01-21T21:31:36.537516+0000","last_clean":"2024-01-21T21:31:36.537516+0000","last_became_active":"2024-01-21T21:31:36.181623+0000","last_became_peered":"2024-01-21T21:31:36.181623+0000","last_unstale":"2024-01-21T21:31:36.537516+0000","last_undegraded":"2024-01-21T21:31:36.537516+0000","last_fullsized":"2024-01-21T21:31:36.537516+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.532476+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:31:36.532476+0000","last_peered":"2024-01-21T21:31:36.532476+0000","last_clean":"2024-01-21T21:31:36.532476+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:31:36.532476+0000","last_undegraded":"2024-01-21T21:31:36.532476+0000","last_fullsized":"2024-01-21T21:31:36.532476+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":158,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539587+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:31:36.539587+0000","last_peered":"2024-01-21T21:31:36.539587+0000","last_clean":"2024-01-21T21:31:36.539587+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:31:36.539587+0000","last_undegraded":"2024-01-21T21:31:36.539587+0000","last_fullsized":"2024-01-21T21:31:36.539587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.560998+0000","last_change":"2024-01-21T21:31:36.545186+0000","last_active":"2024-01-21T21:31:36.560998+0000","last_peered":"2024-01-21T21:31:36.560998+0000","last_clean":"2024-01-21T21:31:36.560998+0000","last_became_active":"2024-01-21T21:31:36.544954+0000","last_became_peered":"2024-01-21T21:31:36.544954+0000","last_unstale":"2024-01-21T21:31:36.560998+0000","last_undegraded":"2024-01-21T21:31:36.560998+0000","last_fullsized":"2024-01-21T21:31:36.560998+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.559020+0000","last_change":"2024-01-21T21:31:36.170376+0000","last_active":"2024-01-21T21:31:36.559020+0000","last_peered":"2024-01-21T21:31:36.559020+0000","last_clean":"2024-01-21T21:31:36.559020+0000","last_became_active":"2024-01-21T21:31:36.169942+0000","last_became_peered":"2024-01-21T21:31:36.169942+0000","last_unstale":"2024-01-21T21:31:36.559020+0000","last_undegraded":"2024-01-21T21:31:36.559020+0000","last_fullsized":"2024-01-21T21:31:36.559020+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539664+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:31:36.539664+0000","last_peered":"2024-01-21T21:31:36.539664+0000","last_clean":"2024-01-21T21:31:36.539664+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:31:36.539664+0000","last_undegraded":"2024-01-21T21:31:36.539664+0000","last_fullsized":"2024-01-21T21:31:36.539664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.559944+0000","last_change":"2024-01-21T21:31:36.557402+0000","last_active":"2024-01-21T21:31:36.559944+0000","last_peered":"2024-01-21T21:31:36.559944+0000","last_clean":"2024-01-21T21:31:36.559944+0000","last_became_active":"2024-01-21T21:31:36.557125+0000","last_became_peered":"2024-01-21T21:31:36.557125+0000","last_unstale":"2024-01-21T21:31:36.559944+0000","last_undegraded":"2024-01-21T21:31:36.559944+0000","last_fullsized":"2024-01-21T21:31:36.559944+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.550988+0000","last_change":"2024-01-21T21:31:36.177004+0000","last_active":"2024-01-21T21:31:36.550988+0000","last_peered":"2024-01-21T21:31:36.550988+0000","last_clean":"2024-01-21T21:31:36.550988+0000","last_became_active":"2024-01-21T21:31:36.176645+0000","last_became_peered":"2024-01-21T21:31:36.176645+0000","last_unstale":"2024-01-21T21:31:36.550988+0000","last_undegraded":"2024-01-21T21:31:36.550988+0000","last_fullsized":"2024-01-21T21:31:36.550988+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.539197+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:31:36.539197+0000","last_peered":"2024-01-21T21:31:36.539197+0000","last_clean":"2024-01-21T21:31:36.539197+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:31:36.539197+0000","last_undegraded":"2024-01-21T21:31:36.539197+0000","last_fullsized":"2024-01-21T21:31:36.539197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552346+0000","last_change":"2024-01-21T21:31:36.550085+0000","last_active":"2024-01-21T21:31:36.552346+0000","last_peered":"2024-01-21T21:31:36.552346+0000","last_clean":"2024-01-21T21:31:36.552346+0000","last_became_active":"2024-01-21T21:31:36.549363+0000","last_became_peered":"2024-01-21T21:31:36.549363+0000","last_unstale":"2024-01-21T21:31:36.552346+0000","last_undegraded":"2024-01-21T21:31:36.552346+0000","last_fullsized":"2024-01-21T21:31:36.552346+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.546107+0000","last_change":"2024-01-21T21:31:36.173888+0000","last_active":"2024-01-21T21:31:36.546107+0000","last_peered":"2024-01-21T21:31:36.546107+0000","last_clean":"2024-01-21T21:31:36.546107+0000","last_became_active":"2024-01-21T21:31:36.173412+0000","last_became_peered":"2024-01-21T21:31:36.173412+0000","last_unstale":"2024-01-21T21:31:36.546107+0000","last_undegraded":"2024-01-21T21:31:36.546107+0000","last_fullsized":"2024-01-21T21:31:36.546107+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":160,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.534369+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:31:36.534369+0000","last_peered":"2024-01-21T21:31:36.534369+0000","last_clean":"2024-01-21T21:31:36.534369+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:31:36.534369+0000","last_undegraded":"2024-01-21T21:31:36.534369+0000","last_fullsized":"2024-01-21T21:31:36.534369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.552943+0000","last_change":"2024-01-21T21:31:36.541848+0000","last_active":"2024-01-21T21:31:36.552943+0000","last_peered":"2024-01-21T21:31:36.552943+0000","last_clean":"2024-01-21T21:31:36.552943+0000","last_became_active":"2024-01-21T21:31:36.541544+0000","last_became_peered":"2024-01-21T21:31:36.541544+0000","last_unstale":"2024-01-21T21:31:36.552943+0000","last_undegraded":"2024-01-21T21:31:36.552943+0000","last_fullsized":"2024-01-21T21:31:36.552943+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:36.148251+0000","last_clean_scrub_stamp":"2024-01-21T21:31:36.148251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.536752+0000","last_change":"2024-01-21T21:31:36.167793+0000","last_active":"2024-01-21T21:31:36.536752+0000","last_peered":"2024-01-21T21:31:36.536752+0000","last_clean":"2024-01-21T21:31:36.536752+0000","last_became_active":"2024-01-21T21:31:36.167480+0000","last_became_peered":"2024-01-21T21:31:36.167480+0000","last_unstale":"2024-01-21T21:31:36.536752+0000","last_undegraded":"2024-01-21T21:31:36.536752+0000","last_fullsized":"2024-01-21T21:31:36.536752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:31:35.144839+0000","last_clean_scrub_stamp":"2024-01-21T21:31:35.144839+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-01-21T21:31:36.535846+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:31:36.535846+0000","last_peered":"2024-01-21T21:31:36.535846+0000","last_clean":"2024-01-21T21:31:36.535846+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:31:36.535846+0000","last_undegraded":"2024-01-21T21:31:36.535846+0000","last_fullsized":"2024-01-21T21:31:36.535846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575951,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2404352,"data_stored":1295077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.63100000000000001},"min":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":0.83199999999999996,"15min":0.84199999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.47099999999999997,"5min":0.46400000000000002,"15min":0.42499999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81699999999999995},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.375},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.495,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.72699999999999998,"5min":0.75,"15min":0.91700000000000004},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.314},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59999999999999998},"min":{"1min":0.46800000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79700000000000004,"5min":0.80200000000000005,"15min":0.84899999999999998},"last":0.503}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.35199999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.61499999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.495,"15min":0.501},"min":{"1min":0.38200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69099999999999995,"5min":0.72699999999999998,"15min":0.84399999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55400000000000005,"15min":0.56999999999999995},"min":{"1min":0.39100000000000001,"5min":0.35099999999999998,"15min":0.33100000000000002},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82199999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.497},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.32500000000000001},"max":{"1min":0.72599999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.37},"max":{"1min":0.76900000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.55200000000000005},"min":{"1min":0.38200000000000001,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.60399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575951,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311732,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94060108,"statfs":{"total":96636764160,"available":96317550592,"internally_reserved":0,"allocated":2404352,"data_stored":1295484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.63100000000000001},"min":{"1min":0.47299999999999998,"5min":0.29599999999999999,"15min":0.29199999999999998},"max":{"1min":0.75700000000000001,"5min":0.77900000000000003,"15min":0.82499999999999996},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64800000000000002,"15min":0.64700000000000002},"min":{"1min":0.52300000000000002,"5min":0.48299999999999998,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.67700000000000005}]},{"osd":1,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.374,"15min":0.371},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.58199999999999996},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":0.74199999999999999,"15min":0.83799999999999997},"last":0.66400000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.47099999999999997,"5min":0.39100000000000001,"15min":0.38},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.436,"5min":0.40600000000000003,"15min":0.35499999999999998},"max":{"1min":0.72099999999999997,"5min":0.75900000000000001,"15min":0.81499999999999995},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.41299999999999998,"15min":0.39400000000000002},"max":{"1min":0.67300000000000004,"5min":0.78700000000000003,"15min":0.872},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.48999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.72499999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.47099999999999997},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.71899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.48499999999999999,"15min":0.503},"min":{"1min":0.38600000000000001,"5min":0.32800000000000001,"15min":0.316},"max":{"1min":0.75,"5min":0.75,"15min":0.78500000000000003},"last":0.48599999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.69499999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57799999999999996,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.75900000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:30:54 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79100000000000004,"5min":0.81399999999999995,"15min":0.98199999999999998},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.55200000000000005},"min":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.71799999999999997,"5min":0.76900000000000002,"15min":0.80100000000000005},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575953,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303544,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068296,"statfs":{"total":96636764160,"available":96325935104,"internally_reserved":0,"allocated":2408448,"data_stored":1295236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.40200000000000002,"15min":0.40400000000000003},"min":{"1min":0.30499999999999999,"5min":0.24399999999999999,"15min":0.23999999999999999},"max":{"1min":0.53800000000000003,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.378,"5min":0.31900000000000001,"15min":0.27100000000000002},"max":{"1min":0.63200000000000001,"5min":0.64900000000000002,"15min":0.66200000000000003},"last":0.443}]},{"osd":2,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.42099999999999999,"15min":0.41899999999999998},"min":{"1min":0.309,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60299999999999998,"5min":0.60899999999999999,"15min":0.70099999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.42799999999999999},"min":{"1min":0.28999999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.35899999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46300000000000002,"15min":0.45800000000000002},"min":{"1min":0.35699999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.66300000000000003,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.28000000000000003},"max":{"1min":0.55400000000000005,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.375}]},{"osd":4,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.46400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80900000000000005,"5min":0.83899999999999997,"15min":0.93100000000000005},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.621,"15min":0.61399999999999999},"min":{"1min":0.49099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.95299999999999996},"last":0.74399999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.036},"last":0.755},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.85699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.01},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68500000000000005},"min":{"1min":0.56599999999999995,"5min":0.45900000000000002,"15min":0.45800000000000002},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.97799999999999998},"last":0.79000000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:30:51 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.47499999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.878,"5min":0.98499999999999999,"15min":1.159},"last":0.78000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575952,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307632,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064208,"statfs":{"total":96636764160,"available":96321748992,"internally_reserved":0,"allocated":2400256,"data_stored":1293665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38500000000000001,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.622},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.58599999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.28999999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.443,"15min":0.441},"min":{"1min":0.315,"5min":0.251,"15min":0.251},"max":{"1min":0.57999999999999996,"5min":0.64000000000000001,"15min":0.66200000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.39200000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61799999999999999,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.436,"15min":0.439},"min":{"1min":0.34200000000000003,"5min":0.317,"15min":0.29899999999999999},"max":{"1min":0.54800000000000004,"5min":0.66200000000000003,"15min":0.66800000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.621,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.30599999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.49299999999999999,"5min":0.443,"15min":0.40600000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.503,"5min":0.44500000000000001,"15min":0.41199999999999998},"max":{"1min":0.98499999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.64600000000000002},"min":{"1min":0.51100000000000001,"5min":0.42299999999999999,"15min":0.39800000000000002},"max":{"1min":0.93899999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":0.98199999999999998,"5min":1.022,"15min":1.022},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.70399999999999996,"15min":0.69299999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.48899999999999999,"15min":0.45300000000000001},"max":{"1min":0.99199999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68899999999999995,"15min":0.68600000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.625},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.54300000000000004,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.0189999999999999,"5min":1.04,"15min":1.04},"last":0.71399999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575952,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2404352,"data_stored":1294662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.248},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.438},"min":{"1min":0.32900000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.58199999999999996,"5min":0.60299999999999998,"15min":0.65800000000000003},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40300000000000002,"15min":0.41199999999999998},"min":{"1min":0.27800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.53300000000000003,"5min":0.61099999999999999,"15min":0.69199999999999995},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.33100000000000002,"5min":0.30199999999999999,"15min":0.27500000000000002},"max":{"1min":0.67200000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.34200000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.626,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.33800000000000002,"5min":0.32900000000000001,"15min":0.315},"max":{"1min":0.61099999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.38500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68200000000000005,"15min":0.67900000000000005},"min":{"1min":0.47299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.90800000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69699999999999995,"15min":0.69599999999999995},"min":{"1min":0.53400000000000003,"5min":0.49399999999999999,"15min":0.42099999999999999},"max":{"1min":0.94499999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55300000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.65100000000000002},"min":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.439},"max":{"1min":0.86399999999999999,"5min":0.97099999999999997,"15min":1.2410000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.49099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":1.1819999999999999},"last":0.53000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94099999999999995,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.56000000000000005,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.92000000000000004,"5min":0.94099999999999995,"15min":0.98299999999999998},"last":0.497}]},{"osd":7,"last update":"Sun Jan 21 21:30:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68000000000000005,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.39300000000000002},"max":{"1min":0.91300000000000003,"5min":0.96199999999999997,"15min":1.0149999999999999},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575952,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064196,"statfs":{"total":96636764160,"available":96321736704,"internally_reserved":0,"allocated":2412544,"data_stored":1295258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41299999999999998,"15min":0.40699999999999997},"min":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.315},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.433,"15min":0.441},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.63300000000000001},"last":0.28999999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.58599999999999997,"5min":0.72099999999999997,"15min":0.73099999999999998},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.42599999999999999},"min":{"1min":0.317,"5min":0.30499999999999999,"15min":0.29099999999999998},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.68200000000000005},"last":0.34699999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.34499999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.69099999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36699999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.45500000000000002,"5min":0.45000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96699999999999997,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.495,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.92900000000000005,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.40799999999999997},"max":{"1min":0.93000000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65900000000000003,"15min":0.65700000000000003},"min":{"1min":0.47099999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66100000000000003,"15min":0.66300000000000003},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.437},"max":{"1min":0.99199999999999999,"5min":0.995,"15min":0.995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66600000000000004,"15min":0.66300000000000003},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.439},"max":{"1min":0.92400000000000004,"5min":0.94999999999999996,"15min":0.97199999999999998},"last":0.58399999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:31:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.51500000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95699999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68200000000000005},"min":{"1min":0.50900000000000001,"5min":0.48499999999999999,"15min":0.46300000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575952,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064196,"statfs":{"total":96636764160,"available":96321736704,"internally_reserved":0,"allocated":2412544,"data_stored":1294774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63900000000000001,"15min":0.625},"min":{"1min":0.51600000000000001,"5min":0.45600000000000002,"15min":0.22900000000000001},"max":{"1min":0.79600000000000004,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.499},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.629,"15min":0.627},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.88200000000000001},"last":0.626}]},{"osd":1,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.46300000000000002,"5min":0.42599999999999999,"15min":0.29099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.85299999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64600000000000002,"15min":0.63700000000000001},"min":{"1min":0.54600000000000004,"5min":0.46000000000000002,"15min":0.436},"max":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.54900000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.61299999999999999,"15min":0.59799999999999998},"min":{"1min":0.53000000000000003,"5min":0.39300000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40799999999999997,"15min":0.38},"max":{"1min":0.752,"5min":0.77700000000000002,"15min":0.79300000000000004},"last":0.72099999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.79200000000000004,"15min":0.84299999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.38},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.68999999999999995,"5min":0.69399999999999995,"15min":0.745},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.36899999999999999,"15min":0.33600000000000002},"max":{"1min":0.69999999999999996,"5min":0.74099999999999999,"15min":0.77100000000000002},"last":0.66000000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.51800000000000002},"min":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.65400000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41999999999999998,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:31:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575951,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315836,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94056004,"statfs":{"total":96636764160,"available":96313348096,"internally_reserved":0,"allocated":2412544,"data_stored":1295270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.93500000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.39500000000000002},"max":{"1min":0.77200000000000002,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57299999999999995,"15min":0.56899999999999995},"min":{"1min":0.496,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.48199999999999998,"5min":0.42499999999999999,"15min":0.316},"max":{"1min":0.69399999999999995,"5min":0.71899999999999997,"15min":0.91100000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.316},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57299999999999995,"15min":0.58299999999999996},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.371},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57599999999999996,"15min":0.57699999999999996},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.36199999999999999},"max":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.874},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.34200000000000003,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.88700000000000001},"last":0.63},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55200000000000005,"15min":0.56699999999999995},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.32400000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.95899999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.49199999999999999,"15min":0.504},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71299999999999997,"5min":0.755,"15min":0.81699999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.50700000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76000000000000001,"5min":0.80500000000000005,"15min":0.83499999999999996},"last":0.60399999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:30:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33600000000000002,"15min":0.317},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.82799999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.33500000000000002},"max":{"1min":0.73599999999999999,"5min":0.80900000000000005,"15min":0.85999999999999999},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:31:44.375 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T21:31:44.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T21:31:44.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.529+0000 7f6638cdc700 1 Processor -- start 2024-01-21T21:31:44.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.529+0000 7f6638cdc700 1 -- start start 2024-01-21T21:31:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6638cdc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 0x7f66340c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6638cdc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66340be810 0x7f66340a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6638cdc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340bfa40 con 0x7f66340c39f0 2024-01-21T21:31:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6638cdc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66340c3e70 con 0x7f66340be810 2024-01-21T21:31:44.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6638cdc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340bee30 con 0x7f663413b970 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66340be810 0x7f66340a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66340be810 0x7f66340a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34240/0 (socket says 172.21.15.133:34240) 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 -- 172.21.15.133:0/162484774 learned_addr learned my addr 172.21.15.133:0/162484774 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 -- 172.21.15.133:0/162484774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 msgr2=0x7f66340c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f663259c700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 0x7f66340c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 0x7f66340c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 -- 172.21.15.133:0/162484774 >> v1:172.21.15.178:6789/0 conn(0x7f66340c39f0 legacy=0x7f66340be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 -- 172.21.15.133:0/162484774 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340bf110 con 0x7f66340be810 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f663259c700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 0x7f66340c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f6632d9d700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340be810 0x7f66340a8ab0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f662c009f20 tx=0x7f662c009840).ready entity=mon.0 client_cookie=7e4deb5e61fcc5c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.530+0000 7f663159a700 1 -- 172.21.15.133:0/162484774 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00e070 con 0x7f66340be810 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f663159a700 1 -- 172.21.15.133:0/162484774 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00ba40 con 0x7f66340be810 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f663159a700 1 -- 172.21.15.133:0/162484774 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00bdc0 con 0x7f66340be810 2024-01-21T21:31:44.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 -- 172.21.15.133:0/162484774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340be810 msgr2=0x7f66340a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340be810 0x7f66340a8ab0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 rx=0x7f662c009f20 tx=0x7f662c009840).stop 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 -- 172.21.15.133:0/162484774 shutdown_connections 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340be810 0x7f66340a8ab0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 --2- 172.21.15.133:0/162484774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f663413b970 0x7f66340c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 -- 172.21.15.133:0/162484774 >> 172.21.15.133:0/162484774 conn(0x7f6634066a70 msgr2=0x7f6634066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 -- 172.21.15.133:0/162484774 shutdown_connections 2024-01-21T21:31:44.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.531+0000 7f6638cdc700 1 -- 172.21.15.133:0/162484774 wait complete. 2024-01-21T21:31:44.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.532+0000 7f6638cdc700 1 Processor -- start 2024-01-21T21:31:44.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.532+0000 7f6638cdc700 1 -- start start 2024-01-21T21:31:44.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66340be810 0x7f6634137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f663413b970 0x7f66340adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340ae080 con 0x7f66340c39f0 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6634138880 con 0x7f663413b970 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6638cdc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66341385a0 con 0x7f66340be810 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34242/0 (socket says 172.21.15.133:34242) 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6631d9b700 1 -- 172.21.15.133:0/3122449690 learned_addr learned my addr 172.21.15.133:0/3122449690 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f6632d9d700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f663413b970 0x7f66340adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.533+0000 7f663259c700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66340be810 0x7f6634137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 -- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66340be810 msgr2=0x7f6634137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66340be810 0x7f6634137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 -- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f663413b970 msgr2=0x7f66340adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f663413b970 0x7f66340adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 -- 172.21.15.133:0/3122449690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009ae0 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6631d9b700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f662400b490 tx=0x7f6624006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624012410 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6624012590 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66341358a0 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6624012950 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.534+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6634135e60 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.535+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340be080 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.535+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f662401b3e0 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.536+0000 7f6622ffd700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 0x7f6614061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.536+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f662407a420 con 0x7f66340c39f0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.536+0000 7f663259c700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 0x7f6614061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.536+0000 7f663259c700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 0x7f6614061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f662800abd0 tx=0x7f6628008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.540+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f662404b3e0 con 0x7f66340c39f0 2024-01-21T21:31:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.774+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6634136050 con 0x7f66340c39f0 2024-01-21T21:31:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.777+0000 7f6622ffd700 1 -- 172.21.15.133:0/3122449690 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v51) v1 ==== 190+0+0 (secure 0 0 0) 0x7f662404ea00 con 0x7f66340c39f0 2024-01-21T21:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 msgr2=0x7f6614061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 0x7f6614061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f662800abd0 tx=0x7f6628008040).stop 2024-01-21T21:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 msgr2=0x7f66340ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f662400b490 tx=0x7f6624006ef0).stop 2024-01-21T21:31:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 shutdown_connections 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f661405f150 0x7f6614061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f663413b970 0x7f66340adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66340be810 0x7f6634137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 --2- 172.21.15.133:0/3122449690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66340c39f0 0x7f66340ad6a0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 >> 172.21.15.133:0/3122449690 conn(0x7f6634066a70 msgr2=0x7f66340c5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 shutdown_connections 2024-01-21T21:31:44.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.779+0000 7f6638cdc700 1 -- 172.21.15.133:0/3122449690 wait complete. 2024-01-21T21:31:44.785 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T21:31:44.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:31:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.908+0000 7ff77372b700 1 Processor -- start 2024-01-21T21:31:44.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.908+0000 7ff77372b700 1 -- start start 2024-01-21T21:31:44.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff77372b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 0x7ff76c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff77372b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 0x7ff76c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff77372b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c1584f0 con 0x7ff76c13aa00 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff77372b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0bd6f0 con 0x7ff76c13a620 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff77372b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c0654e0 con 0x7ff76c062e00 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff7714c7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 0x7ff76c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff771cc8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 0x7ff76c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff770cc6700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff76c13aa00 0x7ff76c0626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:35986/0 (socket says 172.21.15.133:35986) 2024-01-21T21:31:44.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.909+0000 7ff770cc6700 1 -- 172.21.15.133:0/1832961806 learned_addr learned my addr 172.21.15.133:0/1832961806 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff771cc8700 1 -- 172.21.15.133:0/1832961806 >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 msgr2=0x7ff76c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff771cc8700 1 --2- 172.21.15.133:0/1832961806 >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 0x7ff76c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff771cc8700 1 -- 172.21.15.133:0/1832961806 >> v1:172.21.15.178:6789/0 conn(0x7ff76c13aa00 legacy=0x7ff76c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff771cc8700 1 -- 172.21.15.133:0/1832961806 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c158730 con 0x7ff76c062e00 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff763fff700 1 -- 172.21.15.133:0/1832961806 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308501472 0 0) 0x7ff768001110 con 0x7ff76c13aa00 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff7714c7700 1 --2- 172.21.15.133:0/1832961806 >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 0x7ff76c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:44.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff771cc8700 1 --2- 172.21.15.133:0/1832961806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 0x7ff76c158000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff764009e60 tx=0x7ff764009780).ready entity=mon.2 client_cookie=870df4cfae51488e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff763fff700 1 -- 172.21.15.133:0/1832961806 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76400e070 con 0x7ff76c062e00 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff763fff700 1 -- 172.21.15.133:0/1832961806 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76400bb60 con 0x7ff76c062e00 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff763fff700 1 -- 172.21.15.133:0/1832961806 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764012410 con 0x7ff76c062e00 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 -- 172.21.15.133:0/1832961806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 msgr2=0x7ff76c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 --2- 172.21.15.133:0/1832961806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 0x7ff76c158000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff764009e60 tx=0x7ff764009780).stop 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 -- 172.21.15.133:0/1832961806 shutdown_connections 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 --2- 172.21.15.133:0/1832961806 >> v2:172.21.15.178:3300/0 conn(0x7ff76c13a620 0x7ff76c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 --2- 172.21.15.133:0/1832961806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c062e00 0x7ff76c158000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.910+0000 7ff77372b700 1 -- 172.21.15.133:0/1832961806 >> 172.21.15.133:0/1832961806 conn(0x7ff76c0c7dc0 msgr2=0x7ff76c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.911+0000 7ff77372b700 1 -- 172.21.15.133:0/1832961806 shutdown_connections 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.911+0000 7ff77372b700 1 -- 172.21.15.133:0/1832961806 wait complete. 2024-01-21T21:31:44.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 Processor -- start 2024-01-21T21:31:44.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 -- start start 2024-01-21T21:31:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76c062e00 0x7ff76c0a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c13aa00 0x7ff76c0a6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c13d040 con 0x7ff76c13a620 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c13ccf0 con 0x7ff76c062e00 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.912+0000 7ff77372b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c13ba00 con 0x7ff76c13aa00 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34244/0 (socket says 172.21.15.133:34244) 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 -- 172.21.15.133:0/2514597705 learned_addr learned my addr 172.21.15.133:0/2514597705 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff7714c7700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76c062e00 0x7ff76c0a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff771cc8700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c13aa00 0x7ff76c0a6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 -- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c13aa00 msgr2=0x7ff76c0a6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c13aa00 0x7ff76c0a6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 -- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76c062e00 msgr2=0x7ff76c0a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76c062e00 0x7ff76c0a75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 -- 172.21.15.133:0/2514597705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c0092a0 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff770cc6700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff76800c460 tx=0x7ff768007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680072e0 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768007440 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff764009a20 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680057a0 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.913+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c13bfc0 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.914+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76c13d180 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.915+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff768005b90 con 0x7ff76c13a620 2024-01-21T21:31:44.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.915+0000 7ff761ffb700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 0x7ff750061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.915+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff768079bc0 con 0x7ff76c13a620 2024-01-21T21:31:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.915+0000 7ff7714c7700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 0x7ff750061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.915+0000 7ff7714c7700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 0x7ff750061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff75c009270 tx=0x7ff75c008040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:44.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:44.919+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff76c13d180 con 0x7ff76c13a620 2024-01-21T21:31:45.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.123+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff76c1584f0 con 0x7ff76c13a620 2024-01-21T21:31:45.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.124+0000 7ff761ffb700 1 -- 172.21.15.133:0/2514597705 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7ff76c1584f0 con 0x7ff76c13a620 2024-01-21T21:31:45.126 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:45.127 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 msgr2=0x7ff750061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 0x7ff750061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7ff75c009270 tx=0x7ff75c008040).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 msgr2=0x7ff76c13b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7ff76800c460 tx=0x7ff768007e90).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 shutdown_connections 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76c13aa00 0x7ff76c0a6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff75005f150 0x7ff750061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76c062e00 0x7ff76c0a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 --2- 172.21.15.133:0/2514597705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff76c13a620 0x7ff76c13b1d0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 >> 172.21.15.133:0/2514597705 conn(0x7ff76c0c7dc0 msgr2=0x7ff76c0bcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 shutdown_connections 2024-01-21T21:31:45.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.126+0000 7ff77372b700 1 -- 172.21.15.133:0/2514597705 wait complete. 2024-01-21T21:31:45.130 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:31:45.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T21:31:36.526606+0000', 'modified': '2024-01-21T21:31:38.535873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9585}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9585': {'gid': 9585, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2094253960', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 2094253960}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2094253960}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T21:31:45.545 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T21:31:45.545 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-21T21:31:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.663+0000 7ff287ad3700 1 Processor -- start 2024-01-21T21:31:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.663+0000 7ff287ad3700 1 -- start start 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff287ad3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff280069cc0 0x7ff2800c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff287ad3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800c3890 con 0x7ff28013a830 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff287ad3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800c3b70 con 0x7ff28013ac10 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff287ad3700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800c3e50 con 0x7ff280069cc0 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28586f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff28013a830 0x7ff2800bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54430/0 (socket says 172.21.15.133:54430) 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28586f700 1 -- 172.21.15.133:0/1861701871 learned_addr learned my addr 172.21.15.133:0/1861701871 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff286070700 1 --2- 172.21.15.133:0/1861701871 >> v2:172.21.15.178:3300/0 conn(0x7ff280069cc0 0x7ff2800c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059810664 0 0) 0x7ff2800c3890 con 0x7ff28013a830 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff26c0033f0 con 0x7ff28013a830 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985197383 0 0) 0x7ff2800c3b70 con 0x7ff28013ac10 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2800c3890 con 0x7ff28013ac10 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff286070700 1 -- 172.21.15.133:0/1861701871 >> v1:172.21.15.178:6789/0 conn(0x7ff28013ac10 legacy=0x7ff2800695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff286070700 1 -- 172.21.15.133:0/1861701871 >> v1:172.21.15.133:6789/0 conn(0x7ff28013a830 legacy=0x7ff2800bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.664+0000 7ff286070700 1 -- 172.21.15.133:0/1861701871 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800c4130 con 0x7ff280069cc0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff286070700 1 --2- 172.21.15.133:0/1861701871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff280069cc0 0x7ff2800c3220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7ff278009e60 tx=0x7ff278009780).ready entity=mon.1 client_cookie=654534ce30085dab server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800e070 con 0x7ff280069cc0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800bab0 con 0x7ff280069cc0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff28486d700 1 -- 172.21.15.133:0/1861701871 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800be30 con 0x7ff280069cc0 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 -- 172.21.15.133:0/1861701871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff280069cc0 msgr2=0x7ff2800c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1861701871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff280069cc0 0x7ff2800c3220 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7ff278009e60 tx=0x7ff278009780).stop 2024-01-21T21:31:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 -- 172.21.15.133:0/1861701871 shutdown_connections 2024-01-21T21:31:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1861701871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff280069cc0 0x7ff2800c3220 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 -- 172.21.15.133:0/1861701871 >> 172.21.15.133:0/1861701871 conn(0x7ff2800c7dc0 msgr2=0x7ff2800c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 -- 172.21.15.133:0/1861701871 shutdown_connections 2024-01-21T21:31:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.665+0000 7ff287ad3700 1 -- 172.21.15.133:0/1861701871 wait complete. 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 Processor -- start 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 -- start start 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 0x7ff280138300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28013ac10 0x7ff2801387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2801623f0 con 0x7ff280069cc0 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280138ce0 con 0x7ff28013ac10 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff287ad3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280165120 con 0x7ff28013a830 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.667+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34246/0 (socket says 172.21.15.133:34246) 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 -- 172.21.15.133:0/1576191480 learned_addr learned my addr 172.21.15.133:0/1576191480 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff286070700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28013ac10 0x7ff2801387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28506e700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 0x7ff280138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 -- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 msgr2=0x7ff280138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 0x7ff280138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 -- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28013ac10 msgr2=0x7ff2801387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28013ac10 0x7ff2801387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 -- 172.21.15.133:0/1576191480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009a20 con 0x7ff280069cc0 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28506e700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 0x7ff280138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff28586f700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7ff27c00c590 tx=0x7ff27c007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff276777700 1 -- 172.21.15.133:0/1576191480 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0072e0 con 0x7ff280069cc0 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff276777700 1 -- 172.21.15.133:0/1576191480 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c007440 con 0x7ff280069cc0 2024-01-21T21:31:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff280162110 con 0x7ff280069cc0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff276777700 1 -- 172.21.15.133:0/1576191480 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c0057a0 con 0x7ff280069cc0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.668+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff280164db0 con 0x7ff280069cc0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.670+0000 7ff276777700 1 -- 172.21.15.133:0/1576191480 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff27c005b50 con 0x7ff280069cc0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.670+0000 7ff276777700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 0x7ff264061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.670+0000 7ff276777700 1 -- 172.21.15.133:0/1576191480 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff27c079b60 con 0x7ff280069cc0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.670+0000 7ff28506e700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 0x7ff264061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.670+0000 7ff28506e700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 0x7ff264061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff280154790 tx=0x7ff270009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.672+0000 7ff299476b80 1 Processor -- start 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.672+0000 7ff299476b80 1 -- start start 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028ef26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f33d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028e673d0 con 0x564028f34240 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028e2cbe0 con 0x564028f18550 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564028e42260 con 0x564028f18930 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34252/0 (socket says 172.21.15.133:34252) 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 -- 172.21.15.133:0/3866093343 learned_addr learned my addr 172.21.15.133:0/3866093343 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff28586f700 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028ef26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff28506e700 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f33d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 -- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 msgr2=0x564028f33d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f33d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 -- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 msgr2=0x564028ef26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028ef26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 -- 172.21.15.133:0/3866093343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564028e3b2f0 con 0x564028f34240 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.673+0000 7ff286070700 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7ff27800b610 tx=0x7ff278009780).ready entity=mon.0 client_cookie=37c7f0926fe73e5d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff2637fe700 1 -- 172.21.15.133:0/3866093343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278007000 con 0x564028f34240 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff2637fe700 1 -- 172.21.15.133:0/3866093343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800bcf0 con 0x564028f34240 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff2637fe700 1 -- 172.21.15.133:0/3866093343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278012830 con 0x564028f34240 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 -- 172.21.15.133:0/3866093343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 msgr2=0x564028f346c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7ff27800b610 tx=0x7ff278009780).stop 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 -- 172.21.15.133:0/3866093343 shutdown_connections 2024-01-21T21:31:45.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028f346c0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028ef26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 --2- 172.21.15.133:0/3866093343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f33d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 -- 172.21.15.133:0/3866093343 >> 172.21.15.133:0/3866093343 conn(0x564028d592e0 msgr2=0x564028f39750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 -- 172.21.15.133:0/3866093343 shutdown_connections 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.674+0000 7ff299476b80 1 -- 172.21.15.133:0/3866093343 wait complete. 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.675+0000 7ff299476b80 1 -- start start 2024-01-21T21:31:45.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.675+0000 7ff299476b80 1 Processor -- start 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028f33220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f4d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028e423a0 con 0x564028f34240 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028e42620 con 0x564028f18550 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564028e0d990 con 0x564028f18930 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff299476b80 10 client.0 ll_register_callbacks cb 0x564028eb0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34260/0 (socket says 172.21.15.133:34260) 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 -- 172.21.15.133:0/2350166233 learned_addr learned my addr 172.21.15.133:0/2350166233 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff28586f700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028f33220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff28506e700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f4d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 -- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 msgr2=0x564028f4d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f4d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 -- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 msgr2=0x564028f33220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028f33220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.676+0000 7ff286070700 1 -- 172.21.15.133:0/2350166233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2800c4130 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff286070700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7ff278020000 tx=0x7ff27801f000).ready entity=mon.0 client_cookie=68bd47902257134e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278028690 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff2780287f0 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564028eeadf0 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff278028bc0 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 10 client.9744 fetch_fsmap learned FSMap version 68 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x564028e36520 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564028eeadf0 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff278019070 con 0x564028f34240 2024-01-21T21:31:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 10 client.9744 fetch_fsmap finished waiting for FSMap version 68 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 10 client.9744 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 20 client.9744 populate_metadata read hostname 'smithi133' 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f16d60 0x564028f17140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 4 client.9744 mds_command: new command op to 9585 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 --> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564028e37d60 con 0x564028f16d60 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.677+0000 7ff28586f700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f16d60 0x564028f17140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff260ff9700 10 client.9744 ms_handle_connect on v2:172.21.15.133:6835/2094253960 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff28586f700 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f16d60 0x564028f17140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d0f4092bc73f918b server_cookie=b027e40dd53dd7ee in_seq=0 out_seq=0 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff260ff9700 1 -- 172.21.15.133:0/2350166233 <== mds.0 v2:172.21.15.133:6835/2094253960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x564028e37d60 con 0x564028f16d60 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff260ff9700 10 client.9744 handle_command_reply: tid=0 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 client.9744 shutdown 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 msgr2=0x564028eec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 rx=0x7ff278020000 tx=0x7ff27801f000).stop 2024-01-21T21:31:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 shutdown_connections 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f16d60 0x564028f17140 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f34240 0x564028eec870 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18550 0x564028f33220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff260ff9700 0 client.9744 ms_handle_reset on v2:172.21.15.133:6835/2094253960 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 --2- 172.21.15.133:0/2350166233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f4d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.678+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 >> 172.21.15.133:0/2350166233 conn(0x564028d592e0 msgr2=0x564028ef26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.679+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 shutdown_connections 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.679+0000 7ff299476b80 1 -- 172.21.15.133:0/2350166233 wait complete. 2024-01-21T21:31:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.679+0000 7ff299476b80 20 client.9744 trim_cache size 0 max 16384 2024-01-21T21:31:45.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.695+0000 7ff299476b80 1 Processor -- start 2024-01-21T21:31:45.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.695+0000 7ff299476b80 1 -- start start 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f34240 0x564028f1f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028f17960 con 0x564028f18550 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028f1d6e0 con 0x564028f34240 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564028f18040 con 0x564028f18930 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34272/0 (socket says 172.21.15.133:34272) 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 -- 172.21.15.133:0/304511710 learned_addr learned my addr 172.21.15.133:0/304511710 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 -- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 msgr2=0x564028f328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 -- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f34240 msgr2=0x564028f1f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f34240 0x564028f1f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 -- 172.21.15.133:0/304511710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564028e36270 con 0x564028f18550 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff28586f700 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7ff27c00cce0 tx=0x7ff27c050040).ready entity=mon.0 client_cookie=f617ae0d40ef978 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff263fff700 1 -- 172.21.15.133:0/304511710 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c04ca50 con 0x564028f18550 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff263fff700 1 -- 172.21.15.133:0/304511710 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c04cbe0 con 0x564028f18550 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.696+0000 7ff263fff700 1 -- 172.21.15.133:0/304511710 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c04af50 con 0x564028f18550 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- 172.21.15.133:0/304511710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 msgr2=0x564028eec810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7ff27c00cce0 tx=0x7ff27c050040).stop 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- 172.21.15.133:0/304511710 shutdown_connections 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f34240 0x564028f1f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028eec810 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 --2- 172.21.15.133:0/304511710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f18930 0x564028f328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- 172.21.15.133:0/304511710 >> 172.21.15.133:0/304511710 conn(0x564028d592e0 msgr2=0x564028eed970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- 172.21.15.133:0/304511710 shutdown_connections 2024-01-21T21:31:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- 172.21.15.133:0/304511710 wait complete. 2024-01-21T21:31:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 -- start start 2024-01-21T21:31:45.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.697+0000 7ff299476b80 1 Processor -- start 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18930 0x564028f97f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 0x564028f39c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028f98660 con 0x564028f18550 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564028f16160 con 0x564028f18930 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564028f4d220 con 0x564028f34240 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.698+0000 7ff299476b80 10 client.0 ll_register_callbacks cb 0x564028eb0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34276/0 (socket says 172.21.15.133:34276) 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 -- 172.21.15.133:0/4131417814 learned_addr learned my addr 172.21.15.133:0/4131417814 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff286070700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 0x564028f39c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28506e700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18930 0x564028f97f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 -- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 msgr2=0x564028f39c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 0x564028f39c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 -- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18930 msgr2=0x564028f97f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18930 0x564028f97f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 -- 172.21.15.133:0/4131417814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff280164db0 con 0x564028f18550 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff286070700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 0x564028f39c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff28586f700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7ff27c04ad40 tx=0x7ff27c015030).ready entity=mon.0 client_cookie=d5732ce2a3464c68 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c04af50 con 0x564028f18550 2024-01-21T21:31:45.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7ff27c04b0b0 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff27800bcf0 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff27c04a840 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 10 client.9750 fetch_fsmap learned FSMap version 68 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) v3 -- 0x564028caff80 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800bcf0 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 68) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff27c04d7a0 con 0x564028f18550 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 10 client.9750 fetch_fsmap finished waiting for FSMap version 68 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 10 client.9750 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 20 client.9750 populate_metadata read hostname 'smithi133' 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f15500 0x564028f158e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 4 client.9750 mds_command: new command op to 9585 tid=0[{"prefix": "status"}] 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.699+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 --> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564028e2e7d0 con 0x564028f15500 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff28506e700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f15500 0x564028f158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff260ff9700 10 client.9750 ms_handle_connect on v2:172.21.15.133:6835/2094253960 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff28506e700 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f15500 0x564028f158e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5723cd9e0292a9a7 server_cookie=c5964c1906662564 in_seq=0 out_seq=0 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff260ff9700 1 -- 172.21.15.133:0/4131417814 <== mds.0 v2:172.21.15.133:6835/2094253960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x564028e2e7d0 con 0x564028f15500 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff260ff9700 10 client.9750 handle_command_reply: tid=0 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 client.9750 shutdown 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 msgr2=0x564028f1cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7ff27c04ad40 tx=0x7ff27c015030).stop 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 shutdown_connections 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:6835/2094253960,v1:172.21.15.133:6837/2094253960] conn(0x564028f15500 0x564028f158e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564028f34240 0x564028f39c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff260ff9700 0 client.9750 ms_handle_reset on v2:172.21.15.133:6835/2094253960 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564028f18550 0x564028f1cb60 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 --2- 172.21.15.133:0/4131417814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564028f18930 0x564028f97f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 >> 172.21.15.133:0/4131417814 conn(0x564028d592e0 msgr2=0x564028f48880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 shutdown_connections 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.700+0000 7ff299476b80 1 -- 172.21.15.133:0/4131417814 wait complete. 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff299476b80 20 client.9750 trim_cache size 0 max 16384 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 9585, 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.1729207000000006, 2024-01-21T21:31:45.710 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 68, 2024-01-21T21:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 192, 2024-01-21T21:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 192, 2024-01-21T21:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.666440723999999 2024-01-21T21:31:45.711 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 msgr2=0x7ff264061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 0x7ff264061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7ff280154790 tx=0x7ff270009040).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 msgr2=0x7ff2801503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7ff27c00c590 tx=0x7ff27c007cd0).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 shutdown_connections 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff26405f150 0x7ff264061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff28013ac10 0x7ff2801387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff280069cc0 0x7ff2801503a0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 --2- 172.21.15.133:0/1576191480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff28013a830 0x7ff280138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 >> 172.21.15.133:0/1576191480 conn(0x7ff2800c7dc0 msgr2=0x7ff2800c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 shutdown_connections 2024-01-21T21:31:45.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.701+0000 7ff287ad3700 1 -- 172.21.15.133:0/1576191480 wait complete. 2024-01-21T21:31:45.715 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T21:31:45.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.815+0000 7f291c4ae700 1 Processor -- start 2024-01-21T21:31:45.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.815+0000 7f291c4ae700 1 -- start start 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.816+0000 7f291c4ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f2914154270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.816+0000 7f291c4ae700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2914155530 con 0x7f2914153e90 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.816+0000 7f291c4ae700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29140c5f20 con 0x7f2914063430 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.816+0000 7f291c4ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2914154920 con 0x7f29140be540 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.816+0000 7f291a24a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2914153e90 0x7f29140c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54446/0 (socket says 172.21.15.133:54446) 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 -- 172.21.15.133:0/2532734769 learned_addr learned my addr 172.21.15.133:0/2532734769 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245865956 0 0) 0x7f2914155530 con 0x7f2914153e90 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291aa4b700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f2914154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28fc0033f0 con 0x7f2914153e90 2024-01-21T21:31:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3012036562 0 0) 0x7f28fc0033f0 con 0x7f2914153e90 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 msgr2=0x7f2914154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f2914154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 >> v1:172.21.15.178:6789/0 conn(0x7f2914063430 legacy=0x7f29140bde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914154c00 con 0x7f2914153e90 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f2904001470 con 0x7f2914153e90 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 >> v1:172.21.15.133:6789/0 conn(0x7f2914153e90 legacy=0x7f29140c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f28fc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f28fc004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc004b80 0x7f28fc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914154920 con 0x7f28fc003910 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc00b910 con 0x7f28fc004b80 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc00bad0 con 0x7f29140be540 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f28fc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f2919a49700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f28fc004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291aa4b700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc004b80 0x7f28fc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 -- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 msgr2=0x7f28fc004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29140be540 0x7f28fc004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 -- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc004b80 msgr2=0x7f28fc005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc004b80 0x7f28fc005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.817+0000 7f291a24a700 1 -- 172.21.15.133:0/2532734769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0033f0 con 0x7f28fc003910 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291a24a700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f28fc003d30 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f290400c190 tx=0x7f2904001e50).ready entity=mon.0 client_cookie=fe1fa84228448187 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007a20 con 0x7f28fc003910 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290400cac0 con 0x7f28fc003910 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f2919248700 1 -- 172.21.15.133:0/2532734769 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290400ce40 con 0x7f28fc003910 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 -- 172.21.15.133:0/2532734769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 msgr2=0x7f28fc003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 --2- 172.21.15.133:0/2532734769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f28fc003d30 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f290400c190 tx=0x7f2904001e50).stop 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291aa4b700 1 -- 172.21.15.133:0/2532734769 reap_dead start 2024-01-21T21:31:45.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 -- 172.21.15.133:0/2532734769 shutdown_connections 2024-01-21T21:31:45.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 -- 172.21.15.133:0/2532734769 >> 172.21.15.133:0/2532734769 conn(0x7f29140c7cb0 msgr2=0x7f29140c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:45.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 -- 172.21.15.133:0/2532734769 shutdown_connections 2024-01-21T21:31:45.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.818+0000 7f291c4ae700 1 -- 172.21.15.133:0/2532734769 wait complete. 2024-01-21T21:31:45.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.819+0000 7f291c4ae700 1 Processor -- start 2024-01-21T21:31:45.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 -- start start 2024-01-21T21:31:45.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 0x7f29140a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 0x7f291414d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c1160 con 0x7f28fc003910 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291414db60 con 0x7f29140a6010 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291c4ae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29140c0550 con 0x7f291414d210 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291a24a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291a24a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34284/0 (socket says 172.21.15.133:34284) 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.820+0000 7f291a24a700 1 -- 172.21.15.133:0/3931458928 learned_addr learned my addr 172.21.15.133:0/3931458928 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f2919a49700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 0x7f29140a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291aa4b700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 0x7f291414d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 -- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 msgr2=0x7f291414d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 0x7f291414d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 -- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 msgr2=0x7f29140a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 0x7f29140a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 -- 172.21.15.133:0/3931458928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29140c0830 con 0x7f28fc003910 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291aa4b700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 0x7f291414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:45.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f2919a49700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 0x7f29140a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291a24a700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f2904001e90 tx=0x7f2904015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007670 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29040046b0 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904004a50 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29140c0b10 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.821+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29140c0110 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.822+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29140475e0 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.822+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2904020480 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.823+0000 7f2912ffd700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 0x7f2900061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.823+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f290407b2a0 con 0x7f28fc003910 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.823+0000 7f2919a49700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 0x7f2900061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:45.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.823+0000 7f2919a49700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 0x7f2900061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f29140c1d50 tx=0x7f2908009040).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:45.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:45.827+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f290404c260 con 0x7f28fc003910 2024-01-21T21:31:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.032+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2914154ee0 con 0x7f28fc003910 2024-01-21T21:31:46.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.033+0000 7f2912ffd700 1 -- 172.21.15.133:0/3931458928 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2904025070 con 0x7f28fc003910 2024-01-21T21:31:46.035 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 msgr2=0x7f2900061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 0x7f2900061610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f29140c1d50 tx=0x7f2908009040).stop 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 msgr2=0x7f29140bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f2904001e90 tx=0x7f2904015000).stop 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 shutdown_connections 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f291414d210 0x7f291414d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28fc003910 0x7f29140bfc20 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f290005f150 0x7f2900061610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 --2- 172.21.15.133:0/3931458928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29140a6010 0x7f29140a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 >> 172.21.15.133:0/3931458928 conn(0x7f29140c7cb0 msgr2=0x7f2914156600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 shutdown_connections 2024-01-21T21:31:46.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.034+0000 7f291c4ae700 1 -- 172.21.15.133:0/3931458928 wait complete. 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T21:31:46.048 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T21:31:46.049 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:31:46.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.049 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T21:31:46.067 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T21:31:46.067 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T21:31:46.067 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T21:31:46.067 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:31:46.068 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T21:31:46.069 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 36826sec preferred_lft 36826sec 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.072 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:31:46.073 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T21:31:46.073 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T21:31:46.073 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:31:46.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.073 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T21:31:46.137 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T21:31:46.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.138 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T21:31:46.203 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T21:31:46.204 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T21:31:46.204 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T21:31:46.204 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T21:31:46.204 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T21:31:46.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.204 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T21:31:46.204 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T21:31:46.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T21:31:46.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T21:31:46.205 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T21:31:46.205 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T21:31:46.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.314 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:31:46.335 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T21:31:46.335 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T21:31:46.336 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:31:46.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T21:31:46.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.404 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T21:31:46.464 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T21:31:46.464 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:31:46.546 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:31:46.546 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:31:46.568 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:31:46.568 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:31:46.570 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T21:31:46.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:31:46.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T21:31:46.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T21:31:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.798+0000 7fcc9b0de700 1 Processor -- start 2024-01-21T21:31:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.798+0000 7fcc9b0de700 1 -- start start 2024-01-21T21:31:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9b0de700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc940c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9b0de700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc940695b0 0x7fcc94069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9b0de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc94069ef0 con 0x7fcc9413ac10 2024-01-21T21:31:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9b0de700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc940c3890 con 0x7fcc940695b0 2024-01-21T21:31:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9b0de700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940c3b70 con 0x7fcc9413a830 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc93fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc9413ac10 0x7fcc940bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54452/0 (socket says 172.21.15.133:54452) 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc93fff700 1 -- 172.21.15.133:0/3497157664 learned_addr learned my addr 172.21.15.133:0/3497157664 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc9967b700 1 --2- 172.21.15.133:0/3497157664 >> v2:172.21.15.178:3300/0 conn(0x7fcc940695b0 0x7fcc94069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc940c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752551901 0 0) 0x7fcc94069ef0 con 0x7fcc9413ac10 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.799+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc840033f0 con 0x7fcc9413ac10 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3339609449 0 0) 0x7fcc840033f0 con 0x7fcc9413ac10 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 msgr2=0x7fcc940c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc940c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 >> v2:172.21.15.178:3300/0 conn(0x7fcc940695b0 msgr2=0x7fcc94069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 --2- 172.21.15.133:0/3497157664 >> v2:172.21.15.178:3300/0 conn(0x7fcc940695b0 0x7fcc94069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940c3e50 con 0x7fcc9413ac10 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fcc80001470 con 0x7fcc9413ac10 2024-01-21T21:31:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc9967b700 1 --2- 172.21.15.133:0/3497157664 >> v2:172.21.15.178:3300/0 conn(0x7fcc940695b0 0x7fcc94069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 >> v1:172.21.15.133:6789/0 conn(0x7fcc9413ac10 legacy=0x7fcc940bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc840038e0 0x7fcc84003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc84004690 0x7fcc84004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc84005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940c3890 con 0x7fcc840038e0 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940c3b70 con 0x7fcc84004690 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8400b8e0 con 0x7fcc9413a830 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc840038e0 0x7fcc84003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc93fff700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc84004690 0x7fcc84004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc9967b700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc84005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 -- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 msgr2=0x7fcc84005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc84005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 -- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc84004690 msgr2=0x7fcc84004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc84004690 0x7fcc84004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 -- 172.21.15.133:0/3497157664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc840033f0 con 0x7fcc840038e0 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc9967b700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc9413a830 0x7fcc84005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc93fff700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc84004690 0x7fcc84004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc840038e0 0x7fcc84003d00 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fcc88009a80 tx=0x7fcc88009060).ready entity=mon.0 client_cookie=465026f15719e362 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88009430 con 0x7fcc840038e0 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800e640 con 0x7fcc840038e0 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.800+0000 7fcc937fe700 1 -- 172.21.15.133:0/3497157664 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800e9c0 con 0x7fcc840038e0 2024-01-21T21:31:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 -- 172.21.15.133:0/3497157664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc840038e0 msgr2=0x7fcc84003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/3497157664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc840038e0 0x7fcc84003d00 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fcc88009a80 tx=0x7fcc88009060).stop 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9967b700 1 -- 172.21.15.133:0/3497157664 reap_dead start 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 -- 172.21.15.133:0/3497157664 shutdown_connections 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 -- 172.21.15.133:0/3497157664 >> 172.21.15.133:0/3497157664 conn(0x7fcc940c7dc0 msgr2=0x7fcc940c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 -- 172.21.15.133:0/3497157664 shutdown_connections 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.801+0000 7fcc9b0de700 1 -- 172.21.15.133:0/3497157664 wait complete. 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.802+0000 7fcc9b0de700 1 Processor -- start 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.802+0000 7fcc9b0de700 1 -- start start 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc840038e0 0x7fcc941370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc94152050 0x7fcc941524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc940a6570 con 0x7fcc941657a0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc941651e0 con 0x7fcc94152050 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9b0de700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc941654c0 con 0x7fcc840038e0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34294/0 (socket says 172.21.15.133:34294) 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 -- 172.21.15.133:0/872492300 learned_addr learned my addr 172.21.15.133:0/872492300 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc840038e0 0x7fcc941370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc9967b700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc94152050 0x7fcc941524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 -- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc840038e0 msgr2=0x7fcc941370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc840038e0 0x7fcc941370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 -- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc94152050 msgr2=0x7fcc941524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc94152050 0x7fcc941524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.803+0000 7fcc93fff700 1 -- 172.21.15.133:0/872492300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94151570 con 0x7fcc941657a0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc93fff700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7fcc8000e810 tx=0x7fcc80001430).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80010520 con 0x7fcc941657a0 2024-01-21T21:31:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc80010680 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc94151850 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80010a20 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.804+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc94153650 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.805+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9405fdf0 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.805+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fcc80014430 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.805+0000 7fcc917fa700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 0x7fcc78061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.805+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fcc80079ee0 con 0x7fcc941657a0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.806+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 0x7fcc78061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.806+0000 7fcc98e7a700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 0x7fcc78061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcc88006d50 tx=0x7fcc8801a000).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:46.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.809+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fcc80049b00 con 0x7fcc941657a0 2024-01-21T21:31:47.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:46.998+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc940c4130 con 0x7fcc7805f150 2024-01-21T21:31:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.000+0000 7fcc917fa700 1 -- 172.21.15.133:0/872492300 <== mgr.9387 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcc940c4130 con 0x7fcc7805f150 2024-01-21T21:31:47.002 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:31:47.003 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:31:47.003 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T21:31:47.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:31:47.003 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:31:47.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.001+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 msgr2=0x7fcc78061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.001+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 0x7fcc78061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcc88006d50 tx=0x7fcc8801a000).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.001+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 msgr2=0x7fcc94165c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.001+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7fcc8000e810 tx=0x7fcc80001430).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 shutdown_connections 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fcc7805f150 0x7fcc78061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc94152050 0x7fcc941524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc840038e0 0x7fcc941370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 --2- 172.21.15.133:0/872492300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc941657a0 0x7fcc94165c00 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 >> 172.21.15.133:0/872492300 conn(0x7fcc940c7dc0 msgr2=0x7fcc940ad510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 shutdown_connections 2024-01-21T21:31:47.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.002+0000 7fcc9b0de700 1 -- 172.21.15.133:0/872492300 wait complete. 2024-01-21T21:31:47.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T21:31:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.131+0000 7fb259df0700 1 Processor -- start 2024-01-21T21:31:47.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.131+0000 7fb259df0700 1 -- start start 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.132+0000 7fb259df0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.132+0000 7fb259df0700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb254069ef0 0x7fb254066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.132+0000 7fb259df0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb254065660 con 0x7fb2540c3fb0 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.132+0000 7fb259df0700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2540bef10 con 0x7fb254069ef0 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.132+0000 7fb259df0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb254156070 con 0x7fb2540beb30 2024-01-21T21:31:47.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb254069ef0 0x7fb254066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb254069ef0 0x7fb254066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:47810/0 (socket says 172.21.15.133:47810) 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:57892/0 (socket says 172.21.15.133:57892) 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 -- 172.21.15.133:0/2743178915 learned_addr learned my addr 172.21.15.133:0/2743178915 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb252ffd700 1 --1- 172.21.15.133:0/2743178915 >> v1:172.21.15.178:6789/0 conn(0x7fb2540c3fb0 0x7fb2540697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:36028/0 (socket says 172.21.15.133:36028) 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 -- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 msgr2=0x7fb254155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 -- 172.21.15.133:0/2743178915 >> v1:172.21.15.178:6789/0 conn(0x7fb2540c3fb0 legacy=0x7fb2540697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 -- 172.21.15.133:0/2743178915 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb254065f00 con 0x7fb254069ef0 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2527fc700 1 -- 172.21.15.133:0/2743178915 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433944714 0 0) 0x7fb254065660 con 0x7fb2540c3fb0 2024-01-21T21:31:47.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2537fe700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb253fff700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb254069ef0 0x7fb254066390 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb24c009f50 tx=0x7fb24c009840).ready entity=mon.1 client_cookie=2c3629f4ff213078 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2527fc700 1 -- 172.21.15.133:0/2743178915 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00e070 con 0x7fb254069ef0 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2527fc700 1 -- 172.21.15.133:0/2743178915 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00b9c0 con 0x7fb254069ef0 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.133+0000 7fb2527fc700 1 -- 172.21.15.133:0/2743178915 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00bd40 con 0x7fb254069ef0 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 -- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb254069ef0 msgr2=0x7fb254066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb254069ef0 0x7fb254066390 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb24c009f50 tx=0x7fb24c009840).stop 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 -- 172.21.15.133:0/2743178915 shutdown_connections 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb254069ef0 0x7fb254066390 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 --2- 172.21.15.133:0/2743178915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb254155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 -- 172.21.15.133:0/2743178915 >> 172.21.15.133:0/2743178915 conn(0x7fb2540c8010 msgr2=0x7fb2540c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 -- 172.21.15.133:0/2743178915 shutdown_connections 2024-01-21T21:31:47.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.134+0000 7fb259df0700 1 -- 172.21.15.133:0/2743178915 wait complete. 2024-01-21T21:31:47.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.135+0000 7fb259df0700 1 Processor -- start 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.135+0000 7fb259df0700 1 -- start start 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb2540c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2540c3fb0 0x7fb2540a6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540c01a0 con 0x7fb254069ef0 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2541686d0 con 0x7fb2540c3fb0 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb259df0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2540bfec0 con 0x7fb2540beb30 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34296/0 (socket says 172.21.15.133:34296) 2024-01-21T21:31:47.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 -- 172.21.15.133:0/1278908389 learned_addr learned my addr 172.21.15.133:0/1278908389 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb252ffd700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb2540c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb253fff700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2540c3fb0 0x7fb2540a6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 -- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 msgr2=0x7fb2540c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb2540c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 -- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2540c3fb0 msgr2=0x7fb2540a6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2540c3fb0 0x7fb2540a6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.136+0000 7fb2537fe700 1 -- 172.21.15.133:0/1278908389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24400b540 con 0x7fb254069ef0 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb2537fe700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fb24400ee10 tx=0x7fb24400b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ee40 con 0x7fb254069ef0 2024-01-21T21:31:47.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c009ae0 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400dd30 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400dea0 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.137+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb254168360 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.138+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25405fdf0 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.138+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 92) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb2440108a0 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.138+0000 7fb24bfff700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 0x7fb234061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.139+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7fb24407ade0 con 0x7fb254069ef0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.139+0000 7fb252ffd700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 0x7fb234061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:47.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.139+0000 7fb252ffd700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 0x7fb234061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb254067350 tx=0x7fb23c007d70).ready entity=mgr.9387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:47.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.143+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb24404bea0 con 0x7fb254069ef0 2024-01-21T21:31:47.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:47.350+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb2540c4740 con 0x7fb254069ef0 2024-01-21T21:31:48.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.123+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 93) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fb2440789a0 con 0x7fb254069ef0 2024-01-21T21:31:48.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.123+0000 7fb24bfff700 1 -- 172.21.15.133:0/1278908389 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v93) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb244074740 con 0x7fb254069ef0 2024-01-21T21:31:48.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.126+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 msgr2=0x7fb234061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.126+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 0x7fb234061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb254067350 tx=0x7fb23c007d70).stop 2024-01-21T21:31:48.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.126+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 msgr2=0x7fb2540bf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.126+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7fb24400ee10 tx=0x7fb24400b300).stop 2024-01-21T21:31:48.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 shutdown_connections 2024-01-21T21:31:48.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb23405f150 0x7fb234061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2540c3fb0 0x7fb2540a6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb254069ef0 0x7fb2540bf920 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 --2- 172.21.15.133:0/1278908389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2540beb30 0x7fb2540c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 >> 172.21.15.133:0/1278908389 conn(0x7fb2540c8010 msgr2=0x7fb2540bcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:48.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 shutdown_connections 2024-01-21T21:31:48.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.127+0000 7fb259df0700 1 -- 172.21.15.133:0/1278908389 wait complete. 2024-01-21T21:31:48.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T21:31:48.267 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:48.264+0000 7f62d8335680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:31:48.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.265+0000 7f04a95e6700 1 Processor -- start 2024-01-21T21:31:48.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.265+0000 7f04a95e6700 1 -- start start 2024-01-21T21:31:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a95e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a95e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a40c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a95e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a40c6290 con 0x7f04a4137410 2024-01-21T21:31:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a95e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a4068370 con 0x7f04a4137030 2024-01-21T21:31:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a95e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4068650 con 0x7f04a40c5930 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.266+0000 7f04a27fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f04a4137410 0x7f04a4155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54470/0 (socket says 172.21.15.133:54470) 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a27fc700 1 -- 172.21.15.133:0/3875308769 learned_addr learned my addr 172.21.15.133:0/3875308769 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a37fe700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a40c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a2ffd700 1 -- 172.21.15.133:0/3875308769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 msgr2=0x7f04a40c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a2ffd700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a40c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a2ffd700 1 -- 172.21.15.133:0/3875308769 >> v1:172.21.15.133:6789/0 conn(0x7f04a4137410 legacy=0x7f04a4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a2ffd700 1 -- 172.21.15.133:0/3875308769 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a4068930 con 0x7f04a4137030 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a1ffb700 1 -- 172.21.15.133:0/3875308769 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143032529 0 0) 0x7f04a40c6290 con 0x7f04a4137410 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a2ffd700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137030 0x7f04a4067d90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f0494009760 tx=0x7f0494009060).ready entity=mon.0 client_cookie=abb3f0aab62d8e19 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a1ffb700 1 -- 172.21.15.133:0/3875308769 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04940090d0 con 0x7f04a4137030 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a1ffb700 1 -- 172.21.15.133:0/3875308769 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049400f510 con 0x7f04a4137030 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.267+0000 7f04a1ffb700 1 -- 172.21.15.133:0/3875308769 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049400f890 con 0x7f04a4137030 2024-01-21T21:31:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 -- 172.21.15.133:0/3875308769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137030 msgr2=0x7f04a4067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137030 0x7f04a4067d90 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f0494009760 tx=0x7f0494009060).stop 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 -- 172.21.15.133:0/3875308769 shutdown_connections 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a40c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3875308769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137030 0x7f04a4067d90 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 -- 172.21.15.133:0/3875308769 >> 172.21.15.133:0/3875308769 conn(0x7f04a4066a90 msgr2=0x7f04a4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 -- 172.21.15.133:0/3875308769 shutdown_connections 2024-01-21T21:31:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.268+0000 7f04a95e6700 1 -- 172.21.15.133:0/3875308769 wait complete. 2024-01-21T21:31:48.272 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:48.269+0000 7f815a06d680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.269+0000 7f04a95e6700 1 Processor -- start 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.269+0000 7f04a95e6700 1 -- start start 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a413d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a413d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a413d740 con 0x7f04a4137410 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40c0380 con 0x7f04a4137030 2024-01-21T21:31:48.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a95e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a413de40 con 0x7f04a40c5930 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34320/0 (socket says 172.21.15.133:34320) 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 -- 172.21.15.133:0/3637459455 learned_addr learned my addr 172.21.15.133:0/3637459455 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a2ffd700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a413d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a27fc700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a413d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 -- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 msgr2=0x7f04a413d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a413d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 -- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 msgr2=0x7f04a413d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a413d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 -- 172.21.15.133:0/3637459455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04940092a0 con 0x7f04a4137410 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a27fc700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a413d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.270+0000 7f04a37fe700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f049c009e90 tx=0x7f049c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:48.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.271+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00caa0 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.271+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c00f040 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.271+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a40c0620 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.271+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00ce10 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.271+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a40c0be0 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.272+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a40c0e00 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.272+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 93) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f049c013610 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.272+0000 7f048b7fe700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 0x7f0490061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.272+0000 7f04a2ffd700 1 -- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 msgr2=0x7f0490061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.273+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f049c07ace0 con 0x7f04a4137410 2024-01-21T21:31:48.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.273+0000 7f04a2ffd700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 0x7f0490061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.277+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f049c04bd00 con 0x7f04a4137410 2024-01-21T21:31:48.331 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:48.328+0000 7f62d8335680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:31:48.338 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:48.335+0000 7f815a06d680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:31:48.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.448+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f04a40c6e20 con 0x7f04a4137410 2024-01-21T21:31:48.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.452+0000 7f048b7fe700 1 -- 172.21.15.133:0/3637459455 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v39)=0 v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f049c04f320 con 0x7f04a4137410 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 msgr2=0x7f0490061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 0x7f0490061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 msgr2=0x7f04a4159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f049c009e90 tx=0x7f049c00b040).stop 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 shutdown_connections 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04a4137410 0x7f04a4159f20 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04a40c5930 0x7f04a413d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f049005f1a0 0x7f0490061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 --2- 172.21.15.133:0/3637459455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04a4137030 0x7f04a413d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 >> 172.21.15.133:0/3637459455 conn(0x7f04a4066a90 msgr2=0x7f04a40c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 shutdown_connections 2024-01-21T21:31:48.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.454+0000 7f04a95e6700 1 -- 172.21.15.133:0/3637459455 wait complete. 2024-01-21T21:31:48.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:48.469 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T21:31:48.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2024-01-21T21:31:48.606 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:48.603+0000 7f62d8335680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:31:48.625 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:48.623+0000 7f815a06d680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:31:48.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 Processor -- start 2024-01-21T21:31:48.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 -- start start 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 0x7f0b28155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b280c9040 con 0x7f0b28155a60 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b280c9290 con 0x7f0b2814e8d0 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.652+0000 7f0b2d342700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c9570 con 0x7f0b2814ecb0 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b277fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0b28155a60 0x7f0b280c0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54482/0 (socket says 172.21.15.133:54482) 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b277fe700 1 -- 172.21.15.133:0/3497647213 learned_addr learned my addr 172.21.15.133:0/3497647213 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b267fc700 1 --2- 172.21.15.133:0/3497647213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 0x7f0b28155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027527822 0 0) 0x7f0b280c9040 con 0x7f0b28155a60 2024-01-21T21:31:48.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b100033f0 con 0x7f0b28155a60 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737247670 0 0) 0x7f0b280c9290 con 0x7f0b2814e8d0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b280c9040 con 0x7f0b2814e8d0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b267fc700 1 -- 172.21.15.133:0/3497647213 >> v1:172.21.15.178:6789/0 conn(0x7f0b2814e8d0 legacy=0x7f0b2805e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b267fc700 1 -- 172.21.15.133:0/3497647213 >> v1:172.21.15.133:6789/0 conn(0x7f0b28155a60 legacy=0x7f0b280c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b267fc700 1 -- 172.21.15.133:0/3497647213 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b280c9850 con 0x7f0b2814ecb0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b267fc700 1 --2- 172.21.15.133:0/3497647213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 0x7f0b28155570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0b1c009790 tx=0x7f0b1c009060).ready entity=mon.2 client_cookie=bf92cbc77eb8cfdd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00f510 con 0x7f0b2814ecb0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00f670 con 0x7f0b2814ecb0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.653+0000 7f0b25ffb700 1 -- 172.21.15.133:0/3497647213 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00f9f0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 -- 172.21.15.133:0/3497647213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 msgr2=0x7f0b28155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 --2- 172.21.15.133:0/3497647213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 0x7f0b28155570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f0b1c009790 tx=0x7f0b1c009060).stop 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 -- 172.21.15.133:0/3497647213 shutdown_connections 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 --2- 172.21.15.133:0/3497647213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814ecb0 0x7f0b28155570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 -- 172.21.15.133:0/3497647213 >> 172.21.15.133:0/3497647213 conn(0x7f0b28084eb0 msgr2=0x7f0b280947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:48.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 -- 172.21.15.133:0/3497647213 shutdown_connections 2024-01-21T21:31:48.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.654+0000 7f0b2d342700 1 -- 172.21.15.133:0/3497647213 wait complete. 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.655+0000 7f0b2d342700 1 Processor -- start 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.655+0000 7f0b2d342700 1 -- start start 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814e8d0 0x7f0b28145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b28155a60 0x7f0b28157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c35b0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b281461b0 con 0x7f0b28155a60 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b2d342700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b280c29c0 con 0x7f0b2814e8d0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34328/0 (socket says 172.21.15.133:34328) 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b267fc700 1 -- 172.21.15.133:0/603450900 learned_addr learned my addr 172.21.15.133:0/603450900 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814e8d0 0x7f0b28145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.656+0000 7f0b277fe700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b28155a60 0x7f0b28157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814e8d0 msgr2=0x7f0b28145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814e8d0 0x7f0b28145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b28155a60 msgr2=0x7f0b28157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b28155a60 0x7f0b28157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0092a0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b267fc700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f0b280626f0 tx=0x7f0b1c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00fe80 con 0x7f0b2814ecb0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00f7e0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b280c2c80 con 0x7f0b2814ecb0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c01b640 con 0x7f0b2814ecb0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.657+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b280c3240 con 0x7f0b2814ecb0 2024-01-21T21:31:48.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.658+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b280c3760 con 0x7f0b2814ecb0 2024-01-21T21:31:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.659+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 93) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f0b1c01b9b0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.659+0000 7f0b0f7fe700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.659+0000 7f0b26ffd700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.660+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6805+0+0 (secure 0 0 0) 0x7f0b1c07bfd0 con 0x7f0b2814ecb0 2024-01-21T21:31:48.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.660+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:31:48.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.667+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0b1c04cf30 con 0x7f0b2814ecb0 2024-01-21T21:31:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.861+0000 7f0b26ffd700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.861+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:31:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:48.861+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b280c3760 con 0x7f0b1405f170 2024-01-21T21:31:49.220 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:49.218+0000 7f62d8335680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:31:49.251 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:49.248+0000 7f815a06d680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:31:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:49.262+0000 7f0b26ffd700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:49.262+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T21:31:49.293 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:49.290+0000 7f62d8335680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:31:49.323 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:49.321+0000 7f815a06d680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:31:49.480 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:49.477+0000 7f62d8335680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:31:49.511 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:49.508+0000 7f815a06d680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:31:49.901 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:49.898+0000 7f62d8335680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:31:49.932 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:49.930+0000 7f815a06d680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:31:50.004 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.001+0000 7f62d8335680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:50.035 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.033+0000 7f815a06d680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:50.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:50.063+0000 7f0b26ffd700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:50.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:50.063+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T21:31:50.159 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.156+0000 7f62d8335680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:50.191 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.189+0000 7f815a06d680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:50.234 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.231+0000 7f62d8335680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:31:50.266 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.264+0000 7f815a06d680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:31:50.302 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.299+0000 7f62d8335680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:31:50.334 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.332+0000 7f815a06d680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:31:50.558 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.555+0000 7f62d8335680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:31:50.593 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.590+0000 7f815a06d680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:31:50.741 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:50.738+0000 7f62d8335680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:50.776 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:50.774+0000 7f815a06d680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:31:51.393 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.390+0000 7f62d8335680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:31:51.428 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.426+0000 7f815a06d680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:31:51.462 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.459+0000 7f62d8335680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:31:51.498 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.495+0000 7f815a06d680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:31:51.537 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.534+0000 7f62d8335680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:31:51.573 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.571+0000 7f815a06d680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:31:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:51.664+0000 7f0b26ffd700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:31:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:51.664+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T21:31:51.684 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.682+0000 7f62d8335680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:31:51.720 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.718+0000 7f815a06d680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:31:51.755 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.753+0000 7f62d8335680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:31:51.792 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.789+0000 7f815a06d680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:31:51.869 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.867+0000 7f62d8335680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:31:51.907 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:51.905+0000 7f815a06d680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:31:51.977 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:51.975+0000 7f62d8335680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:52.015 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.013+0000 7f815a06d680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:31:52.273 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:52.270+0000 7f62d8335680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:31:52.311 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.309+0000 7f815a06d680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:31:52.343 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:31:52.341+0000 7f62d8335680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:31:52.383 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.381+0000 7f815a06d680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:31:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:52.399+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 94) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f0b1c079a30 con 0x7f0b2814ecb0 2024-01-21T21:31:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:52.399+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b14061630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:31:52.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:52.399+0000 7f0b0f7fe700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b14061630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:31:52.455 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.452+0000 7f80d0e13700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.455 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.452+0000 7f80d0e13700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.456 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.452+0000 7f80d0e13700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.456 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.452+0000 7f80d0e13700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.456 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.452+0000 7f80d0e13700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.453+0000 7f80cde0d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.453+0000 7f80cde0d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.453+0000 7f80cde0d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.453+0000 7f80cde0d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:52.458 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:31:52.453+0000 7f80cde0d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:31:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.416+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 95) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f0b1c079db0 con 0x7f0b2814ecb0 2024-01-21T21:31:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.417+0000 7f0b0f7fe700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b140615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.417+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b280c3760 con 0x7f0b1405f170 2024-01-21T21:31:53.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.418+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b140615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.420+0000 7f0b26ffd700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b140615b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0b18007e90 tx=0x7f0b18009040).ready entity=mgr.9777 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.436+0000 7f0b0f7fe700 1 -- 172.21.15.133:0/603450900 <== mgr.9777 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0b280c3760 con 0x7f0b1405f170 2024-01-21T21:31:53.439 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.438+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 msgr2=0x7f0b140615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.438+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b140615b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0b18007e90 tx=0x7f0b18009040).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 msgr2=0x7f0b28155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f0b280626f0 tx=0x7f0b1c017000).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 shutdown_connections 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0b1405f170 0x7f0b140615b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b28155a60 0x7f0b28157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2814e8d0 0x7f0b28145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 --2- 172.21.15.133:0/603450900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b2814ecb0 0x7f0b28155f10 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 >> 172.21.15.133:0/603450900 conn(0x7f0b28084eb0 msgr2=0x7f0b28064300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 shutdown_connections 2024-01-21T21:31:53.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.439+0000 7f0b2d342700 1 -- 172.21.15.133:0/603450900 wait complete. 2024-01-21T21:31:53.456 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T21:31:53.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2024-01-21T21:31:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.578+0000 7fa69aa0c700 1 Processor -- start 2024-01-21T21:31:53.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.578+0000 7fa69aa0c700 1 -- start start 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa69aa0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6941549a0 0x7fa6940c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa69aa0c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa6941552c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa69aa0c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa694155c40 con 0x7fa6941557b0 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa69aa0c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940c3740 con 0x7fa6941549a0 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa69aa0c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940c22e0 con 0x7fa694154d80 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.579+0000 7fa693fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6941549a0 0x7fa6940c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa698fa9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa6941557b0 0x7fa694069b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57684/0 (socket says 172.21.15.133:57684) 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa698fa9700 1 -- 172.21.15.133:0/1704066682 learned_addr learned my addr 172.21.15.133:0/1704066682 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa6937fe700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa6941552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa693fff700 1 -- 172.21.15.133:0/1704066682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 msgr2=0x7fa6941552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:53.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa693fff700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa6941552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa693fff700 1 -- 172.21.15.133:0/1704066682 >> v1:172.21.15.133:6789/0 conn(0x7fa6941557b0 legacy=0x7fa694069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa693fff700 1 -- 172.21.15.133:0/1704066682 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940c25c0 con 0x7fa6941549a0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa692ffd700 1 -- 172.21.15.133:0/1704066682 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976733307 0 0) 0x7fa694155c40 con 0x7fa6941557b0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa693fff700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941549a0 0x7fa6940c3250 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fa684009760 tx=0x7fa684009060).ready entity=mon.0 client_cookie=886a86d2f1cb4977 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa692ffd700 1 -- 172.21.15.133:0/1704066682 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6840090d0 con 0x7fa6941549a0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa692ffd700 1 -- 172.21.15.133:0/1704066682 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400b580 con 0x7fa6941549a0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.580+0000 7fa692ffd700 1 -- 172.21.15.133:0/1704066682 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400b900 con 0x7fa6941549a0 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 -- 172.21.15.133:0/1704066682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941549a0 msgr2=0x7fa6940c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941549a0 0x7fa6940c3250 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fa684009760 tx=0x7fa684009060).stop 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 -- 172.21.15.133:0/1704066682 shutdown_connections 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941549a0 0x7fa6940c3250 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/1704066682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa6941552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 -- 172.21.15.133:0/1704066682 >> 172.21.15.133:0/1704066682 conn(0x7fa6940c6ef0 msgr2=0x7fa6940c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 -- 172.21.15.133:0/1704066682 shutdown_connections 2024-01-21T21:31:53.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.581+0000 7fa69aa0c700 1 -- 172.21.15.133:0/1704066682 wait complete. 2024-01-21T21:31:53.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.582+0000 7fa69aa0c700 1 Processor -- start 2024-01-21T21:31:53.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.582+0000 7fa69aa0c700 1 -- start start 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 0x7fa6940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa694146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941475a0 con 0x7fa6941557b0 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694164c80 con 0x7fa6941549a0 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa694164f60 con 0x7fa694154d80 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41262/0 (socket says 172.21.15.133:41262) 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 -- 172.21.15.133:0/2062338924 learned_addr learned my addr 172.21.15.133:0/2062338924 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa6937fe700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa694146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa693fff700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 0x7fa6940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 -- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 msgr2=0x7fa694146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa694146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 -- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 msgr2=0x7fa6940a5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 0x7fa6940a5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 -- 172.21.15.133:0/2062338924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840092a0 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa6937fe700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa694146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa693fff700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 0x7fa6940a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa698fa9700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fa68c00c7e0 tx=0x7fa68c007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c005d30 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c005e90 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c007320 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.583+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa694165240 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.584+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa694164990 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa694165760 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 95) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fa68c007710 con 0x7fa6941557b0 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa690ff9700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 0x7fa680061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fa68c07a3a0 con 0x7fa6941557b0 2024-01-21T21:31:53.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa693fff700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 0x7fa680061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.585+0000 7fa693fff700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 0x7fa680061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa68400b340 tx=0x7fa684017000).ready entity=mgr.9777 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.589+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa694165760 con 0x7fa6941557b0 2024-01-21T21:31:53.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.778+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa694165760 con 0x7fa68005f080 2024-01-21T21:31:53.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.782+0000 7fa690ff9700 1 -- 172.21.15.133:0/2062338924 <== mgr.9777 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fa694165760 con 0x7fa68005f080 2024-01-21T21:31:53.785 INFO:teuthology.orchestra.run.smithi133.stdout:Retention added to path snap_test_dir1 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.784+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 msgr2=0x7fa680061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.784+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 0x7fa680061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa68400b340 tx=0x7fa684017000).stop 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.784+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 msgr2=0x7fa6941470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.784+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fa68c00c7e0 tx=0x7fa68c007f90).stop 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 shutdown_connections 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6941557b0 0x7fa6941470b0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa68005f080 0x7fa680061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6941549a0 0x7fa6940a5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 --2- 172.21.15.133:0/2062338924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa694154d80 0x7fa694146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 >> 172.21.15.133:0/2062338924 conn(0x7fa6940c6ef0 msgr2=0x7fa694153080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 shutdown_connections 2024-01-21T21:31:53.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.785+0000 7fa69aa0c700 1 -- 172.21.15.133:0/2062338924 wait complete. 2024-01-21T21:31:53.799 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2024-01-21T21:31:53.799 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2024-01-21-21_32_00 in ~7s... 2024-01-21T21:31:53.799 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2024-01-21T21:31:53.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2024-01-21T21:31:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.916+0000 7f76fcbb7700 1 Processor -- start 2024-01-21T21:31:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.916+0000 7f76fcbb7700 1 -- start start 2024-01-21T21:31:53.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.917+0000 7f76fcbb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f80bda90 0x7f76f80694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.917+0000 7f76fcbb7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76f80c3850 0x7f76f80699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.917+0000 7f76fcbb7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f80c23b0 con 0x7f76f813a7b0 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.917+0000 7f76fcbb7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80663c0 con 0x7f76f80c3850 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.917+0000 7f76fcbb7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8069eb0 con 0x7f76f80bda90 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76f80c3850 0x7f76f80699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76f80c3850 0x7f76f80699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41266/0 (socket says 172.21.15.133:41266) 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 -- 172.21.15.133:0/783569592 learned_addr learned my addr 172.21.15.133:0/783569592 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f5d9b700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f80bda90 0x7f76f80694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 -- 172.21.15.133:0/783569592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f80bda90 msgr2=0x7f76f80694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f80bda90 0x7f76f80694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 -- 172.21.15.133:0/783569592 >> v1:172.21.15.178:6789/0 conn(0x7f76f813a7b0 legacy=0x7f76f8066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 -- 172.21.15.133:0/783569592 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8067600 con 0x7f76f80c3850 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f6d9d700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80c3850 0x7f76f80699c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7f76f0009f20 tx=0x7f76f0009840).ready entity=mon.0 client_cookie=17181eee04cd1423 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f559a700 1 -- 172.21.15.133:0/783569592 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000e070 con 0x7f76f80c3850 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f559a700 1 -- 172.21.15.133:0/783569592 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000b9d0 con 0x7f76f80c3850 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.918+0000 7f76f559a700 1 -- 172.21.15.133:0/783569592 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000bd50 con 0x7f76f80c3850 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 -- 172.21.15.133:0/783569592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80c3850 msgr2=0x7f76f80699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80c3850 0x7f76f80699c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7f76f0009f20 tx=0x7f76f0009840).stop 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 -- 172.21.15.133:0/783569592 shutdown_connections 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80c3850 0x7f76f80699c0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/783569592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f80bda90 0x7f76f80694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 -- 172.21.15.133:0/783569592 >> 172.21.15.133:0/783569592 conn(0x7f76f80c7d20 msgr2=0x7f76f80c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 -- 172.21.15.133:0/783569592 shutdown_connections 2024-01-21T21:31:53.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.919+0000 7f76fcbb7700 1 -- 172.21.15.133:0/783569592 wait complete. 2024-01-21T21:31:53.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.920+0000 7f76fcbb7700 1 Processor -- start 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.920+0000 7f76fcbb7700 1 -- start start 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c3850 0x7f76f8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f813a7b0 0x7f76f81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81660d0 con 0x7f76f80bedc0 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80bf710 con 0x7f76f80c3850 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76fcbb7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f81654c0 con 0x7f76f813a7b0 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f813a7b0 0x7f76f81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41268/0 (socket says 172.21.15.133:41268) 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 -- 172.21.15.133:0/1629026903 learned_addr learned my addr 172.21.15.133:0/1629026903 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f659c700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c3850 0x7f76f8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 -- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f813a7b0 msgr2=0x7f76f81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f813a7b0 0x7f76f81573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 -- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c3850 msgr2=0x7f76f8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c3850 0x7f76f8156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 -- 172.21.15.133:0/1629026903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009ae0 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.921+0000 7f76f6d9d700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f76f0010000 tx=0x7f76f80c2320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.922+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00092e0 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.922+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f0013e30 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.922+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f001e6c0 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.922+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f81657a0 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.922+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f8165d60 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.923+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f805fdf0 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.923+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 95) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f76f0003040 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.923+0000 7f76e6ffd700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 0x7f76d8061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.923+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f76f007b730 con 0x7f76f80bedc0 2024-01-21T21:31:53.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.923+0000 7f76f659c700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 0x7f76d8061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:31:53.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.924+0000 7f76f659c700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 0x7f76d8061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76ec003860 tx=0x7f76ec007d40).ready entity=mgr.9777 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:31:53.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:53.927+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f76f004c920 con 0x7f76f80bedc0 2024-01-21T21:31:54.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.115+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76f806bd20 con 0x7f76d805f080 2024-01-21T21:31:54.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.117+0000 7f76e6ffd700 1 -- 172.21.15.133:0/1629026903 <== mgr.9777 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f76f806bd20 con 0x7f76d805f080 2024-01-21T21:31:54.120 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:31:54.120 INFO:teuthology.orchestra.run.smithi133.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2024-01-21T21:31:54.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.119+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 msgr2=0x7f76d8061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:54.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.119+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 0x7f76d8061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f76ec003860 tx=0x7f76ec007d40).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 msgr2=0x7f76f80bf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f76f0010000 tx=0x7f76f80c2320).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 shutdown_connections 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76f80bedc0 0x7f76f80bf220 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f76d805f080 0x7f76d8061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c3850 0x7f76f8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 --2- 172.21.15.133:0/1629026903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f813a7b0 0x7f76f81573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 >> 172.21.15.133:0/1629026903 conn(0x7f76f80c7d20 msgr2=0x7f76f8153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 shutdown_connections 2024-01-21T21:31:54.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:31:54.120+0000 7f76fcbb7700 1 -- 172.21.15.133:0/1629026903 wait complete. 2024-01-21T21:31:54.134 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2024-01-21T21:31:54.134 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2024-01-21T21:31:54.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:54.135 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:31:55.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:55.154 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:31:56.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:56.178 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:31:57.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:57.200 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:31:58.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:58.224 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:31:59.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:31:59.247 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:00.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:00.270 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:00.790 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:32:00.787+0000 7f80bfdf1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:32:00.790 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:32:00.787+0000 7f80bfdf1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:32:00.790 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:32:00.787+0000 7f80bfdf1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:32:00.790 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:32:00.787+0000 7f80bfdf1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:32:00.790 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:32:00.787+0000 7f80bfdf1700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:32:01.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:01.293 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:01.316 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:01.316 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2024-01-21-21_32_00_UTC'] 2024-01-21T21:32:01.316 DEBUG:tasks.cephfs.test_snap_schedules:exec=1705872713.799262, now = 1705872721.3168445, timo = 7 2024-01-21T21:32:02.317 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2024-01-21-21_32_00 in ~67s... 2024-01-21T21:32:02.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:02.317 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:02.338 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:03.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:03.340 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:03.362 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:04.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:04.363 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:04.385 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:05.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:05.387 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:05.408 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:06.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:06.410 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:06.432 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:07.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:07.433 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:07.455 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:08.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:08.456 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:08.477 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:08.662 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:32:08.665 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:32:09.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:09.479 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:09.501 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:10.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:10.503 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:10.524 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:11.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:11.526 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:11.547 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:12.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:12.549 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:12.570 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:13.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:13.572 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:13.595 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:14.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:14.596 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:14.618 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:15.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:15.619 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:15.640 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:16.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:16.642 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:16.663 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:17.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:17.664 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:18.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:18.687 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:18.709 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:19.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:19.710 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:19.731 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:20.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:20.734 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:20.755 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:21.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:21.756 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:21.777 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:22.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:22.779 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:22.800 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:23.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:23.802 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:23.823 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:24.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:24.825 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:24.846 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:25.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:25.847 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:25.868 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:26.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:26.870 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:26.892 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:27.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:27.892 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:27.914 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:28.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:28.915 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:28.937 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:29.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:29.939 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:29.960 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:30.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:30.961 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:30.982 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:31.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:31.985 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:32.006 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:33.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:33.008 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:33.030 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:34.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:34.031 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:34.053 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:35.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:35.055 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:35.076 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:36.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:36.078 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:36.099 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:37.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:37.101 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:37.122 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:38.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:38.123 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:38.145 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:38.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:32:38.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:32:39.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:39.147 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:39.167 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:40.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:40.169 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:40.191 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:41.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:41.192 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:41.213 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:42.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:42.215 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:42.236 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:43.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:43.238 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:43.259 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:44.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:44.260 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:44.282 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:45.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:45.283 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:45.304 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:46.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:46.306 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:46.327 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:47.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:47.329 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:47.351 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:48.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:48.352 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:48.374 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:49.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:49.375 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:49.396 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:50.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:50.398 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:50.420 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:51.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:51.421 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:51.442 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:52.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:52.444 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:52.465 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:53.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:53.467 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:53.488 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:54.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:54.489 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:54.510 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:55.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:55.512 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:55.534 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:56.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:56.535 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:56.557 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:57.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:57.560 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:57.581 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:58.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:58.582 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:58.603 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:32:59.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:32:59.605 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:32:59.627 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:33:00.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:00.629 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:33:00.651 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_32_00_UTC 2024-01-21T21:33:01.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:01.652 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:33:01.674 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_33_00_UTC 2024-01-21T21:33:01.675 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2024-01-21-21_32_00_UTC'] 2024-01-21T21:33:01.675 DEBUG:tasks.cephfs.test_snap_schedules:exec=1705872713.799262, now = 1705872781.6754892, timo = 67 2024-01-21T21:33:02.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2024-01-21T21:33:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.805+0000 7ff98e54c700 1 Processor -- start 2024-01-21T21:33:02.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.805+0000 7ff98e54c700 1 -- start start 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98e54c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff98813a7b0 0x7ff988066b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98e54c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff988069be0 0x7ff98815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98e54c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9880c23b0 con 0x7ff9880bda90 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98e54c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9880663c0 con 0x7ff988069be0 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98e54c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff988067600 con 0x7ff98813a7b0 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98cae9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff988069be0 0x7ff98815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98cae9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff988069be0 0x7ff98815ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52732/0 (socket says 172.21.15.133:52732) 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.806+0000 7ff98cae9700 1 -- 172.21.15.133:0/1155726027 learned_addr learned my addr 172.21.15.133:0/1155726027 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff987fff700 1 --2- 172.21.15.133:0/1155726027 >> v2:172.21.15.178:3300/0 conn(0x7ff98813a7b0 0x7ff988066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff98cae9700 1 -- 172.21.15.133:0/1155726027 >> v2:172.21.15.178:3300/0 conn(0x7ff98813a7b0 msgr2=0x7ff988066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff98cae9700 1 --2- 172.21.15.133:0/1155726027 >> v2:172.21.15.178:3300/0 conn(0x7ff98813a7b0 0x7ff988066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff98cae9700 1 -- 172.21.15.133:0/1155726027 >> v1:172.21.15.178:6789/0 conn(0x7ff9880bda90 legacy=0x7ff9880694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff98cae9700 1 -- 172.21.15.133:0/1155726027 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880678e0 con 0x7ff988069be0 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff98cae9700 1 --2- 172.21.15.133:0/1155726027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff988069be0 0x7ff98815ab90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7ff9880c7c30 tx=0x7ff980009840).ready entity=mon.0 client_cookie=a39e152a30895129 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff986ffd700 1 -- 172.21.15.133:0/1155726027 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000e070 con 0x7ff988069be0 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff986ffd700 1 -- 172.21.15.133:0/1155726027 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98000ba10 con 0x7ff988069be0 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.807+0000 7ff986ffd700 1 -- 172.21.15.133:0/1155726027 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000bd90 con 0x7ff988069be0 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 -- 172.21.15.133:0/1155726027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff988069be0 msgr2=0x7ff98815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1155726027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff988069be0 0x7ff98815ab90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7ff9880c7c30 tx=0x7ff980009840).stop 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 -- 172.21.15.133:0/1155726027 shutdown_connections 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1155726027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff988069be0 0x7ff98815ab90 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1155726027 >> v2:172.21.15.178:3300/0 conn(0x7ff98813a7b0 0x7ff988066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:02.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 -- 172.21.15.133:0/1155726027 >> 172.21.15.133:0/1155726027 conn(0x7ff9880c7d20 msgr2=0x7ff9880c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 -- 172.21.15.133:0/1155726027 shutdown_connections 2024-01-21T21:33:02.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.808+0000 7ff98e54c700 1 -- 172.21.15.133:0/1155726027 wait complete. 2024-01-21T21:33:02.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.809+0000 7ff98e54c700 1 Processor -- start 2024-01-21T21:33:02.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.809+0000 7ff98e54c700 1 -- start start 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988069be0 0x7ff988139660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9880c3a60 0x7ff9881554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c70c0 con 0x7ff98813a7b0 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9881571d0 con 0x7ff988069be0 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98e54c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9880c3e80 con 0x7ff9880c3a60 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52738/0 (socket says 172.21.15.133:52738) 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 -- 172.21.15.133:0/1050785286 learned_addr learned my addr 172.21.15.133:0/1050785286 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff987fff700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988069be0 0x7ff988139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff98cae9700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9880c3a60 0x7ff9881554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 -- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9880c3a60 msgr2=0x7ff9881554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9880c3a60 0x7ff9881554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:02.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 -- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988069be0 msgr2=0x7ff988139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988069be0 0x7ff988139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 -- 172.21.15.133:0/1050785286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980009ae0 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.810+0000 7ff9877fe700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7ff97000c440 tx=0x7ff970007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.811+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970012400 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.811+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff970012580 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.811+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff988156130 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.811+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff970012940 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.811+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9881566f0 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.812+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98805fdf0 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.812+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 97) v1 ==== 75679+0+0 (secure 0 0 0) 0x7ff970012d30 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.812+0000 7ff984ff9700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 0x7ff9680618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.812+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7ff970079d40 con 0x7ff98813a7b0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.812+0000 7ff987fff700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 0x7ff9680618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:02.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.813+0000 7ff987fff700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 0x7ff9680618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff97800bb10 tx=0x7ff978008040).ready entity=mgr.9777 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:02.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:02.817+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff970048b00 con 0x7ff98813a7b0 2024-01-21T21:33:03.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.002+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9881548d0 con 0x7ff96805f3e0 2024-01-21T21:33:03.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.006+0000 7ff984ff9700 1 -- 172.21.15.133:0/1050785286 <== mgr.9777 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff9881548d0 con 0x7ff96805f3e0 2024-01-21T21:33:03.009 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path snap_test_dir1 2024-01-21T21:33:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 msgr2=0x7ff9680618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 0x7ff9680618a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7ff97800bb10 tx=0x7ff978008040).stop 2024-01-21T21:33:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 msgr2=0x7ff9880c3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7ff97000c440 tx=0x7ff970007de0).stop 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 shutdown_connections 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9880c3a60 0x7ff9881554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff96805f3e0 0x7ff9680618a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff988069be0 0x7ff988139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 --2- 172.21.15.133:0/1050785286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff98813a7b0 0x7ff9880c3570 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.007+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 >> 172.21.15.133:0/1050785286 conn(0x7ff9880c7d20 msgr2=0x7ff988153bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.008+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 shutdown_connections 2024-01-21T21:33:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.008+0000 7ff98e54c700 1 -- 172.21.15.133:0/1050785286 wait complete. 2024-01-21T21:33:03.023 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-01-21T21:33:03.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:03.023 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:33:03.041 INFO:teuthology.orchestra.run.smithi133.stdout:scheduled-2024-01-21-21_33_00_UTC 2024-01-21T21:33:03.041 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2024-01-21-21_33_00_UTC 2024-01-21T21:33:03.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:03.041 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2024-01-21-21_33_00_UTC) 2024-01-21T21:33:03.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:03.103 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T21:33:03.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T21:33:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.316+0000 7f1b56517700 1 Processor -- start 2024-01-21T21:33:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.316+0000 7f1b56517700 1 -- start start 2024-01-21T21:33:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.316+0000 7f1b56517700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.316+0000 7f1b56517700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b56517700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b500c6290 con 0x7f1b50137410 2024-01-21T21:33:03.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b56517700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b50068370 con 0x7f1b50137030 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b56517700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50068650 con 0x7f1b500c5930 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:54904/0 (socket says 172.21.15.133:54904) 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b4ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:49584/0 (socket says 172.21.15.133:49584) 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 -- 172.21.15.133:0/2547894786 learned_addr learned my addr 172.21.15.133:0/2547894786 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b47fff700 1 --1- 172.21.15.133:0/2547894786 >> v1:172.21.15.178:6789/0 conn(0x7f1b50137410 0x7f1b50155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37130/0 (socket says 172.21.15.133:37130) 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 -- 172.21.15.133:0/2547894786 >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 msgr2=0x7f1b50067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 --2- 172.21.15.133:0/2547894786 >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 -- 172.21.15.133:0/2547894786 >> v1:172.21.15.178:6789/0 conn(0x7f1b50137410 legacy=0x7f1b50155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 -- 172.21.15.133:0/2547894786 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50068930 con 0x7f1b500c5930 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b4f7fe700 1 -- 172.21.15.133:0/2547894786 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956991970 0 0) 0x7f1b500c6290 con 0x7f1b50137410 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b4ffff700 1 --2- 172.21.15.133:0/2547894786 >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:03.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.317+0000 7f1b54ab4700 1 --2- 172.21.15.133:0/2547894786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1b48009f20 tx=0x7f1b48009840).ready entity=mon.2 client_cookie=188893a17b06ac00 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b4f7fe700 1 -- 172.21.15.133:0/2547894786 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800e070 con 0x7f1b500c5930 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b4f7fe700 1 -- 172.21.15.133:0/2547894786 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800b9d0 con 0x7f1b500c5930 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b4f7fe700 1 -- 172.21.15.133:0/2547894786 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800bd50 con 0x7f1b500c5930 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 -- 172.21.15.133:0/2547894786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 msgr2=0x7f1b500c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 --2- 172.21.15.133:0/2547894786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1b48009f20 tx=0x7f1b48009840).stop 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 -- 172.21.15.133:0/2547894786 shutdown_connections 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 --2- 172.21.15.133:0/2547894786 >> v2:172.21.15.178:3300/0 conn(0x7f1b50137030 0x7f1b50067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 --2- 172.21.15.133:0/2547894786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b500c5930 0x7f1b500c5da0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 -- 172.21.15.133:0/2547894786 >> 172.21.15.133:0/2547894786 conn(0x7f1b50066a90 msgr2=0x7f1b50066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 -- 172.21.15.133:0/2547894786 shutdown_connections 2024-01-21T21:33:03.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.318+0000 7f1b56517700 1 -- 172.21.15.133:0/2547894786 wait complete. 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.319+0000 7f1b56517700 1 Processor -- start 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.319+0000 7f1b56517700 1 -- start start 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b500c5930 0x7f1b50135400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b50137410 0x7f1b50156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50156dd0 con 0x7f1b50137030 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b501358f0 con 0x7f1b500c5930 2024-01-21T21:33:03.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b56517700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500c0a70 con 0x7f1b50137410 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b47fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b47fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52754/0 (socket says 172.21.15.133:52754) 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b47fff700 1 -- 172.21.15.133:0/2444957414 learned_addr learned my addr 172.21.15.133:0/2444957414 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b4ffff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b500c5930 0x7f1b50135400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.320+0000 7f1b54ab4700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b50137410 0x7f1b50156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 -- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b50137410 msgr2=0x7f1b50156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b50137410 0x7f1b50156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 -- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b500c5930 msgr2=0x7f1b50135400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b500c5930 0x7f1b50135400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 -- 172.21.15.133:0/2444957414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400092a0 con 0x7f1b50137030 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b47fff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f1b3800c470 tx=0x7f1b38007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380072e0 con 0x7f1b50137030 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38007440 con 0x7f1b50137030 2024-01-21T21:33:03.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b48009ae0 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005910 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.321+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b500c01c0 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.322+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b500c0be0 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.322+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 97) v1 ==== 75679+0+0 (secure 0 0 0) 0x7f1b38005d00 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.322+0000 7f1b4d7fa700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 0x7f1b300618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.323+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f1b3807a0a0 con 0x7f1b50137030 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.323+0000 7f1b4ffff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 0x7f1b300618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:03.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.323+0000 7f1b4ffff700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 0x7f1b300618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1b40009270 tx=0x7f1b40008040).ready entity=mgr.9777 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:03.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.327+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1b3804ad10 con 0x7f1b50137030 2024-01-21T21:33:03.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:03.534+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1b5006bd20 con 0x7f1b50137030 2024-01-21T21:33:04.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.151+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f1b38077810 con 0x7f1b50137030 2024-01-21T21:33:04.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.152+0000 7f1b4d7fa700 1 -- 172.21.15.133:0/2444957414 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v98) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1b38075f90 con 0x7f1b50137030 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 msgr2=0x7f1b300618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 0x7f1b300618a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f1b40009270 tx=0x7f1b40008040).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 msgr2=0x7f1b500ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f1b3800c470 tx=0x7f1b38007e30).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 shutdown_connections 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b50137410 0x7f1b50156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1b3005f3e0 0x7f1b300618a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b500c5930 0x7f1b50135400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 --2- 172.21.15.133:0/2444957414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b50137030 0x7f1b500ac050 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 >> 172.21.15.133:0/2444957414 conn(0x7f1b50066a90 msgr2=0x7f1b501551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:04.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 shutdown_connections 2024-01-21T21:33:04.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.155+0000 7f1b56517700 1 -- 172.21.15.133:0/2444957414 wait complete. 2024-01-21T21:33:04.172 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:33:04.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:04.215 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:04.266 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:33:04.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T21:33:04.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:04.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T21:33:04.302 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:04.299+0000 7f576b43f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:04.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:33:04.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:04.305 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T21:33:04.306 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:04.303+0000 7f581d476680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:04.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:04.367 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:04.364+0000 7f576b43f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:04.369 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:04.366+0000 7f581d476680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.482+0000 7f9e8aeec700 1 Processor -- start 2024-01-21T21:33:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.482+0000 7f9e8aeec700 1 -- start start 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.483+0000 7f9e8aeec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e84062e00 0x7f9e840a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.483+0000 7f9e8aeec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e8413aa00 0x7f9e84158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.483+0000 7f9e8aeec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e841584f0 con 0x7f9e8413a620 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.483+0000 7f9e8aeec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e840bd6f0 con 0x7f9e84062e00 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.483+0000 7f9e8aeec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840654e0 con 0x7f9e8413aa00 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e84062e00 0x7f9e840a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e88c88700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e8413a620 0x7f9e840626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55934/0 (socket says 172.21.15.133:55934) 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e88c88700 1 -- 172.21.15.133:0/4198631528 learned_addr learned my addr 172.21.15.133:0/4198631528 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e89489700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e8413aa00 0x7f9e84158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 -- 172.21.15.133:0/4198631528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e8413aa00 msgr2=0x7f9e84158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e8413aa00 0x7f9e84158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 -- 172.21.15.133:0/4198631528 >> v1:172.21.15.133:6789/0 conn(0x7f9e8413a620 legacy=0x7f9e840626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e837fe700 1 -- 172.21.15.133:0/4198631528 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324520320 0 0) 0x7f9e78001110 con 0x7f9e8413a620 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 -- 172.21.15.133:0/4198631528 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e84158730 con 0x7f9e84062e00 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e83fff700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84062e00 0x7f9e840a6e30 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f9e70009760 tx=0x7f9e70009060).ready entity=mon.0 client_cookie=9f88f7b6345c6d71 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e837fe700 1 -- 172.21.15.133:0/4198631528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700090d0 con 0x7f9e84062e00 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e837fe700 1 -- 172.21.15.133:0/4198631528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7000f510 con 0x7f9e84062e00 2024-01-21T21:33:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.484+0000 7f9e837fe700 1 -- 172.21.15.133:0/4198631528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000f890 con 0x7f9e84062e00 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 -- 172.21.15.133:0/4198631528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84062e00 msgr2=0x7f9e840a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84062e00 0x7f9e840a6e30 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f9e70009760 tx=0x7f9e70009060).stop 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 -- 172.21.15.133:0/4198631528 shutdown_connections 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e8413aa00 0x7f9e84158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/4198631528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e84062e00 0x7f9e840a6e30 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 -- 172.21.15.133:0/4198631528 >> 172.21.15.133:0/4198631528 conn(0x7f9e840c7dc0 msgr2=0x7f9e840c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 -- 172.21.15.133:0/4198631528 shutdown_connections 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.485+0000 7f9e8aeec700 1 -- 172.21.15.133:0/4198631528 wait complete. 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.486+0000 7f9e8aeec700 1 Processor -- start 2024-01-21T21:33:04.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.486+0000 7f9e8aeec700 1 -- start start 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e84062e00 0x7f9e841398e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e8413aa00 0x7f9e84065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e84139dd0 con 0x7f9e8413a620 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840a8290 con 0x7f9e8413aa00 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e8aeec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e840a7680 con 0x7f9e84062e00 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52794/0 (socket says 172.21.15.133:52794) 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 -- 172.21.15.133:0/3187820354 learned_addr learned my addr 172.21.15.133:0/3187820354 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e88c88700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e84062e00 0x7f9e841398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e89489700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e8413aa00 0x7f9e84065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e84062e00 msgr2=0x7f9e841398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e84062e00 0x7f9e841398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e8413aa00 msgr2=0x7f9e84065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e8413aa00 0x7f9e84065970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.487+0000 7f9e83fff700 1 -- 172.21.15.133:0/3187820354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700092a0 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e83fff700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f9e70009e00 tx=0x7f9e70017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000f890 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70009e30 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e840a7960 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000fea0 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.488+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e840a7f20 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.489+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8405fdf0 con 0x7f9e8413a620 2024-01-21T21:33:04.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.489+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9e7001b650 con 0x7f9e8413a620 2024-01-21T21:33:04.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.490+0000 7f9e817fa700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 0x7f9e68061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.490+0000 7f9e88c88700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 msgr2=0x7f9e68061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:04.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.490+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f9e7007bd20 con 0x7f9e8413a620 2024-01-21T21:33:04.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.490+0000 7f9e88c88700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 0x7f9e68061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:04.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.494+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9e7004c990 con 0x7f9e8413a620 2024-01-21T21:33:04.645 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:04.642+0000 7f581d476680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:04.660 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:04.656+0000 7f576b43f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:04.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.691+0000 7f9e88c88700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 msgr2=0x7f9e68061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:04.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.691+0000 7f9e88c88700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 0x7f9e68061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:04.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.710+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e8406bdd0 con 0x7f9e8413a620 2024-01-21T21:33:04.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.711+0000 7f9e817fa700 1 -- 172.21.15.133:0/3187820354 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f9e70028020 con 0x7f9e8413a620 2024-01-21T21:33:04.715 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:04.715 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 msgr2=0x7f9e68061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 0x7f9e68061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 msgr2=0x7f9e840ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 rx=0x7f9e70009e00 tx=0x7f9e70017000).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 shutdown_connections 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9e6805f390 0x7f9e68061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e8413aa00 0x7f9e84065970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e84062e00 0x7f9e841398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 --2- 172.21.15.133:0/3187820354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e8413a620 0x7f9e840ad750 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 >> 172.21.15.133:0/3187820354 conn(0x7f9e840c7dc0 msgr2=0x7f9e84156dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:04.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 shutdown_connections 2024-01-21T21:33:04.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.713+0000 7f9e8aeec700 1 -- 172.21.15.133:0/3187820354 wait complete. 2024-01-21T21:33:04.718 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:33:04.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:04.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.845+0000 7ffa09f9b700 1 Processor -- start 2024-01-21T21:33:04.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.845+0000 7ffa09f9b700 1 -- start start 2024-01-21T21:33:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa09f9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa040c6040 0x7ffa04137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa09f9b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa04068370 con 0x7ffa04067d90 2024-01-21T21:33:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa09f9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa04068650 con 0x7ffa04137030 2024-01-21T21:33:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa09f9b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa04068930 con 0x7ffa040c6040 2024-01-21T21:33:04.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa040c6040 0x7ffa04137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa02ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa04067d90 0x7ffa040c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55944/0 (socket says 172.21.15.133:55944) 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.846+0000 7ffa02ffd700 1 -- 172.21.15.133:0/438599744 learned_addr learned my addr 172.21.15.133:0/438599744 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa03fff700 1 -- 172.21.15.133:0/438599744 >> v1:172.21.15.178:6789/0 conn(0x7ffa04137030 legacy=0x7ffa04155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa03fff700 1 -- 172.21.15.133:0/438599744 >> v1:172.21.15.133:6789/0 conn(0x7ffa04067d90 legacy=0x7ffa040c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa027fc700 1 -- 172.21.15.133:0/438599744 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493995220 0 0) 0x7ffa04068650 con 0x7ffa04137030 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa03fff700 1 -- 172.21.15.133:0/438599744 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04068c10 con 0x7ffa040c6040 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa03fff700 1 --2- 172.21.15.133:0/438599744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa040c6040 0x7ffa04137410 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7ff9f4009e60 tx=0x7ff9f4009780).ready entity=mon.0 client_cookie=4da5b4d4bd70592b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa027fc700 1 -- 172.21.15.133:0/438599744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400e070 con 0x7ffa040c6040 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa027fc700 1 -- 172.21.15.133:0/438599744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f400bb30 con 0x7ffa040c6040 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.847+0000 7ffa027fc700 1 -- 172.21.15.133:0/438599744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f400beb0 con 0x7ffa040c6040 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 -- 172.21.15.133:0/438599744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa040c6040 msgr2=0x7ffa04137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/438599744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa040c6040 0x7ffa04137410 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7ff9f4009e60 tx=0x7ff9f4009780).stop 2024-01-21T21:33:04.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 -- 172.21.15.133:0/438599744 shutdown_connections 2024-01-21T21:33:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/438599744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa040c6040 0x7ffa04137410 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 -- 172.21.15.133:0/438599744 >> 172.21.15.133:0/438599744 conn(0x7ffa04066a90 msgr2=0x7ffa04066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 -- 172.21.15.133:0/438599744 shutdown_connections 2024-01-21T21:33:04.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.848+0000 7ffa09f9b700 1 -- 172.21.15.133:0/438599744 wait complete. 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.849+0000 7ffa09f9b700 1 Processor -- start 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.849+0000 7ffa09f9b700 1 -- start start 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa040c6040 0x7ffa040bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa04137030 0x7ffa040c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040c0980 con 0x7ffa04067d90 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040c0b60 con 0x7ffa04137030 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa09f9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040ac910 con 0x7ffa040c6040 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52806/0 (socket says 172.21.15.133:52806) 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 -- 172.21.15.133:0/2587396362 learned_addr learned my addr 172.21.15.133:0/2587396362 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa03fff700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa04137030 0x7ffa040c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa02ffd700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa040c6040 0x7ffa040bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 -- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa040c6040 msgr2=0x7ffa040bffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa040c6040 0x7ffa040bffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 -- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa04137030 msgr2=0x7ffa040c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa04137030 0x7ffa040c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 -- 172.21.15.133:0/2587396362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4009a20 con 0x7ffa04067d90 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.850+0000 7ffa037fe700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7ff9fc001eb0 tx=0x7ff9fc007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.851+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00ce60 con 0x7ffa04067d90 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.851+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00f470 con 0x7ffa04067d90 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.851+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa040abfe0 con 0x7ffa04067d90 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.851+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9fc00f810 con 0x7ffa04067d90 2024-01-21T21:33:04.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.851+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa040ac620 con 0x7ffa04067d90 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.852+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa040acbf0 con 0x7ffa04067d90 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.852+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff9fc00fb80 con 0x7ffa04067d90 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.852+0000 7ff9fbfff700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 0x7ff9e4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.852+0000 7ffa02ffd700 1 -- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 msgr2=0x7ff9e4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.853+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7ff9fc079e00 con 0x7ffa04067d90 2024-01-21T21:33:04.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.853+0000 7ffa02ffd700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 0x7ff9e4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:04.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:04.856+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff9fc04aa70 con 0x7ffa04067d90 2024-01-21T21:33:05.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.028+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa0405fdf0 con 0x7ffa04067d90 2024-01-21T21:33:05.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.029+0000 7ff9fbfff700 1 -- 172.21.15.133:0/2587396362 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+18282 (secure 0 0 0) 0x7ff9fc04e090 con 0x7ffa04067d90 2024-01-21T21:33:05.033 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:05.033 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":193,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:52.394673+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/52661946":"2024-01-22T21:31:52.394643+0000","172.21.15.133:0/3495361745":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6833/94812":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6832/94812":"2024-01-22T21:31:52.394643+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 msgr2=0x7ff9e4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 0x7ff9e4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 msgr2=0x7ffa0414d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 rx=0x7ff9fc001eb0 tx=0x7ff9fc007c70).stop 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 shutdown_connections 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff9e405f390 0x7ff9e4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa04137030 0x7ffa040c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa04067d90 0x7ffa0414d580 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 --2- 172.21.15.133:0/2587396362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa040c6040 0x7ffa040bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 >> 172.21.15.133:0/2587396362 conn(0x7ffa04066a90 msgr2=0x7ffa04155290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 shutdown_connections 2024-01-21T21:33:05.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.031+0000 7ffa09f9b700 1 -- 172.21.15.133:0/2587396362 wait complete. 2024-01-21T21:33:05.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '183', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T21:31:35.098340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T21:31:35.499968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T21:33:05.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:33:05.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.169+0000 7f2e93878700 1 Processor -- start 2024-01-21T21:33:05.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.169+0000 7f2e93878700 1 -- start start 2024-01-21T21:33:05.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e93878700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e93878700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c159010 con 0x7f2e8c154140 2024-01-21T21:33:05.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e93878700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c0c0e40 con 0x7f2e8c0c8120 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e93878700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c154a10 con 0x7f2e8c158bb0 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e91614700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e8c154140 0x7f2e8c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55954/0 (socket says 172.21.15.133:55954) 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e91614700 1 -- 172.21.15.133:0/1167887889 learned_addr learned my addr 172.21.15.133:0/1167887889 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.170+0000 7f2e91e15700 1 --2- 172.21.15.133:0/1167887889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391569223 0 0) 0x7f2e88001110 con 0x7f2e8c154140 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e780033f0 con 0x7f2e8c154140 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633306260 0 0) 0x7f2e8c0c0e40 con 0x7f2e8c0c8120 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e88001110 con 0x7f2e8c0c8120 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e91e15700 1 -- 172.21.15.133:0/1167887889 >> v1:172.21.15.178:6789/0 conn(0x7f2e8c0c8120 legacy=0x7f2e8c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e91e15700 1 -- 172.21.15.133:0/1167887889 >> v1:172.21.15.133:6789/0 conn(0x7f2e8c154140 legacy=0x7f2e8c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e91e15700 1 -- 172.21.15.133:0/1167887889 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0c6800 con 0x7f2e8c158bb0 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e91e15700 1 --2- 172.21.15.133:0/1167887889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c154520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f2e84009e90 tx=0x7f2e84009780).ready entity=mon.2 client_cookie=814229fc389e66f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e8c158bb0 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400bab0 con 0x7f2e8c158bb0 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.171+0000 7f2e83fff700 1 -- 172.21.15.133:0/1167887889 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400be30 con 0x7f2e8c158bb0 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 -- 172.21.15.133:0/1167887889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 msgr2=0x7f2e8c154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 --2- 172.21.15.133:0/1167887889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c154520 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f2e84009e90 tx=0x7f2e84009780).stop 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 -- 172.21.15.133:0/1167887889 shutdown_connections 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 --2- 172.21.15.133:0/1167887889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c154520 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 -- 172.21.15.133:0/1167887889 >> 172.21.15.133:0/1167887889 conn(0x7f2e8c05e1e0 msgr2=0x7f2e8c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 -- 172.21.15.133:0/1167887889 shutdown_connections 2024-01-21T21:33:05.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.172+0000 7f2e93878700 1 -- 172.21.15.133:0/1167887889 wait complete. 2024-01-21T21:33:05.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.173+0000 7f2e93878700 1 Processor -- start 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.173+0000 7f2e93878700 1 -- start start 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0c8120 0x7f2e8c167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c14d770 con 0x7f2e8c154140 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c164d40 con 0x7f2e8c0c8120 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e93878700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0afec0 con 0x7f2e8c158bb0 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e90e13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e90e13700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52816/0 (socket says 172.21.15.133:52816) 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e90e13700 1 -- 172.21.15.133:0/3935592392 learned_addr learned my addr 172.21.15.133:0/3935592392 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.174+0000 7f2e91614700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0c8120 0x7f2e8c167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e91e15700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 msgr2=0x7f2e8c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0c8120 msgr2=0x7f2e8c167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0c8120 0x7f2e8c167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 -- 172.21.15.133:0/3935592392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009a20 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e90e13700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f2e7c00c440 tx=0x7f2e7c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c012400 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c012560 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0af2b0 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c012920 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.175+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0af870 con 0x7f2e8c154140 2024-01-21T21:33:05.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.176+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f2e7c01c440 con 0x7f2e8c154140 2024-01-21T21:33:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.177+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c05fdf0 con 0x7f2e8c154140 2024-01-21T21:33:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.177+0000 7f2e81ffb700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 0x7f2e70061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.177+0000 7f2e91614700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 msgr2=0x7f2e70061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.177+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f2e7c07a110 con 0x7f2e8c154140 2024-01-21T21:33:05.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.177+0000 7f2e91614700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 0x7f2e70061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:05.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.181+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2e7c04b0f0 con 0x7f2e8c154140 2024-01-21T21:33:05.260 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:05.257+0000 7f581d476680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:05.317 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:05.314+0000 7f576b43f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:05.332 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:05.329+0000 7f581d476680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.378+0000 7f2e91614700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 msgr2=0x7f2e70061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:05.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.378+0000 7f2e91614700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 0x7f2e70061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:05.391 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:05.387+0000 7f576b43f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:05.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.401+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2e8c0aa980 con 0x7f2e8c154140 2024-01-21T21:33:05.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.401+0000 7f2e81ffb700 1 -- 172.21.15.133:0/3935592392 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v193) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2e7c04e340 con 0x7f2e8c154140 2024-01-21T21:33:05.405 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:33:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.403+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 msgr2=0x7f2e70061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.403+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 0x7f2e70061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.403+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 msgr2=0x7f2e8c164850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.403+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f2e7c00c440 tx=0x7f2e7c007c90).stop 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 shutdown_connections 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c158bb0 0x7f2e8c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2e7005f390 0x7f2e70061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0c8120 0x7f2e8c167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 --2- 172.21.15.133:0/3935592392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c154140 0x7f2e8c164850 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 >> 172.21.15.133:0/3935592392 conn(0x7f2e8c05e1e0 msgr2=0x7f2e8c14da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 shutdown_connections 2024-01-21T21:33:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.404+0000 7f2e93878700 1 -- 172.21.15.133:0/3935592392 wait complete. 2024-01-21T21:33:05.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:33:05.519 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:05.516+0000 7f581d476680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.540+0000 7f42673cd700 1 Processor -- start 2024-01-21T21:33:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.540+0000 7f42673cd700 1 -- start start 2024-01-21T21:33:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4260154140 0x7f4260158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42600c6090 0x7f42600c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600c6ae0 con 0x7f42600c6090 2024-01-21T21:33:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42600c05e0 con 0x7f4260154140 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f42673cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600ab620 con 0x7f4260154520 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f426596a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42600c6090 0x7f42600c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f426596a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42600c6090 0x7f42600c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52818/0 (socket says 172.21.15.133:52818) 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f426596a700 1 -- 172.21.15.133:0/1923184836 learned_addr learned my addr 172.21.15.133:0/1923184836 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f4265169700 1 --2- 172.21.15.133:0/1923184836 >> v2:172.21.15.178:3300/0 conn(0x7f4260154140 0x7f4260158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.541+0000 7f4264968700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 -- 172.21.15.133:0/1923184836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 msgr2=0x7f42600ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 -- 172.21.15.133:0/1923184836 >> v2:172.21.15.178:3300/0 conn(0x7f4260154140 msgr2=0x7f4260158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 --2- 172.21.15.133:0/1923184836 >> v2:172.21.15.178:3300/0 conn(0x7f4260154140 0x7f4260158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 -- 172.21.15.133:0/1923184836 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42600c0e40 con 0x7f42600c6090 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f426596a700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f42600c7a10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f4260083d70 tx=0x7f4258009840).ready entity=mon.0 client_cookie=68c4d94f841c3331 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f4257fff700 1 -- 172.21.15.133:0/1923184836 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800e070 con 0x7f42600c6090 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f4257fff700 1 -- 172.21.15.133:0/1923184836 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800b970 con 0x7f42600c6090 2024-01-21T21:33:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f4257fff700 1 -- 172.21.15.133:0/1923184836 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800bcf0 con 0x7f42600c6090 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 -- 172.21.15.133:0/1923184836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 msgr2=0x7f42600c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f42600c7a10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 rx=0x7f4260083d70 tx=0x7f4258009840).stop 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 -- 172.21.15.133:0/1923184836 shutdown_connections 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f42600c7a10 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 --2- 172.21.15.133:0/1923184836 >> v2:172.21.15.178:3300/0 conn(0x7f4260154140 0x7f4260158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 --2- 172.21.15.133:0/1923184836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.542+0000 7f42673cd700 1 -- 172.21.15.133:0/1923184836 >> 172.21.15.133:0/1923184836 conn(0x7f426005e1e0 msgr2=0x7f426005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.543+0000 7f42673cd700 1 -- 172.21.15.133:0/1923184836 shutdown_connections 2024-01-21T21:33:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.543+0000 7f42673cd700 1 -- 172.21.15.133:0/1923184836 wait complete. 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 Processor -- start 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 -- start start 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4260154140 0x7f42600ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600c9ef0 con 0x7f42600c6090 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42600ae710 con 0x7f4260154140 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.544+0000 7f42673cd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42600ae9f0 con 0x7f4260154520 2024-01-21T21:33:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52820/0 (socket says 172.21.15.133:52820) 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 -- 172.21.15.133:0/2341463517 learned_addr learned my addr 172.21.15.133:0/2341463517 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4264968700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4260154140 0x7f42600ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f426596a700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 -- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 msgr2=0x7f42600c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 -- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4260154140 msgr2=0x7f42600ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4260154140 0x7f42600ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 -- 172.21.15.133:0/2341463517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4258009ae0 con 0x7f42600c6090 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4265169700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f425c00e930 tx=0x7f425c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c012600 con 0x7f42600c6090 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c012760 con 0x7f42600c6090 2024-01-21T21:33:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42600aecd0 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c012ae0 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.545+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42600af290 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.546+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426005fdf0 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.547+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f425c01b400 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.547+0000 7f4255ffb700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 0x7f4244061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.547+0000 7f4264968700 1 -- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 msgr2=0x7f4244061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.547+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f425c07ad90 con 0x7f42600c6090 2024-01-21T21:33:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.547+0000 7f4264968700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 0x7f4244061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.555+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f425c04b9a0 con 0x7f42600c6090 2024-01-21T21:33:05.594 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:05.591+0000 7f576b43f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.725+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42600c00f0 con 0x7f42600c6090 2024-01-21T21:33:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.726+0000 7f4255ffb700 1 -- 172.21.15.133:0/2341463517 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v193) v1 ==== 92+0+10 (secure 0 0 0) 0x7f425c04efc0 con 0x7f42600c6090 2024-01-21T21:33:05.730 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 msgr2=0x7f4244061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 0x7f4244061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 msgr2=0x7f4260148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7f425c00e930 tx=0x7f425c009060).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 shutdown_connections 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4260154520 0x7f42600c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42600c6090 0x7f4260148030 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f424405f390 0x7f4244061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 --2- 172.21.15.133:0/2341463517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4260154140 0x7f42600ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 >> 172.21.15.133:0/2341463517 conn(0x7f426005e1e0 msgr2=0x7f4260159b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 shutdown_connections 2024-01-21T21:33:05.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.728+0000 7f42673cd700 1 -- 172.21.15.133:0/2341463517 wait complete. 2024-01-21T21:33:05.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T21:33:05.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.864+0000 7f51e6cfa700 1 Processor -- start 2024-01-21T21:33:05.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.865+0000 7f51e6cfa700 1 -- start start 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.865+0000 7f51e6cfa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51e00c8120 0x7f51e0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.865+0000 7f51e6cfa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e00c0e40 con 0x7f51e0154520 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.865+0000 7f51e6cfa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e01549b0 con 0x7f51e0154140 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.865+0000 7f51e6cfa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e00c6ae0 con 0x7f51e00c8120 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51e5297700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f51e0154520 0x7f51e00c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55958/0 (socket says 172.21.15.133:55958) 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51e5297700 1 -- 172.21.15.133:0/2037655551 learned_addr learned my addr 172.21.15.133:0/2037655551 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51dffff700 1 --2- 172.21.15.133:0/2037655551 >> v2:172.21.15.178:3300/0 conn(0x7f51e00c8120 0x7f51e0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51df7fe700 1 -- 172.21.15.133:0/2037655551 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120953355 0 0) 0x7f51e00c0e40 con 0x7f51e0154520 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51df7fe700 1 -- 172.21.15.133:0/2037655551 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d00033f0 con 0x7f51e0154520 2024-01-21T21:33:05.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51dffff700 1 -- 172.21.15.133:0/2037655551 >> v1:172.21.15.178:6789/0 conn(0x7f51e0154140 legacy=0x7f51e00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51dffff700 1 -- 172.21.15.133:0/2037655551 >> v1:172.21.15.133:6789/0 conn(0x7f51e0154520 legacy=0x7f51e00c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51dffff700 1 -- 172.21.15.133:0/2037655551 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e00c6800 con 0x7f51e00c8120 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51dffff700 1 --2- 172.21.15.133:0/2037655551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e00c8120 0x7f51e0158bb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f51cc009760 tx=0x7f51cc009060).ready entity=mon.1 client_cookie=5ba0a718b1f37cd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51df7fe700 1 -- 172.21.15.133:0/2037655551 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00f510 con 0x7f51e00c8120 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51df7fe700 1 -- 172.21.15.133:0/2037655551 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc00f670 con 0x7f51e00c8120 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.866+0000 7f51df7fe700 1 -- 172.21.15.133:0/2037655551 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc00f9f0 con 0x7f51e00c8120 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 -- 172.21.15.133:0/2037655551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e00c8120 msgr2=0x7f51e0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/2037655551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e00c8120 0x7f51e0158bb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f51cc009760 tx=0x7f51cc009060).stop 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 -- 172.21.15.133:0/2037655551 shutdown_connections 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/2037655551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e00c8120 0x7f51e0158bb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 -- 172.21.15.133:0/2037655551 >> 172.21.15.133:0/2037655551 conn(0x7f51e005e1e0 msgr2=0x7f51e005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 -- 172.21.15.133:0/2037655551 shutdown_connections 2024-01-21T21:33:05.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.867+0000 7f51e6cfa700 1 -- 172.21.15.133:0/2037655551 wait complete. 2024-01-21T21:33:05.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.868+0000 7f51e6cfa700 1 Processor -- start 2024-01-21T21:33:05.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.868+0000 7f51e6cfa700 1 -- start start 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51e00c8120 0x7f51e00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e0154140 0x7f51e0168160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ae070 con 0x7f51e0154520 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e00ae630 con 0x7f51e0154140 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e6cfa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e0168bb0 con 0x7f51e00c8120 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e5297700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e5297700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52834/0 (socket says 172.21.15.133:52834) 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e5297700 1 -- 172.21.15.133:0/1721794681 learned_addr learned my addr 172.21.15.133:0/1721794681 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51e4a96700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51e00c8120 0x7f51e00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.869+0000 7f51dffff700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e0154140 0x7f51e0168160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 -- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51e00c8120 msgr2=0x7f51e00b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51e00c8120 0x7f51e00b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 -- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e0154140 msgr2=0x7f51e0168160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:05.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e0154140 0x7f51e0168160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 -- 172.21.15.133:0/1721794681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0092a0 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e5297700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f51d8001460 tx=0x7f51d80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8005d30 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8005e90 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e0168e90 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80072e0 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.870+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01514f0 con 0x7f51e0154520 2024-01-21T21:33:05.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.871+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e005fdf0 con 0x7f51e0154520 2024-01-21T21:33:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.872+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f51d80076d0 con 0x7f51e0154520 2024-01-21T21:33:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.872+0000 7f51dd7fa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 0x7f51c4061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.872+0000 7f51e4a96700 1 -- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 msgr2=0x7f51c4061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.872+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f51d807a2b0 con 0x7f51e0154520 2024-01-21T21:33:05.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.872+0000 7f51e4a96700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 0x7f51c4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:05.880+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f51d804af20 con 0x7f51e0154520 2024-01-21T21:33:05.940 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:05.937+0000 7f581d476680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:06.039 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.035+0000 7f576b43f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:06.042 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.039+0000 7f581d476680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:06.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.049+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51e00aa980 con 0x7f51e0154520 2024-01-21T21:33:06.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.049+0000 7f51dd7fa700 1 -- 172.21.15.133:0/1721794681 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51d804e540 con 0x7f51e0154520 2024-01-21T21:33:06.053 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:33:06.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 msgr2=0x7f51c4061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:06.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 0x7f51c4061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 msgr2=0x7f51e014d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 rx=0x7f51d8001460 tx=0x7f51d80015b0).stop 2024-01-21T21:33:06.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 shutdown_connections 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51e0154520 0x7f51e014d080 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51e00c8120 0x7f51e00b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f51c405f390 0x7f51c4061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 --2- 172.21.15.133:0/1721794681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51e0154140 0x7f51e0168160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 >> 172.21.15.133:0/1721794681 conn(0x7f51e005e1e0 msgr2=0x7f51e00c2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 shutdown_connections 2024-01-21T21:33:06.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.051+0000 7f51e6cfa700 1 -- 172.21.15.133:0/1721794681 wait complete. 2024-01-21T21:33:06.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T21:33:06.152 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.148+0000 7f576b43f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:06.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.187+0000 7faff98c7700 1 Processor -- start 2024-01-21T21:33:06.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.188+0000 7faff98c7700 1 -- start start 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.188+0000 7faff98c7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faff4154140 0x7faff4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.188+0000 7faff98c7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40c0e40 con 0x7faff40c8120 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.188+0000 7faff98c7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff41549b0 con 0x7faff4154520 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.188+0000 7faff98c7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40c6ae0 con 0x7faff4154140 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faff4154140 0x7faff4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faff40c8120 0x7faff40c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55970/0 (socket says 172.21.15.133:55970) 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff37fe700 1 -- 172.21.15.133:0/1888348540 learned_addr learned my addr 172.21.15.133:0/1888348540 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faff4154140 0x7faff4158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52844/0 (socket says 172.21.15.133:52844) 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 -- 172.21.15.133:0/1888348540 >> v1:172.21.15.178:6789/0 conn(0x7faff4154520 legacy=0x7faff40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 -- 172.21.15.133:0/1888348540 >> v1:172.21.15.133:6789/0 conn(0x7faff40c8120 legacy=0x7faff40c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 -- 172.21.15.133:0/1888348540 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40c6800 con 0x7faff4154140 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff1ffb700 1 -- 172.21.15.133:0/1888348540 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638837474 0 0) 0x7faff40c0e40 con 0x7faff40c8120 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff2ffd700 1 --2- 172.21.15.133:0/1888348540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff4154140 0x7faff4158bb0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fafe4009790 tx=0x7fafe4009060).ready entity=mon.0 client_cookie=471198fb0c5ff90d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff1ffb700 1 -- 172.21.15.133:0/1888348540 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400b580 con 0x7faff4154140 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff1ffb700 1 -- 172.21.15.133:0/1888348540 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe400b6e0 con 0x7faff4154140 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.189+0000 7faff1ffb700 1 -- 172.21.15.133:0/1888348540 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400ba60 con 0x7faff4154140 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 -- 172.21.15.133:0/1888348540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff4154140 msgr2=0x7faff4158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 --2- 172.21.15.133:0/1888348540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff4154140 0x7faff4158bb0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7fafe4009790 tx=0x7fafe4009060).stop 2024-01-21T21:33:06.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 -- 172.21.15.133:0/1888348540 shutdown_connections 2024-01-21T21:33:06.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 --2- 172.21.15.133:0/1888348540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff4154140 0x7faff4158bb0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 -- 172.21.15.133:0/1888348540 >> 172.21.15.133:0/1888348540 conn(0x7faff405e1e0 msgr2=0x7faff405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 -- 172.21.15.133:0/1888348540 shutdown_connections 2024-01-21T21:33:06.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.190+0000 7faff98c7700 1 -- 172.21.15.133:0/1888348540 wait complete. 2024-01-21T21:33:06.196 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.193+0000 7f581d476680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:06.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.191+0000 7faff98c7700 1 Processor -- start 2024-01-21T21:33:06.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.191+0000 7faff98c7700 1 -- start start 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faff4154140 0x7faff40cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faff4154520 0x7faff40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40cba00 con 0x7faff40c8120 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff4168ba0 con 0x7faff4154520 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff98c7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff4167f90 con 0x7faff4154140 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff37fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faff4154520 0x7faff40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52856/0 (socket says 172.21.15.133:52856) 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff2ffd700 1 -- 172.21.15.133:0/3153282969 learned_addr learned my addr 172.21.15.133:0/3153282969 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff27fc700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faff4154140 0x7faff40cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.192+0000 7faff2ffd700 1 -- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faff4154140 msgr2=0x7faff40cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff2ffd700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faff4154140 0x7faff40cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff2ffd700 1 -- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faff4154520 msgr2=0x7faff40cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff2ffd700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faff4154520 0x7faff40cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff2ffd700 1 -- 172.21.15.133:0/3153282969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40092a0 con 0x7faff40c8120 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff2ffd700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7faff406afd0 tx=0x7fafe4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400b850 con 0x7faff40c8120 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe400b9b0 con 0x7faff40c8120 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff4168270 con 0x7faff40c8120 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe401b660 con 0x7faff40c8120 2024-01-21T21:33:06.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.193+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff4168830 con 0x7faff40c8120 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.194+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff4168e80 con 0x7faff40c8120 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.194+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fafe401ba50 con 0x7faff40c8120 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.195+0000 7fafdb7fe700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 0x7fafe0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.195+0000 7faff27fc700 1 -- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 msgr2=0x7fafe0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.195+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7fafe407c3f0 con 0x7faff40c8120 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.195+0000 7faff27fc700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 0x7fafe0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:06.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.199+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fafe404d060 con 0x7faff40c8120 2024-01-21T21:33:06.271 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.268+0000 7f581d476680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:06.314 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.311+0000 7f576b43f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:06.338 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.335+0000 7f581d476680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:06.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.370+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faff40aa980 con 0x7faff40c8120 2024-01-21T21:33:06.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.371+0000 7fafdb7fe700 1 -- 172.21.15.133:0/3153282969 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafe40290a0 con 0x7faff40c8120 2024-01-21T21:33:06.375 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 msgr2=0x7fafe0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 0x7fafe0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 msgr2=0x7faff414cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7faff406afd0 tx=0x7fafe4017000).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 shutdown_connections 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fafe005f390 0x7fafe0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faff4154520 0x7faff40cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faff40c8120 0x7faff414cd80 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 --2- 172.21.15.133:0/3153282969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faff4154140 0x7faff40cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 >> 172.21.15.133:0/3153282969 conn(0x7faff405e1e0 msgr2=0x7faff40c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 shutdown_connections 2024-01-21T21:33:06.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.373+0000 7faff98c7700 1 -- 172.21.15.133:0/3153282969 wait complete. 2024-01-21T21:33:06.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:06.392 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.388+0000 7f576b43f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:06.464 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.461+0000 7f576b43f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:06.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.504+0000 7f7ff9209700 1 Processor -- start 2024-01-21T21:33:06.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.504+0000 7f7ff9209700 1 -- start start 2024-01-21T21:33:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff9209700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4137030 0x7f7ff4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff9209700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c5930 0x7f7ff40c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff9209700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff40c6250 con 0x7f7ff4137410 2024-01-21T21:33:06.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff9209700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff4068370 con 0x7f7ff4137030 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff9209700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff4068650 con 0x7f7ff40c5930 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4137030 0x7f7ff4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ff4137030 0x7f7ff4067d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52864/0 (socket says 172.21.15.133:52864) 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/1915728303 learned_addr learned my addr 172.21.15.133:0/1915728303 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff359e700 1 --2- 172.21.15.133:0/1915728303 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c5930 0x7f7ff40c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/1915728303 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c5930 msgr2=0x7f7ff40c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 --2- 172.21.15.133:0/1915728303 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c5930 0x7f7ff40c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/1915728303 >> v1:172.21.15.178:6789/0 conn(0x7f7ff4137410 legacy=0x7f7ff4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/1915728303 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4068930 con 0x7f7ff4137030 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff2d9d700 1 --2- 172.21.15.133:0/1915728303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137030 0x7f7ff4067d90 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f7ff4066070 tx=0x7f7fe40090f0).ready entity=mon.0 client_cookie=4c5ab6c77dc24116 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff1d9b700 1 -- 172.21.15.133:0/1915728303 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400b520 con 0x7f7ff4137030 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff1d9b700 1 -- 172.21.15.133:0/1915728303 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400b680 con 0x7f7ff4137030 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.505+0000 7f7ff1d9b700 1 -- 172.21.15.133:0/1915728303 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400ba20 con 0x7f7ff4137030 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 -- 172.21.15.133:0/1915728303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137030 msgr2=0x7f7ff4067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 --2- 172.21.15.133:0/1915728303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137030 0x7f7ff4067d90 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7f7ff4066070 tx=0x7f7fe40090f0).stop 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 -- 172.21.15.133:0/1915728303 shutdown_connections 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 --2- 172.21.15.133:0/1915728303 >> v2:172.21.15.178:3300/0 conn(0x7f7ff40c5930 0x7f7ff40c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 --2- 172.21.15.133:0/1915728303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137030 0x7f7ff4067d90 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 -- 172.21.15.133:0/1915728303 >> 172.21.15.133:0/1915728303 conn(0x7f7ff4066a90 msgr2=0x7f7ff4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 -- 172.21.15.133:0/1915728303 shutdown_connections 2024-01-21T21:33:06.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.506+0000 7f7ff9209700 1 -- 172.21.15.133:0/1915728303 wait complete. 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.507+0000 7f7ff9209700 1 Processor -- start 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 -- start start 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 0x7f7ff4164480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff4137030 0x7f7ff40c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 0x7f7ff40c2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c0f70 con 0x7f7ff4137410 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c11c0 con 0x7f7ff40c5930 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff9209700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c14a0 con 0x7f7ff4137030 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 0x7f7ff40c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff2d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 0x7f7ff4164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 0x7f7ff40c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52868/0 (socket says 172.21.15.133:52868) 2024-01-21T21:33:06.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff359e700 1 -- 172.21.15.133:0/199345132 learned_addr learned my addr 172.21.15.133:0/199345132 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.508+0000 7f7ff259c700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff4137030 0x7f7ff40c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff4137030 msgr2=0x7f7ff40c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff4137030 0x7f7ff40c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 msgr2=0x7f7ff40c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 0x7f7ff40c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 -- 172.21.15.133:0/199345132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009370 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff2d9d700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 0x7f7ff4164480 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7fe4014000 tx=0x7f7fe4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4006d90 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4006990 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400b7f0 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff40c1780 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.509+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff40c2960 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.510+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40c15e0 con 0x7f7ff40c5930 2024-01-21T21:33:06.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.510+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f7fe401c630 con 0x7f7ff40c5930 2024-01-21T21:33:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.511+0000 7f7fdb7fe700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 0x7f7fe0061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.511+0000 7f7ff259c700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 msgr2=0x7f7fe0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.511+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f7fe407c350 con 0x7f7ff40c5930 2024-01-21T21:33:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.511+0000 7f7ff259c700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 0x7f7fe0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:06.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.515+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ff40c15e0 con 0x7f7ff40c5930 2024-01-21T21:33:06.594 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.591+0000 7f581d476680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:06.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.712+0000 7f7ff259c700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 msgr2=0x7f7fe0061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:06.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.712+0000 7f7ff259c700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 0x7f7fe0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:06.731 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.728+0000 7f576b43f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.728+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ff40c15e0 con 0x7f7ff40c5930 2024-01-21T21:33:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.729+0000 7f7fdb7fe700 1 -- 172.21.15.133:0/199345132 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f7ff40c15e0 con 0x7f7ff40c5930 2024-01-21T21:33:06.733 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:06.733 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 msgr2=0x7f7fe0061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 0x7f7fe0061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 msgr2=0x7f7ff4164480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 0x7f7ff4164480 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f7fe4014000 tx=0x7f7fe4017000).stop 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 shutdown_connections 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ff4137410 0x7f7ff40c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7fe005f390 0x7f7fe0061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ff40c5930 0x7f7ff4164480 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 --2- 172.21.15.133:0/199345132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ff4137030 0x7f7ff40c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 >> 172.21.15.133:0/199345132 conn(0x7f7ff4066a90 msgr2=0x7f7ff40c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 shutdown_connections 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.731+0000 7f7ff9209700 1 -- 172.21.15.133:0/199345132 wait complete. 2024-01-21T21:33:06.736 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:33:06.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:06.776 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:06.773+0000 7f581d476680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.906+0000 7f534c72e700 1 Processor -- start 2024-01-21T21:33:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.906+0000 7f534c72e700 1 -- start start 2024-01-21T21:33:06.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534c72e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5344154140 0x7f5344158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534c72e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53440c8120 0x7f53440ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534c72e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53440ab620 con 0x7f5344154520 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534c72e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53440c6ae0 con 0x7f53440c8120 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534c72e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c05e0 con 0x7f5344154140 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53440c8120 0x7f53440ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f5349cc9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5344154520 0x7f53440c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55980/0 (socket says 172.21.15.133:55980) 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53440c8120 0x7f53440ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52876/0 (socket says 172.21.15.133:52876) 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f5349cc9700 1 -- 172.21.15.133:0/1342338623 learned_addr learned my addr 172.21.15.133:0/1342338623 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534a4ca700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5344154140 0x7f5344158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 -- 172.21.15.133:0/1342338623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5344154140 msgr2=0x7f5344158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5344154140 0x7f5344158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 -- 172.21.15.133:0/1342338623 >> v1:172.21.15.133:6789/0 conn(0x7f5344154520 legacy=0x7f53440c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f534accb700 1 -- 172.21.15.133:0/1342338623 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53440c0e40 con 0x7f53440c8120 2024-01-21T21:33:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.907+0000 7f53494c8700 1 -- 172.21.15.133:0/1342338623 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948426825 0 0) 0x7f53440ab620 con 0x7f5344154520 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534accb700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53440c8120 0x7f53440ab130 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f533c009e60 tx=0x7f533c009780).ready entity=mon.0 client_cookie=1ad79db798091c60 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f53494c8700 1 -- 172.21.15.133:0/1342338623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00e070 con 0x7f53440c8120 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f53494c8700 1 -- 172.21.15.133:0/1342338623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00bb60 con 0x7f53440c8120 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f53494c8700 1 -- 172.21.15.133:0/1342338623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c012410 con 0x7f53440c8120 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 -- 172.21.15.133:0/1342338623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53440c8120 msgr2=0x7f53440ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53440c8120 0x7f53440ab130 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 rx=0x7f533c009e60 tx=0x7f533c009780).stop 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 -- 172.21.15.133:0/1342338623 shutdown_connections 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53440c8120 0x7f53440ab130 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 --2- 172.21.15.133:0/1342338623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5344154140 0x7f5344158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 -- 172.21.15.133:0/1342338623 >> 172.21.15.133:0/1342338623 conn(0x7f534405e1e0 msgr2=0x7f534405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 -- 172.21.15.133:0/1342338623 shutdown_connections 2024-01-21T21:33:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.908+0000 7f534c72e700 1 -- 172.21.15.133:0/1342338623 wait complete. 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 Processor -- start 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 -- start start 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53440c8120 0x7f53440b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5344154140 0x7f5344141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344154ef0 con 0x7f5344154520 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440b0ff0 con 0x7f5344154140 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534c72e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5344154bc0 con 0x7f53440c8120 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.910+0000 7f534accb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52886/0 (socket says 172.21.15.133:52886) 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 -- 172.21.15.133:0/2562206353 learned_addr learned my addr 172.21.15.133:0/2562206353 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534a4ca700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53440c8120 0x7f53440b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f5349cc9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5344154140 0x7f5344141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 -- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53440c8120 msgr2=0x7f53440b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53440c8120 0x7f53440b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 -- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5344154140 msgr2=0x7f5344141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5344154140 0x7f5344141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 -- 172.21.15.133:0/2562206353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c009a20 con 0x7f5344154520 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534accb700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f534406afd0 tx=0x7f53440c0db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00b6f0 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c01d630 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c01d9d0 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534c72e700 1 -- 172.21.15.133:0/2562206353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53440b02a0 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.911+0000 7f534c72e700 1 -- 172.21.15.133:0/2562206353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53440b0860 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.912+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5320005120 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.913+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f533c003040 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.913+0000 7f533affd700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 0x7f5328061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.913+0000 7f534a4ca700 1 -- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 msgr2=0x7f5328061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.913+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6977+0+0 (secure 0 0 0) 0x7f533c07c9c0 con 0x7f5344154520 2024-01-21T21:33:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.913+0000 7f534a4ca700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 0x7f5328061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:06.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:06.917+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f533c050f50 con 0x7f5344154520 2024-01-21T21:33:06.925 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:06.922+0000 7f576b43f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:07.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.089+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5320005ac0 con 0x7f5344154520 2024-01-21T21:33:07.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.090+0000 7f533affd700 1 -- 172.21.15.133:0/2562206353 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+18282 (secure 0 0 0) 0x7f533c050b40 con 0x7f5344154520 2024-01-21T21:33:07.094 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:07.094 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":193,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:31:52.394673+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/52661946":"2024-01-22T21:31:52.394643+0000","172.21.15.133:0/3495361745":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6833/94812":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6832/94812":"2024-01-22T21:31:52.394643+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:07.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 msgr2=0x7f5328061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:07.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 0x7f5328061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 msgr2=0x7f53441646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7f534406afd0 tx=0x7f53440c0db0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 shutdown_connections 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5344154520 0x7f53441646f0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53440c8120 0x7f53440b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f532805f390 0x7f5328061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 --2- 172.21.15.133:0/2562206353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5344154140 0x7f5344141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.092+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 >> 172.21.15.133:0/2562206353 conn(0x7f534405e1e0 msgr2=0x7f53440ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.093+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 shutdown_connections 2024-01-21T21:33:07.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.093+0000 7f5338ff9700 1 -- 172.21.15.133:0/2562206353 wait complete. 2024-01-21T21:33:07.109 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:33:07.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:07.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.230+0000 7fe0d132f700 1 Processor -- start 2024-01-21T21:33:07.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.230+0000 7fe0d132f700 1 -- start start 2024-01-21T21:33:07.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0d132f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0cc154140 0x7fe0cc158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0d132f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0cc0c8120 0x7fe0cc0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0d132f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0cc0ab620 con 0x7fe0cc154520 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0d132f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c6ae0 con 0x7fe0cc154140 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0d132f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c05e0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0cc154140 0x7fe0cc158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0cc154140 0x7fe0cc158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52892/0 (socket says 172.21.15.133:52892) 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 -- 172.21.15.133:0/3716004475 learned_addr learned my addr 172.21.15.133:0/3716004475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0cb7fe700 1 --2- 172.21.15.133:0/3716004475 >> v2:172.21.15.178:3300/0 conn(0x7fe0cc0c8120 0x7fe0cc0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 -- 172.21.15.133:0/3716004475 >> v2:172.21.15.178:3300/0 conn(0x7fe0cc0c8120 msgr2=0x7fe0cc0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 --2- 172.21.15.133:0/3716004475 >> v2:172.21.15.178:3300/0 conn(0x7fe0cc0c8120 0x7fe0cc0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 -- 172.21.15.133:0/3716004475 >> v1:172.21.15.178:6789/0 conn(0x7fe0cc154520 legacy=0x7fe0cc0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.231+0000 7fe0caffd700 1 -- 172.21.15.133:0/3716004475 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0c0e40 con 0x7fe0cc154140 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0caffd700 1 --2- 172.21.15.133:0/3716004475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc154140 0x7fe0cc158bb0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fe0bc006fd0 tx=0x7fe0bc0090f0).ready entity=mon.0 client_cookie=386f06392047f64f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0c9ffb700 1 -- 172.21.15.133:0/3716004475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00b520 con 0x7fe0cc154140 2024-01-21T21:33:07.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0c9ffb700 1 -- 172.21.15.133:0/3716004475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00b680 con 0x7fe0cc154140 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0c9ffb700 1 -- 172.21.15.133:0/3716004475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc00ba00 con 0x7fe0cc154140 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 -- 172.21.15.133:0/3716004475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc154140 msgr2=0x7fe0cc158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 --2- 172.21.15.133:0/3716004475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc154140 0x7fe0cc158bb0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7fe0bc006fd0 tx=0x7fe0bc0090f0).stop 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 -- 172.21.15.133:0/3716004475 shutdown_connections 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 --2- 172.21.15.133:0/3716004475 >> v2:172.21.15.178:3300/0 conn(0x7fe0cc0c8120 0x7fe0cc0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 --2- 172.21.15.133:0/3716004475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc154140 0x7fe0cc158bb0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 -- 172.21.15.133:0/3716004475 >> 172.21.15.133:0/3716004475 conn(0x7fe0cc05e1e0 msgr2=0x7fe0cc05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 -- 172.21.15.133:0/3716004475 shutdown_connections 2024-01-21T21:33:07.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.232+0000 7fe0d132f700 1 -- 172.21.15.133:0/3716004475 wait complete. 2024-01-21T21:33:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 Processor -- start 2024-01-21T21:33:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 -- start start 2024-01-21T21:33:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 0x7fe0cc147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 0x7fe0cc0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9e40 con 0x7fe0cc0c8120 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9290 con 0x7fe0cc154140 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.234+0000 7fe0d132f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0cc0c9510 con 0x7fe0cc154520 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0ca7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0cb7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 0x7fe0cc0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0ca7fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:49736/0 (socket says 172.21.15.133:49736) 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0ca7fc700 1 -- 172.21.15.133:0/68903706 learned_addr learned my addr 172.21.15.133:0/68903706 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 0x7fe0cc147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 msgr2=0x7fe0cc0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 0x7fe0cc0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 msgr2=0x7fe0cc144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 -- 172.21.15.133:0/68903706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc009370 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0cb7fe700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 0x7fe0cc0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0ca7fc700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0caffd700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 0x7fe0cc147ac0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fe0cc062cf0 tx=0x7fe0bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc000bc0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00b7f0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc0c97f0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc000d20 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.235+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0cc146d60 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.236+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0cc0ca120 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.237+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7fe0bc01c8a0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.237+0000 7fe0b37fe700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 0x7fe0b8061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.237+0000 7fe0ca7fc700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 msgr2=0x7fe0b8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.237+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 7033+0+0 (secure 0 0 0) 0x7fe0bc07c3d0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.237+0000 7fe0ca7fc700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 0x7fe0b8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.241+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe0bc050a40 con 0x7fe0cc0c8120 2024-01-21T21:33:07.434 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.431+0000 7f581d476680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.438+0000 7fe0ca7fc700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 msgr2=0x7fe0b8061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.438+0000 7fe0ca7fc700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 0x7fe0b8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.456+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0cc05fdf0 con 0x7fe0cc0c8120 2024-01-21T21:33:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.457+0000 7fe0b37fe700 1 -- 172.21.15.133:0/68903706 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fe0bc020090 con 0x7fe0cc0c8120 2024-01-21T21:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:07.461 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:33:07.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 msgr2=0x7fe0b8061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:07.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 0x7fe0b8061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 msgr2=0x7fe0cc147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 0x7fe0cc147ac0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7fe0cc062cf0 tx=0x7fe0bc015000).stop 2024-01-21T21:33:07.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 shutdown_connections 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0cc154520 0x7fe0cc0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0cc0c8120 0x7fe0cc147ac0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe0b805f390 0x7fe0b8061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 --2- 172.21.15.133:0/68903706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0cc154140 0x7fe0cc144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 >> 172.21.15.133:0/68903706 conn(0x7fe0cc05e1e0 msgr2=0x7fe0cc0c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 shutdown_connections 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.459+0000 7fe0d132f700 1 -- 172.21.15.133:0/68903706 wait complete. 2024-01-21T21:33:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:33:07.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:07.502 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.499+0000 7f581d476680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:07.579 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.576+0000 7f581d476680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:07.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.598+0000 7f9f60c72700 1 Processor -- start 2024-01-21T21:33:07.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.598+0000 7f9f60c72700 1 -- start start 2024-01-21T21:33:07.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f60c72700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 0x7f9f5c0c2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f60c72700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 0x7f9f5c154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f60c72700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c1511f0 con 0x7f9f5c065fb0 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f60c72700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c2ff0 con 0x7f9f5c0bd360 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f60c72700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c065b20 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f59d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f5c065fb0 0x7f9f5c0bcc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55982/0 (socket says 172.21.15.133:55982) 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f59d9b700 1 -- 172.21.15.133:0/1316735944 learned_addr learned my addr 172.21.15.133:0/1316735944 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/1316735944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 0x7f9f5c0c2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5ad9d700 1 --2- 172.21.15.133:0/1316735944 >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 0x7f9f5c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5959a700 1 -- 172.21.15.133:0/1316735944 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336298943 0 0) 0x7f9f50001110 con 0x7f9f5c065fb0 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5959a700 1 -- 172.21.15.133:0/1316735944 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f440033f0 con 0x7f9f5c065fb0 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5a59c700 1 -- 172.21.15.133:0/1316735944 >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 msgr2=0x7f9f5c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/1316735944 >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 0x7f9f5c154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.599+0000 7f9f5a59c700 1 -- 172.21.15.133:0/1316735944 >> v1:172.21.15.133:6789/0 conn(0x7f9f5c065fb0 legacy=0x7f9f5c0bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5a59c700 1 -- 172.21.15.133:0/1316735944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0c2240 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5ad9d700 1 --2- 172.21.15.133:0/1316735944 >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 0x7f9f5c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/1316735944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 0x7f9f5c0c2b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9f4c009760 tx=0x7f9f4c009060).ready entity=mon.2 client_cookie=68b5e05656608e82 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5959a700 1 -- 172.21.15.133:0/1316735944 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0090d0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5959a700 1 -- 172.21.15.133:0/1316735944 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00d4a0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f5959a700 1 -- 172.21.15.133:0/1316735944 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00d820 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f60c72700 1 -- 172.21.15.133:0/1316735944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 msgr2=0x7f9f5c0c2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f60c72700 1 --2- 172.21.15.133:0/1316735944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 0x7f9f5c0c2b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f9f4c009760 tx=0x7f9f4c009060).stop 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f60c72700 1 -- 172.21.15.133:0/1316735944 shutdown_connections 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.600+0000 7f9f60c72700 1 --2- 172.21.15.133:0/1316735944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c0a9e30 0x7f9f5c0c2b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.601+0000 7f9f60c72700 1 --2- 172.21.15.133:0/1316735944 >> v2:172.21.15.178:3300/0 conn(0x7f9f5c0bd360 0x7f9f5c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.601+0000 7f9f60c72700 1 -- 172.21.15.133:0/1316735944 >> 172.21.15.133:0/1316735944 conn(0x7f9f5c0c8200 msgr2=0x7f9f5c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.601+0000 7f9f60c72700 1 -- 172.21.15.133:0/1316735944 shutdown_connections 2024-01-21T21:33:07.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.601+0000 7f9f60c72700 1 -- 172.21.15.133:0/1316735944 wait complete. 2024-01-21T21:33:07.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.602+0000 7f9f60c72700 1 Processor -- start 2024-01-21T21:33:07.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.602+0000 7f9f60c72700 1 -- start start 2024-01-21T21:33:07.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c065fb0 0x7f9f5c142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5c0bd360 0x7f9f5c0c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a08e0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0ad660 con 0x7f9f5c0bd360 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0aca50 con 0x7f9f5c065fb0 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52912/0 (socket says 172.21.15.133:52912) 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 -- 172.21.15.133:0/3507757167 learned_addr learned my addr 172.21.15.133:0/3507757167 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f5ad9d700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5c0bd360 0x7f9f5c0c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c065fb0 0x7f9f5c142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c065fb0 msgr2=0x7f9f5c142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c065fb0 0x7f9f5c142350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5c0bd360 msgr2=0x7f9f5c0c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5c0bd360 0x7f9f5c0c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 -- 172.21.15.133:0/3507757167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54009a20 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f59d9b700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f9f5000c4a0 tx=0x7f9f50007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000cea0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500072e0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.603+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c0092a0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.604+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500057a0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.604+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0ad010 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.605+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c05fdf0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.605+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f9f50005b10 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.606+0000 7f9f4affd700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 0x7f9f3c061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.606+0000 7f9f5a59c700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 msgr2=0x7f9f3c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.606+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 7033+0+0 (secure 0 0 0) 0x7f9f50079da0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.606+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 0x7f9f3c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:07.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.610+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9f5004a9e0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.628 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:07.625+0000 7f576b43f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:07.702 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:07.699+0000 7f576b43f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:07.731 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.728+0000 7f581d476680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:07.783 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:07.779+0000 7f576b43f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:07.804 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.801+0000 7f581d476680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.807+0000 7f9f5a59c700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 msgr2=0x7f9f3c061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:07.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.807+0000 7f9f5a59c700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 0x7f9f3c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.829+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f5c1511f0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.830+0000 7f9f4affd700 1 -- 172.21.15.133:0/3507757167 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f9f5c1511f0 con 0x7f9f5c0a9e30 2024-01-21T21:33:07.834 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:07.834 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:31:36.526606+0000","modified":"2024-01-21T21:31:38.535873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9585":{"gid":9585,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2094253960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2094253960},{"type":"v1","addr":"172.21.15.133:6837","nonce":2094253960}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 msgr2=0x7f9f3c061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 0x7f9f3c061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 msgr2=0x7f9f5c155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7f9f5000c4a0 tx=0x7f9f50007a90).stop 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 shutdown_connections 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9f3c05f390 0x7f9f3c061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5c0bd360 0x7f9f5c0c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f5c065fb0 0x7f9f5c142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 --2- 172.21.15.133:0/3507757167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c0a9e30 0x7f9f5c155bf0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 >> 172.21.15.133:0/3507757167 conn(0x7f9f5c0c8200 msgr2=0x7f9f5c0c3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 shutdown_connections 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.832+0000 7f9f60c72700 1 -- 172.21.15.133:0/3507757167 wait complete. 2024-01-21T21:33:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2024-01-21T21:33:07.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:07.919 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:07.916+0000 7f581d476680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:07.941 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:07.937+0000 7f576b43f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:07.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.964+0000 7f44698db700 1 Processor -- start 2024-01-21T21:33:07.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.964+0000 7f44698db700 1 -- start start 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44698db700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4464154140 0x7f4464158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44698db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44640c8120 0x7f44640ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44698db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44640ab620 con 0x7f4464154520 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44698db700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44640c6ae0 con 0x7f4464154140 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44698db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44640c05e0 con 0x7f44640c8120 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4464154140 0x7f4464158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4464154140 0x7f4464158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52922/0 (socket says 172.21.15.133:52922) 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 -- 172.21.15.133:0/314244230 learned_addr learned my addr 172.21.15.133:0/314244230 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f44637fe700 1 --2- 172.21.15.133:0/314244230 >> v2:172.21.15.178:3300/0 conn(0x7f44640c8120 0x7f44640ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 -- 172.21.15.133:0/314244230 >> v2:172.21.15.178:3300/0 conn(0x7f44640c8120 msgr2=0x7f44640ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 --2- 172.21.15.133:0/314244230 >> v2:172.21.15.178:3300/0 conn(0x7f44640c8120 0x7f44640ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 -- 172.21.15.133:0/314244230 >> v1:172.21.15.178:6789/0 conn(0x7f4464154520 legacy=0x7f44640c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 -- 172.21.15.133:0/314244230 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44640c0e40 con 0x7f4464154140 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4462ffd700 1 --2- 172.21.15.133:0/314244230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464154140 0x7f4464158bb0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f4454006fd0 tx=0x7f44540090f0).ready entity=mon.0 client_cookie=441881e6b98fcc93 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4461ffb700 1 -- 172.21.15.133:0/314244230 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400b600 con 0x7f4464154140 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.965+0000 7f4461ffb700 1 -- 172.21.15.133:0/314244230 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400b760 con 0x7f4464154140 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f4461ffb700 1 -- 172.21.15.133:0/314244230 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400bae0 con 0x7f4464154140 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 -- 172.21.15.133:0/314244230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464154140 msgr2=0x7f4464158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 --2- 172.21.15.133:0/314244230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464154140 0x7f4464158bb0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7f4454006fd0 tx=0x7f44540090f0).stop 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 -- 172.21.15.133:0/314244230 shutdown_connections 2024-01-21T21:33:07.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 --2- 172.21.15.133:0/314244230 >> v2:172.21.15.178:3300/0 conn(0x7f44640c8120 0x7f44640ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 --2- 172.21.15.133:0/314244230 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4464154140 0x7f4464158bb0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 -- 172.21.15.133:0/314244230 >> 172.21.15.133:0/314244230 conn(0x7f446405e1e0 msgr2=0x7f446405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 -- 172.21.15.133:0/314244230 shutdown_connections 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.966+0000 7f44698db700 1 -- 172.21.15.133:0/314244230 wait complete. 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.968+0000 7f44698db700 1 Processor -- start 2024-01-21T21:33:07.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.968+0000 7f44698db700 1 -- start start 2024-01-21T21:33:07.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.969+0000 7f44698db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.969+0000 7f44698db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 0x7f4464167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 0x7f44641684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4464152f50 con 0x7f44640c8120 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44641689d0 con 0x7f4464154520 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44640ca340 con 0x7f4464154140 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52924/0 (socket says 172.21.15.133:52924) 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 -- 172.21.15.133:0/2412586638 learned_addr learned my addr 172.21.15.133:0/2412586638 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44637fe700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 0x7f44641684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44627fc700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 0x7f4464167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 -- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 msgr2=0x7f4464167ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 0x7f4464167ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 -- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 msgr2=0x7f44641684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 0x7f44641684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:07.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 -- 172.21.15.133:0/2412586638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454009370 con 0x7f44640c8120 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44627fc700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 0x7f4464167ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44637fe700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 0x7f44641684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f4462ffd700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f446406afd0 tx=0x7f4454017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445400b8d0 con 0x7f44640c8120 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445400ba50 con 0x7f44640c8120 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4464152990 con 0x7f44640c8120 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445401c670 con 0x7f44640c8120 2024-01-21T21:33:07.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.970+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44640c9fd0 con 0x7f44640c8120 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.971+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44640ca620 con 0x7f44640c8120 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.972+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7f445401c9e0 con 0x7f44640c8120 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.972+0000 7f444b7fe700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 0x7f4450061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.972+0000 7f44627fc700 1 -- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 msgr2=0x7f4450061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.972+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 7033+0+0 (secure 0 0 0) 0x7f445407c120 con 0x7f44640c8120 2024-01-21T21:33:07.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.972+0000 7f44627fc700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 0x7f4450061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:07.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:07.976+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f445404cd60 con 0x7f44640c8120 2024-01-21T21:33:08.019 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.015+0000 7f576b43f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:08.028 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:08.025+0000 7f581d476680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:08.139 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.136+0000 7f576b43f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:08.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.148+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f446405fdf0 con 0x7f44640c8120 2024-01-21T21:33:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.149+0000 7f444b7fe700 1 -- 172.21.15.133:0/2412586638 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f4454020090 con 0x7f44640c8120 2024-01-21T21:33:08.153 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:08.153 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":194,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:07.158670+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"183","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:31:35.098340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-01-21T21:31:35.499968+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":194,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/52661946":"2024-01-22T21:31:52.394643+0000","172.21.15.133:0/3495361745":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6833/94812":"2024-01-22T21:31:52.394643+0000","172.21.15.133:6832/94812":"2024-01-22T21:31:52.394643+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 msgr2=0x7f4450061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 0x7f4450061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 msgr2=0x7f446413b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 rx=0x7f446406afd0 tx=0x7f4454017000).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 shutdown_connections 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f445005f390 0x7f4450061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4464154520 0x7f44641684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44640c8120 0x7f446413b810 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 --2- 172.21.15.133:0/2412586638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4464154140 0x7f4464167ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 >> 172.21.15.133:0/2412586638 conn(0x7f446405e1e0 msgr2=0x7f446414df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 shutdown_connections 2024-01-21T21:33:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.152+0000 7f44698db700 1 -- 172.21.15.133:0/2412586638 wait complete. 2024-01-21T21:33:08.168 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T21:33:08.256 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.253+0000 7f576b43f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:08.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.285+0000 7ff742e06700 1 Processor -- start 2024-01-21T21:33:08.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.285+0000 7ff742e06700 1 -- start start 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff742e06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 0x7ff73c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff742e06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c0c0e40 con 0x7ff73c154520 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff742e06700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73c154980 con 0x7ff73c154140 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff742e06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c0c6ae0 con 0x7ff73c0c8120 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff7413a3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff73c154520 0x7ff73c0c12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55984/0 (socket says 172.21.15.133:55984) 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff7413a3700 1 -- 172.21.15.133:0/2412897120 learned_addr learned my addr 172.21.15.133:0/2412897120 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73bfff700 1 --2- 172.21.15.133:0/2412897120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 0x7ff73c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721756589 0 0) 0x7ff73c0c0e40 con 0x7ff73c154520 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff72c0033f0 con 0x7ff73c154520 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525288556 0 0) 0x7ff73c154980 con 0x7ff73c154140 2024-01-21T21:33:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff73c0c0e40 con 0x7ff73c154140 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73bfff700 1 -- 172.21.15.133:0/2412897120 >> v1:172.21.15.178:6789/0 conn(0x7ff73c154140 legacy=0x7ff73c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73bfff700 1 -- 172.21.15.133:0/2412897120 >> v1:172.21.15.133:6789/0 conn(0x7ff73c154520 legacy=0x7ff73c0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73bfff700 1 -- 172.21.15.133:0/2412897120 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c0c6800 con 0x7ff73c0c8120 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73bfff700 1 --2- 172.21.15.133:0/2412897120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 0x7ff73c158bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff728009790 tx=0x7ff728009060).ready entity=mon.2 client_cookie=aba6c3207410c628 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800f510 con 0x7ff73c0c8120 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800f670 con 0x7ff73c0c8120 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.286+0000 7ff73b7fe700 1 -- 172.21.15.133:0/2412897120 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800f9f0 con 0x7ff73c0c8120 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 -- 172.21.15.133:0/2412897120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 msgr2=0x7ff73c158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 --2- 172.21.15.133:0/2412897120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 0x7ff73c158bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff728009790 tx=0x7ff728009060).stop 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 -- 172.21.15.133:0/2412897120 shutdown_connections 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 --2- 172.21.15.133:0/2412897120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c0c8120 0x7ff73c158bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 -- 172.21.15.133:0/2412897120 >> 172.21.15.133:0/2412897120 conn(0x7ff73c05e1e0 msgr2=0x7ff73c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 -- 172.21.15.133:0/2412897120 shutdown_connections 2024-01-21T21:33:08.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.287+0000 7ff742e06700 1 -- 172.21.15.133:0/2412897120 wait complete. 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.288+0000 7ff742e06700 1 Processor -- start 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.288+0000 7ff742e06700 1 -- start start 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff73c0c8120 0x7ff73c0affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c154520 0x7ff73c0ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c151b50 con 0x7ff73c154140 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c151590 con 0x7ff73c0c8120 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff742e06700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c151870 con 0x7ff73c154520 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff73bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:52934/0 (socket says 172.21.15.133:52934) 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.289+0000 7ff73bfff700 1 -- 172.21.15.133:0/3251830954 learned_addr learned my addr 172.21.15.133:0/3251830954 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff7413a3700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c154520 0x7ff73c0ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff740ba2700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff73c0c8120 0x7ff73c0affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c154520 msgr2=0x7ff73c0ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c154520 0x7ff73c0ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff73c0c8120 msgr2=0x7ff73c0affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff73c0c8120 0x7ff73c0affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 -- 172.21.15.133:0/3251830954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7280092a0 con 0x7ff73c154140 2024-01-21T21:33:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff73bfff700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7ff73c06afd0 tx=0x7ff728017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72800fe80 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800f7e0 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73c168380 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72801b640 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.290+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c0b0490 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.291+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c168820 con 0x7ff73c154140 2024-01-21T21:33:08.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.292+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 98) v1 ==== 75662+0+0 (secure 0 0 0) 0x7ff72801b9b0 con 0x7ff73c154140 2024-01-21T21:33:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.292+0000 7ff7397fa700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 0x7ff720061850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.292+0000 7ff740ba2700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 msgr2=0x7ff720061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.292+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 7033+0+0 (secure 0 0 0) 0x7ff72807c0c0 con 0x7ff73c154140 2024-01-21T21:33:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.292+0000 7ff740ba2700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 0x7ff720061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.297+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff72804cc40 con 0x7ff73c154140 2024-01-21T21:33:08.321 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:08.318+0000 7f581d476680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:08.393 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:08.390+0000 7f581d476680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.493+0000 7ff740ba2700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 msgr2=0x7ff720061850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:08.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.493+0000 7ff740ba2700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 0x7ff720061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:08.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.511+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff73c0aa980 con 0x7ff73c154140 2024-01-21T21:33:08.561 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.558+0000 7f576b43f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:08.634 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.630+0000 7f576b43f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.651+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 99) v1 ==== 75270+0+0 (secure 0 0 0) 0x7ff728079740 con 0x7ff73c154140 2024-01-21T21:33:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.651+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 msgr2=0x7ff720061850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:08.651+0000 7ff7397fa700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 0x7ff720061850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:08.656 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:33:08.653+0000 7f2267717700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:08.656 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:33:08.653+0000 7f2267717700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:08.656 INFO:tasks.ceph.mds.a.smithi133.stderr:2024-01-21T21:33:08.653+0000 7f2267717700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:33:08.672 INFO:tasks.ceph.mds.a.smithi133.stderr: -6> 2024-01-21T21:33:08.653+0000 7f2267717700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:08.672 INFO:tasks.ceph.mds.a.smithi133.stderr: -5> 2024-01-21T21:33:08.653+0000 7f2267717700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:08.672 INFO:tasks.ceph.mds.a.smithi133.stderr: -3> 2024-01-21T21:33:08.653+0000 7f2267717700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:33:08.691 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:33:08.713 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.709+0000 7f56e49ea700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.713 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.709+0000 7f56e49ea700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.713 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.709+0000 7f56e49ea700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.713 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.709+0000 7f56e49ea700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.713 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.709+0000 7f56e49ea700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.714 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.711+0000 7f56e79f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.714 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.711+0000 7f56e79f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.714 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.711+0000 7f56e79f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.714 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.711+0000 7f56e79f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.714 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:08.711+0000 7f56e79f0700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:08.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:33:08.998 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:33:09.173 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T21:33:09.171+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T21:33:09.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.174+0000 7ff7397fa700 1 -- 172.21.15.133:0/3251830954 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff728054c70 con 0x7ff73c154140 2024-01-21T21:33:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 msgr2=0x7ff73c168b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:09.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7ff73c06afd0 tx=0x7ff728017000).stop 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 shutdown_connections 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff73c154520 0x7ff73c0ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff72005f390 0x7ff720061850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff73c0c8120 0x7ff73c0affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 --2- 172.21.15.133:0/3251830954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff73c154140 0x7ff73c168b80 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 >> 172.21.15.133:0/3251830954 conn(0x7ff73c05e1e0 msgr2=0x7ff73c14dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 shutdown_connections 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.177+0000 7ff742e06700 1 -- 172.21.15.133:0/3251830954 wait complete. 2024-01-21T21:33:09.180 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T21:33:09.195 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T21:33:09.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.311+0000 7f1d68907700 1 Processor -- start 2024-01-21T21:33:09.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.311+0000 7f1d68907700 1 -- start start 2024-01-21T21:33:09.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d68907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 0x7f1d640a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d68907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d68907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d641584f0 con 0x7f1d6413a620 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d68907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d640bd6f0 con 0x7f1d64062e00 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d68907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640654e0 con 0x7f1d6413aa00 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d61d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 0x7f1d640a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d62d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d6259c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1d6413a620 0x7f1d640626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:37228/0 (socket says 172.21.15.133:37228) 2024-01-21T21:33:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.312+0000 7f1d6259c700 1 -- 172.21.15.133:0/2377841924 learned_addr learned my addr 172.21.15.133:0/2377841924 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d62d9d700 1 -- 172.21.15.133:0/2377841924 >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 msgr2=0x7f1d640a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d62d9d700 1 --2- 172.21.15.133:0/2377841924 >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 0x7f1d640a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d62d9d700 1 -- 172.21.15.133:0/2377841924 >> v1:172.21.15.178:6789/0 conn(0x7f1d6413a620 legacy=0x7f1d640626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d62d9d700 1 -- 172.21.15.133:0/2377841924 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64158730 con 0x7f1d6413aa00 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d61d9b700 1 --2- 172.21.15.133:0/2377841924 >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 0x7f1d640a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d6159a700 1 -- 172.21.15.133:0/2377841924 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096878041 0 0) 0x7f1d54001110 con 0x7f1d6413a620 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d62d9d700 1 --2- 172.21.15.133:0/2377841924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64158000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1d5c009e60 tx=0x7f1d5c009780).ready entity=mon.2 client_cookie=5f9faab95885aece server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d6159a700 1 -- 172.21.15.133:0/2377841924 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c00e070 con 0x7f1d6413aa00 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d6159a700 1 -- 172.21.15.133:0/2377841924 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c00bb60 con 0x7f1d6413aa00 2024-01-21T21:33:09.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d6159a700 1 -- 172.21.15.133:0/2377841924 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c012410 con 0x7f1d6413aa00 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 -- 172.21.15.133:0/2377841924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 msgr2=0x7f1d64158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 --2- 172.21.15.133:0/2377841924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64158000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f1d5c009e60 tx=0x7f1d5c009780).stop 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 -- 172.21.15.133:0/2377841924 shutdown_connections 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 --2- 172.21.15.133:0/2377841924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64158000 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 --2- 172.21.15.133:0/2377841924 >> v2:172.21.15.178:3300/0 conn(0x7f1d64062e00 0x7f1d640a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 -- 172.21.15.133:0/2377841924 >> 172.21.15.133:0/2377841924 conn(0x7f1d640c7dc0 msgr2=0x7f1d640c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.313+0000 7f1d68907700 1 -- 172.21.15.133:0/2377841924 shutdown_connections 2024-01-21T21:33:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.314+0000 7f1d68907700 1 -- 172.21.15.133:0/2377841924 wait complete. 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.315+0000 7f1d68907700 1 Processor -- start 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.315+0000 7f1d68907700 1 -- start start 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d64062e00 0x7f1d64139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d64153ff0 con 0x7f1d6413a620 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640a7690 con 0x7f1d64062e00 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d68907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640aca40 con 0x7f1d6413aa00 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d61d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d61d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53056/0 (socket says 172.21.15.133:53056) 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d61d9b700 1 -- 172.21.15.133:0/3819939365 learned_addr learned my addr 172.21.15.133:0/3819939365 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:09.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d6259c700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d64062e00 0x7f1d64139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.316+0000 7f1d62d9d700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 -- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 msgr2=0x7f1d64153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 -- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d64062e00 msgr2=0x7f1d64139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d64062e00 0x7f1d64139670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 -- 172.21.15.133:0/3819939365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580092a0 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d61d9b700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f1d5800ea50 tx=0x7f1d58009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800c640 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5800c7a0 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c009a20 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800cb20 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.317+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d640ad000 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.318+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d640a7800 con 0x7f1d6413a620 2024-01-21T21:33:09.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.318+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 99) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f1d580123f0 con 0x7f1d6413a620 2024-01-21T21:33:09.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.319+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7349+0+0 (secure 0 0 0) 0x7f1d5807a2b0 con 0x7f1d6413a620 2024-01-21T21:33:09.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.323+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1d5804b220 con 0x7f1d6413a620 2024-01-21T21:33:09.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.529+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1d6405fdf0 con 0x7f1d6413a620 2024-01-21T21:33:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.652+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 100) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f1d58077d80 con 0x7f1d6413a620 2024-01-21T21:33:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.653+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 0x7f1d44068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:09.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.654+0000 7f1d6259c700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 0x7f1d44068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:09.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:09.655+0000 7f1d6259c700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 0x7f1d44068280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1d540075c0 tx=0x7f1d54007a10).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:10.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.181+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3819939365 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1d5806eb20 con 0x7f1d6413a620 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 msgr2=0x7f1d44068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 0x7f1d44068280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f1d540075c0 tx=0x7f1d54007a10).stop 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 msgr2=0x7f1d64153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 rx=0x7f1d5800ea50 tx=0x7f1d58009060).stop 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 shutdown_connections 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d6413aa00 0x7f1d64153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1d440302f0 0x7f1d44068280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d64062e00 0x7f1d64139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 --2- 172.21.15.133:0/3819939365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d6413a620 0x7f1d64153610 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 >> 172.21.15.133:0/3819939365 conn(0x7f1d640c7dc0 msgr2=0x7f1d64155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 shutdown_connections 2024-01-21T21:33:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.183+0000 7f1d68907700 1 -- 172.21.15.133:0/3819939365 wait complete. 2024-01-21T21:33:10.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T21:33:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.316+0000 7fd0f8be0700 1 Processor -- start 2024-01-21T21:33:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.316+0000 7fd0f8be0700 1 -- start start 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f8be0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0f40bdf20 0x7fd0f40bcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f8be0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40c32e0 con 0x7fd0f40652b0 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f8be0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40c2ff0 con 0x7fd0f4069cd0 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f8be0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f4152500 con 0x7fd0f40bdf20 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0f40bdf20 0x7fd0f40bcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0f40bdf20 0x7fd0f40bcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33880/0 (socket says 172.21.15.133:33880) 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 -- 172.21.15.133:0/1326251933 learned_addr learned my addr 172.21.15.133:0/1326251933 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 -- 172.21.15.133:0/1326251933 >> v1:172.21.15.178:6789/0 conn(0x7fd0f4069cd0 legacy=0x7fd0f40c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 -- 172.21.15.133:0/1326251933 >> v1:172.21.15.133:6789/0 conn(0x7fd0f40652b0 legacy=0x7fd0f40695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 -- 172.21.15.133:0/1326251933 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4151c60 con 0x7fd0f40bdf20 2024-01-21T21:33:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f259c700 1 --2- 172.21.15.133:0/1326251933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40bcd60 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fd0e8006fd0 tx=0x7fd0e80090f0).ready entity=mon.0 client_cookie=6afc4f7409990984 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.318+0000 7fd0f159a700 1 -- 172.21.15.133:0/1326251933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800b600 con 0x7fd0f40bdf20 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f159a700 1 -- 172.21.15.133:0/1326251933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e800b760 con 0x7fd0f40bdf20 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f159a700 1 -- 172.21.15.133:0/1326251933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e800bae0 con 0x7fd0f40bdf20 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 -- 172.21.15.133:0/1326251933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 msgr2=0x7fd0f40bcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/1326251933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40bcd60 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 rx=0x7fd0e8006fd0 tx=0x7fd0e80090f0).stop 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 -- 172.21.15.133:0/1326251933 shutdown_connections 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/1326251933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40bcd60 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 -- 172.21.15.133:0/1326251933 >> 172.21.15.133:0/1326251933 conn(0x7fd0f40c7d20 msgr2=0x7fd0f40c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 -- 172.21.15.133:0/1326251933 shutdown_connections 2024-01-21T21:33:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.319+0000 7fd0f8be0700 1 -- 172.21.15.133:0/1326251933 wait complete. 2024-01-21T21:33:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.321+0000 7fd0f8be0700 1 Processor -- start 2024-01-21T21:33:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.321+0000 7fd0f8be0700 1 -- start start 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 0x7fd0f4145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 0x7fd0f40c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40c1ee0 con 0x7fd0f40bdf20 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4162ea0 con 0x7fd0f40652b0 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f8be0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4162570 con 0x7fd0f4069cd0 2024-01-21T21:33:10.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33894/0 (socket says 172.21.15.133:33894) 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 -- 172.21.15.133:0/3511221622 learned_addr learned my addr 172.21.15.133:0/3511221622 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f259c700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 0x7fd0f4145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f1d9b700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 0x7fd0f40c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 -- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 msgr2=0x7fd0f40c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 0x7fd0f40c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 -- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 msgr2=0x7fd0f4145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 0x7fd0f4145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 -- 172.21.15.133:0/3511221622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e8009370 con 0x7fd0f40bdf20 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f1d9b700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 0x7fd0f40c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f259c700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 0x7fd0f4145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.322+0000 7fd0f2d9d700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fd0ec00c810 tx=0x7fd0ec002530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.323+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec010510 con 0x7fd0f40bdf20 2024-01-21T21:33:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.323+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec010690 con 0x7fd0f40bdf20 2024-01-21T21:33:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.323+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4162850 con 0x7fd0f40bdf20 2024-01-21T21:33:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.323+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec010a50 con 0x7fd0f40bdf20 2024-01-21T21:33:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.323+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f41621e0 con 0x7fd0f40bdf20 2024-01-21T21:33:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.324+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f4163050 con 0x7fd0f40bdf20 2024-01-21T21:33:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.324+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 100) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fd0ec012440 con 0x7fd0f40bdf20 2024-01-21T21:33:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.324+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 0x7fd0d40614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.324+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 7349+0+0 (secure 0 0 0) 0x7fd0ec079e50 con 0x7fd0f40bdf20 2024-01-21T21:33:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.324+0000 7fd0f259c700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 0x7fd0d40614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.325+0000 7fd0f259c700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 0x7fd0d40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd0f40c22e0 tx=0x7fd0e8017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.329+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd0ec048b00 con 0x7fd0f40bdf20 2024-01-21T21:33:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:10.493+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0f405fdf0 con 0x7fd0f40bdf20 2024-01-21T21:33:11.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.187+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3511221622 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v197) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd0f4163050 con 0x7fd0f40bdf20 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 msgr2=0x7fd0d40614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 0x7fd0d40614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd0f40c22e0 tx=0x7fd0e8017000).stop 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 msgr2=0x7fd0f40c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 rx=0x7fd0ec00c810 tx=0x7fd0ec002530).stop 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 shutdown_connections 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0f40bdf20 0x7fd0f40c19f0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd0d405f030 0x7fd0d40614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0f40652b0 0x7fd0f4145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 --2- 172.21.15.133:0/3511221622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0f4069cd0 0x7fd0f40c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 >> 172.21.15.133:0/3511221622 conn(0x7fd0f40c7d20 msgr2=0x7fd0f40c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 shutdown_connections 2024-01-21T21:33:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.190+0000 7fd0f8be0700 1 -- 172.21.15.133:0/3511221622 wait complete. 2024-01-21T21:33:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T21:33:11.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T21:33:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.326+0000 7f54f0f3c700 1 Processor -- start 2024-01-21T21:33:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.326+0000 7f54f0f3c700 1 -- start start 2024-01-21T21:33:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54f0f3c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54f0f3c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54f0f3c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec0be520 con 0x7f54ec154410 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54f0f3c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ec0a6780 con 0x7f54ec062e00 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54f0f3c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0a58e0 con 0x7f54ec154030 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54ead9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54ead9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:50878/0 (socket says 172.21.15.133:50878) 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:38314/0 (socket says 172.21.15.133:38314) 2024-01-21T21:33:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.327+0000 7f54ead9d700 1 -- 172.21.15.133:0/2287620439 learned_addr learned my addr 172.21.15.133:0/2287620439 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ea59c700 1 -- 172.21.15.133:0/2287620439 >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 msgr2=0x7f54ec0a6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ea59c700 1 --2- 172.21.15.133:0/2287620439 >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ea59c700 1 -- 172.21.15.133:0/2287620439 >> v1:172.21.15.178:6789/0 conn(0x7f54ec154410 legacy=0x7f54ec0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ea59c700 1 -- 172.21.15.133:0/2287620439 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec0bdc50 con 0x7f54ec154030 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ead9d700 1 --2- 172.21.15.133:0/2287620439 >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54ea59c700 1 --2- 172.21.15.133:0/2287620439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f54dc009760 tx=0x7f54dc009060).ready entity=mon.2 client_cookie=e92c86432f96d9ae server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54e959a700 1 -- 172.21.15.133:0/2287620439 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00f510 con 0x7f54ec154030 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54e959a700 1 -- 172.21.15.133:0/2287620439 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc00f670 con 0x7f54ec154030 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54e959a700 1 -- 172.21.15.133:0/2287620439 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00f9f0 con 0x7f54ec154030 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54f0f3c700 1 -- 172.21.15.133:0/2287620439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 msgr2=0x7f54ec0c2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.328+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/2287620439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f54dc009760 tx=0x7f54dc009060).stop 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 -- 172.21.15.133:0/2287620439 shutdown_connections 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/2287620439 >> v2:172.21.15.178:3300/0 conn(0x7f54ec062e00 0x7f54ec0a6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/2287620439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec154030 0x7f54ec0c2c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 -- 172.21.15.133:0/2287620439 >> 172.21.15.133:0/2287620439 conn(0x7f54ec0c7d20 msgr2=0x7f54ec0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 -- 172.21.15.133:0/2287620439 shutdown_connections 2024-01-21T21:33:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.329+0000 7f54f0f3c700 1 -- 172.21.15.133:0/2287620439 wait complete. 2024-01-21T21:33:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.330+0000 7f54f0f3c700 1 Processor -- start 2024-01-21T21:33:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.330+0000 7f54f0f3c700 1 -- start start 2024-01-21T21:33:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec062e00 0x7f54ec0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec154410 0x7f54ec148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec149350 con 0x7f54ec154030 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0ab970 con 0x7f54ec154410 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54f0f3c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0abc50 con 0x7f54ec062e00 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33910/0 (socket says 172.21.15.133:33910) 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 -- 172.21.15.133:0/771650389 learned_addr learned my addr 172.21.15.133:0/771650389 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54ea59c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec062e00 0x7f54ec0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54ead9d700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec154410 0x7f54ec148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 -- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec062e00 msgr2=0x7f54ec0a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec062e00 0x7f54ec0a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 -- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec154410 msgr2=0x7f54ec148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec154410 0x7f54ec148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 -- 172.21.15.133:0/771650389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e4009ae0 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54e9d9b700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f54e000c440 tx=0x7f54e0007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.331+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0007020 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.332+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0007180 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.332+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc0092a0 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.332+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e0007520 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.332+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec0bf240 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.333+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec0c20e0 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.333+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 100) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f54e00068b0 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.333+0000 7f54daffd700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 0x7f54cc0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.333+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6911+0+0 (secure 0 0 0) 0x7f54e0079be0 con 0x7f54ec154030 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.333+0000 7f54ea59c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 0x7f54cc0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.334+0000 7f54ea59c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 0x7f54cc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f54dc009fd0 tx=0x7f54dc017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.337+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f54e004ad70 con 0x7f54ec154030 2024-01-21T21:33:11.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.508+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54ec0bf460 con 0x7f54ec154030 2024-01-21T21:33:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:11.658+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f54e0077870 con 0x7f54ec154030 2024-01-21T21:33:12.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.192+0000 7f54daffd700 1 -- 172.21.15.133:0/771650389 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v198) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54e00713b0 con 0x7f54ec154030 2024-01-21T21:33:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 msgr2=0x7f54cc0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 0x7f54cc0614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f54dc009fd0 tx=0x7f54dc017000).stop 2024-01-21T21:33:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 msgr2=0x7f54ec148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 rx=0x7f54e000c440 tx=0x7f54e0007dd0).stop 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 shutdown_connections 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f54cc05f030 0x7f54cc0614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec154410 0x7f54ec148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec062e00 0x7f54ec0a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 --2- 172.21.15.133:0/771650389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54ec154030 0x7f54ec148970 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.196+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 >> 172.21.15.133:0/771650389 conn(0x7f54ec0c7d20 msgr2=0x7f54ec067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.197+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 shutdown_connections 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.197+0000 7f54f0f3c700 1 -- 172.21.15.133:0/771650389 wait complete. 2024-01-21T21:33:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T21:33:12.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T21:33:12.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.331+0000 7f84a299c700 1 Processor -- start 2024-01-21T21:33:12.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 -- start start 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f849c1558c0 0x7f849c0626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f849c0bd890 0x7f849c062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849c0a50f0 con 0x7f849c155ca0 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0630d0 con 0x7f849c0bd890 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.332+0000 7f84a299c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f849c0a4da0 con 0x7f849c1558c0 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f849c0bd890 0x7f849c062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f849c0bd890 0x7f849c062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33916/0 (socket says 172.21.15.133:33916) 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 -- 172.21.15.133:0/2595599017 learned_addr learned my addr 172.21.15.133:0/2595599017 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:12.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f849bfff700 1 --2- 172.21.15.133:0/2595599017 >> v2:172.21.15.178:3300/0 conn(0x7f849c1558c0 0x7f849c0626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 -- 172.21.15.133:0/2595599017 >> v2:172.21.15.178:3300/0 conn(0x7f849c1558c0 msgr2=0x7f849c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 --2- 172.21.15.133:0/2595599017 >> v2:172.21.15.178:3300/0 conn(0x7f849c1558c0 0x7f849c0626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 -- 172.21.15.133:0/2595599017 >> v1:172.21.15.178:6789/0 conn(0x7f849c155ca0 legacy=0x7f849c0bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 -- 172.21.15.133:0/2595599017 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c0bde00 con 0x7f849c0bd890 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f84a0f39700 1 --2- 172.21.15.133:0/2595599017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c0bd890 0x7f849c062be0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f849c0692f0 tx=0x7f8494009840).ready entity=mon.0 client_cookie=22a17a152426afe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f849affd700 1 -- 172.21.15.133:0/2595599017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400e070 con 0x7f849c0bd890 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f849affd700 1 -- 172.21.15.133:0/2595599017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849400ba10 con 0x7f849c0bd890 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.333+0000 7f849affd700 1 -- 172.21.15.133:0/2595599017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400bd90 con 0x7f849c0bd890 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 -- 172.21.15.133:0/2595599017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c0bd890 msgr2=0x7f849c062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 --2- 172.21.15.133:0/2595599017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c0bd890 0x7f849c062be0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7f849c0692f0 tx=0x7f8494009840).stop 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 -- 172.21.15.133:0/2595599017 shutdown_connections 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 --2- 172.21.15.133:0/2595599017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c0bd890 0x7f849c062be0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 --2- 172.21.15.133:0/2595599017 >> v2:172.21.15.178:3300/0 conn(0x7f849c1558c0 0x7f849c0626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 -- 172.21.15.133:0/2595599017 >> 172.21.15.133:0/2595599017 conn(0x7f849c0c8010 msgr2=0x7f849c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 -- 172.21.15.133:0/2595599017 shutdown_connections 2024-01-21T21:33:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.334+0000 7f84a299c700 1 -- 172.21.15.133:0/2595599017 wait complete. 2024-01-21T21:33:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.335+0000 7f84a299c700 1 Processor -- start 2024-01-21T21:33:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.335+0000 7f84a299c700 1 -- start start 2024-01-21T21:33:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f849c0bd890 0x7f849c14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849c155ca0 0x7f849c0c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0c2210 con 0x7f849c1558c0 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0ab0f0 con 0x7f849c155ca0 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a299c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c0ab390 con 0x7f849c0bd890 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33932/0 (socket says 172.21.15.133:33932) 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 -- 172.21.15.133:0/4237722493 learned_addr learned my addr 172.21.15.133:0/4237722493 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f84a0f39700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849c155ca0 0x7f849c0c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849bfff700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f849c0bd890 0x7f849c14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 -- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f849c0bd890 msgr2=0x7f849c14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f849c0bd890 0x7f849c14e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 -- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849c155ca0 msgr2=0x7f849c0c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849c155ca0 0x7f849c0c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 -- 172.21.15.133:0/4237722493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009ae0 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f849b7fe700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f848c00b460 tx=0x7f848c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012410 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.336+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848c012590 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.337+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848c012950 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.337+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849c0ab670 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.337+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849c0c0030 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.338+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849c0abb90 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.338+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f848c012cc0 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.338+0000 7f8498ff9700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 0x7f8488061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.338+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f848c07a020 con 0x7f849c1558c0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.338+0000 7f849bfff700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 0x7f8488061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.339+0000 7f849bfff700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 0x7f8488061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f849000bbc0 tx=0x7f8490008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.342+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f849c0abb90 con 0x7f849c1558c0 2024-01-21T21:33:12.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.517+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f849c0abb90 con 0x7f849c1558c0 2024-01-21T21:33:12.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.521+0000 7f8498ff9700 1 -- 172.21.15.133:0/4237722493 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7f849c0abb90 con 0x7f849c1558c0 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 msgr2=0x7f8488061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 0x7f8488061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f849000bbc0 tx=0x7f8490008040).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 msgr2=0x7f849c0c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f848c00b460 tx=0x7f848c006f20).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 shutdown_connections 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f848805f150 0x7f8488061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f849c155ca0 0x7f849c0c1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f849c0bd890 0x7f849c14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 --2- 172.21.15.133:0/4237722493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f849c1558c0 0x7f849c0c1730 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 >> 172.21.15.133:0/4237722493 conn(0x7f849c0c8010 msgr2=0x7f849c150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 shutdown_connections 2024-01-21T21:33:12.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.523+0000 7f84a299c700 1 -- 172.21.15.133:0/4237722493 wait complete. 2024-01-21T21:33:12.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T21:33:12.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.653+0000 7f2cadd60700 1 Processor -- start 2024-01-21T21:33:12.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.653+0000 7f2cadd60700 1 -- start start 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2cadd60700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ca81558c0 0x7f2ca80626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2cadd60700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ca8155ca0 0x7f2ca8062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2cadd60700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca80a50f0 con 0x7f2ca80bd180 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2cadd60700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80630d0 con 0x7f2ca81558c0 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2cadd60700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80a4da0 con 0x7f2ca8155ca0 2024-01-21T21:33:12.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ca81558c0 0x7f2ca80626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ca81558c0 0x7f2ca80626f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33944/0 (socket says 172.21.15.133:33944) 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 -- 172.21.15.133:0/616405831 learned_addr learned my addr 172.21.15.133:0/616405831 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 -- 172.21.15.133:0/616405831 >> v2:172.21.15.178:3300/0 conn(0x7f2ca8155ca0 msgr2=0x7f2ca8062be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 --2- 172.21.15.133:0/616405831 >> v2:172.21.15.178:3300/0 conn(0x7f2ca8155ca0 0x7f2ca8062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 -- 172.21.15.133:0/616405831 >> v1:172.21.15.178:6789/0 conn(0x7f2ca80bd180 legacy=0x7f2ca80bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.654+0000 7f2ca77fe700 1 -- 172.21.15.133:0/616405831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80bde00 con 0x7f2ca81558c0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2ca77fe700 1 --2- 172.21.15.133:0/616405831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca80626f0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f2ca8067930 tx=0x7f2c900090f0).ready entity=mon.0 client_cookie=eaacde3d4bb5377c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2ca67fc700 1 -- 172.21.15.133:0/616405831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000b5a0 con 0x7f2ca81558c0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2ca67fc700 1 -- 172.21.15.133:0/616405831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000b700 con 0x7f2ca81558c0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2ca67fc700 1 -- 172.21.15.133:0/616405831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000ba80 con 0x7f2ca81558c0 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 -- 172.21.15.133:0/616405831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 msgr2=0x7f2ca80626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 --2- 172.21.15.133:0/616405831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca80626f0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f2ca8067930 tx=0x7f2c900090f0).stop 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 -- 172.21.15.133:0/616405831 shutdown_connections 2024-01-21T21:33:12.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 --2- 172.21.15.133:0/616405831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca80626f0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 --2- 172.21.15.133:0/616405831 >> v2:172.21.15.178:3300/0 conn(0x7f2ca8155ca0 0x7f2ca8062be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 -- 172.21.15.133:0/616405831 >> 172.21.15.133:0/616405831 conn(0x7f2ca80c8010 msgr2=0x7f2ca80c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 -- 172.21.15.133:0/616405831 shutdown_connections 2024-01-21T21:33:12.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.655+0000 7f2cadd60700 1 -- 172.21.15.133:0/616405831 wait complete. 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.656+0000 7f2cadd60700 1 Processor -- start 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 -- start start 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca80bd180 0x7f2ca8168900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 0x7f2ca814f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80ad340 con 0x7f2ca81558c0 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80acd60 con 0x7f2ca8155ca0 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.657+0000 7f2cadd60700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8168df0 con 0x7f2ca80bd180 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33952/0 (socket says 172.21.15.133:33952) 2024-01-21T21:33:12.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 -- 172.21.15.133:0/2199971504 learned_addr learned my addr 172.21.15.133:0/2199971504 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca7fff700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 0x7f2ca814f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca77fe700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca80bd180 0x7f2ca8168900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 -- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca80bd180 msgr2=0x7f2ca8168900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca80bd180 0x7f2ca8168900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 -- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 msgr2=0x7f2ca814f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 0x7f2ca814f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 -- 172.21.15.133:0/2199971504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90009370 con 0x7f2ca81558c0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca7fff700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 0x7f2ca814f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2ca6ffd700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f2c9800b4c0 tx=0x7f2c98009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98002320 con 0x7f2ca81558c0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98002480 con 0x7f2ca81558c0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80672b0 con 0x7f2ca81558c0 2024-01-21T21:33:12.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98002840 con 0x7f2ca81558c0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.658+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca8067590 con 0x7f2ca81558c0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.659+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca80acbc0 con 0x7f2ca81558c0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.659+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2c98002bf0 con 0x7f2ca81558c0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.660+0000 7f2c9ffff700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 0x7f2c88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.660+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f2c9807a190 con 0x7f2ca81558c0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.660+0000 7f2ca77fe700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 0x7f2c88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.660+0000 7f2ca77fe700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 0x7f2c88061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2c90009130 tx=0x7f2c90015000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.664+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2ca80acbc0 con 0x7f2ca81558c0 2024-01-21T21:33:12.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.828+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f2ca80acbc0 con 0x7f2ca81558c0 2024-01-21T21:33:12.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.831+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2199971504 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v41) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2ca80acbc0 con 0x7f2ca81558c0 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 msgr2=0x7f2c88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 0x7f2c88061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2c90009130 tx=0x7f2c90015000).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 msgr2=0x7f2ca8143bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7f2c9800b4c0 tx=0x7f2c98009060).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 shutdown_connections 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2c8805f150 0x7f2c88061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca8155ca0 0x7f2ca814f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca80bd180 0x7f2ca8168900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 --2- 172.21.15.133:0/2199971504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ca81558c0 0x7f2ca8143bd0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 >> 172.21.15.133:0/2199971504 conn(0x7f2ca80c8010 msgr2=0x7f2ca80bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 shutdown_connections 2024-01-21T21:33:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.834+0000 7f2cadd60700 1 -- 172.21.15.133:0/2199971504 wait complete. 2024-01-21T21:33:12.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2024-01-21T21:33:12.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.961+0000 7fe4a9fd6700 1 Processor -- start 2024-01-21T21:33:12.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.961+0000 7fe4a9fd6700 1 -- start start 2024-01-21T21:33:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.962+0000 7fe4a9fd6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4a413b970 0x7fe4a40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.962+0000 7fe4a9fd6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40bfa40 con 0x7fe4a40be810 2024-01-21T21:33:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.962+0000 7fe4a9fd6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a40c3e70 con 0x7fe4a40c39f0 2024-01-21T21:33:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.962+0000 7fe4a9fd6700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a40bee30 con 0x7fe4a413b970 2024-01-21T21:33:12.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe4a40be810 0x7fe4a40a8ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52312/0 (socket says 172.21.15.133:52312) 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a3fff700 1 -- 172.21.15.133:0/2392702463 learned_addr learned my addr 172.21.15.133:0/2392702463 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a37fe700 1 --2- 172.21.15.133:0/2392702463 >> v2:172.21.15.178:3300/0 conn(0x7fe4a413b970 0x7fe4a40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841633585 0 0) 0x7fe4a40bfa40 con 0x7fe4a40be810 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4900033f0 con 0x7fe4a40be810 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1413599177 0 0) 0x7fe4900033f0 con 0x7fe4a40be810 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 >> v2:172.21.15.178:3300/0 conn(0x7fe4a413b970 msgr2=0x7fe4a40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 --2- 172.21.15.133:0/2392702463 >> v2:172.21.15.178:3300/0 conn(0x7fe4a413b970 0x7fe4a40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 >> v1:172.21.15.178:6789/0 conn(0x7fe4a40c39f0 legacy=0x7fe4a40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40bf110 con 0x7fe4a40be810 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fe49c0017f0 con 0x7fe4a40be810 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 >> v1:172.21.15.133:6789/0 conn(0x7fe4a40be810 legacy=0x7fe4a40a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4900038e0 0x7fe490003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe490004690 0x7fe490004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe49000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a40bee30 con 0x7fe490005050 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49000bfe0 con 0x7fe490004690 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49000c1a0 con 0x7fe4900038e0 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe49000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a37fe700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4900038e0 0x7fe490003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe49bfff700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe490004690 0x7fe490004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a3fff700 1 -- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4900038e0 msgr2=0x7fe490003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.963+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4900038e0 0x7fe490003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a3fff700 1 -- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe490004690 msgr2=0x7fe490004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe490004690 0x7fe490004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a3fff700 1 -- 172.21.15.133:0/2392702463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900033f0 con 0x7fe490005050 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a3fff700 1 -- 172.21.15.133:0/2392702463 reap_dead start 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe49000b8e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7fe49c00c450 tx=0x7fe49c00c760).ready entity=mon.0 client_cookie=e9981c2f5c6835fa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c002030 con 0x7fe490005050 2024-01-21T21:33:12.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49c00cdf0 con 0x7fe490005050 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a2ffd700 1 -- 172.21.15.133:0/2392702463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c005d30 con 0x7fe490005050 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 msgr2=0x7fe49000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe49000b8e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7fe49c00c450 tx=0x7fe49c00c760).stop 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2392702463 shutdown_connections 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2392702463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe49000b8e0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2392702463 >> 172.21.15.133:0/2392702463 conn(0x7fe4a4066a70 msgr2=0x7fe4a4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2392702463 shutdown_connections 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.964+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2392702463 wait complete. 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 Processor -- start 2024-01-21T21:33:12.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 -- start start 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a41655c0 0x7fe4a40653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 0x7fe4a4156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41648e0 con 0x7fe490005050 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4065890 con 0x7fe4a41655c0 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a9fd6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41653a0 con 0x7fe4a4167130 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.966+0000 7fe4a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33970/0 (socket says 172.21.15.133:33970) 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 -- 172.21.15.133:0/2539887569 learned_addr learned my addr 172.21.15.133:0/2539887569 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe49bfff700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a41655c0 0x7fe4a40653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 0x7fe4a4156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 -- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 msgr2=0x7fe4a4156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 0x7fe4a4156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 -- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a41655c0 msgr2=0x7fe4a40653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a41655c0 0x7fe4a40653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 -- 172.21.15.133:0/2539887569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a40639c0 con 0x7fe490005050 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a3fff700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 0x7fe4a4156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a37fe700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fe4940119f0 tx=0x7fe494009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494011e80 con 0x7fe490005050 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400f940 con 0x7fe490005050 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400fcc0 con 0x7fe490005050 2024-01-21T21:33:12.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4164b00 con 0x7fe490005050 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.967+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a41650c0 con 0x7fe490005050 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.968+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a405fdf0 con 0x7fe490005050 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.968+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fe494014650 con 0x7fe490005050 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.969+0000 7fe4a0ff9700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 0x7fe484061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.969+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fe49407ad40 con 0x7fe490005050 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.969+0000 7fe49bfff700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 0x7fe484061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.969+0000 7fe49bfff700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 0x7fe484061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4a40aedf0 tx=0x7fe48c007bb0).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:12.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:12.973+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe49404bf10 con 0x7fe490005050 2024-01-21T21:33:13.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:13.204+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fe4a406bd20 con 0x7fe490005050 2024-01-21T21:33:14.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.201+0000 7fe4a0ff9700 1 -- 172.21.15.133:0/2539887569 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3020) v1 ==== 163+0+0 (secure 0 0 0) 0x7fe49404f4b0 con 0x7fe490005050 2024-01-21T21:33:14.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.203+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 msgr2=0x7fe484061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.203+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 0x7fe484061640 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4a40aedf0 tx=0x7fe48c007bb0).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.203+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 msgr2=0x7fe4a41643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7fe4940119f0 tx=0x7fe494009060).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 shutdown_connections 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4a4167130 0x7fe4a4156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe490005050 0x7fe4a41643f0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe48405f180 0x7fe484061640 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 --2- 172.21.15.133:0/2539887569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4a41655c0 0x7fe4a40653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 >> 172.21.15.133:0/2539887569 conn(0x7fe4a4066a70 msgr2=0x7fe4a413a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 shutdown_connections 2024-01-21T21:33:14.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.204+0000 7fe4a9fd6700 1 -- 172.21.15.133:0/2539887569 wait complete. 2024-01-21T21:33:14.222 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2024-01-21T21:33:14.222 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2024-01-21T21:33:14.222 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2024-01-21T21:33:14.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-01-21T21:33:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.341+0000 7fb208691700 1 Processor -- start 2024-01-21T21:33:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.341+0000 7fb208691700 1 -- start start 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.342+0000 7fb208691700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2000beb30 0x7fb200155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.342+0000 7fb208691700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 0x7fb2000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.342+0000 7fb208691700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb200065660 con 0x7fb200069cd0 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.342+0000 7fb208691700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000bef10 con 0x7fb2000beb30 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.342+0000 7fb208691700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb200156070 con 0x7fb2000c3fb0 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2000beb30 0x7fb200155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb2000beb30 0x7fb200155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33980/0 (socket says 172.21.15.133:33980) 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 -- 172.21.15.133:0/1391613736 learned_addr learned my addr 172.21.15.133:0/1391613736 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb205c2c700 1 --2- 172.21.15.133:0/1391613736 >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 0x7fb2000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 -- 172.21.15.133:0/1391613736 >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 msgr2=0x7fb2000697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 --2- 172.21.15.133:0/1391613736 >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 0x7fb2000697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 -- 172.21.15.133:0/1391613736 >> v1:172.21.15.178:6789/0 conn(0x7fb200069cd0 legacy=0x7fb200151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 -- 172.21.15.133:0/1391613736 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200065f00 con 0x7fb2000beb30 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb205c2c700 1 --2- 172.21.15.133:0/1391613736 >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 0x7fb2000697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20642d700 1 --2- 172.21.15.133:0/1391613736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000beb30 0x7fb200155b80 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fb20005ecd0 tx=0x7fb1f40090f0).ready entity=mon.0 client_cookie=ad9337cc021e4434 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20542b700 1 -- 172.21.15.133:0/1391613736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400b580 con 0x7fb2000beb30 2024-01-21T21:33:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20542b700 1 -- 172.21.15.133:0/1391613736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400b6e0 con 0x7fb2000beb30 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.343+0000 7fb20542b700 1 -- 172.21.15.133:0/1391613736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400ba80 con 0x7fb2000beb30 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 -- 172.21.15.133:0/1391613736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000beb30 msgr2=0x7fb200155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 --2- 172.21.15.133:0/1391613736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000beb30 0x7fb200155b80 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 rx=0x7fb20005ecd0 tx=0x7fb1f40090f0).stop 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 -- 172.21.15.133:0/1391613736 shutdown_connections 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 --2- 172.21.15.133:0/1391613736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000beb30 0x7fb200155b80 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 --2- 172.21.15.133:0/1391613736 >> v2:172.21.15.178:3300/0 conn(0x7fb2000c3fb0 0x7fb2000697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 -- 172.21.15.133:0/1391613736 >> 172.21.15.133:0/1391613736 conn(0x7fb2000c8010 msgr2=0x7fb2000c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 -- 172.21.15.133:0/1391613736 shutdown_connections 2024-01-21T21:33:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.344+0000 7fb208691700 1 -- 172.21.15.133:0/1391613736 wait complete. 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.345+0000 7fb208691700 1 Processor -- start 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.345+0000 7fb208691700 1 -- start start 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb200069cd0 0x7fb2000c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2000beb30 0x7fb200153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000bfbf0 con 0x7fb2000c3fb0 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000a58f0 con 0x7fb2000beb30 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb208691700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000c1e70 con 0x7fb200069cd0 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33990/0 (socket says 172.21.15.133:33990) 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 -- 172.21.15.133:0/1681134822 learned_addr learned my addr 172.21.15.133:0/1681134822 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb205c2c700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2000beb30 0x7fb200153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb20642d700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb200069cd0 0x7fb2000c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 -- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb200069cd0 msgr2=0x7fb2000c1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb200069cd0 0x7fb2000c1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 -- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2000beb30 msgr2=0x7fb200153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2000beb30 0x7fb200153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 -- 172.21.15.133:0/1681134822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009370 con 0x7fb2000c3fb0 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb206c2e700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fb1f800b810 tx=0x7fb1f8009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.346+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800d600 con 0x7fb2000c3fb0 2024-01-21T21:33:14.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.347+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800d780 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.347+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000a5b90 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.347+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800db40 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.347+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000a5e70 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.348+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2000bfda0 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.348+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fb1f8019460 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.348+0000 7fb1f2ffd700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 0x7fb1e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.348+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fb1f807a480 con 0x7fb2000c3fb0 2024-01-21T21:33:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.348+0000 7fb20642d700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 0x7fb1e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:14.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.349+0000 7fb20642d700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 0x7fb1e4061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb1f4006df0 tx=0x7fb1f4017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:14.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.352+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb1f804b570 con 0x7fb2000c3fb0 2024-01-21T21:33:14.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:14.578+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fb20005fdf0 con 0x7fb2000c3fb0 2024-01-21T21:33:15.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.204+0000 7fb1f2ffd700 1 -- 172.21.15.133:0/1681134822 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3021) v1 ==== 158+0+0 (secure 0 0 0) 0x7fb1f804eb90 con 0x7fb2000c3fb0 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 msgr2=0x7fb1e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 0x7fb1e4061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb1f4006df0 tx=0x7fb1f4017000).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 msgr2=0x7fb2000aa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7fb1f800b810 tx=0x7fb1f8009290).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 shutdown_connections 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2000c3fb0 0x7fb2000aa220 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb200069cd0 0x7fb2000c1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb1e405f150 0x7fb1e4061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 --2- 172.21.15.133:0/1681134822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2000beb30 0x7fb200153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 >> 172.21.15.133:0/1681134822 conn(0x7fb2000c8010 msgr2=0x7fb2000c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:15.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 shutdown_connections 2024-01-21T21:33:15.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.207+0000 7fb208691700 1 -- 172.21.15.133:0/1681134822 wait complete. 2024-01-21T21:33:15.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-21T21:33:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.344+0000 7fdec283d700 1 Processor -- start 2024-01-21T21:33:15.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.344+0000 7fdec283d700 1 -- start start 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdec283d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdebc155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdec283d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc065660 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdec283d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdebc065f00 con 0x7fdebc069ef0 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdec283d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0bef10 con 0x7fdebc0beb30 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdebb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdebc0c3fb0 0x7fdebc0697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52314/0 (socket says 172.21.15.133:52314) 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdebb7fe700 1 -- 172.21.15.133:0/1018636835 learned_addr learned my addr 172.21.15.133:0/1018636835 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdebbfff700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdebc155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174845132 0 0) 0x7fdebc065660 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.345+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdea40033f0 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173922272 0 0) 0x7fdea40033f0 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 msgr2=0x7fdebc155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdebc155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 >> v1:172.21.15.178:6789/0 conn(0x7fdebc069ef0 legacy=0x7fdebc066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc0c4740 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fdeac001470 con 0x7fdebc0c3fb0 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 >> v1:172.21.15.133:6789/0 conn(0x7fdebc0c3fb0 legacy=0x7fdebc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdea4003910 0x7fdea4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdea4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea4004b80 0x7fdea4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0bef10 con 0x7fdea4004b80 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea400b990 con 0x7fdea4003910 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea400dd10 con 0x7fdebc0beb30 2024-01-21T21:33:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea4004b80 0x7fdea4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebbfff700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdea4003910 0x7fdea4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebb7fe700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdea4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 -- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 msgr2=0x7fdea4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdebc0beb30 0x7fdea4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 -- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdea4003910 msgr2=0x7fdea4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdea4003910 0x7fdea4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 -- 172.21.15.133:0/1018636835 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40033f0 con 0x7fdea4004b80 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdec0dda700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea4004b80 0x7fdea4005000 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7fdeb4001ef0 tx=0x7fdeb4007f10).ready entity=mon.0 client_cookie=1ae9dcd1f399a7f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40017e0 con 0x7fdea4004b80 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb400c6a0 con 0x7fdea4004b80 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.346+0000 7fdebaffd700 1 -- 172.21.15.133:0/1018636835 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb400ca20 con 0x7fdea4004b80 2024-01-21T21:33:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 -- 172.21.15.133:0/1018636835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea4004b80 msgr2=0x7fdea4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 --2- 172.21.15.133:0/1018636835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdea4004b80 0x7fdea4005000 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 rx=0x7fdeb4001ef0 tx=0x7fdeb4007f10).stop 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec0dda700 1 -- 172.21.15.133:0/1018636835 reap_dead start 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 -- 172.21.15.133:0/1018636835 shutdown_connections 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 -- 172.21.15.133:0/1018636835 >> 172.21.15.133:0/1018636835 conn(0x7fdebc0c8010 msgr2=0x7fdebc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 -- 172.21.15.133:0/1018636835 shutdown_connections 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.347+0000 7fdec283d700 1 -- 172.21.15.133:0/1018636835 wait complete. 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.348+0000 7fdec283d700 1 Processor -- start 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.348+0000 7fdec283d700 1 -- start start 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdea4004b80 0x7fdebc0aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdebc0a8b00 0x7fdebc152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc0bf0b0 con 0x7fdebc0aa890 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc154520 con 0x7fdebc0a8b00 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec283d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdebc153770 con 0x7fdea4004b80 2024-01-21T21:33:15.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdebb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdebb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34010/0 (socket says 172.21.15.133:34010) 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdebb7fe700 1 -- 172.21.15.133:0/2804375708 learned_addr learned my addr 172.21.15.133:0/2804375708 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdec0dda700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdebc0a8b00 0x7fdebc152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.349+0000 7fdebbfff700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdea4004b80 0x7fdebc0aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 -- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdea4004b80 msgr2=0x7fdebc0aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdea4004b80 0x7fdebc0aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 -- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdebc0a8b00 msgr2=0x7fdebc152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdebc0a8b00 0x7fdebc152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 -- 172.21.15.133:0/2804375708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdebc153a50 con 0x7fdebc0aa890 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdebb7fe700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fdeac001d00 tx=0x7fdeac001e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac004e20 con 0x7fdebc0aa890 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac00f8a0 con 0x7fdebc0aa890 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac00fc40 con 0x7fdebc0aa890 2024-01-21T21:33:15.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdebc0bf300 con 0x7fdebc0aa890 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.350+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdebc153130 con 0x7fdebc0aa890 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.351+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdebc0bf820 con 0x7fdebc0aa890 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.351+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdeac01d3b0 con 0x7fdebc0aa890 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.351+0000 7fdeb8ff9700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 0x7fdea80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.351+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fdeac079c90 con 0x7fdebc0aa890 2024-01-21T21:33:15.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.352+0000 7fdebbfff700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 0x7fdea80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.352+0000 7fdebbfff700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 0x7fdea80615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdeb0006d50 tx=0x7fdeb0012040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.356+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdebc0bf820 con 0x7fdebc0aa890 2024-01-21T21:33:15.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.522+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdebc0bf820 con 0x7fdebc0aa890 2024-01-21T21:33:15.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.526+0000 7fdeb8ff9700 1 -- 172.21.15.133:0/2804375708 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdeac019020 con 0x7fdebc0aa890 2024-01-21T21:33:15.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 msgr2=0x7fdea80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 0x7fdea80615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdeb0006d50 tx=0x7fdeb0012040).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 msgr2=0x7fdebc0a8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7fdeac001d00 tx=0x7fdeac001e70).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 shutdown_connections 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdea805f120 0x7fdea80615e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdebc0a8b00 0x7fdebc152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdea4004b80 0x7fdebc0aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.527+0000 7fdec283d700 1 --2- 172.21.15.133:0/2804375708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdebc0aa890 0x7fdebc0a8610 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.528+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 >> 172.21.15.133:0/2804375708 conn(0x7fdebc0c8010 msgr2=0x7fdebc066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.528+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 shutdown_connections 2024-01-21T21:33:15.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.528+0000 7fdec283d700 1 -- 172.21.15.133:0/2804375708 wait complete. 2024-01-21T21:33:15.542 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:33:15.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:15.594 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:15.644 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:33:15.645 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-01-21T21:33:15.645 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:15.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.759+0000 7f4557d6e700 1 Processor -- start 2024-01-21T21:33:15.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.759+0000 7f4557d6e700 1 -- start start 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4557d6e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 0x7f45500c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4557d6e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45500695b0 0x7f4550069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4557d6e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4550069ef0 con 0x7f455013ac10 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4557d6e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45500c3890 con 0x7f45500695b0 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4557d6e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c3b70 con 0x7f455013a830 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45500695b0 0x7f4550069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45500695b0 0x7f4550069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34014/0 (socket says 172.21.15.133:34014) 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 -- 172.21.15.133:0/1341120831 learned_addr learned my addr 172.21.15.133:0/1341120831 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 -- 172.21.15.133:0/1341120831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 msgr2=0x7f45500c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:15.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4555b0a700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 0x7f45500c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 0x7f45500c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 -- 172.21.15.133:0/1341120831 >> v1:172.21.15.178:6789/0 conn(0x7f455013ac10 legacy=0x7f45500bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 -- 172.21.15.133:0/1341120831 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500c3e50 con 0x7f45500695b0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4555b0a700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 0x7f45500c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f455630b700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45500695b0 0x7f4550069a00 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f4540006fd0 tx=0x7f45400090f0).ready entity=mon.0 client_cookie=fca31b907e45c53 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4554b08700 1 -- 172.21.15.133:0/1341120831 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454000b600 con 0x7f45500695b0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4554b08700 1 -- 172.21.15.133:0/1341120831 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454000b760 con 0x7f45500695b0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.760+0000 7f4554b08700 1 -- 172.21.15.133:0/1341120831 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454000bb00 con 0x7f45500695b0 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 -- 172.21.15.133:0/1341120831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45500695b0 msgr2=0x7f4550069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45500695b0 0x7f4550069a00 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f4540006fd0 tx=0x7f45400090f0).stop 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 -- 172.21.15.133:0/1341120831 shutdown_connections 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45500695b0 0x7f4550069a00 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 --2- 172.21.15.133:0/1341120831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013a830 0x7f45500c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 -- 172.21.15.133:0/1341120831 >> 172.21.15.133:0/1341120831 conn(0x7f45500c7dc0 msgr2=0x7f45500c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:15.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 -- 172.21.15.133:0/1341120831 shutdown_connections 2024-01-21T21:33:15.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.761+0000 7f4557d6e700 1 -- 172.21.15.133:0/1341120831 wait complete. 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.762+0000 7f4557d6e700 1 Processor -- start 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.762+0000 7f4557d6e700 1 -- start start 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500695b0 0x7f4550136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013ac10 0x7f4550150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500ad360 con 0x7f455013a830 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500aca10 con 0x7f45500695b0 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4557d6e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500ac730 con 0x7f455013ac10 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34028/0 (socket says 172.21.15.133:34028) 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 -- 172.21.15.133:0/3670138365 learned_addr learned my addr 172.21.15.133:0/3670138365 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f455630b700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013ac10 0x7f4550150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555b0a700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500695b0 0x7f4550136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 -- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013ac10 msgr2=0x7f4550150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013ac10 0x7f4550150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 -- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500695b0 msgr2=0x7f4550136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500695b0 0x7f4550136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 -- 172.21.15.133:0/3670138365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009370 con 0x7f455013a830 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f4555309700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f454400c490 tx=0x7f4544007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.763+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544007020 con 0x7f455013a830 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.764+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45440071a0 con 0x7f455013a830 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.764+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500acd10 con 0x7f455013a830 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.764+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544007560 con 0x7f455013a830 2024-01-21T21:33:15.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.764+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500adce0 con 0x7f455013a830 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.764+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45500be110 con 0x7f455013a830 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.765+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4544006ac0 con 0x7f455013a830 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.765+0000 7f454e7fc700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 0x7f453c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.765+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6497+0+0 (secure 0 0 0) 0x7f4544079f10 con 0x7f455013a830 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.765+0000 7f4555b0a700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 0x7f453c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:15.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.766+0000 7f4555b0a700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 0x7f453c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f454800d6e0 tx=0x7f4548007850).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:15.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.769+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f454404b060 con 0x7f455013a830 2024-01-21T21:33:15.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.975+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45500ad4a0 con 0x7f455013a830 2024-01-21T21:33:15.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.975+0000 7f454e7fc700 1 -- 172.21.15.133:0/3670138365 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f454404e680 con 0x7f455013a830 2024-01-21T21:33:15.978 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:15.978 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8554,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/579019243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":579019243},{"type":"v1","addr":"172.21.15.178:6834","nonce":579019243}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2346324318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2346324318},{"type":"v1","addr":"172.21.15.178:6835","nonce":2346324318}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9582,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1445617871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1445617871},{"type":"v1","addr":"172.21.15.133:6836","nonce":1445617871}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/2639141016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":2639141016},{"type":"v1","addr":"172.21.15.133:6837","nonce":2639141016}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[]} 2024-01-21T21:33:15.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 msgr2=0x7f453c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 0x7f453c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f454800d6e0 tx=0x7f4548007850).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 msgr2=0x7f45500ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 rx=0x7f454400c490 tx=0x7f4544007da0).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 shutdown_connections 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f455013ac10 0x7f4550150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f453c05f150 0x7f453c061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45500695b0 0x7f4550136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 --2- 172.21.15.133:0/3670138365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f455013a830 0x7f45500ad7f0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 >> 172.21.15.133:0/3670138365 conn(0x7f45500c7dc0 msgr2=0x7f4550137780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 shutdown_connections 2024-01-21T21:33:15.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:15.977+0000 7f4557d6e700 1 -- 172.21.15.133:0/3670138365 wait complete. 2024-01-21T21:33:15.981 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 70 2024-01-21T21:33:15.992 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-21T21:33:15.992 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-21T21:33:15.992 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T21:33:15.992 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:33:15.992 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-21T21:33:15.992 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-21T21:33:15.993 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T21:33:15.993 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:33:15.993 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-21T21:33:15.993 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-21T21:33:15.993 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T21:33:15.993 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:33:15.993 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-21T21:33:15.993 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-21T21:33:15.994 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T21:33:15.994 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:33:16.001 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T21:33:16.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-21T21:33:16.002 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T21:33:16.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-21T21:33:16.004 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T21:33:16.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-21T21:33:16.005 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T21:33:16.005 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-21T21:33:16.043 INFO:tasks.ceph.mds.a:Started 2024-01-21T21:33:16.044 DEBUG:teuthology.parallel:result is None 2024-01-21T21:33:16.044 INFO:tasks.ceph.mds.c:Started 2024-01-21T21:33:16.044 DEBUG:teuthology.parallel:result is None 2024-01-21T21:33:16.047 INFO:tasks.ceph.mds.b:Started 2024-01-21T21:33:16.047 DEBUG:teuthology.parallel:result is None 2024-01-21T21:33:16.048 INFO:tasks.ceph.mds.d:Started 2024-01-21T21:33:16.048 DEBUG:teuthology.parallel:result is None 2024-01-21T21:33:16.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-21T21:33:16.120 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2024-01-21T21:33:16.121 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2024-01-21T21:33:16.130 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-01-21T21:33:16.130 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T21:33:16.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.175+0000 7fef6d333700 1 Processor -- start 2024-01-21T21:33:16.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.175+0000 7fef6d333700 1 -- start start 2024-01-21T21:33:16.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef6d333700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6813a620 0x7fef680a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef6d333700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef68062e00 0x7fef68158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef6d333700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef681584f0 con 0x7fef6813aa00 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef6d333700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680bd6f0 con 0x7fef68062e00 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef6d333700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680654e0 con 0x7fef6813a620 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef68062e00 0x7fef68158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef68062e00 0x7fef68158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34072/0 (socket says 172.21.15.133:34072) 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 -- 172.21.15.133:0/2081271234 learned_addr learned my addr 172.21.15.133:0/2081271234 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef66ffd700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6813a620 0x7fef680a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 -- 172.21.15.133:0/2081271234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6813a620 msgr2=0x7fef680a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6813a620 0x7fef680a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 -- 172.21.15.133:0/2081271234 >> v1:172.21.15.178:6789/0 conn(0x7fef6813aa00 legacy=0x7fef680626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:16.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.176+0000 7fef677fe700 1 -- 172.21.15.133:0/2081271234 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68158730 con 0x7fef68062e00 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef677fe700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef68062e00 0x7fef68158000 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fef60009f20 tx=0x7fef60009840).ready entity=mon.0 client_cookie=a2a6054178b0bd76 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef65ffb700 1 -- 172.21.15.133:0/2081271234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000e070 con 0x7fef68062e00 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef65ffb700 1 -- 172.21.15.133:0/2081271234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6000b9d0 con 0x7fef68062e00 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef65ffb700 1 -- 172.21.15.133:0/2081271234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000bd50 con 0x7fef68062e00 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 -- 172.21.15.133:0/2081271234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef68062e00 msgr2=0x7fef68158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef68062e00 0x7fef68158000 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 rx=0x7fef60009f20 tx=0x7fef60009840).stop 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 -- 172.21.15.133:0/2081271234 shutdown_connections 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef68062e00 0x7fef68158000 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 --2- 172.21.15.133:0/2081271234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6813a620 0x7fef680a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 -- 172.21.15.133:0/2081271234 >> 172.21.15.133:0/2081271234 conn(0x7fef680c7dc0 msgr2=0x7fef680c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 -- 172.21.15.133:0/2081271234 shutdown_connections 2024-01-21T21:33:16.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.177+0000 7fef6d333700 1 -- 172.21.15.133:0/2081271234 wait complete. 2024-01-21T21:33:16.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 Processor -- start 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 -- start start 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef68062e00 0x7fef68165000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 0x7fef6813b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef68164be0 con 0x7fef6813a620 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef68139b00 con 0x7fef6813aa00 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef6d333700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef680ac920 con 0x7fef68062e00 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.179+0000 7fef667fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34074/0 (socket says 172.21.15.133:34074) 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 -- 172.21.15.133:0/2164114970 learned_addr learned my addr 172.21.15.133:0/2164114970 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef66ffd700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef68062e00 0x7fef68165000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef677fe700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 0x7fef6813b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 -- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef68062e00 msgr2=0x7fef68165000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef68062e00 0x7fef68165000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 -- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 msgr2=0x7fef6813b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 0x7fef6813b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 -- 172.21.15.133:0/2164114970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009ae0 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef677fe700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 0x7fef6813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef667fc700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fef5c00c440 tx=0x7fef5c007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00ce40 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c007020 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6813bd40 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c0073c0 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.180+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68164520 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.181+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fef5c0068b0 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.181+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef68164d20 con 0x7fef6813a620 2024-01-21T21:33:16.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.182+0000 7fef4f7fe700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 0x7fef54061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.182+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fef5c079b40 con 0x7fef6813a620 2024-01-21T21:33:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.182+0000 7fef66ffd700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 0x7fef54061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.182+0000 7fef66ffd700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 0x7fef54061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fef58009c30 tx=0x7fef58009060).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:16.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.186+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fef68164d20 con 0x7fef6813a620 2024-01-21T21:33:16.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:16.364+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fef681584f0 con 0x7fef6813a620 2024-01-21T21:33:17.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.211+0000 7fef4f7fe700 1 -- 172.21.15.133:0/2164114970 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v203) v1 ==== 97+0+0 (secure 0 0 0) 0x7fef681584f0 con 0x7fef6813a620 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 msgr2=0x7fef54061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 0x7fef54061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fef58009c30 tx=0x7fef58009060).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 msgr2=0x7fef680ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fef5c00c440 tx=0x7fef5c007dd0).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 shutdown_connections 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fef5405f150 0x7fef54061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6813aa00 0x7fef6813b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef68062e00 0x7fef68165000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 --2- 172.21.15.133:0/2164114970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef6813a620 0x7fef680ac430 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 >> 172.21.15.133:0/2164114970 conn(0x7fef680c7dc0 msgr2=0x7fef68065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 shutdown_connections 2024-01-21T21:33:17.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.214+0000 7fef6d333700 1 -- 172.21.15.133:0/2164114970 wait complete. 2024-01-21T21:33:17.218 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2024-01-21T21:33:17.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-21T21:33:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 Processor -- start 2024-01-21T21:33:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 -- start start 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d381558c0 0x7f9d380626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d380bd890 0x7f9d38062be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380a50f0 con 0x7f9d38155ca0 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380630d0 con 0x7f9d380bd890 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.351+0000 7f9d3ddef700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d380a4da0 con 0x7f9d381558c0 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d380bd890 0x7f9d38062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d36ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9d38155ca0 0x7f9d380bd180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52338/0 (socket says 172.21.15.133:52338) 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d36ffd700 1 -- 172.21.15.133:0/2274789103 learned_addr learned my addr 172.21.15.133:0/2274789103 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 -- 172.21.15.133:0/2274789103 >> v2:172.21.15.178:3300/0 conn(0x7f9d381558c0 msgr2=0x7f9d380626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 --2- 172.21.15.133:0/2274789103 >> v2:172.21.15.178:3300/0 conn(0x7f9d381558c0 0x7f9d380626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 -- 172.21.15.133:0/2274789103 >> v1:172.21.15.133:6789/0 conn(0x7f9d38155ca0 legacy=0x7f9d380bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 -- 172.21.15.133:0/2274789103 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380bde00 con 0x7f9d380bd890 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d367fc700 1 -- 172.21.15.133:0/2274789103 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028772705 0 0) 0x7f9d380a50f0 con 0x7f9d38155ca0 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d37fff700 1 --2- 172.21.15.133:0/2274789103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d380bd890 0x7f9d38062be0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f9d380692f0 tx=0x7f9d30009780).ready entity=mon.0 client_cookie=15f41313be5117f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d367fc700 1 -- 172.21.15.133:0/2274789103 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000e070 con 0x7f9d380bd890 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d367fc700 1 -- 172.21.15.133:0/2274789103 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000bc30 con 0x7f9d380bd890 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.352+0000 7f9d367fc700 1 -- 172.21.15.133:0/2274789103 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30012410 con 0x7f9d380bd890 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 -- 172.21.15.133:0/2274789103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d380bd890 msgr2=0x7f9d38062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/2274789103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d380bd890 0x7f9d38062be0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 rx=0x7f9d380692f0 tx=0x7f9d30009780).stop 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 -- 172.21.15.133:0/2274789103 shutdown_connections 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/2274789103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d380bd890 0x7f9d38062be0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/2274789103 >> v2:172.21.15.178:3300/0 conn(0x7f9d381558c0 0x7f9d380626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 -- 172.21.15.133:0/2274789103 >> 172.21.15.133:0/2274789103 conn(0x7f9d380c8010 msgr2=0x7f9d380c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 -- 172.21.15.133:0/2274789103 shutdown_connections 2024-01-21T21:33:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.353+0000 7f9d3ddef700 1 -- 172.21.15.133:0/2274789103 wait complete. 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.354+0000 7f9d3ddef700 1 Processor -- start 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.354+0000 7f9d3ddef700 1 -- start start 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 0x7f9d38140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d38155ca0 0x7f9d380ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c09f0 con 0x7f9d381558c0 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380ab540 con 0x7f9d380bd890 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c0430 con 0x7f9d38155ca0 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34092/0 (socket says 172.21.15.133:34092) 2024-01-21T21:33:17.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3311446435 learned_addr learned my addr 172.21.15.133:0/3311446435 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 0x7f9d38140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d37fff700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d38155ca0 0x7f9d380ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d38155ca0 msgr2=0x7f9d380ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d38155ca0 0x7f9d380ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 msgr2=0x7f9d38140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 0x7f9d38140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 -- 172.21.15.133:0/3311446435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d30009a20 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 0x7f9d38140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d36ffd700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f9d2c001eb0 tx=0x7f9d2c007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0072e0 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c007440 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380c0710 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.355+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0057a0 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.356+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d38141020 con 0x7f9d381558c0 2024-01-21T21:33:17.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.356+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380ab320 con 0x7f9d381558c0 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.357+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d2c005b90 con 0x7f9d381558c0 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.357+0000 7f9d1ffff700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 0x7f9d24061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.357+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f9d2c0798d0 con 0x7f9d381558c0 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.357+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 0x7f9d24061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.358+0000 7f9d377fe700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 0x7f9d24061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d28009990 tx=0x7f9d28008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.361+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d2c04ac30 con 0x7f9d381558c0 2024-01-21T21:33:17.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.587+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d380ab680 con 0x7f9d381558c0 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.587+0000 7f9d1ffff700 1 -- 172.21.15.133:0/3311446435 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v51) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f9d380ab680 con 0x7f9d381558c0 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lQefrHhAAyTjMNFaBISMQv+rAuhWfIw==", 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.590 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lxwrAKhAA0SSddAtnjWPFNZTrOxTD8g==", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lX04DJhAAZwb6loEOExNKoNICp6lQ2A==", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2024-01-21T21:33:17.592 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lAvO8MRAAJxvclMmeVoAinegaLVs1Ng==", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBdd61lVDvPERAAg5G1uJ6VXrE8t4K+ubiq1Q==", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.593 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBgd61lj59IEBAAtOZHiyIrm2SScawtwgWDmw==", 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.594 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBjd61ld3BxDhAABwZJloR4lDsGIibHBu7A3g==", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBmd61lsat0DBAA5pk1vyJOGlc9vaW0PJNGOg==", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.595 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBqd61lFafeFRAAegtsP5rJqYdRXVFi/Qr1sw==", 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBtd61lKCqyFRAAr93tg51ahL1K/eAJeQih3A==", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBwd61lJg9vExAAkXKcq7A8b6lkrrKaycgWZg==", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.597 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBzd61lNsYEERAATdt066AJrttp72fePBymoA==", 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.598 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61loLv7NRAAvDzskL171gX9IYsB0nZPjg==", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61l7MT4AhAAgyyDFPGiJdPX+7Qf8CKNng==", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:33:17.599 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.2", 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61l6Bh/OxAAZ5Z0z8A2o5a2X1AWaDclxA==", 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.3", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBad61lqYdxCBAAWU19RXX0R9zlKe3P+UXDiA==", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lMKT0AhAAGyk4ibnwjMRJu17Dg/vpPQ==", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2024-01-21T21:33:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61lamTTGxAAkiqaHGSZikbgn54mor3Y+w==", 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:17.602 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBZd61ldc1JGBAAiWxj4DLybxE0sA8zawSzVA==", 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2024-01-21T21:33:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 msgr2=0x7f9d24061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 0x7f9d24061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d28009990 tx=0x7f9d28008040).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 msgr2=0x7f9d380bfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f9d2c001eb0 tx=0x7f9d2c007e90).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 shutdown_connections 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d38155ca0 0x7f9d380ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2405f150 0x7f9d24061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d380bd890 0x7f9d38140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 --2- 172.21.15.133:0/3311446435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d381558c0 0x7f9d380bfac0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 >> 172.21.15.133:0/3311446435 conn(0x7f9d380c8010 msgr2=0x7f9d38152000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 shutdown_connections 2024-01-21T21:33:17.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.589+0000 7f9d3ddef700 1 -- 172.21.15.133:0/3311446435 wait complete. 2024-01-21T21:33:17.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.719+0000 7fd12b547700 1 Processor -- start 2024-01-21T21:33:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.720+0000 7fd12b547700 1 -- start start 2024-01-21T21:33:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.720+0000 7fd12b547700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd124062c10 0x7fd124062ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.720+0000 7fd12b547700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240634e0 con 0x7fd1240697e0 2024-01-21T21:33:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.720+0000 7fd12b547700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12406a130 con 0x7fd124065d70 2024-01-21T21:33:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.720+0000 7fd12b547700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12406a410 con 0x7fd124062c10 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd128ae2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd1240697e0 0x7fd124065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52350/0 (socket says 172.21.15.133:52350) 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd128ae2700 1 -- 172.21.15.133:0/346309286 learned_addr learned my addr 172.21.15.133:0/346309286 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> v2:172.21.15.178:3300/0 conn(0x7fd124062c10 0x7fd124062ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924789612 0 0) 0x7fd1240634e0 con 0x7fd1240697e0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1100033f0 con 0x7fd1240697e0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503164254 0 0) 0x7fd1100033f0 con 0x7fd1240697e0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 >> v2:172.21.15.178:3300/0 conn(0x7fd124062c10 msgr2=0x7fd124062ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 --2- 172.21.15.133:0/346309286 >> v2:172.21.15.178:3300/0 conn(0x7fd124062c10 0x7fd124062ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 >> v1:172.21.15.178:6789/0 conn(0x7fd124065d70 legacy=0x7fd1240bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12406a6f0 con 0x7fd1240697e0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fd120001470 con 0x7fd1240697e0 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> v2:172.21.15.178:3300/0 conn(0x7fd124062c10 0x7fd124062ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 >> v1:172.21.15.133:6789/0 conn(0x7fd1240697e0 legacy=0x7fd124065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 0x7fd110003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd110005050 0x7fd11000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12406a410 con 0x7fd1100038e0 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11000bfe0 con 0x7fd110004690 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11000c1a0 con 0x7fd110005050 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 0x7fd110003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd128ae2700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.721+0000 7fd129ae4700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd110005050 0x7fd11000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 -- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd110005050 msgr2=0x7fd11000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd110005050 0x7fd11000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 -- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd110004690 msgr2=0x7fd110004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:17.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd110004690 0x7fd110004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 -- 172.21.15.133:0/346309286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100033f0 con 0x7fd1100038e0 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd129ae4700 1 -- 172.21.15.133:0/346309286 reap_dead start 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd1292e3700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 0x7fd110003d00 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fd118006d80 tx=0x7fd118009060).ready entity=mon.0 client_cookie=b6f48c1f066726d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180095c0 con 0x7fd1100038e0 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800e710 con 0x7fd1100038e0 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd117fff700 1 -- 172.21.15.133:0/346309286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800ea90 con 0x7fd1100038e0 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 -- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 msgr2=0x7fd110003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 0x7fd110003d00 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7fd118006d80 tx=0x7fd118009060).stop 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 -- 172.21.15.133:0/346309286 shutdown_connections 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 --2- 172.21.15.133:0/346309286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1100038e0 0x7fd110003d00 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 -- 172.21.15.133:0/346309286 >> 172.21.15.133:0/346309286 conn(0x7fd1240c8010 msgr2=0x7fd1240c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 -- 172.21.15.133:0/346309286 shutdown_connections 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.722+0000 7fd12b547700 1 -- 172.21.15.133:0/346309286 wait complete. 2024-01-21T21:33:17.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 Processor -- start 2024-01-21T21:33:17.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 -- start start 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1100038e0 0x7fd12413c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd124158600 0x7fd1240a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12413cc80 con 0x7fd1240ac140 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240aa5e0 con 0x7fd124158600 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.724+0000 7fd12b547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240aaa70 con 0x7fd1100038e0 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34116/0 (socket says 172.21.15.133:34116) 2024-01-21T21:33:17.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 -- 172.21.15.133:0/1871653521 learned_addr learned my addr 172.21.15.133:0/1871653521 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd128ae2700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd124158600 0x7fd1240a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd1292e3700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1100038e0 0x7fd12413c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 -- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1100038e0 msgr2=0x7fd12413c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1100038e0 0x7fd12413c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 -- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd124158600 msgr2=0x7fd1240a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd124158600 0x7fd1240a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 -- 172.21.15.133:0/1871653521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240aca90 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd129ae4700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fd124067360 tx=0x7fd11c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c00eee0 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c003030 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1240a99d0 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0033b0 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.725+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1240a9f90 con 0x7fd1240ac140 2024-01-21T21:33:17.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.726+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1240aa770 con 0x7fd1240ac140 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.726+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd11c0019a0 con 0x7fd1240ac140 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.727+0000 7fd115ffb700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 0x7fd108061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.727+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fd11c079640 con 0x7fd1240ac140 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.727+0000 7fd1292e3700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 0x7fd108061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.727+0000 7fd1292e3700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 0x7fd108061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd1240acfa0 tx=0x7fd11801a000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:17.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.731+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd11c04a9a0 con 0x7fd1240ac140 2024-01-21T21:33:17.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.894+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1240bcf70 con 0x7fd1240ac140 2024-01-21T21:33:17.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.895+0000 7fd115ffb700 1 -- 172.21.15.133:0/1871653521 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+14862 (secure 0 0 0) 0x7fd11c01a070 con 0x7fd1240ac140 2024-01-21T21:33:17.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:17.898 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":203,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:17.206056+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 msgr2=0x7fd108061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 0x7fd108061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fd1240acfa0 tx=0x7fd11801a000).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 msgr2=0x7fd1240ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 rx=0x7fd124067360 tx=0x7fd11c009040).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 shutdown_connections 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1240ac140 0x7fd1240ac5a0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1100038e0 0x7fd12413c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd10805f150 0x7fd108061610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 --2- 172.21.15.133:0/1871653521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd124158600 0x7fd1240a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 >> 172.21.15.133:0/1871653521 conn(0x7fd1240c8010 msgr2=0x7fd1240ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 shutdown_connections 2024-01-21T21:33:17.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:17.897+0000 7fd12b547700 1 -- 172.21.15.133:0/1871653521 wait complete. 2024-01-21T21:33:17.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '198', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-01-21T21:33:17.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:33:18.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.027+0000 7f4f202c9700 1 Processor -- start 2024-01-21T21:33:18.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.027+0000 7f4f202c9700 1 -- start start 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.028+0000 7f4f202c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f181558c0 0x7f4f180626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.028+0000 7f4f202c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180a50f0 con 0x7f4f180bd890 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.028+0000 7f4f202c9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180a4da0 con 0x7f4f18155ca0 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.028+0000 7f4f202c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180bde00 con 0x7f4f181558c0 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e065700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f181558c0 0x7f4f180626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e866700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4f180bd890 0x7f4f180a5580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52354/0 (socket says 172.21.15.133:52354) 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e866700 1 -- 172.21.15.133:0/1974322192 learned_addr learned my addr 172.21.15.133:0/1974322192 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e065700 1 -- 172.21.15.133:0/1974322192 >> v1:172.21.15.178:6789/0 conn(0x7f4f18155ca0 legacy=0x7f4f180bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e065700 1 -- 172.21.15.133:0/1974322192 >> v1:172.21.15.133:6789/0 conn(0x7f4f180bd890 legacy=0x7f4f180a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e065700 1 -- 172.21.15.133:0/1974322192 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180be0e0 con 0x7f4f181558c0 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1d063700 1 -- 172.21.15.133:0/1974322192 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442470695 0 0) 0x7f4f180a50f0 con 0x7f4f180bd890 2024-01-21T21:33:18.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1e065700 1 --2- 172.21.15.133:0/1974322192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181558c0 0x7f4f180626f0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f4f08009760 tx=0x7f4f08009060).ready entity=mon.0 client_cookie=4e1a9531ae08cb85 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1d063700 1 -- 172.21.15.133:0/1974322192 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800b580 con 0x7f4f181558c0 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1d063700 1 -- 172.21.15.133:0/1974322192 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800b6e0 con 0x7f4f181558c0 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.029+0000 7f4f1d063700 1 -- 172.21.15.133:0/1974322192 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800ba60 con 0x7f4f181558c0 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 -- 172.21.15.133:0/1974322192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181558c0 msgr2=0x7f4f180626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 --2- 172.21.15.133:0/1974322192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181558c0 0x7f4f180626f0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f4f08009760 tx=0x7f4f08009060).stop 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 -- 172.21.15.133:0/1974322192 shutdown_connections 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 --2- 172.21.15.133:0/1974322192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f181558c0 0x7f4f180626f0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 -- 172.21.15.133:0/1974322192 >> 172.21.15.133:0/1974322192 conn(0x7f4f180c8010 msgr2=0x7f4f180c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 -- 172.21.15.133:0/1974322192 shutdown_connections 2024-01-21T21:33:18.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.030+0000 7f4f202c9700 1 -- 172.21.15.133:0/1974322192 wait complete. 2024-01-21T21:33:18.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.031+0000 7f4f202c9700 1 Processor -- start 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.031+0000 7f4f202c9700 1 -- start start 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f180bd890 0x7f4f180c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 0x7f4f180aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c09c0 con 0x7f4f18155ca0 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18151660 con 0x7f4f181558c0 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f202c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18065de0 con 0x7f4f180bd890 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34126/0 (socket says 172.21.15.133:34126) 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 -- 172.21.15.133:0/285483753 learned_addr learned my addr 172.21.15.133:0/285483753 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e065700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f180bd890 0x7f4f180c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1d864700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 0x7f4f180aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 -- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f180bd890 msgr2=0x7f4f180c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f180bd890 0x7f4f180c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 -- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 msgr2=0x7f4f180aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 0x7f4f180aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 -- 172.21.15.133:0/285483753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080092a0 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1d864700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 0x7f4f180aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f1e866700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f4f1000c760 tx=0x7f4f10001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.032+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10005d30 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.033+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10005e90 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.033+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f18151380 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.033+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10007360 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.033+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18065a70 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.033+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1805fdf0 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.034+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4f10007710 con 0x7f4f18155ca0 2024-01-21T21:33:18.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.034+0000 7f4f0ef78700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 0x7f4efc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.034+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f4f1007a060 con 0x7f4f18155ca0 2024-01-21T21:33:18.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.034+0000 7f4f1e065700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 0x7f4efc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.035+0000 7f4f1e065700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 0x7f4efc061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4f08009630 tx=0x7f4f08017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.038+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4f1004b3c0 con 0x7f4f18155ca0 2024-01-21T21:33:18.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.204+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f18065210 con 0x7f4f18155ca0 2024-01-21T21:33:18.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.204+0000 7f4f0ef78700 1 -- 172.21.15.133:0/285483753 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v203) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4f1004e9e0 con 0x7f4f18155ca0 2024-01-21T21:33:18.207 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 msgr2=0x7f4efc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 0x7f4efc061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4f08009630 tx=0x7f4f08017000).stop 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 msgr2=0x7f4f1814ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 rx=0x7f4f1000c760 tx=0x7f4f10001520).stop 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 shutdown_connections 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f18155ca0 0x7f4f1814ee00 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f180bd890 0x7f4f180c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4efc05f150 0x7f4efc061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 --2- 172.21.15.133:0/285483753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f181558c0 0x7f4f180aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 >> 172.21.15.133:0/285483753 conn(0x7f4f180c8010 msgr2=0x7f4f180626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 shutdown_connections 2024-01-21T21:33:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.206+0000 7f4f202c9700 1 -- 172.21.15.133:0/285483753 wait complete. 2024-01-21T21:33:18.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:33:18.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.337+0000 7f63c6686700 1 Processor -- start 2024-01-21T21:33:18.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.337+0000 7f63c6686700 1 -- start start 2024-01-21T21:33:18.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c6686700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 0x7f63c005e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c6686700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c00c4cc0 0x7f63c00ab820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c6686700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c0063030 con 0x7f63c00a9810 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c6686700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c00c5130 con 0x7f63c00c4cc0 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c6686700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c0062d00 con 0x7f63c00c48e0 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c00c4cc0 0x7f63c00ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63c00c4cc0 0x7f63c00ab820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34128/0 (socket says 172.21.15.133:34128) 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 -- 172.21.15.133:0/1068797871 learned_addr learned my addr 172.21.15.133:0/1068797871 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63bf7fe700 1 --1- 172.21.15.133:0/1068797871 >> v1:172.21.15.133:6789/0 conn(0x7f63c00a9810 0x7f63c00634c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52356/0 (socket says 172.21.15.133:52356) 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 -- 172.21.15.133:0/1068797871 >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 msgr2=0x7f63c005e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63bffff700 1 --2- 172.21.15.133:0/1068797871 >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 0x7f63c005e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 --2- 172.21.15.133:0/1068797871 >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 0x7f63c005e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63beffd700 1 -- 172.21.15.133:0/1068797871 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699822172 0 0) 0x7f63c0063030 con 0x7f63c00a9810 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.338+0000 7f63c4c23700 1 -- 172.21.15.133:0/1068797871 >> v1:172.21.15.133:6789/0 conn(0x7f63c00a9810 legacy=0x7f63c00634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c4c23700 1 -- 172.21.15.133:0/1068797871 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0067000 con 0x7f63c00c4cc0 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63bffff700 1 --2- 172.21.15.133:0/1068797871 >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 0x7f63c005e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:18.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c4c23700 1 --2- 172.21.15.133:0/1068797871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4cc0 0x7f63c00ab820 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f63c0068c10 tx=0x7f63b8009840).ready entity=mon.0 client_cookie=6848691c32b9694e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63beffd700 1 -- 172.21.15.133:0/1068797871 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800e070 con 0x7f63c00c4cc0 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63beffd700 1 -- 172.21.15.133:0/1068797871 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b800ba50 con 0x7f63c00c4cc0 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63beffd700 1 -- 172.21.15.133:0/1068797871 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b800bdd0 con 0x7f63c00c4cc0 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 -- 172.21.15.133:0/1068797871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4cc0 msgr2=0x7f63c00ab820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 --2- 172.21.15.133:0/1068797871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4cc0 0x7f63c00ab820 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7f63c0068c10 tx=0x7f63b8009840).stop 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 -- 172.21.15.133:0/1068797871 shutdown_connections 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 --2- 172.21.15.133:0/1068797871 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00c4cc0 0x7f63c00ab820 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 --2- 172.21.15.133:0/1068797871 >> v2:172.21.15.178:3300/0 conn(0x7f63c00c48e0 0x7f63c005e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 -- 172.21.15.133:0/1068797871 >> 172.21.15.133:0/1068797871 conn(0x7f63c0065920 msgr2=0x7f63c00c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 -- 172.21.15.133:0/1068797871 shutdown_connections 2024-01-21T21:33:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.339+0000 7f63c6686700 1 -- 172.21.15.133:0/1068797871 wait complete. 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.341+0000 7f63c6686700 1 Processor -- start 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.341+0000 7f63c6686700 1 -- start start 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.341+0000 7f63c6686700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.341+0000 7f63c6686700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c00c48e0 0x7f63c0154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.341+0000 7f63c6686700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c00c4cc0 0x7f63c00a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c6686700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0154b50 con 0x7f63c00a9810 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c6686700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c014d810 con 0x7f63c00c4cc0 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c6686700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0154930 con 0x7f63c00c48e0 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34130/0 (socket says 172.21.15.133:34130) 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 -- 172.21.15.133:0/794111870 learned_addr learned my addr 172.21.15.133:0/794111870 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bf7fe700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c00c48e0 0x7f63c0154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c4c23700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c00c4cc0 0x7f63c00a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 -- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c00c48e0 msgr2=0x7f63c0154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c00c48e0 0x7f63c0154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 -- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c00c4cc0 msgr2=0x7f63c00a7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c00c4cc0 0x7f63c00a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 -- 172.21.15.133:0/794111870 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b8009ae0 con 0x7f63c00a9810 2024-01-21T21:33:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bffff700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f63b400c880 tx=0x7f63b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4010580 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b40106e0 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4010a60 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c00a48d0 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.342+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c00a8800 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.343+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c005fdf0 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.343+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f63b401b460 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.344+0000 7f63bcff9700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 0x7f63ac061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.344+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f63b407a1d0 con 0x7f63c00a9810 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.344+0000 7f63bf7fe700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 0x7f63ac061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.344+0000 7f63bf7fe700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 0x7f63ac061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f63c0156da0 tx=0x7f63b0009040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.348+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f63b404b4d0 con 0x7f63c00a9810 2024-01-21T21:33:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.512+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63c00a9f70 con 0x7f63c00a9810 2024-01-21T21:33:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.513+0000 7f63bcff9700 1 -- 172.21.15.133:0/794111870 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63b404eaf0 con 0x7f63c00a9810 2024-01-21T21:33:18.516 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 msgr2=0x7f63ac061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 0x7f63ac061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f63c0156da0 tx=0x7f63b0009040).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 msgr2=0x7f63c014cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 rx=0x7f63b400c880 tx=0x7f63b4008040).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 shutdown_connections 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f63ac05f150 0x7f63ac061610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63c00c4cc0 0x7f63c00a7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63c00a9810 0x7f63c014cf50 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 --2- 172.21.15.133:0/794111870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63c00c48e0 0x7f63c0154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 >> 172.21.15.133:0/794111870 conn(0x7f63c0065920 msgr2=0x7f63c00c65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 shutdown_connections 2024-01-21T21:33:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.515+0000 7f63c6686700 1 -- 172.21.15.133:0/794111870 wait complete. 2024-01-21T21:33:18.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-21T21:33:18.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 Processor -- start 2024-01-21T21:33:18.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 -- start start 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbea813b970 0x7fbea80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 0x7fbea80be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea80bfa40 con 0x7fbea80be5f0 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea80c3e70 con 0x7fbea813b970 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.643+0000 7fbeae9f3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea80bee30 con 0x7fbea80c39f0 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbea813b970 0x7fbea80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbea813b970 0x7fbea80c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34138/0 (socket says 172.21.15.133:34138) 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 -- 172.21.15.133:0/646750346 learned_addr learned my addr 172.21.15.133:0/646750346 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea77fe700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 0x7fbea80be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 -- 172.21.15.133:0/646750346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 msgr2=0x7fbea80be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 0x7fbea80be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 -- 172.21.15.133:0/646750346 >> v1:172.21.15.178:6789/0 conn(0x7fbea80be5f0 legacy=0x7fbea80c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 -- 172.21.15.133:0/646750346 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80bf110 con 0x7fbea813b970 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea77fe700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 0x7fbea80be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea7fff700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea813b970 0x7fbea80c3500 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fbe98006fd0 tx=0x7fbe980090f0).ready entity=mon.0 client_cookie=3f878cd6ba417f9d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea6ffd700 1 -- 172.21.15.133:0/646750346 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800b600 con 0x7fbea813b970 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea6ffd700 1 -- 172.21.15.133:0/646750346 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800b760 con 0x7fbea813b970 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.644+0000 7fbea6ffd700 1 -- 172.21.15.133:0/646750346 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800bb00 con 0x7fbea813b970 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 -- 172.21.15.133:0/646750346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea813b970 msgr2=0x7fbea80c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea813b970 0x7fbea80c3500 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7fbe98006fd0 tx=0x7fbe980090f0).stop 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 -- 172.21.15.133:0/646750346 shutdown_connections 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea813b970 0x7fbea80c3500 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/646750346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80c39f0 0x7fbea80be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 -- 172.21.15.133:0/646750346 >> 172.21.15.133:0/646750346 conn(0x7fbea8066a70 msgr2=0x7fbea8066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 -- 172.21.15.133:0/646750346 shutdown_connections 2024-01-21T21:33:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.645+0000 7fbeae9f3700 1 -- 172.21.15.133:0/646750346 wait complete. 2024-01-21T21:33:18.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.646+0000 7fbeae9f3700 1 Processor -- start 2024-01-21T21:33:18.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.646+0000 7fbeae9f3700 1 -- start start 2024-01-21T21:33:18.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 0x7fbea8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 0x7fbea8151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8152f40 con 0x7fbea80c39f0 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8158460 con 0x7fbea813b970 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeae9f3700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea8152280 con 0x7fbea80be5f0 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34148/0 (socket says 172.21.15.133:34148) 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 -- 172.21.15.133:0/27973117 learned_addr learned my addr 172.21.15.133:0/27973117 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea7fff700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 0x7fbea8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeacf90700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 0x7fbea8151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 -- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 msgr2=0x7fbea8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 0x7fbea8152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 -- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 msgr2=0x7fbea8151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 0x7fbea8151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 -- 172.21.15.133:0/27973117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009370 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbeacf90700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 0x7fbea8151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea7fff700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 0x7fbea8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.647+0000 7fbea77fe700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7fbe9c00c880 tx=0x7fbe9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.648+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c010580 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.648+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c0106e0 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.648+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea8153130 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.648+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c010a80 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.648+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea81536f0 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.649+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea805fdf0 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.649+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbe9c01b460 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.649+0000 7fbea4ff9700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 0x7fbe94061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.650+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fbe9c07a0d0 con 0x7fbea80c39f0 2024-01-21T21:33:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.650+0000 7fbea7fff700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 0x7fbe94061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.650+0000 7fbea7fff700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 0x7fbe94061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbe9800b3c0 tx=0x7fbe98017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.654+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbe9c04b430 con 0x7fbea80c39f0 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.822+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbea806bd20 con 0x7fbea80c39f0 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.822+0000 7fbea4ff9700 1 -- 172.21.15.133:0/27973117 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v203) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbe9c04ea50 con 0x7fbea80c39f0 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2024-01-21T21:33:18.825 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:18.826 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 msgr2=0x7fbe94061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 0x7fbe94061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fbe9800b3c0 tx=0x7fbe98017000).stop 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 msgr2=0x7fbea8157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 rx=0x7fbe9c00c880 tx=0x7fbe9c008040).stop 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 shutdown_connections 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbe9405f150 0x7fbe94061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbea813b970 0x7fbea8151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbea80be5f0 0x7fbea8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 --2- 172.21.15.133:0/27973117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbea80c39f0 0x7fbea8157f70 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 >> 172.21.15.133:0/27973117 conn(0x7fbea8066a70 msgr2=0x7fbea8068240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 shutdown_connections 2024-01-21T21:33:18.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.824+0000 7fbeae9f3700 1 -- 172.21.15.133:0/27973117 wait complete. 2024-01-21T21:33:18.839 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-21T21:33:18.839 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2024-01-21T21:33:18.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.957+0000 7fc7166e4700 1 Processor -- start 2024-01-21T21:33:18.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.957+0000 7fc7166e4700 1 -- start start 2024-01-21T21:33:18.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc7166e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc710151fe0 0x7fc7100c3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc7166e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 0x7fc7100c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc7166e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc710067d70 con 0x7fc7101523c0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc7166e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc710156db0 con 0x7fc710151fe0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc7166e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100c3f20 con 0x7fc7100ab6e0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc710151fe0 0x7fc7100c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc710151fe0 0x7fc7100c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34154/0 (socket says 172.21.15.133:34154) 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 -- 172.21.15.133:0/413401250 learned_addr learned my addr 172.21.15.133:0/413401250 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 -- 172.21.15.133:0/413401250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 msgr2=0x7fc7100c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc714c81700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 0x7fc7100c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 0x7fc7100c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 -- 172.21.15.133:0/413401250 >> v1:172.21.15.178:6789/0 conn(0x7fc7101523c0 legacy=0x7fc7100aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 -- 172.21.15.133:0/413401250 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100688f0 con 0x7fc710151fe0 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc714c81700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 0x7fc7100c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:18.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.958+0000 7fc70ffff700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc7100c3540 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7fc704006fd0 tx=0x7fc7040090f0).ready entity=mon.0 client_cookie=13046fdec487c89f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc70effd700 1 -- 172.21.15.133:0/413401250 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70400b600 con 0x7fc710151fe0 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc70effd700 1 -- 172.21.15.133:0/413401250 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70400b760 con 0x7fc710151fe0 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc70effd700 1 -- 172.21.15.133:0/413401250 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70400bb00 con 0x7fc710151fe0 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 -- 172.21.15.133:0/413401250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 msgr2=0x7fc7100c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc7100c3540 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7fc704006fd0 tx=0x7fc7040090f0).stop 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 -- 172.21.15.133:0/413401250 shutdown_connections 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc7100c3540 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 --2- 172.21.15.133:0/413401250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7100ab6e0 0x7fc7100c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 -- 172.21.15.133:0/413401250 >> 172.21.15.133:0/413401250 conn(0x7fc710066a70 msgr2=0x7fc710066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 -- 172.21.15.133:0/413401250 shutdown_connections 2024-01-21T21:33:18.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.959+0000 7fc7166e4700 1 -- 172.21.15.133:0/413401250 wait complete. 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.961+0000 7fc7166e4700 1 Processor -- start 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.961+0000 7fc7166e4700 1 -- start start 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 0x7fc7100c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7101523c0 0x7fc7100ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100c3370 con 0x7fc710151fe0 2024-01-21T21:33:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100c1110 con 0x7fc7100ab6e0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc7166e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc710154680 con 0x7fc7101523c0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34158/0 (socket says 172.21.15.133:34158) 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 -- 172.21.15.133:0/2102952214 learned_addr learned my addr 172.21.15.133:0/2102952214 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc714c81700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7101523c0 0x7fc7100ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70ffff700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 0x7fc7100c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 -- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7101523c0 msgr2=0x7fc7100ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7101523c0 0x7fc7100ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 -- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 msgr2=0x7fc7100c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 0x7fc7100c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 -- 172.21.15.133:0/2102952214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704009370 con 0x7fc710151fe0 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70ffff700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 0x7fc7100c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.962+0000 7fc70f7fe700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7fc70000b490 tx=0x7fc700006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.963+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000be90 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.963+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700012410 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.963+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000127b0 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.963+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7100c0eb0 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.963+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc710154030 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.964+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71005fdf0 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.964+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc700012be0 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.964+0000 7fc70cff9700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 0x7fc6fc061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.964+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fc700079e60 con 0x7fc710151fe0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.964+0000 7fc70ffff700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 0x7fc6fc061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:18.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.965+0000 7fc70ffff700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 0x7fc6fc061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc70400b3c0 tx=0x7fc704017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:18.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:18.968+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc70004b1c0 con 0x7fc710151fe0 2024-01-21T21:33:19.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.134+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fc7101547c0 con 0x7fc710151fe0 2024-01-21T21:33:19.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.220+0000 7fc70cff9700 1 -- 172.21.15.133:0/2102952214 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v204) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc70004e7e0 con 0x7fc710151fe0 2024-01-21T21:33:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.224+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 msgr2=0x7fc6fc061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.224+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 0x7fc6fc061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc70400b3c0 tx=0x7fc704017000).stop 2024-01-21T21:33:19.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.224+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 msgr2=0x7fc71014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:19.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.224+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7fc70000b490 tx=0x7fc700006ef0).stop 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 shutdown_connections 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7101523c0 0x7fc7100ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc6fc05f150 0x7fc6fc061610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7100ab6e0 0x7fc7100c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 --2- 172.21.15.133:0/2102952214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc710151fe0 0x7fc71014fba0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 >> 172.21.15.133:0/2102952214 conn(0x7fc710066a70 msgr2=0x7fc7100c6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 shutdown_connections 2024-01-21T21:33:19.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.226+0000 7fc7166e4700 1 -- 172.21.15.133:0/2102952214 wait complete. 2024-01-21T21:33:19.230 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2024-01-21T21:33:19.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-21T21:33:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 Processor -- start 2024-01-21T21:33:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 -- start start 2024-01-21T21:33:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07f00beb30 0x7f07f0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f07f00c3fb0 0x7f07f00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f0065660 con 0x7f07f0069cd0 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f00bef10 con 0x7f07f00beb30 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.363+0000 7f07f5aae700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f0156070 con 0x7f07f00c3fb0 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07f00beb30 0x7f07f0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f07f00beb30 0x7f07f0155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34166/0 (socket says 172.21.15.133:34166) 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 -- 172.21.15.133:0/2638930325 learned_addr learned my addr 172.21.15.133:0/2638930325 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07eeffd700 1 --2- 172.21.15.133:0/2638930325 >> v2:172.21.15.178:3300/0 conn(0x7f07f00c3fb0 0x7f07f00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 -- 172.21.15.133:0/2638930325 >> v2:172.21.15.178:3300/0 conn(0x7f07f00c3fb0 msgr2=0x7f07f00697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 --2- 172.21.15.133:0/2638930325 >> v2:172.21.15.178:3300/0 conn(0x7f07f00c3fb0 0x7f07f00697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 -- 172.21.15.133:0/2638930325 >> v1:172.21.15.178:6789/0 conn(0x7f07f0069cd0 legacy=0x7f07f0151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 -- 172.21.15.133:0/2638930325 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0065f00 con 0x7f07f00beb30 2024-01-21T21:33:19.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ef7fe700 1 --2- 172.21.15.133:0/2638930325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f0155b80 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f07f005ecd0 tx=0x7f07e000ba50).ready entity=mon.0 client_cookie=dfebeec175637e9c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ee7fc700 1 -- 172.21.15.133:0/2638930325 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0010070 con 0x7f07f00beb30 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ee7fc700 1 -- 172.21.15.133:0/2638930325 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e000de40 con 0x7f07f00beb30 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.364+0000 7f07ee7fc700 1 -- 172.21.15.133:0/2638930325 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e000b2e0 con 0x7f07f00beb30 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 -- 172.21.15.133:0/2638930325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 msgr2=0x7f07f0155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 --2- 172.21.15.133:0/2638930325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f0155b80 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7f07f005ecd0 tx=0x7f07e000ba50).stop 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 -- 172.21.15.133:0/2638930325 shutdown_connections 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 --2- 172.21.15.133:0/2638930325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f0155b80 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 --2- 172.21.15.133:0/2638930325 >> v2:172.21.15.178:3300/0 conn(0x7f07f00c3fb0 0x7f07f00697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 -- 172.21.15.133:0/2638930325 >> 172.21.15.133:0/2638930325 conn(0x7f07f00c8010 msgr2=0x7f07f00c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 -- 172.21.15.133:0/2638930325 shutdown_connections 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.365+0000 7f07f5aae700 1 -- 172.21.15.133:0/2638930325 wait complete. 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.366+0000 7f07f5aae700 1 Processor -- start 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.366+0000 7f07f5aae700 1 -- start start 2024-01-21T21:33:19.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07f0069cd0 0x7f07f01538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 0x7f07f00a6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0138730 con 0x7f07f00beb30 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00bf0b0 con 0x7f07f00c3fb0 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07f5aae700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00ade20 con 0x7f07f0069cd0 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34178/0 (socket says 172.21.15.133:34178) 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 -- 172.21.15.133:0/392198157 learned_addr learned my addr 172.21.15.133:0/392198157 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:19.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07ef7fe700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07f0069cd0 0x7f07f01538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07effff700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 0x7f07f00a6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 -- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07f0069cd0 msgr2=0x7f07f01538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07f0069cd0 0x7f07f01538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 -- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 msgr2=0x7f07f00a6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 0x7f07f00a6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 -- 172.21.15.133:0/392198157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e000bcf0 con 0x7f07f00beb30 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07effff700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 0x7f07f00a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.367+0000 7f07eeffd700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f07d800d890 tx=0x7f07d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.368+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80125f0 con 0x7f07f00beb30 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.368+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8012750 con 0x7f07f00beb30 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.368+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f00a7260 con 0x7f07f00beb30 2024-01-21T21:33:19.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.368+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8012ad0 con 0x7f07f00beb30 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.368+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f0154180 con 0x7f07f00beb30 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.369+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f00bf240 con 0x7f07f00beb30 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.369+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f07d8013480 con 0x7f07f00beb30 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.369+0000 7f07e7fff700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 0x7f07d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.370+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6351+0+0 (secure 0 0 0) 0x7f07d807a050 con 0x7f07f00beb30 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.370+0000 7f07ef7fe700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 0x7f07d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.370+0000 7f07ef7fe700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 0x7f07d0061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f07e000dc00 tx=0x7f07e000ba50).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:19.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.374+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f07d804b1e0 con 0x7f07f00beb30 2024-01-21T21:33:19.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:19.538+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07f005fdf0 con 0x7f07f00beb30 2024-01-21T21:33:20.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.222+0000 7f07e7fff700 1 -- 172.21.15.133:0/392198157 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v205) v1 ==== 170+0+0 (secure 0 0 0) 0x7f07d804e800 con 0x7f07f00beb30 2024-01-21T21:33:20.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 msgr2=0x7f07d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 0x7f07d0061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f07e000dc00 tx=0x7f07e000ba50).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 msgr2=0x7f07f00ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7f07d800d890 tx=0x7f07d8008040).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 shutdown_connections 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f07d005f150 0x7f07d0061610 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0x7f07e000dc00 tx=0x7f07e000ba50).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f07f00c3fb0 0x7f07f00a6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07f0069cd0 0x7f07f01538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 --2- 172.21.15.133:0/392198157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07f00beb30 0x7f07f00ad930 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.227+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 >> 172.21.15.133:0/392198157 conn(0x7f07f00c8010 msgr2=0x7f07f013a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:20.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.228+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 shutdown_connections 2024-01-21T21:33:20.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.232+0000 7f07f5aae700 1 -- 172.21.15.133:0/392198157 wait complete. 2024-01-21T21:33:20.236 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2024-01-21T21:33:20.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-21T21:33:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.378+0000 7f2f6e74c700 1 Processor -- start 2024-01-21T21:33:20.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.378+0000 7f2f6e74c700 1 -- start start 2024-01-21T21:33:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6e74c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f680beb30 0x7f2f68155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6e74c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 0x7f2f68066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6e74c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f68065660 con 0x7f2f680c3fb0 2024-01-21T21:33:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6e74c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680bef10 con 0x7f2f680beb30 2024-01-21T21:33:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6e74c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68156070 con 0x7f2f68069ef0 2024-01-21T21:33:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6cce9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 0x7f2f68066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f680beb30 0x7f2f68155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6cce9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 0x7f2f68066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:51282/0 (socket says 172.21.15.133:51282) 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f680beb30 0x7f2f68155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40392/0 (socket says 172.21.15.133:40392) 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f6cce9700 1 -- 172.21.15.133:0/2373448878 learned_addr learned my addr 172.21.15.133:0/2373448878 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 -- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 msgr2=0x7f2f68066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 --2- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 0x7f2f68066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 -- 172.21.15.133:0/2373448878 >> v1:172.21.15.178:6789/0 conn(0x7f2f680c3fb0 legacy=0x7f2f680697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f67fff700 1 -- 172.21.15.133:0/2373448878 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68065f00 con 0x7f2f680beb30 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.379+0000 7f2f66ffd700 1 -- 172.21.15.133:0/2373448878 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162139661 0 0) 0x7f2f68065660 con 0x7f2f680c3fb0 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f67fff700 1 --2- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680beb30 0x7f2f68155b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2f50009760 tx=0x7f2f50009060).ready entity=mon.1 client_cookie=36e04bc2239ae7aa server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f66ffd700 1 -- 172.21.15.133:0/2373448878 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500090d0 con 0x7f2f680beb30 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f66ffd700 1 -- 172.21.15.133:0/2373448878 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000f510 con 0x7f2f680beb30 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f66ffd700 1 -- 172.21.15.133:0/2373448878 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000f890 con 0x7f2f680beb30 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 -- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680beb30 msgr2=0x7f2f68155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680beb30 0x7f2f68155b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2f50009760 tx=0x7f2f50009060).stop 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 -- 172.21.15.133:0/2373448878 shutdown_connections 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680beb30 0x7f2f68155b80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/2373448878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f68069ef0 0x7f2f68066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 -- 172.21.15.133:0/2373448878 >> 172.21.15.133:0/2373448878 conn(0x7f2f680c8010 msgr2=0x7f2f680c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 -- 172.21.15.133:0/2373448878 shutdown_connections 2024-01-21T21:33:20.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.380+0000 7f2f6e74c700 1 -- 172.21.15.133:0/2373448878 wait complete. 2024-01-21T21:33:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.381+0000 7f2f6e74c700 1 Processor -- start 2024-01-21T21:33:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 -- start start 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f680beb30 0x7f2f68150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680c3fb0 0x7f2f680c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680c07b0 con 0x7f2f68069ef0 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680a8310 con 0x7f2f680c3fb0 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.382+0000 7f2f6e74c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680a85f0 con 0x7f2f680beb30 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35392/0 (socket says 172.21.15.133:35392) 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 -- 172.21.15.133:0/1376533114 learned_addr learned my addr 172.21.15.133:0/1376533114 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f6cce9700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680c3fb0 0x7f2f680c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f677fe700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f680beb30 0x7f2f68150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 -- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f680beb30 msgr2=0x7f2f68150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f680beb30 0x7f2f68150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 -- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680c3fb0 msgr2=0x7f2f680c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680c3fb0 0x7f2f680c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 -- 172.21.15.133:0/1376533114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f500092a0 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f67fff700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f2f50009e00 tx=0x7f2f50017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000f890 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5000fc50 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f680c0160 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5001b410 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.383+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680a6db0 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.384+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f680c0a90 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.385+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2f5001b7c0 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.385+0000 7f2f64ff9700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 0x7f2f48061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.385+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6733+0+0 (secure 0 0 0) 0x7f2f5007bcc0 con 0x7f2f68069ef0 2024-01-21T21:33:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.385+0000 7f2f677fe700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 0x7f2f48061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.385+0000 7f2f677fe700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 0x7f2f48061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2f58007fd0 tx=0x7f2f58007bb0).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.389+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2f5004ccd0 con 0x7f2f68069ef0 2024-01-21T21:33:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.596+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2f6805fdf0 con 0x7f2f68069ef0 2024-01-21T21:33:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.601+0000 7f2f64ff9700 1 -- 172.21.15.133:0/1376533114 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2f500502f0 con 0x7f2f68069ef0 2024-01-21T21:33:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.605+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 msgr2=0x7f2f48061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.605+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 0x7f2f48061640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f2f58007fd0 tx=0x7f2f58007bb0).stop 2024-01-21T21:33:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.605+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 msgr2=0x7f2f680a7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.605+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 rx=0x7f2f50009e00 tx=0x7f2f50017000).stop 2024-01-21T21:33:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 shutdown_connections 2024-01-21T21:33:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2f4805f180 0x7f2f48061640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f680c3fb0 0x7f2f680c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f68069ef0 0x7f2f680a7950 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 --2- 172.21.15.133:0/1376533114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f680beb30 0x7f2f68150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.606+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 >> 172.21.15.133:0/1376533114 conn(0x7f2f680c8010 msgr2=0x7f2f6813a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:20.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.612+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 shutdown_connections 2024-01-21T21:33:20.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.613+0000 7f2f6e74c700 1 -- 172.21.15.133:0/1376533114 wait complete. 2024-01-21T21:33:20.622 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 25 and data pool 26 2024-01-21T21:33:20.637 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.751+0000 7fca0b0e6700 1 Processor -- start 2024-01-21T21:33:20.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.751+0000 7fca0b0e6700 1 -- start start 2024-01-21T21:33:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca0b0e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca041542e0 0x7fca040a7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca0b0e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca04066310 0x7fca040a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca0b0e6700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04066810 con 0x7fca040c4720 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca0b0e6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca040a77f0 con 0x7fca04066310 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca0b0e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04066af0 con 0x7fca041542e0 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca04066310 0x7fca040a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca04066310 0x7fca040a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35402/0 (socket says 172.21.15.133:35402) 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.752+0000 7fca03fff700 1 -- 172.21.15.133:0/86461311 learned_addr learned my addr 172.21.15.133:0/86461311 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca08e82700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca041542e0 0x7fca040a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca03fff700 1 -- 172.21.15.133:0/86461311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca041542e0 msgr2=0x7fca040a7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca03fff700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca041542e0 0x7fca040a7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca03fff700 1 -- 172.21.15.133:0/86461311 >> v1:172.21.15.178:6789/0 conn(0x7fca040c4720 legacy=0x7fca04062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca03fff700 1 -- 172.21.15.133:0/86461311 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04066dd0 con 0x7fca04066310 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca03fff700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca04066310 0x7fca040a69f0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7fc9f0006fd0 tx=0x7fc9f00090f0).ready entity=mon.0 client_cookie=35aea0dd60cc92e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca037fe700 1 -- 172.21.15.133:0/86461311 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000b600 con 0x7fca04066310 2024-01-21T21:33:20.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca037fe700 1 -- 172.21.15.133:0/86461311 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f000b760 con 0x7fca04066310 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca037fe700 1 -- 172.21.15.133:0/86461311 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f000bb00 con 0x7fca04066310 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.753+0000 7fca0b0e6700 1 -- 172.21.15.133:0/86461311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca04066310 msgr2=0x7fca040a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca04066310 0x7fca040a69f0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7fc9f0006fd0 tx=0x7fc9f00090f0).stop 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 -- 172.21.15.133:0/86461311 shutdown_connections 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca041542e0 0x7fca040a7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/86461311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca04066310 0x7fca040a69f0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 -- 172.21.15.133:0/86461311 >> 172.21.15.133:0/86461311 conn(0x7fca04065920 msgr2=0x7fca040c4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 -- 172.21.15.133:0/86461311 shutdown_connections 2024-01-21T21:33:20.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.754+0000 7fca0b0e6700 1 -- 172.21.15.133:0/86461311 wait complete. 2024-01-21T21:33:20.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.755+0000 7fca0b0e6700 1 Processor -- start 2024-01-21T21:33:20.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.755+0000 7fca0b0e6700 1 -- start start 2024-01-21T21:33:20.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca04066310 0x7fca0413f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca040c4720 0x7fca040ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca04155720 con 0x7fca041542e0 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca040ad1d0 con 0x7fca040c4720 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca04166080 con 0x7fca04066310 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35406/0 (socket says 172.21.15.133:35406) 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 -- 172.21.15.133:0/2527771783 learned_addr learned my addr 172.21.15.133:0/2527771783 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca08e82700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca04066310 0x7fca0413f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca03fff700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca040c4720 0x7fca040ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 -- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca04066310 msgr2=0x7fca0413f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca04066310 0x7fca0413f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 -- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca040c4720 msgr2=0x7fca040ac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca040c4720 0x7fca040ac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 -- 172.21.15.133:0/2527771783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0009370 con 0x7fca041542e0 2024-01-21T21:33:20.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca09683700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7fc9fc00c7c0 tx=0x7fc9fc001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00e4a0 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc00e600 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca04166360 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.756+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00e980 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.757+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca04166920 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.757+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0405fdf0 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.758+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc9fc0123f0 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.758+0000 7fca017fa700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 0x7fc9e8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.758+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6833+0+0 (secure 0 0 0) 0x7fc9fc079cb0 con 0x7fca041542e0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.758+0000 7fca08e82700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 0x7fc9e8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:20.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.758+0000 7fca08e82700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 0x7fc9e8061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc9f800bb10 tx=0x7fc9f8008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:20.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.762+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc9fc047b00 con 0x7fca041542e0 2024-01-21T21:33:20.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.927+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca040c4500 con 0x7fca041542e0 2024-01-21T21:33:20.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.928+0000 7fca017fa700 1 -- 172.21.15.133:0/2527771783 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+18095 (secure 0 0 0) 0x7fc9fc04ac50 con 0x7fca041542e0 2024-01-21T21:33:20.931 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:20.931 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":206,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:20.597635+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 msgr2=0x7fc9e8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 0x7fc9e8061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc9f800bb10 tx=0x7fc9f8008040).stop 2024-01-21T21:33:20.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 msgr2=0x7fca040acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7fc9fc00c7c0 tx=0x7fc9fc001510).stop 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 shutdown_connections 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca041542e0 0x7fca040acce0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca04066310 0x7fca0413f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc9e805f150 0x7fc9e8061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 --2- 172.21.15.133:0/2527771783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca040c4720 0x7fca040ac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.930+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 >> 172.21.15.133:0/2527771783 conn(0x7fca04065920 msgr2=0x7fca04151240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.931+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 shutdown_connections 2024-01-21T21:33:20.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:20.931+0000 7fca0b0e6700 1 -- 172.21.15.133:0/2527771783 wait complete. 2024-01-21T21:33:20.946 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.058+0000 7fa90f4d5700 1 Processor -- start 2024-01-21T21:33:21.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.058+0000 7fa90f4d5700 1 -- start start 2024-01-21T21:33:21.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9080a9d10 0x7fa9080ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080aa0f0 0x7fa908063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c4920 0x7fa9081551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080640d0 con 0x7fa9080aa0f0 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa908063750 con 0x7fa9080a9d10 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90f4d5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90805e380 con 0x7fa9080c4920 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080aa0f0 0x7fa908063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080aa0f0 0x7fa908063be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35410/0 (socket says 172.21.15.133:35410) 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 -- 172.21.15.133:0/1039946152 learned_addr learned my addr 172.21.15.133:0/1039946152 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 -- 172.21.15.133:0/1039946152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c4920 msgr2=0x7fa9081551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90da72700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c4920 0x7fa9081551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90d271700 1 --2- 172.21.15.133:0/1039946152 >> v2:172.21.15.178:3300/0 conn(0x7fa9080a9d10 0x7fa9080ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c4920 0x7fa9081551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 -- 172.21.15.133:0/1039946152 >> v2:172.21.15.178:3300/0 conn(0x7fa9080a9d10 msgr2=0x7fa9080ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:21.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 --2- 172.21.15.133:0/1039946152 >> v2:172.21.15.178:3300/0 conn(0x7fa9080a9d10 0x7fa9080ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.059+0000 7fa90ca70700 1 -- 172.21.15.133:0/1039946152 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90805e660 con 0x7fa9080aa0f0 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90ca70700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080aa0f0 0x7fa908063be0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7fa90805f0d0 tx=0x7fa9040090f0).ready entity=mon.0 client_cookie=2730d590d16758c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa8fffff700 1 -- 172.21.15.133:0/1039946152 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400b600 con 0x7fa9080aa0f0 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa8fffff700 1 -- 172.21.15.133:0/1039946152 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400b760 con 0x7fa9080aa0f0 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa8fffff700 1 -- 172.21.15.133:0/1039946152 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90400bb00 con 0x7fa9080aa0f0 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 -- 172.21.15.133:0/1039946152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080aa0f0 msgr2=0x7fa908063be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080aa0f0 0x7fa908063be0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 rx=0x7fa90805f0d0 tx=0x7fa9040090f0).stop 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 -- 172.21.15.133:0/1039946152 shutdown_connections 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c4920 0x7fa9081551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/1039946152 >> v2:172.21.15.178:3300/0 conn(0x7fa9080a9d10 0x7fa9080ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/1039946152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080aa0f0 0x7fa908063be0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 -- 172.21.15.133:0/1039946152 >> 172.21.15.133:0/1039946152 conn(0x7fa9080c8200 msgr2=0x7fa9080c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 -- 172.21.15.133:0/1039946152 shutdown_connections 2024-01-21T21:33:21.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.060+0000 7fa90f4d5700 1 -- 172.21.15.133:0/1039946152 wait complete. 2024-01-21T21:33:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 Processor -- start 2024-01-21T21:33:21.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 -- start start 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 0x7fa9081512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080aa0f0 0x7fa90813d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90814b430 con 0x7fa9080c4920 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90813dad0 con 0x7fa9080a9d10 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90f4d5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908164440 con 0x7fa9080aa0f0 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90da72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90da72700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35420/0 (socket says 172.21.15.133:35420) 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.062+0000 7fa90da72700 1 -- 172.21.15.133:0/4157069758 learned_addr learned my addr 172.21.15.133:0/4157069758 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90ca70700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080aa0f0 0x7fa90813d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90d271700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 0x7fa9081512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 -- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080aa0f0 msgr2=0x7fa90813d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080aa0f0 0x7fa90813d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 -- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 msgr2=0x7fa9081512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 0x7fa9081512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 -- 172.21.15.133:0/4157069758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904009370 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90d271700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 0x7fa9081512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90da72700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7fa90000cdb0 tx=0x7fa9000077d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000aa80 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90000abe0 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa908164720 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000f400 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.063+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90814b0c0 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.064+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90814b5e0 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.064+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa90000d040 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.065+0000 7fa8fdffb700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 0x7fa8ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.065+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6833+0+0 (secure 0 0 0) 0x7fa90007a660 con 0x7fa9080c4920 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.065+0000 7fa90d271700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 0x7fa8ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.065+0000 7fa90d271700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 0x7fa8ec061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa8f8008900 tx=0x7fa8f8008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.069+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa90814b5e0 con 0x7fa9080c4920 2024-01-21T21:33:21.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.235+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa90814b5e0 con 0x7fa9080c4920 2024-01-21T21:33:21.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.236+0000 7fa8fdffb700 1 -- 172.21.15.133:0/4157069758 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) v1 ==== 74+0+18095 (secure 0 0 0) 0x7fa90814b5e0 con 0x7fa9080c4920 2024-01-21T21:33:21.239 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:21.239 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":206,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:20.597635+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:21.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 msgr2=0x7fa8ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 0x7fa8ec061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa8f8008900 tx=0x7fa8f8008040).stop 2024-01-21T21:33:21.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 msgr2=0x7fa908163c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7fa90000cdb0 tx=0x7fa9000077d0).stop 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 shutdown_connections 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c4920 0x7fa908163c10 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa8ec05f150 0x7fa8ec061610 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080a9d10 0x7fa9081512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 --2- 172.21.15.133:0/4157069758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080aa0f0 0x7fa90813d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 >> 172.21.15.133:0/4157069758 conn(0x7fa9080c8200 msgr2=0x7fa9080c2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 shutdown_connections 2024-01-21T21:33:21.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.238+0000 7fa90f4d5700 1 -- 172.21.15.133:0/4157069758 wait complete. 2024-01-21T21:33:21.253 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-21T21:33:21.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 Processor -- start 2024-01-21T21:33:21.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 -- start start 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5dec0c3840 0x7f5dec0c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec067f10 con 0x7f5dec0c5dc0 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec0681f0 con 0x7f5dec0c6250 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.369+0000 7f5df1544700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec0684d0 con 0x7f5dec0c3840 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5dec0c3840 0x7f5dec0c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5dea7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5dec0c5dc0 0x7f5dec13a4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59230/0 (socket says 172.21.15.133:59230) 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5dec0c3840 0x7f5dec0c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35434/0 (socket says 172.21.15.133:35434) 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5dea7fc700 1 -- 172.21.15.133:0/1970895373 learned_addr learned my addr 172.21.15.133:0/1970895373 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 -- 172.21.15.133:0/1970895373 >> v1:172.21.15.178:6789/0 conn(0x7f5dec0c6250 legacy=0x7f5dec0bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 -- 172.21.15.133:0/1970895373 >> v1:172.21.15.133:6789/0 conn(0x7f5dec0c5dc0 legacy=0x7f5dec13a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 -- 172.21.15.133:0/1970895373 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0687b0 con 0x7f5dec0c3840 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5de9ffb700 1 -- 172.21.15.133:0/1970895373 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288067335 0 0) 0x7f5dec067f10 con 0x7f5dec0c5dc0 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5deaffd700 1 --2- 172.21.15.133:0/1970895373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c3840 0x7f5dec0c3c20 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f5ddc009760 tx=0x7f5ddc009060).ready entity=mon.0 client_cookie=daf793b0fc27b542 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5de9ffb700 1 -- 172.21.15.133:0/1970895373 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc0090d0 con 0x7f5dec0c3840 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5de9ffb700 1 -- 172.21.15.133:0/1970895373 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00b520 con 0x7f5dec0c3840 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.370+0000 7f5de9ffb700 1 -- 172.21.15.133:0/1970895373 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00b8a0 con 0x7f5dec0c3840 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 -- 172.21.15.133:0/1970895373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c3840 msgr2=0x7f5dec0c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 --2- 172.21.15.133:0/1970895373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c3840 0x7f5dec0c3c20 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 rx=0x7f5ddc009760 tx=0x7f5ddc009060).stop 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 -- 172.21.15.133:0/1970895373 shutdown_connections 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 --2- 172.21.15.133:0/1970895373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c3840 0x7f5dec0c3c20 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 -- 172.21.15.133:0/1970895373 >> 172.21.15.133:0/1970895373 conn(0x7f5dec066a70 msgr2=0x7f5dec066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 -- 172.21.15.133:0/1970895373 shutdown_connections 2024-01-21T21:33:21.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.371+0000 7f5df1544700 1 -- 172.21.15.133:0/1970895373 wait complete. 2024-01-21T21:33:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.372+0000 7f5df1544700 1 Processor -- start 2024-01-21T21:33:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.372+0000 7f5df1544700 1 -- start start 2024-01-21T21:33:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 0x7f5dec0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 0x7f5dec0bffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0ad430 con 0x7f5dec0c6250 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0ac820 con 0x7f5dec0c5dc0 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5df1544700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec0acb00 con 0x7f5dec0c3840 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35444/0 (socket says 172.21.15.133:35444) 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 -- 172.21.15.133:0/132175966 learned_addr learned my addr 172.21.15.133:0/132175966 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5dea7fc700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 0x7f5dec0bffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deaffd700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 0x7f5dec0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 -- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 msgr2=0x7f5dec0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 0x7f5dec0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 -- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 msgr2=0x7f5dec0bffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 0x7f5dec0bffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 -- 172.21.15.133:0/132175966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0092a0 con 0x7f5dec0c6250 2024-01-21T21:33:21.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5dea7fc700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 0x7f5dec0bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deaffd700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 0x7f5dec0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5deb7fe700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f5de400b810 tx=0x7f5de4009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.373+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400d600 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.374+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400d780 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.374+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0acde0 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.374+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400db40 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.374+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec0c1cd0 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.375+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec0c1ef0 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.375+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5de4019460 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.375+0000 7f5dd37fe700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 0x7f5dd80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.375+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f5de407a5a0 con 0x7f5dec0c6250 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.375+0000 7f5deaffd700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 0x7f5dd80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.376+0000 7f5deaffd700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 0x7f5dd80615e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5ddc00b2e0 tx=0x7f5ddc017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.380+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5dec0c1ef0 con 0x7f5dec0c6250 2024-01-21T21:33:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.587+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5dec0c1ef0 con 0x7f5dec0c6250 2024-01-21T21:33:21.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.601+0000 7f5dd37fe700 1 -- 172.21.15.133:0/132175966 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5dec0c1ef0 con 0x7f5dec0c6250 2024-01-21T21:33:21.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 msgr2=0x7f5dd80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 0x7f5dd80615e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5ddc00b2e0 tx=0x7f5ddc017000).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 msgr2=0x7f5dec0c0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f5de400b810 tx=0x7f5de4009290).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 shutdown_connections 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5dec0c6250 0x7f5dec0c0490 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dec0c3840 0x7f5dec0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5dd805f120 0x7f5dd80615e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 --2- 172.21.15.133:0/132175966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dec0c5dc0 0x7f5dec0bffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.603+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 >> 172.21.15.133:0/132175966 conn(0x7f5dec066a70 msgr2=0x7f5dec0c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:21.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.604+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 shutdown_connections 2024-01-21T21:33:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.604+0000 7f5df1544700 1 -- 172.21.15.133:0/132175966 wait complete. 2024-01-21T21:33:21.619 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-21T21:33:21.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-21T21:33:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.735+0000 7ff0f2ea8700 1 Processor -- start 2024-01-21T21:33:21.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 -- start start 2024-01-21T21:33:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec155cb0 0x7ff0ec156130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0c61a0 con 0x7ff0ec1351d0 2024-01-21T21:33:21.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec156620 con 0x7ff0ec0bde60 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f2ea8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0c5350 con 0x7ff0ec155cb0 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f1445700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.736+0000 7ff0f0c44700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff0ec1351d0 0x7ff0ec0c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59236/0 (socket says 172.21.15.133:59236) 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35452/0 (socket says 172.21.15.133:35452) 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f0c44700 1 -- 172.21.15.133:0/642793786 learned_addr learned my addr 172.21.15.133:0/642793786 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0ebfff700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec155cb0 0x7ff0ec156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 -- 172.21.15.133:0/642793786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec155cb0 msgr2=0x7ff0ec156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec155cb0 0x7ff0ec156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 -- 172.21.15.133:0/642793786 >> v1:172.21.15.133:6789/0 conn(0x7ff0ec1351d0 legacy=0x7ff0ec0c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 -- 172.21.15.133:0/642793786 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0c55d0 con 0x7ff0ec0bde60 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0f1445700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7ff0e4009e60 tx=0x7ff0e4009780).ready entity=mon.0 client_cookie=9a5882db688e8fd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0eb7fe700 1 -- 172.21.15.133:0/642793786 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400e070 con 0x7ff0ec0bde60 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0eb7fe700 1 -- 172.21.15.133:0/642793786 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400bc30 con 0x7ff0ec0bde60 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.737+0000 7ff0eb7fe700 1 -- 172.21.15.133:0/642793786 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4012410 con 0x7ff0ec0bde60 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/642793786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec0bde60 msgr2=0x7ff0ec0be2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7ff0e4009e60 tx=0x7ff0e4009780).stop 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/642793786 shutdown_connections 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0be2f0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/642793786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec155cb0 0x7ff0ec156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/642793786 >> 172.21.15.133:0/642793786 conn(0x7ff0ec066a90 msgr2=0x7ff0ec066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/642793786 shutdown_connections 2024-01-21T21:33:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.738+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/642793786 wait complete. 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.739+0000 7ff0f2ea8700 1 Processor -- start 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.739+0000 7ff0f2ea8700 1 -- start start 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec1351d0 0x7ff0ec1387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec150e40 con 0x7ff0ec155cb0 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0a7e70 con 0x7ff0ec0bde60 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f2ea8700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0a8fa0 con 0x7ff0ec1351d0 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35456/0 (socket says 172.21.15.133:35456) 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 -- 172.21.15.133:0/2570582445 learned_addr learned my addr 172.21.15.133:0/2570582445 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0ebfff700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec1351d0 0x7ff0ec1387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f0c44700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 -- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec1351d0 msgr2=0x7ff0ec1387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec1351d0 0x7ff0ec1387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 -- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0ec0bde60 msgr2=0x7ff0ec0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 -- 172.21.15.133:0/2570582445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4009a20 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.740+0000 7ff0f1445700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7ff0e400b6c0 tx=0x7ff0e4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.741+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400b6f0 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.741+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e401d630 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.741+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec0a9280 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.741+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e401d9b0 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.741+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec0a9840 con 0x7ff0ec155cb0 2024-01-21T21:33:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.742+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec05fdf0 con 0x7ff0ec155cb0 2024-01-21T21:33:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.742+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff0e4003040 con 0x7ff0ec155cb0 2024-01-21T21:33:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.742+0000 7ff0e97fa700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 0x7ff0d0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.742+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7ff0e407c330 con 0x7ff0ec155cb0 2024-01-21T21:33:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.742+0000 7ff0f0c44700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 0x7ff0d0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:21.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.743+0000 7ff0f0c44700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 0x7ff0d0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff0e0007fd0 tx=0x7ff0e0000bc0).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:21.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.746+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff0e404d330 con 0x7ff0ec155cb0 2024-01-21T21:33:21.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:21.951+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff0ec06bd20 con 0x7ff0ec155cb0 2024-01-21T21:33:22.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.605+0000 7ff0e97fa700 1 -- 172.21.15.133:0/2570582445 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0e4050950 con 0x7ff0ec155cb0 2024-01-21T21:33:22.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 msgr2=0x7ff0d0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 0x7ff0d0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff0e0007fd0 tx=0x7ff0e0000bc0).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 msgr2=0x7ff0ec0ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7ff0e400b6c0 tx=0x7ff0e4009780).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 shutdown_connections 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0ec155cb0 0x7ff0ec0ab0a0 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff0d005f150 0x7ff0d0061610 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0ec0bde60 0x7ff0ec0a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 --2- 172.21.15.133:0/2570582445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0ec1351d0 0x7ff0ec1387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 >> 172.21.15.133:0/2570582445 conn(0x7ff0ec066a90 msgr2=0x7ff0ec139d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 shutdown_connections 2024-01-21T21:33:22.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.608+0000 7ff0f2ea8700 1 -- 172.21.15.133:0/2570582445 wait complete. 2024-01-21T21:33:22.624 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-21T21:33:22.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.741+0000 7f4c6ef4f700 1 Processor -- start 2024-01-21T21:33:22.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.741+0000 7f4c6ef4f700 1 -- start start 2024-01-21T21:33:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6ef4f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6ef4f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6ef4f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c68065660 con 0x7f4c68069cd0 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6ef4f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c680bef10 con 0x7f4c680beb30 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6ef4f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68156070 con 0x7f4c680c3fb0 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c67fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6cceb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6cceb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40472/0 (socket says 172.21.15.133:40472) 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c67fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:51372/0 (socket says 172.21.15.133:51372) 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.742+0000 7f4c6cceb700 1 -- 172.21.15.133:0/673971607 learned_addr learned my addr 172.21.15.133:0/673971607 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c67fff700 1 -- 172.21.15.133:0/673971607 >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 msgr2=0x7f4c68155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c67fff700 1 --2- 172.21.15.133:0/673971607 >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c67fff700 1 -- 172.21.15.133:0/673971607 >> v1:172.21.15.178:6789/0 conn(0x7f4c68069cd0 legacy=0x7f4c68151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c67fff700 1 -- 172.21.15.133:0/673971607 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68065f00 con 0x7f4c680c3fb0 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c6cceb700 1 --2- 172.21.15.133:0/673971607 >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:22.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c67fff700 1 --2- 172.21.15.133:0/673971607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4c54009760 tx=0x7f4c54009060).ready entity=mon.2 client_cookie=7ebb825b15ea4b31 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c677fe700 1 -- 172.21.15.133:0/673971607 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c540090d0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c677fe700 1 -- 172.21.15.133:0/673971607 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5400f510 con 0x7f4c680c3fb0 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c677fe700 1 -- 172.21.15.133:0/673971607 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5400f890 con 0x7f4c680c3fb0 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/673971607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 msgr2=0x7f4c680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.743+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/673971607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f4c54009760 tx=0x7f4c54009060).stop 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/673971607 shutdown_connections 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/673971607 >> v2:172.21.15.178:3300/0 conn(0x7f4c680beb30 0x7f4c68155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/673971607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680c3fb0 0x7f4c680697e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/673971607 >> 172.21.15.133:0/673971607 conn(0x7f4c680c8010 msgr2=0x7f4c680c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/673971607 shutdown_connections 2024-01-21T21:33:22.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.744+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/673971607 wait complete. 2024-01-21T21:33:22.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.745+0000 7f4c6ef4f700 1 Processor -- start 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.745+0000 7f4c6ef4f700 1 -- start start 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c68069cd0 0x7f4c680c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680beb30 0x7f4c68138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68138c40 con 0x7f4c680c3fb0 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68138f20 con 0x7f4c68069cd0 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c68139200 con 0x7f4c680beb30 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35462/0 (socket says 172.21.15.133:35462) 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 -- 172.21.15.133:0/4206978003 learned_addr learned my addr 172.21.15.133:0/4206978003 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c67fff700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680beb30 0x7f4c68138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6cceb700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c68069cd0 0x7f4c680c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 -- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680beb30 msgr2=0x7f4c68138460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680beb30 0x7f4c68138460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 -- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c68069cd0 msgr2=0x7f4c680c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c68069cd0 0x7f4c680c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 -- 172.21.15.133:0/4206978003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c00b610 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6d4ec700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f4c6000c7c0 tx=0x7f4c60001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000e4a0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000e600 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c540092a0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.746+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000e980 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.747+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c681397c0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6805fdf0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4c600123f0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c657fa700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 0x7f4c4c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f4c60079c80 con 0x7f4c680c3fb0 2024-01-21T21:33:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c6cceb700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 0x7f4c4c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.748+0000 7f4c6cceb700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 0x7f4c4c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c5c00b240 tx=0x7f4c5c00b3b0).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:22.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.752+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4c60047b00 con 0x7f4c680c3fb0 2024-01-21T21:33:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.956+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c6806a9e0 con 0x7f4c680c3fb0 2024-01-21T21:33:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.957+0000 7f4c657fa700 1 -- 172.21.15.133:0/4206978003 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7f4c6004ac20 con 0x7f4c680c3fb0 2024-01-21T21:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:22.960 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 msgr2=0x7f4c4c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 0x7f4c4c061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4c5c00b240 tx=0x7f4c5c00b3b0).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 msgr2=0x7f4c68150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7f4c6000c7c0 tx=0x7f4c60001510).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 shutdown_connections 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c680c3fb0 0x7f4c68150d80 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4c4c05f150 0x7f4c4c061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c68069cd0 0x7f4c680c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 --2- 172.21.15.133:0/4206978003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c680beb30 0x7f4c68138460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 >> 172.21.15.133:0/4206978003 conn(0x7f4c680c8010 msgr2=0x7f4c68151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 shutdown_connections 2024-01-21T21:33:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:22.959+0000 7f4c6ef4f700 1 -- 172.21.15.133:0/4206978003 wait complete. 2024-01-21T21:33:22.963 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:22.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.086+0000 7f13ee781700 1 Processor -- start 2024-01-21T21:33:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.086+0000 7f13ee781700 1 -- start start 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e80acbc0 0x7f13e80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13e8066460 0x7f13e80634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13e81521e0 0x7f13e81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e8065fd0 con 0x7f13e8066460 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e80653c0 con 0x7f13e81521e0 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13ee781700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e80656a0 con 0x7f13e80acbc0 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.087+0000 7f13e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13e8066460 0x7f13e80634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13e8066460 0x7f13e80634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35472/0 (socket says 172.21.15.133:35472) 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 -- 172.21.15.133:0/1618398524 learned_addr learned my addr 172.21.15.133:0/1618398524 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e7fff700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e80acbc0 0x7f13e80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13ecd1e700 1 --2- 172.21.15.133:0/1618398524 >> v2:172.21.15.178:3300/0 conn(0x7f13e81521e0 0x7f13e81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 -- 172.21.15.133:0/1618398524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e80acbc0 msgr2=0x7f13e80acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e80acbc0 0x7f13e80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 -- 172.21.15.133:0/1618398524 >> v2:172.21.15.178:3300/0 conn(0x7f13e81521e0 msgr2=0x7f13e81525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1618398524 >> v2:172.21.15.178:3300/0 conn(0x7f13e81521e0 0x7f13e81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 -- 172.21.15.133:0/1618398524 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8065980 con 0x7f13e8066460 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e80634d0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f13e8067b20 tx=0x7f13d00090f0).ready entity=mon.0 client_cookie=851c2b0e642ef020 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e6ffd700 1 -- 172.21.15.133:0/1618398524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000b600 con 0x7f13e8066460 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e6ffd700 1 -- 172.21.15.133:0/1618398524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000b760 con 0x7f13e8066460 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.088+0000 7f13e6ffd700 1 -- 172.21.15.133:0/1618398524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000bb00 con 0x7f13e8066460 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 -- 172.21.15.133:0/1618398524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 msgr2=0x7f13e80634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e80634d0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7f13e8067b20 tx=0x7f13d00090f0).stop 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 -- 172.21.15.133:0/1618398524 shutdown_connections 2024-01-21T21:33:23.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 --2- 172.21.15.133:0/1618398524 >> v2:172.21.15.178:3300/0 conn(0x7f13e81521e0 0x7f13e81525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e80acbc0 0x7f13e80acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 --2- 172.21.15.133:0/1618398524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e80634d0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 -- 172.21.15.133:0/1618398524 >> 172.21.15.133:0/1618398524 conn(0x7f13e80c8200 msgr2=0x7f13e80c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 -- 172.21.15.133:0/1618398524 shutdown_connections 2024-01-21T21:33:23.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.089+0000 7f13ee781700 1 -- 172.21.15.133:0/1618398524 wait complete. 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.090+0000 7f13ee781700 1 Processor -- start 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.090+0000 7f13ee781700 1 -- start start 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e80acbc0 0x7f13e8147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e81521e0 0x7f13e80ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8152ae0 con 0x7f13e8066460 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e81654d0 con 0x7f13e80acbc0 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ee781700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8147a70 con 0x7f13e81521e0 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35482/0 (socket says 172.21.15.133:35482) 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 -- 172.21.15.133:0/1283932743 learned_addr learned my addr 172.21.15.133:0/1283932743 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13ecd1e700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e81521e0 0x7f13e80ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e80acbc0 0x7f13e8147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 -- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e81521e0 msgr2=0x7f13e80ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e81521e0 0x7f13e80ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 -- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e80acbc0 msgr2=0x7f13e8147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e80acbc0 0x7f13e8147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 -- 172.21.15.133:0/1283932743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009370 con 0x7f13e8066460 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.091+0000 7f13e7fff700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f13d800c880 tx=0x7f13d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.092+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8010580 con 0x7f13e8066460 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.092+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80106e0 con 0x7f13e8066460 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.092+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e80abf20 con 0x7f13e8066460 2024-01-21T21:33:23.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.092+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8010a60 con 0x7f13e8066460 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.092+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8164ba0 con 0x7f13e8066460 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.093+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e805fdf0 con 0x7f13e8066460 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.093+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f13d801b460 con 0x7f13e8066460 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.093+0000 7f13e4ff9700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 0x7f13c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.094+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f13d807a350 con 0x7f13e8066460 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.094+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 0x7f13c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.094+0000 7f13e77fe700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 0x7f13c8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13d0009fd0 tx=0x7f13d0017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.098+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f13d804b350 con 0x7f13e8066460 2024-01-21T21:33:23.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.261+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13e805e660 con 0x7f13e8066460 2024-01-21T21:33:23.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.262+0000 7f13e4ff9700 1 -- 172.21.15.133:0/1283932743 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+18082 (secure 0 0 0) 0x7f13d804e970 con 0x7f13e8066460 2024-01-21T21:33:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:23.265 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":207,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:21.599820+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 msgr2=0x7f13c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 0x7f13c8061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13d0009fd0 tx=0x7f13d0017000).stop 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 msgr2=0x7f13e81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7f13d800c880 tx=0x7f13d8008040).stop 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 shutdown_connections 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13e81521e0 0x7f13e80ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13e8066460 0x7f13e81525f0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f13c805f150 0x7f13c8061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 --2- 172.21.15.133:0/1283932743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13e80acbc0 0x7f13e8147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 >> 172.21.15.133:0/1283932743 conn(0x7f13e80c8200 msgr2=0x7f13e80c6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 shutdown_connections 2024-01-21T21:33:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.264+0000 7f13ee781700 1 -- 172.21.15.133:0/1283932743 wait complete. 2024-01-21T21:33:23.279 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-21T21:33:23.279 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.392+0000 7fc8366ea700 1 Processor -- start 2024-01-21T21:33:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.392+0000 7fc8366ea700 1 -- start start 2024-01-21T21:33:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc8366ea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc8300c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc8366ea700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830065660 con 0x7fc8300beb30 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc8366ea700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830065f00 con 0x7fc830069ef0 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc8366ea700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300bef10 con 0x7fc830155b80 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc82ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc8300beb30 0x7fc8300697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59240/0 (socket says 172.21.15.133:59240) 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc82ffff700 1 -- 172.21.15.133:0/3405082300 learned_addr learned my addr 172.21.15.133:0/3405082300 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.393+0000 7fc834c87700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc8300c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712452397 0 0) 0x7fc830065660 con 0x7fc8300beb30 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8180033f0 con 0x7fc8300beb30 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924140248 0 0) 0x7fc830065f00 con 0x7fc830069ef0 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc830065660 con 0x7fc830069ef0 2024-01-21T21:33:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1281160052 0 0) 0x7fc8180033f0 con 0x7fc8300beb30 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 msgr2=0x7fc8300c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc8300c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 >> v1:172.21.15.178:6789/0 conn(0x7fc830069ef0 legacy=0x7fc830066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300c44a0 con 0x7fc8300beb30 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7fc820001470 con 0x7fc8300beb30 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc834c87700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc8300c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 >> v1:172.21.15.133:6789/0 conn(0x7fc8300beb30 legacy=0x7fc8300697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc818003aa0 0x7fc818003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc818004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc818004b80 0x7fc818005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300bef10 con 0x7fc818003aa0 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81800b990 con 0x7fc818004b80 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81800bb50 con 0x7fc830155b80 2024-01-21T21:33:23.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc818003aa0 0x7fc818003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc834c87700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc818004b80 0x7fc818005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc818004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 -- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 msgr2=0x7fc818004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc818004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 -- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc818004b80 msgr2=0x7fc818005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc818004b80 0x7fc818005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 -- 172.21.15.133:0/3405082300 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009a20 con 0x7fc818003aa0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc830155b80 0x7fc818004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.394+0000 7fc82ffff700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc818003aa0 0x7fc818003ea0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7fc82000c190 tx=0x7fc820001e10).ready entity=mon.0 client_cookie=16a3e7956ae2ca97 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82000ca00 con 0x7fc818003aa0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82000cb60 con 0x7fc818003aa0 2024-01-21T21:33:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc82effd700 1 -- 172.21.15.133:0/3405082300 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200070d0 con 0x7fc818003aa0 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 -- 172.21.15.133:0/3405082300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc818003aa0 msgr2=0x7fc818003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 --2- 172.21.15.133:0/3405082300 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc818003aa0 0x7fc818003ea0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 rx=0x7fc82000c190 tx=0x7fc820001e10).stop 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc834c87700 1 -- 172.21.15.133:0/3405082300 reap_dead start 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 -- 172.21.15.133:0/3405082300 shutdown_connections 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 -- 172.21.15.133:0/3405082300 >> 172.21.15.133:0/3405082300 conn(0x7fc8300c8010 msgr2=0x7fc8300c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 -- 172.21.15.133:0/3405082300 shutdown_connections 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.395+0000 7fc8366ea700 1 -- 172.21.15.133:0/3405082300 wait complete. 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.396+0000 7fc8366ea700 1 Processor -- start 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 -- start start 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc818003aa0 0x7fc830151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 0x7fc8300a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300a8ae0 con 0x7fc8300a7e40 2024-01-21T21:33:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300aa860 con 0x7fc8300c1c30 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc8366ea700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300a9f70 con 0x7fc818003aa0 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc834c87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc834c87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35496/0 (socket says 172.21.15.133:35496) 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.397+0000 7fc834c87700 1 -- 172.21.15.133:0/2368389997 learned_addr learned my addr 172.21.15.133:0/2368389997 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82ffff700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc818003aa0 0x7fc830151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 0x7fc8300a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 -- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc818003aa0 msgr2=0x7fc830151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc818003aa0 0x7fc830151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 -- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 msgr2=0x7fc8300a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 0x7fc8300a7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 -- 172.21.15.133:0/2368389997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300a8800 con 0x7fc8300a7e40 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82f7fe700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 0x7fc8300a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc834c87700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7fc830069360 tx=0x7fc82800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800e040 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800f040 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8300aa210 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800feb0 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.398+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8300a82a0 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.399+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8300aa6b0 con 0x7fc8300a7e40 2024-01-21T21:33:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.399+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc828015660 con 0x7fc8300a7e40 2024-01-21T21:33:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.400+0000 7fc82cff9700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 0x7fc81c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.400+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7fc82807b340 con 0x7fc8300a7e40 2024-01-21T21:33:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.400+0000 7fc82ffff700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 0x7fc81c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.400+0000 7fc82ffff700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 0x7fc81c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc820001e70 tx=0x7fc820015000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.404+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc82804c340 con 0x7fc8300a7e40 2024-01-21T21:33:23.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.563+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8300bfc20 con 0x7fc81c05f150 2024-01-21T21:33:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.573+0000 7fc82cff9700 1 -- 172.21.15.133:0/2368389997 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353464 (secure 0 0 0) 0x7fc8300bfc20 con 0x7fc81c05f150 2024-01-21T21:33:23.581 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 msgr2=0x7fc81c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 0x7fc81c061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fc820001e70 tx=0x7fc820015000).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 msgr2=0x7fc8300bff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7fc830069360 tx=0x7fc82800b040).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 shutdown_connections 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8300a7e40 0x7fc8300bff00 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc818003aa0 0x7fc830151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc81c05f150 0x7fc81c061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 --2- 172.21.15.133:0/2368389997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8300c1c30 0x7fc8300a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 >> 172.21.15.133:0/2368389997 conn(0x7fc8300c8010 msgr2=0x7fc83013ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 shutdown_connections 2024-01-21T21:33:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.576+0000 7fc8366ea700 1 -- 172.21.15.133:0/2368389997 wait complete. 2024-01-21T21:33:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:23.591 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:33:22.658392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470384,"kb_used_data":19888,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752504336,"statfs":{"total":773094113280,"available":770564440064,"internally_reserved":0,"allocated":20365312,"data_stored":10998068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27322,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.527040"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222097+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223180+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220541+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224988+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226728+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220253+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222549+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224006+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220015+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224101+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222741+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223828+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224227+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220173+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222340+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223649+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226380+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223338+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224421+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226766+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226275+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226018+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220386+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223257+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222845+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222632+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226335+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223107+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219408+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226259+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222399+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219811+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224040+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223209+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223496+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224545+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219415+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219410+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223680+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223418+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219426+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222087+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225266+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226652+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224456+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223825+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227186+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222487+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222353+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222309+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.221941+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226231+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223645+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227293+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572753+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:17.572753+0000","last_peered":"2024-01-21T21:33:17.572753+0000","last_clean":"2024-01-21T21:33:17.572753+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:17.572753+0000","last_undegraded":"2024-01-21T21:33:17.572753+0000","last_fullsized":"2024-01-21T21:33:17.572753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222002+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212565+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:17.212565+0000","last_peered":"2024-01-21T21:33:17.212565+0000","last_clean":"2024-01-21T21:33:17.212565+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:17.212565+0000","last_undegraded":"2024-01-21T21:33:17.212565+0000","last_fullsized":"2024-01-21T21:33:17.212565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225662+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212214+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:17.212214+0000","last_peered":"2024-01-21T21:33:17.212214+0000","last_clean":"2024-01-21T21:33:17.212214+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:17.212214+0000","last_undegraded":"2024-01-21T21:33:17.212214+0000","last_fullsized":"2024-01-21T21:33:17.212214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223647+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212559+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:17.212559+0000","last_peered":"2024-01-21T21:33:17.212559+0000","last_clean":"2024-01-21T21:33:17.212559+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:17.212559+0000","last_undegraded":"2024-01-21T21:33:17.212559+0000","last_fullsized":"2024-01-21T21:33:17.212559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":167,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745949+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:18.745949+0000","last_peered":"2024-01-21T21:33:18.745949+0000","last_clean":"2024-01-21T21:33:18.745949+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:18.745949+0000","last_undegraded":"2024-01-21T21:33:18.745949+0000","last_fullsized":"2024-01-21T21:33:18.745949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222884+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745925+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:18.745925+0000","last_peered":"2024-01-21T21:33:18.745925+0000","last_clean":"2024-01-21T21:33:18.745925+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:18.745925+0000","last_undegraded":"2024-01-21T21:33:18.745925+0000","last_fullsized":"2024-01-21T21:33:18.745925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745992+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:18.745992+0000","last_peered":"2024-01-21T21:33:18.745992+0000","last_clean":"2024-01-21T21:33:18.745992+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:18.745992+0000","last_undegraded":"2024-01-21T21:33:18.745992+0000","last_fullsized":"2024-01-21T21:33:18.745992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219449+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572741+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:17.572741+0000","last_peered":"2024-01-21T21:33:17.572741+0000","last_clean":"2024-01-21T21:33:17.572741+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:17.572741+0000","last_undegraded":"2024-01-21T21:33:17.572741+0000","last_fullsized":"2024-01-21T21:33:17.572741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223653+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.329800+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:18.329800+0000","last_peered":"2024-01-21T21:33:18.329800+0000","last_clean":"2024-01-21T21:33:18.329800+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:18.329800+0000","last_undegraded":"2024-01-21T21:33:18.329800+0000","last_fullsized":"2024-01-21T21:33:18.329800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064084,"statfs":{"total":96636764160,"available":96321622016,"internally_reserved":0,"allocated":2527232,"data_stored":1365669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059960,"statfs":{"total":96636764160,"available":96317399040,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.255},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.30099999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575971,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2551808,"data_stored":1379195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.251},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.26100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.28999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064056,"statfs":{"total":96636764160,"available":96321593344,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.377}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.62}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.37},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315964,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055876,"statfs":{"total":96636764160,"available":96313217024,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:23.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:23.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.746+0000 7ff683ffb700 1 Processor -- start 2024-01-21T21:33:23.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.746+0000 7ff683ffb700 1 -- start start 2024-01-21T21:33:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff683ffb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff67c0c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff683ffb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0c3890 con 0x7ff67c0695b0 2024-01-21T21:33:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff683ffb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0c3b70 con 0x7ff67c13ac10 2024-01-21T21:33:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff683ffb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c3e50 con 0x7ff67c13a830 2024-01-21T21:33:23.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff682598700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff67c0695b0 0x7ff67c0653d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59246/0 (socket says 172.21.15.133:59246) 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff682598700 1 -- 172.21.15.133:0/2638586143 learned_addr learned my addr 172.21.15.133:0/2638586143 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435831288 0 0) 0x7ff67c0c3890 con 0x7ff67c0695b0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680033f0 con 0x7ff67c0695b0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.747+0000 7ff681d97700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff67c0c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3884693546 0 0) 0x7ff6680033f0 con 0x7ff67c0695b0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 msgr2=0x7ff67c0c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff67c0c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 >> v1:172.21.15.178:6789/0 conn(0x7ff67c13ac10 legacy=0x7ff67c0bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0c4130 con 0x7ff67c0695b0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7ff6740017f0 con 0x7ff67c0695b0 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 >> v1:172.21.15.133:6789/0 conn(0x7ff67c0695b0 legacy=0x7ff67c0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668003910 0x7ff668003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff668004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff6680050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c3e50 con 0x7ff668004690 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66800dbd0 con 0x7ff668003910 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66800dd90 con 0x7ff67c13a830 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff668004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681d97700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668003910 0x7ff668003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff682598700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff6680050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 -- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 msgr2=0x7ff6680050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c13a830 0x7ff6680050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 -- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668003910 msgr2=0x7ff668003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668003910 0x7ff668003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 -- 172.21.15.133:0/2638586143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680033f0 con 0x7ff668004690 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff681596700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff668004b10 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7ff67c0690c0 tx=0x7ff66c007bb0).ready entity=mon.0 client_cookie=71189a0047ef127 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007020 con 0x7ff668004690 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c007180 con 0x7ff668004690 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.748+0000 7ff680d95700 1 -- 172.21.15.133:0/2638586143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c007500 con 0x7ff668004690 2024-01-21T21:33:23.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 -- 172.21.15.133:0/2638586143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 msgr2=0x7ff668004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2638586143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff668004b10 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7ff67c0690c0 tx=0x7ff66c007bb0).stop 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff682598700 1 -- 172.21.15.133:0/2638586143 reap_dead start 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 -- 172.21.15.133:0/2638586143 shutdown_connections 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 -- 172.21.15.133:0/2638586143 >> 172.21.15.133:0/2638586143 conn(0x7ff67c0c7dc0 msgr2=0x7ff67c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 -- 172.21.15.133:0/2638586143 shutdown_connections 2024-01-21T21:33:23.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.749+0000 7ff683ffb700 1 -- 172.21.15.133:0/2638586143 wait complete. 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.750+0000 7ff683ffb700 1 Processor -- start 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.750+0000 7ff683ffb700 1 -- start start 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 0x7ff67c0c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c0c71e0 0x7ff67c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c1230 con 0x7ff668004690 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0add00 con 0x7ff67c0c08e0 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff683ffb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c7b50 con 0x7ff67c0c71e0 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35516/0 (socket says 172.21.15.133:35516) 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 -- 172.21.15.133:0/2978098511 learned_addr learned my addr 172.21.15.133:0/2978098511 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff682598700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c0c71e0 0x7ff67c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681596700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 0x7ff67c0c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 -- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c0c71e0 msgr2=0x7ff67c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c0c71e0 0x7ff67c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 -- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 msgr2=0x7ff67c0c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 0x7ff67c0c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 -- 172.21.15.133:0/2978098511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0c1440 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681596700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 0x7ff67c0c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.751+0000 7ff681d97700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7ff678011a50 tx=0x7ff678009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.752+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800f8e0 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.752+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800fa40 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.752+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0c1720 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.752+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800fdc0 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.752+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c0c1ce0 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.753+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c05fdf0 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.753+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff678014650 con 0x7ff668004690 2024-01-21T21:33:23.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.753+0000 7ff6727fc700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 0x7ff660061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.753+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7ff67807b1c0 con 0x7ff668004690 2024-01-21T21:33:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.753+0000 7ff681596700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 0x7ff660061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.754+0000 7ff681596700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 0x7ff660061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff67c0aa670 tx=0x7ff66c016000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:23.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.757+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff67804c1c0 con 0x7ff668004690 2024-01-21T21:33:23.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.917+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff67c0c4410 con 0x7ff66005f150 2024-01-21T21:33:23.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.926+0000 7ff6727fc700 1 -- 172.21.15.133:0/2978098511 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353464 (secure 0 0 0) 0x7ff67c0c4410 con 0x7ff66005f150 2024-01-21T21:33:23.936 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 msgr2=0x7ff660061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 0x7ff660061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff67c0aa670 tx=0x7ff66c016000).stop 2024-01-21T21:33:23.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 msgr2=0x7ff67c0ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7ff678011a50 tx=0x7ff678009060).stop 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 shutdown_connections 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff67c0c71e0 0x7ff67c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff668004690 0x7ff67c0ad810 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff66005f150 0x7ff660061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.929+0000 7ff683ffb700 1 --2- 172.21.15.133:0/2978098511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff67c0c08e0 0x7ff67c0c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.930+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 >> 172.21.15.133:0/2978098511 conn(0x7ff67c0c7dc0 msgr2=0x7ff67c0bcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.930+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 shutdown_connections 2024-01-21T21:33:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:23.930+0000 7ff683ffb700 1 -- 172.21.15.133:0/2978098511 wait complete. 2024-01-21T21:33:23.943 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:23.944 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:33:22.658392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470384,"kb_used_data":19888,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752504336,"statfs":{"total":773094113280,"available":770564440064,"internally_reserved":0,"allocated":20365312,"data_stored":10998068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27322,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.527040"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222097+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223180+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220541+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224988+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226728+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220253+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222549+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224006+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220015+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224101+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222741+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223828+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224227+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220173+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222340+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223649+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226380+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223338+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224421+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226766+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226275+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226018+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220386+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223257+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222845+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222632+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226335+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223107+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219408+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226259+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222399+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219811+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224040+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223209+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223496+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224545+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219415+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219410+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223680+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223418+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219426+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222087+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225266+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226652+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224456+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223825+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227186+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222487+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222353+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222309+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.221941+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226231+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223645+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227293+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572753+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:17.572753+0000","last_peered":"2024-01-21T21:33:17.572753+0000","last_clean":"2024-01-21T21:33:17.572753+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:17.572753+0000","last_undegraded":"2024-01-21T21:33:17.572753+0000","last_fullsized":"2024-01-21T21:33:17.572753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222002+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212565+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:17.212565+0000","last_peered":"2024-01-21T21:33:17.212565+0000","last_clean":"2024-01-21T21:33:17.212565+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:17.212565+0000","last_undegraded":"2024-01-21T21:33:17.212565+0000","last_fullsized":"2024-01-21T21:33:17.212565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225662+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212214+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:17.212214+0000","last_peered":"2024-01-21T21:33:17.212214+0000","last_clean":"2024-01-21T21:33:17.212214+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:17.212214+0000","last_undegraded":"2024-01-21T21:33:17.212214+0000","last_fullsized":"2024-01-21T21:33:17.212214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223647+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212559+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:17.212559+0000","last_peered":"2024-01-21T21:33:17.212559+0000","last_clean":"2024-01-21T21:33:17.212559+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:17.212559+0000","last_undegraded":"2024-01-21T21:33:17.212559+0000","last_fullsized":"2024-01-21T21:33:17.212559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":167,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745949+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:18.745949+0000","last_peered":"2024-01-21T21:33:18.745949+0000","last_clean":"2024-01-21T21:33:18.745949+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:18.745949+0000","last_undegraded":"2024-01-21T21:33:18.745949+0000","last_fullsized":"2024-01-21T21:33:18.745949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222884+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745925+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:18.745925+0000","last_peered":"2024-01-21T21:33:18.745925+0000","last_clean":"2024-01-21T21:33:18.745925+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:18.745925+0000","last_undegraded":"2024-01-21T21:33:18.745925+0000","last_fullsized":"2024-01-21T21:33:18.745925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745992+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:18.745992+0000","last_peered":"2024-01-21T21:33:18.745992+0000","last_clean":"2024-01-21T21:33:18.745992+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:18.745992+0000","last_undegraded":"2024-01-21T21:33:18.745992+0000","last_fullsized":"2024-01-21T21:33:18.745992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219449+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572741+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:17.572741+0000","last_peered":"2024-01-21T21:33:17.572741+0000","last_clean":"2024-01-21T21:33:17.572741+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:17.572741+0000","last_undegraded":"2024-01-21T21:33:17.572741+0000","last_fullsized":"2024-01-21T21:33:17.572741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223653+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.329800+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:18.329800+0000","last_peered":"2024-01-21T21:33:18.329800+0000","last_clean":"2024-01-21T21:33:18.329800+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:18.329800+0000","last_undegraded":"2024-01-21T21:33:18.329800+0000","last_fullsized":"2024-01-21T21:33:18.329800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064084,"statfs":{"total":96636764160,"available":96321622016,"internally_reserved":0,"allocated":2527232,"data_stored":1365669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059960,"statfs":{"total":96636764160,"available":96317399040,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.255},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.30099999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575971,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2551808,"data_stored":1379195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.251},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.26100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.28999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064056,"statfs":{"total":96636764160,"available":96321593344,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.377}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.62}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.37},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315964,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055876,"statfs":{"total":96636764160,"available":96313217024,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:23.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.097+0000 7f6ba1f5d700 1 Processor -- start 2024-01-21T21:33:24.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.097+0000 7f6ba1f5d700 1 -- start start 2024-01-21T21:33:24.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6ba1f5d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 0x7f6b9c0bd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6ba1f5d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b9c062e00 0x7f6b9c0bd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6ba1f5d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b9c0a50f0 con 0x7f6b9c1558c0 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6ba1f5d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0bdb60 con 0x7f6b9c062e00 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6ba1f5d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0a4da0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6b9bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b9c062e00 0x7f6b9c0bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6b9bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b9c062e00 0x7f6b9c0bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35518/0 (socket says 172.21.15.133:35518) 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6b9bfff700 1 -- 172.21.15.133:0/3197555539 learned_addr learned my addr 172.21.15.133:0/3197555539 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.098+0000 7f6b9b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b9c1558c0 0x7f6b9c0626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59252/0 (socket says 172.21.15.133:59252) 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9affd700 1 --2- 172.21.15.133:0/3197555539 >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 0x7f6b9c0bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9bfff700 1 -- 172.21.15.133:0/3197555539 >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 msgr2=0x7f6b9c0bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9bfff700 1 --2- 172.21.15.133:0/3197555539 >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 0x7f6b9c0bd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9bfff700 1 -- 172.21.15.133:0/3197555539 >> v1:172.21.15.133:6789/0 conn(0x7f6b9c1558c0 legacy=0x7f6b9c0626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9a7fc700 1 -- 172.21.15.133:0/3197555539 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2897402068 0 0) 0x7f6b9c0a50f0 con 0x7f6b9c1558c0 2024-01-21T21:33:24.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9bfff700 1 -- 172.21.15.133:0/3197555539 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c0bde00 con 0x7f6b9c062e00 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9affd700 1 --2- 172.21.15.133:0/3197555539 >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 0x7f6b9c0bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9bfff700 1 --2- 172.21.15.133:0/3197555539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c062e00 0x7f6b9c0bd670 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f6b9c067930 tx=0x7f6b94009840).ready entity=mon.0 client_cookie=abdf2c42e22bd1db server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9a7fc700 1 -- 172.21.15.133:0/3197555539 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400e070 con 0x7f6b9c062e00 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9a7fc700 1 -- 172.21.15.133:0/3197555539 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9400ba50 con 0x7f6b9c062e00 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6b9a7fc700 1 -- 172.21.15.133:0/3197555539 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400bdd0 con 0x7f6b9c062e00 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/3197555539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c062e00 msgr2=0x7f6b9c0bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.099+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/3197555539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c062e00 0x7f6b9c0bd670 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 rx=0x7f6b9c067930 tx=0x7f6b94009840).stop 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/3197555539 shutdown_connections 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/3197555539 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c062e00 0x7f6b9c0bd670 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/3197555539 >> v2:172.21.15.178:3300/0 conn(0x7f6b9c155ca0 0x7f6b9c0bd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/3197555539 >> 172.21.15.133:0/3197555539 conn(0x7f6b9c0c8010 msgr2=0x7f6b9c0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/3197555539 shutdown_connections 2024-01-21T21:33:24.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.100+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/3197555539 wait complete. 2024-01-21T21:33:24.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.101+0000 7f6ba1f5d700 1 Processor -- start 2024-01-21T21:33:24.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.101+0000 7f6ba1f5d700 1 -- start start 2024-01-21T21:33:24.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9c062e00 0x7f6b9c150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b9c1558c0 0x7f6b9c1643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0ac020 con 0x7f6b9c155ca0 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c065b00 con 0x7f6b9c062e00 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0aba60 con 0x7f6b9c1558c0 2024-01-21T21:33:24.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35526/0 (socket says 172.21.15.133:35526) 2024-01-21T21:33:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 -- 172.21.15.133:0/2696464349 learned_addr learned my addr 172.21.15.133:0/2696464349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9affd700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b9c1558c0 0x7f6b9c1643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9b7fe700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9c062e00 0x7f6b9c150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 -- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b9c1558c0 msgr2=0x7f6b9c1643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b9c1558c0 0x7f6b9c1643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 -- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9c062e00 msgr2=0x7f6b9c150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9c062e00 0x7f6b9c150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 -- 172.21.15.133:0/2696464349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b94009ae0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b9bfff700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f6b9c068a00 tx=0x7f6b9c0c3d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9400bdd0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b940032f0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9401d6b0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.102+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c0abd40 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.103+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c0675d0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.103+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c0c2430 con 0x7f6b9c155ca0 2024-01-21T21:33:24.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.104+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6b94003040 con 0x7f6b9c155ca0 2024-01-21T21:33:24.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.104+0000 7f6b83fff700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 0x7f6b88061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.104+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f6b9407b840 con 0x7f6b9c155ca0 2024-01-21T21:33:24.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.104+0000 7f6b9b7fe700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 0x7f6b88061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.104+0000 7f6b9b7fe700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 0x7f6b88061640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6b900011e0 tx=0x7f6b90007180).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.108+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6b9404c8f0 con 0x7f6b9c155ca0 2024-01-21T21:33:24.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.271+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b9c05fdf0 con 0x7f6b8805f180 2024-01-21T21:33:24.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.280+0000 7f6b83fff700 1 -- 172.21.15.133:0/2696464349 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+353464 (secure 0 0 0) 0x7f6b9c05fdf0 con 0x7f6b8805f180 2024-01-21T21:33:24.287 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.283+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 msgr2=0x7f6b88061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.283+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 0x7f6b88061640 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f6b900011e0 tx=0x7f6b90007180).stop 2024-01-21T21:33:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.283+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 msgr2=0x7f6b9c0aafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.283+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 rx=0x7f6b9c068a00 tx=0x7f6b9c0c3d70).stop 2024-01-21T21:33:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.283+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 shutdown_connections 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b9c155ca0 0x7f6b9c0aafc0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6b8805f180 0x7f6b88061640 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b9c062e00 0x7f6b9c150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 --2- 172.21.15.133:0/2696464349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b9c1558c0 0x7f6b9c1643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 >> 172.21.15.133:0/2696464349 conn(0x7f6b9c0c8010 msgr2=0x7f6b9c0c25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 shutdown_connections 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.284+0000 7f6ba1f5d700 1 -- 172.21.15.133:0/2696464349 wait complete. 2024-01-21T21:33:24.293 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:24.298 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:33:22.658392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470384,"kb_used_data":19888,"kb_used_omap":0,"kb_used_meta":2450432,"kb_avail":752504336,"statfs":{"total":773094113280,"available":770564440064,"internally_reserved":0,"allocated":20365312,"data_stored":10998068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2509242368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27322,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.527040"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222097+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223180+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220541+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224988+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226728+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220253+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222549+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224006+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220015+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224101+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222741+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223828+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224227+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220173+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222340+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223649+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226380+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223338+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224421+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226766+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226275+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226018+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220386+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223257+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222845+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222632+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226335+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223107+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219408+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226259+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222399+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219811+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224040+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223209+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223496+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219792+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224545+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219415+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219410+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223680+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223418+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219426+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222087+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225266+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226652+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.224456+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223825+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227186+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222487+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222353+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222309+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.221941+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.226231+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223645+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.227293+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572753+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:17.572753+0000","last_peered":"2024-01-21T21:33:17.572753+0000","last_clean":"2024-01-21T21:33:17.572753+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:17.572753+0000","last_undegraded":"2024-01-21T21:33:17.572753+0000","last_fullsized":"2024-01-21T21:33:17.572753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222002+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212565+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:17.212565+0000","last_peered":"2024-01-21T21:33:17.212565+0000","last_clean":"2024-01-21T21:33:17.212565+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:17.212565+0000","last_undegraded":"2024-01-21T21:33:17.212565+0000","last_fullsized":"2024-01-21T21:33:17.212565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.225662+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212214+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:17.212214+0000","last_peered":"2024-01-21T21:33:17.212214+0000","last_clean":"2024-01-21T21:33:17.212214+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:17.212214+0000","last_undegraded":"2024-01-21T21:33:17.212214+0000","last_fullsized":"2024-01-21T21:33:17.212214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223647+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212559+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:17.212559+0000","last_peered":"2024-01-21T21:33:17.212559+0000","last_clean":"2024-01-21T21:33:17.212559+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:17.212559+0000","last_undegraded":"2024-01-21T21:33:17.212559+0000","last_fullsized":"2024-01-21T21:33:17.212559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":167,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745949+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:18.745949+0000","last_peered":"2024-01-21T21:33:18.745949+0000","last_clean":"2024-01-21T21:33:18.745949+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:18.745949+0000","last_undegraded":"2024-01-21T21:33:18.745949+0000","last_fullsized":"2024-01-21T21:33:18.745949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222884+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745925+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:18.745925+0000","last_peered":"2024-01-21T21:33:18.745925+0000","last_clean":"2024-01-21T21:33:18.745925+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:18.745925+0000","last_undegraded":"2024-01-21T21:33:18.745925+0000","last_fullsized":"2024-01-21T21:33:18.745925+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222809+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.745992+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:18.745992+0000","last_peered":"2024-01-21T21:33:18.745992+0000","last_clean":"2024-01-21T21:33:18.745992+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:18.745992+0000","last_undegraded":"2024-01-21T21:33:18.745992+0000","last_fullsized":"2024-01-21T21:33:18.745992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219449+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.572741+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:17.572741+0000","last_peered":"2024-01-21T21:33:17.572741+0000","last_clean":"2024-01-21T21:33:17.572741+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:17.572741+0000","last_undegraded":"2024-01-21T21:33:17.572741+0000","last_fullsized":"2024-01-21T21:33:17.572741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223653+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:18.329800+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:18.329800+0000","last_peered":"2024-01-21T21:33:18.329800+0000","last_clean":"2024-01-21T21:33:18.329800+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:18.329800+0000","last_undegraded":"2024-01-21T21:33:18.329800+0000","last_fullsized":"2024-01-21T21:33:18.329800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575970,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307756,"kb_used_data":2468,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064084,"statfs":{"total":96636764160,"available":96321622016,"internally_reserved":0,"allocated":2527232,"data_stored":1365669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.621}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56399999999999995}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.51000000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.40500000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.42899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059960,"statfs":{"total":96636764160,"available":96317399040,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.42099999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.52600000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.63600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575972,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303676,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068164,"statfs":{"total":96636764160,"available":96325799936,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.255},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.47799999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.30099999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79200000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.84299999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575971,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2551808,"data_stored":1379195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.31}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.251},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.26100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.28999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575971,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064056,"statfs":{"total":96636764160,"available":96321593344,"internally_reserved":0,"allocated":2555904,"data_stored":1380156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.46000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58999999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.54900000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.499},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.65200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.377}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.432},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.44500000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.62}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.37},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315964,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055876,"statfs":{"total":96636764160,"available":96313217024,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3c is not active+clean 2024-01-21T21:33:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2024-01-21T21:33:24.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222097+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3d is not active+clean 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223180+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3e is not active+clean 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.220541+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3f is not active+clean 2024-01-21T21:33:24.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224988+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.38 is not active+clean 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226728+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.39 is not active+clean 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2024-01-21T21:33:24.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.220253+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3a is not active+clean 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222549+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3b is not active+clean 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224006+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.34 is not active+clean 2024-01-21T21:33:24.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.220015+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.35 is not active+clean 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224101+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.36 is not active+clean 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2024-01-21T21:33:24.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222741+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.37 is not active+clean 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223828+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.30 is not active+clean 2024-01-21T21:33:24.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224227+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.31 is not active+clean 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.220173+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.32 is not active+clean 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2024-01-21T21:33:24.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222340+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.33 is not active+clean 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223649+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2c is not active+clean 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226380+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2d is not active+clean 2024-01-21T21:33:24.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223338+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2e is not active+clean 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224421+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2f is not active+clean 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226766+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.28 is not active+clean 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226275+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.29 is not active+clean 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226018+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2a is not active+clean 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.220386+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2b is not active+clean 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223257+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.24 is not active+clean 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222845+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.25 is not active+clean 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222632+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.26 is not active+clean 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2024-01-21T21:33:24.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219792+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.27 is not active+clean 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226335+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.20 is not active+clean 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223107+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.21 is not active+clean 2024-01-21T21:33:24.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219408+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.22 is not active+clean 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219809+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.23 is not active+clean 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2024-01-21T21:33:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226259+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.14 is not active+clean 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222399+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.15 is not active+clean 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219811+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.16 is not active+clean 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224040+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.17 is not active+clean 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223209+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.10 is not active+clean 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2024-01-21T21:33:24.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223496+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.11 is not active+clean 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219792+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.12 is not active+clean 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224545+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.13 is not active+clean 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219415+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.c is not active+clean 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2024-01-21T21:33:24.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219410+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.d is not active+clean 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223680+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.e is not active+clean 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223418+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.f is not active+clean 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219426+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.8 is not active+clean 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222087+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.9 is not active+clean 2024-01-21T21:33:24.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.225266+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.a is not active+clean 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226652+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.b is not active+clean 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.224456+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.4 is not active+clean 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223825+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.5 is not active+clean 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2024-01-21T21:33:24.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.227186+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.6 is not active+clean 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222487+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.7 is not active+clean 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222353+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.0 is not active+clean 2024-01-21T21:33:24.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222309+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1 is not active+clean 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.221941+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.2 is not active+clean 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.226231+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.3 is not active+clean 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223645+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1c is not active+clean 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.227293+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1a is not active+clean 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222002+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.19 is not active+clean 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.225662+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1b is not active+clean 2024-01-21T21:33:24.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2024-01-21T21:33:24.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223647+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.18 is not active+clean 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222884+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1d is not active+clean 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.222809+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-21T21:33:24.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1e is not active+clean 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.219449+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 26.1f is not active+clean 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-01-21T21:33:20.216437+0000', 'last_change': '2024-01-21T21:33:20.216437+0000', 'last_active': '2024-01-21T21:33:20.216437+0000', 'last_peered': '2024-01-21T21:33:20.216437+0000', 'last_clean': '2024-01-21T21:33:20.216437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:20.216437+0000', 'last_undegraded': '2024-01-21T21:33:20.216437+0000', 'last_fullsized': '2024-01-21T21:33:20.216437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:20.216437+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2024-01-21T21:33:24.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2024-01-21T21:33:19.212221+0000', 'last_change': '2024-01-21T21:33:19.223653+0000', 'last_active': '2024-01-21T21:33:19.212221+0000', 'last_peered': '2024-01-21T21:33:19.212221+0000', 'last_clean': '2024-01-21T21:33:19.212221+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-21T21:33:19.212221+0000', 'last_undegraded': '2024-01-21T21:33:19.212221+0000', 'last_fullsized': '2024-01-21T21:33:19.212221+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'last_clean_scrub_stamp': '2024-01-21T21:33:19.212221+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-21T21:33:24.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-21T21:33:24.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.450+0000 7f3c14368700 1 Processor -- start 2024-01-21T21:33:24.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.450+0000 7f3c14368700 1 -- start start 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137030 0x7f3c0c067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c0c137410 0x7f3c0c155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c62d0 con 0x7f3c0c0c5930 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c1557f0 con 0x7f3c0c137410 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c14368700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c068370 con 0x7f3c0c137030 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.451+0000 7f3c12905700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35532/0 (socket says 172.21.15.133:35532) 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 -- 172.21.15.133:0/2292240237 learned_addr learned my addr 172.21.15.133:0/2292240237 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12104700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137030 0x7f3c0c067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c11903700 1 --2- 172.21.15.133:0/2292240237 >> v2:172.21.15.178:3300/0 conn(0x7f3c0c137410 0x7f3c0c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 -- 172.21.15.133:0/2292240237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137030 msgr2=0x7f3c0c067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:24.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137030 0x7f3c0c067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 -- 172.21.15.133:0/2292240237 >> v2:172.21.15.178:3300/0 conn(0x7f3c0c137410 msgr2=0x7f3c0c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 --2- 172.21.15.133:0/2292240237 >> v2:172.21.15.178:3300/0 conn(0x7f3c0c137410 0x7f3c0c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 -- 172.21.15.133:0/2292240237 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c068650 con 0x7f3c0c0c5930 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c12905700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f3c0c0664d0 tx=0x7f3c04009840).ready entity=mon.0 client_cookie=cfb58725eea4e888 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c11102700 1 -- 172.21.15.133:0/2292240237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400e070 con 0x7f3c0c0c5930 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c11102700 1 -- 172.21.15.133:0/2292240237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400ba50 con 0x7f3c0c0c5930 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.452+0000 7f3c11102700 1 -- 172.21.15.133:0/2292240237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0400bdd0 con 0x7f3c0c0c5930 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 -- 172.21.15.133:0/2292240237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c0c5930 msgr2=0x7f3c0c0c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f3c0c0664d0 tx=0x7f3c04009840).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 -- 172.21.15.133:0/2292240237 shutdown_connections 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c0c5de0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 --2- 172.21.15.133:0/2292240237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137030 0x7f3c0c067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 --2- 172.21.15.133:0/2292240237 >> v2:172.21.15.178:3300/0 conn(0x7f3c0c137410 0x7f3c0c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 -- 172.21.15.133:0/2292240237 >> 172.21.15.133:0/2292240237 conn(0x7f3c0c066a90 msgr2=0x7f3c0c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:24.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 -- 172.21.15.133:0/2292240237 shutdown_connections 2024-01-21T21:33:24.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.453+0000 7f3c14368700 1 -- 172.21.15.133:0/2292240237 wait complete. 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.454+0000 7f3c14368700 1 Processor -- start 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.454+0000 7f3c14368700 1 -- start start 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c13ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137410 0x7f3c0c137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c163dc0 con 0x7f3c0c137030 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c138430 con 0x7f3c0c0c5930 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c14368700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c138710 con 0x7f3c0c137410 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c11903700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c11903700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35536/0 (socket says 172.21.15.133:35536) 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.455+0000 7f3c11903700 1 -- 172.21.15.133:0/3350049504 learned_addr learned my addr 172.21.15.133:0/3350049504 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c12905700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137410 0x7f3c0c137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c12104700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c13ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 -- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137410 msgr2=0x7f3c0c137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137410 0x7f3c0c137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 -- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0c0c5930 msgr2=0x7f3c0c13ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c13ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 -- 172.21.15.133:0/3350049504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c04009ae0 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c11903700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f3c0800d890 tx=0x7f3c08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011590 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080116f0 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c1389f0 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08011a70 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.456+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c138fb0 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.457+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c05fdf0 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.457+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3c08012420 con 0x7f3c0c137030 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.458+0000 7f3bfeffd700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 0x7f3bf0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.458+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f3c08079f10 con 0x7f3c0c137030 2024-01-21T21:33:24.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.458+0000 7f3c12104700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 0x7f3bf0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.458+0000 7f3c12104700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 0x7f3bf0061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3c00006fd0 tx=0x7f3c00008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.462+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c0804aeb0 con 0x7f3c0c137030 2024-01-21T21:33:24.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.690+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3c0c0c5e40 con 0x7f3c0c137030 2024-01-21T21:33:24.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.691+0000 7f3bfeffd700 1 -- 172.21.15.133:0/3350049504 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1114 (secure 0 0 0) 0x7f3c0804e4d0 con 0x7f3c0c137030 2024-01-21T21:33:24.693 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:24.694 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5675,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":207,"num_osds":8,"num_up_osds":8,"osd_up_since":1705867137,"num_in_osds":8,"osd_in_since":1705867131,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"unknown","count":64},{"state_name":"active+clean","count":9}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2529673216,"bytes_avail":770564440064,"bytes_total":773094113280,"unknown_pgs_ratio":0.46715328097343445,"inactive_pgs_ratio":0.46715328097343445},"fsmap":{"epoch":74,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"d","status":"up:active","gid":10053}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2024-01-21T21:32:54.424204+0000","services":{}},"progress_events":{}} 2024-01-21T21:33:24.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 msgr2=0x7f3bf0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 0x7f3bf0061610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3c00006fd0 tx=0x7f3c00008040).stop 2024-01-21T21:33:24.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 msgr2=0x7f3c0c1638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x7f3c0800d890 tx=0x7f3c08008040).stop 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 shutdown_connections 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0c137410 0x7f3c0c137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3bf005f150 0x7f3bf0061610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0c0c5930 0x7f3c0c13ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 --2- 172.21.15.133:0/3350049504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c0c137030 0x7f3c0c1638d0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 >> 172.21.15.133:0/3350049504 conn(0x7f3c0c066a90 msgr2=0x7f3c0c136380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.692+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 shutdown_connections 2024-01-21T21:33:24.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.693+0000 7f3c14368700 1 -- 172.21.15.133:0/3350049504 wait complete. 2024-01-21T21:33:24.707 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-21T21:33:24.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:24.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.821+0000 7f4b3bc89700 1 Processor -- start 2024-01-21T21:33:24.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.821+0000 7f4b3bc89700 1 -- start start 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3bc89700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4b341546b0 0x7f4b34154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3bc89700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b340bc6d0 0x7f4b34066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3bc89700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b340654f0 con 0x7f4b340a9e30 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3bc89700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b34063700 con 0x7f4b340bc6d0 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3bc89700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b34063950 con 0x7f4b341546b0 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4b340bc6d0 0x7f4b34066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b39224700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4b340a9e30 0x7f4b34065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59266/0 (socket says 172.21.15.133:59266) 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b39224700 1 -- 172.21.15.133:0/3710020832 learned_addr learned my addr 172.21.15.133:0/3710020832 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 -- 172.21.15.133:0/3710020832 >> v2:172.21.15.178:3300/0 conn(0x7f4b341546b0 msgr2=0x7f4b34154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:24.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b39a25700 1 --2- 172.21.15.133:0/3710020832 >> v2:172.21.15.178:3300/0 conn(0x7f4b341546b0 0x7f4b34154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 --2- 172.21.15.133:0/3710020832 >> v2:172.21.15.178:3300/0 conn(0x7f4b341546b0 0x7f4b34154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b38a23700 1 -- 172.21.15.133:0/3710020832 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130211876 0 0) 0x7f4b340654f0 con 0x7f4b340a9e30 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 -- 172.21.15.133:0/3710020832 >> v1:172.21.15.133:6789/0 conn(0x7f4b340a9e30 legacy=0x7f4b34065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 -- 172.21.15.133:0/3710020832 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34065180 con 0x7f4b340bc6d0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b3a226700 1 --2- 172.21.15.133:0/3710020832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340bc6d0 0x7f4b34066090 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f4b3405f0d0 tx=0x7f4b2c009060).ready entity=mon.0 client_cookie=6202ee9f54f603bd server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b38a23700 1 -- 172.21.15.133:0/3710020832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0090d0 con 0x7f4b340bc6d0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b38a23700 1 -- 172.21.15.133:0/3710020832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c00b580 con 0x7f4b340bc6d0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.822+0000 7f4b38a23700 1 -- 172.21.15.133:0/3710020832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c00b900 con 0x7f4b340bc6d0 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 -- 172.21.15.133:0/3710020832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340bc6d0 msgr2=0x7f4b34066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/3710020832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340bc6d0 0x7f4b34066090 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f4b3405f0d0 tx=0x7f4b2c009060).stop 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 -- 172.21.15.133:0/3710020832 shutdown_connections 2024-01-21T21:33:24.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/3710020832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340bc6d0 0x7f4b34066090 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/3710020832 >> v2:172.21.15.178:3300/0 conn(0x7f4b341546b0 0x7f4b34154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 -- 172.21.15.133:0/3710020832 >> 172.21.15.133:0/3710020832 conn(0x7f4b340c8200 msgr2=0x7f4b340c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 -- 172.21.15.133:0/3710020832 shutdown_connections 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.823+0000 7f4b3bc89700 1 -- 172.21.15.133:0/3710020832 wait complete. 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.824+0000 7f4b3bc89700 1 Processor -- start 2024-01-21T21:33:24.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.824+0000 7f4b3bc89700 1 -- start start 2024-01-21T21:33:24.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 0x7f4b340bf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 0x7f4b340bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340beb60 con 0x7f4b340a9e30 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340acc60 con 0x7f4b341546b0 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3bc89700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b340ac050 con 0x7f4b340bc6d0 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35562/0 (socket says 172.21.15.133:35562) 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 -- 172.21.15.133:0/2175466940 learned_addr learned my addr 172.21.15.133:0/2175466940 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39224700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 0x7f4b340bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3a226700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 0x7f4b340bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 -- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 msgr2=0x7f4b340bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 0x7f4b340bf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 -- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 msgr2=0x7f4b340bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 0x7f4b340bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39a25700 1 -- 172.21.15.133:0/2175466940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0092a0 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b39224700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 0x7f4b340bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.825+0000 7f4b3a226700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 0x7f4b340bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b39a25700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f4b3000ce60 tx=0x7f4b300077f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000ab90 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3000acf0 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b340ac330 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000f610 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.826+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b340ac8f0 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.827+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b340acf40 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.827+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f4b3000d040 con 0x7f4b340a9e30 2024-01-21T21:33:24.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.827+0000 7f4b2a7fc700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 0x7f4b18061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.827+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f4b3007a7a0 con 0x7f4b340a9e30 2024-01-21T21:33:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.828+0000 7f4b39224700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 0x7f4b18061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.828+0000 7f4b39224700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 0x7f4b18061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4b340c0490 tx=0x7f4b24009040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:24.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.832+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f4b3004b7a0 con 0x7f4b340a9e30 2024-01-21T21:33:24.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.990+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b3414e5f0 con 0x7f4b1805f150 2024-01-21T21:33:25.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:24.999+0000 7f4b2a7fc700 1 -- 172.21.15.133:0/2175466940 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+360208 (secure 0 0 0) 0x7f4b3414e5f0 con 0x7f4b1805f150 2024-01-21T21:33:25.010 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 msgr2=0x7f4b18061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 0x7f4b18061610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4b340c0490 tx=0x7f4b24009040).stop 2024-01-21T21:33:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 msgr2=0x7f4b340ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f4b3000ce60 tx=0x7f4b300077f0).stop 2024-01-21T21:33:25.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 shutdown_connections 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f4b1805f150 0x7f4b18061610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b341546b0 0x7f4b340bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b340a9e30 0x7f4b340ad0f0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 --2- 172.21.15.133:0/2175466940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b340bc6d0 0x7f4b340bf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 >> 172.21.15.133:0/2175466940 conn(0x7f4b340c8200 msgr2=0x7f4b34158400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 shutdown_connections 2024-01-21T21:33:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:25.003+0000 7f4b3bc89700 1 -- 172.21.15.133:0/2175466940 wait complete. 2024-01-21T21:33:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:25.018 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-01-21T21:33:24.658771+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1606,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":246,"acting":246,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2474780,"kb_used_data":20188,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499940,"statfs":{"total":773094113280,"available":770559938560,"internally_reserved":0,"allocated":20672512,"data_stored":11164846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-27322,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-77,"num_write_kb":-58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.527040"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631946+0000","last_change":"2024-01-21T21:33:20.631195+0000","last_active":"2024-01-21T21:33:20.631946+0000","last_peered":"2024-01-21T21:33:20.631946+0000","last_clean":"2024-01-21T21:33:20.631946+0000","last_became_active":"2024-01-21T21:33:20.630907+0000","last_became_peered":"2024-01-21T21:33:20.630907+0000","last_unstale":"2024-01-21T21:33:20.631946+0000","last_undegraded":"2024-01-21T21:33:20.631946+0000","last_fullsized":"2024-01-21T21:33:20.631946+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"206'3","reported_seq":13,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625330+0000","last_change":"2024-01-21T21:33:20.250531+0000","last_active":"2024-01-21T21:33:20.625330+0000","last_peered":"2024-01-21T21:33:20.625330+0000","last_clean":"2024-01-21T21:33:20.625330+0000","last_became_active":"2024-01-21T21:33:20.250254+0000","last_became_peered":"2024-01-21T21:33:20.250254+0000","last_unstale":"2024-01-21T21:33:20.625330+0000","last_undegraded":"2024-01-21T21:33:20.625330+0000","last_fullsized":"2024-01-21T21:33:20.625330+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623843+0000","last_change":"2024-01-21T21:33:20.621764+0000","last_active":"2024-01-21T21:33:20.623843+0000","last_peered":"2024-01-21T21:33:20.623843+0000","last_clean":"2024-01-21T21:33:20.623843+0000","last_became_active":"2024-01-21T21:33:20.621439+0000","last_became_peered":"2024-01-21T21:33:20.621439+0000","last_unstale":"2024-01-21T21:33:20.623843+0000","last_undegraded":"2024-01-21T21:33:20.623843+0000","last_fullsized":"2024-01-21T21:33:20.623843+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610879+0000","last_change":"2024-01-21T21:33:20.240297+0000","last_active":"2024-01-21T21:33:20.610879+0000","last_peered":"2024-01-21T21:33:20.610879+0000","last_clean":"2024-01-21T21:33:20.610879+0000","last_became_active":"2024-01-21T21:33:20.240014+0000","last_became_peered":"2024-01-21T21:33:20.240014+0000","last_unstale":"2024-01-21T21:33:20.610879+0000","last_undegraded":"2024-01-21T21:33:20.610879+0000","last_fullsized":"2024-01-21T21:33:20.610879+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632093+0000","last_change":"2024-01-21T21:33:20.617373+0000","last_active":"2024-01-21T21:33:20.632093+0000","last_peered":"2024-01-21T21:33:20.632093+0000","last_clean":"2024-01-21T21:33:20.632093+0000","last_became_active":"2024-01-21T21:33:20.617103+0000","last_became_peered":"2024-01-21T21:33:20.617103+0000","last_unstale":"2024-01-21T21:33:20.632093+0000","last_undegraded":"2024-01-21T21:33:20.632093+0000","last_fullsized":"2024-01-21T21:33:20.632093+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611264+0000","last_change":"2024-01-21T21:33:20.252657+0000","last_active":"2024-01-21T21:33:20.611264+0000","last_peered":"2024-01-21T21:33:20.611264+0000","last_clean":"2024-01-21T21:33:20.611264+0000","last_became_active":"2024-01-21T21:33:20.252165+0000","last_became_peered":"2024-01-21T21:33:20.252165+0000","last_unstale":"2024-01-21T21:33:20.611264+0000","last_undegraded":"2024-01-21T21:33:20.611264+0000","last_fullsized":"2024-01-21T21:33:20.611264+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632780+0000","last_change":"2024-01-21T21:33:20.623710+0000","last_active":"2024-01-21T21:33:20.632780+0000","last_peered":"2024-01-21T21:33:20.632780+0000","last_clean":"2024-01-21T21:33:20.632780+0000","last_became_active":"2024-01-21T21:33:20.623301+0000","last_became_peered":"2024-01-21T21:33:20.623301+0000","last_unstale":"2024-01-21T21:33:20.632780+0000","last_undegraded":"2024-01-21T21:33:20.632780+0000","last_fullsized":"2024-01-21T21:33:20.632780+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626024+0000","last_change":"2024-01-21T21:33:20.240272+0000","last_active":"2024-01-21T21:33:20.626024+0000","last_peered":"2024-01-21T21:33:20.626024+0000","last_clean":"2024-01-21T21:33:20.626024+0000","last_became_active":"2024-01-21T21:33:20.239980+0000","last_became_peered":"2024-01-21T21:33:20.239980+0000","last_unstale":"2024-01-21T21:33:20.626024+0000","last_undegraded":"2024-01-21T21:33:20.626024+0000","last_fullsized":"2024-01-21T21:33:20.626024+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626731+0000","last_change":"2024-01-21T21:33:20.625417+0000","last_active":"2024-01-21T21:33:20.626731+0000","last_peered":"2024-01-21T21:33:20.626731+0000","last_clean":"2024-01-21T21:33:20.626731+0000","last_became_active":"2024-01-21T21:33:20.625132+0000","last_became_peered":"2024-01-21T21:33:20.625132+0000","last_unstale":"2024-01-21T21:33:20.626731+0000","last_undegraded":"2024-01-21T21:33:20.626731+0000","last_fullsized":"2024-01-21T21:33:20.626731+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621323+0000","last_change":"2024-01-21T21:33:20.231214+0000","last_active":"2024-01-21T21:33:20.621323+0000","last_peered":"2024-01-21T21:33:20.621323+0000","last_clean":"2024-01-21T21:33:20.621323+0000","last_became_active":"2024-01-21T21:33:20.230873+0000","last_became_peered":"2024-01-21T21:33:20.230873+0000","last_unstale":"2024-01-21T21:33:20.621323+0000","last_undegraded":"2024-01-21T21:33:20.621323+0000","last_fullsized":"2024-01-21T21:33:20.621323+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.622275+0000","last_change":"2024-01-21T21:33:20.619573+0000","last_active":"2024-01-21T21:33:20.622275+0000","last_peered":"2024-01-21T21:33:20.622275+0000","last_clean":"2024-01-21T21:33:20.622275+0000","last_became_active":"2024-01-21T21:33:20.619293+0000","last_became_peered":"2024-01-21T21:33:20.619293+0000","last_unstale":"2024-01-21T21:33:20.622275+0000","last_undegraded":"2024-01-21T21:33:20.622275+0000","last_fullsized":"2024-01-21T21:33:20.622275+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632189+0000","last_change":"2024-01-21T21:33:20.252243+0000","last_active":"2024-01-21T21:33:20.632189+0000","last_peered":"2024-01-21T21:33:20.632189+0000","last_clean":"2024-01-21T21:33:20.632189+0000","last_became_active":"2024-01-21T21:33:20.251952+0000","last_became_peered":"2024-01-21T21:33:20.251952+0000","last_unstale":"2024-01-21T21:33:20.632189+0000","last_undegraded":"2024-01-21T21:33:20.632189+0000","last_fullsized":"2024-01-21T21:33:20.632189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625102+0000","last_change":"2024-01-21T21:33:20.617096+0000","last_active":"2024-01-21T21:33:20.625102+0000","last_peered":"2024-01-21T21:33:20.625102+0000","last_clean":"2024-01-21T21:33:20.625102+0000","last_became_active":"2024-01-21T21:33:20.616816+0000","last_became_peered":"2024-01-21T21:33:20.616816+0000","last_unstale":"2024-01-21T21:33:20.625102+0000","last_undegraded":"2024-01-21T21:33:20.625102+0000","last_fullsized":"2024-01-21T21:33:20.625102+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222549+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624912+0000","last_change":"2024-01-21T21:33:20.615317+0000","last_active":"2024-01-21T21:33:20.624912+0000","last_peered":"2024-01-21T21:33:20.624912+0000","last_clean":"2024-01-21T21:33:20.624912+0000","last_became_active":"2024-01-21T21:33:20.615065+0000","last_became_peered":"2024-01-21T21:33:20.615065+0000","last_unstale":"2024-01-21T21:33:20.624912+0000","last_undegraded":"2024-01-21T21:33:20.624912+0000","last_fullsized":"2024-01-21T21:33:20.624912+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606040+0000","last_change":"2024-01-21T21:33:20.240324+0000","last_active":"2024-01-21T21:33:20.606040+0000","last_peered":"2024-01-21T21:33:20.606040+0000","last_clean":"2024-01-21T21:33:20.606040+0000","last_became_active":"2024-01-21T21:33:20.240031+0000","last_became_peered":"2024-01-21T21:33:20.240031+0000","last_unstale":"2024-01-21T21:33:20.606040+0000","last_undegraded":"2024-01-21T21:33:20.606040+0000","last_fullsized":"2024-01-21T21:33:20.606040+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617512+0000","last_change":"2024-01-21T21:33:20.613871+0000","last_active":"2024-01-21T21:33:20.617512+0000","last_peered":"2024-01-21T21:33:20.617512+0000","last_clean":"2024-01-21T21:33:20.617512+0000","last_became_active":"2024-01-21T21:33:20.613445+0000","last_became_peered":"2024-01-21T21:33:20.613445+0000","last_unstale":"2024-01-21T21:33:20.617512+0000","last_undegraded":"2024-01-21T21:33:20.617512+0000","last_fullsized":"2024-01-21T21:33:20.617512+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220015+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.609190+0000","last_change":"2024-01-21T21:33:20.253769+0000","last_active":"2024-01-21T21:33:20.609190+0000","last_peered":"2024-01-21T21:33:20.609190+0000","last_clean":"2024-01-21T21:33:20.609190+0000","last_became_active":"2024-01-21T21:33:20.253312+0000","last_became_peered":"2024-01-21T21:33:20.253312+0000","last_unstale":"2024-01-21T21:33:20.609190+0000","last_undegraded":"2024-01-21T21:33:20.609190+0000","last_fullsized":"2024-01-21T21:33:20.609190+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631480+0000","last_change":"2024-01-21T21:33:20.630384+0000","last_active":"2024-01-21T21:33:20.631480+0000","last_peered":"2024-01-21T21:33:20.631480+0000","last_clean":"2024-01-21T21:33:20.631480+0000","last_became_active":"2024-01-21T21:33:20.630092+0000","last_became_peered":"2024-01-21T21:33:20.630092+0000","last_unstale":"2024-01-21T21:33:20.631480+0000","last_undegraded":"2024-01-21T21:33:20.631480+0000","last_fullsized":"2024-01-21T21:33:20.631480+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222741+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632759+0000","last_change":"2024-01-21T21:33:20.623544+0000","last_active":"2024-01-21T21:33:20.632759+0000","last_peered":"2024-01-21T21:33:20.632759+0000","last_clean":"2024-01-21T21:33:20.632759+0000","last_became_active":"2024-01-21T21:33:20.622938+0000","last_became_peered":"2024-01-21T21:33:20.622938+0000","last_unstale":"2024-01-21T21:33:20.632759+0000","last_undegraded":"2024-01-21T21:33:20.632759+0000","last_fullsized":"2024-01-21T21:33:20.632759+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"206'4","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627128+0000","last_change":"2024-01-21T21:33:20.241972+0000","last_active":"2024-01-21T21:33:20.627128+0000","last_peered":"2024-01-21T21:33:20.627128+0000","last_clean":"2024-01-21T21:33:20.627128+0000","last_became_active":"2024-01-21T21:33:20.241360+0000","last_became_peered":"2024-01-21T21:33:20.241360+0000","last_unstale":"2024-01-21T21:33:20.627128+0000","last_undegraded":"2024-01-21T21:33:20.627128+0000","last_fullsized":"2024-01-21T21:33:20.627128+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625232+0000","last_change":"2024-01-21T21:33:20.617222+0000","last_active":"2024-01-21T21:33:20.625232+0000","last_peered":"2024-01-21T21:33:20.625232+0000","last_clean":"2024-01-21T21:33:20.625232+0000","last_became_active":"2024-01-21T21:33:20.614620+0000","last_became_peered":"2024-01-21T21:33:20.614620+0000","last_unstale":"2024-01-21T21:33:20.625232+0000","last_undegraded":"2024-01-21T21:33:20.625232+0000","last_fullsized":"2024-01-21T21:33:20.625232+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628513+0000","last_change":"2024-01-21T21:33:20.239569+0000","last_active":"2024-01-21T21:33:20.628513+0000","last_peered":"2024-01-21T21:33:20.628513+0000","last_clean":"2024-01-21T21:33:20.628513+0000","last_became_active":"2024-01-21T21:33:20.239286+0000","last_became_peered":"2024-01-21T21:33:20.239286+0000","last_unstale":"2024-01-21T21:33:20.628513+0000","last_undegraded":"2024-01-21T21:33:20.628513+0000","last_fullsized":"2024-01-21T21:33:20.628513+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632797+0000","last_change":"2024-01-21T21:33:20.627722+0000","last_active":"2024-01-21T21:33:20.632797+0000","last_peered":"2024-01-21T21:33:20.632797+0000","last_clean":"2024-01-21T21:33:20.632797+0000","last_became_active":"2024-01-21T21:33:20.627381+0000","last_became_peered":"2024-01-21T21:33:20.627381+0000","last_unstale":"2024-01-21T21:33:20.632797+0000","last_undegraded":"2024-01-21T21:33:20.632797+0000","last_fullsized":"2024-01-21T21:33:20.632797+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.220173+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628884+0000","last_change":"2024-01-21T21:33:20.627809+0000","last_active":"2024-01-21T21:33:20.628884+0000","last_peered":"2024-01-21T21:33:20.628884+0000","last_clean":"2024-01-21T21:33:20.628884+0000","last_became_active":"2024-01-21T21:33:20.627521+0000","last_became_peered":"2024-01-21T21:33:20.627521+0000","last_unstale":"2024-01-21T21:33:20.628884+0000","last_undegraded":"2024-01-21T21:33:20.628884+0000","last_fullsized":"2024-01-21T21:33:20.628884+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611336+0000","last_change":"2024-01-21T21:33:20.242268+0000","last_active":"2024-01-21T21:33:20.611336+0000","last_peered":"2024-01-21T21:33:20.611336+0000","last_clean":"2024-01-21T21:33:20.611336+0000","last_became_active":"2024-01-21T21:33:20.241375+0000","last_became_peered":"2024-01-21T21:33:20.241375+0000","last_unstale":"2024-01-21T21:33:20.611336+0000","last_undegraded":"2024-01-21T21:33:20.611336+0000","last_fullsized":"2024-01-21T21:33:20.611336+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"206'4","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625045+0000","last_change":"2024-01-21T21:33:20.241884+0000","last_active":"2024-01-21T21:33:20.625045+0000","last_peered":"2024-01-21T21:33:20.625045+0000","last_clean":"2024-01-21T21:33:20.625045+0000","last_became_active":"2024-01-21T21:33:20.241547+0000","last_became_peered":"2024-01-21T21:33:20.241547+0000","last_unstale":"2024-01-21T21:33:20.625045+0000","last_undegraded":"2024-01-21T21:33:20.625045+0000","last_fullsized":"2024-01-21T21:33:20.625045+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617227+0000","last_change":"2024-01-21T21:33:20.613975+0000","last_active":"2024-01-21T21:33:20.617227+0000","last_peered":"2024-01-21T21:33:20.617227+0000","last_clean":"2024-01-21T21:33:20.617227+0000","last_became_active":"2024-01-21T21:33:20.613719+0000","last_became_peered":"2024-01-21T21:33:20.613719+0000","last_unstale":"2024-01-21T21:33:20.617227+0000","last_undegraded":"2024-01-21T21:33:20.617227+0000","last_fullsized":"2024-01-21T21:33:20.617227+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602034+0000","last_change":"2024-01-21T21:33:20.245342+0000","last_active":"2024-01-21T21:33:20.602034+0000","last_peered":"2024-01-21T21:33:20.602034+0000","last_clean":"2024-01-21T21:33:20.602034+0000","last_became_active":"2024-01-21T21:33:20.245051+0000","last_became_peered":"2024-01-21T21:33:20.245051+0000","last_unstale":"2024-01-21T21:33:20.602034+0000","last_undegraded":"2024-01-21T21:33:20.602034+0000","last_fullsized":"2024-01-21T21:33:20.602034+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.618027+0000","last_change":"2024-01-21T21:33:20.246380+0000","last_active":"2024-01-21T21:33:20.618027+0000","last_peered":"2024-01-21T21:33:20.618027+0000","last_clean":"2024-01-21T21:33:20.618027+0000","last_became_active":"2024-01-21T21:33:20.246095+0000","last_became_peered":"2024-01-21T21:33:20.246095+0000","last_unstale":"2024-01-21T21:33:20.618027+0000","last_undegraded":"2024-01-21T21:33:20.618027+0000","last_fullsized":"2024-01-21T21:33:20.618027+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621662+0000","last_change":"2024-01-21T21:33:20.234692+0000","last_active":"2024-01-21T21:33:20.621662+0000","last_peered":"2024-01-21T21:33:20.621662+0000","last_clean":"2024-01-21T21:33:20.621662+0000","last_became_active":"2024-01-21T21:33:20.234399+0000","last_became_peered":"2024-01-21T21:33:20.234399+0000","last_unstale":"2024-01-21T21:33:20.621662+0000","last_undegraded":"2024-01-21T21:33:20.621662+0000","last_fullsized":"2024-01-21T21:33:20.621662+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625281+0000","last_change":"2024-01-21T21:33:20.623258+0000","last_active":"2024-01-21T21:33:20.625281+0000","last_peered":"2024-01-21T21:33:20.625281+0000","last_clean":"2024-01-21T21:33:20.625281+0000","last_became_active":"2024-01-21T21:33:20.622958+0000","last_became_peered":"2024-01-21T21:33:20.622958+0000","last_unstale":"2024-01-21T21:33:20.625281+0000","last_undegraded":"2024-01-21T21:33:20.625281+0000","last_fullsized":"2024-01-21T21:33:20.625281+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602171+0000","last_change":"2024-01-21T21:33:20.245378+0000","last_active":"2024-01-21T21:33:20.602171+0000","last_peered":"2024-01-21T21:33:20.602171+0000","last_clean":"2024-01-21T21:33:20.602171+0000","last_became_active":"2024-01-21T21:33:20.244898+0000","last_became_peered":"2024-01-21T21:33:20.244898+0000","last_unstale":"2024-01-21T21:33:20.602171+0000","last_undegraded":"2024-01-21T21:33:20.602171+0000","last_fullsized":"2024-01-21T21:33:20.602171+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632168+0000","last_change":"2024-01-21T21:33:20.618783+0000","last_active":"2024-01-21T21:33:20.632168+0000","last_peered":"2024-01-21T21:33:20.632168+0000","last_clean":"2024-01-21T21:33:20.632168+0000","last_became_active":"2024-01-21T21:33:20.618524+0000","last_became_peered":"2024-01-21T21:33:20.618524+0000","last_unstale":"2024-01-21T21:33:20.632168+0000","last_undegraded":"2024-01-21T21:33:20.632168+0000","last_fullsized":"2024-01-21T21:33:20.632168+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621439+0000","last_change":"2024-01-21T21:33:20.230042+0000","last_active":"2024-01-21T21:33:20.621439+0000","last_peered":"2024-01-21T21:33:20.621439+0000","last_clean":"2024-01-21T21:33:20.621439+0000","last_became_active":"2024-01-21T21:33:20.229731+0000","last_became_peered":"2024-01-21T21:33:20.229731+0000","last_unstale":"2024-01-21T21:33:20.621439+0000","last_undegraded":"2024-01-21T21:33:20.621439+0000","last_fullsized":"2024-01-21T21:33:20.621439+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.633318+0000","last_change":"2024-01-21T21:33:20.632747+0000","last_active":"2024-01-21T21:33:20.633318+0000","last_peered":"2024-01-21T21:33:20.633318+0000","last_clean":"2024-01-21T21:33:20.633318+0000","last_became_active":"2024-01-21T21:33:20.632507+0000","last_became_peered":"2024-01-21T21:33:20.632507+0000","last_unstale":"2024-01-21T21:33:20.633318+0000","last_undegraded":"2024-01-21T21:33:20.633318+0000","last_fullsized":"2024-01-21T21:33:20.633318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604760+0000","last_change":"2024-01-21T21:33:20.243821+0000","last_active":"2024-01-21T21:33:20.604760+0000","last_peered":"2024-01-21T21:33:20.604760+0000","last_clean":"2024-01-21T21:33:20.604760+0000","last_became_active":"2024-01-21T21:33:20.242862+0000","last_became_peered":"2024-01-21T21:33:20.242862+0000","last_unstale":"2024-01-21T21:33:20.604760+0000","last_undegraded":"2024-01-21T21:33:20.604760+0000","last_fullsized":"2024-01-21T21:33:20.604760+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632538+0000","last_change":"2024-01-21T21:33:20.622669+0000","last_active":"2024-01-21T21:33:20.632538+0000","last_peered":"2024-01-21T21:33:20.632538+0000","last_clean":"2024-01-21T21:33:20.632538+0000","last_became_active":"2024-01-21T21:33:20.622411+0000","last_became_peered":"2024-01-21T21:33:20.622411+0000","last_unstale":"2024-01-21T21:33:20.632538+0000","last_undegraded":"2024-01-21T21:33:20.632538+0000","last_fullsized":"2024-01-21T21:33:20.632538+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610234+0000","last_change":"2024-01-21T21:33:20.253573+0000","last_active":"2024-01-21T21:33:20.610234+0000","last_peered":"2024-01-21T21:33:20.610234+0000","last_clean":"2024-01-21T21:33:20.610234+0000","last_became_active":"2024-01-21T21:33:20.253343+0000","last_became_peered":"2024-01-21T21:33:20.253343+0000","last_unstale":"2024-01-21T21:33:20.610234+0000","last_undegraded":"2024-01-21T21:33:20.610234+0000","last_fullsized":"2024-01-21T21:33:20.610234+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632530+0000","last_change":"2024-01-21T21:33:20.622651+0000","last_active":"2024-01-21T21:33:20.632530+0000","last_peered":"2024-01-21T21:33:20.632530+0000","last_clean":"2024-01-21T21:33:20.632530+0000","last_became_active":"2024-01-21T21:33:20.622399+0000","last_became_peered":"2024-01-21T21:33:20.622399+0000","last_unstale":"2024-01-21T21:33:20.632530+0000","last_undegraded":"2024-01-21T21:33:20.632530+0000","last_fullsized":"2024-01-21T21:33:20.632530+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606222+0000","last_change":"2024-01-21T21:33:20.246392+0000","last_active":"2024-01-21T21:33:20.606222+0000","last_peered":"2024-01-21T21:33:20.606222+0000","last_clean":"2024-01-21T21:33:20.606222+0000","last_became_active":"2024-01-21T21:33:20.246081+0000","last_became_peered":"2024-01-21T21:33:20.246081+0000","last_unstale":"2024-01-21T21:33:20.606222+0000","last_undegraded":"2024-01-21T21:33:20.606222+0000","last_fullsized":"2024-01-21T21:33:20.606222+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624891+0000","last_change":"2024-01-21T21:33:20.614663+0000","last_active":"2024-01-21T21:33:20.624891+0000","last_peered":"2024-01-21T21:33:20.624891+0000","last_clean":"2024-01-21T21:33:20.624891+0000","last_became_active":"2024-01-21T21:33:20.614393+0000","last_became_peered":"2024-01-21T21:33:20.614393+0000","last_unstale":"2024-01-21T21:33:20.624891+0000","last_undegraded":"2024-01-21T21:33:20.624891+0000","last_fullsized":"2024-01-21T21:33:20.624891+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612564+0000","last_change":"2024-01-21T21:33:20.250649+0000","last_active":"2024-01-21T21:33:20.612564+0000","last_peered":"2024-01-21T21:33:20.612564+0000","last_clean":"2024-01-21T21:33:20.612564+0000","last_became_active":"2024-01-21T21:33:20.250317+0000","last_became_peered":"2024-01-21T21:33:20.250317+0000","last_unstale":"2024-01-21T21:33:20.612564+0000","last_undegraded":"2024-01-21T21:33:20.612564+0000","last_fullsized":"2024-01-21T21:33:20.612564+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626194+0000","last_change":"2024-01-21T21:33:20.623467+0000","last_active":"2024-01-21T21:33:20.626194+0000","last_peered":"2024-01-21T21:33:20.626194+0000","last_clean":"2024-01-21T21:33:20.626194+0000","last_became_active":"2024-01-21T21:33:20.623054+0000","last_became_peered":"2024-01-21T21:33:20.623054+0000","last_unstale":"2024-01-21T21:33:20.626194+0000","last_undegraded":"2024-01-21T21:33:20.626194+0000","last_fullsized":"2024-01-21T21:33:20.626194+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222632+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611351+0000","last_change":"2024-01-21T21:33:20.252436+0000","last_active":"2024-01-21T21:33:20.611351+0000","last_peered":"2024-01-21T21:33:20.611351+0000","last_clean":"2024-01-21T21:33:20.611351+0000","last_became_active":"2024-01-21T21:33:20.251811+0000","last_became_peered":"2024-01-21T21:33:20.251811+0000","last_unstale":"2024-01-21T21:33:20.611351+0000","last_undegraded":"2024-01-21T21:33:20.611351+0000","last_fullsized":"2024-01-21T21:33:20.611351+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621126+0000","last_change":"2024-01-21T21:33:20.614911+0000","last_active":"2024-01-21T21:33:20.621126+0000","last_peered":"2024-01-21T21:33:20.621126+0000","last_clean":"2024-01-21T21:33:20.621126+0000","last_became_active":"2024-01-21T21:33:20.614617+0000","last_became_peered":"2024-01-21T21:33:20.614617+0000","last_unstale":"2024-01-21T21:33:20.621126+0000","last_undegraded":"2024-01-21T21:33:20.621126+0000","last_fullsized":"2024-01-21T21:33:20.621126+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602329+0000","last_change":"2024-01-21T21:33:20.234830+0000","last_active":"2024-01-21T21:33:20.602329+0000","last_peered":"2024-01-21T21:33:20.602329+0000","last_clean":"2024-01-21T21:33:20.602329+0000","last_became_active":"2024-01-21T21:33:20.234504+0000","last_became_peered":"2024-01-21T21:33:20.234504+0000","last_unstale":"2024-01-21T21:33:20.602329+0000","last_undegraded":"2024-01-21T21:33:20.602329+0000","last_fullsized":"2024-01-21T21:33:20.602329+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628267+0000","last_change":"2024-01-21T21:33:20.627688+0000","last_active":"2024-01-21T21:33:20.628267+0000","last_peered":"2024-01-21T21:33:20.628267+0000","last_clean":"2024-01-21T21:33:20.628267+0000","last_became_active":"2024-01-21T21:33:20.627404+0000","last_became_peered":"2024-01-21T21:33:20.627404+0000","last_unstale":"2024-01-21T21:33:20.628267+0000","last_undegraded":"2024-01-21T21:33:20.628267+0000","last_fullsized":"2024-01-21T21:33:20.628267+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611037+0000","last_change":"2024-01-21T21:33:20.241232+0000","last_active":"2024-01-21T21:33:20.611037+0000","last_peered":"2024-01-21T21:33:20.611037+0000","last_clean":"2024-01-21T21:33:20.611037+0000","last_became_active":"2024-01-21T21:33:20.240937+0000","last_became_peered":"2024-01-21T21:33:20.240937+0000","last_unstale":"2024-01-21T21:33:20.611037+0000","last_undegraded":"2024-01-21T21:33:20.611037+0000","last_fullsized":"2024-01-21T21:33:20.611037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621681+0000","last_change":"2024-01-21T21:33:20.616170+0000","last_active":"2024-01-21T21:33:20.621681+0000","last_peered":"2024-01-21T21:33:20.621681+0000","last_clean":"2024-01-21T21:33:20.621681+0000","last_became_active":"2024-01-21T21:33:20.615916+0000","last_became_peered":"2024-01-21T21:33:20.615916+0000","last_unstale":"2024-01-21T21:33:20.621681+0000","last_undegraded":"2024-01-21T21:33:20.621681+0000","last_fullsized":"2024-01-21T21:33:20.621681+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219408+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610129+0000","last_change":"2024-01-21T21:33:20.254189+0000","last_active":"2024-01-21T21:33:20.610129+0000","last_peered":"2024-01-21T21:33:20.610129+0000","last_clean":"2024-01-21T21:33:20.610129+0000","last_became_active":"2024-01-21T21:33:20.253907+0000","last_became_peered":"2024-01-21T21:33:20.253907+0000","last_unstale":"2024-01-21T21:33:20.610129+0000","last_undegraded":"2024-01-21T21:33:20.610129+0000","last_fullsized":"2024-01-21T21:33:20.610129+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601692+0000","last_change":"2024-01-21T21:33:20.235862+0000","last_active":"2024-01-21T21:33:20.601692+0000","last_peered":"2024-01-21T21:33:20.601692+0000","last_clean":"2024-01-21T21:33:20.601692+0000","last_became_active":"2024-01-21T21:33:20.235583+0000","last_became_peered":"2024-01-21T21:33:20.235583+0000","last_unstale":"2024-01-21T21:33:20.601692+0000","last_undegraded":"2024-01-21T21:33:20.601692+0000","last_fullsized":"2024-01-21T21:33:20.601692+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631856+0000","last_change":"2024-01-21T21:33:20.630928+0000","last_active":"2024-01-21T21:33:20.631856+0000","last_peered":"2024-01-21T21:33:20.631856+0000","last_clean":"2024-01-21T21:33:20.631856+0000","last_became_active":"2024-01-21T21:33:20.630600+0000","last_became_peered":"2024-01-21T21:33:20.630600+0000","last_unstale":"2024-01-21T21:33:20.631856+0000","last_undegraded":"2024-01-21T21:33:20.631856+0000","last_fullsized":"2024-01-21T21:33:20.631856+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608297+0000","last_change":"2024-01-21T21:33:20.250660+0000","last_active":"2024-01-21T21:33:20.608297+0000","last_peered":"2024-01-21T21:33:20.608297+0000","last_clean":"2024-01-21T21:33:20.608297+0000","last_became_active":"2024-01-21T21:33:20.250335+0000","last_became_peered":"2024-01-21T21:33:20.250335+0000","last_unstale":"2024-01-21T21:33:20.608297+0000","last_undegraded":"2024-01-21T21:33:20.608297+0000","last_fullsized":"2024-01-21T21:33:20.608297+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625201+0000","last_change":"2024-01-21T21:33:20.619378+0000","last_active":"2024-01-21T21:33:20.625201+0000","last_peered":"2024-01-21T21:33:20.625201+0000","last_clean":"2024-01-21T21:33:20.625201+0000","last_became_active":"2024-01-21T21:33:20.619126+0000","last_became_peered":"2024-01-21T21:33:20.619126+0000","last_unstale":"2024-01-21T21:33:20.625201+0000","last_undegraded":"2024-01-21T21:33:20.625201+0000","last_fullsized":"2024-01-21T21:33:20.625201+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612317+0000","last_change":"2024-01-21T21:33:20.252295+0000","last_active":"2024-01-21T21:33:20.612317+0000","last_peered":"2024-01-21T21:33:20.612317+0000","last_clean":"2024-01-21T21:33:20.612317+0000","last_became_active":"2024-01-21T21:33:20.251862+0000","last_became_peered":"2024-01-21T21:33:20.251862+0000","last_unstale":"2024-01-21T21:33:20.612317+0000","last_undegraded":"2024-01-21T21:33:20.612317+0000","last_fullsized":"2024-01-21T21:33:20.612317+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"206'3","reported_seq":13,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625383+0000","last_change":"2024-01-21T21:33:20.243094+0000","last_active":"2024-01-21T21:33:20.625383+0000","last_peered":"2024-01-21T21:33:20.625383+0000","last_clean":"2024-01-21T21:33:20.625383+0000","last_became_active":"2024-01-21T21:33:20.242750+0000","last_became_peered":"2024-01-21T21:33:20.242750+0000","last_unstale":"2024-01-21T21:33:20.625383+0000","last_undegraded":"2024-01-21T21:33:20.625383+0000","last_fullsized":"2024-01-21T21:33:20.625383+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632060+0000","last_change":"2024-01-21T21:33:20.617159+0000","last_active":"2024-01-21T21:33:20.632060+0000","last_peered":"2024-01-21T21:33:20.632060+0000","last_clean":"2024-01-21T21:33:20.632060+0000","last_became_active":"2024-01-21T21:33:20.616894+0000","last_became_peered":"2024-01-21T21:33:20.616894+0000","last_unstale":"2024-01-21T21:33:20.632060+0000","last_undegraded":"2024-01-21T21:33:20.632060+0000","last_fullsized":"2024-01-21T21:33:20.632060+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223209+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621318+0000","last_change":"2024-01-21T21:33:20.618378+0000","last_active":"2024-01-21T21:33:20.621318+0000","last_peered":"2024-01-21T21:33:20.621318+0000","last_clean":"2024-01-21T21:33:20.621318+0000","last_became_active":"2024-01-21T21:33:20.618109+0000","last_became_peered":"2024-01-21T21:33:20.618109+0000","last_unstale":"2024-01-21T21:33:20.621318+0000","last_undegraded":"2024-01-21T21:33:20.621318+0000","last_fullsized":"2024-01-21T21:33:20.621318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223496+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625065+0000","last_change":"2024-01-21T21:33:20.616280+0000","last_active":"2024-01-21T21:33:20.625065+0000","last_peered":"2024-01-21T21:33:20.625065+0000","last_clean":"2024-01-21T21:33:20.625065+0000","last_became_active":"2024-01-21T21:33:20.615827+0000","last_became_peered":"2024-01-21T21:33:20.615827+0000","last_unstale":"2024-01-21T21:33:20.625065+0000","last_undegraded":"2024-01-21T21:33:20.625065+0000","last_fullsized":"2024-01-21T21:33:20.625065+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611378+0000","last_change":"2024-01-21T21:33:20.252515+0000","last_active":"2024-01-21T21:33:20.611378+0000","last_peered":"2024-01-21T21:33:20.611378+0000","last_clean":"2024-01-21T21:33:20.611378+0000","last_became_active":"2024-01-21T21:33:20.252108+0000","last_became_peered":"2024-01-21T21:33:20.252108+0000","last_unstale":"2024-01-21T21:33:20.611378+0000","last_undegraded":"2024-01-21T21:33:20.611378+0000","last_fullsized":"2024-01-21T21:33:20.611378+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604781+0000","last_change":"2024-01-21T21:33:20.236220+0000","last_active":"2024-01-21T21:33:20.604781+0000","last_peered":"2024-01-21T21:33:20.604781+0000","last_clean":"2024-01-21T21:33:20.604781+0000","last_became_active":"2024-01-21T21:33:20.235947+0000","last_became_peered":"2024-01-21T21:33:20.235947+0000","last_unstale":"2024-01-21T21:33:20.604781+0000","last_undegraded":"2024-01-21T21:33:20.604781+0000","last_fullsized":"2024-01-21T21:33:20.604781+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219415+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621156+0000","last_change":"2024-01-21T21:33:20.615762+0000","last_active":"2024-01-21T21:33:20.621156+0000","last_peered":"2024-01-21T21:33:20.621156+0000","last_clean":"2024-01-21T21:33:20.621156+0000","last_became_active":"2024-01-21T21:33:20.615504+0000","last_became_peered":"2024-01-21T21:33:20.615504+0000","last_unstale":"2024-01-21T21:33:20.621156+0000","last_undegraded":"2024-01-21T21:33:20.621156+0000","last_fullsized":"2024-01-21T21:33:20.621156+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219410+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631512+0000","last_change":"2024-01-21T21:33:20.630652+0000","last_active":"2024-01-21T21:33:20.631512+0000","last_peered":"2024-01-21T21:33:20.631512+0000","last_clean":"2024-01-21T21:33:20.631512+0000","last_became_active":"2024-01-21T21:33:20.630341+0000","last_became_peered":"2024-01-21T21:33:20.630341+0000","last_unstale":"2024-01-21T21:33:20.631512+0000","last_undegraded":"2024-01-21T21:33:20.631512+0000","last_fullsized":"2024-01-21T21:33:20.631512+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627877+0000","last_change":"2024-01-21T21:33:20.244470+0000","last_active":"2024-01-21T21:33:20.627877+0000","last_peered":"2024-01-21T21:33:20.627877+0000","last_clean":"2024-01-21T21:33:20.627877+0000","last_became_active":"2024-01-21T21:33:20.243985+0000","last_became_peered":"2024-01-21T21:33:20.243985+0000","last_unstale":"2024-01-21T21:33:20.627877+0000","last_undegraded":"2024-01-21T21:33:20.627877+0000","last_fullsized":"2024-01-21T21:33:20.627877+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611947+0000","last_change":"2024-01-21T21:33:20.245628+0000","last_active":"2024-01-21T21:33:20.611947+0000","last_peered":"2024-01-21T21:33:20.611947+0000","last_clean":"2024-01-21T21:33:20.611947+0000","last_became_active":"2024-01-21T21:33:20.245250+0000","last_became_peered":"2024-01-21T21:33:20.245250+0000","last_unstale":"2024-01-21T21:33:20.611947+0000","last_undegraded":"2024-01-21T21:33:20.611947+0000","last_fullsized":"2024-01-21T21:33:20.611947+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632031+0000","last_change":"2024-01-21T21:33:20.616847+0000","last_active":"2024-01-21T21:33:20.632031+0000","last_peered":"2024-01-21T21:33:20.632031+0000","last_clean":"2024-01-21T21:33:20.632031+0000","last_became_active":"2024-01-21T21:33:20.616561+0000","last_became_peered":"2024-01-21T21:33:20.616561+0000","last_unstale":"2024-01-21T21:33:20.632031+0000","last_undegraded":"2024-01-21T21:33:20.632031+0000","last_fullsized":"2024-01-21T21:33:20.632031+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219426+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631926+0000","last_change":"2024-01-21T21:33:20.615903+0000","last_active":"2024-01-21T21:33:20.631926+0000","last_peered":"2024-01-21T21:33:20.631926+0000","last_clean":"2024-01-21T21:33:20.631926+0000","last_became_active":"2024-01-21T21:33:20.615609+0000","last_became_peered":"2024-01-21T21:33:20.615609+0000","last_unstale":"2024-01-21T21:33:20.631926+0000","last_undegraded":"2024-01-21T21:33:20.631926+0000","last_fullsized":"2024-01-21T21:33:20.631926+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222087+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.629842+0000","last_change":"2024-01-21T21:33:20.628205+0000","last_active":"2024-01-21T21:33:20.629842+0000","last_peered":"2024-01-21T21:33:20.629842+0000","last_clean":"2024-01-21T21:33:20.629842+0000","last_became_active":"2024-01-21T21:33:20.627913+0000","last_became_peered":"2024-01-21T21:33:20.627913+0000","last_unstale":"2024-01-21T21:33:20.629842+0000","last_undegraded":"2024-01-21T21:33:20.629842+0000","last_fullsized":"2024-01-21T21:33:20.629842+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604966+0000","last_change":"2024-01-21T21:33:20.248006+0000","last_active":"2024-01-21T21:33:20.604966+0000","last_peered":"2024-01-21T21:33:20.604966+0000","last_clean":"2024-01-21T21:33:20.604966+0000","last_became_active":"2024-01-21T21:33:20.247726+0000","last_became_peered":"2024-01-21T21:33:20.247726+0000","last_unstale":"2024-01-21T21:33:20.604966+0000","last_undegraded":"2024-01-21T21:33:20.604966+0000","last_fullsized":"2024-01-21T21:33:20.604966+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.615256+0000","last_change":"2024-01-21T21:33:20.609562+0000","last_active":"2024-01-21T21:33:20.615256+0000","last_peered":"2024-01-21T21:33:20.615256+0000","last_clean":"2024-01-21T21:33:20.615256+0000","last_became_active":"2024-01-21T21:33:20.609303+0000","last_became_peered":"2024-01-21T21:33:20.609303+0000","last_unstale":"2024-01-21T21:33:20.615256+0000","last_undegraded":"2024-01-21T21:33:20.615256+0000","last_fullsized":"2024-01-21T21:33:20.615256+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601718+0000","last_change":"2024-01-21T21:33:20.254574+0000","last_active":"2024-01-21T21:33:20.601718+0000","last_peered":"2024-01-21T21:33:20.601718+0000","last_clean":"2024-01-21T21:33:20.601718+0000","last_became_active":"2024-01-21T21:33:20.254274+0000","last_became_peered":"2024-01-21T21:33:20.254274+0000","last_unstale":"2024-01-21T21:33:20.601718+0000","last_undegraded":"2024-01-21T21:33:20.601718+0000","last_fullsized":"2024-01-21T21:33:20.601718+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624936+0000","last_change":"2024-01-21T21:33:20.615841+0000","last_active":"2024-01-21T21:33:20.624936+0000","last_peered":"2024-01-21T21:33:20.624936+0000","last_clean":"2024-01-21T21:33:20.624936+0000","last_became_active":"2024-01-21T21:33:20.615566+0000","last_became_peered":"2024-01-21T21:33:20.615566+0000","last_unstale":"2024-01-21T21:33:20.624936+0000","last_undegraded":"2024-01-21T21:33:20.624936+0000","last_fullsized":"2024-01-21T21:33:20.624936+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.613565+0000","last_change":"2024-01-21T21:33:20.241218+0000","last_active":"2024-01-21T21:33:20.613565+0000","last_peered":"2024-01-21T21:33:20.613565+0000","last_clean":"2024-01-21T21:33:20.613565+0000","last_became_active":"2024-01-21T21:33:20.240930+0000","last_became_peered":"2024-01-21T21:33:20.240930+0000","last_unstale":"2024-01-21T21:33:20.613565+0000","last_undegraded":"2024-01-21T21:33:20.613565+0000","last_fullsized":"2024-01-21T21:33:20.613565+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.619451+0000","last_change":"2024-01-21T21:33:20.614258+0000","last_active":"2024-01-21T21:33:20.619451+0000","last_peered":"2024-01-21T21:33:20.619451+0000","last_clean":"2024-01-21T21:33:20.619451+0000","last_became_active":"2024-01-21T21:33:20.614005+0000","last_became_peered":"2024-01-21T21:33:20.614005+0000","last_unstale":"2024-01-21T21:33:20.619451+0000","last_undegraded":"2024-01-21T21:33:20.619451+0000","last_fullsized":"2024-01-21T21:33:20.619451+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623794+0000","last_change":"2024-01-21T21:33:20.248557+0000","last_active":"2024-01-21T21:33:20.623794+0000","last_peered":"2024-01-21T21:33:20.623794+0000","last_clean":"2024-01-21T21:33:20.623794+0000","last_became_active":"2024-01-21T21:33:20.247951+0000","last_became_peered":"2024-01-21T21:33:20.247951+0000","last_unstale":"2024-01-21T21:33:20.623794+0000","last_undegraded":"2024-01-21T21:33:20.623794+0000","last_fullsized":"2024-01-21T21:33:20.623794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632420+0000","last_change":"2024-01-21T21:33:20.621122+0000","last_active":"2024-01-21T21:33:20.632420+0000","last_peered":"2024-01-21T21:33:20.632420+0000","last_clean":"2024-01-21T21:33:20.632420+0000","last_became_active":"2024-01-21T21:33:20.620828+0000","last_became_peered":"2024-01-21T21:33:20.620828+0000","last_unstale":"2024-01-21T21:33:20.632420+0000","last_undegraded":"2024-01-21T21:33:20.632420+0000","last_fullsized":"2024-01-21T21:33:20.632420+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601923+0000","last_change":"2024-01-21T21:33:20.254575+0000","last_active":"2024-01-21T21:33:20.601923+0000","last_peered":"2024-01-21T21:33:20.601923+0000","last_clean":"2024-01-21T21:33:20.601923+0000","last_became_active":"2024-01-21T21:33:20.254258+0000","last_became_peered":"2024-01-21T21:33:20.254258+0000","last_unstale":"2024-01-21T21:33:20.601923+0000","last_undegraded":"2024-01-21T21:33:20.601923+0000","last_fullsized":"2024-01-21T21:33:20.601923+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626225+0000","last_change":"2024-01-21T21:33:20.624428+0000","last_active":"2024-01-21T21:33:20.626225+0000","last_peered":"2024-01-21T21:33:20.626225+0000","last_clean":"2024-01-21T21:33:20.626225+0000","last_became_active":"2024-01-21T21:33:20.624167+0000","last_became_peered":"2024-01-21T21:33:20.624167+0000","last_unstale":"2024-01-21T21:33:20.626225+0000","last_undegraded":"2024-01-21T21:33:20.626225+0000","last_fullsized":"2024-01-21T21:33:20.626225+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.607011+0000","last_change":"2024-01-21T21:33:20.242392+0000","last_active":"2024-01-21T21:33:20.607011+0000","last_peered":"2024-01-21T21:33:20.607011+0000","last_clean":"2024-01-21T21:33:20.607011+0000","last_became_active":"2024-01-21T21:33:20.242117+0000","last_became_peered":"2024-01-21T21:33:20.242117+0000","last_unstale":"2024-01-21T21:33:20.607011+0000","last_undegraded":"2024-01-21T21:33:20.607011+0000","last_fullsized":"2024-01-21T21:33:20.607011+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.619737+0000","last_change":"2024-01-21T21:33:20.613594+0000","last_active":"2024-01-21T21:33:20.619737+0000","last_peered":"2024-01-21T21:33:20.619737+0000","last_clean":"2024-01-21T21:33:20.619737+0000","last_became_active":"2024-01-21T21:33:20.611894+0000","last_became_peered":"2024-01-21T21:33:20.611894+0000","last_unstale":"2024-01-21T21:33:20.619737+0000","last_undegraded":"2024-01-21T21:33:20.619737+0000","last_fullsized":"2024-01-21T21:33:20.619737+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608930+0000","last_change":"2024-01-21T21:33:20.255346+0000","last_active":"2024-01-21T21:33:20.608930+0000","last_peered":"2024-01-21T21:33:20.608930+0000","last_clean":"2024-01-21T21:33:20.608930+0000","last_became_active":"2024-01-21T21:33:20.255039+0000","last_became_peered":"2024-01-21T21:33:20.255039+0000","last_unstale":"2024-01-21T21:33:20.608930+0000","last_undegraded":"2024-01-21T21:33:20.608930+0000","last_fullsized":"2024-01-21T21:33:20.608930+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623030+0000","last_change":"2024-01-21T21:33:20.620554+0000","last_active":"2024-01-21T21:33:20.623030+0000","last_peered":"2024-01-21T21:33:20.623030+0000","last_clean":"2024-01-21T21:33:20.623030+0000","last_became_active":"2024-01-21T21:33:20.620274+0000","last_became_peered":"2024-01-21T21:33:20.620274+0000","last_unstale":"2024-01-21T21:33:20.623030+0000","last_undegraded":"2024-01-21T21:33:20.623030+0000","last_fullsized":"2024-01-21T21:33:20.623030+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616876+0000","last_change":"2024-01-21T21:33:20.246900+0000","last_active":"2024-01-21T21:33:20.616876+0000","last_peered":"2024-01-21T21:33:20.616876+0000","last_clean":"2024-01-21T21:33:20.616876+0000","last_became_active":"2024-01-21T21:33:20.246585+0000","last_became_peered":"2024-01-21T21:33:20.246585+0000","last_unstale":"2024-01-21T21:33:20.616876+0000","last_undegraded":"2024-01-21T21:33:20.616876+0000","last_fullsized":"2024-01-21T21:33:20.616876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616416+0000","last_change":"2024-01-21T21:33:20.243525+0000","last_active":"2024-01-21T21:33:20.616416+0000","last_peered":"2024-01-21T21:33:20.616416+0000","last_clean":"2024-01-21T21:33:20.616416+0000","last_became_active":"2024-01-21T21:33:20.243137+0000","last_became_peered":"2024-01-21T21:33:20.243137+0000","last_unstale":"2024-01-21T21:33:20.616416+0000","last_undegraded":"2024-01-21T21:33:20.616416+0000","last_fullsized":"2024-01-21T21:33:20.616416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620473+0000","last_change":"2024-01-21T21:33:20.615735+0000","last_active":"2024-01-21T21:33:20.620473+0000","last_peered":"2024-01-21T21:33:20.620473+0000","last_clean":"2024-01-21T21:33:20.620473+0000","last_became_active":"2024-01-21T21:33:20.615449+0000","last_became_peered":"2024-01-21T21:33:20.615449+0000","last_unstale":"2024-01-21T21:33:20.620473+0000","last_undegraded":"2024-01-21T21:33:20.620473+0000","last_fullsized":"2024-01-21T21:33:20.620473+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601842+0000","last_change":"2024-01-21T21:33:20.245996+0000","last_active":"2024-01-21T21:33:20.601842+0000","last_peered":"2024-01-21T21:33:20.601842+0000","last_clean":"2024-01-21T21:33:20.601842+0000","last_became_active":"2024-01-21T21:33:20.245626+0000","last_became_peered":"2024-01-21T21:33:20.245626+0000","last_unstale":"2024-01-21T21:33:20.601842+0000","last_undegraded":"2024-01-21T21:33:20.601842+0000","last_fullsized":"2024-01-21T21:33:20.601842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.633333+0000","last_change":"2024-01-21T21:33:20.632860+0000","last_active":"2024-01-21T21:33:20.633333+0000","last_peered":"2024-01-21T21:33:20.633333+0000","last_clean":"2024-01-21T21:33:20.633333+0000","last_became_active":"2024-01-21T21:33:20.632569+0000","last_became_peered":"2024-01-21T21:33:20.632569+0000","last_unstale":"2024-01-21T21:33:20.633333+0000","last_undegraded":"2024-01-21T21:33:20.633333+0000","last_fullsized":"2024-01-21T21:33:20.633333+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610781+0000","last_change":"2024-01-21T21:33:20.245507+0000","last_active":"2024-01-21T21:33:20.610781+0000","last_peered":"2024-01-21T21:33:20.610781+0000","last_clean":"2024-01-21T21:33:20.610781+0000","last_became_active":"2024-01-21T21:33:20.245216+0000","last_became_peered":"2024-01-21T21:33:20.245216+0000","last_unstale":"2024-01-21T21:33:20.610781+0000","last_undegraded":"2024-01-21T21:33:20.610781+0000","last_fullsized":"2024-01-21T21:33:20.610781+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625817+0000","last_change":"2024-01-21T21:33:20.621166+0000","last_active":"2024-01-21T21:33:20.625817+0000","last_peered":"2024-01-21T21:33:20.625817+0000","last_clean":"2024-01-21T21:33:20.625817+0000","last_became_active":"2024-01-21T21:33:20.620802+0000","last_became_peered":"2024-01-21T21:33:20.620802+0000","last_unstale":"2024-01-21T21:33:20.625817+0000","last_undegraded":"2024-01-21T21:33:20.625817+0000","last_fullsized":"2024-01-21T21:33:20.625817+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620099+0000","last_change":"2024-01-21T21:33:20.248781+0000","last_active":"2024-01-21T21:33:20.620099+0000","last_peered":"2024-01-21T21:33:20.620099+0000","last_clean":"2024-01-21T21:33:20.620099+0000","last_became_active":"2024-01-21T21:33:20.248376+0000","last_became_peered":"2024-01-21T21:33:20.248376+0000","last_unstale":"2024-01-21T21:33:20.620099+0000","last_undegraded":"2024-01-21T21:33:20.620099+0000","last_fullsized":"2024-01-21T21:33:20.620099+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611368+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:20.611368+0000","last_peered":"2024-01-21T21:33:20.611368+0000","last_clean":"2024-01-21T21:33:20.611368+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:20.611368+0000","last_undegraded":"2024-01-21T21:33:20.611368+0000","last_fullsized":"2024-01-21T21:33:20.611368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632868+0000","last_change":"2024-01-21T21:33:20.630556+0000","last_active":"2024-01-21T21:33:20.632868+0000","last_peered":"2024-01-21T21:33:20.632868+0000","last_clean":"2024-01-21T21:33:20.632868+0000","last_became_active":"2024-01-21T21:33:20.630262+0000","last_became_peered":"2024-01-21T21:33:20.630262+0000","last_unstale":"2024-01-21T21:33:20.632868+0000","last_undegraded":"2024-01-21T21:33:20.632868+0000","last_fullsized":"2024-01-21T21:33:20.632868+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.222002+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212565+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:17.212565+0000","last_peered":"2024-01-21T21:33:17.212565+0000","last_clean":"2024-01-21T21:33:17.212565+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:17.212565+0000","last_undegraded":"2024-01-21T21:33:17.212565+0000","last_fullsized":"2024-01-21T21:33:17.212565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632402+0000","last_change":"2024-01-21T21:33:20.620500+0000","last_active":"2024-01-21T21:33:20.632402+0000","last_peered":"2024-01-21T21:33:20.632402+0000","last_clean":"2024-01-21T21:33:20.632402+0000","last_became_active":"2024-01-21T21:33:20.620235+0000","last_became_peered":"2024-01-21T21:33:20.620235+0000","last_unstale":"2024-01-21T21:33:20.632402+0000","last_undegraded":"2024-01-21T21:33:20.632402+0000","last_fullsized":"2024-01-21T21:33:20.632402+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604869+0000","last_change":"2024-01-21T21:33:20.243644+0000","last_active":"2024-01-21T21:33:20.604869+0000","last_peered":"2024-01-21T21:33:20.604869+0000","last_clean":"2024-01-21T21:33:20.604869+0000","last_became_active":"2024-01-21T21:33:20.242456+0000","last_became_peered":"2024-01-21T21:33:20.242456+0000","last_unstale":"2024-01-21T21:33:20.604869+0000","last_undegraded":"2024-01-21T21:33:20.604869+0000","last_fullsized":"2024-01-21T21:33:20.604869+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.603416+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:20.603416+0000","last_peered":"2024-01-21T21:33:20.603416+0000","last_clean":"2024-01-21T21:33:20.603416+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:20.603416+0000","last_undegraded":"2024-01-21T21:33:20.603416+0000","last_fullsized":"2024-01-21T21:33:20.603416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623082+0000","last_change":"2024-01-21T21:33:20.616373+0000","last_active":"2024-01-21T21:33:20.623082+0000","last_peered":"2024-01-21T21:33:20.623082+0000","last_clean":"2024-01-21T21:33:20.623082+0000","last_became_active":"2024-01-21T21:33:20.616096+0000","last_became_peered":"2024-01-21T21:33:20.616096+0000","last_unstale":"2024-01-21T21:33:20.623082+0000","last_undegraded":"2024-01-21T21:33:20.623082+0000","last_fullsized":"2024-01-21T21:33:20.623082+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.605120+0000","last_change":"2024-01-21T21:33:20.239936+0000","last_active":"2024-01-21T21:33:20.605120+0000","last_peered":"2024-01-21T21:33:20.605120+0000","last_clean":"2024-01-21T21:33:20.605120+0000","last_became_active":"2024-01-21T21:33:20.239603+0000","last_became_peered":"2024-01-21T21:33:20.239603+0000","last_unstale":"2024-01-21T21:33:20.605120+0000","last_undegraded":"2024-01-21T21:33:20.605120+0000","last_fullsized":"2024-01-21T21:33:20.605120+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":203,"state":"active+clean","last_fresh":"2024-01-21T21:33:17.212559+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:17.212559+0000","last_peered":"2024-01-21T21:33:17.212559+0000","last_clean":"2024-01-21T21:33:17.212559+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:17.212559+0000","last_undegraded":"2024-01-21T21:33:17.212559+0000","last_fullsized":"2024-01-21T21:33:17.212559+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616317+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:20.616317+0000","last_peered":"2024-01-21T21:33:20.616317+0000","last_clean":"2024-01-21T21:33:20.616317+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:20.616317+0000","last_undegraded":"2024-01-21T21:33:20.616317+0000","last_fullsized":"2024-01-21T21:33:20.616317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.607719+0000","last_change":"2024-01-21T21:33:20.241849+0000","last_active":"2024-01-21T21:33:20.607719+0000","last_peered":"2024-01-21T21:33:20.607719+0000","last_clean":"2024-01-21T21:33:20.607719+0000","last_became_active":"2024-01-21T21:33:20.241529+0000","last_became_peered":"2024-01-21T21:33:20.241529+0000","last_unstale":"2024-01-21T21:33:20.607719+0000","last_undegraded":"2024-01-21T21:33:20.607719+0000","last_fullsized":"2024-01-21T21:33:20.607719+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616422+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:20.616422+0000","last_peered":"2024-01-21T21:33:20.616422+0000","last_clean":"2024-01-21T21:33:20.616422+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:20.616422+0000","last_undegraded":"2024-01-21T21:33:20.616422+0000","last_fullsized":"2024-01-21T21:33:20.616422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620278+0000","last_change":"2024-01-21T21:33:20.611615+0000","last_active":"2024-01-21T21:33:20.620278+0000","last_peered":"2024-01-21T21:33:20.620278+0000","last_clean":"2024-01-21T21:33:20.620278+0000","last_became_active":"2024-01-21T21:33:20.611363+0000","last_became_peered":"2024-01-21T21:33:20.611363+0000","last_unstale":"2024-01-21T21:33:20.620278+0000","last_undegraded":"2024-01-21T21:33:20.620278+0000","last_fullsized":"2024-01-21T21:33:20.620278+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621983+0000","last_change":"2024-01-21T21:33:20.242804+0000","last_active":"2024-01-21T21:33:20.621983+0000","last_peered":"2024-01-21T21:33:20.621983+0000","last_clean":"2024-01-21T21:33:20.621983+0000","last_became_active":"2024-01-21T21:33:20.241463+0000","last_became_peered":"2024-01-21T21:33:20.241463+0000","last_unstale":"2024-01-21T21:33:20.621983+0000","last_undegraded":"2024-01-21T21:33:20.621983+0000","last_fullsized":"2024-01-21T21:33:20.621983+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617565+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:20.617565+0000","last_peered":"2024-01-21T21:33:20.617565+0000","last_clean":"2024-01-21T21:33:20.617565+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:20.617565+0000","last_undegraded":"2024-01-21T21:33:20.617565+0000","last_fullsized":"2024-01-21T21:33:20.617565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-21T21:33:20.216437+0000","last_change":"2024-01-21T21:33:20.216437+0000","last_active":"2024-01-21T21:33:20.216437+0000","last_peered":"2024-01-21T21:33:20.216437+0000","last_clean":"2024-01-21T21:33:20.216437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:20.216437+0000","last_undegraded":"2024-01-21T21:33:20.216437+0000","last_fullsized":"2024-01-21T21:33:20.216437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.219449+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612390+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:20.612390+0000","last_peered":"2024-01-21T21:33:20.612390+0000","last_clean":"2024-01-21T21:33:20.612390+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:20.612390+0000","last_undegraded":"2024-01-21T21:33:20.612390+0000","last_fullsized":"2024-01-21T21:33:20.612390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624237+0000","last_change":"2024-01-21T21:33:20.621649+0000","last_active":"2024-01-21T21:33:20.624237+0000","last_peered":"2024-01-21T21:33:20.624237+0000","last_clean":"2024-01-21T21:33:20.624237+0000","last_became_active":"2024-01-21T21:33:20.621374+0000","last_became_peered":"2024-01-21T21:33:20.621374+0000","last_unstale":"2024-01-21T21:33:20.624237+0000","last_undegraded":"2024-01-21T21:33:20.624237+0000","last_fullsized":"2024-01-21T21:33:20.624237+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-01-21T21:33:19.212221+0000","last_change":"2024-01-21T21:33:19.223653+0000","last_active":"2024-01-21T21:33:19.212221+0000","last_peered":"2024-01-21T21:33:19.212221+0000","last_clean":"2024-01-21T21:33:19.212221+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-21T21:33:19.212221+0000","last_undegraded":"2024-01-21T21:33:19.212221+0000","last_fullsized":"2024-01-21T21:33:19.212221+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612626+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:20.612626+0000","last_peered":"2024-01-21T21:33:20.612626+0000","last_clean":"2024-01-21T21:33:20.612626+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:20.612626+0000","last_undegraded":"2024-01-21T21:33:20.612626+0000","last_fullsized":"2024-01-21T21:33:20.612626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":1606,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575971,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2596864,"data_stored":1403339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.47099999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2596864,"data_stored":1403746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.66500000000000004}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.64100000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303724,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068116,"statfs":{"total":96636764160,"available":96325750784,"internally_reserved":0,"allocated":2592768,"data_stored":1402854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.315},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.26500000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.28599999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.434}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.501}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.495},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575972,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2609152,"data_stored":1402663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.38},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.432},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.627}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064020,"statfs":{"total":96636764160,"available":96321556480,"internally_reserved":0,"allocated":2592768,"data_stored":1402854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.36099999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.379},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60099999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307824,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064016,"statfs":{"total":96636764160,"available":96321552384,"internally_reserved":0,"allocated":2596864,"data_stored":1402944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.316}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.433},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.38300000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39000000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307772,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064068,"statfs":{"total":96636764160,"available":96321605632,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.62}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.53500000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.49199999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.37},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.45700000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55800000000000005}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.503}]}]},{"osd":5,"up_from":13,"seq":55834575970,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315964,"kb_used_data":2484,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055876,"statfs":{"total":96636764160,"available":96313217024,"internally_reserved":0,"allocated":2543616,"data_stored":1373223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.64300000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.60099999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.53300000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.436}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.44400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:26.534 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:26.532+0000 7f65dab65700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:33:28.029 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:28.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.156+0000 7f6fdc728700 1 Processor -- start 2024-01-21T21:33:28.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.156+0000 7f6fdc728700 1 -- start start 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.157+0000 7f6fdc728700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.157+0000 7f6fdc728700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.157+0000 7f6fdc728700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd4067f10 con 0x7f6fd40c6220 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.157+0000 7f6fdc728700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd40681f0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.157+0000 7f6fdc728700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd40684d0 con 0x7f6fd40c3840 2024-01-21T21:33:28.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd9cc3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd9cc3700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:40612/0 (socket says 172.21.15.133:40612) 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:51508/0 (socket says 172.21.15.133:51508) 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd9cc3700 1 -- 172.21.15.133:0/2942849846 learned_addr learned my addr 172.21.15.133:0/2942849846 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 -- 172.21.15.133:0/2942849846 >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 msgr2=0x7f6fd413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 --2- 172.21.15.133:0/2942849846 >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 -- 172.21.15.133:0/2942849846 >> v1:172.21.15.178:6789/0 conn(0x7f6fd40c6220 legacy=0x7f6fd4157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 -- 172.21.15.133:0/2942849846 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd40687b0 con 0x7f6fd40c3840 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd9cc3700 1 --2- 172.21.15.133:0/2942849846 >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fda4c4700 1 --2- 172.21.15.133:0/2942849846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f6fd0009760 tx=0x7f6fd0009060).ready entity=mon.2 client_cookie=1517875b23110897 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd94c2700 1 -- 172.21.15.133:0/2942849846 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00090d0 con 0x7f6fd40c3840 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd94c2700 1 -- 172.21.15.133:0/2942849846 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd000f510 con 0x7f6fd40c3840 2024-01-21T21:33:28.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.158+0000 7f6fd94c2700 1 -- 172.21.15.133:0/2942849846 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000f890 con 0x7f6fd40c3840 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 -- 172.21.15.133:0/2942849846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 msgr2=0x7f6fd40c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 --2- 172.21.15.133:0/2942849846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f6fd0009760 tx=0x7f6fd0009060).stop 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 -- 172.21.15.133:0/2942849846 shutdown_connections 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 --2- 172.21.15.133:0/2942849846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd40c3c20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 --2- 172.21.15.133:0/2942849846 >> v2:172.21.15.178:3300/0 conn(0x7f6fd40c5dc0 0x7f6fd413a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 -- 172.21.15.133:0/2942849846 >> 172.21.15.133:0/2942849846 conn(0x7f6fd4066a70 msgr2=0x7f6fd4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 -- 172.21.15.133:0/2942849846 shutdown_connections 2024-01-21T21:33:28.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.159+0000 7f6fdc728700 1 -- 172.21.15.133:0/2942849846 wait complete. 2024-01-21T21:33:28.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.160+0000 7f6fdc728700 1 Processor -- start 2024-01-21T21:33:28.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.160+0000 7f6fdc728700 1 -- start start 2024-01-21T21:33:28.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40c6220 0x7f6fd413d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd414b060 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd414b340 con 0x7f6fd40c6220 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdc728700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd414b620 con 0x7f6fd40c3840 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fd9cc3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fd9cc3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35574/0 (socket says 172.21.15.133:35574) 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fd9cc3700 1 -- 172.21.15.133:0/1127003674 learned_addr learned my addr 172.21.15.133:0/1127003674 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fda4c4700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.161+0000 7f6fdacc5700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40c6220 0x7f6fd413d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 -- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 msgr2=0x7f6fd414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd414c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 -- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40c6220 msgr2=0x7f6fd413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40c6220 0x7f6fd413d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 -- 172.21.15.133:0/1127003674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc8009370 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fd9cc3700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f6fc800ea20 tx=0x7f6fc80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800c7f0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800c950 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800ccd0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd00092a0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.162+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd414bbe0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.163+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd414bdd0 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.163+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6fc8012600 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.163+0000 7f6fc6ffd700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 0x7f6fb8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.164+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f6fc807aa60 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.164+0000 7f6fda4c4700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 0x7f6fb8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.164+0000 7f6fda4c4700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 0x7f6fb8061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6fd0009fd0 tx=0x7f6fd0017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.168+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6fc804ba60 con 0x7f6fd40c5dc0 2024-01-21T21:33:28.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.332+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fd4068a90 con 0x7f6fb805f150 2024-01-21T21:33:28.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.342+0000 7f6fc6ffd700 1 -- 172.21.15.133:0/1127003674 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+362284 (secure 0 0 0) 0x7f6fd4068a90 con 0x7f6fb805f150 2024-01-21T21:33:28.349 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 msgr2=0x7f6fb8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 0x7f6fb8061610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6fd0009fd0 tx=0x7f6fd0017000).stop 2024-01-21T21:33:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 msgr2=0x7f6fd40ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 rx=0x7f6fc800ea20 tx=0x7f6fc80090f0).stop 2024-01-21T21:33:28.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 shutdown_connections 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.345+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6fb805f150 0x7f6fb8061610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40c6220 0x7f6fd413d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40c3840 0x7f6fd414c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 --2- 172.21.15.133:0/1127003674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fd40c5dc0 0x7f6fd40ae2f0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 >> 172.21.15.133:0/1127003674 conn(0x7f6fd4066a70 msgr2=0x7f6fd4065210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 shutdown_connections 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.346+0000 7f6fdc728700 1 -- 172.21.15.133:0/1127003674 wait complete. 2024-01-21T21:33:28.353 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:28.360 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-21T21:33:26.659299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2474904,"kb_used_data":20312,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499816,"statfs":{"total":773094113280,"available":770559811584,"internally_reserved":0,"allocated":20799488,"data_stored":11225522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26622,"num_objects":-15,"num_object_clones":0,"num_object_copies":-30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.527568"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631946+0000","last_change":"2024-01-21T21:33:20.631195+0000","last_active":"2024-01-21T21:33:20.631946+0000","last_peered":"2024-01-21T21:33:20.631946+0000","last_clean":"2024-01-21T21:33:20.631946+0000","last_became_active":"2024-01-21T21:33:20.630907+0000","last_became_peered":"2024-01-21T21:33:20.630907+0000","last_unstale":"2024-01-21T21:33:20.631946+0000","last_undegraded":"2024-01-21T21:33:20.631946+0000","last_fullsized":"2024-01-21T21:33:20.631946+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.3f","version":"206'3","reported_seq":13,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625330+0000","last_change":"2024-01-21T21:33:20.250531+0000","last_active":"2024-01-21T21:33:20.625330+0000","last_peered":"2024-01-21T21:33:20.625330+0000","last_clean":"2024-01-21T21:33:20.625330+0000","last_became_active":"2024-01-21T21:33:20.250254+0000","last_became_peered":"2024-01-21T21:33:20.250254+0000","last_unstale":"2024-01-21T21:33:20.625330+0000","last_undegraded":"2024-01-21T21:33:20.625330+0000","last_fullsized":"2024-01-21T21:33:20.625330+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623843+0000","last_change":"2024-01-21T21:33:20.621764+0000","last_active":"2024-01-21T21:33:20.623843+0000","last_peered":"2024-01-21T21:33:20.623843+0000","last_clean":"2024-01-21T21:33:20.623843+0000","last_became_active":"2024-01-21T21:33:20.621439+0000","last_became_peered":"2024-01-21T21:33:20.621439+0000","last_unstale":"2024-01-21T21:33:20.623843+0000","last_undegraded":"2024-01-21T21:33:20.623843+0000","last_fullsized":"2024-01-21T21:33:20.623843+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610879+0000","last_change":"2024-01-21T21:33:20.240297+0000","last_active":"2024-01-21T21:33:20.610879+0000","last_peered":"2024-01-21T21:33:20.610879+0000","last_clean":"2024-01-21T21:33:20.610879+0000","last_became_active":"2024-01-21T21:33:20.240014+0000","last_became_peered":"2024-01-21T21:33:20.240014+0000","last_unstale":"2024-01-21T21:33:20.610879+0000","last_undegraded":"2024-01-21T21:33:20.610879+0000","last_fullsized":"2024-01-21T21:33:20.610879+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632093+0000","last_change":"2024-01-21T21:33:20.617373+0000","last_active":"2024-01-21T21:33:20.632093+0000","last_peered":"2024-01-21T21:33:20.632093+0000","last_clean":"2024-01-21T21:33:20.632093+0000","last_became_active":"2024-01-21T21:33:20.617103+0000","last_became_peered":"2024-01-21T21:33:20.617103+0000","last_unstale":"2024-01-21T21:33:20.632093+0000","last_undegraded":"2024-01-21T21:33:20.632093+0000","last_fullsized":"2024-01-21T21:33:20.632093+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611264+0000","last_change":"2024-01-21T21:33:20.252657+0000","last_active":"2024-01-21T21:33:20.611264+0000","last_peered":"2024-01-21T21:33:20.611264+0000","last_clean":"2024-01-21T21:33:20.611264+0000","last_became_active":"2024-01-21T21:33:20.252165+0000","last_became_peered":"2024-01-21T21:33:20.252165+0000","last_unstale":"2024-01-21T21:33:20.611264+0000","last_undegraded":"2024-01-21T21:33:20.611264+0000","last_fullsized":"2024-01-21T21:33:20.611264+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632780+0000","last_change":"2024-01-21T21:33:20.623710+0000","last_active":"2024-01-21T21:33:20.632780+0000","last_peered":"2024-01-21T21:33:20.632780+0000","last_clean":"2024-01-21T21:33:20.632780+0000","last_became_active":"2024-01-21T21:33:20.623301+0000","last_became_peered":"2024-01-21T21:33:20.623301+0000","last_unstale":"2024-01-21T21:33:20.632780+0000","last_undegraded":"2024-01-21T21:33:20.632780+0000","last_fullsized":"2024-01-21T21:33:20.632780+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626024+0000","last_change":"2024-01-21T21:33:20.240272+0000","last_active":"2024-01-21T21:33:20.626024+0000","last_peered":"2024-01-21T21:33:20.626024+0000","last_clean":"2024-01-21T21:33:20.626024+0000","last_became_active":"2024-01-21T21:33:20.239980+0000","last_became_peered":"2024-01-21T21:33:20.239980+0000","last_unstale":"2024-01-21T21:33:20.626024+0000","last_undegraded":"2024-01-21T21:33:20.626024+0000","last_fullsized":"2024-01-21T21:33:20.626024+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626731+0000","last_change":"2024-01-21T21:33:20.625417+0000","last_active":"2024-01-21T21:33:20.626731+0000","last_peered":"2024-01-21T21:33:20.626731+0000","last_clean":"2024-01-21T21:33:20.626731+0000","last_became_active":"2024-01-21T21:33:20.625132+0000","last_became_peered":"2024-01-21T21:33:20.625132+0000","last_unstale":"2024-01-21T21:33:20.626731+0000","last_undegraded":"2024-01-21T21:33:20.626731+0000","last_fullsized":"2024-01-21T21:33:20.626731+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3b","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621323+0000","last_change":"2024-01-21T21:33:20.231214+0000","last_active":"2024-01-21T21:33:20.621323+0000","last_peered":"2024-01-21T21:33:20.621323+0000","last_clean":"2024-01-21T21:33:20.621323+0000","last_became_active":"2024-01-21T21:33:20.230873+0000","last_became_peered":"2024-01-21T21:33:20.230873+0000","last_unstale":"2024-01-21T21:33:20.621323+0000","last_undegraded":"2024-01-21T21:33:20.621323+0000","last_fullsized":"2024-01-21T21:33:20.621323+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.622275+0000","last_change":"2024-01-21T21:33:20.619573+0000","last_active":"2024-01-21T21:33:20.622275+0000","last_peered":"2024-01-21T21:33:20.622275+0000","last_clean":"2024-01-21T21:33:20.622275+0000","last_became_active":"2024-01-21T21:33:20.619293+0000","last_became_peered":"2024-01-21T21:33:20.619293+0000","last_unstale":"2024-01-21T21:33:20.622275+0000","last_undegraded":"2024-01-21T21:33:20.622275+0000","last_fullsized":"2024-01-21T21:33:20.622275+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632189+0000","last_change":"2024-01-21T21:33:20.252243+0000","last_active":"2024-01-21T21:33:20.632189+0000","last_peered":"2024-01-21T21:33:20.632189+0000","last_clean":"2024-01-21T21:33:20.632189+0000","last_became_active":"2024-01-21T21:33:20.251952+0000","last_became_peered":"2024-01-21T21:33:20.251952+0000","last_unstale":"2024-01-21T21:33:20.632189+0000","last_undegraded":"2024-01-21T21:33:20.632189+0000","last_fullsized":"2024-01-21T21:33:20.632189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625102+0000","last_change":"2024-01-21T21:33:20.617096+0000","last_active":"2024-01-21T21:33:20.625102+0000","last_peered":"2024-01-21T21:33:20.625102+0000","last_clean":"2024-01-21T21:33:20.625102+0000","last_became_active":"2024-01-21T21:33:20.616816+0000","last_became_peered":"2024-01-21T21:33:20.616816+0000","last_unstale":"2024-01-21T21:33:20.625102+0000","last_undegraded":"2024-01-21T21:33:20.625102+0000","last_fullsized":"2024-01-21T21:33:20.625102+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606903+0000","last_change":"2024-01-21T21:33:20.238995+0000","last_active":"2024-01-21T21:33:20.606903+0000","last_peered":"2024-01-21T21:33:20.606903+0000","last_clean":"2024-01-21T21:33:20.606903+0000","last_became_active":"2024-01-21T21:33:20.238642+0000","last_became_peered":"2024-01-21T21:33:20.238642+0000","last_unstale":"2024-01-21T21:33:20.606903+0000","last_undegraded":"2024-01-21T21:33:20.606903+0000","last_fullsized":"2024-01-21T21:33:20.606903+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624912+0000","last_change":"2024-01-21T21:33:20.615317+0000","last_active":"2024-01-21T21:33:20.624912+0000","last_peered":"2024-01-21T21:33:20.624912+0000","last_clean":"2024-01-21T21:33:20.624912+0000","last_became_active":"2024-01-21T21:33:20.615065+0000","last_became_peered":"2024-01-21T21:33:20.615065+0000","last_unstale":"2024-01-21T21:33:20.624912+0000","last_undegraded":"2024-01-21T21:33:20.624912+0000","last_fullsized":"2024-01-21T21:33:20.624912+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606040+0000","last_change":"2024-01-21T21:33:20.240324+0000","last_active":"2024-01-21T21:33:20.606040+0000","last_peered":"2024-01-21T21:33:20.606040+0000","last_clean":"2024-01-21T21:33:20.606040+0000","last_became_active":"2024-01-21T21:33:20.240031+0000","last_became_peered":"2024-01-21T21:33:20.240031+0000","last_unstale":"2024-01-21T21:33:20.606040+0000","last_undegraded":"2024-01-21T21:33:20.606040+0000","last_fullsized":"2024-01-21T21:33:20.606040+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617512+0000","last_change":"2024-01-21T21:33:20.613871+0000","last_active":"2024-01-21T21:33:20.617512+0000","last_peered":"2024-01-21T21:33:20.617512+0000","last_clean":"2024-01-21T21:33:20.617512+0000","last_became_active":"2024-01-21T21:33:20.613445+0000","last_became_peered":"2024-01-21T21:33:20.613445+0000","last_unstale":"2024-01-21T21:33:20.617512+0000","last_undegraded":"2024-01-21T21:33:20.617512+0000","last_fullsized":"2024-01-21T21:33:20.617512+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606348+0000","last_change":"2024-01-21T21:33:20.238900+0000","last_active":"2024-01-21T21:33:20.606348+0000","last_peered":"2024-01-21T21:33:20.606348+0000","last_clean":"2024-01-21T21:33:20.606348+0000","last_became_active":"2024-01-21T21:33:20.238633+0000","last_became_peered":"2024-01-21T21:33:20.238633+0000","last_unstale":"2024-01-21T21:33:20.606348+0000","last_undegraded":"2024-01-21T21:33:20.606348+0000","last_fullsized":"2024-01-21T21:33:20.606348+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627936+0000","last_change":"2024-01-21T21:33:20.623332+0000","last_active":"2024-01-21T21:33:20.627936+0000","last_peered":"2024-01-21T21:33:20.627936+0000","last_clean":"2024-01-21T21:33:20.627936+0000","last_became_active":"2024-01-21T21:33:20.623031+0000","last_became_peered":"2024-01-21T21:33:20.623031+0000","last_unstale":"2024-01-21T21:33:20.627936+0000","last_undegraded":"2024-01-21T21:33:20.627936+0000","last_fullsized":"2024-01-21T21:33:20.627936+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.609190+0000","last_change":"2024-01-21T21:33:20.253769+0000","last_active":"2024-01-21T21:33:20.609190+0000","last_peered":"2024-01-21T21:33:20.609190+0000","last_clean":"2024-01-21T21:33:20.609190+0000","last_became_active":"2024-01-21T21:33:20.253312+0000","last_became_peered":"2024-01-21T21:33:20.253312+0000","last_unstale":"2024-01-21T21:33:20.609190+0000","last_undegraded":"2024-01-21T21:33:20.609190+0000","last_fullsized":"2024-01-21T21:33:20.609190+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631480+0000","last_change":"2024-01-21T21:33:20.630384+0000","last_active":"2024-01-21T21:33:20.631480+0000","last_peered":"2024-01-21T21:33:20.631480+0000","last_clean":"2024-01-21T21:33:20.631480+0000","last_became_active":"2024-01-21T21:33:20.630092+0000","last_became_peered":"2024-01-21T21:33:20.630092+0000","last_unstale":"2024-01-21T21:33:20.631480+0000","last_undegraded":"2024-01-21T21:33:20.631480+0000","last_fullsized":"2024-01-21T21:33:20.631480+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.618729+0000","last_change":"2024-01-21T21:33:20.240544+0000","last_active":"2024-01-21T21:33:20.618729+0000","last_peered":"2024-01-21T21:33:20.618729+0000","last_clean":"2024-01-21T21:33:20.618729+0000","last_became_active":"2024-01-21T21:33:20.240258+0000","last_became_peered":"2024-01-21T21:33:20.240258+0000","last_unstale":"2024-01-21T21:33:20.618729+0000","last_undegraded":"2024-01-21T21:33:20.618729+0000","last_fullsized":"2024-01-21T21:33:20.618729+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632759+0000","last_change":"2024-01-21T21:33:20.623544+0000","last_active":"2024-01-21T21:33:20.632759+0000","last_peered":"2024-01-21T21:33:20.632759+0000","last_clean":"2024-01-21T21:33:20.632759+0000","last_became_active":"2024-01-21T21:33:20.622938+0000","last_became_peered":"2024-01-21T21:33:20.622938+0000","last_unstale":"2024-01-21T21:33:20.632759+0000","last_undegraded":"2024-01-21T21:33:20.632759+0000","last_fullsized":"2024-01-21T21:33:20.632759+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.34","version":"206'4","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627128+0000","last_change":"2024-01-21T21:33:20.241972+0000","last_active":"2024-01-21T21:33:20.627128+0000","last_peered":"2024-01-21T21:33:20.627128+0000","last_clean":"2024-01-21T21:33:20.627128+0000","last_became_active":"2024-01-21T21:33:20.241360+0000","last_became_peered":"2024-01-21T21:33:20.241360+0000","last_unstale":"2024-01-21T21:33:20.627128+0000","last_undegraded":"2024-01-21T21:33:20.627128+0000","last_fullsized":"2024-01-21T21:33:20.627128+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625232+0000","last_change":"2024-01-21T21:33:20.617222+0000","last_active":"2024-01-21T21:33:20.625232+0000","last_peered":"2024-01-21T21:33:20.625232+0000","last_clean":"2024-01-21T21:33:20.625232+0000","last_became_active":"2024-01-21T21:33:20.614620+0000","last_became_peered":"2024-01-21T21:33:20.614620+0000","last_unstale":"2024-01-21T21:33:20.625232+0000","last_undegraded":"2024-01-21T21:33:20.625232+0000","last_fullsized":"2024-01-21T21:33:20.625232+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.33","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628513+0000","last_change":"2024-01-21T21:33:20.239569+0000","last_active":"2024-01-21T21:33:20.628513+0000","last_peered":"2024-01-21T21:33:20.628513+0000","last_clean":"2024-01-21T21:33:20.628513+0000","last_became_active":"2024-01-21T21:33:20.239286+0000","last_became_peered":"2024-01-21T21:33:20.239286+0000","last_unstale":"2024-01-21T21:33:20.628513+0000","last_undegraded":"2024-01-21T21:33:20.628513+0000","last_fullsized":"2024-01-21T21:33:20.628513+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632797+0000","last_change":"2024-01-21T21:33:20.627722+0000","last_active":"2024-01-21T21:33:20.632797+0000","last_peered":"2024-01-21T21:33:20.632797+0000","last_clean":"2024-01-21T21:33:20.632797+0000","last_became_active":"2024-01-21T21:33:20.627381+0000","last_became_peered":"2024-01-21T21:33:20.627381+0000","last_unstale":"2024-01-21T21:33:20.632797+0000","last_undegraded":"2024-01-21T21:33:20.632797+0000","last_fullsized":"2024-01-21T21:33:20.632797+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604187+0000","last_change":"2024-01-21T21:33:20.237949+0000","last_active":"2024-01-21T21:33:20.604187+0000","last_peered":"2024-01-21T21:33:20.604187+0000","last_clean":"2024-01-21T21:33:20.604187+0000","last_became_active":"2024-01-21T21:33:20.237619+0000","last_became_peered":"2024-01-21T21:33:20.237619+0000","last_unstale":"2024-01-21T21:33:20.604187+0000","last_undegraded":"2024-01-21T21:33:20.604187+0000","last_fullsized":"2024-01-21T21:33:20.604187+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628884+0000","last_change":"2024-01-21T21:33:20.627809+0000","last_active":"2024-01-21T21:33:20.628884+0000","last_peered":"2024-01-21T21:33:20.628884+0000","last_clean":"2024-01-21T21:33:20.628884+0000","last_became_active":"2024-01-21T21:33:20.627521+0000","last_became_peered":"2024-01-21T21:33:20.627521+0000","last_unstale":"2024-01-21T21:33:20.628884+0000","last_undegraded":"2024-01-21T21:33:20.628884+0000","last_fullsized":"2024-01-21T21:33:20.628884+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611336+0000","last_change":"2024-01-21T21:33:20.242268+0000","last_active":"2024-01-21T21:33:20.611336+0000","last_peered":"2024-01-21T21:33:20.611336+0000","last_clean":"2024-01-21T21:33:20.611336+0000","last_became_active":"2024-01-21T21:33:20.241375+0000","last_became_peered":"2024-01-21T21:33:20.241375+0000","last_unstale":"2024-01-21T21:33:20.611336+0000","last_undegraded":"2024-01-21T21:33:20.611336+0000","last_fullsized":"2024-01-21T21:33:20.611336+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631995+0000","last_change":"2024-01-21T21:33:20.630260+0000","last_active":"2024-01-21T21:33:20.631995+0000","last_peered":"2024-01-21T21:33:20.631995+0000","last_clean":"2024-01-21T21:33:20.631995+0000","last_became_active":"2024-01-21T21:33:20.627565+0000","last_became_peered":"2024-01-21T21:33:20.627565+0000","last_unstale":"2024-01-21T21:33:20.631995+0000","last_undegraded":"2024-01-21T21:33:20.631995+0000","last_fullsized":"2024-01-21T21:33:20.631995+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.30","version":"206'4","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625045+0000","last_change":"2024-01-21T21:33:20.241884+0000","last_active":"2024-01-21T21:33:20.625045+0000","last_peered":"2024-01-21T21:33:20.625045+0000","last_clean":"2024-01-21T21:33:20.625045+0000","last_became_active":"2024-01-21T21:33:20.241547+0000","last_became_peered":"2024-01-21T21:33:20.241547+0000","last_unstale":"2024-01-21T21:33:20.625045+0000","last_undegraded":"2024-01-21T21:33:20.625045+0000","last_fullsized":"2024-01-21T21:33:20.625045+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617227+0000","last_change":"2024-01-21T21:33:20.613975+0000","last_active":"2024-01-21T21:33:20.617227+0000","last_peered":"2024-01-21T21:33:20.617227+0000","last_clean":"2024-01-21T21:33:20.617227+0000","last_became_active":"2024-01-21T21:33:20.613719+0000","last_became_peered":"2024-01-21T21:33:20.613719+0000","last_unstale":"2024-01-21T21:33:20.617227+0000","last_undegraded":"2024-01-21T21:33:20.617227+0000","last_fullsized":"2024-01-21T21:33:20.617227+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602034+0000","last_change":"2024-01-21T21:33:20.245342+0000","last_active":"2024-01-21T21:33:20.602034+0000","last_peered":"2024-01-21T21:33:20.602034+0000","last_clean":"2024-01-21T21:33:20.602034+0000","last_became_active":"2024-01-21T21:33:20.245051+0000","last_became_peered":"2024-01-21T21:33:20.245051+0000","last_unstale":"2024-01-21T21:33:20.602034+0000","last_undegraded":"2024-01-21T21:33:20.602034+0000","last_fullsized":"2024-01-21T21:33:20.602034+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.630222+0000","last_change":"2024-01-21T21:33:20.626777+0000","last_active":"2024-01-21T21:33:20.630222+0000","last_peered":"2024-01-21T21:33:20.630222+0000","last_clean":"2024-01-21T21:33:20.630222+0000","last_became_active":"2024-01-21T21:33:20.626514+0000","last_became_peered":"2024-01-21T21:33:20.626514+0000","last_unstale":"2024-01-21T21:33:20.630222+0000","last_undegraded":"2024-01-21T21:33:20.630222+0000","last_fullsized":"2024-01-21T21:33:20.630222+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.618027+0000","last_change":"2024-01-21T21:33:20.246380+0000","last_active":"2024-01-21T21:33:20.618027+0000","last_peered":"2024-01-21T21:33:20.618027+0000","last_clean":"2024-01-21T21:33:20.618027+0000","last_became_active":"2024-01-21T21:33:20.246095+0000","last_became_peered":"2024-01-21T21:33:20.246095+0000","last_unstale":"2024-01-21T21:33:20.618027+0000","last_undegraded":"2024-01-21T21:33:20.618027+0000","last_fullsized":"2024-01-21T21:33:20.618027+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631608+0000","last_change":"2024-01-21T21:33:20.627841+0000","last_active":"2024-01-21T21:33:20.631608+0000","last_peered":"2024-01-21T21:33:20.631608+0000","last_clean":"2024-01-21T21:33:20.631608+0000","last_became_active":"2024-01-21T21:33:20.626977+0000","last_became_peered":"2024-01-21T21:33:20.626977+0000","last_unstale":"2024-01-21T21:33:20.631608+0000","last_undegraded":"2024-01-21T21:33:20.631608+0000","last_fullsized":"2024-01-21T21:33:20.631608+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2d","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621662+0000","last_change":"2024-01-21T21:33:20.234692+0000","last_active":"2024-01-21T21:33:20.621662+0000","last_peered":"2024-01-21T21:33:20.621662+0000","last_clean":"2024-01-21T21:33:20.621662+0000","last_became_active":"2024-01-21T21:33:20.234399+0000","last_became_peered":"2024-01-21T21:33:20.234399+0000","last_unstale":"2024-01-21T21:33:20.621662+0000","last_undegraded":"2024-01-21T21:33:20.621662+0000","last_fullsized":"2024-01-21T21:33:20.621662+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625281+0000","last_change":"2024-01-21T21:33:20.623258+0000","last_active":"2024-01-21T21:33:20.625281+0000","last_peered":"2024-01-21T21:33:20.625281+0000","last_clean":"2024-01-21T21:33:20.625281+0000","last_became_active":"2024-01-21T21:33:20.622958+0000","last_became_peered":"2024-01-21T21:33:20.622958+0000","last_unstale":"2024-01-21T21:33:20.625281+0000","last_undegraded":"2024-01-21T21:33:20.625281+0000","last_fullsized":"2024-01-21T21:33:20.625281+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602171+0000","last_change":"2024-01-21T21:33:20.245378+0000","last_active":"2024-01-21T21:33:20.602171+0000","last_peered":"2024-01-21T21:33:20.602171+0000","last_clean":"2024-01-21T21:33:20.602171+0000","last_became_active":"2024-01-21T21:33:20.244898+0000","last_became_peered":"2024-01-21T21:33:20.244898+0000","last_unstale":"2024-01-21T21:33:20.602171+0000","last_undegraded":"2024-01-21T21:33:20.602171+0000","last_fullsized":"2024-01-21T21:33:20.602171+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632168+0000","last_change":"2024-01-21T21:33:20.618783+0000","last_active":"2024-01-21T21:33:20.632168+0000","last_peered":"2024-01-21T21:33:20.632168+0000","last_clean":"2024-01-21T21:33:20.632168+0000","last_became_active":"2024-01-21T21:33:20.618524+0000","last_became_peered":"2024-01-21T21:33:20.618524+0000","last_unstale":"2024-01-21T21:33:20.632168+0000","last_undegraded":"2024-01-21T21:33:20.632168+0000","last_fullsized":"2024-01-21T21:33:20.632168+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2b","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621439+0000","last_change":"2024-01-21T21:33:20.230042+0000","last_active":"2024-01-21T21:33:20.621439+0000","last_peered":"2024-01-21T21:33:20.621439+0000","last_clean":"2024-01-21T21:33:20.621439+0000","last_became_active":"2024-01-21T21:33:20.229731+0000","last_became_peered":"2024-01-21T21:33:20.229731+0000","last_unstale":"2024-01-21T21:33:20.621439+0000","last_undegraded":"2024-01-21T21:33:20.621439+0000","last_fullsized":"2024-01-21T21:33:20.621439+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.633318+0000","last_change":"2024-01-21T21:33:20.632747+0000","last_active":"2024-01-21T21:33:20.633318+0000","last_peered":"2024-01-21T21:33:20.633318+0000","last_clean":"2024-01-21T21:33:20.633318+0000","last_became_active":"2024-01-21T21:33:20.632507+0000","last_became_peered":"2024-01-21T21:33:20.632507+0000","last_unstale":"2024-01-21T21:33:20.633318+0000","last_undegraded":"2024-01-21T21:33:20.633318+0000","last_fullsized":"2024-01-21T21:33:20.633318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604760+0000","last_change":"2024-01-21T21:33:20.243821+0000","last_active":"2024-01-21T21:33:20.604760+0000","last_peered":"2024-01-21T21:33:20.604760+0000","last_clean":"2024-01-21T21:33:20.604760+0000","last_became_active":"2024-01-21T21:33:20.242862+0000","last_became_peered":"2024-01-21T21:33:20.242862+0000","last_unstale":"2024-01-21T21:33:20.604760+0000","last_undegraded":"2024-01-21T21:33:20.604760+0000","last_fullsized":"2024-01-21T21:33:20.604760+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632538+0000","last_change":"2024-01-21T21:33:20.622669+0000","last_active":"2024-01-21T21:33:20.632538+0000","last_peered":"2024-01-21T21:33:20.632538+0000","last_clean":"2024-01-21T21:33:20.632538+0000","last_became_active":"2024-01-21T21:33:20.622411+0000","last_became_peered":"2024-01-21T21:33:20.622411+0000","last_unstale":"2024-01-21T21:33:20.632538+0000","last_undegraded":"2024-01-21T21:33:20.632538+0000","last_fullsized":"2024-01-21T21:33:20.632538+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610234+0000","last_change":"2024-01-21T21:33:20.253573+0000","last_active":"2024-01-21T21:33:20.610234+0000","last_peered":"2024-01-21T21:33:20.610234+0000","last_clean":"2024-01-21T21:33:20.610234+0000","last_became_active":"2024-01-21T21:33:20.253343+0000","last_became_peered":"2024-01-21T21:33:20.253343+0000","last_unstale":"2024-01-21T21:33:20.610234+0000","last_undegraded":"2024-01-21T21:33:20.610234+0000","last_fullsized":"2024-01-21T21:33:20.610234+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632530+0000","last_change":"2024-01-21T21:33:20.622651+0000","last_active":"2024-01-21T21:33:20.632530+0000","last_peered":"2024-01-21T21:33:20.632530+0000","last_clean":"2024-01-21T21:33:20.632530+0000","last_became_active":"2024-01-21T21:33:20.622399+0000","last_became_peered":"2024-01-21T21:33:20.622399+0000","last_unstale":"2024-01-21T21:33:20.632530+0000","last_undegraded":"2024-01-21T21:33:20.632530+0000","last_fullsized":"2024-01-21T21:33:20.632530+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.606222+0000","last_change":"2024-01-21T21:33:20.246392+0000","last_active":"2024-01-21T21:33:20.606222+0000","last_peered":"2024-01-21T21:33:20.606222+0000","last_clean":"2024-01-21T21:33:20.606222+0000","last_became_active":"2024-01-21T21:33:20.246081+0000","last_became_peered":"2024-01-21T21:33:20.246081+0000","last_unstale":"2024-01-21T21:33:20.606222+0000","last_undegraded":"2024-01-21T21:33:20.606222+0000","last_fullsized":"2024-01-21T21:33:20.606222+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624891+0000","last_change":"2024-01-21T21:33:20.614663+0000","last_active":"2024-01-21T21:33:20.624891+0000","last_peered":"2024-01-21T21:33:20.624891+0000","last_clean":"2024-01-21T21:33:20.624891+0000","last_became_active":"2024-01-21T21:33:20.614393+0000","last_became_peered":"2024-01-21T21:33:20.614393+0000","last_unstale":"2024-01-21T21:33:20.624891+0000","last_undegraded":"2024-01-21T21:33:20.624891+0000","last_fullsized":"2024-01-21T21:33:20.624891+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612564+0000","last_change":"2024-01-21T21:33:20.250649+0000","last_active":"2024-01-21T21:33:20.612564+0000","last_peered":"2024-01-21T21:33:20.612564+0000","last_clean":"2024-01-21T21:33:20.612564+0000","last_became_active":"2024-01-21T21:33:20.250317+0000","last_became_peered":"2024-01-21T21:33:20.250317+0000","last_unstale":"2024-01-21T21:33:20.612564+0000","last_undegraded":"2024-01-21T21:33:20.612564+0000","last_fullsized":"2024-01-21T21:33:20.612564+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626194+0000","last_change":"2024-01-21T21:33:20.623467+0000","last_active":"2024-01-21T21:33:20.626194+0000","last_peered":"2024-01-21T21:33:20.626194+0000","last_clean":"2024-01-21T21:33:20.626194+0000","last_became_active":"2024-01-21T21:33:20.623054+0000","last_became_peered":"2024-01-21T21:33:20.623054+0000","last_unstale":"2024-01-21T21:33:20.626194+0000","last_undegraded":"2024-01-21T21:33:20.626194+0000","last_fullsized":"2024-01-21T21:33:20.626194+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608374+0000","last_change":"2024-01-21T21:33:20.238691+0000","last_active":"2024-01-21T21:33:20.608374+0000","last_peered":"2024-01-21T21:33:20.608374+0000","last_clean":"2024-01-21T21:33:20.608374+0000","last_became_active":"2024-01-21T21:33:20.238375+0000","last_became_peered":"2024-01-21T21:33:20.238375+0000","last_unstale":"2024-01-21T21:33:20.608374+0000","last_undegraded":"2024-01-21T21:33:20.608374+0000","last_fullsized":"2024-01-21T21:33:20.608374+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.614973+0000","last_change":"2024-01-21T21:33:20.612382+0000","last_active":"2024-01-21T21:33:20.614973+0000","last_peered":"2024-01-21T21:33:20.614973+0000","last_clean":"2024-01-21T21:33:20.614973+0000","last_became_active":"2024-01-21T21:33:20.611836+0000","last_became_peered":"2024-01-21T21:33:20.611836+0000","last_unstale":"2024-01-21T21:33:20.614973+0000","last_undegraded":"2024-01-21T21:33:20.614973+0000","last_fullsized":"2024-01-21T21:33:20.614973+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611351+0000","last_change":"2024-01-21T21:33:20.252436+0000","last_active":"2024-01-21T21:33:20.611351+0000","last_peered":"2024-01-21T21:33:20.611351+0000","last_clean":"2024-01-21T21:33:20.611351+0000","last_became_active":"2024-01-21T21:33:20.251811+0000","last_became_peered":"2024-01-21T21:33:20.251811+0000","last_unstale":"2024-01-21T21:33:20.611351+0000","last_undegraded":"2024-01-21T21:33:20.611351+0000","last_fullsized":"2024-01-21T21:33:20.611351+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621126+0000","last_change":"2024-01-21T21:33:20.614911+0000","last_active":"2024-01-21T21:33:20.621126+0000","last_peered":"2024-01-21T21:33:20.621126+0000","last_clean":"2024-01-21T21:33:20.621126+0000","last_became_active":"2024-01-21T21:33:20.614617+0000","last_became_peered":"2024-01-21T21:33:20.614617+0000","last_unstale":"2024-01-21T21:33:20.621126+0000","last_undegraded":"2024-01-21T21:33:20.621126+0000","last_fullsized":"2024-01-21T21:33:20.621126+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.602329+0000","last_change":"2024-01-21T21:33:20.234830+0000","last_active":"2024-01-21T21:33:20.602329+0000","last_peered":"2024-01-21T21:33:20.602329+0000","last_clean":"2024-01-21T21:33:20.602329+0000","last_became_active":"2024-01-21T21:33:20.234504+0000","last_became_peered":"2024-01-21T21:33:20.234504+0000","last_unstale":"2024-01-21T21:33:20.602329+0000","last_undegraded":"2024-01-21T21:33:20.602329+0000","last_fullsized":"2024-01-21T21:33:20.602329+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628267+0000","last_change":"2024-01-21T21:33:20.627688+0000","last_active":"2024-01-21T21:33:20.628267+0000","last_peered":"2024-01-21T21:33:20.628267+0000","last_clean":"2024-01-21T21:33:20.628267+0000","last_became_active":"2024-01-21T21:33:20.627404+0000","last_became_peered":"2024-01-21T21:33:20.627404+0000","last_unstale":"2024-01-21T21:33:20.628267+0000","last_undegraded":"2024-01-21T21:33:20.628267+0000","last_fullsized":"2024-01-21T21:33:20.628267+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611037+0000","last_change":"2024-01-21T21:33:20.241232+0000","last_active":"2024-01-21T21:33:20.611037+0000","last_peered":"2024-01-21T21:33:20.611037+0000","last_clean":"2024-01-21T21:33:20.611037+0000","last_became_active":"2024-01-21T21:33:20.240937+0000","last_became_peered":"2024-01-21T21:33:20.240937+0000","last_unstale":"2024-01-21T21:33:20.611037+0000","last_undegraded":"2024-01-21T21:33:20.611037+0000","last_fullsized":"2024-01-21T21:33:20.611037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621681+0000","last_change":"2024-01-21T21:33:20.616170+0000","last_active":"2024-01-21T21:33:20.621681+0000","last_peered":"2024-01-21T21:33:20.621681+0000","last_clean":"2024-01-21T21:33:20.621681+0000","last_became_active":"2024-01-21T21:33:20.615916+0000","last_became_peered":"2024-01-21T21:33:20.615916+0000","last_unstale":"2024-01-21T21:33:20.621681+0000","last_undegraded":"2024-01-21T21:33:20.621681+0000","last_fullsized":"2024-01-21T21:33:20.621681+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.605164+0000","last_change":"2024-01-21T21:33:20.241428+0000","last_active":"2024-01-21T21:33:20.605164+0000","last_peered":"2024-01-21T21:33:20.605164+0000","last_clean":"2024-01-21T21:33:20.605164+0000","last_became_active":"2024-01-21T21:33:20.241137+0000","last_became_peered":"2024-01-21T21:33:20.241137+0000","last_unstale":"2024-01-21T21:33:20.605164+0000","last_undegraded":"2024-01-21T21:33:20.605164+0000","last_fullsized":"2024-01-21T21:33:20.605164+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.619788+0000","last_change":"2024-01-21T21:33:20.616228+0000","last_active":"2024-01-21T21:33:20.619788+0000","last_peered":"2024-01-21T21:33:20.619788+0000","last_clean":"2024-01-21T21:33:20.619788+0000","last_became_active":"2024-01-21T21:33:20.615922+0000","last_became_peered":"2024-01-21T21:33:20.615922+0000","last_unstale":"2024-01-21T21:33:20.619788+0000","last_undegraded":"2024-01-21T21:33:20.619788+0000","last_fullsized":"2024-01-21T21:33:20.619788+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610129+0000","last_change":"2024-01-21T21:33:20.254189+0000","last_active":"2024-01-21T21:33:20.610129+0000","last_peered":"2024-01-21T21:33:20.610129+0000","last_clean":"2024-01-21T21:33:20.610129+0000","last_became_active":"2024-01-21T21:33:20.253907+0000","last_became_peered":"2024-01-21T21:33:20.253907+0000","last_unstale":"2024-01-21T21:33:20.610129+0000","last_undegraded":"2024-01-21T21:33:20.610129+0000","last_fullsized":"2024-01-21T21:33:20.610129+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620467+0000","last_change":"2024-01-21T21:33:20.619681+0000","last_active":"2024-01-21T21:33:20.620467+0000","last_peered":"2024-01-21T21:33:20.620467+0000","last_clean":"2024-01-21T21:33:20.620467+0000","last_became_active":"2024-01-21T21:33:20.619367+0000","last_became_peered":"2024-01-21T21:33:20.619367+0000","last_unstale":"2024-01-21T21:33:20.620467+0000","last_undegraded":"2024-01-21T21:33:20.620467+0000","last_fullsized":"2024-01-21T21:33:20.620467+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601692+0000","last_change":"2024-01-21T21:33:20.235862+0000","last_active":"2024-01-21T21:33:20.601692+0000","last_peered":"2024-01-21T21:33:20.601692+0000","last_clean":"2024-01-21T21:33:20.601692+0000","last_became_active":"2024-01-21T21:33:20.235583+0000","last_became_peered":"2024-01-21T21:33:20.235583+0000","last_unstale":"2024-01-21T21:33:20.601692+0000","last_undegraded":"2024-01-21T21:33:20.601692+0000","last_fullsized":"2024-01-21T21:33:20.601692+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631856+0000","last_change":"2024-01-21T21:33:20.630928+0000","last_active":"2024-01-21T21:33:20.631856+0000","last_peered":"2024-01-21T21:33:20.631856+0000","last_clean":"2024-01-21T21:33:20.631856+0000","last_became_active":"2024-01-21T21:33:20.630600+0000","last_became_peered":"2024-01-21T21:33:20.630600+0000","last_unstale":"2024-01-21T21:33:20.631856+0000","last_undegraded":"2024-01-21T21:33:20.631856+0000","last_fullsized":"2024-01-21T21:33:20.631856+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608297+0000","last_change":"2024-01-21T21:33:20.250660+0000","last_active":"2024-01-21T21:33:20.608297+0000","last_peered":"2024-01-21T21:33:20.608297+0000","last_clean":"2024-01-21T21:33:20.608297+0000","last_became_active":"2024-01-21T21:33:20.250335+0000","last_became_peered":"2024-01-21T21:33:20.250335+0000","last_unstale":"2024-01-21T21:33:20.608297+0000","last_undegraded":"2024-01-21T21:33:20.608297+0000","last_fullsized":"2024-01-21T21:33:20.608297+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625201+0000","last_change":"2024-01-21T21:33:20.619378+0000","last_active":"2024-01-21T21:33:20.625201+0000","last_peered":"2024-01-21T21:33:20.625201+0000","last_clean":"2024-01-21T21:33:20.625201+0000","last_became_active":"2024-01-21T21:33:20.619126+0000","last_became_peered":"2024-01-21T21:33:20.619126+0000","last_unstale":"2024-01-21T21:33:20.625201+0000","last_undegraded":"2024-01-21T21:33:20.625201+0000","last_fullsized":"2024-01-21T21:33:20.625201+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612317+0000","last_change":"2024-01-21T21:33:20.252295+0000","last_active":"2024-01-21T21:33:20.612317+0000","last_peered":"2024-01-21T21:33:20.612317+0000","last_clean":"2024-01-21T21:33:20.612317+0000","last_became_active":"2024-01-21T21:33:20.251862+0000","last_became_peered":"2024-01-21T21:33:20.251862+0000","last_unstale":"2024-01-21T21:33:20.612317+0000","last_undegraded":"2024-01-21T21:33:20.612317+0000","last_fullsized":"2024-01-21T21:33:20.612317+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.630356+0000","last_change":"2024-01-21T21:33:20.627255+0000","last_active":"2024-01-21T21:33:20.630356+0000","last_peered":"2024-01-21T21:33:20.630356+0000","last_clean":"2024-01-21T21:33:20.630356+0000","last_became_active":"2024-01-21T21:33:20.626709+0000","last_became_peered":"2024-01-21T21:33:20.626709+0000","last_unstale":"2024-01-21T21:33:20.630356+0000","last_undegraded":"2024-01-21T21:33:20.630356+0000","last_fullsized":"2024-01-21T21:33:20.630356+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"206'3","reported_seq":13,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625383+0000","last_change":"2024-01-21T21:33:20.243094+0000","last_active":"2024-01-21T21:33:20.625383+0000","last_peered":"2024-01-21T21:33:20.625383+0000","last_clean":"2024-01-21T21:33:20.625383+0000","last_became_active":"2024-01-21T21:33:20.242750+0000","last_became_peered":"2024-01-21T21:33:20.242750+0000","last_unstale":"2024-01-21T21:33:20.625383+0000","last_undegraded":"2024-01-21T21:33:20.625383+0000","last_fullsized":"2024-01-21T21:33:20.625383+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632060+0000","last_change":"2024-01-21T21:33:20.617159+0000","last_active":"2024-01-21T21:33:20.632060+0000","last_peered":"2024-01-21T21:33:20.632060+0000","last_clean":"2024-01-21T21:33:20.632060+0000","last_became_active":"2024-01-21T21:33:20.616894+0000","last_became_peered":"2024-01-21T21:33:20.616894+0000","last_unstale":"2024-01-21T21:33:20.632060+0000","last_undegraded":"2024-01-21T21:33:20.632060+0000","last_fullsized":"2024-01-21T21:33:20.632060+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632002+0000","last_change":"2024-01-21T21:33:20.231826+0000","last_active":"2024-01-21T21:33:20.632002+0000","last_peered":"2024-01-21T21:33:20.632002+0000","last_clean":"2024-01-21T21:33:20.632002+0000","last_became_active":"2024-01-21T21:33:20.231529+0000","last_became_peered":"2024-01-21T21:33:20.231529+0000","last_unstale":"2024-01-21T21:33:20.632002+0000","last_undegraded":"2024-01-21T21:33:20.632002+0000","last_fullsized":"2024-01-21T21:33:20.632002+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621318+0000","last_change":"2024-01-21T21:33:20.618378+0000","last_active":"2024-01-21T21:33:20.621318+0000","last_peered":"2024-01-21T21:33:20.621318+0000","last_clean":"2024-01-21T21:33:20.621318+0000","last_became_active":"2024-01-21T21:33:20.618109+0000","last_became_peered":"2024-01-21T21:33:20.618109+0000","last_unstale":"2024-01-21T21:33:20.621318+0000","last_undegraded":"2024-01-21T21:33:20.621318+0000","last_fullsized":"2024-01-21T21:33:20.621318+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627362+0000","last_change":"2024-01-21T21:33:20.240799+0000","last_active":"2024-01-21T21:33:20.627362+0000","last_peered":"2024-01-21T21:33:20.627362+0000","last_clean":"2024-01-21T21:33:20.627362+0000","last_became_active":"2024-01-21T21:33:20.239277+0000","last_became_peered":"2024-01-21T21:33:20.239277+0000","last_unstale":"2024-01-21T21:33:20.627362+0000","last_undegraded":"2024-01-21T21:33:20.627362+0000","last_fullsized":"2024-01-21T21:33:20.627362+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625065+0000","last_change":"2024-01-21T21:33:20.616280+0000","last_active":"2024-01-21T21:33:20.625065+0000","last_peered":"2024-01-21T21:33:20.625065+0000","last_clean":"2024-01-21T21:33:20.625065+0000","last_became_active":"2024-01-21T21:33:20.615827+0000","last_became_peered":"2024-01-21T21:33:20.615827+0000","last_unstale":"2024-01-21T21:33:20.625065+0000","last_undegraded":"2024-01-21T21:33:20.625065+0000","last_fullsized":"2024-01-21T21:33:20.625065+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611378+0000","last_change":"2024-01-21T21:33:20.252515+0000","last_active":"2024-01-21T21:33:20.611378+0000","last_peered":"2024-01-21T21:33:20.611378+0000","last_clean":"2024-01-21T21:33:20.611378+0000","last_became_active":"2024-01-21T21:33:20.252108+0000","last_became_peered":"2024-01-21T21:33:20.252108+0000","last_unstale":"2024-01-21T21:33:20.611378+0000","last_undegraded":"2024-01-21T21:33:20.611378+0000","last_fullsized":"2024-01-21T21:33:20.611378+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.630362+0000","last_change":"2024-01-21T21:33:20.626411+0000","last_active":"2024-01-21T21:33:20.630362+0000","last_peered":"2024-01-21T21:33:20.630362+0000","last_clean":"2024-01-21T21:33:20.630362+0000","last_became_active":"2024-01-21T21:33:20.626097+0000","last_became_peered":"2024-01-21T21:33:20.626097+0000","last_unstale":"2024-01-21T21:33:20.630362+0000","last_undegraded":"2024-01-21T21:33:20.630362+0000","last_fullsized":"2024-01-21T21:33:20.630362+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604781+0000","last_change":"2024-01-21T21:33:20.236220+0000","last_active":"2024-01-21T21:33:20.604781+0000","last_peered":"2024-01-21T21:33:20.604781+0000","last_clean":"2024-01-21T21:33:20.604781+0000","last_became_active":"2024-01-21T21:33:20.235947+0000","last_became_peered":"2024-01-21T21:33:20.235947+0000","last_unstale":"2024-01-21T21:33:20.604781+0000","last_undegraded":"2024-01-21T21:33:20.604781+0000","last_fullsized":"2024-01-21T21:33:20.604781+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631560+0000","last_change":"2024-01-21T21:33:20.627792+0000","last_active":"2024-01-21T21:33:20.631560+0000","last_peered":"2024-01-21T21:33:20.631560+0000","last_clean":"2024-01-21T21:33:20.631560+0000","last_became_active":"2024-01-21T21:33:20.627501+0000","last_became_peered":"2024-01-21T21:33:20.627501+0000","last_unstale":"2024-01-21T21:33:20.631560+0000","last_undegraded":"2024-01-21T21:33:20.631560+0000","last_fullsized":"2024-01-21T21:33:20.631560+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"206'4","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.622748+0000","last_change":"2024-01-21T21:33:20.236775+0000","last_active":"2024-01-21T21:33:20.622748+0000","last_peered":"2024-01-21T21:33:20.622748+0000","last_clean":"2024-01-21T21:33:20.622748+0000","last_became_active":"2024-01-21T21:33:20.236449+0000","last_became_peered":"2024-01-21T21:33:20.236449+0000","last_unstale":"2024-01-21T21:33:20.622748+0000","last_undegraded":"2024-01-21T21:33:20.622748+0000","last_fullsized":"2024-01-21T21:33:20.622748+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621156+0000","last_change":"2024-01-21T21:33:20.615762+0000","last_active":"2024-01-21T21:33:20.621156+0000","last_peered":"2024-01-21T21:33:20.621156+0000","last_clean":"2024-01-21T21:33:20.621156+0000","last_became_active":"2024-01-21T21:33:20.615504+0000","last_became_peered":"2024-01-21T21:33:20.615504+0000","last_unstale":"2024-01-21T21:33:20.621156+0000","last_undegraded":"2024-01-21T21:33:20.621156+0000","last_fullsized":"2024-01-21T21:33:20.621156+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.622772+0000","last_change":"2024-01-21T21:33:20.238076+0000","last_active":"2024-01-21T21:33:20.622772+0000","last_peered":"2024-01-21T21:33:20.622772+0000","last_clean":"2024-01-21T21:33:20.622772+0000","last_became_active":"2024-01-21T21:33:20.237817+0000","last_became_peered":"2024-01-21T21:33:20.237817+0000","last_unstale":"2024-01-21T21:33:20.622772+0000","last_undegraded":"2024-01-21T21:33:20.622772+0000","last_fullsized":"2024-01-21T21:33:20.622772+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631512+0000","last_change":"2024-01-21T21:33:20.630652+0000","last_active":"2024-01-21T21:33:20.631512+0000","last_peered":"2024-01-21T21:33:20.631512+0000","last_clean":"2024-01-21T21:33:20.631512+0000","last_became_active":"2024-01-21T21:33:20.630341+0000","last_became_peered":"2024-01-21T21:33:20.630341+0000","last_unstale":"2024-01-21T21:33:20.631512+0000","last_undegraded":"2024-01-21T21:33:20.631512+0000","last_fullsized":"2024-01-21T21:33:20.631512+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627877+0000","last_change":"2024-01-21T21:33:20.244470+0000","last_active":"2024-01-21T21:33:20.627877+0000","last_peered":"2024-01-21T21:33:20.627877+0000","last_clean":"2024-01-21T21:33:20.627877+0000","last_became_active":"2024-01-21T21:33:20.243985+0000","last_became_peered":"2024-01-21T21:33:20.243985+0000","last_unstale":"2024-01-21T21:33:20.627877+0000","last_undegraded":"2024-01-21T21:33:20.627877+0000","last_fullsized":"2024-01-21T21:33:20.627877+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.614954+0000","last_change":"2024-01-21T21:33:20.612164+0000","last_active":"2024-01-21T21:33:20.614954+0000","last_peered":"2024-01-21T21:33:20.614954+0000","last_clean":"2024-01-21T21:33:20.614954+0000","last_became_active":"2024-01-21T21:33:20.611488+0000","last_became_peered":"2024-01-21T21:33:20.611488+0000","last_unstale":"2024-01-21T21:33:20.614954+0000","last_undegraded":"2024-01-21T21:33:20.614954+0000","last_fullsized":"2024-01-21T21:33:20.614954+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611947+0000","last_change":"2024-01-21T21:33:20.245628+0000","last_active":"2024-01-21T21:33:20.611947+0000","last_peered":"2024-01-21T21:33:20.611947+0000","last_clean":"2024-01-21T21:33:20.611947+0000","last_became_active":"2024-01-21T21:33:20.245250+0000","last_became_peered":"2024-01-21T21:33:20.245250+0000","last_unstale":"2024-01-21T21:33:20.611947+0000","last_undegraded":"2024-01-21T21:33:20.611947+0000","last_fullsized":"2024-01-21T21:33:20.611947+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632031+0000","last_change":"2024-01-21T21:33:20.616847+0000","last_active":"2024-01-21T21:33:20.632031+0000","last_peered":"2024-01-21T21:33:20.632031+0000","last_clean":"2024-01-21T21:33:20.632031+0000","last_became_active":"2024-01-21T21:33:20.616561+0000","last_became_peered":"2024-01-21T21:33:20.616561+0000","last_unstale":"2024-01-21T21:33:20.632031+0000","last_undegraded":"2024-01-21T21:33:20.632031+0000","last_fullsized":"2024-01-21T21:33:20.632031+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.605017+0000","last_change":"2024-01-21T21:33:20.240633+0000","last_active":"2024-01-21T21:33:20.605017+0000","last_peered":"2024-01-21T21:33:20.605017+0000","last_clean":"2024-01-21T21:33:20.605017+0000","last_became_active":"2024-01-21T21:33:20.239598+0000","last_became_peered":"2024-01-21T21:33:20.239598+0000","last_unstale":"2024-01-21T21:33:20.605017+0000","last_undegraded":"2024-01-21T21:33:20.605017+0000","last_fullsized":"2024-01-21T21:33:20.605017+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631926+0000","last_change":"2024-01-21T21:33:20.615903+0000","last_active":"2024-01-21T21:33:20.631926+0000","last_peered":"2024-01-21T21:33:20.631926+0000","last_clean":"2024-01-21T21:33:20.631926+0000","last_became_active":"2024-01-21T21:33:20.615609+0000","last_became_peered":"2024-01-21T21:33:20.615609+0000","last_unstale":"2024-01-21T21:33:20.631926+0000","last_undegraded":"2024-01-21T21:33:20.631926+0000","last_fullsized":"2024-01-21T21:33:20.631926+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.627264+0000","last_change":"2024-01-21T21:33:20.245338+0000","last_active":"2024-01-21T21:33:20.627264+0000","last_peered":"2024-01-21T21:33:20.627264+0000","last_clean":"2024-01-21T21:33:20.627264+0000","last_became_active":"2024-01-21T21:33:20.244567+0000","last_became_peered":"2024-01-21T21:33:20.244567+0000","last_unstale":"2024-01-21T21:33:20.627264+0000","last_undegraded":"2024-01-21T21:33:20.627264+0000","last_fullsized":"2024-01-21T21:33:20.627264+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.629842+0000","last_change":"2024-01-21T21:33:20.628205+0000","last_active":"2024-01-21T21:33:20.629842+0000","last_peered":"2024-01-21T21:33:20.629842+0000","last_clean":"2024-01-21T21:33:20.629842+0000","last_became_active":"2024-01-21T21:33:20.627913+0000","last_became_peered":"2024-01-21T21:33:20.627913+0000","last_unstale":"2024-01-21T21:33:20.629842+0000","last_undegraded":"2024-01-21T21:33:20.629842+0000","last_fullsized":"2024-01-21T21:33:20.629842+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604966+0000","last_change":"2024-01-21T21:33:20.248006+0000","last_active":"2024-01-21T21:33:20.604966+0000","last_peered":"2024-01-21T21:33:20.604966+0000","last_clean":"2024-01-21T21:33:20.604966+0000","last_became_active":"2024-01-21T21:33:20.247726+0000","last_became_peered":"2024-01-21T21:33:20.247726+0000","last_unstale":"2024-01-21T21:33:20.604966+0000","last_undegraded":"2024-01-21T21:33:20.604966+0000","last_fullsized":"2024-01-21T21:33:20.604966+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.615256+0000","last_change":"2024-01-21T21:33:20.609562+0000","last_active":"2024-01-21T21:33:20.615256+0000","last_peered":"2024-01-21T21:33:20.615256+0000","last_clean":"2024-01-21T21:33:20.615256+0000","last_became_active":"2024-01-21T21:33:20.609303+0000","last_became_peered":"2024-01-21T21:33:20.609303+0000","last_unstale":"2024-01-21T21:33:20.615256+0000","last_undegraded":"2024-01-21T21:33:20.615256+0000","last_fullsized":"2024-01-21T21:33:20.615256+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601718+0000","last_change":"2024-01-21T21:33:20.254574+0000","last_active":"2024-01-21T21:33:20.601718+0000","last_peered":"2024-01-21T21:33:20.601718+0000","last_clean":"2024-01-21T21:33:20.601718+0000","last_became_active":"2024-01-21T21:33:20.254274+0000","last_became_peered":"2024-01-21T21:33:20.254274+0000","last_unstale":"2024-01-21T21:33:20.601718+0000","last_undegraded":"2024-01-21T21:33:20.601718+0000","last_fullsized":"2024-01-21T21:33:20.601718+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624936+0000","last_change":"2024-01-21T21:33:20.615841+0000","last_active":"2024-01-21T21:33:20.624936+0000","last_peered":"2024-01-21T21:33:20.624936+0000","last_clean":"2024-01-21T21:33:20.624936+0000","last_became_active":"2024-01-21T21:33:20.615566+0000","last_became_peered":"2024-01-21T21:33:20.615566+0000","last_unstale":"2024-01-21T21:33:20.624936+0000","last_undegraded":"2024-01-21T21:33:20.624936+0000","last_fullsized":"2024-01-21T21:33:20.624936+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.613565+0000","last_change":"2024-01-21T21:33:20.241218+0000","last_active":"2024-01-21T21:33:20.613565+0000","last_peered":"2024-01-21T21:33:20.613565+0000","last_clean":"2024-01-21T21:33:20.613565+0000","last_became_active":"2024-01-21T21:33:20.240930+0000","last_became_peered":"2024-01-21T21:33:20.240930+0000","last_unstale":"2024-01-21T21:33:20.613565+0000","last_undegraded":"2024-01-21T21:33:20.613565+0000","last_fullsized":"2024-01-21T21:33:20.613565+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.619451+0000","last_change":"2024-01-21T21:33:20.614258+0000","last_active":"2024-01-21T21:33:20.619451+0000","last_peered":"2024-01-21T21:33:20.619451+0000","last_clean":"2024-01-21T21:33:20.619451+0000","last_became_active":"2024-01-21T21:33:20.614005+0000","last_became_peered":"2024-01-21T21:33:20.614005+0000","last_unstale":"2024-01-21T21:33:20.619451+0000","last_undegraded":"2024-01-21T21:33:20.619451+0000","last_fullsized":"2024-01-21T21:33:20.619451+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623794+0000","last_change":"2024-01-21T21:33:20.248557+0000","last_active":"2024-01-21T21:33:20.623794+0000","last_peered":"2024-01-21T21:33:20.623794+0000","last_clean":"2024-01-21T21:33:20.623794+0000","last_became_active":"2024-01-21T21:33:20.247951+0000","last_became_peered":"2024-01-21T21:33:20.247951+0000","last_unstale":"2024-01-21T21:33:20.623794+0000","last_undegraded":"2024-01-21T21:33:20.623794+0000","last_fullsized":"2024-01-21T21:33:20.623794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632420+0000","last_change":"2024-01-21T21:33:20.621122+0000","last_active":"2024-01-21T21:33:20.632420+0000","last_peered":"2024-01-21T21:33:20.632420+0000","last_clean":"2024-01-21T21:33:20.632420+0000","last_became_active":"2024-01-21T21:33:20.620828+0000","last_became_peered":"2024-01-21T21:33:20.620828+0000","last_unstale":"2024-01-21T21:33:20.632420+0000","last_undegraded":"2024-01-21T21:33:20.632420+0000","last_fullsized":"2024-01-21T21:33:20.632420+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601923+0000","last_change":"2024-01-21T21:33:20.254575+0000","last_active":"2024-01-21T21:33:20.601923+0000","last_peered":"2024-01-21T21:33:20.601923+0000","last_clean":"2024-01-21T21:33:20.601923+0000","last_became_active":"2024-01-21T21:33:20.254258+0000","last_became_peered":"2024-01-21T21:33:20.254258+0000","last_unstale":"2024-01-21T21:33:20.601923+0000","last_undegraded":"2024-01-21T21:33:20.601923+0000","last_fullsized":"2024-01-21T21:33:20.601923+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.626225+0000","last_change":"2024-01-21T21:33:20.624428+0000","last_active":"2024-01-21T21:33:20.626225+0000","last_peered":"2024-01-21T21:33:20.626225+0000","last_clean":"2024-01-21T21:33:20.626225+0000","last_became_active":"2024-01-21T21:33:20.624167+0000","last_became_peered":"2024-01-21T21:33:20.624167+0000","last_unstale":"2024-01-21T21:33:20.626225+0000","last_undegraded":"2024-01-21T21:33:20.626225+0000","last_fullsized":"2024-01-21T21:33:20.626225+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.607011+0000","last_change":"2024-01-21T21:33:20.242392+0000","last_active":"2024-01-21T21:33:20.607011+0000","last_peered":"2024-01-21T21:33:20.607011+0000","last_clean":"2024-01-21T21:33:20.607011+0000","last_became_active":"2024-01-21T21:33:20.242117+0000","last_became_peered":"2024-01-21T21:33:20.242117+0000","last_unstale":"2024-01-21T21:33:20.607011+0000","last_undegraded":"2024-01-21T21:33:20.607011+0000","last_fullsized":"2024-01-21T21:33:20.607011+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.619737+0000","last_change":"2024-01-21T21:33:20.613594+0000","last_active":"2024-01-21T21:33:20.619737+0000","last_peered":"2024-01-21T21:33:20.619737+0000","last_clean":"2024-01-21T21:33:20.619737+0000","last_became_active":"2024-01-21T21:33:20.611894+0000","last_became_peered":"2024-01-21T21:33:20.611894+0000","last_unstale":"2024-01-21T21:33:20.619737+0000","last_undegraded":"2024-01-21T21:33:20.619737+0000","last_fullsized":"2024-01-21T21:33:20.619737+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608930+0000","last_change":"2024-01-21T21:33:20.255346+0000","last_active":"2024-01-21T21:33:20.608930+0000","last_peered":"2024-01-21T21:33:20.608930+0000","last_clean":"2024-01-21T21:33:20.608930+0000","last_became_active":"2024-01-21T21:33:20.255039+0000","last_became_peered":"2024-01-21T21:33:20.255039+0000","last_unstale":"2024-01-21T21:33:20.608930+0000","last_undegraded":"2024-01-21T21:33:20.608930+0000","last_fullsized":"2024-01-21T21:33:20.608930+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623030+0000","last_change":"2024-01-21T21:33:20.620554+0000","last_active":"2024-01-21T21:33:20.623030+0000","last_peered":"2024-01-21T21:33:20.623030+0000","last_clean":"2024-01-21T21:33:20.623030+0000","last_became_active":"2024-01-21T21:33:20.620274+0000","last_became_peered":"2024-01-21T21:33:20.620274+0000","last_unstale":"2024-01-21T21:33:20.623030+0000","last_undegraded":"2024-01-21T21:33:20.623030+0000","last_fullsized":"2024-01-21T21:33:20.623030+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616876+0000","last_change":"2024-01-21T21:33:20.246900+0000","last_active":"2024-01-21T21:33:20.616876+0000","last_peered":"2024-01-21T21:33:20.616876+0000","last_clean":"2024-01-21T21:33:20.616876+0000","last_became_active":"2024-01-21T21:33:20.246585+0000","last_became_peered":"2024-01-21T21:33:20.246585+0000","last_unstale":"2024-01-21T21:33:20.616876+0000","last_undegraded":"2024-01-21T21:33:20.616876+0000","last_fullsized":"2024-01-21T21:33:20.616876+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631549+0000","last_change":"2024-01-21T21:33:20.627690+0000","last_active":"2024-01-21T21:33:20.631549+0000","last_peered":"2024-01-21T21:33:20.631549+0000","last_clean":"2024-01-21T21:33:20.631549+0000","last_became_active":"2024-01-21T21:33:20.627348+0000","last_became_peered":"2024-01-21T21:33:20.627348+0000","last_unstale":"2024-01-21T21:33:20.631549+0000","last_undegraded":"2024-01-21T21:33:20.631549+0000","last_fullsized":"2024-01-21T21:33:20.631549+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616416+0000","last_change":"2024-01-21T21:33:20.243525+0000","last_active":"2024-01-21T21:33:20.616416+0000","last_peered":"2024-01-21T21:33:20.616416+0000","last_clean":"2024-01-21T21:33:20.616416+0000","last_became_active":"2024-01-21T21:33:20.243137+0000","last_became_peered":"2024-01-21T21:33:20.243137+0000","last_unstale":"2024-01-21T21:33:20.616416+0000","last_undegraded":"2024-01-21T21:33:20.616416+0000","last_fullsized":"2024-01-21T21:33:20.616416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620473+0000","last_change":"2024-01-21T21:33:20.615735+0000","last_active":"2024-01-21T21:33:20.620473+0000","last_peered":"2024-01-21T21:33:20.620473+0000","last_clean":"2024-01-21T21:33:20.620473+0000","last_became_active":"2024-01-21T21:33:20.615449+0000","last_became_peered":"2024-01-21T21:33:20.615449+0000","last_unstale":"2024-01-21T21:33:20.620473+0000","last_undegraded":"2024-01-21T21:33:20.620473+0000","last_fullsized":"2024-01-21T21:33:20.620473+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.601842+0000","last_change":"2024-01-21T21:33:20.245996+0000","last_active":"2024-01-21T21:33:20.601842+0000","last_peered":"2024-01-21T21:33:20.601842+0000","last_clean":"2024-01-21T21:33:20.601842+0000","last_became_active":"2024-01-21T21:33:20.245626+0000","last_became_peered":"2024-01-21T21:33:20.245626+0000","last_unstale":"2024-01-21T21:33:20.601842+0000","last_undegraded":"2024-01-21T21:33:20.601842+0000","last_fullsized":"2024-01-21T21:33:20.601842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.633333+0000","last_change":"2024-01-21T21:33:20.632860+0000","last_active":"2024-01-21T21:33:20.633333+0000","last_peered":"2024-01-21T21:33:20.633333+0000","last_clean":"2024-01-21T21:33:20.633333+0000","last_became_active":"2024-01-21T21:33:20.632569+0000","last_became_peered":"2024-01-21T21:33:20.632569+0000","last_unstale":"2024-01-21T21:33:20.633333+0000","last_undegraded":"2024-01-21T21:33:20.633333+0000","last_fullsized":"2024-01-21T21:33:20.633333+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.610781+0000","last_change":"2024-01-21T21:33:20.245507+0000","last_active":"2024-01-21T21:33:20.610781+0000","last_peered":"2024-01-21T21:33:20.610781+0000","last_clean":"2024-01-21T21:33:20.610781+0000","last_became_active":"2024-01-21T21:33:20.245216+0000","last_became_peered":"2024-01-21T21:33:20.245216+0000","last_unstale":"2024-01-21T21:33:20.610781+0000","last_undegraded":"2024-01-21T21:33:20.610781+0000","last_fullsized":"2024-01-21T21:33:20.610781+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.625817+0000","last_change":"2024-01-21T21:33:20.621166+0000","last_active":"2024-01-21T21:33:20.625817+0000","last_peered":"2024-01-21T21:33:20.625817+0000","last_clean":"2024-01-21T21:33:20.625817+0000","last_became_active":"2024-01-21T21:33:20.620802+0000","last_became_peered":"2024-01-21T21:33:20.620802+0000","last_unstale":"2024-01-21T21:33:20.625817+0000","last_undegraded":"2024-01-21T21:33:20.625817+0000","last_fullsized":"2024-01-21T21:33:20.625817+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620099+0000","last_change":"2024-01-21T21:33:20.248781+0000","last_active":"2024-01-21T21:33:20.620099+0000","last_peered":"2024-01-21T21:33:20.620099+0000","last_clean":"2024-01-21T21:33:20.620099+0000","last_became_active":"2024-01-21T21:33:20.248376+0000","last_became_peered":"2024-01-21T21:33:20.248376+0000","last_unstale":"2024-01-21T21:33:20.620099+0000","last_undegraded":"2024-01-21T21:33:20.620099+0000","last_fullsized":"2024-01-21T21:33:20.620099+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.611368+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:20.611368+0000","last_peered":"2024-01-21T21:33:20.611368+0000","last_clean":"2024-01-21T21:33:20.611368+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:20.611368+0000","last_undegraded":"2024-01-21T21:33:20.611368+0000","last_fullsized":"2024-01-21T21:33:20.611368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632868+0000","last_change":"2024-01-21T21:33:20.630556+0000","last_active":"2024-01-21T21:33:20.632868+0000","last_peered":"2024-01-21T21:33:20.632868+0000","last_clean":"2024-01-21T21:33:20.632868+0000","last_became_active":"2024-01-21T21:33:20.630262+0000","last_became_peered":"2024-01-21T21:33:20.630262+0000","last_unstale":"2024-01-21T21:33:20.632868+0000","last_undegraded":"2024-01-21T21:33:20.632868+0000","last_fullsized":"2024-01-21T21:33:20.632868+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.607011+0000","last_change":"2024-01-21T21:33:20.240386+0000","last_active":"2024-01-21T21:33:20.607011+0000","last_peered":"2024-01-21T21:33:20.607011+0000","last_clean":"2024-01-21T21:33:20.607011+0000","last_became_active":"2024-01-21T21:33:20.240043+0000","last_became_peered":"2024-01-21T21:33:20.240043+0000","last_unstale":"2024-01-21T21:33:20.607011+0000","last_undegraded":"2024-01-21T21:33:20.607011+0000","last_fullsized":"2024-01-21T21:33:20.607011+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":190,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.605214+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:20.605214+0000","last_peered":"2024-01-21T21:33:20.605214+0000","last_clean":"2024-01-21T21:33:20.605214+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:20.605214+0000","last_undegraded":"2024-01-21T21:33:20.605214+0000","last_fullsized":"2024-01-21T21:33:20.605214+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.632402+0000","last_change":"2024-01-21T21:33:20.620500+0000","last_active":"2024-01-21T21:33:20.632402+0000","last_peered":"2024-01-21T21:33:20.632402+0000","last_clean":"2024-01-21T21:33:20.632402+0000","last_became_active":"2024-01-21T21:33:20.620235+0000","last_became_peered":"2024-01-21T21:33:20.620235+0000","last_unstale":"2024-01-21T21:33:20.632402+0000","last_undegraded":"2024-01-21T21:33:20.632402+0000","last_fullsized":"2024-01-21T21:33:20.632402+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604869+0000","last_change":"2024-01-21T21:33:20.243644+0000","last_active":"2024-01-21T21:33:20.604869+0000","last_peered":"2024-01-21T21:33:20.604869+0000","last_clean":"2024-01-21T21:33:20.604869+0000","last_became_active":"2024-01-21T21:33:20.242456+0000","last_became_peered":"2024-01-21T21:33:20.242456+0000","last_unstale":"2024-01-21T21:33:20.604869+0000","last_undegraded":"2024-01-21T21:33:20.604869+0000","last_fullsized":"2024-01-21T21:33:20.604869+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.603416+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:20.603416+0000","last_peered":"2024-01-21T21:33:20.603416+0000","last_clean":"2024-01-21T21:33:20.603416+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:20.603416+0000","last_undegraded":"2024-01-21T21:33:20.603416+0000","last_fullsized":"2024-01-21T21:33:20.603416+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.623082+0000","last_change":"2024-01-21T21:33:20.616373+0000","last_active":"2024-01-21T21:33:20.623082+0000","last_peered":"2024-01-21T21:33:20.623082+0000","last_clean":"2024-01-21T21:33:20.623082+0000","last_became_active":"2024-01-21T21:33:20.616096+0000","last_became_peered":"2024-01-21T21:33:20.616096+0000","last_unstale":"2024-01-21T21:33:20.623082+0000","last_undegraded":"2024-01-21T21:33:20.623082+0000","last_fullsized":"2024-01-21T21:33:20.623082+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.605120+0000","last_change":"2024-01-21T21:33:20.239936+0000","last_active":"2024-01-21T21:33:20.605120+0000","last_peered":"2024-01-21T21:33:20.605120+0000","last_clean":"2024-01-21T21:33:20.605120+0000","last_became_active":"2024-01-21T21:33:20.239603+0000","last_became_peered":"2024-01-21T21:33:20.239603+0000","last_unstale":"2024-01-21T21:33:20.605120+0000","last_undegraded":"2024-01-21T21:33:20.605120+0000","last_fullsized":"2024-01-21T21:33:20.605120+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":190,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.604144+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:20.604144+0000","last_peered":"2024-01-21T21:33:20.604144+0000","last_clean":"2024-01-21T21:33:20.604144+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:20.604144+0000","last_undegraded":"2024-01-21T21:33:20.604144+0000","last_fullsized":"2024-01-21T21:33:20.604144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":170,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616317+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:20.616317+0000","last_peered":"2024-01-21T21:33:20.616317+0000","last_clean":"2024-01-21T21:33:20.616317+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:20.616317+0000","last_undegraded":"2024-01-21T21:33:20.616317+0000","last_fullsized":"2024-01-21T21:33:20.616317+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.631517+0000","last_change":"2024-01-21T21:33:20.627551+0000","last_active":"2024-01-21T21:33:20.631517+0000","last_peered":"2024-01-21T21:33:20.631517+0000","last_clean":"2024-01-21T21:33:20.631517+0000","last_became_active":"2024-01-21T21:33:20.627215+0000","last_became_peered":"2024-01-21T21:33:20.627215+0000","last_unstale":"2024-01-21T21:33:20.631517+0000","last_undegraded":"2024-01-21T21:33:20.631517+0000","last_fullsized":"2024-01-21T21:33:20.631517+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.607719+0000","last_change":"2024-01-21T21:33:20.241849+0000","last_active":"2024-01-21T21:33:20.607719+0000","last_peered":"2024-01-21T21:33:20.607719+0000","last_clean":"2024-01-21T21:33:20.607719+0000","last_became_active":"2024-01-21T21:33:20.241529+0000","last_became_peered":"2024-01-21T21:33:20.241529+0000","last_unstale":"2024-01-21T21:33:20.607719+0000","last_undegraded":"2024-01-21T21:33:20.607719+0000","last_fullsized":"2024-01-21T21:33:20.607719+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.616422+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:20.616422+0000","last_peered":"2024-01-21T21:33:20.616422+0000","last_clean":"2024-01-21T21:33:20.616422+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:20.616422+0000","last_undegraded":"2024-01-21T21:33:20.616422+0000","last_fullsized":"2024-01-21T21:33:20.616422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.620278+0000","last_change":"2024-01-21T21:33:20.611615+0000","last_active":"2024-01-21T21:33:20.620278+0000","last_peered":"2024-01-21T21:33:20.620278+0000","last_clean":"2024-01-21T21:33:20.620278+0000","last_became_active":"2024-01-21T21:33:20.611363+0000","last_became_peered":"2024-01-21T21:33:20.611363+0000","last_unstale":"2024-01-21T21:33:20.620278+0000","last_undegraded":"2024-01-21T21:33:20.620278+0000","last_fullsized":"2024-01-21T21:33:20.620278+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"206'1","reported_seq":11,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.621983+0000","last_change":"2024-01-21T21:33:20.242804+0000","last_active":"2024-01-21T21:33:20.621983+0000","last_peered":"2024-01-21T21:33:20.621983+0000","last_clean":"2024-01-21T21:33:20.621983+0000","last_became_active":"2024-01-21T21:33:20.241463+0000","last_became_peered":"2024-01-21T21:33:20.241463+0000","last_unstale":"2024-01-21T21:33:20.621983+0000","last_undegraded":"2024-01-21T21:33:20.621983+0000","last_fullsized":"2024-01-21T21:33:20.621983+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.617565+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:20.617565+0000","last_peered":"2024-01-21T21:33:20.617565+0000","last_clean":"2024-01-21T21:33:20.617565+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:20.617565+0000","last_undegraded":"2024-01-21T21:33:20.617565+0000","last_fullsized":"2024-01-21T21:33:20.617565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.618983+0000","last_change":"2024-01-21T21:33:20.614846+0000","last_active":"2024-01-21T21:33:20.618983+0000","last_peered":"2024-01-21T21:33:20.618983+0000","last_clean":"2024-01-21T21:33:20.618983+0000","last_became_active":"2024-01-21T21:33:20.614536+0000","last_became_peered":"2024-01-21T21:33:20.614536+0000","last_unstale":"2024-01-21T21:33:20.618983+0000","last_undegraded":"2024-01-21T21:33:20.618983+0000","last_fullsized":"2024-01-21T21:33:20.618983+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"206'2","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.628454+0000","last_change":"2024-01-21T21:33:20.231209+0000","last_active":"2024-01-21T21:33:20.628454+0000","last_peered":"2024-01-21T21:33:20.628454+0000","last_clean":"2024-01-21T21:33:20.628454+0000","last_became_active":"2024-01-21T21:33:20.230896+0000","last_became_peered":"2024-01-21T21:33:20.230896+0000","last_unstale":"2024-01-21T21:33:20.628454+0000","last_undegraded":"2024-01-21T21:33:20.628454+0000","last_fullsized":"2024-01-21T21:33:20.628454+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612390+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:20.612390+0000","last_peered":"2024-01-21T21:33:20.612390+0000","last_clean":"2024-01-21T21:33:20.612390+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:20.612390+0000","last_undegraded":"2024-01-21T21:33:20.612390+0000","last_fullsized":"2024-01-21T21:33:20.612390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.624237+0000","last_change":"2024-01-21T21:33:20.621649+0000","last_active":"2024-01-21T21:33:20.624237+0000","last_peered":"2024-01-21T21:33:20.624237+0000","last_clean":"2024-01-21T21:33:20.624237+0000","last_became_active":"2024-01-21T21:33:20.621374+0000","last_became_peered":"2024-01-21T21:33:20.621374+0000","last_unstale":"2024-01-21T21:33:20.624237+0000","last_undegraded":"2024-01-21T21:33:20.624237+0000","last_fullsized":"2024-01-21T21:33:20.624237+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":205,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:20.216437+0000","last_clean_scrub_stamp":"2024-01-21T21:33:20.216437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.608993+0000","last_change":"2024-01-21T21:33:20.244478+0000","last_active":"2024-01-21T21:33:20.608993+0000","last_peered":"2024-01-21T21:33:20.608993+0000","last_clean":"2024-01-21T21:33:20.608993+0000","last_became_active":"2024-01-21T21:33:20.244177+0000","last_became_peered":"2024-01-21T21:33:20.244177+0000","last_unstale":"2024-01-21T21:33:20.608993+0000","last_undegraded":"2024-01-21T21:33:20.608993+0000","last_fullsized":"2024-01-21T21:33:20.608993+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:19.212221+0000","last_clean_scrub_stamp":"2024-01-21T21:33:19.212221+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-01-21T21:33:20.612626+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:20.612626+0000","last_peered":"2024-01-21T21:33:20.612626+0000","last_clean":"2024-01-21T21:33:20.612626+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:20.612626+0000","last_undegraded":"2024-01-21T21:33:20.612626+0000","last_fullsized":"2024-01-21T21:33:20.612626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575971,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2596864,"data_stored":1403339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.47099999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575971,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059920,"statfs":{"total":96636764160,"available":96317358080,"internally_reserved":0,"allocated":2596864,"data_stored":1403746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.66500000000000004}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.58499999999999996}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.64100000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.75},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.72199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303724,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068116,"statfs":{"total":96636764160,"available":96325750784,"internally_reserved":0,"allocated":2592768,"data_stored":1402854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.315},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.26500000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.28599999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.434}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.501}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.54700000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.495},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575972,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307836,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064004,"statfs":{"total":96636764160,"available":96321540096,"internally_reserved":0,"allocated":2609152,"data_stored":1402663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.38},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.432},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.40799999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.34999999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.627}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.622}]}]},{"osd":2,"up_from":13,"seq":55834575972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307820,"kb_used_data":2532,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064020,"statfs":{"total":96636764160,"available":96321556480,"internally_reserved":0,"allocated":2592768,"data_stored":1402854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.37},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.36099999999999999}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.29599999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.379},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.34200000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60099999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.58899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575972,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307824,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064016,"statfs":{"total":96636764160,"available":96321552384,"internally_reserved":0,"allocated":2596864,"data_stored":1402944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.316}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.26600000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.433},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.38300000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.39000000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575972,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307832,"kb_used_data":2544,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94064008,"statfs":{"total":96636764160,"available":96321544192,"internally_reserved":0,"allocated":2605056,"data_stored":1403532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.57499999999999996}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.51600000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.41799999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.39500000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.439}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.56299999999999994}]}]},{"osd":5,"up_from":13,"seq":55834575971,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316028,"kb_used_data":2548,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055812,"statfs":{"total":96636764160,"available":96313151488,"internally_reserved":0,"allocated":2609152,"data_stored":1403590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.441},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.56299999999999994}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53400000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:28.366 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-21T21:33:28.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-21T21:33:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.520+0000 7f5c81768700 1 Processor -- start 2024-01-21T21:33:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.520+0000 7f5c81768700 1 -- start start 2024-01-21T21:33:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c81768700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c81768700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c7c13aa00 0x7f5c7c158000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c81768700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7c1584f0 con 0x7f5c7c0626f0 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c81768700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c7c0bd6f0 con 0x7f5c7c13aa00 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c81768700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0654e0 con 0x7f5c7c13a620 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c7a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c7c13aa00 0x7f5c7c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c7a7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c7c13aa00 0x7f5c7c158000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35586/0 (socket says 172.21.15.133:35586) 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.521+0000 7f5c7a7fc700 1 -- 172.21.15.133:0/739895328 learned_addr learned my addr 172.21.15.133:0/739895328 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7affd700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7a7fc700 1 -- 172.21.15.133:0/739895328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 msgr2=0x7f5c7c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7a7fc700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0a6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7a7fc700 1 -- 172.21.15.133:0/739895328 >> v1:172.21.15.178:6789/0 conn(0x7f5c7c0626f0 legacy=0x7f5c7c0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7a7fc700 1 -- 172.21.15.133:0/739895328 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c158730 con 0x7f5c7c13aa00 2024-01-21T21:33:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c7a7fc700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c158000 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f5c6c006fd0 tx=0x7f5c6c0090f0).ready entity=mon.0 client_cookie=f3946e21dd4707d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c79ffb700 1 -- 172.21.15.133:0/739895328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00b580 con 0x7f5c7c13aa00 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c79ffb700 1 -- 172.21.15.133:0/739895328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c00b6e0 con 0x7f5c7c13aa00 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c79ffb700 1 -- 172.21.15.133:0/739895328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c00ba80 con 0x7f5c7c13aa00 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c81768700 1 -- 172.21.15.133:0/739895328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c13aa00 msgr2=0x7f5c7c158000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c81768700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c158000 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f5c6c006fd0 tx=0x7f5c6c0090f0).stop 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.522+0000 7f5c81768700 1 -- 172.21.15.133:0/739895328 shutdown_connections 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.523+0000 7f5c81768700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0a6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.523+0000 7f5c81768700 1 --2- 172.21.15.133:0/739895328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c158000 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.523+0000 7f5c81768700 1 -- 172.21.15.133:0/739895328 >> 172.21.15.133:0/739895328 conn(0x7f5c7c0c7dc0 msgr2=0x7f5c7c0c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.523+0000 7f5c81768700 1 -- 172.21.15.133:0/739895328 shutdown_connections 2024-01-21T21:33:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.523+0000 7f5c81768700 1 -- 172.21.15.133:0/739895328 wait complete. 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.524+0000 7f5c81768700 1 Processor -- start 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.524+0000 7f5c81768700 1 -- start start 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0add70 con 0x7f5c7c0626f0 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0ac0f0 con 0x7f5c7c13aa00 2024-01-21T21:33:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7c0aad70 con 0x7f5c7c13a620 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35602/0 (socket says 172.21.15.133:35602) 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 -- 172.21.15.133:0/4136081821 learned_addr learned my addr 172.21.15.133:0/4136081821 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7a7fc700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7b7fe700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 -- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 msgr2=0x7f5c7c0ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 -- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c7c13aa00 msgr2=0x7f5c7c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c0ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 -- 172.21.15.133:0/4136081821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c009370 con 0x7f5c7c0626f0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c7affd700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f5c7000e950 tx=0x7f5c70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70009530 con 0x7f5c7c0626f0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70012600 con 0x7f5c7c0626f0 2024-01-21T21:33:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7c0ab050 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70012980 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.525+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7c0ab8f0 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.526+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7c05fdf0 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.527+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5c70012d30 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.527+0000 7f5c637fe700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 0x7f5c68061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.527+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f5c7007a980 con 0x7f5c7c0626f0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.527+0000 7f5c7a7fc700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 0x7f5c68061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.527+0000 7f5c7a7fc700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 0x7f5c68061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5c6c006fd0 tx=0x7f5c6c017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.531+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f5c7004b980 con 0x7f5c7c0626f0 2024-01-21T21:33:28.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.764+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5c7c06bdd0 con 0x7f5c7c0626f0 2024-01-21T21:33:28.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.767+0000 7f5c637fe700 1 -- 172.21.15.133:0/4136081821 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v52) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5c7004efa0 con 0x7f5c7c0626f0 2024-01-21T21:33:28.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 msgr2=0x7f5c68061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 0x7f5c68061610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f5c6c006fd0 tx=0x7f5c6c017000).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 msgr2=0x7f5c7c1396e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 rx=0x7f5c7000e950 tx=0x7f5c70009060).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 shutdown_connections 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5c6805f150 0x7f5c68061610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c7c13aa00 0x7f5c7c0ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c7c0626f0 0x7f5c7c1396e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 --2- 172.21.15.133:0/4136081821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c7c13a620 0x7f5c7c0ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 >> 172.21.15.133:0/4136081821 conn(0x7f5c7c0c7dc0 msgr2=0x7f5c7c157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 shutdown_connections 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.769+0000 7f5c81768700 1 -- 172.21.15.133:0/4136081821 wait complete. 2024-01-21T21:33:28.773 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2024-01-21T21:33:28.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.898+0000 7f17aa832700 1 Processor -- start 2024-01-21T21:33:28.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.898+0000 7f17aa832700 1 -- start start 2024-01-21T21:33:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17aa832700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 0x7f17a40be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17aa832700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40bfa40 con 0x7f17a413b970 2024-01-21T21:33:28.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17aa832700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40bee30 con 0x7f17a40c3c10 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17aa832700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40bf110 con 0x7f17a40a9ac0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17a413b970 0x7f17a40c3500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59276/0 (socket says 172.21.15.133:59276) 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a3fff700 1 -- 172.21.15.133:0/2263527147 learned_addr learned my addr 172.21.15.133:0/2263527147 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a8dcf700 1 --2- 172.21.15.133:0/2263527147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 0x7f17a40be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4116232087 0 0) 0x7f17a40bfa40 con 0x7f17a413b970 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17900033f0 con 0x7f17a413b970 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187140455 0 0) 0x7f17a40bee30 con 0x7f17a40c3c10 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a8dcf700 1 -- 172.21.15.133:0/2263527147 >> v1:172.21.15.178:6789/0 conn(0x7f17a40c3c10 legacy=0x7f17a40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a8dcf700 1 -- 172.21.15.133:0/2263527147 >> v1:172.21.15.133:6789/0 conn(0x7f17a413b970 legacy=0x7f17a40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.899+0000 7f17a8dcf700 1 -- 172.21.15.133:0/2263527147 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40bf3f0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17a8dcf700 1 --2- 172.21.15.133:0/2263527147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 0x7f17a40be810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f179c009e90 tx=0x7f179c009780).ready entity=mon.2 client_cookie=3b14bafa2facfbd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c00e070 con 0x7f17a40a9ac0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c00b850 con 0x7f17a40a9ac0 2024-01-21T21:33:28.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17a2ffd700 1 -- 172.21.15.133:0/2263527147 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c001470 con 0x7f17a40a9ac0 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 -- 172.21.15.133:0/2263527147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 msgr2=0x7f17a40be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 --2- 172.21.15.133:0/2263527147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 0x7f17a40be810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f179c009e90 tx=0x7f179c009780).stop 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 -- 172.21.15.133:0/2263527147 shutdown_connections 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 --2- 172.21.15.133:0/2263527147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40a9ac0 0x7f17a40be810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 -- 172.21.15.133:0/2263527147 >> 172.21.15.133:0/2263527147 conn(0x7f17a4066a70 msgr2=0x7f17a4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 -- 172.21.15.133:0/2263527147 shutdown_connections 2024-01-21T21:33:28.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.900+0000 7f17aa832700 1 -- 172.21.15.133:0/2263527147 wait complete. 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.901+0000 7f17aa832700 1 Processor -- start 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 -- start start 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 0x7f17a4151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17a413b970 0x7f17a41377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a413a450 con 0x7f17a40a9ac0 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4139840 con 0x7f17a413b970 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17aa832700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4139b20 con 0x7f17a40c3c10 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35616/0 (socket says 172.21.15.133:35616) 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.902+0000 7f17a3fff700 1 -- 172.21.15.133:0/1444198657 learned_addr learned my addr 172.21.15.133:0/1444198657 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a37fe700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 0x7f17a4151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a8dcf700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17a413b970 0x7f17a41377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 -- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 msgr2=0x7f17a4151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 0x7f17a4151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 -- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17a413b970 msgr2=0x7f17a41377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17a413b970 0x7f17a41377f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 -- 172.21.15.133:0/1444198657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c009a20 con 0x7f17a40a9ac0 2024-01-21T21:33:28.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a37fe700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 0x7f17a4151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a3fff700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f178c00c7f0 tx=0x7f178c001b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c007170 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c0072d0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4139e00 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0048c0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.903+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a41336a0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.904+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a405fdf0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.904+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f178c004cb0 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.905+0000 7f17a0ff9700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 0x7f1784061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.905+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f178c07a220 con 0x7f17a40a9ac0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.905+0000 7f17a37fe700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 0x7f1784061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:28.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.905+0000 7f17a37fe700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 0x7f1784061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f17940011e0 tx=0x7f1794009040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:28.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:28.909+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f178c04b1c0 con 0x7f17a40a9ac0 2024-01-21T21:33:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.110+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17a406bd20 con 0x7f17a40a9ac0 2024-01-21T21:33:29.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.111+0000 7f17a0ff9700 1 -- 172.21.15.133:0/1444198657 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7f178c019030 con 0x7f17a40a9ac0 2024-01-21T21:33:29.113 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:29.114 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.112+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 msgr2=0x7f1784061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 0x7f1784061610 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f17940011e0 tx=0x7f1794009040).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 msgr2=0x7f17a41331b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f178c00c7f0 tx=0x7f178c001b70).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 shutdown_connections 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f178405f150 0x7f1784061610 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17a413b970 0x7f17a41377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a40a9ac0 0x7f17a41331b0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 --2- 172.21.15.133:0/1444198657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17a40c3c10 0x7f17a4151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 >> 172.21.15.133:0/1444198657 conn(0x7f17a4066a70 msgr2=0x7f17a40c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 shutdown_connections 2024-01-21T21:33:29.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.113+0000 7f17aa832700 1 -- 172.21.15.133:0/1444198657 wait complete. 2024-01-21T21:33:29.117 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:29.530 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-21T21:33:20.598011+0000', 'modified': '2024-01-21T21:33:22.603623+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10053}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10053': {'gid': 10053, 'name': 'd', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/2870485430', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6833', 'nonce': 2870485430}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 2870485430}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-01-21T21:33:29.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-21T21:33:29.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-01-21T21:33:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.650+0000 7f349d669700 1 Processor -- start 2024-01-21T21:33:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.650+0000 7f349d669700 1 -- start start 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f349d669700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3498062e00 0x7f349815d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f349d669700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980a50f0 con 0x7f34981558c0 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f349d669700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34980a4da0 con 0x7f3498155ca0 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f349d669700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34980bde00 con 0x7f3498062e00 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3498062e00 0x7f349815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3498062e00 0x7f349815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35624/0 (socket says 172.21.15.133:35624) 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 -- 172.21.15.133:0/1970721750 learned_addr learned my addr 172.21.15.133:0/1970721750 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f3496ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34981558c0 0x7f34980626f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59278/0 (socket says 172.21.15.133:59278) 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 -- 172.21.15.133:0/1970721750 >> v1:172.21.15.178:6789/0 conn(0x7f3498155ca0 legacy=0x7f34980bd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 -- 172.21.15.133:0/1970721750 >> v1:172.21.15.133:6789/0 conn(0x7f34981558c0 legacy=0x7f34980626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 -- 172.21.15.133:0/1970721750 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34980be0e0 con 0x7f3498062e00 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f3495ffb700 1 -- 172.21.15.133:0/1970721750 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690021151 0 0) 0x7f34980a50f0 con 0x7f34981558c0 2024-01-21T21:33:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f34977fe700 1 --2- 172.21.15.133:0/1970721750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3498062e00 0x7f349815d150 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f3490009f20 tx=0x7f3490009840).ready entity=mon.0 client_cookie=af1e962345ae5195 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f3495ffb700 1 -- 172.21.15.133:0/1970721750 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000e070 con 0x7f3498062e00 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f3495ffb700 1 -- 172.21.15.133:0/1970721750 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349000ba80 con 0x7f3498062e00 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.651+0000 7f3495ffb700 1 -- 172.21.15.133:0/1970721750 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000be00 con 0x7f3498062e00 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 -- 172.21.15.133:0/1970721750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3498062e00 msgr2=0x7f349815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 --2- 172.21.15.133:0/1970721750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3498062e00 0x7f349815d150 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 rx=0x7f3490009f20 tx=0x7f3490009840).stop 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 -- 172.21.15.133:0/1970721750 shutdown_connections 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 --2- 172.21.15.133:0/1970721750 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3498062e00 0x7f349815d150 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 -- 172.21.15.133:0/1970721750 >> 172.21.15.133:0/1970721750 conn(0x7f34980c8010 msgr2=0x7f34980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 -- 172.21.15.133:0/1970721750 shutdown_connections 2024-01-21T21:33:29.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.652+0000 7f349d669700 1 -- 172.21.15.133:0/1970721750 wait complete. 2024-01-21T21:33:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.653+0000 7f349d669700 1 Processor -- start 2024-01-21T21:33:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.653+0000 7f349d669700 1 -- start start 2024-01-21T21:33:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3498062e00 0x7f34981560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 0x7f34980c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498162a40 con 0x7f34981558c0 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3498156880 con 0x7f3498155ca0 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f349d669700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3498156b60 con 0x7f3498062e00 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35640/0 (socket says 172.21.15.133:35640) 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 -- 172.21.15.133:0/760851490 learned_addr learned my addr 172.21.15.133:0/760851490 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f3496ffd700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3498062e00 0x7f34981560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34977fe700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 0x7f34980c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 -- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3498062e00 msgr2=0x7f34981560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3498062e00 0x7f34981560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 -- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 msgr2=0x7f34980c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 0x7f34980c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34967fc700 1 -- 172.21.15.133:0/760851490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009ae0 con 0x7f34981558c0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.654+0000 7f34977fe700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 0x7f34980c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f34967fc700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f348c00c440 tx=0x7f348c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f347f7fe700 1 -- 172.21.15.133:0/760851490 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00ce40 con 0x7f34981558c0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f347f7fe700 1 -- 172.21.15.133:0/760851490 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c015b70 con 0x7f34981558c0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3498156e40 con 0x7f34981558c0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f347f7fe700 1 -- 172.21.15.133:0/760851490 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c015d00 con 0x7f34981558c0 2024-01-21T21:33:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.655+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498151520 con 0x7f34981558c0 2024-01-21T21:33:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.657+0000 7f347f7fe700 1 -- 172.21.15.133:0/760851490 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f348c01b030 con 0x7f34981558c0 2024-01-21T21:33:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.657+0000 7f347f7fe700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 0x7f3484061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.657+0000 7f347f7fe700 1 -- 172.21.15.133:0/760851490 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f348c081c20 con 0x7f34981558c0 2024-01-21T21:33:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.657+0000 7f3496ffd700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 0x7f3484061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.658+0000 7f3496ffd700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 0x7f3484061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f34880011e0 tx=0x7f3488007bb0).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.659+0000 7f34af00cb80 1 Processor -- start 2024-01-21T21:33:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.659+0000 7f34af00cb80 1 -- start start 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686a96270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a686a113d0 con 0x55a686a9a620 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6869d6be0 con 0x55a686a95df0 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6869ec260 con 0x55a686ae32c0 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35644/0 (socket says 172.21.15.133:35644) 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.660+0000 7f3496ffd700 1 -- 172.21.15.133:0/3041270814 learned_addr learned my addr 172.21.15.133:0/3041270814 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f34967fc700 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f34977fe700 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686a96270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 -- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 msgr2=0x55a686a95900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a95900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 -- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 msgr2=0x55a686a96270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686a96270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 -- 172.21.15.133:0/3041270814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6869e52f0 con 0x55a686a9a620 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f3496ffd700 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f3488001710 tx=0x7f348800a000).ready entity=mon.0 client_cookie=385abf513a22bf2a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f347cff9700 1 -- 172.21.15.133:0/3041270814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348801c070 con 0x55a686a9a620 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f347cff9700 1 -- 172.21.15.133:0/3041270814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488016480 con 0x55a686a9a620 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.661+0000 7f347cff9700 1 -- 172.21.15.133:0/3041270814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880165f0 con 0x55a686a9a620 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- 172.21.15.133:0/3041270814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 msgr2=0x55a686a9aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f3488001710 tx=0x7f348800a000).stop 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- 172.21.15.133:0/3041270814 shutdown_connections 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686a96270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a9aa00 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 --2- 172.21.15.133:0/3041270814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a95900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- 172.21.15.133:0/3041270814 >> 172.21.15.133:0/3041270814 conn(0x55a6869032e0 msgr2=0x55a686ae3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- 172.21.15.133:0/3041270814 shutdown_connections 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- 172.21.15.133:0/3041270814 wait complete. 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 -- start start 2024-01-21T21:33:29.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.662+0000 7f34af00cb80 1 Processor -- start 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686a9a620 0x55a686ac5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686ae32c0 0x55a686ac4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6869ec3a0 con 0x55a686a95df0 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6869ec620 con 0x55a686ae32c0 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a6869b7990 con 0x55a686a9a620 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f34af00cb80 10 client.0 ll_register_callbacks cb 0x55a686a5a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35660/0 (socket says 172.21.15.133:35660) 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.663+0000 7f3496ffd700 1 -- 172.21.15.133:0/11990941 learned_addr learned my addr 172.21.15.133:0/11990941 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 -- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686a9a620 msgr2=0x55a686ac5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686a9a620 0x55a686ac5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34977fe700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686ae32c0 0x55a686ac4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 -- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686ae32c0 msgr2=0x55a686ac4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686ae32c0 0x55a686ac4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 -- 172.21.15.133:0/11990941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34880013b0 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3496ffd700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3488007710 tx=0x7f3488017000).ready entity=mon.0 client_cookie=5cd209a44fa75cdc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488029070 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f348801ec00 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a686a94df0 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34880147b0 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 10 client.10218 fetch_fsmap learned FSMap version 74 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a6869e0520 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488032070 con 0x55a686a95df0 2024-01-21T21:33:29.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3488014910 con 0x55a686a95df0 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 10 client.10218 fetch_fsmap finished waiting for FSMap version 74 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 10 client.10218 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 20 client.10218 populate_metadata read hostname 'smithi133' 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686ac1a10 0x55a686ac1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 4 client.10218 mds_command: new command op to 10053 tid=0[{"prefix": "get_command_descriptions"}] 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.664+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 --> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6869e1d60 con 0x55a686ac1a10 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.665+0000 7f34967fc700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686ac1a10 0x55a686ac1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.665+0000 7f34967fc700 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686ac1a10 0x55a686ac1df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a9f8fe988c445d1f server_cookie=c38740d83b4a9f7d in_seq=0 out_seq=0 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.665+0000 7f3475ffb700 10 client.10218 ms_handle_connect on v2:172.21.15.178:6833/2870485430 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f3475ffb700 1 -- 172.21.15.133:0/11990941 <== mds.0 v2:172.21.15.178:6833/2870485430 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x55a6869e1d60 con 0x55a686ac1a10 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f3475ffb700 10 client.10218 handle_command_reply: tid=0 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 client.10218 shutdown 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 msgr2=0x55a686ac5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f3488007710 tx=0x7f3488017000).stop 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 shutdown_connections 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686ac1a10 0x55a686ac1df0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686ae32c0 0x55a686ac4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f3475ffb700 0 client.10218 ms_handle_reset on v2:172.21.15.178:6833/2870485430 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686ac5740 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 --2- 172.21.15.133:0/11990941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686a9a620 0x55a686ac5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 >> 172.21.15.133:0/11990941 conn(0x55a6869032e0 msgr2=0x55a686a98690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 shutdown_connections 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 1 -- 172.21.15.133:0/11990941 wait complete. 2024-01-21T21:33:29.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.666+0000 7f34af00cb80 20 client.10218 trim_cache size 0 max 16384 2024-01-21T21:33:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.682+0000 7f34af00cb80 1 Processor -- start 2024-01-21T21:33:29.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.682+0000 7f34af00cb80 1 -- start start 2024-01-21T21:33:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686af1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a686a99760 con 0x55a686a9a620 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a686ac7d40 con 0x55a686a95df0 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a686ae4de0 con 0x55a686ae32c0 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34967fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35670/0 (socket says 172.21.15.133:35670) 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34967fc700 1 -- 172.21.15.133:0/653038403 learned_addr learned my addr 172.21.15.133:0/653038403 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34977fe700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f3496ffd700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686af1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34967fc700 1 -- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 msgr2=0x55a686a91510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.683+0000 7f34967fc700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34967fc700 1 -- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 msgr2=0x55a686af1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34967fc700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686af1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34967fc700 1 -- 172.21.15.133:0/653038403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a686a9bd20 con 0x55a686a9a620 2024-01-21T21:33:29.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f3496ffd700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686af1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34967fc700 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f348c052de0 tx=0x7f348c003040).ready entity=mon.0 client_cookie=fe80507dba4b959d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f347d7fa700 1 -- 172.21.15.133:0/653038403 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c05b040 con 0x55a686a9a620 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f347d7fa700 1 -- 172.21.15.133:0/653038403 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c065020 con 0x55a686a9a620 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f347d7fa700 1 -- 172.21.15.133:0/653038403 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c054c80 con 0x55a686a9a620 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 -- 172.21.15.133:0/653038403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 msgr2=0x55a686a91020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 rx=0x7f348c052de0 tx=0x7f348c003040).stop 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 -- 172.21.15.133:0/653038403 shutdown_connections 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a95df0 0x55a686af1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 --2- 172.21.15.133:0/653038403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 -- 172.21.15.133:0/653038403 >> 172.21.15.133:0/653038403 conn(0x55a6869032e0 msgr2=0x55a686ae36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 -- 172.21.15.133:0/653038403 shutdown_connections 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.684+0000 7f34af00cb80 1 -- 172.21.15.133:0/653038403 wait complete. 2024-01-21T21:33:29.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.685+0000 7f34af00cb80 1 -- start start 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.685+0000 7f34af00cb80 1 Processor -- start 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a686a91a00 con 0x55a686a95df0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a686b45530 con 0x55a686a9a620 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a686aabdb0 con 0x55a686ae32c0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 10 client.0 ll_register_callbacks cb 0x55a686a5a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35682/0 (socket says 172.21.15.133:35682) 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 -- 172.21.15.133:0/2944013308 learned_addr learned my addr 172.21.15.133:0/2944013308 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34967fc700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34977fe700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 -- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 msgr2=0x55a686a91510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 -- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 msgr2=0x55a686a91020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 -- 172.21.15.133:0/2944013308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3498151520 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34967fc700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3496ffd700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f3488001540 tx=0x7f3488029000).ready entity=mon.0 client_cookie=cab0232d38ed9267 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3475ffb700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880149c0 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f3488001a50 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3488016480 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3488022420 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 10 client.10224 fetch_fsmap learned FSMap version 74 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.686+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a6869e0270 con 0x55a686a95df0 2024-01-21T21:33:29.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488016480 con 0x55a686a95df0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3488022580 con 0x55a686a95df0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 10 client.10224 fetch_fsmap finished waiting for FSMap version 74 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 10 client.10224 resolve_mds: resolved name 'd' to daemon mds.d 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 20 client.10224 populate_metadata read hostname 'smithi133' 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686b487f0 0x55a686b48bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 4 client.10224 mds_command: new command op to 10053 tid=0[{"prefix": "status"}] 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 --> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a6869d87d0 con 0x55a686b487f0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34967fc700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686b487f0 0x55a686b48bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f3475ffb700 10 client.10224 ms_handle_connect on v2:172.21.15.178:6833/2870485430 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34967fc700 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686b487f0 0x55a686b48bd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4f2a88f82663d77d server_cookie=6ef37b60aa85c572 in_seq=0 out_seq=0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f3475ffb700 1 -- 172.21.15.133:0/2944013308 <== mds.0 v2:172.21.15.178:6833/2870485430 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a6869d87d0 con 0x55a686b487f0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f3475ffb700 10 client.10224 handle_command_reply: tid=0 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.687+0000 7f34af00cb80 1 client.10224 shutdown 2024-01-21T21:33:29.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 msgr2=0x55a686b3ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f3488001540 tx=0x7f3488029000).stop 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 shutdown_connections 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:6833/2870485430,v1:172.21.15.178:6835/2870485430] conn(0x55a686b487f0 0x55a686b48bd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a686ae32c0 0x55a686a91510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55a686a95df0 0x55a686b3ba40 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f3475ffb700 0 client.10224 ms_handle_reset on v2:172.21.15.178:6833/2870485430 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 --2- 172.21.15.133:0/2944013308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a686a9a620 0x55a686a91020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 >> 172.21.15.133:0/2944013308 conn(0x55a6869032e0 msgr2=0x55a686af2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 shutdown_connections 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 1 -- 172.21.15.133:0/2944013308 wait complete. 2024-01-21T21:33:29.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f34af00cb80 20 client.10224 trim_cache size 0 max 16384 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "5608d7ec-e990-4e2d-988c-7c34378633be", 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 10053, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 9.0884821549999995, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 74, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 207, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 207, 2024-01-21T21:33:29.698 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 13.5585536 2024-01-21T21:33:29.699 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:29.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 msgr2=0x7f3484061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 0x7f3484061610 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f34880011e0 tx=0x7f3488007bb0).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 msgr2=0x7f3498151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7f348c00c440 tx=0x7f348c007e00).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 shutdown_connections 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f348405f150 0x7f3484061610 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3498155ca0 0x7f34980c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3498062e00 0x7f34981560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 --2- 172.21.15.133:0/760851490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34981558c0 0x7f3498151030 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 >> 172.21.15.133:0/760851490 conn(0x7f34980c8010 msgr2=0x7f3498152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 shutdown_connections 2024-01-21T21:33:29.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.688+0000 7f349d669700 1 -- 172.21.15.133:0/760851490 wait complete. 2024-01-21T21:33:29.703 DEBUG:teuthology.orchestra.run.smithi133:> ceph fs ls 2024-01-21T21:33:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.804+0000 7f7d79ecb700 1 Processor -- start 2024-01-21T21:33:29.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.804+0000 7f7d79ecb700 1 -- start start 2024-01-21T21:33:29.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 0x7f7d74069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740a6660 0x7f7d740c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d740c4330 0x7f7d74062770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740c2960 con 0x7f7d740c4330 2024-01-21T21:33:29.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740c23e0 con 0x7f7d740a6280 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d79ecb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c2680 con 0x7f7d740a6660 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d740c4330 0x7f7d74062770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7d740c4330 0x7f7d74062770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35690/0 (socket says 172.21.15.133:35690) 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 -- 172.21.15.133:0/530909643 learned_addr learned my addr 172.21.15.133:0/530909643 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d72ffd700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740a6660 0x7f7d740c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d737fe700 1 --2- 172.21.15.133:0/530909643 >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 0x7f7d74069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 -- 172.21.15.133:0/530909643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740a6660 msgr2=0x7f7d740c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740a6660 0x7f7d740c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 -- 172.21.15.133:0/530909643 >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 msgr2=0x7f7d74069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:29.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 --2- 172.21.15.133:0/530909643 >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 0x7f7d74069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 -- 172.21.15.133:0/530909643 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740695e0 con 0x7f7d740c4330 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d737fe700 1 --2- 172.21.15.133:0/530909643 >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 0x7f7d74069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d73fff700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740c4330 0x7f7d74062770 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f7d74156bd0 tx=0x7f7d6c009840).ready entity=mon.0 client_cookie=d6c931eb0ab71bbc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.805+0000 7f7d727fc700 1 -- 172.21.15.133:0/530909643 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00e070 con 0x7f7d740c4330 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d727fc700 1 -- 172.21.15.133:0/530909643 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c00ba50 con 0x7f7d740c4330 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d727fc700 1 -- 172.21.15.133:0/530909643 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00bdd0 con 0x7f7d740c4330 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 -- 172.21.15.133:0/530909643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740c4330 msgr2=0x7f7d74062770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740c4330 0x7f7d74062770 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f7d74156bd0 tx=0x7f7d6c009840).stop 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 -- 172.21.15.133:0/530909643 shutdown_connections 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740c4330 0x7f7d74062770 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/530909643 >> v2:172.21.15.178:3300/0 conn(0x7f7d740a6280 0x7f7d74069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/530909643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740a6660 0x7f7d740c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 -- 172.21.15.133:0/530909643 >> 172.21.15.133:0/530909643 conn(0x7f7d740c7cb0 msgr2=0x7f7d740c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 -- 172.21.15.133:0/530909643 shutdown_connections 2024-01-21T21:33:29.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.806+0000 7f7d79ecb700 1 -- 172.21.15.133:0/530909643 wait complete. 2024-01-21T21:33:29.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.807+0000 7f7d79ecb700 1 Processor -- start 2024-01-21T21:33:29.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.807+0000 7f7d79ecb700 1 -- start start 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 0x7f7d740c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740c4330 0x7f7d740c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740c7470 con 0x7f7d740a6280 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d74142200 con 0x7f7d740a6660 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d79ecb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740a8770 con 0x7f7d740c4330 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35696/0 (socket says 172.21.15.133:35696) 2024-01-21T21:33:29.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d737fe700 1 -- 172.21.15.133:0/118148481 learned_addr learned my addr 172.21.15.133:0/118148481 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d73fff700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740c4330 0x7f7d740c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.808+0000 7f7d72ffd700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 0x7f7d740c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 -- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740c4330 msgr2=0x7f7d740c1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740c4330 0x7f7d740c1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 -- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 msgr2=0x7f7d740c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 0x7f7d740c0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 -- 172.21.15.133:0/118148481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009ae0 con 0x7f7d740a6280 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d72ffd700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 0x7f7d740c0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:29.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d737fe700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f7d6800c880 tx=0x7f7d68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68010580 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680106e0 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d740c7190 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68010a60 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.809+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d740a8400 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.810+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d740475e0 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.810+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7d6801b460 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.811+0000 7f7d5bfff700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 0x7f7d60061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.811+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f7d6807a3d0 con 0x7f7d740a6280 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.811+0000 7f7d72ffd700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 0x7f7d60061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:29.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.811+0000 7f7d72ffd700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 0x7f7d60061640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7d740c0930 tx=0x7f7d64008040).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:29.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:29.815+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7d6804b370 con 0x7f7d740a6280 2024-01-21T21:33:30.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.021+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7d740698c0 con 0x7f7d740a6280 2024-01-21T21:33:30.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.022+0000 7f7d5bfff700 1 -- 172.21.15.133:0/118148481 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7d6804e990 con 0x7f7d740a6280 2024-01-21T21:33:30.025 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 msgr2=0x7f7d60061640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 0x7f7d60061640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7d740c0930 tx=0x7f7d64008040).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 msgr2=0x7f7d74141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f7d6800c880 tx=0x7f7d68008040).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 shutdown_connections 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d740c4330 0x7f7d740c1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d740a6280 0x7f7d74141d10 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7d6005f180 0x7f7d60061640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 --2- 172.21.15.133:0/118148481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d740a6660 0x7f7d740c0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 >> 172.21.15.133:0/118148481 conn(0x7f7d740c7cb0 msgr2=0x7f7d740c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 shutdown_connections 2024-01-21T21:33:30.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.024+0000 7f7d79ecb700 1 -- 172.21.15.133:0/118148481 wait complete. 2024-01-21T21:33:30.037 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-21T21:33:30.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-21T21:33:30.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-21T21:33:30.038 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:33:30.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.038 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2024-01-21T21:33:30.056 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-21T21:33:30.056 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-21T21:33:30.056 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2024-01-21T21:33:30.056 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-21T21:33:30.057 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 36721sec preferred_lft 36721sec 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::6362:b774:98c1:e854/64 scope link noprefixroute 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::47c:fbff:fea3:34bc/64 scope link 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 76:d5:8b:f0:3f:ed brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::74d5:8bff:fef0:3fed/64 scope link 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-21T21:33:30.058 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 06:15:4c:55:c4:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T21:33:30.059 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::415:4cff:fe55:c400/64 scope link 2024-01-21T21:33:30.059 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2024-01-21T21:33:30.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.059 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-21T21:33:30.122 INFO:teuthology.orchestra.run.smithi133.stdout:1 2024-01-21T21:33:30.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.124 DEBUG:teuthology.orchestra.run.smithi133:> route 2024-01-21T21:33:30.182 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2024-01-21T21:33:30.182 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-21T21:33:30.183 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-21T21:33:30.183 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-21T21:33:30.183 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-21T21:33:30.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.183 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2024-01-21T21:33:30.183 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2024-01-21T21:33:30.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-21T21:33:30.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-21T21:33:30.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-21T21:33:30.184 DEBUG:teuthology.orchestra.run.smithi133:> ') 2024-01-21T21:33:30.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.288 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:33:30.304 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T21:33:30.305 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T21:33:30.305 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-21T21:33:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2024-01-21T21:33:30.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.372 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /home/ubuntu/cephtest/mnt.0 2024-01-21T21:33:30.429 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-01-21T21:33:30.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:33:30.511 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:33:30.511 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:33:30.533 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2024-01-21T21:33:30.533 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2024-01-21T21:33:30.535 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-21T21:33:30.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:30.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-21T21:33:30.603 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-01-21T21:33:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.759+0000 7f5576fab700 1 Processor -- start 2024-01-21T21:33:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.759+0000 7f5576fab700 1 -- start start 2024-01-21T21:33:30.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.760+0000 7f5576fab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.760+0000 7f5576fab700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 0x7f55700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.760+0000 7f5576fab700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5570065660 con 0x7f5570069cd0 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.760+0000 7f5576fab700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55700bef10 con 0x7f55700c3fb0 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.760+0000 7f5576fab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5570156070 con 0x7f55700beb30 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f556ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 0x7f55700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:41902/0 (socket says 172.21.15.133:41902) 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f556ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 0x7f55700697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:47856/0 (socket says 172.21.15.133:47856) 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 -- 172.21.15.133:0/1361795701 learned_addr learned my addr 172.21.15.133:0/1361795701 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 -- 172.21.15.133:0/1361795701 >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 msgr2=0x7f55700697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 --2- 172.21.15.133:0/1361795701 >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 0x7f55700697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 -- 172.21.15.133:0/1361795701 >> v1:172.21.15.178:6789/0 conn(0x7f5570069cd0 legacy=0x7f5570151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 -- 172.21.15.133:0/1361795701 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570065f00 con 0x7f55700beb30 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f5574d47700 1 --2- 172.21.15.133:0/1361795701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5564006fd0 tx=0x7f55640090f0).ready entity=mon.2 client_cookie=954db7d5ed8c0a8d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f556f7fe700 1 -- 172.21.15.133:0/1361795701 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400b580 con 0x7f55700beb30 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f556f7fe700 1 -- 172.21.15.133:0/1361795701 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556400b6e0 con 0x7f55700beb30 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.761+0000 7f556f7fe700 1 -- 172.21.15.133:0/1361795701 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400ba80 con 0x7f55700beb30 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 -- 172.21.15.133:0/1361795701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 msgr2=0x7f5570155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 --2- 172.21.15.133:0/1361795701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f5564006fd0 tx=0x7f55640090f0).stop 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 -- 172.21.15.133:0/1361795701 shutdown_connections 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 --2- 172.21.15.133:0/1361795701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f5570155b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 --2- 172.21.15.133:0/1361795701 >> v2:172.21.15.178:3300/0 conn(0x7f55700c3fb0 0x7f55700697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 -- 172.21.15.133:0/1361795701 >> 172.21.15.133:0/1361795701 conn(0x7f55700c8010 msgr2=0x7f55700c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 -- 172.21.15.133:0/1361795701 shutdown_connections 2024-01-21T21:33:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.762+0000 7f5576fab700 1 -- 172.21.15.133:0/1361795701 wait complete. 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.763+0000 7f5576fab700 1 Processor -- start 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.763+0000 7f5576fab700 1 -- start start 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f557013dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55700c3fb0 0x7f5570165f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55700ac9a0 con 0x7f5570069cd0 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5570164000 con 0x7f55700c3fb0 2024-01-21T21:33:30.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5576fab700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55701669b0 con 0x7f55700beb30 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37700/0 (socket says 172.21.15.133:37700) 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 -- 172.21.15.133:0/3998320168 learned_addr learned my addr 172.21.15.133:0/3998320168 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f556ffff700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f557013dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5575548700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55700c3fb0 0x7f5570165f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 -- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 msgr2=0x7f557013dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f557013dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 -- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55700c3fb0 msgr2=0x7f5570165f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55700c3fb0 0x7f5570165f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.764+0000 7f5574d47700 1 -- 172.21.15.133:0/3998320168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564009370 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f5574d47700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f55700600a0 tx=0x7f5564017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564006d90 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5564006970 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5570166c90 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556400be40 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.765+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5570162c00 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.766+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55700acae0 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.766+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f556401c630 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.766+0000 7f556d7fa700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.766+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f556407be30 con 0x7f5570069cd0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.767+0000 7f556ffff700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:30.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.767+0000 7f556ffff700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 0x7f5554061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f55700add10 tx=0x7f555c009060).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.771+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f556404ce30 con 0x7f5570069cd0 2024-01-21T21:33:30.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.958+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f557006ac20 con 0x7f555405f150 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.959+0000 7f556d7fa700 1 -- 172.21.15.133:0/3998320168 <== mgr.9864 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f557006ac20 con 0x7f555405f150 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs" 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-01-21T21:33:30.962 INFO:teuthology.orchestra.run.smithi133.stdout:] 2024-01-21T21:33:30.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 msgr2=0x7f5554061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 0x7f5554061610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f55700add10 tx=0x7f555c009060).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 msgr2=0x7f5570163b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f55700600a0 tx=0x7f5564017000).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 shutdown_connections 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f555405f150 0x7f5554061610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55700c3fb0 0x7f5570165f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5570069cd0 0x7f5570163b10 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.961+0000 7f5576fab700 1 --2- 172.21.15.133:0/3998320168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55700beb30 0x7f557013dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.962+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 >> 172.21.15.133:0/3998320168 conn(0x7f55700c8010 msgr2=0x7f55700c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.962+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 shutdown_connections 2024-01-21T21:33:30.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:30.962+0000 7f5576fab700 1 -- 172.21.15.133:0/3998320168 wait complete. 2024-01-21T21:33:30.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-01-21T21:33:31.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.090+0000 7fbdac956700 1 Processor -- start 2024-01-21T21:33:31.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.091+0000 7fbdac956700 1 -- start start 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.091+0000 7fbdac956700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137030 0x7fbda8067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.091+0000 7fbdac956700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbda8137410 0x7fbda8155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbdac956700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda81557f0 con 0x7fbda80c5930 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbdac956700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda8068370 con 0x7fbda8137410 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbdac956700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8068650 con 0x7fbda8137030 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbda8137410 0x7fbda8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbda80c5930 0x7fbda8157e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41152/0 (socket says 172.21.15.133:41152) 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbda8137410 0x7fbda8155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37710/0 (socket says 172.21.15.133:37710) 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda6d9d700 1 -- 172.21.15.133:0/3963394171 learned_addr learned my addr 172.21.15.133:0/3963394171 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:31.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda659c700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137030 0x7fbda8067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 -- 172.21.15.133:0/3963394171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137030 msgr2=0x7fbda8067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137030 0x7fbda8067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 -- 172.21.15.133:0/3963394171 >> v1:172.21.15.133:6789/0 conn(0x7fbda80c5930 legacy=0x7fbda8157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 -- 172.21.15.133:0/3963394171 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8068930 con 0x7fbda8137410 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda559a700 1 -- 172.21.15.133:0/3963394171 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365286389 0 0) 0x7fbda81557f0 con 0x7fbda80c5930 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda5d9b700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda8137410 0x7fbda8155300 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7fbd98009760 tx=0x7fbd98009060).ready entity=mon.0 client_cookie=5790316918f863c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda559a700 1 -- 172.21.15.133:0/3963394171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980090d0 con 0x7fbda8137410 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda559a700 1 -- 172.21.15.133:0/3963394171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800b580 con 0x7fbda8137410 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.092+0000 7fbda559a700 1 -- 172.21.15.133:0/3963394171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800b900 con 0x7fbda8137410 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 -- 172.21.15.133:0/3963394171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda8137410 msgr2=0x7fbda8155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda8137410 0x7fbda8155300 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 rx=0x7fbd98009760 tx=0x7fbd98009060).stop 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 -- 172.21.15.133:0/3963394171 shutdown_connections 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137030 0x7fbda8067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 --2- 172.21.15.133:0/3963394171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda8137410 0x7fbda8155300 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:31.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 -- 172.21.15.133:0/3963394171 >> 172.21.15.133:0/3963394171 conn(0x7fbda8066a90 msgr2=0x7fbda8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 -- 172.21.15.133:0/3963394171 shutdown_connections 2024-01-21T21:33:31.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.093+0000 7fbdac956700 1 -- 172.21.15.133:0/3963394171 wait complete. 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.094+0000 7fbdac956700 1 Processor -- start 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.094+0000 7fbdac956700 1 -- start start 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda8137030 0x7fbda81675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137410 0x7fbda80c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c0f30 con 0x7fbda80c5930 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c0c30 con 0x7fbda8137030 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbdac956700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8167e10 con 0x7fbda8137410 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37722/0 (socket says 172.21.15.133:37722) 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 -- 172.21.15.133:0/638995897 learned_addr learned my addr 172.21.15.133:0/638995897 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda6d9d700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137410 0x7fbda80c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda5d9b700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda8137030 0x7fbda81675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 -- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137410 msgr2=0x7fbda80c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137410 0x7fbda80c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 -- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda8137030 msgr2=0x7fbda81675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda8137030 0x7fbda81675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 -- 172.21.15.133:0/638995897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd980092a0 con 0x7fbda80c5930 2024-01-21T21:33:31.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.095+0000 7fbda659c700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fbd9000d890 tx=0x7fbd90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.096+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900125f0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.096+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd90012750 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.096+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda81680f0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.096+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90012ad0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.096+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda8167ab0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.097+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda805fdf0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.097+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 101) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbd90013480 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.097+0000 7fbd9effd700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 0x7fbd88061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.097+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7fbd9007a2c0 con 0x7fbda80c5930 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.097+0000 7fbda5d9b700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 0x7fbd88061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:31.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.098+0000 7fbda5d9b700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 0x7fbd88061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbd98009760 tx=0x7fbd98017000).ready entity=mgr.9864 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:31.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.101+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fbd9004b260 con 0x7fbda80c5930 2024-01-21T21:33:31.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:31.307+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbda806bd20 con 0x7fbda80c5930 2024-01-21T21:33:32.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.150+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 102) v1 ==== 75463+0+0 (secure 0 0 0) 0x7fbd90077dc0 con 0x7fbda80c5930 2024-01-21T21:33:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.152+0000 7fbd9effd700 1 -- 172.21.15.133:0/638995897 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v102) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbd90072b20 con 0x7fbda80c5930 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 msgr2=0x7fbd88061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 0x7fbd88061610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fbd98009760 tx=0x7fbd98017000).stop 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 msgr2=0x7fbda813b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7fbd9000d890 tx=0x7fbd90008040).stop 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 shutdown_connections 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda8137410 0x7fbda80c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbda80c5930 0x7fbda813b2b0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbd8805f150 0x7fbd88061610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 --2- 172.21.15.133:0/638995897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda8137030 0x7fbda81675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 >> 172.21.15.133:0/638995897 conn(0x7fbda8066a90 msgr2=0x7fbda8155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 shutdown_connections 2024-01-21T21:33:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.154+0000 7fbdac956700 1 -- 172.21.15.133:0/638995897 wait complete. 2024-01-21T21:33:32.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-01-21T21:33:32.295 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:32.292+0000 7fd19d838680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:32.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.298+0000 7f7bca4aa700 1 Processor -- start 2024-01-21T21:33:32.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.298+0000 7f7bca4aa700 1 -- start start 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bca4aa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bca4aa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bc4154520 0x7f7bc40ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bca4aa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc40ab620 con 0x7f7bc40c6090 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bca4aa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc40c6ae0 con 0x7f7bc4154520 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bca4aa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40c05e0 con 0x7f7bc4154140 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bc4154520 0x7f7bc40ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bc4154520 0x7f7bc40ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:47908/0 (socket says 172.21.15.133:47908) 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:41968/0 (socket says 172.21.15.133:41968) 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 -- 172.21.15.133:0/1244037417 learned_addr learned my addr 172.21.15.133:0/1244037417 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:32.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc8a47700 1 --1- 172.21.15.133:0/1244037417 >> v1:172.21.15.178:6789/0 conn(0x7f7bc40c6090 0x7f7bc40c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:34540/0 (socket says 172.21.15.133:34540) 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 -- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 msgr2=0x7f7bc4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 -- 172.21.15.133:0/1244037417 >> v1:172.21.15.178:6789/0 conn(0x7f7bc40c6090 legacy=0x7f7bc40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 -- 172.21.15.133:0/1244037417 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40c0e40 con 0x7f7bc4154520 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc2ffd700 1 -- 172.21.15.133:0/1244037417 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144101930 0 0) 0x7f7bc40ab620 con 0x7f7bc40c6090 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc3fff700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.299+0000 7f7bc37fe700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ab130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f7bb8006fd0 tx=0x7f7bb80090f0).ready entity=mon.1 client_cookie=c5d0084422608b0d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bc2ffd700 1 -- 172.21.15.133:0/1244037417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800b580 con 0x7f7bc4154520 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bc2ffd700 1 -- 172.21.15.133:0/1244037417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800b6e0 con 0x7f7bc4154520 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bc2ffd700 1 -- 172.21.15.133:0/1244037417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800ba60 con 0x7f7bc4154520 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 msgr2=0x7f7bc40ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ab130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f7bb8006fd0 tx=0x7f7bb80090f0).stop 2024-01-21T21:33:32.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1244037417 shutdown_connections 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc4158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1244037417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ab130 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1244037417 >> 172.21.15.133:0/1244037417 conn(0x7f7bc405e1e0 msgr2=0x7f7bc405e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1244037417 shutdown_connections 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.300+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1244037417 wait complete. 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.301+0000 7f7bca4aa700 1 Processor -- start 2024-01-21T21:33:32.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 -- start start 2024-01-21T21:33:32.307 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f039acaa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc40ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc40cac70 con 0x7f7bc40c6090 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc4156990 con 0x7f7bc4154520 2024-01-21T21:33:32.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.302+0000 7f7bca4aa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc41577b0 con 0x7f7bc4154140 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37764/0 (socket says 172.21.15.133:37764) 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 -- 172.21.15.133:0/1538644975 learned_addr learned my addr 172.21.15.133:0/1538644975 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc37fe700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc40ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc8a47700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 -- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 msgr2=0x7f7bc40ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc40ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 -- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 msgr2=0x7f7bc40ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 -- 172.21.15.133:0/1538644975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb40092a0 con 0x7f7bc40c6090 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc3fff700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f7bb400ea20 tx=0x7f7bb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400ee60 con 0x7f7bc40c6090 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400c850 con 0x7f7bc40c6090 2024-01-21T21:33:32.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8009370 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400cbd0 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.303+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc4157160 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.304+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc4157a90 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.305+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 102) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f7bb401b400 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.305+0000 7f7bc0ff9700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 0x7f7bb0061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.305+0000 7f7bc37fe700 1 -- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 msgr2=0x7f7bb0061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.305+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f7bb407aac0 con 0x7f7bc40c6090 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.305+0000 7f7bc37fe700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 0x7f7bb0061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.310+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7bb404ba50 con 0x7f7bc40c6090 2024-01-21T21:33:32.360 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:32.356+0000 7fd19d838680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:32.371 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:32.368+0000 7f039acaa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.483+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7bc405fdf0 con 0x7f7bc40c6090 2024-01-21T21:33:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.488+0000 7f7bc0ff9700 1 -- 172.21.15.133:0/1538644975 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v43)=0 v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7bb404f070 con 0x7f7bc40c6090 2024-01-21T21:33:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 msgr2=0x7f7bb0061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 0x7f7bb0061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 msgr2=0x7f7bc41564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f7bb400ea20 tx=0x7f7bb4009060).stop 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 shutdown_connections 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7bb005f1a0 0x7f7bb0061660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bc4154520 0x7f7bc40ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bc40c6090 0x7f7bc41564a0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 --2- 172.21.15.133:0/1538644975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bc4154140 0x7f7bc40ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 >> 172.21.15.133:0/1538644975 conn(0x7f7bc405e1e0 msgr2=0x7f7bc40c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 shutdown_connections 2024-01-21T21:33:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.490+0000 7f7bca4aa700 1 -- 172.21.15.133:0/1538644975 wait complete. 2024-01-21T21:33:32.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:32.506 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-01-21T21:33:32.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2024-01-21T21:33:32.634 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:32.631+0000 7fd19d838680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:32.658 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:32.655+0000 7f039acaa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:32.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.687+0000 7f8c1e951700 1 Processor -- start 2024-01-21T21:33:32.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.687+0000 7f8c1e951700 1 -- start start 2024-01-21T21:33:32.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1e951700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1814ecb0 0x7f8c18155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1e951700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1e951700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180c9040 con 0x7f8c1814e8d0 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1e951700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180c9290 con 0x7f8c1814ecb0 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1e951700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180c9570 con 0x7f8c18155a60 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1814ecb0 0x7f8c18155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1ceee700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1814ecb0 0x7f8c18155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:47912/0 (socket says 172.21.15.133:47912) 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 -- 172.21.15.133:0/2989142475 learned_addr learned my addr 172.21.15.133:0/2989142475 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c17fff700 1 --1- 172.21.15.133:0/2989142475 >> v1:172.21.15.178:6789/0 conn(0x7f8c1814e8d0 0x7f8c1805e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:34552/0 (socket says 172.21.15.133:34552) 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1ceee700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.133:41976/0 (socket says 172.21.15.133:41976) 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 -- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 msgr2=0x7f8c180c0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 -- 172.21.15.133:0/2989142475 >> v1:172.21.15.178:6789/0 conn(0x7f8c1814e8d0 legacy=0x7f8c1805e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c177fe700 1 -- 172.21.15.133:0/2989142475 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180c9850 con 0x7f8c1814ecb0 2024-01-21T21:33:32.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.688+0000 7f8c1ceee700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:32.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c177fe700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814ecb0 0x7f8c18155570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8c0c006fd0 tx=0x7f8c0c0090f0).ready entity=mon.1 client_cookie=5f0b278aae76f745 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:32.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c16ffd700 1 -- 172.21.15.133:0/2989142475 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00b580 con 0x7f8c1814ecb0 2024-01-21T21:33:32.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c16ffd700 1 -- 172.21.15.133:0/2989142475 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00b6e0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c16ffd700 1 -- 172.21.15.133:0/2989142475 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c00ba60 con 0x7f8c1814ecb0 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 -- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814ecb0 msgr2=0x7f8c18155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814ecb0 0x7f8c18155570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f8c0c006fd0 tx=0x7f8c0c0090f0).stop 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 -- 172.21.15.133:0/2989142475 shutdown_connections 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c180c0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 --2- 172.21.15.133:0/2989142475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814ecb0 0x7f8c18155570 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 -- 172.21.15.133:0/2989142475 >> 172.21.15.133:0/2989142475 conn(0x7f8c18084eb0 msgr2=0x7f8c180947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 -- 172.21.15.133:0/2989142475 shutdown_connections 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.689+0000 7f8c1e951700 1 -- 172.21.15.133:0/2989142475 wait complete. 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.691+0000 7f8c1e951700 1 Processor -- start 2024-01-21T21:33:32.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.691+0000 7f8c1e951700 1 -- start start 2024-01-21T21:33:32.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 0x7f8c1814ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c1814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1814bf30 con 0x7f8c1814ecb0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18158150 con 0x7f8c1814e8d0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1e951700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18158360 con 0x7f8c18155a60 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37776/0 (socket says 172.21.15.133:37776) 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 -- 172.21.15.133:0/3430767289 learned_addr learned my addr 172.21.15.133:0/3430767289 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 0x7f8c1814ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c1ceee700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c1814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 msgr2=0x7f8c1814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c1814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.692+0000 7f8c177fe700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 msgr2=0x7f8c1814ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c177fe700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 0x7f8c1814ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c177fe700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009a20 con 0x7f8c1814ecb0 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 0x7f8c1814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:32.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c177fe700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f8c0c009fd0 tx=0x7f8c0c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c000bc0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00b850 con 0x7f8c1814ecb0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c009370 con 0x7f8c1814ecb0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c000d20 con 0x7f8c1814ecb0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.693+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c180abc60 con 0x7f8c1814ecb0 2024-01-21T21:33:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.694+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c180ac2b0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.694+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 102) v1 ==== 75463+0+0 (secure 0 0 0) 0x7f8c0c01c8c0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.695+0000 7f8c14ff9700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:32.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.695+0000 7f8c17fff700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:32.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.695+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 6833+0+0 (secure 0 0 0) 0x7f8c0c07c0f0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.695+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:32.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.699+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f8c0c04d0f0 con 0x7f8c1814ecb0 2024-01-21T21:33:32.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.896+0000 7f8c17fff700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:32.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.896+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:32.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:32.897+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c180c9b30 con 0x7f8c0405f1a0 2024-01-21T21:33:33.247 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:33.244+0000 7fd19d838680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:33.284 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:33.282+0000 7f039acaa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:33.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:33.297+0000 7f8c17fff700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:33.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:33.297+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-01-21T21:33:33.319 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:33.316+0000 7fd19d838680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:33.356 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:33.354+0000 7f039acaa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:33.506 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:33.503+0000 7fd19d838680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:33.544 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:33.541+0000 7f039acaa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:33.925 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:33.922+0000 7fd19d838680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:33.964 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:33.962+0000 7f039acaa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:34.029 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.026+0000 7fd19d838680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:34.068 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.066+0000 7f039acaa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:34.098+0000 7f8c17fff700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:34.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:34.098+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-01-21T21:33:34.182 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.179+0000 7fd19d838680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:34.223 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.220+0000 7f039acaa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:34.257 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.254+0000 7fd19d838680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:34.298 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.295+0000 7f039acaa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:34.324 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.321+0000 7fd19d838680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:34.365 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.362+0000 7f039acaa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:34.578 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.575+0000 7fd19d838680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:34.622 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.619+0000 7f039acaa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:34.762 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:34.758+0000 7fd19d838680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:34.806 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:34.803+0000 7f039acaa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:35.411 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.408+0000 7fd19d838680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:35.457 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.455+0000 7f039acaa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:35.479 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.476+0000 7fd19d838680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:35.527 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.524+0000 7f039acaa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:35.554 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.551+0000 7fd19d838680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:35.602 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.599+0000 7f039acaa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:35.701 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.699+0000 7fd19d838680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:35.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:35.699+0000 7f8c17fff700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:35.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:35.699+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-01-21T21:33:35.749 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.747+0000 7f039acaa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:35.771 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.770+0000 7fd19d838680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:35.820 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.817+0000 7f039acaa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:35.887 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.885+0000 7fd19d838680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:35.934 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:35.932+0000 7f039acaa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:35.995 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:35.993+0000 7fd19d838680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:36.042 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.039+0000 7f039acaa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:36.290 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:36.288+0000 7fd19d838680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:36.337 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.335+0000 7f039acaa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:36.362 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:36.360+0000 7fd19d838680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:36.410 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.407+0000 7f039acaa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:36.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:36.426+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 103) v1 ==== 75287+0+0 (secure 0 0 0) 0x7f8c0c079bf0 con 0x7f8c1814ecb0 2024-01-21T21:33:36.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:36.427+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c04061660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:36.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:36.427+0000 7f8c14ff9700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c04061660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f031124f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f031124f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f031124f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f031124f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f031124f700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.484 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f030ea4a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.485 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f030ea4a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.485 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f030ea4a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.485 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f030ea4a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:36.485 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:36.481+0000 7f030ea4a700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:37.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.440+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mgrmap(e 104) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f8c0c079f70 con 0x7f8c1814ecb0 2024-01-21T21:33:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.441+0000 7f8c14ff9700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c040615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.441+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c180c9b30 con 0x7f8c0405f1a0 2024-01-21T21:33:37.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.441+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c040615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.443+0000 7f8c17fff700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c040615e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8c08007fd0 tx=0x7f8c08007d30).ready entity=mgr.10257 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.457+0000 7f8c14ff9700 1 -- 172.21.15.133:0/3430767289 <== mgr.10257 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c180c9b30 con 0x7f8c0405f1a0 2024-01-21T21:33:37.460 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule set for path snap_test_dir1 2024-01-21T21:33:37.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.459+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 msgr2=0x7f8c040615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.459+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c040615e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f8c08007fd0 tx=0x7f8c08007d30).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.459+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 msgr2=0x7f8c18157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.459+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f8c0c009fd0 tx=0x7f8c0c017000).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 shutdown_connections 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c18155a60 0x7f8c1814aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f8c0405f1a0 0x7f8c040615e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1814e8d0 0x7f8c1814ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 --2- 172.21.15.133:0/3430767289 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c1814ecb0 0x7f8c18157c60 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 >> 172.21.15.133:0/3430767289 conn(0x7f8c18084eb0 msgr2=0x7f8c1814cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 shutdown_connections 2024-01-21T21:33:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.460+0000 7f8c1e951700 1 -- 172.21.15.133:0/3430767289 wait complete. 2024-01-21T21:33:37.475 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-01-21T21:33:37.475 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2024-01-21T21:33:37.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.595+0000 7f1deb64a700 1 Processor -- start 2024-01-21T21:33:37.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.595+0000 7f1deb64a700 1 -- start start 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.596+0000 7f1deb64a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1de413a830 0x7f1de40c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.596+0000 7f1deb64a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 0x7f1de4069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.596+0000 7f1deb64a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de4069ef0 con 0x7f1de413ac10 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.596+0000 7f1deb64a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de40c3890 con 0x7f1de413a830 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.596+0000 7f1deb64a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40c3b70 con 0x7f1de40695b0 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1de413a830 0x7f1de40c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de9be7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 0x7f1de4069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1de413a830 0x7f1de40c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:48006/0 (socket says 172.21.15.133:48006) 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de8be5700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1de413ac10 0x7f1de40bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:34566/0 (socket says 172.21.15.133:34566) 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 -- 172.21.15.133:0/4191026716 learned_addr learned my addr 172.21.15.133:0/4191026716 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 -- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 msgr2=0x7f1de4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 0x7f1de4069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 -- 172.21.15.133:0/4191026716 >> v1:172.21.15.178:6789/0 conn(0x7f1de413ac10 legacy=0x7f1de40bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1ddbfff700 1 -- 172.21.15.133:0/4191026716 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685479346 0 0) 0x7f1de4069ef0 con 0x7f1de413ac10 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 -- 172.21.15.133:0/4191026716 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40c3e50 con 0x7f1de413a830 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de9be7700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 0x7f1de4069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1de93e6700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de413a830 0x7f1de40c3220 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f1dd4006fd0 tx=0x7f1dd40090f0).ready entity=mon.1 client_cookie=5d702c5b69210b64 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1ddbfff700 1 -- 172.21.15.133:0/4191026716 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400b580 con 0x7f1de413a830 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1ddbfff700 1 -- 172.21.15.133:0/4191026716 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400b6e0 con 0x7f1de413a830 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.597+0000 7f1ddbfff700 1 -- 172.21.15.133:0/4191026716 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd400ba80 con 0x7f1de413a830 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 -- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de413a830 msgr2=0x7f1de40c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de413a830 0x7f1de40c3220 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f1dd4006fd0 tx=0x7f1dd40090f0).stop 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 -- 172.21.15.133:0/4191026716 shutdown_connections 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de413a830 0x7f1de40c3220 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 --2- 172.21.15.133:0/4191026716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de40695b0 0x7f1de4069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 -- 172.21.15.133:0/4191026716 >> 172.21.15.133:0/4191026716 conn(0x7f1de40c7dc0 msgr2=0x7f1de40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 -- 172.21.15.133:0/4191026716 shutdown_connections 2024-01-21T21:33:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.598+0000 7f1deb64a700 1 -- 172.21.15.133:0/4191026716 wait complete. 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.599+0000 7f1deb64a700 1 Processor -- start 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.599+0000 7f1deb64a700 1 -- start start 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 0x7f1de41539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de413ac10 0x7f1de41624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4153eb0 con 0x7f1de413a830 2024-01-21T21:33:37.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40a7c30 con 0x7f1de40695b0 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1deb64a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40a8a80 con 0x7f1de413ac10 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37904/0 (socket says 172.21.15.133:37904) 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de93e6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 0x7f1de41539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 -- 172.21.15.133:0/2155876349 learned_addr learned my addr 172.21.15.133:0/2155876349 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de9be7700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de413ac10 0x7f1de41624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 -- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de413ac10 msgr2=0x7f1de41624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de413ac10 0x7f1de41624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 -- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 msgr2=0x7f1de41539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 0x7f1de41539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 -- 172.21.15.133:0/2155876349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009a20 con 0x7f1de413a830 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de93e6700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 0x7f1de41539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:37.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.600+0000 7f1de8be5700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f1de000c510 tx=0x7f1de0007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.601+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000ce90 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.601+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de00072e0 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.601+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd4009370 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.601+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de00056e0 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.601+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40a8430 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.602+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de405fdf0 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.602+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 104) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f1de0005ad0 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.602+0000 7f1dd9ffb700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 0x7f1dc8061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.602+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f1de0079b10 con 0x7f1de413a830 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.602+0000 7f1de93e6700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 0x7f1dc8061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.603+0000 7f1de93e6700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 0x7f1dc8061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1dd400b340 tx=0x7f1dd4017000).ready entity=mgr.10257 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.606+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f1de004acc0 con 0x7f1de413a830 2024-01-21T21:33:37.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.795+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1de40671a0 con 0x7f1dc805f080 2024-01-21T21:33:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.799+0000 7f1dd9ffb700 1 -- 172.21.15.133:0/2155876349 <== mgr.10257 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f1de40671a0 con 0x7f1dc805f080 2024-01-21T21:33:37.801 INFO:teuthology.orchestra.run.smithi133.stdout:Retention added to path snap_test_dir1 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 msgr2=0x7f1dc8061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 0x7f1dc8061540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f1dd400b340 tx=0x7f1dd4017000).stop 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 msgr2=0x7f1de40a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f1de000c510 tx=0x7f1de0007c60).stop 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 shutdown_connections 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1de413ac10 0x7f1de41624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f1dc805f080 0x7f1dc8061540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1de40695b0 0x7f1de41539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 --2- 172.21.15.133:0/2155876349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de413a830 0x7f1de40a7740 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 >> 172.21.15.133:0/2155876349 conn(0x7f1de40c7dc0 msgr2=0x7f1de40c7220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:37.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 shutdown_connections 2024-01-21T21:33:37.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.801+0000 7f1deb64a700 1 -- 172.21.15.133:0/2155876349 wait complete. 2024-01-21T21:33:37.815 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2024-01-21T21:33:37.822 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2024-01-21-21_34_00 in ~23s... 2024-01-21T21:33:37.822 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2024-01-21T21:33:37.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2024-01-21T21:33:37.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.938+0000 7fd3cc3fc700 1 Processor -- start 2024-01-21T21:33:37.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.938+0000 7fd3cc3fc700 1 -- start start 2024-01-21T21:33:37.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.939+0000 7fd3cc3fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3c4150de0 0x7fd3c41511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.939+0000 7fd3cc3fc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40be2b0 con 0x7fd3c4069510 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.939+0000 7fd3cc3fc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40be740 con 0x7fd3c40bd130 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.939+0000 7fd3cc3fc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40bd6a0 con 0x7fd3c4150de0 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3c4150de0 0x7fd3c41511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3c4150de0 0x7fd3c41511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37906/0 (socket says 172.21.15.133:37906) 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 -- 172.21.15.133:0/2389651943 learned_addr learned my addr 172.21.15.133:0/2389651943 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca999700 1 --1- 172.21.15.133:0/2389651943 >> v1:172.21.15.133:6789/0 conn(0x7fd3c4069510 0x7fd3c4065680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41160/0 (socket says 172.21.15.133:41160) 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 -- 172.21.15.133:0/2389651943 >> v1:172.21.15.178:6789/0 conn(0x7fd3c40bd130 legacy=0x7fd3c40c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 -- 172.21.15.133:0/2389651943 >> v1:172.21.15.133:6789/0 conn(0x7fd3c4069510 legacy=0x7fd3c4065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 -- 172.21.15.133:0/2389651943 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40bd980 con 0x7fd3c4150de0 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3ca198700 1 --2- 172.21.15.133:0/2389651943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4150de0 0x7fd3c41511c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fd3b4006fd0 tx=0x7fd3b40090f0).ready entity=mon.0 client_cookie=cc67128a544b9db1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3c9196700 1 -- 172.21.15.133:0/2389651943 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400b600 con 0x7fd3c4150de0 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3c9196700 1 -- 172.21.15.133:0/2389651943 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400b760 con 0x7fd3c4150de0 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.940+0000 7fd3c9196700 1 -- 172.21.15.133:0/2389651943 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400bae0 con 0x7fd3c4150de0 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/2389651943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4150de0 msgr2=0x7fd3c41511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/2389651943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4150de0 0x7fd3c41511c0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7fd3b4006fd0 tx=0x7fd3b40090f0).stop 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/2389651943 shutdown_connections 2024-01-21T21:33:37.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/2389651943 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4150de0 0x7fd3c41511c0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/2389651943 >> 172.21.15.133:0/2389651943 conn(0x7fd3c40c7d30 msgr2=0x7fd3c40c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:37.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/2389651943 shutdown_connections 2024-01-21T21:33:37.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.941+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/2389651943 wait complete. 2024-01-21T21:33:37.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.942+0000 7fd3cc3fc700 1 Processor -- start 2024-01-21T21:33:37.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.942+0000 7fd3cc3fc700 1 -- start start 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40bd130 0x7fd3c40a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 0x7fd3c40626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40a5b20 con 0x7fd3c4069510 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40a5e00 con 0x7fd3c4150de0 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3cc3fc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40a60e0 con 0x7fd3c40bd130 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37918/0 (socket says 172.21.15.133:37918) 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 -- 172.21.15.133:0/563431812 learned_addr learned my addr 172.21.15.133:0/563431812 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca999700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 0x7fd3c40626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3c9997700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40bd130 0x7fd3c40a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 -- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40bd130 msgr2=0x7fd3c40a6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40bd130 0x7fd3c40a6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 -- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 msgr2=0x7fd3c40626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 0x7fd3c40626f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 -- 172.21.15.133:0/563431812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4009370 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca999700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 0x7fd3c40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3ca198700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7fd3c4069020 tx=0x7fd3b4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.943+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400bae0 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.944+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4000c90 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.944+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40a63c0 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.944+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b401c670 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.944+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c4165a60 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.945+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c405fdf0 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.945+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 104) v1 ==== 75357+0+0 (secure 0 0 0) 0x7fd3b401ca20 con 0x7fd3c4069510 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.945+0000 7fd3baffd700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 0x7fd3a8061540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:37.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.945+0000 7fd3c9997700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 0x7fd3a8061540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.946+0000 7fd3c9997700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 0x7fd3a8061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd3c000b7f0 tx=0x7fd3c0008040).ready entity=mgr.10257 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:37.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.948+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fd3b4050b30 con 0x7fd3c4069510 2024-01-21T21:33:37.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:37.950+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd3b404ced0 con 0x7fd3c4069510 2024-01-21T21:33:38.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.135+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3c406a350 con 0x7fd3a805f080 2024-01-21T21:33:38.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.137+0000 7fd3baffd700 1 -- 172.21.15.133:0/563431812 <== mgr.10257 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7fd3c406a350 con 0x7fd3a805f080 2024-01-21T21:33:38.140 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:38.140 INFO:teuthology.orchestra.run.smithi133.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2024-01-21T21:33:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 msgr2=0x7fd3a8061540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 0x7fd3a8061540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd3c000b7f0 tx=0x7fd3c0008040).stop 2024-01-21T21:33:38.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 msgr2=0x7fd3c4165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 rx=0x7fd3c4069020 tx=0x7fd3b4017000).stop 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 shutdown_connections 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd3a805f080 0x7fd3a8061540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4150de0 0x7fd3c40626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3c4069510 0x7fd3c4165570 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 --2- 172.21.15.133:0/563431812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40bd130 0x7fd3c40a6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 >> 172.21.15.133:0/563431812 conn(0x7fd3c40c7d30 msgr2=0x7fd3c40c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 shutdown_connections 2024-01-21T21:33:38.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.139+0000 7fd3cc3fc700 1 -- 172.21.15.133:0/563431812 wait complete. 2024-01-21T21:33:38.154 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2024-01-21T21:33:38.154 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2024-01-21T21:33:38.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2024-01-21T21:33:38.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.284+0000 7f9c97074700 1 Processor -- start 2024-01-21T21:33:38.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.284+0000 7f9c97074700 1 -- start start 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c97074700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c900aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c97074700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c900694d0 0x7f9c90066240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c97074700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c90069a40 con 0x7f9c90151bc0 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c97074700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c90069d20 con 0x7f9c900694d0 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c97074700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9006a000 con 0x7f9c900aa0f0 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c95611700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c90151bc0 0x7f9c90152030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41166/0 (socket says 172.21.15.133:41166) 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c95611700 1 -- 172.21.15.133:0/2848213017 learned_addr learned my addr 172.21.15.133:0/2848213017 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351833102 0 0) 0x7f9c90069a40 con 0x7f9c90151bc0 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c94e10700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c900aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/2848213017 >> v2:172.21.15.178:3300/0 conn(0x7f9c900694d0 0x7f9c90066240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.285+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c800033f0 con 0x7f9c90151bc0 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 791246769 0 0) 0x7f9c800033f0 con 0x7f9c90151bc0 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 msgr2=0x7f9c900aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c900aa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 >> v2:172.21.15.178:3300/0 conn(0x7f9c900694d0 msgr2=0x7f9c90066240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 --2- 172.21.15.133:0/2848213017 >> v2:172.21.15.178:3300/0 conn(0x7f9c900694d0 0x7f9c90066240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9006a2e0 con 0x7f9c90151bc0 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f9c880017f0 con 0x7f9c90151bc0 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 >> v1:172.21.15.133:6789/0 conn(0x7f9c90151bc0 legacy=0x7f9c90152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c800038e0 0x7f9c80003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c80004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c80004b80 0x7f9c80005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90069d20 con 0x7f9c80004b80 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9006a000 con 0x7f9c800038e0 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8000b8e0 con 0x7f9c900aa0f0 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c80004b80 0x7f9c80005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c94e10700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c800038e0 0x7f9c80003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c80004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 -- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 msgr2=0x7f9c80004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c80004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 -- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c800038e0 msgr2=0x7f9c80003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c800038e0 0x7f9c80003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 -- 172.21.15.133:0/2848213017 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800033f0 con 0x7f9c80004b80 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c900aa0f0 0x7f9c80004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:38.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c95611700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c80004b80 0x7f9c80005000 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f9c8800c500 tx=0x7f9c88001d90).ready entity=mon.0 client_cookie=8a55c2175f1e7abc server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800ce30 con 0x7f9c80004b80 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c88005b20 con 0x7f9c80004b80 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.286+0000 7f9c8f7fe700 1 -- 172.21.15.133:0/2848213017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880070d0 con 0x7f9c80004b80 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 -- 172.21.15.133:0/2848213017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c80004b80 msgr2=0x7f9c80005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 --2- 172.21.15.133:0/2848213017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c80004b80 0x7f9c80005000 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f9c8800c500 tx=0x7f9c88001d90).stop 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c95611700 1 -- 172.21.15.133:0/2848213017 reap_dead start 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 -- 172.21.15.133:0/2848213017 shutdown_connections 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 -- 172.21.15.133:0/2848213017 >> 172.21.15.133:0/2848213017 conn(0x7f9c900c7d20 msgr2=0x7f9c900c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 -- 172.21.15.133:0/2848213017 shutdown_connections 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.287+0000 7f9c97074700 1 -- 172.21.15.133:0/2848213017 wait complete. 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.288+0000 7f9c97074700 1 Processor -- start 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.288+0000 7f9c97074700 1 -- start start 2024-01-21T21:33:38.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9013e6b0 0x7f9c90153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9013ea90 0x7f9c900a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900a8fd0 con 0x7f9c900c55b0 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c901550c0 con 0x7f9c9013e6b0 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c97074700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90154c30 con 0x7f9c9013ea90 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37926/0 (socket says 172.21.15.133:37926) 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c8ffff700 1 -- 172.21.15.133:0/3987320334 learned_addr learned my addr 172.21.15.133:0/3987320334 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c94e10700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9013e6b0 0x7f9c90153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.289+0000 7f9c95611700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9013ea90 0x7f9c900a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 -- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9013ea90 msgr2=0x7f9c900a8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9013ea90 0x7f9c900a8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 -- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9013e6b0 msgr2=0x7f9c90153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9013e6b0 0x7f9c90153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 -- 172.21.15.133:0/3987320334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90154020 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8ffff700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f9c7c011620 tx=0x7f9c7c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0145f0 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c014750 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c90154300 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c014ad0 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.290+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c901548c0 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.291+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c900c2000 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.291+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 104) v1 ==== 75357+0+0 (secure 0 0 0) 0x7f9c7c015480 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.292+0000 7f9c8d7fa700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 0x7f9c74061570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.292+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f9c7c07a9f0 con 0x7f9c900c55b0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.292+0000 7f9c94e10700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 0x7f9c74061570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.292+0000 7f9c94e10700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 0x7f9c74061570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9c84006d80 tx=0x7f9c84009060).ready entity=mgr.10257 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.296+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9c7c07ce60 con 0x7f9c900c55b0 2024-01-21T21:33:38.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.454+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 105) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f9c7c078620 con 0x7f9c900c55b0 2024-01-21T21:33:38.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.485+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c90154d70 con 0x7f9c7405f0b0 2024-01-21T21:33:38.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.489+0000 7f9c8d7fa700 1 -- 172.21.15.133:0/3987320334 <== mgr.10257 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9c90154d70 con 0x7f9c7405f0b0 2024-01-21T21:33:38.492 INFO:teuthology.orchestra.run.smithi133.stdout:Schedule removed for path snap_test_dir1 2024-01-21T21:33:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.490+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 msgr2=0x7f9c74061570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.490+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 0x7f9c74061570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9c84006d80 tx=0x7f9c84009060).stop 2024-01-21T21:33:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 msgr2=0x7f9c900a85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f9c7c011620 tx=0x7f9c7c008040).stop 2024-01-21T21:33:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 shutdown_connections 2024-01-21T21:33:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9013ea90 0x7f9c900a8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9c7405f0b0 0x7f9c74061570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9013e6b0 0x7f9c90153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 --2- 172.21.15.133:0/3987320334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c900c55b0 0x7f9c900a85f0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 >> 172.21.15.133:0/3987320334 conn(0x7f9c900c7d20 msgr2=0x7f9c9014cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 shutdown_connections 2024-01-21T21:33:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.491+0000 7f9c97074700 1 -- 172.21.15.133:0/3987320334 wait complete. 2024-01-21T21:33:38.506 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-01-21T21:33:38.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:38.506 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2024-01-21T21:33:38.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:38.525 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-01-21T21:33:38.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-01-21T21:33:38.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.739+0000 7f8519421700 1 Processor -- start 2024-01-21T21:33:38.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 -- start start 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f8514154530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 0x7f85140c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140c04d0 con 0x7f85140aafe0 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85140c0790 con 0x7f85140c6060 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.740+0000 7f8519421700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c0a70 con 0x7f8514154150 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f8514154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f85127fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 0x7f85140c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f85137fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f85140aafe0 0x7f85140c1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:34588/0 (socket says 172.21.15.133:34588) 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f85137fe700 1 -- 172.21.15.133:0/1594953910 learned_addr learned my addr 172.21.15.133:0/1594953910 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8511ffb700 1 -- 172.21.15.133:0/1594953910 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985589855 0 0) 0x7f85140c04d0 con 0x7f85140aafe0 2024-01-21T21:33:38.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8511ffb700 1 -- 172.21.15.133:0/1594953910 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85000033f0 con 0x7f85140aafe0 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 -- 172.21.15.133:0/1594953910 >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 msgr2=0x7f85140c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 --2- 172.21.15.133:0/1594953910 >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 0x7f85140c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 -- 172.21.15.133:0/1594953910 >> v1:172.21.15.178:6789/0 conn(0x7f85140aafe0 legacy=0x7f85140c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 -- 172.21.15.133:0/1594953910 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140c0d50 con 0x7f8514154150 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f85127fc700 1 --2- 172.21.15.133:0/1594953910 >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 0x7f85140c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.741+0000 7f8512ffd700 1 --2- 172.21.15.133:0/1594953910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f8514154530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f850c009e60 tx=0x7f850c009780).ready entity=mon.2 client_cookie=e008b97a3972c334 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8511ffb700 1 -- 172.21.15.133:0/1594953910 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e070 con 0x7f8514154150 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8511ffb700 1 -- 172.21.15.133:0/1594953910 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00bab0 con 0x7f8514154150 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8511ffb700 1 -- 172.21.15.133:0/1594953910 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00be30 con 0x7f8514154150 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 -- 172.21.15.133:0/1594953910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 msgr2=0x7f8514154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 --2- 172.21.15.133:0/1594953910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f8514154530 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f850c009e60 tx=0x7f850c009780).stop 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 -- 172.21.15.133:0/1594953910 shutdown_connections 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 --2- 172.21.15.133:0/1594953910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f8514154530 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 --2- 172.21.15.133:0/1594953910 >> v2:172.21.15.178:3300/0 conn(0x7f85140c6060 0x7f85140c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 -- 172.21.15.133:0/1594953910 >> 172.21.15.133:0/1594953910 conn(0x7f8514064990 msgr2=0x7f8514064da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:38.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 -- 172.21.15.133:0/1594953910 shutdown_connections 2024-01-21T21:33:38.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.742+0000 7f8519421700 1 -- 172.21.15.133:0/1594953910 wait complete. 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.744+0000 7f8519421700 1 Processor -- start 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.744+0000 7f8519421700 1 -- start start 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c6060 0x7f85140c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f851414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141642c0 con 0x7f85140aafe0 2024-01-21T21:33:38.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141655c0 con 0x7f85140c6060 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8519421700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514166420 con 0x7f8514154150 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37928/0 (socket says 172.21.15.133:37928) 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 -- 172.21.15.133:0/3308343280 learned_addr learned my addr 172.21.15.133:0/3308343280 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f85127fc700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c6060 0x7f85140c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f85137fe700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f851414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 -- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 msgr2=0x7f851414d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f851414d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 -- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c6060 msgr2=0x7f85140c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:38.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c6060 0x7f85140c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 -- 172.21.15.133:0/3308343280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc0092a0 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.745+0000 7f8512ffd700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f850c0097c0 tx=0x7f85140c0680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.746+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c013e60 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.746+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c01d630 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.746+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c009a20 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.746+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c01d9d0 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.746+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514165af0 con 0x7f85140aafe0 2024-01-21T21:33:38.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.747+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851405fdf0 con 0x7f85140aafe0 2024-01-21T21:33:38.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.747+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 105) v1 ==== 75622+0+0 (secure 0 0 0) 0x7f850c003040 con 0x7f85140aafe0 2024-01-21T21:33:38.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.747+0000 7f850b7fe700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 0x7f84f4061810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:38.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.747+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f850c07c680 con 0x7f85140aafe0 2024-01-21T21:33:38.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.747+0000 7f85127fc700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 0x7f84f4061810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:38.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.748+0000 7f85127fc700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 0x7f84f4061810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f84fc009270 tx=0x7f84fc008040).ready entity=mgr.10257 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:38.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.751+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f850c04d2d0 con 0x7f85140aafe0 2024-01-21T21:33:38.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:38.955+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f85140c1030 con 0x7f85140aafe0 2024-01-21T21:33:39.117 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:33:39.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:33:39.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.459+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f850c079dd0 con 0x7f85140aafe0 2024-01-21T21:33:39.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.460+0000 7f850b7fe700 1 -- 172.21.15.133:0/3308343280 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v106) v1 ==== 93+0+0 (secure 0 0 0) 0x7f850c042a80 con 0x7f85140aafe0 2024-01-21T21:33:39.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 msgr2=0x7f84f4061810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 0x7f84f4061810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f84fc009270 tx=0x7f84fc008040).stop 2024-01-21T21:33:39.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 msgr2=0x7f8514163dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f850c0097c0 tx=0x7f85140c0680).stop 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 shutdown_connections 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8514154150 0x7f851414d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85140aafe0 0x7f8514163dd0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f84f405f350 0x7f84f4061810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 --2- 172.21.15.133:0/3308343280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c6060 0x7f85140c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 >> 172.21.15.133:0/3308343280 conn(0x7f8514064990 msgr2=0x7f851414f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.463+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 shutdown_connections 2024-01-21T21:33:39.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.464+0000 7f8519421700 1 -- 172.21.15.133:0/3308343280 wait complete. 2024-01-21T21:33:39.482 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-21T21:33:39.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:39.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-21T21:33:39.567 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-21T21:33:39.568 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-21T21:33:39.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-01-21T21:33:39.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-21T21:33:39.611 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:39.609+0000 7f1c0f95e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:39.611 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:39.609+0000 7f5e525f1680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-21T21:33:39.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:33:39.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:39.618 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-21T21:33:39.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:39.676 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:39.673+0000 7f1c0f95e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:39.677 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:39.674+0000 7f5e525f1680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-21T21:33:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.791+0000 7f2bdc3bc700 1 Processor -- start 2024-01-21T21:33:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.791+0000 7f2bdc3bc700 1 -- start start 2024-01-21T21:33:39.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bdc3bc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bd4137030 0x7f2bd4067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bdc3bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bdc3bc700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd41557f0 con 0x7f2bd40c5930 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bdc3bc700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd4068370 con 0x7f2bd4137030 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bdc3bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4068650 con 0x7f2bd4137410 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bd9957700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bda158700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bd4137030 0x7f2bd4067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bda959700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2bd40c5930 0x7f2bd4157e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:34612/0 (socket says 172.21.15.133:34612) 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.792+0000 7f2bda959700 1 -- 172.21.15.133:0/3282520076 learned_addr learned my addr 172.21.15.133:0/3282520076 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bda158700 1 -- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 msgr2=0x7f2bd4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bda158700 1 --2- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bda158700 1 -- 172.21.15.133:0/3282520076 >> v1:172.21.15.178:6789/0 conn(0x7f2bd40c5930 legacy=0x7f2bd4157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bda158700 1 -- 172.21.15.133:0/3282520076 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4068930 con 0x7f2bd4137030 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bd9156700 1 -- 172.21.15.133:0/3282520076 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989607250 0 0) 0x7f2bd41557f0 con 0x7f2bd40c5930 2024-01-21T21:33:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bda158700 1 --2- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd4137030 0x7f2bd4067d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2bd0009760 tx=0x7f2bd0009060).ready entity=mon.1 client_cookie=65578fd719ec4958 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bd9156700 1 -- 172.21.15.133:0/3282520076 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00090d0 con 0x7f2bd4137030 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bd9156700 1 -- 172.21.15.133:0/3282520076 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd000f510 con 0x7f2bd4137030 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.793+0000 7f2bd9156700 1 -- 172.21.15.133:0/3282520076 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000f890 con 0x7f2bd4137030 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd4137030 msgr2=0x7f2bd4067d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd4137030 0x7f2bd4067d90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f2bd0009760 tx=0x7f2bd0009060).stop 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/3282520076 shutdown_connections 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd4137030 0x7f2bd4067d90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/3282520076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/3282520076 >> 172.21.15.133:0/3282520076 conn(0x7f2bd4066a90 msgr2=0x7f2bd4066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/3282520076 shutdown_connections 2024-01-21T21:33:39.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.794+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/3282520076 wait complete. 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.795+0000 7f2bdc3bc700 1 Processor -- start 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.795+0000 7f2bdc3bc700 1 -- start start 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 0x7f2bd4135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4135bf0 con 0x7f2bd4137030 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c1970 con 0x7f2bd40c5930 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c1c50 con 0x7f2bd4137410 2024-01-21T21:33:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37958/0 (socket says 172.21.15.133:37958) 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 -- 172.21.15.133:0/390331855 learned_addr learned my addr 172.21.15.133:0/390331855 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bda158700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 0x7f2bd4135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bda959700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 msgr2=0x7f2bd4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 msgr2=0x7f2bd4135700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 0x7f2bd4135700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 -- 172.21.15.133:0/390331855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00092a0 con 0x7f2bd4137030 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bda158700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 0x7f2bd4135700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bd9957700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f2bc400e930 tx=0x7f2bc4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4012600 con 0x7f2bd4137030 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd40c1f30 con 0x7f2bd4137030 2024-01-21T21:33:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc4012760 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4012ae0 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.796+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd40c2580 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.797+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd4063950 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.798+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f2bc401b400 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.798+0000 7f2bcaffd700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 0x7f2bb80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.798+0000 7f2bda158700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 msgr2=0x7f2bb80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.798+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f2bc407aca0 con 0x7f2bd4137030 2024-01-21T21:33:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.798+0000 7f2bda158700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 0x7f2bb80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:39.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.806+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f2bc407f070 con 0x7f2bd4137030 2024-01-21T21:33:39.950 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:39.948+0000 7f1c0f95e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:39.966 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:39.964+0000 7f5e525f1680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-21T21:33:40.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.999+0000 7f2bda158700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 msgr2=0x7f2bb80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:40.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:39.999+0000 7f2bda158700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 0x7f2bb80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:40.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.016+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bd405fdf0 con 0x7f2bd4137030 2024-01-21T21:33:40.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.016+0000 7f2bcaffd700 1 -- 172.21.15.133:0/390331855 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7f2bc404b9a0 con 0x7f2bd4137030 2024-01-21T21:33:40.019 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:40.019 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:40.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 msgr2=0x7f2bb80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:40.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 0x7f2bb80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 msgr2=0x7f2bd40c0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f2bc400e930 tx=0x7f2bc4009060).stop 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 shutdown_connections 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd4137410 0x7f2bd4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f2bb805f300 0x7f2bb80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd40c5930 0x7f2bd4135700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 --2- 172.21.15.133:0/390331855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bd4137030 0x7f2bd40c0960 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.018+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 >> 172.21.15.133:0/390331855 conn(0x7f2bd4066a90 msgr2=0x7f2bd40c5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.019+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 shutdown_connections 2024-01-21T21:33:40.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.019+0000 7f2bdc3bc700 1 -- 172.21.15.133:0/390331855 wait complete. 2024-01-21T21:33:40.023 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:40.034 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:40.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.151+0000 7f821b952700 1 Processor -- start 2024-01-21T21:33:40.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 -- start start 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82140c3840 0x7f82140c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f82140c5dc0 0x7f821413a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8214067f10 con 0x7f82140c6250 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140681f0 con 0x7f82140c3840 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.152+0000 7f821b952700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82140684d0 con 0x7f82140c5dc0 2024-01-21T21:33:40.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82140c3840 0x7f82140c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82140c3840 0x7f82140c3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37974/0 (socket says 172.21.15.133:37974) 2024-01-21T21:33:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 -- 172.21.15.133:0/132892707 learned_addr learned my addr 172.21.15.133:0/132892707 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f8218eed700 1 --2- 172.21.15.133:0/132892707 >> v2:172.21.15.178:3300/0 conn(0x7f82140c5dc0 0x7f821413a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 -- 172.21.15.133:0/132892707 >> v2:172.21.15.178:3300/0 conn(0x7f82140c5dc0 msgr2=0x7f821413a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:40.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 --2- 172.21.15.133:0/132892707 >> v2:172.21.15.178:3300/0 conn(0x7f82140c5dc0 0x7f821413a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 -- 172.21.15.133:0/132892707 >> v1:172.21.15.178:6789/0 conn(0x7f82140c6250 legacy=0x7f8214157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 -- 172.21.15.133:0/132892707 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82140687b0 con 0x7f82140c3840 2024-01-21T21:33:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f82196ee700 1 --2- 172.21.15.133:0/132892707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f82140c3c20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f8214066310 tx=0x7f82080090f0).ready entity=mon.0 client_cookie=c6325a590ecd0484 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f8207fff700 1 -- 172.21.15.133:0/132892707 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800b520 con 0x7f82140c3840 2024-01-21T21:33:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f8207fff700 1 -- 172.21.15.133:0/132892707 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820800b680 con 0x7f82140c3840 2024-01-21T21:33:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.153+0000 7f8207fff700 1 -- 172.21.15.133:0/132892707 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820800ba20 con 0x7f82140c3840 2024-01-21T21:33:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 -- 172.21.15.133:0/132892707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 msgr2=0x7f82140c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 --2- 172.21.15.133:0/132892707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f82140c3c20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f8214066310 tx=0x7f82080090f0).stop 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 -- 172.21.15.133:0/132892707 shutdown_connections 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 --2- 172.21.15.133:0/132892707 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f82140c3c20 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 --2- 172.21.15.133:0/132892707 >> v2:172.21.15.178:3300/0 conn(0x7f82140c5dc0 0x7f821413a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 -- 172.21.15.133:0/132892707 >> 172.21.15.133:0/132892707 conn(0x7f8214066a70 msgr2=0x7f8214066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 -- 172.21.15.133:0/132892707 shutdown_connections 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.154+0000 7f821b952700 1 -- 172.21.15.133:0/132892707 wait complete. 2024-01-21T21:33:40.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.156+0000 7f821b952700 1 Processor -- start 2024-01-21T21:33:40.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.156+0000 7f821b952700 1 -- start start 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82140c5dc0 0x7f82140ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82140c6250 0x7f82140ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82140bffa0 con 0x7f82140c3840 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8214157380 con 0x7f82140c6250 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f821b952700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8214064460 con 0x7f82140c5dc0 2024-01-21T21:33:40.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f82196ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f82196ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37978/0 (socket says 172.21.15.133:37978) 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f82196ee700 1 -- 172.21.15.133:0/287874320 learned_addr learned my addr 172.21.15.133:0/287874320 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f8218eed700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82140c5dc0 0x7f82140ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.157+0000 7f8219eef700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82140c6250 0x7f82140ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 -- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82140c5dc0 msgr2=0x7f82140ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82140c5dc0 0x7f82140ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 -- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82140c6250 msgr2=0x7f82140ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82140c6250 0x7f82140ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 -- 172.21.15.133:0/287874320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8208009370 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f82196ee700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f8208006fd0 tx=0x7f8208017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208006990 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208000bc0 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820801c420 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8214064740 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.158+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8214064130 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.159+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f820801c850 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.160+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8214157150 con 0x7f82140c3840 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.160+0000 7f8205ffb700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 0x7f81f80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.160+0000 7f8218eed700 1 -- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 msgr2=0x7f81f80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:40.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.160+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f820807c4f0 con 0x7f82140c3840 2024-01-21T21:33:40.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.160+0000 7f8218eed700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 0x7f81f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:40.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.164+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f820804d250 con 0x7f82140c3840 2024-01-21T21:33:40.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.352+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f821405fdf0 con 0x7f82140c3840 2024-01-21T21:33:40.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.353+0000 7f8205ffb700 1 -- 172.21.15.133:0/287874320 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f8208020070 con 0x7f82140c3840 2024-01-21T21:33:40.356 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:40.357 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":208,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:36.420693+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/1079767282":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6833/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6832/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:0/912648497":"2024-01-22T21:33:36.420664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:40.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 msgr2=0x7f81f80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:40.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 0x7f81f80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 msgr2=0x7f8214151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f8208006fd0 tx=0x7f8208017000).stop 2024-01-21T21:33:40.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 shutdown_connections 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f81f805f300 0x7f81f80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82140c6250 0x7f82140ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82140c3840 0x7f8214151bd0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 --2- 172.21.15.133:0/287874320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82140c5dc0 0x7f82140ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 >> 172.21.15.133:0/287874320 conn(0x7f8214066a70 msgr2=0x7f8214139860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 shutdown_connections 2024-01-21T21:33:40.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.355+0000 7f821b952700 1 -- 172.21.15.133:0/287874320 wait complete. 2024-01-21T21:33:40.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-01-21T19:58:57.899927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '198', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-01-21T19:59:00.238523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-21T21:33:19.165061+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '206', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2024-01-21T21:33:19.568969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '207', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-01-21T21:33:40.374 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-01-21T21:33:40.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.498+0000 7fae9b353700 1 Processor -- start 2024-01-21T21:33:40.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.498+0000 7fae9b353700 1 -- start start 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae9b353700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae94067d90 0x7fae94137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae9b353700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae94068370 con 0x7fae94137030 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae9b353700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae94068650 con 0x7fae940c5930 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae9b353700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae94068930 con 0x7fae94067d90 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae990ef700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae94137030 0x7fae94155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37194/0 (socket says 172.21.15.133:37194) 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae990ef700 1 -- 172.21.15.133:0/1269697405 learned_addr learned my addr 172.21.15.133:0/1269697405 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae988ee700 1 --2- 172.21.15.133:0/1269697405 >> v2:172.21.15.178:3300/0 conn(0x7fae94067d90 0x7fae94137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905176987 0 0) 0x7fae94068370 con 0x7fae94137030 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae800033f0 con 0x7fae94137030 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae988ee700 1 -- 172.21.15.133:0/1269697405 >> v1:172.21.15.178:6789/0 conn(0x7fae940c5930 legacy=0x7fae940c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700662033 0 0) 0x7fae94068650 con 0x7fae940c5930 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae988ee700 1 -- 172.21.15.133:0/1269697405 >> v1:172.21.15.133:6789/0 conn(0x7fae94137030 legacy=0x7fae94155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.499+0000 7fae988ee700 1 -- 172.21.15.133:0/1269697405 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94068c10 con 0x7fae94067d90 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae988ee700 1 --2- 172.21.15.133:0/1269697405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94067d90 0x7fae94137410 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fae84009760 tx=0x7fae84009060).ready entity=mon.1 client_cookie=b40099e156eda583 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90001470 con 0x7fae94067d90 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84009130 con 0x7fae94067d90 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae8bfff700 1 -- 172.21.15.133:0/1269697405 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84012620 con 0x7fae94067d90 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 -- 172.21.15.133:0/1269697405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94067d90 msgr2=0x7fae94137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 --2- 172.21.15.133:0/1269697405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94067d90 0x7fae94137410 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fae84009760 tx=0x7fae84009060).stop 2024-01-21T21:33:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 -- 172.21.15.133:0/1269697405 shutdown_connections 2024-01-21T21:33:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 --2- 172.21.15.133:0/1269697405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94067d90 0x7fae94137410 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 -- 172.21.15.133:0/1269697405 >> 172.21.15.133:0/1269697405 conn(0x7fae94066a90 msgr2=0x7fae94066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.500+0000 7fae9b353700 1 -- 172.21.15.133:0/1269697405 shutdown_connections 2024-01-21T21:33:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.501+0000 7fae9b353700 1 -- 172.21.15.133:0/1269697405 wait complete. 2024-01-21T21:33:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 Processor -- start 2024-01-21T21:33:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 -- start start 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94067d90 0x7fae940abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae940c5930 0x7fae940ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940ac890 con 0x7fae94137030 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9414e3f0 con 0x7fae940c5930 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.502+0000 7fae9b353700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940c54f0 con 0x7fae94067d90 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae988ee700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae940c5930 0x7fae940ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53610/0 (socket says 172.21.15.133:53610) 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 -- 172.21.15.133:0/1457463049 learned_addr learned my addr 172.21.15.133:0/1457463049 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae990ef700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94067d90 0x7fae940abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94067d90 msgr2=0x7fae940abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94067d90 0x7fae940abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae940c5930 msgr2=0x7fae940ac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae940c5930 0x7fae940ac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 -- 172.21.15.133:0/1457463049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840092a0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae998f0700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7fae8c00c760 tx=0x7fae8c007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00e4a0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00e620 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c00e9e0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.503+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae94164140 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.504+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940acdf0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fae8c00ed50 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9405fdf0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae89ffb700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 0x7fae780617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae990ef700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 msgr2=0x7fae780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fae8c07a1f0 con 0x7fae94137030 2024-01-21T21:33:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.505+0000 7fae990ef700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 0x7fae780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:40.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.509+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fae8c04af50 con 0x7fae94137030 2024-01-21T21:33:40.566 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:40.564+0000 7f1c0f95e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:40.637 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:40.634+0000 7f5e525f1680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-21T21:33:40.639 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:40.638+0000 7f1c0f95e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.706+0000 7fae990ef700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 msgr2=0x7fae780617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.706+0000 7fae990ef700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 0x7fae780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:40.711 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:40.709+0000 7f5e525f1680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-21T21:33:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.714+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fae9406bd20 con 0x7fae94137030 2024-01-21T21:33:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.714+0000 7fae89ffb700 1 -- 172.21.15.133:0/1457463049 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v208) v1 ==== 110+0+10 (secure 0 0 0) 0x7fae8c04e570 con 0x7fae94137030 2024-01-21T21:33:40.717 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2024-01-21T21:33:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 msgr2=0x7fae780617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 0x7fae780617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 msgr2=0x7fae940c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7fae8c00c760 tx=0x7fae8c007f10).stop 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 shutdown_connections 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae94137030 0x7fae940c3ca0 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94067d90 0x7fae940abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fae7805f300 0x7fae780617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 --2- 172.21.15.133:0/1457463049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae940c5930 0x7fae940ac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.716+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 >> 172.21.15.133:0/1457463049 conn(0x7fae94066a90 msgr2=0x7fae940c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.717+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 shutdown_connections 2024-01-21T21:33:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.717+0000 7fae9b353700 1 -- 172.21.15.133:0/1457463049 wait complete. 2024-01-21T21:33:40.732 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-01-21T21:33:40.827 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:40.825+0000 7f1c0f95e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:40.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.853+0000 7fdd6fafd700 1 Processor -- start 2024-01-21T21:33:40.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.853+0000 7fdd6fafd700 1 -- start start 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.854+0000 7fdd6fafd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813ac10 0x7fdd680c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.854+0000 7fdd6fafd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd680695b0 0x7fdd68069a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6fafd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd68069f10 con 0x7fdd6813a830 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6fafd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd680c3890 con 0x7fdd680695b0 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6fafd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680c3b70 con 0x7fdd6813ac10 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd680695b0 0x7fdd68069a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6d899700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd6813a830 0x7fdd680bce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37206/0 (socket says 172.21.15.133:37206) 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6d899700 1 -- 172.21.15.133:0/3134490625 learned_addr learned my addr 172.21.15.133:0/3134490625 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6d098700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813ac10 0x7fdd680c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 -- 172.21.15.133:0/3134490625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813ac10 msgr2=0x7fdd680c3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813ac10 0x7fdd680c3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 -- 172.21.15.133:0/3134490625 >> v1:172.21.15.133:6789/0 conn(0x7fdd6813a830 legacy=0x7fdd680bce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 -- 172.21.15.133:0/3134490625 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd680c3e50 con 0x7fdd680695b0 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6c897700 1 -- 172.21.15.133:0/3134490625 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627517221 0 0) 0x7fdd68069f10 con 0x7fdd6813a830 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6e09a700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd68069a20 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7fdd60009e60 tx=0x7fdd60009780).ready entity=mon.0 client_cookie=d93d8794482d9dc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6c897700 1 -- 172.21.15.133:0/3134490625 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6000e070 con 0x7fdd680695b0 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6c897700 1 -- 172.21.15.133:0/3134490625 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000bb60 con 0x7fdd680695b0 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.855+0000 7fdd6c897700 1 -- 172.21.15.133:0/3134490625 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60012410 con 0x7fdd680695b0 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 -- 172.21.15.133:0/3134490625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 msgr2=0x7fdd68069a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd68069a20 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7fdd60009e60 tx=0x7fdd60009780).stop 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 -- 172.21.15.133:0/3134490625 shutdown_connections 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd68069a20 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/3134490625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813ac10 0x7fdd680c3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 -- 172.21.15.133:0/3134490625 >> 172.21.15.133:0/3134490625 conn(0x7fdd680c7dc0 msgr2=0x7fdd680c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:40.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 -- 172.21.15.133:0/3134490625 shutdown_connections 2024-01-21T21:33:40.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.856+0000 7fdd6fafd700 1 -- 172.21.15.133:0/3134490625 wait complete. 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.857+0000 7fdd6fafd700 1 Processor -- start 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.857+0000 7fdd6fafd700 1 -- start start 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813a830 0x7fdd681383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6813ac10 0x7fdd680a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680a8d20 con 0x7fdd680695b0 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680a5190 con 0x7fdd6813ac10 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6fafd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd680a5470 con 0x7fdd6813a830 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6d899700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6d899700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53628/0 (socket says 172.21.15.133:53628) 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6d899700 1 -- 172.21.15.133:0/2676243564 learned_addr learned my addr 172.21.15.133:0/2676243564 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6d098700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813a830 0x7fdd681383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.858+0000 7fdd6e09a700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6813ac10 0x7fdd680a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 -- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813a830 msgr2=0x7fdd681383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813a830 0x7fdd681383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 -- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6813ac10 msgr2=0x7fdd680a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6813ac10 0x7fdd680a48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 -- 172.21.15.133:0/2676243564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd60009a20 con 0x7fdd680695b0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6d899700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7fdd64001eb0 tx=0x7fdd64007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640070d0 con 0x7fdd680695b0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd64007230 con 0x7fdd680695b0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd680a5750 con 0x7fdd680695b0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd640075d0 con 0x7fdd680695b0 2024-01-21T21:33:40.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.859+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd68138890 con 0x7fdd680695b0 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.860+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd680a8810 con 0x7fdd680695b0 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.861+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fdd640059b0 con 0x7fdd680695b0 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.861+0000 7fdd5e7fc700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 0x7fdd4c0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.861+0000 7fdd6d098700 1 -- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 msgr2=0x7fdd4c0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.861+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fdd64079ec0 con 0x7fdd680695b0 2024-01-21T21:33:40.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.861+0000 7fdd6d098700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 0x7fdd4c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:40.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:40.865+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdd680a8810 con 0x7fdd680695b0 2024-01-21T21:33:40.912 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:40.909+0000 7f5e525f1680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-21T21:33:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.035+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd680a8810 con 0x7fdd680695b0 2024-01-21T21:33:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.035+0000 7fdd5e7fc700 1 -- 172.21.15.133:0/2676243564 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v208) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd680a8810 con 0x7fdd680695b0 2024-01-21T21:33:41.038 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2024-01-21T21:33:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 msgr2=0x7fdd4c0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 0x7fdd4c0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 msgr2=0x7fdd680a6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7fdd64001eb0 tx=0x7fdd64007e90).stop 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 shutdown_connections 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdd4c05f300 0x7fdd4c0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd6813ac10 0x7fdd680a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd680695b0 0x7fdd680a6e00 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 --2- 172.21.15.133:0/2676243564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd6813a830 0x7fdd681383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 >> 172.21.15.133:0/2676243564 conn(0x7fdd680c7dc0 msgr2=0x7fdd680c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 shutdown_connections 2024-01-21T21:33:41.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.037+0000 7fdd6fafd700 1 -- 172.21.15.133:0/2676243564 wait complete. 2024-01-21T21:33:41.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-21T21:33:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.175+0000 7f96f2a55700 1 Processor -- start 2024-01-21T21:33:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.175+0000 7f96f2a55700 1 -- start start 2024-01-21T21:33:41.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f2a55700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 0x7f96ec158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f2a55700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 0x7f96ec0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f2a55700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0ab620 con 0x7f96ec154520 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f2a55700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6ae0 con 0x7f96ec154140 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f2a55700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c05e0 con 0x7f96ec0c8120 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96eb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f96ec154520 0x7f96ec0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37208/0 (socket says 172.21.15.133:37208) 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96eb7fe700 1 -- 172.21.15.133:0/4172677648 learned_addr learned my addr 172.21.15.133:0/4172677648 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96ebfff700 1 --2- 172.21.15.133:0/4172677648 >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 0x7f96ec158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/4172677648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 0x7f96ec0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96eaffd700 1 -- 172.21.15.133:0/4172677648 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867467180 0 0) 0x7f96ec0ab620 con 0x7f96ec154520 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.176+0000 7f96eaffd700 1 -- 172.21.15.133:0/4172677648 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d40033f0 con 0x7f96ec154520 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f0ff2700 1 -- 172.21.15.133:0/4172677648 >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 msgr2=0x7f96ec158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/4172677648 >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 0x7f96ec158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f0ff2700 1 -- 172.21.15.133:0/4172677648 >> v1:172.21.15.133:6789/0 conn(0x7f96ec154520 legacy=0x7f96ec0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f0ff2700 1 -- 172.21.15.133:0/4172677648 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0c0e40 con 0x7f96ec0c8120 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96ebfff700 1 --2- 172.21.15.133:0/4172677648 >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 0x7f96ec158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/4172677648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 0x7f96ec0ab130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f96e4009e60 tx=0x7f96e4009780).ready entity=mon.2 client_cookie=78023f71d71f704c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96eaffd700 1 -- 172.21.15.133:0/4172677648 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e070 con 0x7f96ec0c8120 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96eaffd700 1 -- 172.21.15.133:0/4172677648 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400bab0 con 0x7f96ec0c8120 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96eaffd700 1 -- 172.21.15.133:0/4172677648 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400be30 con 0x7f96ec0c8120 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f2a55700 1 -- 172.21.15.133:0/4172677648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 msgr2=0x7f96ec0ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.177+0000 7f96f2a55700 1 --2- 172.21.15.133:0/4172677648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 0x7f96ec0ab130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f96e4009e60 tx=0x7f96e4009780).stop 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 -- 172.21.15.133:0/4172677648 shutdown_connections 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 --2- 172.21.15.133:0/4172677648 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec0c8120 0x7f96ec0ab130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 --2- 172.21.15.133:0/4172677648 >> v2:172.21.15.178:3300/0 conn(0x7f96ec154140 0x7f96ec158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 -- 172.21.15.133:0/4172677648 >> 172.21.15.133:0/4172677648 conn(0x7f96ec05e1e0 msgr2=0x7f96ec05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 -- 172.21.15.133:0/4172677648 shutdown_connections 2024-01-21T21:33:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.178+0000 7f96f2a55700 1 -- 172.21.15.133:0/4172677648 wait complete. 2024-01-21T21:33:41.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.179+0000 7f96f2a55700 1 Processor -- start 2024-01-21T21:33:41.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.179+0000 7f96f2a55700 1 -- start start 2024-01-21T21:33:41.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96ec0c8120 0x7f96ec14d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec154140 0x7f96ec0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0cb2d0 con 0x7f96ec154520 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0ca750 con 0x7f96ec0c8120 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f2a55700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0caa30 con 0x7f96ec154140 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53630/0 (socket says 172.21.15.133:53630) 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 -- 172.21.15.133:0/786489007 learned_addr learned my addr 172.21.15.133:0/786489007 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96ebfff700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96ec0c8120 0x7f96ec14d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96eb7fe700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec154140 0x7f96ec0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 -- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec154140 msgr2=0x7f96ec0c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec154140 0x7f96ec0c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 -- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96ec0c8120 msgr2=0x7f96ec14d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96ec0c8120 0x7f96ec14d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 -- 172.21.15.133:0/786489007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc0092a0 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.180+0000 7f96f0ff2700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f96ec0c6c20 tx=0x7f96ec05ed40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.181+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4013e40 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.181+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e401d630 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.181+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e4009a20 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.181+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e401d9f0 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.181+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0caff0 con 0x7f96ec154520 2024-01-21T21:33:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.182+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec05fdf0 con 0x7f96ec154520 2024-01-21T21:33:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.182+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f96e4003040 con 0x7f96ec154520 2024-01-21T21:33:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.183+0000 7f96e8ff9700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 0x7f96d80617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.183+0000 7f96ebfff700 1 -- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 msgr2=0x7f96d80617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.183+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f96e407c5f0 con 0x7f96ec154520 2024-01-21T21:33:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.183+0000 7f96ebfff700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 0x7f96d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.187+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f96e404d2c0 con 0x7f96ec154520 2024-01-21T21:33:41.249 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.247+0000 7f1c0f95e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:41.352 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.351+0000 7f1c0f95e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:41.354 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:41.352+0000 7f5e525f1680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-21T21:33:41.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.357+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96ec0aa980 con 0x7f96ec154520 2024-01-21T21:33:41.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.357+0000 7f96e8ff9700 1 -- 172.21.15.133:0/786489007 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v208) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96e40508e0 con 0x7f96ec154520 2024-01-21T21:33:41.360 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:33:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 msgr2=0x7f96d80617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 0x7f96d80617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 msgr2=0x7f96ec15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f96ec0c6c20 tx=0x7f96ec05ed40).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 shutdown_connections 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96ec154520 0x7f96ec15a1d0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f96d805f300 0x7f96d80617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96ec0c8120 0x7f96ec14d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 --2- 172.21.15.133:0/786489007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96ec154140 0x7f96ec0c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 >> 172.21.15.133:0/786489007 conn(0x7f96ec05e1e0 msgr2=0x7f96ec0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 shutdown_connections 2024-01-21T21:33:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.359+0000 7f96f2a55700 1 -- 172.21.15.133:0/786489007 wait complete. 2024-01-21T21:33:41.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-21T21:33:41.470 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:41.467+0000 7f5e525f1680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.496+0000 7f59d9b70700 1 Processor -- start 2024-01-21T21:33:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.496+0000 7f59d9b70700 1 -- start start 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d9b70700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59d4154a90 0x7f59d40a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d9b70700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d40bc6d0 0x7f59d4066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d9b70700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d40654f0 con 0x7f59d41546b0 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d9b70700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d4063700 con 0x7f59d4154a90 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d9b70700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d4063950 con 0x7f59d40bc6d0 2024-01-21T21:33:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59d41546b0 0x7f59d4065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37212/0 (socket says 172.21.15.133:37212) 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d37fe700 1 -- 172.21.15.133:0/1864977361 learned_addr learned my addr 172.21.15.133:0/1864977361 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 --2- 172.21.15.133:0/1864977361 >> v2:172.21.15.178:3300/0 conn(0x7f59d4154a90 0x7f59d40a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d3fff700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d40bc6d0 0x7f59d4066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444804540 0 0) 0x7f59d40654f0 con 0x7f59d41546b0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59bc0033f0 con 0x7f59d41546b0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 -- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d40bc6d0 msgr2=0x7f59d4066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d40bc6d0 0x7f59d4066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 -- 172.21.15.133:0/1864977361 >> v1:172.21.15.133:6789/0 conn(0x7f59d41546b0 legacy=0x7f59d4065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 295829650 0 0) 0x7f59bc0033f0 con 0x7f59d41546b0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 -- 172.21.15.133:0/1864977361 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4065180 con 0x7f59d4154a90 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d2ffd700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d4154a90 0x7f59d40a9e30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f59c8009760 tx=0x7f59c8009060).ready entity=mon.1 client_cookie=4892b5fa0d88d94e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.497+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4001470 con 0x7f59d4154a90 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c80090d0 con 0x7f59d4154a90 2024-01-21T21:33:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d27fc700 1 -- 172.21.15.133:0/1864977361 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8011610 con 0x7f59d4154a90 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 -- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d4154a90 msgr2=0x7f59d40a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d4154a90 0x7f59d40a9e30 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f59c8009760 tx=0x7f59c8009060).stop 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 -- 172.21.15.133:0/1864977361 shutdown_connections 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d40bc6d0 0x7f59d4066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 --2- 172.21.15.133:0/1864977361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d4154a90 0x7f59d40a9e30 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 -- 172.21.15.133:0/1864977361 >> 172.21.15.133:0/1864977361 conn(0x7f59d40c8200 msgr2=0x7f59d40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 -- 172.21.15.133:0/1864977361 shutdown_connections 2024-01-21T21:33:41.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.498+0000 7f59d9b70700 1 -- 172.21.15.133:0/1864977361 wait complete. 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.499+0000 7f59d9b70700 1 Processor -- start 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 -- start start 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d41546b0 0x7f59d414fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d4154a90 0x7f59d414ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d41504b0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d40c5360 con 0x7f59d41546b0 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d9b70700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d40c04d0 con 0x7f59d4154a90 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53636/0 (socket says 172.21.15.133:53636) 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d37fe700 1 -- 172.21.15.133:0/2552916920 learned_addr learned my addr 172.21.15.133:0/2552916920 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.500+0000 7f59d2ffd700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d41546b0 0x7f59d414fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d3fff700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d4154a90 0x7f59d414ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 -- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d4154a90 msgr2=0x7f59d414ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d4154a90 0x7f59d414ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 -- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d41546b0 msgr2=0x7f59d414fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d41546b0 0x7f59d414fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 -- 172.21.15.133:0/2552916920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80092a0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d37fe700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f59c400c810 tx=0x7f59c4001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4007170 con 0x7f59d40bc6d0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c40072d0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c40048c0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d40bff10 con 0x7f59d40bc6d0 2024-01-21T21:33:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.501+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d40c4ff0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.502+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d405fdf0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.503+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f59c4004c70 con 0x7f59d40bc6d0 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.503+0000 7f59bbfff700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 0x7f59c00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.503+0000 7f59d2ffd700 1 -- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 msgr2=0x7f59c00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.503+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f59c407a9a0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.503+0000 7f59d2ffd700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 0x7f59c00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:41.508 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.503+0000 7f1c0f95e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:41.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.507+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f59c404b680 con 0x7f59d40bc6d0 2024-01-21T21:33:41.584 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.578+0000 7f1c0f95e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:41.632 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:41.629+0000 7f5e525f1680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:41.649 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.646+0000 7f1c0f95e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:41.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.679+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59d405e850 con 0x7f59d40bc6d0 2024-01-21T21:33:41.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.679+0000 7f59bbfff700 1 -- 172.21.15.133:0/2552916920 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v208) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59c404eca0 con 0x7f59d40bc6d0 2024-01-21T21:33:41.682 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2024-01-21T21:33:41.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 msgr2=0x7f59c00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:41.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 0x7f59c00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 msgr2=0x7f59d40acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f59c400c810 tx=0x7f59c4001ab0).stop 2024-01-21T21:33:41.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 shutdown_connections 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59d4154a90 0x7f59d414ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59d40bc6d0 0x7f59d40acd50 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f59c005f300 0x7f59c00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 --2- 172.21.15.133:0/2552916920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59d41546b0 0x7f59d414fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 >> 172.21.15.133:0/2552916920 conn(0x7f59d40c8200 msgr2=0x7f59d40bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 shutdown_connections 2024-01-21T21:33:41.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.682+0000 7f59d9b70700 1 -- 172.21.15.133:0/2552916920 wait complete. 2024-01-21T21:33:41.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:41.718 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:41.716+0000 7f5e525f1680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-21T21:33:41.792 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:41.789+0000 7f5e525f1680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-21T21:33:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.818+0000 7fe925771700 1 Processor -- start 2024-01-21T21:33:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 -- start start 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9200c6590 0x7fe9200c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200c89d0 con 0x7fe9201545a0 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9200c6a20 con 0x7fe9200c6590 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe925771700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200c7dc0 con 0x7fe9200c77b0 2024-01-21T21:33:41.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.819+0000 7fe91f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9200c6590 0x7fe9200c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9200c6590 0x7fe9200c0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53644/0 (socket says 172.21.15.133:53644) 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 -- 172.21.15.133:0/3330685359 learned_addr learned my addr 172.21.15.133:0/3330685359 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91e7fc700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91effd700 1 --1- 172.21.15.133:0/3330685359 >> v1:172.21.15.178:6789/0 conn(0x7fe9201545a0 0x7fe9200aa360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.133:52400/0 (socket says 172.21.15.133:52400) 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 -- 172.21.15.133:0/3330685359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 msgr2=0x7fe9200c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:41.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 -- 172.21.15.133:0/3330685359 >> v1:172.21.15.178:6789/0 conn(0x7fe9201545a0 legacy=0x7fe9200aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91dffb700 1 -- 172.21.15.133:0/3330685359 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673832265 0 0) 0x7fe9200c89d0 con 0x7fe9201545a0 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 -- 172.21.15.133:0/3330685359 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200c80a0 con 0x7fe9200c6590 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91f7fe700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200c0750 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7fe918009f20 tx=0x7fe918009840).ready entity=mon.0 client_cookie=4d94963075cf91b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91dffb700 1 -- 172.21.15.133:0/3330685359 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800e070 con 0x7fe9200c6590 2024-01-21T21:33:41.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91dffb700 1 -- 172.21.15.133:0/3330685359 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91800b9d0 con 0x7fe9200c6590 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.820+0000 7fe91dffb700 1 -- 172.21.15.133:0/3330685359 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91800bd50 con 0x7fe9200c6590 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 -- 172.21.15.133:0/3330685359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 msgr2=0x7fe9200c0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200c0750 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7fe918009f20 tx=0x7fe918009840).stop 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 -- 172.21.15.133:0/3330685359 shutdown_connections 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200c0750 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 --2- 172.21.15.133:0/3330685359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 -- 172.21.15.133:0/3330685359 >> 172.21.15.133:0/3330685359 conn(0x7fe9200649d0 msgr2=0x7fe920064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:41.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 -- 172.21.15.133:0/3330685359 shutdown_connections 2024-01-21T21:33:41.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.821+0000 7fe925771700 1 -- 172.21.15.133:0/3330685359 wait complete. 2024-01-21T21:33:41.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.822+0000 7fe925771700 1 Processor -- start 2024-01-21T21:33:41.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.822+0000 7fe925771700 1 -- start start 2024-01-21T21:33:41.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9201545a0 0x7fe9200acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200ae080 con 0x7fe9200c6590 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200ae360 con 0x7fe9201545a0 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe925771700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200ae640 con 0x7fe9200c77b0 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53656/0 (socket says 172.21.15.133:53656) 2024-01-21T21:33:41.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 -- 172.21.15.133:0/3233716042 learned_addr learned my addr 172.21.15.133:0/3233716042 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91e7fc700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91f7fe700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9201545a0 0x7fe9200acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 msgr2=0x7fe9200b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9201545a0 msgr2=0x7fe9200acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:41.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9201545a0 0x7fe9200acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91effd700 1 -- 172.21.15.133:0/3233716042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe918009ae0 con 0x7fe9200c6590 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.823+0000 7fe91e7fc700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe91effd700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fe90800c560 tx=0x7fe908007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080072e0 con 0x7fe9200c6590 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908007440 con 0x7fe9200c6590 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080058f0 con 0x7fe9200c6590 2024-01-21T21:33:41.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9200ae920 con 0x7fe9200c6590 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.824+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200aeee0 con 0x7fe9200c6590 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.825+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92005fdf0 con 0x7fe9200c6590 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.825+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe908005ce0 con 0x7fe9200c6590 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.826+0000 7fe9177fe700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 0x7fe9000617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.826+0000 7fe91e7fc700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 msgr2=0x7fe9000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:41.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.826+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fe908079f00 con 0x7fe9200c6590 2024-01-21T21:33:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.826+0000 7fe91e7fc700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 0x7fe9000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:41.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:41.830+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe90804ac60 con 0x7fe9200c6590 2024-01-21T21:33:41.906 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:41.903+0000 7f1c0f95e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:42.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.027+0000 7fe91e7fc700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 msgr2=0x7fe9000617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:42.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.027+0000 7fe91e7fc700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 0x7fe9000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:42.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.043+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9200c8380 con 0x7fe9200c6590 2024-01-21T21:33:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.043+0000 7fe9177fe700 1 -- 172.21.15.133:0/3233716042 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7fe90804e280 con 0x7fe9200c6590 2024-01-21T21:33:42.046 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:42.046 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.045+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 msgr2=0x7fe9000617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.045+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 0x7fe9000617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.045+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 msgr2=0x7fe9200afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.045+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fe90800c560 tx=0x7fe908007c90).stop 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 shutdown_connections 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe90005f300 0x7fe9000617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9201545a0 0x7fe9200acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9200c6590 0x7fe9200afb60 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 --2- 172.21.15.133:0/3233716042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9200c77b0 0x7fe9200b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 >> 172.21.15.133:0/3233716042 conn(0x7fe9200649d0 msgr2=0x7fe9200c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 shutdown_connections 2024-01-21T21:33:42.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.046+0000 7fe925771700 1 -- 172.21.15.133:0/3233716042 wait complete. 2024-01-21T21:33:42.051 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:42.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:42.063 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:42.060+0000 7f5e525f1680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-21T21:33:42.091 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:42.088+0000 7f1c0f95e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.184+0000 7f30f3664700 1 Processor -- start 2024-01-21T21:33:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.184+0000 7f30f3664700 1 -- start start 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f3664700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30ec154140 0x7f30ec158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f3664700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec0c0e40 con 0x7f30ec154520 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f3664700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec1549b0 con 0x7f30ec0c8120 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f3664700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec0c6ae0 con 0x7f30ec154140 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f0bff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f30ec154520 0x7f30ec0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37214/0 (socket says 172.21.15.133:37214) 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f0bff700 1 -- 172.21.15.133:0/1018644239 learned_addr learned my addr 172.21.15.133:0/1018644239 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30f1400700 1 --2- 172.21.15.133:0/1018644239 >> v2:172.21.15.178:3300/0 conn(0x7f30ec154140 0x7f30ec158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705523377 0 0) 0x7f30ec0c0e40 con 0x7f30ec154520 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30d80033f0 con 0x7f30ec154520 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526150870 0 0) 0x7f30ec1549b0 con 0x7f30ec0c8120 2024-01-21T21:33:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.185+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec0c0e40 con 0x7f30ec0c8120 2024-01-21T21:33:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30f1400700 1 -- 172.21.15.133:0/1018644239 >> v1:172.21.15.178:6789/0 conn(0x7f30ec0c8120 legacy=0x7f30ec0c12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1036789834 0 0) 0x7f30d80033f0 con 0x7f30ec154520 2024-01-21T21:33:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30f1400700 1 -- 172.21.15.133:0/1018644239 >> v1:172.21.15.133:6789/0 conn(0x7f30ec154520 legacy=0x7f30ec0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30f1400700 1 -- 172.21.15.133:0/1018644239 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0c6800 con 0x7f30ec154140 2024-01-21T21:33:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30f1400700 1 --2- 172.21.15.133:0/1018644239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154140 0x7f30ec158bb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f30e8009790 tx=0x7f30e8009060).ready entity=mon.1 client_cookie=ab12f25d2582628d server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc001470 con 0x7f30ec154140 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8011400 con 0x7f30ec154140 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30e3fff700 1 -- 172.21.15.133:0/1018644239 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8011780 con 0x7f30ec154140 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.186+0000 7f30f3664700 1 -- 172.21.15.133:0/1018644239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154140 msgr2=0x7f30ec158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 --2- 172.21.15.133:0/1018644239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154140 0x7f30ec158bb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f30e8009790 tx=0x7f30e8009060).stop 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 -- 172.21.15.133:0/1018644239 shutdown_connections 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 --2- 172.21.15.133:0/1018644239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154140 0x7f30ec158bb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 -- 172.21.15.133:0/1018644239 >> 172.21.15.133:0/1018644239 conn(0x7f30ec05e1e0 msgr2=0x7f30ec05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 -- 172.21.15.133:0/1018644239 shutdown_connections 2024-01-21T21:33:42.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.187+0000 7f30f3664700 1 -- 172.21.15.133:0/1018644239 wait complete. 2024-01-21T21:33:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.188+0000 7f30f3664700 1 Processor -- start 2024-01-21T21:33:42.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.188+0000 7f30f3664700 1 -- start start 2024-01-21T21:33:42.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30ec154140 0x7f30ec1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 0x7f30ec144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec147b90 con 0x7f30ec0c8120 2024-01-21T21:33:42.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec147e70 con 0x7f30ec154520 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f3664700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec148150 con 0x7f30ec154140 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1400700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1400700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53666/0 (socket says 172.21.15.133:53666) 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1400700 1 -- 172.21.15.133:0/1933806430 learned_addr learned my addr 172.21.15.133:0/1933806430 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 0x7f30ec144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f0bff700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30ec154140 0x7f30ec1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 -- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30ec154140 msgr2=0x7f30ec1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30ec154140 0x7f30ec1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 -- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 msgr2=0x7f30ec147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 -- 172.21.15.133:0/1933806430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80092a0 con 0x7f30ec154520 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1400700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.189+0000 7f30f1c01700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 0x7f30ec144c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f30e400c790 tx=0x7f30e4007ef0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.190+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4002240 con 0x7f30ec154520 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.190+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e40023a0 con 0x7f30ec154520 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.190+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec148430 con 0x7f30ec154520 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.190+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e4001650 con 0x7f30ec154520 2024-01-21T21:33:42.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.190+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec145180 con 0x7f30ec154520 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f30e4001a40 con 0x7f30ec154520 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec05fdf0 con 0x7f30ec154520 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30e1ffb700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 0x7f30d00617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30f1400700 1 -- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 msgr2=0x7f30d00617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f30e407a5f0 con 0x7f30ec154520 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.191+0000 7f30f1400700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 0x7f30d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:42.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.195+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f30e404b350 con 0x7f30ec154520 2024-01-21T21:33:42.261 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:42.258+0000 7f5e525f1680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-21T21:33:42.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.368+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30ec14e340 con 0x7f30ec154520 2024-01-21T21:33:42.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.369+0000 7f30e1ffb700 1 -- 172.21.15.133:0/1933806430 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+18328 (secure 0 0 0) 0x7f30e404e970 con 0x7f30ec154520 2024-01-21T21:33:42.372 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:42.372 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":208,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:36.420693+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/1079767282":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6833/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6832/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:0/912648497":"2024-01-22T21:33:36.420664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:42.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 msgr2=0x7f30d00617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:42.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 0x7f30d00617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 msgr2=0x7f30ec144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 0x7f30ec144c90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f30e400c790 tx=0x7f30e4007ef0).stop 2024-01-21T21:33:42.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 shutdown_connections 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f30d005f300 0x7f30d00617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30ec154520 0x7f30ec144c90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30ec0c8120 0x7f30ec147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 --2- 172.21.15.133:0/1933806430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30ec154140 0x7f30ec1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 >> 172.21.15.133:0/1933806430 conn(0x7f30ec05e1e0 msgr2=0x7f30ec0c3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 shutdown_connections 2024-01-21T21:33:42.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.371+0000 7f30f3664700 1 -- 172.21.15.133:0/1933806430 wait complete. 2024-01-21T21:33:42.387 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:33:42.387 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:42.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.504+0000 7fb869358700 1 Processor -- start 2024-01-21T21:33:42.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.504+0000 7fb869358700 1 -- start start 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb869358700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb864065d70 0x7fb86415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb869358700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb864069ef0 con 0x7fb864062ff0 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb869358700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86406a130 con 0x7fb864062c10 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb869358700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86406a410 con 0x7fb864065d70 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb8627fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb864062ff0 0x7fb864065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37216/0 (socket says 172.21.15.133:37216) 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.505+0000 7fb8627fc700 1 -- 172.21.15.133:0/3281687302 learned_addr learned my addr 172.21.15.133:0/3281687302 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb8637fe700 1 --2- 172.21.15.133:0/3281687302 >> v2:172.21.15.178:3300/0 conn(0x7fb864065d70 0x7fb86415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271045762 0 0) 0x7fb858001110 con 0x7fb864062ff0 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84c0033f0 con 0x7fb864062ff0 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683780514 0 0) 0x7fb86406a130 con 0x7fb864062c10 2024-01-21T21:33:42.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb858001110 con 0x7fb864062c10 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb8637fe700 1 -- 172.21.15.133:0/3281687302 >> v1:172.21.15.178:6789/0 conn(0x7fb864062c10 legacy=0x7fb8640697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb8637fe700 1 -- 172.21.15.133:0/3281687302 >> v1:172.21.15.133:6789/0 conn(0x7fb864062ff0 legacy=0x7fb864065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb8637fe700 1 -- 172.21.15.133:0/3281687302 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86406a6f0 con 0x7fb864065d70 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb8637fe700 1 --2- 172.21.15.133:0/3281687302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864065d70 0x7fb86415f750 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb85c009e60 tx=0x7fb85c009780).ready entity=mon.1 client_cookie=c33f8945f39fd900 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00e070 con 0x7fb864065d70 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00bab0 con 0x7fb864065d70 2024-01-21T21:33:42.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.506+0000 7fb861ffb700 1 -- 172.21.15.133:0/3281687302 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00be30 con 0x7fb864065d70 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 -- 172.21.15.133:0/3281687302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864065d70 msgr2=0x7fb86415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 --2- 172.21.15.133:0/3281687302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864065d70 0x7fb86415f750 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fb85c009e60 tx=0x7fb85c009780).stop 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 -- 172.21.15.133:0/3281687302 shutdown_connections 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 --2- 172.21.15.133:0/3281687302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864065d70 0x7fb86415f750 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 -- 172.21.15.133:0/3281687302 >> 172.21.15.133:0/3281687302 conn(0x7fb8640c8010 msgr2=0x7fb8640c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 -- 172.21.15.133:0/3281687302 shutdown_connections 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.507+0000 7fb869358700 1 -- 172.21.15.133:0/3281687302 wait complete. 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.508+0000 7fb869358700 1 Processor -- start 2024-01-21T21:33:42.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.508+0000 7fb869358700 1 -- start start 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb864062ff0 0x7fb8640a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640c0080 con 0x7fb864065d70 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86413cfc0 con 0x7fb864062c10 2024-01-21T21:33:42.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb869358700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640bf470 con 0x7fb864062ff0 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb8637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb862ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb8627fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb864062ff0 0x7fb8640a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb862ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.133:50260/0 (socket says 172.21.15.133:50260) 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb8637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53670/0 (socket says 172.21.15.133:53670) 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.509+0000 7fb862ffd700 1 -- 172.21.15.133:0/1945252041 learned_addr learned my addr 172.21.15.133:0/1945252041 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb864062ff0 msgr2=0x7fb8640a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb864062ff0 0x7fb8640a7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 msgr2=0x7fb864139dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 -- 172.21.15.133:0/1945252041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c009a20 con 0x7fb864065d70 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb862ffd700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb8637fe700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fb85c014000 tx=0x7fb85c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c013e60 con 0x7fb864065d70 2024-01-21T21:33:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c01d630 con 0x7fb864065d70 2024-01-21T21:33:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640bf750 con 0x7fb864065d70 2024-01-21T21:33:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c01d9f0 con 0x7fb864065d70 2024-01-21T21:33:42.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.510+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640bfd10 con 0x7fb864065d70 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.511+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fb85c003040 con 0x7fb864065d70 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.511+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640c01f0 con 0x7fb864065d70 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.511+0000 7fb84b7fe700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 0x7fb8500617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.512+0000 7fb862ffd700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 msgr2=0x7fb8500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.512+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fb85c07c600 con 0x7fb864065d70 2024-01-21T21:33:42.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.512+0000 7fb862ffd700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 0x7fb8500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:42.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.516+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fb85c04d150 con 0x7fb864065d70 2024-01-21T21:33:42.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.713+0000 7fb862ffd700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 msgr2=0x7fb8500617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:42.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.713+0000 7fb862ffd700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 0x7fb8500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:42.746 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:42.743+0000 7f1c0f95e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:42.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.746+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb86405fdf0 con 0x7fb864065d70 2024-01-21T21:33:42.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.746+0000 7fb84b7fe700 1 -- 172.21.15.133:0/1945252041 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7fb85c050770 con 0x7fb864065d70 2024-01-21T21:33:42.749 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:42.749 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:42.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 msgr2=0x7fb8500617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:42.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 0x7fb8500617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 msgr2=0x7fb8640bd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fb85c014000 tx=0x7fb85c009780).stop 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 shutdown_connections 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb864065d70 0x7fb8640bd670 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fb85005f300 0x7fb8500617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb864062c10 0x7fb864139dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.748+0000 7fb869358700 1 --2- 172.21.15.133:0/1945252041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb864062ff0 0x7fb8640a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.749+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 >> 172.21.15.133:0/1945252041 conn(0x7fb8640c8010 msgr2=0x7fb8640be240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.749+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 shutdown_connections 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.749+0000 7fb869358700 1 -- 172.21.15.133:0/1945252041 wait complete. 2024-01-21T21:33:42.752 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:42.764 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:33:42.814 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:42.811+0000 7f1c0f95e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:42.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.883+0000 7fd5e5f87700 1 Processor -- start 2024-01-21T21:33:42.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.883+0000 7fd5e5f87700 1 -- start start 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5e5f87700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5e0154140 0x7fd5e0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5e5f87700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5e0154520 0x7fd5e00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5e5f87700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e00ab620 con 0x7fd5e00c6090 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5e5f87700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00c6ae0 con 0x7fd5e0154140 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5e5f87700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e00c05e0 con 0x7fd5e0154520 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5e0154140 0x7fd5e0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5e0154140 0x7fd5e0158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53676/0 (socket says 172.21.15.133:53676) 2024-01-21T21:33:42.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 -- 172.21.15.133:0/3254713179 learned_addr learned my addr 172.21.15.133:0/3254713179 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5deffd700 1 --2- 172.21.15.133:0/3254713179 >> v2:172.21.15.178:3300/0 conn(0x7fd5e0154520 0x7fd5e00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 -- 172.21.15.133:0/3254713179 >> v2:172.21.15.178:3300/0 conn(0x7fd5e0154520 msgr2=0x7fd5e00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 --2- 172.21.15.133:0/3254713179 >> v2:172.21.15.178:3300/0 conn(0x7fd5e0154520 0x7fd5e00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 -- 172.21.15.133:0/3254713179 >> v1:172.21.15.178:6789/0 conn(0x7fd5e00c6090 legacy=0x7fd5e00c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 -- 172.21.15.133:0/3254713179 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00c0e40 con 0x7fd5e0154140 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.884+0000 7fd5df7fe700 1 --2- 172.21.15.133:0/3254713179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e0154140 0x7fd5e0158bb0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7fd5e0062cf0 tx=0x7fd5d00090f0).ready entity=mon.0 client_cookie=9b8404f582b57a87 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5de7fc700 1 -- 172.21.15.133:0/3254713179 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000b520 con 0x7fd5e0154140 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5de7fc700 1 -- 172.21.15.133:0/3254713179 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000b680 con 0x7fd5e0154140 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5de7fc700 1 -- 172.21.15.133:0/3254713179 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000ba00 con 0x7fd5e0154140 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 -- 172.21.15.133:0/3254713179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e0154140 msgr2=0x7fd5e0158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/3254713179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e0154140 0x7fd5e0158bb0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x7fd5e0062cf0 tx=0x7fd5d00090f0).stop 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 -- 172.21.15.133:0/3254713179 shutdown_connections 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/3254713179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e0154140 0x7fd5e0158bb0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/3254713179 >> v2:172.21.15.178:3300/0 conn(0x7fd5e0154520 0x7fd5e00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 -- 172.21.15.133:0/3254713179 >> 172.21.15.133:0/3254713179 conn(0x7fd5e005e1e0 msgr2=0x7fd5e005e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 -- 172.21.15.133:0/3254713179 shutdown_connections 2024-01-21T21:33:42.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.885+0000 7fd5e5f87700 1 -- 172.21.15.133:0/3254713179 wait complete. 2024-01-21T21:33:42.890 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:42.886+0000 7f1c0f95e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 Processor -- start 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 -- start start 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 0x7fd5e00c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5e0154520 0x7fd5e00c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c9920 con 0x7fd5e00c6090 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c9c00 con 0x7fd5e0154140 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.887+0000 7fd5e5f87700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00c9ee0 con 0x7fd5e0154520 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53688/0 (socket says 172.21.15.133:53688) 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 -- 172.21.15.133:0/1486576975 learned_addr learned my addr 172.21.15.133:0/1486576975 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5deffd700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 0x7fd5e00c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5dffff700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5e0154520 0x7fd5e00c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5e0154520 msgr2=0x7fd5e00c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5e0154520 0x7fd5e00c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 msgr2=0x7fd5e00c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 0x7fd5e00c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 -- 172.21.15.133:0/1486576975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009370 con 0x7fd5e00c6090 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5deffd700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 0x7fd5e00c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5df7fe700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fd5d0009130 tx=0x7fd5d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0000bc0 con 0x7fd5e00c6090 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000b7f0 con 0x7fd5e00c6090 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0000d20 con 0x7fd5e00c6090 2024-01-21T21:33:42.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00ae070 con 0x7fd5e00c6090 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.888+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e0147610 con 0x7fd5e00c6090 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fd5d001c8c0 con 0x7fd5e00c6090 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e005fdf0 con 0x7fd5e00c6090 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5c7fff700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 0x7fd5cc0617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5deffd700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 msgr2=0x7fd5cc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fd5d007c4a0 con 0x7fd5e00c6090 2024-01-21T21:33:42.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.890+0000 7fd5deffd700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 0x7fd5cc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:42.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:42.894+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd5d004d200 con 0x7fd5e00c6090 2024-01-21T21:33:42.997 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:42.994+0000 7f5e525f1680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-21T21:33:43.036 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.033+0000 7f1c0f95e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.091+0000 7fd5deffd700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 msgr2=0x7fd5cc0617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:43.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.091+0000 7fd5deffd700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 0x7fd5cc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:43.107 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.104+0000 7f1c0f95e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:43.108 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.106+0000 7f5e525f1680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-21T21:33:43.187 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.184+0000 7f5e525f1680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-21T21:33:43.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.213+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5e00aa980 con 0x7fd5e00c6090 2024-01-21T21:33:43.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.214+0000 7fd5c7fff700 1 -- 172.21.15.133:0/1486576975 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4511 (secure 0 0 0) 0x7fd5d002a020 con 0x7fd5e00c6090 2024-01-21T21:33:43.216 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:43.216 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":74,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-21T21:33:20.598011+0000","modified":"2024-01-21T21:33:22.603623+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10053},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10053":{"gid":10053,"name":"d","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/2870485430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2870485430},{"type":"v1","addr":"172.21.15.178:6835","nonce":2870485430}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2024-01-21T21:33:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 msgr2=0x7fd5cc0617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 0x7fd5cc0617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:43.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 msgr2=0x7fd5e0147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fd5d0009130 tx=0x7fd5d0017000).stop 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 shutdown_connections 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5e0154520 0x7fd5e00c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5e00c6090 0x7fd5e0147120 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd5cc05f300 0x7fd5cc0617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 --2- 172.21.15.133:0/1486576975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0154140 0x7fd5e00c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.215+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 >> 172.21.15.133:0/1486576975 conn(0x7fd5e005e1e0 msgr2=0x7fd5e0148310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.216+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 shutdown_connections 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.216+0000 7fd5e5f87700 1 -- 172.21.15.133:0/1486576975 wait complete. 2024-01-21T21:33:43.219 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 74 2024-01-21T21:33:43.224 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.219+0000 7f1c0f95e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:43.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:43.331 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.328+0000 7f1c0f95e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:43.346 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.343+0000 7f5e525f1680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-21T21:33:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.346+0000 7fe3273fb700 1 Processor -- start 2024-01-21T21:33:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.346+0000 7fe3273fb700 1 -- start start 2024-01-21T21:33:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe3273fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe320137410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe3273fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe320068370 con 0x7fe320067d90 2024-01-21T21:33:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe3273fb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe320068650 con 0x7fe320137030 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe3273fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe320068930 con 0x7fe3200c6040 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe324996700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe320067d90 0x7fe3200c5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37230/0 (socket says 172.21.15.133:37230) 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe324996700 1 -- 172.21.15.133:0/3707853544 learned_addr learned my addr 172.21.15.133:0/3707853544 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe325998700 1 --2- 172.21.15.133:0/3707853544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe320137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416366342 0 0) 0x7fe320068370 con 0x7fe320067d90 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c0033f0 con 0x7fe320067d90 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.347+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294047694 0 0) 0x7fe320068650 con 0x7fe320137030 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe320068370 con 0x7fe320137030 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe325998700 1 -- 172.21.15.133:0/3707853544 >> v1:172.21.15.178:6789/0 conn(0x7fe320137030 legacy=0x7fe320155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2512020613 0 0) 0x7fe30c0033f0 con 0x7fe320067d90 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe325998700 1 -- 172.21.15.133:0/3707853544 >> v1:172.21.15.133:6789/0 conn(0x7fe320067d90 legacy=0x7fe3200c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe325998700 1 -- 172.21.15.133:0/3707853544 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320068c10 con 0x7fe3200c6040 2024-01-21T21:33:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe325998700 1 --2- 172.21.15.133:0/3707853544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe320137410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe318009e90 tx=0x7fe318009780).ready entity=mon.2 client_cookie=8ee75f3db4a05e67 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800e070 con 0x7fe3200c6040 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800b7a0 con 0x7fe3200c6040 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe317fff700 1 -- 172.21.15.133:0/3707853544 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310001470 con 0x7fe3200c6040 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe3273fb700 1 -- 172.21.15.133:0/3707853544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 msgr2=0x7fe320137410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.348+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3707853544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe320137410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe318009e90 tx=0x7fe318009780).stop 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.349+0000 7fe3273fb700 1 -- 172.21.15.133:0/3707853544 shutdown_connections 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.349+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3707853544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe320137410 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.349+0000 7fe3273fb700 1 -- 172.21.15.133:0/3707853544 >> 172.21.15.133:0/3707853544 conn(0x7fe320066a90 msgr2=0x7fe320066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.349+0000 7fe3273fb700 1 -- 172.21.15.133:0/3707853544 shutdown_connections 2024-01-21T21:33:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.349+0000 7fe3273fb700 1 -- 172.21.15.133:0/3707853544 wait complete. 2024-01-21T21:33:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.350+0000 7fe3273fb700 1 Processor -- start 2024-01-21T21:33:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.350+0000 7fe3273fb700 1 -- start start 2024-01-21T21:33:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe320067d90 0x7fe320167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe3200c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c2c80 con 0x7fe320137030 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200bffa0 con 0x7fe320067d90 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200c0e00 con 0x7fe3200c6040 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53702/0 (socket says 172.21.15.133:53702) 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 -- 172.21.15.133:0/3744555487 learned_addr learned my addr 172.21.15.133:0/3744555487 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe324996700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe3200c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325197700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe320067d90 0x7fe320167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 -- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 msgr2=0x7fe3200c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe3200c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 -- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe320067d90 msgr2=0x7fe320167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe320067d90 0x7fe320167b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 -- 172.21.15.133:0/3744555487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009a20 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe325998700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fe3200c6440 tx=0x7fe318009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800bd80 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3200c1290 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31801e440 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.351+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800bee0 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.352+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3200c04d0 con 0x7fe320137030 2024-01-21T21:33:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.352+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3200c0f70 con 0x7fe320137030 2024-01-21T21:33:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.354+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7fe318003040 con 0x7fe320137030 2024-01-21T21:33:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.354+0000 7fe315ffb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 0x7fe3040617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.354+0000 7fe325197700 1 -- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 msgr2=0x7fe3040617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.354+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7fe31807cab0 con 0x7fe320137030 2024-01-21T21:33:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.354+0000 7fe325197700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 0x7fe3040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.358+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fe31804d600 con 0x7fe320137030 2024-01-21T21:33:43.422 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.420+0000 7f5e525f1680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-21T21:33:43.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.529+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32006bd20 con 0x7fe320137030 2024-01-21T21:33:43.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.530+0000 7fe315ffb700 1 -- 172.21.15.133:0/3744555487 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v208) v1 ==== 74+0+18328 (secure 0 0 0) 0x7fe318050c20 con 0x7fe320137030 2024-01-21T21:33:43.533 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:43.533 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":208,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:36.420693+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2024-01-21T21:33:19.165061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2024-01-21T21:33:19.568969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"207","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/1079767282":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6833/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6832/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:0/912648497":"2024-01-22T21:33:36.420664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 msgr2=0x7fe3040617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 0x7fe3040617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 msgr2=0x7fe3200c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7fe3200c6440 tx=0x7fe318009780).stop 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 shutdown_connections 2024-01-21T21:33:43.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe320137030 0x7fe3200c2790 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fe30405f300 0x7fe3040617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe320067d90 0x7fe320167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 --2- 172.21.15.133:0/3744555487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3200c6040 0x7fe3200c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 >> 172.21.15.133:0/3744555487 conn(0x7fe320066a90 msgr2=0x7fe3200c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 shutdown_connections 2024-01-21T21:33:43.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.532+0000 7fe3273fb700 1 -- 172.21.15.133:0/3744555487 wait complete. 2024-01-21T21:33:43.542 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.540+0000 7f5e525f1680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-21T21:33:43.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-21T21:33:43.623 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.620+0000 7f1c0f95e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:43.659 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.656+0000 7f5e525f1680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-21T21:33:43.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.663+0000 7f5494ee4700 1 Processor -- start 2024-01-21T21:33:43.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.664+0000 7f5494ee4700 1 -- start start 2024-01-21T21:33:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.664+0000 7f5494ee4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 0x7f5490155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f5494ee4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54900c3fb0 0x7f5490066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f5494ee4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5490065660 con 0x7f54900beb30 2024-01-21T21:33:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f5494ee4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900bef10 con 0x7f54900c3fb0 2024-01-21T21:33:43.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f5494ee4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5490156070 con 0x7f5490069ef0 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f54900beb30 0x7f54900697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37234/0 (socket says 172.21.15.133:37234) 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548e59c700 1 -- 172.21.15.133:0/3955458122 learned_addr learned my addr 172.21.15.133:0/3955458122 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548dd9b700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 0x7f5490155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 --2- 172.21.15.133:0/3955458122 >> v2:172.21.15.178:3300/0 conn(0x7f54900c3fb0 0x7f5490066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548d59a700 1 -- 172.21.15.133:0/3955458122 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652954147 0 0) 0x7f5490065660 con 0x7f54900beb30 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548d59a700 1 -- 172.21.15.133:0/3955458122 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f547c0033f0 con 0x7f54900beb30 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 -- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 msgr2=0x7f5490155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 0x7f5490155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 -- 172.21.15.133:0/3955458122 >> v1:172.21.15.133:6789/0 conn(0x7f54900beb30 legacy=0x7f54900697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 -- 172.21.15.133:0/3955458122 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490065f00 con 0x7f54900c3fb0 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548dd9b700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 0x7f5490155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:43.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548ed9d700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900c3fb0 0x7f5490066390 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f5488009e90 tx=0x7f5488009780).ready entity=mon.1 client_cookie=e177e43d0676ea0b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548d59a700 1 -- 172.21.15.133:0/3955458122 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800e070 con 0x7f54900c3fb0 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.665+0000 7f548d59a700 1 -- 172.21.15.133:0/3955458122 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800ba70 con 0x7f54900c3fb0 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f548d59a700 1 -- 172.21.15.133:0/3955458122 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800bdf0 con 0x7f54900c3fb0 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 -- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900c3fb0 msgr2=0x7f5490066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900c3fb0 0x7f5490066390 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f5488009e90 tx=0x7f5488009780).stop 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 -- 172.21.15.133:0/3955458122 shutdown_connections 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900c3fb0 0x7f5490066390 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 --2- 172.21.15.133:0/3955458122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5490069ef0 0x7f5490155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 -- 172.21.15.133:0/3955458122 >> 172.21.15.133:0/3955458122 conn(0x7f54900c8010 msgr2=0x7f54900c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 -- 172.21.15.133:0/3955458122 shutdown_connections 2024-01-21T21:33:43.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.666+0000 7f5494ee4700 1 -- 172.21.15.133:0/3955458122 wait complete. 2024-01-21T21:33:43.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 Processor -- start 2024-01-21T21:33:43.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 -- start start 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900beb30 0x7f54900bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54900c3fb0 0x7f54901571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490151500 con 0x7f5490069ef0 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900c5cb0 con 0x7f54900beb30 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.668+0000 7f5494ee4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900c6f60 con 0x7f54900c3fb0 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53704/0 (socket says 172.21.15.133:53704) 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 -- 172.21.15.133:0/1461039988 learned_addr learned my addr 172.21.15.133:0/1461039988 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548ed9d700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54900c3fb0 0x7f54901571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548dd9b700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900beb30 0x7f54900bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:43.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54900c3fb0 msgr2=0x7f54901571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54900c3fb0 0x7f54901571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900beb30 msgr2=0x7f54900bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900beb30 0x7f54900bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 -- 172.21.15.133:0/1461039988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780092a0 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f548e59c700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7f548000c5c0 tx=0x7f5480007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800072e0 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5488009a20 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480007440 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800057a0 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.669+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54900c61a0 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.670+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549005fdf0 con 0x7f5490069ef0 2024-01-21T21:33:43.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.671+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 106) v1 ==== 75605+0+0 (secure 0 0 0) 0x7f5480005bd0 con 0x7f5490069ef0 2024-01-21T21:33:43.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.671+0000 7f5486ffd700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 0x7f54700617c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:43.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.671+0000 7f548dd9b700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 msgr2=0x7f54700617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:43.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.671+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(208..208 src has 1..208) v4 ==== 7005+0+0 (secure 0 0 0) 0x7f5480079fc0 con 0x7f5490069ef0 2024-01-21T21:33:43.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.671+0000 7f548dd9b700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 0x7f54700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-01-21T21:33:43.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.676+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f548004ad20 con 0x7f5490069ef0 2024-01-21T21:33:43.695 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-01-21T21:33:43.692+0000 7f1c0f95e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.872+0000 7f548dd9b700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 msgr2=0x7f54700617c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.133:6832/94812 2024-01-21T21:33:43.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.872+0000 7f548dd9b700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 0x7f54700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-01-21T21:33:43.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:43.892+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f549006ac20 con 0x7f5490069ef0 2024-01-21T21:33:43.965 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:43.963+0000 7f5e525f1680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-21T21:33:44.039 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.036+0000 7f5e525f1680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-21T21:33:44.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.055+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 107) v1 ==== 75270+0+0 (secure 0 0 0) 0x7f548001bdb0 con 0x7f5490069ef0 2024-01-21T21:33:44.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.055+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 msgr2=0x7f54700617c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-21T21:33:44.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.055+0000 7f5486ffd700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 0x7f54700617c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:44.061 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.061 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.061 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.061 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.061 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2024-01-21T21:33:44.062 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-01-21T21:33:44.058+0000 7f65d735e700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:33:44.064 INFO:tasks.ceph.mds.d.smithi178.stderr: -2259> 2024-01-21T21:33:26.532+0000 7f65dab65700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -7> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -6> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -5> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) _finish_flush got (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -4> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -3> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 mds.0.journaler.mdlog(rw) handle_write_error: multiple write errors, handler already called 2024-01-21T21:33:44.067 INFO:tasks.ceph.mds.d.smithi178.stderr: -1> 2024-01-21T21:33:44.058+0000 7f65d735e700 -1 MDSIOContextBase: failed with -108, restarting... 2024-01-21T21:33:44.085 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-01-21T21:33:44.117 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.114+0000 7f5dcc39d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.117 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.114+0000 7f5dcc39d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.117 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.114+0000 7f5dcc39d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.117 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.114+0000 7f5dcc39d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.117 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.114+0000 7f5dcc39d700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.115+0000 7f5dceba2700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.115+0000 7f5dceba2700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.115+0000 7f5dceba2700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.115+0000 7f5dceba2700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.118 INFO:tasks.ceph.mgr.y.smithi133.stderr:2024-01-21T21:33:44.115+0000 7f5dceba2700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-21T21:33:44.464 INFO:tasks.ceph.mon.a.smithi133.stderr:2024-01-21T21:33:44.461+0000 7f00d7d2d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-21T21:33:44.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.467+0000 7f5486ffd700 1 -- 172.21.15.133:0/1461039988 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5480072df0 con 0x7f5490069ef0 2024-01-21T21:33:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 msgr2=0x7f5490151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:44.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7f548000c5c0 tx=0x7f5480007c80).stop 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 shutdown_connections 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54900c3fb0 0x7f54901571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5490069ef0 0x7f5490151010 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f547005f300 0x7f54700617c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 --2- 172.21.15.133:0/1461039988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54900beb30 0x7f54900bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 >> 172.21.15.133:0/1461039988 conn(0x7f54900c8010 msgr2=0x7f549013aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 shutdown_connections 2024-01-21T21:33:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.469+0000 7f5494ee4700 1 -- 172.21.15.133:0/1461039988 wait complete. 2024-01-21T21:33:44.474 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-21T21:33:44.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-21T21:33:44.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.599+0000 7fc28a3c4700 1 Processor -- start 2024-01-21T21:33:44.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.599+0000 7fc28a3c4700 1 -- start start 2024-01-21T21:33:44.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc28a3c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2841546b0 0x7fc284154a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc28a3c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 0x7fc2840bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc28a3c4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840654f0 con 0x7fc284065980 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc28a3c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc284063700 con 0x7fc2841546b0 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc28a3c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc284063950 con 0x7fc2840a9e30 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc283fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2841546b0 0x7fc284154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc283fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2841546b0 0x7fc284154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53782/0 (socket says 172.21.15.133:53782) 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc283fff700 1 -- 172.21.15.133:0/3757245270 learned_addr learned my addr 172.21.15.133:0/3757245270 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.600+0000 7fc288961700 1 --1- 172.21.15.133:0/3757245270 >> v1:172.21.15.133:6789/0 conn(0x7fc284065980 0x7fc284065e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37244/0 (socket says 172.21.15.133:37244) 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc2837fe700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 0x7fc2840bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc283fff700 1 -- 172.21.15.133:0/3757245270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 msgr2=0x7fc2840bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc283fff700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 0x7fc2840bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc283fff700 1 -- 172.21.15.133:0/3757245270 >> v1:172.21.15.133:6789/0 conn(0x7fc284065980 legacy=0x7fc284065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc283fff700 1 -- 172.21.15.133:0/3757245270 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284065180 con 0x7fc2841546b0 2024-01-21T21:33:44.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc2837fe700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 0x7fc2840bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc283fff700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2841546b0 0x7fc284154a90 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7fc26c006fd0 tx=0x7fc26c0090f0).ready entity=mon.0 client_cookie=5c6ff4b90298cde4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc282ffd700 1 -- 172.21.15.133:0/3757245270 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00b600 con 0x7fc2841546b0 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc282ffd700 1 -- 172.21.15.133:0/3757245270 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c00b760 con 0x7fc2841546b0 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc282ffd700 1 -- 172.21.15.133:0/3757245270 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c00bb00 con 0x7fc2841546b0 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3757245270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2841546b0 msgr2=0x7fc284154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2841546b0 0x7fc284154a90 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 rx=0x7fc26c006fd0 tx=0x7fc26c0090f0).stop 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3757245270 shutdown_connections 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2841546b0 0x7fc284154a90 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3757245270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2840a9e30 0x7fc2840bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.601+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3757245270 >> 172.21.15.133:0/3757245270 conn(0x7fc2840c8200 msgr2=0x7fc2840c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.602+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3757245270 shutdown_connections 2024-01-21T21:33:44.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.602+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3757245270 wait complete. 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.603+0000 7fc28a3c4700 1 Processor -- start 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.603+0000 7fc28a3c4700 1 -- start start 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc284065980 0x7fc28413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 0x7fc28414cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28413d3b0 con 0x7fc2840a9e30 2024-01-21T21:33:44.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840ab610 con 0x7fc284065980 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840aa720 con 0x7fc2841546b0 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53788/0 (socket says 172.21.15.133:53788) 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 -- 172.21.15.133:0/3301323702 learned_addr learned my addr 172.21.15.133:0/3301323702 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc288961700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 0x7fc28414cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc283fff700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc284065980 0x7fc28413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 -- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 msgr2=0x7fc28414cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 0x7fc28414cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 -- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc284065980 msgr2=0x7fc28413cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc284065980 0x7fc28413cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 -- 172.21.15.133:0/3301323702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009370 con 0x7fc2840a9e30 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc288961700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 0x7fc28414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc2837fe700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7fc27400d890 tx=0x7fc274008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:44.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274011590 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2740116f0 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2840aaa00 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274011a70 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.604+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2840aafc0 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.605+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2840ac7a0 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.606+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 107) v1 ==== 75270+0+0 (secure 0 0 0) 0x7fc27401c460 con 0x7fc2840a9e30 2024-01-21T21:33:44.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.607+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 7306+0+0 (secure 0 0 0) 0x7fc27407ab80 con 0x7fc2840a9e30 2024-01-21T21:33:44.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.611+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc27404ba90 con 0x7fc2840a9e30 2024-01-21T21:33:44.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:44.822+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc2840ac7a0 con 0x7fc2840a9e30 2024-01-21T21:33:45.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.060+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 108) v1 ==== 75340+0+0 (secure 0 0 0) 0x7fc2740785f0 con 0x7fc2840a9e30 2024-01-21T21:33:45.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.060+0000 7fc280ff9700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 0x7fc264068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.060+0000 7fc283fff700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 0x7fc264068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.061+0000 7fc283fff700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 0x7fc264068280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc26c00b3c0 tx=0x7fc26c017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:45.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.473+0000 7fc280ff9700 1 -- 172.21.15.133:0/3301323702 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc274072340 con 0x7fc2840a9e30 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 msgr2=0x7fc264068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 0x7fc264068280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc26c00b3c0 tx=0x7fc26c017000).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 msgr2=0x7fc2840a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7fc27400d890 tx=0x7fc274008040).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 shutdown_connections 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2841546b0 0x7fc28414cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc2640302f0 0x7fc264068280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc284065980 0x7fc28413cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 --2- 172.21.15.133:0/3301323702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2840a9e30 0x7fc2840a8ec0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 >> 172.21.15.133:0/3301323702 conn(0x7fc2840c8200 msgr2=0x7fc2840bd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:45.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 shutdown_connections 2024-01-21T21:33:45.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.475+0000 7fc28a3c4700 1 -- 172.21.15.133:0/3301323702 wait complete. 2024-01-21T21:33:45.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-21T21:33:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.608+0000 7f3caed04700 1 Processor -- start 2024-01-21T21:33:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.608+0000 7f3caed04700 1 -- start start 2024-01-21T21:33:45.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3caed04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ca8069c20 0x7f3ca81511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3caed04700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80be2b0 con 0x7f3ca8150de0 2024-01-21T21:33:45.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3caed04700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80be740 con 0x7f3ca80bd130 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3caed04700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80bd6a0 con 0x7f3ca8069c20 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3cacaa0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3ca8150de0 0x7f3ca80c3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37258/0 (socket says 172.21.15.133:37258) 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3cacaa0700 1 -- 172.21.15.133:0/2283606208 learned_addr learned my addr 172.21.15.133:0/2283606208 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111031004 0 0) 0x7f3ca80be2b0 con 0x7f3ca8150de0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/2283606208 >> v2:172.21.15.178:3300/0 conn(0x7f3ca8069c20 0x7f3ca81511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c980033f0 con 0x7f3ca8150de0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986214627 0 0) 0x7f3c980033f0 con 0x7f3ca8150de0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 >> v2:172.21.15.178:3300/0 conn(0x7f3ca8069c20 msgr2=0x7f3ca81511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 --2- 172.21.15.133:0/2283606208 >> v2:172.21.15.178:3300/0 conn(0x7f3ca8069c20 0x7f3ca81511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 >> v1:172.21.15.178:6789/0 conn(0x7f3ca80bd130 legacy=0x7f3ca8069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80bd980 con 0x7f3ca8150de0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f3c9c001470 con 0x7f3ca8150de0 2024-01-21T21:33:45.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 >> v1:172.21.15.133:6789/0 conn(0x7f3ca8150de0 legacy=0x7f3ca80c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c980038e0 0x7f3c98003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98004690 0x7f3c98004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 0x7f3c9800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80bd6a0 con 0x7f3c98005000 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.609+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9800bf60 con 0x7f3c98004690 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9800c0f0 con 0x7f3c980038e0 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 0x7f3c9800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cacaa0700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c980038e0 0x7f3c98003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3ca7fff700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98004690 0x7f3c98004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 -- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c980038e0 msgr2=0x7f3c98003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c980038e0 0x7f3c98003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 -- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98004690 msgr2=0x7f3c98004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:45.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98004690 0x7f3c98004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 -- 172.21.15.133:0/2283606208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c980033f0 con 0x7f3c98005000 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 -- 172.21.15.133:0/2283606208 reap_dead start 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 0x7f3c9800b8e0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f3ca806a020 tx=0x7f3ca000b040).ready entity=mon.0 client_cookie=b7c217b870410e83 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0009ac0 con 0x7f3c98005000 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000f040 con 0x7f3c98005000 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.610+0000 7f3ca77fe700 1 -- 172.21.15.133:0/2283606208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000ece0 con 0x7f3c98005000 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 -- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 msgr2=0x7f3c9800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 0x7f3c9800b8e0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 rx=0x7f3ca806a020 tx=0x7f3ca000b040).stop 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 -- 172.21.15.133:0/2283606208 shutdown_connections 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 --2- 172.21.15.133:0/2283606208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c98005000 0x7f3c9800b8e0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 -- 172.21.15.133:0/2283606208 >> 172.21.15.133:0/2283606208 conn(0x7f3ca80c7d30 msgr2=0x7f3ca80c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 -- 172.21.15.133:0/2283606208 shutdown_connections 2024-01-21T21:33:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.611+0000 7f3caed04700 1 -- 172.21.15.133:0/2283606208 wait complete. 2024-01-21T21:33:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.612+0000 7f3caed04700 1 Processor -- start 2024-01-21T21:33:45.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.612+0000 7f3caed04700 1 -- start start 2024-01-21T21:33:45.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98005000 0x7f3ca81661f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 0x7f3ca80c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8162250 con 0x7f3ca8162f40 2024-01-21T21:33:45.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80a7d20 con 0x7f3c98005000 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3caed04700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8162460 con 0x7f3ca813caa0 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53808/0 (socket says 172.21.15.133:53808) 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 -- 172.21.15.133:0/4260486353 learned_addr learned my addr 172.21.15.133:0/4260486353 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3cacaa0700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98005000 0x7f3ca81661f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 0x7f3ca80c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 -- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 msgr2=0x7f3ca80c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 0x7f3ca80c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 -- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98005000 msgr2=0x7f3ca81661f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98005000 0x7f3ca81661f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 -- 172.21.15.133:0/4260486353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca8162740 con 0x7f3ca8162f40 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3cad2a1700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 0x7f3ca80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:45.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.613+0000 7f3ca7fff700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f3c94003f10 tx=0x7f3c94007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.614+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011590 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.614+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940116f0 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.614+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8162a20 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.614+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94011a70 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.614+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca80a77d0 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.615+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca805fdf0 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.615+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 108) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f3c940133f0 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.615+0000 7f3ca57fa700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 0x7f3c8c0614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.615+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 7306+0+0 (secure 0 0 0) 0x7f3c94079df0 con 0x7f3ca8162f40 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.615+0000 7f3cacaa0700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 0x7f3c8c0614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:45.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.616+0000 7f3cacaa0700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 0x7f3c8c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3ca814e270 tx=0x7f3c9c001e50).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:45.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.620+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f3c94049b00 con 0x7f3ca8162f40 2024-01-21T21:33:45.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:45.784+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3ca80bdc60 con 0x7f3ca8162f40 2024-01-21T21:33:46.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.475+0000 7f3ca57fa700 1 -- 172.21.15.133:0/4260486353 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v211) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3c9404e870 con 0x7f3ca8162f40 2024-01-21T21:33:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 msgr2=0x7f3c8c0614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 0x7f3c8c0614f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f3ca814e270 tx=0x7f3c9c001e50).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 msgr2=0x7f3ca813c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7f3c94003f10 tx=0x7f3c94007bb0).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 shutdown_connections 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ca813caa0 0x7f3ca80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f3c8c05f030 0x7f3c8c0614f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c98005000 0x7f3ca81661f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 --2- 172.21.15.133:0/4260486353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ca8162f40 0x7f3ca813c5b0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.482+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 >> 172.21.15.133:0/4260486353 conn(0x7f3ca80c7d30 msgr2=0x7f3ca8151700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.483+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 shutdown_connections 2024-01-21T21:33:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.483+0000 7f3caed04700 1 -- 172.21.15.133:0/4260486353 wait complete. 2024-01-21T21:33:46.487 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2024-01-21T21:33:46.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-21T21:33:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.617+0000 7f6a11ddd700 1 Processor -- start 2024-01-21T21:33:46.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.617+0000 7f6a11ddd700 1 -- start start 2024-01-21T21:33:46.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a11ddd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a0c0bcc80 0x7f6a0c13a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a11ddd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c0626f0 0x7f6a0c062b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a11ddd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c063070 con 0x7f6a0c13a580 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a11ddd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c0bd220 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a11ddd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c065430 con 0x7f6a0c0626f0 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a0b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a0c13a580 0x7f6a0c1587e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37272/0 (socket says 172.21.15.133:37272) 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2219033247 >> v2:172.21.15.133:3300/0 conn(0x7f6a0c0bcc80 0x7f6a0c13a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a0b7fe700 1 -- 172.21.15.133:0/2219033247 learned_addr learned my addr 172.21.15.133:0/2219033247 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.618+0000 7f6a0bfff700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c0626f0 0x7f6a0c062b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0affd700 1 -- 172.21.15.133:0/2219033247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c0626f0 msgr2=0x7f6a0c062b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c0626f0 0x7f6a0c062b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0affd700 1 -- 172.21.15.133:0/2219033247 >> v1:172.21.15.133:6789/0 conn(0x7f6a0c13a580 legacy=0x7f6a0c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0affd700 1 -- 172.21.15.133:0/2219033247 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c065710 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0a7fc700 1 -- 172.21.15.133:0/2219033247 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564264972 0 0) 0x7f6a0c063070 con 0x7f6a0c13a580 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c13a960 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f69fc009760 tx=0x7f69fc009060).ready entity=mon.0 client_cookie=6237cc137190637b server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0a7fc700 1 -- 172.21.15.133:0/2219033247 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00b580 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0a7fc700 1 -- 172.21.15.133:0/2219033247 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc00b6e0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a0a7fc700 1 -- 172.21.15.133:0/2219033247 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00ba60 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2219033247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 msgr2=0x7f6a0c13a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c13a960 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f69fc009760 tx=0x7f69fc009060).stop 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2219033247 shutdown_connections 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c0626f0 0x7f6a0c062b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2219033247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c13a960 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2219033247 >> 172.21.15.133:0/2219033247 conn(0x7f6a0c0c7d20 msgr2=0x7f6a0c0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2219033247 shutdown_connections 2024-01-21T21:33:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.619+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2219033247 wait complete. 2024-01-21T21:33:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.621+0000 7f6a11ddd700 1 Processor -- start 2024-01-21T21:33:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.621+0000 7f6a11ddd700 1 -- start start 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 0x7f6a0c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c13a580 0x7f6a0c0a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a6280 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a9be0 con 0x7f6a0c0626f0 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a11ddd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0a8fd0 con 0x7f6a0c13a580 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53818/0 (socket says 172.21.15.133:53818) 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 -- 172.21.15.133:0/2682780900 learned_addr learned my addr 172.21.15.133:0/2682780900 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0bfff700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c13a580 0x7f6a0c0a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0b7fe700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 0x7f6a0c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 -- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c13a580 msgr2=0x7f6a0c0a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c13a580 0x7f6a0c0a5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 -- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 msgr2=0x7f6a0c1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 0x7f6a0c1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0affd700 1 -- 172.21.15.133:0/2682780900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0092a0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.622+0000 7f6a0b7fe700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 0x7f6a0c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f6a0affd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f69fc009eb0 tx=0x7f69fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc00b850 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc00b9b0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0c0a92b0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc01b690 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.623+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0a9870 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.624+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c05fdf0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.624+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 108) v1 ==== 75340+0+0 (secure 0 0 0) 0x7f69fc01ba00 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.624+0000 7f69f3fff700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 0x7f69f80614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.624+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6868+0+0 (secure 0 0 0) 0x7f69fc07bc10 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.625+0000 7f6a0b7fe700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 0x7f69f80614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.625+0000 7f6a0b7fe700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 0x7f69f80614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6a000011e0 tx=0x7f6a00009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.628+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f69fc04cdc0 con 0x7f6a0c0bcc80 2024-01-21T21:33:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:46.791+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a0c0a72f0 con 0x7f6a0c0bcc80 2024-01-21T21:33:47.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.063+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f69fc0aab00 con 0x7f6a0c0bcc80 2024-01-21T21:33:47.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.479+0000 7f69f3fff700 1 -- 172.21.15.133:0/2682780900 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v212) v1 ==== 169+0+0 (secure 0 0 0) 0x7f69fc0416f0 con 0x7f6a0c0bcc80 2024-01-21T21:33:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 msgr2=0x7f69f80614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 0x7f69f80614f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6a000011e0 tx=0x7f6a00009040).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 msgr2=0x7f6a0c0a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f69fc009eb0 tx=0x7f69fc017000).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 shutdown_connections 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a0c13a580 0x7f6a0c0a5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f69f805f030 0x7f69f80614f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a0c0626f0 0x7f6a0c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 --2- 172.21.15.133:0/2682780900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a0c0bcc80 0x7f6a0c0a58a0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 >> 172.21.15.133:0/2682780900 conn(0x7f6a0c0c7d20 msgr2=0x7f6a0c152d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 shutdown_connections 2024-01-21T21:33:47.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.482+0000 7f6a11ddd700 1 -- 172.21.15.133:0/2682780900 wait complete. 2024-01-21T21:33:47.486 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2024-01-21T21:33:47.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-21T21:33:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.621+0000 7ff8bb446700 1 Processor -- start 2024-01-21T21:33:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.621+0000 7ff8bb446700 1 -- start start 2024-01-21T21:33:47.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 0x7ff8b40be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b40be5f0 0x7ff8b40c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40bfa40 con 0x7ff8b40be5f0 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b40c3e70 con 0x7ff8b40c39f0 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8bb446700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40bee30 con 0x7ff8b413b970 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8b99e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b40be5f0 0x7ff8b40c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.622+0000 7ff8b99e3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8b40be5f0 0x7ff8b40c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53832/0 (socket says 172.21.15.133:53832) 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 -- 172.21.15.133:0/647756748 learned_addr learned my addr 172.21.15.133:0/647756748 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/647756748 >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 0x7ff8b40be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b91e2700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 -- 172.21.15.133:0/647756748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 msgr2=0x7ff8b40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 -- 172.21.15.133:0/647756748 >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 msgr2=0x7ff8b40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 --2- 172.21.15.133:0/647756748 >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 0x7ff8b40be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 -- 172.21.15.133:0/647756748 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40bf110 con 0x7ff8b40be5f0 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b91e2700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/647756748 >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 0x7ff8b40be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8b99e3700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c5480 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7ff8b406a500 tx=0x7ff8ac009840).ready entity=mon.0 client_cookie=b34303539c1575b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8abfff700 1 -- 172.21.15.133:0/647756748 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00e070 con 0x7ff8b40be5f0 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8abfff700 1 -- 172.21.15.133:0/647756748 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac00ba50 con 0x7ff8b40be5f0 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.623+0000 7ff8abfff700 1 -- 172.21.15.133:0/647756748 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac00bdd0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 -- 172.21.15.133:0/647756748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 msgr2=0x7ff8b40c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c5480 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7ff8b406a500 tx=0x7ff8ac009840).stop 2024-01-21T21:33:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 -- 172.21.15.133:0/647756748 shutdown_connections 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c5480 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 --2- 172.21.15.133:0/647756748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 --2- 172.21.15.133:0/647756748 >> v2:172.21.15.178:3300/0 conn(0x7ff8b40c39f0 0x7ff8b40be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 -- 172.21.15.133:0/647756748 >> 172.21.15.133:0/647756748 conn(0x7ff8b4066a70 msgr2=0x7ff8b4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 -- 172.21.15.133:0/647756748 shutdown_connections 2024-01-21T21:33:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.624+0000 7ff8bb446700 1 -- 172.21.15.133:0/647756748 wait complete. 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.625+0000 7ff8bb446700 1 Processor -- start 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.625+0000 7ff8bb446700 1 -- start start 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 0x7ff8b4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c0fb0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40bffa0 con 0x7ff8b40c39f0 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c0b20 con 0x7ff8b413b970 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53834/0 (socket says 172.21.15.133:53834) 2024-01-21T21:33:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 -- 172.21.15.133:0/1178429428 learned_addr learned my addr 172.21.15.133:0/1178429428 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 0x7ff8b4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b99e3700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 -- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 msgr2=0x7ff8b40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 -- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 msgr2=0x7ff8b4133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 0x7ff8b4133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 -- 172.21.15.133:0/1178429428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac009ae0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b99e3700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 0x7ff8b4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8b91e2700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7ff8a400c880 tx=0x7ff8a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4010580 con 0x7ff8b40be5f0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a40106e0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b40c01f0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.626+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4010a60 con 0x7ff8b40be5f0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.627+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40c07b0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.628+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b405fdf0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.628+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff8a401b460 con 0x7ff8b40be5f0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.628+0000 7ff8a9ffb700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 0x7ff898061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.628+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7ff8a407a330 con 0x7ff8b40be5f0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.628+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 0x7ff898061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.629+0000 7ff8b89e1700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 0x7ff898061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff8b41523c0 tx=0x7ff8b0008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.632+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff8a404b450 con 0x7ff8b40be5f0 2024-01-21T21:33:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.797+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff8b40bf3f0 con 0x7ff8b40be5f0 2024-01-21T21:33:47.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.800+0000 7ff8a9ffb700 1 -- 172.21.15.133:0/1178429428 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff8a404ea70 con 0x7ff8b40be5f0 2024-01-21T21:33:47.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 msgr2=0x7ff898061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 0x7ff898061610 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff8b41523c0 tx=0x7ff8b0008040).stop 2024-01-21T21:33:47.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 msgr2=0x7ff8b40c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 rx=0x7ff8a400c880 tx=0x7ff8a4008040).stop 2024-01-21T21:33:47.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 shutdown_connections 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8b413b970 0x7ff8b40c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b40be5f0 0x7ff8b40c2c50 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff89805f150 0x7ff898061610 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 --2- 172.21.15.133:0/1178429428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8b40c39f0 0x7ff8b4133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 >> 172.21.15.133:0/1178429428 conn(0x7ff8b4066a70 msgr2=0x7ff8b40acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 shutdown_connections 2024-01-21T21:33:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.802+0000 7ff8bb446700 1 -- 172.21.15.133:0/1178429428 wait complete. 2024-01-21T21:33:47.817 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-01-21T21:33:47.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.932+0000 7f7eed6d2700 1 Processor -- start 2024-01-21T21:33:47.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.932+0000 7f7eed6d2700 1 -- start start 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7eed6d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ee80bf780 0x7f7ee80c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7eed6d2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee8152f70 0x7f7ee80c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7eed6d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee8068760 con 0x7f7ee80bfb60 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7eed6d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee81533d0 con 0x7f7ee80bf780 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7eed6d2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80c3ee0 con 0x7f7ee8152f70 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7ee6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ee80bf780 0x7f7ee80c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7ee67fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ee80bfb60 0x7f7ee8152860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37286/0 (socket says 172.21.15.133:37286) 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.933+0000 7f7ee67fc700 1 -- 172.21.15.133:0/647663049 learned_addr learned my addr 172.21.15.133:0/647663049 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee77fe700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee8152f70 0x7f7ee80c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee6ffd700 1 -- 172.21.15.133:0/647663049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee8152f70 msgr2=0x7f7ee80c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee8152f70 0x7f7ee80c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee6ffd700 1 -- 172.21.15.133:0/647663049 >> v1:172.21.15.133:6789/0 conn(0x7f7ee80bfb60 legacy=0x7f7ee8152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee6ffd700 1 -- 172.21.15.133:0/647663049 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee81535d0 con 0x7f7ee80bf780 2024-01-21T21:33:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee5ffb700 1 -- 172.21.15.133:0/647663049 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368795380 0 0) 0x7f7ee8068760 con 0x7f7ee80bfb60 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee80bf780 0x7f7ee80c3500 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f7edc009790 tx=0x7f7edc009060).ready entity=mon.0 client_cookie=b02093d3151275d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee5ffb700 1 -- 172.21.15.133:0/647663049 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0090d0 con 0x7f7ee80bf780 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee5ffb700 1 -- 172.21.15.133:0/647663049 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc00f510 con 0x7f7ee80bf780 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7ee5ffb700 1 -- 172.21.15.133:0/647663049 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc00f890 con 0x7f7ee80bf780 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7eed6d2700 1 -- 172.21.15.133:0/647663049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee80bf780 msgr2=0x7f7ee80c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.934+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee80bf780 0x7f7ee80c3500 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7f7edc009790 tx=0x7f7edc009060).stop 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 -- 172.21.15.133:0/647663049 shutdown_connections 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee8152f70 0x7f7ee80c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/647663049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee80bf780 0x7f7ee80c3500 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 -- 172.21.15.133:0/647663049 >> 172.21.15.133:0/647663049 conn(0x7f7ee8066a90 msgr2=0x7f7ee8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 -- 172.21.15.133:0/647663049 shutdown_connections 2024-01-21T21:33:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.935+0000 7f7eed6d2700 1 -- 172.21.15.133:0/647663049 wait complete. 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.936+0000 7f7eed6d2700 1 Processor -- start 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.936+0000 7f7eed6d2700 1 -- start start 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 0x7f7ee8165990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 0x7f7ee8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee814cef0 con 0x7f7ee8152f70 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8164f40 con 0x7f7ee80bfb60 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8165500 con 0x7f7ee80bf780 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53852/0 (socket says 172.21.15.133:53852) 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 -- 172.21.15.133:0/1125765341 learned_addr learned my addr 172.21.15.133:0/1125765341 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 0x7f7ee8165990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee67fc700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 0x7f7ee8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 -- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 msgr2=0x7f7ee8165990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 0x7f7ee8165990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 -- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 msgr2=0x7f7ee8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 0x7f7ee8156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 -- 172.21.15.133:0/1125765341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0092a0 con 0x7f7ee8152f70 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 0x7f7ee8165990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee67fc700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 0x7f7ee8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:47.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ee77fe700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7ee0009df0 tx=0x7f7ee000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000cb50 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000f040 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee81623e0 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000cec0 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.937+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8165190 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7ee0013610 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee8165670 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7ecf7fe700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 0x7f7ed4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f7ee007ab70 con 0x7f7ee8152f70 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 0x7f7ed4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:47.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.939+0000 7f7ee6ffd700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 0x7f7ed4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7edc009790 tx=0x7f7edc017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:47.943+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7ee004bcf0 con 0x7f7ee8152f70 2024-01-21T21:33:48.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.105+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7ee805fdf0 con 0x7f7ee8152f70 2024-01-21T21:33:48.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.109+0000 7f7ecf7fe700 1 -- 172.21.15.133:0/1125765341 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v45) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7ee004f310 con 0x7f7ee8152f70 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 msgr2=0x7f7ed4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 0x7f7ed4061610 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7edc009790 tx=0x7f7edc017000).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 msgr2=0x7f7ee8161990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f7ee0009df0 tx=0x7f7ee000b040).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 shutdown_connections 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ee8152f70 0x7f7ee8161990 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ee80bf780 0x7f7ee8165990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7ed405f150 0x7f7ed4061610 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 --2- 172.21.15.133:0/1125765341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ee80bfb60 0x7f7ee8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 >> 172.21.15.133:0/1125765341 conn(0x7f7ee8066a90 msgr2=0x7f7ee80bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 shutdown_connections 2024-01-21T21:33:48.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.111+0000 7f7eed6d2700 1 -- 172.21.15.133:0/1125765341 wait complete. 2024-01-21T21:33:48.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-01-21T21:33:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.239+0000 7f91bd28b700 1 Processor -- start 2024-01-21T21:33:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.239+0000 7f91bd28b700 1 -- start start 2024-01-21T21:33:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91bd28b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91b80c77b0 0x7f91b80c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91bd28b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 0x7f91b80c0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91bd28b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b80c89d0 con 0x7f91b81545a0 2024-01-21T21:33:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91bd28b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b80c6a00 con 0x7f91b80c77b0 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91bd28b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80c7dc0 con 0x7f91b80c6590 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91b80c77b0 0x7f91b80c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f91b80c77b0 0x7f91b80c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53858/0 (socket says 172.21.15.133:53858) 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 -- 172.21.15.133:0/193396818 learned_addr learned my addr 172.21.15.133:0/193396818 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 -- 172.21.15.133:0/193396818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 msgr2=0x7f91b80c0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b77fe700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 0x7f91b80c0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 0x7f91b80c0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 -- 172.21.15.133:0/193396818 >> v1:172.21.15.178:6789/0 conn(0x7f91b81545a0 legacy=0x7f91b80aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 -- 172.21.15.133:0/193396818 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80c80a0 con 0x7f91b80c77b0 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b77fe700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 0x7f91b80c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.240+0000 7f91b67fc700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c77b0 0x7f91b80c60a0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f91a8006fd0 tx=0x7f91a80090f0).ready entity=mon.0 client_cookie=856081b270462974 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91b5ffb700 1 -- 172.21.15.133:0/193396818 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800b600 con 0x7f91b80c77b0 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91b5ffb700 1 -- 172.21.15.133:0/193396818 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a800b760 con 0x7f91b80c77b0 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91b5ffb700 1 -- 172.21.15.133:0/193396818 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a800bb00 con 0x7f91b80c77b0 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 -- 172.21.15.133:0/193396818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c77b0 msgr2=0x7f91b80c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c77b0 0x7f91b80c60a0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f91a8006fd0 tx=0x7f91a80090f0).stop 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 -- 172.21.15.133:0/193396818 shutdown_connections 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b80c6590 0x7f91b80c0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 --2- 172.21.15.133:0/193396818 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c77b0 0x7f91b80c60a0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 -- 172.21.15.133:0/193396818 >> 172.21.15.133:0/193396818 conn(0x7f91b80649d0 msgr2=0x7f91b8064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 -- 172.21.15.133:0/193396818 shutdown_connections 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.241+0000 7f91bd28b700 1 -- 172.21.15.133:0/193396818 wait complete. 2024-01-21T21:33:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.242+0000 7f91bd28b700 1 Processor -- start 2024-01-21T21:33:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 -- start start 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 0x7f91b80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b81545a0 0x7f91b80ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8157840 con 0x7f91b80c6590 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8167fc0 con 0x7f91b80c77b0 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91bd28b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8168210 con 0x7f91b81545a0 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91b6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91b6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53864/0 (socket says 172.21.15.133:53864) 2024-01-21T21:33:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.243+0000 7f91b6ffd700 1 -- 172.21.15.133:0/1379338143 learned_addr learned my addr 172.21.15.133:0/1379338143 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b67fc700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 0x7f91b80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b77fe700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b81545a0 0x7f91b80ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 -- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b81545a0 msgr2=0x7f91b80ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b81545a0 0x7f91b80ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 -- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 msgr2=0x7f91b80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 0x7f91b80aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 -- 172.21.15.133:0/1379338143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009370 con 0x7f91b80c6590 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b67fc700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 0x7f91b80aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91b6ffd700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7f91ac00c440 tx=0x7f91ac007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00f470 con 0x7f91b80c6590 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00f5f0 con 0x7f91b80c6590 2024-01-21T21:33:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b81684f0 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00f9b0 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.244+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b8168ab0 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.245+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b805fdf0 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.245+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f91ac012400 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.246+0000 7f919f7fe700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 0x7f91a4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.246+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f91ac0797e0 con 0x7f91b80c6590 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.246+0000 7f91b67fc700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 0x7f91a4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.246+0000 7f91b67fc700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 0x7f91a4061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f91b80c42c0 tx=0x7f91a8017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.250+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f91ac048b00 con 0x7f91b80c6590 2024-01-21T21:33:48.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.476+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f91b80c8380 con 0x7f91b80c6590 2024-01-21T21:33:48.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.486+0000 7f919f7fe700 1 -- 172.21.15.133:0/1379338143 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3049) v1 ==== 155+0+0 (secure 0 0 0) 0x7f91ac04a9b0 con 0x7f91b80c6590 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 msgr2=0x7f91a4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 0x7f91a4061610 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f91b80c42c0 tx=0x7f91a8017000).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 msgr2=0x7f91b80aea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 rx=0x7f91ac00c440 tx=0x7f91ac007de0).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 shutdown_connections 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91b81545a0 0x7f91b80ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91b80c6590 0x7f91b80aea50 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f91a405f150 0x7f91a4061610 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 --2- 172.21.15.133:0/1379338143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91b80c77b0 0x7f91b80aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:48.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 >> 172.21.15.133:0/1379338143 conn(0x7f91b80649d0 msgr2=0x7f91b80abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 shutdown_connections 2024-01-21T21:33:48.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:48.488+0000 7f91bd28b700 1 -- 172.21.15.133:0/1379338143 wait complete. 2024-01-21T21:33:48.503 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2024-01-21T21:33:48.503 INFO:tasks.cephfs_test_runner: 2024-01-21T21:33:48.503 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-21T21:33:48.503 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5649.523s 2024-01-21T21:33:48.504 INFO:tasks.cephfs_test_runner: 2024-01-21T21:33:48.504 INFO:tasks.cephfs_test_runner:OK 2024-01-21T21:33:48.504 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-21T21:33:48.513 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-21T21:33:48.553 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-21T21:33:48.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.554 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:33:48.572 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-01-21T21:33:48.572 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-21T21:33:48.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.573 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-01-21T21:33:48.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.654 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-21T21:33:48.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-21T21:33:48.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.816 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2024-01-21T21:33:48.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2024-01-21T21:33:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2024-01-21T21:33:48.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:33:48.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.907 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T21:33:48.928 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-01-21T21:33:48.929 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-21T21:33:48.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:48.929 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-01-21T21:33:49.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:49.009 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-21T21:33:49.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:49.101 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-01-21T21:33:49.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:49.187 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-01-21T21:33:49.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-21T21:33:49.207 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-01-21T21:33:49.279 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-01-21T21:33:49.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:33:49.281 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-21T21:33:49.291 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-01-21T21:33:49.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.407+0000 7fa68aa43700 1 Processor -- start 2024-01-21T21:33:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.407+0000 7fa68aa43700 1 -- start start 2024-01-21T21:33:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa68aa43700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6840bcc80 0x7fa6840a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa68aa43700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6840a4280 0x7fa68406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa68aa43700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa684065000 con 0x7fa6840bc8a0 2024-01-21T21:33:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa68aa43700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840a46e0 con 0x7fa6840bcc80 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa68aa43700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa684069540 con 0x7fa6840a4280 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6840bcc80 0x7fa6840a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6840bcc80 0x7fa6840a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53866/0 (socket says 172.21.15.133:53866) 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 -- 172.21.15.133:0/391743689 learned_addr learned my addr 172.21.15.133:0/391743689 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa688fe0700 1 --2- 172.21.15.133:0/391743689 >> v2:172.21.15.178:3300/0 conn(0x7fa6840a4280 0x7fa68406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 -- 172.21.15.133:0/391743689 >> v2:172.21.15.178:3300/0 conn(0x7fa6840a4280 msgr2=0x7fa68406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 --2- 172.21.15.133:0/391743689 >> v2:172.21.15.178:3300/0 conn(0x7fa6840a4280 0x7fa68406a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 -- 172.21.15.133:0/391743689 >> v1:172.21.15.178:6789/0 conn(0x7fa6840bc8a0 legacy=0x7fa684065490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 -- 172.21.15.133:0/391743689 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684064410 con 0x7fa6840bcc80 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.408+0000 7fa6837fe700 1 --2- 172.21.15.133:0/391743689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a3d90 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7fa6840a9bf0 tx=0x7fa66c0090f0).ready entity=mon.0 client_cookie=1175a651401e1b9f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa682ffd700 1 -- 172.21.15.133:0/391743689 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00b5a0 con 0x7fa6840bcc80 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa682ffd700 1 -- 172.21.15.133:0/391743689 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00b700 con 0x7fa6840bcc80 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa682ffd700 1 -- 172.21.15.133:0/391743689 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00baa0 con 0x7fa6840bcc80 2024-01-21T21:33:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 -- 172.21.15.133:0/391743689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 msgr2=0x7fa6840a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 --2- 172.21.15.133:0/391743689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a3d90 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7fa6840a9bf0 tx=0x7fa66c0090f0).stop 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 -- 172.21.15.133:0/391743689 shutdown_connections 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 --2- 172.21.15.133:0/391743689 >> v2:172.21.15.178:3300/0 conn(0x7fa6840a4280 0x7fa68406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 --2- 172.21.15.133:0/391743689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a3d90 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 -- 172.21.15.133:0/391743689 >> 172.21.15.133:0/391743689 conn(0x7fa6840c6ef0 msgr2=0x7fa6840c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 -- 172.21.15.133:0/391743689 shutdown_connections 2024-01-21T21:33:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.409+0000 7fa68aa43700 1 -- 172.21.15.133:0/391743689 wait complete. 2024-01-21T21:33:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.410+0000 7fa68aa43700 1 Processor -- start 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 -- start start 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840a4280 0x7fa6840c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840bc8a0 0x7fa68414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c2b90 con 0x7fa6840bcc80 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684165690 con 0x7fa6840bc8a0 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.411+0000 7fa68aa43700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c2540 con 0x7fa6840a4280 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53882/0 (socket says 172.21.15.133:53882) 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 -- 172.21.15.133:0/3316290271 learned_addr learned my addr 172.21.15.133:0/3316290271 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa6837fe700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840bc8a0 0x7fa68414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa683fff700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840a4280 0x7fa6840c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 -- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840a4280 msgr2=0x7fa6840c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840a4280 0x7fa6840c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 -- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840bc8a0 msgr2=0x7fa68414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840bc8a0 0x7fa68414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 -- 172.21.15.133:0/3316290271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009370 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa688fe0700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7fa67c009fa0 tx=0x7fa67c009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00ebc0 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c00ed20 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6840c2820 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c014610 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.412+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684150160 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.413+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6840c23a0 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.414+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fa67c01d3b0 con 0x7fa6840bcc80 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.414+0000 7fa680ff9700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 0x7fa664061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.414+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fa67c07a780 con 0x7fa6840bcc80 2024-01-21T21:33:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.414+0000 7fa683fff700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 0x7fa664061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.414+0000 7fa683fff700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 0x7fa664061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa6740038b0 tx=0x7fa674007d20).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.418+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fa6840c23a0 con 0x7fa6840bcc80 2024-01-21T21:33:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.586+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6840c23a0 con 0x7fa6840bcc80 2024-01-21T21:33:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.587+0000 7fa680ff9700 1 -- 172.21.15.133:0/3316290271 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+15554 (secure 0 0 0) 0x7fa6840c23a0 con 0x7fa6840bcc80 2024-01-21T21:33:49.592 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:49.592 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":212,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:47.473819+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/1514923135":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/1450506345":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/1911649568":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/184881117":"2024-01-22T21:33:44.049782+0000","172.21.15.178:6835/2870485430":"2024-01-22T21:33:43.893858+0000","172.21.15.178:6833/2870485430":"2024-01-22T21:33:43.893858+0000","172.21.15.133:0/1079767282":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6833/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6832/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:0/3493985817":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/912648497":"2024-01-22T21:33:36.420664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 msgr2=0x7fa664061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 0x7fa664061610 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa6740038b0 tx=0x7fa674007d20).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 msgr2=0x7fa6840a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 rx=0x7fa67c009fa0 tx=0x7fa67c009900).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 shutdown_connections 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6840bcc80 0x7fa6840a4820 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840a4280 0x7fa6840c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fa66405f150 0x7fa664061610 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 --2- 172.21.15.133:0/3316290271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840bc8a0 0x7fa68414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 >> 172.21.15.133:0/3316290271 conn(0x7fa6840c6ef0 msgr2=0x7fa6840ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 shutdown_connections 2024-01-21T21:33:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.589+0000 7fa68aa43700 1 -- 172.21.15.133:0/3316290271 wait complete. 2024-01-21T21:33:49.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-21T21:33:49.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:49.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.717+0000 7f6dc1510700 1 Processor -- start 2024-01-21T21:33:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.717+0000 7f6dc1510700 1 -- start start 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dc1510700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dbc062ff0 0x7f6dbc065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dc1510700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc069ef0 con 0x7f6dbc065b50 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dc1510700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc065fe0 con 0x7f6dbc062c10 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dc1510700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc06a130 con 0x7f6dbc062ff0 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6dbc062ff0 0x7f6dbc065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dbb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6dbc065b50 0x7f6dbc0bd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37288/0 (socket says 172.21.15.133:37288) 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dbb7fe700 1 -- 172.21.15.133:0/2347081504 learned_addr learned my addr 172.21.15.133:0/2347081504 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 --2- 172.21.15.133:0/2347081504 >> v2:172.21.15.133:3300/0 conn(0x7f6dbc062ff0 0x7f6dbc065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53888/0 (socket says 172.21.15.133:53888) 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 -- 172.21.15.133:0/2347081504 >> v1:172.21.15.178:6789/0 conn(0x7f6dbc062c10 legacy=0x7f6dbc0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 -- 172.21.15.133:0/2347081504 >> v1:172.21.15.133:6789/0 conn(0x7f6dbc065b50 legacy=0x7f6dbc0bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 -- 172.21.15.133:0/2347081504 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc06a410 con 0x7f6dbc062ff0 2024-01-21T21:33:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6db9ffb700 1 -- 172.21.15.133:0/2347081504 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757224642 0 0) 0x7f6db4001490 con 0x7f6dbc065b50 2024-01-21T21:33:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6dba7fc700 1 --2- 172.21.15.133:0/2347081504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc065660 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f6db0009760 tx=0x7f6db0009060).ready entity=mon.0 client_cookie=17fad01c4700a1f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6db9ffb700 1 -- 172.21.15.133:0/2347081504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0009120 con 0x7f6dbc062ff0 2024-01-21T21:33:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6db9ffb700 1 -- 172.21.15.133:0/2347081504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db000b580 con 0x7f6dbc062ff0 2024-01-21T21:33:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.718+0000 7f6db9ffb700 1 -- 172.21.15.133:0/2347081504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db000b900 con 0x7f6dbc062ff0 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 -- 172.21.15.133:0/2347081504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc062ff0 msgr2=0x7f6dbc065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 --2- 172.21.15.133:0/2347081504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc065660 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 rx=0x7f6db0009760 tx=0x7f6db0009060).stop 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 -- 172.21.15.133:0/2347081504 shutdown_connections 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 --2- 172.21.15.133:0/2347081504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc065660 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 -- 172.21.15.133:0/2347081504 >> 172.21.15.133:0/2347081504 conn(0x7f6dbc0c8010 msgr2=0x7f6dbc0c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 -- 172.21.15.133:0/2347081504 shutdown_connections 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.719+0000 7f6dc1510700 1 -- 172.21.15.133:0/2347081504 wait complete. 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.720+0000 7f6dc1510700 1 Processor -- start 2024-01-21T21:33:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.720+0000 7f6dc1510700 1 -- start start 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dbc062c10 0x7f6dbc139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0aafc0 con 0x7f6dbc065b50 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0ab580 con 0x7f6dbc062ff0 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dc1510700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc165450 con 0x7f6dbc062c10 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53898/0 (socket says 172.21.15.133:53898) 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 -- 172.21.15.133:0/3680450550 learned_addr learned my addr 172.21.15.133:0/3680450550 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dba7fc700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbaffd700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dbc062c10 0x7f6dbc139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 -- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dbc062c10 msgr2=0x7f6dbc139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dbc062c10 0x7f6dbc139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 -- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dbc062ff0 msgr2=0x7f6dbc0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc0a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.721+0000 7f6dbb7fe700 1 -- 172.21.15.133:0/3680450550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00092a0 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6dbb7fe700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f6db400c810 tx=0x7f6db4007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4005d30 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4005e90 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4007300 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc165730 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.722+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc0c20c0 con 0x7f6dbc065b50 2024-01-21T21:33:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.723+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc05fdf0 con 0x7f6dbc065b50 2024-01-21T21:33:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.723+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f6db40076b0 con 0x7f6dbc065b50 2024-01-21T21:33:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.724+0000 7f6da37fe700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 0x7f6da80615e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.724+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f6db4079b00 con 0x7f6dbc065b50 2024-01-21T21:33:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.724+0000 7f6dbaffd700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 0x7f6da80615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.724+0000 7f6dbaffd700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 0x7f6da80615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6dac003860 tx=0x7f6dac007d40).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.728+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f6db404ac80 con 0x7f6dbc065b50 2024-01-21T21:33:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.888+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dbc069ef0 con 0x7f6da805f120 2024-01-21T21:33:49.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.891+0000 7f6da37fe700 1 -- 172.21.15.133:0/3680450550 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71402 (secure 0 0 0) 0x7f6dbc069ef0 con 0x7f6da805f120 2024-01-21T21:33:49.894 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 msgr2=0x7f6da80615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 0x7f6da80615e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f6dac003860 tx=0x7f6dac007d40).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 msgr2=0x7f6dbc164950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f6db400c810 tx=0x7f6db4007dd0).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 shutdown_connections 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dbc065b50 0x7f6dbc164950 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dbc062c10 0x7f6dbc139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f6da805f120 0x7f6da80615e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 --2- 172.21.15.133:0/3680450550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dbc062ff0 0x7f6dbc0a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 >> 172.21.15.133:0/3680450550 conn(0x7f6dbc0c8010 msgr2=0x7f6dbc0bde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.892+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 shutdown_connections 2024-01-21T21:33:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:49.893+0000 7f6dc1510700 1 -- 172.21.15.133:0/3680450550 wait complete. 2024-01-21T21:33:49.897 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:49.907 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2024-01-21T21:33:48.063030+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2475188,"kb_used_data":20596,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499532,"statfs":{"total":773094113280,"available":770559520768,"internally_reserved":0,"allocated":21090304,"data_stored":11402157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.410698"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.472480+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:36.472480+0000","last_peered":"2024-01-21T21:33:36.472480+0000","last_clean":"2024-01-21T21:33:36.472480+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:36.472480+0000","last_undegraded":"2024-01-21T21:33:36.472480+0000","last_fullsized":"2024-01-21T21:33:36.472480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":193,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-01-21T21:33:43.897548+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:43.897548+0000","last_peered":"2024-01-21T21:33:43.897548+0000","last_clean":"2024-01-21T21:33:43.897548+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:43.897548+0000","last_undegraded":"2024-01-21T21:33:43.897548+0000","last_fullsized":"2024-01-21T21:33:43.897548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.468503+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:36.468503+0000","last_peered":"2024-01-21T21:33:36.468503+0000","last_clean":"2024-01-21T21:33:36.468503+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:36.468503+0000","last_undegraded":"2024-01-21T21:33:36.468503+0000","last_fullsized":"2024-01-21T21:33:36.468503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":193,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-01-21T21:33:43.897804+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:43.897804+0000","last_peered":"2024-01-21T21:33:43.897804+0000","last_clean":"2024-01-21T21:33:43.897804+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:43.897804+0000","last_undegraded":"2024-01-21T21:33:43.897804+0000","last_fullsized":"2024-01-21T21:33:43.897804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":172,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.427613+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:36.427613+0000","last_peered":"2024-01-21T21:33:36.427613+0000","last_clean":"2024-01-21T21:33:36.427613+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:36.427613+0000","last_undegraded":"2024-01-21T21:33:36.427613+0000","last_fullsized":"2024-01-21T21:33:36.427613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":170,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.427653+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:36.427653+0000","last_peered":"2024-01-21T21:33:36.427653+0000","last_clean":"2024-01-21T21:33:36.427653+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:36.427653+0000","last_undegraded":"2024-01-21T21:33:36.427653+0000","last_fullsized":"2024-01-21T21:33:36.427653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":170,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.426141+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:36.426141+0000","last_peered":"2024-01-21T21:33:36.426141+0000","last_clean":"2024-01-21T21:33:36.426141+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:36.426141+0000","last_undegraded":"2024-01-21T21:33:36.426141+0000","last_fullsized":"2024-01-21T21:33:36.426141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.472711+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:36.472711+0000","last_peered":"2024-01-21T21:33:36.472711+0000","last_clean":"2024-01-21T21:33:36.472711+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:36.472711+0000","last_undegraded":"2024-01-21T21:33:36.472711+0000","last_fullsized":"2024-01-21T21:33:36.472711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":170,"reported_epoch":208,"state":"active+clean","last_fresh":"2024-01-21T21:33:36.429362+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:36.429362+0000","last_peered":"2024-01-21T21:33:36.429362+0000","last_clean":"2024-01-21T21:33:36.429362+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:36.429362+0000","last_undegraded":"2024-01-21T21:33:36.429362+0000","last_fullsized":"2024-01-21T21:33:36.429362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575974,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311940,"kb_used_data":2556,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059900,"statfs":{"total":96636764160,"available":96317337600,"internally_reserved":0,"allocated":2617344,"data_stored":1419537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.499},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.376}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.436}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54100000000000004}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.54600000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.42199999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.44700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311968,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059872,"statfs":{"total":96636764160,"available":96317308928,"internally_reserved":0,"allocated":2646016,"data_stored":1435213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.62},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575976,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303764,"kb_used_data":2572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068076,"statfs":{"total":96636764160,"available":96325709824,"internally_reserved":0,"allocated":2633728,"data_stored":1425492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.308},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.40400000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.442}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.48199999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.495},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.433}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.53200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575975,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307876,"kb_used_data":2588,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063964,"statfs":{"total":96636764160,"available":96321499136,"internally_reserved":0,"allocated":2650112,"data_stored":1425923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.251}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.317},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.36499999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.39800000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575975,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063984,"statfs":{"total":96636764160,"available":96321519616,"internally_reserved":0,"allocated":2629632,"data_stored":1425391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40899999999999997,"15min":0.40500000000000003},"min":{"1min":0.249,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.60999999999999999,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.435},"min":{"1min":0.29599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.47399999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.626,"5min":0.626,"15min":0.64300000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.45000000000000001,"15min":0.438},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66500000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.45700000000000002},"min":{"1min":0.34899999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.61799999999999999,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.47099999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.69699999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.44}]},{"osd":4,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.67300000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79100000000000004,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.68899999999999995},"min":{"1min":0.42799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.83099999999999996,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.626,"15min":0.63900000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63200000000000001,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77300000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67500000000000004,"15min":0.67200000000000004},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.45600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Jan 21 21:32:46 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64100000000000001,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.67400000000000004},"min":{"1min":0.45400000000000001,"5min":0.42799999999999999,"15min":0.39300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.54300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575975,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2564,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2625536,"data_stored":1418405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.35499999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.36699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.438},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42899999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41999999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.45900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575975,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307868,"kb_used_data":2580,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063972,"statfs":{"total":96636764160,"available":96321507328,"internally_reserved":0,"allocated":2641920,"data_stored":1426069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.498},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.436},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.36899999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.41199999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575974,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316064,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055776,"statfs":{"total":96636764160,"available":96313114624,"internally_reserved":0,"allocated":2646016,"data_stored":1426127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.42299999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.44}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.495},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.51100000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:49.909 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.022+0000 7fdb7ece9700 1 Processor -- start 2024-01-21T21:33:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.022+0000 7fdb7ece9700 1 -- start start 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ece9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 0x7fdb780c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ece9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb780c3c60 0x7fdb78155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ece9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780c61a0 con 0x7fdb781561a0 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ece9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780c5350 con 0x7fdb780c3c60 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ece9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780c55d0 con 0x7fdb781351d0 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb780c3c60 0x7fdb78155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7d286700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb781561a0 0x7fdb781526a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37292/0 (socket says 172.21.15.133:37292) 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7d286700 1 -- 172.21.15.133:0/3756920377 learned_addr learned my addr 172.21.15.133:0/3756920377 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3756920377 >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 0x7fdb780c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 -- 172.21.15.133:0/3756920377 >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 msgr2=0x7fdb780c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 --2- 172.21.15.133:0/3756920377 >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 0x7fdb780c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 -- 172.21.15.133:0/3756920377 >> v1:172.21.15.133:6789/0 conn(0x7fdb781561a0 legacy=0x7fdb781526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb777fe700 1 -- 172.21.15.133:0/3756920377 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843305956 0 0) 0x7fdb780c61a0 con 0x7fdb781561a0 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 -- 172.21.15.133:0/3756920377 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb781565d0 con 0x7fdb780c3c60 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3756920377 >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 0x7fdb780c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.023+0000 7fdb77fff700 1 --2- 172.21.15.133:0/3756920377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb780c3c60 0x7fdb78155cb0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7fdb7806a630 tx=0x7fdb64009060).ready entity=mon.0 client_cookie=6a6c87424c97947c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb777fe700 1 -- 172.21.15.133:0/3756920377 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640090d0 con 0x7fdb780c3c60 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb777fe700 1 -- 172.21.15.133:0/3756920377 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6400b580 con 0x7fdb780c3c60 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb777fe700 1 -- 172.21.15.133:0/3756920377 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400b900 con 0x7fdb780c3c60 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3756920377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb780c3c60 msgr2=0x7fdb78155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3756920377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb780c3c60 0x7fdb78155cb0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7fdb7806a630 tx=0x7fdb64009060).stop 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3756920377 shutdown_connections 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3756920377 >> v2:172.21.15.178:3300/0 conn(0x7fdb781351d0 0x7fdb780c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3756920377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb780c3c60 0x7fdb78155cb0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3756920377 >> 172.21.15.133:0/3756920377 conn(0x7fdb78066a90 msgr2=0x7fdb78066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3756920377 shutdown_connections 2024-01-21T21:33:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.024+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3756920377 wait complete. 2024-01-21T21:33:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.025+0000 7fdb7ece9700 1 Processor -- start 2024-01-21T21:33:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.025+0000 7fdb7ece9700 1 -- start start 2024-01-21T21:33:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 0x7fdb78163350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 0x7fdb78152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb781621a0 con 0x7fdb781561a0 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78151180 con 0x7fdb780c3c60 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7ece9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7814fc90 con 0x7fdb781351d0 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7d286700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7d286700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53918/0 (socket says 172.21.15.133:53918) 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.026+0000 7fdb7d286700 1 -- 172.21.15.133:0/3414694144 learned_addr learned my addr 172.21.15.133:0/3414694144 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb77fff700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 0x7fdb78152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 0x7fdb78163350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 -- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 msgr2=0x7fdb78152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 0x7fdb78152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 -- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 msgr2=0x7fdb78163350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 0x7fdb78163350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 -- 172.21.15.133:0/3414694144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640092a0 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb77fff700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 0x7fdb78152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 0x7fdb78163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7d286700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7fdb7000c730 tx=0x7fdb70001520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70005d30 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70005e90 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb78150290 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70007340 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.027+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78150620 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.028+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb781622f0 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.028+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fdb700076f0 con 0x7fdb781561a0 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.029+0000 7fdb757fa700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 0x7fdb5c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.029+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fdb7007a2e0 con 0x7fdb781561a0 2024-01-21T21:33:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.029+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 0x7fdb5c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.029+0000 7fdb7ca85700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 0x7fdb5c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdb6c006d80 tx=0x7fdb6c008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.033+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fdb781622f0 con 0x7fdb781561a0 2024-01-21T21:33:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.195+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb781622f0 con 0x7fdb5c05f150 2024-01-21T21:33:50.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.198+0000 7fdb757fa700 1 -- 172.21.15.133:0/3414694144 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71568 (secure 0 0 0) 0x7fdb781622f0 con 0x7fdb5c05f150 2024-01-21T21:33:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 msgr2=0x7fdb5c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 0x7fdb5c061610 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdb6c006d80 tx=0x7fdb6c008040).stop 2024-01-21T21:33:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 msgr2=0x7fdb780ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7fdb7000c730 tx=0x7fdb70001520).stop 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 shutdown_connections 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb781561a0 0x7fdb780ae890 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fdb5c05f150 0x7fdb5c061610 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb780c3c60 0x7fdb78163350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 --2- 172.21.15.133:0/3414694144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb781351d0 0x7fdb78152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.199+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 >> 172.21.15.133:0/3414694144 conn(0x7fdb78066a90 msgr2=0x7fdb78155820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.200+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 shutdown_connections 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.200+0000 7fdb7ece9700 1 -- 172.21.15.133:0/3414694144 wait complete. 2024-01-21T21:33:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:50.215 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-01-21T21:33:50.063309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2475384,"kb_used_data":20792,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499336,"statfs":{"total":773094113280,"available":770559320064,"internally_reserved":0,"allocated":21291008,"data_stored":11520862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.410698"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.479172+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:46.479172+0000","last_peered":"2024-01-21T21:33:46.479172+0000","last_clean":"2024-01-21T21:33:46.479172+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:46.479172+0000","last_undegraded":"2024-01-21T21:33:46.479172+0000","last_fullsized":"2024-01-21T21:33:46.479172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477151+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:46.477151+0000","last_peered":"2024-01-21T21:33:46.477151+0000","last_clean":"2024-01-21T21:33:46.477151+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:46.477151+0000","last_undegraded":"2024-01-21T21:33:46.477151+0000","last_fullsized":"2024-01-21T21:33:46.477151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477645+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:46.477645+0000","last_peered":"2024-01-21T21:33:46.477645+0000","last_clean":"2024-01-21T21:33:46.477645+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:46.477645+0000","last_undegraded":"2024-01-21T21:33:46.477645+0000","last_fullsized":"2024-01-21T21:33:46.477645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477669+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:46.477669+0000","last_peered":"2024-01-21T21:33:46.477669+0000","last_clean":"2024-01-21T21:33:46.477669+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:46.477669+0000","last_undegraded":"2024-01-21T21:33:46.477669+0000","last_fullsized":"2024-01-21T21:33:46.477669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848498+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:46.848498+0000","last_peered":"2024-01-21T21:33:46.848498+0000","last_clean":"2024-01-21T21:33:46.848498+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:46.848498+0000","last_undegraded":"2024-01-21T21:33:46.848498+0000","last_fullsized":"2024-01-21T21:33:46.848498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848580+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:46.848580+0000","last_peered":"2024-01-21T21:33:46.848580+0000","last_clean":"2024-01-21T21:33:46.848580+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:46.848580+0000","last_undegraded":"2024-01-21T21:33:46.848580+0000","last_fullsized":"2024-01-21T21:33:46.848580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844277+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:46.844277+0000","last_peered":"2024-01-21T21:33:46.844277+0000","last_clean":"2024-01-21T21:33:46.844277+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:46.844277+0000","last_undegraded":"2024-01-21T21:33:46.844277+0000","last_fullsized":"2024-01-21T21:33:46.844277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.480378+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:46.480378+0000","last_peered":"2024-01-21T21:33:46.480378+0000","last_clean":"2024-01-21T21:33:46.480378+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:46.480378+0000","last_undegraded":"2024-01-21T21:33:46.480378+0000","last_fullsized":"2024-01-21T21:33:46.480378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844397+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:46.844397+0000","last_peered":"2024-01-21T21:33:46.844397+0000","last_clean":"2024-01-21T21:33:46.844397+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:46.844397+0000","last_undegraded":"2024-01-21T21:33:46.844397+0000","last_fullsized":"2024-01-21T21:33:46.844397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.62},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.314}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.436}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.436},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.499}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.55800000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"max":{"1min":0.53500000000000003,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.40200000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40400000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.626,"15min":0.64300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54000000000000004,"5min":0.67800000000000005,"15min":0.68300000000000005},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54700000000000004,"5min":0.626,"15min":0.66200000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.68400000000000005},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91200000000000003,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84699999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.251},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.376}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29899999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33400000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575976,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.433},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.627},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316080,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055760,"statfs":{"total":96636764160,"available":96313098240,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.76500000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.748}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:50.217 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-21T21:33:50.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.329+0000 7f210f184700 1 Processor -- start 2024-01-21T21:33:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.329+0000 7f210f184700 1 -- start start 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2108137030 0x7f2108067d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2108137410 0x7f2108155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 0x7f21080c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080c62d0 con 0x7f2108137410 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21081557f0 con 0x7f21080c5930 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210f184700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108068370 con 0x7f2108137030 2024-01-21T21:33:50.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f2107fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2108137410 0x7f2108155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f2107fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2108137410 0x7f2108155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35530/0 (socket says 172.21.15.133:35530) 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f2107fff700 1 -- 172.21.15.133:0/4088545587 learned_addr learned my addr 172.21.15.133:0/4088545587 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210cf20700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2108137030 0x7f2108067d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.330+0000 7f210d721700 1 --2- 172.21.15.133:0/4088545587 >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 0x7f21080c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 -- 172.21.15.133:0/4088545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2108137030 msgr2=0x7f2108067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2108137030 0x7f2108067d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 -- 172.21.15.133:0/4088545587 >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 msgr2=0x7f21080c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 --2- 172.21.15.133:0/4088545587 >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 0x7f21080c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 -- 172.21.15.133:0/4088545587 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108068650 con 0x7f2108137410 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210d721700 1 --2- 172.21.15.133:0/4088545587 >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 0x7f21080c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f2107fff700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108155300 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f2108155a40 tx=0x7f20f40090f0).ready entity=mon.0 client_cookie=ec7f5c61091a1bc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f21077fe700 1 -- 172.21.15.133:0/4088545587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400b600 con 0x7f2108137410 2024-01-21T21:33:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f21077fe700 1 -- 172.21.15.133:0/4088545587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400b760 con 0x7f2108137410 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f21077fe700 1 -- 172.21.15.133:0/4088545587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400bb00 con 0x7f2108137410 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 -- 172.21.15.133:0/4088545587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 msgr2=0x7f2108155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108155300 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 rx=0x7f2108155a40 tx=0x7f20f40090f0).stop 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 -- 172.21.15.133:0/4088545587 shutdown_connections 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 --2- 172.21.15.133:0/4088545587 >> v2:172.21.15.178:3300/0 conn(0x7f21080c5930 0x7f21080c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2108137030 0x7f2108067d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 --2- 172.21.15.133:0/4088545587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108155300 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 -- 172.21.15.133:0/4088545587 >> 172.21.15.133:0/4088545587 conn(0x7f2108066a90 msgr2=0x7f2108066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 -- 172.21.15.133:0/4088545587 shutdown_connections 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.331+0000 7f210f184700 1 -- 172.21.15.133:0/4088545587 wait complete. 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.333+0000 7f210f184700 1 Processor -- start 2024-01-21T21:33:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.333+0000 7f210f184700 1 -- start start 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21080c5930 0x7f2108164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 0x7f210813d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21081640f0 con 0x7f2108137410 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21081646a0 con 0x7f2108137030 2024-01-21T21:33:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108165020 con 0x7f21080c5930 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35542/0 (socket says 172.21.15.133:35542) 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 -- 172.21.15.133:0/3067030146 learned_addr learned my addr 172.21.15.133:0/3067030146 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210cf20700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21080c5930 0x7f2108164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f2107fff700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 0x7f210813d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 -- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21080c5930 msgr2=0x7f2108164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21080c5930 0x7f2108164b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 -- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 msgr2=0x7f210813d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 0x7f210813d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 -- 172.21.15.133:0/3067030146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4009370 con 0x7f2108137410 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f2107fff700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 0x7f210813d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210d721700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f210000cf20 tx=0x7f2100007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000ad40 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2100016400 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21081680f0 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000aea0 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.334+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2108164330 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.335+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2108164830 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.336+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f210001f3f0 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.336+0000 7f21057fa700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 0x7f20ec061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.336+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f210007a9f0 con 0x7f2108137410 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.336+0000 7f210cf20700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 0x7f20ec061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.337+0000 7f210cf20700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 0x7f20ec061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f20fc00bb10 tx=0x7f20fc008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.340+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f210004bb10 con 0x7f2108137410 2024-01-21T21:33:50.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.501+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f210805fdf0 con 0x7f20ec05f150 2024-01-21T21:33:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.504+0000 7f21057fa700 1 -- 172.21.15.133:0/3067030146 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71568 (secure 0 0 0) 0x7f210805fdf0 con 0x7f20ec05f150 2024-01-21T21:33:50.509 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 msgr2=0x7f20ec061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 0x7f20ec061610 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f20fc00bb10 tx=0x7f20fc008040).stop 2024-01-21T21:33:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 msgr2=0x7f2108167710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7f210000cf20 tx=0x7f2100007860).stop 2024-01-21T21:33:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 shutdown_connections 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2108137410 0x7f2108167710 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21080c5930 0x7f2108164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f20ec05f150 0x7f20ec061610 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 --2- 172.21.15.133:0/3067030146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2108137030 0x7f210813d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 >> 172.21.15.133:0/3067030146 conn(0x7f2108066a90 msgr2=0x7f2108155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 shutdown_connections 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.506+0000 7f210f184700 1 -- 172.21.15.133:0/3067030146 wait complete. 2024-01-21T21:33:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:50.522 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-01-21T21:33:50.063309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2475384,"kb_used_data":20792,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499336,"statfs":{"total":773094113280,"available":770559320064,"internally_reserved":0,"allocated":21291008,"data_stored":11520862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.410698"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.479172+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:46.479172+0000","last_peered":"2024-01-21T21:33:46.479172+0000","last_clean":"2024-01-21T21:33:46.479172+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:46.479172+0000","last_undegraded":"2024-01-21T21:33:46.479172+0000","last_fullsized":"2024-01-21T21:33:46.479172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477151+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:46.477151+0000","last_peered":"2024-01-21T21:33:46.477151+0000","last_clean":"2024-01-21T21:33:46.477151+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:46.477151+0000","last_undegraded":"2024-01-21T21:33:46.477151+0000","last_fullsized":"2024-01-21T21:33:46.477151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477645+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:46.477645+0000","last_peered":"2024-01-21T21:33:46.477645+0000","last_clean":"2024-01-21T21:33:46.477645+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:46.477645+0000","last_undegraded":"2024-01-21T21:33:46.477645+0000","last_fullsized":"2024-01-21T21:33:46.477645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477669+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:46.477669+0000","last_peered":"2024-01-21T21:33:46.477669+0000","last_clean":"2024-01-21T21:33:46.477669+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:46.477669+0000","last_undegraded":"2024-01-21T21:33:46.477669+0000","last_fullsized":"2024-01-21T21:33:46.477669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848498+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:46.848498+0000","last_peered":"2024-01-21T21:33:46.848498+0000","last_clean":"2024-01-21T21:33:46.848498+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:46.848498+0000","last_undegraded":"2024-01-21T21:33:46.848498+0000","last_fullsized":"2024-01-21T21:33:46.848498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848580+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:46.848580+0000","last_peered":"2024-01-21T21:33:46.848580+0000","last_clean":"2024-01-21T21:33:46.848580+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:46.848580+0000","last_undegraded":"2024-01-21T21:33:46.848580+0000","last_fullsized":"2024-01-21T21:33:46.848580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844277+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:46.844277+0000","last_peered":"2024-01-21T21:33:46.844277+0000","last_clean":"2024-01-21T21:33:46.844277+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:46.844277+0000","last_undegraded":"2024-01-21T21:33:46.844277+0000","last_fullsized":"2024-01-21T21:33:46.844277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.480378+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:46.480378+0000","last_peered":"2024-01-21T21:33:46.480378+0000","last_clean":"2024-01-21T21:33:46.480378+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:46.480378+0000","last_undegraded":"2024-01-21T21:33:46.480378+0000","last_fullsized":"2024-01-21T21:33:46.480378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844397+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:46.844397+0000","last_peered":"2024-01-21T21:33:46.844397+0000","last_clean":"2024-01-21T21:33:46.844397+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:46.844397+0000","last_undegraded":"2024-01-21T21:33:46.844397+0000","last_fullsized":"2024-01-21T21:33:46.844397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.62},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.314}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.436}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.436},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.499}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.55800000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"max":{"1min":0.53500000000000003,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.40200000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40400000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.626,"15min":0.64300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54000000000000004,"5min":0.67800000000000005,"15min":0.68300000000000005},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54700000000000004,"5min":0.626,"15min":0.66200000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.68400000000000005},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91200000000000003,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84699999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.251},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.376}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29899999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33400000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575976,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.433},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.627},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316080,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055760,"statfs":{"total":96636764160,"available":96313098240,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.76500000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.748}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:50.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-21T21:33:50.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.635+0000 7f49fa0f2700 1 Processor -- start 2024-01-21T21:33:50.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.635+0000 7f49fa0f2700 1 -- start start 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49fa0f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f40c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49fa0f2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49f40be810 0x7f49f40a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49fa0f2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40bfa40 con 0x7f49f40c39f0 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49fa0f2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40c3e70 con 0x7f49f40be810 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49fa0f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40bee30 con 0x7f49f413b970 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49f3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49f40be810 0x7f49f40a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49f2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f49f40c39f0 0x7f49f40be100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50478/0 (socket says 172.21.15.133:50478) 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.636+0000 7f49f2ffd700 1 -- 172.21.15.133:0/2653756674 learned_addr learned my addr 172.21.15.133:0/2653756674 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f37fe700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f40c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f3fff700 1 -- 172.21.15.133:0/2653756674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 msgr2=0x7f49f40c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f3fff700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f40c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f3fff700 1 -- 172.21.15.133:0/2653756674 >> v1:172.21.15.133:6789/0 conn(0x7f49f40c39f0 legacy=0x7f49f40be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f27fc700 1 -- 172.21.15.133:0/2653756674 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033543721 0 0) 0x7f49f40bfa40 con 0x7f49f40c39f0 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f3fff700 1 -- 172.21.15.133:0/2653756674 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40bf110 con 0x7f49f40be810 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f3fff700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f40a8ab0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f49ec009e60 tx=0x7f49ec009780).ready entity=mon.0 client_cookie=282d6afadae2175 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f27fc700 1 -- 172.21.15.133:0/2653756674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec00e070 con 0x7f49f40be810 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f27fc700 1 -- 172.21.15.133:0/2653756674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec00bc30 con 0x7f49f40be810 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49f27fc700 1 -- 172.21.15.133:0/2653756674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec012410 con 0x7f49f40be810 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 -- 172.21.15.133:0/2653756674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 msgr2=0x7f49f40a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f40a8ab0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f49ec009e60 tx=0x7f49ec009780).stop 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 -- 172.21.15.133:0/2653756674 shutdown_connections 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f40a8ab0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/2653756674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f40c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.637+0000 7f49fa0f2700 1 -- 172.21.15.133:0/2653756674 >> 172.21.15.133:0/2653756674 conn(0x7f49f4066a70 msgr2=0x7f49f4066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.638+0000 7f49fa0f2700 1 -- 172.21.15.133:0/2653756674 shutdown_connections 2024-01-21T21:33:50.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.638+0000 7f49fa0f2700 1 -- 172.21.15.133:0/2653756674 wait complete. 2024-01-21T21:33:50.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.639+0000 7f49fa0f2700 1 Processor -- start 2024-01-21T21:33:50.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.639+0000 7f49fa0f2700 1 -- start start 2024-01-21T21:33:50.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49f40c39f0 0x7f49f4156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4157550 con 0x7f49f40be810 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f4139420 con 0x7f49f40c39f0 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f41398b0 con 0x7f49f413b970 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35560/0 (socket says 172.21.15.133:35560) 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 -- 172.21.15.133:0/237612518 learned_addr learned my addr 172.21.15.133:0/237612518 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f3fff700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f2ffd700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49f40c39f0 0x7f49f4156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 -- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 msgr2=0x7f49f4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 -- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49f40c39f0 msgr2=0x7f49f4156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49f40c39f0 0x7f49f4156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 -- 172.21.15.133:0/237612518 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec009a20 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49f37fe700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f49dc00c850 tx=0x7f49dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc010580 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0106e0 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4138810 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc010a60 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.640+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4138dd0 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.642+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f4139700 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.642+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f49dc01b460 con 0x7f49f40be810 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.642+0000 7f49ebfff700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 0x7f49d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.642+0000 7f49f2ffd700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 0x7f49d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.642+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f49dc07a280 con 0x7f49f40be810 2024-01-21T21:33:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.643+0000 7f49f2ffd700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 0x7f49d4061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f49f4157b50 tx=0x7f49e4009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.646+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f49dc04b3a0 con 0x7f49f40be810 2024-01-21T21:33:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.809+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f405fdf0 con 0x7f49f40be810 2024-01-21T21:33:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.810+0000 7f49ebfff700 1 -- 172.21.15.133:0/237612518 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+15554 (secure 0 0 0) 0x7f49dc04e9c0 con 0x7f49f40be810 2024-01-21T21:33:50.814 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:50.814 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":212,"fsid":"5608d7ec-e990-4e2d-988c-7c34378633be","created":"2024-01-21T19:58:49.118146+0000","modified":"2024-01-21T21:33:47.473819+0000","last_up_change":"2024-01-21T19:58:57.863556+0000","last_in_change":"2024-01-21T19:58:51.531096+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-01-21T19:58:57.899927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-21T19:59:00.238523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"889e1b23-a30f-41de-a410-f9508c0b3007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":43684},{"type":"v1","addr":"172.21.15.133:6825","nonce":43684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":43684},{"type":"v1","addr":"172.21.15.133:6827","nonce":43684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":43684},{"type":"v1","addr":"172.21.15.133:6831","nonce":43684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":43684},{"type":"v1","addr":"172.21.15.133:6829","nonce":43684}]},"public_addr":"172.21.15.133:6825/43684","cluster_addr":"172.21.15.133:6827/43684","heartbeat_back_addr":"172.21.15.133:6831/43684","heartbeat_front_addr":"172.21.15.133:6829/43684","state":["exists","up"]},{"osd":1,"uuid":"7b1647fa-e508-4a8e-ae0e-6c43c687eba4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":43675},{"type":"v1","addr":"172.21.15.133:6817","nonce":43675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":43675},{"type":"v1","addr":"172.21.15.133:6819","nonce":43675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":43675},{"type":"v1","addr":"172.21.15.133:6823","nonce":43675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":43675},{"type":"v1","addr":"172.21.15.133:6821","nonce":43675}]},"public_addr":"172.21.15.133:6817/43675","cluster_addr":"172.21.15.133:6819/43675","heartbeat_back_addr":"172.21.15.133:6823/43675","heartbeat_front_addr":"172.21.15.133:6821/43675","state":["exists","up"]},{"osd":2,"uuid":"dd9d1bc0-7f9f-434f-8398-d5727e17f902","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":43673},{"type":"v1","addr":"172.21.15.133:6801","nonce":43673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":43673},{"type":"v1","addr":"172.21.15.133:6803","nonce":43673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":43673},{"type":"v1","addr":"172.21.15.133:6807","nonce":43673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":43673},{"type":"v1","addr":"172.21.15.133:6805","nonce":43673}]},"public_addr":"172.21.15.133:6801/43673","cluster_addr":"172.21.15.133:6803/43673","heartbeat_back_addr":"172.21.15.133:6807/43673","heartbeat_front_addr":"172.21.15.133:6805/43673","state":["exists","up"]},{"osd":3,"uuid":"925b134b-fb46-4552-a8dc-47d566fc86bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":43674},{"type":"v1","addr":"172.21.15.133:6809","nonce":43674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":43674},{"type":"v1","addr":"172.21.15.133:6811","nonce":43674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":43674},{"type":"v1","addr":"172.21.15.133:6815","nonce":43674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":43674},{"type":"v1","addr":"172.21.15.133:6813","nonce":43674}]},"public_addr":"172.21.15.133:6809/43674","cluster_addr":"172.21.15.133:6811/43674","heartbeat_back_addr":"172.21.15.133:6815/43674","heartbeat_front_addr":"172.21.15.133:6813/43674","state":["exists","up"]},{"osd":4,"uuid":"73e87d8f-c1e6-497e-bfd4-85402b130ed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":43897},{"type":"v1","addr":"172.21.15.178:6801","nonce":43897}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":43897},{"type":"v1","addr":"172.21.15.178:6803","nonce":43897}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":43897},{"type":"v1","addr":"172.21.15.178:6807","nonce":43897}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":43897},{"type":"v1","addr":"172.21.15.178:6805","nonce":43897}]},"public_addr":"172.21.15.178:6801/43897","cluster_addr":"172.21.15.178:6803/43897","heartbeat_back_addr":"172.21.15.178:6807/43897","heartbeat_front_addr":"172.21.15.178:6805/43897","state":["exists","up"]},{"osd":5,"uuid":"c0bf882d-61a6-4a82-91fa-6da314fa6699","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":43898},{"type":"v1","addr":"172.21.15.178:6817","nonce":43898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":43898},{"type":"v1","addr":"172.21.15.178:6819","nonce":43898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":43898},{"type":"v1","addr":"172.21.15.178:6823","nonce":43898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":43898},{"type":"v1","addr":"172.21.15.178:6821","nonce":43898}]},"public_addr":"172.21.15.178:6817/43898","cluster_addr":"172.21.15.178:6819/43898","heartbeat_back_addr":"172.21.15.178:6823/43898","heartbeat_front_addr":"172.21.15.178:6821/43898","state":["exists","up"]},{"osd":6,"uuid":"2fec80c9-4500-4f89-9d4a-ff67637535b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":43899},{"type":"v1","addr":"172.21.15.178:6809","nonce":43899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":43899},{"type":"v1","addr":"172.21.15.178:6811","nonce":43899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":43899},{"type":"v1","addr":"172.21.15.178:6815","nonce":43899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":43899},{"type":"v1","addr":"172.21.15.178:6813","nonce":43899}]},"public_addr":"172.21.15.178:6809/43899","cluster_addr":"172.21.15.178:6811/43899","heartbeat_back_addr":"172.21.15.178:6815/43899","heartbeat_front_addr":"172.21.15.178:6813/43899","state":["exists","up"]},{"osd":7,"uuid":"5cdee6cb-24ee-4eb6-b90b-9f563cf9e97f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":43943},{"type":"v1","addr":"172.21.15.178:6825","nonce":43943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":43943},{"type":"v1","addr":"172.21.15.178:6827","nonce":43943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":43943},{"type":"v1","addr":"172.21.15.178:6831","nonce":43943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":43943},{"type":"v1","addr":"172.21.15.178:6829","nonce":43943}]},"public_addr":"172.21.15.178:6825/43943","cluster_addr":"172.21.15.178:6827/43943","heartbeat_back_addr":"172.21.15.178:6831/43943","heartbeat_front_addr":"172.21.15.178:6829/43943","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.712362+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.668093+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.682117+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.651751+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.721797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.662248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.705614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-01-21T19:58:56.711684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:0/1514923135":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/1450506345":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/1911649568":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/184881117":"2024-01-22T21:33:44.049782+0000","172.21.15.178:6835/2870485430":"2024-01-22T21:33:43.893858+0000","172.21.15.178:6833/2870485430":"2024-01-22T21:33:43.893858+0000","172.21.15.133:0/1079767282":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6833/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:6832/94812":"2024-01-22T21:33:36.420664+0000","172.21.15.133:0/3493985817":"2024-01-22T21:33:44.049782+0000","172.21.15.133:0/912648497":"2024-01-22T21:33:36.420664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":8,"length":1},{"begin":11,"length":1},{"begin":15,"length":1},{"begin":18,"length":1},{"begin":21,"length":1},{"begin":25,"length":1},{"begin":28,"length":1},{"begin":31,"length":1},{"begin":35,"length":1},{"begin":38,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":48,"length":1},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":58,"length":1},{"begin":61,"length":1},{"begin":65,"length":1},{"begin":68,"length":1},{"begin":71,"length":1},{"begin":75,"length":1},{"begin":78,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":98,"length":1},{"begin":101,"length":1},{"begin":104,"length":2},{"begin":108,"length":1},{"begin":111,"length":1},{"begin":188,"length":34}]},{"pool":8,"snaps":[{"begin":2,"length":4}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":22,"snaps":[{"begin":2,"length":32}]},{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 msgr2=0x7f49d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 0x7f49d4061610 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f49f4157b50 tx=0x7f49e4009040).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 msgr2=0x7f49f4133c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f49dc00c850 tx=0x7f49dc008040).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 shutdown_connections 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49f413b970 0x7f49f4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.812+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f40be810 0x7f49f4133c10 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.813+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f49d405f150 0x7f49d4061610 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.813+0000 7f49fa0f2700 1 --2- 172.21.15.133:0/237612518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49f40c39f0 0x7f49f4156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.813+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 >> 172.21.15.133:0/237612518 conn(0x7f49f4066a70 msgr2=0x7f49f40c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:50.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.813+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 shutdown_connections 2024-01-21T21:33:50.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:50.813+0000 7f49fa0f2700 1 -- 172.21.15.133:0/237612518 wait complete. 2024-01-21T21:33:51.829 INFO:tasks.ceph:Scrubbing osd.0 2024-01-21T21:33:51.829 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:51.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.959+0000 7fc042f65700 1 Processor -- start 2024-01-21T21:33:51.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.959+0000 7fc042f65700 1 -- start start 2024-01-21T21:33:51.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc042f65700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 0x7fc03c069550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc042f65700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc03c063e10 0x7fc03c154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc042f65700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03c065440 con 0x7fc03c0c1aa0 2024-01-21T21:33:51.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc042f65700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03c0c1f20 con 0x7fc03c063e10 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc042f65700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0a4d90 con 0x7fc03c154050 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc03c063e10 0x7fc03c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc03c063e10 0x7fc03c154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35564/0 (socket says 172.21.15.133:35564) 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 -- 172.21.15.133:0/808696239 learned_addr learned my addr 172.21.15.133:0/808696239 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc040d01700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 0x7fc03c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 -- 172.21.15.133:0/808696239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 msgr2=0x7fc03c069550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 0x7fc03c069550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 -- 172.21.15.133:0/808696239 >> v1:172.21.15.178:6789/0 conn(0x7fc03c0c1aa0 legacy=0x7fc03c063700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 -- 172.21.15.133:0/808696239 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c069cd0 con 0x7fc03c063e10 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc040d01700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 0x7fc03c069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc041502700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c063e10 0x7fc03c154430 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7fc034009f20 tx=0x7fc034009840).ready entity=mon.0 client_cookie=b0a0c84354f73061 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.960+0000 7fc03b7fe700 1 -- 172.21.15.133:0/808696239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400e070 con 0x7fc03c063e10 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc03b7fe700 1 -- 172.21.15.133:0/808696239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400ba40 con 0x7fc03c063e10 2024-01-21T21:33:51.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc03b7fe700 1 -- 172.21.15.133:0/808696239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400bdc0 con 0x7fc03c063e10 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 -- 172.21.15.133:0/808696239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c063e10 msgr2=0x7fc03c154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c063e10 0x7fc03c154430 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7fc034009f20 tx=0x7fc034009840).stop 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 -- 172.21.15.133:0/808696239 shutdown_connections 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c063e10 0x7fc03c154430 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 --2- 172.21.15.133:0/808696239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c154050 0x7fc03c069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 -- 172.21.15.133:0/808696239 >> 172.21.15.133:0/808696239 conn(0x7fc03c0c4a10 msgr2=0x7fc03c068d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 -- 172.21.15.133:0/808696239 shutdown_connections 2024-01-21T21:33:51.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.961+0000 7fc042f65700 1 -- 172.21.15.133:0/808696239 wait complete. 2024-01-21T21:33:51.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.962+0000 7fc042f65700 1 Processor -- start 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.962+0000 7fc042f65700 1 -- start start 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c063e10 0x7fc03c0ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c0c1aa0 0x7fc03c164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 0x7fc03c0bf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c0aa8b0 con 0x7fc03c154050 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c1653e0 con 0x7fc03c0c1aa0 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc042f65700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c164e20 con 0x7fc03c063e10 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc041502700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 0x7fc03c0bf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc041502700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 0x7fc03c0bf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35580/0 (socket says 172.21.15.133:35580) 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc041502700 1 -- 172.21.15.133:0/971990330 learned_addr learned my addr 172.21.15.133:0/971990330 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc040d01700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c063e10 0x7fc03c0ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.963+0000 7fc03bfff700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c0c1aa0 0x7fc03c164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 -- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c063e10 msgr2=0x7fc03c0ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc03c063e10 0x7fc03c0ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 -- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c0c1aa0 msgr2=0x7fc03c164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c0c1aa0 0x7fc03c164460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009ae0 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc03bfff700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc03c0c1aa0 0x7fc03c164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc041502700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 0x7fc03c0bf510 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7fc03c064270 tx=0x7fc03c069a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0340092e0 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03401e470 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03c165100 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03401e810 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.964+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc03c0acb60 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.965+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc03c05fdf0 con 0x7fc03c154050 2024-01-21T21:33:51.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.965+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc034003040 con 0x7fc03c154050 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.965+0000 7fc0397fa700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc02005f150 0x7fc020061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fc03407bab0 con 0x7fc03c154050 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc040d01700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc02005f150 0x7fc020061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc0397fa700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fc020066060 0x7fc020068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc020068ae0 con 0x7fc020066060 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc034080220 con 0x7fc03c154050 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc03bfff700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fc020066060 0x7fc020068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc040d01700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc02005f150 0x7fc020061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc03000ab40 tx=0x7fc030008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.966+0000 7fc03bfff700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fc020066060 0x7fc020068500 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:51.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.967+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== osd.0 v2:172.21.15.133:6824/43684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fc020068ae0 con 0x7fc020066060 2024-01-21T21:33:51.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 --> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc03c069fb0 con 0x7fc020066060 2024-01-21T21:33:51.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc0397fa700 1 -- 172.21.15.133:0/971990330 <== osd.0 v2:172.21.15.133:6824/43684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc03c069fb0 con 0x7fc020066060 2024-01-21T21:33:51.984 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:51.984 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:51.985 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:51.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fc020066060 msgr2=0x7fc020068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6824/43684,v1:172.21.15.133:6825/43684] conn(0x7fc020066060 0x7fc020068500 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc02005f150 msgr2=0x7fc020061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc02005f150 0x7fc020061610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fc03000ab40 tx=0x7fc030008040).stop 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 msgr2=0x7fc03c0bf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 --2- 172.21.15.133:0/971990330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc03c154050 0x7fc03c0bf510 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 rx=0x7fc03c064270 tx=0x7fc03c069a40).stop 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc041502700 1 -- 172.21.15.133:0/971990330 reap_dead start 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 shutdown_connections 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.980+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 >> 172.21.15.133:0/971990330 conn(0x7fc03c0c4a10 msgr2=0x7fc03c153150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.981+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 shutdown_connections 2024-01-21T21:33:51.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:51.981+0000 7fc042f65700 1 -- 172.21.15.133:0/971990330 wait complete. 2024-01-21T21:33:51.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-21T21:33:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.109+0000 7f7deb1c9700 1 Processor -- start 2024-01-21T21:33:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.109+0000 7f7deb1c9700 1 -- start start 2024-01-21T21:33:52.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7de40acbc0 0x7f7de40acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7de4066460 0x7f7de40634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4152650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de4065fd0 con 0x7f7de4066460 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de40653c0 con 0x7f7de40acbc0 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7deb1c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40656a0 con 0x7f7de41521e0 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7de3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7de4066460 0x7f7de40634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7de3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7de4066460 0x7f7de40634d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35588/0 (socket says 172.21.15.133:35588) 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.110+0000 7f7de3fff700 1 -- 172.21.15.133:0/3146732752 learned_addr learned my addr 172.21.15.133:0/3146732752 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 -- 172.21.15.133:0/3146732752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 msgr2=0x7f7de4152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3146732752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de8f65700 1 --2- 172.21.15.133:0/3146732752 >> v2:172.21.15.178:3300/0 conn(0x7f7de40acbc0 0x7f7de40acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 -- 172.21.15.133:0/3146732752 >> v2:172.21.15.178:3300/0 conn(0x7f7de40acbc0 msgr2=0x7f7de40acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3146732752 >> v2:172.21.15.178:3300/0 conn(0x7f7de40acbc0 0x7f7de40acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 -- 172.21.15.133:0/3146732752 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de4065980 con 0x7f7de4066460 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3146732752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de4066460 0x7f7de40634d0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f7de4064610 tx=0x7f7dd00090f0).ready entity=mon.0 client_cookie=cf31f51a74e0ce2e server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de37fe700 1 -- 172.21.15.133:0/3146732752 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000b600 con 0x7f7de4066460 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de37fe700 1 -- 172.21.15.133:0/3146732752 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000b760 con 0x7f7de4066460 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7de37fe700 1 -- 172.21.15.133:0/3146732752 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bb00 con 0x7f7de4066460 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3146732752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de4066460 msgr2=0x7f7de40634d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.111+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3146732752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de4066460 0x7f7de40634d0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f7de4064610 tx=0x7f7dd00090f0).stop 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3146732752 shutdown_connections 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3146732752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3146732752 >> v2:172.21.15.178:3300/0 conn(0x7f7de40acbc0 0x7f7de40acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3146732752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de4066460 0x7f7de40634d0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3146732752 >> 172.21.15.133:0/3146732752 conn(0x7f7de40c8200 msgr2=0x7f7de40c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3146732752 shutdown_connections 2024-01-21T21:33:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.112+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3146732752 wait complete. 2024-01-21T21:33:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.113+0000 7f7deb1c9700 1 Processor -- start 2024-01-21T21:33:52.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.113+0000 7f7deb1c9700 1 -- start start 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 0x7f7de4164ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41654e0 con 0x7f7de40acbc0 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de41656c0 con 0x7f7de4066460 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4159dc0 con 0x7f7de41521e0 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35604/0 (socket says 172.21.15.133:35604) 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 -- 172.21.15.133:0/3966270093 learned_addr learned my addr 172.21.15.133:0/3966270093 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de8f65700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 0x7f7de4164ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de9766700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 -- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 msgr2=0x7f7de4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 -- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 msgr2=0x7f7de4164ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 0x7f7de4164ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 -- 172.21.15.133:0/3966270093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009370 con 0x7f7de40acbc0 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de8f65700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 0x7f7de4164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de9766700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de3fff700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f7dd0006fd0 tx=0x7f7dd0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0002f30 con 0x7f7de40acbc0 2024-01-21T21:33:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd0006990 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de4157610 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000bb00 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.114+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de415a320 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.115+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4165890 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.116+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7dd0021070 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.116+0000 7f7de17fa700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 0x7f7dc8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.116+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f7dd007be90 con 0x7f7de40acbc0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.116+0000 7f7de8f65700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 0x7f7dc8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.116+0000 7f7de8f65700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 0x7f7dc8061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7de40ad3a0 tx=0x7f7dd8008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.120+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f7de4165890 con 0x7f7de40acbc0 2024-01-21T21:33:52.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.284+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7de4165890 con 0x7f7dc805f150 2024-01-21T21:33:52.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.285+0000 7f7de17fa700 1 -- 172.21.15.133:0/3966270093 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7de4165890 con 0x7f7dc805f150 2024-01-21T21:33:52.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.286+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 msgr2=0x7f7dc8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.286+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 0x7f7dc8061610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7de40ad3a0 tx=0x7f7dd8008040).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.286+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 msgr2=0x7f7de4154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.286+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f7dd0006fd0 tx=0x7f7dd0017000).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 shutdown_connections 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de41521e0 0x7f7de4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f7dc805f150 0x7f7dc8061610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de4066460 0x7f7de4164ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 --2- 172.21.15.133:0/3966270093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7de40acbc0 0x7f7de4154b00 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 >> 172.21.15.133:0/3966270093 conn(0x7f7de40c8200 msgr2=0x7f7de40bc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 shutdown_connections 2024-01-21T21:33:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.287+0000 7f7deb1c9700 1 -- 172.21.15.133:0/3966270093 wait complete. 2024-01-21T21:33:52.292 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2024-01-21T21:33:52.302 INFO:tasks.ceph:Scrubbing osd.1 2024-01-21T21:33:52.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:52.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.418+0000 7f5da03a5700 1 Processor -- start 2024-01-21T21:33:52.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.418+0000 7f5da03a5700 1 -- start start 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5da03a5700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d98154960 0x7f5d980c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5da03a5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d98063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5da03a5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d98157f30 con 0x7f5d980c5060 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5da03a5700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980674d0 con 0x7f5d98154960 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5da03a5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98154ed0 con 0x7f5d980c3560 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9e141700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5d980c5060 0x7f5d98066dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50490/0 (socket says 172.21.15.133:50490) 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9e141700 1 -- 172.21.15.133:0/2524439683 learned_addr learned my addr 172.21.15.133:0/2524439683 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9e942700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d98063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d940700 1 --2- 172.21.15.133:0/2524439683 >> v2:172.21.15.178:3300/0 conn(0x7f5d98154960 0x7f5d980c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669883464 0 0) 0x7f5d98157f30 con 0x7f5d980c5060 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d840033f0 con 0x7f5d980c5060 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4222418922 0 0) 0x7f5d840033f0 con 0x7f5d980c5060 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 msgr2=0x7f5d98063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d98063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 >> v2:172.21.15.178:3300/0 conn(0x7f5d98154960 msgr2=0x7f5d980c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 --2- 172.21.15.133:0/2524439683 >> v2:172.21.15.178:3300/0 conn(0x7f5d98154960 0x7f5d980c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d981551b0 con 0x7f5d980c5060 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.419+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f5d94001470 con 0x7f5d980c5060 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 >> v1:172.21.15.133:6789/0 conn(0x7f5d980c5060 legacy=0x7f5d98066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d840038e0 0x7f5d84003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d84004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d84004b80 0x7f5d84005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98154ed0 con 0x7f5d840038e0 2024-01-21T21:33:52.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8400b8e0 con 0x7f5d84004b80 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8400ba20 con 0x7f5d980c3560 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d840038e0 0x7f5d84003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d940700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d84004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e942700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d84004b80 0x7f5d84005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 -- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 msgr2=0x7f5d84004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c3560 0x7f5d84004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 -- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d84004b80 msgr2=0x7f5d84005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d84004b80 0x7f5d84005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 -- 172.21.15.133:0/2524439683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d840033f0 con 0x7f5d840038e0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e942700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d84004b80 0x7f5d84005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9e141700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d840038e0 0x7f5d84003d00 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f5d9400c210 tx=0x7f5d94001e90).ready entity=mon.0 client_cookie=bf531759d2fa9f75 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94007a60 con 0x7f5d840038e0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9400cae0 con 0x7f5d840038e0 2024-01-21T21:33:52.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.420+0000 7f5d9d13f700 1 -- 172.21.15.133:0/2524439683 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9400ce60 con 0x7f5d840038e0 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 -- 172.21.15.133:0/2524439683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d840038e0 msgr2=0x7f5d84003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 --2- 172.21.15.133:0/2524439683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d840038e0 0x7f5d84003d00 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f5d9400c210 tx=0x7f5d94001e90).stop 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5d9e942700 1 -- 172.21.15.133:0/2524439683 reap_dead start 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 -- 172.21.15.133:0/2524439683 shutdown_connections 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 -- 172.21.15.133:0/2524439683 >> 172.21.15.133:0/2524439683 conn(0x7f5d980c8f60 msgr2=0x7f5d980c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 -- 172.21.15.133:0/2524439683 shutdown_connections 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.421+0000 7f5da03a5700 1 -- 172.21.15.133:0/2524439683 wait complete. 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.422+0000 7f5da03a5700 1 Processor -- start 2024-01-21T21:33:52.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.422+0000 7f5da03a5700 1 -- start start 2024-01-21T21:33:52.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d840038e0 0x7f5d9814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980abf90 0x7f5d980c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 0x7f5d980ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9814dbb0 con 0x7f5d980c2180 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980c2730 con 0x7f5d840038e0 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5da03a5700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981580e0 con 0x7f5d980abf90 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 0x7f5d980ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 0x7f5d980ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35610/0 (socket says 172.21.15.133:35610) 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 -- 172.21.15.133:0/3797452410 learned_addr learned my addr 172.21.15.133:0/3797452410 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e141700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d840038e0 0x7f5d9814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9d940700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980abf90 0x7f5d980c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 -- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980abf90 msgr2=0x7f5d980c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980abf90 0x7f5d980c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 -- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d840038e0 msgr2=0x7f5d9814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d840038e0 0x7f5d9814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d981583c0 con 0x7f5d980c2180 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d9e942700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 0x7f5d980ae2d0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f5d9806a460 tx=0x7f5d9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.423+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000e040 con 0x7f5d980c2180 2024-01-21T21:33:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.424+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9000f040 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.424+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d981586a0 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.424+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000fd70 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.424+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d980ac410 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.424+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d980ae0d0 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f5d90015660 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5d7c05f150 0x7f5d7c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f5d9007b060 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d9e141700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5d7c05f150 0x7f5d7c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7f5d7c066060 0x7f5d7c068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d7c068ae0 con 0x7f5d7c066060 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d9007b410 con 0x7f5d980c2180 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.425+0000 7f5d9d940700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7f5d7c066060 0x7f5d7c068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.426+0000 7f5d9e141700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5d7c05f150 0x7f5d7c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5d94001ed0 tx=0x7f5d94015000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.426+0000 7f5d9d940700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7f5d7c066060 0x7f5d7c068500 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.426+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== osd.1 v2:172.21.15.133:6816/43675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f5d7c068ae0 con 0x7f5d7c066060 2024-01-21T21:33:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.439+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 --> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d9805fdf0 con 0x7f5d7c066060 2024-01-21T21:33:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.439+0000 7f5d8effd700 1 -- 172.21.15.133:0/3797452410 <== osd.1 v2:172.21.15.133:6816/43675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5d9805fdf0 con 0x7f5d7c066060 2024-01-21T21:33:52.443 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:52.443 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:52.443 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7f5d7c066060 msgr2=0x7f5d7c068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6816/43675,v1:172.21.15.133:6817/43675] conn(0x7f5d7c066060 0x7f5d7c068500 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5d7c05f150 msgr2=0x7f5d7c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f5d7c05f150 0x7f5d7c061610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5d94001ed0 tx=0x7f5d94015000).stop 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 msgr2=0x7f5d980ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 --2- 172.21.15.133:0/3797452410 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d980c2180 0x7f5d980ae2d0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 rx=0x7f5d9806a460 tx=0x7f5d9000b040).stop 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5d9e942700 1 -- 172.21.15.133:0/3797452410 reap_dead start 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 shutdown_connections 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 >> 172.21.15.133:0/3797452410 conn(0x7f5d980c8f60 msgr2=0x7f5d981525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 shutdown_connections 2024-01-21T21:33:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.440+0000 7f5da03a5700 1 -- 172.21.15.133:0/3797452410 wait complete. 2024-01-21T21:33:52.455 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-21T21:33:52.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.567+0000 7f9d4b630700 1 Processor -- start 2024-01-21T21:33:52.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.567+0000 7f9d4b630700 1 -- start start 2024-01-21T21:33:52.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d4b630700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d440beb30 0x7f9d44155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d4b630700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d440c3fb0 0x7f9d440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d4b630700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d44065660 con 0x7f9d44069cd0 2024-01-21T21:33:52.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d4b630700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d440bef10 con 0x7f9d440beb30 2024-01-21T21:33:52.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d4b630700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d44156070 con 0x7f9d440c3fb0 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d493cc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d440beb30 0x7f9d44155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d49bcd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9d44069cd0 0x7f9d44151b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50494/0 (socket says 172.21.15.133:50494) 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d49bcd700 1 -- 172.21.15.133:0/1024946088 learned_addr learned my addr 172.21.15.133:0/1024946088 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d48bcb700 1 --2- 172.21.15.133:0/1024946088 >> v2:172.21.15.178:3300/0 conn(0x7f9d440c3fb0 0x7f9d440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d493cc700 1 -- 172.21.15.133:0/1024946088 >> v2:172.21.15.178:3300/0 conn(0x7f9d440c3fb0 msgr2=0x7f9d440697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d493cc700 1 --2- 172.21.15.133:0/1024946088 >> v2:172.21.15.178:3300/0 conn(0x7f9d440c3fb0 0x7f9d440697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d493cc700 1 -- 172.21.15.133:0/1024946088 >> v1:172.21.15.133:6789/0 conn(0x7f9d44069cd0 legacy=0x7f9d44151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d37fff700 1 -- 172.21.15.133:0/1024946088 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983231498 0 0) 0x7f9d44065660 con 0x7f9d44069cd0 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.568+0000 7f9d493cc700 1 -- 172.21.15.133:0/1024946088 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44065f00 con 0x7f9d440beb30 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d493cc700 1 --2- 172.21.15.133:0/1024946088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44155b80 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f9d4405ecd0 tx=0x7f9d38009060).ready entity=mon.0 client_cookie=b6a1071a313165af server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d37fff700 1 -- 172.21.15.133:0/1024946088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380090d0 con 0x7f9d440beb30 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d37fff700 1 -- 172.21.15.133:0/1024946088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800f510 con 0x7f9d440beb30 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d37fff700 1 -- 172.21.15.133:0/1024946088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800f890 con 0x7f9d440beb30 2024-01-21T21:33:52.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 -- 172.21.15.133:0/1024946088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 msgr2=0x7f9d44155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 --2- 172.21.15.133:0/1024946088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44155b80 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f9d4405ecd0 tx=0x7f9d38009060).stop 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 -- 172.21.15.133:0/1024946088 shutdown_connections 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 --2- 172.21.15.133:0/1024946088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44155b80 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 --2- 172.21.15.133:0/1024946088 >> v2:172.21.15.178:3300/0 conn(0x7f9d440c3fb0 0x7f9d440697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 -- 172.21.15.133:0/1024946088 >> 172.21.15.133:0/1024946088 conn(0x7f9d440c8010 msgr2=0x7f9d440c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 -- 172.21.15.133:0/1024946088 shutdown_connections 2024-01-21T21:33:52.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.569+0000 7f9d4b630700 1 -- 172.21.15.133:0/1024946088 wait complete. 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 Processor -- start 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 -- start start 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d44069cd0 0x7f9d441390e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d440c3fb0 0x7f9d440bf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440c00c0 con 0x7f9d440beb30 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440c0a10 con 0x7f9d440c3fb0 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d4b630700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d440bfb00 con 0x7f9d44069cd0 2024-01-21T21:33:52.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.571+0000 7f9d48bcb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35638/0 (socket says 172.21.15.133:35638) 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 -- 172.21.15.133:0/3745469905 learned_addr learned my addr 172.21.15.133:0/3745469905 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d493cc700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d44069cd0 0x7f9d441390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d49bcd700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d440c3fb0 0x7f9d440bf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 -- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d44069cd0 msgr2=0x7f9d441390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d44069cd0 0x7f9d441390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 -- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d440c3fb0 msgr2=0x7f9d440bf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d440c3fb0 0x7f9d440bf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 -- 172.21.15.133:0/3745469905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380092a0 con 0x7f9d440beb30 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d48bcb700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f9d4000e930 tx=0x7f9d40009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012600 con 0x7f9d440beb30 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d40012760 con 0x7f9d440beb30 2024-01-21T21:33:52.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d440bfde0 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40012ae0 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.572+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d441661f0 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.573+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d440c0500 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.574+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9d4001b400 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.574+0000 7f9d35ffb700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 0x7f9d28061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.574+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f9d4007a790 con 0x7f9d440beb30 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.574+0000 7f9d493cc700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 0x7f9d28061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.574+0000 7f9d493cc700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 0x7f9d28061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d38006f30 tx=0x7f9d38017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.578+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f9d440c0500 con 0x7f9d440beb30 2024-01-21T21:33:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.743+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d440c0500 con 0x7f9d2805f150 2024-01-21T21:33:52.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.743+0000 7f9d35ffb700 1 -- 172.21.15.133:0/3745469905 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9d440c0500 con 0x7f9d2805f150 2024-01-21T21:33:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 msgr2=0x7f9d28061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 0x7f9d28061610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9d38006f30 tx=0x7f9d38017000).stop 2024-01-21T21:33:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 msgr2=0x7f9d44165d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 rx=0x7f9d4000e930 tx=0x7f9d40009060).stop 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 shutdown_connections 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f9d2805f150 0x7f9d28061610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d440c3fb0 0x7f9d440bf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d44069cd0 0x7f9d441390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 --2- 172.21.15.133:0/3745469905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d440beb30 0x7f9d44165d00 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 >> 172.21.15.133:0/3745469905 conn(0x7f9d440c8010 msgr2=0x7f9d44139d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.745+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 shutdown_connections 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.746+0000 7f9d4b630700 1 -- 172.21.15.133:0/3745469905 wait complete. 2024-01-21T21:33:52.750 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2024-01-21T21:33:52.761 INFO:tasks.ceph:Scrubbing osd.2 2024-01-21T21:33:52.761 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:52.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.876+0000 7f246f9e7700 1 Processor -- start 2024-01-21T21:33:52.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.876+0000 7f246f9e7700 1 -- start start 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246f9e7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2468154250 0x7f2468154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246f9e7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468065f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246f9e7700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246806a4b0 con 0x7f2468069510 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246f9e7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2468069ef0 con 0x7f2468154250 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246f9e7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246806a1d0 con 0x7f2468062e00 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2468154250 0x7f2468154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2468154250 0x7f2468154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35648/0 (socket says 172.21.15.133:35648) 2024-01-21T21:33:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 -- 172.21.15.133:0/4285941210 learned_addr learned my addr 172.21.15.133:0/4285941210 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246df84700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 -- 172.21.15.133:0/4285941210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 msgr2=0x7f2468065f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468065f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 -- 172.21.15.133:0/4285941210 >> v1:172.21.15.178:6789/0 conn(0x7f2468069510 legacy=0x7f24680626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.877+0000 7f246d783700 1 -- 172.21.15.133:0/4285941210 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468065720 con 0x7f2468154250 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246d783700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468154630 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f2458006fd0 tx=0x7f24580090f0).ready entity=mon.0 client_cookie=18204dbf811fd25 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f245ffff700 1 -- 172.21.15.133:0/4285941210 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800b600 con 0x7f2468154250 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f245ffff700 1 -- 172.21.15.133:0/4285941210 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245800b760 con 0x7f2468154250 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f245ffff700 1 -- 172.21.15.133:0/4285941210 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245800bae0 con 0x7f2468154250 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 -- 172.21.15.133:0/4285941210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 msgr2=0x7f2468154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468154630 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f2458006fd0 tx=0x7f24580090f0).stop 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 -- 172.21.15.133:0/4285941210 shutdown_connections 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468154630 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 --2- 172.21.15.133:0/4285941210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468065f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 -- 172.21.15.133:0/4285941210 >> 172.21.15.133:0/4285941210 conn(0x7f24680c7d30 msgr2=0x7f24680c8140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 -- 172.21.15.133:0/4285941210 shutdown_connections 2024-01-21T21:33:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.878+0000 7f246f9e7700 1 -- 172.21.15.133:0/4285941210 wait complete. 2024-01-21T21:33:52.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.880+0000 7f246f9e7700 1 Processor -- start 2024-01-21T21:33:52.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.880+0000 7f246f9e7700 1 -- start start 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2468069510 0x7f24680a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468151f30 con 0x7f2468154250 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2468152210 con 0x7f2468069510 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246f9e7700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2468151370 con 0x7f2468062e00 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35650/0 (socket says 172.21.15.133:35650) 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 -- 172.21.15.133:0/1720854704 learned_addr learned my addr 172.21.15.133:0/1720854704 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246d783700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246cf82700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2468069510 0x7f24680a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 -- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 msgr2=0x7f2468155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2468062e00 0x7f2468155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 -- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2468069510 msgr2=0x7f24680a6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2468069510 0x7f24680a6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458009370 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.881+0000 7f246df84700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468150920 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f2460007ef0 tx=0x7f2460009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.882+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000eb30 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.882+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000ec90 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.882+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2468151650 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.882+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2460014610 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.882+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24680a6660 con 0x7f2468154250 2024-01-21T21:33:52.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.883+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2468151a40 con 0x7f2468154250 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.883+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f2460014a40 con 0x7f2468154250 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.883+0000 7f245dffb700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f244c05f150 0x7f244c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f246007ae90 con 0x7f2468154250 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f246d783700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f244c05f150 0x7f244c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f245dffb700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7f244c066060 0x7f244c068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f244c068ae0 con 0x7f244c066060 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f246007b180 con 0x7f2468154250 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f246cf82700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7f244c066060 0x7f244c068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f246d783700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f244c05f150 0x7f244c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2458009130 tx=0x7f2458017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.884+0000 7f246cf82700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7f244c066060 0x7f244c068500 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:52.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.885+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== osd.2 v2:172.21.15.133:6800/43673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f244c068ae0 con 0x7f244c066060 2024-01-21T21:33:52.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 --> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2468152380 con 0x7f244c066060 2024-01-21T21:33:52.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f245dffb700 1 -- 172.21.15.133:0/1720854704 <== osd.2 v2:172.21.15.133:6800/43673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2468152380 con 0x7f244c066060 2024-01-21T21:33:52.902 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:52.902 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:52.902 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7f244c066060 msgr2=0x7f244c068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6800/43673,v1:172.21.15.133:6801/43673] conn(0x7f244c066060 0x7f244c068500 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f244c05f150 msgr2=0x7f244c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f244c05f150 0x7f244c061610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2458009130 tx=0x7f2458017000).stop 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 msgr2=0x7f2468150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:52.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246f9e7700 1 --2- 172.21.15.133:0/1720854704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2468154250 0x7f2468150920 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f2460007ef0 tx=0x7f2460009840).stop 2024-01-21T21:33:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.898+0000 7f246df84700 1 -- 172.21.15.133:0/1720854704 reap_dead start 2024-01-21T21:33:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.899+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 shutdown_connections 2024-01-21T21:33:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.899+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 >> 172.21.15.133:0/1720854704 conn(0x7f24680c7d30 msgr2=0x7f24680acd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.899+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 shutdown_connections 2024-01-21T21:33:52.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:52.899+0000 7f246f9e7700 1 -- 172.21.15.133:0/1720854704 wait complete. 2024-01-21T21:33:52.914 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-21T21:33:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 Processor -- start 2024-01-21T21:33:53.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 -- start start 2024-01-21T21:33:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c0a9d10 0x7fd68c0ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd68c1558d0 0x7fd68c063be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c063750 con 0x7fd68c0aa0f0 2024-01-21T21:33:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0640d0 con 0x7fd68c0a9d10 2024-01-21T21:33:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.027+0000 7fd692729700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c05e380 con 0x7fd68c1558d0 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c0a9d10 0x7fd68c0ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c0a9d10 0x7fd68c0ad410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35662/0 (socket says 172.21.15.133:35662) 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 -- 172.21.15.133:0/2234911357 learned_addr learned my addr 172.21.15.133:0/2234911357 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd690cc6700 1 --2- 172.21.15.133:0/2234911357 >> v2:172.21.15.178:3300/0 conn(0x7fd68c1558d0 0x7fd68c063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 -- 172.21.15.133:0/2234911357 >> v2:172.21.15.178:3300/0 conn(0x7fd68c1558d0 msgr2=0x7fd68c063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 --2- 172.21.15.133:0/2234911357 >> v2:172.21.15.178:3300/0 conn(0x7fd68c1558d0 0x7fd68c063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 -- 172.21.15.133:0/2234911357 >> v1:172.21.15.178:6789/0 conn(0x7fd68c0aa0f0 legacy=0x7fd68c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 -- 172.21.15.133:0/2234911357 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c05e660 con 0x7fd68c0a9d10 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68bfff700 1 --2- 172.21.15.133:0/2234911357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c0ad410 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fd68c0bd3b0 tx=0x7fd67c0090f0).ready entity=mon.0 client_cookie=f9bb7d81216f5e3c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68affd700 1 -- 172.21.15.133:0/2234911357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00b520 con 0x7fd68c0a9d10 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68affd700 1 -- 172.21.15.133:0/2234911357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00b680 con 0x7fd68c0a9d10 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.028+0000 7fd68affd700 1 -- 172.21.15.133:0/2234911357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00ba20 con 0x7fd68c0a9d10 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 -- 172.21.15.133:0/2234911357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 msgr2=0x7fd68c0ad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 --2- 172.21.15.133:0/2234911357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c0ad410 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7fd68c0bd3b0 tx=0x7fd67c0090f0).stop 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 -- 172.21.15.133:0/2234911357 shutdown_connections 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 --2- 172.21.15.133:0/2234911357 >> v2:172.21.15.178:3300/0 conn(0x7fd68c1558d0 0x7fd68c063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 --2- 172.21.15.133:0/2234911357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c0ad410 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 -- 172.21.15.133:0/2234911357 >> 172.21.15.133:0/2234911357 conn(0x7fd68c0c8200 msgr2=0x7fd68c0c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 -- 172.21.15.133:0/2234911357 shutdown_connections 2024-01-21T21:33:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.029+0000 7fd692729700 1 -- 172.21.15.133:0/2234911357 wait complete. 2024-01-21T21:33:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.030+0000 7fd692729700 1 Processor -- start 2024-01-21T21:33:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.030+0000 7fd692729700 1 -- start start 2024-01-21T21:33:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd68c0aa0f0 0x7fd68c0bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 0x7fd68c0c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0c0600 con 0x7fd68c0a9d10 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c14b690 con 0x7fd68c0aa0f0 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd692729700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c144ed0 con 0x7fd68c1558d0 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35676/0 (socket says 172.21.15.133:35676) 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 -- 172.21.15.133:0/1437810469 learned_addr learned my addr 172.21.15.133:0/1437810469 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68b7fe700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd68c0aa0f0 0x7fd68c0bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd690cc6700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 0x7fd68c0c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 -- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 msgr2=0x7fd68c0c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 0x7fd68c0c0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 -- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd68c0aa0f0 msgr2=0x7fd68c0bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd68c0aa0f0 0x7fd68c0bfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd68bfff700 1 -- 172.21.15.133:0/1437810469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009370 con 0x7fd68c0a9d10 2024-01-21T21:33:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.031+0000 7fd690cc6700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 0x7fd68c0c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd68bfff700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7fd67c006fd0 tx=0x7fd67c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c000bc0 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00b7f0 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c14b060 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c000d20 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.032+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c14e230 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.033+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c05fdf0 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.033+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fd67c01c630 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.033+0000 7fd688ff9700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 0x7fd678061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.034+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fd67c07c000 con 0x7fd68c0a9d10 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.034+0000 7fd68b7fe700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 0x7fd678061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.034+0000 7fd68b7fe700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 0x7fd678061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd68c154ff0 tx=0x7fd680000bc0).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.038+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fd67c04d180 con 0x7fd68c0a9d10 2024-01-21T21:33:53.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.200+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68c0662a0 con 0x7fd67805f150 2024-01-21T21:33:53.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.200+0000 7fd688ff9700 1 -- 172.21.15.133:0/1437810469 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd68c0662a0 con 0x7fd67805f150 2024-01-21T21:33:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 msgr2=0x7fd678061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 0x7fd678061610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd68c154ff0 tx=0x7fd680000bc0).stop 2024-01-21T21:33:53.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 msgr2=0x7fd68c1449e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7fd67c006fd0 tx=0x7fd67c017000).stop 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 shutdown_connections 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd68c1558d0 0x7fd68c0c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c0a9d10 0x7fd68c1449e0 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fd67805f150 0x7fd678061610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 --2- 172.21.15.133:0/1437810469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd68c0aa0f0 0x7fd68c0bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 >> 172.21.15.133:0/1437810469 conn(0x7fd68c0c8200 msgr2=0x7fd68c0c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 shutdown_connections 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.202+0000 7fd692729700 1 -- 172.21.15.133:0/1437810469 wait complete. 2024-01-21T21:33:53.207 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2024-01-21T21:33:53.217 INFO:tasks.ceph:Scrubbing osd.3 2024-01-21T21:33:53.218 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.333+0000 7f37819df700 1 Processor -- start 2024-01-21T21:33:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.333+0000 7f37819df700 1 -- start start 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f377c0c0cf0 0x7f377c0c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c9050 0x7f377c1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f377c154eb0 0x7f377c14e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0c67a0 con 0x7f377c0c0cf0 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c1554f0 con 0x7f377c154eb0 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f37819df700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c1557d0 con 0x7f377c0c9050 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f377affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f377c0c0cf0 0x7f377c0c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f377affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f377c0c0cf0 0x7f377c0c10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35692/0 (socket says 172.21.15.133:35692) 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f377affd700 1 -- 172.21.15.133:0/4040305500 learned_addr learned my addr 172.21.15.133:0/4040305500 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f377a7fc700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c9050 0x7f377c1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.334+0000 7f377b7fe700 1 --2- 172.21.15.133:0/4040305500 >> v2:172.21.15.178:3300/0 conn(0x7f377c154eb0 0x7f377c14e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 -- 172.21.15.133:0/4040305500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c9050 msgr2=0x7f377c1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c9050 0x7f377c1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 -- 172.21.15.133:0/4040305500 >> v2:172.21.15.178:3300/0 conn(0x7f377c154eb0 msgr2=0x7f377c14e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 --2- 172.21.15.133:0/4040305500 >> v2:172.21.15.178:3300/0 conn(0x7f377c154eb0 0x7f377c14e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 -- 172.21.15.133:0/4040305500 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0c6430 con 0x7f377c0c0cf0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f377affd700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c0c0cf0 0x7f377c0c10d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f377c0c5e60 tx=0x7f3770009060).ready entity=mon.0 client_cookie=e63bfd273fe5e092 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f3779ffb700 1 -- 172.21.15.133:0/4040305500 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005880 con 0x7f377c0c0cf0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f3779ffb700 1 -- 172.21.15.133:0/4040305500 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37700059e0 con 0x7f377c0c0cf0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f3779ffb700 1 -- 172.21.15.133:0/4040305500 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770005d60 con 0x7f377c0c0cf0 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 -- 172.21.15.133:0/4040305500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c0c0cf0 msgr2=0x7f377c0c10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c0c0cf0 0x7f377c0c10d0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 rx=0x7f377c0c5e60 tx=0x7f3770009060).stop 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 -- 172.21.15.133:0/4040305500 shutdown_connections 2024-01-21T21:33:53.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 --2- 172.21.15.133:0/4040305500 >> v2:172.21.15.178:3300/0 conn(0x7f377c154eb0 0x7f377c14e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c0c0cf0 0x7f377c0c10d0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 --2- 172.21.15.133:0/4040305500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c9050 0x7f377c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 -- 172.21.15.133:0/4040305500 >> 172.21.15.133:0/4040305500 conn(0x7f377c084ee0 msgr2=0x7f377c094800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.335+0000 7f37819df700 1 -- 172.21.15.133:0/4040305500 shutdown_connections 2024-01-21T21:33:53.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.336+0000 7f37819df700 1 -- 172.21.15.133:0/4040305500 wait complete. 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.337+0000 7f37819df700 1 Processor -- start 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.337+0000 7f37819df700 1 -- start start 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c0cf0 0x7f377c098ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f377c0c9050 0x7f377c164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 0x7f377c096610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c164b30 con 0x7f377c154eb0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c164500 con 0x7f377c0c9050 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c096e60 con 0x7f377c0c0cf0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 0x7f377c096610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 0x7f377c096610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35698/0 (socket says 172.21.15.133:35698) 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 -- 172.21.15.133:0/1999539703 learned_addr learned my addr 172.21.15.133:0/1999539703 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377affd700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c0cf0 0x7f377c098ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377a7fc700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f377c0c9050 0x7f377c164fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 -- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c0cf0 msgr2=0x7f377c098ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f377c0c0cf0 0x7f377c098ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 -- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f377c0c9050 msgr2=0x7f377c164fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f377c0c9050 0x7f377c164fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770009300 con 0x7f377c154eb0 2024-01-21T21:33:53.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f377b7fe700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 0x7f377c096610 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f3774009e90 tx=0x7f377400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400caa0 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400f040 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c097140 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400ce10 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.338+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c096b00 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.339+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f377c05fdf0 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f3774013610 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f376805f150 0x7f3768061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f377407ab70 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f377affd700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f376805f150 0x7f3768061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f3768066060 0x7f3768068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3768068ae0 con 0x7f3768066060 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f377407f220 con 0x7f377c154eb0 2024-01-21T21:33:53.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f377a7fc700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f3768066060 0x7f3768068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.340+0000 7f377affd700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f376805f150 0x7f3768061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f377c0c5e60 tx=0x7f3770016000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.341+0000 7f377a7fc700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f3768066060 0x7f3768068500 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.341+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== osd.3 v2:172.21.15.133:6808/43674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f3768068ae0 con 0x7f3768066060 2024-01-21T21:33:53.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.354+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 --> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f377c164c70 con 0x7f3768066060 2024-01-21T21:33:53.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37637fe700 1 -- 172.21.15.133:0/1999539703 <== osd.3 v2:172.21.15.133:6808/43674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f377c164c70 con 0x7f3768066060 2024-01-21T21:33:53.359 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:53.359 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:53.359 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f3768066060 msgr2=0x7f3768068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6808/43674,v1:172.21.15.133:6809/43674] conn(0x7f3768066060 0x7f3768068500 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f376805f150 msgr2=0x7f3768061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f376805f150 0x7f3768061610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f377c0c5e60 tx=0x7f3770016000).stop 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 msgr2=0x7f377c096610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 --2- 172.21.15.133:0/1999539703 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f377c154eb0 0x7f377c096610 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f3774009e90 tx=0x7f377400b040).stop 2024-01-21T21:33:53.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f377b7fe700 1 -- 172.21.15.133:0/1999539703 reap_dead start 2024-01-21T21:33:53.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 shutdown_connections 2024-01-21T21:33:53.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 >> 172.21.15.133:0/1999539703 conn(0x7f377c084ee0 msgr2=0x7f377c0ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 shutdown_connections 2024-01-21T21:33:53.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.355+0000 7f37819df700 1 -- 172.21.15.133:0/1999539703 wait complete. 2024-01-21T21:33:53.370 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-21T21:33:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.483+0000 7f9879d1f700 1 Processor -- start 2024-01-21T21:33:53.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.483+0000 7f9879d1f700 1 -- start start 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9879d1f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 0x7f9874155b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9879d1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9874069ef0 0x7f9874066390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9879d1f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9874065660 con 0x7f98740c3fb0 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9879d1f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98740bef10 con 0x7f9874069ef0 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9879d1f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9874156070 con 0x7f98740beb30 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9873fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9874069ef0 0x7f9874066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9872ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98740c3fb0 0x7f98740697e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50502/0 (socket says 172.21.15.133:50502) 2024-01-21T21:33:53.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9872ffd700 1 -- 172.21.15.133:0/957563314 learned_addr learned my addr 172.21.15.133:0/957563314 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f9873fff700 1 --2- 172.21.15.133:0/957563314 >> v2:172.21.15.133:3300/0 conn(0x7f9874069ef0 0x7f9874066390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35710/0 (socket says 172.21.15.133:35710) 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.484+0000 7f98737fe700 1 --2- 172.21.15.133:0/957563314 >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 0x7f9874155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9873fff700 1 -- 172.21.15.133:0/957563314 >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 msgr2=0x7f9874155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9873fff700 1 --2- 172.21.15.133:0/957563314 >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 0x7f9874155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9873fff700 1 -- 172.21.15.133:0/957563314 >> v1:172.21.15.133:6789/0 conn(0x7f98740c3fb0 legacy=0x7f98740697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9873fff700 1 -- 172.21.15.133:0/957563314 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874065f00 con 0x7f9874069ef0 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f98727fc700 1 -- 172.21.15.133:0/957563314 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304027283 0 0) 0x7f9874065660 con 0x7f98740c3fb0 2024-01-21T21:33:53.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f98737fe700 1 --2- 172.21.15.133:0/957563314 >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 0x7f9874155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9873fff700 1 --2- 172.21.15.133:0/957563314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9874069ef0 0x7f9874066390 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f98740650a0 tx=0x7f986c009780).ready entity=mon.0 client_cookie=623238e415a2cae0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f98727fc700 1 -- 172.21.15.133:0/957563314 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00e070 con 0x7f9874069ef0 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f98727fc700 1 -- 172.21.15.133:0/957563314 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00bbf0 con 0x7f9874069ef0 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f98727fc700 1 -- 172.21.15.133:0/957563314 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c012410 con 0x7f9874069ef0 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 -- 172.21.15.133:0/957563314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9874069ef0 msgr2=0x7f9874066390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 --2- 172.21.15.133:0/957563314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9874069ef0 0x7f9874066390 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 rx=0x7f98740650a0 tx=0x7f986c009780).stop 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 -- 172.21.15.133:0/957563314 shutdown_connections 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 --2- 172.21.15.133:0/957563314 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9874069ef0 0x7f9874066390 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 --2- 172.21.15.133:0/957563314 >> v2:172.21.15.178:3300/0 conn(0x7f98740beb30 0x7f9874155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 -- 172.21.15.133:0/957563314 >> 172.21.15.133:0/957563314 conn(0x7f98740c8010 msgr2=0x7f98740c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 -- 172.21.15.133:0/957563314 shutdown_connections 2024-01-21T21:33:53.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.485+0000 7f9879d1f700 1 -- 172.21.15.133:0/957563314 wait complete. 2024-01-21T21:33:53.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.487+0000 7f9879d1f700 1 Processor -- start 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.487+0000 7f9879d1f700 1 -- start start 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 0x7f98740a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98740c3fb0 0x7f9874150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9874169440 con 0x7f98740beb30 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98740a5cf0 con 0x7f98740c3fb0 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9874168550 con 0x7f9874069ef0 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35720/0 (socket says 172.21.15.133:35720) 2024-01-21T21:33:53.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 -- 172.21.15.133:0/4110829825 learned_addr learned my addr 172.21.15.133:0/4110829825 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9873fff700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98740c3fb0 0x7f9874150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f98737fe700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 0x7f98740a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 -- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 msgr2=0x7f98740a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 0x7f98740a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 -- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98740c3fb0 msgr2=0x7f9874150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98740c3fb0 0x7f9874150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 -- 172.21.15.133:0/4110829825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009a20 con 0x7f98740beb30 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f98737fe700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 0x7f98740a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9872ffd700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f986400c4e0 tx=0x7f9864007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640072e0 con 0x7f98740beb30 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9864007440 con 0x7f98740beb30 2024-01-21T21:33:53.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9874168830 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640057a0 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.488+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9874168df0 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.489+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9874164fd0 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.490+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f9864005bd0 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.490+0000 7f985bfff700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 0x7f9860061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.490+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f9864079b00 con 0x7f98740beb30 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.490+0000 7f98737fe700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 0x7f9860061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.490+0000 7f98737fe700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 0x7f9860061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9868006fd0 tx=0x7f9868008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.494+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f986404ac80 con 0x7f98740beb30 2024-01-21T21:33:53.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.659+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f98740c4740 con 0x7f986005f150 2024-01-21T21:33:53.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.660+0000 7f985bfff700 1 -- 172.21.15.133:0/4110829825 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f98740c4740 con 0x7f986005f150 2024-01-21T21:33:53.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 msgr2=0x7f9860061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 0x7f9860061610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9868006fd0 tx=0x7f9868008040).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 msgr2=0x7f9874139bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f986400c4e0 tx=0x7f9864007c70).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 shutdown_connections 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f986005f150 0x7f9860061610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98740c3fb0 0x7f9874150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874069ef0 0x7f98740a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 --2- 172.21.15.133:0/4110829825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98740beb30 0x7f9874139bc0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.661+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 >> 172.21.15.133:0/4110829825 conn(0x7f98740c8010 msgr2=0x7f98740bdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.662+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 shutdown_connections 2024-01-21T21:33:53.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.662+0000 7f9879d1f700 1 -- 172.21.15.133:0/4110829825 wait complete. 2024-01-21T21:33:53.667 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2024-01-21T21:33:53.677 INFO:tasks.ceph:Scrubbing osd.4 2024-01-21T21:33:53.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:53.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.793+0000 7f70a45fa700 1 Processor -- start 2024-01-21T21:33:53.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.794+0000 7f70a45fa700 1 -- start start 2024-01-21T21:33:53.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.794+0000 7f70a45fa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f709c0bda90 0x7f709c0694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a45fa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0c23b0 con 0x7f709c13a7b0 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a45fa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c067600 con 0x7f709c0c3850 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a45fa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0663c0 con 0x7f709c0bda90 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1b95700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f709c0bda90 0x7f709c0694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a2396700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f709c13a7b0 0x7f709c066b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50516/0 (socket says 172.21.15.133:50516) 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a2396700 1 -- 172.21.15.133:0/2970515168 learned_addr learned my addr 172.21.15.133:0/2970515168 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1b95700 1 -- 172.21.15.133:0/2970515168 >> v1:172.21.15.178:6789/0 conn(0x7f709c0c3850 legacy=0x7f709c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1b95700 1 -- 172.21.15.133:0/2970515168 >> v1:172.21.15.133:6789/0 conn(0x7f709c13a7b0 legacy=0x7f709c066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1b95700 1 -- 172.21.15.133:0/2970515168 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0678e0 con 0x7f709c0bda90 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1b95700 1 --2- 172.21.15.133:0/2970515168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c0bda90 0x7f709c0694d0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f7098009760 tx=0x7f7098009060).ready entity=mon.0 client_cookie=31c93b5cdd8c7640 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1394700 1 -- 172.21.15.133:0/2970515168 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980090d0 con 0x7f709c0bda90 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1394700 1 -- 172.21.15.133:0/2970515168 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800f510 con 0x7f709c0bda90 2024-01-21T21:33:53.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.795+0000 7f70a1394700 1 -- 172.21.15.133:0/2970515168 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800f890 con 0x7f709c0bda90 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 -- 172.21.15.133:0/2970515168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c0bda90 msgr2=0x7f709c0694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 --2- 172.21.15.133:0/2970515168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c0bda90 0x7f709c0694d0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7f7098009760 tx=0x7f7098009060).stop 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 -- 172.21.15.133:0/2970515168 shutdown_connections 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 --2- 172.21.15.133:0/2970515168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c0bda90 0x7f709c0694d0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 -- 172.21.15.133:0/2970515168 >> 172.21.15.133:0/2970515168 conn(0x7f709c0c7d20 msgr2=0x7f709c0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 -- 172.21.15.133:0/2970515168 shutdown_connections 2024-01-21T21:33:53.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.796+0000 7f70a45fa700 1 -- 172.21.15.133:0/2970515168 wait complete. 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.797+0000 7f70a45fa700 1 Processor -- start 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.797+0000 7f70a45fa700 1 -- start start 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f709c0c3850 0x7f709c0a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 0x7f709c0694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f709c0699c0 0x7f709c161d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c152e20 con 0x7f709c13a7b0 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c069e20 con 0x7f709c0699c0 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a45fa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c162af0 con 0x7f709c0c3850 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 0x7f709c0694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 0x7f709c0694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35744/0 (socket says 172.21.15.133:35744) 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 -- 172.21.15.133:0/194696480 learned_addr learned my addr 172.21.15.133:0/194696480 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a2396700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f709c0c3850 0x7f709c0a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a2b97700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f709c0699c0 0x7f709c161d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 -- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f709c0c3850 msgr2=0x7f709c0a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f709c0c3850 0x7f709c0a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 -- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f709c0699c0 msgr2=0x7f709c161d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f709c0699c0 0x7f709c161d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980092a0 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.798+0000 7f70a1b95700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 0x7f709c0694d0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f7098009eb0 tx=0x7f7098017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709801f070 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800f680 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800fea0 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c165220 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c1657e0 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.799+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f709c05fdf0 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.800+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f7098011400 con 0x7f709c13a7b0 2024-01-21T21:33:53.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.800+0000 7f708effd700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f708005f150 0x7f7080061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.800+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f709807d8a0 con 0x7f709c13a7b0 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.800+0000 7f70a2396700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f708005f150 0x7f7080061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f708effd700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f7080066060 0x7f7080068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7080068ae0 con 0x7f7080066060 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f709807dc50 con 0x7f709c13a7b0 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f70a2b97700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f7080066060 0x7f7080068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f70a2396700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f708005f150 0x7f7080061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7090005750 tx=0x7f7090009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.801+0000 7f70a2b97700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f7080066060 0x7f7080068500 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.802+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== osd.4 v2:172.21.15.178:6800/43897 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f7080068ae0 con 0x7f7080066060 2024-01-21T21:33:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 --> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f709c067bc0 con 0x7f7080066060 2024-01-21T21:33:53.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f708effd700 1 -- 172.21.15.133:0/194696480 <== osd.4 v2:172.21.15.178:6800/43897 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f709c067bc0 con 0x7f7080066060 2024-01-21T21:33:53.819 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:53.819 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:53.819 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f7080066060 msgr2=0x7f7080068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.178:6800/43897,v1:172.21.15.178:6801/43897] conn(0x7f7080066060 0x7f7080068500 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f708005f150 msgr2=0x7f7080061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f708005f150 0x7f7080061610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7090005750 tx=0x7f7090009040).stop 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 msgr2=0x7f709c0694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 --2- 172.21.15.133:0/194696480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f709c13a7b0 0x7f709c0694d0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f7098009eb0 tx=0x7f7098017000).stop 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a2b97700 1 -- 172.21.15.133:0/194696480 reap_dead start 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 shutdown_connections 2024-01-21T21:33:53.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 >> 172.21.15.133:0/194696480 conn(0x7f709c0c7d20 msgr2=0x7f709c1540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 shutdown_connections 2024-01-21T21:33:53.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.815+0000 7f70a45fa700 1 -- 172.21.15.133:0/194696480 wait complete. 2024-01-21T21:33:53.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-21T21:33:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.944+0000 7f46ed373700 1 Processor -- start 2024-01-21T21:33:53.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.944+0000 7f46ed373700 1 -- start start 2024-01-21T21:33:53.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46ed373700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46e80c67b0 0x7f46e815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46ed373700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e80c89d0 con 0x7f46e81545a0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46ed373700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e80c7dc0 con 0x7f46e80c77b0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46ed373700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e80c80a0 con 0x7f46e80c67b0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46e80c67b0 0x7f46e815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f46e81545a0 0x7f46e80aa360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50528/0 (socket says 172.21.15.133:50528) 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f46e80c67b0 0x7f46e815f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35756/0 (socket says 172.21.15.133:35756) 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e6ffd700 1 -- 172.21.15.133:0/1085368325 learned_addr learned my addr 172.21.15.133:0/1085368325 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 -- 172.21.15.133:0/1085368325 >> v1:172.21.15.178:6789/0 conn(0x7f46e80c77b0 legacy=0x7f46e80c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 -- 172.21.15.133:0/1085368325 >> v1:172.21.15.133:6789/0 conn(0x7f46e81545a0 legacy=0x7f46e80aa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 -- 172.21.15.133:0/1085368325 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80c8380 con 0x7f46e80c67b0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e5ffb700 1 -- 172.21.15.133:0/1085368325 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107574403 0 0) 0x7f46e80c89d0 con 0x7f46e81545a0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e77fe700 1 --2- 172.21.15.133:0/1085368325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e815f640 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f46e0009de0 tx=0x7f46e0009780).ready entity=mon.0 client_cookie=7552c9984719102c server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e5ffb700 1 -- 172.21.15.133:0/1085368325 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000e070 con 0x7f46e80c67b0 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e5ffb700 1 -- 172.21.15.133:0/1085368325 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e000bae0 con 0x7f46e80c67b0 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.945+0000 7f46e5ffb700 1 -- 172.21.15.133:0/1085368325 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000be60 con 0x7f46e80c67b0 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 -- 172.21.15.133:0/1085368325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 msgr2=0x7f46e815f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 --2- 172.21.15.133:0/1085368325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e815f640 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7f46e0009de0 tx=0x7f46e0009780).stop 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 -- 172.21.15.133:0/1085368325 shutdown_connections 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 --2- 172.21.15.133:0/1085368325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e815f640 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 -- 172.21.15.133:0/1085368325 >> 172.21.15.133:0/1085368325 conn(0x7f46e80649d0 msgr2=0x7f46e8064de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 -- 172.21.15.133:0/1085368325 shutdown_connections 2024-01-21T21:33:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.946+0000 7f46ed373700 1 -- 172.21.15.133:0/1085368325 wait complete. 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.947+0000 7f46ed373700 1 Processor -- start 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.947+0000 7f46ed373700 1 -- start start 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e80c77b0 0x7f46e8142e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e81545a0 0x7f46e81555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80af700 con 0x7f46e80c67b0 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8143360 con 0x7f46e80c77b0 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46ed373700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e80afc50 con 0x7f46e81545a0 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35766/0 (socket says 172.21.15.133:35766) 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 -- 172.21.15.133:0/4234134106 learned_addr learned my addr 172.21.15.133:0/4234134106 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e67fc700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e80c77b0 0x7f46e8142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e77fe700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e81545a0 0x7f46e81555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 -- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e81545a0 msgr2=0x7f46e81555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e81545a0 0x7f46e81555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 -- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e80c77b0 msgr2=0x7f46e8142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e80c77b0 0x7f46e8142e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.948+0000 7f46e6ffd700 1 -- 172.21.15.133:0/4234134106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0009a20 con 0x7f46e80c67b0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46e6ffd700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f46d800c4c0 tx=0x7f46d8007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800ce10 con 0x7f46e80c67b0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80072e0 con 0x7f46e80c67b0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80057a0 con 0x7f46e80c67b0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8155da0 con 0x7f46e80c67b0 2024-01-21T21:33:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.949+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e80af8e0 con 0x7f46e80c67b0 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.950+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e81562c0 con 0x7f46e80c67b0 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.950+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f46d8005bd0 con 0x7f46e80c67b0 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.950+0000 7f46cf7fe700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 0x7f46d4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.950+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f46d80799a0 con 0x7f46e80c67b0 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.950+0000 7f46e67fc700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 0x7f46d4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.951+0000 7f46e67fc700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 0x7f46d4061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f46e8154db0 tx=0x7f46dc007cc0).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:53.954+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f46e81562c0 con 0x7f46e80c67b0 2024-01-21T21:33:54.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.120+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f46e80afd90 con 0x7f46d405f150 2024-01-21T21:33:54.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.121+0000 7f46cf7fe700 1 -- 172.21.15.133:0/4234134106 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46dc003640 con 0x7f46d405f150 2024-01-21T21:33:54.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.122+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 msgr2=0x7f46d4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.122+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 0x7f46d4061610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f46e8154db0 tx=0x7f46dc007cc0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.122+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 msgr2=0x7f46e80aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.122+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7f46d800c4c0 tx=0x7f46d8007cd0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 shutdown_connections 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e81545a0 0x7f46e81555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46e80c67b0 0x7f46e80aecb0 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f46d405f150 0x7f46d4061610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 --2- 172.21.15.133:0/4234134106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e80c77b0 0x7f46e8142e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 >> 172.21.15.133:0/4234134106 conn(0x7f46e80649d0 msgr2=0x7f46e80c4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 shutdown_connections 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.123+0000 7f46ed373700 1 -- 172.21.15.133:0/4234134106 wait complete. 2024-01-21T21:33:54.127 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2024-01-21T21:33:54.138 INFO:tasks.ceph:Scrubbing osd.5 2024-01-21T21:33:54.138 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:54.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.254+0000 7f41e269c700 1 Processor -- start 2024-01-21T21:33:54.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.254+0000 7f41e269c700 1 -- start start 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e269c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41dc069be0 0x7f41dc15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e269c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0c23b0 con 0x7f41dc13a7b0 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e269c700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc067600 con 0x7f41dc0bda90 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e269c700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0663c0 con 0x7f41dc069be0 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41dbfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f41dc13a7b0 0x7f41dc066b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50540/0 (socket says 172.21.15.133:50540) 2024-01-21T21:33:54.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41dbfff700 1 -- 172.21.15.133:0/2694486749 learned_addr learned my addr 172.21.15.133:0/2694486749 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e0c39700 1 --2- 172.21.15.133:0/2694486749 >> v2:172.21.15.178:3300/0 conn(0x7f41dc069be0 0x7f41dc15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147771169 0 0) 0x7f41dc0c23b0 con 0x7f41dc13a7b0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c40033f0 con 0x7f41dc13a7b0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179319536 0 0) 0x7f41dc067600 con 0x7f41dc0bda90 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41dc0c23b0 con 0x7f41dc0bda90 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 254191825 0 0) 0x7f41c40033f0 con 0x7f41dc13a7b0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e0c39700 1 -- 172.21.15.133:0/2694486749 >> v1:172.21.15.178:6789/0 conn(0x7f41dc0bda90 legacy=0x7f41dc0694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e0c39700 1 -- 172.21.15.133:0/2694486749 >> v1:172.21.15.133:6789/0 conn(0x7f41dc13a7b0 legacy=0x7f41dc066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e0c39700 1 -- 172.21.15.133:0/2694486749 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0678e0 con 0x7f41dc069be0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.255+0000 7f41e0c39700 1 --2- 172.21.15.133:0/2694486749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc069be0 0x7f41dc15bba0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f41d4009e60 tx=0x7f41d4009780).ready entity=mon.1 client_cookie=59eed65736ba1ea4 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d400e070 con 0x7f41dc069be0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d400b7a0 con 0x7f41dc069be0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41daffd700 1 -- 172.21.15.133:0/2694486749 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc001470 con 0x7f41dc069be0 2024-01-21T21:33:54.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 -- 172.21.15.133:0/2694486749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc069be0 msgr2=0x7f41dc15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 --2- 172.21.15.133:0/2694486749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc069be0 0x7f41dc15bba0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f41d4009e60 tx=0x7f41d4009780).stop 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 -- 172.21.15.133:0/2694486749 shutdown_connections 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 --2- 172.21.15.133:0/2694486749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc069be0 0x7f41dc15bba0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 -- 172.21.15.133:0/2694486749 >> 172.21.15.133:0/2694486749 conn(0x7f41dc0c7d20 msgr2=0x7f41dc0c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 -- 172.21.15.133:0/2694486749 shutdown_connections 2024-01-21T21:33:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.256+0000 7f41e269c700 1 -- 172.21.15.133:0/2694486749 wait complete. 2024-01-21T21:33:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.257+0000 7f41e269c700 1 Processor -- start 2024-01-21T21:33:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 -- start start 2024-01-21T21:33:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41dc069be0 0x7f41dc0c1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc13a7b0 0x7f41dc162600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 0x7f41dc0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0c1780 con 0x7f41dc0aa190 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc162af0 con 0x7f41dc13a7b0 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e269c700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0bf190 con 0x7f41dc069be0 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e0c39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 0x7f41dc0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e0c39700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 0x7f41dc0bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35772/0 (socket says 172.21.15.133:35772) 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.258+0000 7f41e0c39700 1 -- 172.21.15.133:0/1802072447 learned_addr learned my addr 172.21.15.133:0/1802072447 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41db7fe700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc13a7b0 0x7f41dc162600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41dbfff700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41dc069be0 0x7f41dc0c1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 -- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41dc069be0 msgr2=0x7f41dc0c1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41dc069be0 0x7f41dc0c1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 -- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc13a7b0 msgr2=0x7f41dc162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc13a7b0 0x7f41dc162600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4009a20 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e0c39700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 0x7f41dc0bf870 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7f41d400b610 tx=0x7f41d4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d401e480 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d401e5e0 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc0bf470 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d401e960 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.259+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc0c1c60 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.260+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41dc0bf690 con 0x7f41dc0aa190 2024-01-21T21:33:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f41d401ed50 con 0x7f41dc0aa190 2024-01-21T21:33:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f41c805f150 0x7f41c8061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f41d407ca40 con 0x7f41dc0aa190 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41dbfff700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f41c805f150 0x7f41c8061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7f41c80660e0 0x7f41c8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41c8068b60 con 0x7f41c80660e0 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.261+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41d407cd70 con 0x7f41dc0aa190 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.262+0000 7f41db7fe700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7f41c80660e0 0x7f41c8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.262+0000 7f41dbfff700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f41c805f150 0x7f41c8061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f41cc001660 tx=0x7f41cc001520).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.262+0000 7f41db7fe700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7f41c80660e0 0x7f41c8068580 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.263+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== osd.5 v2:172.21.15.178:6816/43898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f41c8068b60 con 0x7f41c80660e0 2024-01-21T21:33:54.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.276+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 --> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f41dc0bce70 con 0x7f41c80660e0 2024-01-21T21:33:54.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.276+0000 7f41d8ff9700 1 -- 172.21.15.133:0/1802072447 <== osd.5 v2:172.21.15.178:6816/43898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f41dc0bce70 con 0x7f41c80660e0 2024-01-21T21:33:54.280 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:54.280 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:54.280 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.276+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7f41c80660e0 msgr2=0x7f41c8068580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.276+0000 7f41e269c700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.178:6816/43898,v1:172.21.15.178:6817/43898] conn(0x7f41c80660e0 0x7f41c8068580 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f41c805f150 msgr2=0x7f41c8061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f41c805f150 0x7f41c8061610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f41cc001660 tx=0x7f41cc001520).stop 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 msgr2=0x7f41dc0bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 --2- 172.21.15.133:0/1802072447 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f41dc0aa190 0x7f41dc0bf870 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7f41d400b610 tx=0x7f41d4009780).stop 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e0c39700 1 -- 172.21.15.133:0/1802072447 reap_dead start 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 shutdown_connections 2024-01-21T21:33:54.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 >> 172.21.15.133:0/1802072447 conn(0x7f41dc0c7d20 msgr2=0x7f41dc0ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 shutdown_connections 2024-01-21T21:33:54.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.277+0000 7f41e269c700 1 -- 172.21.15.133:0/1802072447 wait complete. 2024-01-21T21:33:54.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-21T21:33:54.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.405+0000 7f1645046700 1 Processor -- start 2024-01-21T21:33:54.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.405+0000 7f1645046700 1 -- start start 2024-01-21T21:33:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f1645046700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16400c3c20 0x7f164013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f1645046700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164013a9e0 0x7f16400bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f1645046700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16400c64d0 con 0x7f16400c3840 2024-01-21T21:33:54.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f1645046700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1640067f10 con 0x7f16400c3c20 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f1645046700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400681f0 con 0x7f164013a9e0 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16400c3c20 0x7f164013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16400c3840 0x7f16400c5dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50548/0 (socket says 172.21.15.133:50548) 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16400c3c20 0x7f164013a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35780/0 (socket says 172.21.15.133:35780) 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163ed9d700 1 -- 172.21.15.133:0/1722027182 learned_addr learned my addr 172.21.15.133:0/1722027182 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163f59e700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164013a9e0 0x7f16400bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 -- 172.21.15.133:0/1722027182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164013a9e0 msgr2=0x7f16400bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164013a9e0 0x7f16400bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 -- 172.21.15.133:0/1722027182 >> v1:172.21.15.133:6789/0 conn(0x7f16400c3840 legacy=0x7f16400c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163e59c700 1 -- 172.21.15.133:0/1722027182 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400684d0 con 0x7f16400c3c20 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.406+0000 7f163dd9b700 1 -- 172.21.15.133:0/1722027182 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317284306 0 0) 0x7f1634001110 con 0x7f16400c3840 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f163e59c700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f164013a4f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f1630009760 tx=0x7f1630009060).ready entity=mon.0 client_cookie=8b7d5c2f786b4edb server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f163dd9b700 1 -- 172.21.15.133:0/1722027182 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16300090d0 con 0x7f16400c3c20 2024-01-21T21:33:54.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f163dd9b700 1 -- 172.21.15.133:0/1722027182 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000f510 con 0x7f16400c3c20 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f163dd9b700 1 -- 172.21.15.133:0/1722027182 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000f890 con 0x7f16400c3c20 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 -- 172.21.15.133:0/1722027182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 msgr2=0x7f164013a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f164013a4f0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 rx=0x7f1630009760 tx=0x7f1630009060).stop 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 -- 172.21.15.133:0/1722027182 shutdown_connections 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164013a9e0 0x7f16400bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 --2- 172.21.15.133:0/1722027182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f164013a4f0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 -- 172.21.15.133:0/1722027182 >> 172.21.15.133:0/1722027182 conn(0x7f1640066a70 msgr2=0x7f1640066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 -- 172.21.15.133:0/1722027182 shutdown_connections 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.407+0000 7f1645046700 1 -- 172.21.15.133:0/1722027182 wait complete. 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.409+0000 7f1645046700 1 Processor -- start 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.409+0000 7f1645046700 1 -- start start 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16400c3840 0x7f16401523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164013a9e0 0x7f16401681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640153690 con 0x7f16400c3c20 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1640152dd0 con 0x7f164013a9e0 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f1645046700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1640150510 con 0x7f16400c3840 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35786/0 (socket says 172.21.15.133:35786) 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 -- 172.21.15.133:0/798985427 learned_addr learned my addr 172.21.15.133:0/798985427 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163ed9d700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16400c3840 0x7f16401523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163f59e700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164013a9e0 0x7f16401681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 -- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16400c3840 msgr2=0x7f16401523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16400c3840 0x7f16401523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 -- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164013a9e0 msgr2=0x7f16401681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164013a9e0 0x7f16401681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 -- 172.21.15.133:0/798985427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300092a0 con 0x7f16400c3c20 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.410+0000 7f163e59c700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f1630009e00 tx=0x7f1630017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.411+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000f890 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.411+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1630009e30 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.411+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000fea0 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.411+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164013b450 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.411+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164013ba10 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.412+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164005fdf0 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.412+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f163001b650 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.412+0000 7f16277fe700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 0x7f162c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.412+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f163007b7c0 con 0x7f16400c3c20 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.412+0000 7f163ed9d700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 0x7f162c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.413+0000 7f163ed9d700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 0x7f162c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1634007fd0 tx=0x7f1634007dd0).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.416+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f163004c940 con 0x7f16400c3c20 2024-01-21T21:33:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.581+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f16400aba60 con 0x7f162c05f150 2024-01-21T21:33:54.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.581+0000 7f16277fe700 1 -- 172.21.15.133:0/798985427 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f16400aba60 con 0x7f162c05f150 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 msgr2=0x7f162c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 0x7f162c061610 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1634007fd0 tx=0x7f1634007dd0).stop 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 msgr2=0x7f16401528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f1630009e00 tx=0x7f1630017000).stop 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 shutdown_connections 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f162c05f150 0x7f162c061610 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164013a9e0 0x7f16401681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16400c3840 0x7f16401523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 --2- 172.21.15.133:0/798985427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16400c3c20 0x7f16401528e0 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 >> 172.21.15.133:0/798985427 conn(0x7f1640066a70 msgr2=0x7f1640137d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 shutdown_connections 2024-01-21T21:33:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.583+0000 7f1645046700 1 -- 172.21.15.133:0/798985427 wait complete. 2024-01-21T21:33:54.588 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2024-01-21T21:33:54.598 INFO:tasks.ceph:Scrubbing osd.6 2024-01-21T21:33:54.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:54.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.714+0000 7f0e5feec700 1 Processor -- start 2024-01-21T21:33:54.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.714+0000 7f0e5feec700 1 -- start start 2024-01-21T21:33:54.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5feec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e58066b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5feec700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0e58069be0 0x7f0e5815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5feec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580c23b0 con 0x7f0e580bda90 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5feec700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580663c0 con 0x7f0e58069be0 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5feec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58067600 con 0x7f0e5813a7b0 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5d487700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0e580bda90 0x7f0e580694d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50560/0 (socket says 172.21.15.133:50560) 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5d487700 1 -- 172.21.15.133:0/1814134876 learned_addr learned my addr 172.21.15.133:0/1814134876 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5e489700 1 --2- 172.21.15.133:0/1814134876 >> v2:172.21.15.178:3300/0 conn(0x7f0e58069be0 0x7f0e5815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5dc88700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e58066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5cc86700 1 -- 172.21.15.133:0/1814134876 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715948977 0 0) 0x7f0e580c23b0 con 0x7f0e580bda90 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5cc86700 1 -- 172.21.15.133:0/1814134876 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e440033f0 con 0x7f0e580bda90 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5e489700 1 -- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 msgr2=0x7f0e58066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5e489700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e58066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5e489700 1 -- 172.21.15.133:0/1814134876 >> v1:172.21.15.133:6789/0 conn(0x7f0e580bda90 legacy=0x7f0e580694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5e489700 1 -- 172.21.15.133:0/1814134876 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580678e0 con 0x7f0e58069be0 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.715+0000 7f0e5dc88700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e58066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5e489700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58069be0 0x7f0e5815ab90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0e50009e60 tx=0x7f0e50009780).ready entity=mon.1 client_cookie=38055404eb899535 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5cc86700 1 -- 172.21.15.133:0/1814134876 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000e070 con 0x7f0e58069be0 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5cc86700 1 -- 172.21.15.133:0/1814134876 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000bab0 con 0x7f0e58069be0 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5cc86700 1 -- 172.21.15.133:0/1814134876 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000be30 con 0x7f0e58069be0 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 -- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58069be0 msgr2=0x7f0e5815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58069be0 0x7f0e5815ab90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f0e50009e60 tx=0x7f0e50009780).stop 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 -- 172.21.15.133:0/1814134876 shutdown_connections 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e58066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 --2- 172.21.15.133:0/1814134876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58069be0 0x7f0e5815ab90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 -- 172.21.15.133:0/1814134876 >> 172.21.15.133:0/1814134876 conn(0x7f0e580c7d20 msgr2=0x7f0e580c8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 -- 172.21.15.133:0/1814134876 shutdown_connections 2024-01-21T21:33:54.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.716+0000 7f0e5feec700 1 -- 172.21.15.133:0/1814134876 wait complete. 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.717+0000 7f0e5feec700 1 Processor -- start 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 -- start start 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 0x7f0e5814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e580aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e580c3910 0x7f0e580c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ac030 con 0x7f0e58069be0 2024-01-21T21:33:54.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ab1a0 con 0x7f0e580c3910 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5feec700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580ab420 con 0x7f0e5813a7b0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5dc88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 0x7f0e5814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5dc88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 0x7f0e5814e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35800/0 (socket says 172.21.15.133:35800) 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.718+0000 7f0e5dc88700 1 -- 172.21.15.133:0/4094719044 learned_addr learned my addr 172.21.15.133:0/4094719044 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5d487700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e580aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5e489700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e580c3910 0x7f0e580c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 -- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 msgr2=0x7f0e580aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e5813a7b0 0x7f0e580aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 -- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e580c3910 msgr2=0x7f0e580c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e580c3910 0x7f0e580c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540092a0 con 0x7f0e58069be0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5dc88700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 0x7f0e5814e5f0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f0e5400e9b0 tx=0x7f0e54009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400c670 con 0x7f0e58069be0 2024-01-21T21:33:54.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5400c7d0 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400cb50 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50009a20 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.719+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580ab9e0 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.720+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e5805fdf0 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.720+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0e5401b400 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e4e7fc700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0e3c05f150 0x7f0e3c061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f0e5407a7e0 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e5d487700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0e3c05f150 0x7f0e3c061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e4e7fc700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f0e3c066060 0x7f0e3c068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e3c068ae0 con 0x7f0e3c066060 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e5407f220 con 0x7f0e58069be0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e5e489700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f0e3c066060 0x7f0e3c068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e5d487700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0e3c05f150 0x7f0e3c061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0e5814f600 tx=0x7f0e48009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.721+0000 7f0e5e489700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f0e3c066060 0x7f0e3c068500 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.722+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== osd.6 v2:172.21.15.178:6808/43899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f0e3c068ae0 con 0x7f0e3c066060 2024-01-21T21:33:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.735+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 --> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0e580ac170 con 0x7f0e3c066060 2024-01-21T21:33:54.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.735+0000 7f0e4e7fc700 1 -- 172.21.15.133:0/4094719044 <== osd.6 v2:172.21.15.178:6808/43899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0e5000be70 con 0x7f0e3c066060 2024-01-21T21:33:54.739 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:54.739 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:54.740 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f0e3c066060 msgr2=0x7f0e3c068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.178:6808/43899,v1:172.21.15.178:6809/43899] conn(0x7f0e3c066060 0x7f0e3c068500 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0e3c05f150 msgr2=0x7f0e3c061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0e3c05f150 0x7f0e3c061610 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f0e5814f600 tx=0x7f0e48009040).stop 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 msgr2=0x7f0e5814e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 --2- 172.21.15.133:0/4094719044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e58069be0 0x7f0e5814e5f0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 rx=0x7f0e5400e9b0 tx=0x7f0e54009060).stop 2024-01-21T21:33:54.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5e489700 1 -- 172.21.15.133:0/4094719044 reap_dead start 2024-01-21T21:33:54.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 shutdown_connections 2024-01-21T21:33:54.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 >> 172.21.15.133:0/4094719044 conn(0x7f0e580c7d20 msgr2=0x7f0e580626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 shutdown_connections 2024-01-21T21:33:54.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.736+0000 7f0e5feec700 1 -- 172.21.15.133:0/4094719044 wait complete. 2024-01-21T21:33:54.751 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-21T21:33:54.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.864+0000 7ff41d135700 1 Processor -- start 2024-01-21T21:33:54.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.864+0000 7ff41d135700 1 -- start start 2024-01-21T21:33:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41d135700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4180c3c20 0x7ff41813a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41d135700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff41813a9e0 0x7ff4180bdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41d135700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4180c64d0 con 0x7ff4180c3840 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41d135700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff418067f10 con 0x7ff4180c3c20 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41d135700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4180681f0 con 0x7ff41813a9e0 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4180c3c20 0x7ff41813a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4180c3c20 0x7ff41813a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35810/0 (socket says 172.21.15.133:35810) 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41659c700 1 -- 172.21.15.133:0/801860521 learned_addr learned my addr 172.21.15.133:0/801860521 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.865+0000 7ff41759e700 1 --2- 172.21.15.133:0/801860521 >> v2:172.21.15.178:3300/0 conn(0x7ff41813a9e0 0x7ff4180bdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41659c700 1 -- 172.21.15.133:0/801860521 >> v2:172.21.15.178:3300/0 conn(0x7ff41813a9e0 msgr2=0x7ff4180bdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41659c700 1 --2- 172.21.15.133:0/801860521 >> v2:172.21.15.178:3300/0 conn(0x7ff41813a9e0 0x7ff4180bdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41659c700 1 -- 172.21.15.133:0/801860521 >> v1:172.21.15.178:6789/0 conn(0x7ff4180c3840 legacy=0x7ff4180c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41659c700 1 -- 172.21.15.133:0/801860521 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180684d0 con 0x7ff4180c3c20 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41659c700 1 --2- 172.21.15.133:0/801860521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4180c3c20 0x7ff41813a4f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7ff4180c8eb0 tx=0x7ff4080090f0).ready entity=mon.0 client_cookie=510f77e758d5792a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff415d9b700 1 -- 172.21.15.133:0/801860521 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800b520 con 0x7ff4180c3c20 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff415d9b700 1 -- 172.21.15.133:0/801860521 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40800b680 con 0x7ff4180c3c20 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff415d9b700 1 -- 172.21.15.133:0/801860521 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40800ba20 con 0x7ff4180c3c20 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 -- 172.21.15.133:0/801860521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4180c3c20 msgr2=0x7ff41813a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 --2- 172.21.15.133:0/801860521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4180c3c20 0x7ff41813a4f0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7ff4180c8eb0 tx=0x7ff4080090f0).stop 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 -- 172.21.15.133:0/801860521 shutdown_connections 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 --2- 172.21.15.133:0/801860521 >> v2:172.21.15.178:3300/0 conn(0x7ff41813a9e0 0x7ff4180bdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 --2- 172.21.15.133:0/801860521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4180c3c20 0x7ff41813a4f0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.866+0000 7ff41d135700 1 -- 172.21.15.133:0/801860521 >> 172.21.15.133:0/801860521 conn(0x7ff418066a70 msgr2=0x7ff418066e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.867+0000 7ff41d135700 1 -- 172.21.15.133:0/801860521 shutdown_connections 2024-01-21T21:33:54.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.867+0000 7ff41d135700 1 -- 172.21.15.133:0/801860521 wait complete. 2024-01-21T21:33:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.868+0000 7ff41d135700 1 Processor -- start 2024-01-21T21:33:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.868+0000 7ff41d135700 1 -- start start 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4180c3840 0x7ff418134810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41813a9e0 0x7ff418138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff418165df0 con 0x7ff418139230 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff418134d00 con 0x7ff41813a9e0 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41d135700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff418139690 con 0x7ff4180c3840 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35826/0 (socket says 172.21.15.133:35826) 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 -- 172.21.15.133:0/3752099963 learned_addr learned my addr 172.21.15.133:0/3752099963 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:54.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff416d9d700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4180c3840 0x7ff418134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41659c700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41813a9e0 0x7ff418138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 -- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4180c3840 msgr2=0x7ff418134810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4180c3840 0x7ff418134810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 -- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41813a9e0 msgr2=0x7ff418138d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41813a9e0 0x7ff418138d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 -- 172.21.15.133:0/3752099963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009370 con 0x7ff418139230 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.869+0000 7ff41759e700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7ff410009e90 tx=0x7ff41000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.870+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000caa0 con 0x7ff418139230 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.870+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41000f040 con 0x7ff418139230 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.870+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff418134f60 con 0x7ff418139230 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.870+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41000ce10 con 0x7ff418139230 2024-01-21T21:33:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.870+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff418135520 con 0x7ff418139230 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.871+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff418165fa0 con 0x7ff418139230 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.871+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7ff410013610 con 0x7ff418139230 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.871+0000 7ff3ff7fe700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 0x7ff404061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.871+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7ff41007ab70 con 0x7ff418139230 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.871+0000 7ff416d9d700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 0x7ff404061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.872+0000 7ff416d9d700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 0x7ff404061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff418162710 tx=0x7ff40c009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:54.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:54.875+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7ff418165fa0 con 0x7ff418139230 2024-01-21T21:33:55.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.037+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff418165fa0 con 0x7ff40405f150 2024-01-21T21:33:55.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.037+0000 7ff3ff7fe700 1 -- 172.21.15.133:0/3752099963 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff418165fa0 con 0x7ff40405f150 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 msgr2=0x7ff404061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 0x7ff404061610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff418162710 tx=0x7ff40c009040).stop 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 msgr2=0x7ff418164f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7ff410009e90 tx=0x7ff41000b040).stop 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 shutdown_connections 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff418139230 0x7ff418164f50 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4180c3840 0x7ff418134810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7ff40405f150 0x7ff404061610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 --2- 172.21.15.133:0/3752099963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff41813a9e0 0x7ff418138d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 >> 172.21.15.133:0/3752099963 conn(0x7ff418066a70 msgr2=0x7ff4180c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 shutdown_connections 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.039+0000 7ff41d135700 1 -- 172.21.15.133:0/3752099963 wait complete. 2024-01-21T21:33:55.044 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2024-01-21T21:33:55.055 INFO:tasks.ceph:Scrubbing osd.7 2024-01-21T21:33:55.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-21T21:33:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.172+0000 7fbbb9569700 1 Processor -- start 2024-01-21T21:33:55.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.172+0000 7fbbb9569700 1 -- start start 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.172+0000 7fbbb9569700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbbb414e8d0 0x7fbbb405e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb9569700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40c9040 con 0x7fbbb40c0a70 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb9569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40c9290 con 0x7fbbb414ecb0 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb9569700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb40c9570 con 0x7fbbb414e8d0 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbbb414e8d0 0x7fbbb405e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbbb40c0a70 0x7fbbb4156f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50564/0 (socket says 172.21.15.133:50564) 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb37fe700 1 -- 172.21.15.133:0/3907730086 learned_addr learned my addr 172.21.15.133:0/3907730086 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb2ffd700 1 -- 172.21.15.133:0/3907730086 >> v1:172.21.15.178:6789/0 conn(0x7fbbb414ecb0 legacy=0x7fbbb4155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb2ffd700 1 -- 172.21.15.133:0/3907730086 >> v1:172.21.15.133:6789/0 conn(0x7fbbb40c0a70 legacy=0x7fbbb4156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb2ffd700 1 -- 172.21.15.133:0/3907730086 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40c9850 con 0x7fbbb414e8d0 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb1ffb700 1 -- 172.21.15.133:0/3907730086 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57509951 0 0) 0x7fbbb40c9040 con 0x7fbbb40c0a70 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb2ffd700 1 --2- 172.21.15.133:0/3907730086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb405e9c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7fbba4009760 tx=0x7fbba4009060).ready entity=mon.0 client_cookie=50307be07d69093f server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb1ffb700 1 -- 172.21.15.133:0/3907730086 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400b580 con 0x7fbbb414e8d0 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb1ffb700 1 -- 172.21.15.133:0/3907730086 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba400b6e0 con 0x7fbbb414e8d0 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.173+0000 7fbbb1ffb700 1 -- 172.21.15.133:0/3907730086 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba400ba60 con 0x7fbbb414e8d0 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 -- 172.21.15.133:0/3907730086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 msgr2=0x7fbbb405e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 --2- 172.21.15.133:0/3907730086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb405e9c0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7fbba4009760 tx=0x7fbba4009060).stop 2024-01-21T21:33:55.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 -- 172.21.15.133:0/3907730086 shutdown_connections 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 --2- 172.21.15.133:0/3907730086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb405e9c0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 -- 172.21.15.133:0/3907730086 >> 172.21.15.133:0/3907730086 conn(0x7fbbb4084eb0 msgr2=0x7fbbb40947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 -- 172.21.15.133:0/3907730086 shutdown_connections 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.174+0000 7fbbb9569700 1 -- 172.21.15.133:0/3907730086 wait complete. 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.175+0000 7fbbb9569700 1 Processor -- start 2024-01-21T21:33:55.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.175+0000 7fbbb9569700 1 -- start start 2024-01-21T21:33:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb40c0a70 0x7fbbb40b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb40c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb414ecb0 0x7fbbb4167cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c2e90 con 0x7fbbb414e8d0 2024-01-21T21:33:55.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c3170 con 0x7fbbb414ecb0 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb9569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40c3450 con 0x7fbbb40c0a70 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb40c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb40c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35856/0 (socket says 172.21.15.133:35856) 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 -- 172.21.15.133:0/2945480760 learned_addr learned my addr 172.21.15.133:0/2945480760 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb2ffd700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb40c0a70 0x7fbbb40b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb37fe700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb414ecb0 0x7fbbb4167cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 -- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb40c0a70 msgr2=0x7fbbb40b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb40c0a70 0x7fbbb40b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 -- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb414ecb0 msgr2=0x7fbbb4167cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb414ecb0 0x7fbbb4167cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.176+0000 7fbbb27fc700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40092a0 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbbb27fc700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb40c4a80 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7fbba800c440 tx=0x7fbba8007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8007020 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8007180 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb40c3730 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8007520 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb41681b0 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.177+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbb40c3000 con 0x7fbbb414e8d0 2024-01-21T21:33:55.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.178+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fbba80068b0 con 0x7fbbb414e8d0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.178+0000 7fbb9b7fe700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbba005f150 0x7fbba0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fbba807a4d0 con 0x7fbbb414e8d0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbbb2ffd700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbba005f150 0x7fbba0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbb9b7fe700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7fbba0066060 0x7fbba0068500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbba0068ae0 con 0x7fbba0066060 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=212) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbba807a880 con 0x7fbbb414e8d0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbbb37fe700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7fbba0066060 0x7fbba0068500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbbb2ffd700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbba005f150 0x7fbba0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbba400b340 tx=0x7fbba4017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.179+0000 7fbbb37fe700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7fbba0066060 0x7fbba0068500 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.180+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== osd.7 v2:172.21.15.178:6824/43943 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fbba0068ae0 con 0x7fbba0066060 2024-01-21T21:33:55.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.193+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 --> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbbb40c32e0 con 0x7fbba0066060 2024-01-21T21:33:55.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.193+0000 7fbb9b7fe700 1 -- 172.21.15.133:0/2945480760 <== osd.7 v2:172.21.15.178:6824/43943 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbbb40c32e0 con 0x7fbba0066060 2024-01-21T21:33:55.197 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-01-21T21:33:55.197 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2024-01-21T21:33:55.197 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7fbba0066060 msgr2=0x7fbba0068500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.178:6824/43943,v1:172.21.15.178:6825/43943] conn(0x7fbba0066060 0x7fbba0068500 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbba005f150 msgr2=0x7fbba0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fbba005f150 0x7fbba0061610 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbba400b340 tx=0x7fbba4017000).stop 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 msgr2=0x7fbbb40c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 --2- 172.21.15.133:0/2945480760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb414e8d0 0x7fbbb40c4a80 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 rx=0x7fbba800c440 tx=0x7fbba8007da0).stop 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb37fe700 1 -- 172.21.15.133:0/2945480760 reap_dead start 2024-01-21T21:33:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 shutdown_connections 2024-01-21T21:33:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 >> 172.21.15.133:0/2945480760 conn(0x7fbbb4084eb0 msgr2=0x7fbbb40a9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 shutdown_connections 2024-01-21T21:33:55.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.194+0000 7fbbb9569700 1 -- 172.21.15.133:0/2945480760 wait complete. 2024-01-21T21:33:55.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-21T21:33:55.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.322+0000 7efff4faa700 1 Processor -- start 2024-01-21T21:33:55.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.322+0000 7efff4faa700 1 -- start start 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7efff4faa700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efff0154a90 0x7efff00a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7efff4faa700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff00654f0 con 0x7efff01546b0 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7efff4faa700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff0063700 con 0x7efff00bc6d0 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7efff4faa700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff0063950 con 0x7efff0154a90 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7effee59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efff01546b0 0x7efff0065980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50576/0 (socket says 172.21.15.133:50576) 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7effee59c700 1 -- 172.21.15.133:0/1844616118 learned_addr learned my addr 172.21.15.133:0/1844616118 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7effedd9b700 1 --2- 172.21.15.133:0/1844616118 >> v2:172.21.15.178:3300/0 conn(0x7efff0154a90 0x7efff00a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202014 0 0) 0x7efff00654f0 con 0x7efff01546b0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.323+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd80033f0 con 0x7efff01546b0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562639769 0 0) 0x7efff0063700 con 0x7efff00bc6d0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff00654f0 con 0x7efff00bc6d0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effedd9b700 1 -- 172.21.15.133:0/1844616118 >> v1:172.21.15.178:6789/0 conn(0x7efff00bc6d0 legacy=0x7efff0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effedd9b700 1 -- 172.21.15.133:0/1844616118 >> v1:172.21.15.133:6789/0 conn(0x7efff01546b0 legacy=0x7efff0065980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2600974521 0 0) 0x7effd80033f0 con 0x7efff01546b0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effedd9b700 1 -- 172.21.15.133:0/1844616118 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0065180 con 0x7efff0154a90 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effedd9b700 1 --2- 172.21.15.133:0/1844616118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff00a9e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7effe0009760 tx=0x7effe0009060).ready entity=mon.1 client_cookie=5c9b1c03a42d8abf server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0009120 con 0x7efff0154a90 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe000d4a0 con 0x7efff0154a90 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7effed59a700 1 -- 172.21.15.133:0/1844616118 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe000d820 con 0x7efff0154a90 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7efff4faa700 1 -- 172.21.15.133:0/1844616118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 msgr2=0x7efff00a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.324+0000 7efff4faa700 1 --2- 172.21.15.133:0/1844616118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff00a9e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7effe0009760 tx=0x7effe0009060).stop 2024-01-21T21:33:55.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.325+0000 7efff4faa700 1 -- 172.21.15.133:0/1844616118 shutdown_connections 2024-01-21T21:33:55.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.325+0000 7efff4faa700 1 --2- 172.21.15.133:0/1844616118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff00a9e30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.325+0000 7efff4faa700 1 -- 172.21.15.133:0/1844616118 >> 172.21.15.133:0/1844616118 conn(0x7efff00c8200 msgr2=0x7efff00c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.325+0000 7efff4faa700 1 -- 172.21.15.133:0/1844616118 shutdown_connections 2024-01-21T21:33:55.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.325+0000 7efff4faa700 1 -- 172.21.15.133:0/1844616118 wait complete. 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.326+0000 7efff4faa700 1 Processor -- start 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.326+0000 7efff4faa700 1 -- start start 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff00bc6d0 0x7efff0168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff01462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff00ac6d0 con 0x7efff01546b0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0169100 con 0x7efff0154a90 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7efff4faa700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00ab7e0 con 0x7efff00bc6d0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7effedd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7effedd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35870/0 (socket says 172.21.15.133:35870) 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.327+0000 7effedd9b700 1 -- 172.21.15.133:0/2983960363 learned_addr learned my addr 172.21.15.133:0/2983960363 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effee59c700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff00bc6d0 0x7efff0168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effeed9d700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff01462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 -- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff00bc6d0 msgr2=0x7efff0168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff00bc6d0 0x7efff0168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 -- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 msgr2=0x7efff01462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff01462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 -- 172.21.15.133:0/2983960363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00092a0 con 0x7efff01546b0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effedd9b700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7effe0010000 tx=0x7effe0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0012870 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe00129d0 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0012d70 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff00abac0 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.328+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00ac080 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.329+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff00ac840 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.329+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7effe001c630 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.330+0000 7effdeffd700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 0x7effd0061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.330+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7effe007b7f0 con 0x7efff01546b0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.330+0000 7effee59c700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 0x7effd0061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.330+0000 7effee59c700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 0x7effd0061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7effe40011e0 tx=0x7effe4007b80).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.334+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7effe004ca10 con 0x7efff01546b0 2024-01-21T21:33:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.497+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7efff005e850 con 0x7effd005f150 2024-01-21T21:33:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.497+0000 7effdeffd700 1 -- 172.21.15.133:0/2983960363 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efff005e850 con 0x7effd005f150 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 msgr2=0x7effd0061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 0x7effd0061610 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7effe40011e0 tx=0x7effe4007b80).stop 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 msgr2=0x7efff00a71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 rx=0x7effe0010000 tx=0x7effe0016000).stop 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 shutdown_connections 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7effd005f150 0x7effd0061610 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff0154a90 0x7efff01462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff00bc6d0 0x7efff0168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 --2- 172.21.15.133:0/2983960363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff01546b0 0x7efff00a71b0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 >> 172.21.15.133:0/2983960363 conn(0x7efff00c8200 msgr2=0x7efff00697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 shutdown_connections 2024-01-21T21:33:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.499+0000 7efff4faa700 1 -- 172.21.15.133:0/2983960363 wait complete. 2024-01-21T21:33:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2024-01-21T21:33:55.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:33:55.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.627+0000 7f13ad85e700 1 Processor -- start 2024-01-21T21:33:55.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.627+0000 7f13ad85e700 1 -- start start 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13ad85e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154140 0x7f13a8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13ad85e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13a8154520 0x7f13a80ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13ad85e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a80ab620 con 0x7f13a80c6090 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13ad85e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a80c6ae0 con 0x7f13a8154520 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13ad85e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a80c05e0 con 0x7f13a8154140 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13a80c6090 0x7f13a80c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50592/0 (socket says 172.21.15.133:50592) 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a77fe700 1 -- 172.21.15.133:0/2930067144 learned_addr learned my addr 172.21.15.133:0/2930067144 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:33:55.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13a8154520 0x7f13a80ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a6ffd700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154140 0x7f13a8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a67fc700 1 -- 172.21.15.133:0/2930067144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154140 msgr2=0x7f13a8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a67fc700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154140 0x7f13a8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a67fc700 1 -- 172.21.15.133:0/2930067144 >> v1:172.21.15.133:6789/0 conn(0x7f13a80c6090 legacy=0x7f13a80c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a67fc700 1 -- 172.21.15.133:0/2930067144 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a80c0e40 con 0x7f13a8154520 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.628+0000 7f13a5ffb700 1 -- 172.21.15.133:0/2930067144 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868349142 0 0) 0x7f13a80ab620 con 0x7f13a80c6090 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13a67fc700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a8154520 0x7f13a80ab130 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f139c009760 tx=0x7f139c009060).ready entity=mon.0 client_cookie=fbc2c707f22a74b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13a5ffb700 1 -- 172.21.15.133:0/2930067144 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00b580 con 0x7f13a8154520 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13a5ffb700 1 -- 172.21.15.133:0/2930067144 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00b6e0 con 0x7f13a8154520 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13a5ffb700 1 -- 172.21.15.133:0/2930067144 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00ba60 con 0x7f13a8154520 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 -- 172.21.15.133:0/2930067144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a8154520 msgr2=0x7f13a80ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a8154520 0x7f13a80ab130 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7f139c009760 tx=0x7f139c009060).stop 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 -- 172.21.15.133:0/2930067144 shutdown_connections 2024-01-21T21:33:55.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154140 0x7f13a8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 --2- 172.21.15.133:0/2930067144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a8154520 0x7f13a80ab130 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 -- 172.21.15.133:0/2930067144 >> 172.21.15.133:0/2930067144 conn(0x7f13a805e1e0 msgr2=0x7f13a805e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 -- 172.21.15.133:0/2930067144 shutdown_connections 2024-01-21T21:33:55.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.629+0000 7f13ad85e700 1 -- 172.21.15.133:0/2930067144 wait complete. 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.631+0000 7f13ad85e700 1 Processor -- start 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.631+0000 7f13ad85e700 1 -- start start 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.631+0000 7f13ad85e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.631+0000 7f13ad85e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a8154140 0x7f13a8141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 0x7f13a80af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a814ce70 con 0x7f13a80c6090 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81646f0 con 0x7f13a8154140 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a81649b0 con 0x7f13a8154520 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35892/0 (socket says 172.21.15.133:35892) 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 -- 172.21.15.133:0/3949539400 learned_addr learned my addr 172.21.15.133:0/3949539400 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a77fe700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 0x7f13a80af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a67fc700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a8154140 0x7f13a8141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 -- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 msgr2=0x7f13a80af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 0x7f13a80af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 -- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a8154140 msgr2=0x7f13a8141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a8154140 0x7f13a8141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 -- 172.21.15.133:0/3949539400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0092a0 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a77fe700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 0x7f13a80af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13a6ffd700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f139800e190 tx=0x7f1398009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139800ee30 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398014400 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a8164c90 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398014780 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.632+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a8165250 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.633+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a80ae1a0 con 0x7f13a80c6090 2024-01-21T21:33:55.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.633+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f139801d3b0 con 0x7f13a80c6090 2024-01-21T21:33:55.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.634+0000 7f138f7fe700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 0x7f1394061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:33:55.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.634+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f139807a810 con 0x7f13a80c6090 2024-01-21T21:33:55.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.634+0000 7f13a67fc700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 0x7f1394061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:33:55.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.634+0000 7f13a67fc700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 0x7f1394061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f139c009760 tx=0x7f139c017000).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:33:55.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.638+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f139804b930 con 0x7f13a80c6090 2024-01-21T21:33:55.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.798+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13a805fdf0 con 0x7f139405f150 2024-01-21T21:33:55.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.800+0000 7f138f7fe700 1 -- 172.21.15.133:0/3949539400 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71569 (secure 0 0 0) 0x7f13a805fdf0 con 0x7f139405f150 2024-01-21T21:33:55.805 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 msgr2=0x7f1394061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 0x7f1394061610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f139c009760 tx=0x7f139c017000).stop 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 msgr2=0x7f13a80afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7f139800e190 tx=0x7f1398009920).stop 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 shutdown_connections 2024-01-21T21:33:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a8154520 0x7f13a80af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13a80c6090 0x7f13a80afc00 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f139405f150 0x7f1394061610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 --2- 172.21.15.133:0/3949539400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a8154140 0x7f13a8141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 >> 172.21.15.133:0/3949539400 conn(0x7f13a805e1e0 msgr2=0x7f13a80aafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 shutdown_connections 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:33:55.802+0000 7f13ad85e700 1 -- 172.21.15.133:0/3949539400 wait complete. 2024-01-21T21:33:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:33:55.818 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-01-21T21:33:54.063932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2475384,"kb_used_data":20792,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499336,"statfs":{"total":773094113280,"available":770559320064,"internally_reserved":0,"allocated":21291008,"data_stored":11520862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.410698"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.479172+0000","last_change":"2024-01-21T19:59:02.668073+0000","last_active":"2024-01-21T21:33:46.479172+0000","last_peered":"2024-01-21T21:33:46.479172+0000","last_clean":"2024-01-21T21:33:46.479172+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:46.479172+0000","last_undegraded":"2024-01-21T21:33:46.479172+0000","last_fullsized":"2024-01-21T21:33:46.479172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477151+0000","last_change":"2024-01-21T19:59:01.899610+0000","last_active":"2024-01-21T21:33:46.477151+0000","last_peered":"2024-01-21T21:33:46.477151+0000","last_clean":"2024-01-21T21:33:46.477151+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:46.477151+0000","last_undegraded":"2024-01-21T21:33:46.477151+0000","last_fullsized":"2024-01-21T21:33:46.477151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477645+0000","last_change":"2024-01-21T19:59:01.899438+0000","last_active":"2024-01-21T21:33:46.477645+0000","last_peered":"2024-01-21T21:33:46.477645+0000","last_clean":"2024-01-21T21:33:46.477645+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:46.477645+0000","last_undegraded":"2024-01-21T21:33:46.477645+0000","last_fullsized":"2024-01-21T21:33:46.477645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.477669+0000","last_change":"2024-01-21T19:59:01.896742+0000","last_active":"2024-01-21T21:33:46.477669+0000","last_peered":"2024-01-21T21:33:46.477669+0000","last_clean":"2024-01-21T21:33:46.477669+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:33:46.477669+0000","last_undegraded":"2024-01-21T21:33:46.477669+0000","last_fullsized":"2024-01-21T21:33:46.477669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":174,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848498+0000","last_change":"2024-01-21T19:59:00.734001+0000","last_active":"2024-01-21T21:33:46.848498+0000","last_peered":"2024-01-21T21:33:46.848498+0000","last_clean":"2024-01-21T21:33:46.848498+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:46.848498+0000","last_undegraded":"2024-01-21T21:33:46.848498+0000","last_fullsized":"2024-01-21T21:33:46.848498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:58:58.870778+0000","last_clean_scrub_stamp":"2024-01-21T19:58:58.870778+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.848580+0000","last_change":"2024-01-21T19:59:01.899524+0000","last_active":"2024-01-21T21:33:46.848580+0000","last_peered":"2024-01-21T21:33:46.848580+0000","last_clean":"2024-01-21T21:33:46.848580+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:33:46.848580+0000","last_undegraded":"2024-01-21T21:33:46.848580+0000","last_fullsized":"2024-01-21T21:33:46.848580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844277+0000","last_change":"2024-01-21T19:59:02.668362+0000","last_active":"2024-01-21T21:33:46.844277+0000","last_peered":"2024-01-21T21:33:46.844277+0000","last_clean":"2024-01-21T21:33:46.844277+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:33:46.844277+0000","last_undegraded":"2024-01-21T21:33:46.844277+0000","last_fullsized":"2024-01-21T21:33:46.844277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":177,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.480378+0000","last_change":"2024-01-21T19:59:01.899227+0000","last_active":"2024-01-21T21:33:46.480378+0000","last_peered":"2024-01-21T21:33:46.480378+0000","last_clean":"2024-01-21T21:33:46.480378+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:33:46.480378+0000","last_undegraded":"2024-01-21T21:33:46.480378+0000","last_fullsized":"2024-01-21T21:33:46.480378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":211,"state":"active+clean","last_fresh":"2024-01-21T21:33:46.844397+0000","last_change":"2024-01-21T19:59:01.892937+0000","last_active":"2024-01-21T21:33:46.844397+0000","last_peered":"2024-01-21T21:33:46.844397+0000","last_clean":"2024-01-21T21:33:46.844397+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:46.844397+0000","last_undegraded":"2024-01-21T21:33:46.844397+0000","last_fullsized":"2024-01-21T21:33:46.844397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T19:59:00.878148+0000","last_clean_scrub_stamp":"2024-01-21T19:59:00.878148+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575975,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.626,"15min":0.628},"min":{"1min":0.47599999999999998,"5min":0.40699999999999997,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.65000000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.43099999999999999},"max":{"1min":0.78400000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.59399999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.375},"max":{"1min":0.75800000000000001,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70099999999999996,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.42699999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.58699999999999997},"min":{"1min":0.45000000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.75900000000000001,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.71699999999999997,"5min":0.79700000000000004,"15min":0.84899999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.59599999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.749,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81000000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49399999999999999,"15min":0.503},"min":{"1min":0.36599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.65700000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.872,"15min":0.872},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.49299999999999999,"15min":0.499},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.33200000000000002},"max":{"1min":0.71399999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.59699999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:33:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39300000000000002,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.77200000000000002,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834575975,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.54700000000000004,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63400000000000001,"15min":0.64300000000000002},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45000000000000001},"max":{"1min":0.76500000000000001,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56599999999999995,"15min":0.57999999999999996},"min":{"1min":0.47799999999999998,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.502}]},{"osd":2,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.371,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.374,"15min":0.35499999999999998},"max":{"1min":0.69499999999999995,"5min":0.751,"15min":0.81499999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56899999999999995,"15min":0.58099999999999996},"min":{"1min":0.53600000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.872},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.58799999999999997,"15min":0.60499999999999998},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.38},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.46800000000000003},"min":{"1min":0.377,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.433,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.46800000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.80700000000000005},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42199999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:02 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54800000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.62},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.60099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.39400000000000002,"15min":0.40500000000000003},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.67700000000000005},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.27100000000000002},"max":{"1min":0.60499999999999998,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.33000000000000002}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41899999999999998},"min":{"1min":0.32400000000000001,"5min":0.29299999999999998,"15min":0.28699999999999998},"max":{"1min":0.55100000000000005,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59899999999999998,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.314}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45500000000000002,"15min":0.45900000000000002},"min":{"1min":0.34200000000000003,"5min":0.312,"15min":0.312},"max":{"1min":0.56299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.57599999999999996,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.36299999999999999}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60899999999999999,"15min":0.60999999999999999},"min":{"1min":0.52400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.63100000000000001,"15min":0.61599999999999999},"min":{"1min":0.56399999999999995,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.503}]},{"osd":5,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.56599999999999995,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.80400000000000005,"5min":0.97699999999999998,"15min":1.036},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.95499999999999996,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.65500000000000003,"15min":0.65600000000000003},"min":{"1min":0.58399999999999996,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.56000000000000005,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.436}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64900000000000002},"min":{"1min":0.47799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93000000000000005,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66900000000000004,"15min":0.67100000000000004},"min":{"1min":0.53700000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90800000000000003,"5min":0.98499999999999999,"15min":1.159},"last":0.46999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.27100000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.57099999999999995,"5min":0.58499999999999996,"15min":0.622},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.42599999999999999,"15min":0.42499999999999999},"min":{"1min":0.28999999999999998,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.36399999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.44,"15min":0.439},"min":{"1min":0.313,"5min":0.25900000000000001,"15min":0.251},"max":{"1min":0.58299999999999996,"5min":0.622,"15min":0.64700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46300000000000002},"min":{"1min":0.36099999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.33400000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.438,"15min":0.437},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.34999999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.628,"5min":0.629,"15min":0.64700000000000002},"last":0.35499999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.46700000000000003,"5min":0.434,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.436},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.65400000000000003},"min":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.499}]},{"osd":5,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.442,"15min":0.39800000000000002},"max":{"1min":0.90900000000000003,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.48899999999999999,"5min":0.45900000000000002,"15min":0.42099999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.71299999999999997,"15min":0.69699999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.46800000000000003},"max":{"1min":1.002,"5min":1.0409999999999999,"15min":1.0620000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.69599999999999995},"min":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.45300000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0569999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:32:50 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.69999999999999996,"15min":0.68999999999999995},"min":{"1min":0.504,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.58999999999999997,"5min":0.45500000000000002,"15min":0.41099999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.04},"last":0.47099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.55800000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"max":{"1min":0.53500000000000003,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.40200000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40400000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.626,"15min":0.64300000000000002},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54000000000000004,"5min":0.67800000000000005,"15min":0.68300000000000005},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54700000000000004,"5min":0.626,"15min":0.66200000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.39600000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.68400000000000005},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91200000000000003,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84699999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.40400000000000003,"15min":0.40500000000000003},"min":{"1min":0.27500000000000002,"5min":0.26200000000000001,"15min":0.253},"max":{"1min":0.48099999999999998,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.251},{"interface":"front","average":{"1min":0.438,"5min":0.43099999999999999,"15min":0.437},"min":{"1min":0.36099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.376}]},{"osd":1,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.50700000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.57699999999999996,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.29899999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.38400000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.41699999999999998,"5min":0.34100000000000003,"15min":0.32400000000000001},"max":{"1min":0.622,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.33400000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.40699999999999997,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":1.004,"15min":1.004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.45700000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90300000000000002,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64200000000000002,"15min":0.64300000000000002},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76900000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.66100000000000003,"15min":0.65500000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628}]},{"osd":6,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.45300000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.89000000000000001,"5min":0.995,"15min":0.995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:33:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.52200000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68500000000000005,"15min":0.67900000000000005},"min":{"1min":0.56899999999999995,"5min":0.48099999999999998,"15min":0.46300000000000002},"max":{"1min":0.90300000000000002,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575976,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63,"15min":0.62},"min":{"1min":0.48199999999999998,"5min":0.42699999999999999,"15min":0.22900000000000001},"max":{"1min":0.749,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.622,"15min":0.623},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.29099999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.501,"5min":0.47499999999999998,"15min":0.436},"max":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.85899999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.433},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.46700000000000003}]},{"osd":3,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.40999999999999998,"15min":0.36199999999999999},"max":{"1min":0.73299999999999998,"5min":0.74399999999999999,"15min":0.84299999999999997},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81799999999999995,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.59199999999999997}]},{"osd":5,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.39500000000000002,"5min":0.35399999999999998,"15min":0.32800000000000001},"max":{"1min":0.66300000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.38600000000000001,"5min":0.35099999999999998,"15min":0.33600000000000002},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.76000000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52000000000000002,"15min":0.51700000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.34999999999999998},"max":{"1min":0.71799999999999997,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.627},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55600000000000005,"15min":0.54600000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.749,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.66100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575975,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316080,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055760,"statfs":{"total":96636764160,"available":96313098240,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.61399999999999999,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.32600000000000001,"15min":0.28899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.80400000000000005},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.628,"15min":0.63400000000000001},"min":{"1min":0.51200000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80000000000000004,"5min":0.84399999999999997,"15min":0.84899999999999998},"last":0.76500000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.51200000000000001,"5min":0.374,"15min":0.33000000000000002},"max":{"1min":0.73399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58199999999999996,"15min":0.58399999999999996},"min":{"1min":0.47399999999999998,"5min":0.35399999999999998,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.66300000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.502,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.753,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.54600000000000004,"5min":0.39700000000000002,"15min":0.371},"max":{"1min":0.76200000000000001,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.48499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.77700000000000002,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.625}]},{"osd":4,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.35499999999999998,"5min":0.309,"15min":0.29499999999999998},"max":{"1min":0.73199999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.56599999999999995},"min":{"1min":0.41299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.90200000000000002}]},{"osd":6,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48499999999999999,"15min":0.501},"min":{"1min":0.38700000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68700000000000006,"5min":0.73799999999999999,"15min":0.755},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.38600000000000001,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.76700000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.748}]},{"osd":7,"last update":"Sun Jan 21 21:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.52700000000000002},"min":{"1min":0.36799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.751,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.56100000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.78100000000000003,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:33:55.822 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.822 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.822 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-21T19:58:58.870778+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=58, tm_sec=58, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-21T19:59:00.878148+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=19, tm_min=59, tm_sec=0, tm_wday=6, tm_yday=21, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=21, tm_hour=21, tm_min=33, tm_sec=50, tm_wday=6, tm_yday=21, tm_isdst=0) 2024-01-21T21:33:55.823 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-21T21:34:09.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:09.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:15.825 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-21T21:34:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.950+0000 7f0a84357700 1 Processor -- start 2024-01-21T21:34:15.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.950+0000 7f0a84357700 1 -- start start 2024-01-21T21:34:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.951+0000 7f0a84357700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a7c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.951+0000 7f0a84357700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a7c154520 0x7f0a7c0ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.951+0000 7f0a84357700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7c0ab620 con 0x7f0a7c0c6090 2024-01-21T21:34:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.951+0000 7f0a84357700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c6ae0 con 0x7f0a7c154520 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.951+0000 7f0a84357700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c05e0 con 0x7f0a7c154140 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a828f4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a7c0c6090 0x7f0a7c0c7a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40116/0 (socket says 172.21.15.133:40116) 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a828f4700 1 -- 172.21.15.133:0/2532355846 learned_addr learned my addr 172.21.15.133:0/2532355846 (peer_addr_for_me v1:172.21.15.133:0/0) 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a820f3700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a7c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> v2:172.21.15.178:3300/0 conn(0x7f0a7c154520 0x7f0a7c0ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293967011 0 0) 0x7f0a7c0ab620 con 0x7f0a7c0c6090 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a680033f0 con 0x7f0a7c0c6090 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362231365 0 0) 0x7f0a680033f0 con 0x7f0a7c0c6090 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 msgr2=0x7f0a7c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a7c158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 >> v2:172.21.15.178:3300/0 conn(0x7f0a7c154520 msgr2=0x7f0a7c0ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 --2- 172.21.15.133:0/2532355846 >> v2:172.21.15.178:3300/0 conn(0x7f0a7c154520 0x7f0a7c0ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0c0e40 con 0x7f0a7c0c6090 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2912571771 0 0) 0x7f0a740017f0 con 0x7f0a7c0c6090 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> v2:172.21.15.178:3300/0 conn(0x7f0a7c154520 0x7f0a7c0ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 >> v1:172.21.15.133:6789/0 conn(0x7f0a7c0c6090 legacy=0x7f0a7c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a680038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a68003e10 0x7f0a68004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68004b80 0x7f0a68005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c6ae0 con 0x7f0a68004b80 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c05e0 con 0x7f0a68003e10 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6800b8e0 con 0x7f0a7c154140 2024-01-21T21:34:15.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a828f4700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68004b80 0x7f0a68005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a68003e10 0x7f0a68004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.952+0000 7f0a820f3700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a680038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 -- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 msgr2=0x7f0a680038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7c154140 0x7f0a680038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 -- 172.21.15.133:0/2532355846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68004b80 msgr2=0x7f0a68005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68004b80 0x7f0a68005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 -- 172.21.15.133:0/2532355846 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a680033f0 con 0x7f0a68003e10 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a828f4700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a68004b80 0x7f0a68005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a818f2700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a68003e10 0x7f0a68004690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f0a78009c70 tx=0x7f0a78009060).ready entity=mon.1 client_cookie=981ec5c1b819d7a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780095c0 con 0x7f0a68003e10 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800e6f0 con 0x7f0a68003e10 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a810f1700 1 -- 172.21.15.133:0/2532355846 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800ea70 con 0x7f0a68003e10 2024-01-21T21:34:15.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a84357700 1 -- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a68003e10 msgr2=0x7f0a68004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a84357700 1 --2- 172.21.15.133:0/2532355846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a68003e10 0x7f0a68004690 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f0a78009c70 tx=0x7f0a78009060).stop 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.953+0000 7f0a828f4700 1 -- 172.21.15.133:0/2532355846 reap_dead start 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.954+0000 7f0a84357700 1 -- 172.21.15.133:0/2532355846 shutdown_connections 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.954+0000 7f0a84357700 1 -- 172.21.15.133:0/2532355846 >> 172.21.15.133:0/2532355846 conn(0x7f0a7c05e1e0 msgr2=0x7f0a7c05e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.954+0000 7f0a84357700 1 -- 172.21.15.133:0/2532355846 shutdown_connections 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.954+0000 7f0a84357700 1 -- 172.21.15.133:0/2532355846 wait complete. 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.955+0000 7f0a84357700 1 Processor -- start 2024-01-21T21:34:15.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.955+0000 7f0a84357700 1 -- start start 2024-01-21T21:34:15.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 0x7f0a7c1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 0x7f0a7c0afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0b07b0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0ca620 con 0x7f0a7c0af430 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c0c9a10 con 0x7f0a68003e10 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37766/0 (socket says 172.21.15.133:37766) 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 -- 172.21.15.133:0/801554122 learned_addr learned my addr 172.21.15.133:0/801554122 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 -- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 msgr2=0x7f0a7c1481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a818f2700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 0x7f0a7c0afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a820f3700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 0x7f0a7c1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 0x7f0a7c1481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 -- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 msgr2=0x7f0a7c0afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 0x7f0a7c0afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 -- 172.21.15.133:0/801554122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0c9cf0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a818f2700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 0x7f0a7c0afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a820f3700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 0x7f0a7c1481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a828f4700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7f0a7c0c6c20 tx=0x7f0a74002210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74001f50 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7400ca30 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c0c9fd0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400cdf0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.956+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c0cb640 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.957+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7c0ca7d0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.958+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f0a74012560 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.958+0000 7f0a6effd700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 0x7f0a60061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.958+0000 7f0a820f3700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 0x7f0a60061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.958+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f0a7407a0e0 con 0x7f0a7c0af8b0 2024-01-21T21:34:15.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.959+0000 7f0a820f3700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 0x7f0a60061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0a70006c40 tx=0x7f0a70008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:15.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:15.962+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f0a7404ab00 con 0x7f0a7c0af8b0 2024-01-21T21:34:16.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.122+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 --> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a7c05fdf0 con 0x7f0a6005f150 2024-01-21T21:34:16.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.124+0000 7f0a6effd700 1 -- 172.21.15.133:0/801554122 <== mgr.10326 v2:172.21.15.133:6832/94812 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71600 (secure 0 0 0) 0x7f0a7c05fdf0 con 0x7f0a6005f150 2024-01-21T21:34:16.128 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 msgr2=0x7f0a60061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 0x7f0a60061610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0a70006c40 tx=0x7f0a70008040).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 msgr2=0x7f0a7c0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 rx=0x7f0a7c0c6c20 tx=0x7f0a74002210).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 shutdown_connections 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a7c0af8b0 0x7f0a7c0b02c0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a68003e10 0x7f0a7c1481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f0a6005f150 0x7f0a60061610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 --2- 172.21.15.133:0/801554122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7c0af430 0x7f0a7c0afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.126+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 >> 172.21.15.133:0/801554122 conn(0x7f0a7c05e1e0 msgr2=0x7f0a7c0ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.127+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 shutdown_connections 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.127+0000 7f0a84357700 1 -- 172.21.15.133:0/801554122 wait complete. 2024-01-21T21:34:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-01-21T21:34:16.141 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-21T21:34:16.068234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2475384,"kb_used_data":20792,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752499336,"statfs":{"total":773094113280,"available":770559320064,"internally_reserved":0,"allocated":21291008,"data_stored":11520862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-11959,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-64,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.410698"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:33:56.321760+0000","last_change":"2024-01-21T21:33:56.321760+0000","last_active":"2024-01-21T21:33:56.321760+0000","last_peered":"2024-01-21T21:33:56.321760+0000","last_clean":"2024-01-21T21:33:56.321760+0000","last_became_active":"2024-01-21T19:59:02.667760+0000","last_became_peered":"2024-01-21T19:59:02.667760+0000","last_unstale":"2024-01-21T21:33:56.321760+0000","last_undegraded":"2024-01-21T21:33:56.321760+0000","last_fullsized":"2024-01-21T21:33:56.321760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:56.321662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:56.321662+0000","last_clean_scrub_stamp":"2024-01-21T21:33:56.321662+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":200,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:33:55.863777+0000","last_change":"2024-01-21T21:33:55.863777+0000","last_active":"2024-01-21T21:33:55.863777+0000","last_peered":"2024-01-21T21:33:55.863777+0000","last_clean":"2024-01-21T21:33:55.863777+0000","last_became_active":"2024-01-21T19:59:01.899273+0000","last_became_peered":"2024-01-21T19:59:01.899273+0000","last_unstale":"2024-01-21T21:33:55.863777+0000","last_undegraded":"2024-01-21T21:33:55.863777+0000","last_fullsized":"2024-01-21T21:33:55.863777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:55.863637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:55.863637+0000","last_clean_scrub_stamp":"2024-01-21T21:33:55.863637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":188,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:33:57.871953+0000","last_change":"2024-01-21T21:33:57.871953+0000","last_active":"2024-01-21T21:33:57.871953+0000","last_peered":"2024-01-21T21:33:57.871953+0000","last_clean":"2024-01-21T21:33:57.871953+0000","last_became_active":"2024-01-21T19:59:01.899161+0000","last_became_peered":"2024-01-21T19:59:01.899161+0000","last_unstale":"2024-01-21T21:33:57.871953+0000","last_undegraded":"2024-01-21T21:33:57.871953+0000","last_fullsized":"2024-01-21T21:33:57.871953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:57.871848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:57.871848+0000","last_clean_scrub_stamp":"2024-01-21T21:33:57.871848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":200,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:34:01.717659+0000","last_change":"2024-01-21T21:34:01.717659+0000","last_active":"2024-01-21T21:34:01.717659+0000","last_peered":"2024-01-21T21:34:01.717659+0000","last_clean":"2024-01-21T21:34:01.717659+0000","last_became_active":"2024-01-21T19:59:01.896452+0000","last_became_peered":"2024-01-21T19:59:01.896452+0000","last_unstale":"2024-01-21T21:34:01.717659+0000","last_undegraded":"2024-01-21T21:34:01.717659+0000","last_fullsized":"2024-01-21T21:34:01.717659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:34:01.717547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:34:01.717547+0000","last_clean_scrub_stamp":"2024-01-21T21:34:01.717547+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":179,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:33:59.688643+0000","last_change":"2024-01-21T21:33:59.688643+0000","last_active":"2024-01-21T21:33:59.688643+0000","last_peered":"2024-01-21T21:33:59.688643+0000","last_clean":"2024-01-21T21:33:59.688643+0000","last_became_active":"2024-01-21T19:59:00.733681+0000","last_became_peered":"2024-01-21T19:59:00.733681+0000","last_unstale":"2024-01-21T21:33:59.688643+0000","last_undegraded":"2024-01-21T21:33:59.688643+0000","last_fullsized":"2024-01-21T21:33:59.688643+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:59.688462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:59.688462+0000","last_clean_scrub_stamp":"2024-01-21T21:33:59.688462+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":177,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:34:04.593093+0000","last_change":"2024-01-21T21:34:04.593093+0000","last_active":"2024-01-21T21:34:04.593093+0000","last_peered":"2024-01-21T21:34:04.593093+0000","last_clean":"2024-01-21T21:34:04.593093+0000","last_became_active":"2024-01-21T19:59:01.899190+0000","last_became_peered":"2024-01-21T19:59:01.899190+0000","last_unstale":"2024-01-21T21:34:04.593093+0000","last_undegraded":"2024-01-21T21:34:04.593093+0000","last_fullsized":"2024-01-21T21:34:04.593093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:34:04.592985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:34:04.592985+0000","last_clean_scrub_stamp":"2024-01-21T21:34:04.592985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":177,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:34:05.589590+0000","last_change":"2024-01-21T21:34:05.589590+0000","last_active":"2024-01-21T21:34:05.589590+0000","last_peered":"2024-01-21T21:34:05.589590+0000","last_clean":"2024-01-21T21:34:05.589590+0000","last_became_active":"2024-01-21T19:59:02.668060+0000","last_became_peered":"2024-01-21T19:59:02.668060+0000","last_unstale":"2024-01-21T21:34:05.589590+0000","last_undegraded":"2024-01-21T21:34:05.589590+0000","last_fullsized":"2024-01-21T21:34:05.589590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:34:05.589418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:34:05.589418+0000","last_clean_scrub_stamp":"2024-01-21T21:34:05.589418+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":182,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:34:01.347903+0000","last_change":"2024-01-21T21:34:01.347903+0000","last_active":"2024-01-21T21:34:01.347903+0000","last_peered":"2024-01-21T21:34:01.347903+0000","last_clean":"2024-01-21T21:34:01.347903+0000","last_became_active":"2024-01-21T19:59:01.898856+0000","last_became_peered":"2024-01-21T19:59:01.898856+0000","last_unstale":"2024-01-21T21:34:01.347903+0000","last_undegraded":"2024-01-21T21:34:01.347903+0000","last_fullsized":"2024-01-21T21:34:01.347903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:34:01.347782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:34:01.347782+0000","last_clean_scrub_stamp":"2024-01-21T21:34:01.347782+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":212,"state":"active+clean","last_fresh":"2024-01-21T21:33:56.618084+0000","last_change":"2024-01-21T21:33:56.618084+0000","last_active":"2024-01-21T21:33:56.618084+0000","last_peered":"2024-01-21T21:33:56.618084+0000","last_clean":"2024-01-21T21:33:56.618084+0000","last_became_active":"2024-01-21T19:59:01.892632+0000","last_became_peered":"2024-01-21T19:59:01.892632+0000","last_unstale":"2024-01-21T21:33:56.618084+0000","last_undegraded":"2024-01-21T21:33:56.618084+0000","last_fullsized":"2024-01-21T21:33:56.618084+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-21T21:33:56.617949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-21T21:33:56.617949+0000","last_clean_scrub_stamp":"2024-01-21T21:33:56.617949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575980,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311980,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059860,"statfs":{"total":96636764160,"available":96317296640,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60799999999999998,"15min":0.622},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.64100000000000001,"15min":0.64400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.751,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.55500000000000005}]},{"osd":1,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.56799999999999995,"15min":0.58599999999999997},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66900000000000004,"5min":0.79000000000000004,"15min":0.85599999999999998},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.57699999999999996},"min":{"1min":0.35499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.82699999999999996,"15min":0.91700000000000004},"last":0.57999999999999996}]},{"osd":2,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.57699999999999996,"15min":0.58299999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73799999999999999,"5min":0.81499999999999995,"15min":0.84399999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.34100000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80200000000000005},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.57699999999999996,"15min":0.58999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67900000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.58599999999999997,"15min":0.60499999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76400000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.629}]},{"osd":4,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.66300000000000003,"5min":0.79600000000000004,"15min":0.84399999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.36799999999999999,"15min":0.34899999999999998},"max":{"1min":0.87,"5min":0.872,"15min":0.872},"last":0.52400000000000002}]},{"osd":5,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48999999999999999,"15min":0.498},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.33200000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73399999999999999,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.46700000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:34:03 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84799999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.34599999999999997,"15min":0.34499999999999997},"max":{"1min":0.82699999999999996,"5min":0.83999999999999997,"15min":0.85399999999999998},"last":0.39200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575980,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311984,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94059856,"statfs":{"total":96636764160,"available":96317292544,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58799999999999997,"15min":0.62},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.29599999999999999},"max":{"1min":0.70299999999999996,"5min":0.82299999999999995,"15min":0.82499999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.61099999999999999,"15min":0.63600000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71999999999999997,"5min":0.78700000000000003,"15min":0.84699999999999998},"last":0.64200000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.56899999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.63400000000000001,"5min":0.78100000000000003,"15min":0.79900000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55200000000000005,"15min":0.57499999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70399999999999996,"5min":0.78300000000000003,"15min":0.83799999999999997},"last":0.52900000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.55700000000000005,"15min":0.58299999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67700000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57299999999999995,"15min":0.59399999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.73399999999999999,"5min":0.751,"15min":0.81499999999999995},"last":0.51100000000000001}]},{"osd":3,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69099999999999995,"5min":0.79700000000000004,"15min":0.872},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.57099999999999995,"15min":0.59899999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64600000000000002,"5min":0.81299999999999994,"15min":0.83799999999999997},"last":0.503}]},{"osd":4,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.317,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70399999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.79100000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.56299999999999994}]},{"osd":5,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.38100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68700000000000006,"5min":0.746,"15min":0.80700000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57999999999999996,"15min":0.58499999999999996},"min":{"1min":0.433,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73899999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.65200000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:34:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.373,"5min":0.309,"15min":0.309},"max":{"1min":0.75,"5min":0.85499999999999998,"15min":0.98199999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.80100000000000005},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575982,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303792,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94068048,"statfs":{"total":96636764160,"available":96325681152,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.38300000000000001,"15min":0.40000000000000002},"min":{"1min":0.25,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.48699999999999999,"5min":0.57499999999999996,"15min":0.67700000000000005},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.441,"15min":0.45500000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.63200000000000001,"15min":0.66200000000000003},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.56799999999999995,"5min":0.60899999999999999,"15min":0.63600000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.54100000000000004,"5min":0.61399999999999999,"15min":0.68400000000000005},"last":0.40300000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.41799999999999998,"15min":0.42599999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.74199999999999999},"last":0.32600000000000001}]},{"osd":4,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.747,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.61099999999999999,"15min":0.61199999999999999},"min":{"1min":0.434,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.5}]},{"osd":5,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.64400000000000002,"15min":0.65300000000000002},"min":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.35099999999999998},"max":{"1min":0.83299999999999996,"5min":0.97699999999999998,"15min":1.036},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.66600000000000004,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85599999999999998,"5min":0.99199999999999999,"15min":0.99399999999999999},"last":0.51300000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64700000000000002,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.39100000000000001},"max":{"1min":0.79500000000000004,"5min":0.94499999999999995,"15min":1.01},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89500000000000002,"5min":0.94999999999999996,"15min":0.96499999999999997},"last":0.56799999999999995}]},{"osd":7,"last update":"Sun Jan 21 21:33:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.64400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82899999999999996,"5min":0.96499999999999997,"15min":1.2190000000000001},"last":0.621},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64700000000000002,"15min":0.66300000000000003},"min":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.877,"5min":0.98499999999999999,"15min":1.159},"last":0.59699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575981,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307884,"kb_used_data":2596,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063956,"statfs":{"total":96636764160,"available":96321490944,"internally_reserved":0,"allocated":2658304,"data_stored":1439387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.372,"15min":0.38100000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.5,"5min":0.58499999999999996,"15min":0.622},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.41199999999999998,"15min":0.42099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.58999999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42099999999999999,"15min":0.434},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.53400000000000003,"5min":0.622,"15min":0.64700000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.45400000000000001,"15min":0.45900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.248},"max":{"1min":0.57099999999999995,"5min":0.64800000000000002,"15min":0.67800000000000005},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.42499999999999999,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54400000000000004,"5min":0.66500000000000004,"15min":0.66800000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.439,"15min":0.44600000000000001},"min":{"1min":0.27700000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56499999999999995,"5min":0.628,"15min":0.64700000000000002},"last":0.58299999999999996}]},{"osd":4,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77500000000000002,"5min":1.131,"15min":1.131},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.65100000000000002,"15min":0.64800000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.436},"max":{"1min":0.86599999999999999,"5min":0.99199999999999999,"15min":1.0109999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.39800000000000002},"max":{"1min":0.81899999999999995,"5min":0.96399999999999997,"15min":1.0249999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76100000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69599999999999995,"15min":0.68999999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83499999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.68300000000000005,"15min":0.68799999999999994},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.45300000000000001},"max":{"1min":0.74299999999999999,"5min":1.018,"15min":1.0569999999999999},"last":0.95999999999999996}]},{"osd":7,"last update":"Sun Jan 21 21:33:53 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.68600000000000005,"15min":0.68400000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.41099999999999998},"max":{"1min":0.78500000000000003,"5min":1.034,"15min":1.04},"last":0.93700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834575981,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.40300000000000002,"15min":0.40200000000000002},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.55800000000000005,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.433,"15min":0.434},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"max":{"1min":0.53500000000000003,"5min":0.60599999999999998,"15min":0.65800000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40100000000000002,"15min":0.40400000000000003},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51200000000000001,"5min":0.626,"15min":0.64300000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.54000000000000004,"5min":0.67800000000000005,"15min":0.68300000000000005},"last":0.34799999999999998}]},{"osd":3,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54700000000000004,"5min":0.626,"15min":0.66200000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61899999999999999,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.63700000000000001,"15min":0.66700000000000004},"min":{"1min":0.40000000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.90800000000000003,"15min":0.96399999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.68400000000000005},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.91200000000000003,"5min":0.94499999999999995,"15min":1.0069999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.626,"15min":0.64100000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.91100000000000003,"15min":0.97099999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.373,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77800000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.44800000000000001}]},{"osd":6,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.47499999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.94099999999999995,"15min":0.94999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84699999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.52000000000000002}]},{"osd":7,"last update":"Sun Jan 21 21:33:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63200000000000001,"15min":0.64400000000000002},"min":{"1min":0.41599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.87,"5min":0.95199999999999996,"15min":0.98799999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.96199999999999997},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.42799999999999999,"5min":0.59099999999999997,"15min":0.65100000000000002},"last":0.373},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.41899999999999998,"15min":0.432},"min":{"1min":0.316,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.50700000000000001,"5min":0.60299999999999998,"15min":0.60399999999999998},"last":0.38900000000000001}]},{"osd":1,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.38400000000000001,"15min":0.39900000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.72099999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.47999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46200000000000002,"15min":0.46999999999999997},"min":{"1min":0.33000000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48599999999999999,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.64300000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34699999999999998},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55800000000000005}]},{"osd":5,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.433,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81200000000000006,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.626},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90400000000000003,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.65100000000000002,"15min":0.65300000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85899999999999999,"5min":0.995,"15min":0.995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":0.59999999999999998}]},{"osd":7,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.874,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66900000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307888,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94063952,"statfs":{"total":96636764160,"available":96321486848,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.22900000000000001},"max":{"1min":0.71899999999999997,"5min":0.80900000000000005,"15min":0.81799999999999995},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60899999999999999,"15min":0.621},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.68799999999999994,"5min":0.78600000000000003,"15min":0.88200000000000001},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.35699999999999998},"max":{"1min":0.66500000000000004,"5min":0.79300000000000004,"15min":0.85299999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63100000000000001,"15min":0.63200000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.68000000000000005,"5min":0.80000000000000004,"15min":0.85899999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":0.70299999999999996,"5min":0.78600000000000003,"15min":0.81799999999999995},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38},"max":{"1min":0.61899999999999999,"5min":0.76200000000000001,"15min":0.79300000000000004},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.56499999999999995,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.373},"max":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.84299999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59799999999999998,"15min":0.60299999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.66500000000000004,"5min":0.84599999999999997,"15min":0.89600000000000002},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48999999999999999,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.59799999999999998}]},{"osd":6,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52100000000000002,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.75700000000000001,"15min":0.85899999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":0.746,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.746}]},{"osd":7,"last update":"Sun Jan 21 21:34:09 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54700000000000004,"15min":0.54900000000000004},"min":{"1min":0.36199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70399999999999996,"5min":0.754,"15min":0.84599999999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59199999999999997,"15min":0.58699999999999997},"min":{"1min":0.39200000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":0.81299999999999994,"15min":0.89100000000000001},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575980,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":316080,"kb_used_data":2600,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94055760,"statfs":{"total":96636764160,"available":96313098240,"internally_reserved":0,"allocated":2662400,"data_stored":1440348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.60099999999999998,"15min":0.61199999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.755},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61699999999999999,"15min":0.63200000000000001},"min":{"1min":0.39200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.84899999999999998},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56699999999999995,"15min":0.58099999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78800000000000003,"15min":0.81299999999999994},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56899999999999995,"15min":0.57899999999999996},"min":{"1min":0.34799999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":0.69299999999999995,"5min":0.80000000000000004,"15min":0.80700000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69899999999999995,"5min":0.79600000000000004,"15min":0.82999999999999996},"last":0.58699999999999997}]},{"osd":3,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.40899999999999997,"5min":0.38,"15min":0.36199999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.82199999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60199999999999998,"15min":0.60899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.69499999999999995,"5min":0.81000000000000005,"15min":0.83799999999999997},"last":0.57299999999999995}]},{"osd":4,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.49099999999999999,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.29499999999999998},"max":{"1min":0.65800000000000003,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55600000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49099999999999999}]},{"osd":6,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.755},"last":0.505},{"interface":"front","average":{"1min":0.505,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.748,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.42499999999999999}]},{"osd":7,"last update":"Sun Jan 21 21:33:57 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51000000000000001,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.626,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54800000000000004,"15min":0.55700000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.755,"5min":0.82199999999999995,"15min":0.83499999999999996},"last":0.45700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-21T21:34:16.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-21T21:34:16.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.256+0000 7f6963f83700 1 Processor -- start 2024-01-21T21:34:16.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.256+0000 7f6963f83700 1 -- start start 2024-01-21T21:34:16.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6963f83700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f695c0bf780 0x7f695c0c3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6963f83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6963f83700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c068760 con 0x7f695c0bfb60 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6963f83700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c1533d0 con 0x7f695c0bf780 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6963f83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0c3ee0 con 0x7f695c152f70 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f695c0bf780 0x7f695c0c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f695c0bf780 0x7f695c0c3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37770/0 (socket says 172.21.15.133:37770) 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 -- 172.21.15.133:0/3131742061 learned_addr learned my addr 172.21.15.133:0/3131742061 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6962520700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 -- 172.21.15.133:0/3131742061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 msgr2=0x7f695c0c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 -- 172.21.15.133:0/3131742061 >> v1:172.21.15.178:6789/0 conn(0x7f695c0bfb60 legacy=0x7f695c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:16.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.257+0000 7f6961d1f700 1 -- 172.21.15.133:0/3131742061 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c1535d0 con 0x7f695c0bf780 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6962520700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6961d1f700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0c3500 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7f694c009830 tx=0x7f694c0090f0).ready entity=mon.0 client_cookie=7aa121ece6f1db8a server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6960d1d700 1 -- 172.21.15.133:0/3131742061 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00b600 con 0x7f695c0bf780 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6960d1d700 1 -- 172.21.15.133:0/3131742061 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00b760 con 0x7f695c0bf780 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6960d1d700 1 -- 172.21.15.133:0/3131742061 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c00bb00 con 0x7f695c0bf780 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 -- 172.21.15.133:0/3131742061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 msgr2=0x7f695c0c3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0c3500 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7f694c009830 tx=0x7f694c0090f0).stop 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 -- 172.21.15.133:0/3131742061 shutdown_connections 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0c3500 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 --2- 172.21.15.133:0/3131742061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 -- 172.21.15.133:0/3131742061 >> 172.21.15.133:0/3131742061 conn(0x7f695c066a90 msgr2=0x7f695c066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 -- 172.21.15.133:0/3131742061 shutdown_connections 2024-01-21T21:34:16.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.258+0000 7f6963f83700 1 -- 172.21.15.133:0/3131742061 wait complete. 2024-01-21T21:34:16.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.260+0000 7f6963f83700 1 Processor -- start 2024-01-21T21:34:16.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.260+0000 7f6963f83700 1 -- start start 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 0x7f695c0c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0ae3c0 con 0x7f695c0bf780 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0addb0 con 0x7f695c0bfb60 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6963f83700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c155890 con 0x7f695c152f70 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37778/0 (socket says 172.21.15.133:37778) 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 -- 172.21.15.133:0/3697932188 learned_addr learned my addr 172.21.15.133:0/3697932188 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f696151e700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 0x7f695c0c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6962520700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 -- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 msgr2=0x7f695c0aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 -- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 msgr2=0x7f695c0c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 0x7f695c0c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 -- 172.21.15.133:0/3697932188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c009370 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f696151e700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 0x7f695c0c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.261+0000 7f6961d1f700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7f694c009f80 tx=0x7f694c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.262+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0069b0 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.262+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c00b8d0 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.262+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c024470 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.262+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c155b70 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.262+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c155e50 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.263+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c0ae6a0 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.263+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7f694c021070 con 0x7f695c0bf780 2024-01-21T21:34:16.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.263+0000 7f69527fc700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 0x7f6940061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.263+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7f694c07bf80 con 0x7f695c0bf780 2024-01-21T21:34:16.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.263+0000 7f696151e700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 0x7f6940061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.264+0000 7f696151e700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 0x7f6940061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f695c151450 tx=0x7f6958009040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.267+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7f694c0aab00 con 0x7f695c0bf780 2024-01-21T21:34:16.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.430+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f695c05fdf0 con 0x7f695c0bf780 2024-01-21T21:34:16.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.435+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f694c04d0a0 con 0x7f695c0bf780 2024-01-21T21:34:16.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.436+0000 7f69527fc700 1 -- 172.21.15.133:0/3697932188 <== mon.0 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v46)=0 v46) v1 ==== 123+0+0 (secure 0 0 0) 0x7f694c029030 con 0x7f695c0bf780 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 msgr2=0x7f6940061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 0x7f6940061610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f695c151450 tx=0x7f6958009040).stop 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 msgr2=0x7f695c0ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 rx=0x7f694c009f80 tx=0x7f694c017000).stop 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 shutdown_connections 2024-01-21T21:34:16.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f695c152f70 0x7f695c0aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f695c0bf780 0x7f695c0ae850 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7f694005f150 0x7f6940061610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 --2- 172.21.15.133:0/3697932188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f695c0bfb60 0x7f695c0c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 >> 172.21.15.133:0/3697932188 conn(0x7f695c066a90 msgr2=0x7f695c0abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 shutdown_connections 2024-01-21T21:34:16.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.438+0000 7f6963f83700 1 -- 172.21.15.133:0/3697932188 wait complete. 2024-01-21T21:34:16.453 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-21T21:34:16.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-21T21:34:16.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.566+0000 7fc1fd2bd700 1 Processor -- start 2024-01-21T21:34:16.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.566+0000 7fc1fd2bd700 1 -- start start 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f80c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1f80c3c60 0x7fc1f8155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1f81561a0 0x7fc1f81526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f80c61a0 con 0x7fc1f81561a0 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f8156630 con 0x7fc1f80c3c60 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1fd2bd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80c5350 con 0x7fc1f81351d0 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.567+0000 7fc1f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1f81561a0 0x7fc1f81526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1f81561a0 0x7fc1f81526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37786/0 (socket says 172.21.15.133:37786) 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 -- 172.21.15.133:0/2335073492 learned_addr learned my addr 172.21.15.133:0/2335073492 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f67fc700 1 --2- 172.21.15.133:0/2335073492 >> v2:172.21.15.178:3300/0 conn(0x7fc1f80c3c60 0x7fc1f8155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f6ffd700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f80c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 -- 172.21.15.133:0/2335073492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 msgr2=0x7fc1f80c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f80c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 -- 172.21.15.133:0/2335073492 >> v2:172.21.15.178:3300/0 conn(0x7fc1f80c3c60 msgr2=0x7fc1f8155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/2335073492 >> v2:172.21.15.178:3300/0 conn(0x7fc1f80c3c60 0x7fc1f8155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 -- 172.21.15.133:0/2335073492 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80c55d0 con 0x7fc1f81561a0 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f6ffd700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f80c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f81526a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7fc1f806afd0 tx=0x7fc1f0009840).ready entity=mon.0 client_cookie=daf3b2c0feeddfde server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f5ffb700 1 -- 172.21.15.133:0/2335073492 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000e070 con 0x7fc1f81561a0 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f5ffb700 1 -- 172.21.15.133:0/2335073492 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1f000ba20 con 0x7fc1f81561a0 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.568+0000 7fc1f5ffb700 1 -- 172.21.15.133:0/2335073492 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f000bdc0 con 0x7fc1f81561a0 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/2335073492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 msgr2=0x7fc1f81526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f81526a0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 rx=0x7fc1f806afd0 tx=0x7fc1f0009840).stop 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/2335073492 shutdown_connections 2024-01-21T21:34:16.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f81526a0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/2335073492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f80c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/2335073492 >> v2:172.21.15.178:3300/0 conn(0x7fc1f80c3c60 0x7fc1f8155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/2335073492 >> 172.21.15.133:0/2335073492 conn(0x7fc1f8066a90 msgr2=0x7fc1f8066ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/2335073492 shutdown_connections 2024-01-21T21:34:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.569+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/2335073492 wait complete. 2024-01-21T21:34:16.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.570+0000 7fc1fd2bd700 1 Processor -- start 2024-01-21T21:34:16.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.570+0000 7fc1fd2bd700 1 -- start start 2024-01-21T21:34:16.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f80c3c60 0x7fc1f8164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f81364b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81369a0 con 0x7fc1f81561a0 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8138220 con 0x7fc1f80c3c60 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1fd2bd700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8167970 con 0x7fc1f81351d0 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37792/0 (socket says 172.21.15.133:37792) 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 -- 172.21.15.133:0/1627484156 learned_addr learned my addr 172.21.15.133:0/1627484156 (peer_addr_for_me v2:172.21.15.133:0/0) 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f6ffd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f80c3c60 0x7fc1f8164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f67fc700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f81364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 -- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 msgr2=0x7fc1f81364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f81364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 -- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f80c3c60 msgr2=0x7fc1f8164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f80c3c60 0x7fc1f8164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 -- 172.21.15.133:0/1627484156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009ae0 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.571+0000 7fc1f77fe700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fc1f0013ce0 tx=0x7fc1f0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.572+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0007000 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.572+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1f00092e0 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.572+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f81648c0 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.572+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0007880 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.572+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f8164e80 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.573+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f805fdf0 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.573+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 109) v1 ==== 75446+0+0 (secure 0 0 0) 0x7fc1f0003040 con 0x7fc1f81561a0 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.573+0000 7fc1df7fe700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 0x7fc1e4061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-01-21T21:34:16.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.573+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6454+0+0 (secure 0 0 0) 0x7fc1f007bc10 con 0x7fc1f81561a0 2024-01-21T21:34:16.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.573+0000 7fc1f6ffd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 0x7fc1e4061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-01-21T21:34:16.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.574+0000 7fc1f6ffd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 0x7fc1e4061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc1f81345f0 tx=0x7fc1e8008040).ready entity=mgr.10326 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-21T21:34:16.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.577+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162534 (secure 0 0 0) 0x7fc1f004cee0 con 0x7fc1f81561a0 2024-01-21T21:34:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.780+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f806bd20 con 0x7fc1f81561a0 2024-01-21T21:34:16.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.781+0000 7fc1df7fe700 1 -- 172.21.15.133:0/1627484156 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3544 (secure 0 0 0) 0x7fc1f0024070 con 0x7fc1f81561a0 2024-01-21T21:34:16.784 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-01-21T21:34:16.784 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8132,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3355277782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3355277782},{"type":"v1","addr":"172.21.15.178:6835","nonce":3355277782}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75},{"gid":10035,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6836/1959257265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1959257265},{"type":"v1","addr":"172.21.15.133:6836","nonce":1959257265}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1899868301","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1899868301},{"type":"v1","addr":"172.21.15.133:6837","nonce":1899868301}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":10050,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3017481444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3017481444},{"type":"v1","addr":"172.21.15.178:6834","nonce":3017481444}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 msgr2=0x7fc1e4061610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 0x7fc1e4061610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc1f81345f0 tx=0x7fc1e8008040).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 msgr2=0x7fc1f80c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 rx=0x7fc1f0013ce0 tx=0x7fc1f0009840).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 shutdown_connections 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1f81561a0 0x7fc1f80c8ef0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.133:6832/94812,v1:172.21.15.133:6833/94812] conn(0x7fc1e405f150 0x7fc1e4061610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1f80c3c60 0x7fc1f8164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 --2- 172.21.15.133:0/1627484156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1f81351d0 0x7fc1f81364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 >> 172.21.15.133:0/1627484156 conn(0x7fc1f8066a90 msgr2=0x7fc1f8134830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 shutdown_connections 2024-01-21T21:34:16.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-01-21T21:34:16.783+0000 7fc1fd2bd700 1 -- 172.21.15.133:0/1627484156 wait complete. 2024-01-21T21:34:16.787 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 76 2024-01-21T21:34:16.797 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-21T21:34:16.798 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-21T21:34:16.798 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-21T21:34:16.798 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:16.806 INFO:tasks.ceph.mds.a:Stopped 2024-01-21T21:34:16.806 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-21T21:34:16.806 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:16.856 INFO:tasks.ceph.mds.c:Stopped 2024-01-21T21:34:16.856 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-21T21:34:16.857 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:16.867 INFO:tasks.ceph.mds.b:Stopped 2024-01-21T21:34:16.867 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-21T21:34:16.868 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:16.919 INFO:tasks.ceph.mds.d:Stopped 2024-01-21T21:34:16.919 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-21T21:34:16.919 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-21T21:34:16.919 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:16.947 INFO:tasks.ceph.osd.0:Stopped 2024-01-21T21:34:16.947 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-21T21:34:16.947 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.019 INFO:tasks.ceph.osd.1:Stopped 2024-01-21T21:34:17.019 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-21T21:34:17.019 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.086 INFO:tasks.ceph.osd.2:Stopped 2024-01-21T21:34:17.086 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-21T21:34:17.086 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.158 INFO:tasks.ceph.osd.3:Stopped 2024-01-21T21:34:17.158 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-21T21:34:17.158 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.197 INFO:tasks.ceph.osd.4:Stopped 2024-01-21T21:34:17.197 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-21T21:34:17.197 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.267 INFO:tasks.ceph.osd.5:Stopped 2024-01-21T21:34:17.267 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-21T21:34:17.267 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.345 INFO:tasks.ceph.osd.6:Stopped 2024-01-21T21:34:17.345 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-21T21:34:17.345 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.415 INFO:tasks.ceph.osd.7:Stopped 2024-01-21T21:34:17.415 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-21T21:34:17.415 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-21T21:34:17.416 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.442 INFO:tasks.ceph.mgr.y:Stopped 2024-01-21T21:34:17.442 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-21T21:34:17.442 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.482 INFO:tasks.ceph.mgr.x:Stopped 2024-01-21T21:34:17.482 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-21T21:34:17.483 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-21T21:34:17.483 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.501 INFO:tasks.ceph.mon.a:Stopped 2024-01-21T21:34:17.502 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-21T21:34:17.502 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.540 INFO:tasks.ceph.mon.b:Stopped 2024-01-21T21:34:17.540 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-21T21:34:17.540 INFO:teuthology.orchestra.run:waiting for 300 2024-01-21T21:34:17.597 INFO:tasks.ceph.mon.c:Stopped 2024-01-21T21:34:17.598 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-21T21:34:17.598 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-21T21:34:17.629 INFO:teuthology.orchestra.run.smithi133.stdout:2024-01-21T20:13:10.069511+0000 mon.a (mon.0) 587 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-01-21T21:34:17.629 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-01-21T21:34:17.630 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-21T21:34:17.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-21T21:34:17.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-21T21:34:17.842 INFO:teuthology.orchestra.run.smithi133.stdout:2024-01-21T20:13:10.069511+0000 mon.a (mon.0) 587 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-01-21T21:34:17.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:34:17.842 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-21T21:34:18.072 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:34:18.072 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-21T21:34:18.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:34:18.171 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-21T21:34:18.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:34:18.238 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-21T21:34:18.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T21:34:18.306 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-21T21:34:18.453 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T21:34:18.453 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-21T21:34:18.530 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T21:34:18.530 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-21T21:34:18.609 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T21:34:18.610 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-21T21:34:18.678 INFO:tasks.ceph:Archiving mon data... 2024-01-21T21:34:18.680 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/data/mon.a.tgz 2024-01-21T21:34:18.683 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-01-21T21:34:18.701 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.ajj9WDBbi8 2024-01-21T21:34:18.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ajj9WDBbi8 2024-01-21T21:34:19.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.ajj9WDBbi8 2024-01-21T21:34:19.346 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.ajj9WDBbi8 is 2MB 2024-01-21T21:34:19.450 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.ajj9WDBbi8 2024-01-21T21:34:19.467 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/data/mon.b.tgz 2024-01-21T21:34:19.468 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-01-21T21:34:19.488 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.hSCMBmLVDt 2024-01-21T21:34:19.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hSCMBmLVDt 2024-01-21T21:34:20.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.hSCMBmLVDt 2024-01-21T21:34:20.149 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.hSCMBmLVDt is 3MB 2024-01-21T21:34:20.302 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.hSCMBmLVDt 2024-01-21T21:34:20.320 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/data/mon.c.tgz 2024-01-21T21:34:20.320 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-01-21T21:34:20.375 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.CxC0lq9Ag5 2024-01-21T21:34:20.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CxC0lq9Ag5 2024-01-21T21:34:20.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.CxC0lq9Ag5 2024-01-21T21:34:21.020 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.CxC0lq9Ag5 is 3MB 2024-01-21T21:34:21.167 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.CxC0lq9Ag5 2024-01-21T21:34:21.184 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-21T21:34:21.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-21T21:34:21.187 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-21T21:34:21.250 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-01-21T21:34:21.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-21T21:34:21.260 DEBUG:teuthology.orchestra.run.smithi178:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-01-21T21:34:21.289 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-21T21:34:21.317 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-01-21T21:34:21.323 INFO:tasks.ceph:Archiving crash dumps... 2024-01-21T21:34:21.324 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi133/crash 2024-01-21T21:34:21.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-21T21:34:21.369 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi178/crash 2024-01-21T21:34:21.370 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-21T21:34:21.395 INFO:tasks.ceph:Shutting down logrotate 2024-01-21T21:34:21.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:21.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:21.493 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:21.521 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-21T21:34:21.547 INFO:tasks.ceph:Compressing logs... 2024-01-21T21:34:21.548 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-21T21:34:21.564 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-21T21:34:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71547.log 2024-01-21T21:34:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92925.log 2024-01-21T21:34:21.590 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93303.log 2024-01-21T21:34:21.628 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43501.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43547.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.43501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43592.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43455.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43547.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43501.log.gz 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43592.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43592.log.gz 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr: 87.8%/var/log/ceph/ceph-client.admin.43455.log: -- replaced with /var/log/ceph/ceph-client.admin.43547.log.gz 2024-01-21T21:34:21.629 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log /var/log/ceph/ceph-osd.7.log: 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43455.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.48383.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43737.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47920.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.3.48383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.48383.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.1.47920.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47920.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.6.log: 94.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-21T21:34:21.630 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-21T21:34:21.631 INFO:teuthology.orchestra.run.smithi178.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-21T21:34:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43692.log 2024-01-21T21:34:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43692.log.gz 2024-01-21T21:34:21.631 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47436.log 2024-01-21T21:34:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.47436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47436.log.gz 2024-01-21T21:34:21.633 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-21T21:34:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43784.log 2024-01-21T21:34:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.43784.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43784.log.gz 2024-01-21T21:34:21.638 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-21T21:34:21.650 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-21T21:34:21.682 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47953.log 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4%/var/log/ceph/ceph-client.admin.92925.log: -- replaced with /var/log/ceph/ceph-client.admin.71547.log.gz 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98090.log 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92925.log.gz 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94766.log 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93303.log.gz 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67484.log 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98090.log.gz 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.94766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66987.log 2024-01-21T21:34:21.683 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94766.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94720.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.67484.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.66987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80929.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66987.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.94720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76641.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80929.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94720.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55451.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80929.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74614.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76641.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73645.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74614.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55451.log.gz 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81802.log 2024-01-21T21:34:21.684 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74614.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53496.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73645.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89807.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53496.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81802.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96495.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53496.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70146.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89807.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78597.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70146.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96495.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52516.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70146.log.gz/var/log/ceph/ceph-client.admin.78597.log: 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103381.log 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78597.log.gz 2024-01-21T21:34:21.685 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91200.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103381.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52516.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93349.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103381.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61274.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91200.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77995.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72510.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77995.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93349.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61274.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80483.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77995.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100826.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72510.log: /var/log/ceph/ceph-client.admin.80483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97699.log 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72510.log.gz 2024-01-21T21:34:21.686 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105802.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80483.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97699.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.100826.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54329.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97699.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76977.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105802.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106032.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54329.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77568.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76339.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.76977.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106032.log.gz 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56164.log 2024-01-21T21:34:21.687 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.77568.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53869.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102026.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76339.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56164.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62194.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102026.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53869.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101080.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62194.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102026.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54841.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62194.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101080.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.54841.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101080.log.gz 2024-01-21T21:34:21.688 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54841.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100882.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95811.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99033.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100882.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102072.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95811.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105019.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.99033.log: /var/log/ceph/ceph-client.admin.102072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96201.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99033.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105019.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102072.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81848.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105019.log.gz 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71833.log 2024-01-21T21:34:21.689 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96201.log: /var/log/ceph/ceph-client.admin.81848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83524.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.96201.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.81848.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58032.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71833.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71741.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83524.log: /var/log/ceph/ceph-client.admin.58032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57636.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.83524.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58032.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63488.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71741.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71451.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57636.log: /var/log/ceph/ceph-client.admin.63488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93796.log 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57636.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63488.log.gz 2024-01-21T21:34:21.690 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70954.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93211.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71451.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70954.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93796.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52608.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70954.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47609.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93211.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69355.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52608.log: /var/log/ceph/ceph-client.admin.47609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78457.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52608.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.69355.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47609.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52654.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69355.log.gz 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53312.log 2024-01-21T21:34:21.691 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52654.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.78457.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67289.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52654.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60049.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53312.log: /var/log/ceph/ceph-client.admin.67289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61665.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53312.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.60049.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67289.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102590.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61665.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60049.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78273.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61665.log.gz 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62692.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102590.log: /var/log/ceph/ceph-client.admin.78273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78181.log 2024-01-21T21:34:21.692 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102590.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78273.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89287.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90554.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62692.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89287.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.78181.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75904.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89287.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77090.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90554.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75589.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75904.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92412.log 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.77090.log.gz 2024-01-21T21:34:21.693 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81534.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75589.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92590.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52997.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92412.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.81534.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66673.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52997.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92590.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74380.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52997.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.66673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75708.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66673.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88744.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74380.log.gz 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62445.log 2024-01-21T21:34:21.694 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73290.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75708.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88744.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92776.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88998.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62445.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73290.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82673.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92776.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53179.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88998.log.gz 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49620.log: gzip 88.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.82673.log.gz-- 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63911.log 2024-01-21T21:34:21.695 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102264.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53179.log.gz 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80190.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63911.log: /var/log/ceph/ceph-client.admin.102264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62102.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63911.log.gz 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102264.log.gz 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50172.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80190.log.gzgzip 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.89241.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62102.log: /var/log/ceph/ceph-client.admin.50172.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62102.log.gz 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78549.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105572.log 2024-01-21T21:34:21.696 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89241.log: /var/log/ceph/ceph-client.admin.78549.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50172.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89241.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49942.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105572.log: /var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82719.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: 91.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78549.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105572.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77949.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92682.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49942.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82719.log.gz 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50080.log 2024-01-21T21:34:21.697 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92682.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77949.log.gzgzip 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.103497.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50080.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92682.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101504.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50080.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73875.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104100.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103497.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101504.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98986.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73875.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90501.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104100.log.gz 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62148.log 2024-01-21T21:34:21.698 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98986.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.90501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55874.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.90501.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62148.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51716.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47249.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55874.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91353.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91353.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51716.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105388.log 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8%/var/log/ceph/ceph-client.admin.48968.log: -- replaced with /var/log/ceph/ceph-client.admin.91353.log.gz 2024-01-21T21:34:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97906.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95351.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105388.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88052.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97906.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54145.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88052.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95351.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62922.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54145.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88052.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71693.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54145.log.gz 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74982.log 2024-01-21T21:34:21.700 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62922.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92205.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52132.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71693.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92205.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74982.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77800.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92205.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74890.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52132.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100981.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74890.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77800.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.74890.log.gz 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88652.log 2024-01-21T21:34:21.701 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.100981.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93726.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80296.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96046.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88652.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80296.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93726.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77476.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96046.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80296.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100484.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96046.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47140.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77476.log.gz 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102544.log 2024-01-21T21:34:21.702 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47140.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100484.log.gz 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73737.log 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47140.log.gz 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51302.log 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102544.log.gz 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72753.log 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51302.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73737.log.gz 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51302.log.gz 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104149.log 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.c.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.72753.log.gz--verbose 2024-01-21T21:34:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:-- /var/log/ceph/ceph-client.admin.81624.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97226.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81624.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104149.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82017.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.81624.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97140.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82017.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97226.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47795.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.82017.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78365.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97140.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89425.log 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47795.log: /var/log/ceph/ceph-client.admin.78365.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47795.log.gz 2024-01-21T21:34:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55921.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89425.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78365.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51394.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89425.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92636.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82165.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55921.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92636.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97272.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105526.log 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82165.log.gz 2024-01-21T21:34:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97272.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59436.log 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97272.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53915.log 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105526.log: /var/log/ceph/ceph-client.admin.59436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48784.log 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105526.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59436.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55384.log 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:gzip 88.2%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53915.log.gz/var/log/ceph/ceph-client.admin.91473.log /var/log/ceph/ceph-client.admin.48784.log: 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55384.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48784.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56211.log 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55384.log.gz 2024-01-21T21:34:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97318.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91473.log: /var/log/ceph/ceph-client.admin.56211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73783.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.91473.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56211.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69805.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51946.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73783.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97318.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53726.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73783.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52930.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69805.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53726.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51946.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90753.log 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53726.log.gz 2024-01-21T21:34:21.707 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91717.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70244.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52930.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92021.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.90753.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.91717.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59129.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70244.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67336.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92021.log: /var/log/ceph/ceph-client.admin.59129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64246.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92021.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67336.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59129.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70489.log 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67336.log.gz 2024-01-21T21:34:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.64246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89761.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64246.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74196.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70489.log: /var/log/ceph/ceph-client.admin.89761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95998.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70489.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74196.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89761.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69029.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95998.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74196.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48646.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.95998.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80784.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82489.log 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69029.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80784.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69029.log.gz 2024-01-21T21:34:21.709 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104253.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71267.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80784.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104253.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.82489.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56062.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104253.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82211.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48692.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71267.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56062.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68891.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48692.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.82211.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75028.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48692.log.gz 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97653.log 2024-01-21T21:34:21.710 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68891.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75028.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48441.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97653.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102636.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48441.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66799.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48441.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73192.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102636.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.66799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74706.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66799.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97998.log 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73192.log.gz 2024-01-21T21:34:21.711 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61764.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74706.log: /var/log/ceph/ceph-client.admin.97998.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74706.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71925.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3%/var/log/ceph/ceph-client.admin.61764.log: -- replaced with /var/log/ceph/ceph-client.admin.97998.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70040.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61764.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88928.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61909.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70040.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71925.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88928.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70040.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61909.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.88928.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61909.log.gz 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92067.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54515.log 2024-01-21T21:34:21.712 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97814.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54515.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92067.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93397.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54515.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73829.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52178.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97814.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93397.log: /var/log/ceph/ceph-client.admin.73829.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93397.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67830.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73829.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83212.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73143.log 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52178.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83212.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67830.log.gz 2024-01-21T21:34:21.713 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57228.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83212.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103098.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73143.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57228.log: /var/log/ceph/ceph-client.admin.47981.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57228.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106238.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103098.log: /var/log/ceph/ceph-client.admin.106238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103098.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51440.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106238.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51578.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76012.log 2024-01-21T21:34:21.714 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51578.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz--verbose 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:-- /var/log/ceph/ceph-client.admin.76494.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51578.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76243.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76012.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76494.log: /var/log/ceph/ceph-client.admin.76243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101550.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76494.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76243.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70862.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0%/var/log/ceph/ceph-client.admin.101550.log: -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102452.log 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70862.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101550.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70862.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102452.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102452.log.gz 2024-01-21T21:34:21.715 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97050.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54609.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105618.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97050.log.gz 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81372.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105618.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.54609.log.gz--verbose 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:-- /var/log/ceph/ceph-client.admin.49206.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81372.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105618.log.gz 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81372.log.gz 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49206.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104547.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104498.log 2024-01-21T21:34:21.716 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104547.log.gz/var/log/ceph/ceph-client.admin.47935.log: 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104498.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104498.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68335.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101225.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94081.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8%/var/log/ceph/ceph-client.admin.101225.log: -- replaced with /var/log/ceph/ceph-client.admin.68335.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101225.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.94081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94081.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101642.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101127.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67922.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101642.log.gz 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104881.log 2024-01-21T21:34:21.717 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67922.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.101127.log.gz--verbose 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:-- /var/log/ceph/ceph-client.admin.98274.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104881.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67922.log.gz 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104881.log.gz 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98274.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.98274.log.gz 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81464.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52746.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91572.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6%/var/log/ceph/ceph-client.admin.52746.log: -- replaced with /var/log/ceph/ceph-client.admin.81464.log.gz 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96396.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52746.log.gz 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105204.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:gzip 87.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.91572.log.gz-- 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70195.log 2024-01-21T21:34:21.718 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96396.log: /var/log/ceph/ceph-client.admin.105204.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96396.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105204.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70195.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70195.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49060.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62399.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49060.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62784.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77706.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62399.log.gz/var/log/ceph/ceph-client.admin.52224.log: 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62784.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62784.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77706.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77706.log.gz 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96933.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90950.log 2024-01-21T21:34:21.719 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77228.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96933.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51854.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88698.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77228.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.90950.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51854.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77228.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51854.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88698.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88698.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83045.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101596.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.83045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51486.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.83045.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101596.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101596.log.gz 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74334.log 2024-01-21T21:34:21.720 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54237.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51486.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88150.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74334.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68569.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76445.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54237.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88150.log: /var/log/ceph/ceph-client.admin.68569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82119.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88150.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76445.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68569.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68038.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76445.log.gz 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82119.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37042.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52792.log 2024-01-21T21:34:21.721 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82119.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68038.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.tmp-client.admin.37042.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37042.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55719.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93257.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52792.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71647.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55719.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61811.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71647.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.93257.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77182.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.71647.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98322.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77182.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61811.log.gz 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82581.log 2024-01-21T21:34:21.722 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98322.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.77182.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82581.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98322.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89667.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82581.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102406.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89945.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89667.log: /var/log/ceph/ceph-client.admin.102406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72892.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.89667.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102406.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88395.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72892.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.89945.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78089.log 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72892.log.gz 2024-01-21T21:34:21.723 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88395.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-21T21:34:21.724 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.47953.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47953.log.gz 2024-01-21T21:34:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101176.log 2024-01-21T21:34:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78089.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88395.log.gz 2024-01-21T21:34:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.a.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78089.log.gz 2024-01-21T21:34:21.746 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101176.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101176.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58098.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68381.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58098.log: /var/log/ceph/ceph-client.admin.68381.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58098.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68381.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101734.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78227.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101734.log: /var/log/ceph/ceph-client.admin.78227.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101734.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.78227.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73094.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105434.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73094.log: /var/log/ceph/ceph-client.admin.105434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73094.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105434.log.gz 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68427.log 2024-01-21T21:34:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48303.log 2024-01-21T21:34:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68427.log: /var/log/ceph/ceph-client.admin.48303.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68427.log.gz 2024-01-21T21:34:21.748 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48303.log.gz 2024-01-21T21:34:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105296.log 2024-01-21T21:34:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93073.log 2024-01-21T21:34:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105296.log: /var/log/ceph/ceph-client.admin.93073.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105296.log.gz 2024-01-21T21:34:21.751 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93073.log.gz 2024-01-21T21:34:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73387.log 2024-01-21T21:34:21.751 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51808.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73387.log: /var/log/ceph/ceph-client.admin.51808.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73387.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51808.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54469.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.54469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54469.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96348.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67876.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96348.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67876.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67876.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49298.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97504.log 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49298.log: /var/log/ceph/ceph-client.admin.97504.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49298.log.gz 2024-01-21T21:34:21.752 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97504.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92498.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57458.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92498.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92498.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57458.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57458.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80685.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50126.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80685.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50126.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76395.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52470.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76395.log: /var/log/ceph/ceph-client.admin.52470.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.76395.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52470.log.gz 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106170.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2024-01-21T21:34:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106170.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.106170.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47655.log: 89.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89991.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74844.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63582.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74844.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89991.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74844.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63582.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63582.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62307.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63442.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98182.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62307.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98182.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63442.log.gz 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98651.log 2024-01-21T21:34:21.754 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98182.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105250.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91249.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105250.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98651.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91249.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105250.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91249.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55652.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93680.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79290.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93680.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55652.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93680.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.79290.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79290.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80531.log 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.80531.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80531.log.gz 2024-01-21T21:34:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90129.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90129.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.90129.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61413.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62516.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61413.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62516.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62516.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93165.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96841.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93165.log: 87.8%/var/log/ceph/ceph-client.admin.96841.log: -- replaced with /var/log/ceph/ceph-client.admin.93165.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96841.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82351.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54053.log 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82351.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82351.log.gz 2024-01-21T21:34:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54053.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54053.log.gz 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66939.log 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.66939.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66939.log.gz 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61566.log 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53089.log: /var/log/ceph/ceph-client.admin.61566.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61566.log.gz 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71114.log 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.71114.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71114.log.gz 2024-01-21T21:34:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97747.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97747.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80881.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80881.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.80881.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93027.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93027.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.93027.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48027.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48027.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48027.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103566.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103566.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103566.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101688.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101688.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101688.log.gz 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57320.log 2024-01-21T21:34:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57320.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57320.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96300.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96300.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96300.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104351.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104351.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104351.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93886.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93886.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.93886.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100778.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51532.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100778.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.100778.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51532.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51532.log.gz 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80979.log 2024-01-21T21:34:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80979.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80979.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57900.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57900.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57900.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102498.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102498.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102498.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74660.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74660.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74660.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49390.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49390.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49390.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81188.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81188.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81188.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72063.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55585.log 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72063.log: /var/log/ceph/ceph-client.admin.55585.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55585.log.gz 2024-01-21T21:34:21.760 INFO:teuthology.orchestra.run.smithi133.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.72063.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62606.log 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62606.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62606.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54375.log 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54375.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104197.log 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104197.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104197.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61616.log 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61616.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61616.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88249.log 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88249.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88249.log.gz 2024-01-21T21:34:21.761 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51900.log 2024-01-21T21:34:21.762 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-21T21:34:21.763 INFO:teuthology.orchestra.run.smithi178.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-21T21:34:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51900.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51900.log.gz 2024-01-21T21:34:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-01-21T21:34:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56258.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2024-01-21T21:34:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87996.log 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.87996.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87996.log.gz 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72988.log 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72988.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.72988.log.gz 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69452.log 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101940.log 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69452.log: /var/log/ceph/ceph-client.admin.101940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69452.log.gz 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101940.log.gz 2024-01-21T21:34:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57412.log 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57412.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57412.log.gz 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105986.log 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105986.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.105986.log.gz 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91424.log 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91424.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91424.log.gz 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75659.log 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75659.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75659.log.gz 2024-01-21T21:34:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82765.log 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49850.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82765.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82765.log.gz 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57366.log 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57366.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57366.log.gz 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61510.log 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61510.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61510.log.gz 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56117.log 2024-01-21T21:34:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56117.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56117.log.gz 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73921.log 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68128.log 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73921.log: 88.2%/var/log/ceph/ceph-client.admin.68128.log: -- replaced with /var/log/ceph/ceph-client.admin.73921.log.gz 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68128.log.gz 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87899.log 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.87899.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87899.log.gz 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63212.log 2024-01-21T21:34:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104973.log 2024-01-21T21:34:21.771 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63212.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63212.log.gz 2024-01-21T21:34:21.771 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104973.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104973.log.gz 2024-01-21T21:34:21.771 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-01-21T21:34:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57090.log 2024-01-21T21:34:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48073.log: /var/log/ceph/ceph-client.admin.57090.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-01-21T21:34:21.773 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57090.log.gz 2024-01-21T21:34:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102218.log 2024-01-21T21:34:21.773 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102218.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102218.log.gz 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81280.log 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86518.log 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81280.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81280.log.gz 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.86518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.86518.log.gz 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91975.log 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91975.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91975.log.gz 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101458.log 2024-01-21T21:34:21.774 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68521.log 2024-01-21T21:34:21.775 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101458.log.gz 2024-01-21T21:34:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68521.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68521.log.gz 2024-01-21T21:34:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103004.log 2024-01-21T21:34:21.776 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88345.log 2024-01-21T21:34:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103004.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103004.log.gz 2024-01-21T21:34:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88345.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88345.log.gz 2024-01-21T21:34:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102866.log 2024-01-21T21:34:21.778 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105756.log 2024-01-21T21:34:21.779 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102866.log: /var/log/ceph/ceph-client.admin.105756.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102866.log.gz 2024-01-21T21:34:21.779 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105756.log.gz 2024-01-21T21:34:21.779 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-01-21T21:34:21.780 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53404.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-01-21T21:34:21.780 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49436.log 2024-01-21T21:34:21.780 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68473.log 2024-01-21T21:34:21.781 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49436.log: /var/log/ceph/ceph-client.admin.68473.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49436.log.gz 2024-01-21T21:34:21.781 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68473.log.gz 2024-01-21T21:34:21.781 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101275.log 2024-01-21T21:34:21.782 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101275.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.101275.log.gz 2024-01-21T21:34:21.782 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67385.log 2024-01-21T21:34:21.783 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91767.log 2024-01-21T21:34:21.783 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92159.log 2024-01-21T21:34:21.783 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67385.log.gz 2024-01-21T21:34:21.784 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91767.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.91767.log.gz 2024-01-21T21:34:21.786 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92159.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92159.log.gz 2024-01-21T21:34:21.786 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67968.log 2024-01-21T21:34:21.786 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82397.log 2024-01-21T21:34:21.787 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67968.log.gz 2024-01-21T21:34:21.788 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82397.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82397.log.gz 2024-01-21T21:34:21.788 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75543.log 2024-01-21T21:34:21.788 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75543.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75543.log.gz 2024-01-21T21:34:21.789 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70096.log 2024-01-21T21:34:21.789 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49804.log 2024-01-21T21:34:21.790 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70096.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70096.log.gz 2024-01-21T21:34:21.790 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49804.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49804.log.gz 2024-01-21T21:34:21.790 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63164.log 2024-01-21T21:34:21.792 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63164.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63164.log.gz 2024-01-21T21:34:21.792 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89715.log 2024-01-21T21:34:21.794 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89715.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.89715.log.gz 2024-01-21T21:34:21.794 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63396.log 2024-01-21T21:34:21.795 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63396.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63396.log.gz 2024-01-21T21:34:21.795 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106124.log 2024-01-21T21:34:21.795 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57274.log 2024-01-21T21:34:21.796 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106124.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.106124.log.gz 2024-01-21T21:34:21.797 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57274.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57274.log.gz 2024-01-21T21:34:21.797 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-21T21:34:21.805 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91061.log 2024-01-21T21:34:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.91061.log.gz 2024-01-21T21:34:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61860.log 2024-01-21T21:34:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61860.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61860.log.gz 2024-01-21T21:34:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97456.log 2024-01-21T21:34:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97456.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97456.log.gz 2024-01-21T21:34:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78926.log 2024-01-21T21:34:21.827 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.78926.log.gz 2024-01-21T21:34:21.828 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49252.log 2024-01-21T21:34:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49252.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49252.log.gz 2024-01-21T21:34:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73599.log 2024-01-21T21:34:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73599.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73599.log.gz 2024-01-21T21:34:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83096.log 2024-01-21T21:34:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83096.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83096.log.gz 2024-01-21T21:34:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88200.log 2024-01-21T21:34:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88200.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88200.log.gz 2024-01-21T21:34:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101780.log 2024-01-21T21:34:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101780.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101780.log.gz 2024-01-21T21:34:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57136.log 2024-01-21T21:34:21.834 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57136.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57136.log.gz 2024-01-21T21:34:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62970.log 2024-01-21T21:34:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62970.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62970.log.gz 2024-01-21T21:34:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68753.log 2024-01-21T21:34:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68753.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68753.log.gz 2024-01-21T21:34:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70439.log 2024-01-21T21:34:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70439.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70439.log.gz 2024-01-21T21:34:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90037.log 2024-01-21T21:34:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90037.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.90037.log.gz 2024-01-21T21:34:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53821.log 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53821.log.gz 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81142.log 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81142.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81142.log.gz 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104789.log 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104789.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104789.log.gz 2024-01-21T21:34:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53634.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48119.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77752.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77752.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77752.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78043.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78043.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78043.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48738.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48738.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48738.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54561.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54561.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54561.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103762.log 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103762.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103762.log.gz 2024-01-21T21:34:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74568.log 2024-01-21T21:34:21.862 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74568.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.74568.log.gz 2024-01-21T21:34:21.862 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2024-01-21T21:34:21.862 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51624.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz 2024-01-21T21:34:21.862 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2024-01-21T21:34:21.862 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54423.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54423.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54423.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103330.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.103330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103330.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48349.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74474.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74474.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74474.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77522.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77522.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.77522.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71405.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71405.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71405.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70908.log 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70908.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70908.log.gz 2024-01-21T21:34:21.863 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56015.log 2024-01-21T21:34:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56015.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56015.log.gz 2024-01-21T21:34:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67738.log 2024-01-21T21:34:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67738.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67738.log.gz 2024-01-21T21:34:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63258.log 2024-01-21T21:34:21.873 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63258.log.gz 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58516.log 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58516.log.gz 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80832.log 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80832.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80832.log.gz 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69123.log 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69123.log.gz 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43800.log 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43800.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43800.log.gz 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68707.log 2024-01-21T21:34:21.874 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68707.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68707.log.gz 2024-01-21T21:34:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81756.log 2024-01-21T21:34:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81756.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.81756.log.gz 2024-01-21T21:34:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90600.log 2024-01-21T21:34:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90600.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.90600.log.gz 2024-01-21T21:34:21.875 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60968.log 2024-01-21T21:34:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.60968.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60968.log.gz 2024-01-21T21:34:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48257.log 2024-01-21T21:34:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48257.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48257.log.gz 2024-01-21T21:34:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74081.log 2024-01-21T21:34:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74081.log.gz 2024-01-21T21:34:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89129.log 2024-01-21T21:34:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89129.log.gz 2024-01-21T21:34:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74522.log 2024-01-21T21:34:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74522.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74522.log.gz 2024-01-21T21:34:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2024-01-21T21:34:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54099.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 2024-01-21T21:34:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70678.log 2024-01-21T21:34:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70678.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70678.log.gz 2024-01-21T21:34:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75120.log 2024-01-21T21:34:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75120.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75120.log.gz 2024-01-21T21:34:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102682.log 2024-01-21T21:34:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102682.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102682.log.gz 2024-01-21T21:34:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93629.log 2024-01-21T21:34:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.93629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.93629.log.gz 2024-01-21T21:34:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104303.log 2024-01-21T21:34:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104303.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104303.log.gz 2024-01-21T21:34:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53772.log 2024-01-21T21:34:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53772.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53772.log.gz 2024-01-21T21:34:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58210.log 2024-01-21T21:34:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58210.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58210.log.gz 2024-01-21T21:34:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96703.log 2024-01-21T21:34:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96703.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96703.log.gz 2024-01-21T21:34:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50788.log 2024-01-21T21:34:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.50788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50788.log.gz 2024-01-21T21:34:21.896 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-21T21:34:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-21T21:34:21.903 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53542.log 2024-01-21T21:34:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53542.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53542.log.gz 2024-01-21T21:34:21.904 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92824.log 2024-01-21T21:34:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92824.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92824.log.gz 2024-01-21T21:34:21.905 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74288.log 2024-01-21T21:34:21.906 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74288.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74288.log.gz 2024-01-21T21:34:21.906 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93119.log 2024-01-21T21:34:21.907 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93119.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93119.log.gz 2024-01-21T21:34:21.907 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81234.log 2024-01-21T21:34:21.908 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81234.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.81234.log.gz 2024-01-21T21:34:21.909 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2024-01-21T21:34:21.912 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52040.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2024-01-21T21:34:21.912 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54007.log 2024-01-21T21:34:21.913 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54007.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54007.log.gz 2024-01-21T21:34:21.913 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73338.log 2024-01-21T21:34:21.914 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73338.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.73338.log.gz 2024-01-21T21:34:21.914 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67646.log 2024-01-21T21:34:21.915 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67646.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67646.log.gz 2024-01-21T21:34:21.916 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98721.log 2024-01-21T21:34:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98721.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98721.log.gz 2024-01-21T21:34:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74242.log 2024-01-21T21:34:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74242.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74242.log.gz 2024-01-21T21:34:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-01-21T21:34:21.919 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53266.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-01-21T21:34:21.919 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67692.log 2024-01-21T21:34:21.920 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67692.log.gz 2024-01-21T21:34:21.920 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82813.log 2024-01-21T21:34:21.921 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82813.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.82813.log.gz 2024-01-21T21:34:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77660.log 2024-01-21T21:34:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77660.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77660.log.gz 2024-01-21T21:34:21.923 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72343.log 2024-01-21T21:34:21.924 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.72343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.72343.log.gz 2024-01-21T21:34:21.924 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52838.log 2024-01-21T21:34:21.925 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52838.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52838.log.gz 2024-01-21T21:34:21.925 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103427.log 2024-01-21T21:34:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103427.log.gz 2024-01-21T21:34:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70770.log 2024-01-21T21:34:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70770.log.gz 2024-01-21T21:34:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69591.log 2024-01-21T21:34:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69591.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69591.log.gz 2024-01-21T21:34:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69992.log 2024-01-21T21:34:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69992.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69992.log.gz 2024-01-21T21:34:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104645.log 2024-01-21T21:34:21.931 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104645.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104645.log.gz 2024-01-21T21:34:21.931 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2024-01-21T21:34:21.932 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52884.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2024-01-21T21:34:21.932 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88101.log 2024-01-21T21:34:21.933 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88101.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.88101.log.gz 2024-01-21T21:34:21.933 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68845.log 2024-01-21T21:34:21.934 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68845.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68845.log.gz 2024-01-21T21:34:21.934 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82627.log 2024-01-21T21:34:21.935 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82627.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.82627.log.gz 2024-01-21T21:34:21.935 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103855.log 2024-01-21T21:34:21.936 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103855.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103855.log.gz 2024-01-21T21:34:21.937 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49528.log 2024-01-21T21:34:21.938 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49528.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49528.log.gz 2024-01-21T21:34:21.938 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67141.log 2024-01-21T21:34:21.939 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67141.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67141.log.gz 2024-01-21T21:34:21.939 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83281.log 2024-01-21T21:34:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83281.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.83281.log.gz 2024-01-21T21:34:21.940 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87947.log 2024-01-21T21:34:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.87947.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.87947.log.gz 2024-01-21T21:34:21.941 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67091.log 2024-01-21T21:34:21.942 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67091.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67091.log.gz 2024-01-21T21:34:21.942 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88444.log 2024-01-21T21:34:21.943 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88444.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88444.log.gz 2024-01-21T21:34:21.943 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57504.log 2024-01-21T21:34:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57504.log.gz 2024-01-21T21:34:21.945 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97553.log 2024-01-21T21:34:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97553.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97553.log.gz 2024-01-21T21:34:21.946 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81418.log 2024-01-21T21:34:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81418.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81418.log.gz 2024-01-21T21:34:21.947 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89379.log 2024-01-21T21:34:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89379.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89379.log.gz 2024-01-21T21:34:21.948 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48165.log 2024-01-21T21:34:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48165.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48165.log.gz 2024-01-21T21:34:21.949 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81326.log 2024-01-21T21:34:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81326.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81326.log.gz 2024-01-21T21:34:21.950 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90175.log 2024-01-21T21:34:21.951 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90175.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90175.log.gz 2024-01-21T21:34:21.952 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63350.log 2024-01-21T21:34:21.955 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63350.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63350.log.gz 2024-01-21T21:34:21.956 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53043.log 2024-01-21T21:34:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53043.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53043.log.gz 2024-01-21T21:34:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96979.log 2024-01-21T21:34:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96979.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96979.log.gz 2024-01-21T21:34:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103941.log 2024-01-21T21:34:21.957 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103941.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103941.log.gz 2024-01-21T21:34:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88297.log 2024-01-21T21:34:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88297.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88297.log.gz 2024-01-21T21:34:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82535.log 2024-01-21T21:34:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82535.log.gz 2024-01-21T21:34:21.958 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63534.log 2024-01-21T21:34:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63534.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.63534.log.gz 2024-01-21T21:34:21.960 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57768.log 2024-01-21T21:34:21.961 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57768.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57768.log.gz 2024-01-21T21:34:21.961 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55008.log 2024-01-21T21:34:21.962 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55008.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55008.log.gz 2024-01-21T21:34:21.963 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71971.log 2024-01-21T21:34:21.964 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71971.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71971.log.gz 2024-01-21T21:34:21.964 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78503.log 2024-01-21T21:34:21.965 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78503.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.78503.log.gz 2024-01-21T21:34:21.965 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74752.log 2024-01-21T21:34:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74752.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74752.log.gz 2024-01-21T21:34:21.966 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70294.log 2024-01-21T21:34:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70294.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70294.log.gz 2024-01-21T21:34:21.967 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63865.log 2024-01-21T21:34:21.968 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63865.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63865.log.gz 2024-01-21T21:34:21.969 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96657.log 2024-01-21T21:34:21.969 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96657.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96657.log.gz 2024-01-21T21:34:21.970 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2024-01-21T21:34:21.971 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55098.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2024-01-21T21:34:21.971 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50821.log 2024-01-21T21:34:21.972 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50821.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50821.log.gz 2024-01-21T21:34:21.972 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102164.log 2024-01-21T21:34:21.973 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102164.log.gz 2024-01-21T21:34:21.973 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91668.log 2024-01-21T21:34:21.974 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91668.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.91668.log.gz 2024-01-21T21:34:21.974 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60662.log 2024-01-21T21:34:21.975 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.60662.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60662.log.gz 2024-01-21T21:34:21.975 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89333.log 2024-01-21T21:34:21.976 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89333.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89333.log.gz 2024-01-21T21:34:21.976 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59742.log 2024-01-21T21:34:21.977 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.59742.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59742.log.gz 2024-01-21T21:34:21.978 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52270.log 2024-01-21T21:34:21.979 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52270.log.gz 2024-01-21T21:34:21.979 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2024-01-21T21:34:21.980 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52562.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2024-01-21T21:34:21.980 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77274.log 2024-01-21T21:34:21.981 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77274.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.77274.log.gz 2024-01-21T21:34:21.981 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103809.log 2024-01-21T21:34:21.982 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103809.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103809.log.gz 2024-01-21T21:34:21.982 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96250.log 2024-01-21T21:34:21.983 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96250.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96250.log.gz 2024-01-21T21:34:21.984 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63981.log 2024-01-21T21:34:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63981.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63981.log.gz 2024-01-21T21:34:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71313.log 2024-01-21T21:34:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71313.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71313.log.gz 2024-01-21T21:34:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48922.log 2024-01-21T21:34:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48922.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48922.log.gz 2024-01-21T21:34:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70632.log 2024-01-21T21:34:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70632.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70632.log.gz 2024-01-21T21:34:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49988.log 2024-01-21T21:34:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49988.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49988.log.gz 2024-01-21T21:34:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69944.log 2024-01-21T21:34:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69944.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69944.log.gz 2024-01-21T21:34:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78880.log 2024-01-21T21:34:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78880.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78880.log.gz 2024-01-21T21:34:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82305.log 2024-01-21T21:34:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82305.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82305.log.gz 2024-01-21T21:34:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104450.log 2024-01-21T21:34:21.994 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104450.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.104450.log.gz 2024-01-21T21:34:21.994 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71787.log 2024-01-21T21:34:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71787.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71787.log.gz 2024-01-21T21:34:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76291.log 2024-01-21T21:34:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76291.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.76291.log.gz 2024-01-21T21:34:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105894.log 2024-01-21T21:34:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105894.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105894.log.gz 2024-01-21T21:34:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76931.log 2024-01-21T21:34:21.998 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76931.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76931.log.gz 2024-01-21T21:34:21.999 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2024-01-21T21:34:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49896.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2024-01-21T21:34:22.000 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69075.log 2024-01-21T21:34:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69075.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69075.log.gz 2024-01-21T21:34:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47470.log 2024-01-21T21:34:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47470.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47470.log.gz 2024-01-21T21:34:22.002 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76689.log 2024-01-21T21:34:22.003 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76689.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.76689.log.gz 2024-01-21T21:34:22.004 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82065.log 2024-01-21T21:34:22.005 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82065.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82065.log.gz 2024-01-21T21:34:22.005 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72940.log 2024-01-21T21:34:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72940.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72940.log.gz 2024-01-21T21:34:22.006 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54283.log 2024-01-21T21:34:22.007 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54283.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54283.log.gz 2024-01-21T21:34:22.007 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55807.log 2024-01-21T21:34:22.008 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55807.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55807.log.gz 2024-01-21T21:34:22.008 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47747.log 2024-01-21T21:34:22.009 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47747.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47747.log.gz 2024-01-21T21:34:22.009 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2024-01-21T21:34:22.011 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49758.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2024-01-21T21:34:22.011 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55518.log 2024-01-21T21:34:22.012 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55518.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55518.log.gz 2024-01-21T21:34:22.012 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88836.log 2024-01-21T21:34:22.013 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88836.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88836.log.gz 2024-01-21T21:34:22.013 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47701.log 2024-01-21T21:34:22.014 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47701.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47701.log.gz 2024-01-21T21:34:22.014 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97860.log 2024-01-21T21:34:22.015 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97860.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97860.log.gz 2024-01-21T21:34:22.015 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75260.log 2024-01-21T21:34:22.016 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75260.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75260.log.gz 2024-01-21T21:34:22.016 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2024-01-21T21:34:22.017 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51994.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2024-01-21T21:34:22.018 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76058.log 2024-01-21T21:34:22.019 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76058.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.76058.log.gz 2024-01-21T21:34:22.019 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60355.log 2024-01-21T21:34:22.020 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.60355.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60355.log.gz 2024-01-21T21:34:22.020 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92544.log 2024-01-21T21:34:22.021 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92544.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.92544.log.gz 2024-01-21T21:34:22.021 INFO:teuthology.orchestra.run.smithi133.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-21T21:34:22.021 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100932.log 2024-01-21T21:34:22.022 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100932.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.100932.log.gz 2024-01-21T21:34:22.022 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69522.log 2024-01-21T21:34:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69522.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.69522.log.gz 2024-01-21T21:34:22.024 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89853.log 2024-01-21T21:34:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74936.log 2024-01-21T21:34:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89853.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89853.log.gz 2024-01-21T21:34:22.027 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96152.log 2024-01-21T21:34:22.028 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74936.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.74936.log.gz 2024-01-21T21:34:22.029 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96152.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96152.log.gz 2024-01-21T21:34:22.029 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101850.log 2024-01-21T21:34:22.030 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-01-21T21:34:22.030 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101850.log: /var/log/ceph/ceph-client.admin.55968.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101850.log.gz 2024-01-21T21:34:22.030 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-01-21T21:34:22.030 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89899.log 2024-01-21T21:34:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89899.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89899.log.gz 2024-01-21T21:34:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102360.log 2024-01-21T21:34:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102360.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102360.log.gz 2024-01-21T21:34:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102118.log 2024-01-21T21:34:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102118.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102118.log.gz 2024-01-21T21:34:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88882.log 2024-01-21T21:34:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88882.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88882.log.gz 2024-01-21T21:34:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77614.log 2024-01-21T21:34:22.035 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77614.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.77614.log.gz 2024-01-21T21:34:22.035 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49114.log 2024-01-21T21:34:22.036 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49114.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49114.log.gz 2024-01-21T21:34:22.036 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82443.log 2024-01-21T21:34:22.037 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82443.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.82443.log.gz 2024-01-21T21:34:22.037 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-01-21T21:34:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70390.log 2024-01-21T21:34:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48876.log: /var/log/ceph/ceph-client.admin.70390.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-01-21T21:34:22.039 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70390.log.gz 2024-01-21T21:34:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57834.log 2024-01-21T21:34:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57834.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57834.log.gz 2024-01-21T21:34:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58822.log 2024-01-21T21:34:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53450.log 2024-01-21T21:34:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58822.log: /var/log/ceph/ceph-client.admin.53450.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58822.log.gz 2024-01-21T21:34:22.041 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53450.log.gz 2024-01-21T21:34:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102958.log 2024-01-21T21:34:22.043 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102958.log.gz 2024-01-21T21:34:22.043 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57702.log 2024-01-21T21:34:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57702.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57702.log.gz 2024-01-21T21:34:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68937.log 2024-01-21T21:34:22.045 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68937.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68937.log.gz 2024-01-21T21:34:22.045 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2024-01-21T21:34:22.046 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53961.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2024-01-21T21:34:22.046 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102912.log 2024-01-21T21:34:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102912.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102912.log.gz 2024-01-21T21:34:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48830.log 2024-01-21T21:34:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48830.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48830.log.gz 2024-01-21T21:34:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95397.log 2024-01-21T21:34:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70816.log 2024-01-21T21:34:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95397.log: /var/log/ceph/ceph-client.admin.70816.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95397.log.gz 2024-01-21T21:34:22.049 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70816.log.gz 2024-01-21T21:34:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86564.log 2024-01-21T21:34:22.051 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.86564.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86564.log.gz 2024-01-21T21:34:22.051 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76739.log 2024-01-21T21:34:22.052 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76739.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.76739.log.gz 2024-01-21T21:34:22.052 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47424.log 2024-01-21T21:34:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47424.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47424.log.gz 2024-01-21T21:34:22.053 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83142.log 2024-01-21T21:34:22.054 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83142.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83142.log.gz 2024-01-21T21:34:22.054 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72394.log 2024-01-21T21:34:22.055 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47339.log 2024-01-21T21:34:22.055 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72394.log: /var/log/ceph/ceph-client.admin.47339.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72394.log.gz 2024-01-21T21:34:22.055 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47339.log.gz 2024-01-21T21:34:22.055 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91929.log 2024-01-21T21:34:22.056 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91929.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91929.log.gz 2024-01-21T21:34:22.056 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105710.log 2024-01-21T21:34:22.057 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105710.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105710.log.gz 2024-01-21T21:34:22.057 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104835.log 2024-01-21T21:34:22.058 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104835.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104835.log.gz 2024-01-21T21:34:22.058 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97607.log 2024-01-21T21:34:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2024-01-21T21:34:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97607.log: /var/log/ceph/ceph-client.admin.47889.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97607.log.gz 2024-01-21T21:34:22.060 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2024-01-21T21:34:22.060 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100590.log 2024-01-21T21:34:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100590.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100590.log.gz 2024-01-21T21:34:22.061 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76104.log 2024-01-21T21:34:22.062 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76104.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.76104.log.gz 2024-01-21T21:34:22.062 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62876.log 2024-01-21T21:34:22.063 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62876.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62876.log.gz 2024-01-21T21:34:22.063 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78411.log 2024-01-21T21:34:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78411.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.78411.log.gz 2024-01-21T21:34:22.064 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57966.log 2024-01-21T21:34:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57966.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57966.log.gz 2024-01-21T21:34:22.065 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-01-21T21:34:22.066 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47203.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-01-21T21:34:22.066 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83477.log 2024-01-21T21:34:22.067 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83477.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.83477.log.gz 2024-01-21T21:34:22.067 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75166.log 2024-01-21T21:34:22.068 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75166.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.75166.log.gz 2024-01-21T21:34:22.068 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105480.log 2024-01-21T21:34:22.069 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105480.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105480.log.gz 2024-01-21T21:34:22.069 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62261.log 2024-01-21T21:34:22.070 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62261.log.gz 2024-01-21T21:34:22.070 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98136.log 2024-01-21T21:34:22.071 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98136.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98136.log.gz 2024-01-21T21:34:22.071 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77849.log 2024-01-21T21:34:22.072 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77849.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.77849.log.gz 2024-01-21T21:34:22.072 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67190.log 2024-01-21T21:34:22.073 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67190.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67190.log.gz 2024-01-21T21:34:22.073 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92322.log 2024-01-21T21:34:22.074 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92322.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.92322.log.gz 2024-01-21T21:34:22.074 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71879.log 2024-01-21T21:34:22.075 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71879.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71879.log.gz 2024-01-21T21:34:22.075 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95285.log 2024-01-21T21:34:22.076 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95285.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95285.log.gz 2024-01-21T21:34:22.076 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106328.log 2024-01-21T21:34:22.077 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106328.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106328.log.gz 2024-01-21T21:34:22.077 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98790.log 2024-01-21T21:34:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98790.log.gz 2024-01-21T21:34:22.078 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102774.log 2024-01-21T21:34:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102774.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102774.log.gz 2024-01-21T21:34:22.079 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67434.log 2024-01-21T21:34:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67434.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67434.log.gz 2024-01-21T21:34:22.080 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54191.log 2024-01-21T21:34:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54191.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54191.log.gz 2024-01-21T21:34:22.081 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73044.log 2024-01-21T21:34:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73044.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73044.log.gz 2024-01-21T21:34:22.082 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102820.log 2024-01-21T21:34:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102820.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102820.log.gz 2024-01-21T21:34:22.083 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92113.log 2024-01-21T21:34:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92113.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92113.log.gz 2024-01-21T21:34:22.084 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89521.log 2024-01-21T21:34:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89521.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89521.log.gz 2024-01-21T21:34:22.085 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53680.log 2024-01-21T21:34:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53680.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53680.log.gz 2024-01-21T21:34:22.086 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68214.log 2024-01-21T21:34:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68214.log.gz 2024-01-21T21:34:22.087 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75492.log 2024-01-21T21:34:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.75492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.75492.log.gz 2024-01-21T21:34:22.088 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73691.log 2024-01-21T21:34:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73691.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73691.log.gz 2024-01-21T21:34:22.089 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101029.log 2024-01-21T21:34:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101029.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101029.log.gz 2024-01-21T21:34:22.090 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63304.log 2024-01-21T21:34:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63304.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63304.log.gz 2024-01-21T21:34:22.091 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67784.log 2024-01-21T21:34:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98044.log 2024-01-21T21:34:22.092 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67784.log: /var/log/ceph/ceph-client.admin.98044.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67784.log.gz 2024-01-21T21:34:22.093 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98044.log.gz 2024-01-21T21:34:22.093 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91297.log 2024-01-21T21:34:22.094 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91297.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91297.log.gz 2024-01-21T21:34:22.094 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77903.log 2024-01-21T21:34:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77903.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.77903.log.gz 2024-01-21T21:34:22.095 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79065.log 2024-01-21T21:34:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.79065.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79065.log.gz 2024-01-21T21:34:22.096 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98228.log 2024-01-21T21:34:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98228.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98228.log.gz 2024-01-21T21:34:22.097 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81710.log 2024-01-21T21:34:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81710.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81710.log.gz 2024-01-21T21:34:22.099 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91522.log 2024-01-21T21:34:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49574.log 2024-01-21T21:34:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91522.log: /var/log/ceph/ceph-client.admin.49574.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.91522.log.gz 2024-01-21T21:34:22.100 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49574.log.gz 2024-01-21T21:34:22.100 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67239.log 2024-01-21T21:34:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67239.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67239.log.gz 2024-01-21T21:34:22.102 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74798.log 2024-01-21T21:34:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74798.log.gz 2024-01-21T21:34:22.103 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92251.log 2024-01-21T21:34:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92251.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92251.log.gz 2024-01-21T21:34:22.104 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104596.log 2024-01-21T21:34:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104596.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104596.log.gz 2024-01-21T21:34:22.105 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48533.log 2024-01-21T21:34:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48533.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48533.log.gz 2024-01-21T21:34:22.106 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62738.log 2024-01-21T21:34:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75212.log 2024-01-21T21:34:22.107 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62738.log: /var/log/ceph/ceph-client.admin.75212.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62738.log.gz 2024-01-21T21:34:22.108 INFO:teuthology.orchestra.run.smithi133.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.75212.log.gz 2024-01-21T21:34:22.108 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100729.log 2024-01-21T21:34:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100729.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100729.log.gz 2024-01-21T21:34:22.109 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54938.log 2024-01-21T21:34:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80434.log 2024-01-21T21:34:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54938.log: /var/log/ceph/ceph-client.admin.80434.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54938.log.gz 2024-01-21T21:34:22.110 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.80434.log.gz 2024-01-21T21:34:22.110 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89621.log 2024-01-21T21:34:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89621.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89621.log.gz 2024-01-21T21:34:22.112 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97364.log 2024-01-21T21:34:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97364.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97364.log.gz 2024-01-21T21:34:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48600.log 2024-01-21T21:34:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48600.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2024-01-21T21:34:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49712.log 2024-01-21T21:34:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49712.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49712.log.gz 2024-01-21T21:34:22.115 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72111.log 2024-01-21T21:34:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72111.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72111.log.gz 2024-01-21T21:34:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54892.log 2024-01-21T21:34:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54892.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54892.log.gz 2024-01-21T21:34:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92879.log 2024-01-21T21:34:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.92879.log.gz 2024-01-21T21:34:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2024-01-21T21:34:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49482.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2024-01-21T21:34:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103050.log 2024-01-21T21:34:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103050.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.103050.log.gz 2024-01-21T21:34:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.98554.log 2024-01-21T21:34:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.98554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.98554.log.gz 2024-01-21T21:34:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47516.log 2024-01-21T21:34:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87758.log 2024-01-21T21:34:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47516.log: /var/log/ceph/ceph-client.admin.87758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47516.log.gz 2024-01-21T21:34:22.123 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87758.log.gz 2024-01-21T21:34:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68661.log 2024-01-21T21:34:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68661.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68661.log.gz 2024-01-21T21:34:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55314.log 2024-01-21T21:34:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55314.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55314.log.gz 2024-01-21T21:34:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62353.log 2024-01-21T21:34:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62353.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62353.log.gz 2024-01-21T21:34:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53588.log 2024-01-21T21:34:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53588.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53588.log.gz 2024-01-21T21:34:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56352.log 2024-01-21T21:34:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56352.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56352.log.gz 2024-01-21T21:34:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-01-21T21:34:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63814.log 2024-01-21T21:34:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52700.log: /var/log/ceph/ceph-client.0.63814.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2024-01-21T21:34:22.130 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63814.log.gz 2024-01-21T21:34:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52424.log 2024-01-21T21:34:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52424.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52424.log.gz 2024-01-21T21:34:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70724.log 2024-01-21T21:34:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70724.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70724.log.gz 2024-01-21T21:34:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-01-21T21:34:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43672.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-01-21T21:34:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90996.log 2024-01-21T21:34:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90996.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.90996.log.gz 2024-01-21T21:34:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-01-21T21:34:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43363.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-01-21T21:34:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97410.log 2024-01-21T21:34:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97410.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97410.log.gz 2024-01-21T21:34:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73991.log 2024-01-21T21:34:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-21T21:34:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73991.log: /var/log/ceph/ceph-mgr.y.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.73991.log.gz 2024-01-21T21:34:22.145 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77023.log 2024-01-21T21:34:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77023.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.77023.log.gz 2024-01-21T21:34:22.146 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58164.log 2024-01-21T21:34:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58164.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58164.log.gz 2024-01-21T21:34:22.147 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57570.log 2024-01-21T21:34:22.148 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57570.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57570.log.gz 2024-01-21T21:34:22.149 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76543.log 2024-01-21T21:34:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76543.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.76543.log.gz 2024-01-21T21:34:22.150 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2024-01-21T21:34:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49344.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2024-01-21T21:34:22.151 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78135.log 2024-01-21T21:34:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78135.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.78135.log.gz 2024-01-21T21:34:22.152 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92728.log 2024-01-21T21:34:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92728.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92728.log.gz 2024-01-21T21:34:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72440.log 2024-01-21T21:34:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72440.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72440.log.gz 2024-01-21T21:34:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71024.log 2024-01-21T21:34:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71024.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71024.log.gz 2024-01-21T21:34:22.155 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73437.log 2024-01-21T21:34:22.156 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73437.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73437.log.gz 2024-01-21T21:34:22.157 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96446.log 2024-01-21T21:34:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96446.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96446.log.gz 2024-01-21T21:34:22.158 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106078.log 2024-01-21T21:34:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106078.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106078.log.gz 2024-01-21T21:34:22.159 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105342.log 2024-01-21T21:34:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105342.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105342.log.gz 2024-01-21T21:34:22.160 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72017.log 2024-01-21T21:34:22.163 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72017.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72017.log.gz 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78319.log 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78319.log.gz 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49666.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89473.log 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89473.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.89473.log.gz 2024-01-21T21:34:22.164 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71601.log 2024-01-21T21:34:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71601.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.71601.log.gz 2024-01-21T21:34:22.166 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82259.log 2024-01-21T21:34:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82259.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.82259.log.gz 2024-01-21T21:34:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90269.log 2024-01-21T21:34:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90269.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.90269.log.gz 2024-01-21T21:34:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89195.log 2024-01-21T21:34:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89195.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89195.log.gz 2024-01-21T21:34:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75074.log 2024-01-21T21:34:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75074.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75074.log.gz 2024-01-21T21:34:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76593.log 2024-01-21T21:34:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76593.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.76593.log.gz 2024-01-21T21:34:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68289.log 2024-01-21T21:34:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68289.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68289.log.gz 2024-01-21T21:34:22.173 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70342.log 2024-01-21T21:34:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70342.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70342.log.gz 2024-01-21T21:34:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61958.log 2024-01-21T21:34:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61958.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61958.log.gz 2024-01-21T21:34:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96795.log 2024-01-21T21:34:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96795.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96795.log.gz 2024-01-21T21:34:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81948.log 2024-01-21T21:34:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81948.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.81948.log.gz 2024-01-21T21:34:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105664.log 2024-01-21T21:34:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105664.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105664.log.gz 2024-01-21T21:34:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106282.log 2024-01-21T21:34:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106282.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106282.log.gz 2024-01-21T21:34:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71499.log 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71499.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71499.log.gz 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76788.log 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76788.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.76788.log.gz 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104927.log 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104927.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104927.log.gz 2024-01-21T21:34:22.183 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78996.log 2024-01-21T21:34:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.78996.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.78996.log.gz 2024-01-21T21:34:22.184 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62830.log 2024-01-21T21:34:22.185 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62830.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62830.log.gz 2024-01-21T21:34:22.186 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80587.log 2024-01-21T21:34:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80587.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80587.log.gz 2024-01-21T21:34:22.187 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68799.log 2024-01-21T21:34:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68799.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68799.log.gz 2024-01-21T21:34:22.188 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77344.log 2024-01-21T21:34:22.189 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77344.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.77344.log.gz 2024-01-21T21:34:22.189 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50304.log 2024-01-21T21:34:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50304.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50304.log.gz 2024-01-21T21:34:22.190 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63118.log 2024-01-21T21:34:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63118.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63118.log.gz 2024-01-21T21:34:22.191 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.51251.log 2024-01-21T21:34:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.2.51251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.51251.log.gz 2024-01-21T21:34:22.192 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71359.log 2024-01-21T21:34:22.193 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71359.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71359.log.gz 2024-01-21T21:34:22.193 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102728.log 2024-01-21T21:34:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102728.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102728.log.gz 2024-01-21T21:34:22.194 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89575.log 2024-01-21T21:34:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89575.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89575.log.gz 2024-01-21T21:34:22.196 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105848.log 2024-01-21T21:34:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105848.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105848.log.gz 2024-01-21T21:34:22.197 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77136.log 2024-01-21T21:34:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.77136.log.gz 2024-01-21T21:34:22.198 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90684.log 2024-01-21T21:34:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90684.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.90684.log.gz 2024-01-21T21:34:22.199 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63072.log 2024-01-21T21:34:22.200 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63072.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63072.log.gz 2024-01-21T21:34:22.200 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102312.log 2024-01-21T21:34:22.201 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102312.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102312.log.gz 2024-01-21T21:34:22.201 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81902.log 2024-01-21T21:34:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81902.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.81902.log.gz 2024-01-21T21:34:22.203 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96102.log 2024-01-21T21:34:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96102.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.96102.log.gz 2024-01-21T21:34:22.204 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98605.log 2024-01-21T21:34:22.205 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98605.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98605.log.gz 2024-01-21T21:34:22.205 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61713.log 2024-01-21T21:34:22.206 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61713.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61713.log.gz 2024-01-21T21:34:22.206 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88606.log 2024-01-21T21:34:22.207 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88606.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88606.log.gz 2024-01-21T21:34:22.208 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64050.log 2024-01-21T21:34:22.208 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.64050.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64050.log.gz 2024-01-21T21:34:22.209 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68983.log 2024-01-21T21:34:22.210 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68983.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68983.log.gz 2024-01-21T21:34:22.210 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80734.log 2024-01-21T21:34:22.211 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80734.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.80734.log.gz 2024-01-21T21:34:22.211 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-01-21T21:34:22.212 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51762.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-01-21T21:34:22.212 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91620.log 2024-01-21T21:34:22.213 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91620.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.91620.log.gz 2024-01-21T21:34:22.213 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80637.log 2024-01-21T21:34:22.214 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.80637.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80637.log.gz 2024-01-21T21:34:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78829.log 2024-01-21T21:34:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.78829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.78829.log.gz 2024-01-21T21:34:22.215 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90221.log 2024-01-21T21:34:22.217 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90221.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.90221.log.gz 2024-01-21T21:34:22.217 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97952.log 2024-01-21T21:34:22.218 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97952.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97952.log.gz 2024-01-21T21:34:22.218 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90083.log 2024-01-21T21:34:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90083.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.90083.log.gz 2024-01-21T21:34:22.219 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-01-21T21:34:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51348.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-01-21T21:34:22.220 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63018.log 2024-01-21T21:34:22.222 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63018.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63018.log.gz 2024-01-21T21:34:22.222 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69406.log 2024-01-21T21:34:22.223 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69406.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69406.log.gz 2024-01-21T21:34:22.223 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73242.log 2024-01-21T21:34:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.73242.log.gz 2024-01-21T21:34:22.224 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72559.log 2024-01-21T21:34:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72559.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.72559.log.gz 2024-01-21T21:34:22.225 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68615.log 2024-01-21T21:34:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.68615.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68615.log.gz 2024-01-21T21:34:22.226 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67035.log 2024-01-21T21:34:22.227 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67035.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67035.log.gz 2024-01-21T21:34:22.228 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92979.log 2024-01-21T21:34:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92979.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.92979.log.gz 2024-01-21T21:34:22.229 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57182.log 2024-01-21T21:34:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57182.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57182.log.gz 2024-01-21T21:34:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56305.log 2024-01-21T21:34:22.231 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56305.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56305.log.gz 2024-01-21T21:34:22.231 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64293.log 2024-01-21T21:34:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.64293.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64293.log.gz 2024-01-21T21:34:22.232 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74426.log 2024-01-21T21:34:22.233 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74426.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74426.log.gz 2024-01-21T21:34:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95950.log 2024-01-21T21:34:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95950.log.gz 2024-01-21T21:34:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-01-21T21:34:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48395.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-01-21T21:34:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88790.log 2024-01-21T21:34:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88790.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88790.log.gz 2024-01-21T21:34:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96887.log 2024-01-21T21:34:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96887.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96887.log.gz 2024-01-21T21:34:22.238 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96749.log 2024-01-21T21:34:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96749.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96749.log.gz 2024-01-21T21:34:22.239 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104400.log 2024-01-21T21:34:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104400.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104400.log.gz 2024-01-21T21:34:22.240 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61462.log 2024-01-21T21:34:22.241 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61462.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61462.log.gz 2024-01-21T21:34:22.242 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48487.log 2024-01-21T21:34:22.243 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48487.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48487.log.gz 2024-01-21T21:34:22.243 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71221.log 2024-01-21T21:34:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71221.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71221.log.gz 2024-01-21T21:34:22.244 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105940.log 2024-01-21T21:34:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105940.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.105940.log.gz 2024-01-21T21:34:22.245 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49014.log 2024-01-21T21:34:22.246 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49014.log.gz 2024-01-21T21:34:22.319 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-21T21:34:22.561 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-21T21:34:22.691 INFO:teuthology.orchestra.run.smithi178.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-21T21:34:23.142 INFO:teuthology.orchestra.run.smithi178.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-21T21:34:23.760 INFO:teuthology.orchestra.run.smithi133.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-21T21:34:24.066 INFO:teuthology.orchestra.run.smithi178.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-21T21:34:24.100 INFO:teuthology.orchestra.run.smithi178.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-21T21:34:24.173 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-21T21:34:24.232 INFO:teuthology.orchestra.run.smithi133.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-21T21:34:24.238 INFO:teuthology.orchestra.run.smithi178.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-21T21:34:24.240 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-01-21T21:34:24.240 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m2.636s 2024-01-21T21:34:24.240 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m13.034s 2024-01-21T21:34:24.240 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m0.493s 2024-01-21T21:34:24.434 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-21T21:34:24.549 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-21T21:34:24.562 INFO:teuthology.orchestra.run.smithi133.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-21T21:34:24.711 INFO:teuthology.orchestra.run.smithi133.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-21T21:34:24.712 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-01-21T21:34:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m3.134s 2024-01-21T21:34:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m16.649s 2024-01-21T21:34:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m0.989s 2024-01-21T21:34:24.713 INFO:tasks.ceph:Archiving logs... 2024-01-21T21:34:24.713 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi133/log 2024-01-21T21:34:24.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-21T21:34:27.431 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi178/log 2024-01-21T21:34:27.432 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-21T21:34:29.112 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-21T21:34:29.122 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-21T21:34:29.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-21T21:34:29.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-21T21:34:29.202 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-21T21:34:29.211 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-21T21:34:29.211 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T21:34:29.214 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-21T21:34:29.230 INFO:teuthology.orchestra.run.smithi133.stderr:bash: ntpq: command not found 2024-01-21T21:34:29.232 INFO:teuthology.orchestra.run.smithi178.stderr:bash: ntpq: command not found 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 242 +23us[+1515ns] +/- 74ms 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -557us[ -561us] +/- 59ms 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +836us[ +836us] +/- 92ms 2024-01-21T21:34:29.236 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 54 -34us[ -34us] +/- 77ms 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv02.front.sepia.ceph.com 3 7 377 110 -565us[ -584us] +/- 58ms 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 110 +773us[ +773us] +/- 91ms 2024-01-21T21:34:29.237 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-21T21:34:29.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-21T21:34:29.248 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-21T21:34:29.248 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-21T21:34:29.257 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-21T21:34:29.374 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-21T21:34:29.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-21T21:34:29.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:34:29.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-21T21:34:29.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:34:29.516 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-21T21:34:29.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-21T21:34:29.533 INFO:teuthology.task.internal:Duration was 6463.857316 seconds 2024-01-21T21:34:29.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-21T21:34:29.541 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-21T21:34:29.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-21T21:34:29.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-21T21:34:29.588 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-21T21:34:29.605 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-21T21:34:29.926 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-21T21:34:29.926 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-01-21T21:34:29.926 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-21T21:34:29.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-01-21T21:34:29.948 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-21T21:34:29.971 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-21T21:34:29.971 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-21T21:34:29.991 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-21T21:34:30.056 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-21T21:34:30.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-21T21:34:30.059 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-21T21:34:30.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-21T21:34:30.170 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-21T21:34:30.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-21T21:34:30.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-21T21:34:30.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-21T21:34:30.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-21T21:34:30.241 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-21T21:34:30.265 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-01-21T21:34:30.291 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-01-21T21:34:30.305 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-21T21:34:30.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:34:30.335 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-21T21:34:30.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-21T21:34:30.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-21T21:34:30.374 INFO:teuthology.task.internal:Transferring archived files... 2024-01-21T21:34:30.375 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi133 2024-01-21T21:34:30.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-21T21:34:30.423 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070/remote/smithi178 2024-01-21T21:34:30.423 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-21T21:34:30.463 INFO:teuthology.task.internal:Removing archive directory... 2024-01-21T21:34:30.463 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-21T21:34:30.466 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-21T21:34:30.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-21T21:34:30.525 INFO:teuthology.task.internal:Not uploading archives. 2024-01-21T21:34:30.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-21T21:34:30.536 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-21T21:34:30.536 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-21T21:34:30.539 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-21T21:34:30.553 INFO:teuthology.orchestra.run.smithi133.stdout: 262158 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 21 21:34 /home/ubuntu/cephtest 2024-01-21T21:34:30.570 INFO:teuthology.orchestra.run.smithi178.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 21 21:34 /home/ubuntu/cephtest 2024-01-21T21:34:30.571 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-21T21:34:30.613 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-21T21:34:30.641 INFO:teuthology.nuke:Checking targets against current locks 2024-01-21T21:34:30.666 DEBUG:teuthology.nuke:shortname: smithi133 2024-01-21T21:34:30.667 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T21:34:30.692 DEBUG:teuthology.nuke:shortname: smithi178 2024-01-21T21:34:30.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T21:34:30.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 19:40:52.476216', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA0nymZtq0wl7N3BjCPsC+43K4l1FjsZVDSaWo3ez8LK9r8VQBsn/7VbQ7knGB48HJWr1/xWNRA683XBnh90QgE='} 2024-01-21T21:34:30.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-21_16:37:18-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7525070', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 19:40:52.475093', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBwAB24ROxB5Vhyls7EaREMRAIMA8XAHx9kVobDKri2yLptvTTWljFmfXittcFFzD0ony72pOOLvWVMeGdXG8='} 2024-01-21T21:34:30.749 INFO:teuthology.orchestra.console.smithi133:Power off 2024-01-21T21:34:30.749 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T21:34:30.772 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-01-21T21:34:30.772 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:30.791 INFO:teuthology.orchestra.console.smithi178:Power off 2024-01-21T21:34:30.791 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T21:34:30.799 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-21T21:34:30.812 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-01-21T21:34:30.813 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:30.836 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-01-21T21:34:34.800 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:34.837 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:34.912 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-21T21:34:34.947 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-01-21T21:34:38.916 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:38.947 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:39.027 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-01-21T21:34:39.058 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-01-21T21:34:39.158 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-01-21T21:34:43.030 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T21:34:43.141 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-01-21T21:34:43.242 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-01-21T21:34:43.346 INFO:teuthology.run:Summary data: description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6463.857315540314 failure_reason: '"2024-01-21T20:13:10.069511+0000 mon.a (mon.0) 587 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2024-01-21T21:34:43.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T21:34:43.426 INFO:teuthology.run:FAIL